2024-09-13T16:46:10.566 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-13T16:46:10.591 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T16:46:10.697 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903855 branch: wip-rishabh-testing-20240910.100730-reef description: fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: null first_in_suite: false job_id: '7903855' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/reef ' name: rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-rishabh-testing-20240910.100730-reef ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 mon warn on pool no app: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - OSD_DOWN - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-testing-20240910.100730-reef sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 owner: scheduled_rishabh@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 6439 sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 sleep_before_teardown: 0 subset: 964/1024 suite: fs suite_branch: wip-rishabh-testing-20240910.100730-reef suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 targets: smithi115.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIZwN6Sm8xxRYYVkPa4qaQ9kY7F2gbJa2UaCUs31HrmOp/NNUlJ0qyd7fHO3dA9nH98vlYiQ5WDgrhDJum47tcA= smithi195.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNrWjsVOCwIJ2y177+iz960oqoRVfL4wHNBpGRmrixkfojFLix3nMw1AKpScvwPAhhnrdhe6Che+cmGX6hTt+H8= tasks: - install: branch: reef exclude_packages: - ceph-volume - print: '**** done install task...' - cephadm: compiled_cephadm_branch: reef conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.ceph.io/ceph-ci/ceph:reef roleless: true - print: '**** done end installing reef cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 1 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay true - cephadm.shell: host.a: - ceph fs set cephfs inline_data true --yes-i-really-really-mean-it - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - kclient: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: [] meta: {} postmerge: [] variables: fail_fs: true teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-13_14:42:16 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph versions | jq -e '.mgr | length == 1' - ceph versions | jq -e '.mgr | keys' | grep $sha1 - ceph versions | jq -e '.overall | length == 2' - ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '.up_to_date | length == 2' - ceph orch ps - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2024-09-13T16:46:10.697 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/qa; will attempt to use it 2024-09-13T16:46:10.698 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/qa/tasks 2024-09-13T16:46:10.698 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-13T16:46:10.699 INFO:teuthology.task.internal:Checking packages... 2024-09-13T16:46:10.722 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3' 2024-09-13T16:46:10.722 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T16:46:10.722 INFO:teuthology.packaging:ref: None 2024-09-13T16:46:10.722 INFO:teuthology.packaging:tag: None 2024-09-13T16:46:10.722 INFO:teuthology.packaging:branch: wip-rishabh-testing-20240910.100730-reef 2024-09-13T16:46:10.722 INFO:teuthology.packaging:sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T16:46:10.722 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-rishabh-testing-20240910.100730-reef 2024-09-13T16:46:10.880 INFO:teuthology.task.internal:Found packages for ceph version 18.2.4-860.g6c6b083f 2024-09-13T16:46:10.881 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-13T16:46:10.888 INFO:teuthology.task.internal:no buildpackages task found 2024-09-13T16:46:10.888 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-13T16:46:10.901 INFO:teuthology.task.internal:Saving configuration 2024-09-13T16:46:10.921 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-13T16:46:10.927 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-13T16:46:10.960 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi115.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903855', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 16:41:06.288213', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIZwN6Sm8xxRYYVkPa4qaQ9kY7F2gbJa2UaCUs31HrmOp/NNUlJ0qyd7fHO3dA9nH98vlYiQ5WDgrhDJum47tcA='} 2024-09-13T16:46:10.991 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi195.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903855', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 16:41:06.286471', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNrWjsVOCwIJ2y177+iz960oqoRVfL4wHNBpGRmrixkfojFLix3nMw1AKpScvwPAhhnrdhe6Che+cmGX6hTt+H8='} 2024-09-13T16:46:10.991 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-13T16:46:10.997 INFO:teuthology.task.internal:roles: ubuntu@smithi115.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2024-09-13T16:46:10.997 INFO:teuthology.task.internal:roles: ubuntu@smithi195.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2024-09-13T16:46:10.997 INFO:teuthology.run_tasks:Running task console_log... 2024-09-13T16:46:11.072 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f2079653be0>, signals=[15]) 2024-09-13T16:46:11.072 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-13T16:46:11.080 INFO:teuthology.task.internal:Opening connections... 2024-09-13T16:46:11.080 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi115.front.sepia.ceph.com 2024-09-13T16:46:11.082 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T16:46:11.184 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi195.front.sepia.ceph.com 2024-09-13T16:46:11.185 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T16:46:11.271 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-13T16:46:11.277 DEBUG:teuthology.orchestra.run.smithi115:> uname -m 2024-09-13T16:46:11.295 INFO:teuthology.orchestra.run.smithi115.stdout:x86_64 2024-09-13T16:46:11.296 DEBUG:teuthology.orchestra.run.smithi115:> cat /etc/os-release 2024-09-13T16:46:11.352 INFO:teuthology.orchestra.run.smithi115.stdout:NAME="CentOS Stream" 2024-09-13T16:46:11.353 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION="9" 2024-09-13T16:46:11.353 INFO:teuthology.orchestra.run.smithi115.stdout:ID="centos" 2024-09-13T16:46:11.353 INFO:teuthology.orchestra.run.smithi115.stdout:ID_LIKE="rhel fedora" 2024-09-13T16:46:11.353 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_ID="9" 2024-09-13T16:46:11.353 INFO:teuthology.orchestra.run.smithi115.stdout:PLATFORM_ID="platform:el9" 2024-09-13T16:46:11.353 INFO:teuthology.orchestra.run.smithi115.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-13T16:46:11.353 INFO:teuthology.orchestra.run.smithi115.stdout:ANSI_COLOR="0;31" 2024-09-13T16:46:11.353 INFO:teuthology.orchestra.run.smithi115.stdout:LOGO="fedora-logo-icon" 2024-09-13T16:46:11.353 INFO:teuthology.orchestra.run.smithi115.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-13T16:46:11.353 INFO:teuthology.orchestra.run.smithi115.stdout:HOME_URL="https://centos.org/" 2024-09-13T16:46:11.353 INFO:teuthology.orchestra.run.smithi115.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-13T16:46:11.353 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-13T16:46:11.353 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-13T16:46:11.354 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server 2024-09-13T16:46:11.382 DEBUG:teuthology.orchestra.run.smithi195:> uname -m 2024-09-13T16:46:11.401 INFO:teuthology.orchestra.run.smithi195.stdout:x86_64 2024-09-13T16:46:11.401 DEBUG:teuthology.orchestra.run.smithi195:> cat /etc/os-release 2024-09-13T16:46:11.459 INFO:teuthology.orchestra.run.smithi195.stdout:NAME="CentOS Stream" 2024-09-13T16:46:11.460 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION="9" 2024-09-13T16:46:11.460 INFO:teuthology.orchestra.run.smithi195.stdout:ID="centos" 2024-09-13T16:46:11.460 INFO:teuthology.orchestra.run.smithi195.stdout:ID_LIKE="rhel fedora" 2024-09-13T16:46:11.460 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_ID="9" 2024-09-13T16:46:11.460 INFO:teuthology.orchestra.run.smithi195.stdout:PLATFORM_ID="platform:el9" 2024-09-13T16:46:11.460 INFO:teuthology.orchestra.run.smithi195.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-13T16:46:11.460 INFO:teuthology.orchestra.run.smithi195.stdout:ANSI_COLOR="0;31" 2024-09-13T16:46:11.460 INFO:teuthology.orchestra.run.smithi195.stdout:LOGO="fedora-logo-icon" 2024-09-13T16:46:11.460 INFO:teuthology.orchestra.run.smithi195.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-13T16:46:11.460 INFO:teuthology.orchestra.run.smithi195.stdout:HOME_URL="https://centos.org/" 2024-09-13T16:46:11.460 INFO:teuthology.orchestra.run.smithi195.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-13T16:46:11.460 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-13T16:46:11.460 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-13T16:46:11.461 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server 2024-09-13T16:46:11.494 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-13T16:46:11.503 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-13T16:46:11.509 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-13T16:46:11.509 DEBUG:teuthology.orchestra.run.smithi115:> test '!' -e /home/ubuntu/cephtest 2024-09-13T16:46:11.512 DEBUG:teuthology.orchestra.run.smithi195:> test '!' -e /home/ubuntu/cephtest 2024-09-13T16:46:11.529 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-13T16:46:11.535 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-13T16:46:11.535 DEBUG:teuthology.orchestra.run.smithi115:> test -z $(ls -A /var/lib/ceph) 2024-09-13T16:46:11.569 DEBUG:teuthology.orchestra.run.smithi195:> test -z $(ls -A /var/lib/ceph) 2024-09-13T16:46:11.673 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-13T16:46:11.734 INFO:teuthology.run_tasks:Running task kernel... 2024-09-13T16:46:11.749 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-13T16:46:11.749 INFO:teuthology.task.kernel:config {'host.a': {'kdb': 1, 'sha1': 'distro'}, 'host.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-13T16:46:11.749 DEBUG:teuthology.orchestra.run.smithi115:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T16:46:11.750 DEBUG:teuthology.orchestra.run.smithi195:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T16:46:11.766 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T16:46:11.767 DEBUG:teuthology.orchestra.run.smithi195:> uname -r 2024-09-13T16:46:11.767 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T16:46:11.768 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-09-13T16:46:11.825 INFO:teuthology.orchestra.run.smithi195.stdout:5.14.0-503.el9.x86_64 2024-09-13T16:46:11.825 INFO:teuthology.task.kernel:Running kernel on smithi195: 5.14.0-503.el9.x86_64 2024-09-13T16:46:11.826 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum install -y kernel 2024-09-13T16:46:11.827 INFO:teuthology.orchestra.run.smithi115.stdout:5.14.0-503.el9.x86_64 2024-09-13T16:46:11.827 INFO:teuthology.task.kernel:Running kernel on smithi115: 5.14.0-503.el9.x86_64 2024-09-13T16:46:11.827 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum install -y kernel 2024-09-13T16:46:15.165 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 9 - BaseOS 5.3 MB/s | 8.2 MB 00:01 2024-09-13T16:46:15.491 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS Stream 9 - BaseOS 4.3 MB/s | 8.2 MB 00:01 2024-09-13T16:46:17.383 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 9 - AppStream 19 MB/s | 20 MB 00:01 2024-09-13T16:46:19.833 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS Stream 9 - AppStream 6.3 MB/s | 20 MB 00:03 2024-09-13T16:46:22.033 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.5 MB 00:00 2024-09-13T16:46:23.792 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 9 - Extras packages 44 kB/s | 19 kB 00:00 2024-09-13T16:46:24.117 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.5 MB 00:00 2024-09-13T16:46:25.521 INFO:teuthology.orchestra.run.smithi195.stdout:Extra Packages for Enterprise Linux 14 MB/s | 23 MB 00:01 2024-09-13T16:46:25.601 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS Stream 9 - Extras packages 63 kB/s | 19 kB 00:00 2024-09-13T16:46:26.988 INFO:teuthology.orchestra.run.smithi115.stdout:Extra Packages for Enterprise Linux 18 MB/s | 23 MB 00:01 2024-09-13T16:46:30.986 INFO:teuthology.orchestra.run.smithi195.stdout:lab-extras 25 kB/s | 1.7 kB 00:00 2024-09-13T16:46:32.352 INFO:teuthology.orchestra.run.smithi115.stdout:lab-extras 14 kB/s | 1.7 kB 00:00 2024-09-13T16:46:32.993 INFO:teuthology.orchestra.run.smithi195.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-13T16:46:32.993 INFO:teuthology.orchestra.run.smithi195.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-13T16:46:33.090 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-09-13T16:46:33.099 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T16:46:33.099 INFO:teuthology.orchestra.run.smithi195.stdout: Package Architecture Version Repository Size 2024-09-13T16:46:33.099 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T16:46:33.100 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-09-13T16:46:33.100 INFO:teuthology.orchestra.run.smithi195.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-13T16:46:33.100 INFO:teuthology.orchestra.run.smithi195.stdout:Installing dependencies: 2024-09-13T16:46:33.100 INFO:teuthology.orchestra.run.smithi195.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-13T16:46:33.100 INFO:teuthology.orchestra.run.smithi195.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-13T16:46:33.100 INFO:teuthology.orchestra.run.smithi195.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-13T16:46:33.100 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:46:33.100 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-09-13T16:46:33.100 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T16:46:33.100 INFO:teuthology.orchestra.run.smithi195.stdout:Install 4 Packages 2024-09-13T16:46:33.100 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:46:33.101 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 79 M 2024-09-13T16:46:33.101 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 126 M 2024-09-13T16:46:33.101 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-09-13T16:46:33.346 INFO:teuthology.orchestra.run.smithi195.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 185 kB/s | 23 kB 00:00 2024-09-13T16:46:34.350 INFO:teuthology.orchestra.run.smithi115.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-13T16:46:34.350 INFO:teuthology.orchestra.run.smithi115.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-13T16:46:34.439 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-09-13T16:46:34.443 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T16:46:34.443 INFO:teuthology.orchestra.run.smithi115.stdout: Package Architecture Version Repository Size 2024-09-13T16:46:34.444 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T16:46:34.444 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2024-09-13T16:46:34.444 INFO:teuthology.orchestra.run.smithi115.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-13T16:46:34.444 INFO:teuthology.orchestra.run.smithi115.stdout:Installing dependencies: 2024-09-13T16:46:34.444 INFO:teuthology.orchestra.run.smithi115.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-13T16:46:34.444 INFO:teuthology.orchestra.run.smithi115.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-13T16:46:34.444 INFO:teuthology.orchestra.run.smithi115.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-13T16:46:34.444 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T16:46:34.444 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2024-09-13T16:46:34.444 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T16:46:34.444 INFO:teuthology.orchestra.run.smithi115.stdout:Install 4 Packages 2024-09-13T16:46:34.444 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T16:46:34.445 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 79 M 2024-09-13T16:46:34.445 INFO:teuthology.orchestra.run.smithi115.stdout:Installed size: 126 M 2024-09-13T16:46:34.445 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading Packages: 2024-09-13T16:46:34.628 INFO:teuthology.orchestra.run.smithi115.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 141 kB/s | 23 kB 00:00 2024-09-13T16:46:35.454 INFO:teuthology.orchestra.run.smithi195.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 7.0 MB/s | 16 MB 00:02 2024-09-13T16:46:36.287 INFO:teuthology.orchestra.run.smithi195.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 11 MB/s | 35 MB 00:03 2024-09-13T16:46:37.821 INFO:teuthology.orchestra.run.smithi195.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 6.4 MB/s | 29 MB 00:04 2024-09-13T16:46:37.821 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-09-13T16:46:37.821 INFO:teuthology.orchestra.run.smithi195.stdout:Total 17 MB/s | 79 MB 00:04 2024-09-13T16:46:38.508 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-09-13T16:46:38.829 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-09-13T16:46:38.829 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-09-13T16:46:39.444 INFO:teuthology.orchestra.run.smithi115.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 3.1 MB/s | 16 MB 00:04 2024-09-13T16:46:39.794 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-09-13T16:46:39.794 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-09-13T16:46:42.261 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-09-13T16:46:42.947 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-13T16:46:43.038 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T16:46:45.360 INFO:teuthology.orchestra.run.smithi115.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 2.7 MB/s | 29 MB 00:10 2024-09-13T16:46:45.830 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T16:46:45.959 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T16:46:48.943 INFO:teuthology.orchestra.run.smithi115.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 2.4 MB/s | 35 MB 00:14 2024-09-13T16:46:48.943 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2024-09-13T16:46:48.943 INFO:teuthology.orchestra.run.smithi115.stdout:Total 5.4 MB/s | 79 MB 00:14 2024-09-13T16:46:49.623 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2024-09-13T16:46:49.970 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction check succeeded. 2024-09-13T16:46:49.970 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2024-09-13T16:46:50.774 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T16:46:50.867 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-13T16:46:50.930 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded. 2024-09-13T16:46:50.931 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2024-09-13T16:46:53.366 INFO:teuthology.orchestra.run.smithi115.stdout: Preparing : 1/1 2024-09-13T16:46:54.007 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-13T16:46:54.093 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T16:46:55.719 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T16:46:56.885 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T16:46:57.013 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T16:47:01.891 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T16:47:02.171 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-13T16:47:07.029 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T16:47:33.833 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T16:47:33.872 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-13T16:47:34.187 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-13T16:47:34.187 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-13T16:47:34.187 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T16:47:34.187 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T16:47:34.995 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T16:47:34.995 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:47:34.995 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-09-13T16:47:34.995 INFO:teuthology.orchestra.run.smithi195.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-13T16:47:34.995 INFO:teuthology.orchestra.run.smithi195.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-13T16:47:34.995 INFO:teuthology.orchestra.run.smithi195.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-13T16:47:34.995 INFO:teuthology.orchestra.run.smithi195.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-13T16:47:34.995 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:47:34.996 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-09-13T16:47:35.333 DEBUG:teuthology.orchestra.run.smithi195:> rpm -q kernel | sort -rV | head -n 1 2024-09-13T16:47:35.458 INFO:teuthology.orchestra.run.smithi195.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-13T16:47:35.459 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-13T16:47:35.459 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-13T16:47:35.459 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-13T16:47:35.459 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-13T16:47:35.459 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2024-09-13T16:47:35.459 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi195.front.sepia.ceph.com, path=None, version=distro) 2024-09-13T16:47:35.460 DEBUG:teuthology.orchestra.run.smithi195:> rpm -q kernel | sort -rV | head -n 1 2024-09-13T16:47:35.518 INFO:teuthology.orchestra.run.smithi195.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-13T16:47:35.518 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-13T16:47:35.518 DEBUG:teuthology.orchestra.run.smithi195:> sudo rpm -qi grub2-tools 2024-09-13T16:47:35.555 INFO:teuthology.orchestra.run.smithi195.stdout:Name : grub2-tools 2024-09-13T16:47:35.555 INFO:teuthology.orchestra.run.smithi195.stdout:Epoch : 1 2024-09-13T16:47:35.555 INFO:teuthology.orchestra.run.smithi195.stdout:Version : 2.06 2024-09-13T16:47:35.555 INFO:teuthology.orchestra.run.smithi195.stdout:Release : 82.el9 2024-09-13T16:47:35.555 INFO:teuthology.orchestra.run.smithi195.stdout:Architecture: x86_64 2024-09-13T16:47:35.555 INFO:teuthology.orchestra.run.smithi195.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-13T16:47:35.555 INFO:teuthology.orchestra.run.smithi195.stdout:Group : Unspecified 2024-09-13T16:47:35.555 INFO:teuthology.orchestra.run.smithi195.stdout:Size : 8274670 2024-09-13T16:47:35.555 INFO:teuthology.orchestra.run.smithi195.stdout:License : GPLv3+ 2024-09-13T16:47:35.555 INFO:teuthology.orchestra.run.smithi195.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-13T16:47:35.555 INFO:teuthology.orchestra.run.smithi195.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-13T16:47:35.556 INFO:teuthology.orchestra.run.smithi195.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-13T16:47:35.556 INFO:teuthology.orchestra.run.smithi195.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-13T16:47:35.556 INFO:teuthology.orchestra.run.smithi195.stdout:Packager : builder@centos.org 2024-09-13T16:47:35.556 INFO:teuthology.orchestra.run.smithi195.stdout:Vendor : CentOS 2024-09-13T16:47:35.556 INFO:teuthology.orchestra.run.smithi195.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-13T16:47:35.556 INFO:teuthology.orchestra.run.smithi195.stdout:Summary : Support tools for GRUB. 2024-09-13T16:47:35.556 INFO:teuthology.orchestra.run.smithi195.stdout:Description : 2024-09-13T16:47:35.556 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:47:35.556 INFO:teuthology.orchestra.run.smithi195.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-13T16:47:35.556 INFO:teuthology.orchestra.run.smithi195.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-13T16:47:35.556 INFO:teuthology.orchestra.run.smithi195.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-13T16:47:35.556 INFO:teuthology.orchestra.run.smithi195.stdout:hardware devices. 2024-09-13T16:47:35.556 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:47:35.556 INFO:teuthology.orchestra.run.smithi195.stdout:This subpackage provides tools for support of all platforms. 2024-09-13T16:47:35.557 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-13T16:47:35.557 INFO:teuthology.task.kernel:Updating grub on smithi195 to boot 5.14.0-505.el9.x86_64 2024-09-13T16:47:35.557 DEBUG:teuthology.orchestra.run.smithi195:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-13T16:47:36.234 INFO:teuthology.orchestra.run.smithi195.stderr:Generating grub configuration file ... 2024-09-13T16:47:37.593 INFO:teuthology.orchestra.run.smithi195.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-13T16:47:37.629 INFO:teuthology.orchestra.run.smithi195.stderr:done 2024-09-13T16:47:37.631 DEBUG:teuthology.orchestra.run.smithi195:> mktemp 2024-09-13T16:47:37.646 INFO:teuthology.orchestra.run.smithi195.stdout:/tmp/tmp.1EeKHxyhbJ 2024-09-13T16:47:37.646 DEBUG:teuthology.orchestra.run.smithi195:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.1EeKHxyhbJ 2024-09-13T16:47:37.713 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 0666 /tmp/tmp.1EeKHxyhbJ 2024-09-13T16:47:37.845 DEBUG:teuthology.orchestra.remote:smithi195:/tmp/tmp.1EeKHxyhbJ is 6KB 2024-09-13T16:47:37.895 DEBUG:teuthology.orchestra.run.smithi195:> rm -fr /tmp/tmp.1EeKHxyhbJ 2024-09-13T16:47:37.910 DEBUG:teuthology.orchestra.run.smithi195:> sudo /bin/ls /boot/loader/entries || true 2024-09-13T16:47:37.972 INFO:teuthology.orchestra.run.smithi195.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-13T16:47:37.972 INFO:teuthology.orchestra.run.smithi195.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-13T16:47:37.973 INFO:teuthology.orchestra.run.smithi195.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-13T16:47:37.973 INFO:teuthology.orchestra.run.smithi195.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-13T16:47:37.974 DEBUG:teuthology.orchestra.run.smithi195:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-13T16:47:38.127 DEBUG:teuthology.orchestra.run.smithi195:> sudo shutdown -r now 2024-09-13T16:47:45.348 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T16:47:45.387 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-13T16:47:45.771 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-13T16:47:45.772 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-13T16:47:45.772 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T16:47:45.772 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T16:47:46.637 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T16:47:46.637 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T16:47:46.637 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2024-09-13T16:47:46.637 INFO:teuthology.orchestra.run.smithi115.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-13T16:47:46.637 INFO:teuthology.orchestra.run.smithi115.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-13T16:47:46.637 INFO:teuthology.orchestra.run.smithi115.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-13T16:47:46.637 INFO:teuthology.orchestra.run.smithi115.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-13T16:47:46.637 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T16:47:46.637 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-09-13T16:47:46.978 DEBUG:teuthology.orchestra.run.smithi115:> rpm -q kernel | sort -rV | head -n 1 2024-09-13T16:47:47.058 INFO:teuthology.orchestra.run.smithi115.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-13T16:47:47.059 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-13T16:47:47.059 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-13T16:47:47.059 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-13T16:47:47.059 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-13T16:47:47.059 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2024-09-13T16:47:47.059 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi115.front.sepia.ceph.com, path=None, version=distro) 2024-09-13T16:47:47.059 DEBUG:teuthology.orchestra.run.smithi115:> rpm -q kernel | sort -rV | head -n 1 2024-09-13T16:47:47.118 INFO:teuthology.orchestra.run.smithi115.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-13T16:47:47.119 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-13T16:47:47.119 DEBUG:teuthology.orchestra.run.smithi115:> sudo rpm -qi grub2-tools 2024-09-13T16:47:47.153 INFO:teuthology.orchestra.run.smithi115.stdout:Name : grub2-tools 2024-09-13T16:47:47.153 INFO:teuthology.orchestra.run.smithi115.stdout:Epoch : 1 2024-09-13T16:47:47.153 INFO:teuthology.orchestra.run.smithi115.stdout:Version : 2.06 2024-09-13T16:47:47.153 INFO:teuthology.orchestra.run.smithi115.stdout:Release : 82.el9 2024-09-13T16:47:47.153 INFO:teuthology.orchestra.run.smithi115.stdout:Architecture: x86_64 2024-09-13T16:47:47.153 INFO:teuthology.orchestra.run.smithi115.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-13T16:47:47.153 INFO:teuthology.orchestra.run.smithi115.stdout:Group : Unspecified 2024-09-13T16:47:47.153 INFO:teuthology.orchestra.run.smithi115.stdout:Size : 8274670 2024-09-13T16:47:47.153 INFO:teuthology.orchestra.run.smithi115.stdout:License : GPLv3+ 2024-09-13T16:47:47.154 INFO:teuthology.orchestra.run.smithi115.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-13T16:47:47.154 INFO:teuthology.orchestra.run.smithi115.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-13T16:47:47.154 INFO:teuthology.orchestra.run.smithi115.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-13T16:47:47.154 INFO:teuthology.orchestra.run.smithi115.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-13T16:47:47.154 INFO:teuthology.orchestra.run.smithi115.stdout:Packager : builder@centos.org 2024-09-13T16:47:47.154 INFO:teuthology.orchestra.run.smithi115.stdout:Vendor : CentOS 2024-09-13T16:47:47.154 INFO:teuthology.orchestra.run.smithi115.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-13T16:47:47.154 INFO:teuthology.orchestra.run.smithi115.stdout:Summary : Support tools for GRUB. 2024-09-13T16:47:47.154 INFO:teuthology.orchestra.run.smithi115.stdout:Description : 2024-09-13T16:47:47.154 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T16:47:47.154 INFO:teuthology.orchestra.run.smithi115.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-13T16:47:47.154 INFO:teuthology.orchestra.run.smithi115.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-13T16:47:47.155 INFO:teuthology.orchestra.run.smithi115.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-13T16:47:47.155 INFO:teuthology.orchestra.run.smithi115.stdout:hardware devices. 2024-09-13T16:47:47.155 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T16:47:47.155 INFO:teuthology.orchestra.run.smithi115.stdout:This subpackage provides tools for support of all platforms. 2024-09-13T16:47:47.156 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-13T16:47:47.156 INFO:teuthology.task.kernel:Updating grub on smithi115 to boot 5.14.0-505.el9.x86_64 2024-09-13T16:47:47.156 DEBUG:teuthology.orchestra.run.smithi115:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-13T16:47:47.857 INFO:teuthology.orchestra.run.smithi115.stderr:Generating grub configuration file ... 2024-09-13T16:47:49.185 INFO:teuthology.orchestra.run.smithi115.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-13T16:47:49.217 INFO:teuthology.orchestra.run.smithi115.stderr:done 2024-09-13T16:47:49.219 DEBUG:teuthology.orchestra.run.smithi115:> mktemp 2024-09-13T16:47:49.235 INFO:teuthology.orchestra.run.smithi115.stdout:/tmp/tmp.QTuj7XrhQc 2024-09-13T16:47:49.235 DEBUG:teuthology.orchestra.run.smithi115:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.QTuj7XrhQc 2024-09-13T16:47:49.302 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 0666 /tmp/tmp.QTuj7XrhQc 2024-09-13T16:47:49.438 DEBUG:teuthology.orchestra.remote:smithi115:/tmp/tmp.QTuj7XrhQc is 6KB 2024-09-13T16:47:49.487 DEBUG:teuthology.orchestra.run.smithi115:> rm -fr /tmp/tmp.QTuj7XrhQc 2024-09-13T16:47:49.501 DEBUG:teuthology.orchestra.run.smithi115:> sudo /bin/ls /boot/loader/entries || true 2024-09-13T16:47:49.564 INFO:teuthology.orchestra.run.smithi115.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-13T16:47:49.564 INFO:teuthology.orchestra.run.smithi115.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-13T16:47:49.564 INFO:teuthology.orchestra.run.smithi115.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-13T16:47:49.564 INFO:teuthology.orchestra.run.smithi115.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-13T16:47:49.565 DEBUG:teuthology.orchestra.run.smithi115:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-13T16:47:49.709 DEBUG:teuthology.orchestra.run.smithi115:> sudo shutdown -r now 2024-09-13T16:48:08.147 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2024-09-13T16:48:08.147 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-09-13T16:48:08.148 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T16:48:19.719 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2024-09-13T16:48:19.720 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-09-13T16:48:19.721 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T16:48:26.685 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.195 2024-09-13T16:48:35.693 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-09-13T16:48:35.693 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T16:48:38.205 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-09-13T16:48:38.781 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.195 2024-09-13T16:48:47.208 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-09-13T16:48:47.209 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T16:48:50.269 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-09-13T16:48:50.782 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-09-13T16:48:50.783 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T16:49:02.281 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-09-13T16:49:02.282 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T16:49:20.701 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-09-13T16:49:22.579 DEBUG:teuthology.orchestra.run.smithi195:> true 2024-09-13T16:49:22.960 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-09-13T16:49:22.960 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "5.14.0-505.el9.x86_64"... 2024-09-13T16:49:22.961 DEBUG:teuthology.orchestra.run.smithi195:> uname -r 2024-09-13T16:49:22.975 INFO:teuthology.orchestra.run.smithi195.stdout:5.14.0-505.el9.x86_64 2024-09-13T16:49:22.976 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-13T16:49:22.976 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T16:49:22.976 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-13T16:49:23.977 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-09-13T16:49:23.977 DEBUG:teuthology.orchestra.run.smithi195:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-13T16:49:24.072 INFO:teuthology.orchestra.run.smithi195.stdout:ttyS1 2024-09-13T16:49:24.096 DEBUG:teuthology.parallel:result is None 2024-09-13T16:49:35.702 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-09-13T16:49:35.703 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T16:49:36.019 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-09-13T16:49:36.497 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-09-13T16:49:36.497 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "5.14.0-505.el9.x86_64"... 2024-09-13T16:49:36.497 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-09-13T16:49:36.540 INFO:teuthology.orchestra.run.smithi115.stdout:5.14.0-505.el9.x86_64 2024-09-13T16:49:36.541 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-13T16:49:36.541 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T16:49:36.541 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-13T16:49:37.542 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-09-13T16:49:37.542 DEBUG:teuthology.orchestra.run.smithi115:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-13T16:49:37.606 INFO:teuthology.orchestra.run.smithi115.stdout:ttyS1 2024-09-13T16:49:37.627 DEBUG:teuthology.parallel:result is None 2024-09-13T16:49:37.627 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-13T16:49:37.634 INFO:teuthology.task.internal:Creating test directory... 2024-09-13T16:49:37.635 DEBUG:teuthology.orchestra.run.smithi115:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T16:49:37.637 DEBUG:teuthology.orchestra.run.smithi195:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T16:49:37.657 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-13T16:49:37.663 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-13T16:49:37.674 INFO:teuthology.task.internal:Creating archive directory... 2024-09-13T16:49:37.674 DEBUG:teuthology.orchestra.run.smithi115:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T16:49:37.693 DEBUG:teuthology.orchestra.run.smithi195:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T16:49:37.833 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-13T16:49:37.840 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-13T16:49:37.840 DEBUG:teuthology.orchestra.run.smithi115:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T16:49:37.842 DEBUG:teuthology.orchestra.run.smithi195:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T16:49:37.873 INFO:teuthology.orchestra.run.smithi195.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T16:49:37.874 INFO:teuthology.orchestra.run.smithi115.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T16:49:37.883 INFO:teuthology.orchestra.run.smithi115.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T16:49:37.885 INFO:teuthology.orchestra.run.smithi195.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T16:49:37.886 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-13T16:49:37.894 INFO:teuthology.task.internal:Configuring sudo... 2024-09-13T16:49:37.894 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T16:49:37.928 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T16:49:37.957 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-13T16:49:37.966 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-13T16:49:37.969 DEBUG:teuthology.orchestra.run.smithi115:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T16:49:37.992 DEBUG:teuthology.orchestra.run.smithi195:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T16:49:38.015 DEBUG:teuthology.orchestra.run.smithi115:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T16:49:38.098 DEBUG:teuthology.orchestra.run.smithi115:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T16:49:38.145 DEBUG:teuthology.orchestra.run.smithi115:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T16:49:38.236 DEBUG:teuthology.orchestra.run.smithi115:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T16:49:38.268 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-13T16:49:38.268 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T16:49:38.332 DEBUG:teuthology.orchestra.run.smithi195:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T16:49:38.385 DEBUG:teuthology.orchestra.run.smithi195:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T16:49:38.427 DEBUG:teuthology.orchestra.run.smithi195:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T16:49:38.518 DEBUG:teuthology.orchestra.run.smithi195:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T16:49:38.557 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-09-13T16:49:38.557 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T16:49:38.624 DEBUG:teuthology.orchestra.run.smithi115:> sudo service rsyslog restart 2024-09-13T16:49:38.626 DEBUG:teuthology.orchestra.run.smithi195:> sudo service rsyslog restart 2024-09-13T16:49:38.667 INFO:teuthology.orchestra.run.smithi115.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T16:49:38.714 INFO:teuthology.orchestra.run.smithi195.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T16:49:39.185 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-13T16:49:39.193 INFO:teuthology.task.internal:Starting timer... 2024-09-13T16:49:39.193 INFO:teuthology.run_tasks:Running task pcp... 2024-09-13T16:49:39.207 INFO:teuthology.run_tasks:Running task selinux... 2024-09-13T16:49:39.216 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-09-13T16:49:39.216 DEBUG:teuthology.orchestra.run.smithi115:> sudo service auditd rotate 2024-09-13T16:49:39.295 INFO:teuthology.orchestra.run.smithi115.stdout:Rotating logs: 2024-09-13T16:49:39.297 DEBUG:teuthology.orchestra.run.smithi195:> sudo service auditd rotate 2024-09-13T16:49:39.361 INFO:teuthology.orchestra.run.smithi195.stdout:Rotating logs: 2024-09-13T16:49:39.364 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-13T16:49:39.364 DEBUG:teuthology.orchestra.run.smithi115:> /usr/sbin/getenforce 2024-09-13T16:49:39.393 INFO:teuthology.orchestra.run.smithi115.stdout:Permissive 2024-09-13T16:49:39.393 DEBUG:teuthology.orchestra.run.smithi195:> /usr/sbin/getenforce 2024-09-13T16:49:39.430 INFO:teuthology.orchestra.run.smithi195.stdout:Permissive 2024-09-13T16:49:39.430 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi115.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi195.front.sepia.ceph.com': 'permissive'} 2024-09-13T16:49:39.430 DEBUG:teuthology.orchestra.run.smithi115:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-13T16:49:39.459 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T16:49:39.460 DEBUG:teuthology.orchestra.run.smithi195:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-13T16:49:39.497 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T16:49:39.497 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-13T16:49:39.497 DEBUG:teuthology.orchestra.run.smithi115:> sudo /usr/sbin/setenforce permissive 2024-09-13T16:49:39.535 DEBUG:teuthology.orchestra.run.smithi195:> sudo /usr/sbin/setenforce permissive 2024-09-13T16:49:39.571 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-13T16:49:39.580 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-13T16:49:39.592 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-13T16:49:39.593 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi115.front.sepia.ceph.com,smithi195.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-13T16:53:30.076 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi115.front.sepia.ceph.com'), Remote(name='ubuntu@smithi195.front.sepia.ceph.com')] 2024-09-13T16:53:30.077 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-09-13T16:53:30.078 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T16:53:30.162 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-09-13T16:53:30.240 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-09-13T16:53:30.240 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-09-13T16:53:30.240 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T16:53:30.325 DEBUG:teuthology.orchestra.run.smithi195:> true 2024-09-13T16:53:30.404 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-09-13T16:53:30.405 INFO:teuthology.run_tasks:Running task clock... 2024-09-13T16:53:30.413 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-13T16:53:30.414 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T16:53:30.414 DEBUG:teuthology.orchestra.run.smithi115:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T16:53:30.416 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T16:53:30.417 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T16:53:30.443 INFO:teuthology.orchestra.run.smithi115.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-13T16:53:30.457 INFO:teuthology.orchestra.run.smithi115.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-13T16:53:30.474 INFO:teuthology.orchestra.run.smithi195.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-13T16:53:30.481 INFO:teuthology.orchestra.run.smithi115.stderr:sudo: ntpd: command not found 2024-09-13T16:53:30.488 INFO:teuthology.orchestra.run.smithi195.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-13T16:53:30.493 INFO:teuthology.orchestra.run.smithi115.stdout:506 Cannot talk to daemon 2024-09-13T16:53:30.507 INFO:teuthology.orchestra.run.smithi115.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-13T16:53:30.513 INFO:teuthology.orchestra.run.smithi195.stderr:sudo: ntpd: command not found 2024-09-13T16:53:30.521 INFO:teuthology.orchestra.run.smithi115.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-13T16:53:30.523 INFO:teuthology.orchestra.run.smithi195.stdout:506 Cannot talk to daemon 2024-09-13T16:53:30.538 INFO:teuthology.orchestra.run.smithi195.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-13T16:53:30.552 INFO:teuthology.orchestra.run.smithi195.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-13T16:53:30.580 INFO:teuthology.orchestra.run.smithi115.stderr:bash: line 1: ntpq: command not found 2024-09-13T16:53:30.584 INFO:teuthology.orchestra.run.smithi115.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T16:53:30.584 INFO:teuthology.orchestra.run.smithi115.stdout:=============================================================================== 2024-09-13T16:53:30.584 INFO:teuthology.orchestra.run.smithi115.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T16:53:30.584 INFO:teuthology.orchestra.run.smithi115.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T16:53:30.584 INFO:teuthology.orchestra.run.smithi115.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T16:53:30.584 INFO:teuthology.orchestra.run.smithi115.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T16:53:30.611 INFO:teuthology.orchestra.run.smithi195.stderr:bash: line 1: ntpq: command not found 2024-09-13T16:53:30.615 INFO:teuthology.orchestra.run.smithi195.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T16:53:30.615 INFO:teuthology.orchestra.run.smithi195.stdout:=============================================================================== 2024-09-13T16:53:30.615 INFO:teuthology.orchestra.run.smithi195.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T16:53:30.615 INFO:teuthology.orchestra.run.smithi195.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T16:53:30.615 INFO:teuthology.orchestra.run.smithi195.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T16:53:30.615 INFO:teuthology.orchestra.run.smithi195.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T16:53:30.616 INFO:teuthology.run_tasks:Running task install... 2024-09-13T16:53:30.624 DEBUG:teuthology.task.install:project ceph 2024-09-13T16:53:30.624 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'}} 2024-09-13T16:53:30.624 DEBUG:teuthology.task.install:config {'branch': 'reef', 'exclude_packages': ['ceph-volume'], 'flavor': 'default', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'} 2024-09-13T16:53:30.624 INFO:teuthology.task.install:Using flavor: default 2024-09-13T16:53:30.636 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-13T16:53:30.636 INFO:teuthology.task.install:extra packages: [] 2024-09-13T16:53:30.637 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'reef', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3', 'tag': None, 'wait_for_package': False} 2024-09-13T16:53:30.637 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T16:53:30.637 INFO:teuthology.packaging:ref: None 2024-09-13T16:53:30.637 INFO:teuthology.packaging:tag: None 2024-09-13T16:53:30.637 INFO:teuthology.packaging:branch: reef 2024-09-13T16:53:30.637 INFO:teuthology.packaging:sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T16:53:30.638 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=reef 2024-09-13T16:53:30.639 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'reef', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3', 'tag': None, 'wait_for_package': False} 2024-09-13T16:53:30.639 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T16:53:30.640 INFO:teuthology.packaging:ref: None 2024-09-13T16:53:30.640 INFO:teuthology.packaging:tag: None 2024-09-13T16:53:30.640 INFO:teuthology.packaging:branch: reef 2024-09-13T16:53:30.640 INFO:teuthology.packaging:sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T16:53:30.640 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=reef 2024-09-13T16:53:30.896 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/reef/2c01458affee2b2435cd231b6e392435c1c21661/centos/9/flavors/default/ 2024-09-13T16:53:30.896 INFO:teuthology.task.install.rpm:Package version is 18.2.4-843.g2c01458a 2024-09-13T16:53:30.959 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/reef/2c01458affee2b2435cd231b6e392435c1c21661/centos/9/flavors/default/ 2024-09-13T16:53:30.960 INFO:teuthology.task.install.rpm:Package version is 18.2.4-843.g2c01458a 2024-09-13T16:53:31.036 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/reef/2c01458affee2b2435cd231b6e392435c1c21661/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/reef/2c01458affee2b2435cd231b6e392435c1c21661/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/reef/2c01458affee2b2435cd231b6e392435c1c21661/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-13T16:53:31.036 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-09-13T16:53:31.037 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-13T16:53:31.063 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-13T16:53:31.063 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T16:53:31.063 INFO:teuthology.packaging:ref: None 2024-09-13T16:53:31.063 INFO:teuthology.packaging:tag: None 2024-09-13T16:53:31.063 INFO:teuthology.packaging:branch: reef 2024-09-13T16:53:31.063 INFO:teuthology.packaging:sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T16:53:31.064 DEBUG:teuthology.orchestra.run.smithi195:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/reef/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-13T16:53:31.079 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/reef/2c01458affee2b2435cd231b6e392435c1c21661/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/reef/2c01458affee2b2435cd231b6e392435c1c21661/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/reef/2c01458affee2b2435cd231b6e392435c1c21661/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-13T16:53:31.079 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-13T16:53:31.079 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-13T16:53:31.105 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-13T16:53:31.105 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T16:53:31.105 INFO:teuthology.packaging:ref: None 2024-09-13T16:53:31.105 INFO:teuthology.packaging:tag: None 2024-09-13T16:53:31.105 INFO:teuthology.packaging:branch: reef 2024-09-13T16:53:31.105 INFO:teuthology.packaging:sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T16:53:31.107 DEBUG:teuthology.orchestra.run.smithi115:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/reef/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-13T16:53:31.129 DEBUG:teuthology.orchestra.run.smithi195:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-13T16:53:31.170 DEBUG:teuthology.orchestra.run.smithi115:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-13T16:53:31.205 DEBUG:teuthology.orchestra.run.smithi195:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-13T16:53:31.245 DEBUG:teuthology.orchestra.run.smithi115:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-13T16:53:31.269 INFO:teuthology.orchestra.run.smithi195.stdout:check_obsoletes = 1 2024-09-13T16:53:31.270 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum clean all 2024-09-13T16:53:31.310 INFO:teuthology.orchestra.run.smithi115.stdout:check_obsoletes = 1 2024-09-13T16:53:31.313 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum clean all 2024-09-13T16:53:31.495 INFO:teuthology.orchestra.run.smithi195.stdout:45 files removed 2024-09-13T16:53:31.522 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install ceph-radosgw 2024-09-13T16:53:31.545 INFO:teuthology.orchestra.run.smithi115.stdout:45 files removed 2024-09-13T16:53:31.572 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install ceph-radosgw 2024-09-13T16:53:32.079 INFO:teuthology.orchestra.run.smithi195.stdout:ceph packages for x86_64 287 kB/s | 77 kB 00:00 2024-09-13T16:53:32.128 INFO:teuthology.orchestra.run.smithi115.stdout:ceph packages for x86_64 282 kB/s | 77 kB 00:00 2024-09-13T16:53:32.363 INFO:teuthology.orchestra.run.smithi195.stdout:ceph noarch packages 48 kB/s | 11 kB 00:00 2024-09-13T16:53:32.396 INFO:teuthology.orchestra.run.smithi115.stdout:ceph noarch packages 51 kB/s | 11 kB 00:00 2024-09-13T16:53:32.638 INFO:teuthology.orchestra.run.smithi195.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-13T16:53:32.679 INFO:teuthology.orchestra.run.smithi115.stdout:ceph source packages 7.6 kB/s | 1.9 kB 00:00 2024-09-13T16:53:33.447 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.2 MB 00:00 2024-09-13T16:53:35.379 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS Stream 9 - BaseOS 3.1 MB/s | 8.2 MB 00:02 2024-09-13T16:53:38.081 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 9 - AppStream 5.8 MB/s | 20 MB 00:03 2024-09-13T16:53:38.622 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS Stream 9 - AppStream 9.5 MB/s | 20 MB 00:02 2024-09-13T16:53:43.667 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 9 - CRB 3.8 MB/s | 6.5 MB 00:01 2024-09-13T16:53:44.572 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS Stream 9 - CRB 3.0 MB/s | 6.5 MB 00:02 2024-09-13T16:53:45.143 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 9 - Extras packages 83 kB/s | 19 kB 00:00 2024-09-13T16:53:46.089 INFO:teuthology.orchestra.run.smithi195.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-13T16:53:46.497 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS Stream 9 - Extras packages 33 kB/s | 19 kB 00:00 2024-09-13T16:53:47.585 INFO:teuthology.orchestra.run.smithi115.stdout:Extra Packages for Enterprise Linux 24 MB/s | 23 MB 00:00 2024-09-13T16:53:51.687 INFO:teuthology.orchestra.run.smithi195.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-13T16:53:53.032 INFO:teuthology.orchestra.run.smithi115.stdout:lab-extras 36 kB/s | 1.7 kB 00:00 2024-09-13T16:53:54.056 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-09-13T16:53:54.065 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T16:53:54.065 INFO:teuthology.orchestra.run.smithi195.stdout: Package Arch Version Repository Size 2024-09-13T16:53:54.066 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T16:53:54.066 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-09-13T16:53:54.066 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-radosgw x86_64 2:18.2.4-843.g2c01458a.el9 ceph 7.7 M 2024-09-13T16:53:54.066 INFO:teuthology.orchestra.run.smithi195.stdout:Upgrading: 2024-09-13T16:53:54.066 INFO:teuthology.orchestra.run.smithi195.stdout: librados2 x86_64 2:18.2.4-843.g2c01458a.el9 ceph 3.3 M 2024-09-13T16:53:54.066 INFO:teuthology.orchestra.run.smithi195.stdout: librbd1 x86_64 2:18.2.4-843.g2c01458a.el9 ceph 3.0 M 2024-09-13T16:53:54.066 INFO:teuthology.orchestra.run.smithi195.stdout:Installing dependencies: 2024-09-13T16:53:54.066 INFO:teuthology.orchestra.run.smithi195.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-13T16:53:54.066 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-base x86_64 2:18.2.4-843.g2c01458a.el9 ceph 5.1 M 2024-09-13T16:53:54.066 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-common x86_64 2:18.2.4-843.g2c01458a.el9 ceph 18 M 2024-09-13T16:53:54.066 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-selinux x86_64 2:18.2.4-843.g2c01458a.el9 ceph 25 k 2024-09-13T16:53:54.066 INFO:teuthology.orchestra.run.smithi195.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-09-13T16:53:54.067 INFO:teuthology.orchestra.run.smithi195.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-13T16:53:54.067 INFO:teuthology.orchestra.run.smithi195.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-13T16:53:54.067 INFO:teuthology.orchestra.run.smithi195.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-13T16:53:54.067 INFO:teuthology.orchestra.run.smithi195.stdout: libcephfs2 x86_64 2:18.2.4-843.g2c01458a.el9 ceph 712 k 2024-09-13T16:53:54.067 INFO:teuthology.orchestra.run.smithi195.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-13T16:53:54.067 INFO:teuthology.orchestra.run.smithi195.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-13T16:53:54.067 INFO:teuthology.orchestra.run.smithi195.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-13T16:53:54.067 INFO:teuthology.orchestra.run.smithi195.stdout: libradosstriper1 x86_64 2:18.2.4-843.g2c01458a.el9 ceph 477 k 2024-09-13T16:53:54.067 INFO:teuthology.orchestra.run.smithi195.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-13T16:53:54.067 INFO:teuthology.orchestra.run.smithi195.stdout: librgw2 x86_64 2:18.2.4-843.g2c01458a.el9 ceph 4.5 M 2024-09-13T16:53:54.067 INFO:teuthology.orchestra.run.smithi195.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-13T16:53:54.067 INFO:teuthology.orchestra.run.smithi195.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-13T16:53:54.067 INFO:teuthology.orchestra.run.smithi195.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-13T16:53:54.068 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ceph-argparse x86_64 2:18.2.4-843.g2c01458a.el9 ceph 45 k 2024-09-13T16:53:54.068 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ceph-common x86_64 2:18.2.4-843.g2c01458a.el9 ceph 129 k 2024-09-13T16:53:54.068 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cephfs x86_64 2:18.2.4-843.g2c01458a.el9 ceph 162 k 2024-09-13T16:53:54.068 INFO:teuthology.orchestra.run.smithi195.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-13T16:53:54.068 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rados x86_64 2:18.2.4-843.g2c01458a.el9 ceph 321 k 2024-09-13T16:53:54.068 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rbd x86_64 2:18.2.4-843.g2c01458a.el9 ceph 301 k 2024-09-13T16:53:54.068 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rgw x86_64 2:18.2.4-843.g2c01458a.el9 ceph 99 k 2024-09-13T16:53:54.068 INFO:teuthology.orchestra.run.smithi195.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-13T16:53:54.068 INFO:teuthology.orchestra.run.smithi195.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-13T16:53:54.068 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:53:54.068 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-09-13T16:53:54.068 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T16:53:54.069 INFO:teuthology.orchestra.run.smithi195.stdout:Install 28 Packages 2024-09-13T16:53:54.069 INFO:teuthology.orchestra.run.smithi195.stdout:Upgrade 2 Packages 2024-09-13T16:53:54.069 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:53:54.069 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 53 M 2024-09-13T16:53:54.069 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-09-13T16:53:55.088 INFO:teuthology.orchestra.run.smithi195.stdout:(1/30): ceph-base-18.2.4-843.g2c01458a.el9.x86_ 9.5 MB/s | 5.1 MB 00:00 2024-09-13T16:53:55.230 INFO:teuthology.orchestra.run.smithi195.stdout:(2/30): ceph-radosgw-18.2.4-843.g2c01458a.el9.x 11 MB/s | 7.7 MB 00:00 2024-09-13T16:53:55.255 INFO:teuthology.orchestra.run.smithi195.stdout:(3/30): ceph-selinux-18.2.4-843.g2c01458a.el9.x 151 kB/s | 25 kB 00:00 2024-09-13T16:53:55.391 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-09-13T16:53:55.394 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T16:53:55.394 INFO:teuthology.orchestra.run.smithi115.stdout: Package Arch Version Repository Size 2024-09-13T16:53:55.395 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T16:53:55.395 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2024-09-13T16:53:55.395 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-radosgw x86_64 2:18.2.4-843.g2c01458a.el9 ceph 7.7 M 2024-09-13T16:53:55.395 INFO:teuthology.orchestra.run.smithi115.stdout:Upgrading: 2024-09-13T16:53:55.395 INFO:teuthology.orchestra.run.smithi115.stdout: librados2 x86_64 2:18.2.4-843.g2c01458a.el9 ceph 3.3 M 2024-09-13T16:53:55.395 INFO:teuthology.orchestra.run.smithi115.stdout: librbd1 x86_64 2:18.2.4-843.g2c01458a.el9 ceph 3.0 M 2024-09-13T16:53:55.396 INFO:teuthology.orchestra.run.smithi115.stdout:Installing dependencies: 2024-09-13T16:53:55.396 INFO:teuthology.orchestra.run.smithi115.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-13T16:53:55.396 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-base x86_64 2:18.2.4-843.g2c01458a.el9 ceph 5.1 M 2024-09-13T16:53:55.396 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-common x86_64 2:18.2.4-843.g2c01458a.el9 ceph 18 M 2024-09-13T16:53:55.396 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-selinux x86_64 2:18.2.4-843.g2c01458a.el9 ceph 25 k 2024-09-13T16:53:55.396 INFO:teuthology.orchestra.run.smithi115.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-09-13T16:53:55.396 INFO:teuthology.orchestra.run.smithi115.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-13T16:53:55.397 INFO:teuthology.orchestra.run.smithi115.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-13T16:53:55.397 INFO:teuthology.orchestra.run.smithi115.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-13T16:53:55.397 INFO:teuthology.orchestra.run.smithi115.stdout: libcephfs2 x86_64 2:18.2.4-843.g2c01458a.el9 ceph 712 k 2024-09-13T16:53:55.397 INFO:teuthology.orchestra.run.smithi115.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-13T16:53:55.397 INFO:teuthology.orchestra.run.smithi115.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-13T16:53:55.397 INFO:teuthology.orchestra.run.smithi115.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-13T16:53:55.398 INFO:teuthology.orchestra.run.smithi115.stdout: libradosstriper1 x86_64 2:18.2.4-843.g2c01458a.el9 ceph 477 k 2024-09-13T16:53:55.398 INFO:teuthology.orchestra.run.smithi115.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-13T16:53:55.398 INFO:teuthology.orchestra.run.smithi115.stdout: librgw2 x86_64 2:18.2.4-843.g2c01458a.el9 ceph 4.5 M 2024-09-13T16:53:55.398 INFO:teuthology.orchestra.run.smithi115.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-13T16:53:55.398 INFO:teuthology.orchestra.run.smithi115.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-13T16:53:55.398 INFO:teuthology.orchestra.run.smithi115.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-13T16:53:55.399 INFO:teuthology.orchestra.run.smithi115.stdout: python3-ceph-argparse x86_64 2:18.2.4-843.g2c01458a.el9 ceph 45 k 2024-09-13T16:53:55.399 INFO:teuthology.orchestra.run.smithi115.stdout: python3-ceph-common x86_64 2:18.2.4-843.g2c01458a.el9 ceph 129 k 2024-09-13T16:53:55.399 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cephfs x86_64 2:18.2.4-843.g2c01458a.el9 ceph 162 k 2024-09-13T16:53:55.399 INFO:teuthology.orchestra.run.smithi115.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-13T16:53:55.399 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rados x86_64 2:18.2.4-843.g2c01458a.el9 ceph 321 k 2024-09-13T16:53:55.399 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rbd x86_64 2:18.2.4-843.g2c01458a.el9 ceph 301 k 2024-09-13T16:53:55.400 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rgw x86_64 2:18.2.4-843.g2c01458a.el9 ceph 99 k 2024-09-13T16:53:55.400 INFO:teuthology.orchestra.run.smithi115.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-13T16:53:55.400 INFO:teuthology.orchestra.run.smithi115.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-13T16:53:55.400 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T16:53:55.400 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2024-09-13T16:53:55.400 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T16:53:55.400 INFO:teuthology.orchestra.run.smithi115.stdout:Install 28 Packages 2024-09-13T16:53:55.400 INFO:teuthology.orchestra.run.smithi115.stdout:Upgrade 2 Packages 2024-09-13T16:53:55.400 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T16:53:55.401 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 53 M 2024-09-13T16:53:55.401 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading Packages: 2024-09-13T16:53:55.430 INFO:teuthology.orchestra.run.smithi195.stdout:(4/30): libradosstriper1-18.2.4-843.g2c01458a.e 2.7 MB/s | 477 kB 00:00 2024-09-13T16:53:55.455 INFO:teuthology.orchestra.run.smithi195.stdout:(5/30): libcephfs2-18.2.4-843.g2c01458a.el9.x86 3.1 MB/s | 712 kB 00:00 2024-09-13T16:53:55.639 INFO:teuthology.orchestra.run.smithi195.stdout:(6/30): ceph-common-18.2.4-843.g2c01458a.el9.x8 17 MB/s | 18 MB 00:01 2024-09-13T16:53:55.664 INFO:teuthology.orchestra.run.smithi195.stdout:(7/30): python3-ceph-argparse-18.2.4-843.g2c014 216 kB/s | 45 kB 00:00 2024-09-13T16:53:55.689 INFO:teuthology.orchestra.run.smithi195.stdout:(8/30): python3-ceph-common-18.2.4-843.g2c01458 2.5 MB/s | 129 kB 00:00 2024-09-13T16:53:55.715 INFO:teuthology.orchestra.run.smithi195.stdout:(9/30): python3-cephfs-18.2.4-843.g2c01458a.el9 3.2 MB/s | 162 kB 00:00 2024-09-13T16:53:55.782 INFO:teuthology.orchestra.run.smithi195.stdout:(10/30): librgw2-18.2.4-843.g2c01458a.el9.x86_6 13 MB/s | 4.5 MB 00:00 2024-09-13T16:53:55.807 INFO:teuthology.orchestra.run.smithi195.stdout:(11/30): python3-rbd-18.2.4-843.g2c01458a.el9.x 3.2 MB/s | 301 kB 00:00 2024-09-13T16:53:55.832 INFO:teuthology.orchestra.run.smithi195.stdout:(12/30): python3-rados-18.2.4-843.g2c01458a.el9 2.2 MB/s | 321 kB 00:00 2024-09-13T16:53:55.858 INFO:teuthology.orchestra.run.smithi195.stdout:(13/30): python3-rgw-18.2.4-843.g2c01458a.el9.x 1.3 MB/s | 99 kB 00:00 2024-09-13T16:53:55.958 INFO:teuthology.orchestra.run.smithi195.stdout:(14/30): librabbitmq-0.11.0-7.el9.x86_64.rpm 452 kB/s | 45 kB 00:00 2024-09-13T16:53:55.992 INFO:teuthology.orchestra.run.smithi195.stdout:(15/30): boost-program-options-1.75.0-8.el9.x86 580 kB/s | 107 kB 00:00 2024-09-13T16:53:56.051 INFO:teuthology.orchestra.run.smithi195.stdout:(16/30): libpmemobj-1.12.1-1.el9.x86_64.rpm 736 kB/s | 160 kB 00:00 2024-09-13T16:53:56.075 INFO:teuthology.orchestra.run.smithi115.stdout:(1/30): ceph-base-18.2.4-843.g2c01458a.el9.x86_ 10 MB/s | 5.1 MB 00:00 2024-09-13T16:53:56.101 INFO:teuthology.orchestra.run.smithi195.stdout:(17/30): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.6 MB/s | 292 kB 00:00 2024-09-13T16:53:56.125 INFO:teuthology.orchestra.run.smithi115.stdout:(2/30): ceph-selinux-18.2.4-843.g2c01458a.el9.x 505 kB/s | 25 kB 00:00 2024-09-13T16:53:56.126 INFO:teuthology.orchestra.run.smithi195.stdout:(18/30): python3-prettytable-0.7.2-27.el9.noarc 562 kB/s | 42 kB 00:00 2024-09-13T16:53:56.159 INFO:teuthology.orchestra.run.smithi195.stdout:(19/30): librdkafka-1.6.1-102.el9.x86_64.rpm 3.2 MB/s | 662 kB 00:00 2024-09-13T16:53:56.201 INFO:teuthology.orchestra.run.smithi195.stdout:(20/30): fmt-8.1.1-5.el9.x86_64.rpm 1.1 MB/s | 111 kB 00:00 2024-09-13T16:53:56.217 INFO:teuthology.orchestra.run.smithi115.stdout:(3/30): libcephfs2-18.2.4-843.g2c01458a.el9.x86 7.6 MB/s | 712 kB 00:00 2024-09-13T16:53:56.227 INFO:teuthology.orchestra.run.smithi195.stdout:(21/30): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.5 MB/s | 26 kB 00:00 2024-09-13T16:53:56.252 INFO:teuthology.orchestra.run.smithi195.stdout:(22/30): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.4 MB/s | 308 kB 00:00 2024-09-13T16:53:56.269 INFO:teuthology.orchestra.run.smithi195.stdout:(23/30): liboath-2.6.7-2.el9.x86_64.rpm 1.2 MB/s | 49 kB 00:00 2024-09-13T16:53:56.294 INFO:teuthology.orchestra.run.smithi195.stdout:(24/30): libunwind-1.6.2-1.el9.x86_64.rpm 1.6 MB/s | 67 kB 00:00 2024-09-13T16:53:56.309 INFO:teuthology.orchestra.run.smithi115.stdout:(4/30): ceph-radosgw-18.2.4-843.g2c01458a.el9.x 11 MB/s | 7.7 MB 00:00 2024-09-13T16:53:56.334 INFO:teuthology.orchestra.run.smithi115.stdout:(5/30): libradosstriper1-18.2.4-843.g2c01458a.e 4.0 MB/s | 477 kB 00:00 2024-09-13T16:53:56.336 INFO:teuthology.orchestra.run.smithi195.stdout:(25/30): parquet-libs-9.0.0-11.el9.x86_64.rpm 12 MB/s | 839 kB 00:00 2024-09-13T16:53:56.370 INFO:teuthology.orchestra.run.smithi195.stdout:(26/30): re2-20211101-20.el9.x86_64.rpm 2.5 MB/s | 191 kB 00:00 2024-09-13T16:53:56.401 INFO:teuthology.orchestra.run.smithi115.stdout:(6/30): python3-ceph-argparse-18.2.4-843.g2c014 677 kB/s | 45 kB 00:00 2024-09-13T16:53:56.420 INFO:teuthology.orchestra.run.smithi195.stdout:(27/30): thrift-0.15.0-2.el9.x86_64.rpm 19 MB/s | 1.6 MB 00:00 2024-09-13T16:53:56.554 INFO:teuthology.orchestra.run.smithi195.stdout:(28/30): libarrow-9.0.0-11.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-09-13T16:53:56.621 INFO:teuthology.orchestra.run.smithi195.stdout:(29/30): librados2-18.2.4-843.g2c01458a.el9.x86 13 MB/s | 3.3 MB 00:00 2024-09-13T16:53:56.626 INFO:teuthology.orchestra.run.smithi115.stdout:(7/30): ceph-common-18.2.4-843.g2c01458a.el9.x8 17 MB/s | 18 MB 00:01 2024-09-13T16:53:56.652 INFO:teuthology.orchestra.run.smithi115.stdout:(8/30): python3-ceph-common-18.2.4-843.g2c01458 516 kB/s | 129 kB 00:00 2024-09-13T16:53:56.677 INFO:teuthology.orchestra.run.smithi115.stdout:(9/30): python3-cephfs-18.2.4-843.g2c01458a.el9 3.2 MB/s | 162 kB 00:00 2024-09-13T16:53:56.703 INFO:teuthology.orchestra.run.smithi115.stdout:(10/30): python3-rados-18.2.4-843.g2c01458a.el9 6.3 MB/s | 321 kB 00:00 2024-09-13T16:53:56.721 INFO:teuthology.orchestra.run.smithi195.stdout:(30/30): librbd1-18.2.4-843.g2c01458a.el9.x86_6 10 MB/s | 3.0 MB 00:00 2024-09-13T16:53:56.726 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-09-13T16:53:56.726 INFO:teuthology.orchestra.run.smithi195.stdout:Total 20 MB/s | 53 MB 00:02 2024-09-13T16:53:56.727 INFO:teuthology.orchestra.run.smithi115.stdout:(11/30): python3-rbd-18.2.4-843.g2c01458a.el9.x 5.9 MB/s | 301 kB 00:00 2024-09-13T16:53:56.787 INFO:teuthology.orchestra.run.smithi115.stdout:(12/30): librgw2-18.2.4-843.g2c01458a.el9.x86_6 9.4 MB/s | 4.5 MB 00:00 2024-09-13T16:53:56.794 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-09-13T16:53:56.811 INFO:teuthology.orchestra.run.smithi115.stdout:(13/30): python3-rgw-18.2.4-843.g2c01458a.el9.x 914 kB/s | 99 kB 00:00 2024-09-13T16:53:56.828 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-09-13T16:53:56.828 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-09-13T16:53:56.904 INFO:teuthology.orchestra.run.smithi115.stdout:(14/30): librabbitmq-0.11.0-7.el9.x86_64.rpm 493 kB/s | 45 kB 00:00 2024-09-13T16:53:56.928 INFO:teuthology.orchestra.run.smithi115.stdout:(15/30): boost-program-options-1.75.0-8.el9.x86 533 kB/s | 107 kB 00:00 2024-09-13T16:53:56.954 INFO:teuthology.orchestra.run.smithi115.stdout:(16/30): libpmemobj-1.12.1-1.el9.x86_64.rpm 958 kB/s | 160 kB 00:00 2024-09-13T16:53:56.996 INFO:teuthology.orchestra.run.smithi115.stdout:(17/30): python3-prettytable-0.7.2-27.el9.noarc 1.0 MB/s | 42 kB 00:00 2024-09-13T16:53:57.030 INFO:teuthology.orchestra.run.smithi115.stdout:(18/30): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.8 MB/s | 292 kB 00:00 2024-09-13T16:53:57.071 INFO:teuthology.orchestra.run.smithi115.stdout:(19/30): librdkafka-1.6.1-102.el9.x86_64.rpm 3.9 MB/s | 662 kB 00:00 2024-09-13T16:53:57.107 INFO:teuthology.orchestra.run.smithi115.stdout:(20/30): fmt-8.1.1-5.el9.x86_64.rpm 999 kB/s | 111 kB 00:00 2024-09-13T16:53:57.132 INFO:teuthology.orchestra.run.smithi115.stdout:(21/30): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.1 MB/s | 26 kB 00:00 2024-09-13T16:53:57.158 INFO:teuthology.orchestra.run.smithi115.stdout:(22/30): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.3 MB/s | 308 kB 00:00 2024-09-13T16:53:57.183 INFO:teuthology.orchestra.run.smithi115.stdout:(23/30): liboath-2.6.7-2.el9.x86_64.rpm 969 kB/s | 49 kB 00:00 2024-09-13T16:53:57.208 INFO:teuthology.orchestra.run.smithi115.stdout:(24/30): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-13T16:53:57.250 INFO:teuthology.orchestra.run.smithi115.stdout:(25/30): parquet-libs-9.0.0-11.el9.x86_64.rpm 12 MB/s | 839 kB 00:00 2024-09-13T16:53:57.275 INFO:teuthology.orchestra.run.smithi115.stdout:(26/30): re2-20211101-20.el9.x86_64.rpm 2.8 MB/s | 191 kB 00:00 2024-09-13T16:53:57.367 INFO:teuthology.orchestra.run.smithi115.stdout:(27/30): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-09-13T16:53:57.446 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-09-13T16:53:57.446 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-09-13T16:53:57.461 INFO:teuthology.orchestra.run.smithi115.stdout:(28/30): libarrow-9.0.0-11.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-09-13T16:53:57.526 INFO:teuthology.orchestra.run.smithi115.stdout:(29/30): librados2-18.2.4-843.g2c01458a.el9.x86 13 MB/s | 3.3 MB 00:00 2024-09-13T16:53:57.593 INFO:teuthology.orchestra.run.smithi115.stdout:(30/30): librbd1-18.2.4-843.g2c01458a.el9.x86_6 13 MB/s | 3.0 MB 00:00 2024-09-13T16:53:57.597 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2024-09-13T16:53:57.598 INFO:teuthology.orchestra.run.smithi115.stdout:Total 24 MB/s | 53 MB 00:02 2024-09-13T16:53:57.671 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2024-09-13T16:53:57.705 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction check succeeded. 2024-09-13T16:53:57.705 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2024-09-13T16:53:58.370 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded. 2024-09-13T16:53:58.370 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2024-09-13T16:53:58.833 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-09-13T16:53:58.922 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/32 2024-09-13T16:53:58.966 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/32 2024-09-13T16:53:59.176 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/32 2024-09-13T16:53:59.491 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/32 2024-09-13T16:53:59.600 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : librados2-2:18.2.4-843.g2c01458a.el9.x86_64 5/32 2024-09-13T16:53:59.675 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librados2-2:18.2.4-843.g2c01458a.el9.x86_64 5/32 2024-09-13T16:53:59.767 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-rados-2:18.2.4-843.g2c01458a.el9.x86_64 6/32 2024-09-13T16:53:59.802 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libcephfs2-2:18.2.4-843.g2c01458a.el9.x86_64 7/32 2024-09-13T16:53:59.826 INFO:teuthology.orchestra.run.smithi115.stdout: Preparing : 1/1 2024-09-13T16:53:59.864 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libcephfs2-2:18.2.4-843.g2c01458a.el9.x86_64 7/32 2024-09-13T16:53:59.893 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : liboath-2.6.7-2.el9.x86_64 8/32 2024-09-13T16:53:59.910 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/32 2024-09-13T16:53:59.936 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-ceph-argparse-2:18.2.4-843.g2c01458a.el9.x 9/32 2024-09-13T16:53:59.939 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/32 2024-09-13T16:53:59.989 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/32 2024-09-13T16:54:00.002 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cephfs-2:18.2.4-843.g2c01458a.el9.x86_64 10/32 2024-09-13T16:54:00.029 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libradosstriper1-2:18.2.4-843.g2c01458a.el9.x86_64 11/32 2024-09-13T16:54:00.094 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libradosstriper1-2:18.2.4-843.g2c01458a.el9.x86_64 11/32 2024-09-13T16:54:00.200 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : re2-1:20211101-20.el9.x86_64 12/32 2024-09-13T16:54:00.227 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 13/32 2024-09-13T16:54:00.277 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/32 2024-09-13T16:54:00.309 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/32 2024-09-13T16:54:00.336 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 16/32 2024-09-13T16:54:00.338 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/32 2024-09-13T16:54:00.373 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : fmt-8.1.1-5.el9.x86_64 17/32 2024-09-13T16:54:00.405 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : librados2-2:18.2.4-843.g2c01458a.el9.x86_64 5/32 2024-09-13T16:54:00.405 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 18/32 2024-09-13T16:54:00.497 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: librados2-2:18.2.4-843.g2c01458a.el9.x86_64 5/32 2024-09-13T16:54:00.582 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-rados-2:18.2.4-843.g2c01458a.el9.x86_64 6/32 2024-09-13T16:54:00.607 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libcephfs2-2:18.2.4-843.g2c01458a.el9.x86_64 7/32 2024-09-13T16:54:00.669 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libcephfs2-2:18.2.4-843.g2c01458a.el9.x86_64 7/32 2024-09-13T16:54:00.698 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : liboath-2.6.7-2.el9.x86_64 8/32 2024-09-13T16:54:00.709 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 19/32 2024-09-13T16:54:00.741 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-ceph-argparse-2:18.2.4-843.g2c01458a.el9.x 9/32 2024-09-13T16:54:00.760 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : librbd1-2:18.2.4-843.g2c01458a.el9.x86_64 20/32 2024-09-13T16:54:00.808 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-cephfs-2:18.2.4-843.g2c01458a.el9.x86_64 10/32 2024-09-13T16:54:00.834 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libradosstriper1-2:18.2.4-843.g2c01458a.el9.x86_64 11/32 2024-09-13T16:54:00.850 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librbd1-2:18.2.4-843.g2c01458a.el9.x86_64 20/32 2024-09-13T16:54:00.883 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libradosstriper1-2:18.2.4-843.g2c01458a.el9.x86_64 11/32 2024-09-13T16:54:00.889 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-rbd-2:18.2.4-843.g2c01458a.el9.x86_64 21/32 2024-09-13T16:54:00.934 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 22/32 2024-09-13T16:54:00.997 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : re2-1:20211101-20.el9.x86_64 12/32 2024-09-13T16:54:01.040 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 13/32 2024-09-13T16:54:01.090 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/32 2024-09-13T16:54:01.131 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/32 2024-09-13T16:54:01.158 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 16/32 2024-09-13T16:54:01.194 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : fmt-8.1.1-5.el9.x86_64 17/32 2024-09-13T16:54:01.232 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 18/32 2024-09-13T16:54:01.349 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 23/32 2024-09-13T16:54:01.379 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : librgw2-2:18.2.4-843.g2c01458a.el9.x86_64 24/32 2024-09-13T16:54:01.450 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librgw2-2:18.2.4-843.g2c01458a.el9.x86_64 24/32 2024-09-13T16:54:01.518 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-rgw-2:18.2.4-843.g2c01458a.el9.x86_64 25/32 2024-09-13T16:54:01.525 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 19/32 2024-09-13T16:54:01.548 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-ceph-common-2:18.2.4-843.g2c01458a.el9.x86 26/32 2024-09-13T16:54:01.573 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : librbd1-2:18.2.4-843.g2c01458a.el9.x86_64 20/32 2024-09-13T16:54:01.664 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: librbd1-2:18.2.4-843.g2c01458a.el9.x86_64 20/32 2024-09-13T16:54:01.695 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-rbd-2:18.2.4-843.g2c01458a.el9.x86_64 21/32 2024-09-13T16:54:01.738 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 22/32 2024-09-13T16:54:02.143 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 23/32 2024-09-13T16:54:02.176 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : librgw2-2:18.2.4-843.g2c01458a.el9.x86_64 24/32 2024-09-13T16:54:02.230 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: librgw2-2:18.2.4-843.g2c01458a.el9.x86_64 24/32 2024-09-13T16:54:02.297 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-rgw-2:18.2.4-843.g2c01458a.el9.x86_64 25/32 2024-09-13T16:54:02.328 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-ceph-common-2:18.2.4-843.g2c01458a.el9.x86 26/32 2024-09-13T16:54:03.683 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-common-2:18.2.4-843.g2c01458a.el9.x86_64 27/32 2024-09-13T16:54:03.720 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-common-2:18.2.4-843.g2c01458a.el9.x86_64 27/32 2024-09-13T16:54:04.288 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-common-2:18.2.4-843.g2c01458a.el9.x86_64 27/32 2024-09-13T16:54:04.331 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-base-2:18.2.4-843.g2c01458a.el9.x86_64 28/32 2024-09-13T16:54:04.435 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-base-2:18.2.4-843.g2c01458a.el9.x86_64 28/32 2024-09-13T16:54:04.436 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-13T16:54:04.436 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-13T16:54:04.436 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:54:04.451 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-common-2:18.2.4-843.g2c01458a.el9.x86_64 27/32 2024-09-13T16:54:04.466 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-selinux-2:18.2.4-843.g2c01458a.el9.x86_64 29/32 2024-09-13T16:54:04.483 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-common-2:18.2.4-843.g2c01458a.el9.x86_64 27/32 2024-09-13T16:54:05.033 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-common-2:18.2.4-843.g2c01458a.el9.x86_64 27/32 2024-09-13T16:54:05.069 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-base-2:18.2.4-843.g2c01458a.el9.x86_64 28/32 2024-09-13T16:54:05.169 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-base-2:18.2.4-843.g2c01458a.el9.x86_64 28/32 2024-09-13T16:54:05.169 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-13T16:54:05.169 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-13T16:54:05.169 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T16:54:05.214 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-selinux-2:18.2.4-843.g2c01458a.el9.x86_64 29/32 2024-09-13T16:54:14.415 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-selinux-2:18.2.4-843.g2c01458a.el9.x86_64 29/32 2024-09-13T16:54:14.415 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /sys 2024-09-13T16:54:14.415 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /proc 2024-09-13T16:54:14.415 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /mnt 2024-09-13T16:54:14.415 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /var/tmp 2024-09-13T16:54:14.415 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /home 2024-09-13T16:54:14.415 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /root 2024-09-13T16:54:14.416 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /tmp 2024-09-13T16:54:14.416 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:54:15.149 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-radosgw-2:18.2.4-843.g2c01458a.el9.x86_64 30/32 2024-09-13T16:54:15.174 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-radosgw-2:18.2.4-843.g2c01458a.el9.x86_64 30/32 2024-09-13T16:54:15.175 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T16:54:15.175 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-13T16:54:15.175 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T16:54:15.175 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T16:54:15.175 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:54:15.177 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-09-13T16:54:15.183 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-selinux-2:18.2.4-843.g2c01458a.el9.x86_64 29/32 2024-09-13T16:54:15.183 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /sys 2024-09-13T16:54:15.184 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /proc 2024-09-13T16:54:15.184 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /mnt 2024-09-13T16:54:15.184 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /var/tmp 2024-09-13T16:54:15.184 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /home 2024-09-13T16:54:15.184 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /root 2024-09-13T16:54:15.184 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /tmp 2024-09-13T16:54:15.184 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T16:54:15.260 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-09-13T16:54:15.260 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 32/32 2024-09-13T16:54:15.912 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-radosgw-2:18.2.4-843.g2c01458a.el9.x86_64 30/32 2024-09-13T16:54:15.937 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-radosgw-2:18.2.4-843.g2c01458a.el9.x86_64 30/32 2024-09-13T16:54:15.937 INFO:teuthology.orchestra.run.smithi115.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T16:54:15.938 INFO:teuthology.orchestra.run.smithi115.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-13T16:54:15.938 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T16:54:15.938 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T16:54:15.938 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T16:54:15.940 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-09-13T16:54:16.032 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-09-13T16:54:16.032 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 32/32 2024-09-13T16:54:16.439 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 32/32 2024-09-13T16:54:16.439 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-base-2:18.2.4-843.g2c01458a.el9.x86_64 1/32 2024-09-13T16:54:16.439 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-common-2:18.2.4-843.g2c01458a.el9.x86_64 2/32 2024-09-13T16:54:16.439 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-radosgw-2:18.2.4-843.g2c01458a.el9.x86_64 3/32 2024-09-13T16:54:16.439 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-selinux-2:18.2.4-843.g2c01458a.el9.x86_64 4/32 2024-09-13T16:54:16.439 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libcephfs2-2:18.2.4-843.g2c01458a.el9.x86_64 5/32 2024-09-13T16:54:16.439 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libradosstriper1-2:18.2.4-843.g2c01458a.el9.x86_64 6/32 2024-09-13T16:54:16.439 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librgw2-2:18.2.4-843.g2c01458a.el9.x86_64 7/32 2024-09-13T16:54:16.439 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-ceph-argparse-2:18.2.4-843.g2c01458a.el9.x 8/32 2024-09-13T16:54:16.439 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-ceph-common-2:18.2.4-843.g2c01458a.el9.x86 9/32 2024-09-13T16:54:16.440 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cephfs-2:18.2.4-843.g2c01458a.el9.x86_64 10/32 2024-09-13T16:54:16.440 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-rados-2:18.2.4-843.g2c01458a.el9.x86_64 11/32 2024-09-13T16:54:16.440 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-rbd-2:18.2.4-843.g2c01458a.el9.x86_64 12/32 2024-09-13T16:54:16.440 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-rgw-2:18.2.4-843.g2c01458a.el9.x86_64 13/32 2024-09-13T16:54:16.440 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/32 2024-09-13T16:54:16.440 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/32 2024-09-13T16:54:16.440 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/32 2024-09-13T16:54:16.440 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/32 2024-09-13T16:54:16.440 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/32 2024-09-13T16:54:16.440 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/32 2024-09-13T16:54:16.440 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 20/32 2024-09-13T16:54:16.440 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 21/32 2024-09-13T16:54:16.441 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 22/32 2024-09-13T16:54:16.441 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 23/32 2024-09-13T16:54:16.441 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 24/32 2024-09-13T16:54:16.441 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 25/32 2024-09-13T16:54:16.441 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 26/32 2024-09-13T16:54:16.441 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : re2-1:20211101-20.el9.x86_64 27/32 2024-09-13T16:54:16.441 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 28/32 2024-09-13T16:54:16.441 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librados2-2:18.2.4-843.g2c01458a.el9.x86_64 29/32 2024-09-13T16:54:16.441 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 30/32 2024-09-13T16:54:16.441 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librbd1-2:18.2.4-843.g2c01458a.el9.x86_64 31/32 2024-09-13T16:54:17.277 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 32/32 2024-09-13T16:54:17.277 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-base-2:18.2.4-843.g2c01458a.el9.x86_64 1/32 2024-09-13T16:54:17.277 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-common-2:18.2.4-843.g2c01458a.el9.x86_64 2/32 2024-09-13T16:54:17.277 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-radosgw-2:18.2.4-843.g2c01458a.el9.x86_64 3/32 2024-09-13T16:54:17.277 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-selinux-2:18.2.4-843.g2c01458a.el9.x86_64 4/32 2024-09-13T16:54:17.278 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libcephfs2-2:18.2.4-843.g2c01458a.el9.x86_64 5/32 2024-09-13T16:54:17.278 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libradosstriper1-2:18.2.4-843.g2c01458a.el9.x86_64 6/32 2024-09-13T16:54:17.278 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librgw2-2:18.2.4-843.g2c01458a.el9.x86_64 7/32 2024-09-13T16:54:17.278 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-ceph-argparse-2:18.2.4-843.g2c01458a.el9.x 8/32 2024-09-13T16:54:17.278 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-ceph-common-2:18.2.4-843.g2c01458a.el9.x86 9/32 2024-09-13T16:54:17.278 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-cephfs-2:18.2.4-843.g2c01458a.el9.x86_64 10/32 2024-09-13T16:54:17.278 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-rados-2:18.2.4-843.g2c01458a.el9.x86_64 11/32 2024-09-13T16:54:17.278 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-rbd-2:18.2.4-843.g2c01458a.el9.x86_64 12/32 2024-09-13T16:54:17.278 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-rgw-2:18.2.4-843.g2c01458a.el9.x86_64 13/32 2024-09-13T16:54:17.278 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/32 2024-09-13T16:54:17.278 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/32 2024-09-13T16:54:17.278 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/32 2024-09-13T16:54:17.278 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/32 2024-09-13T16:54:17.279 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/32 2024-09-13T16:54:17.279 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/32 2024-09-13T16:54:17.279 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 20/32 2024-09-13T16:54:17.279 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 21/32 2024-09-13T16:54:17.279 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 22/32 2024-09-13T16:54:17.279 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 23/32 2024-09-13T16:54:17.279 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 24/32 2024-09-13T16:54:17.279 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 25/32 2024-09-13T16:54:17.279 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 26/32 2024-09-13T16:54:17.279 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : re2-1:20211101-20.el9.x86_64 27/32 2024-09-13T16:54:17.279 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 28/32 2024-09-13T16:54:17.279 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librados2-2:18.2.4-843.g2c01458a.el9.x86_64 29/32 2024-09-13T16:54:17.279 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 30/32 2024-09-13T16:54:17.279 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librbd1-2:18.2.4-843.g2c01458a.el9.x86_64 31/32 2024-09-13T16:54:17.416 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 32/32 2024-09-13T16:54:17.416 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:54:17.417 INFO:teuthology.orchestra.run.smithi195.stdout:Upgraded: 2024-09-13T16:54:17.417 INFO:teuthology.orchestra.run.smithi195.stdout: librados2-2:18.2.4-843.g2c01458a.el9.x86_64 2024-09-13T16:54:17.417 INFO:teuthology.orchestra.run.smithi195.stdout: librbd1-2:18.2.4-843.g2c01458a.el9.x86_64 2024-09-13T16:54:17.417 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-09-13T16:54:17.417 INFO:teuthology.orchestra.run.smithi195.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-13T16:54:17.417 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-base-2:18.2.4-843.g2c01458a.el9.x86_64 2024-09-13T16:54:17.417 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-common-2:18.2.4-843.g2c01458a.el9.x86_64 2024-09-13T16:54:17.417 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-radosgw-2:18.2.4-843.g2c01458a.el9.x86_64 2024-09-13T16:54:17.417 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-selinux-2:18.2.4-843.g2c01458a.el9.x86_64 2024-09-13T16:54:17.417 INFO:teuthology.orchestra.run.smithi195.stdout: fmt-8.1.1-5.el9.x86_64 2024-09-13T16:54:17.417 INFO:teuthology.orchestra.run.smithi195.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-13T16:54:17.417 INFO:teuthology.orchestra.run.smithi195.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-13T16:54:17.417 INFO:teuthology.orchestra.run.smithi195.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-13T16:54:17.418 INFO:teuthology.orchestra.run.smithi195.stdout: libcephfs2-2:18.2.4-843.g2c01458a.el9.x86_64 2024-09-13T16:54:17.418 INFO:teuthology.orchestra.run.smithi195.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-13T16:54:17.418 INFO:teuthology.orchestra.run.smithi195.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-13T16:54:17.418 INFO:teuthology.orchestra.run.smithi195.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-13T16:54:17.418 INFO:teuthology.orchestra.run.smithi195.stdout: libradosstriper1-2:18.2.4-843.g2c01458a.el9.x86_64 2024-09-13T16:54:17.418 INFO:teuthology.orchestra.run.smithi195.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-13T16:54:17.418 INFO:teuthology.orchestra.run.smithi195.stdout: librgw2-2:18.2.4-843.g2c01458a.el9.x86_64 2024-09-13T16:54:17.418 INFO:teuthology.orchestra.run.smithi195.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-13T16:54:17.418 INFO:teuthology.orchestra.run.smithi195.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-13T16:54:17.418 INFO:teuthology.orchestra.run.smithi195.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-13T16:54:17.418 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ceph-argparse-2:18.2.4-843.g2c01458a.el9.x86_64 2024-09-13T16:54:17.418 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ceph-common-2:18.2.4-843.g2c01458a.el9.x86_64 2024-09-13T16:54:17.418 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cephfs-2:18.2.4-843.g2c01458a.el9.x86_64 2024-09-13T16:54:17.418 INFO:teuthology.orchestra.run.smithi195.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-13T16:54:17.419 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rados-2:18.2.4-843.g2c01458a.el9.x86_64 2024-09-13T16:54:17.419 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rbd-2:18.2.4-843.g2c01458a.el9.x86_64 2024-09-13T16:54:17.419 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rgw-2:18.2.4-843.g2c01458a.el9.x86_64 2024-09-13T16:54:17.419 INFO:teuthology.orchestra.run.smithi195.stdout: re2-1:20211101-20.el9.x86_64 2024-09-13T16:54:17.419 INFO:teuthology.orchestra.run.smithi195.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-13T16:54:17.419 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:54:17.419 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-09-13T16:54:17.796 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install ceph-test 2024-09-13T16:54:18.226 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 32/32 2024-09-13T16:54:18.226 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T16:54:18.226 INFO:teuthology.orchestra.run.smithi115.stdout:Upgraded: 2024-09-13T16:54:18.226 INFO:teuthology.orchestra.run.smithi115.stdout: librados2-2:18.2.4-843.g2c01458a.el9.x86_64 2024-09-13T16:54:18.226 INFO:teuthology.orchestra.run.smithi115.stdout: librbd1-2:18.2.4-843.g2c01458a.el9.x86_64 2024-09-13T16:54:18.226 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2024-09-13T16:54:18.227 INFO:teuthology.orchestra.run.smithi115.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-13T16:54:18.227 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-base-2:18.2.4-843.g2c01458a.el9.x86_64 2024-09-13T16:54:18.227 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-common-2:18.2.4-843.g2c01458a.el9.x86_64 2024-09-13T16:54:18.227 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-radosgw-2:18.2.4-843.g2c01458a.el9.x86_64 2024-09-13T16:54:18.227 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-selinux-2:18.2.4-843.g2c01458a.el9.x86_64 2024-09-13T16:54:18.227 INFO:teuthology.orchestra.run.smithi115.stdout: fmt-8.1.1-5.el9.x86_64 2024-09-13T16:54:18.227 INFO:teuthology.orchestra.run.smithi115.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-13T16:54:18.227 INFO:teuthology.orchestra.run.smithi115.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-13T16:54:18.227 INFO:teuthology.orchestra.run.smithi115.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-13T16:54:18.227 INFO:teuthology.orchestra.run.smithi115.stdout: libcephfs2-2:18.2.4-843.g2c01458a.el9.x86_64 2024-09-13T16:54:18.227 INFO:teuthology.orchestra.run.smithi115.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-13T16:54:18.227 INFO:teuthology.orchestra.run.smithi115.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-13T16:54:18.228 INFO:teuthology.orchestra.run.smithi115.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-13T16:54:18.228 INFO:teuthology.orchestra.run.smithi115.stdout: libradosstriper1-2:18.2.4-843.g2c01458a.el9.x86_64 2024-09-13T16:54:18.228 INFO:teuthology.orchestra.run.smithi115.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-13T16:54:18.228 INFO:teuthology.orchestra.run.smithi115.stdout: librgw2-2:18.2.4-843.g2c01458a.el9.x86_64 2024-09-13T16:54:18.228 INFO:teuthology.orchestra.run.smithi115.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-13T16:54:18.228 INFO:teuthology.orchestra.run.smithi115.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-13T16:54:18.228 INFO:teuthology.orchestra.run.smithi115.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-13T16:54:18.228 INFO:teuthology.orchestra.run.smithi115.stdout: python3-ceph-argparse-2:18.2.4-843.g2c01458a.el9.x86_64 2024-09-13T16:54:18.228 INFO:teuthology.orchestra.run.smithi115.stdout: python3-ceph-common-2:18.2.4-843.g2c01458a.el9.x86_64 2024-09-13T16:54:18.228 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cephfs-2:18.2.4-843.g2c01458a.el9.x86_64 2024-09-13T16:54:18.229 INFO:teuthology.orchestra.run.smithi115.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-13T16:54:18.229 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rados-2:18.2.4-843.g2c01458a.el9.x86_64 2024-09-13T16:54:18.229 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rbd-2:18.2.4-843.g2c01458a.el9.x86_64 2024-09-13T16:54:18.229 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rgw-2:18.2.4-843.g2c01458a.el9.x86_64 2024-09-13T16:54:18.229 INFO:teuthology.orchestra.run.smithi115.stdout: re2-1:20211101-20.el9.x86_64 2024-09-13T16:54:18.229 INFO:teuthology.orchestra.run.smithi115.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-13T16:54:18.229 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T16:54:18.229 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-09-13T16:54:18.363 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:00:27 ago on Fri 13 Sep 2024 04:53:51 PM UTC. 2024-09-13T16:54:18.495 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-09-13T16:54:18.496 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T16:54:18.496 INFO:teuthology.orchestra.run.smithi195.stdout: Package Arch Version Repository Size 2024-09-13T16:54:18.496 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T16:54:18.496 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-09-13T16:54:18.496 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-test x86_64 2:18.2.4-843.g2c01458a.el9 ceph 40 M 2024-09-13T16:54:18.496 INFO:teuthology.orchestra.run.smithi195.stdout:Installing dependencies: 2024-09-13T16:54:18.496 INFO:teuthology.orchestra.run.smithi195.stdout: libcephsqlite x86_64 2:18.2.4-843.g2c01458a.el9 ceph 166 k 2024-09-13T16:54:18.496 INFO:teuthology.orchestra.run.smithi195.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-13T16:54:18.497 INFO:teuthology.orchestra.run.smithi195.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-13T16:54:18.497 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:54:18.497 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-09-13T16:54:18.497 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T16:54:18.497 INFO:teuthology.orchestra.run.smithi195.stdout:Install 4 Packages 2024-09-13T16:54:18.497 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:54:18.498 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 40 M 2024-09-13T16:54:18.498 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 164 M 2024-09-13T16:54:18.498 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-09-13T16:54:18.509 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install ceph-test 2024-09-13T16:54:18.781 INFO:teuthology.orchestra.run.smithi195.stdout:(1/4): libcephsqlite-18.2.4-843.g2c01458a.el9.x 711 kB/s | 166 kB 00:00 2024-09-13T16:54:18.807 INFO:teuthology.orchestra.run.smithi195.stdout:(2/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.2 MB/s | 304 kB 00:00 2024-09-13T16:54:18.949 INFO:teuthology.orchestra.run.smithi195.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 381 kB/s | 64 kB 00:00 2024-09-13T16:54:19.070 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:00:26 ago on Fri 13 Sep 2024 04:53:53 PM UTC. 2024-09-13T16:54:19.209 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-09-13T16:54:19.209 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T16:54:19.209 INFO:teuthology.orchestra.run.smithi115.stdout: Package Arch Version Repository Size 2024-09-13T16:54:19.210 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T16:54:19.210 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2024-09-13T16:54:19.210 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-test x86_64 2:18.2.4-843.g2c01458a.el9 ceph 40 M 2024-09-13T16:54:19.210 INFO:teuthology.orchestra.run.smithi115.stdout:Installing dependencies: 2024-09-13T16:54:19.210 INFO:teuthology.orchestra.run.smithi115.stdout: libcephsqlite x86_64 2:18.2.4-843.g2c01458a.el9 ceph 166 k 2024-09-13T16:54:19.210 INFO:teuthology.orchestra.run.smithi115.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-13T16:54:19.210 INFO:teuthology.orchestra.run.smithi115.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-13T16:54:19.210 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T16:54:19.210 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2024-09-13T16:54:19.210 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T16:54:19.210 INFO:teuthology.orchestra.run.smithi115.stdout:Install 4 Packages 2024-09-13T16:54:19.210 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T16:54:19.211 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 40 M 2024-09-13T16:54:19.211 INFO:teuthology.orchestra.run.smithi115.stdout:Installed size: 164 M 2024-09-13T16:54:19.211 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading Packages: 2024-09-13T16:54:19.422 INFO:teuthology.orchestra.run.smithi115.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.8 MB/s | 304 kB 00:00 2024-09-13T16:54:19.464 INFO:teuthology.orchestra.run.smithi115.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-09-13T16:54:19.506 INFO:teuthology.orchestra.run.smithi115.stdout:(3/4): libcephsqlite-18.2.4-843.g2c01458a.el9.x 672 kB/s | 166 kB 00:00 2024-09-13T16:54:21.123 INFO:teuthology.orchestra.run.smithi115.stdout:(4/4): ceph-test-18.2.4-843.g2c01458a.el9.x86_6 21 MB/s | 40 MB 00:01 2024-09-13T16:54:21.125 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2024-09-13T16:54:21.125 INFO:teuthology.orchestra.run.smithi115.stdout:Total 21 MB/s | 40 MB 00:01 2024-09-13T16:54:21.152 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2024-09-13T16:54:21.172 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction check succeeded. 2024-09-13T16:54:21.172 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2024-09-13T16:54:21.290 INFO:teuthology.orchestra.run.smithi195.stdout:(4/4): ceph-test-18.2.4-843.g2c01458a.el9.x86_6 14 MB/s | 40 MB 00:02 2024-09-13T16:54:21.292 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-09-13T16:54:21.293 INFO:teuthology.orchestra.run.smithi195.stdout:Total 14 MB/s | 40 MB 00:02 2024-09-13T16:54:21.319 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-09-13T16:54:21.339 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-09-13T16:54:21.340 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-09-13T16:54:21.504 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded. 2024-09-13T16:54:21.504 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2024-09-13T16:54:21.669 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-09-13T16:54:21.669 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-09-13T16:54:21.976 INFO:teuthology.orchestra.run.smithi115.stdout: Preparing : 1/1 2024-09-13T16:54:22.068 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-13T16:54:22.114 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-13T16:54:22.140 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-09-13T16:54:22.141 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libcephsqlite-2:18.2.4-843.g2c01458a.el9.x86_64 3/4 2024-09-13T16:54:22.218 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-13T16:54:22.256 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-13T16:54:22.284 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libcephsqlite-2:18.2.4-843.g2c01458a.el9.x86_64 3/4 2024-09-13T16:54:25.971 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libcephsqlite-2:18.2.4-843.g2c01458a.el9.x86_64 3/4 2024-09-13T16:54:25.990 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libcephsqlite-2:18.2.4-843.g2c01458a.el9.x86_64 3/4 2024-09-13T16:54:26.055 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-test-2:18.2.4-843.g2c01458a.el9.x86_64 4/4 2024-09-13T16:54:26.065 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-test-2:18.2.4-843.g2c01458a.el9.x86_64 4/4 2024-09-13T16:54:27.960 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-test-2:18.2.4-843.g2c01458a.el9.x86_64 4/4 2024-09-13T16:54:27.960 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-test-2:18.2.4-843.g2c01458a.el9.x86_64 1/4 2024-09-13T16:54:27.960 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libcephsqlite-2:18.2.4-843.g2c01458a.el9.x86_64 2/4 2024-09-13T16:54:27.960 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-13T16:54:28.045 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-test-2:18.2.4-843.g2c01458a.el9.x86_64 4/4 2024-09-13T16:54:28.045 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-test-2:18.2.4-843.g2c01458a.el9.x86_64 1/4 2024-09-13T16:54:28.045 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libcephsqlite-2:18.2.4-843.g2c01458a.el9.x86_64 2/4 2024-09-13T16:54:28.045 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-13T16:54:28.250 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-13T16:54:28.250 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T16:54:28.250 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2024-09-13T16:54:28.250 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-test-2:18.2.4-843.g2c01458a.el9.x86_64 2024-09-13T16:54:28.250 INFO:teuthology.orchestra.run.smithi115.stdout: libcephsqlite-2:18.2.4-843.g2c01458a.el9.x86_64 2024-09-13T16:54:28.250 INFO:teuthology.orchestra.run.smithi115.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-13T16:54:28.250 INFO:teuthology.orchestra.run.smithi115.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-13T16:54:28.250 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T16:54:28.250 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-09-13T16:54:28.353 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-13T16:54:28.353 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:54:28.353 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-09-13T16:54:28.353 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-test-2:18.2.4-843.g2c01458a.el9.x86_64 2024-09-13T16:54:28.354 INFO:teuthology.orchestra.run.smithi195.stdout: libcephsqlite-2:18.2.4-843.g2c01458a.el9.x86_64 2024-09-13T16:54:28.354 INFO:teuthology.orchestra.run.smithi195.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-13T16:54:28.354 INFO:teuthology.orchestra.run.smithi195.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-13T16:54:28.354 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:54:28.354 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-09-13T16:54:28.542 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install ceph 2024-09-13T16:54:28.688 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install ceph 2024-09-13T16:54:29.105 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:00:36 ago on Fri 13 Sep 2024 04:53:53 PM UTC. 2024-09-13T16:54:29.244 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-09-13T16:54:29.246 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T16:54:29.247 INFO:teuthology.orchestra.run.smithi115.stdout: Package Arch Version Repository Size 2024-09-13T16:54:29.247 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T16:54:29.247 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2024-09-13T16:54:29.247 INFO:teuthology.orchestra.run.smithi115.stdout: ceph x86_64 2:18.2.4-843.g2c01458a.el9 ceph 6.5 k 2024-09-13T16:54:29.247 INFO:teuthology.orchestra.run.smithi115.stdout:Installing dependencies: 2024-09-13T16:54:29.247 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mds x86_64 2:18.2.4-843.g2c01458a.el9 ceph 2.1 M 2024-09-13T16:54:29.247 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr x86_64 2:18.2.4-843.g2c01458a.el9 ceph 1.5 M 2024-09-13T16:54:29.247 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-modules-core noarch 2:18.2.4-843.g2c01458a.el9 ceph-noarch 246 k 2024-09-13T16:54:29.247 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mon x86_64 2:18.2.4-843.g2c01458a.el9 ceph 4.7 M 2024-09-13T16:54:29.247 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-osd x86_64 2:18.2.4-843.g2c01458a.el9 ceph 17 M 2024-09-13T16:54:29.248 INFO:teuthology.orchestra.run.smithi115.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-13T16:54:29.248 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-13T16:54:29.248 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-13T16:54:29.248 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-13T16:54:29.248 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-13T16:54:29.248 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-13T16:54:29.248 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-13T16:54:29.248 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-13T16:54:29.248 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-13T16:54:29.248 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-13T16:54:29.248 INFO:teuthology.orchestra.run.smithi115.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-13T16:54:29.248 INFO:teuthology.orchestra.run.smithi115.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-13T16:54:29.249 INFO:teuthology.orchestra.run.smithi115.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-13T16:54:29.249 INFO:teuthology.orchestra.run.smithi115.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-13T16:54:29.249 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-13T16:54:29.249 INFO:teuthology.orchestra.run.smithi115.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-13T16:54:29.249 INFO:teuthology.orchestra.run.smithi115.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-13T16:54:29.249 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-13T16:54:29.249 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-13T16:54:29.249 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-13T16:54:29.249 INFO:teuthology.orchestra.run.smithi115.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-13T16:54:29.249 INFO:teuthology.orchestra.run.smithi115.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-13T16:54:29.249 INFO:teuthology.orchestra.run.smithi115.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-13T16:54:29.249 INFO:teuthology.orchestra.run.smithi115.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-13T16:54:29.250 INFO:teuthology.orchestra.run.smithi115.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-13T16:54:29.250 INFO:teuthology.orchestra.run.smithi115.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-13T16:54:29.250 INFO:teuthology.orchestra.run.smithi115.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-13T16:54:29.250 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T16:54:29.250 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2024-09-13T16:54:29.250 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T16:54:29.250 INFO:teuthology.orchestra.run.smithi115.stdout:Install 33 Packages 2024-09-13T16:54:29.250 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T16:54:29.251 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 29 M 2024-09-13T16:54:29.251 INFO:teuthology.orchestra.run.smithi115.stdout:Installed size: 104 M 2024-09-13T16:54:29.251 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading Packages: 2024-09-13T16:54:29.256 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:00:38 ago on Fri 13 Sep 2024 04:53:51 PM UTC. 2024-09-13T16:54:29.394 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-09-13T16:54:29.396 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T16:54:29.396 INFO:teuthology.orchestra.run.smithi195.stdout: Package Arch Version Repository Size 2024-09-13T16:54:29.396 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T16:54:29.396 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-09-13T16:54:29.396 INFO:teuthology.orchestra.run.smithi195.stdout: ceph x86_64 2:18.2.4-843.g2c01458a.el9 ceph 6.5 k 2024-09-13T16:54:29.396 INFO:teuthology.orchestra.run.smithi195.stdout:Installing dependencies: 2024-09-13T16:54:29.397 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mds x86_64 2:18.2.4-843.g2c01458a.el9 ceph 2.1 M 2024-09-13T16:54:29.397 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr x86_64 2:18.2.4-843.g2c01458a.el9 ceph 1.5 M 2024-09-13T16:54:29.397 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-modules-core noarch 2:18.2.4-843.g2c01458a.el9 ceph-noarch 246 k 2024-09-13T16:54:29.397 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mon x86_64 2:18.2.4-843.g2c01458a.el9 ceph 4.7 M 2024-09-13T16:54:29.397 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-osd x86_64 2:18.2.4-843.g2c01458a.el9 ceph 17 M 2024-09-13T16:54:29.397 INFO:teuthology.orchestra.run.smithi195.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-13T16:54:29.397 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-13T16:54:29.397 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-13T16:54:29.397 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-13T16:54:29.397 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-13T16:54:29.397 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-13T16:54:29.398 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-13T16:54:29.398 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-13T16:54:29.398 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-13T16:54:29.398 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-13T16:54:29.398 INFO:teuthology.orchestra.run.smithi195.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-13T16:54:29.398 INFO:teuthology.orchestra.run.smithi195.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-13T16:54:29.398 INFO:teuthology.orchestra.run.smithi195.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-13T16:54:29.398 INFO:teuthology.orchestra.run.smithi195.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-13T16:54:29.398 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-13T16:54:29.398 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-13T16:54:29.398 INFO:teuthology.orchestra.run.smithi195.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-13T16:54:29.398 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-13T16:54:29.399 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-13T16:54:29.399 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-13T16:54:29.399 INFO:teuthology.orchestra.run.smithi195.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-13T16:54:29.399 INFO:teuthology.orchestra.run.smithi195.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-13T16:54:29.399 INFO:teuthology.orchestra.run.smithi195.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-13T16:54:29.399 INFO:teuthology.orchestra.run.smithi195.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-13T16:54:29.399 INFO:teuthology.orchestra.run.smithi195.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-13T16:54:29.399 INFO:teuthology.orchestra.run.smithi195.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-13T16:54:29.399 INFO:teuthology.orchestra.run.smithi195.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-13T16:54:29.399 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:54:29.399 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-09-13T16:54:29.400 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T16:54:29.400 INFO:teuthology.orchestra.run.smithi195.stdout:Install 33 Packages 2024-09-13T16:54:29.400 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:54:29.400 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 29 M 2024-09-13T16:54:29.401 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 104 M 2024-09-13T16:54:29.401 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-09-13T16:54:29.865 INFO:teuthology.orchestra.run.smithi115.stdout:(1/33): ceph-18.2.4-843.g2c01458a.el9.x86_64.rp 32 kB/s | 6.5 kB 00:00 2024-09-13T16:54:29.892 INFO:teuthology.orchestra.run.smithi195.stdout:(1/33): ceph-18.2.4-843.g2c01458a.el9.x86_64.rp 22 kB/s | 6.5 kB 00:00 2024-09-13T16:54:30.399 INFO:teuthology.orchestra.run.smithi115.stdout:(2/33): ceph-mgr-18.2.4-843.g2c01458a.el9.x86_6 2.0 MB/s | 1.5 MB 00:00 2024-09-13T16:54:30.515 INFO:teuthology.orchestra.run.smithi115.stdout:(3/33): ceph-mds-18.2.4-843.g2c01458a.el9.x86_6 2.5 MB/s | 2.1 MB 00:00 2024-09-13T16:54:30.657 INFO:teuthology.orchestra.run.smithi115.stdout:(4/33): ceph-mgr-modules-core-18.2.4-843.g2c014 1.7 MB/s | 246 kB 00:00 2024-09-13T16:54:30.791 INFO:teuthology.orchestra.run.smithi115.stdout:(5/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.9 MB/s | 253 kB 00:00 2024-09-13T16:54:30.891 INFO:teuthology.orchestra.run.smithi115.stdout:(6/33): python3-cryptography-36.0.1-4.el9.x86_6 12 MB/s | 1.2 MB 00:00 2024-09-13T16:54:30.933 INFO:teuthology.orchestra.run.smithi115.stdout:(7/33): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-09-13T16:54:30.975 INFO:teuthology.orchestra.run.smithi115.stdout:(8/33): python3-pycparser-2.20-6.el9.noarch.rpm 3.2 MB/s | 135 kB 00:00 2024-09-13T16:54:30.984 INFO:teuthology.orchestra.run.smithi195.stdout:(2/33): ceph-mgr-18.2.4-843.g2c01458a.el9.x86_6 1.1 MB/s | 1.5 MB 00:01 2024-09-13T16:54:31.017 INFO:teuthology.orchestra.run.smithi115.stdout:(9/33): python3-requests-2.25.1-8.el9.noarch.rp 2.9 MB/s | 125 kB 00:00 2024-09-13T16:54:31.059 INFO:teuthology.orchestra.run.smithi115.stdout:(10/33): python3-urllib3-1.26.5-6.el9.noarch.rp 5.1 MB/s | 215 kB 00:00 2024-09-13T16:54:31.101 INFO:teuthology.orchestra.run.smithi195.stdout:(3/33): ceph-mds-18.2.4-843.g2c01458a.el9.x86_6 1.4 MB/s | 2.1 MB 00:01 2024-09-13T16:54:31.234 INFO:teuthology.orchestra.run.smithi115.stdout:(11/33): python3-mako-1.1.4-6.el9.noarch.rpm 984 kB/s | 172 kB 00:00 2024-09-13T16:54:31.285 INFO:teuthology.orchestra.run.smithi115.stdout:(12/33): python3-markupsafe-1.1.1-12.el9.x86_64 693 kB/s | 35 kB 00:00 2024-09-13T16:54:31.335 INFO:teuthology.orchestra.run.smithi115.stdout:(13/33): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-13T16:54:31.360 INFO:teuthology.orchestra.run.smithi195.stdout:(4/33): ceph-mgr-modules-core-18.2.4-843.g2c014 952 kB/s | 246 kB 00:00 2024-09-13T16:54:31.385 INFO:teuthology.orchestra.run.smithi115.stdout:(14/33): python3-toml-0.10.2-6.el9.noarch.rpm 835 kB/s | 42 kB 00:00 2024-09-13T16:54:31.436 INFO:teuthology.orchestra.run.smithi115.stdout:(15/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 869 kB/s | 43 kB 00:00 2024-09-13T16:54:31.461 INFO:teuthology.orchestra.run.smithi115.stdout:(16/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 6.7 MB/s | 172 kB 00:00 2024-09-13T16:54:31.495 INFO:teuthology.orchestra.run.smithi115.stdout:(17/33): python3-cherrypy-18.6.1-2.el9.noarch.r 11 MB/s | 358 kB 00:00 2024-09-13T16:54:31.529 INFO:teuthology.orchestra.run.smithi115.stdout:(18/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 319 kB/s | 11 kB 00:00 2024-09-13T16:54:31.554 INFO:teuthology.orchestra.run.smithi115.stdout:(19/33): python3-jaraco-classes-3.2.1-5.el9.noa 712 kB/s | 18 kB 00:00 2024-09-13T16:54:31.560 INFO:teuthology.orchestra.run.smithi195.stdout:(5/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.2 MB/s | 253 kB 00:00 2024-09-13T16:54:31.579 INFO:teuthology.orchestra.run.smithi115.stdout:(20/33): python3-jaraco-collections-3.0.0-8.el9 926 kB/s | 23 kB 00:00 2024-09-13T16:54:31.596 INFO:teuthology.orchestra.run.smithi115.stdout:(21/33): python3-jaraco-functools-3.5.0-2.el9.n 1.1 MB/s | 19 kB 00:00 2024-09-13T16:54:31.613 INFO:teuthology.orchestra.run.smithi115.stdout:(22/33): python3-jaraco-text-3.2.0-6.el9.noarch 1.2 MB/s | 20 kB 00:00 2024-09-13T16:54:31.630 INFO:teuthology.orchestra.run.smithi115.stdout:(23/33): python3-logutils-0.3.5-21.el9.noarch.r 2.7 MB/s | 46 kB 00:00 2024-09-13T16:54:31.655 INFO:teuthology.orchestra.run.smithi115.stdout:(24/33): python3-more-itertools-8.12.0-2.el9.no 3.1 MB/s | 79 kB 00:00 2024-09-13T16:54:31.685 INFO:teuthology.orchestra.run.smithi195.stdout:(6/33): python3-cryptography-36.0.1-4.el9.x86_6 9.8 MB/s | 1.2 MB 00:00 2024-09-13T16:54:31.689 INFO:teuthology.orchestra.run.smithi115.stdout:(25/33): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-13T16:54:31.706 INFO:teuthology.orchestra.run.smithi115.stdout:(26/33): python3-portend-3.1.0-2.el9.noarch.rpm 1.0 MB/s | 16 kB 00:00 2024-09-13T16:54:31.731 INFO:teuthology.orchestra.run.smithi115.stdout:(27/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 3.5 MB/s | 90 kB 00:00 2024-09-13T16:54:31.735 INFO:teuthology.orchestra.run.smithi195.stdout:(7/33): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-13T16:54:31.756 INFO:teuthology.orchestra.run.smithi115.stdout:(28/33): python3-tempora-5.0.0-2.el9.noarch.rpm 1.4 MB/s | 36 kB 00:00 2024-09-13T16:54:31.790 INFO:teuthology.orchestra.run.smithi115.stdout:(29/33): python3-webob-1.8.8-2.el9.noarch.rpm 6.7 MB/s | 230 kB 00:00 2024-09-13T16:54:31.794 INFO:teuthology.orchestra.run.smithi195.stdout:(8/33): python3-pycparser-2.20-6.el9.noarch.rpm 2.3 MB/s | 135 kB 00:00 2024-09-13T16:54:31.832 INFO:teuthology.orchestra.run.smithi115.stdout:(30/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 10 MB/s | 427 kB 00:00 2024-09-13T16:54:31.844 INFO:teuthology.orchestra.run.smithi195.stdout:(9/33): python3-requests-2.25.1-8.el9.noarch.rp 2.4 MB/s | 125 kB 00:00 2024-09-13T16:54:31.857 INFO:teuthology.orchestra.run.smithi115.stdout:(31/33): python3-zc-lockfile-2.0-10.el9.noarch. 798 kB/s | 20 kB 00:00 2024-09-13T16:54:31.903 INFO:teuthology.orchestra.run.smithi195.stdout:(10/33): python3-urllib3-1.26.5-6.el9.noarch.rp 3.6 MB/s | 215 kB 00:00 2024-09-13T16:54:32.324 INFO:teuthology.orchestra.run.smithi115.stdout:(32/33): ceph-osd-18.2.4-843.g2c01458a.el9.x86_ 8.6 MB/s | 17 MB 00:01 2024-09-13T16:54:32.445 INFO:teuthology.orchestra.run.smithi195.stdout:(11/33): ceph-mon-18.2.4-843.g2c01458a.el9.x86_ 1.8 MB/s | 4.7 MB 00:02 2024-09-13T16:54:32.479 INFO:teuthology.orchestra.run.smithi195.stdout:(12/33): python3-mako-1.1.4-6.el9.noarch.rpm 299 kB/s | 172 kB 00:00 2024-09-13T16:54:32.596 INFO:teuthology.orchestra.run.smithi195.stdout:(13/33): python3-pytz-2021.1-5.el9.noarch.rpm 437 kB/s | 51 kB 00:00 2024-09-13T16:54:32.712 INFO:teuthology.orchestra.run.smithi195.stdout:(14/33): python3-toml-0.10.2-6.el9.noarch.rpm 357 kB/s | 42 kB 00:00 2024-09-13T16:54:32.737 INFO:teuthology.orchestra.run.smithi195.stdout:(15/33): python3-markupsafe-1.1.1-12.el9.x86_64 119 kB/s | 35 kB 00:00 2024-09-13T16:54:32.780 INFO:teuthology.orchestra.run.smithi195.stdout:(16/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 650 kB/s | 43 kB 00:00 2024-09-13T16:54:33.075 INFO:teuthology.orchestra.run.smithi115.stdout:(33/33): ceph-mon-18.2.4-843.g2c01458a.el9.x86_ 1.5 MB/s | 4.7 MB 00:03 2024-09-13T16:54:33.075 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2024-09-13T16:54:33.075 INFO:teuthology.orchestra.run.smithi115.stdout:Total 7.9 MB/s | 29 MB 00:03 2024-09-13T16:54:33.076 INFO:teuthology.orchestra.run.smithi195.stdout:(17/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 2.2 MB/s | 172 kB 00:00 2024-09-13T16:54:33.076 INFO:teuthology.orchestra.run.smithi195.stdout:(18/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 431 kB/s | 11 kB 00:00 2024-09-13T16:54:33.077 INFO:teuthology.orchestra.run.smithi195.stdout:(19/33): python3-jaraco-classes-3.2.1-5.el9.noa 702 kB/s | 18 kB 00:00 2024-09-13T16:54:33.077 INFO:teuthology.orchestra.run.smithi195.stdout:(20/33): python3-jaraco-collections-3.0.0-8.el9 927 kB/s | 23 kB 00:00 2024-09-13T16:54:33.077 INFO:teuthology.orchestra.run.smithi195.stdout:(21/33): python3-cherrypy-18.6.1-2.el9.noarch.r 2.5 MB/s | 358 kB 00:00 2024-09-13T16:54:33.077 INFO:teuthology.orchestra.run.smithi195.stdout:(22/33): python3-jaraco-functools-3.5.0-2.el9.n 332 kB/s | 19 kB 00:00 2024-09-13T16:54:33.077 INFO:teuthology.orchestra.run.smithi195.stdout:(23/33): python3-jaraco-text-3.2.0-6.el9.noarch 392 kB/s | 20 kB 00:00 2024-09-13T16:54:33.077 INFO:teuthology.orchestra.run.smithi195.stdout:(24/33): python3-logutils-0.3.5-21.el9.noarch.r 924 kB/s | 46 kB 00:00 2024-09-13T16:54:33.077 INFO:teuthology.orchestra.run.smithi195.stdout:(25/33): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-13T16:54:33.077 INFO:teuthology.orchestra.run.smithi195.stdout:(26/33): python3-portend-3.1.0-2.el9.noarch.rpm 662 kB/s | 16 kB 00:00 2024-09-13T16:54:33.077 INFO:teuthology.orchestra.run.smithi195.stdout:(27/33): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-09-13T16:54:33.082 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2024-09-13T16:54:33.108 INFO:teuthology.orchestra.run.smithi195.stdout:(28/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.5 MB/s | 90 kB 00:00 2024-09-13T16:54:33.120 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction check succeeded. 2024-09-13T16:54:33.120 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2024-09-13T16:54:33.134 INFO:teuthology.orchestra.run.smithi195.stdout:(29/33): python3-tempora-5.0.0-2.el9.noarch.rpm 611 kB/s | 36 kB 00:00 2024-09-13T16:54:33.167 INFO:teuthology.orchestra.run.smithi195.stdout:(30/33): python3-webob-1.8.8-2.el9.noarch.rpm 3.8 MB/s | 230 kB 00:00 2024-09-13T16:54:33.196 INFO:teuthology.orchestra.run.smithi195.stdout:(31/33): python3-zc-lockfile-2.0-10.el9.noarch. 709 kB/s | 20 kB 00:00 2024-09-13T16:54:33.221 INFO:teuthology.orchestra.run.smithi195.stdout:(32/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.8 MB/s | 427 kB 00:00 2024-09-13T16:54:33.527 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded. 2024-09-13T16:54:33.527 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2024-09-13T16:54:34.063 INFO:teuthology.orchestra.run.smithi195.stdout:(33/33): ceph-osd-18.2.4-843.g2c01458a.el9.x86_ 5.4 MB/s | 17 MB 00:03 2024-09-13T16:54:34.068 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-09-13T16:54:34.068 INFO:teuthology.orchestra.run.smithi195.stdout:Total 6.2 MB/s | 29 MB 00:04 2024-09-13T16:54:34.191 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-09-13T16:54:34.229 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-09-13T16:54:34.229 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-09-13T16:54:34.647 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-09-13T16:54:34.647 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-09-13T16:54:34.801 INFO:teuthology.orchestra.run.smithi115.stdout: Preparing : 1/1 2024-09-13T16:54:34.869 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-09-13T16:54:34.901 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-09-13T16:54:34.934 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-09-13T16:54:35.034 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-09-13T16:54:35.103 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-09-13T16:54:35.145 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 6/33 2024-09-13T16:54:35.180 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-09-13T16:54:35.210 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/33 2024-09-13T16:54:35.245 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/33 2024-09-13T16:54:35.281 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/33 2024-09-13T16:54:35.322 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/33 2024-09-13T16:54:35.365 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/33 2024-09-13T16:54:35.400 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/33 2024-09-13T16:54:35.457 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/33 2024-09-13T16:54:35.536 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 15/33 2024-09-13T16:54:35.684 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 16/33 2024-09-13T16:54:35.762 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 17/33 2024-09-13T16:54:35.824 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 18/33 2024-09-13T16:54:35.862 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 19/33 2024-09-13T16:54:35.876 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-09-13T16:54:35.911 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-ply-3.11-14.el9.noarch 20/33 2024-09-13T16:54:35.949 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-09-13T16:54:35.967 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 21/33 2024-09-13T16:54:35.990 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-09-13T16:54:36.023 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-09-13T16:54:36.121 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-09-13T16:54:36.163 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 22/33 2024-09-13T16:54:36.209 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-09-13T16:54:36.217 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 23/33 2024-09-13T16:54:36.250 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 6/33 2024-09-13T16:54:36.285 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-09-13T16:54:36.297 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 24/33 2024-09-13T16:54:36.315 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/33 2024-09-13T16:54:36.350 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/33 2024-09-13T16:54:36.383 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/33 2024-09-13T16:54:36.384 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 25/33 2024-09-13T16:54:36.423 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/33 2024-09-13T16:54:36.433 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 26/33 2024-09-13T16:54:36.467 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/33 2024-09-13T16:54:36.510 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/33 2024-09-13T16:54:36.557 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/33 2024-09-13T16:54:36.558 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 27/33 2024-09-13T16:54:36.638 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 15/33 2024-09-13T16:54:36.724 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mgr-modules-core-2:18.2.4-843.g2c01458a.el9.n 28/33 2024-09-13T16:54:36.761 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mgr-2:18.2.4-843.g2c01458a.el9.x86_64 29/33 2024-09-13T16:54:36.784 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 16/33 2024-09-13T16:54:36.785 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mgr-2:18.2.4-843.g2c01458a.el9.x86_64 29/33 2024-09-13T16:54:36.785 INFO:teuthology.orchestra.run.smithi115.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T16:54:36.785 INFO:teuthology.orchestra.run.smithi115.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-13T16:54:36.785 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T16:54:36.785 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T16:54:36.785 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T16:54:36.864 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 17/33 2024-09-13T16:54:36.917 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 18/33 2024-09-13T16:54:36.964 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 19/33 2024-09-13T16:54:37.020 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-ply-3.11-14.el9.noarch 20/33 2024-09-13T16:54:37.076 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 21/33 2024-09-13T16:54:37.262 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 22/33 2024-09-13T16:54:37.319 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 23/33 2024-09-13T16:54:37.401 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 24/33 2024-09-13T16:54:37.578 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 25/33 2024-09-13T16:54:37.625 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 26/33 2024-09-13T16:54:37.744 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 27/33 2024-09-13T16:54:37.895 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-modules-core-2:18.2.4-843.g2c01458a.el9.n 28/33 2024-09-13T16:54:37.921 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-2:18.2.4-843.g2c01458a.el9.x86_64 29/33 2024-09-13T16:54:37.946 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-2:18.2.4-843.g2c01458a.el9.x86_64 29/33 2024-09-13T16:54:37.946 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T16:54:37.946 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-13T16:54:37.946 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T16:54:37.946 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T16:54:37.946 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:54:38.256 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-osd-2:18.2.4-843.g2c01458a.el9.x86_64 30/33 2024-09-13T16:54:38.285 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-osd-2:18.2.4-843.g2c01458a.el9.x86_64 30/33 2024-09-13T16:54:38.285 INFO:teuthology.orchestra.run.smithi115.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T16:54:38.285 INFO:teuthology.orchestra.run.smithi115.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-13T16:54:38.285 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T16:54:38.285 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T16:54:38.285 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T16:54:38.731 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mon-2:18.2.4-843.g2c01458a.el9.x86_64 31/33 2024-09-13T16:54:38.755 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mon-2:18.2.4-843.g2c01458a.el9.x86_64 31/33 2024-09-13T16:54:38.755 INFO:teuthology.orchestra.run.smithi115.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T16:54:38.755 INFO:teuthology.orchestra.run.smithi115.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-13T16:54:38.755 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T16:54:38.755 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T16:54:38.756 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T16:54:38.957 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mds-2:18.2.4-843.g2c01458a.el9.x86_64 32/33 2024-09-13T16:54:38.980 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mds-2:18.2.4-843.g2c01458a.el9.x86_64 32/33 2024-09-13T16:54:38.981 INFO:teuthology.orchestra.run.smithi115.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T16:54:38.981 INFO:teuthology.orchestra.run.smithi115.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-13T16:54:38.981 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T16:54:38.981 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T16:54:38.981 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T16:54:39.044 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-2:18.2.4-843.g2c01458a.el9.x86_64 33/33 2024-09-13T16:54:39.425 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-osd-2:18.2.4-843.g2c01458a.el9.x86_64 30/33 2024-09-13T16:54:39.454 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-osd-2:18.2.4-843.g2c01458a.el9.x86_64 30/33 2024-09-13T16:54:39.455 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T16:54:39.455 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-13T16:54:39.455 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T16:54:39.455 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T16:54:39.455 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:54:39.901 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mon-2:18.2.4-843.g2c01458a.el9.x86_64 31/33 2024-09-13T16:54:39.925 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mon-2:18.2.4-843.g2c01458a.el9.x86_64 31/33 2024-09-13T16:54:39.925 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T16:54:39.925 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-13T16:54:39.925 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T16:54:39.926 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T16:54:39.926 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:54:40.135 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mds-2:18.2.4-843.g2c01458a.el9.x86_64 32/33 2024-09-13T16:54:40.159 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mds-2:18.2.4-843.g2c01458a.el9.x86_64 32/33 2024-09-13T16:54:40.159 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T16:54:40.159 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-13T16:54:40.159 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T16:54:40.159 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T16:54:40.159 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:54:40.222 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-2:18.2.4-843.g2c01458a.el9.x86_64 33/33 2024-09-13T16:54:40.718 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-2:18.2.4-843.g2c01458a.el9.x86_64 33/33 2024-09-13T16:54:40.718 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-2:18.2.4-843.g2c01458a.el9.x86_64 1/33 2024-09-13T16:54:40.718 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mds-2:18.2.4-843.g2c01458a.el9.x86_64 2/33 2024-09-13T16:54:40.718 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mgr-2:18.2.4-843.g2c01458a.el9.x86_64 3/33 2024-09-13T16:54:40.718 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mon-2:18.2.4-843.g2c01458a.el9.x86_64 4/33 2024-09-13T16:54:40.718 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-osd-2:18.2.4-843.g2c01458a.el9.x86_64 5/33 2024-09-13T16:54:40.718 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mgr-modules-core-2:18.2.4-843.g2c01458a.el9.n 6/33 2024-09-13T16:54:40.718 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/33 2024-09-13T16:54:40.718 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/33 2024-09-13T16:54:40.718 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/33 2024-09-13T16:54:40.719 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/33 2024-09-13T16:54:40.719 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/33 2024-09-13T16:54:40.719 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/33 2024-09-13T16:54:40.719 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/33 2024-09-13T16:54:40.719 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/33 2024-09-13T16:54:40.719 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 15/33 2024-09-13T16:54:40.719 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 16/33 2024-09-13T16:54:40.719 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-09-13T16:54:40.719 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-09-13T16:54:40.719 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-09-13T16:54:40.719 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-09-13T16:54:40.719 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-09-13T16:54:40.719 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-09-13T16:54:40.720 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-09-13T16:54:40.720 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-09-13T16:54:40.720 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-09-13T16:54:40.721 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-09-13T16:54:40.721 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-09-13T16:54:40.721 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-09-13T16:54:40.721 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-09-13T16:54:40.721 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-09-13T16:54:40.721 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 31/33 2024-09-13T16:54:40.721 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-09-13T16:54:41.466 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-09-13T16:54:41.467 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T16:54:41.467 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2024-09-13T16:54:41.467 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-2:18.2.4-843.g2c01458a.el9.x86_64 2024-09-13T16:54:41.467 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mds-2:18.2.4-843.g2c01458a.el9.x86_64 2024-09-13T16:54:41.467 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-2:18.2.4-843.g2c01458a.el9.x86_64 2024-09-13T16:54:41.467 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-modules-core-2:18.2.4-843.g2c01458a.el9.noarch 2024-09-13T16:54:41.467 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mon-2:18.2.4-843.g2c01458a.el9.x86_64 2024-09-13T16:54:41.467 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-osd-2:18.2.4-843.g2c01458a.el9.x86_64 2024-09-13T16:54:41.467 INFO:teuthology.orchestra.run.smithi115.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-13T16:54:41.467 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-13T16:54:41.467 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-13T16:54:41.467 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-13T16:54:41.467 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-13T16:54:41.467 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-13T16:54:41.468 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-13T16:54:41.468 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-13T16:54:41.468 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-13T16:54:41.468 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-13T16:54:41.468 INFO:teuthology.orchestra.run.smithi115.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-13T16:54:41.468 INFO:teuthology.orchestra.run.smithi115.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-13T16:54:41.468 INFO:teuthology.orchestra.run.smithi115.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-13T16:54:41.468 INFO:teuthology.orchestra.run.smithi115.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-13T16:54:41.468 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-13T16:54:41.468 INFO:teuthology.orchestra.run.smithi115.stdout: python3-ply-3.11-14.el9.noarch 2024-09-13T16:54:41.468 INFO:teuthology.orchestra.run.smithi115.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-13T16:54:41.468 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-13T16:54:41.468 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-13T16:54:41.469 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-13T16:54:41.469 INFO:teuthology.orchestra.run.smithi115.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-13T16:54:41.469 INFO:teuthology.orchestra.run.smithi115.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-13T16:54:41.469 INFO:teuthology.orchestra.run.smithi115.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-13T16:54:41.469 INFO:teuthology.orchestra.run.smithi115.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-13T16:54:41.469 INFO:teuthology.orchestra.run.smithi115.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-13T16:54:41.469 INFO:teuthology.orchestra.run.smithi115.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-13T16:54:41.469 INFO:teuthology.orchestra.run.smithi115.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-13T16:54:41.469 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T16:54:41.469 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-09-13T16:54:41.867 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install ceph-base 2024-09-13T16:54:41.874 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-2:18.2.4-843.g2c01458a.el9.x86_64 33/33 2024-09-13T16:54:41.874 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-2:18.2.4-843.g2c01458a.el9.x86_64 1/33 2024-09-13T16:54:41.874 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mds-2:18.2.4-843.g2c01458a.el9.x86_64 2/33 2024-09-13T16:54:41.874 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-2:18.2.4-843.g2c01458a.el9.x86_64 3/33 2024-09-13T16:54:41.874 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mon-2:18.2.4-843.g2c01458a.el9.x86_64 4/33 2024-09-13T16:54:41.874 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-osd-2:18.2.4-843.g2c01458a.el9.x86_64 5/33 2024-09-13T16:54:41.874 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-modules-core-2:18.2.4-843.g2c01458a.el9.n 6/33 2024-09-13T16:54:41.874 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/33 2024-09-13T16:54:41.874 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/33 2024-09-13T16:54:41.874 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/33 2024-09-13T16:54:41.874 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/33 2024-09-13T16:54:41.875 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/33 2024-09-13T16:54:41.875 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/33 2024-09-13T16:54:41.875 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/33 2024-09-13T16:54:41.875 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/33 2024-09-13T16:54:41.875 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 15/33 2024-09-13T16:54:41.875 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 16/33 2024-09-13T16:54:41.875 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-09-13T16:54:41.875 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-09-13T16:54:41.875 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-09-13T16:54:41.875 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-09-13T16:54:41.875 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-09-13T16:54:41.875 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-09-13T16:54:41.875 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-09-13T16:54:41.876 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-09-13T16:54:41.876 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-09-13T16:54:41.876 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-09-13T16:54:41.877 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-09-13T16:54:41.877 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-09-13T16:54:41.877 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-09-13T16:54:41.877 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-09-13T16:54:41.877 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 31/33 2024-09-13T16:54:41.877 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-09-13T16:54:42.431 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:00:49 ago on Fri 13 Sep 2024 04:53:53 PM UTC. 2024-09-13T16:54:42.520 INFO:teuthology.orchestra.run.smithi115.stdout:Package ceph-base-2:18.2.4-843.g2c01458a.el9.x86_64 is already installed. 2024-09-13T16:54:42.562 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-09-13T16:54:42.563 INFO:teuthology.orchestra.run.smithi115.stdout:Nothing to do. 2024-09-13T16:54:42.563 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-09-13T16:54:42.637 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install cephadm 2024-09-13T16:54:42.720 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-09-13T16:54:42.720 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:54:42.720 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-09-13T16:54:42.720 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-2:18.2.4-843.g2c01458a.el9.x86_64 2024-09-13T16:54:42.720 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mds-2:18.2.4-843.g2c01458a.el9.x86_64 2024-09-13T16:54:42.720 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-2:18.2.4-843.g2c01458a.el9.x86_64 2024-09-13T16:54:42.720 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-modules-core-2:18.2.4-843.g2c01458a.el9.noarch 2024-09-13T16:54:42.720 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mon-2:18.2.4-843.g2c01458a.el9.x86_64 2024-09-13T16:54:42.720 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-osd-2:18.2.4-843.g2c01458a.el9.x86_64 2024-09-13T16:54:42.720 INFO:teuthology.orchestra.run.smithi195.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-13T16:54:42.721 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-13T16:54:42.721 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-13T16:54:42.721 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-13T16:54:42.721 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-13T16:54:42.721 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-13T16:54:42.721 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-13T16:54:42.721 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-13T16:54:42.721 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-13T16:54:42.721 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-13T16:54:42.721 INFO:teuthology.orchestra.run.smithi195.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-13T16:54:42.721 INFO:teuthology.orchestra.run.smithi195.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-13T16:54:42.721 INFO:teuthology.orchestra.run.smithi195.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-13T16:54:42.721 INFO:teuthology.orchestra.run.smithi195.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-13T16:54:42.721 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-13T16:54:42.722 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ply-3.11-14.el9.noarch 2024-09-13T16:54:42.722 INFO:teuthology.orchestra.run.smithi195.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-13T16:54:42.722 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-13T16:54:42.722 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-13T16:54:42.722 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-13T16:54:42.722 INFO:teuthology.orchestra.run.smithi195.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-13T16:54:42.722 INFO:teuthology.orchestra.run.smithi195.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-13T16:54:42.722 INFO:teuthology.orchestra.run.smithi195.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-13T16:54:42.722 INFO:teuthology.orchestra.run.smithi195.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-13T16:54:42.722 INFO:teuthology.orchestra.run.smithi195.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-13T16:54:42.722 INFO:teuthology.orchestra.run.smithi195.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-13T16:54:42.722 INFO:teuthology.orchestra.run.smithi195.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-13T16:54:42.722 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:54:42.722 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-09-13T16:54:43.124 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install ceph-base 2024-09-13T16:54:43.195 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:00:50 ago on Fri 13 Sep 2024 04:53:53 PM UTC. 2024-09-13T16:54:43.326 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-09-13T16:54:43.327 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T16:54:43.327 INFO:teuthology.orchestra.run.smithi115.stdout: Package Arch Version Repository Size 2024-09-13T16:54:43.327 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T16:54:43.327 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2024-09-13T16:54:43.327 INFO:teuthology.orchestra.run.smithi115.stdout: cephadm noarch 2:18.2.4-843.g2c01458a.el9 ceph-noarch 226 k 2024-09-13T16:54:43.327 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T16:54:43.327 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2024-09-13T16:54:43.327 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T16:54:43.327 INFO:teuthology.orchestra.run.smithi115.stdout:Install 1 Package 2024-09-13T16:54:43.327 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T16:54:43.327 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 226 k 2024-09-13T16:54:43.328 INFO:teuthology.orchestra.run.smithi115.stdout:Installed size: 217 k 2024-09-13T16:54:43.328 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading Packages: 2024-09-13T16:54:43.563 INFO:teuthology.orchestra.run.smithi115.stdout:cephadm-18.2.4-843.g2c01458a.el9.noarch.rpm 960 kB/s | 226 kB 00:00 2024-09-13T16:54:43.564 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2024-09-13T16:54:43.564 INFO:teuthology.orchestra.run.smithi115.stdout:Total 954 kB/s | 226 kB 00:00 2024-09-13T16:54:43.564 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2024-09-13T16:54:43.569 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction check succeeded. 2024-09-13T16:54:43.569 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2024-09-13T16:54:43.572 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded. 2024-09-13T16:54:43.573 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2024-09-13T16:54:43.639 INFO:teuthology.orchestra.run.smithi115.stdout: Preparing : 1/1 2024-09-13T16:54:43.695 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:00:52 ago on Fri 13 Sep 2024 04:53:51 PM UTC. 2024-09-13T16:54:43.785 INFO:teuthology.orchestra.run.smithi195.stdout:Package ceph-base-2:18.2.4-843.g2c01458a.el9.x86_64 is already installed. 2024-09-13T16:54:43.827 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-09-13T16:54:43.827 INFO:teuthology.orchestra.run.smithi195.stdout:Nothing to do. 2024-09-13T16:54:43.828 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-09-13T16:54:43.886 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install cephadm 2024-09-13T16:54:44.092 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: cephadm-2:18.2.4-843.g2c01458a.el9.noarch 1/1 2024-09-13T16:54:44.175 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : cephadm-2:18.2.4-843.g2c01458a.el9.noarch 1/1 2024-09-13T16:54:44.451 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:00:53 ago on Fri 13 Sep 2024 04:53:51 PM UTC. 2024-09-13T16:54:44.489 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: cephadm-2:18.2.4-843.g2c01458a.el9.noarch 1/1 2024-09-13T16:54:44.584 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-09-13T16:54:44.584 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T16:54:44.585 INFO:teuthology.orchestra.run.smithi195.stdout: Package Arch Version Repository Size 2024-09-13T16:54:44.585 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T16:54:44.585 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-09-13T16:54:44.585 INFO:teuthology.orchestra.run.smithi195.stdout: cephadm noarch 2:18.2.4-843.g2c01458a.el9 ceph-noarch 226 k 2024-09-13T16:54:44.585 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:54:44.585 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-09-13T16:54:44.585 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T16:54:44.585 INFO:teuthology.orchestra.run.smithi195.stdout:Install 1 Package 2024-09-13T16:54:44.585 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:54:44.585 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 226 k 2024-09-13T16:54:44.585 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 217 k 2024-09-13T16:54:44.585 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-09-13T16:54:44.705 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : cephadm-2:18.2.4-843.g2c01458a.el9.noarch 1/1 2024-09-13T16:54:44.705 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T16:54:44.705 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2024-09-13T16:54:44.705 INFO:teuthology.orchestra.run.smithi115.stdout: cephadm-2:18.2.4-843.g2c01458a.el9.noarch 2024-09-13T16:54:44.705 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T16:54:44.706 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-09-13T16:54:44.826 INFO:teuthology.orchestra.run.smithi195.stdout:cephadm-18.2.4-843.g2c01458a.el9.noarch.rpm 941 kB/s | 226 kB 00:00 2024-09-13T16:54:44.826 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-09-13T16:54:44.826 INFO:teuthology.orchestra.run.smithi195.stdout:Total 935 kB/s | 226 kB 00:00 2024-09-13T16:54:44.827 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-09-13T16:54:44.832 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-09-13T16:54:44.832 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-09-13T16:54:44.835 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-09-13T16:54:44.835 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-09-13T16:54:44.908 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-09-13T16:54:44.915 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install ceph-immutable-object-cache 2024-09-13T16:54:45.363 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: cephadm-2:18.2.4-843.g2c01458a.el9.noarch 1/1 2024-09-13T16:54:45.461 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : cephadm-2:18.2.4-843.g2c01458a.el9.noarch 1/1 2024-09-13T16:54:45.482 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:00:52 ago on Fri 13 Sep 2024 04:53:53 PM UTC. 2024-09-13T16:54:45.618 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-09-13T16:54:45.619 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T16:54:45.619 INFO:teuthology.orchestra.run.smithi115.stdout: Package Arch Version Repo Size 2024-09-13T16:54:45.619 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T16:54:45.619 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2024-09-13T16:54:45.619 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-immutable-object-cache x86_64 2:18.2.4-843.g2c01458a.el9 ceph 143 k 2024-09-13T16:54:45.619 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T16:54:45.619 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2024-09-13T16:54:45.619 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T16:54:45.619 INFO:teuthology.orchestra.run.smithi115.stdout:Install 1 Package 2024-09-13T16:54:45.619 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T16:54:45.619 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 143 k 2024-09-13T16:54:45.619 INFO:teuthology.orchestra.run.smithi115.stdout:Installed size: 395 k 2024-09-13T16:54:45.620 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading Packages: 2024-09-13T16:54:45.796 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: cephadm-2:18.2.4-843.g2c01458a.el9.noarch 1/1 2024-09-13T16:54:45.827 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-immutable-object-cache-18.2.4-843.g2c01458 687 kB/s | 143 kB 00:00 2024-09-13T16:54:45.828 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2024-09-13T16:54:45.829 INFO:teuthology.orchestra.run.smithi115.stdout:Total 681 kB/s | 143 kB 00:00 2024-09-13T16:54:45.829 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2024-09-13T16:54:45.836 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction check succeeded. 2024-09-13T16:54:45.836 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2024-09-13T16:54:45.892 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded. 2024-09-13T16:54:45.893 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2024-09-13T16:54:46.034 INFO:teuthology.orchestra.run.smithi115.stdout: Preparing : 1/1 2024-09-13T16:54:46.043 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : cephadm-2:18.2.4-843.g2c01458a.el9.noarch 1/1 2024-09-13T16:54:46.043 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:54:46.043 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-09-13T16:54:46.043 INFO:teuthology.orchestra.run.smithi195.stdout: cephadm-2:18.2.4-843.g2c01458a.el9.noarch 2024-09-13T16:54:46.043 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:54:46.044 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-09-13T16:54:46.112 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-immutable-object-cache-2:18.2.4-843.g2c01458a.e 1/1 2024-09-13T16:54:46.137 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.4-843.g2c01458a.e 1/1 2024-09-13T16:54:46.137 INFO:teuthology.orchestra.run.smithi115.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T16:54:46.137 INFO:teuthology.orchestra.run.smithi115.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-13T16:54:46.137 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T16:54:46.246 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install ceph-immutable-object-cache 2024-09-13T16:54:46.820 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:00:55 ago on Fri 13 Sep 2024 04:53:51 PM UTC. 2024-09-13T16:54:46.955 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-09-13T16:54:46.956 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T16:54:46.956 INFO:teuthology.orchestra.run.smithi195.stdout: Package Arch Version Repo Size 2024-09-13T16:54:46.956 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T16:54:46.956 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-09-13T16:54:46.956 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-immutable-object-cache x86_64 2:18.2.4-843.g2c01458a.el9 ceph 143 k 2024-09-13T16:54:46.956 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:54:46.956 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-09-13T16:54:46.956 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T16:54:46.956 INFO:teuthology.orchestra.run.smithi195.stdout:Install 1 Package 2024-09-13T16:54:46.956 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:54:46.957 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 143 k 2024-09-13T16:54:46.957 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 395 k 2024-09-13T16:54:46.957 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-09-13T16:54:47.056 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-immutable-object-cache-2:18.2.4-843.g2c01458a.e 1/1 2024-09-13T16:54:47.056 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T16:54:47.056 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2024-09-13T16:54:47.056 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-immutable-object-cache-2:18.2.4-843.g2c01458a.el9.x86_64 2024-09-13T16:54:47.056 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T16:54:47.056 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-09-13T16:54:47.148 INFO:teuthology.orchestra.run.smithi195.stdout:ceph-immutable-object-cache-18.2.4-843.g2c01458 748 kB/s | 143 kB 00:00 2024-09-13T16:54:47.149 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-09-13T16:54:47.149 INFO:teuthology.orchestra.run.smithi195.stdout:Total 742 kB/s | 143 kB 00:00 2024-09-13T16:54:47.149 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-09-13T16:54:47.157 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-09-13T16:54:47.157 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-09-13T16:54:47.214 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-09-13T16:54:47.214 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-09-13T16:54:47.287 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install ceph-mgr 2024-09-13T16:54:47.363 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-09-13T16:54:47.434 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-immutable-object-cache-2:18.2.4-843.g2c01458a.e 1/1 2024-09-13T16:54:47.460 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.4-843.g2c01458a.e 1/1 2024-09-13T16:54:47.460 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T16:54:47.460 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-13T16:54:47.460 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:54:47.855 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:00:54 ago on Fri 13 Sep 2024 04:53:53 PM UTC. 2024-09-13T16:54:47.949 INFO:teuthology.orchestra.run.smithi115.stdout:Package ceph-mgr-2:18.2.4-843.g2c01458a.el9.x86_64 is already installed. 2024-09-13T16:54:47.993 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-09-13T16:54:47.994 INFO:teuthology.orchestra.run.smithi115.stdout:Nothing to do. 2024-09-13T16:54:47.994 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-09-13T16:54:48.063 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install ceph-mgr-dashboard 2024-09-13T16:54:48.376 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-immutable-object-cache-2:18.2.4-843.g2c01458a.e 1/1 2024-09-13T16:54:48.376 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:54:48.376 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-09-13T16:54:48.376 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-immutable-object-cache-2:18.2.4-843.g2c01458a.el9.x86_64 2024-09-13T16:54:48.376 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:54:48.377 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-09-13T16:54:48.596 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install ceph-mgr 2024-09-13T16:54:48.634 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:00:55 ago on Fri 13 Sep 2024 04:53:53 PM UTC. 2024-09-13T16:54:48.767 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-09-13T16:54:48.768 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T16:54:48.768 INFO:teuthology.orchestra.run.smithi115.stdout: Package Arch Version Repository Size 2024-09-13T16:54:48.768 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T16:54:48.768 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2024-09-13T16:54:48.768 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-dashboard noarch 2:18.2.4-843.g2c01458a.el9 ceph-noarch 3.5 M 2024-09-13T16:54:48.768 INFO:teuthology.orchestra.run.smithi115.stdout:Installing dependencies: 2024-09-13T16:54:48.768 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-grafana-dashboards noarch 2:18.2.4-843.g2c01458a.el9 ceph-noarch 24 k 2024-09-13T16:54:48.768 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-prometheus-alerts noarch 2:18.2.4-843.g2c01458a.el9 ceph-noarch 16 k 2024-09-13T16:54:48.768 INFO:teuthology.orchestra.run.smithi115.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-13T16:54:48.768 INFO:teuthology.orchestra.run.smithi115.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-13T16:54:48.768 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T16:54:48.768 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2024-09-13T16:54:48.769 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T16:54:48.769 INFO:teuthology.orchestra.run.smithi115.stdout:Install 5 Packages 2024-09-13T16:54:48.769 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T16:54:48.769 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 3.8 M 2024-09-13T16:54:48.769 INFO:teuthology.orchestra.run.smithi115.stdout:Installed size: 87 M 2024-09-13T16:54:48.769 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading Packages: 2024-09-13T16:54:48.990 INFO:teuthology.orchestra.run.smithi115.stdout:(1/5): ceph-grafana-dashboards-18.2.4-843.g2c01 161 kB/s | 24 kB 00:00 2024-09-13T16:54:49.015 INFO:teuthology.orchestra.run.smithi115.stdout:(2/5): ceph-prometheus-alerts-18.2.4-843.g2c014 93 kB/s | 16 kB 00:00 2024-09-13T16:54:49.057 INFO:teuthology.orchestra.run.smithi115.stdout:(3/5): python3-repoze-lru-0.7-16.el9.noarch.rpm 460 kB/s | 31 kB 00:00 2024-09-13T16:54:49.091 INFO:teuthology.orchestra.run.smithi115.stdout:(4/5): python3-routes-2.5.1-5.el9.noarch.rpm 2.5 MB/s | 188 kB 00:00 2024-09-13T16:54:49.183 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:00:58 ago on Fri 13 Sep 2024 04:53:51 PM UTC. 2024-09-13T16:54:49.277 INFO:teuthology.orchestra.run.smithi195.stdout:Package ceph-mgr-2:18.2.4-843.g2c01458a.el9.x86_64 is already installed. 2024-09-13T16:54:49.283 INFO:teuthology.orchestra.run.smithi115.stdout:(5/5): ceph-mgr-dashboard-18.2.4-843.g2c01458a. 8.0 MB/s | 3.5 MB 00:00 2024-09-13T16:54:49.286 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2024-09-13T16:54:49.286 INFO:teuthology.orchestra.run.smithi115.stdout:Total 7.3 MB/s | 3.8 MB 00:00 2024-09-13T16:54:49.286 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2024-09-13T16:54:49.293 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction check succeeded. 2024-09-13T16:54:49.293 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2024-09-13T16:54:49.320 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-09-13T16:54:49.321 INFO:teuthology.orchestra.run.smithi195.stdout:Nothing to do. 2024-09-13T16:54:49.321 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-09-13T16:54:49.378 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded. 2024-09-13T16:54:49.379 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2024-09-13T16:54:49.386 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install ceph-mgr-dashboard 2024-09-13T16:54:49.628 INFO:teuthology.orchestra.run.smithi115.stdout: Preparing : 1/1 2024-09-13T16:54:49.697 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 1/5 2024-09-13T16:54:49.738 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 2/5 2024-09-13T16:54:49.766 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-prometheus-alerts-2:18.2.4-843.g2c01458a.el9.no 3/5 2024-09-13T16:54:49.951 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:00:58 ago on Fri 13 Sep 2024 04:53:51 PM UTC. 2024-09-13T16:54:50.083 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-09-13T16:54:50.083 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T16:54:50.083 INFO:teuthology.orchestra.run.smithi195.stdout: Package Arch Version Repository Size 2024-09-13T16:54:50.083 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T16:54:50.084 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-09-13T16:54:50.084 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-dashboard noarch 2:18.2.4-843.g2c01458a.el9 ceph-noarch 3.5 M 2024-09-13T16:54:50.084 INFO:teuthology.orchestra.run.smithi195.stdout:Installing dependencies: 2024-09-13T16:54:50.084 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-grafana-dashboards noarch 2:18.2.4-843.g2c01458a.el9 ceph-noarch 24 k 2024-09-13T16:54:50.084 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-prometheus-alerts noarch 2:18.2.4-843.g2c01458a.el9 ceph-noarch 16 k 2024-09-13T16:54:50.084 INFO:teuthology.orchestra.run.smithi195.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-13T16:54:50.084 INFO:teuthology.orchestra.run.smithi195.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-13T16:54:50.084 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:54:50.084 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-09-13T16:54:50.084 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T16:54:50.084 INFO:teuthology.orchestra.run.smithi195.stdout:Install 5 Packages 2024-09-13T16:54:50.084 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:54:50.085 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 3.8 M 2024-09-13T16:54:50.085 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 87 M 2024-09-13T16:54:50.085 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-09-13T16:54:50.262 INFO:teuthology.orchestra.run.smithi195.stdout:(1/5): ceph-grafana-dashboards-18.2.4-843.g2c01 164 kB/s | 24 kB 00:00 2024-09-13T16:54:50.287 INFO:teuthology.orchestra.run.smithi195.stdout:(2/5): ceph-prometheus-alerts-18.2.4-843.g2c014 94 kB/s | 16 kB 00:00 2024-09-13T16:54:50.329 INFO:teuthology.orchestra.run.smithi195.stdout:(3/5): python3-repoze-lru-0.7-16.el9.noarch.rpm 460 kB/s | 31 kB 00:00 2024-09-13T16:54:50.354 INFO:teuthology.orchestra.run.smithi195.stdout:(4/5): python3-routes-2.5.1-5.el9.noarch.rpm 2.8 MB/s | 188 kB 00:00 2024-09-13T16:54:50.580 INFO:teuthology.orchestra.run.smithi195.stdout:(5/5): ceph-mgr-dashboard-18.2.4-843.g2c01458a. 7.6 MB/s | 3.5 MB 00:00 2024-09-13T16:54:50.583 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-09-13T16:54:50.584 INFO:teuthology.orchestra.run.smithi195.stdout:Total 7.6 MB/s | 3.8 MB 00:00 2024-09-13T16:54:50.584 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-09-13T16:54:50.591 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-09-13T16:54:50.592 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-09-13T16:54:50.686 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-09-13T16:54:50.686 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-09-13T16:54:50.814 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-grafana-dashboards-2:18.2.4-843.g2c01458a.el9.n 4/5 2024-09-13T16:54:50.855 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mgr-dashboard-2:18.2.4-843.g2c01458a.el9.noarch 5/5 2024-09-13T16:54:50.939 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-09-13T16:54:51.020 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 1/5 2024-09-13T16:54:51.052 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 2/5 2024-09-13T16:54:51.080 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-prometheus-alerts-2:18.2.4-843.g2c01458a.el9.no 3/5 2024-09-13T16:54:51.931 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.4-843.g2c01458a.el9.noarch 5/5 2024-09-13T16:54:51.931 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-grafana-dashboards-2:18.2.4-843.g2c01458a.el9.n 1/5 2024-09-13T16:54:51.931 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mgr-dashboard-2:18.2.4-843.g2c01458a.el9.noarch 2/5 2024-09-13T16:54:51.931 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-prometheus-alerts-2:18.2.4-843.g2c01458a.el9.no 3/5 2024-09-13T16:54:51.931 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 4/5 2024-09-13T16:54:52.125 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-grafana-dashboards-2:18.2.4-843.g2c01458a.el9.n 4/5 2024-09-13T16:54:52.167 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-dashboard-2:18.2.4-843.g2c01458a.el9.noarch 5/5 2024-09-13T16:54:52.193 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 5/5 2024-09-13T16:54:52.193 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T16:54:52.193 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2024-09-13T16:54:52.193 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-grafana-dashboards-2:18.2.4-843.g2c01458a.el9.noarch 2024-09-13T16:54:52.194 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-dashboard-2:18.2.4-843.g2c01458a.el9.noarch 2024-09-13T16:54:52.194 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-prometheus-alerts-2:18.2.4-843.g2c01458a.el9.noarch 2024-09-13T16:54:52.194 INFO:teuthology.orchestra.run.smithi115.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-13T16:54:52.194 INFO:teuthology.orchestra.run.smithi115.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-13T16:54:52.194 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T16:54:52.194 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-09-13T16:54:52.404 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-13T16:54:52.966 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:00:59 ago on Fri 13 Sep 2024 04:53:53 PM UTC. 2024-09-13T16:54:53.100 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-09-13T16:54:53.101 INFO:teuthology.orchestra.run.smithi115.stdout:====================================================================================== 2024-09-13T16:54:53.101 INFO:teuthology.orchestra.run.smithi115.stdout: Package Arch Version Repository Size 2024-09-13T16:54:53.101 INFO:teuthology.orchestra.run.smithi115.stdout:====================================================================================== 2024-09-13T16:54:53.101 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2024-09-13T16:54:53.101 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.4-843.g2c01458a.el9 ceph-noarch 7.4 M 2024-09-13T16:54:53.101 INFO:teuthology.orchestra.run.smithi115.stdout:Installing dependencies: 2024-09-13T16:54:53.101 INFO:teuthology.orchestra.run.smithi115.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-13T16:54:53.101 INFO:teuthology.orchestra.run.smithi115.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-13T16:54:53.101 INFO:teuthology.orchestra.run.smithi115.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-13T16:54:53.102 INFO:teuthology.orchestra.run.smithi115.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-13T16:54:53.102 INFO:teuthology.orchestra.run.smithi115.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-13T16:54:53.102 INFO:teuthology.orchestra.run.smithi115.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-13T16:54:53.102 INFO:teuthology.orchestra.run.smithi115.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-13T16:54:53.102 INFO:teuthology.orchestra.run.smithi115.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-13T16:54:53.102 INFO:teuthology.orchestra.run.smithi115.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-13T16:54:53.102 INFO:teuthology.orchestra.run.smithi115.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-13T16:54:53.102 INFO:teuthology.orchestra.run.smithi115.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-13T16:54:53.102 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T16:54:53.102 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2024-09-13T16:54:53.102 INFO:teuthology.orchestra.run.smithi115.stdout:====================================================================================== 2024-09-13T16:54:53.102 INFO:teuthology.orchestra.run.smithi115.stdout:Install 12 Packages 2024-09-13T16:54:53.102 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T16:54:53.103 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 38 M 2024-09-13T16:54:53.103 INFO:teuthology.orchestra.run.smithi115.stdout:Installed size: 212 M 2024-09-13T16:54:53.103 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading Packages: 2024-09-13T16:54:53.265 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.4-843.g2c01458a.el9.noarch 5/5 2024-09-13T16:54:53.265 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-grafana-dashboards-2:18.2.4-843.g2c01458a.el9.n 1/5 2024-09-13T16:54:53.265 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-dashboard-2:18.2.4-843.g2c01458a.el9.noarch 2/5 2024-09-13T16:54:53.265 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-prometheus-alerts-2:18.2.4-843.g2c01458a.el9.no 3/5 2024-09-13T16:54:53.265 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 4/5 2024-09-13T16:54:53.527 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 5/5 2024-09-13T16:54:53.527 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:54:53.527 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-09-13T16:54:53.527 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-grafana-dashboards-2:18.2.4-843.g2c01458a.el9.noarch 2024-09-13T16:54:53.527 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-dashboard-2:18.2.4-843.g2c01458a.el9.noarch 2024-09-13T16:54:53.527 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-prometheus-alerts-2:18.2.4-843.g2c01458a.el9.noarch 2024-09-13T16:54:53.527 INFO:teuthology.orchestra.run.smithi195.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-13T16:54:53.527 INFO:teuthology.orchestra.run.smithi195.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-13T16:54:53.528 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:54:53.528 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-09-13T16:54:53.750 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-13T16:54:53.883 INFO:teuthology.orchestra.run.smithi115.stdout:(1/12): ceph-mgr-diskprediction-local-18.2.4-84 14 MB/s | 7.4 MB 00:00 2024-09-13T16:54:53.908 INFO:teuthology.orchestra.run.smithi115.stdout:(2/12): libquadmath-11.5.0-2.el9.x86_64.rpm 346 kB/s | 191 kB 00:00 2024-09-13T16:54:53.975 INFO:teuthology.orchestra.run.smithi115.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 357 kB/s | 33 kB 00:00 2024-09-13T16:54:54.017 INFO:teuthology.orchestra.run.smithi115.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 436 kB/s | 18 kB 00:00 2024-09-13T16:54:54.059 INFO:teuthology.orchestra.run.smithi115.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 927 kB/s | 38 kB 00:00 2024-09-13T16:54:54.143 INFO:teuthology.orchestra.run.smithi115.stdout:(6/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 13 MB/s | 3.0 MB 00:00 2024-09-13T16:54:54.193 INFO:teuthology.orchestra.run.smithi115.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 4.8 MB/s | 245 kB 00:00 2024-09-13T16:54:54.313 INFO:teuthology.orchestra.run.smithi115.stdout:(8/12): libgfortran-11.5.0-2.el9.x86_64.rpm 840 kB/s | 801 kB 00:00 2024-09-13T16:54:54.313 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:01:03 ago on Fri 13 Sep 2024 04:53:51 PM UTC. 2024-09-13T16:54:54.377 INFO:teuthology.orchestra.run.smithi115.stdout:(9/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 16 MB/s | 4.9 MB 00:00 2024-09-13T16:54:54.446 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-09-13T16:54:54.447 INFO:teuthology.orchestra.run.smithi195.stdout:====================================================================================== 2024-09-13T16:54:54.447 INFO:teuthology.orchestra.run.smithi195.stdout: Package Arch Version Repository Size 2024-09-13T16:54:54.447 INFO:teuthology.orchestra.run.smithi195.stdout:====================================================================================== 2024-09-13T16:54:54.447 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-09-13T16:54:54.447 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.4-843.g2c01458a.el9 ceph-noarch 7.4 M 2024-09-13T16:54:54.447 INFO:teuthology.orchestra.run.smithi195.stdout:Installing dependencies: 2024-09-13T16:54:54.448 INFO:teuthology.orchestra.run.smithi195.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-13T16:54:54.448 INFO:teuthology.orchestra.run.smithi195.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-13T16:54:54.448 INFO:teuthology.orchestra.run.smithi195.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-13T16:54:54.448 INFO:teuthology.orchestra.run.smithi195.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-13T16:54:54.448 INFO:teuthology.orchestra.run.smithi195.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-13T16:54:54.448 INFO:teuthology.orchestra.run.smithi195.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-13T16:54:54.448 INFO:teuthology.orchestra.run.smithi195.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-13T16:54:54.448 INFO:teuthology.orchestra.run.smithi195.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-13T16:54:54.448 INFO:teuthology.orchestra.run.smithi195.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-13T16:54:54.448 INFO:teuthology.orchestra.run.smithi195.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-13T16:54:54.448 INFO:teuthology.orchestra.run.smithi195.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-13T16:54:54.449 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:54:54.449 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-09-13T16:54:54.449 INFO:teuthology.orchestra.run.smithi195.stdout:====================================================================================== 2024-09-13T16:54:54.449 INFO:teuthology.orchestra.run.smithi195.stdout:Install 12 Packages 2024-09-13T16:54:54.449 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:54:54.450 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 38 M 2024-09-13T16:54:54.450 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 212 M 2024-09-13T16:54:54.450 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-09-13T16:54:54.497 INFO:teuthology.orchestra.run.smithi115.stdout:(10/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 17 MB/s | 5.1 MB 00:00 2024-09-13T16:54:54.627 INFO:teuthology.orchestra.run.smithi115.stdout:(11/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 790 kB/s | 250 kB 00:00 2024-09-13T16:54:54.869 INFO:teuthology.orchestra.run.smithi115.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 33 MB/s | 16 MB 00:00 2024-09-13T16:54:54.869 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2024-09-13T16:54:54.870 INFO:teuthology.orchestra.run.smithi115.stdout:Total 22 MB/s | 38 MB 00:01 2024-09-13T16:54:54.895 INFO:teuthology.orchestra.run.smithi195.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 766 kB/s | 191 kB 00:00 2024-09-13T16:54:54.995 INFO:teuthology.orchestra.run.smithi195.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 328 kB/s | 33 kB 00:00 2024-09-13T16:54:55.146 INFO:teuthology.orchestra.run.smithi195.stdout:(3/12): libgfortran-11.5.0-2.el9.x86_64.rpm 1.6 MB/s | 801 kB 00:00 2024-09-13T16:54:55.225 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2024-09-13T16:54:55.250 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction check succeeded. 2024-09-13T16:54:55.251 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2024-09-13T16:54:55.263 INFO:teuthology.orchestra.run.smithi195.stdout:(4/12): ceph-mgr-diskprediction-local-18.2.4-84 12 MB/s | 7.4 MB 00:00 2024-09-13T16:54:55.281 INFO:teuthology.orchestra.run.smithi195.stdout:(5/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 136 kB/s | 18 kB 00:00 2024-09-13T16:54:55.347 INFO:teuthology.orchestra.run.smithi195.stdout:(6/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 8.5 MB/s | 3.0 MB 00:00 2024-09-13T16:54:55.397 INFO:teuthology.orchestra.run.smithi195.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 4.8 MB/s | 245 kB 00:00 2024-09-13T16:54:55.431 INFO:teuthology.orchestra.run.smithi195.stdout:(8/12): openblas-0.3.26-2.el9.x86_64.rpm 230 kB/s | 38 kB 00:00 2024-09-13T16:54:55.531 INFO:teuthology.orchestra.run.smithi195.stdout:(9/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 38 MB/s | 5.1 MB 00:00 2024-09-13T16:54:55.606 INFO:teuthology.orchestra.run.smithi195.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 1.4 MB/s | 250 kB 00:00 2024-09-13T16:54:55.745 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded. 2024-09-13T16:54:55.745 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2024-09-13T16:54:55.840 INFO:teuthology.orchestra.run.smithi195.stdout:(11/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 53 MB/s | 16 MB 00:00 2024-09-13T16:54:56.065 INFO:teuthology.orchestra.run.smithi195.stdout:(12/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 6.3 MB/s | 4.9 MB 00:00 2024-09-13T16:54:56.065 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-09-13T16:54:56.066 INFO:teuthology.orchestra.run.smithi195.stdout:Total 24 MB/s | 38 MB 00:01 2024-09-13T16:54:56.420 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-09-13T16:54:56.446 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-09-13T16:54:56.446 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-09-13T16:54:56.504 INFO:teuthology.orchestra.run.smithi115.stdout: Preparing : 1/1 2024-09-13T16:54:56.571 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-13T16:54:56.609 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-13T16:54:56.710 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-13T16:54:56.752 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-13T16:54:56.937 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-13T16:54:56.941 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-09-13T16:54:56.941 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-09-13T16:54:56.969 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-13T16:54:57.045 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-13T16:54:57.710 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-13T16:54:57.711 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-09-13T16:54:57.793 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-13T16:54:57.814 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-13T16:54:57.838 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-13T16:54:58.014 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-13T16:54:58.056 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-13T16:54:58.240 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-13T16:54:58.271 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-13T16:54:58.347 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-13T16:54:59.003 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-13T16:54:59.067 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-13T16:54:59.117 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-13T16:55:00.095 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-13T16:55:00.125 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.4-843.g2c0145 12/12 2024-09-13T16:55:00.352 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-13T16:55:01.383 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-13T16:55:01.413 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.4-843.g2c0145 12/12 2024-09-13T16:55:02.819 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.4-843.g2c0145 12/12 2024-09-13T16:55:02.819 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.4-843.g2c0145 1/12 2024-09-13T16:55:02.819 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-13T16:55:02.819 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-13T16:55:02.819 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-13T16:55:02.819 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-13T16:55:02.819 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-13T16:55:02.820 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-13T16:55:02.820 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-13T16:55:02.820 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-13T16:55:02.820 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-13T16:55:02.820 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-13T16:55:03.221 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-13T16:55:03.221 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T16:55:03.221 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2024-09-13T16:55:03.221 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-diskprediction-local-2:18.2.4-843.g2c01458a.el9.noarch 2024-09-13T16:55:03.221 INFO:teuthology.orchestra.run.smithi115.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-13T16:55:03.221 INFO:teuthology.orchestra.run.smithi115.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-13T16:55:03.221 INFO:teuthology.orchestra.run.smithi115.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-13T16:55:03.221 INFO:teuthology.orchestra.run.smithi115.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-13T16:55:03.221 INFO:teuthology.orchestra.run.smithi115.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-13T16:55:03.221 INFO:teuthology.orchestra.run.smithi115.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-13T16:55:03.222 INFO:teuthology.orchestra.run.smithi115.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-13T16:55:03.222 INFO:teuthology.orchestra.run.smithi115.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-13T16:55:03.222 INFO:teuthology.orchestra.run.smithi115.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-13T16:55:03.222 INFO:teuthology.orchestra.run.smithi115.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-13T16:55:03.222 INFO:teuthology.orchestra.run.smithi115.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-13T16:55:03.222 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T16:55:03.222 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-09-13T16:55:03.588 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install ceph-mgr-rook 2024-09-13T16:55:03.993 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.4-843.g2c0145 12/12 2024-09-13T16:55:03.994 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.4-843.g2c0145 1/12 2024-09-13T16:55:03.994 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-13T16:55:03.994 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-13T16:55:03.994 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-13T16:55:03.994 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-13T16:55:03.994 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-13T16:55:03.994 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-13T16:55:03.994 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-13T16:55:03.994 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-13T16:55:03.996 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-13T16:55:03.996 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-13T16:55:04.161 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:01:11 ago on Fri 13 Sep 2024 04:53:53 PM UTC. 2024-09-13T16:55:04.294 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-09-13T16:55:04.295 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T16:55:04.296 INFO:teuthology.orchestra.run.smithi115.stdout: Package Arch Version Repository Size 2024-09-13T16:55:04.296 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T16:55:04.296 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2024-09-13T16:55:04.296 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-rook noarch 2:18.2.4-843.g2c01458a.el9 ceph-noarch 49 k 2024-09-13T16:55:04.296 INFO:teuthology.orchestra.run.smithi115.stdout:Installing dependencies: 2024-09-13T16:55:04.296 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-13T16:55:04.296 INFO:teuthology.orchestra.run.smithi115.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-13T16:55:04.296 INFO:teuthology.orchestra.run.smithi115.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-13T16:55:04.296 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-13T16:55:04.297 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-13T16:55:04.297 INFO:teuthology.orchestra.run.smithi115.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-13T16:55:04.297 INFO:teuthology.orchestra.run.smithi115.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-13T16:55:04.297 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-13T16:55:04.297 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-13T16:55:04.297 INFO:teuthology.orchestra.run.smithi115.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-13T16:55:04.297 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-13T16:55:04.297 INFO:teuthology.orchestra.run.smithi115.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-13T16:55:04.297 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T16:55:04.297 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2024-09-13T16:55:04.297 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T16:55:04.297 INFO:teuthology.orchestra.run.smithi115.stdout:Install 13 Packages 2024-09-13T16:55:04.298 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T16:55:04.298 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 2.2 M 2024-09-13T16:55:04.299 INFO:teuthology.orchestra.run.smithi115.stdout:Installed size: 26 M 2024-09-13T16:55:04.299 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading Packages: 2024-09-13T16:55:04.422 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-13T16:55:04.422 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:55:04.423 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-09-13T16:55:04.423 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-diskprediction-local-2:18.2.4-843.g2c01458a.el9.noarch 2024-09-13T16:55:04.423 INFO:teuthology.orchestra.run.smithi195.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-13T16:55:04.423 INFO:teuthology.orchestra.run.smithi195.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-13T16:55:04.423 INFO:teuthology.orchestra.run.smithi195.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-13T16:55:04.423 INFO:teuthology.orchestra.run.smithi195.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-13T16:55:04.423 INFO:teuthology.orchestra.run.smithi195.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-13T16:55:04.423 INFO:teuthology.orchestra.run.smithi195.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-13T16:55:04.423 INFO:teuthology.orchestra.run.smithi195.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-13T16:55:04.423 INFO:teuthology.orchestra.run.smithi195.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-13T16:55:04.423 INFO:teuthology.orchestra.run.smithi195.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-13T16:55:04.423 INFO:teuthology.orchestra.run.smithi195.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-13T16:55:04.423 INFO:teuthology.orchestra.run.smithi195.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-13T16:55:04.423 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:55:04.424 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-09-13T16:55:04.834 INFO:teuthology.orchestra.run.smithi115.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 207 kB/s | 19 kB 00:00 2024-09-13T16:55:04.857 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install ceph-mgr-rook 2024-09-13T16:55:04.858 INFO:teuthology.orchestra.run.smithi115.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 218 kB/s | 26 kB 00:00 2024-09-13T16:55:04.967 INFO:teuthology.orchestra.run.smithi115.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.6 MB/s | 222 kB 00:00 2024-09-13T16:55:04.993 INFO:teuthology.orchestra.run.smithi115.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.2 MB/s | 159 kB 00:00 2024-09-13T16:55:05.035 INFO:teuthology.orchestra.run.smithi115.stdout:(5/13): python3-pyasn1-modules-0.4.8-6.el9.noar 4.1 MB/s | 279 kB 00:00 2024-09-13T16:55:05.060 INFO:teuthology.orchestra.run.smithi115.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 802 kB/s | 54 kB 00:00 2024-09-13T16:55:05.102 INFO:teuthology.orchestra.run.smithi115.stdout:(7/13): ceph-mgr-rook-18.2.4-843.g2c01458a.el9. 136 kB/s | 49 kB 00:00 2024-09-13T16:55:05.127 INFO:teuthology.orchestra.run.smithi115.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 349 kB/s | 32 kB 00:00 2024-09-13T16:55:05.161 INFO:teuthology.orchestra.run.smithi115.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 141 kB/s | 14 kB 00:00 2024-09-13T16:55:05.178 INFO:teuthology.orchestra.run.smithi115.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 3.9 MB/s | 59 kB 00:00 2024-09-13T16:55:05.211 INFO:teuthology.orchestra.run.smithi115.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 2.6 MB/s | 90 kB 00:00 2024-09-13T16:55:05.237 INFO:teuthology.orchestra.run.smithi115.stdout:(12/13): python3-google-auth-2.34.0-1.el9.noarc 1.6 MB/s | 220 kB 00:00 2024-09-13T16:55:05.303 INFO:teuthology.orchestra.run.smithi115.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 6.1 MB/s | 1.0 MB 00:00 2024-09-13T16:55:05.308 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2024-09-13T16:55:05.308 INFO:teuthology.orchestra.run.smithi115.stdout:Total 2.2 MB/s | 2.2 MB 00:01 2024-09-13T16:55:05.381 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2024-09-13T16:55:05.396 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction check succeeded. 2024-09-13T16:55:05.397 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2024-09-13T16:55:05.433 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:01:14 ago on Fri 13 Sep 2024 04:53:51 PM UTC. 2024-09-13T16:55:05.484 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded. 2024-09-13T16:55:05.484 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2024-09-13T16:55:05.568 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-09-13T16:55:05.569 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T16:55:05.569 INFO:teuthology.orchestra.run.smithi195.stdout: Package Arch Version Repository Size 2024-09-13T16:55:05.569 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T16:55:05.569 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-09-13T16:55:05.569 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-rook noarch 2:18.2.4-843.g2c01458a.el9 ceph-noarch 49 k 2024-09-13T16:55:05.569 INFO:teuthology.orchestra.run.smithi195.stdout:Installing dependencies: 2024-09-13T16:55:05.569 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-13T16:55:05.569 INFO:teuthology.orchestra.run.smithi195.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-13T16:55:05.570 INFO:teuthology.orchestra.run.smithi195.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-13T16:55:05.570 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-13T16:55:05.570 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-13T16:55:05.570 INFO:teuthology.orchestra.run.smithi195.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-13T16:55:05.570 INFO:teuthology.orchestra.run.smithi195.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-13T16:55:05.570 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-13T16:55:05.570 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-13T16:55:05.570 INFO:teuthology.orchestra.run.smithi195.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-13T16:55:05.570 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-13T16:55:05.570 INFO:teuthology.orchestra.run.smithi195.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-13T16:55:05.570 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:55:05.570 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-09-13T16:55:05.570 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T16:55:05.571 INFO:teuthology.orchestra.run.smithi195.stdout:Install 13 Packages 2024-09-13T16:55:05.571 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:55:05.571 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 2.2 M 2024-09-13T16:55:05.571 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 26 M 2024-09-13T16:55:05.571 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-09-13T16:55:05.913 INFO:teuthology.orchestra.run.smithi195.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 224 kB/s | 26 kB 00:00 2024-09-13T16:55:05.938 INFO:teuthology.orchestra.run.smithi195.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 137 kB/s | 19 kB 00:00 2024-09-13T16:55:06.006 INFO:teuthology.orchestra.run.smithi115.stdout: Preparing : 1/1 2024-09-13T16:55:06.063 INFO:teuthology.orchestra.run.smithi195.stdout:(3/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.2 MB/s | 159 kB 00:00 2024-09-13T16:55:06.097 INFO:teuthology.orchestra.run.smithi195.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.4 MB/s | 222 kB 00:00 2024-09-13T16:55:06.156 INFO:teuthology.orchestra.run.smithi195.stdout:(5/13): python3-pyasn1-modules-0.4.8-6.el9.noar 3.0 MB/s | 279 kB 00:00 2024-09-13T16:55:06.181 INFO:teuthology.orchestra.run.smithi195.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 642 kB/s | 54 kB 00:00 2024-09-13T16:55:06.183 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-13T16:55:06.223 INFO:teuthology.orchestra.run.smithi195.stdout:(7/13): ceph-mgr-rook-18.2.4-843.g2c01458a.el9. 116 kB/s | 49 kB 00:00 2024-09-13T16:55:06.246 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-13T16:55:06.257 INFO:teuthology.orchestra.run.smithi195.stdout:(8/13): python3-certifi-2023.05.07-4.el9.noarch 187 kB/s | 14 kB 00:00 2024-09-13T16:55:06.282 INFO:teuthology.orchestra.run.smithi195.stdout:(9/13): python3-cachetools-4.2.4-1.el9.noarch.r 256 kB/s | 32 kB 00:00 2024-09-13T16:55:06.307 INFO:teuthology.orchestra.run.smithi195.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-13T16:55:06.310 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-13T16:55:06.333 INFO:teuthology.orchestra.run.smithi195.stdout:(11/13): python3-google-auth-2.34.0-1.el9.noarc 2.0 MB/s | 220 kB 00:00 2024-09-13T16:55:06.348 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-13T16:55:06.358 INFO:teuthology.orchestra.run.smithi195.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.7 MB/s | 90 kB 00:00 2024-09-13T16:55:06.389 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-13T16:55:06.408 INFO:teuthology.orchestra.run.smithi195.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 6.8 MB/s | 1.0 MB 00:00 2024-09-13T16:55:06.412 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-09-13T16:55:06.412 INFO:teuthology.orchestra.run.smithi195.stdout:Total 2.6 MB/s | 2.2 MB 00:00 2024-09-13T16:55:06.476 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-09-13T16:55:06.491 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-13T16:55:06.491 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-09-13T16:55:06.491 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-09-13T16:55:06.581 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-09-13T16:55:06.582 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-09-13T16:55:06.591 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-13T16:55:06.641 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-13T16:55:07.087 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-09-13T16:55:07.273 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-13T16:55:07.335 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-13T16:55:07.350 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-13T16:55:07.389 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-13T16:55:07.413 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-13T16:55:07.427 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-13T16:55:07.446 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-13T16:55:07.477 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-13T16:55:07.495 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-13T16:55:07.524 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mgr-rook-2:18.2.4-843.g2c01458a.el9.noarch 13/13 2024-09-13T16:55:07.579 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-13T16:55:07.680 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-13T16:55:07.737 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-13T16:55:08.370 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.4-843.g2c01458a.el9.noarch 13/13 2024-09-13T16:55:08.370 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mgr-rook-2:18.2.4-843.g2c01458a.el9.noarch 1/13 2024-09-13T16:55:08.371 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-13T16:55:08.371 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-13T16:55:08.371 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-13T16:55:08.371 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-13T16:55:08.371 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-13T16:55:08.371 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-13T16:55:08.371 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-13T16:55:08.371 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-13T16:55:08.371 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-13T16:55:08.371 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-13T16:55:08.371 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-13T16:55:08.450 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-13T16:55:08.501 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-13T16:55:08.534 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-13T16:55:08.583 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-13T16:55:08.613 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-rook-2:18.2.4-843.g2c01458a.el9.noarch 13/13 2024-09-13T16:55:08.709 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-13T16:55:08.709 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T16:55:08.709 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2024-09-13T16:55:08.709 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-rook-2:18.2.4-843.g2c01458a.el9.noarch 2024-09-13T16:55:08.709 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-13T16:55:08.709 INFO:teuthology.orchestra.run.smithi115.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-13T16:55:08.709 INFO:teuthology.orchestra.run.smithi115.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-13T16:55:08.709 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-13T16:55:08.709 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-13T16:55:08.710 INFO:teuthology.orchestra.run.smithi115.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-13T16:55:08.710 INFO:teuthology.orchestra.run.smithi115.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-13T16:55:08.710 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-13T16:55:08.710 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-13T16:55:08.710 INFO:teuthology.orchestra.run.smithi115.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-13T16:55:08.710 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-13T16:55:08.710 INFO:teuthology.orchestra.run.smithi115.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-13T16:55:08.710 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T16:55:08.710 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-09-13T16:55:08.970 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install ceph-mgr-cephadm 2024-09-13T16:55:09.542 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:01:16 ago on Fri 13 Sep 2024 04:53:53 PM UTC. 2024-09-13T16:55:09.566 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.4-843.g2c01458a.el9.noarch 13/13 2024-09-13T16:55:09.566 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-rook-2:18.2.4-843.g2c01458a.el9.noarch 1/13 2024-09-13T16:55:09.566 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-13T16:55:09.566 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-13T16:55:09.566 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-13T16:55:09.566 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-13T16:55:09.567 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-13T16:55:09.567 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-13T16:55:09.567 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-13T16:55:09.567 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-13T16:55:09.567 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-13T16:55:09.567 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-13T16:55:09.567 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-13T16:55:09.676 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-09-13T16:55:09.676 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T16:55:09.676 INFO:teuthology.orchestra.run.smithi115.stdout: Package Arch Version Repository Size 2024-09-13T16:55:09.676 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T16:55:09.676 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2024-09-13T16:55:09.677 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-cephadm noarch 2:18.2.4-843.g2c01458a.el9 ceph-noarch 139 k 2024-09-13T16:55:09.677 INFO:teuthology.orchestra.run.smithi115.stdout:Installing dependencies: 2024-09-13T16:55:09.677 INFO:teuthology.orchestra.run.smithi115.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-13T16:55:09.677 INFO:teuthology.orchestra.run.smithi115.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-13T16:55:09.677 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-13T16:55:09.677 INFO:teuthology.orchestra.run.smithi115.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-13T16:55:09.677 INFO:teuthology.orchestra.run.smithi115.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-13T16:55:09.677 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T16:55:09.677 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2024-09-13T16:55:09.677 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T16:55:09.677 INFO:teuthology.orchestra.run.smithi115.stdout:Install 6 Packages 2024-09-13T16:55:09.677 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T16:55:09.678 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 7.0 M 2024-09-13T16:55:09.678 INFO:teuthology.orchestra.run.smithi115.stdout:Installed size: 33 M 2024-09-13T16:55:09.678 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading Packages: 2024-09-13T16:55:09.904 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-13T16:55:09.904 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:55:09.905 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-09-13T16:55:09.905 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-rook-2:18.2.4-843.g2c01458a.el9.noarch 2024-09-13T16:55:09.905 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-13T16:55:09.905 INFO:teuthology.orchestra.run.smithi195.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-13T16:55:09.905 INFO:teuthology.orchestra.run.smithi195.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-13T16:55:09.905 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-13T16:55:09.905 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-13T16:55:09.905 INFO:teuthology.orchestra.run.smithi195.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-13T16:55:09.905 INFO:teuthology.orchestra.run.smithi195.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-13T16:55:09.905 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-13T16:55:09.905 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-13T16:55:09.905 INFO:teuthology.orchestra.run.smithi195.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-13T16:55:09.905 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-13T16:55:09.905 INFO:teuthology.orchestra.run.smithi195.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-13T16:55:09.906 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:55:09.906 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-09-13T16:55:10.123 INFO:teuthology.orchestra.run.smithi115.stdout:(1/6): ceph-mgr-cephadm-18.2.4-843.g2c01458a.el 649 kB/s | 139 kB 00:00 2024-09-13T16:55:10.173 INFO:teuthology.orchestra.run.smithi115.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 11 MB/s | 548 kB 00:00 2024-09-13T16:55:10.175 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install ceph-mgr-cephadm 2024-09-13T16:55:10.198 INFO:teuthology.orchestra.run.smithi115.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 2.2 MB/s | 58 kB 00:00 2024-09-13T16:55:10.224 INFO:teuthology.orchestra.run.smithi115.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 2.9 MB/s | 74 kB 00:00 2024-09-13T16:55:10.557 INFO:teuthology.orchestra.run.smithi115.stdout:(5/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 383 kB/s | 248 kB 00:00 2024-09-13T16:55:10.752 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:01:19 ago on Fri 13 Sep 2024 04:53:51 PM UTC. 2024-09-13T16:55:10.887 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-09-13T16:55:10.888 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T16:55:10.888 INFO:teuthology.orchestra.run.smithi195.stdout: Package Arch Version Repository Size 2024-09-13T16:55:10.888 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T16:55:10.888 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-09-13T16:55:10.888 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-cephadm noarch 2:18.2.4-843.g2c01458a.el9 ceph-noarch 139 k 2024-09-13T16:55:10.888 INFO:teuthology.orchestra.run.smithi195.stdout:Installing dependencies: 2024-09-13T16:55:10.888 INFO:teuthology.orchestra.run.smithi195.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-13T16:55:10.888 INFO:teuthology.orchestra.run.smithi195.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-13T16:55:10.888 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-13T16:55:10.888 INFO:teuthology.orchestra.run.smithi195.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-13T16:55:10.888 INFO:teuthology.orchestra.run.smithi195.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-13T16:55:10.889 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:55:10.889 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-09-13T16:55:10.889 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T16:55:10.889 INFO:teuthology.orchestra.run.smithi195.stdout:Install 6 Packages 2024-09-13T16:55:10.889 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:55:10.889 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 7.0 M 2024-09-13T16:55:10.889 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 33 M 2024-09-13T16:55:10.889 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-09-13T16:55:11.249 INFO:teuthology.orchestra.run.smithi115.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 4.4 MB/s | 6.0 MB 00:01 2024-09-13T16:55:11.251 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2024-09-13T16:55:11.251 INFO:teuthology.orchestra.run.smithi115.stdout:Total 4.4 MB/s | 7.0 MB 00:01 2024-09-13T16:55:11.324 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2024-09-13T16:55:11.336 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction check succeeded. 2024-09-13T16:55:11.336 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2024-09-13T16:55:11.361 INFO:teuthology.orchestra.run.smithi195.stdout:(1/6): ceph-mgr-cephadm-18.2.4-843.g2c01458a.el 741 kB/s | 139 kB 00:00 2024-09-13T16:55:11.433 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded. 2024-09-13T16:55:11.433 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2024-09-13T16:55:11.436 INFO:teuthology.orchestra.run.smithi195.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 7.1 MB/s | 548 kB 00:00 2024-09-13T16:55:11.461 INFO:teuthology.orchestra.run.smithi195.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 2.3 MB/s | 58 kB 00:00 2024-09-13T16:55:11.487 INFO:teuthology.orchestra.run.smithi195.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 2.9 MB/s | 74 kB 00:00 2024-09-13T16:55:11.734 INFO:teuthology.orchestra.run.smithi115.stdout: Preparing : 1/1 2024-09-13T16:55:11.909 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-13T16:55:11.954 INFO:teuthology.orchestra.run.smithi195.stdout:(5/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 318 kB/s | 248 kB 00:00 2024-09-13T16:55:11.959 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-13T16:55:12.354 INFO:teuthology.orchestra.run.smithi195.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 5.1 MB/s | 6.0 MB 00:01 2024-09-13T16:55:12.356 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-09-13T16:55:12.357 INFO:teuthology.orchestra.run.smithi195.stdout:Total 4.8 MB/s | 7.0 MB 00:01 2024-09-13T16:55:12.431 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-09-13T16:55:12.442 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-09-13T16:55:12.442 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-09-13T16:55:12.488 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-13T16:55:12.541 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-09-13T16:55:12.542 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-09-13T16:55:12.570 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-13T16:55:12.657 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-13T16:55:12.688 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mgr-cephadm-2:18.2.4-843.g2c01458a.el9.noarch 6/6 2024-09-13T16:55:12.849 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-09-13T16:55:13.023 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-13T16:55:13.073 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-13T16:55:13.444 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.4-843.g2c01458a.el9.noarch 6/6 2024-09-13T16:55:13.444 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mgr-cephadm-2:18.2.4-843.g2c01458a.el9.noarch 1/6 2024-09-13T16:55:13.444 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-13T16:55:13.445 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-13T16:55:13.445 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-13T16:55:13.445 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-13T16:55:13.590 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-13T16:55:13.676 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-13T16:55:13.722 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-13T16:55:13.722 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T16:55:13.722 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2024-09-13T16:55:13.722 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-cephadm-2:18.2.4-843.g2c01458a.el9.noarch 2024-09-13T16:55:13.722 INFO:teuthology.orchestra.run.smithi115.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-13T16:55:13.722 INFO:teuthology.orchestra.run.smithi115.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-13T16:55:13.722 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-13T16:55:13.722 INFO:teuthology.orchestra.run.smithi115.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-13T16:55:13.722 INFO:teuthology.orchestra.run.smithi115.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-13T16:55:13.722 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T16:55:13.723 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-09-13T16:55:13.737 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-13T16:55:13.768 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-cephadm-2:18.2.4-843.g2c01458a.el9.noarch 6/6 2024-09-13T16:55:13.979 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install ceph-fuse 2024-09-13T16:55:14.538 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.4-843.g2c01458a.el9.noarch 6/6 2024-09-13T16:55:14.538 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-cephadm-2:18.2.4-843.g2c01458a.el9.noarch 1/6 2024-09-13T16:55:14.538 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-13T16:55:14.538 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-13T16:55:14.538 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-13T16:55:14.538 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-13T16:55:14.555 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:01:21 ago on Fri 13 Sep 2024 04:53:53 PM UTC. 2024-09-13T16:55:14.688 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-09-13T16:55:14.689 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T16:55:14.689 INFO:teuthology.orchestra.run.smithi115.stdout: Package Arch Version Repository Size 2024-09-13T16:55:14.689 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T16:55:14.689 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2024-09-13T16:55:14.689 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-fuse x86_64 2:18.2.4-843.g2c01458a.el9 ceph 852 k 2024-09-13T16:55:14.689 INFO:teuthology.orchestra.run.smithi115.stdout:Installing dependencies: 2024-09-13T16:55:14.689 INFO:teuthology.orchestra.run.smithi115.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-13T16:55:14.690 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T16:55:14.690 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2024-09-13T16:55:14.690 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T16:55:14.690 INFO:teuthology.orchestra.run.smithi115.stdout:Install 2 Packages 2024-09-13T16:55:14.690 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T16:55:14.690 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 932 k 2024-09-13T16:55:14.690 INFO:teuthology.orchestra.run.smithi115.stdout:Installed size: 2.7 M 2024-09-13T16:55:14.690 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading Packages: 2024-09-13T16:55:14.818 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-13T16:55:14.819 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:55:14.819 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-09-13T16:55:14.819 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-cephadm-2:18.2.4-843.g2c01458a.el9.noarch 2024-09-13T16:55:14.819 INFO:teuthology.orchestra.run.smithi195.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-13T16:55:14.819 INFO:teuthology.orchestra.run.smithi195.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-13T16:55:14.819 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-13T16:55:14.819 INFO:teuthology.orchestra.run.smithi195.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-13T16:55:14.819 INFO:teuthology.orchestra.run.smithi195.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-13T16:55:14.819 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:55:14.819 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-09-13T16:55:14.876 INFO:teuthology.orchestra.run.smithi115.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 518 kB/s | 80 kB 00:00 2024-09-13T16:55:15.051 INFO:teuthology.orchestra.run.smithi115.stdout:(2/2): ceph-fuse-18.2.4-843.g2c01458a.el9.x86_6 2.5 MB/s | 852 kB 00:00 2024-09-13T16:55:15.052 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2024-09-13T16:55:15.052 INFO:teuthology.orchestra.run.smithi115.stdout:Total 2.5 MB/s | 932 kB 00:00 2024-09-13T16:55:15.063 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2024-09-13T16:55:15.080 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install ceph-fuse 2024-09-13T16:55:15.085 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction check succeeded. 2024-09-13T16:55:15.085 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2024-09-13T16:55:15.165 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded. 2024-09-13T16:55:15.165 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2024-09-13T16:55:15.352 INFO:teuthology.orchestra.run.smithi115.stdout: Preparing : 1/1 2024-09-13T16:55:15.486 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-13T16:55:15.558 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-fuse-2:18.2.4-843.g2c01458a.el9.x86_64 2/2 2024-09-13T16:55:15.651 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:01:24 ago on Fri 13 Sep 2024 04:53:51 PM UTC. 2024-09-13T16:55:15.786 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-09-13T16:55:15.787 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T16:55:15.787 INFO:teuthology.orchestra.run.smithi195.stdout: Package Arch Version Repository Size 2024-09-13T16:55:15.787 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T16:55:15.787 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-09-13T16:55:15.787 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-fuse x86_64 2:18.2.4-843.g2c01458a.el9 ceph 852 k 2024-09-13T16:55:15.787 INFO:teuthology.orchestra.run.smithi195.stdout:Installing dependencies: 2024-09-13T16:55:15.787 INFO:teuthology.orchestra.run.smithi195.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-13T16:55:15.787 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:55:15.787 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-09-13T16:55:15.787 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T16:55:15.787 INFO:teuthology.orchestra.run.smithi195.stdout:Install 2 Packages 2024-09-13T16:55:15.787 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:55:15.788 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 932 k 2024-09-13T16:55:15.788 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 2.7 M 2024-09-13T16:55:15.788 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-09-13T16:55:16.203 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-fuse-2:18.2.4-843.g2c01458a.el9.x86_64 2/2 2024-09-13T16:55:16.203 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-fuse-2:18.2.4-843.g2c01458a.el9.x86_64 1/2 2024-09-13T16:55:16.239 INFO:teuthology.orchestra.run.smithi195.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 435 kB/s | 80 kB 00:00 2024-09-13T16:55:16.496 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-13T16:55:16.497 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T16:55:16.497 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2024-09-13T16:55:16.497 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-fuse-2:18.2.4-843.g2c01458a.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-13T16:55:16.497 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T16:55:16.497 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-09-13T16:55:16.531 INFO:teuthology.orchestra.run.smithi195.stdout:(2/2): ceph-fuse-18.2.4-843.g2c01458a.el9.x86_6 1.8 MB/s | 852 kB 00:00 2024-09-13T16:55:16.532 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-09-13T16:55:16.532 INFO:teuthology.orchestra.run.smithi195.stdout:Total 1.2 MB/s | 932 kB 00:00 2024-09-13T16:55:16.544 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-09-13T16:55:16.567 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-09-13T16:55:16.567 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-09-13T16:55:16.649 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-09-13T16:55:16.649 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-09-13T16:55:16.818 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install librados-devel 2024-09-13T16:55:16.833 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-09-13T16:55:16.980 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-13T16:55:17.056 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-fuse-2:18.2.4-843.g2c01458a.el9.x86_64 2/2 2024-09-13T16:55:17.398 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:01:24 ago on Fri 13 Sep 2024 04:53:53 PM UTC. 2024-09-13T16:55:17.536 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-09-13T16:55:17.537 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T16:55:17.537 INFO:teuthology.orchestra.run.smithi115.stdout: Package Arch Version Repo Size 2024-09-13T16:55:17.537 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T16:55:17.537 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2024-09-13T16:55:17.537 INFO:teuthology.orchestra.run.smithi115.stdout: librados-devel x86_64 2:18.2.4-843.g2c01458a.el9 ceph 127 k 2024-09-13T16:55:17.537 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T16:55:17.538 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2024-09-13T16:55:17.538 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T16:55:17.538 INFO:teuthology.orchestra.run.smithi115.stdout:Install 1 Package 2024-09-13T16:55:17.538 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T16:55:17.538 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 127 k 2024-09-13T16:55:17.538 INFO:teuthology.orchestra.run.smithi115.stdout:Installed size: 456 k 2024-09-13T16:55:17.538 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading Packages: 2024-09-13T16:55:17.744 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-fuse-2:18.2.4-843.g2c01458a.el9.x86_64 2/2 2024-09-13T16:55:17.744 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-fuse-2:18.2.4-843.g2c01458a.el9.x86_64 1/2 2024-09-13T16:55:17.764 INFO:teuthology.orchestra.run.smithi115.stdout:librados-devel-18.2.4-843.g2c01458a.el9.x86_64. 560 kB/s | 127 kB 00:00 2024-09-13T16:55:17.765 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2024-09-13T16:55:17.765 INFO:teuthology.orchestra.run.smithi115.stdout:Total 556 kB/s | 127 kB 00:00 2024-09-13T16:55:17.765 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2024-09-13T16:55:17.771 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction check succeeded. 2024-09-13T16:55:17.771 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2024-09-13T16:55:17.834 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded. 2024-09-13T16:55:17.834 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2024-09-13T16:55:17.987 INFO:teuthology.orchestra.run.smithi115.stdout: Preparing : 1/1 2024-09-13T16:55:18.046 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-13T16:55:18.046 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:55:18.046 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-09-13T16:55:18.046 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-fuse-2:18.2.4-843.g2c01458a.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-13T16:55:18.046 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:55:18.046 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-09-13T16:55:18.095 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : librados-devel-2:18.2.4-843.g2c01458a.el9.x86_64 1/1 2024-09-13T16:55:18.369 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install librados-devel 2024-09-13T16:55:18.538 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: librados-devel-2:18.2.4-843.g2c01458a.el9.x86_64 1/1 2024-09-13T16:55:18.798 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librados-devel-2:18.2.4-843.g2c01458a.el9.x86_64 1/1 2024-09-13T16:55:18.798 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T16:55:18.798 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2024-09-13T16:55:18.798 INFO:teuthology.orchestra.run.smithi115.stdout: librados-devel-2:18.2.4-843.g2c01458a.el9.x86_64 2024-09-13T16:55:18.798 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T16:55:18.798 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-09-13T16:55:18.951 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:01:27 ago on Fri 13 Sep 2024 04:53:51 PM UTC. 2024-09-13T16:55:19.044 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install libcephfs2 2024-09-13T16:55:19.087 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-09-13T16:55:19.088 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T16:55:19.088 INFO:teuthology.orchestra.run.smithi195.stdout: Package Arch Version Repo Size 2024-09-13T16:55:19.088 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T16:55:19.088 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-09-13T16:55:19.088 INFO:teuthology.orchestra.run.smithi195.stdout: librados-devel x86_64 2:18.2.4-843.g2c01458a.el9 ceph 127 k 2024-09-13T16:55:19.088 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:55:19.088 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-09-13T16:55:19.088 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T16:55:19.088 INFO:teuthology.orchestra.run.smithi195.stdout:Install 1 Package 2024-09-13T16:55:19.088 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:55:19.088 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 127 k 2024-09-13T16:55:19.089 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 456 k 2024-09-13T16:55:19.089 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-09-13T16:55:19.312 INFO:teuthology.orchestra.run.smithi195.stdout:librados-devel-18.2.4-843.g2c01458a.el9.x86_64. 569 kB/s | 127 kB 00:00 2024-09-13T16:55:19.312 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-09-13T16:55:19.312 INFO:teuthology.orchestra.run.smithi195.stdout:Total 565 kB/s | 127 kB 00:00 2024-09-13T16:55:19.313 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-09-13T16:55:19.318 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-09-13T16:55:19.318 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-09-13T16:55:19.381 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-09-13T16:55:19.382 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-09-13T16:55:19.533 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-09-13T16:55:19.634 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : librados-devel-2:18.2.4-843.g2c01458a.el9.x86_64 1/1 2024-09-13T16:55:19.636 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:01:26 ago on Fri 13 Sep 2024 04:53:53 PM UTC. 2024-09-13T16:55:19.729 INFO:teuthology.orchestra.run.smithi115.stdout:Package libcephfs2-2:18.2.4-843.g2c01458a.el9.x86_64 is already installed. 2024-09-13T16:55:19.774 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-09-13T16:55:19.775 INFO:teuthology.orchestra.run.smithi115.stdout:Nothing to do. 2024-09-13T16:55:19.775 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-09-13T16:55:19.847 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install libcephfs-devel 2024-09-13T16:55:20.082 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librados-devel-2:18.2.4-843.g2c01458a.el9.x86_64 1/1 2024-09-13T16:55:20.371 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librados-devel-2:18.2.4-843.g2c01458a.el9.x86_64 1/1 2024-09-13T16:55:20.371 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:55:20.371 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-09-13T16:55:20.371 INFO:teuthology.orchestra.run.smithi195.stdout: librados-devel-2:18.2.4-843.g2c01458a.el9.x86_64 2024-09-13T16:55:20.371 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:55:20.371 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-09-13T16:55:20.412 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:01:27 ago on Fri 13 Sep 2024 04:53:53 PM UTC. 2024-09-13T16:55:20.546 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-09-13T16:55:20.547 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T16:55:20.547 INFO:teuthology.orchestra.run.smithi115.stdout: Package Arch Version Repo Size 2024-09-13T16:55:20.547 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T16:55:20.547 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2024-09-13T16:55:20.548 INFO:teuthology.orchestra.run.smithi115.stdout: libcephfs-devel x86_64 2:18.2.4-843.g2c01458a.el9 ceph 31 k 2024-09-13T16:55:20.548 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T16:55:20.548 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2024-09-13T16:55:20.548 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T16:55:20.548 INFO:teuthology.orchestra.run.smithi115.stdout:Install 1 Package 2024-09-13T16:55:20.549 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T16:55:20.549 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 31 k 2024-09-13T16:55:20.549 INFO:teuthology.orchestra.run.smithi115.stdout:Installed size: 139 k 2024-09-13T16:55:20.549 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading Packages: 2024-09-13T16:55:20.595 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install libcephfs2 2024-09-13T16:55:20.694 INFO:teuthology.orchestra.run.smithi115.stdout:libcephfs-devel-18.2.4-843.g2c01458a.el9.x86_64 212 kB/s | 31 kB 00:00 2024-09-13T16:55:20.694 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2024-09-13T16:55:20.694 INFO:teuthology.orchestra.run.smithi115.stdout:Total 210 kB/s | 31 kB 00:00 2024-09-13T16:55:20.694 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2024-09-13T16:55:20.698 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction check succeeded. 2024-09-13T16:55:20.698 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2024-09-13T16:55:20.717 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded. 2024-09-13T16:55:20.717 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2024-09-13T16:55:20.800 INFO:teuthology.orchestra.run.smithi115.stdout: Preparing : 1/1 2024-09-13T16:55:20.907 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libcephfs-devel-2:18.2.4-843.g2c01458a.el9.x86_64 1/1 2024-09-13T16:55:21.178 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:01:30 ago on Fri 13 Sep 2024 04:53:51 PM UTC. 2024-09-13T16:55:21.271 INFO:teuthology.orchestra.run.smithi195.stdout:Package libcephfs2-2:18.2.4-843.g2c01458a.el9.x86_64 is already installed. 2024-09-13T16:55:21.288 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libcephfs-devel-2:18.2.4-843.g2c01458a.el9.x86_64 1/1 2024-09-13T16:55:21.315 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-09-13T16:55:21.316 INFO:teuthology.orchestra.run.smithi195.stdout:Nothing to do. 2024-09-13T16:55:21.317 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-09-13T16:55:21.377 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install libcephfs-devel 2024-09-13T16:55:21.520 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libcephfs-devel-2:18.2.4-843.g2c01458a.el9.x86_64 1/1 2024-09-13T16:55:21.520 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T16:55:21.520 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2024-09-13T16:55:21.520 INFO:teuthology.orchestra.run.smithi115.stdout: libcephfs-devel-2:18.2.4-843.g2c01458a.el9.x86_64 2024-09-13T16:55:21.520 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T16:55:21.520 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-09-13T16:55:21.708 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install librados2 2024-09-13T16:55:21.947 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:01:30 ago on Fri 13 Sep 2024 04:53:51 PM UTC. 2024-09-13T16:55:22.080 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-09-13T16:55:22.081 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T16:55:22.081 INFO:teuthology.orchestra.run.smithi195.stdout: Package Arch Version Repo Size 2024-09-13T16:55:22.081 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T16:55:22.081 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-09-13T16:55:22.081 INFO:teuthology.orchestra.run.smithi195.stdout: libcephfs-devel x86_64 2:18.2.4-843.g2c01458a.el9 ceph 31 k 2024-09-13T16:55:22.081 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:55:22.081 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-09-13T16:55:22.082 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T16:55:22.082 INFO:teuthology.orchestra.run.smithi195.stdout:Install 1 Package 2024-09-13T16:55:22.082 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:55:22.082 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 31 k 2024-09-13T16:55:22.082 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 139 k 2024-09-13T16:55:22.082 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-09-13T16:55:22.273 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:01:29 ago on Fri 13 Sep 2024 04:53:53 PM UTC. 2024-09-13T16:55:22.363 INFO:teuthology.orchestra.run.smithi115.stdout:Package librados2-2:18.2.4-843.g2c01458a.el9.x86_64 is already installed. 2024-09-13T16:55:22.405 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-09-13T16:55:22.406 INFO:teuthology.orchestra.run.smithi115.stdout:Nothing to do. 2024-09-13T16:55:22.406 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-09-13T16:55:22.415 INFO:teuthology.orchestra.run.smithi195.stdout:libcephfs-devel-18.2.4-843.g2c01458a.el9.x86_64 93 kB/s | 31 kB 00:00 2024-09-13T16:55:22.416 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-09-13T16:55:22.416 INFO:teuthology.orchestra.run.smithi195.stdout:Total 93 kB/s | 31 kB 00:00 2024-09-13T16:55:22.416 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-09-13T16:55:22.420 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-09-13T16:55:22.420 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-09-13T16:55:22.435 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-09-13T16:55:22.435 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-09-13T16:55:22.479 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install librbd1 2024-09-13T16:55:22.523 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-09-13T16:55:22.637 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libcephfs-devel-2:18.2.4-843.g2c01458a.el9.x86_64 1/1 2024-09-13T16:55:22.992 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libcephfs-devel-2:18.2.4-843.g2c01458a.el9.x86_64 1/1 2024-09-13T16:55:23.041 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:01:30 ago on Fri 13 Sep 2024 04:53:53 PM UTC. 2024-09-13T16:55:23.130 INFO:teuthology.orchestra.run.smithi115.stdout:Package librbd1-2:18.2.4-843.g2c01458a.el9.x86_64 is already installed. 2024-09-13T16:55:23.173 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-09-13T16:55:23.174 INFO:teuthology.orchestra.run.smithi115.stdout:Nothing to do. 2024-09-13T16:55:23.174 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-09-13T16:55:23.222 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libcephfs-devel-2:18.2.4-843.g2c01458a.el9.x86_64 1/1 2024-09-13T16:55:23.222 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:55:23.222 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-09-13T16:55:23.222 INFO:teuthology.orchestra.run.smithi195.stdout: libcephfs-devel-2:18.2.4-843.g2c01458a.el9.x86_64 2024-09-13T16:55:23.222 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:55:23.223 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-09-13T16:55:23.245 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install python3-rados 2024-09-13T16:55:23.395 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install librados2 2024-09-13T16:55:23.809 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:01:30 ago on Fri 13 Sep 2024 04:53:53 PM UTC. 2024-09-13T16:55:23.898 INFO:teuthology.orchestra.run.smithi115.stdout:Package python3-rados-2:18.2.4-843.g2c01458a.el9.x86_64 is already installed. 2024-09-13T16:55:23.941 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-09-13T16:55:23.942 INFO:teuthology.orchestra.run.smithi115.stdout:Nothing to do. 2024-09-13T16:55:23.942 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-09-13T16:55:23.964 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:01:32 ago on Fri 13 Sep 2024 04:53:51 PM UTC. 2024-09-13T16:55:24.007 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install python3-rgw 2024-09-13T16:55:24.054 INFO:teuthology.orchestra.run.smithi195.stdout:Package librados2-2:18.2.4-843.g2c01458a.el9.x86_64 is already installed. 2024-09-13T16:55:24.096 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-09-13T16:55:24.097 INFO:teuthology.orchestra.run.smithi195.stdout:Nothing to do. 2024-09-13T16:55:24.097 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-09-13T16:55:24.158 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install librbd1 2024-09-13T16:55:24.572 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:01:31 ago on Fri 13 Sep 2024 04:53:53 PM UTC. 2024-09-13T16:55:24.664 INFO:teuthology.orchestra.run.smithi115.stdout:Package python3-rgw-2:18.2.4-843.g2c01458a.el9.x86_64 is already installed. 2024-09-13T16:55:24.707 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-09-13T16:55:24.708 INFO:teuthology.orchestra.run.smithi115.stdout:Nothing to do. 2024-09-13T16:55:24.708 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-09-13T16:55:24.726 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:01:33 ago on Fri 13 Sep 2024 04:53:51 PM UTC. 2024-09-13T16:55:24.775 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install python3-cephfs 2024-09-13T16:55:24.818 INFO:teuthology.orchestra.run.smithi195.stdout:Package librbd1-2:18.2.4-843.g2c01458a.el9.x86_64 is already installed. 2024-09-13T16:55:24.860 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-09-13T16:55:24.861 INFO:teuthology.orchestra.run.smithi195.stdout:Nothing to do. 2024-09-13T16:55:24.861 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-09-13T16:55:24.925 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install python3-rados 2024-09-13T16:55:25.337 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:01:32 ago on Fri 13 Sep 2024 04:53:53 PM UTC. 2024-09-13T16:55:25.427 INFO:teuthology.orchestra.run.smithi115.stdout:Package python3-cephfs-2:18.2.4-843.g2c01458a.el9.x86_64 is already installed. 2024-09-13T16:55:25.469 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-09-13T16:55:25.470 INFO:teuthology.orchestra.run.smithi115.stdout:Nothing to do. 2024-09-13T16:55:25.471 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-09-13T16:55:25.483 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:01:34 ago on Fri 13 Sep 2024 04:53:51 PM UTC. 2024-09-13T16:55:25.544 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install python3-rbd 2024-09-13T16:55:25.572 INFO:teuthology.orchestra.run.smithi195.stdout:Package python3-rados-2:18.2.4-843.g2c01458a.el9.x86_64 is already installed. 2024-09-13T16:55:25.615 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-09-13T16:55:25.616 INFO:teuthology.orchestra.run.smithi195.stdout:Nothing to do. 2024-09-13T16:55:25.616 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-09-13T16:55:25.680 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install python3-rgw 2024-09-13T16:55:26.106 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:01:33 ago on Fri 13 Sep 2024 04:53:53 PM UTC. 2024-09-13T16:55:26.195 INFO:teuthology.orchestra.run.smithi115.stdout:Package python3-rbd-2:18.2.4-843.g2c01458a.el9.x86_64 is already installed. 2024-09-13T16:55:26.238 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-09-13T16:55:26.240 INFO:teuthology.orchestra.run.smithi115.stdout:Nothing to do. 2024-09-13T16:55:26.240 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-09-13T16:55:26.241 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:01:35 ago on Fri 13 Sep 2024 04:53:51 PM UTC. 2024-09-13T16:55:26.308 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install rbd-fuse 2024-09-13T16:55:26.332 INFO:teuthology.orchestra.run.smithi195.stdout:Package python3-rgw-2:18.2.4-843.g2c01458a.el9.x86_64 is already installed. 2024-09-13T16:55:26.375 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-09-13T16:55:26.376 INFO:teuthology.orchestra.run.smithi195.stdout:Nothing to do. 2024-09-13T16:55:26.376 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-09-13T16:55:26.441 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install python3-cephfs 2024-09-13T16:55:26.867 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:01:33 ago on Fri 13 Sep 2024 04:53:53 PM UTC. 2024-09-13T16:55:26.998 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-09-13T16:55:26.999 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T16:55:26.999 INFO:teuthology.orchestra.run.smithi115.stdout: Package Architecture Version Repository Size 2024-09-13T16:55:26.999 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T16:55:26.999 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2024-09-13T16:55:26.999 INFO:teuthology.orchestra.run.smithi115.stdout: rbd-fuse x86_64 2:18.2.4-843.g2c01458a.el9 ceph 87 k 2024-09-13T16:55:26.999 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T16:55:26.999 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2024-09-13T16:55:27.000 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T16:55:27.000 INFO:teuthology.orchestra.run.smithi115.stdout:Install 1 Package 2024-09-13T16:55:27.000 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T16:55:27.000 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 87 k 2024-09-13T16:55:27.000 INFO:teuthology.orchestra.run.smithi115.stdout:Installed size: 227 k 2024-09-13T16:55:27.000 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading Packages: 2024-09-13T16:55:27.004 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:01:36 ago on Fri 13 Sep 2024 04:53:51 PM UTC. 2024-09-13T16:55:27.094 INFO:teuthology.orchestra.run.smithi195.stdout:Package python3-cephfs-2:18.2.4-843.g2c01458a.el9.x86_64 is already installed. 2024-09-13T16:55:27.137 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-09-13T16:55:27.138 INFO:teuthology.orchestra.run.smithi195.stdout:Nothing to do. 2024-09-13T16:55:27.138 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-09-13T16:55:27.188 INFO:teuthology.orchestra.run.smithi115.stdout:rbd-fuse-18.2.4-843.g2c01458a.el9.x86_64.rpm 461 kB/s | 87 kB 00:00 2024-09-13T16:55:27.189 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2024-09-13T16:55:27.189 INFO:teuthology.orchestra.run.smithi115.stdout:Total 458 kB/s | 87 kB 00:00 2024-09-13T16:55:27.189 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2024-09-13T16:55:27.196 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction check succeeded. 2024-09-13T16:55:27.196 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2024-09-13T16:55:27.205 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install python3-rbd 2024-09-13T16:55:27.260 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded. 2024-09-13T16:55:27.261 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2024-09-13T16:55:27.411 INFO:teuthology.orchestra.run.smithi115.stdout: Preparing : 1/1 2024-09-13T16:55:27.519 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : rbd-fuse-2:18.2.4-843.g2c01458a.el9.x86_64 1/1 2024-09-13T16:55:27.761 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:01:36 ago on Fri 13 Sep 2024 04:53:51 PM UTC. 2024-09-13T16:55:27.850 INFO:teuthology.orchestra.run.smithi195.stdout:Package python3-rbd-2:18.2.4-843.g2c01458a.el9.x86_64 is already installed. 2024-09-13T16:55:27.893 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-09-13T16:55:27.894 INFO:teuthology.orchestra.run.smithi195.stdout:Nothing to do. 2024-09-13T16:55:27.894 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-09-13T16:55:27.929 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: rbd-fuse-2:18.2.4-843.g2c01458a.el9.x86_64 1/1 2024-09-13T16:55:27.954 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install rbd-fuse 2024-09-13T16:55:28.185 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : rbd-fuse-2:18.2.4-843.g2c01458a.el9.x86_64 1/1 2024-09-13T16:55:28.185 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T16:55:28.185 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2024-09-13T16:55:28.185 INFO:teuthology.orchestra.run.smithi115.stdout: rbd-fuse-2:18.2.4-843.g2c01458a.el9.x86_64 2024-09-13T16:55:28.185 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T16:55:28.185 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-09-13T16:55:28.408 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install rbd-mirror 2024-09-13T16:55:28.518 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:01:37 ago on Fri 13 Sep 2024 04:53:51 PM UTC. 2024-09-13T16:55:28.652 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-09-13T16:55:28.652 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T16:55:28.653 INFO:teuthology.orchestra.run.smithi195.stdout: Package Architecture Version Repository Size 2024-09-13T16:55:28.653 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T16:55:28.653 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-09-13T16:55:28.653 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-fuse x86_64 2:18.2.4-843.g2c01458a.el9 ceph 87 k 2024-09-13T16:55:28.653 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:55:28.653 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-09-13T16:55:28.653 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T16:55:28.653 INFO:teuthology.orchestra.run.smithi195.stdout:Install 1 Package 2024-09-13T16:55:28.653 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:55:28.653 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 87 k 2024-09-13T16:55:28.653 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 227 k 2024-09-13T16:55:28.653 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-09-13T16:55:28.843 INFO:teuthology.orchestra.run.smithi195.stdout:rbd-fuse-18.2.4-843.g2c01458a.el9.x86_64.rpm 456 kB/s | 87 kB 00:00 2024-09-13T16:55:28.844 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-09-13T16:55:28.844 INFO:teuthology.orchestra.run.smithi195.stdout:Total 453 kB/s | 87 kB 00:00 2024-09-13T16:55:28.844 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-09-13T16:55:28.851 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-09-13T16:55:28.851 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-09-13T16:55:28.913 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-09-13T16:55:28.913 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-09-13T16:55:28.986 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:01:35 ago on Fri 13 Sep 2024 04:53:53 PM UTC. 2024-09-13T16:55:29.059 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-09-13T16:55:29.121 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-09-13T16:55:29.122 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T16:55:29.122 INFO:teuthology.orchestra.run.smithi115.stdout: Package Arch Version Repo Size 2024-09-13T16:55:29.122 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T16:55:29.122 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2024-09-13T16:55:29.122 INFO:teuthology.orchestra.run.smithi115.stdout: rbd-mirror x86_64 2:18.2.4-843.g2c01458a.el9 ceph 3.0 M 2024-09-13T16:55:29.122 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T16:55:29.122 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2024-09-13T16:55:29.123 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T16:55:29.123 INFO:teuthology.orchestra.run.smithi115.stdout:Install 1 Package 2024-09-13T16:55:29.123 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T16:55:29.123 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 3.0 M 2024-09-13T16:55:29.123 INFO:teuthology.orchestra.run.smithi115.stdout:Installed size: 12 M 2024-09-13T16:55:29.123 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading Packages: 2024-09-13T16:55:29.165 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : rbd-fuse-2:18.2.4-843.g2c01458a.el9.x86_64 1/1 2024-09-13T16:55:29.458 INFO:teuthology.orchestra.run.smithi115.stdout:rbd-mirror-18.2.4-843.g2c01458a.el9.x86_64.rpm 8.9 MB/s | 3.0 MB 00:00 2024-09-13T16:55:29.459 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2024-09-13T16:55:29.459 INFO:teuthology.orchestra.run.smithi115.stdout:Total 8.9 MB/s | 3.0 MB 00:00 2024-09-13T16:55:29.459 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2024-09-13T16:55:29.467 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction check succeeded. 2024-09-13T16:55:29.467 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2024-09-13T16:55:29.553 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded. 2024-09-13T16:55:29.553 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2024-09-13T16:55:29.558 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: rbd-fuse-2:18.2.4-843.g2c01458a.el9.x86_64 1/1 2024-09-13T16:55:29.839 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : rbd-fuse-2:18.2.4-843.g2c01458a.el9.x86_64 1/1 2024-09-13T16:55:29.839 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:55:29.839 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-09-13T16:55:29.839 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-fuse-2:18.2.4-843.g2c01458a.el9.x86_64 2024-09-13T16:55:29.839 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:55:29.839 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-09-13T16:55:29.998 INFO:teuthology.orchestra.run.smithi115.stdout: Preparing : 1/1 2024-09-13T16:55:30.069 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install rbd-mirror 2024-09-13T16:55:30.175 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : rbd-mirror-2:18.2.4-843.g2c01458a.el9.x86_64 1/1 2024-09-13T16:55:30.201 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: rbd-mirror-2:18.2.4-843.g2c01458a.el9.x86_64 1/1 2024-09-13T16:55:30.201 INFO:teuthology.orchestra.run.smithi115.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T16:55:30.201 INFO:teuthology.orchestra.run.smithi115.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-13T16:55:30.202 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T16:55:30.202 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T16:55:30.202 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T16:55:30.643 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:01:39 ago on Fri 13 Sep 2024 04:53:51 PM UTC. 2024-09-13T16:55:30.779 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-09-13T16:55:30.780 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T16:55:30.780 INFO:teuthology.orchestra.run.smithi195.stdout: Package Arch Version Repo Size 2024-09-13T16:55:30.780 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T16:55:30.780 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-09-13T16:55:30.780 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-mirror x86_64 2:18.2.4-843.g2c01458a.el9 ceph 3.0 M 2024-09-13T16:55:30.780 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:55:30.780 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-09-13T16:55:30.781 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T16:55:30.781 INFO:teuthology.orchestra.run.smithi195.stdout:Install 1 Package 2024-09-13T16:55:30.781 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:55:30.781 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 3.0 M 2024-09-13T16:55:30.781 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 12 M 2024-09-13T16:55:30.781 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-09-13T16:55:31.122 INFO:teuthology.orchestra.run.smithi195.stdout:rbd-mirror-18.2.4-843.g2c01458a.el9.x86_64.rpm 8.8 MB/s | 3.0 MB 00:00 2024-09-13T16:55:31.122 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-09-13T16:55:31.123 INFO:teuthology.orchestra.run.smithi195.stdout:Total 8.7 MB/s | 3.0 MB 00:00 2024-09-13T16:55:31.123 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-09-13T16:55:31.131 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-09-13T16:55:31.131 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-09-13T16:55:31.193 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : rbd-mirror-2:18.2.4-843.g2c01458a.el9.x86_64 1/1 2024-09-13T16:55:31.193 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T16:55:31.193 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2024-09-13T16:55:31.193 INFO:teuthology.orchestra.run.smithi115.stdout: rbd-mirror-2:18.2.4-843.g2c01458a.el9.x86_64 2024-09-13T16:55:31.193 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T16:55:31.193 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-09-13T16:55:31.218 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-09-13T16:55:31.218 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-09-13T16:55:31.461 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install rbd-nbd 2024-09-13T16:55:31.675 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-09-13T16:55:31.747 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : rbd-mirror-2:18.2.4-843.g2c01458a.el9.x86_64 1/1 2024-09-13T16:55:31.773 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: rbd-mirror-2:18.2.4-843.g2c01458a.el9.x86_64 1/1 2024-09-13T16:55:31.773 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T16:55:31.773 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-13T16:55:31.773 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T16:55:31.773 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T16:55:31.773 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:55:32.030 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:01:39 ago on Fri 13 Sep 2024 04:53:53 PM UTC. 2024-09-13T16:55:32.168 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-09-13T16:55:32.169 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T16:55:32.169 INFO:teuthology.orchestra.run.smithi115.stdout: Package Architecture Version Repository Size 2024-09-13T16:55:32.169 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T16:55:32.169 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2024-09-13T16:55:32.169 INFO:teuthology.orchestra.run.smithi115.stdout: rbd-nbd x86_64 2:18.2.4-843.g2c01458a.el9 ceph 172 k 2024-09-13T16:55:32.169 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T16:55:32.169 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2024-09-13T16:55:32.169 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T16:55:32.169 INFO:teuthology.orchestra.run.smithi115.stdout:Install 1 Package 2024-09-13T16:55:32.169 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T16:55:32.169 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 172 k 2024-09-13T16:55:32.169 INFO:teuthology.orchestra.run.smithi115.stdout:Installed size: 494 k 2024-09-13T16:55:32.170 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading Packages: 2024-09-13T16:55:32.379 INFO:teuthology.orchestra.run.smithi115.stdout:rbd-nbd-18.2.4-843.g2c01458a.el9.x86_64.rpm 822 kB/s | 172 kB 00:00 2024-09-13T16:55:32.379 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2024-09-13T16:55:32.379 INFO:teuthology.orchestra.run.smithi115.stdout:Total 817 kB/s | 172 kB 00:00 2024-09-13T16:55:32.379 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2024-09-13T16:55:32.387 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction check succeeded. 2024-09-13T16:55:32.387 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2024-09-13T16:55:32.450 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded. 2024-09-13T16:55:32.450 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2024-09-13T16:55:32.608 INFO:teuthology.orchestra.run.smithi115.stdout: Preparing : 1/1 2024-09-13T16:55:32.708 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : rbd-nbd-2:18.2.4-843.g2c01458a.el9.x86_64 1/1 2024-09-13T16:55:32.841 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : rbd-mirror-2:18.2.4-843.g2c01458a.el9.x86_64 1/1 2024-09-13T16:55:32.842 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:55:32.842 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-09-13T16:55:32.842 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-mirror-2:18.2.4-843.g2c01458a.el9.x86_64 2024-09-13T16:55:32.842 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:55:32.842 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-09-13T16:55:33.094 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install rbd-nbd 2024-09-13T16:55:33.151 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: rbd-nbd-2:18.2.4-843.g2c01458a.el9.x86_64 1/1 2024-09-13T16:55:33.428 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : rbd-nbd-2:18.2.4-843.g2c01458a.el9.x86_64 1/1 2024-09-13T16:55:33.428 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T16:55:33.428 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2024-09-13T16:55:33.428 INFO:teuthology.orchestra.run.smithi115.stdout: rbd-nbd-2:18.2.4-843.g2c01458a.el9.x86_64 2024-09-13T16:55:33.428 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T16:55:33.429 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-09-13T16:55:33.674 DEBUG:teuthology.parallel:result is None 2024-09-13T16:55:33.680 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:01:42 ago on Fri 13 Sep 2024 04:53:51 PM UTC. 2024-09-13T16:55:33.816 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-09-13T16:55:33.817 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T16:55:33.818 INFO:teuthology.orchestra.run.smithi195.stdout: Package Architecture Version Repository Size 2024-09-13T16:55:33.818 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T16:55:33.818 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-09-13T16:55:33.818 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-nbd x86_64 2:18.2.4-843.g2c01458a.el9 ceph 172 k 2024-09-13T16:55:33.818 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:55:33.818 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-09-13T16:55:33.818 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T16:55:33.818 INFO:teuthology.orchestra.run.smithi195.stdout:Install 1 Package 2024-09-13T16:55:33.818 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:55:33.818 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 172 k 2024-09-13T16:55:33.818 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 494 k 2024-09-13T16:55:33.818 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-09-13T16:55:34.026 INFO:teuthology.orchestra.run.smithi195.stdout:rbd-nbd-18.2.4-843.g2c01458a.el9.x86_64.rpm 830 kB/s | 172 kB 00:00 2024-09-13T16:55:34.026 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-09-13T16:55:34.027 INFO:teuthology.orchestra.run.smithi195.stdout:Total 824 kB/s | 172 kB 00:00 2024-09-13T16:55:34.027 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-09-13T16:55:34.034 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-09-13T16:55:34.034 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-09-13T16:55:34.099 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-09-13T16:55:34.099 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-09-13T16:55:34.262 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-09-13T16:55:34.364 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : rbd-nbd-2:18.2.4-843.g2c01458a.el9.x86_64 1/1 2024-09-13T16:55:34.769 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: rbd-nbd-2:18.2.4-843.g2c01458a.el9.x86_64 1/1 2024-09-13T16:55:35.033 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : rbd-nbd-2:18.2.4-843.g2c01458a.el9.x86_64 1/1 2024-09-13T16:55:35.033 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:55:35.034 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-09-13T16:55:35.034 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-nbd-2:18.2.4-843.g2c01458a.el9.x86_64 2024-09-13T16:55:35.034 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:55:35.034 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-09-13T16:55:35.330 DEBUG:teuthology.parallel:result is None 2024-09-13T16:55:35.330 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T16:55:35.330 INFO:teuthology.packaging:ref: None 2024-09-13T16:55:35.330 INFO:teuthology.packaging:tag: None 2024-09-13T16:55:35.330 INFO:teuthology.packaging:branch: reef 2024-09-13T16:55:35.330 INFO:teuthology.packaging:sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T16:55:35.331 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=reef 2024-09-13T16:55:35.608 DEBUG:teuthology.orchestra.run.smithi115:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-13T16:55:35.634 INFO:teuthology.orchestra.run.smithi115.stdout:18.2.4-843.g2c01458a.el9 2024-09-13T16:55:35.635 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-843.g2c01458a.el9 2024-09-13T16:55:35.635 INFO:teuthology.task.install:The correct ceph version 18.2.4-843.g2c01458a is installed. 2024-09-13T16:55:35.636 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T16:55:35.637 INFO:teuthology.packaging:ref: None 2024-09-13T16:55:35.637 INFO:teuthology.packaging:tag: None 2024-09-13T16:55:35.637 INFO:teuthology.packaging:branch: reef 2024-09-13T16:55:35.637 INFO:teuthology.packaging:sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T16:55:35.637 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=reef 2024-09-13T16:55:35.882 DEBUG:teuthology.orchestra.run.smithi195:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-13T16:55:35.903 INFO:teuthology.orchestra.run.smithi195.stdout:18.2.4-843.g2c01458a.el9 2024-09-13T16:55:35.904 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-843.g2c01458a.el9 2024-09-13T16:55:35.904 INFO:teuthology.task.install:The correct ceph version 18.2.4-843.g2c01458a is installed. 2024-09-13T16:55:35.906 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-13T16:55:35.906 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-13T16:55:35.906 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T16:55:35.953 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-09-13T16:55:35.953 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T16:55:35.980 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-13T16:55:35.980 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-13T16:55:35.981 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T16:55:36.022 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T16:55:36.090 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-09-13T16:55:36.090 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T16:55:36.115 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T16:55:36.180 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-13T16:55:36.181 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-13T16:55:36.181 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T16:55:36.208 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T16:55:36.275 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-09-13T16:55:36.275 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T16:55:36.299 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T16:55:36.363 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-13T16:55:36.364 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-13T16:55:36.364 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T16:55:36.391 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T16:55:36.456 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-09-13T16:55:36.456 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T16:55:36.481 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T16:55:36.546 INFO:teuthology.run_tasks:Running task print... 2024-09-13T16:55:36.558 INFO:teuthology.task.print:**** done install task... 2024-09-13T16:55:36.558 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-13T16:55:36.846 INFO:tasks.cephadm:Config: {'compiled_cephadm_branch': 'reef', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on pool no app': False}}, 'image': 'quay.ceph.io/ceph-ci/ceph:reef', 'roleless': True, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'OSD_DOWN', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'} 2024-09-13T16:55:36.846 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:reef 2024-09-13T16:55:36.847 INFO:tasks.cephadm:Cluster fsid is ffbd7588-71f0-11ef-bceb-c7b262605968 2024-09-13T16:55:36.847 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-13T16:55:36.847 INFO:tasks.cephadm:No mon roles; fabricating mons 2024-09-13T16:55:36.847 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi115': '172.21.15.115', 'mon.smithi195': '172.21.15.195'} 2024-09-13T16:55:36.847 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-13T16:55:36.847 DEBUG:teuthology.orchestra.run.smithi115:> sudo hostname $(hostname -s) 2024-09-13T16:55:36.876 DEBUG:teuthology.orchestra.run.smithi195:> sudo hostname $(hostname -s) 2024-09-13T16:55:36.902 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-13T16:55:36.902 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T16:55:37.060 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/82954/', 'root_build_cause': 'SCMTRIGGER', 'version': '18.2.4-860-g6c6b083f', 'node_name': '172.21.4.58+omani008', 'job_name': 'ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '18.2.4-860.g6c6b083f'}, 'url': 'https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-10 17:57:22.919627', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-rishabh-testing-20240910.100730-reef', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/', 'archs': ['arm64', 'x86_64', 'source'], 'distro': 'centos'}, {'status': 'ready', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/82954/', 'root_build_cause': 'SCMTRIGGER', 'version': '18.2.4-860-g6c6b083f', 'node_name': '172.21.5.40+adami10', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '18.2.4-860.g6c6b083f'}, 'url': 'https://4.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-10 13:55:29.568955', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-rishabh-testing-20240910.100730-reef', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-09-13T16:55:37.213 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref wip-rishabh-testing-20240910.100730-reef, sha1 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T16:55:37.215 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/x86_64/flavors/default/cephadm 2024-09-13T16:55:37.215 DEBUG:teuthology.orchestra.run.smithi115:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-13T16:55:37.573 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r--. 1 ubuntu ubuntu 217223 Sep 13 16:55 /home/ubuntu/cephtest/cephadm 2024-09-13T16:55:37.574 DEBUG:teuthology.orchestra.run.smithi195:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-13T16:55:37.911 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r--. 1 ubuntu ubuntu 217223 Sep 13 16:55 /home/ubuntu/cephtest/cephadm 2024-09-13T16:55:37.911 DEBUG:teuthology.orchestra.run.smithi115:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-13T16:55:37.927 DEBUG:teuthology.orchestra.run.smithi195:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-13T16:55:37.958 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:reef on all hosts... 2024-09-13T16:55:37.958 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef pull 2024-09-13T16:55:37.970 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef pull 2024-09-13T16:55:39.525 INFO:teuthology.orchestra.run.smithi115.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:reef... 2024-09-13T16:55:39.660 INFO:teuthology.orchestra.run.smithi195.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:reef... 2024-09-13T16:56:10.284 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-13T16:56:10.285 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph_version": "ceph version 18.2.4-843-g2c01458a (2c01458affee2b2435cd231b6e392435c1c21661) reef (stable)", 2024-09-13T16:56:10.285 INFO:teuthology.orchestra.run.smithi115.stdout: "image_id": "c129f5a2fd4eccce3e6eec43830eff1929af98bc48f3b850cf144ce5b326e8b5", 2024-09-13T16:56:10.285 INFO:teuthology.orchestra.run.smithi115.stdout: "repo_digests": [ 2024-09-13T16:56:10.285 INFO:teuthology.orchestra.run.smithi115.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:c37c250ffe653639d7a4124ac8acdc3c8f6a53cb4ef1f26b1d2df36648631a11" 2024-09-13T16:56:10.285 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-09-13T16:56:10.285 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-13T16:56:19.658 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-09-13T16:56:19.658 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_version": "ceph version 18.2.4-843-g2c01458a (2c01458affee2b2435cd231b6e392435c1c21661) reef (stable)", 2024-09-13T16:56:19.658 INFO:teuthology.orchestra.run.smithi195.stdout: "image_id": "c129f5a2fd4eccce3e6eec43830eff1929af98bc48f3b850cf144ce5b326e8b5", 2024-09-13T16:56:19.658 INFO:teuthology.orchestra.run.smithi195.stdout: "repo_digests": [ 2024-09-13T16:56:19.658 INFO:teuthology.orchestra.run.smithi195.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:c37c250ffe653639d7a4124ac8acdc3c8f6a53cb4ef1f26b1d2df36648631a11" 2024-09-13T16:56:19.659 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-09-13T16:56:19.659 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-09-13T16:56:19.678 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /etc/ceph 2024-09-13T16:56:19.712 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /etc/ceph 2024-09-13T16:56:19.740 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 777 /etc/ceph 2024-09-13T16:56:19.782 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 777 /etc/ceph 2024-09-13T16:56:19.806 INFO:tasks.cephadm:Writing seed config... 2024-09-13T16:56:19.810 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2024-09-13T16:56:19.810 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2024-09-13T16:56:19.810 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-09-13T16:56:19.810 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-09-13T16:56:19.810 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-09-13T16:56:19.810 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-13T16:56:19.810 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-13T16:56:19.810 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-09-13T16:56:19.810 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-09-13T16:56:19.811 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-13T16:56:19.811 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-13T16:56:19.811 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-09-13T16:56:19.811 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-13T16:56:19.811 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-13T16:56:19.811 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-13T16:56:19.811 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-13T16:56:19.811 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-13T16:56:19.811 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-13T16:56:19.811 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-13T16:56:19.812 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-13T16:56:19.812 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-13T16:56:19.812 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-13T16:56:19.812 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-13T16:56:19.812 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2024-09-13T16:56:19.812 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-13T16:56:19.812 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-13T16:56:19.812 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-13T16:56:19.812 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-13T16:56:19.812 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-13T16:56:19.812 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-13T16:56:19.812 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-13T16:56:19.812 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-13T16:56:19.813 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-13T16:56:19.813 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-13T16:56:19.813 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-13T16:56:19.813 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-13T16:56:19.813 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-13T16:56:19.813 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-13T16:56:19.813 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-13T16:56:19.813 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-13T16:56:19.813 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-13T16:56:19.813 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-13T16:56:19.814 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-13T16:56:19.814 DEBUG:teuthology.orchestra.run.smithi115:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-13T16:56:19.840 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = ffbd7588-71f0-11ef-bceb-c7b262605968 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-13T16:56:19.840 DEBUG:teuthology.orchestra.run.smithi115:mon.smithi115> sudo journalctl -f -n 0 -u ceph-ffbd7588-71f0-11ef-bceb-c7b262605968@mon.smithi115.service 2024-09-13T16:56:19.883 INFO:tasks.cephadm:Bootstrapping... 2024-09-13T16:56:19.883 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef -v bootstrap --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.115 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-13T16:56:20.041 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2024-09-13T16:56:20.041 INFO:teuthology.orchestra.run.smithi115.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:reef', '-v', 'bootstrap', '--fsid', 'ffbd7588-71f0-11ef-bceb-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.115', '--skip-admin-label'] 2024-09-13T16:56:20.065 INFO:teuthology.orchestra.run.smithi115.stdout:/bin/podman: stdout 5.2.2 2024-09-13T16:56:20.065 INFO:teuthology.orchestra.run.smithi115.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-13T16:56:20.066 INFO:teuthology.orchestra.run.smithi115.stdout:Verifying podman|docker is present... 2024-09-13T16:56:20.088 INFO:teuthology.orchestra.run.smithi115.stdout:/bin/podman: stdout 5.2.2 2024-09-13T16:56:20.088 INFO:teuthology.orchestra.run.smithi115.stdout:Verifying lvm2 is present... 2024-09-13T16:56:20.088 INFO:teuthology.orchestra.run.smithi115.stdout:Verifying time synchronization is in place... 2024-09-13T16:56:20.096 INFO:teuthology.orchestra.run.smithi115.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-13T16:56:20.096 INFO:teuthology.orchestra.run.smithi115.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-13T16:56:20.102 INFO:teuthology.orchestra.run.smithi115.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-13T16:56:20.102 INFO:teuthology.orchestra.run.smithi115.stdout:systemctl: stdout inactive 2024-09-13T16:56:20.109 INFO:teuthology.orchestra.run.smithi115.stdout:systemctl: stdout enabled 2024-09-13T16:56:20.115 INFO:teuthology.orchestra.run.smithi115.stdout:systemctl: stdout active 2024-09-13T16:56:20.115 INFO:teuthology.orchestra.run.smithi115.stdout:Unit chronyd.service is enabled and running 2024-09-13T16:56:20.115 INFO:teuthology.orchestra.run.smithi115.stdout:Repeating the final host check... 2024-09-13T16:56:20.137 INFO:teuthology.orchestra.run.smithi115.stdout:/bin/podman: stdout 5.2.2 2024-09-13T16:56:20.137 INFO:teuthology.orchestra.run.smithi115.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-13T16:56:20.137 INFO:teuthology.orchestra.run.smithi115.stdout:systemctl is present 2024-09-13T16:56:20.137 INFO:teuthology.orchestra.run.smithi115.stdout:lvcreate is present 2024-09-13T16:56:20.144 INFO:teuthology.orchestra.run.smithi115.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-13T16:56:20.144 INFO:teuthology.orchestra.run.smithi115.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-13T16:56:20.150 INFO:teuthology.orchestra.run.smithi115.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-13T16:56:20.150 INFO:teuthology.orchestra.run.smithi115.stdout:systemctl: stdout inactive 2024-09-13T16:56:20.156 INFO:teuthology.orchestra.run.smithi115.stdout:systemctl: stdout enabled 2024-09-13T16:56:20.163 INFO:teuthology.orchestra.run.smithi115.stdout:systemctl: stdout active 2024-09-13T16:56:20.163 INFO:teuthology.orchestra.run.smithi115.stdout:Unit chronyd.service is enabled and running 2024-09-13T16:56:20.163 INFO:teuthology.orchestra.run.smithi115.stdout:Host looks OK 2024-09-13T16:56:20.163 INFO:teuthology.orchestra.run.smithi115.stdout:Cluster fsid: ffbd7588-71f0-11ef-bceb-c7b262605968 2024-09-13T16:56:20.163 INFO:teuthology.orchestra.run.smithi115.stdout:Acquiring lock 140466489484624 on /run/cephadm/ffbd7588-71f0-11ef-bceb-c7b262605968.lock 2024-09-13T16:56:20.163 INFO:teuthology.orchestra.run.smithi115.stdout:Lock 140466489484624 acquired on /run/cephadm/ffbd7588-71f0-11ef-bceb-c7b262605968.lock 2024-09-13T16:56:20.164 INFO:teuthology.orchestra.run.smithi115.stdout:Verifying IP 172.21.15.115 port 3300 ... 2024-09-13T16:56:20.164 INFO:teuthology.orchestra.run.smithi115.stdout:Verifying IP 172.21.15.115 port 6789 ... 2024-09-13T16:56:20.164 INFO:teuthology.orchestra.run.smithi115.stdout:Base mon IP(s) is [172.21.15.115:3300, 172.21.15.115:6789], mon addrv is [v2:172.21.15.115:3300,v1:172.21.15.115:6789] 2024-09-13T16:56:20.167 INFO:teuthology.orchestra.run.smithi115.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.115 metric 100 2024-09-13T16:56:20.167 INFO:teuthology.orchestra.run.smithi115.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.115 metric 100 2024-09-13T16:56:20.170 INFO:teuthology.orchestra.run.smithi115.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-13T16:56:20.170 INFO:teuthology.orchestra.run.smithi115.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-09-13T16:56:20.170 INFO:teuthology.orchestra.run.smithi115.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-09-13T16:56:20.172 INFO:teuthology.orchestra.run.smithi115.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-13T16:56:20.172 INFO:teuthology.orchestra.run.smithi115.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-13T16:56:20.173 INFO:teuthology.orchestra.run.smithi115.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-13T16:56:20.173 INFO:teuthology.orchestra.run.smithi115.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-09-13T16:56:20.173 INFO:teuthology.orchestra.run.smithi115.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:ce8f/64 scope link noprefixroute 2024-09-13T16:56:20.173 INFO:teuthology.orchestra.run.smithi115.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-13T16:56:20.174 INFO:teuthology.orchestra.run.smithi115.stdout:Mon IP `172.21.15.115` is in CIDR network `172.21.0.0/20` 2024-09-13T16:56:20.174 INFO:teuthology.orchestra.run.smithi115.stdout:Mon IP `172.21.15.115` is in CIDR network `172.21.0.0/20` 2024-09-13T16:56:20.174 INFO:teuthology.orchestra.run.smithi115.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-13T16:56:20.174 INFO:teuthology.orchestra.run.smithi115.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-13T16:56:20.174 INFO:teuthology.orchestra.run.smithi115.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:reef... 2024-09-13T16:56:20.759 INFO:teuthology.orchestra.run.smithi115.stdout:/bin/podman: stdout c129f5a2fd4eccce3e6eec43830eff1929af98bc48f3b850cf144ce5b326e8b5 2024-09-13T16:56:20.759 INFO:teuthology.orchestra.run.smithi115.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:reef... 2024-09-13T16:56:20.759 INFO:teuthology.orchestra.run.smithi115.stdout:/bin/podman: stderr Getting image source signatures 2024-09-13T16:56:20.759 INFO:teuthology.orchestra.run.smithi115.stdout:/bin/podman: stderr Copying blob sha256:f9a1328d66f49e17fe78ed666f97dd3c34cc07be60bd7ae6ba8f2402a2a33f7f 2024-09-13T16:56:20.759 INFO:teuthology.orchestra.run.smithi115.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-13T16:56:20.759 INFO:teuthology.orchestra.run.smithi115.stdout:/bin/podman: stderr Copying config sha256:c129f5a2fd4eccce3e6eec43830eff1929af98bc48f3b850cf144ce5b326e8b5 2024-09-13T16:56:20.760 INFO:teuthology.orchestra.run.smithi115.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-13T16:56:21.663 INFO:teuthology.orchestra.run.smithi115.stdout:ceph: stdout ceph version 18.2.4-843-g2c01458a (2c01458affee2b2435cd231b6e392435c1c21661) reef (stable) 2024-09-13T16:56:21.663 INFO:teuthology.orchestra.run.smithi115.stdout:Ceph version: ceph version 18.2.4-843-g2c01458a (2c01458affee2b2435cd231b6e392435c1c21661) reef (stable) 2024-09-13T16:56:21.663 INFO:teuthology.orchestra.run.smithi115.stdout:Extracting ceph user uid/gid from container image... 2024-09-13T16:56:22.586 INFO:teuthology.orchestra.run.smithi115.stdout:stat: stdout 167 167 2024-09-13T16:56:22.586 INFO:teuthology.orchestra.run.smithi115.stdout:Creating initial keys... 2024-09-13T16:56:23.537 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph-authtool: stdout AQC2buRmBZCxNhAA/T+Wsmpu0eAWRYK2zH1mjw== 2024-09-13T16:56:24.456 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph-authtool: stdout AQC3buRml70VNBAAAokpnxuYEsSUH6XiqOZrbQ== 2024-09-13T16:56:25.520 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph-authtool: stdout AQC4buRmx+10LxAAaMfp05tIKeFA9D0fXMXl0g== 2024-09-13T16:56:25.522 INFO:teuthology.orchestra.run.smithi115.stdout:Creating initial monmap... 2024-09-13T16:56:26.417 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-13T16:56:26.418 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = pacific 2024-09-13T16:56:26.418 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to ffbd7588-71f0-11ef-bceb-c7b262605968 2024-09-13T16:56:26.418 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-13T16:56:26.418 INFO:teuthology.orchestra.run.smithi115.stdout:monmaptool for smithi115 [v2:172.21.15.115:3300,v1:172.21.15.115:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-13T16:56:26.418 INFO:teuthology.orchestra.run.smithi115.stdout:setting min_mon_release = pacific 2024-09-13T16:56:26.418 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/monmaptool: set fsid to ffbd7588-71f0-11ef-bceb-c7b262605968 2024-09-13T16:56:26.418 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-13T16:56:26.418 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T16:56:26.418 INFO:teuthology.orchestra.run.smithi115.stdout:Creating mon... 2024-09-13T16:56:27.356 INFO:teuthology.orchestra.run.smithi115.stdout:create mon.smithi115 on 2024-09-13T16:56:27.576 INFO:teuthology.orchestra.run.smithi115.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-13T16:56:27.712 INFO:teuthology.orchestra.run.smithi115.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-13T16:56:27.891 INFO:teuthology.orchestra.run.smithi115.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-ffbd7588-71f0-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-ffbd7588-71f0-11ef-bceb-c7b262605968.target. 2024-09-13T16:56:27.891 INFO:teuthology.orchestra.run.smithi115.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-ffbd7588-71f0-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-ffbd7588-71f0-11ef-bceb-c7b262605968.target. 2024-09-13T16:56:28.138 INFO:teuthology.orchestra.run.smithi115.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-ffbd7588-71f0-11ef-bceb-c7b262605968@mon.smithi115 2024-09-13T16:56:28.138 INFO:teuthology.orchestra.run.smithi115.stdout:systemctl: stderr Failed to reset failed state of unit ceph-ffbd7588-71f0-11ef-bceb-c7b262605968@mon.smithi115.service: Unit ceph-ffbd7588-71f0-11ef-bceb-c7b262605968@mon.smithi115.service not loaded. 2024-09-13T16:56:28.304 INFO:teuthology.orchestra.run.smithi115.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-ffbd7588-71f0-11ef-bceb-c7b262605968.target.wants/ceph-ffbd7588-71f0-11ef-bceb-c7b262605968@mon.smithi115.service → /etc/systemd/system/ceph-ffbd7588-71f0-11ef-bceb-c7b262605968@.service. 2024-09-13T16:56:28.847 INFO:teuthology.orchestra.run.smithi115.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-13T16:56:28.847 INFO:teuthology.orchestra.run.smithi115.stdout:systemctl: stdout disabled 2024-09-13T16:56:28.854 INFO:teuthology.orchestra.run.smithi115.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-13T16:56:28.854 INFO:teuthology.orchestra.run.smithi115.stdout:systemctl: stdout inactive 2024-09-13T16:56:28.854 INFO:teuthology.orchestra.run.smithi115.stdout:firewalld.service is not enabled 2024-09-13T16:56:28.854 INFO:teuthology.orchestra.run.smithi115.stdout:Not possible to enable service . firewalld.service is not available 2024-09-13T16:56:28.855 INFO:teuthology.orchestra.run.smithi115.stdout:Waiting for mon to start... 2024-09-13T16:56:28.855 INFO:teuthology.orchestra.run.smithi115.stdout:Waiting for mon... 2024-09-13T16:56:29.881 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:29 smithi115 ceph-mon[27338]: from='client.? 172.21.15.115:0/3073351309' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-13T16:56:29.882 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout cluster: 2024-09-13T16:56:29.890 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout id: ffbd7588-71f0-11ef-bceb-c7b262605968 2024-09-13T16:56:29.890 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-13T16:56:29.890 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout 2024-09-13T16:56:29.890 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout services: 2024-09-13T16:56:29.890 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi115 (age 0.556472s) 2024-09-13T16:56:29.890 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-13T16:56:29.890 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-13T16:56:29.890 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout 2024-09-13T16:56:29.891 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout data: 2024-09-13T16:56:29.891 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-13T16:56:29.891 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-13T16:56:29.891 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-13T16:56:29.891 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout pgs: 2024-09-13T16:56:29.891 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout 2024-09-13T16:56:29.891 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:29.277+0000 7f9d07598640 1 Processor -- start 2024-09-13T16:56:29.891 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:29.277+0000 7f9d07598640 1 -- start start 2024-09-13T16:56:29.891 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:29.277+0000 7f9d07598640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d00105e70 0x7f9d00108260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:56:29.891 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:29.277+0000 7f9d07598640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d00078ec0 con 0x7f9d00105e70 2024-09-13T16:56:29.891 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:29.278+0000 7f9d05334640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d00105e70 0x7f9d00108260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:56:29.892 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:29.278+0000 7f9d05334640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d00105e70 0x7f9d00108260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52668/0 (socket says 172.21.15.115:52668) 2024-09-13T16:56:29.892 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:29.278+0000 7f9d05334640 1 -- 172.21.15.115:0/3802427814 learned_addr learned my addr 172.21.15.115:0/3802427814 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T16:56:29.892 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:29.278+0000 7f9d05334640 1 -- 172.21.15.115:0/3802427814 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d001087a0 con 0x7f9d00105e70 2024-09-13T16:56:29.892 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:29.280+0000 7f9d05334640 1 --2- 172.21.15.115:0/3802427814 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d00105e70 0x7f9d00108260 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc009820 tx=0x7f9cfc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4176856292853fb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:56:29.892 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:29.280+0000 7f9cf7fff640 1 -- 172.21.15.115:0/3802427814 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9cfc02ad40 con 0x7f9d00105e70 2024-09-13T16:56:29.892 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:29.280+0000 7f9cf7fff640 1 -- 172.21.15.115:0/3802427814 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cfc032440 con 0x7f9d00105e70 2024-09-13T16:56:29.892 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:29.280+0000 7f9cf7fff640 1 -- 172.21.15.115:0/3802427814 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9cfc02aea0 con 0x7f9d00105e70 2024-09-13T16:56:29.892 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:29.281+0000 7f9d07598640 1 -- 172.21.15.115:0/3802427814 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d00105e70 msgr2=0x7f9d00108260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:56:29.892 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:29.281+0000 7f9d07598640 1 --2- 172.21.15.115:0/3802427814 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d00105e70 0x7f9d00108260 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc009820 tx=0x7f9cfc02a270 comp rx=0 tx=0).stop 2024-09-13T16:56:29.892 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:29.281+0000 7f9d07598640 1 -- 172.21.15.115:0/3802427814 shutdown_connections 2024-09-13T16:56:29.893 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:29.281+0000 7f9d07598640 1 --2- 172.21.15.115:0/3802427814 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d00105e70 0x7f9d00108260 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:29.893 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:29.281+0000 7f9d07598640 1 -- 172.21.15.115:0/3802427814 >> 172.21.15.115:0/3802427814 conn(0x7f9d000ffaf0 msgr2=0x7f9d00101f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:56:29.893 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:29.281+0000 7f9d07598640 1 -- 172.21.15.115:0/3802427814 shutdown_connections 2024-09-13T16:56:29.893 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:29.281+0000 7f9d07598640 1 -- 172.21.15.115:0/3802427814 wait complete. 2024-09-13T16:56:29.893 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:29.281+0000 7f9d07598640 1 Processor -- start 2024-09-13T16:56:29.893 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:29.281+0000 7f9d07598640 1 -- start start 2024-09-13T16:56:29.893 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:29.282+0000 7f9d07598640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d00105e70 0x7f9d00198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:56:29.893 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:29.282+0000 7f9d07598640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d00198e60 con 0x7f9d00105e70 2024-09-13T16:56:29.893 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:29.282+0000 7f9d05334640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d00105e70 0x7f9d00198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:56:29.893 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:29.282+0000 7f9d05334640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d00105e70 0x7f9d00198920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52672/0 (socket says 172.21.15.115:52672) 2024-09-13T16:56:29.893 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:29.282+0000 7f9d05334640 1 -- 172.21.15.115:0/3073351309 learned_addr learned my addr 172.21.15.115:0/3073351309 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T16:56:29.894 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:29.282+0000 7f9d05334640 1 -- 172.21.15.115:0/3073351309 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cfc0094d0 con 0x7f9d00105e70 2024-09-13T16:56:29.894 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:29.282+0000 7f9d05334640 1 --2- 172.21.15.115:0/3073351309 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d00105e70 0x7f9d00198920 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc0090b0 tx=0x7f9cfc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:56:29.894 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:29.282+0000 7f9cf67fc640 1 -- 172.21.15.115:0/3073351309 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9cfc0308d0 con 0x7f9d00105e70 2024-09-13T16:56:29.894 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:29.282+0000 7f9cf67fc640 1 -- 172.21.15.115:0/3073351309 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cfc030a30 con 0x7f9d00105e70 2024-09-13T16:56:29.894 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:29.282+0000 7f9cf67fc640 1 -- 172.21.15.115:0/3073351309 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9cfc030d30 con 0x7f9d00105e70 2024-09-13T16:56:29.894 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:29.282+0000 7f9d07598640 1 -- 172.21.15.115:0/3073351309 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d00199060 con 0x7f9d00105e70 2024-09-13T16:56:29.894 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:29.282+0000 7f9d07598640 1 -- 172.21.15.115:0/3073351309 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d00199500 con 0x7f9d00105e70 2024-09-13T16:56:29.894 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:29.283+0000 7f9cf67fc640 1 -- 172.21.15.115:0/3073351309 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f9cfc039040 con 0x7f9d00105e70 2024-09-13T16:56:29.894 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:29.283+0000 7f9cf67fc640 1 -- 172.21.15.115:0/3073351309 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f9cfc03b8c0 con 0x7f9d00105e70 2024-09-13T16:56:29.894 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:29.283+0000 7f9d07598640 1 -- 172.21.15.115:0/3073351309 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d001926e0 con 0x7f9d00105e70 2024-09-13T16:56:29.895 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:29.286+0000 7f9cf67fc640 1 -- 172.21.15.115:0/3073351309 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f9cfc037070 con 0x7f9d00105e70 2024-09-13T16:56:29.895 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:29.345+0000 7f9d07598640 1 -- 172.21.15.115:0/3073351309 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f9d0002c480 con 0x7f9d00105e70 2024-09-13T16:56:29.895 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:29.346+0000 7f9cf67fc640 1 -- 172.21.15.115:0/3073351309 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+325 (secure 0 0 0) 0x7f9cfc03bb20 con 0x7f9d00105e70 2024-09-13T16:56:29.895 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:29.346+0000 7f9d07598640 1 -- 172.21.15.115:0/3073351309 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d00105e70 msgr2=0x7f9d00198920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:56:29.895 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:29.346+0000 7f9d07598640 1 --2- 172.21.15.115:0/3073351309 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d00105e70 0x7f9d00198920 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc0090b0 tx=0x7f9cfc0046c0 comp rx=0 tx=0).stop 2024-09-13T16:56:29.895 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:29.346+0000 7f9d07598640 1 -- 172.21.15.115:0/3073351309 shutdown_connections 2024-09-13T16:56:29.895 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:29.347+0000 7f9d07598640 1 --2- 172.21.15.115:0/3073351309 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d00105e70 0x7f9d00198920 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:29.895 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:29.347+0000 7f9d07598640 1 -- 172.21.15.115:0/3073351309 >> 172.21.15.115:0/3073351309 conn(0x7f9d000ffaf0 msgr2=0x7f9d00100b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:56:29.895 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:29.347+0000 7f9d07598640 1 -- 172.21.15.115:0/3073351309 shutdown_connections 2024-09-13T16:56:29.895 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:29.347+0000 7f9d07598640 1 -- 172.21.15.115:0/3073351309 wait complete. 2024-09-13T16:56:29.895 INFO:teuthology.orchestra.run.smithi115.stdout:mon is available 2024-09-13T16:56:29.895 INFO:teuthology.orchestra.run.smithi115.stdout:Assimilating anything we can from ceph.conf... 2024-09-13T16:56:30.912 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:30 smithi115 ceph-mon[27338]: from='client.? 172.21.15.115:0/2678552615' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-13T16:56:30.912 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:30 smithi115 ceph-mon[27338]: from='client.? 172.21.15.115:0/2678552615' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-13T16:56:30.922 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout 2024-09-13T16:56:30.923 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout [global] 2024-09-13T16:56:30.923 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout fsid = ffbd7588-71f0-11ef-bceb-c7b262605968 2024-09-13T16:56:30.924 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.115:3300,v1:172.21.15.115:6789] 2024-09-13T16:56:30.924 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-13T16:56:30.924 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-13T16:56:30.924 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-13T16:56:30.924 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-13T16:56:30.925 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout 2024-09-13T16:56:30.925 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-13T16:56:30.925 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-13T16:56:30.926 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout 2024-09-13T16:56:30.926 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout [osd] 2024-09-13T16:56:30.926 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-13T16:56:30.926 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-13T16:56:30.926 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-13T16:56:30.927 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-13T16:56:30.927 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-13T16:56:30.927 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:30.258+0000 7fbf9b919640 1 Processor -- start 2024-09-13T16:56:30.928 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:30.258+0000 7fbf9b919640 1 -- start start 2024-09-13T16:56:30.928 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:30.258+0000 7fbf9b919640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbf94105410 0x7fbf94105810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:56:30.928 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:30.258+0000 7fbf9b919640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf94105de0 con 0x7fbf94105410 2024-09-13T16:56:30.928 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:30.259+0000 7fbf996b5640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbf94105410 0x7fbf94105810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:56:30.929 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:30.259+0000 7fbf996b5640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbf94105410 0x7fbf94105810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52680/0 (socket says 172.21.15.115:52680) 2024-09-13T16:56:30.929 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:30.259+0000 7fbf996b5640 1 -- 172.21.15.115:0/518904124 learned_addr learned my addr 172.21.15.115:0/518904124 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T16:56:30.930 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:30.259+0000 7fbf996b5640 1 -- 172.21.15.115:0/518904124 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf941065c0 con 0x7fbf94105410 2024-09-13T16:56:30.930 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:30.259+0000 7fbf996b5640 1 --2- 172.21.15.115:0/518904124 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbf94105410 0x7fbf94105810 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fbf90009820 tx=0x7fbf9002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=636dca826c5ebdcf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:56:30.930 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:30.260+0000 7fbf8bfff640 1 -- 172.21.15.115:0/518904124 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbf9002ad40 con 0x7fbf94105410 2024-09-13T16:56:30.931 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:30.260+0000 7fbf8bfff640 1 -- 172.21.15.115:0/518904124 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf90032440 con 0x7fbf94105410 2024-09-13T16:56:30.931 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:30.260+0000 7fbf8bfff640 1 -- 172.21.15.115:0/518904124 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbf9002aea0 con 0x7fbf94105410 2024-09-13T16:56:30.931 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:30.260+0000 7fbf9b919640 1 -- 172.21.15.115:0/518904124 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbf94105410 msgr2=0x7fbf94105810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:56:30.931 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:30.260+0000 7fbf9b919640 1 --2- 172.21.15.115:0/518904124 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbf94105410 0x7fbf94105810 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fbf90009820 tx=0x7fbf9002a270 comp rx=0 tx=0).stop 2024-09-13T16:56:30.931 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:30.260+0000 7fbf9b919640 1 -- 172.21.15.115:0/518904124 shutdown_connections 2024-09-13T16:56:30.932 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:30.260+0000 7fbf9b919640 1 --2- 172.21.15.115:0/518904124 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbf94105410 0x7fbf94105810 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:30.932 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:30.260+0000 7fbf9b919640 1 -- 172.21.15.115:0/518904124 >> 172.21.15.115:0/518904124 conn(0x7fbf94100bc0 msgr2=0x7fbf94102fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:56:30.932 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:30.260+0000 7fbf9b919640 1 -- 172.21.15.115:0/518904124 shutdown_connections 2024-09-13T16:56:30.932 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:30.260+0000 7fbf9b919640 1 -- 172.21.15.115:0/518904124 wait complete. 2024-09-13T16:56:30.932 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:30.261+0000 7fbf9b919640 1 Processor -- start 2024-09-13T16:56:30.933 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:30.261+0000 7fbf9b919640 1 -- start start 2024-09-13T16:56:30.933 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:30.261+0000 7fbf9b919640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbf94105410 0x7fbf94198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:56:30.933 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:30.261+0000 7fbf9b919640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf94198e40 con 0x7fbf94105410 2024-09-13T16:56:30.933 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:30.261+0000 7fbf996b5640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbf94105410 0x7fbf94198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:56:30.933 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:30.261+0000 7fbf996b5640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbf94105410 0x7fbf94198900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52688/0 (socket says 172.21.15.115:52688) 2024-09-13T16:56:30.934 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:30.261+0000 7fbf996b5640 1 -- 172.21.15.115:0/2678552615 learned_addr learned my addr 172.21.15.115:0/2678552615 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T16:56:30.934 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:30.261+0000 7fbf996b5640 1 -- 172.21.15.115:0/2678552615 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf900094d0 con 0x7fbf94105410 2024-09-13T16:56:30.934 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:30.261+0000 7fbf996b5640 1 --2- 172.21.15.115:0/2678552615 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbf94105410 0x7fbf94198900 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fbf900090b0 tx=0x7fbf900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:56:30.934 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:30.262+0000 7fbf8a7fc640 1 -- 172.21.15.115:0/2678552615 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbf900308d0 con 0x7fbf94105410 2024-09-13T16:56:30.935 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:30.262+0000 7fbf8a7fc640 1 -- 172.21.15.115:0/2678552615 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf90030a30 con 0x7fbf94105410 2024-09-13T16:56:30.935 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:30.262+0000 7fbf9b919640 1 -- 172.21.15.115:0/2678552615 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf94199040 con 0x7fbf94105410 2024-09-13T16:56:30.936 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:30.262+0000 7fbf8a7fc640 1 -- 172.21.15.115:0/2678552615 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbf90030d30 con 0x7fbf94105410 2024-09-13T16:56:30.936 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:30.262+0000 7fbf9b919640 1 -- 172.21.15.115:0/2678552615 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf941994e0 con 0x7fbf94105410 2024-09-13T16:56:30.936 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:30.262+0000 7fbf8a7fc640 1 -- 172.21.15.115:0/2678552615 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fbf90039040 con 0x7fbf94105410 2024-09-13T16:56:30.936 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:30.262+0000 7fbf8a7fc640 1 -- 172.21.15.115:0/2678552615 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fbf9003b8d0 con 0x7fbf94105410 2024-09-13T16:56:30.936 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:30.263+0000 7fbf9b919640 1 -- 172.21.15.115:0/2678552615 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf94191fd0 con 0x7fbf94105410 2024-09-13T16:56:30.936 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:30.265+0000 7fbf8a7fc640 1 -- 172.21.15.115:0/2678552615 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7fbf90037070 con 0x7fbf94105410 2024-09-13T16:56:30.936 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:30.320+0000 7fbf9b919640 1 -- 172.21.15.115:0/2678552615 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7fbf94106930 con 0x7fbf94105410 2024-09-13T16:56:30.936 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:30.323+0000 7fbf8a7fc640 1 -- 172.21.15.115:0/2678552615 <== mon.0 v2:172.21.15.115:3300/0 7 ==== config(26 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7fbf90046d20 con 0x7fbf94105410 2024-09-13T16:56:30.936 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:30.323+0000 7fbf8a7fc640 1 -- 172.21.15.115:0/2678552615 <== mon.0 v2:172.21.15.115:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+431 (secure 0 0 0) 0x7fbf9004fdd0 con 0x7fbf94105410 2024-09-13T16:56:30.936 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:30.324+0000 7fbf9b919640 1 -- 172.21.15.115:0/2678552615 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbf94105410 msgr2=0x7fbf94198900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:56:30.936 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:30.324+0000 7fbf9b919640 1 --2- 172.21.15.115:0/2678552615 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbf94105410 0x7fbf94198900 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fbf900090b0 tx=0x7fbf900046c0 comp rx=0 tx=0).stop 2024-09-13T16:56:30.936 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:30.324+0000 7fbf9b919640 1 -- 172.21.15.115:0/2678552615 shutdown_connections 2024-09-13T16:56:30.937 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:30.324+0000 7fbf9b919640 1 --2- 172.21.15.115:0/2678552615 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbf94105410 0x7fbf94198900 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:30.937 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:30.324+0000 7fbf9b919640 1 -- 172.21.15.115:0/2678552615 >> 172.21.15.115:0/2678552615 conn(0x7fbf94100bc0 msgr2=0x7fbf9418ce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:56:30.937 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:30.324+0000 7fbf9b919640 1 -- 172.21.15.115:0/2678552615 shutdown_connections 2024-09-13T16:56:30.937 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:30.324+0000 7fbf9b919640 1 -- 172.21.15.115:0/2678552615 wait complete. 2024-09-13T16:56:30.937 INFO:teuthology.orchestra.run.smithi115.stdout:Generating new minimal ceph.conf... 2024-09-13T16:56:31.985 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:31 smithi115 ceph-mon[27338]: from='client.? 172.21.15.115:0/4183257601' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:56:31.991 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:31.297+0000 7fd18036d640 1 Processor -- start 2024-09-13T16:56:31.991 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:31.297+0000 7fd18036d640 1 -- start start 2024-09-13T16:56:31.992 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:31.298+0000 7fd18036d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd178105e70 0x7fd178108260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:56:31.992 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:31.298+0000 7fd18036d640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd178078ec0 con 0x7fd178105e70 2024-09-13T16:56:31.992 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:31.298+0000 7fd17e109640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd178105e70 0x7fd178108260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:56:31.992 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:31.298+0000 7fd17e109640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd178105e70 0x7fd178108260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52694/0 (socket says 172.21.15.115:52694) 2024-09-13T16:56:31.992 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:31.298+0000 7fd17e109640 1 -- 172.21.15.115:0/3382918879 learned_addr learned my addr 172.21.15.115:0/3382918879 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T16:56:31.992 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:31.298+0000 7fd17e109640 1 -- 172.21.15.115:0/3382918879 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1781087a0 con 0x7fd178105e70 2024-09-13T16:56:31.992 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:31.299+0000 7fd17e109640 1 --2- 172.21.15.115:0/3382918879 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd178105e70 0x7fd178108260 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fd168009820 tx=0x7fd16802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a3268ccde359bf8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:56:31.992 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:31.299+0000 7fd17d107640 1 -- 172.21.15.115:0/3382918879 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd16802ad40 con 0x7fd178105e70 2024-09-13T16:56:31.992 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:31.299+0000 7fd17d107640 1 -- 172.21.15.115:0/3382918879 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7fd168032890 con 0x7fd178105e70 2024-09-13T16:56:31.992 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:31.299+0000 7fd17d107640 1 -- 172.21.15.115:0/3382918879 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd1680307d0 con 0x7fd178105e70 2024-09-13T16:56:31.992 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:31.299+0000 7fd18036d640 1 -- 172.21.15.115:0/3382918879 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd178105e70 msgr2=0x7fd178108260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:56:31.992 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:31.299+0000 7fd18036d640 1 --2- 172.21.15.115:0/3382918879 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd178105e70 0x7fd178108260 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fd168009820 tx=0x7fd16802a270 comp rx=0 tx=0).stop 2024-09-13T16:56:31.993 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:31.300+0000 7fd18036d640 1 -- 172.21.15.115:0/3382918879 shutdown_connections 2024-09-13T16:56:31.993 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:31.300+0000 7fd18036d640 1 --2- 172.21.15.115:0/3382918879 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd178105e70 0x7fd178108260 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:31.993 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:31.300+0000 7fd18036d640 1 -- 172.21.15.115:0/3382918879 >> 172.21.15.115:0/3382918879 conn(0x7fd1780ffaf0 msgr2=0x7fd178101f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:56:31.993 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:31.300+0000 7fd18036d640 1 -- 172.21.15.115:0/3382918879 shutdown_connections 2024-09-13T16:56:31.993 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:31.300+0000 7fd18036d640 1 -- 172.21.15.115:0/3382918879 wait complete. 2024-09-13T16:56:31.993 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:31.300+0000 7fd18036d640 1 Processor -- start 2024-09-13T16:56:31.993 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:31.300+0000 7fd18036d640 1 -- start start 2024-09-13T16:56:31.993 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:31.300+0000 7fd18036d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd178105e70 0x7fd1781990e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:56:31.993 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:31.300+0000 7fd18036d640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd178199620 con 0x7fd178105e70 2024-09-13T16:56:31.993 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:31.300+0000 7fd17e109640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd178105e70 0x7fd1781990e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:56:31.993 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:31.300+0000 7fd17e109640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd178105e70 0x7fd1781990e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52698/0 (socket says 172.21.15.115:52698) 2024-09-13T16:56:31.993 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:31.300+0000 7fd17e109640 1 -- 172.21.15.115:0/4183257601 learned_addr learned my addr 172.21.15.115:0/4183257601 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T16:56:31.993 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:31.301+0000 7fd17e109640 1 -- 172.21.15.115:0/4183257601 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1680094d0 con 0x7fd178105e70 2024-09-13T16:56:31.993 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:31.301+0000 7fd17e109640 1 --2- 172.21.15.115:0/4183257601 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd178105e70 0x7fd1781990e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd168030380 tx=0x7fd168030cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:56:31.994 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:31.301+0000 7fd16f7fe640 1 -- 172.21.15.115:0/4183257601 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd168030ed0 con 0x7fd178105e70 2024-09-13T16:56:31.994 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:31.301+0000 7fd16f7fe640 1 -- 172.21.15.115:0/4183257601 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7fd168032c10 con 0x7fd178105e70 2024-09-13T16:56:31.994 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:31.301+0000 7fd18036d640 1 -- 172.21.15.115:0/4183257601 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd178199820 con 0x7fd178105e70 2024-09-13T16:56:31.994 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:31.301+0000 7fd16f7fe640 1 -- 172.21.15.115:0/4183257601 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd16803a560 con 0x7fd178105e70 2024-09-13T16:56:31.994 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:31.301+0000 7fd18036d640 1 -- 172.21.15.115:0/4183257601 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd178199cc0 con 0x7fd178105e70 2024-09-13T16:56:31.994 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:31.301+0000 7fd16f7fe640 1 -- 172.21.15.115:0/4183257601 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fd16803ab20 con 0x7fd178105e70 2024-09-13T16:56:31.994 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:31.301+0000 7fd16f7fe640 1 -- 172.21.15.115:0/4183257601 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fd168046d00 con 0x7fd178105e70 2024-09-13T16:56:31.994 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:31.302+0000 7fd18036d640 1 -- 172.21.15.115:0/4183257601 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1781094c0 con 0x7fd178105e70 2024-09-13T16:56:31.994 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:31.304+0000 7fd16f7fe640 1 -- 172.21.15.115:0/4183257601 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7fd168037070 con 0x7fd178105e70 2024-09-13T16:56:31.994 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:31.361+0000 7fd18036d640 1 -- 172.21.15.115:0/4183257601 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7fd178109680 con 0x7fd178105e70 2024-09-13T16:56:31.994 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:31.361+0000 7fd16f7fe640 1 -- 172.21.15.115:0/4183257601 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+177 (secure 0 0 0) 0x7fd168032d80 con 0x7fd178105e70 2024-09-13T16:56:31.994 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:31.362+0000 7fd18036d640 1 -- 172.21.15.115:0/4183257601 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd178105e70 msgr2=0x7fd1781990e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:56:31.994 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:31.362+0000 7fd18036d640 1 --2- 172.21.15.115:0/4183257601 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd178105e70 0x7fd1781990e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd168030380 tx=0x7fd168030cc0 comp rx=0 tx=0).stop 2024-09-13T16:56:31.994 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:31.362+0000 7fd18036d640 1 -- 172.21.15.115:0/4183257601 shutdown_connections 2024-09-13T16:56:31.995 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:31.362+0000 7fd18036d640 1 --2- 172.21.15.115:0/4183257601 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd178105e70 0x7fd1781990e0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:31.995 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:31.362+0000 7fd18036d640 1 -- 172.21.15.115:0/4183257601 >> 172.21.15.115:0/4183257601 conn(0x7fd1780ffaf0 msgr2=0x7fd1781006c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:56:31.995 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:31.362+0000 7fd18036d640 1 -- 172.21.15.115:0/4183257601 shutdown_connections 2024-09-13T16:56:31.995 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:31.362+0000 7fd18036d640 1 -- 172.21.15.115:0/4183257601 wait complete. 2024-09-13T16:56:31.995 INFO:teuthology.orchestra.run.smithi115.stdout:Restarting the monitor... 2024-09-13T16:56:32.264 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:32 smithi115 systemd[1]: Stopping Ceph mon.smithi115 for ffbd7588-71f0-11ef-bceb-c7b262605968... 2024-09-13T16:56:32.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:32 smithi115 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-mon-smithi115[27334]: 2024-09-13T16:56:32.262+0000 7f11644da640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi115 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T16:56:32.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:32 smithi115 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-mon-smithi115[27334]: 2024-09-13T16:56:32.262+0000 7f11644da640 -1 mon.smithi115@0(leader) e1 *** Got Signal Terminated *** 2024-09-13T16:56:32.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:32 smithi115 podman[27582]: 2024-09-13 16:56:32.477431017 +0000 UTC m=+0.319683506 container died 38d9585e012741c0f3056c7218212050d033e73fee9f26d2fe4699a75c876ee8 (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-mon-smithi115, ceph=True, maintainer=Guillaume Abrioux , RELEASE=reef-2c01458, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-13T16:56:32.989 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:32 smithi115 podman[27582]: 2024-09-13 16:56:32.795334991 +0000 UTC m=+0.637587481 container cleanup 38d9585e012741c0f3056c7218212050d033e73fee9f26d2fe4699a75c876ee8 (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-mon-smithi115, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=reef-2c01458, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-13T16:56:32.990 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:32 smithi115 bash[27582]: ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-mon-smithi115 2024-09-13T16:56:32.990 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:32 smithi115 podman[27596]: 2024-09-13 16:56:32.988150745 +0000 UTC m=+0.505206451 container remove 38d9585e012741c0f3056c7218212050d033e73fee9f26d2fe4699a75c876ee8 (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-mon-smithi115, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=reef-2c01458, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-13T16:56:33.406 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 systemd[1]: ceph-ffbd7588-71f0-11ef-bceb-c7b262605968@mon.smithi115.service: Deactivated successfully. 2024-09-13T16:56:33.406 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 systemd[1]: Stopped Ceph mon.smithi115 for ffbd7588-71f0-11ef-bceb-c7b262605968. 2024-09-13T16:56:33.406 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 systemd[1]: Starting Ceph mon.smithi115 for ffbd7588-71f0-11ef-bceb-c7b262605968... 2024-09-13T16:56:33.667 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 podman[27688]: 2024-09-13 16:56:33.40569157 +0000 UTC m=+0.110143658 container create 202375d41e6879d250542be38d20001638a9d3acc0e1cb69e0f9b784a1c5a105 (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-mon-smithi115, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=reef-2c01458, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T16:56:33.667 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 podman[27688]: 2024-09-13 16:56:33.311169217 +0000 UTC m=+0.015621314 image pull c129f5a2fd4eccce3e6eec43830eff1929af98bc48f3b850cf144ce5b326e8b5 quay.ceph.io/ceph-ci/ceph:reef 2024-09-13T16:56:33.667 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 podman[27688]: 2024-09-13 16:56:33.582820843 +0000 UTC m=+0.287272932 container init 202375d41e6879d250542be38d20001638a9d3acc0e1cb69e0f9b784a1c5a105 (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-mon-smithi115, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=reef-2c01458, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True) 2024-09-13T16:56:33.667 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 podman[27688]: 2024-09-13 16:56:33.585815611 +0000 UTC m=+0.290267700 container start 202375d41e6879d250542be38d20001638a9d3acc0e1cb69e0f9b784a1c5a105 (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-mon-smithi115, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, RELEASE=reef-2c01458, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=) 2024-09-13T16:56:33.668 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: set uid:gid to 167:167 (ceph:ceph) 2024-09-13T16:56:33.668 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: ceph version 18.2.4-843-g2c01458a (2c01458affee2b2435cd231b6e392435c1c21661) reef (stable), process ceph-mon, pid 2 2024-09-13T16:56:33.668 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: pidfile_write: ignore empty --pid-file 2024-09-13T16:56:33.668 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: load: jerasure load: lrc 2024-09-13T16:56:33.668 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: RocksDB version: 7.9.2 2024-09-13T16:56:33.668 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Git sha 0 2024-09-13T16:56:33.668 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Compile date 2024-09-12 19:46:18 2024-09-13T16:56:33.668 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: DB SUMMARY 2024-09-13T16:56:33.668 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: DB Session ID: 42Z527TN78KYKZW4P0C7 2024-09-13T16:56:33.668 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: CURRENT file: CURRENT 2024-09-13T16:56:33.668 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: IDENTITY file: IDENTITY 2024-09-13T16:56:33.669 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-13T16:56:33.669 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi115/store.db dir, Total Num: 1, files: 000008.sst 2024-09-13T16:56:33.669 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi115/store.db: 000009.log size: 98034 ; 2024-09-13T16:56:33.669 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.error_if_exists: 0 2024-09-13T16:56:33.669 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.create_if_missing: 0 2024-09-13T16:56:33.669 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.paranoid_checks: 1 2024-09-13T16:56:33.669 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-13T16:56:33.669 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-13T16:56:33.669 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-13T16:56:33.669 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.env: 0x55799cda8bc0 2024-09-13T16:56:33.669 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.fs: PosixFileSystem 2024-09-13T16:56:33.669 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.info_log: 0x55799df9cdc0 2024-09-13T16:56:33.670 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.max_file_opening_threads: 16 2024-09-13T16:56:33.670 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.statistics: (nil) 2024-09-13T16:56:33.670 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.use_fsync: 0 2024-09-13T16:56:33.670 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.max_log_file_size: 0 2024-09-13T16:56:33.670 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-13T16:56:33.670 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-13T16:56:33.670 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.keep_log_file_num: 1000 2024-09-13T16:56:33.670 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.recycle_log_file_num: 0 2024-09-13T16:56:33.670 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.allow_fallocate: 1 2024-09-13T16:56:33.670 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.allow_mmap_reads: 0 2024-09-13T16:56:33.670 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.allow_mmap_writes: 0 2024-09-13T16:56:33.670 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.use_direct_reads: 0 2024-09-13T16:56:33.670 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-13T16:56:33.671 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.create_missing_column_families: 0 2024-09-13T16:56:33.671 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.db_log_dir: 2024-09-13T16:56:33.671 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.wal_dir: 2024-09-13T16:56:33.671 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-13T16:56:33.671 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-13T16:56:33.671 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-13T16:56:33.671 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-13T16:56:33.671 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-13T16:56:33.671 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-13T16:56:33.671 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.advise_random_on_open: 1 2024-09-13T16:56:33.671 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.db_write_buffer_size: 0 2024-09-13T16:56:33.671 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.write_buffer_manager: 0x55799dfaa320 2024-09-13T16:56:33.671 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-13T16:56:33.672 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-13T16:56:33.672 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-13T16:56:33.672 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.rate_limiter: (nil) 2024-09-13T16:56:33.672 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-13T16:56:33.672 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.wal_recovery_mode: 2 2024-09-13T16:56:33.672 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.enable_thread_tracking: 0 2024-09-13T16:56:33.672 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.enable_pipelined_write: 0 2024-09-13T16:56:33.674 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.unordered_write: 0 2024-09-13T16:56:33.674 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-13T16:56:33.674 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-13T16:56:33.674 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-13T16:56:33.674 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-13T16:56:33.674 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.row_cache: None 2024-09-13T16:56:33.674 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.wal_filter: None 2024-09-13T16:56:33.674 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-13T16:56:33.674 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.allow_ingest_behind: 0 2024-09-13T16:56:33.674 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.two_write_queues: 0 2024-09-13T16:56:33.674 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.manual_wal_flush: 0 2024-09-13T16:56:33.675 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.wal_compression: 0 2024-09-13T16:56:33.675 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.atomic_flush: 0 2024-09-13T16:56:33.675 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-13T16:56:33.675 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-13T16:56:33.675 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-13T16:56:33.675 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.log_readahead_size: 0 2024-09-13T16:56:33.675 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-13T16:56:33.675 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.best_efforts_recovery: 0 2024-09-13T16:56:33.675 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-13T16:56:33.675 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-13T16:56:33.675 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.allow_data_in_errors: 0 2024-09-13T16:56:33.675 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.db_host_id: __hostname__ 2024-09-13T16:56:33.675 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-13T16:56:33.676 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.max_background_jobs: 2 2024-09-13T16:56:33.676 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.max_background_compactions: -1 2024-09-13T16:56:33.676 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.max_subcompactions: 1 2024-09-13T16:56:33.676 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-13T16:56:33.676 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-13T16:56:33.676 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-13T16:56:33.676 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.max_total_wal_size: 0 2024-09-13T16:56:33.676 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-13T16:56:33.676 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-13T16:56:33.676 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-13T16:56:33.676 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-13T16:56:33.676 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.max_open_files: -1 2024-09-13T16:56:33.676 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.bytes_per_sync: 0 2024-09-13T16:56:33.677 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-13T16:56:33.677 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-13T16:56:33.677 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.compaction_readahead_size: 0 2024-09-13T16:56:33.677 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.max_background_flushes: -1 2024-09-13T16:56:33.677 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Compression algorithms supported: 2024-09-13T16:56:33.677 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: kZSTD supported: 0 2024-09-13T16:56:33.677 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: kXpressCompression supported: 0 2024-09-13T16:56:33.677 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: kBZip2Compression supported: 0 2024-09-13T16:56:33.677 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-13T16:56:33.677 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: kLZ4Compression supported: 1 2024-09-13T16:56:33.677 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: kZlibCompression supported: 1 2024-09-13T16:56:33.677 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: kLZ4HCCompression supported: 1 2024-09-13T16:56:33.677 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: kSnappyCompression supported: 1 2024-09-13T16:56:33.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-13T16:56:33.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-13T16:56:33.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi115/store.db/MANIFEST-000010 2024-09-13T16:56:33.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-13T16:56:33.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-13T16:56:33.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.merge_operator: 2024-09-13T16:56:33.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.compaction_filter: None 2024-09-13T16:56:33.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.compaction_filter_factory: None 2024-09-13T16:56:33.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.sst_partitioner_factory: None 2024-09-13T16:56:33.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-13T16:56:33.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-13T16:56:33.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55799df9ca20) 2024-09-13T16:56:33.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: cache_index_and_filter_blocks: 1 2024-09-13T16:56:33.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-13T16:56:33.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-13T16:56:33.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: pin_top_level_index_and_filter: 1 2024-09-13T16:56:33.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: index_type: 0 2024-09-13T16:56:33.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: data_block_index_type: 0 2024-09-13T16:56:33.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: index_shortening: 1 2024-09-13T16:56:33.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-13T16:56:33.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: checksum: 4 2024-09-13T16:56:33.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: no_block_cache: 0 2024-09-13T16:56:33.680 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: block_cache: 0x55799df911f0 2024-09-13T16:56:33.680 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: block_cache_name: BinnedLRUCache 2024-09-13T16:56:33.680 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: block_cache_options: 2024-09-13T16:56:33.680 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: capacity : 536870912 2024-09-13T16:56:33.680 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: num_shard_bits : 4 2024-09-13T16:56:33.680 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: strict_capacity_limit : 0 2024-09-13T16:56:33.680 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: high_pri_pool_ratio: 0.000 2024-09-13T16:56:33.680 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: block_cache_compressed: (nil) 2024-09-13T16:56:33.680 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: persistent_cache: (nil) 2024-09-13T16:56:33.680 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: block_size: 4096 2024-09-13T16:56:33.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: block_size_deviation: 10 2024-09-13T16:56:33.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: block_restart_interval: 16 2024-09-13T16:56:33.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: index_block_restart_interval: 1 2024-09-13T16:56:33.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: metadata_block_size: 4096 2024-09-13T16:56:33.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: partition_filters: 0 2024-09-13T16:56:33.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: use_delta_encoding: 1 2024-09-13T16:56:33.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: filter_policy: bloomfilter 2024-09-13T16:56:33.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: whole_key_filtering: 1 2024-09-13T16:56:33.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: verify_compression: 0 2024-09-13T16:56:33.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: read_amp_bytes_per_bit: 0 2024-09-13T16:56:33.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: format_version: 5 2024-09-13T16:56:33.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: enable_index_compression: 1 2024-09-13T16:56:33.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: block_align: 0 2024-09-13T16:56:33.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: max_auto_readahead_size: 262144 2024-09-13T16:56:33.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: prepopulate_block_cache: 0 2024-09-13T16:56:33.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: initial_auto_readahead_size: 8192 2024-09-13T16:56:33.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: num_file_reads_for_auto_readahead: 2 2024-09-13T16:56:33.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.write_buffer_size: 33554432 2024-09-13T16:56:33.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.max_write_buffer_number: 2 2024-09-13T16:56:33.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.compression: NoCompression 2024-09-13T16:56:33.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.bottommost_compression: Disabled 2024-09-13T16:56:33.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.prefix_extractor: nullptr 2024-09-13T16:56:33.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-13T16:56:33.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.num_levels: 7 2024-09-13T16:56:33.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-13T16:56:33.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-13T16:56:33.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-13T16:56:33.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-13T16:56:33.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-13T16:56:33.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-13T16:56:33.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-13T16:56:33.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-13T16:56:33.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-13T16:56:33.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-13T16:56:33.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-13T16:56:33.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-13T16:56:33.684 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-13T16:56:33.684 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.compression_opts.level: 32767 2024-09-13T16:56:33.684 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.compression_opts.strategy: 0 2024-09-13T16:56:33.684 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-13T16:56:33.684 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-13T16:56:33.684 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-13T16:56:33.684 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-13T16:56:33.684 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.compression_opts.enabled: false 2024-09-13T16:56:33.684 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-13T16:56:33.684 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-13T16:56:33.684 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-13T16:56:33.684 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-13T16:56:33.684 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.target_file_size_base: 67108864 2024-09-13T16:56:33.685 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-13T16:56:33.685 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-13T16:56:33.685 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-13T16:56:33.685 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-13T16:56:33.685 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-13T16:56:33.685 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-13T16:56:33.685 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-13T16:56:33.685 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-13T16:56:33.685 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-13T16:56:33.685 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-13T16:56:33.685 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-13T16:56:33.686 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-13T16:56:33.686 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-13T16:56:33.686 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-13T16:56:33.686 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.arena_block_size: 1048576 2024-09-13T16:56:33.686 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-13T16:56:33.686 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-13T16:56:33.686 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.disable_auto_compactions: 0 2024-09-13T16:56:33.686 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-13T16:56:33.686 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-13T16:56:33.686 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-13T16:56:33.686 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-13T16:56:33.686 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-13T16:56:33.686 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-13T16:56:33.687 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-13T16:56:33.687 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-13T16:56:33.687 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-13T16:56:33.687 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-13T16:56:33.687 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-13T16:56:33.687 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.inplace_update_support: 0 2024-09-13T16:56:33.687 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-13T16:56:33.687 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-13T16:56:33.687 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-13T16:56:33.687 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-13T16:56:33.687 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.bloom_locality: 0 2024-09-13T16:56:33.687 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.max_successive_merges: 0 2024-09-13T16:56:33.687 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-13T16:56:33.687 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.paranoid_file_checks: 0 2024-09-13T16:56:33.688 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.force_consistency_checks: 1 2024-09-13T16:56:33.688 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.report_bg_io_stats: 0 2024-09-13T16:56:33.688 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.ttl: 2592000 2024-09-13T16:56:33.688 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-13T16:56:33.688 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-13T16:56:33.688 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-13T16:56:33.688 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.enable_blob_files: false 2024-09-13T16:56:33.688 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.min_blob_size: 0 2024-09-13T16:56:33.688 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.blob_file_size: 268435456 2024-09-13T16:56:33.688 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-13T16:56:33.688 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-13T16:56:33.688 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-13T16:56:33.688 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-13T16:56:33.689 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-13T16:56:33.689 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.blob_file_starting_level: 0 2024-09-13T16:56:33.689 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-13T16:56:33.689 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi115/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-13T16:56:33.689 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-13T16:56:33.689 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 3a9c1a52-0c37-4393-b1e6-e7dadded2995 2024-09-13T16:56:33.689 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726246593611110, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-13T16:56:33.689 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-13T16:56:33.689 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726246593612103, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 93366, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 312, "table_properties": {"data_size": 91357, "index_size": 265, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13453, "raw_average_key_size": 49, "raw_value_size": 84029, "raw_average_value_size": 310, "num_data_blocks": 11, "num_entries": 271, "num_filter_entries": 271, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726246593, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "3a9c1a52-0c37-4393-b1e6-e7dadded2995", "db_session_id": "42Z527TN78KYKZW4P0C7", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-13T16:56:33.689 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726246593612198, "job": 1, "event": "recovery_finished"} 2024-09-13T16:56:33.689 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-13T16:56:33.689 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi115/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-13T16:56:33.689 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55799dfbce00 2024-09-13T16:56:33.690 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: DB pointer 0x55799e0b2000 2024-09-13T16:56:33.690 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-13T16:56:33.690 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-13T16:56:33.690 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: ** DB Stats ** 2024-09-13T16:56:33.690 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T16:56:33.690 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-13T16:56:33.690 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T16:56:33.690 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T16:56:33.690 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-13T16:56:33.690 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T16:56:33.690 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T16:56:33.690 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: 2024-09-13T16:56:33.690 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: ** Compaction Stats [default] ** 2024-09-13T16:56:33.690 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T16:56:33.691 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-13T16:56:33.691 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: L0 2/0 93.08 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 136.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-13T16:56:33.691 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Sum 2/0 93.08 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 136.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-13T16:56:33.691 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 136.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-13T16:56:33.691 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: 2024-09-13T16:56:33.691 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: ** Compaction Stats [default] ** 2024-09-13T16:56:33.691 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T16:56:33.691 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-13T16:56:33.691 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 136.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-13T16:56:33.691 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: 2024-09-13T16:56:33.691 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-13T16:56:33.691 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: 2024-09-13T16:56:33.691 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T16:56:33.692 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-13T16:56:33.692 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-13T16:56:33.692 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-13T16:56:33.692 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-13T16:56:33.692 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-13T16:56:33.692 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Cumulative compaction: 0.00 GB write, 29.16 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T16:56:33.692 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Interval compaction: 0.00 GB write, 29.16 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T16:56:33.692 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-13T16:56:33.692 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Block cache BinnedLRUCache@0x55799df911f0#2 capacity: 512.00 MB usage: 1.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-13T16:56:33.692 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.89 KB,0.000169873%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-09-13T16:56:33.692 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: 2024-09-13T16:56:33.692 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-13T16:56:33.692 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: starting mon.smithi115 rank 0 at public addrs [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] at bind addrs [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi115 fsid ffbd7588-71f0-11ef-bceb-c7b262605968 2024-09-13T16:56:33.692 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: mon.smithi115@-1(???) e1 preinit fsid ffbd7588-71f0-11ef-bceb-c7b262605968 2024-09-13T16:56:33.693 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: mon.smithi115@-1(???).mds e1 new map 2024-09-13T16:56:33.693 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: mon.smithi115@-1(???).mds e1 print_map 2024-09-13T16:56:33.693 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: e1 2024-09-13T16:56:33.693 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T16:56:33.693 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T16:56:33.693 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: legacy client fscid: -1 2024-09-13T16:56:33.693 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: 2024-09-13T16:56:33.693 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: No filesystems configured 2024-09-13T16:56:33.693 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: mon.smithi115@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-13T16:56:33.693 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: mon.smithi115@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T16:56:33.693 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: mon.smithi115@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T16:56:33.693 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: mon.smithi115@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T16:56:33.693 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: mon.smithi115@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-13T16:56:33.694 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 bash[27688]: 202375d41e6879d250542be38d20001638a9d3acc0e1cb69e0f9b784a1c5a105 2024-09-13T16:56:33.694 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 systemd[1]: Started Ceph mon.smithi115 for ffbd7588-71f0-11ef-bceb-c7b262605968. 2024-09-13T16:56:33.694 INFO:teuthology.orchestra.run.smithi115.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-13T16:56:33.920 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: mon.smithi115 is new leader, mons smithi115 in quorum (ranks 0) 2024-09-13T16:56:33.921 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: monmap e1: 1 mons at {smithi115=[v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T16:56:33.921 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: fsmap 2024-09-13T16:56:33.921 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: osdmap e1: 0 total, 0 up, 0 in 2024-09-13T16:56:33.921 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:33 smithi115 ceph-mon[27708]: mgrmap e1: no daemons active 2024-09-13T16:56:34.689 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:34.098+0000 7efdef4ed640 1 Processor -- start 2024-09-13T16:56:34.689 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:34.099+0000 7efdef4ed640 1 -- start start 2024-09-13T16:56:34.689 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:34.099+0000 7efdef4ed640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efde81042c0 0x7efde81046c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:56:34.689 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:34.099+0000 7efdef4ed640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efde8104c90 con 0x7efde81042c0 2024-09-13T16:56:34.689 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:34.099+0000 7efded289640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efde81042c0 0x7efde81046c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:56:34.689 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:34.099+0000 7efded289640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efde81042c0 0x7efde81046c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:36158/0 (socket says 172.21.15.115:36158) 2024-09-13T16:56:34.690 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:34.099+0000 7efded289640 1 -- 172.21.15.115:0/3261575954 learned_addr learned my addr 172.21.15.115:0/3261575954 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T16:56:34.690 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:34.099+0000 7efded289640 1 -- 172.21.15.115:0/3261575954 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efde81054c0 con 0x7efde81042c0 2024-09-13T16:56:34.690 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:34.101+0000 7efded289640 1 --2- 172.21.15.115:0/3261575954 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efde81042c0 0x7efde81046c0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7efde4009820 tx=0x7efde402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd90aabe5333a634 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:56:34.690 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:34.101+0000 7efddffff640 1 -- 172.21.15.115:0/3261575954 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efde402ad40 con 0x7efde81042c0 2024-09-13T16:56:34.690 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:34.101+0000 7efddffff640 1 -- 172.21.15.115:0/3261575954 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7efde4032890 con 0x7efde81042c0 2024-09-13T16:56:34.690 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:34.101+0000 7efddffff640 1 -- 172.21.15.115:0/3261575954 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efde40307d0 con 0x7efde81042c0 2024-09-13T16:56:34.690 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:34.102+0000 7efdef4ed640 1 -- 172.21.15.115:0/3261575954 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efde81042c0 msgr2=0x7efde81046c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:56:34.690 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:34.102+0000 7efdef4ed640 1 --2- 172.21.15.115:0/3261575954 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efde81042c0 0x7efde81046c0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7efde4009820 tx=0x7efde402a270 comp rx=0 tx=0).stop 2024-09-13T16:56:34.690 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:34.102+0000 7efdef4ed640 1 -- 172.21.15.115:0/3261575954 shutdown_connections 2024-09-13T16:56:34.690 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:34.102+0000 7efdef4ed640 1 --2- 172.21.15.115:0/3261575954 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efde81042c0 0x7efde81046c0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:34.690 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:34.102+0000 7efdef4ed640 1 -- 172.21.15.115:0/3261575954 >> 172.21.15.115:0/3261575954 conn(0x7efde80ffa10 msgr2=0x7efde8101e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:56:34.691 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:34.102+0000 7efdef4ed640 1 -- 172.21.15.115:0/3261575954 shutdown_connections 2024-09-13T16:56:34.691 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:34.102+0000 7efdef4ed640 1 -- 172.21.15.115:0/3261575954 wait complete. 2024-09-13T16:56:34.691 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:34.103+0000 7efdef4ed640 1 Processor -- start 2024-09-13T16:56:34.691 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:34.103+0000 7efdef4ed640 1 -- start start 2024-09-13T16:56:34.691 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:34.103+0000 7efdef4ed640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efde81042c0 0x7efde81980a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:56:34.691 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:34.103+0000 7efdef4ed640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efde81985e0 con 0x7efde81042c0 2024-09-13T16:56:34.691 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:34.103+0000 7efded289640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efde81042c0 0x7efde81980a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:56:34.691 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:34.103+0000 7efded289640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efde81042c0 0x7efde81980a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:36170/0 (socket says 172.21.15.115:36170) 2024-09-13T16:56:34.691 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:34.103+0000 7efded289640 1 -- 172.21.15.115:0/1113425200 learned_addr learned my addr 172.21.15.115:0/1113425200 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T16:56:34.691 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:34.103+0000 7efded289640 1 -- 172.21.15.115:0/1113425200 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efde40094d0 con 0x7efde81042c0 2024-09-13T16:56:34.691 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:34.103+0000 7efded289640 1 --2- 172.21.15.115:0/1113425200 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efde81042c0 0x7efde81980a0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7efde40304c0 tx=0x7efde4030d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:56:34.692 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:34.104+0000 7efdde7fc640 1 -- 172.21.15.115:0/1113425200 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efde4032c10 con 0x7efde81042c0 2024-09-13T16:56:34.692 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:34.104+0000 7efdde7fc640 1 -- 172.21.15.115:0/1113425200 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7efde4032d70 con 0x7efde81042c0 2024-09-13T16:56:34.692 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:34.104+0000 7efdde7fc640 1 -- 172.21.15.115:0/1113425200 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efde403a560 con 0x7efde81042c0 2024-09-13T16:56:34.692 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:34.104+0000 7efdef4ed640 1 -- 172.21.15.115:0/1113425200 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efde81987e0 con 0x7efde81042c0 2024-09-13T16:56:34.692 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:34.104+0000 7efdef4ed640 1 -- 172.21.15.115:0/1113425200 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efde8198c80 con 0x7efde81042c0 2024-09-13T16:56:34.692 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:34.104+0000 7efdde7fc640 1 -- 172.21.15.115:0/1113425200 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7efde403a9c0 con 0x7efde81042c0 2024-09-13T16:56:34.692 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:34.104+0000 7efdde7fc640 1 -- 172.21.15.115:0/1113425200 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7efde4046c10 con 0x7efde81042c0 2024-09-13T16:56:34.692 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:34.105+0000 7efdef4ed640 1 -- 172.21.15.115:0/1113425200 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efde8104740 con 0x7efde81042c0 2024-09-13T16:56:34.692 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:34.107+0000 7efdde7fc640 1 -- 172.21.15.115:0/1113425200 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7efde4037070 con 0x7efde81042c0 2024-09-13T16:56:34.692 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:34.163+0000 7efdef4ed640 1 -- 172.21.15.115:0/1113425200 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7efde81086f0 con 0x7efde81042c0 2024-09-13T16:56:34.692 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:34.168+0000 7efdde7fc640 1 -- 172.21.15.115:0/1113425200 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7efde4046dd0 con 0x7efde81042c0 2024-09-13T16:56:34.692 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:34.168+0000 7efdef4ed640 1 -- 172.21.15.115:0/1113425200 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efde81042c0 msgr2=0x7efde81980a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:56:34.692 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:34.168+0000 7efdef4ed640 1 --2- 172.21.15.115:0/1113425200 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efde81042c0 0x7efde81980a0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7efde40304c0 tx=0x7efde4030d10 comp rx=0 tx=0).stop 2024-09-13T16:56:34.693 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:34.168+0000 7efdef4ed640 1 -- 172.21.15.115:0/1113425200 shutdown_connections 2024-09-13T16:56:34.693 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:34.168+0000 7efdef4ed640 1 --2- 172.21.15.115:0/1113425200 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efde81042c0 0x7efde81980a0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:34.693 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:34.168+0000 7efdef4ed640 1 -- 172.21.15.115:0/1113425200 >> 172.21.15.115:0/1113425200 conn(0x7efde80ffa10 msgr2=0x7efde8100720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:56:34.693 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:34.169+0000 7efdef4ed640 1 -- 172.21.15.115:0/1113425200 shutdown_connections 2024-09-13T16:56:34.693 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:34.169+0000 7efdef4ed640 1 -- 172.21.15.115:0/1113425200 wait complete. 2024-09-13T16:56:34.693 INFO:teuthology.orchestra.run.smithi115.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-13T16:56:34.706 INFO:teuthology.orchestra.run.smithi115.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-13T16:56:34.706 INFO:teuthology.orchestra.run.smithi115.stdout:Creating mgr... 2024-09-13T16:56:34.707 INFO:teuthology.orchestra.run.smithi115.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-13T16:56:34.707 INFO:teuthology.orchestra.run.smithi115.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-13T16:56:34.707 INFO:teuthology.orchestra.run.smithi115.stdout:Verifying port 0.0.0.0:8443 ... 2024-09-13T16:56:34.954 INFO:teuthology.orchestra.run.smithi115.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-ffbd7588-71f0-11ef-bceb-c7b262605968@mgr.smithi115.hetcni 2024-09-13T16:56:34.954 INFO:teuthology.orchestra.run.smithi115.stdout:systemctl: stderr Failed to reset failed state of unit ceph-ffbd7588-71f0-11ef-bceb-c7b262605968@mgr.smithi115.hetcni.service: Unit ceph-ffbd7588-71f0-11ef-bceb-c7b262605968@mgr.smithi115.hetcni.service not loaded. 2024-09-13T16:56:35.109 INFO:teuthology.orchestra.run.smithi115.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-ffbd7588-71f0-11ef-bceb-c7b262605968.target.wants/ceph-ffbd7588-71f0-11ef-bceb-c7b262605968@mgr.smithi115.hetcni.service → /etc/systemd/system/ceph-ffbd7588-71f0-11ef-bceb-c7b262605968@.service. 2024-09-13T16:56:35.335 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:35 smithi115 ceph-mon[27708]: from='client.? 172.21.15.115:0/1113425200' entity='client.admin' 2024-09-13T16:56:38.970 INFO:teuthology.orchestra.run.smithi115.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-13T16:56:38.971 INFO:teuthology.orchestra.run.smithi115.stdout:systemctl: stdout disabled 2024-09-13T16:56:38.978 INFO:teuthology.orchestra.run.smithi115.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-13T16:56:38.978 INFO:teuthology.orchestra.run.smithi115.stdout:systemctl: stdout inactive 2024-09-13T16:56:38.978 INFO:teuthology.orchestra.run.smithi115.stdout:firewalld.service is not enabled 2024-09-13T16:56:38.978 INFO:teuthology.orchestra.run.smithi115.stdout:Not possible to enable service . firewalld.service is not available 2024-09-13T16:56:38.987 INFO:teuthology.orchestra.run.smithi115.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-13T16:56:38.987 INFO:teuthology.orchestra.run.smithi115.stdout:systemctl: stdout disabled 2024-09-13T16:56:38.995 INFO:teuthology.orchestra.run.smithi115.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-13T16:56:38.995 INFO:teuthology.orchestra.run.smithi115.stdout:systemctl: stdout inactive 2024-09-13T16:56:38.995 INFO:teuthology.orchestra.run.smithi115.stdout:firewalld.service is not enabled 2024-09-13T16:56:38.995 INFO:teuthology.orchestra.run.smithi115.stdout:Not possible to open ports <[9283, 8765, 8443]>. firewalld.service is not available 2024-09-13T16:56:38.995 INFO:teuthology.orchestra.run.smithi115.stdout:Waiting for mgr to start... 2024-09-13T16:56:38.995 INFO:teuthology.orchestra.run.smithi115.stdout:Waiting for mgr... 2024-09-13T16:56:42.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:42 smithi115 ceph-mon[27708]: from='client.? 172.21.15.115:0/205280560' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-13T16:56:43.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:43 smithi115 ceph-mon[27708]: Activating manager daemon smithi115.hetcni 2024-09-13T16:56:43.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:43 smithi115 ceph-mon[27708]: mgrmap e2: smithi115.hetcni(active, starting, since 0.00297876s) 2024-09-13T16:56:43.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:43 smithi115 ceph-mon[27708]: from='mgr.14100 172.21.15.115:0/312940735' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T16:56:43.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:43 smithi115 ceph-mon[27708]: from='mgr.14100 172.21.15.115:0/312940735' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T16:56:43.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:43 smithi115 ceph-mon[27708]: from='mgr.14100 172.21.15.115:0/312940735' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T16:56:43.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:43 smithi115 ceph-mon[27708]: from='mgr.14100 172.21.15.115:0/312940735' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mon metadata", "id": "smithi115"}]: dispatch 2024-09-13T16:56:43.430 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:43 smithi115 ceph-mon[27708]: from='mgr.14100 172.21.15.115:0/312940735' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mgr metadata", "who": "smithi115.hetcni", "id": "smithi115.hetcni"}]: dispatch 2024-09-13T16:56:43.430 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:43 smithi115 ceph-mon[27708]: Manager daemon smithi115.hetcni is now available 2024-09-13T16:56:43.430 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:43 smithi115 ceph-mon[27708]: from='mgr.14100 172.21.15.115:0/312940735' entity='mgr.smithi115.hetcni' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi115.hetcni/mirror_snapshot_schedule"}]: dispatch 2024-09-13T16:56:43.430 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:43 smithi115 ceph-mon[27708]: from='mgr.14100 172.21.15.115:0/312940735' entity='mgr.smithi115.hetcni' 2024-09-13T16:56:43.430 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:43 smithi115 ceph-mon[27708]: from='mgr.14100 172.21.15.115:0/312940735' entity='mgr.smithi115.hetcni' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi115.hetcni/trash_purge_schedule"}]: dispatch 2024-09-13T16:56:43.430 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:43 smithi115 ceph-mon[27708]: from='mgr.14100 172.21.15.115:0/312940735' entity='mgr.smithi115.hetcni' 2024-09-13T16:56:43.430 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:43 smithi115 ceph-mon[27708]: from='mgr.14100 172.21.15.115:0/312940735' entity='mgr.smithi115.hetcni' 2024-09-13T16:56:45.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:44 smithi115 ceph-mon[27708]: mgrmap e3: smithi115.hetcni(active, since 1.00694s) 2024-09-13T16:56:45.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:45 smithi115 ceph-mon[27708]: mgrmap e4: smithi115.hetcni(active, since 2s) 2024-09-13T16:56:47.413 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout 2024-09-13T16:56:47.415 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout { 2024-09-13T16:56:47.416 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "fsid": "ffbd7588-71f0-11ef-bceb-c7b262605968", 2024-09-13T16:56:47.416 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "health": { 2024-09-13T16:56:47.416 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-13T16:56:47.416 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-13T16:56:47.416 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-13T16:56:47.416 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout }, 2024-09-13T16:56:47.416 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-13T16:56:47.416 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-13T16:56:47.416 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout 0 2024-09-13T16:56:47.416 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout ], 2024-09-13T16:56:47.416 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-13T16:56:47.416 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "smithi115" 2024-09-13T16:56:47.417 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout ], 2024-09-13T16:56:47.417 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2024-09-13T16:56:47.417 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-13T16:56:47.417 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T16:56:47.417 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-09-13T16:56:47.417 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-13T16:56:47.417 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout }, 2024-09-13T16:56:47.417 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-13T16:56:47.417 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T16:56:47.417 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-13T16:56:47.417 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-13T16:56:47.417 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-13T16:56:47.424 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-13T16:56:47.425 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-13T16:56:47.425 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-13T16:56:47.425 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout }, 2024-09-13T16:56:47.425 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-13T16:56:47.425 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-13T16:56:47.425 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-13T16:56:47.425 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-13T16:56:47.425 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-13T16:56:47.425 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-13T16:56:47.425 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-13T16:56:47.425 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-13T16:56:47.426 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-13T16:56:47.426 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout }, 2024-09-13T16:56:47.426 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-13T16:56:47.426 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T16:56:47.426 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-13T16:56:47.426 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-13T16:56:47.426 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout }, 2024-09-13T16:56:47.426 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-13T16:56:47.426 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-13T16:56:47.426 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-13T16:56:47.426 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-13T16:56:47.426 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-13T16:56:47.426 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-13T16:56:47.427 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "restful" 2024-09-13T16:56:47.427 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout ], 2024-09-13T16:56:47.427 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T16:56:47.427 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout }, 2024-09-13T16:56:47.427 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-13T16:56:47.427 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T16:56:47.427 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "modified": "2024-09-13T16:56:28.791372+0000", 2024-09-13T16:56:47.427 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T16:56:47.427 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout }, 2024-09-13T16:56:47.427 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-13T16:56:47.427 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout } 2024-09-13T16:56:47.427 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:41.920+0000 7f450ea32640 1 Processor -- start 2024-09-13T16:56:47.427 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:41.921+0000 7f450ea32640 1 -- start start 2024-09-13T16:56:47.428 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:41.921+0000 7f450ea32640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4508105e70 0x7f4508108260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:56:47.428 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:41.921+0000 7f450ea32640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4508078ec0 con 0x7f4508105e70 2024-09-13T16:56:47.428 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:41.921+0000 7f4507fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4508105e70 0x7f4508108260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:56:47.428 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:41.921+0000 7f4507fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4508105e70 0x7f4508108260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:36194/0 (socket says 172.21.15.115:36194) 2024-09-13T16:56:47.428 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:41.921+0000 7f4507fff640 1 -- 172.21.15.115:0/601341624 learned_addr learned my addr 172.21.15.115:0/601341624 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T16:56:47.428 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:41.921+0000 7f4507fff640 1 -- 172.21.15.115:0/601341624 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45081087a0 con 0x7f4508105e70 2024-09-13T16:56:47.428 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:41.922+0000 7f4507fff640 1 --2- 172.21.15.115:0/601341624 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4508105e70 0x7f4508108260 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f44f8009820 tx=0x7f44f802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e545ff2297ce24c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:56:47.428 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:41.922+0000 7f4506ffd640 1 -- 172.21.15.115:0/601341624 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f44f802ad40 con 0x7f4508105e70 2024-09-13T16:56:47.428 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:41.922+0000 7f4506ffd640 1 -- 172.21.15.115:0/601341624 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f44f8032890 con 0x7f4508105e70 2024-09-13T16:56:47.428 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:41.922+0000 7f4506ffd640 1 -- 172.21.15.115:0/601341624 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f44f80307d0 con 0x7f4508105e70 2024-09-13T16:56:47.428 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:41.923+0000 7f450ea32640 1 -- 172.21.15.115:0/601341624 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4508105e70 msgr2=0x7f4508108260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:56:47.428 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:41.923+0000 7f450ea32640 1 --2- 172.21.15.115:0/601341624 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4508105e70 0x7f4508108260 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f44f8009820 tx=0x7f44f802a270 comp rx=0 tx=0).stop 2024-09-13T16:56:47.428 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:41.923+0000 7f450ea32640 1 -- 172.21.15.115:0/601341624 shutdown_connections 2024-09-13T16:56:47.429 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:41.923+0000 7f450ea32640 1 --2- 172.21.15.115:0/601341624 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4508105e70 0x7f4508108260 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:47.429 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:41.923+0000 7f450ea32640 1 -- 172.21.15.115:0/601341624 >> 172.21.15.115:0/601341624 conn(0x7f45080ffaf0 msgr2=0x7f4508101f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:56:47.429 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:41.923+0000 7f450ea32640 1 -- 172.21.15.115:0/601341624 shutdown_connections 2024-09-13T16:56:47.429 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:41.923+0000 7f450ea32640 1 -- 172.21.15.115:0/601341624 wait complete. 2024-09-13T16:56:47.429 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:41.924+0000 7f450ea32640 1 Processor -- start 2024-09-13T16:56:47.429 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:41.924+0000 7f450ea32640 1 -- start start 2024-09-13T16:56:47.429 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:41.924+0000 7f450ea32640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4508105e70 0x7f45081990e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:56:47.429 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:41.924+0000 7f450ea32640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4508199620 con 0x7f4508105e70 2024-09-13T16:56:47.429 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:41.924+0000 7f4507fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4508105e70 0x7f45081990e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:56:47.429 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:41.924+0000 7f4507fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4508105e70 0x7f45081990e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:36198/0 (socket says 172.21.15.115:36198) 2024-09-13T16:56:47.429 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:41.924+0000 7f4507fff640 1 -- 172.21.15.115:0/205280560 learned_addr learned my addr 172.21.15.115:0/205280560 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T16:56:47.429 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:41.924+0000 7f4507fff640 1 -- 172.21.15.115:0/205280560 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44f80094d0 con 0x7f4508105e70 2024-09-13T16:56:47.429 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:41.925+0000 7f4507fff640 1 --2- 172.21.15.115:0/205280560 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4508105e70 0x7f45081990e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f44f8030380 tx=0x7f44f8030cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:56:47.429 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:41.925+0000 7f45057fa640 1 -- 172.21.15.115:0/205280560 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f44f8030ed0 con 0x7f4508105e70 2024-09-13T16:56:47.430 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:41.925+0000 7f45057fa640 1 -- 172.21.15.115:0/205280560 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f44f8032c10 con 0x7f4508105e70 2024-09-13T16:56:47.430 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:41.925+0000 7f45057fa640 1 -- 172.21.15.115:0/205280560 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f44f803a560 con 0x7f4508105e70 2024-09-13T16:56:47.430 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:41.925+0000 7f450ea32640 1 -- 172.21.15.115:0/205280560 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4508199820 con 0x7f4508105e70 2024-09-13T16:56:47.430 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:41.925+0000 7f450ea32640 1 -- 172.21.15.115:0/205280560 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4508199cc0 con 0x7f4508105e70 2024-09-13T16:56:47.430 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:41.925+0000 7f45057fa640 1 -- 172.21.15.115:0/205280560 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f44f803ab20 con 0x7f4508105e70 2024-09-13T16:56:47.430 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:41.925+0000 7f45057fa640 1 -- 172.21.15.115:0/205280560 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f44f8046d00 con 0x7f4508105e70 2024-09-13T16:56:47.430 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:41.926+0000 7f450ea32640 1 -- 172.21.15.115:0/205280560 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45081094c0 con 0x7f4508105e70 2024-09-13T16:56:47.430 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:41.928+0000 7f45057fa640 1 -- 172.21.15.115:0/205280560 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f44f8037070 con 0x7f4508105e70 2024-09-13T16:56:47.430 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:41.988+0000 7f450ea32640 1 -- 172.21.15.115:0/205280560 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f4508109680 con 0x7f4508105e70 2024-09-13T16:56:47.430 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:41.988+0000 7f45057fa640 1 -- 172.21.15.115:0/205280560 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1246 (secure 0 0 0) 0x7f44f8032d80 con 0x7f4508105e70 2024-09-13T16:56:47.430 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:41.989+0000 7f450ea32640 1 -- 172.21.15.115:0/205280560 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4508105e70 msgr2=0x7f45081990e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:56:47.430 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:41.989+0000 7f450ea32640 1 --2- 172.21.15.115:0/205280560 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4508105e70 0x7f45081990e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f44f8030380 tx=0x7f44f8030cc0 comp rx=0 tx=0).stop 2024-09-13T16:56:47.430 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:41.989+0000 7f450ea32640 1 -- 172.21.15.115:0/205280560 shutdown_connections 2024-09-13T16:56:47.430 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:41.989+0000 7f450ea32640 1 --2- 172.21.15.115:0/205280560 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4508105e70 0x7f45081990e0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:47.431 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:41.989+0000 7f450ea32640 1 -- 172.21.15.115:0/205280560 >> 172.21.15.115:0/205280560 conn(0x7f45080ffaf0 msgr2=0x7f45081006c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:56:47.431 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:41.989+0000 7f450ea32640 1 -- 172.21.15.115:0/205280560 shutdown_connections 2024-09-13T16:56:47.431 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:41.989+0000 7f450ea32640 1 -- 172.21.15.115:0/205280560 wait complete. 2024-09-13T16:56:47.431 INFO:teuthology.orchestra.run.smithi115.stdout:mgr not available, waiting (1/15)... 2024-09-13T16:56:50.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:50 smithi115 ceph-mon[27708]: from='client.? 172.21.15.115:0/3426125131' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-13T16:56:50.612 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout 2024-09-13T16:56:50.612 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout { 2024-09-13T16:56:50.612 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "fsid": "ffbd7588-71f0-11ef-bceb-c7b262605968", 2024-09-13T16:56:50.612 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "health": { 2024-09-13T16:56:50.612 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-13T16:56:50.613 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-13T16:56:50.613 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-13T16:56:50.613 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout }, 2024-09-13T16:56:50.613 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-13T16:56:50.613 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-13T16:56:50.613 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout 0 2024-09-13T16:56:50.613 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout ], 2024-09-13T16:56:50.613 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-13T16:56:50.613 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "smithi115" 2024-09-13T16:56:50.613 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout ], 2024-09-13T16:56:50.613 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "quorum_age": 16, 2024-09-13T16:56:50.613 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-13T16:56:50.614 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T16:56:50.614 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-09-13T16:56:50.614 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-13T16:56:50.614 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout }, 2024-09-13T16:56:50.614 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-13T16:56:50.614 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T16:56:50.614 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-13T16:56:50.614 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-13T16:56:50.614 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-13T16:56:50.623 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-13T16:56:50.623 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-13T16:56:50.623 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-13T16:56:50.623 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout }, 2024-09-13T16:56:50.623 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-13T16:56:50.623 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-13T16:56:50.624 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-13T16:56:50.624 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-13T16:56:50.624 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-13T16:56:50.624 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-13T16:56:50.624 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-13T16:56:50.624 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-13T16:56:50.624 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-13T16:56:50.624 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout }, 2024-09-13T16:56:50.624 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-13T16:56:50.624 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T16:56:50.624 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-13T16:56:50.624 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-13T16:56:50.625 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout }, 2024-09-13T16:56:50.625 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-13T16:56:50.625 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-13T16:56:50.625 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-13T16:56:50.625 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-13T16:56:50.625 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-13T16:56:50.625 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-13T16:56:50.625 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "restful" 2024-09-13T16:56:50.625 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout ], 2024-09-13T16:56:50.625 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T16:56:50.625 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout }, 2024-09-13T16:56:50.625 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-13T16:56:50.626 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T16:56:50.626 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "modified": "2024-09-13T16:56:28.791372+0000", 2024-09-13T16:56:50.626 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T16:56:50.626 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout }, 2024-09-13T16:56:50.626 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-13T16:56:50.626 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout } 2024-09-13T16:56:50.626 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:49.797+0000 7fcd7d54e640 1 Processor -- start 2024-09-13T16:56:50.626 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:49.797+0000 7fcd7d54e640 1 -- start start 2024-09-13T16:56:50.626 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:49.797+0000 7fcd7d54e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd78104300 0x7fcd78104700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:56:50.626 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:49.798+0000 7fcd7d54e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd78104cd0 con 0x7fcd78104300 2024-09-13T16:56:50.626 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:49.798+0000 7fcd76ffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd78104300 0x7fcd78104700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:56:50.627 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:49.798+0000 7fcd76ffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd78104300 0x7fcd78104700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:34802/0 (socket says 172.21.15.115:34802) 2024-09-13T16:56:50.627 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:49.798+0000 7fcd76ffd640 1 -- 172.21.15.115:0/3656225626 learned_addr learned my addr 172.21.15.115:0/3656225626 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T16:56:50.627 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:49.798+0000 7fcd76ffd640 1 -- 172.21.15.115:0/3656225626 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd78105500 con 0x7fcd78104300 2024-09-13T16:56:50.627 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:49.799+0000 7fcd76ffd640 1 --2- 172.21.15.115:0/3656225626 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd78104300 0x7fcd78104700 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fcd70009820 tx=0x7fcd7002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d6c479189eddd0b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:56:50.627 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:49.799+0000 7fcd75ffb640 1 -- 172.21.15.115:0/3656225626 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcd7002ad40 con 0x7fcd78104300 2024-09-13T16:56:50.627 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:49.799+0000 7fcd75ffb640 1 -- 172.21.15.115:0/3656225626 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7fcd70032890 con 0x7fcd78104300 2024-09-13T16:56:50.627 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:49.799+0000 7fcd75ffb640 1 -- 172.21.15.115:0/3656225626 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcd700307d0 con 0x7fcd78104300 2024-09-13T16:56:50.627 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:49.800+0000 7fcd7d54e640 1 -- 172.21.15.115:0/3656225626 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd78104300 msgr2=0x7fcd78104700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:56:50.627 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:49.800+0000 7fcd7d54e640 1 --2- 172.21.15.115:0/3656225626 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd78104300 0x7fcd78104700 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fcd70009820 tx=0x7fcd7002a270 comp rx=0 tx=0).stop 2024-09-13T16:56:50.627 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:49.800+0000 7fcd7d54e640 1 -- 172.21.15.115:0/3656225626 shutdown_connections 2024-09-13T16:56:50.627 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:49.800+0000 7fcd7d54e640 1 --2- 172.21.15.115:0/3656225626 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd78104300 0x7fcd78104700 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:50.628 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:49.800+0000 7fcd7d54e640 1 -- 172.21.15.115:0/3656225626 >> 172.21.15.115:0/3656225626 conn(0x7fcd780ffaf0 msgr2=0x7fcd78101f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:56:50.628 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:49.800+0000 7fcd7d54e640 1 -- 172.21.15.115:0/3656225626 shutdown_connections 2024-09-13T16:56:50.628 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:49.800+0000 7fcd7d54e640 1 -- 172.21.15.115:0/3656225626 wait complete. 2024-09-13T16:56:50.628 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:49.800+0000 7fcd7d54e640 1 Processor -- start 2024-09-13T16:56:50.628 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:49.801+0000 7fcd7d54e640 1 -- start start 2024-09-13T16:56:50.628 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:49.801+0000 7fcd7d54e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd78104300 0x7fcd78078a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:56:50.628 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:49.801+0000 7fcd7d54e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd78078fa0 con 0x7fcd78104300 2024-09-13T16:56:50.628 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:49.801+0000 7fcd76ffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd78104300 0x7fcd78078a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:56:50.628 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:49.801+0000 7fcd76ffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd78104300 0x7fcd78078a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:34804/0 (socket says 172.21.15.115:34804) 2024-09-13T16:56:50.628 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:49.801+0000 7fcd76ffd640 1 -- 172.21.15.115:0/3426125131 learned_addr learned my addr 172.21.15.115:0/3426125131 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T16:56:50.628 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:49.801+0000 7fcd76ffd640 1 -- 172.21.15.115:0/3426125131 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd700094d0 con 0x7fcd78104300 2024-09-13T16:56:50.628 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:49.801+0000 7fcd76ffd640 1 --2- 172.21.15.115:0/3426125131 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd78104300 0x7fcd78078a60 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fcd70009940 tx=0x7fcd70030cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:56:50.629 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:49.802+0000 7fcd5ffff640 1 -- 172.21.15.115:0/3426125131 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcd70040070 con 0x7fcd78104300 2024-09-13T16:56:50.629 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:49.802+0000 7fcd5ffff640 1 -- 172.21.15.115:0/3426125131 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7fcd70030e80 con 0x7fcd78104300 2024-09-13T16:56:50.629 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:49.802+0000 7fcd5ffff640 1 -- 172.21.15.115:0/3426125131 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcd7003a3b0 con 0x7fcd78104300 2024-09-13T16:56:50.629 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:49.802+0000 7fcd7d54e640 1 -- 172.21.15.115:0/3426125131 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd7819bec0 con 0x7fcd78104300 2024-09-13T16:56:50.629 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:49.802+0000 7fcd7d54e640 1 -- 172.21.15.115:0/3426125131 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd7819c360 con 0x7fcd78104300 2024-09-13T16:56:50.629 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:49.802+0000 7fcd5ffff640 1 -- 172.21.15.115:0/3426125131 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 45545+0+0 (secure 0 0 0) 0x7fcd7003a510 con 0x7fcd78104300 2024-09-13T16:56:50.629 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:49.803+0000 7fcd5ffff640 1 --2- 172.21.15.115:0/3426125131 >> [v2:172.21.15.115:6800/1463863592,v1:172.21.15.115:6801/1463863592] conn(0x7fcd60038650 0x7fcd6003ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:56:50.629 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:49.803+0000 7fcd7d54e640 1 -- 172.21.15.115:0/3426125131 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd78104780 con 0x7fcd78104300 2024-09-13T16:56:50.629 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:49.803+0000 7fcd5ffff640 1 -- 172.21.15.115:0/3426125131 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fcd7006af50 con 0x7fcd78104300 2024-09-13T16:56:50.629 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:49.803+0000 7fcd767fc640 1 --2- 172.21.15.115:0/3426125131 >> [v2:172.21.15.115:6800/1463863592,v1:172.21.15.115:6801/1463863592] conn(0x7fcd60038650 0x7fcd6003ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:56:50.629 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:49.803+0000 7fcd767fc640 1 --2- 172.21.15.115:0/3426125131 >> [v2:172.21.15.115:6800/1463863592,v1:172.21.15.115:6801/1463863592] conn(0x7fcd60038650 0x7fcd6003ab10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c00ad30 tx=0x7fcd6c0093f0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:56:50.630 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:49.808+0000 7fcd5ffff640 1 -- 172.21.15.115:0/3426125131 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fcd70039900 con 0x7fcd78104300 2024-09-13T16:56:50.630 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:50.030+0000 7fcd7d54e640 1 -- 172.21.15.115:0/3426125131 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fcd7819c660 con 0x7fcd78104300 2024-09-13T16:56:50.630 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:50.031+0000 7fcd5ffff640 1 -- 172.21.15.115:0/3426125131 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1246 (secure 0 0 0) 0x7fcd70039310 con 0x7fcd78104300 2024-09-13T16:56:50.630 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:50.033+0000 7fcd7d54e640 1 -- 172.21.15.115:0/3426125131 >> [v2:172.21.15.115:6800/1463863592,v1:172.21.15.115:6801/1463863592] conn(0x7fcd60038650 msgr2=0x7fcd6003ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:56:50.630 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:50.033+0000 7fcd7d54e640 1 --2- 172.21.15.115:0/3426125131 >> [v2:172.21.15.115:6800/1463863592,v1:172.21.15.115:6801/1463863592] conn(0x7fcd60038650 0x7fcd6003ab10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c00ad30 tx=0x7fcd6c0093f0 comp rx=0 tx=0).stop 2024-09-13T16:56:50.630 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:50.033+0000 7fcd7d54e640 1 -- 172.21.15.115:0/3426125131 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd78104300 msgr2=0x7fcd78078a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:56:50.630 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:50.033+0000 7fcd7d54e640 1 --2- 172.21.15.115:0/3426125131 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd78104300 0x7fcd78078a60 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fcd70009940 tx=0x7fcd70030cc0 comp rx=0 tx=0).stop 2024-09-13T16:56:50.630 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:50.033+0000 7fcd7d54e640 1 -- 172.21.15.115:0/3426125131 shutdown_connections 2024-09-13T16:56:50.630 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:50.033+0000 7fcd7d54e640 1 --2- 172.21.15.115:0/3426125131 >> [v2:172.21.15.115:6800/1463863592,v1:172.21.15.115:6801/1463863592] conn(0x7fcd60038650 0x7fcd6003ab10 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:50.630 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:50.033+0000 7fcd7d54e640 1 --2- 172.21.15.115:0/3426125131 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd78104300 0x7fcd78078a60 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:50.630 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:50.033+0000 7fcd7d54e640 1 -- 172.21.15.115:0/3426125131 >> 172.21.15.115:0/3426125131 conn(0x7fcd780ffaf0 msgr2=0x7fcd781006b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:56:50.630 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:50.033+0000 7fcd7d54e640 1 -- 172.21.15.115:0/3426125131 shutdown_connections 2024-09-13T16:56:50.631 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:50.033+0000 7fcd7d54e640 1 -- 172.21.15.115:0/3426125131 wait complete. 2024-09-13T16:56:50.631 INFO:teuthology.orchestra.run.smithi115.stdout:mgr is available 2024-09-13T16:56:51.428 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:51 smithi115 ceph-mon[27708]: from='client.? 172.21.15.115:0/2548574819' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-13T16:56:51.715 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout 2024-09-13T16:56:51.715 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout [global] 2024-09-13T16:56:51.715 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout fsid = ffbd7588-71f0-11ef-bceb-c7b262605968 2024-09-13T16:56:51.715 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-13T16:56:51.715 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-13T16:56:51.716 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-13T16:56:51.716 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-13T16:56:51.716 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout 2024-09-13T16:56:51.716 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-13T16:56:51.716 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-13T16:56:51.716 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout 2024-09-13T16:56:51.716 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout [osd] 2024-09-13T16:56:51.716 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-13T16:56:51.716 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-13T16:56:51.716 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-13T16:56:51.716 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-13T16:56:51.716 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-13T16:56:51.716 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:50.983+0000 7fdb2cae4640 1 Processor -- start 2024-09-13T16:56:51.717 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:50.983+0000 7fdb2cae4640 1 -- start start 2024-09-13T16:56:51.717 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:50.984+0000 7fdb2cae4640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb28105e70 0x7fdb28108260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:56:51.717 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:50.984+0000 7fdb2cae4640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb28078ec0 con 0x7fdb28105e70 2024-09-13T16:56:51.717 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:50.984+0000 7fdb2659c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb28105e70 0x7fdb28108260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:56:51.717 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:50.984+0000 7fdb2659c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb28105e70 0x7fdb28108260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:34812/0 (socket says 172.21.15.115:34812) 2024-09-13T16:56:51.717 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:50.984+0000 7fdb2659c640 1 -- 172.21.15.115:0/1952833751 learned_addr learned my addr 172.21.15.115:0/1952833751 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T16:56:51.717 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:50.984+0000 7fdb2659c640 1 -- 172.21.15.115:0/1952833751 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb281087a0 con 0x7fdb28105e70 2024-09-13T16:56:51.717 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:50.985+0000 7fdb2659c640 1 --2- 172.21.15.115:0/1952833751 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb28105e70 0x7fdb28108260 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fdb18009820 tx=0x7fdb1802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ab80fdd89539da5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:56:51.717 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:50.985+0000 7fdb2559a640 1 -- 172.21.15.115:0/1952833751 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdb1802ad40 con 0x7fdb28105e70 2024-09-13T16:56:51.717 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:50.985+0000 7fdb2559a640 1 -- 172.21.15.115:0/1952833751 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7fdb18032890 con 0x7fdb28105e70 2024-09-13T16:56:51.717 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:50.985+0000 7fdb2559a640 1 -- 172.21.15.115:0/1952833751 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdb180307d0 con 0x7fdb28105e70 2024-09-13T16:56:51.717 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:50.985+0000 7fdb2cae4640 1 -- 172.21.15.115:0/1952833751 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb28105e70 msgr2=0x7fdb28108260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:56:51.717 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:50.985+0000 7fdb2cae4640 1 --2- 172.21.15.115:0/1952833751 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb28105e70 0x7fdb28108260 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fdb18009820 tx=0x7fdb1802a270 comp rx=0 tx=0).stop 2024-09-13T16:56:51.718 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:50.985+0000 7fdb2cae4640 1 -- 172.21.15.115:0/1952833751 shutdown_connections 2024-09-13T16:56:51.718 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:50.985+0000 7fdb2cae4640 1 --2- 172.21.15.115:0/1952833751 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb28105e70 0x7fdb28108260 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:51.718 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:50.985+0000 7fdb2cae4640 1 -- 172.21.15.115:0/1952833751 >> 172.21.15.115:0/1952833751 conn(0x7fdb280ffaf0 msgr2=0x7fdb28101f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:56:51.718 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:50.986+0000 7fdb2cae4640 1 -- 172.21.15.115:0/1952833751 shutdown_connections 2024-09-13T16:56:51.718 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:50.986+0000 7fdb2cae4640 1 -- 172.21.15.115:0/1952833751 wait complete. 2024-09-13T16:56:51.718 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:50.986+0000 7fdb2cae4640 1 Processor -- start 2024-09-13T16:56:51.718 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:50.986+0000 7fdb2cae4640 1 -- start start 2024-09-13T16:56:51.718 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:50.986+0000 7fdb2cae4640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb28105e70 0x7fdb281990e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:56:51.718 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:50.986+0000 7fdb2cae4640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb28199620 con 0x7fdb28105e70 2024-09-13T16:56:51.718 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:50.986+0000 7fdb2659c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb28105e70 0x7fdb281990e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:56:51.718 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:50.987+0000 7fdb2659c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb28105e70 0x7fdb281990e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:34822/0 (socket says 172.21.15.115:34822) 2024-09-13T16:56:51.718 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:50.987+0000 7fdb2659c640 1 -- 172.21.15.115:0/2548574819 learned_addr learned my addr 172.21.15.115:0/2548574819 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T16:56:51.718 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:50.987+0000 7fdb2659c640 1 -- 172.21.15.115:0/2548574819 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb180094d0 con 0x7fdb28105e70 2024-09-13T16:56:51.719 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:50.987+0000 7fdb2659c640 1 --2- 172.21.15.115:0/2548574819 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb28105e70 0x7fdb281990e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fdb18030d40 tx=0x7fdb18030d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:56:51.719 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:50.987+0000 7fdb1f7fe640 1 -- 172.21.15.115:0/2548574819 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdb18032c10 con 0x7fdb28105e70 2024-09-13T16:56:51.719 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:50.987+0000 7fdb2cae4640 1 -- 172.21.15.115:0/2548574819 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb28199820 con 0x7fdb28105e70 2024-09-13T16:56:51.719 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:50.987+0000 7fdb1f7fe640 1 -- 172.21.15.115:0/2548574819 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7fdb18032d70 con 0x7fdb28105e70 2024-09-13T16:56:51.719 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:50.987+0000 7fdb1f7fe640 1 -- 172.21.15.115:0/2548574819 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdb1803a560 con 0x7fdb28105e70 2024-09-13T16:56:51.719 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:50.987+0000 7fdb2cae4640 1 -- 172.21.15.115:0/2548574819 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb28199cc0 con 0x7fdb28105e70 2024-09-13T16:56:51.719 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:50.988+0000 7fdb1f7fe640 1 -- 172.21.15.115:0/2548574819 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 45545+0+0 (secure 0 0 0) 0x7fdb1803a820 con 0x7fdb28105e70 2024-09-13T16:56:51.719 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:50.988+0000 7fdb1f7fe640 1 --2- 172.21.15.115:0/2548574819 >> [v2:172.21.15.115:6800/1463863592,v1:172.21.15.115:6801/1463863592] conn(0x7fdb140385a0 0x7fdb1403aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:56:51.719 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:50.988+0000 7fdb1f7fe640 1 -- 172.21.15.115:0/2548574819 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fdb1806b670 con 0x7fdb28105e70 2024-09-13T16:56:51.719 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:50.988+0000 7fdb25d9b640 1 --2- 172.21.15.115:0/2548574819 >> [v2:172.21.15.115:6800/1463863592,v1:172.21.15.115:6801/1463863592] conn(0x7fdb140385a0 0x7fdb1403aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:56:51.719 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:50.988+0000 7fdb2cae4640 1 -- 172.21.15.115:0/2548574819 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb281062d0 con 0x7fdb28105e70 2024-09-13T16:56:51.719 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:50.989+0000 7fdb25d9b640 1 --2- 172.21.15.115:0/2548574819 >> [v2:172.21.15.115:6800/1463863592,v1:172.21.15.115:6801/1463863592] conn(0x7fdb140385a0 0x7fdb1403aa60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fdb100098c0 tx=0x7fdb10006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:56:51.719 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:50.993+0000 7fdb1f7fe640 1 -- 172.21.15.115:0/2548574819 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fdb18046460 con 0x7fdb28105e70 2024-09-13T16:56:51.720 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:51.154+0000 7fdb2cae4640 1 -- 172.21.15.115:0/2548574819 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7fdb281094c0 con 0x7fdb28105e70 2024-09-13T16:56:51.720 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:51.155+0000 7fdb1f7fe640 1 -- 172.21.15.115:0/2548574819 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7fdb18039310 con 0x7fdb28105e70 2024-09-13T16:56:51.720 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:51.158+0000 7fdb2cae4640 1 -- 172.21.15.115:0/2548574819 >> [v2:172.21.15.115:6800/1463863592,v1:172.21.15.115:6801/1463863592] conn(0x7fdb140385a0 msgr2=0x7fdb1403aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:56:51.720 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:51.158+0000 7fdb2cae4640 1 --2- 172.21.15.115:0/2548574819 >> [v2:172.21.15.115:6800/1463863592,v1:172.21.15.115:6801/1463863592] conn(0x7fdb140385a0 0x7fdb1403aa60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fdb100098c0 tx=0x7fdb10006db0 comp rx=0 tx=0).stop 2024-09-13T16:56:51.720 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:51.158+0000 7fdb2cae4640 1 -- 172.21.15.115:0/2548574819 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb28105e70 msgr2=0x7fdb281990e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:56:51.720 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:51.158+0000 7fdb2cae4640 1 --2- 172.21.15.115:0/2548574819 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb28105e70 0x7fdb281990e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fdb18030d40 tx=0x7fdb18030d70 comp rx=0 tx=0).stop 2024-09-13T16:56:51.720 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:51.158+0000 7fdb2cae4640 1 -- 172.21.15.115:0/2548574819 shutdown_connections 2024-09-13T16:56:51.720 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:51.158+0000 7fdb2cae4640 1 --2- 172.21.15.115:0/2548574819 >> [v2:172.21.15.115:6800/1463863592,v1:172.21.15.115:6801/1463863592] conn(0x7fdb140385a0 0x7fdb1403aa60 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:51.720 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:51.158+0000 7fdb2cae4640 1 --2- 172.21.15.115:0/2548574819 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb28105e70 0x7fdb281990e0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:51.720 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:51.158+0000 7fdb2cae4640 1 -- 172.21.15.115:0/2548574819 >> 172.21.15.115:0/2548574819 conn(0x7fdb280ffaf0 msgr2=0x7fdb281006c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:56:51.720 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:51.158+0000 7fdb2cae4640 1 -- 172.21.15.115:0/2548574819 shutdown_connections 2024-09-13T16:56:51.720 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:51.158+0000 7fdb2cae4640 1 -- 172.21.15.115:0/2548574819 wait complete. 2024-09-13T16:56:51.721 INFO:teuthology.orchestra.run.smithi115.stdout:Enabling cephadm module... 2024-09-13T16:56:52.675 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:52 smithi115 ceph-mon[27708]: from='client.? 172.21.15.115:0/2996906403' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-13T16:56:53.327 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:52.061+0000 7f0a62933640 1 Processor -- start 2024-09-13T16:56:53.327 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:52.061+0000 7f0a62933640 1 -- start start 2024-09-13T16:56:53.327 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:52.061+0000 7f0a62933640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a5c104320 0x7f0a5c104720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:56:53.327 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:52.061+0000 7f0a62933640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5c104cf0 con 0x7f0a5c104320 2024-09-13T16:56:53.327 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:52.061+0000 7f0a5bfff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a5c104320 0x7f0a5c104720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:56:53.327 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:52.061+0000 7f0a5bfff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a5c104320 0x7f0a5c104720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:34834/0 (socket says 172.21.15.115:34834) 2024-09-13T16:56:53.327 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:52.061+0000 7f0a5bfff640 1 -- 172.21.15.115:0/3256968877 learned_addr learned my addr 172.21.15.115:0/3256968877 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T16:56:53.327 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:52.062+0000 7f0a5bfff640 1 -- 172.21.15.115:0/3256968877 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a5c105520 con 0x7f0a5c104320 2024-09-13T16:56:53.327 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:52.062+0000 7f0a5bfff640 1 --2- 172.21.15.115:0/3256968877 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a5c104320 0x7f0a5c104720 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c009820 tx=0x7f0a4c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd3aea52d8f30449 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:56:53.328 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:52.063+0000 7f0a5b7fe640 1 -- 172.21.15.115:0/3256968877 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0a4c02ad40 con 0x7f0a5c104320 2024-09-13T16:56:53.328 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:52.063+0000 7f0a5b7fe640 1 -- 172.21.15.115:0/3256968877 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f0a4c032890 con 0x7f0a5c104320 2024-09-13T16:56:53.328 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:52.063+0000 7f0a5b7fe640 1 -- 172.21.15.115:0/3256968877 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0a4c0307d0 con 0x7f0a5c104320 2024-09-13T16:56:53.328 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:52.063+0000 7f0a62933640 1 -- 172.21.15.115:0/3256968877 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a5c104320 msgr2=0x7f0a5c104720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:56:53.328 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:52.063+0000 7f0a62933640 1 --2- 172.21.15.115:0/3256968877 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a5c104320 0x7f0a5c104720 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c009820 tx=0x7f0a4c02a270 comp rx=0 tx=0).stop 2024-09-13T16:56:53.328 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:52.063+0000 7f0a62933640 1 -- 172.21.15.115:0/3256968877 shutdown_connections 2024-09-13T16:56:53.328 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:52.063+0000 7f0a62933640 1 --2- 172.21.15.115:0/3256968877 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a5c104320 0x7f0a5c104720 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:53.328 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:52.063+0000 7f0a62933640 1 -- 172.21.15.115:0/3256968877 >> 172.21.15.115:0/3256968877 conn(0x7f0a5c0ffb30 msgr2=0x7f0a5c101f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:56:53.328 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:52.063+0000 7f0a62933640 1 -- 172.21.15.115:0/3256968877 shutdown_connections 2024-09-13T16:56:53.328 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:52.063+0000 7f0a62933640 1 -- 172.21.15.115:0/3256968877 wait complete. 2024-09-13T16:56:53.329 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:52.064+0000 7f0a62933640 1 Processor -- start 2024-09-13T16:56:53.329 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:52.064+0000 7f0a62933640 1 -- start start 2024-09-13T16:56:53.329 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:52.064+0000 7f0a62933640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a5c104320 0x7f0a5c1991c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:56:53.329 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:52.064+0000 7f0a62933640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5c199700 con 0x7f0a5c104320 2024-09-13T16:56:53.329 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:52.064+0000 7f0a5bfff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a5c104320 0x7f0a5c1991c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:56:53.329 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:52.064+0000 7f0a5bfff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a5c104320 0x7f0a5c1991c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:34840/0 (socket says 172.21.15.115:34840) 2024-09-13T16:56:53.329 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:52.064+0000 7f0a5bfff640 1 -- 172.21.15.115:0/2996906403 learned_addr learned my addr 172.21.15.115:0/2996906403 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T16:56:53.329 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:52.064+0000 7f0a5bfff640 1 -- 172.21.15.115:0/2996906403 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a4c0094d0 con 0x7f0a5c104320 2024-09-13T16:56:53.329 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:52.065+0000 7f0a5bfff640 1 --2- 172.21.15.115:0/2996906403 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a5c104320 0x7f0a5c1991c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c009940 tx=0x7f0a4c030cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:56:53.329 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:52.065+0000 7f0a59ffb640 1 -- 172.21.15.115:0/2996906403 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0a4c040070 con 0x7f0a5c104320 2024-09-13T16:56:53.329 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:52.065+0000 7f0a59ffb640 1 -- 172.21.15.115:0/2996906403 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f0a4c032c10 con 0x7f0a5c104320 2024-09-13T16:56:53.329 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:52.065+0000 7f0a59ffb640 1 -- 172.21.15.115:0/2996906403 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0a4c03a560 con 0x7f0a5c104320 2024-09-13T16:56:53.330 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:52.065+0000 7f0a62933640 1 -- 172.21.15.115:0/2996906403 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a5c199900 con 0x7f0a5c104320 2024-09-13T16:56:53.330 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:52.065+0000 7f0a62933640 1 -- 172.21.15.115:0/2996906403 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a5c199da0 con 0x7f0a5c104320 2024-09-13T16:56:53.330 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:52.066+0000 7f0a59ffb640 1 -- 172.21.15.115:0/2996906403 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 45545+0+0 (secure 0 0 0) 0x7f0a4c03a6c0 con 0x7f0a5c104320 2024-09-13T16:56:53.330 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:52.066+0000 7f0a59ffb640 1 --2- 172.21.15.115:0/2996906403 >> [v2:172.21.15.115:6800/1463863592,v1:172.21.15.115:6801/1463863592] conn(0x7f0a48038650 0x7f0a4803ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:56:53.330 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:52.066+0000 7f0a59ffb640 1 -- 172.21.15.115:0/2996906403 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f0a4c06b080 con 0x7f0a5c104320 2024-09-13T16:56:53.330 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:52.066+0000 7f0a62933640 1 -- 172.21.15.115:0/2996906403 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a5c1047a0 con 0x7f0a5c104320 2024-09-13T16:56:53.330 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:52.066+0000 7f0a53fff640 1 --2- 172.21.15.115:0/2996906403 >> [v2:172.21.15.115:6800/1463863592,v1:172.21.15.115:6801/1463863592] conn(0x7f0a48038650 0x7f0a4803ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:56:53.330 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:52.066+0000 7f0a53fff640 1 --2- 172.21.15.115:0/2996906403 >> [v2:172.21.15.115:6800/1463863592,v1:172.21.15.115:6801/1463863592] conn(0x7f0a48038650 0x7f0a4803ab10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0a440098c0 tx=0x7f0a44006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:56:53.330 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:52.071+0000 7f0a59ffb640 1 -- 172.21.15.115:0/2996906403 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f0a4c045410 con 0x7f0a5c104320 2024-09-13T16:56:53.331 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:52.280+0000 7f0a62933640 1 -- 172.21.15.115:0/2996906403 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7f0a5c193310 con 0x7f0a5c104320 2024-09-13T16:56:53.331 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:52.333+0000 7f0a59ffb640 1 -- 172.21.15.115:0/2996906403 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mgrmap(e 5) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f0a4c03c9e0 con 0x7f0a5c104320 2024-09-13T16:56:53.331 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:52.334+0000 7f0a59ffb640 1 -- 172.21.15.115:0/2996906403 <== mon.0 v2:172.21.15.115:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7f0a4c037430 con 0x7f0a5c104320 2024-09-13T16:56:53.331 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:52.337+0000 7f0a62933640 1 -- 172.21.15.115:0/2996906403 >> [v2:172.21.15.115:6800/1463863592,v1:172.21.15.115:6801/1463863592] conn(0x7f0a48038650 msgr2=0x7f0a4803ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:56:53.331 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:52.337+0000 7f0a62933640 1 --2- 172.21.15.115:0/2996906403 >> [v2:172.21.15.115:6800/1463863592,v1:172.21.15.115:6801/1463863592] conn(0x7f0a48038650 0x7f0a4803ab10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0a440098c0 tx=0x7f0a44006db0 comp rx=0 tx=0).stop 2024-09-13T16:56:53.331 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:52.337+0000 7f0a62933640 1 -- 172.21.15.115:0/2996906403 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a5c104320 msgr2=0x7f0a5c1991c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:56:53.331 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:52.337+0000 7f0a62933640 1 --2- 172.21.15.115:0/2996906403 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a5c104320 0x7f0a5c1991c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c009940 tx=0x7f0a4c030cc0 comp rx=0 tx=0).stop 2024-09-13T16:56:53.331 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:52.337+0000 7f0a62933640 1 -- 172.21.15.115:0/2996906403 shutdown_connections 2024-09-13T16:56:53.331 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:52.337+0000 7f0a62933640 1 --2- 172.21.15.115:0/2996906403 >> [v2:172.21.15.115:6800/1463863592,v1:172.21.15.115:6801/1463863592] conn(0x7f0a48038650 0x7f0a4803ab10 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:53.331 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:52.337+0000 7f0a62933640 1 --2- 172.21.15.115:0/2996906403 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a5c104320 0x7f0a5c1991c0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:53.331 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:52.337+0000 7f0a62933640 1 -- 172.21.15.115:0/2996906403 >> 172.21.15.115:0/2996906403 conn(0x7f0a5c0ffb30 msgr2=0x7f0a5c100ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:56:53.331 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:52.337+0000 7f0a62933640 1 -- 172.21.15.115:0/2996906403 shutdown_connections 2024-09-13T16:56:53.331 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:52.337+0000 7f0a62933640 1 -- 172.21.15.115:0/2996906403 wait complete. 2024-09-13T16:56:53.587 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:53 smithi115 ceph-mon[27708]: from='client.? 172.21.15.115:0/2996906403' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-13T16:56:53.587 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:53 smithi115 ceph-mon[27708]: mgrmap e5: smithi115.hetcni(active, since 9s) 2024-09-13T16:56:54.517 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout { 2024-09-13T16:56:54.518 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-13T16:56:54.518 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-13T16:56:54.518 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "active_name": "smithi115.hetcni", 2024-09-13T16:56:54.518 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-13T16:56:54.518 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout } 2024-09-13T16:56:54.519 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:53.704+0000 7f595fc69640 1 Processor -- start 2024-09-13T16:56:54.519 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:53.705+0000 7f595fc69640 1 -- start start 2024-09-13T16:56:54.519 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:53.705+0000 7f595fc69640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5958105420 0x7f5958105820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:56:54.519 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:53.705+0000 7f595fc69640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5958105df0 con 0x7f5958105420 2024-09-13T16:56:54.519 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:53.705+0000 7f595da05640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5958105420 0x7f5958105820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:56:54.519 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:53.705+0000 7f595da05640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5958105420 0x7f5958105820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:34884/0 (socket says 172.21.15.115:34884) 2024-09-13T16:56:54.520 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:53.705+0000 7f595da05640 1 -- 172.21.15.115:0/4089630269 learned_addr learned my addr 172.21.15.115:0/4089630269 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T16:56:54.520 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:53.705+0000 7f595da05640 1 -- 172.21.15.115:0/4089630269 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59581065d0 con 0x7f5958105420 2024-09-13T16:56:54.520 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:53.706+0000 7f595da05640 1 --2- 172.21.15.115:0/4089630269 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5958105420 0x7f5958105820 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5954009820 tx=0x7f595402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab04b3afd751bd7d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:56:54.520 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:53.706+0000 7f595ca03640 1 -- 172.21.15.115:0/4089630269 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f595402ad40 con 0x7f5958105420 2024-09-13T16:56:54.520 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:53.706+0000 7f595ca03640 1 -- 172.21.15.115:0/4089630269 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f5954032890 con 0x7f5958105420 2024-09-13T16:56:54.521 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:53.706+0000 7f595ca03640 1 -- 172.21.15.115:0/4089630269 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f59540307d0 con 0x7f5958105420 2024-09-13T16:56:54.521 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:53.707+0000 7f595fc69640 1 -- 172.21.15.115:0/4089630269 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5958105420 msgr2=0x7f5958105820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:56:54.521 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:53.707+0000 7f595fc69640 1 --2- 172.21.15.115:0/4089630269 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5958105420 0x7f5958105820 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5954009820 tx=0x7f595402a270 comp rx=0 tx=0).stop 2024-09-13T16:56:54.521 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:53.707+0000 7f595fc69640 1 -- 172.21.15.115:0/4089630269 shutdown_connections 2024-09-13T16:56:54.521 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:53.707+0000 7f595fc69640 1 --2- 172.21.15.115:0/4089630269 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5958105420 0x7f5958105820 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:54.522 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:53.707+0000 7f595fc69640 1 -- 172.21.15.115:0/4089630269 >> 172.21.15.115:0/4089630269 conn(0x7f5958100bd0 msgr2=0x7f5958102ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:56:54.522 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:53.707+0000 7f595fc69640 1 -- 172.21.15.115:0/4089630269 shutdown_connections 2024-09-13T16:56:54.522 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:53.707+0000 7f595fc69640 1 -- 172.21.15.115:0/4089630269 wait complete. 2024-09-13T16:56:54.522 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:53.707+0000 7f595fc69640 1 Processor -- start 2024-09-13T16:56:54.522 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:53.707+0000 7f595fc69640 1 -- start start 2024-09-13T16:56:54.522 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:53.708+0000 7f595fc69640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5958105420 0x7f5958199140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:56:54.522 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:53.708+0000 7f595fc69640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5958199680 con 0x7f5958105420 2024-09-13T16:56:54.523 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:53.708+0000 7f595da05640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5958105420 0x7f5958199140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:56:54.523 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:53.708+0000 7f595da05640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5958105420 0x7f5958199140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:34892/0 (socket says 172.21.15.115:34892) 2024-09-13T16:56:54.523 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:53.708+0000 7f595da05640 1 -- 172.21.15.115:0/1668741160 learned_addr learned my addr 172.21.15.115:0/1668741160 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T16:56:54.523 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:53.708+0000 7f595da05640 1 -- 172.21.15.115:0/1668741160 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59540094d0 con 0x7f5958105420 2024-09-13T16:56:54.523 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:53.708+0000 7f595da05640 1 --2- 172.21.15.115:0/1668741160 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5958105420 0x7f5958199140 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f59540304c0 tx=0x7f5954030d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:56:54.523 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:53.708+0000 7f594effd640 1 -- 172.21.15.115:0/1668741160 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5954032c10 con 0x7f5958105420 2024-09-13T16:56:54.523 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:53.708+0000 7f595fc69640 1 -- 172.21.15.115:0/1668741160 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5958199880 con 0x7f5958105420 2024-09-13T16:56:54.523 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:53.708+0000 7f594effd640 1 -- 172.21.15.115:0/1668741160 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f5954032d70 con 0x7f5958105420 2024-09-13T16:56:54.523 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:53.708+0000 7f594effd640 1 -- 172.21.15.115:0/1668741160 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f595403a560 con 0x7f5958105420 2024-09-13T16:56:54.523 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:53.708+0000 7f595fc69640 1 -- 172.21.15.115:0/1668741160 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5958199d20 con 0x7f5958105420 2024-09-13T16:56:54.523 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:53.709+0000 7f594effd640 1 -- 172.21.15.115:0/1668741160 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f595403a790 con 0x7f5958105420 2024-09-13T16:56:54.523 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:53.709+0000 7f594effd640 1 --2- 172.21.15.115:0/1668741160 >> [v2:172.21.15.115:6800/1463863592,v1:172.21.15.115:6801/1463863592] conn(0x7f5944038650 0x7f594403ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:56:54.523 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:53.709+0000 7f594effd640 1 -- 172.21.15.115:0/1668741160 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f595406b500 con 0x7f5958105420 2024-09-13T16:56:54.524 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:53.709+0000 7f595d204640 1 -- 172.21.15.115:0/1668741160 >> [v2:172.21.15.115:6800/1463863592,v1:172.21.15.115:6801/1463863592] conn(0x7f5944038650 msgr2=0x7f594403ab10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6800/1463863592 2024-09-13T16:56:54.524 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:53.709+0000 7f595d204640 1 --2- 172.21.15.115:0/1668741160 >> [v2:172.21.15.115:6800/1463863592,v1:172.21.15.115:6801/1463863592] conn(0x7f5944038650 0x7f594403ab10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T16:56:54.524 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:53.709+0000 7f595fc69640 1 -- 172.21.15.115:0/1668741160 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59581058a0 con 0x7f5958105420 2024-09-13T16:56:54.524 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:53.714+0000 7f594effd640 1 -- 172.21.15.115:0/1668741160 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f5954046460 con 0x7f5958105420 2024-09-13T16:56:54.524 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:53.910+0000 7f595d204640 1 -- 172.21.15.115:0/1668741160 >> [v2:172.21.15.115:6800/1463863592,v1:172.21.15.115:6801/1463863592] conn(0x7f5944038650 msgr2=0x7f594403ab10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6800/1463863592 2024-09-13T16:56:54.524 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:53.910+0000 7f595d204640 1 --2- 172.21.15.115:0/1668741160 >> [v2:172.21.15.115:6800/1463863592,v1:172.21.15.115:6801/1463863592] conn(0x7f5944038650 0x7f594403ab10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T16:56:54.524 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:53.929+0000 7f595fc69640 1 -- 172.21.15.115:0/1668741160 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f595819c840 con 0x7f5958105420 2024-09-13T16:56:54.524 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:53.929+0000 7f594effd640 1 -- 172.21.15.115:0/1668741160 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+103 (secure 0 0 0) 0x7f5954044e90 con 0x7f5958105420 2024-09-13T16:56:54.524 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:53.931+0000 7f595fc69640 1 -- 172.21.15.115:0/1668741160 >> [v2:172.21.15.115:6800/1463863592,v1:172.21.15.115:6801/1463863592] conn(0x7f5944038650 msgr2=0x7f594403ab10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T16:56:54.525 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:53.931+0000 7f595fc69640 1 --2- 172.21.15.115:0/1668741160 >> [v2:172.21.15.115:6800/1463863592,v1:172.21.15.115:6801/1463863592] conn(0x7f5944038650 0x7f594403ab10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:54.525 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:53.931+0000 7f595fc69640 1 -- 172.21.15.115:0/1668741160 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5958105420 msgr2=0x7f5958199140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:56:54.525 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:53.931+0000 7f595fc69640 1 --2- 172.21.15.115:0/1668741160 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5958105420 0x7f5958199140 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f59540304c0 tx=0x7f5954030d10 comp rx=0 tx=0).stop 2024-09-13T16:56:54.525 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:53.931+0000 7f595fc69640 1 -- 172.21.15.115:0/1668741160 shutdown_connections 2024-09-13T16:56:54.525 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:53.931+0000 7f595fc69640 1 --2- 172.21.15.115:0/1668741160 >> [v2:172.21.15.115:6800/1463863592,v1:172.21.15.115:6801/1463863592] conn(0x7f5944038650 0x7f594403ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:54.525 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:53.931+0000 7f595fc69640 1 --2- 172.21.15.115:0/1668741160 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5958105420 0x7f5958199140 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:54.526 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:53.931+0000 7f595fc69640 1 -- 172.21.15.115:0/1668741160 >> 172.21.15.115:0/1668741160 conn(0x7f5958100bd0 msgr2=0x7f59581017b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:56:54.526 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:53.931+0000 7f595fc69640 1 -- 172.21.15.115:0/1668741160 shutdown_connections 2024-09-13T16:56:54.526 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:53.932+0000 7f595fc69640 1 -- 172.21.15.115:0/1668741160 wait complete. 2024-09-13T16:56:54.526 INFO:teuthology.orchestra.run.smithi115.stdout:Waiting for the mgr to restart... 2024-09-13T16:56:54.526 INFO:teuthology.orchestra.run.smithi115.stdout:Waiting for mgr epoch 5... 2024-09-13T16:56:54.548 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:54 smithi115 ceph-mon[27708]: from='client.? 172.21.15.115:0/1668741160' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-13T16:56:57.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:57 smithi115 ceph-mon[27708]: Active manager daemon smithi115.hetcni restarted 2024-09-13T16:56:57.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:57 smithi115 ceph-mon[27708]: Activating manager daemon smithi115.hetcni 2024-09-13T16:56:57.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:57 smithi115 ceph-mon[27708]: osdmap e2: 0 total, 0 up, 0 in 2024-09-13T16:56:57.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:57 smithi115 ceph-mon[27708]: mgrmap e6: smithi115.hetcni(active, starting, since 0.00361605s) 2024-09-13T16:56:57.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:57 smithi115 ceph-mon[27708]: from='mgr.14116 172.21.15.115:0/1701263389' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mon metadata", "id": "smithi115"}]: dispatch 2024-09-13T16:56:57.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:57 smithi115 ceph-mon[27708]: from='mgr.14116 172.21.15.115:0/1701263389' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mgr metadata", "who": "smithi115.hetcni", "id": "smithi115.hetcni"}]: dispatch 2024-09-13T16:56:57.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:57 smithi115 ceph-mon[27708]: from='mgr.14116 172.21.15.115:0/1701263389' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T16:56:57.430 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:57 smithi115 ceph-mon[27708]: from='mgr.14116 172.21.15.115:0/1701263389' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T16:56:57.430 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:57 smithi115 ceph-mon[27708]: from='mgr.14116 172.21.15.115:0/1701263389' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T16:56:57.430 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:57 smithi115 ceph-mon[27708]: Manager daemon smithi115.hetcni is now available 2024-09-13T16:56:57.430 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:57 smithi115 ceph-mon[27708]: from='mgr.14116 172.21.15.115:0/1701263389' entity='mgr.smithi115.hetcni' 2024-09-13T16:56:57.430 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:57 smithi115 ceph-mon[27708]: from='mgr.14116 172.21.15.115:0/1701263389' entity='mgr.smithi115.hetcni' 2024-09-13T16:56:57.430 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:57 smithi115 ceph-mon[27708]: from='mgr.14116 172.21.15.115:0/1701263389' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:56:57.430 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:57 smithi115 ceph-mon[27708]: from='mgr.14116 172.21.15.115:0/1701263389' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:56:57.430 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:57 smithi115 ceph-mon[27708]: from='mgr.14116 172.21.15.115:0/1701263389' entity='mgr.smithi115.hetcni' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi115.hetcni/mirror_snapshot_schedule"}]: dispatch 2024-09-13T16:56:57.430 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:57 smithi115 ceph-mon[27708]: from='mgr.14116 172.21.15.115:0/1701263389' entity='mgr.smithi115.hetcni' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi115.hetcni/trash_purge_schedule"}]: dispatch 2024-09-13T16:56:58.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:58 smithi115 ceph-mon[27708]: Found migration_current of "None". Setting to last migration. 2024-09-13T16:56:58.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:58 smithi115 ceph-mon[27708]: mgrmap e7: smithi115.hetcni(active, since 1.00563s) 2024-09-13T16:56:58.649 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout { 2024-09-13T16:56:58.653 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-13T16:56:58.653 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-13T16:56:58.653 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout } 2024-09-13T16:56:58.653 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:54.946+0000 7f317762e640 1 Processor -- start 2024-09-13T16:56:58.653 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:54.946+0000 7f317762e640 1 -- start start 2024-09-13T16:56:58.653 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:54.947+0000 7f317762e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3170104300 0x7f3170104700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:56:58.653 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:54.947+0000 7f317762e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3170104cd0 con 0x7f3170104300 2024-09-13T16:56:58.653 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:54.947+0000 7f31753ca640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3170104300 0x7f3170104700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:56:58.653 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:54.947+0000 7f31753ca640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3170104300 0x7f3170104700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60020/0 (socket says 172.21.15.115:60020) 2024-09-13T16:56:58.653 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:54.947+0000 7f31753ca640 1 -- 172.21.15.115:0/1308095024 learned_addr learned my addr 172.21.15.115:0/1308095024 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T16:56:58.653 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:54.947+0000 7f31753ca640 1 -- 172.21.15.115:0/1308095024 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3170105500 con 0x7f3170104300 2024-09-13T16:56:58.654 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:54.948+0000 7f31753ca640 1 --2- 172.21.15.115:0/1308095024 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3170104300 0x7f3170104700 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3160009820 tx=0x7f316002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeb54cdb46bf4a59 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:56:58.654 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:54.948+0000 7f3167fff640 1 -- 172.21.15.115:0/1308095024 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f316002ad40 con 0x7f3170104300 2024-09-13T16:56:58.654 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:54.948+0000 7f3167fff640 1 -- 172.21.15.115:0/1308095024 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f3160032890 con 0x7f3170104300 2024-09-13T16:56:58.654 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:54.948+0000 7f3167fff640 1 -- 172.21.15.115:0/1308095024 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f31600307d0 con 0x7f3170104300 2024-09-13T16:56:58.654 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:54.948+0000 7f317762e640 1 -- 172.21.15.115:0/1308095024 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3170104300 msgr2=0x7f3170104700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:56:58.654 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:54.948+0000 7f317762e640 1 --2- 172.21.15.115:0/1308095024 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3170104300 0x7f3170104700 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3160009820 tx=0x7f316002a270 comp rx=0 tx=0).stop 2024-09-13T16:56:58.654 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:54.948+0000 7f317762e640 1 -- 172.21.15.115:0/1308095024 shutdown_connections 2024-09-13T16:56:58.654 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:54.948+0000 7f317762e640 1 --2- 172.21.15.115:0/1308095024 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3170104300 0x7f3170104700 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:58.654 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:54.948+0000 7f317762e640 1 -- 172.21.15.115:0/1308095024 >> 172.21.15.115:0/1308095024 conn(0x7f31700ffaf0 msgr2=0x7f3170101f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:56:58.654 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:54.949+0000 7f317762e640 1 -- 172.21.15.115:0/1308095024 shutdown_connections 2024-09-13T16:56:58.654 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:54.949+0000 7f317762e640 1 -- 172.21.15.115:0/1308095024 wait complete. 2024-09-13T16:56:58.654 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:54.949+0000 7f317762e640 1 Processor -- start 2024-09-13T16:56:58.654 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:54.949+0000 7f317762e640 1 -- start start 2024-09-13T16:56:58.654 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:54.949+0000 7f317762e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3170104300 0x7f317018f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:56:58.655 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:54.949+0000 7f317762e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f317018f990 con 0x7f3170104300 2024-09-13T16:56:58.655 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:54.949+0000 7f31753ca640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3170104300 0x7f317018f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:56:58.655 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:54.949+0000 7f31753ca640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3170104300 0x7f317018f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60022/0 (socket says 172.21.15.115:60022) 2024-09-13T16:56:58.655 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:54.949+0000 7f31753ca640 1 -- 172.21.15.115:0/1202653292 learned_addr learned my addr 172.21.15.115:0/1202653292 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T16:56:58.655 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:54.950+0000 7f31753ca640 1 -- 172.21.15.115:0/1202653292 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31600094d0 con 0x7f3170104300 2024-09-13T16:56:58.655 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:54.950+0000 7f31753ca640 1 --2- 172.21.15.115:0/1202653292 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3170104300 0x7f317018f450 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3160009940 tx=0x7f3160030cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:56:58.655 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:54.950+0000 7f31667fc640 1 -- 172.21.15.115:0/1202653292 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3160040070 con 0x7f3170104300 2024-09-13T16:56:58.655 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:54.950+0000 7f31667fc640 1 -- 172.21.15.115:0/1202653292 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f3160032c10 con 0x7f3170104300 2024-09-13T16:56:58.655 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:54.950+0000 7f317762e640 1 -- 172.21.15.115:0/1202653292 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f317018db80 con 0x7f3170104300 2024-09-13T16:56:58.655 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:54.950+0000 7f31667fc640 1 -- 172.21.15.115:0/1202653292 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f316003a560 con 0x7f3170104300 2024-09-13T16:56:58.655 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:54.950+0000 7f317762e640 1 -- 172.21.15.115:0/1202653292 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f317018e020 con 0x7f3170104300 2024-09-13T16:56:58.655 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:54.951+0000 7f31667fc640 1 -- 172.21.15.115:0/1202653292 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f316003a6c0 con 0x7f3170104300 2024-09-13T16:56:58.655 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:54.951+0000 7f31667fc640 1 --2- 172.21.15.115:0/1202653292 >> [v2:172.21.15.115:6800/1463863592,v1:172.21.15.115:6801/1463863592] conn(0x7f315c0386a0 0x7f315c03ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:56:58.655 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:54.951+0000 7f31667fc640 1 -- 172.21.15.115:0/1202653292 --> [v2:172.21.15.115:6800/1463863592,v1:172.21.15.115:6801/1463863592] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f315c03b270 con 0x7f315c0386a0 2024-09-13T16:56:58.656 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:54.951+0000 7f31667fc640 1 -- 172.21.15.115:0/1202653292 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f316006b140 con 0x7f3170104300 2024-09-13T16:56:58.656 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:54.951+0000 7f3174bc9640 1 -- 172.21.15.115:0/1202653292 >> [v2:172.21.15.115:6800/1463863592,v1:172.21.15.115:6801/1463863592] conn(0x7f315c0386a0 msgr2=0x7f315c03ab60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6800/1463863592 2024-09-13T16:56:58.656 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:54.951+0000 7f3174bc9640 1 --2- 172.21.15.115:0/1202653292 >> [v2:172.21.15.115:6800/1463863592,v1:172.21.15.115:6801/1463863592] conn(0x7f315c0386a0 0x7f315c03ab60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T16:56:58.656 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:55.152+0000 7f3174bc9640 1 -- 172.21.15.115:0/1202653292 >> [v2:172.21.15.115:6800/1463863592,v1:172.21.15.115:6801/1463863592] conn(0x7f315c0386a0 msgr2=0x7f315c03ab60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6800/1463863592 2024-09-13T16:56:58.656 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:55.152+0000 7f3174bc9640 1 --2- 172.21.15.115:0/1202653292 >> [v2:172.21.15.115:6800/1463863592,v1:172.21.15.115:6801/1463863592] conn(0x7f315c0386a0 0x7f315c03ab60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T16:56:58.656 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:55.553+0000 7f3174bc9640 1 -- 172.21.15.115:0/1202653292 >> [v2:172.21.15.115:6800/1463863592,v1:172.21.15.115:6801/1463863592] conn(0x7f315c0386a0 msgr2=0x7f315c03ab60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6800/1463863592 2024-09-13T16:56:58.656 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:55.553+0000 7f3174bc9640 1 --2- 172.21.15.115:0/1202653292 >> [v2:172.21.15.115:6800/1463863592,v1:172.21.15.115:6801/1463863592] conn(0x7f315c0386a0 0x7f315c03ab60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-13T16:56:58.656 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:56.355+0000 7f3174bc9640 1 -- 172.21.15.115:0/1202653292 >> [v2:172.21.15.115:6800/1463863592,v1:172.21.15.115:6801/1463863592] conn(0x7f315c0386a0 msgr2=0x7f315c03ab60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6800/1463863592 2024-09-13T16:56:58.656 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:56.355+0000 7f3174bc9640 1 --2- 172.21.15.115:0/1202653292 >> [v2:172.21.15.115:6800/1463863592,v1:172.21.15.115:6801/1463863592] conn(0x7f315c0386a0 0x7f315c03ab60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-13T16:56:58.656 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:57.114+0000 7f31667fc640 1 -- 172.21.15.115:0/1202653292 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mgrmap(e 6) v1 ==== 45323+0+0 (secure 0 0 0) 0x7f316003c9e0 con 0x7f3170104300 2024-09-13T16:56:58.656 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:57.114+0000 7f31667fc640 1 -- 172.21.15.115:0/1202653292 >> [v2:172.21.15.115:6800/1463863592,v1:172.21.15.115:6801/1463863592] conn(0x7f315c0386a0 msgr2=0x7f315c03ab60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T16:56:58.657 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:57.114+0000 7f31667fc640 1 --2- 172.21.15.115:0/1202653292 >> [v2:172.21.15.115:6800/1463863592,v1:172.21.15.115:6801/1463863592] conn(0x7f315c0386a0 0x7f315c03ab60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:58.657 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:58.115+0000 7f31667fc640 1 -- 172.21.15.115:0/1202653292 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mgrmap(e 7) v1 ==== 45450+0+0 (secure 0 0 0) 0x7f316003ad40 con 0x7f3170104300 2024-09-13T16:56:58.657 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:58.115+0000 7f31667fc640 1 --2- 172.21.15.115:0/1202653292 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7f315c03bfd0 0x7f315c03e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:56:58.657 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:58.115+0000 7f31667fc640 1 -- 172.21.15.115:0/1202653292 --> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f315c03b270 con 0x7f315c03bfd0 2024-09-13T16:56:58.657 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:58.116+0000 7f3174bc9640 1 --2- 172.21.15.115:0/1202653292 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7f315c03bfd0 0x7f315c03e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:56:58.657 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:58.116+0000 7f3174bc9640 1 --2- 172.21.15.115:0/1202653292 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7f315c03bfd0 0x7f315c03e3c0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f316c003980 tx=0x7f316c0092b0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:56:58.657 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:58.117+0000 7f31667fc640 1 -- 172.21.15.115:0/1202653292 <== mgr.14116 v2:172.21.15.115:6800/2943337696 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+7774 (secure 0 0 0) 0x7f315c03b270 con 0x7f315c03bfd0 2024-09-13T16:56:58.657 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:58.122+0000 7f317762e640 1 -- 172.21.15.115:0/1202653292 --> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f31701062f0 con 0x7f315c03bfd0 2024-09-13T16:56:58.657 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:58.123+0000 7f31667fc640 1 -- 172.21.15.115:0/1202653292 <== mgr.14116 v2:172.21.15.115:6800/2943337696 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f316c003bd0 con 0x7f315c03bfd0 2024-09-13T16:56:58.658 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:58.123+0000 7f317762e640 1 -- 172.21.15.115:0/1202653292 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7f315c03bfd0 msgr2=0x7f315c03e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:56:58.658 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:58.123+0000 7f317762e640 1 --2- 172.21.15.115:0/1202653292 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7f315c03bfd0 0x7f315c03e3c0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f316c003980 tx=0x7f316c0092b0 comp rx=0 tx=0).stop 2024-09-13T16:56:58.658 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:58.123+0000 7f317762e640 1 -- 172.21.15.115:0/1202653292 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3170104300 msgr2=0x7f317018f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:56:58.658 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:58.123+0000 7f317762e640 1 --2- 172.21.15.115:0/1202653292 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3170104300 0x7f317018f450 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3160009940 tx=0x7f3160030cc0 comp rx=0 tx=0).stop 2024-09-13T16:56:58.658 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:58.123+0000 7f317762e640 1 -- 172.21.15.115:0/1202653292 shutdown_connections 2024-09-13T16:56:58.658 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:58.123+0000 7f317762e640 1 --2- 172.21.15.115:0/1202653292 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7f315c03bfd0 0x7f315c03e3c0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:58.658 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:58.123+0000 7f317762e640 1 --2- 172.21.15.115:0/1202653292 >> [v2:172.21.15.115:6800/1463863592,v1:172.21.15.115:6801/1463863592] conn(0x7f315c0386a0 0x7f315c03ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:58.658 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:58.123+0000 7f317762e640 1 --2- 172.21.15.115:0/1202653292 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3170104300 0x7f317018f450 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:58.658 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:58.123+0000 7f317762e640 1 -- 172.21.15.115:0/1202653292 >> 172.21.15.115:0/1202653292 conn(0x7f31700ffaf0 msgr2=0x7f3170100a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:56:58.658 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:58.123+0000 7f317762e640 1 -- 172.21.15.115:0/1202653292 shutdown_connections 2024-09-13T16:56:58.658 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:58.123+0000 7f317762e640 1 -- 172.21.15.115:0/1202653292 wait complete. 2024-09-13T16:56:58.658 INFO:teuthology.orchestra.run.smithi115.stdout:mgr epoch 5 is available 2024-09-13T16:56:58.658 INFO:teuthology.orchestra.run.smithi115.stdout:Setting orchestrator backend to cephadm... 2024-09-13T16:56:59.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:59 smithi115 ceph-mon[27708]: from='client.14120 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-13T16:56:59.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:59 smithi115 ceph-mon[27708]: from='client.14120 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-13T16:56:59.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:59 smithi115 ceph-mon[27708]: from='mgr.14116 172.21.15.115:0/1701263389' entity='mgr.smithi115.hetcni' 2024-09-13T16:56:59.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:56:59 smithi115 ceph-mon[27708]: from='mgr.14116 172.21.15.115:0/1701263389' entity='mgr.smithi115.hetcni' 2024-09-13T16:56:59.929 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:59.076+0000 7f2c37ad5640 1 Processor -- start 2024-09-13T16:56:59.929 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:59.076+0000 7f2c37ad5640 1 -- start start 2024-09-13T16:56:59.929 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:59.076+0000 7f2c37ad5640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c30105400 0x7f2c30105800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:56:59.929 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:59.077+0000 7f2c37ad5640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c30105dd0 con 0x7f2c30105400 2024-09-13T16:56:59.929 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:59.077+0000 7f2c35871640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c30105400 0x7f2c30105800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:56:59.929 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:59.077+0000 7f2c35871640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c30105400 0x7f2c30105800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60096/0 (socket says 172.21.15.115:60096) 2024-09-13T16:56:59.930 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:59.077+0000 7f2c35871640 1 -- 172.21.15.115:0/1750752476 learned_addr learned my addr 172.21.15.115:0/1750752476 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T16:56:59.930 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:59.077+0000 7f2c35871640 1 -- 172.21.15.115:0/1750752476 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c301065b0 con 0x7f2c30105400 2024-09-13T16:56:59.930 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:59.078+0000 7f2c35871640 1 --2- 172.21.15.115:0/1750752476 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c30105400 0x7f2c30105800 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c009820 tx=0x7f2c2c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50cf64effc9b56dd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:56:59.930 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:59.078+0000 7f2c3486f640 1 -- 172.21.15.115:0/1750752476 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2c2c02ad40 con 0x7f2c30105400 2024-09-13T16:56:59.930 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:59.078+0000 7f2c3486f640 1 -- 172.21.15.115:0/1750752476 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f2c2c032890 con 0x7f2c30105400 2024-09-13T16:56:59.930 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:59.078+0000 7f2c3486f640 1 -- 172.21.15.115:0/1750752476 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2c2c0307d0 con 0x7f2c30105400 2024-09-13T16:56:59.930 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:59.078+0000 7f2c37ad5640 1 -- 172.21.15.115:0/1750752476 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c30105400 msgr2=0x7f2c30105800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:56:59.930 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:59.078+0000 7f2c37ad5640 1 --2- 172.21.15.115:0/1750752476 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c30105400 0x7f2c30105800 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c009820 tx=0x7f2c2c02a270 comp rx=0 tx=0).stop 2024-09-13T16:56:59.930 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:59.078+0000 7f2c37ad5640 1 -- 172.21.15.115:0/1750752476 shutdown_connections 2024-09-13T16:56:59.930 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:59.078+0000 7f2c37ad5640 1 --2- 172.21.15.115:0/1750752476 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c30105400 0x7f2c30105800 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:59.930 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:59.078+0000 7f2c37ad5640 1 -- 172.21.15.115:0/1750752476 >> 172.21.15.115:0/1750752476 conn(0x7f2c30100bd0 msgr2=0x7f2c30102ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:56:59.930 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:59.079+0000 7f2c37ad5640 1 -- 172.21.15.115:0/1750752476 shutdown_connections 2024-09-13T16:56:59.930 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:59.079+0000 7f2c37ad5640 1 -- 172.21.15.115:0/1750752476 wait complete. 2024-09-13T16:56:59.930 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:59.079+0000 7f2c37ad5640 1 Processor -- start 2024-09-13T16:56:59.931 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:59.079+0000 7f2c37ad5640 1 -- start start 2024-09-13T16:56:59.931 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:59.079+0000 7f2c37ad5640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c30105400 0x7f2c30199160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:56:59.931 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:59.079+0000 7f2c37ad5640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c301996a0 con 0x7f2c30105400 2024-09-13T16:56:59.931 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:59.079+0000 7f2c35871640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c30105400 0x7f2c30199160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:56:59.931 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:59.079+0000 7f2c35871640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c30105400 0x7f2c30199160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60112/0 (socket says 172.21.15.115:60112) 2024-09-13T16:56:59.931 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:59.079+0000 7f2c35871640 1 -- 172.21.15.115:0/2481801672 learned_addr learned my addr 172.21.15.115:0/2481801672 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T16:56:59.931 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:59.080+0000 7f2c35871640 1 -- 172.21.15.115:0/2481801672 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c2c0094d0 con 0x7f2c30105400 2024-09-13T16:56:59.931 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:59.080+0000 7f2c35871640 1 --2- 172.21.15.115:0/2481801672 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c30105400 0x7f2c30199160 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c009940 tx=0x7f2c2c030cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:56:59.931 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:59.080+0000 7f2c22ffd640 1 -- 172.21.15.115:0/2481801672 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2c2c040070 con 0x7f2c30105400 2024-09-13T16:56:59.931 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:59.080+0000 7f2c22ffd640 1 -- 172.21.15.115:0/2481801672 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f2c2c032c10 con 0x7f2c30105400 2024-09-13T16:56:59.931 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:59.080+0000 7f2c37ad5640 1 -- 172.21.15.115:0/2481801672 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c301998a0 con 0x7f2c30105400 2024-09-13T16:56:59.931 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:59.080+0000 7f2c22ffd640 1 -- 172.21.15.115:0/2481801672 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2c2c03a560 con 0x7f2c30105400 2024-09-13T16:56:59.931 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:59.080+0000 7f2c37ad5640 1 -- 172.21.15.115:0/2481801672 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c30199d40 con 0x7f2c30105400 2024-09-13T16:56:59.932 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:59.081+0000 7f2c22ffd640 1 -- 172.21.15.115:0/2481801672 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 7) v1 ==== 45450+0+0 (secure 0 0 0) 0x7f2c2c03a790 con 0x7f2c30105400 2024-09-13T16:56:59.932 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:59.081+0000 7f2c22ffd640 1 --2- 172.21.15.115:0/2481801672 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7f2c1c038530 0x7f2c1c03a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:56:59.932 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:59.081+0000 7f2c37ad5640 1 -- 172.21.15.115:0/2481801672 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c301097e0 con 0x7f2c30105400 2024-09-13T16:56:59.932 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:59.081+0000 7f2c22ffd640 1 -- 172.21.15.115:0/2481801672 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f2c2c06b300 con 0x7f2c30105400 2024-09-13T16:56:59.932 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:59.081+0000 7f2c35070640 1 --2- 172.21.15.115:0/2481801672 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7f2c1c038530 0x7f2c1c03a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:56:59.932 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:59.082+0000 7f2c35070640 1 --2- 172.21.15.115:0/2481801672 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7f2c1c038530 0x7f2c1c03a9f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2c240098c0 tx=0x7f2c24006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:56:59.932 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:59.086+0000 7f2c22ffd640 1 -- 172.21.15.115:0/2481801672 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f2c2c045410 con 0x7f2c30105400 2024-09-13T16:56:59.932 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:59.266+0000 7f2c37ad5640 1 -- 172.21.15.115:0/2481801672 --> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f2c30101f20 con 0x7f2c1c038530 2024-09-13T16:56:59.932 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:59.275+0000 7f2c22ffd640 1 -- 172.21.15.115:0/2481801672 <== mgr.14116 v2:172.21.15.115:6800/2943337696 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f2c30101f20 con 0x7f2c1c038530 2024-09-13T16:56:59.932 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:59.277+0000 7f2c37ad5640 1 -- 172.21.15.115:0/2481801672 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7f2c1c038530 msgr2=0x7f2c1c03a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:56:59.932 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:59.277+0000 7f2c37ad5640 1 --2- 172.21.15.115:0/2481801672 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7f2c1c038530 0x7f2c1c03a9f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2c240098c0 tx=0x7f2c24006db0 comp rx=0 tx=0).stop 2024-09-13T16:56:59.932 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:59.277+0000 7f2c37ad5640 1 -- 172.21.15.115:0/2481801672 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c30105400 msgr2=0x7f2c30199160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:56:59.933 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:59.277+0000 7f2c37ad5640 1 --2- 172.21.15.115:0/2481801672 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c30105400 0x7f2c30199160 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c009940 tx=0x7f2c2c030cc0 comp rx=0 tx=0).stop 2024-09-13T16:56:59.933 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:59.277+0000 7f2c37ad5640 1 -- 172.21.15.115:0/2481801672 shutdown_connections 2024-09-13T16:56:59.933 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:59.277+0000 7f2c37ad5640 1 --2- 172.21.15.115:0/2481801672 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7f2c1c038530 0x7f2c1c03a9f0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:59.933 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:59.277+0000 7f2c37ad5640 1 --2- 172.21.15.115:0/2481801672 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c30105400 0x7f2c30199160 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:56:59.933 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:59.277+0000 7f2c37ad5640 1 -- 172.21.15.115:0/2481801672 >> 172.21.15.115:0/2481801672 conn(0x7f2c30100bd0 msgr2=0x7f2c30101810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:56:59.933 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:59.277+0000 7f2c37ad5640 1 -- 172.21.15.115:0/2481801672 shutdown_connections 2024-09-13T16:56:59.933 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:56:59.277+0000 7f2c37ad5640 1 -- 172.21.15.115:0/2481801672 wait complete. 2024-09-13T16:57:00.467 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:00 smithi115 ceph-mon[27708]: from='client.14128 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:57:00.467 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:00 smithi115 ceph-mon[27708]: from='mgr.14116 172.21.15.115:0/1701263389' entity='mgr.smithi115.hetcni' 2024-09-13T16:57:00.467 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:00 smithi115 ceph-mon[27708]: from='mgr.14116 172.21.15.115:0/1701263389' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:57:00.467 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:00 smithi115 ceph-mon[27708]: mgrmap e8: smithi115.hetcni(active, since 2s) 2024-09-13T16:57:00.467 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:00 smithi115 ceph-mon[27708]: from='mgr.14116 172.21.15.115:0/1701263389' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:57:01.093 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-13T16:57:01.093 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:00.294+0000 7f3e3b93b640 1 Processor -- start 2024-09-13T16:57:01.094 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:00.294+0000 7f3e3b93b640 1 -- start start 2024-09-13T16:57:01.094 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:00.294+0000 7f3e3b93b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e341053e0 0x7f3e341057e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:01.094 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:00.294+0000 7f3e3b93b640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e34105db0 con 0x7f3e341053e0 2024-09-13T16:57:01.094 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:00.294+0000 7f3e396d7640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e341053e0 0x7f3e341057e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:01.094 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:00.294+0000 7f3e396d7640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e341053e0 0x7f3e341057e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60114/0 (socket says 172.21.15.115:60114) 2024-09-13T16:57:01.094 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:00.294+0000 7f3e396d7640 1 -- 172.21.15.115:0/2285815596 learned_addr learned my addr 172.21.15.115:0/2285815596 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T16:57:01.094 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:00.294+0000 7f3e396d7640 1 -- 172.21.15.115:0/2285815596 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e34106590 con 0x7f3e341053e0 2024-09-13T16:57:01.094 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:00.295+0000 7f3e396d7640 1 --2- 172.21.15.115:0/2285815596 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e341053e0 0x7f3e341057e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f3e24009820 tx=0x7f3e2402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15e0a7eb48de64ab server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:01.094 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:00.295+0000 7f3e2bfff640 1 -- 172.21.15.115:0/2285815596 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3e2402ad40 con 0x7f3e341053e0 2024-09-13T16:57:01.094 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:00.295+0000 7f3e2bfff640 1 -- 172.21.15.115:0/2285815596 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f3e24032890 con 0x7f3e341053e0 2024-09-13T16:57:01.094 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:00.295+0000 7f3e2bfff640 1 -- 172.21.15.115:0/2285815596 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3e240307d0 con 0x7f3e341053e0 2024-09-13T16:57:01.095 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:00.296+0000 7f3e3b93b640 1 -- 172.21.15.115:0/2285815596 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e341053e0 msgr2=0x7f3e341057e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:01.095 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:00.296+0000 7f3e3b93b640 1 --2- 172.21.15.115:0/2285815596 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e341053e0 0x7f3e341057e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f3e24009820 tx=0x7f3e2402a270 comp rx=0 tx=0).stop 2024-09-13T16:57:01.095 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:00.296+0000 7f3e3b93b640 1 -- 172.21.15.115:0/2285815596 shutdown_connections 2024-09-13T16:57:01.095 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:00.296+0000 7f3e3b93b640 1 --2- 172.21.15.115:0/2285815596 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e341053e0 0x7f3e341057e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:01.095 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:00.296+0000 7f3e3b93b640 1 -- 172.21.15.115:0/2285815596 >> 172.21.15.115:0/2285815596 conn(0x7f3e34100bd0 msgr2=0x7f3e34102ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:57:01.095 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:00.296+0000 7f3e3b93b640 1 -- 172.21.15.115:0/2285815596 shutdown_connections 2024-09-13T16:57:01.095 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:00.296+0000 7f3e3b93b640 1 -- 172.21.15.115:0/2285815596 wait complete. 2024-09-13T16:57:01.095 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:00.296+0000 7f3e3b93b640 1 Processor -- start 2024-09-13T16:57:01.095 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:00.297+0000 7f3e3b93b640 1 -- start start 2024-09-13T16:57:01.095 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:00.297+0000 7f3e3b93b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e341053e0 0x7f3e34199170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:01.095 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:00.297+0000 7f3e3b93b640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e341996b0 con 0x7f3e341053e0 2024-09-13T16:57:01.096 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:00.297+0000 7f3e396d7640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e341053e0 0x7f3e34199170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:01.096 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:00.297+0000 7f3e396d7640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e341053e0 0x7f3e34199170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60126/0 (socket says 172.21.15.115:60126) 2024-09-13T16:57:01.096 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:00.297+0000 7f3e396d7640 1 -- 172.21.15.115:0/1346893022 learned_addr learned my addr 172.21.15.115:0/1346893022 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T16:57:01.096 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:00.297+0000 7f3e396d7640 1 -- 172.21.15.115:0/1346893022 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e240094d0 con 0x7f3e341053e0 2024-09-13T16:57:01.096 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:00.297+0000 7f3e396d7640 1 --2- 172.21.15.115:0/1346893022 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e341053e0 0x7f3e34199170 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3e240304c0 tx=0x7f3e24030d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:01.096 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:00.297+0000 7f3e2a7fc640 1 -- 172.21.15.115:0/1346893022 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3e24032c10 con 0x7f3e341053e0 2024-09-13T16:57:01.096 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:00.297+0000 7f3e2a7fc640 1 -- 172.21.15.115:0/1346893022 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f3e24032d70 con 0x7f3e341053e0 2024-09-13T16:57:01.096 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:00.297+0000 7f3e3b93b640 1 -- 172.21.15.115:0/1346893022 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e341998b0 con 0x7f3e341053e0 2024-09-13T16:57:01.096 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:00.297+0000 7f3e2a7fc640 1 -- 172.21.15.115:0/1346893022 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3e2403a560 con 0x7f3e341053e0 2024-09-13T16:57:01.096 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:00.297+0000 7f3e3b93b640 1 -- 172.21.15.115:0/1346893022 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e34199d50 con 0x7f3e341053e0 2024-09-13T16:57:01.096 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:00.298+0000 7f3e2a7fc640 1 -- 172.21.15.115:0/1346893022 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f3e2403a6c0 con 0x7f3e341053e0 2024-09-13T16:57:01.096 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:00.298+0000 7f3e3b93b640 1 -- 172.21.15.115:0/1346893022 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e341097c0 con 0x7f3e341053e0 2024-09-13T16:57:01.096 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:00.298+0000 7f3e2a7fc640 1 --2- 172.21.15.115:0/1346893022 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7f3e200386a0 0x7f3e2003ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:01.097 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:00.298+0000 7f3e2a7fc640 1 -- 172.21.15.115:0/1346893022 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f3e2406b920 con 0x7f3e341053e0 2024-09-13T16:57:01.097 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:00.299+0000 7f3e38ed6640 1 --2- 172.21.15.115:0/1346893022 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7f3e200386a0 0x7f3e2003ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:01.097 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:00.299+0000 7f3e38ed6640 1 --2- 172.21.15.115:0/1346893022 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7f3e200386a0 0x7f3e2003ab60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3e300098c0 tx=0x7f3e30006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:01.097 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:00.303+0000 7f3e2a7fc640 1 -- 172.21.15.115:0/1346893022 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f3e240394f0 con 0x7f3e341053e0 2024-09-13T16:57:01.097 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:00.465+0000 7f3e3b93b640 1 -- 172.21.15.115:0/1346893022 --> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7f3e34101f40 con 0x7f3e200386a0 2024-09-13T16:57:01.097 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:00.466+0000 7f3e2a7fc640 1 -- 172.21.15.115:0/1346893022 <== mgr.14116 v2:172.21.15.115:6800/2943337696 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7f3e34101f40 con 0x7f3e200386a0 2024-09-13T16:57:01.097 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:00.468+0000 7f3e3b93b640 1 -- 172.21.15.115:0/1346893022 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7f3e200386a0 msgr2=0x7f3e2003ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:01.097 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:00.468+0000 7f3e3b93b640 1 --2- 172.21.15.115:0/1346893022 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7f3e200386a0 0x7f3e2003ab60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3e300098c0 tx=0x7f3e30006db0 comp rx=0 tx=0).stop 2024-09-13T16:57:01.097 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:00.468+0000 7f3e3b93b640 1 -- 172.21.15.115:0/1346893022 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e341053e0 msgr2=0x7f3e34199170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:01.097 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:00.468+0000 7f3e3b93b640 1 --2- 172.21.15.115:0/1346893022 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e341053e0 0x7f3e34199170 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3e240304c0 tx=0x7f3e24030d10 comp rx=0 tx=0).stop 2024-09-13T16:57:01.098 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:00.468+0000 7f3e3b93b640 1 -- 172.21.15.115:0/1346893022 shutdown_connections 2024-09-13T16:57:01.098 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:00.468+0000 7f3e3b93b640 1 --2- 172.21.15.115:0/1346893022 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7f3e200386a0 0x7f3e2003ab60 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:01.098 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:00.468+0000 7f3e3b93b640 1 --2- 172.21.15.115:0/1346893022 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e341053e0 0x7f3e34199170 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:01.098 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:00.468+0000 7f3e3b93b640 1 -- 172.21.15.115:0/1346893022 >> 172.21.15.115:0/1346893022 conn(0x7f3e34100bd0 msgr2=0x7f3e34101830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:57:01.098 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:00.468+0000 7f3e3b93b640 1 -- 172.21.15.115:0/1346893022 shutdown_connections 2024-09-13T16:57:01.098 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:00.468+0000 7f3e3b93b640 1 -- 172.21.15.115:0/1346893022 wait complete. 2024-09-13T16:57:01.098 INFO:teuthology.orchestra.run.smithi115.stdout:Generating ssh key... 2024-09-13T16:57:01.413 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:01 smithi115 ceph-mon[27708]: [13/Sep/2024:16:56:59] ENGINE Bus STARTING 2024-09-13T16:57:01.413 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:01 smithi115 ceph-mon[27708]: [13/Sep/2024:16:56:59] ENGINE Serving on http://172.21.15.115:8765 2024-09-13T16:57:01.413 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:01 smithi115 ceph-mon[27708]: [13/Sep/2024:16:56:59] ENGINE Serving on https://172.21.15.115:7150 2024-09-13T16:57:01.413 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:01 smithi115 ceph-mon[27708]: [13/Sep/2024:16:56:59] ENGINE Bus STARTED 2024-09-13T16:57:01.413 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:01 smithi115 ceph-mon[27708]: [13/Sep/2024:16:56:59] ENGINE Error in HTTPServer.serve 2024-09-13T16:57:01.413 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Traceback (most recent call last): 2024-09-13T16:57:01.413 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T16:57:01.413 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: self._connections.run(self.expiration_interval) 2024-09-13T16:57:01.414 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T16:57:01.414 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: self._run(expiration_interval) 2024-09-13T16:57:01.414 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T16:57:01.414 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T16:57:01.414 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T16:57:01.414 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T16:57:01.414 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T16:57:01.414 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: s = self.context.wrap_socket( 2024-09-13T16:57:01.414 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T16:57:01.414 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: return self.sslsocket_class._create( 2024-09-13T16:57:01.414 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T16:57:01.414 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: self.do_handshake() 2024-09-13T16:57:01.415 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T16:57:01.415 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: self._sslobj.do_handshake() 2024-09-13T16:57:01.415 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T16:57:02.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:02 smithi115 ceph-mon[27708]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:57:02.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:02 smithi115 ceph-mon[27708]: from='mgr.14116 172.21.15.115:0/1701263389' entity='mgr.smithi115.hetcni' 2024-09-13T16:57:02.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:02 smithi115 ceph-mon[27708]: from='mgr.14116 172.21.15.115:0/1701263389' entity='mgr.smithi115.hetcni' 2024-09-13T16:57:02.457 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:01.488+0000 7f6fc660f640 1 Processor -- start 2024-09-13T16:57:02.457 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:01.488+0000 7f6fc660f640 1 -- start start 2024-09-13T16:57:02.457 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:01.488+0000 7f6fc660f640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6fc007ae60 0x7f6fc0079310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:02.458 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:01.488+0000 7f6fc660f640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc0079850 con 0x7f6fc007ae60 2024-09-13T16:57:02.458 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:01.488+0000 7f6fbffff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6fc007ae60 0x7f6fc0079310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:02.458 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:01.488+0000 7f6fbffff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6fc007ae60 0x7f6fc0079310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60132/0 (socket says 172.21.15.115:60132) 2024-09-13T16:57:02.458 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:01.488+0000 7f6fbffff640 1 -- 172.21.15.115:0/2057317636 learned_addr learned my addr 172.21.15.115:0/2057317636 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T16:57:02.458 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:01.488+0000 7f6fbffff640 1 -- 172.21.15.115:0/2057317636 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fc0079990 con 0x7f6fc007ae60 2024-09-13T16:57:02.458 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:01.489+0000 7f6fbffff640 1 --2- 172.21.15.115:0/2057317636 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6fc007ae60 0x7f6fc0079310 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6fb0009820 tx=0x7f6fb002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8840760c5f33d70 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:02.458 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:01.489+0000 7f6fbf7fe640 1 -- 172.21.15.115:0/2057317636 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6fb002add0 con 0x7f6fc007ae60 2024-09-13T16:57:02.458 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:01.489+0000 7f6fbf7fe640 1 -- 172.21.15.115:0/2057317636 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f6fb0032890 con 0x7f6fc007ae60 2024-09-13T16:57:02.458 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:01.489+0000 7f6fbf7fe640 1 -- 172.21.15.115:0/2057317636 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6fb0030860 con 0x7f6fc007ae60 2024-09-13T16:57:02.458 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:01.490+0000 7f6fc660f640 1 -- 172.21.15.115:0/2057317636 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6fc007ae60 msgr2=0x7f6fc0079310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:02.458 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:01.490+0000 7f6fc660f640 1 --2- 172.21.15.115:0/2057317636 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6fc007ae60 0x7f6fc0079310 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6fb0009820 tx=0x7f6fb002a300 comp rx=0 tx=0).stop 2024-09-13T16:57:02.458 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:01.490+0000 7f6fc660f640 1 -- 172.21.15.115:0/2057317636 shutdown_connections 2024-09-13T16:57:02.458 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:01.490+0000 7f6fc660f640 1 --2- 172.21.15.115:0/2057317636 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6fc007ae60 0x7f6fc0079310 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:02.459 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:01.490+0000 7f6fc660f640 1 -- 172.21.15.115:0/2057317636 >> 172.21.15.115:0/2057317636 conn(0x7f6fc0100c30 msgr2=0x7f6fc0103050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:57:02.459 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:01.490+0000 7f6fc660f640 1 -- 172.21.15.115:0/2057317636 shutdown_connections 2024-09-13T16:57:02.459 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:01.490+0000 7f6fc660f640 1 -- 172.21.15.115:0/2057317636 wait complete. 2024-09-13T16:57:02.459 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:01.490+0000 7f6fc660f640 1 Processor -- start 2024-09-13T16:57:02.459 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:01.491+0000 7f6fc660f640 1 -- start start 2024-09-13T16:57:02.459 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:01.491+0000 7f6fc660f640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6fc007ae60 0x7f6fc019b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:02.459 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:01.491+0000 7f6fc660f640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc019b840 con 0x7f6fc007ae60 2024-09-13T16:57:02.459 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:01.491+0000 7f6fbffff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6fc007ae60 0x7f6fc019b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:02.459 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:01.491+0000 7f6fbffff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6fc007ae60 0x7f6fc019b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60136/0 (socket says 172.21.15.115:60136) 2024-09-13T16:57:02.459 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:01.491+0000 7f6fbffff640 1 -- 172.21.15.115:0/1971533517 learned_addr learned my addr 172.21.15.115:0/1971533517 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T16:57:02.459 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:01.491+0000 7f6fbffff640 1 -- 172.21.15.115:0/1971533517 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fb00094d0 con 0x7f6fc007ae60 2024-09-13T16:57:02.459 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:01.491+0000 7f6fbffff640 1 --2- 172.21.15.115:0/1971533517 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6fc007ae60 0x7f6fc019b300 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6fb0009940 tx=0x7f6fb0030860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:02.459 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:01.491+0000 7f6fbdffb640 1 -- 172.21.15.115:0/1971533517 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6fb003f070 con 0x7f6fc007ae60 2024-09-13T16:57:02.459 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:01.491+0000 7f6fbdffb640 1 -- 172.21.15.115:0/1971533517 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f6fb0030d50 con 0x7f6fc007ae60 2024-09-13T16:57:02.460 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:01.491+0000 7f6fc660f640 1 -- 172.21.15.115:0/1971533517 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fc019ba40 con 0x7f6fc007ae60 2024-09-13T16:57:02.460 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:01.491+0000 7f6fbdffb640 1 -- 172.21.15.115:0/1971533517 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6fb003a6a0 con 0x7f6fc007ae60 2024-09-13T16:57:02.460 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:01.491+0000 7f6fc660f640 1 -- 172.21.15.115:0/1971533517 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fc019bee0 con 0x7f6fc007ae60 2024-09-13T16:57:02.460 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:01.492+0000 7f6fbdffb640 1 -- 172.21.15.115:0/1971533517 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f6fb003b470 con 0x7f6fc007ae60 2024-09-13T16:57:02.460 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:01.493+0000 7f6fc660f640 1 -- 172.21.15.115:0/1971533517 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fc010b6a0 con 0x7f6fc007ae60 2024-09-13T16:57:02.460 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:01.493+0000 7f6fbdffb640 1 --2- 172.21.15.115:0/1971533517 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7f6fac0386a0 0x7f6fac03ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:02.460 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:01.493+0000 7f6fbdffb640 1 -- 172.21.15.115:0/1971533517 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f6fb006b430 con 0x7f6fc007ae60 2024-09-13T16:57:02.460 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:01.493+0000 7f6fb7fff640 1 --2- 172.21.15.115:0/1971533517 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7f6fac0386a0 0x7f6fac03ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:02.460 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:01.493+0000 7f6fb7fff640 1 --2- 172.21.15.115:0/1971533517 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7f6fac0386a0 0x7f6fac03ab60 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6fa80098c0 tx=0x7f6fa8006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:02.460 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:01.497+0000 7f6fbdffb640 1 -- 172.21.15.115:0/1971533517 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f6fb003a800 con 0x7f6fc007ae60 2024-09-13T16:57:02.460 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:01.660+0000 7f6fc660f640 1 -- 172.21.15.115:0/1971533517 --> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f6fc0102030 con 0x7f6fac0386a0 2024-09-13T16:57:02.460 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:01.847+0000 7f6fbdffb640 1 -- 172.21.15.115:0/1971533517 <== mgr.14116 v2:172.21.15.115:6800/2943337696 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f6fc0102030 con 0x7f6fac0386a0 2024-09-13T16:57:02.461 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:01.849+0000 7f6fc660f640 1 -- 172.21.15.115:0/1971533517 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7f6fac0386a0 msgr2=0x7f6fac03ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:02.461 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:01.849+0000 7f6fc660f640 1 --2- 172.21.15.115:0/1971533517 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7f6fac0386a0 0x7f6fac03ab60 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6fa80098c0 tx=0x7f6fa8006db0 comp rx=0 tx=0).stop 2024-09-13T16:57:02.461 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:01.850+0000 7f6fc660f640 1 -- 172.21.15.115:0/1971533517 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6fc007ae60 msgr2=0x7f6fc019b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:02.461 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:01.850+0000 7f6fc660f640 1 --2- 172.21.15.115:0/1971533517 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6fc007ae60 0x7f6fc019b300 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6fb0009940 tx=0x7f6fb0030860 comp rx=0 tx=0).stop 2024-09-13T16:57:02.461 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:01.850+0000 7f6fc660f640 1 -- 172.21.15.115:0/1971533517 shutdown_connections 2024-09-13T16:57:02.461 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:01.850+0000 7f6fc660f640 1 --2- 172.21.15.115:0/1971533517 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7f6fac0386a0 0x7f6fac03ab60 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:02.461 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:01.850+0000 7f6fc660f640 1 --2- 172.21.15.115:0/1971533517 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6fc007ae60 0x7f6fc019b300 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:02.461 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:01.850+0000 7f6fc660f640 1 -- 172.21.15.115:0/1971533517 >> 172.21.15.115:0/1971533517 conn(0x7f6fc0100c30 msgr2=0x7f6fc0101920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:57:02.461 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:01.850+0000 7f6fc660f640 1 -- 172.21.15.115:0/1971533517 shutdown_connections 2024-09-13T16:57:02.461 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:01.850+0000 7f6fc660f640 1 -- 172.21.15.115:0/1971533517 wait complete. 2024-09-13T16:57:03.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:03 smithi115 ceph-mon[27708]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:57:03.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:03 smithi115 ceph-mon[27708]: Generating ssh key... 2024-09-13T16:57:03.630 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDL5xgg/ILTITZ3RzY9QT6D5tlO1es36uN8EblRcn4ua7OuEGS3ODgx1yiyhiC3LkDnJQQf+IGO26zPr4Nbg9ySbjnJtXlfVMRTw8Gs5jHNLoSKrS53sHBIrfyO2PRZywvMqD85ZQgiG+uuOub8ByjX0oUkbwmis1+BdSKGHpZHxPafP8dj650BbPjYIYXbf1u1sj3UY8PyGdnxUhRgaF1sj6GPWjG44NY/Ov+ogHePP59wel7Ljf5EM8py4zbgWIDu5/p5XEswd7I3JdJjgfWWWMt3leJ13+2aT0gQpBx6+Asx8Y8Wk0Yt8N4U11hQ8FB0cav3KV+sVNnfJsvw1cKwdFlmLjOHMcco5ZcdLtdmdPSNXI94tb+r+IltCqY2R8K6yVLLZN6rGsU3U0HHZBpOeNYC3M+66hMDRKFY9e6hmPlNphtDO8obs4yn+B7qhd7rhutBQBXHkFn7qlPYrm03ii9XP6URUjwV/YSOw/kfTYtUY95tQlRvwKrme1yVdZs= ceph-ffbd7588-71f0-11ef-bceb-c7b262605968 2024-09-13T16:57:03.630 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:02.865+0000 7f5b7ed14640 1 Processor -- start 2024-09-13T16:57:03.630 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:02.865+0000 7f5b7ed14640 1 -- start start 2024-09-13T16:57:03.630 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:02.866+0000 7f5b7ed14640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b78104300 0x7f5b78104700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:03.630 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:02.866+0000 7f5b7ed14640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b78104cd0 con 0x7f5b78104300 2024-09-13T16:57:03.630 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:02.866+0000 7f5b7cab0640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b78104300 0x7f5b78104700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:03.630 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:02.866+0000 7f5b7cab0640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b78104300 0x7f5b78104700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60138/0 (socket says 172.21.15.115:60138) 2024-09-13T16:57:03.630 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:02.866+0000 7f5b7cab0640 1 -- 172.21.15.115:0/1390973224 learned_addr learned my addr 172.21.15.115:0/1390973224 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T16:57:03.630 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:02.866+0000 7f5b7cab0640 1 -- 172.21.15.115:0/1390973224 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b78105500 con 0x7f5b78104300 2024-09-13T16:57:03.630 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:02.867+0000 7f5b7cab0640 1 --2- 172.21.15.115:0/1390973224 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b78104300 0x7f5b78104700 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5b60009e80 tx=0x7f5b6002a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dfecc0b2e114ea8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:03.631 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:02.867+0000 7f5b777fe640 1 -- 172.21.15.115:0/1390973224 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5b60031400 con 0x7f5b78104300 2024-09-13T16:57:03.631 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:02.867+0000 7f5b777fe640 1 -- 172.21.15.115:0/1390973224 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f5b6002d050 con 0x7f5b78104300 2024-09-13T16:57:03.631 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:02.867+0000 7f5b777fe640 1 -- 172.21.15.115:0/1390973224 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5b600077a0 con 0x7f5b78104300 2024-09-13T16:57:03.631 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:02.868+0000 7f5b7ed14640 1 -- 172.21.15.115:0/1390973224 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b78104300 msgr2=0x7f5b78104700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:03.631 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:02.868+0000 7f5b7ed14640 1 --2- 172.21.15.115:0/1390973224 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b78104300 0x7f5b78104700 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5b60009e80 tx=0x7f5b6002a7a0 comp rx=0 tx=0).stop 2024-09-13T16:57:03.631 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:02.868+0000 7f5b7ed14640 1 -- 172.21.15.115:0/1390973224 shutdown_connections 2024-09-13T16:57:03.631 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:02.868+0000 7f5b7ed14640 1 --2- 172.21.15.115:0/1390973224 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b78104300 0x7f5b78104700 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:03.631 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:02.868+0000 7f5b7ed14640 1 -- 172.21.15.115:0/1390973224 >> 172.21.15.115:0/1390973224 conn(0x7f5b780ffaf0 msgr2=0x7f5b78101f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:57:03.631 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:02.868+0000 7f5b7ed14640 1 -- 172.21.15.115:0/1390973224 shutdown_connections 2024-09-13T16:57:03.631 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:02.868+0000 7f5b7ed14640 1 -- 172.21.15.115:0/1390973224 wait complete. 2024-09-13T16:57:03.631 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:02.868+0000 7f5b7ed14640 1 Processor -- start 2024-09-13T16:57:03.631 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:02.868+0000 7f5b7ed14640 1 -- start start 2024-09-13T16:57:03.631 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:02.868+0000 7f5b7ed14640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b78104300 0x7f5b78199200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:03.632 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:02.868+0000 7f5b7ed14640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b78199740 con 0x7f5b78104300 2024-09-13T16:57:03.632 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:02.868+0000 7f5b7cab0640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b78104300 0x7f5b78199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:03.632 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:02.868+0000 7f5b7cab0640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b78104300 0x7f5b78199200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60148/0 (socket says 172.21.15.115:60148) 2024-09-13T16:57:03.632 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:02.868+0000 7f5b7cab0640 1 -- 172.21.15.115:0/1661133549 learned_addr learned my addr 172.21.15.115:0/1661133549 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T16:57:03.632 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:02.869+0000 7f5b7cab0640 1 -- 172.21.15.115:0/1661133549 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b60009b30 con 0x7f5b78104300 2024-09-13T16:57:03.632 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:02.869+0000 7f5b7cab0640 1 --2- 172.21.15.115:0/1661133549 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b78104300 0x7f5b78199200 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5b6002acc0 tx=0x7f5b60031630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:03.632 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:02.869+0000 7f5b75ffb640 1 -- 172.21.15.115:0/1661133549 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5b60031a80 con 0x7f5b78104300 2024-09-13T16:57:03.632 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:02.869+0000 7f5b75ffb640 1 -- 172.21.15.115:0/1661133549 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f5b60031be0 con 0x7f5b78104300 2024-09-13T16:57:03.632 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:02.869+0000 7f5b7ed14640 1 -- 172.21.15.115:0/1661133549 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b78199940 con 0x7f5b78104300 2024-09-13T16:57:03.632 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:02.869+0000 7f5b75ffb640 1 -- 172.21.15.115:0/1661133549 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5b600394d0 con 0x7f5b78104300 2024-09-13T16:57:03.632 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:02.869+0000 7f5b7ed14640 1 -- 172.21.15.115:0/1661133549 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b78199de0 con 0x7f5b78104300 2024-09-13T16:57:03.632 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:02.870+0000 7f5b75ffb640 1 -- 172.21.15.115:0/1661133549 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f5b60038040 con 0x7f5b78104300 2024-09-13T16:57:03.632 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:02.870+0000 7f5b7ed14640 1 -- 172.21.15.115:0/1661133549 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b781932f0 con 0x7f5b78104300 2024-09-13T16:57:03.633 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:02.870+0000 7f5b75ffb640 1 --2- 172.21.15.115:0/1661133549 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7f5b640386a0 0x7f5b6403ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:03.633 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:02.870+0000 7f5b75ffb640 1 -- 172.21.15.115:0/1661133549 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f5b6006b520 con 0x7f5b78104300 2024-09-13T16:57:03.633 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:02.870+0000 7f5b77fff640 1 --2- 172.21.15.115:0/1661133549 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7f5b640386a0 0x7f5b6403ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:03.633 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:02.871+0000 7f5b77fff640 1 --2- 172.21.15.115:0/1661133549 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7f5b640386a0 0x7f5b6403ab60 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5b680098c0 tx=0x7f5b68006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:03.633 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:02.875+0000 7f5b75ffb640 1 -- 172.21.15.115:0/1661133549 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f5b60044360 con 0x7f5b78104300 2024-09-13T16:57:03.633 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:03.036+0000 7f5b7ed14640 1 -- 172.21.15.115:0/1661133549 --> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f5b7802c5d0 con 0x7f5b640386a0 2024-09-13T16:57:03.633 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:03.037+0000 7f5b75ffb640 1 -- 172.21.15.115:0/1661133549 <== mgr.14116 v2:172.21.15.115:6800/2943337696 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7f5b7802c5d0 con 0x7f5b640386a0 2024-09-13T16:57:03.633 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:03.039+0000 7f5b7ed14640 1 -- 172.21.15.115:0/1661133549 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7f5b640386a0 msgr2=0x7f5b6403ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:03.633 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:03.039+0000 7f5b7ed14640 1 --2- 172.21.15.115:0/1661133549 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7f5b640386a0 0x7f5b6403ab60 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5b680098c0 tx=0x7f5b68006db0 comp rx=0 tx=0).stop 2024-09-13T16:57:03.633 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:03.039+0000 7f5b7ed14640 1 -- 172.21.15.115:0/1661133549 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b78104300 msgr2=0x7f5b78199200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:03.633 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:03.039+0000 7f5b7ed14640 1 --2- 172.21.15.115:0/1661133549 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b78104300 0x7f5b78199200 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5b6002acc0 tx=0x7f5b60031630 comp rx=0 tx=0).stop 2024-09-13T16:57:03.633 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:03.039+0000 7f5b7ed14640 1 -- 172.21.15.115:0/1661133549 shutdown_connections 2024-09-13T16:57:03.633 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:03.039+0000 7f5b7ed14640 1 --2- 172.21.15.115:0/1661133549 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7f5b640386a0 0x7f5b6403ab60 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:03.633 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:03.039+0000 7f5b7ed14640 1 --2- 172.21.15.115:0/1661133549 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b78104300 0x7f5b78199200 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:03.634 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:03.039+0000 7f5b7ed14640 1 -- 172.21.15.115:0/1661133549 >> 172.21.15.115:0/1661133549 conn(0x7f5b780ffaf0 msgr2=0x7f5b78100a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:57:03.634 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:03.039+0000 7f5b7ed14640 1 -- 172.21.15.115:0/1661133549 shutdown_connections 2024-09-13T16:57:03.634 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:03.039+0000 7f5b7ed14640 1 -- 172.21.15.115:0/1661133549 wait complete. 2024-09-13T16:57:03.634 INFO:teuthology.orchestra.run.smithi115.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-13T16:57:03.634 INFO:teuthology.orchestra.run.smithi115.stdout:Adding key to root@localhost authorized_keys... 2024-09-13T16:57:03.634 INFO:teuthology.orchestra.run.smithi115.stdout:Adding host smithi115... 2024-09-13T16:57:04.407 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:04 smithi115 ceph-mon[27708]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:57:05.629 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:05 smithi115 ceph-mon[27708]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi115", "addr": "172.21.15.115", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:57:06.535 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:06 smithi115 ceph-mon[27708]: Deploying cephadm binary to smithi115 2024-09-13T16:57:07.312 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout Added host 'smithi115' with addr '172.21.15.115' 2024-09-13T16:57:07.312 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:03.978+0000 7fbefeea9640 1 Processor -- start 2024-09-13T16:57:07.312 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:03.978+0000 7fbefeea9640 1 -- start start 2024-09-13T16:57:07.312 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:03.978+0000 7fbefeea9640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbef8105400 0x7fbef8105800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:07.312 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:03.978+0000 7fbefeea9640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbef8105dd0 con 0x7fbef8105400 2024-09-13T16:57:07.312 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:03.978+0000 7fbefcc45640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbef8105400 0x7fbef8105800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:07.312 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:03.979+0000 7fbefcc45640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbef8105400 0x7fbef8105800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60152/0 (socket says 172.21.15.115:60152) 2024-09-13T16:57:07.312 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:03.979+0000 7fbefcc45640 1 -- 172.21.15.115:0/1417705324 learned_addr learned my addr 172.21.15.115:0/1417705324 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T16:57:07.313 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:03.979+0000 7fbefcc45640 1 -- 172.21.15.115:0/1417705324 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbef81065b0 con 0x7fbef8105400 2024-09-13T16:57:07.313 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:03.979+0000 7fbefcc45640 1 --2- 172.21.15.115:0/1417705324 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbef8105400 0x7fbef8105800 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fbef0009820 tx=0x7fbef002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38153bef13cf5ce9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:07.313 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:03.980+0000 7fbef77fe640 1 -- 172.21.15.115:0/1417705324 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbef002ad40 con 0x7fbef8105400 2024-09-13T16:57:07.313 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:03.980+0000 7fbef77fe640 1 -- 172.21.15.115:0/1417705324 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7fbef0032890 con 0x7fbef8105400 2024-09-13T16:57:07.313 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:03.980+0000 7fbef77fe640 1 -- 172.21.15.115:0/1417705324 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbef00307d0 con 0x7fbef8105400 2024-09-13T16:57:07.313 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:03.980+0000 7fbefeea9640 1 -- 172.21.15.115:0/1417705324 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbef8105400 msgr2=0x7fbef8105800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:07.313 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:03.980+0000 7fbefeea9640 1 --2- 172.21.15.115:0/1417705324 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbef8105400 0x7fbef8105800 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fbef0009820 tx=0x7fbef002a270 comp rx=0 tx=0).stop 2024-09-13T16:57:07.313 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:03.980+0000 7fbefeea9640 1 -- 172.21.15.115:0/1417705324 shutdown_connections 2024-09-13T16:57:07.313 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:03.980+0000 7fbefeea9640 1 --2- 172.21.15.115:0/1417705324 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbef8105400 0x7fbef8105800 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:07.313 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:03.980+0000 7fbefeea9640 1 -- 172.21.15.115:0/1417705324 >> 172.21.15.115:0/1417705324 conn(0x7fbef8100c30 msgr2=0x7fbef8103050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:57:07.313 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:03.980+0000 7fbefeea9640 1 -- 172.21.15.115:0/1417705324 shutdown_connections 2024-09-13T16:57:07.313 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:03.980+0000 7fbefeea9640 1 -- 172.21.15.115:0/1417705324 wait complete. 2024-09-13T16:57:07.313 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:03.981+0000 7fbefeea9640 1 Processor -- start 2024-09-13T16:57:07.314 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:03.981+0000 7fbefeea9640 1 -- start start 2024-09-13T16:57:07.314 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:03.981+0000 7fbefeea9640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbef8105400 0x7fbef81991c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:07.314 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:03.981+0000 7fbefeea9640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbef8199700 con 0x7fbef8105400 2024-09-13T16:57:07.314 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:03.981+0000 7fbefcc45640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbef8105400 0x7fbef81991c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:07.314 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:03.981+0000 7fbefcc45640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbef8105400 0x7fbef81991c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60168/0 (socket says 172.21.15.115:60168) 2024-09-13T16:57:07.314 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:03.981+0000 7fbefcc45640 1 -- 172.21.15.115:0/2582636053 learned_addr learned my addr 172.21.15.115:0/2582636053 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T16:57:07.314 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:03.981+0000 7fbefcc45640 1 -- 172.21.15.115:0/2582636053 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbef00094d0 con 0x7fbef8105400 2024-09-13T16:57:07.314 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:03.981+0000 7fbefcc45640 1 --2- 172.21.15.115:0/2582636053 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbef8105400 0x7fbef81991c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fbef0009940 tx=0x7fbef0030cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:07.314 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:03.981+0000 7fbef5ffb640 1 -- 172.21.15.115:0/2582636053 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbef0040070 con 0x7fbef8105400 2024-09-13T16:57:07.314 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:03.982+0000 7fbef5ffb640 1 -- 172.21.15.115:0/2582636053 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7fbef0032c10 con 0x7fbef8105400 2024-09-13T16:57:07.314 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:03.982+0000 7fbefeea9640 1 -- 172.21.15.115:0/2582636053 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbef8199900 con 0x7fbef8105400 2024-09-13T16:57:07.314 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:03.982+0000 7fbef5ffb640 1 -- 172.21.15.115:0/2582636053 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbef003a560 con 0x7fbef8105400 2024-09-13T16:57:07.314 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:03.982+0000 7fbefeea9640 1 -- 172.21.15.115:0/2582636053 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbef8199da0 con 0x7fbef8105400 2024-09-13T16:57:07.315 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:03.982+0000 7fbef5ffb640 1 -- 172.21.15.115:0/2582636053 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7fbef003c9e0 con 0x7fbef8105400 2024-09-13T16:57:07.315 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:03.983+0000 7fbef5ffb640 1 --2- 172.21.15.115:0/2582636053 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7fbee4038650 0x7fbee403ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:07.315 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:03.983+0000 7fbef5ffb640 1 -- 172.21.15.115:0/2582636053 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fbef006b490 con 0x7fbef8105400 2024-09-13T16:57:07.315 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:03.983+0000 7fbefeea9640 1 -- 172.21.15.115:0/2582636053 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbef81097e0 con 0x7fbef8105400 2024-09-13T16:57:07.315 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:03.983+0000 7fbef7fff640 1 --2- 172.21.15.115:0/2582636053 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7fbee4038650 0x7fbee403ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:07.315 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:03.983+0000 7fbef7fff640 1 --2- 172.21.15.115:0/2582636053 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7fbee4038650 0x7fbee403ab10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fbee800ad30 tx=0x7fbee80093f0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:07.315 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:03.987+0000 7fbef5ffb640 1 -- 172.21.15.115:0/2582636053 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fbef0043d30 con 0x7fbef8105400 2024-09-13T16:57:07.315 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:04.152+0000 7fbefeea9640 1 -- 172.21.15.115:0/2582636053 --> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi115", "addr": "172.21.15.115", "target": ["mon-mgr", ""]}) v1 -- 0x7fbef8101f80 con 0x7fbee4038650 2024-09-13T16:57:07.315 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:06.781+0000 7fbef5ffb640 1 -- 172.21.15.115:0/2582636053 <== mgr.14116 v2:172.21.15.115:6800/2943337696 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fbef8101f80 con 0x7fbee4038650 2024-09-13T16:57:07.315 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:06.784+0000 7fbefeea9640 1 -- 172.21.15.115:0/2582636053 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7fbee4038650 msgr2=0x7fbee403ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:07.315 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:06.784+0000 7fbefeea9640 1 --2- 172.21.15.115:0/2582636053 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7fbee4038650 0x7fbee403ab10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fbee800ad30 tx=0x7fbee80093f0 comp rx=0 tx=0).stop 2024-09-13T16:57:07.315 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:06.784+0000 7fbefeea9640 1 -- 172.21.15.115:0/2582636053 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbef8105400 msgr2=0x7fbef81991c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:07.315 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:06.784+0000 7fbefeea9640 1 --2- 172.21.15.115:0/2582636053 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbef8105400 0x7fbef81991c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fbef0009940 tx=0x7fbef0030cc0 comp rx=0 tx=0).stop 2024-09-13T16:57:07.316 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:06.784+0000 7fbefeea9640 1 -- 172.21.15.115:0/2582636053 shutdown_connections 2024-09-13T16:57:07.316 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:06.784+0000 7fbefeea9640 1 --2- 172.21.15.115:0/2582636053 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7fbee4038650 0x7fbee403ab10 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:07.316 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:06.784+0000 7fbefeea9640 1 --2- 172.21.15.115:0/2582636053 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbef8105400 0x7fbef81991c0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:07.316 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:06.784+0000 7fbefeea9640 1 -- 172.21.15.115:0/2582636053 >> 172.21.15.115:0/2582636053 conn(0x7fbef8100c30 msgr2=0x7fbef8101870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:57:07.316 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:06.784+0000 7fbefeea9640 1 -- 172.21.15.115:0/2582636053 shutdown_connections 2024-09-13T16:57:07.316 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:06.785+0000 7fbefeea9640 1 -- 172.21.15.115:0/2582636053 wait complete. 2024-09-13T16:57:07.316 INFO:teuthology.orchestra.run.smithi115.stdout:Deploying mon service with default placement... 2024-09-13T16:57:07.901 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:07 smithi115 ceph-mon[27708]: from='mgr.14116 172.21.15.115:0/1701263389' entity='mgr.smithi115.hetcni' 2024-09-13T16:57:07.901 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:07 smithi115 ceph-mon[27708]: Added host smithi115 2024-09-13T16:57:07.901 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:07 smithi115 ceph-mon[27708]: from='mgr.14116 172.21.15.115:0/1701263389' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:57:08.798 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-13T16:57:08.798 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:07.905+0000 7f1fc99d0640 1 Processor -- start 2024-09-13T16:57:08.798 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:07.906+0000 7f1fc99d0640 1 -- start start 2024-09-13T16:57:08.798 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:07.906+0000 7f1fc99d0640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1fc4105ec0 0x7f1fc41082b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:08.798 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:07.906+0000 7f1fc99d0640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc4078e60 con 0x7f1fc4105ec0 2024-09-13T16:57:08.798 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:07.906+0000 7f1fc2ffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1fc4105ec0 0x7f1fc41082b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:08.798 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:07.906+0000 7f1fc2ffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1fc4105ec0 0x7f1fc41082b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:53152/0 (socket says 172.21.15.115:53152) 2024-09-13T16:57:08.798 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:07.906+0000 7f1fc2ffd640 1 -- 172.21.15.115:0/3470713921 learned_addr learned my addr 172.21.15.115:0/3470713921 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T16:57:08.798 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:07.906+0000 7f1fc2ffd640 1 -- 172.21.15.115:0/3470713921 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fc41087f0 con 0x7f1fc4105ec0 2024-09-13T16:57:08.798 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:07.907+0000 7f1fc2ffd640 1 --2- 172.21.15.115:0/3470713921 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1fc4105ec0 0x7f1fc41082b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1fb4009820 tx=0x7f1fb402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aba7131c1d48e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:08.798 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:07.907+0000 7f1fc1ffb640 1 -- 172.21.15.115:0/3470713921 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1fb402ad40 con 0x7f1fc4105ec0 2024-09-13T16:57:08.799 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:07.907+0000 7f1fc1ffb640 1 -- 172.21.15.115:0/3470713921 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f1fb4032890 con 0x7f1fc4105ec0 2024-09-13T16:57:08.799 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:07.907+0000 7f1fc1ffb640 1 -- 172.21.15.115:0/3470713921 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1fb40307d0 con 0x7f1fc4105ec0 2024-09-13T16:57:08.799 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:07.908+0000 7f1fc99d0640 1 -- 172.21.15.115:0/3470713921 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1fc4105ec0 msgr2=0x7f1fc41082b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:08.799 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:07.908+0000 7f1fc99d0640 1 --2- 172.21.15.115:0/3470713921 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1fc4105ec0 0x7f1fc41082b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1fb4009820 tx=0x7f1fb402a270 comp rx=0 tx=0).stop 2024-09-13T16:57:08.799 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:07.908+0000 7f1fc99d0640 1 -- 172.21.15.115:0/3470713921 shutdown_connections 2024-09-13T16:57:08.799 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:07.908+0000 7f1fc99d0640 1 --2- 172.21.15.115:0/3470713921 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1fc4105ec0 0x7f1fc41082b0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:08.799 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:07.908+0000 7f1fc99d0640 1 -- 172.21.15.115:0/3470713921 >> 172.21.15.115:0/3470713921 conn(0x7f1fc40ffa60 msgr2=0x7f1fc4101ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:57:08.799 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:07.908+0000 7f1fc99d0640 1 -- 172.21.15.115:0/3470713921 shutdown_connections 2024-09-13T16:57:08.799 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:07.908+0000 7f1fc99d0640 1 -- 172.21.15.115:0/3470713921 wait complete. 2024-09-13T16:57:08.799 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:07.908+0000 7f1fc99d0640 1 Processor -- start 2024-09-13T16:57:08.799 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:07.908+0000 7f1fc99d0640 1 -- start start 2024-09-13T16:57:08.799 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:07.909+0000 7f1fc99d0640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1fc4105ec0 0x7f1fc41990f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:08.799 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:07.909+0000 7f1fc99d0640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc4199630 con 0x7f1fc4105ec0 2024-09-13T16:57:08.800 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:07.909+0000 7f1fc2ffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1fc4105ec0 0x7f1fc41990f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:08.800 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:07.909+0000 7f1fc2ffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1fc4105ec0 0x7f1fc41990f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:53154/0 (socket says 172.21.15.115:53154) 2024-09-13T16:57:08.800 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:07.909+0000 7f1fc2ffd640 1 -- 172.21.15.115:0/407833487 learned_addr learned my addr 172.21.15.115:0/407833487 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T16:57:08.800 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:07.909+0000 7f1fc2ffd640 1 -- 172.21.15.115:0/407833487 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fb40094d0 con 0x7f1fc4105ec0 2024-09-13T16:57:08.800 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:07.909+0000 7f1fc2ffd640 1 --2- 172.21.15.115:0/407833487 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1fc4105ec0 0x7f1fc41990f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1fb4030380 tx=0x7f1fb4030cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:08.800 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:07.909+0000 7f1fc89ce640 1 -- 172.21.15.115:0/407833487 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1fb4030ed0 con 0x7f1fc4105ec0 2024-09-13T16:57:08.800 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:07.909+0000 7f1fc89ce640 1 -- 172.21.15.115:0/407833487 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f1fb4032c10 con 0x7f1fc4105ec0 2024-09-13T16:57:08.800 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:07.909+0000 7f1fc99d0640 1 -- 172.21.15.115:0/407833487 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fc4199830 con 0x7f1fc4105ec0 2024-09-13T16:57:08.800 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:07.909+0000 7f1fc89ce640 1 -- 172.21.15.115:0/407833487 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1fb403a560 con 0x7f1fc4105ec0 2024-09-13T16:57:08.800 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:07.909+0000 7f1fc99d0640 1 -- 172.21.15.115:0/407833487 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fc4199cd0 con 0x7f1fc4105ec0 2024-09-13T16:57:08.800 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:07.910+0000 7f1fc89ce640 1 -- 172.21.15.115:0/407833487 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f1fb403a7d0 con 0x7f1fc4105ec0 2024-09-13T16:57:08.800 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:07.910+0000 7f1fc89ce640 1 --2- 172.21.15.115:0/407833487 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7f1fb00386a0 0x7f1fb003ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:08.800 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:07.910+0000 7f1fc89ce640 1 -- 172.21.15.115:0/407833487 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f1fb406baf0 con 0x7f1fc4105ec0 2024-09-13T16:57:08.800 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:07.910+0000 7f1fc27fc640 1 --2- 172.21.15.115:0/407833487 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7f1fb00386a0 0x7f1fb003ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:08.801 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:07.910+0000 7f1fc99d0640 1 -- 172.21.15.115:0/407833487 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fc4106320 con 0x7f1fc4105ec0 2024-09-13T16:57:08.801 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:07.911+0000 7f1fc27fc640 1 --2- 172.21.15.115:0/407833487 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7f1fb00386a0 0x7f1fb003ab60 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1fac0098c0 tx=0x7f1fac006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:08.801 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:07.915+0000 7f1fc89ce640 1 -- 172.21.15.115:0/407833487 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f1fb4046460 con 0x7f1fc4105ec0 2024-09-13T16:57:08.801 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:08.091+0000 7f1fc99d0640 1 -- 172.21.15.115:0/407833487 --> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}) v1 -- 0x7f1fc4100da0 con 0x7f1fb00386a0 2024-09-13T16:57:08.801 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:08.096+0000 7f1fc89ce640 1 -- 172.21.15.115:0/407833487 <== mgr.14116 v2:172.21.15.115:6800/2943337696 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f1fc4100da0 con 0x7f1fb00386a0 2024-09-13T16:57:08.801 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:08.098+0000 7f1fc99d0640 1 -- 172.21.15.115:0/407833487 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7f1fb00386a0 msgr2=0x7f1fb003ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:08.801 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:08.098+0000 7f1fc99d0640 1 --2- 172.21.15.115:0/407833487 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7f1fb00386a0 0x7f1fb003ab60 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1fac0098c0 tx=0x7f1fac006db0 comp rx=0 tx=0).stop 2024-09-13T16:57:08.801 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:08.098+0000 7f1fc99d0640 1 -- 172.21.15.115:0/407833487 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1fc4105ec0 msgr2=0x7f1fc41990f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:08.801 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:08.098+0000 7f1fc99d0640 1 --2- 172.21.15.115:0/407833487 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1fc4105ec0 0x7f1fc41990f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1fb4030380 tx=0x7f1fb4030cc0 comp rx=0 tx=0).stop 2024-09-13T16:57:08.801 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:08.098+0000 7f1fc99d0640 1 -- 172.21.15.115:0/407833487 shutdown_connections 2024-09-13T16:57:08.801 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:08.098+0000 7f1fc99d0640 1 --2- 172.21.15.115:0/407833487 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7f1fb00386a0 0x7f1fb003ab60 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:08.801 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:08.098+0000 7f1fc99d0640 1 --2- 172.21.15.115:0/407833487 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1fc4105ec0 0x7f1fc41990f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:08.801 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:08.098+0000 7f1fc99d0640 1 -- 172.21.15.115:0/407833487 >> 172.21.15.115:0/407833487 conn(0x7f1fc40ffa60 msgr2=0x7f1fc4100690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:57:08.802 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:08.099+0000 7f1fc99d0640 1 -- 172.21.15.115:0/407833487 shutdown_connections 2024-09-13T16:57:08.802 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:08.099+0000 7f1fc99d0640 1 -- 172.21.15.115:0/407833487 wait complete. 2024-09-13T16:57:08.802 INFO:teuthology.orchestra.run.smithi115.stdout:Deploying mgr service with default placement... 2024-09-13T16:57:09.394 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:09 smithi115 ceph-mon[27708]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:57:09.394 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:09 smithi115 ceph-mon[27708]: Saving service mon spec with placement count:5 2024-09-13T16:57:09.394 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:09 smithi115 ceph-mon[27708]: from='mgr.14116 172.21.15.115:0/1701263389' entity='mgr.smithi115.hetcni' 2024-09-13T16:57:10.208 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-13T16:57:10.209 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:09.207+0000 7f95a1def640 1 Processor -- start 2024-09-13T16:57:10.209 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:09.207+0000 7f95a1def640 1 -- start start 2024-09-13T16:57:10.209 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:09.207+0000 7f95a1def640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f959c105e80 0x7f959c108270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:10.209 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:09.207+0000 7f95a1def640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f959c078ec0 con 0x7f959c105e80 2024-09-13T16:57:10.209 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:09.207+0000 7f959b7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f959c105e80 0x7f959c108270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:10.209 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:09.207+0000 7f959b7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f959c105e80 0x7f959c108270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:53164/0 (socket says 172.21.15.115:53164) 2024-09-13T16:57:10.209 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:09.207+0000 7f959b7fe640 1 -- 172.21.15.115:0/1721250893 learned_addr learned my addr 172.21.15.115:0/1721250893 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T16:57:10.209 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:09.208+0000 7f959b7fe640 1 -- 172.21.15.115:0/1721250893 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f959c1087b0 con 0x7f959c105e80 2024-09-13T16:57:10.209 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:09.208+0000 7f959b7fe640 1 --2- 172.21.15.115:0/1721250893 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f959c105e80 0x7f959c108270 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f958c009820 tx=0x7f958c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5c336474f37c356 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:10.209 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:09.208+0000 7f959affd640 1 -- 172.21.15.115:0/1721250893 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f958c02ad40 con 0x7f959c105e80 2024-09-13T16:57:10.209 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:09.208+0000 7f959affd640 1 -- 172.21.15.115:0/1721250893 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f958c032890 con 0x7f959c105e80 2024-09-13T16:57:10.209 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:09.208+0000 7f959affd640 1 -- 172.21.15.115:0/1721250893 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f958c0307d0 con 0x7f959c105e80 2024-09-13T16:57:10.210 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:09.209+0000 7f95a1def640 1 -- 172.21.15.115:0/1721250893 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f959c105e80 msgr2=0x7f959c108270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:10.210 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:09.209+0000 7f95a1def640 1 --2- 172.21.15.115:0/1721250893 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f959c105e80 0x7f959c108270 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f958c009820 tx=0x7f958c02a270 comp rx=0 tx=0).stop 2024-09-13T16:57:10.210 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:09.209+0000 7f95a1def640 1 -- 172.21.15.115:0/1721250893 shutdown_connections 2024-09-13T16:57:10.210 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:09.209+0000 7f95a1def640 1 --2- 172.21.15.115:0/1721250893 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f959c105e80 0x7f959c108270 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:10.210 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:09.209+0000 7f95a1def640 1 -- 172.21.15.115:0/1721250893 >> 172.21.15.115:0/1721250893 conn(0x7f959c0ffae0 msgr2=0x7f959c101f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:57:10.210 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:09.209+0000 7f95a1def640 1 -- 172.21.15.115:0/1721250893 shutdown_connections 2024-09-13T16:57:10.210 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:09.209+0000 7f95a1def640 1 -- 172.21.15.115:0/1721250893 wait complete. 2024-09-13T16:57:10.210 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:09.210+0000 7f95a1def640 1 Processor -- start 2024-09-13T16:57:10.210 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:09.210+0000 7f95a1def640 1 -- start start 2024-09-13T16:57:10.210 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:09.210+0000 7f95a1def640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f959c105e80 0x7f959c105700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:10.210 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:09.210+0000 7f95a1def640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f959c105c40 con 0x7f959c105e80 2024-09-13T16:57:10.210 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:09.210+0000 7f959b7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f959c105e80 0x7f959c105700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:10.210 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:09.210+0000 7f959b7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f959c105e80 0x7f959c105700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:53170/0 (socket says 172.21.15.115:53170) 2024-09-13T16:57:10.210 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:09.210+0000 7f959b7fe640 1 -- 172.21.15.115:0/2779952830 learned_addr learned my addr 172.21.15.115:0/2779952830 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T16:57:10.211 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:09.210+0000 7f959b7fe640 1 -- 172.21.15.115:0/2779952830 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f958c0094d0 con 0x7f959c105e80 2024-09-13T16:57:10.211 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:09.210+0000 7f959b7fe640 1 --2- 172.21.15.115:0/2779952830 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f959c105e80 0x7f959c105700 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f958c030380 tx=0x7f958c030cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:10.211 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:09.211+0000 7f95997fa640 1 -- 172.21.15.115:0/2779952830 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f958c030ed0 con 0x7f959c105e80 2024-09-13T16:57:10.211 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:09.211+0000 7f95997fa640 1 -- 172.21.15.115:0/2779952830 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f958c032c10 con 0x7f959c105e80 2024-09-13T16:57:10.211 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:09.211+0000 7f95a1def640 1 -- 172.21.15.115:0/2779952830 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f959c103e30 con 0x7f959c105e80 2024-09-13T16:57:10.211 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:09.211+0000 7f95997fa640 1 -- 172.21.15.115:0/2779952830 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f958c03a560 con 0x7f959c105e80 2024-09-13T16:57:10.211 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:09.211+0000 7f95a1def640 1 -- 172.21.15.115:0/2779952830 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f959c1042d0 con 0x7f959c105e80 2024-09-13T16:57:10.211 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:09.211+0000 7f95997fa640 1 -- 172.21.15.115:0/2779952830 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f958c03a7d0 con 0x7f959c105e80 2024-09-13T16:57:10.211 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:09.212+0000 7f95997fa640 1 --2- 172.21.15.115:0/2779952830 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7f95880386a0 0x7f958803ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:10.211 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:09.212+0000 7f95997fa640 1 -- 172.21.15.115:0/2779952830 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f958c06b7d0 con 0x7f959c105e80 2024-09-13T16:57:10.211 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:09.212+0000 7f9593fff640 1 --2- 172.21.15.115:0/2779952830 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7f95880386a0 0x7f958803ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:10.211 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:09.212+0000 7f95a1def640 1 -- 172.21.15.115:0/2779952830 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f959c1062e0 con 0x7f959c105e80 2024-09-13T16:57:10.212 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:09.212+0000 7f9593fff640 1 --2- 172.21.15.115:0/2779952830 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7f95880386a0 0x7f958803ab60 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f95840098c0 tx=0x7f9584006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:10.212 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:09.217+0000 7f95997fa640 1 -- 172.21.15.115:0/2779952830 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f958c046460 con 0x7f959c105e80 2024-09-13T16:57:10.212 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:09.392+0000 7f95a1def640 1 -- 172.21.15.115:0/2779952830 --> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7f959c1047c0 con 0x7f95880386a0 2024-09-13T16:57:10.212 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:09.399+0000 7f95997fa640 1 -- 172.21.15.115:0/2779952830 <== mgr.14116 v2:172.21.15.115:6800/2943337696 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f959c1047c0 con 0x7f95880386a0 2024-09-13T16:57:10.212 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:09.401+0000 7f95a1def640 1 -- 172.21.15.115:0/2779952830 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7f95880386a0 msgr2=0x7f958803ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:10.212 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:09.401+0000 7f95a1def640 1 --2- 172.21.15.115:0/2779952830 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7f95880386a0 0x7f958803ab60 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f95840098c0 tx=0x7f9584006db0 comp rx=0 tx=0).stop 2024-09-13T16:57:10.212 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:09.401+0000 7f95a1def640 1 -- 172.21.15.115:0/2779952830 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f959c105e80 msgr2=0x7f959c105700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:10.212 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:09.401+0000 7f95a1def640 1 --2- 172.21.15.115:0/2779952830 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f959c105e80 0x7f959c105700 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f958c030380 tx=0x7f958c030cc0 comp rx=0 tx=0).stop 2024-09-13T16:57:10.212 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:09.401+0000 7f95a1def640 1 -- 172.21.15.115:0/2779952830 shutdown_connections 2024-09-13T16:57:10.212 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:09.401+0000 7f95a1def640 1 --2- 172.21.15.115:0/2779952830 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7f95880386a0 0x7f958803ab60 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:10.212 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:09.401+0000 7f95a1def640 1 --2- 172.21.15.115:0/2779952830 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f959c105e80 0x7f959c105700 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:10.213 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:09.401+0000 7f95a1def640 1 -- 172.21.15.115:0/2779952830 >> 172.21.15.115:0/2779952830 conn(0x7f959c0ffae0 msgr2=0x7f959c100760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:57:10.213 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:09.401+0000 7f95a1def640 1 -- 172.21.15.115:0/2779952830 shutdown_connections 2024-09-13T16:57:10.213 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:09.401+0000 7f95a1def640 1 -- 172.21.15.115:0/2779952830 wait complete. 2024-09-13T16:57:10.213 INFO:teuthology.orchestra.run.smithi115.stdout:Deploying crash service with default placement... 2024-09-13T16:57:10.576 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:10 smithi115 ceph-mon[27708]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:57:10.576 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:10 smithi115 ceph-mon[27708]: Saving service mgr spec with placement count:2 2024-09-13T16:57:10.576 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:10 smithi115 ceph-mon[27708]: from='mgr.14116 172.21.15.115:0/1701263389' entity='mgr.smithi115.hetcni' 2024-09-13T16:57:10.576 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:10 smithi115 ceph-mon[27708]: from='mgr.14116 172.21.15.115:0/1701263389' entity='mgr.smithi115.hetcni' 2024-09-13T16:57:10.576 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:10 smithi115 ceph-mon[27708]: from='mgr.14116 172.21.15.115:0/1701263389' entity='mgr.smithi115.hetcni' 2024-09-13T16:57:11.928 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:11 smithi115 ceph-mon[27708]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:57:11.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:11 smithi115 ceph-mon[27708]: Saving service crash spec with placement * 2024-09-13T16:57:11.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:11 smithi115 ceph-mon[27708]: from='mgr.14116 172.21.15.115:0/1701263389' entity='mgr.smithi115.hetcni' 2024-09-13T16:57:11.975 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2024-09-13T16:57:11.976 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:10.574+0000 7f7035991640 1 Processor -- start 2024-09-13T16:57:11.976 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:10.574+0000 7f7035991640 1 -- start start 2024-09-13T16:57:11.976 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:10.574+0000 7f7035991640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70301053e0 0x7f70301057e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:11.976 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:10.574+0000 7f7035991640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7030105db0 con 0x7f70301053e0 2024-09-13T16:57:11.976 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:10.574+0000 7f702effd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70301053e0 0x7f70301057e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:11.976 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:10.574+0000 7f702effd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70301053e0 0x7f70301057e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:53176/0 (socket says 172.21.15.115:53176) 2024-09-13T16:57:11.976 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:10.574+0000 7f702effd640 1 -- 172.21.15.115:0/3857082853 learned_addr learned my addr 172.21.15.115:0/3857082853 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T16:57:11.976 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:10.575+0000 7f702effd640 1 -- 172.21.15.115:0/3857082853 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7030106590 con 0x7f70301053e0 2024-09-13T16:57:11.977 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:10.575+0000 7f702effd640 1 --2- 172.21.15.115:0/3857082853 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70301053e0 0x7f70301057e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7020009820 tx=0x7f702002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de2e3c1fe22535a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:11.977 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:10.575+0000 7f702e7fc640 1 -- 172.21.15.115:0/3857082853 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f702002ad40 con 0x7f70301053e0 2024-09-13T16:57:11.977 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:10.575+0000 7f702e7fc640 1 -- 172.21.15.115:0/3857082853 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f70200328e0 con 0x7f70301053e0 2024-09-13T16:57:11.977 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:10.575+0000 7f702e7fc640 1 -- 172.21.15.115:0/3857082853 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f70200307d0 con 0x7f70301053e0 2024-09-13T16:57:11.978 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:10.576+0000 7f7035991640 1 -- 172.21.15.115:0/3857082853 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70301053e0 msgr2=0x7f70301057e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:11.978 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:10.576+0000 7f7035991640 1 --2- 172.21.15.115:0/3857082853 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70301053e0 0x7f70301057e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7020009820 tx=0x7f702002a270 comp rx=0 tx=0).stop 2024-09-13T16:57:11.978 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:10.576+0000 7f7035991640 1 -- 172.21.15.115:0/3857082853 shutdown_connections 2024-09-13T16:57:11.978 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:10.576+0000 7f7035991640 1 --2- 172.21.15.115:0/3857082853 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70301053e0 0x7f70301057e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:11.978 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:10.576+0000 7f7035991640 1 -- 172.21.15.115:0/3857082853 >> 172.21.15.115:0/3857082853 conn(0x7f7030100bd0 msgr2=0x7f7030102ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:57:11.978 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:10.576+0000 7f7035991640 1 -- 172.21.15.115:0/3857082853 shutdown_connections 2024-09-13T16:57:11.978 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:10.576+0000 7f7035991640 1 -- 172.21.15.115:0/3857082853 wait complete. 2024-09-13T16:57:11.979 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:10.577+0000 7f7035991640 1 Processor -- start 2024-09-13T16:57:11.979 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:10.577+0000 7f7035991640 1 -- start start 2024-09-13T16:57:11.979 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:10.577+0000 7f7035991640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70301053e0 0x7f703007ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:11.979 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:10.577+0000 7f7035991640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f703007b0c0 con 0x7f70301053e0 2024-09-13T16:57:11.979 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:10.577+0000 7f702effd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70301053e0 0x7f703007ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:11.979 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:10.577+0000 7f702effd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70301053e0 0x7f703007ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:53180/0 (socket says 172.21.15.115:53180) 2024-09-13T16:57:11.979 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:10.577+0000 7f702effd640 1 -- 172.21.15.115:0/1828757771 learned_addr learned my addr 172.21.15.115:0/1828757771 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T16:57:11.979 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:10.577+0000 7f702effd640 1 -- 172.21.15.115:0/1828757771 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70200094d0 con 0x7f70301053e0 2024-09-13T16:57:11.979 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:10.577+0000 7f702effd640 1 --2- 172.21.15.115:0/1828757771 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70301053e0 0x7f703007ab80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7020009940 tx=0x7f7020032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:11.979 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:10.578+0000 7f703498f640 1 -- 172.21.15.115:0/1828757771 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7020030e40 con 0x7f70301053e0 2024-09-13T16:57:11.979 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:10.578+0000 7f703498f640 1 -- 172.21.15.115:0/1828757771 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f702003b8b0 con 0x7f70301053e0 2024-09-13T16:57:11.979 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:10.578+0000 7f7035991640 1 -- 172.21.15.115:0/1828757771 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70300792b0 con 0x7f70301053e0 2024-09-13T16:57:11.979 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:10.578+0000 7f703498f640 1 -- 172.21.15.115:0/1828757771 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f702003a620 con 0x7f70301053e0 2024-09-13T16:57:11.980 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:10.578+0000 7f7035991640 1 -- 172.21.15.115:0/1828757771 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70300796d0 con 0x7f70301053e0 2024-09-13T16:57:11.980 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:10.578+0000 7f703498f640 1 -- 172.21.15.115:0/1828757771 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f7020039040 con 0x7f70301053e0 2024-09-13T16:57:11.980 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:10.579+0000 7f7035991640 1 -- 172.21.15.115:0/1828757771 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70301057e0 con 0x7f70301053e0 2024-09-13T16:57:11.980 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:10.579+0000 7f703498f640 1 --2- 172.21.15.115:0/1828757771 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7f701c038650 0x7f701c03ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:11.980 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:10.579+0000 7f703498f640 1 -- 172.21.15.115:0/1828757771 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f702006b970 con 0x7f70301053e0 2024-09-13T16:57:11.980 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:10.579+0000 7f7027fff640 1 --2- 172.21.15.115:0/1828757771 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7f701c038650 0x7f701c03ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:11.980 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:10.579+0000 7f7027fff640 1 --2- 172.21.15.115:0/1828757771 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7f701c038650 0x7f701c03ab10 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f70180098c0 tx=0x7f7018006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:11.980 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:10.583+0000 7f703498f640 1 -- 172.21.15.115:0/1828757771 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f702004b710 con 0x7f70301053e0 2024-09-13T16:57:11.980 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:10.774+0000 7f7035991640 1 -- 172.21.15.115:0/1828757771 --> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}) v1 -- 0x7f7030079c80 con 0x7f701c038650 2024-09-13T16:57:11.980 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:10.781+0000 7f703498f640 1 -- 172.21.15.115:0/1828757771 <== mgr.14116 v2:172.21.15.115:6800/2943337696 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7f7030079c80 con 0x7f701c038650 2024-09-13T16:57:11.980 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:10.784+0000 7f7035991640 1 -- 172.21.15.115:0/1828757771 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7f701c038650 msgr2=0x7f701c03ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:11.981 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:10.784+0000 7f7035991640 1 --2- 172.21.15.115:0/1828757771 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7f701c038650 0x7f701c03ab10 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f70180098c0 tx=0x7f7018006db0 comp rx=0 tx=0).stop 2024-09-13T16:57:11.981 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:10.784+0000 7f7035991640 1 -- 172.21.15.115:0/1828757771 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70301053e0 msgr2=0x7f703007ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:11.981 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:10.784+0000 7f7035991640 1 --2- 172.21.15.115:0/1828757771 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70301053e0 0x7f703007ab80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7020009940 tx=0x7f7020032670 comp rx=0 tx=0).stop 2024-09-13T16:57:11.981 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:10.784+0000 7f7035991640 1 -- 172.21.15.115:0/1828757771 shutdown_connections 2024-09-13T16:57:11.981 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:10.784+0000 7f7035991640 1 --2- 172.21.15.115:0/1828757771 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7f701c038650 0x7f701c03ab10 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:11.981 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:10.784+0000 7f7035991640 1 --2- 172.21.15.115:0/1828757771 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70301053e0 0x7f703007ab80 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:11.981 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:10.784+0000 7f7035991640 1 -- 172.21.15.115:0/1828757771 >> 172.21.15.115:0/1828757771 conn(0x7f7030100bd0 msgr2=0x7f70301017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:57:11.981 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:10.784+0000 7f7035991640 1 -- 172.21.15.115:0/1828757771 shutdown_connections 2024-09-13T16:57:11.981 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:10.784+0000 7f7035991640 1 -- 172.21.15.115:0/1828757771 wait complete. 2024-09-13T16:57:11.981 INFO:teuthology.orchestra.run.smithi115.stdout:Deploying ceph-exporter service with default placement... 2024-09-13T16:57:13.309 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout Scheduled ceph-exporter update... 2024-09-13T16:57:13.309 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:12.364+0000 7f2c40937640 1 Processor -- start 2024-09-13T16:57:13.309 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:12.364+0000 7f2c40937640 1 -- start start 2024-09-13T16:57:13.309 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:12.364+0000 7f2c40937640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c3c105f30 0x7f2c3c108320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:13.309 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:12.364+0000 7f2c40937640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c3c078e00 con 0x7f2c3c105f30 2024-09-13T16:57:13.309 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:12.364+0000 7f2c3a59c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c3c105f30 0x7f2c3c108320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:13.309 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:12.364+0000 7f2c3a59c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c3c105f30 0x7f2c3c108320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:53196/0 (socket says 172.21.15.115:53196) 2024-09-13T16:57:13.309 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:12.365+0000 7f2c3a59c640 1 -- 172.21.15.115:0/811151202 learned_addr learned my addr 172.21.15.115:0/811151202 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T16:57:13.309 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:12.365+0000 7f2c3a59c640 1 -- 172.21.15.115:0/811151202 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c3c078f40 con 0x7f2c3c105f30 2024-09-13T16:57:13.310 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:12.365+0000 7f2c3a59c640 1 --2- 172.21.15.115:0/811151202 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c3c105f30 0x7f2c3c108320 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c009820 tx=0x7f2c2c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4011de9d2a15f8b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:13.310 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:12.366+0000 7f2c3959a640 1 -- 172.21.15.115:0/811151202 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2c2c02ad40 con 0x7f2c3c105f30 2024-09-13T16:57:13.310 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:12.366+0000 7f2c3959a640 1 -- 172.21.15.115:0/811151202 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2c2c0328e0 con 0x7f2c3c105f30 2024-09-13T16:57:13.310 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:12.366+0000 7f2c3959a640 1 -- 172.21.15.115:0/811151202 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2c2c0307d0 con 0x7f2c3c105f30 2024-09-13T16:57:13.310 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:12.366+0000 7f2c40937640 1 -- 172.21.15.115:0/811151202 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c3c105f30 msgr2=0x7f2c3c108320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:13.310 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:12.366+0000 7f2c40937640 1 --2- 172.21.15.115:0/811151202 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c3c105f30 0x7f2c3c108320 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c009820 tx=0x7f2c2c02a270 comp rx=0 tx=0).stop 2024-09-13T16:57:13.310 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:12.366+0000 7f2c40937640 1 -- 172.21.15.115:0/811151202 shutdown_connections 2024-09-13T16:57:13.310 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:12.366+0000 7f2c40937640 1 --2- 172.21.15.115:0/811151202 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c3c105f30 0x7f2c3c108320 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:13.310 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:12.366+0000 7f2c40937640 1 -- 172.21.15.115:0/811151202 >> 172.21.15.115:0/811151202 conn(0x7f2c3c0ffaf0 msgr2=0x7f2c3c101f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:57:13.310 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:12.366+0000 7f2c40937640 1 -- 172.21.15.115:0/811151202 shutdown_connections 2024-09-13T16:57:13.310 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:12.366+0000 7f2c40937640 1 -- 172.21.15.115:0/811151202 wait complete. 2024-09-13T16:57:13.311 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:12.367+0000 7f2c40937640 1 Processor -- start 2024-09-13T16:57:13.311 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:12.367+0000 7f2c40937640 1 -- start start 2024-09-13T16:57:13.311 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:12.367+0000 7f2c40937640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c3c105f30 0x7f2c3c1057b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:13.311 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:12.367+0000 7f2c40937640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c3c105cf0 con 0x7f2c3c105f30 2024-09-13T16:57:13.311 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:12.367+0000 7f2c3a59c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c3c105f30 0x7f2c3c1057b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:13.311 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:12.367+0000 7f2c3a59c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c3c105f30 0x7f2c3c1057b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:53198/0 (socket says 172.21.15.115:53198) 2024-09-13T16:57:13.311 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:12.367+0000 7f2c3a59c640 1 -- 172.21.15.115:0/3918916793 learned_addr learned my addr 172.21.15.115:0/3918916793 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T16:57:13.311 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:12.368+0000 7f2c3a59c640 1 -- 172.21.15.115:0/3918916793 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c2c0094d0 con 0x7f2c3c105f30 2024-09-13T16:57:13.311 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:12.368+0000 7f2c3a59c640 1 --2- 172.21.15.115:0/3918916793 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c3c105f30 0x7f2c3c1057b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c030380 tx=0x7f2c2c032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:13.311 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:12.368+0000 7f2c337fe640 1 -- 172.21.15.115:0/3918916793 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2c2c030df0 con 0x7f2c3c105f30 2024-09-13T16:57:13.311 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:12.368+0000 7f2c40937640 1 -- 172.21.15.115:0/3918916793 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c3c103ee0 con 0x7f2c3c105f30 2024-09-13T16:57:13.311 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:12.368+0000 7f2c337fe640 1 -- 172.21.15.115:0/3918916793 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2c2c03b8c0 con 0x7f2c3c105f30 2024-09-13T16:57:13.311 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:12.368+0000 7f2c40937640 1 -- 172.21.15.115:0/3918916793 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c3c104300 con 0x7f2c3c105f30 2024-09-13T16:57:13.311 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:12.368+0000 7f2c337fe640 1 -- 172.21.15.115:0/3918916793 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2c2c03a760 con 0x7f2c3c105f30 2024-09-13T16:57:13.312 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:12.369+0000 7f2c337fe640 1 -- 172.21.15.115:0/3918916793 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f2c2c039070 con 0x7f2c3c105f30 2024-09-13T16:57:13.312 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:12.369+0000 7f2c337fe640 1 --2- 172.21.15.115:0/3918916793 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7f2c28038650 0x7f2c2803ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:13.312 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:12.369+0000 7f2c40937640 1 -- 172.21.15.115:0/3918916793 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c3c106310 con 0x7f2c3c105f30 2024-09-13T16:57:13.312 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:12.369+0000 7f2c337fe640 1 -- 172.21.15.115:0/3918916793 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f2c2c06b990 con 0x7f2c3c105f30 2024-09-13T16:57:13.312 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:12.369+0000 7f2c39d9b640 1 --2- 172.21.15.115:0/3918916793 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7f2c28038650 0x7f2c2803ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:13.312 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:12.369+0000 7f2c39d9b640 1 --2- 172.21.15.115:0/3918916793 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7f2c28038650 0x7f2c2803ab10 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2c240098c0 tx=0x7f2c24006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:13.312 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:12.374+0000 7f2c337fe640 1 -- 172.21.15.115:0/3918916793 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f2c2c03f020 con 0x7f2c3c105f30 2024-09-13T16:57:13.312 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:12.551+0000 7f2c40937640 1 -- 172.21.15.115:0/3918916793 --> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "ceph-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7f2c3c104990 con 0x7f2c28038650 2024-09-13T16:57:13.312 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:12.558+0000 7f2c337fe640 1 -- 172.21.15.115:0/3918916793 <== mgr.14116 v2:172.21.15.115:6800/2943337696 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7f2c3c104990 con 0x7f2c28038650 2024-09-13T16:57:13.312 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:12.561+0000 7f2c40937640 1 -- 172.21.15.115:0/3918916793 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7f2c28038650 msgr2=0x7f2c2803ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:13.312 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:12.561+0000 7f2c40937640 1 --2- 172.21.15.115:0/3918916793 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7f2c28038650 0x7f2c2803ab10 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2c240098c0 tx=0x7f2c24006db0 comp rx=0 tx=0).stop 2024-09-13T16:57:13.312 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:12.561+0000 7f2c40937640 1 -- 172.21.15.115:0/3918916793 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c3c105f30 msgr2=0x7f2c3c1057b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:13.312 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:12.561+0000 7f2c40937640 1 --2- 172.21.15.115:0/3918916793 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c3c105f30 0x7f2c3c1057b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c030380 tx=0x7f2c2c032670 comp rx=0 tx=0).stop 2024-09-13T16:57:13.313 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:12.561+0000 7f2c40937640 1 -- 172.21.15.115:0/3918916793 shutdown_connections 2024-09-13T16:57:13.313 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:12.561+0000 7f2c40937640 1 --2- 172.21.15.115:0/3918916793 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7f2c28038650 0x7f2c2803ab10 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:13.313 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:12.561+0000 7f2c40937640 1 --2- 172.21.15.115:0/3918916793 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c3c105f30 0x7f2c3c1057b0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:13.313 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:12.561+0000 7f2c40937640 1 -- 172.21.15.115:0/3918916793 >> 172.21.15.115:0/3918916793 conn(0x7f2c3c0ffaf0 msgr2=0x7f2c3c100660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:57:13.313 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:12.562+0000 7f2c40937640 1 -- 172.21.15.115:0/3918916793 shutdown_connections 2024-09-13T16:57:13.313 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:12.562+0000 7f2c40937640 1 -- 172.21.15.115:0/3918916793 wait complete. 2024-09-13T16:57:13.313 INFO:teuthology.orchestra.run.smithi115.stdout:Deploying prometheus service with default placement... 2024-09-13T16:57:13.734 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:13 smithi115 ceph-mon[27708]: from='mgr.14116 172.21.15.115:0/1701263389' entity='mgr.smithi115.hetcni' 2024-09-13T16:57:13.735 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:13 smithi115 ceph-mon[27708]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "ceph-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:57:13.735 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:13 smithi115 ceph-mon[27708]: Saving service ceph-exporter spec with placement * 2024-09-13T16:57:13.735 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:13 smithi115 ceph-mon[27708]: from='mgr.14116 172.21.15.115:0/1701263389' entity='mgr.smithi115.hetcni' 2024-09-13T16:57:13.735 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:13 smithi115 ceph-mon[27708]: from='mgr.14116 172.21.15.115:0/1701263389' entity='mgr.smithi115.hetcni' 2024-09-13T16:57:14.510 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2024-09-13T16:57:14.510 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:13.733+0000 7f08f1284640 1 Processor -- start 2024-09-13T16:57:14.510 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:13.733+0000 7f08f1284640 1 -- start start 2024-09-13T16:57:14.510 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:13.733+0000 7f08f1284640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08ec104860 0x7f08ec104c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:14.511 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:13.733+0000 7f08f1284640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08ec105230 con 0x7f08ec104860 2024-09-13T16:57:14.511 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:13.733+0000 7f08eaffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08ec104860 0x7f08ec104c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:14.511 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:13.733+0000 7f08eaffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08ec104860 0x7f08ec104c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:53202/0 (socket says 172.21.15.115:53202) 2024-09-13T16:57:14.511 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:13.733+0000 7f08eaffd640 1 -- 172.21.15.115:0/3429007044 learned_addr learned my addr 172.21.15.115:0/3429007044 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T16:57:14.511 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:13.734+0000 7f08eaffd640 1 -- 172.21.15.115:0/3429007044 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08ec105580 con 0x7f08ec104860 2024-09-13T16:57:14.511 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:13.734+0000 7f08eaffd640 1 --2- 172.21.15.115:0/3429007044 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08ec104860 0x7f08ec104c60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f08dc009820 tx=0x7f08dc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ccefb269e5ba89b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:14.511 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:13.734+0000 7f08ea7fc640 1 -- 172.21.15.115:0/3429007044 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f08dc02ad40 con 0x7f08ec104860 2024-09-13T16:57:14.511 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:13.735+0000 7f08ea7fc640 1 -- 172.21.15.115:0/3429007044 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f08dc0328e0 con 0x7f08ec104860 2024-09-13T16:57:14.511 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:13.735+0000 7f08ea7fc640 1 -- 172.21.15.115:0/3429007044 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f08dc0307d0 con 0x7f08ec104860 2024-09-13T16:57:14.511 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:13.735+0000 7f08f1284640 1 -- 172.21.15.115:0/3429007044 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08ec104860 msgr2=0x7f08ec104c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:14.511 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:13.735+0000 7f08f1284640 1 --2- 172.21.15.115:0/3429007044 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08ec104860 0x7f08ec104c60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f08dc009820 tx=0x7f08dc02a270 comp rx=0 tx=0).stop 2024-09-13T16:57:14.512 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:13.735+0000 7f08f1284640 1 -- 172.21.15.115:0/3429007044 shutdown_connections 2024-09-13T16:57:14.512 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:13.735+0000 7f08f1284640 1 --2- 172.21.15.115:0/3429007044 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08ec104860 0x7f08ec104c60 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:14.512 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:13.735+0000 7f08f1284640 1 -- 172.21.15.115:0/3429007044 >> 172.21.15.115:0/3429007044 conn(0x7f08ec0ff230 msgr2=0x7f08ec101690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:57:14.512 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:13.735+0000 7f08f1284640 1 -- 172.21.15.115:0/3429007044 shutdown_connections 2024-09-13T16:57:14.512 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:13.735+0000 7f08f1284640 1 -- 172.21.15.115:0/3429007044 wait complete. 2024-09-13T16:57:14.512 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:13.736+0000 7f08f1284640 1 Processor -- start 2024-09-13T16:57:14.512 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:13.736+0000 7f08f1284640 1 -- start start 2024-09-13T16:57:14.512 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:13.736+0000 7f08f1284640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08ec104860 0x7f08ec1980c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:14.512 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:13.736+0000 7f08f1284640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08ec198600 con 0x7f08ec104860 2024-09-13T16:57:14.512 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:13.736+0000 7f08eaffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08ec104860 0x7f08ec1980c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:14.512 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:13.736+0000 7f08eaffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08ec104860 0x7f08ec1980c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:53210/0 (socket says 172.21.15.115:53210) 2024-09-13T16:57:14.513 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:13.736+0000 7f08eaffd640 1 -- 172.21.15.115:0/2675369280 learned_addr learned my addr 172.21.15.115:0/2675369280 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T16:57:14.513 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:13.736+0000 7f08eaffd640 1 -- 172.21.15.115:0/2675369280 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08dc0094d0 con 0x7f08ec104860 2024-09-13T16:57:14.513 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:13.736+0000 7f08eaffd640 1 --2- 172.21.15.115:0/2675369280 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08ec104860 0x7f08ec1980c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f08dc030380 tx=0x7f08dc032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:14.513 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:13.737+0000 7f08e8ff9640 1 -- 172.21.15.115:0/2675369280 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f08dc030df0 con 0x7f08ec104860 2024-09-13T16:57:14.513 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:13.737+0000 7f08e8ff9640 1 -- 172.21.15.115:0/2675369280 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f08dc03b8c0 con 0x7f08ec104860 2024-09-13T16:57:14.513 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:13.737+0000 7f08f1284640 1 -- 172.21.15.115:0/2675369280 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08ec198800 con 0x7f08ec104860 2024-09-13T16:57:14.513 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:13.737+0000 7f08e8ff9640 1 -- 172.21.15.115:0/2675369280 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f08dc03a6f0 con 0x7f08ec104860 2024-09-13T16:57:14.513 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:13.737+0000 7f08f1284640 1 -- 172.21.15.115:0/2675369280 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08ec198c20 con 0x7f08ec104860 2024-09-13T16:57:14.513 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:13.738+0000 7f08e8ff9640 1 -- 172.21.15.115:0/2675369280 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f08dc039070 con 0x7f08ec104860 2024-09-13T16:57:14.513 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:13.738+0000 7f08e8ff9640 1 --2- 172.21.15.115:0/2675369280 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7f08d80386a0 0x7f08d803ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:14.513 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:13.738+0000 7f08f1284640 1 -- 172.21.15.115:0/2675369280 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08ec1087b0 con 0x7f08ec104860 2024-09-13T16:57:14.514 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:13.738+0000 7f08e8ff9640 1 -- 172.21.15.115:0/2675369280 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f08dc06b8d0 con 0x7f08ec104860 2024-09-13T16:57:14.514 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:13.738+0000 7f08e3fff640 1 --2- 172.21.15.115:0/2675369280 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7f08d80386a0 0x7f08d803ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:14.514 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:13.738+0000 7f08e3fff640 1 --2- 172.21.15.115:0/2675369280 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7f08d80386a0 0x7f08d803ab60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f08d40098c0 tx=0x7f08d4006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:14.514 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:13.744+0000 7f08e8ff9640 1 -- 172.21.15.115:0/2675369280 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f08dc0313a0 con 0x7f08ec104860 2024-09-13T16:57:14.514 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:13.922+0000 7f08f1284640 1 -- 172.21.15.115:0/2675369280 --> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7f08ec19b580 con 0x7f08d80386a0 2024-09-13T16:57:14.514 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:13.927+0000 7f08e8ff9640 1 -- 172.21.15.115:0/2675369280 <== mgr.14116 v2:172.21.15.115:6800/2943337696 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7f08ec19b580 con 0x7f08d80386a0 2024-09-13T16:57:14.514 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:13.929+0000 7f08f1284640 1 -- 172.21.15.115:0/2675369280 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7f08d80386a0 msgr2=0x7f08d803ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:14.514 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:13.929+0000 7f08f1284640 1 --2- 172.21.15.115:0/2675369280 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7f08d80386a0 0x7f08d803ab60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f08d40098c0 tx=0x7f08d4006db0 comp rx=0 tx=0).stop 2024-09-13T16:57:14.514 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:13.929+0000 7f08f1284640 1 -- 172.21.15.115:0/2675369280 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08ec104860 msgr2=0x7f08ec1980c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:14.514 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:13.929+0000 7f08f1284640 1 --2- 172.21.15.115:0/2675369280 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08ec104860 0x7f08ec1980c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f08dc030380 tx=0x7f08dc032670 comp rx=0 tx=0).stop 2024-09-13T16:57:14.514 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:13.929+0000 7f08f1284640 1 -- 172.21.15.115:0/2675369280 shutdown_connections 2024-09-13T16:57:14.514 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:13.929+0000 7f08f1284640 1 --2- 172.21.15.115:0/2675369280 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7f08d80386a0 0x7f08d803ab60 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:14.515 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:13.929+0000 7f08f1284640 1 --2- 172.21.15.115:0/2675369280 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08ec104860 0x7f08ec1980c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:14.515 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:13.929+0000 7f08f1284640 1 -- 172.21.15.115:0/2675369280 >> 172.21.15.115:0/2675369280 conn(0x7f08ec0ff230 msgr2=0x7f08ec0ffe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:57:14.515 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:13.929+0000 7f08f1284640 1 -- 172.21.15.115:0/2675369280 shutdown_connections 2024-09-13T16:57:14.515 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:13.929+0000 7f08f1284640 1 -- 172.21.15.115:0/2675369280 wait complete. 2024-09-13T16:57:14.515 INFO:teuthology.orchestra.run.smithi115.stdout:Deploying grafana service with default placement... 2024-09-13T16:57:15.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:14 smithi115 ceph-mon[27708]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:57:15.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:14 smithi115 ceph-mon[27708]: Saving service prometheus spec with placement count:1 2024-09-13T16:57:15.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:14 smithi115 ceph-mon[27708]: from='mgr.14116 172.21.15.115:0/1701263389' entity='mgr.smithi115.hetcni' 2024-09-13T16:57:16.479 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2024-09-13T16:57:16.479 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:15.675+0000 7f2ec73cd640 1 Processor -- start 2024-09-13T16:57:16.479 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:15.675+0000 7f2ec73cd640 1 -- start start 2024-09-13T16:57:16.479 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:15.675+0000 7f2ec73cd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ec0104300 0x7f2ec0104700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:16.479 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:15.675+0000 7f2ec73cd640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec0104cd0 con 0x7f2ec0104300 2024-09-13T16:57:16.479 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:15.675+0000 7f2ec5169640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ec0104300 0x7f2ec0104700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:16.479 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:15.675+0000 7f2ec5169640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ec0104300 0x7f2ec0104700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49842/0 (socket says 172.21.15.115:49842) 2024-09-13T16:57:16.479 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:15.675+0000 7f2ec5169640 1 -- 172.21.15.115:0/1956937914 learned_addr learned my addr 172.21.15.115:0/1956937914 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T16:57:16.479 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:15.676+0000 7f2ec5169640 1 -- 172.21.15.115:0/1956937914 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ec0105500 con 0x7f2ec0104300 2024-09-13T16:57:16.479 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:15.676+0000 7f2ec5169640 1 --2- 172.21.15.115:0/1956937914 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ec0104300 0x7f2ec0104700 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc009820 tx=0x7f2ebc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc646ea3d9a9bc6f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:16.479 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:15.676+0000 7f2eb7fff640 1 -- 172.21.15.115:0/1956937914 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2ebc02ad40 con 0x7f2ec0104300 2024-09-13T16:57:16.480 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:15.677+0000 7f2eb7fff640 1 -- 172.21.15.115:0/1956937914 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2ebc0328e0 con 0x7f2ec0104300 2024-09-13T16:57:16.480 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:15.677+0000 7f2eb7fff640 1 -- 172.21.15.115:0/1956937914 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2ebc0307d0 con 0x7f2ec0104300 2024-09-13T16:57:16.480 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:15.677+0000 7f2ec73cd640 1 -- 172.21.15.115:0/1956937914 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ec0104300 msgr2=0x7f2ec0104700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:16.480 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:15.677+0000 7f2ec73cd640 1 --2- 172.21.15.115:0/1956937914 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ec0104300 0x7f2ec0104700 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc009820 tx=0x7f2ebc02a270 comp rx=0 tx=0).stop 2024-09-13T16:57:16.480 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:15.677+0000 7f2ec73cd640 1 -- 172.21.15.115:0/1956937914 shutdown_connections 2024-09-13T16:57:16.480 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:15.677+0000 7f2ec73cd640 1 --2- 172.21.15.115:0/1956937914 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ec0104300 0x7f2ec0104700 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:16.480 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:15.677+0000 7f2ec73cd640 1 -- 172.21.15.115:0/1956937914 >> 172.21.15.115:0/1956937914 conn(0x7f2ec00ffaf0 msgr2=0x7f2ec0101f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:57:16.480 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:15.677+0000 7f2ec73cd640 1 -- 172.21.15.115:0/1956937914 shutdown_connections 2024-09-13T16:57:16.480 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:15.677+0000 7f2ec73cd640 1 -- 172.21.15.115:0/1956937914 wait complete. 2024-09-13T16:57:16.480 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:15.678+0000 7f2ec73cd640 1 Processor -- start 2024-09-13T16:57:16.480 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:15.678+0000 7f2ec73cd640 1 -- start start 2024-09-13T16:57:16.480 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:15.678+0000 7f2ec73cd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ec0104300 0x7f2ec018f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:16.481 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:15.678+0000 7f2ec73cd640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec018f9f0 con 0x7f2ec0104300 2024-09-13T16:57:16.481 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:15.678+0000 7f2ec5169640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ec0104300 0x7f2ec018f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:16.481 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:15.678+0000 7f2ec5169640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ec0104300 0x7f2ec018f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49856/0 (socket says 172.21.15.115:49856) 2024-09-13T16:57:16.481 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:15.678+0000 7f2ec5169640 1 -- 172.21.15.115:0/1577131263 learned_addr learned my addr 172.21.15.115:0/1577131263 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T16:57:16.481 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:15.678+0000 7f2ec5169640 1 -- 172.21.15.115:0/1577131263 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ebc0094d0 con 0x7f2ec0104300 2024-09-13T16:57:16.481 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:15.679+0000 7f2ec5169640 1 --2- 172.21.15.115:0/1577131263 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ec0104300 0x7f2ec018f4b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc030380 tx=0x7f2ebc032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:16.481 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:15.679+0000 7f2eb67fc640 1 -- 172.21.15.115:0/1577131263 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2ebc030df0 con 0x7f2ec0104300 2024-09-13T16:57:16.481 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:15.679+0000 7f2eb67fc640 1 -- 172.21.15.115:0/1577131263 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2ebc03b8c0 con 0x7f2ec0104300 2024-09-13T16:57:16.481 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:15.679+0000 7f2eb67fc640 1 -- 172.21.15.115:0/1577131263 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2ebc03a6f0 con 0x7f2ec0104300 2024-09-13T16:57:16.481 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:15.679+0000 7f2ec73cd640 1 -- 172.21.15.115:0/1577131263 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ec018dbe0 con 0x7f2ec0104300 2024-09-13T16:57:16.481 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:15.679+0000 7f2ec73cd640 1 -- 172.21.15.115:0/1577131263 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ec018e000 con 0x7f2ec0104300 2024-09-13T16:57:16.481 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:15.680+0000 7f2eb67fc640 1 -- 172.21.15.115:0/1577131263 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f2ebc039070 con 0x7f2ec0104300 2024-09-13T16:57:16.481 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:15.680+0000 7f2eb67fc640 1 --2- 172.21.15.115:0/1577131263 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7f2eac0386a0 0x7f2eac03ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:16.482 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:15.680+0000 7f2ec73cd640 1 -- 172.21.15.115:0/1577131263 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ec0104700 con 0x7f2ec0104300 2024-09-13T16:57:16.482 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:15.680+0000 7f2eb67fc640 1 -- 172.21.15.115:0/1577131263 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f2ebc06b930 con 0x7f2ec0104300 2024-09-13T16:57:16.482 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:15.680+0000 7f2ec4968640 1 --2- 172.21.15.115:0/1577131263 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7f2eac0386a0 0x7f2eac03ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:16.482 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:15.680+0000 7f2ec4968640 1 --2- 172.21.15.115:0/1577131263 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7f2eac0386a0 0x7f2eac03ab60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2eb00098c0 tx=0x7f2eb0006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:16.482 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:15.685+0000 7f2eb67fc640 1 -- 172.21.15.115:0/1577131263 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f2ebc03be10 con 0x7f2ec0104300 2024-09-13T16:57:16.482 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:15.860+0000 7f2ec73cd640 1 -- 172.21.15.115:0/1577131263 --> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}) v1 -- 0x7f2ec018e770 con 0x7f2eac0386a0 2024-09-13T16:57:16.482 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:15.864+0000 7f2eb67fc640 1 -- 172.21.15.115:0/1577131263 <== mgr.14116 v2:172.21.15.115:6800/2943337696 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7f2ec018e770 con 0x7f2eac0386a0 2024-09-13T16:57:16.482 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:15.866+0000 7f2ec73cd640 1 -- 172.21.15.115:0/1577131263 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7f2eac0386a0 msgr2=0x7f2eac03ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:16.482 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:15.866+0000 7f2ec73cd640 1 --2- 172.21.15.115:0/1577131263 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7f2eac0386a0 0x7f2eac03ab60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2eb00098c0 tx=0x7f2eb0006db0 comp rx=0 tx=0).stop 2024-09-13T16:57:16.482 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:15.866+0000 7f2ec73cd640 1 -- 172.21.15.115:0/1577131263 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ec0104300 msgr2=0x7f2ec018f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:16.482 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:15.866+0000 7f2ec73cd640 1 --2- 172.21.15.115:0/1577131263 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ec0104300 0x7f2ec018f4b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc030380 tx=0x7f2ebc032670 comp rx=0 tx=0).stop 2024-09-13T16:57:16.482 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:15.866+0000 7f2ec73cd640 1 -- 172.21.15.115:0/1577131263 shutdown_connections 2024-09-13T16:57:16.482 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:15.866+0000 7f2ec73cd640 1 --2- 172.21.15.115:0/1577131263 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7f2eac0386a0 0x7f2eac03ab60 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:16.483 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:15.866+0000 7f2ec73cd640 1 --2- 172.21.15.115:0/1577131263 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ec0104300 0x7f2ec018f4b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:16.483 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:15.866+0000 7f2ec73cd640 1 -- 172.21.15.115:0/1577131263 >> 172.21.15.115:0/1577131263 conn(0x7f2ec00ffaf0 msgr2=0x7f2ec0100630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:57:16.483 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:15.866+0000 7f2ec73cd640 1 -- 172.21.15.115:0/1577131263 shutdown_connections 2024-09-13T16:57:16.483 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:15.866+0000 7f2ec73cd640 1 -- 172.21.15.115:0/1577131263 wait complete. 2024-09-13T16:57:16.483 INFO:teuthology.orchestra.run.smithi115.stdout:Deploying node-exporter service with default placement... 2024-09-13T16:57:17.035 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:16 smithi115 ceph-mon[27708]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:57:17.035 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:16 smithi115 ceph-mon[27708]: Saving service grafana spec with placement count:1 2024-09-13T16:57:17.035 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:16 smithi115 ceph-mon[27708]: from='mgr.14116 172.21.15.115:0/1701263389' entity='mgr.smithi115.hetcni' 2024-09-13T16:57:17.669 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2024-09-13T16:57:17.669 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:16.852+0000 7fd369406640 1 Processor -- start 2024-09-13T16:57:17.669 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:16.852+0000 7fd369406640 1 -- start start 2024-09-13T16:57:17.669 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:16.852+0000 7fd369406640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd364104310 0x7fd364104710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:17.669 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:16.852+0000 7fd369406640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd364104ce0 con 0x7fd364104310 2024-09-13T16:57:17.669 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:16.852+0000 7fd362ffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd364104310 0x7fd364104710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:17.669 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:16.853+0000 7fd362ffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd364104310 0x7fd364104710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49864/0 (socket says 172.21.15.115:49864) 2024-09-13T16:57:17.669 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:16.853+0000 7fd362ffd640 1 -- 172.21.15.115:0/1915817371 learned_addr learned my addr 172.21.15.115:0/1915817371 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T16:57:17.669 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:16.853+0000 7fd362ffd640 1 -- 172.21.15.115:0/1915817371 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd364105510 con 0x7fd364104310 2024-09-13T16:57:17.669 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:16.853+0000 7fd362ffd640 1 --2- 172.21.15.115:0/1915817371 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd364104310 0x7fd364104710 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd354009820 tx=0x7fd35402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87aaf781b41526a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:17.669 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:16.854+0000 7fd361ffb640 1 -- 172.21.15.115:0/1915817371 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd35402ad40 con 0x7fd364104310 2024-09-13T16:57:17.670 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:16.854+0000 7fd361ffb640 1 -- 172.21.15.115:0/1915817371 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd3540328e0 con 0x7fd364104310 2024-09-13T16:57:17.670 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:16.854+0000 7fd361ffb640 1 -- 172.21.15.115:0/1915817371 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd3540307d0 con 0x7fd364104310 2024-09-13T16:57:17.670 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:16.854+0000 7fd369406640 1 -- 172.21.15.115:0/1915817371 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd364104310 msgr2=0x7fd364104710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:17.670 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:16.854+0000 7fd369406640 1 --2- 172.21.15.115:0/1915817371 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd364104310 0x7fd364104710 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd354009820 tx=0x7fd35402a270 comp rx=0 tx=0).stop 2024-09-13T16:57:17.670 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:16.854+0000 7fd369406640 1 -- 172.21.15.115:0/1915817371 shutdown_connections 2024-09-13T16:57:17.670 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:16.854+0000 7fd369406640 1 --2- 172.21.15.115:0/1915817371 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd364104310 0x7fd364104710 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:17.670 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:16.854+0000 7fd369406640 1 -- 172.21.15.115:0/1915817371 >> 172.21.15.115:0/1915817371 conn(0x7fd3640ffae0 msgr2=0x7fd364101f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:57:17.670 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:16.854+0000 7fd369406640 1 -- 172.21.15.115:0/1915817371 shutdown_connections 2024-09-13T16:57:17.670 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:16.854+0000 7fd369406640 1 -- 172.21.15.115:0/1915817371 wait complete. 2024-09-13T16:57:17.670 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:16.855+0000 7fd369406640 1 Processor -- start 2024-09-13T16:57:17.670 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:16.855+0000 7fd369406640 1 -- start start 2024-09-13T16:57:17.670 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:16.855+0000 7fd369406640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd364104310 0x7fd364078a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:17.670 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:16.855+0000 7fd369406640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd364078fa0 con 0x7fd364104310 2024-09-13T16:57:17.670 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:16.855+0000 7fd362ffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd364104310 0x7fd364078a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:17.671 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:16.855+0000 7fd362ffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd364104310 0x7fd364078a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49880/0 (socket says 172.21.15.115:49880) 2024-09-13T16:57:17.671 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:16.855+0000 7fd362ffd640 1 -- 172.21.15.115:0/2294329455 learned_addr learned my addr 172.21.15.115:0/2294329455 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T16:57:17.671 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:16.855+0000 7fd362ffd640 1 -- 172.21.15.115:0/2294329455 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3540094d0 con 0x7fd364104310 2024-09-13T16:57:17.671 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:16.856+0000 7fd362ffd640 1 --2- 172.21.15.115:0/2294329455 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd364104310 0x7fd364078a60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd354030380 tx=0x7fd354032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:17.671 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:16.856+0000 7fd34bfff640 1 -- 172.21.15.115:0/2294329455 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd354030ca0 con 0x7fd364104310 2024-09-13T16:57:17.671 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:16.856+0000 7fd34bfff640 1 -- 172.21.15.115:0/2294329455 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd354030e00 con 0x7fd364104310 2024-09-13T16:57:17.671 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:16.856+0000 7fd369406640 1 -- 172.21.15.115:0/2294329455 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd36419bf60 con 0x7fd364104310 2024-09-13T16:57:17.671 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:16.856+0000 7fd34bfff640 1 -- 172.21.15.115:0/2294329455 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd35403a650 con 0x7fd364104310 2024-09-13T16:57:17.671 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:16.856+0000 7fd369406640 1 -- 172.21.15.115:0/2294329455 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd36419c380 con 0x7fd364104310 2024-09-13T16:57:17.671 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:16.857+0000 7fd34bfff640 1 -- 172.21.15.115:0/2294329455 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7fd354039070 con 0x7fd364104310 2024-09-13T16:57:17.671 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:16.857+0000 7fd369406640 1 -- 172.21.15.115:0/2294329455 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd364108740 con 0x7fd364104310 2024-09-13T16:57:17.671 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:16.857+0000 7fd34bfff640 1 --2- 172.21.15.115:0/2294329455 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7fd34c0386a0 0x7fd34c03ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:17.672 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:16.857+0000 7fd34bfff640 1 -- 172.21.15.115:0/2294329455 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fd35406b8e0 con 0x7fd364104310 2024-09-13T16:57:17.672 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:16.857+0000 7fd3627fc640 1 --2- 172.21.15.115:0/2294329455 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7fd34c0386a0 0x7fd34c03ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:17.672 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:16.857+0000 7fd3627fc640 1 --2- 172.21.15.115:0/2294329455 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7fd34c0386a0 0x7fd34c03ab60 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd3580098c0 tx=0x7fd358006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:17.672 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:16.861+0000 7fd34bfff640 1 -- 172.21.15.115:0/2294329455 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd354039320 con 0x7fd364104310 2024-09-13T16:57:17.672 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:17.034+0000 7fd369406640 1 -- 172.21.15.115:0/2294329455 --> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7fd36419c5c0 con 0x7fd34c0386a0 2024-09-13T16:57:17.672 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:17.038+0000 7fd34bfff640 1 -- 172.21.15.115:0/2294329455 <== mgr.14116 v2:172.21.15.115:6800/2943337696 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7fd36419c5c0 con 0x7fd34c0386a0 2024-09-13T16:57:17.672 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:17.040+0000 7fd369406640 1 -- 172.21.15.115:0/2294329455 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7fd34c0386a0 msgr2=0x7fd34c03ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:17.672 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:17.040+0000 7fd369406640 1 --2- 172.21.15.115:0/2294329455 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7fd34c0386a0 0x7fd34c03ab60 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd3580098c0 tx=0x7fd358006db0 comp rx=0 tx=0).stop 2024-09-13T16:57:17.672 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:17.040+0000 7fd369406640 1 -- 172.21.15.115:0/2294329455 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd364104310 msgr2=0x7fd364078a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:17.672 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:17.040+0000 7fd369406640 1 --2- 172.21.15.115:0/2294329455 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd364104310 0x7fd364078a60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd354030380 tx=0x7fd354032670 comp rx=0 tx=0).stop 2024-09-13T16:57:17.672 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:17.040+0000 7fd369406640 1 -- 172.21.15.115:0/2294329455 shutdown_connections 2024-09-13T16:57:17.672 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:17.040+0000 7fd369406640 1 --2- 172.21.15.115:0/2294329455 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7fd34c0386a0 0x7fd34c03ab60 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:17.672 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:17.040+0000 7fd369406640 1 --2- 172.21.15.115:0/2294329455 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd364104310 0x7fd364078a60 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:17.673 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:17.040+0000 7fd369406640 1 -- 172.21.15.115:0/2294329455 >> 172.21.15.115:0/2294329455 conn(0x7fd3640ffae0 msgr2=0x7fd364100680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:57:17.673 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:17.041+0000 7fd369406640 1 -- 172.21.15.115:0/2294329455 shutdown_connections 2024-09-13T16:57:17.673 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:17.041+0000 7fd369406640 1 -- 172.21.15.115:0/2294329455 wait complete. 2024-09-13T16:57:17.673 INFO:teuthology.orchestra.run.smithi115.stdout:Deploying alertmanager service with default placement... 2024-09-13T16:57:18.178 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:18 smithi115 ceph-mon[27708]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:57:18.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:18 smithi115 ceph-mon[27708]: Saving service node-exporter spec with placement * 2024-09-13T16:57:18.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:18 smithi115 ceph-mon[27708]: from='mgr.14116 172.21.15.115:0/1701263389' entity='mgr.smithi115.hetcni' 2024-09-13T16:57:18.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:18 smithi115 ceph-mon[27708]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:57:18.859 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2024-09-13T16:57:18.859 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:18.083+0000 7f7168eef640 1 Processor -- start 2024-09-13T16:57:18.859 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:18.083+0000 7f7168eef640 1 -- start start 2024-09-13T16:57:18.859 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:18.083+0000 7f7168eef640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7164105400 0x7f7164105800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:18.860 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:18.083+0000 7f7168eef640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7164105dd0 con 0x7f7164105400 2024-09-13T16:57:18.860 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:18.083+0000 7f716259c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7164105400 0x7f7164105800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:18.860 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:18.083+0000 7f716259c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7164105400 0x7f7164105800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49892/0 (socket says 172.21.15.115:49892) 2024-09-13T16:57:18.860 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:18.083+0000 7f716259c640 1 -- 172.21.15.115:0/2257991882 learned_addr learned my addr 172.21.15.115:0/2257991882 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T16:57:18.860 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:18.084+0000 7f716259c640 1 -- 172.21.15.115:0/2257991882 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71641065b0 con 0x7f7164105400 2024-09-13T16:57:18.860 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:18.084+0000 7f716259c640 1 --2- 172.21.15.115:0/2257991882 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7164105400 0x7f7164105800 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7154009820 tx=0x7f715402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b8e20a731cb84d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:18.860 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:18.085+0000 7f716159a640 1 -- 172.21.15.115:0/2257991882 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f715402ad40 con 0x7f7164105400 2024-09-13T16:57:18.861 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:18.085+0000 7f716159a640 1 -- 172.21.15.115:0/2257991882 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f71540328e0 con 0x7f7164105400 2024-09-13T16:57:18.862 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:18.085+0000 7f716159a640 1 -- 172.21.15.115:0/2257991882 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f71540307d0 con 0x7f7164105400 2024-09-13T16:57:18.862 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:18.085+0000 7f7168eef640 1 -- 172.21.15.115:0/2257991882 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7164105400 msgr2=0x7f7164105800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:18.862 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:18.085+0000 7f7168eef640 1 --2- 172.21.15.115:0/2257991882 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7164105400 0x7f7164105800 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7154009820 tx=0x7f715402a270 comp rx=0 tx=0).stop 2024-09-13T16:57:18.862 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:18.085+0000 7f7168eef640 1 -- 172.21.15.115:0/2257991882 shutdown_connections 2024-09-13T16:57:18.862 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:18.085+0000 7f7168eef640 1 --2- 172.21.15.115:0/2257991882 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7164105400 0x7f7164105800 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:18.862 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:18.085+0000 7f7168eef640 1 -- 172.21.15.115:0/2257991882 >> 172.21.15.115:0/2257991882 conn(0x7f7164100c30 msgr2=0x7f7164103050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:57:18.862 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:18.085+0000 7f7168eef640 1 -- 172.21.15.115:0/2257991882 shutdown_connections 2024-09-13T16:57:18.862 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:18.085+0000 7f7168eef640 1 -- 172.21.15.115:0/2257991882 wait complete. 2024-09-13T16:57:18.863 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:18.086+0000 7f7168eef640 1 Processor -- start 2024-09-13T16:57:18.863 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:18.086+0000 7f7168eef640 1 -- start start 2024-09-13T16:57:18.863 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:18.086+0000 7f7168eef640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7164105400 0x7f7164199180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:18.863 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:18.086+0000 7f7168eef640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71641996c0 con 0x7f7164105400 2024-09-13T16:57:18.863 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:18.086+0000 7f716259c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7164105400 0x7f7164199180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:18.863 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:18.086+0000 7f716259c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7164105400 0x7f7164199180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49906/0 (socket says 172.21.15.115:49906) 2024-09-13T16:57:18.863 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:18.086+0000 7f716259c640 1 -- 172.21.15.115:0/1017785015 learned_addr learned my addr 172.21.15.115:0/1017785015 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T16:57:18.863 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:18.087+0000 7f716259c640 1 -- 172.21.15.115:0/1017785015 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71540094d0 con 0x7f7164105400 2024-09-13T16:57:18.863 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:18.087+0000 7f716259c640 1 --2- 172.21.15.115:0/1017785015 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7164105400 0x7f7164199180 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7154009940 tx=0x7f7154032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:18.864 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:18.087+0000 7f71537fe640 1 -- 172.21.15.115:0/1017785015 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7154030e40 con 0x7f7164105400 2024-09-13T16:57:18.864 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:18.087+0000 7f71537fe640 1 -- 172.21.15.115:0/1017785015 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f715403b8b0 con 0x7f7164105400 2024-09-13T16:57:18.864 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:18.087+0000 7f7168eef640 1 -- 172.21.15.115:0/1017785015 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71641998c0 con 0x7f7164105400 2024-09-13T16:57:18.864 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:18.087+0000 7f71537fe640 1 -- 172.21.15.115:0/1017785015 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f715403a620 con 0x7f7164105400 2024-09-13T16:57:18.864 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:18.087+0000 7f7168eef640 1 -- 172.21.15.115:0/1017785015 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7164199ce0 con 0x7f7164105400 2024-09-13T16:57:18.864 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:18.088+0000 7f71537fe640 1 -- 172.21.15.115:0/1017785015 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f7154039040 con 0x7f7164105400 2024-09-13T16:57:18.865 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:18.088+0000 7f7168eef640 1 -- 172.21.15.115:0/1017785015 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71641097e0 con 0x7f7164105400 2024-09-13T16:57:18.865 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:18.088+0000 7f71537fe640 1 --2- 172.21.15.115:0/1017785015 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7f714c038650 0x7f714c03ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:18.865 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:18.088+0000 7f71537fe640 1 -- 172.21.15.115:0/1017785015 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f715406b850 con 0x7f7164105400 2024-09-13T16:57:18.865 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:18.088+0000 7f7161d9b640 1 --2- 172.21.15.115:0/1017785015 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7f714c038650 0x7f714c03ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:18.865 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:18.089+0000 7f7161d9b640 1 --2- 172.21.15.115:0/1017785015 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7f714c038650 0x7f714c03ab10 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f71580098c0 tx=0x7f7158006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:18.865 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:18.093+0000 7f71537fe640 1 -- 172.21.15.115:0/1017785015 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f71540319f0 con 0x7f7164105400 2024-09-13T16:57:18.865 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:18.267+0000 7f7168eef640 1 -- 172.21.15.115:0/1017785015 --> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}) v1 -- 0x7f7164101f60 con 0x7f714c038650 2024-09-13T16:57:18.865 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:18.271+0000 7f71537fe640 1 -- 172.21.15.115:0/1017785015 <== mgr.14116 v2:172.21.15.115:6800/2943337696 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7f7164101f60 con 0x7f714c038650 2024-09-13T16:57:18.865 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:18.273+0000 7f7168eef640 1 -- 172.21.15.115:0/1017785015 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7f714c038650 msgr2=0x7f714c03ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:18.865 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:18.274+0000 7f7168eef640 1 --2- 172.21.15.115:0/1017785015 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7f714c038650 0x7f714c03ab10 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f71580098c0 tx=0x7f7158006db0 comp rx=0 tx=0).stop 2024-09-13T16:57:18.865 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:18.274+0000 7f7168eef640 1 -- 172.21.15.115:0/1017785015 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7164105400 msgr2=0x7f7164199180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:18.865 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:18.274+0000 7f7168eef640 1 --2- 172.21.15.115:0/1017785015 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7164105400 0x7f7164199180 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7154009940 tx=0x7f7154032670 comp rx=0 tx=0).stop 2024-09-13T16:57:18.865 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:18.274+0000 7f7168eef640 1 -- 172.21.15.115:0/1017785015 shutdown_connections 2024-09-13T16:57:18.866 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:18.274+0000 7f7168eef640 1 --2- 172.21.15.115:0/1017785015 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7f714c038650 0x7f714c03ab10 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:18.866 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:18.274+0000 7f7168eef640 1 --2- 172.21.15.115:0/1017785015 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7164105400 0x7f7164199180 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:18.866 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:18.274+0000 7f7168eef640 1 -- 172.21.15.115:0/1017785015 >> 172.21.15.115:0/1017785015 conn(0x7f7164100c30 msgr2=0x7f7164101850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:57:18.866 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:18.274+0000 7f7168eef640 1 -- 172.21.15.115:0/1017785015 shutdown_connections 2024-09-13T16:57:18.866 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:18.274+0000 7f7168eef640 1 -- 172.21.15.115:0/1017785015 wait complete. 2024-09-13T16:57:19.438 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:19 smithi115 ceph-mon[27708]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:57:19.438 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:19 smithi115 ceph-mon[27708]: Saving service alertmanager spec with placement count:1 2024-09-13T16:57:19.438 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:19 smithi115 ceph-mon[27708]: from='mgr.14116 172.21.15.115:0/1701263389' entity='mgr.smithi115.hetcni' 2024-09-13T16:57:19.999 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:19.264+0000 7fb556692640 1 Processor -- start 2024-09-13T16:57:19.999 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:19.264+0000 7fb556692640 1 -- start start 2024-09-13T16:57:19.999 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:19.264+0000 7fb556692640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb550105400 0x7fb550105800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:19.999 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:19.264+0000 7fb556692640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb550105dd0 con 0x7fb550105400 2024-09-13T16:57:20.000 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:19.264+0000 7fb54ffff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb550105400 0x7fb550105800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:20.000 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:19.264+0000 7fb54ffff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb550105400 0x7fb550105800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49916/0 (socket says 172.21.15.115:49916) 2024-09-13T16:57:20.000 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:19.264+0000 7fb54ffff640 1 -- 172.21.15.115:0/266884521 learned_addr learned my addr 172.21.15.115:0/266884521 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T16:57:20.000 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:19.265+0000 7fb54ffff640 1 -- 172.21.15.115:0/266884521 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5501065b0 con 0x7fb550105400 2024-09-13T16:57:20.000 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:19.265+0000 7fb54ffff640 1 --2- 172.21.15.115:0/266884521 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb550105400 0x7fb550105800 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb540009820 tx=0x7fb54002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e51d0028118bf28 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:20.000 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:19.266+0000 7fb54effd640 1 -- 172.21.15.115:0/266884521 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb54002ad40 con 0x7fb550105400 2024-09-13T16:57:20.000 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:19.266+0000 7fb54effd640 1 -- 172.21.15.115:0/266884521 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb5400328e0 con 0x7fb550105400 2024-09-13T16:57:20.000 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:19.266+0000 7fb54effd640 1 -- 172.21.15.115:0/266884521 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb5400307d0 con 0x7fb550105400 2024-09-13T16:57:20.000 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:19.266+0000 7fb556692640 1 -- 172.21.15.115:0/266884521 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb550105400 msgr2=0x7fb550105800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:20.000 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:19.266+0000 7fb556692640 1 --2- 172.21.15.115:0/266884521 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb550105400 0x7fb550105800 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb540009820 tx=0x7fb54002a270 comp rx=0 tx=0).stop 2024-09-13T16:57:20.000 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:19.266+0000 7fb556692640 1 -- 172.21.15.115:0/266884521 shutdown_connections 2024-09-13T16:57:20.001 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:19.266+0000 7fb556692640 1 --2- 172.21.15.115:0/266884521 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb550105400 0x7fb550105800 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:20.001 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:19.266+0000 7fb556692640 1 -- 172.21.15.115:0/266884521 >> 172.21.15.115:0/266884521 conn(0x7fb550100c30 msgr2=0x7fb550103050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:57:20.001 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:19.266+0000 7fb556692640 1 -- 172.21.15.115:0/266884521 shutdown_connections 2024-09-13T16:57:20.001 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:19.266+0000 7fb556692640 1 -- 172.21.15.115:0/266884521 wait complete. 2024-09-13T16:57:20.001 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:19.267+0000 7fb556692640 1 Processor -- start 2024-09-13T16:57:20.001 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:19.267+0000 7fb556692640 1 -- start start 2024-09-13T16:57:20.001 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:19.267+0000 7fb556692640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb550105400 0x7fb550199180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:20.001 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:19.267+0000 7fb556692640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5501996c0 con 0x7fb550105400 2024-09-13T16:57:20.001 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:19.267+0000 7fb54ffff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb550105400 0x7fb550199180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:20.001 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:19.267+0000 7fb54ffff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb550105400 0x7fb550199180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49930/0 (socket says 172.21.15.115:49930) 2024-09-13T16:57:20.001 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:19.267+0000 7fb54ffff640 1 -- 172.21.15.115:0/2507001560 learned_addr learned my addr 172.21.15.115:0/2507001560 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T16:57:20.001 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:19.268+0000 7fb54ffff640 1 -- 172.21.15.115:0/2507001560 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5400094d0 con 0x7fb550105400 2024-09-13T16:57:20.001 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:19.268+0000 7fb54ffff640 1 --2- 172.21.15.115:0/2507001560 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb550105400 0x7fb550199180 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb540030380 tx=0x7fb540032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:20.002 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:19.268+0000 7fb54d7fa640 1 -- 172.21.15.115:0/2507001560 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb540030df0 con 0x7fb550105400 2024-09-13T16:57:20.002 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:19.268+0000 7fb556692640 1 -- 172.21.15.115:0/2507001560 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5501998c0 con 0x7fb550105400 2024-09-13T16:57:20.002 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:19.268+0000 7fb54d7fa640 1 -- 172.21.15.115:0/2507001560 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb54003b8c0 con 0x7fb550105400 2024-09-13T16:57:20.002 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:19.268+0000 7fb54d7fa640 1 -- 172.21.15.115:0/2507001560 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb54003a6f0 con 0x7fb550105400 2024-09-13T16:57:20.002 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:19.268+0000 7fb556692640 1 -- 172.21.15.115:0/2507001560 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb550199ce0 con 0x7fb550105400 2024-09-13T16:57:20.002 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:19.269+0000 7fb54d7fa640 1 -- 172.21.15.115:0/2507001560 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7fb540039070 con 0x7fb550105400 2024-09-13T16:57:20.002 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:19.269+0000 7fb556692640 1 -- 172.21.15.115:0/2507001560 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb550105800 con 0x7fb550105400 2024-09-13T16:57:20.002 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:19.269+0000 7fb54d7fa640 1 --2- 172.21.15.115:0/2507001560 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7fb538038650 0x7fb53803ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:20.002 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:19.269+0000 7fb54d7fa640 1 -- 172.21.15.115:0/2507001560 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fb54006b970 con 0x7fb550105400 2024-09-13T16:57:20.002 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:19.269+0000 7fb54f7fe640 1 --2- 172.21.15.115:0/2507001560 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7fb538038650 0x7fb53803ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:20.003 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:19.270+0000 7fb54f7fe640 1 --2- 172.21.15.115:0/2507001560 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7fb538038650 0x7fb53803ab10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb5440098c0 tx=0x7fb544006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:20.003 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:19.274+0000 7fb54d7fa640 1 -- 172.21.15.115:0/2507001560 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fb5400396e0 con 0x7fb550105400 2024-09-13T16:57:20.003 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:19.433+0000 7fb556692640 1 -- 172.21.15.115:0/2507001560 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7fb5501097e0 con 0x7fb550105400 2024-09-13T16:57:20.003 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:19.436+0000 7fb54d7fa640 1 -- 172.21.15.115:0/2507001560 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7fb54003f020 con 0x7fb550105400 2024-09-13T16:57:20.003 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:19.439+0000 7fb556692640 1 -- 172.21.15.115:0/2507001560 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7fb538038650 msgr2=0x7fb53803ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:20.003 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:19.439+0000 7fb556692640 1 --2- 172.21.15.115:0/2507001560 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7fb538038650 0x7fb53803ab10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb5440098c0 tx=0x7fb544006db0 comp rx=0 tx=0).stop 2024-09-13T16:57:20.003 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:19.439+0000 7fb556692640 1 -- 172.21.15.115:0/2507001560 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb550105400 msgr2=0x7fb550199180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:20.003 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:19.439+0000 7fb556692640 1 --2- 172.21.15.115:0/2507001560 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb550105400 0x7fb550199180 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb540030380 tx=0x7fb540032670 comp rx=0 tx=0).stop 2024-09-13T16:57:20.004 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:19.440+0000 7fb556692640 1 -- 172.21.15.115:0/2507001560 shutdown_connections 2024-09-13T16:57:20.004 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:19.440+0000 7fb556692640 1 --2- 172.21.15.115:0/2507001560 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7fb538038650 0x7fb53803ab10 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:20.004 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:19.440+0000 7fb556692640 1 --2- 172.21.15.115:0/2507001560 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb550105400 0x7fb550199180 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:20.004 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:19.440+0000 7fb556692640 1 -- 172.21.15.115:0/2507001560 >> 172.21.15.115:0/2507001560 conn(0x7fb550100c30 msgr2=0x7fb550101850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:57:20.004 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:19.440+0000 7fb556692640 1 -- 172.21.15.115:0/2507001560 shutdown_connections 2024-09-13T16:57:20.004 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:19.440+0000 7fb556692640 1 -- 172.21.15.115:0/2507001560 wait complete. 2024-09-13T16:57:20.533 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:20 smithi115 ceph-mon[27708]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:57:20.533 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:20 smithi115 ceph-mon[27708]: from='client.? 172.21.15.115:0/2507001560' entity='client.admin' 2024-09-13T16:57:21.112 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:20.361+0000 7f19d6490640 1 Processor -- start 2024-09-13T16:57:21.113 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:20.361+0000 7f19d6490640 1 -- start start 2024-09-13T16:57:21.113 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:20.361+0000 7f19d6490640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19d007ae60 0x7f19d0079310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:21.113 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:20.361+0000 7f19d6490640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d0079850 con 0x7f19d007ae60 2024-09-13T16:57:21.113 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:20.361+0000 7f19cffff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19d007ae60 0x7f19d0079310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:21.113 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:20.361+0000 7f19cffff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19d007ae60 0x7f19d0079310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49946/0 (socket says 172.21.15.115:49946) 2024-09-13T16:57:21.113 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:20.361+0000 7f19cffff640 1 -- 172.21.15.115:0/1433705354 learned_addr learned my addr 172.21.15.115:0/1433705354 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T16:57:21.113 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:20.361+0000 7f19cffff640 1 -- 172.21.15.115:0/1433705354 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19d0079990 con 0x7f19d007ae60 2024-09-13T16:57:21.113 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:20.362+0000 7f19cffff640 1 --2- 172.21.15.115:0/1433705354 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19d007ae60 0x7f19d0079310 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f19c0009820 tx=0x7f19c002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76423dd314ca998a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:21.113 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:20.362+0000 7f19ceffd640 1 -- 172.21.15.115:0/1433705354 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f19c002add0 con 0x7f19d007ae60 2024-09-13T16:57:21.113 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:20.362+0000 7f19ceffd640 1 -- 172.21.15.115:0/1433705354 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f19c00328e0 con 0x7f19d007ae60 2024-09-13T16:57:21.113 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:20.362+0000 7f19ceffd640 1 -- 172.21.15.115:0/1433705354 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f19c00308a0 con 0x7f19d007ae60 2024-09-13T16:57:21.113 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:20.363+0000 7f19d6490640 1 -- 172.21.15.115:0/1433705354 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19d007ae60 msgr2=0x7f19d0079310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:21.113 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:20.363+0000 7f19d6490640 1 --2- 172.21.15.115:0/1433705354 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19d007ae60 0x7f19d0079310 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f19c0009820 tx=0x7f19c002a300 comp rx=0 tx=0).stop 2024-09-13T16:57:21.114 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:20.363+0000 7f19d6490640 1 -- 172.21.15.115:0/1433705354 shutdown_connections 2024-09-13T16:57:21.114 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:20.363+0000 7f19d6490640 1 --2- 172.21.15.115:0/1433705354 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19d007ae60 0x7f19d0079310 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:21.114 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:20.363+0000 7f19d6490640 1 -- 172.21.15.115:0/1433705354 >> 172.21.15.115:0/1433705354 conn(0x7f19d0100c40 msgr2=0x7f19d0103060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:57:21.114 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:20.363+0000 7f19d6490640 1 -- 172.21.15.115:0/1433705354 shutdown_connections 2024-09-13T16:57:21.114 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:20.363+0000 7f19d6490640 1 -- 172.21.15.115:0/1433705354 wait complete. 2024-09-13T16:57:21.114 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:20.363+0000 7f19d6490640 1 Processor -- start 2024-09-13T16:57:21.114 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:20.363+0000 7f19d6490640 1 -- start start 2024-09-13T16:57:21.114 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:20.364+0000 7f19d6490640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19d007ae60 0x7f19d019b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:21.114 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:20.364+0000 7f19d6490640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d019b7f0 con 0x7f19d007ae60 2024-09-13T16:57:21.114 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:20.364+0000 7f19cffff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19d007ae60 0x7f19d019b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:21.114 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:20.364+0000 7f19cffff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19d007ae60 0x7f19d019b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49954/0 (socket says 172.21.15.115:49954) 2024-09-13T16:57:21.114 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:20.364+0000 7f19cffff640 1 -- 172.21.15.115:0/780480739 learned_addr learned my addr 172.21.15.115:0/780480739 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T16:57:21.114 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:20.364+0000 7f19cffff640 1 -- 172.21.15.115:0/780480739 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19c00094d0 con 0x7f19d007ae60 2024-09-13T16:57:21.115 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:20.364+0000 7f19cffff640 1 --2- 172.21.15.115:0/780480739 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19d007ae60 0x7f19d019b2b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f19c0006f10 tx=0x7f19c0030910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:21.115 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:20.364+0000 7f19cd7fa640 1 -- 172.21.15.115:0/780480739 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f19c0030d30 con 0x7f19d007ae60 2024-09-13T16:57:21.115 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:20.364+0000 7f19cd7fa640 1 -- 172.21.15.115:0/780480739 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f19c0030e90 con 0x7f19d007ae60 2024-09-13T16:57:21.115 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:20.364+0000 7f19d6490640 1 -- 172.21.15.115:0/780480739 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19d019b9f0 con 0x7f19d007ae60 2024-09-13T16:57:21.115 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:20.364+0000 7f19cd7fa640 1 -- 172.21.15.115:0/780480739 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f19c003c850 con 0x7f19d007ae60 2024-09-13T16:57:21.115 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:20.364+0000 7f19d6490640 1 -- 172.21.15.115:0/780480739 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19d019be90 con 0x7f19d007ae60 2024-09-13T16:57:21.115 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:20.365+0000 7f19d6490640 1 -- 172.21.15.115:0/780480739 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19d010b710 con 0x7f19d007ae60 2024-09-13T16:57:21.115 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:20.365+0000 7f19cd7fa640 1 -- 172.21.15.115:0/780480739 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f19c003d480 con 0x7f19d007ae60 2024-09-13T16:57:21.115 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:20.366+0000 7f19cd7fa640 1 --2- 172.21.15.115:0/780480739 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7f19b8038650 0x7f19b803ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:21.116 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:20.366+0000 7f19cd7fa640 1 -- 172.21.15.115:0/780480739 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f19c006bc80 con 0x7f19d007ae60 2024-09-13T16:57:21.116 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:20.366+0000 7f19cf7fe640 1 --2- 172.21.15.115:0/780480739 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7f19b8038650 0x7f19b803ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:21.116 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:20.366+0000 7f19cf7fe640 1 --2- 172.21.15.115:0/780480739 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7f19b8038650 0x7f19b803ab10 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f19c40098c0 tx=0x7f19c4006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:21.116 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:20.370+0000 7f19cd7fa640 1 -- 172.21.15.115:0/780480739 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f19c003ca90 con 0x7f19d007ae60 2024-09-13T16:57:21.116 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:20.531+0000 7f19d6490640 1 -- 172.21.15.115:0/780480739 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f19d010b950 con 0x7f19d007ae60 2024-09-13T16:57:21.117 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:20.536+0000 7f19cd7fa640 1 -- 172.21.15.115:0/780480739 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7f19c00313a0 con 0x7f19d007ae60 2024-09-13T16:57:21.117 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:20.538+0000 7f19d6490640 1 -- 172.21.15.115:0/780480739 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7f19b8038650 msgr2=0x7f19b803ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:21.117 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:20.538+0000 7f19d6490640 1 --2- 172.21.15.115:0/780480739 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7f19b8038650 0x7f19b803ab10 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f19c40098c0 tx=0x7f19c4006db0 comp rx=0 tx=0).stop 2024-09-13T16:57:21.117 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:20.538+0000 7f19d6490640 1 -- 172.21.15.115:0/780480739 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19d007ae60 msgr2=0x7f19d019b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:21.117 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:20.538+0000 7f19d6490640 1 --2- 172.21.15.115:0/780480739 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19d007ae60 0x7f19d019b2b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f19c0006f10 tx=0x7f19c0030910 comp rx=0 tx=0).stop 2024-09-13T16:57:21.117 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:20.538+0000 7f19d6490640 1 -- 172.21.15.115:0/780480739 shutdown_connections 2024-09-13T16:57:21.117 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:20.538+0000 7f19d6490640 1 --2- 172.21.15.115:0/780480739 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7f19b8038650 0x7f19b803ab10 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:21.117 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:20.538+0000 7f19d6490640 1 --2- 172.21.15.115:0/780480739 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19d007ae60 0x7f19d019b2b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:21.117 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:20.538+0000 7f19d6490640 1 -- 172.21.15.115:0/780480739 >> 172.21.15.115:0/780480739 conn(0x7f19d0100c40 msgr2=0x7f19d01017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:57:21.118 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:20.538+0000 7f19d6490640 1 -- 172.21.15.115:0/780480739 shutdown_connections 2024-09-13T16:57:21.118 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:20.538+0000 7f19d6490640 1 -- 172.21.15.115:0/780480739 wait complete. 2024-09-13T16:57:21.118 INFO:teuthology.orchestra.run.smithi115.stdout:Enabling the dashboard module... 2024-09-13T16:57:21.736 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:21 smithi115 ceph-mon[27708]: from='client.? 172.21.15.115:0/780480739' entity='client.admin' 2024-09-13T16:57:21.736 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:21 smithi115 ceph-mon[27708]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:57:22.903 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:22 smithi115 ceph-mon[27708]: from='client.? 172.21.15.115:0/3069752750' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-13T16:57:23.292 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:21.516+0000 7fca6c9c3640 1 Processor -- start 2024-09-13T16:57:23.292 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:21.516+0000 7fca6c9c3640 1 -- start start 2024-09-13T16:57:23.292 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:21.516+0000 7fca6c9c3640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca681053c0 0x7fca681057c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:23.292 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:21.516+0000 7fca6c9c3640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca68105d90 con 0x7fca681053c0 2024-09-13T16:57:23.293 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:21.517+0000 7fca6659c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca681053c0 0x7fca681057c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:23.293 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:21.517+0000 7fca6659c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca681053c0 0x7fca681057c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49966/0 (socket says 172.21.15.115:49966) 2024-09-13T16:57:23.293 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:21.517+0000 7fca6659c640 1 -- 172.21.15.115:0/345137208 learned_addr learned my addr 172.21.15.115:0/345137208 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T16:57:23.293 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:21.517+0000 7fca6659c640 1 -- 172.21.15.115:0/345137208 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca68106570 con 0x7fca681053c0 2024-09-13T16:57:23.293 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:21.517+0000 7fca6659c640 1 --2- 172.21.15.115:0/345137208 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca681053c0 0x7fca681057c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fca58009e80 tx=0x7fca5802a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=679c39a2e4d730 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:23.293 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:21.518+0000 7fca6559a640 1 -- 172.21.15.115:0/345137208 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fca58031400 con 0x7fca681053c0 2024-09-13T16:57:23.301 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:21.518+0000 7fca6559a640 1 -- 172.21.15.115:0/345137208 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fca5802d050 con 0x7fca681053c0 2024-09-13T16:57:23.301 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:21.518+0000 7fca6559a640 1 -- 172.21.15.115:0/345137208 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fca580078e0 con 0x7fca681053c0 2024-09-13T16:57:23.302 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:21.518+0000 7fca6c9c3640 1 -- 172.21.15.115:0/345137208 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca681053c0 msgr2=0x7fca681057c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:23.302 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:21.518+0000 7fca6c9c3640 1 --2- 172.21.15.115:0/345137208 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca681053c0 0x7fca681057c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fca58009e80 tx=0x7fca5802a7a0 comp rx=0 tx=0).stop 2024-09-13T16:57:23.302 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:21.518+0000 7fca6c9c3640 1 -- 172.21.15.115:0/345137208 shutdown_connections 2024-09-13T16:57:23.302 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:21.518+0000 7fca6c9c3640 1 --2- 172.21.15.115:0/345137208 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca681053c0 0x7fca681057c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:23.302 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:21.518+0000 7fca6c9c3640 1 -- 172.21.15.115:0/345137208 >> 172.21.15.115:0/345137208 conn(0x7fca68100bd0 msgr2=0x7fca68102ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:57:23.302 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:21.518+0000 7fca6c9c3640 1 -- 172.21.15.115:0/345137208 shutdown_connections 2024-09-13T16:57:23.302 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:21.518+0000 7fca6c9c3640 1 -- 172.21.15.115:0/345137208 wait complete. 2024-09-13T16:57:23.303 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:21.519+0000 7fca6c9c3640 1 Processor -- start 2024-09-13T16:57:23.303 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:21.519+0000 7fca6c9c3640 1 -- start start 2024-09-13T16:57:23.303 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:21.519+0000 7fca6c9c3640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca681053c0 0x7fca6807ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:23.303 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:21.519+0000 7fca6c9c3640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca6807b0c0 con 0x7fca681053c0 2024-09-13T16:57:23.303 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:21.519+0000 7fca6659c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca681053c0 0x7fca6807ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:23.303 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:21.519+0000 7fca6659c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca681053c0 0x7fca6807ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49970/0 (socket says 172.21.15.115:49970) 2024-09-13T16:57:23.303 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:21.519+0000 7fca6659c640 1 -- 172.21.15.115:0/3069752750 learned_addr learned my addr 172.21.15.115:0/3069752750 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T16:57:23.304 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:21.520+0000 7fca6659c640 1 -- 172.21.15.115:0/3069752750 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca58009b30 con 0x7fca681053c0 2024-09-13T16:57:23.304 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:21.520+0000 7fca6659c640 1 --2- 172.21.15.115:0/3069752750 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca681053c0 0x7fca6807ab80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fca58009fa0 tx=0x7fca58031610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:23.304 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:21.520+0000 7fca5f7fe640 1 -- 172.21.15.115:0/3069752750 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fca58031b80 con 0x7fca681053c0 2024-09-13T16:57:23.304 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:21.520+0000 7fca5f7fe640 1 -- 172.21.15.115:0/3069752750 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fca58031ce0 con 0x7fca681053c0 2024-09-13T16:57:23.304 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:21.520+0000 7fca6c9c3640 1 -- 172.21.15.115:0/3069752750 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca680792b0 con 0x7fca681053c0 2024-09-13T16:57:23.304 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:21.520+0000 7fca5f7fe640 1 -- 172.21.15.115:0/3069752750 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fca5803a740 con 0x7fca681053c0 2024-09-13T16:57:23.304 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:21.520+0000 7fca6c9c3640 1 -- 172.21.15.115:0/3069752750 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca680797b0 con 0x7fca681053c0 2024-09-13T16:57:23.305 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:21.521+0000 7fca5f7fe640 1 -- 172.21.15.115:0/3069752750 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7fca58038040 con 0x7fca681053c0 2024-09-13T16:57:23.305 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:21.521+0000 7fca5f7fe640 1 --2- 172.21.15.115:0/3069752750 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7fca540386a0 0x7fca5403ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:23.305 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:21.521+0000 7fca5f7fe640 1 -- 172.21.15.115:0/3069752750 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fca5806ba10 con 0x7fca681053c0 2024-09-13T16:57:23.305 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:21.521+0000 7fca6c9c3640 1 -- 172.21.15.115:0/3069752750 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca681057c0 con 0x7fca681053c0 2024-09-13T16:57:23.305 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:21.521+0000 7fca65d9b640 1 --2- 172.21.15.115:0/3069752750 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7fca540386a0 0x7fca5403ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:23.305 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:21.521+0000 7fca65d9b640 1 --2- 172.21.15.115:0/3069752750 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7fca540386a0 0x7fca5403ab60 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fca500098c0 tx=0x7fca50006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:23.306 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:21.526+0000 7fca5f7fe640 1 -- 172.21.15.115:0/3069752750 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fca58040080 con 0x7fca681053c0 2024-09-13T16:57:23.306 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:21.733+0000 7fca6c9c3640 1 -- 172.21.15.115:0/3069752750 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7fca68109770 con 0x7fca681053c0 2024-09-13T16:57:23.306 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:22.542+0000 7fca5f7fe640 1 -- 172.21.15.115:0/3069752750 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mgrmap(e 9) v1 ==== 45569+0+0 (secure 0 0 0) 0x7fca58039d50 con 0x7fca681053c0 2024-09-13T16:57:23.306 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:22.544+0000 7fca5f7fe640 1 -- 172.21.15.115:0/3069752750 <== mon.0 v2:172.21.15.115:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7fca58044400 con 0x7fca681053c0 2024-09-13T16:57:23.306 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:22.546+0000 7fca6c9c3640 1 -- 172.21.15.115:0/3069752750 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7fca540386a0 msgr2=0x7fca5403ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:23.306 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:22.546+0000 7fca6c9c3640 1 --2- 172.21.15.115:0/3069752750 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7fca540386a0 0x7fca5403ab60 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fca500098c0 tx=0x7fca50006db0 comp rx=0 tx=0).stop 2024-09-13T16:57:23.306 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:22.546+0000 7fca6c9c3640 1 -- 172.21.15.115:0/3069752750 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca681053c0 msgr2=0x7fca6807ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:23.307 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:22.546+0000 7fca6c9c3640 1 --2- 172.21.15.115:0/3069752750 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca681053c0 0x7fca6807ab80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fca58009fa0 tx=0x7fca58031610 comp rx=0 tx=0).stop 2024-09-13T16:57:23.307 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:22.546+0000 7fca6c9c3640 1 -- 172.21.15.115:0/3069752750 shutdown_connections 2024-09-13T16:57:23.307 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:22.546+0000 7fca6c9c3640 1 --2- 172.21.15.115:0/3069752750 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7fca540386a0 0x7fca5403ab60 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:23.307 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:22.546+0000 7fca6c9c3640 1 --2- 172.21.15.115:0/3069752750 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca681053c0 0x7fca6807ab80 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:23.307 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:22.546+0000 7fca6c9c3640 1 -- 172.21.15.115:0/3069752750 >> 172.21.15.115:0/3069752750 conn(0x7fca68100bd0 msgr2=0x7fca681017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:57:23.307 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:22.546+0000 7fca6c9c3640 1 -- 172.21.15.115:0/3069752750 shutdown_connections 2024-09-13T16:57:23.307 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:22.546+0000 7fca6c9c3640 1 -- 172.21.15.115:0/3069752750 wait complete. 2024-09-13T16:57:23.826 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:23 smithi115 ceph-mon[27708]: from='client.? 172.21.15.115:0/3069752750' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-13T16:57:23.827 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:23 smithi115 ceph-mon[27708]: mgrmap e9: smithi115.hetcni(active, since 25s) 2024-09-13T16:57:24.524 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout { 2024-09-13T16:57:24.524 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-13T16:57:24.524 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-13T16:57:24.525 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "active_name": "smithi115.hetcni", 2024-09-13T16:57:24.525 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-13T16:57:24.525 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout } 2024-09-13T16:57:24.525 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:23.699+0000 7fa83b34e640 1 Processor -- start 2024-09-13T16:57:24.525 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:23.699+0000 7fa83b34e640 1 -- start start 2024-09-13T16:57:24.525 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:23.700+0000 7fa83b34e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa834105410 0x7fa834105810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:24.525 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:23.700+0000 7fa83b34e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa834105de0 con 0x7fa834105410 2024-09-13T16:57:24.525 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:23.700+0000 7fa8390ea640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa834105410 0x7fa834105810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:24.525 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:23.700+0000 7fa8390ea640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa834105410 0x7fa834105810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50012/0 (socket says 172.21.15.115:50012) 2024-09-13T16:57:24.525 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:23.700+0000 7fa8390ea640 1 -- 172.21.15.115:0/2691893110 learned_addr learned my addr 172.21.15.115:0/2691893110 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T16:57:24.526 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:23.700+0000 7fa8390ea640 1 -- 172.21.15.115:0/2691893110 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8341065c0 con 0x7fa834105410 2024-09-13T16:57:24.526 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:23.701+0000 7fa8390ea640 1 --2- 172.21.15.115:0/2691893110 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa834105410 0x7fa834105810 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa830009820 tx=0x7fa83002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc3f633cfa1e48a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:24.526 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:23.701+0000 7fa82bfff640 1 -- 172.21.15.115:0/2691893110 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa83002ad40 con 0x7fa834105410 2024-09-13T16:57:24.526 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:23.701+0000 7fa82bfff640 1 -- 172.21.15.115:0/2691893110 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa8300328e0 con 0x7fa834105410 2024-09-13T16:57:24.526 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:23.701+0000 7fa82bfff640 1 -- 172.21.15.115:0/2691893110 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa8300307d0 con 0x7fa834105410 2024-09-13T16:57:24.526 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:23.702+0000 7fa83b34e640 1 -- 172.21.15.115:0/2691893110 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa834105410 msgr2=0x7fa834105810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:24.526 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:23.702+0000 7fa83b34e640 1 --2- 172.21.15.115:0/2691893110 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa834105410 0x7fa834105810 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa830009820 tx=0x7fa83002a270 comp rx=0 tx=0).stop 2024-09-13T16:57:24.526 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:23.702+0000 7fa83b34e640 1 -- 172.21.15.115:0/2691893110 shutdown_connections 2024-09-13T16:57:24.526 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:23.702+0000 7fa83b34e640 1 --2- 172.21.15.115:0/2691893110 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa834105410 0x7fa834105810 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:24.526 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:23.702+0000 7fa83b34e640 1 -- 172.21.15.115:0/2691893110 >> 172.21.15.115:0/2691893110 conn(0x7fa834100c00 msgr2=0x7fa834103020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:57:24.526 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:23.702+0000 7fa83b34e640 1 -- 172.21.15.115:0/2691893110 shutdown_connections 2024-09-13T16:57:24.526 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:23.702+0000 7fa83b34e640 1 -- 172.21.15.115:0/2691893110 wait complete. 2024-09-13T16:57:24.527 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:23.702+0000 7fa83b34e640 1 Processor -- start 2024-09-13T16:57:24.527 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:23.702+0000 7fa83b34e640 1 -- start start 2024-09-13T16:57:24.527 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:23.702+0000 7fa83b34e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa834105410 0x7fa8341990d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:24.527 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:23.702+0000 7fa83b34e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa834199610 con 0x7fa834105410 2024-09-13T16:57:24.527 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:23.703+0000 7fa8390ea640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa834105410 0x7fa8341990d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:24.527 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:23.703+0000 7fa8390ea640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa834105410 0x7fa8341990d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50022/0 (socket says 172.21.15.115:50022) 2024-09-13T16:57:24.527 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:23.703+0000 7fa8390ea640 1 -- 172.21.15.115:0/2201709434 learned_addr learned my addr 172.21.15.115:0/2201709434 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T16:57:24.527 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:23.703+0000 7fa8390ea640 1 -- 172.21.15.115:0/2201709434 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8300094d0 con 0x7fa834105410 2024-09-13T16:57:24.527 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:23.703+0000 7fa8390ea640 1 --2- 172.21.15.115:0/2201709434 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa834105410 0x7fa8341990d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa8300097f0 tx=0x7fa830032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:24.528 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:23.703+0000 7fa82a7fc640 1 -- 172.21.15.115:0/2201709434 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa830030df0 con 0x7fa834105410 2024-09-13T16:57:24.528 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:23.703+0000 7fa82a7fc640 1 -- 172.21.15.115:0/2201709434 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa83003b8b0 con 0x7fa834105410 2024-09-13T16:57:24.528 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:23.703+0000 7fa83b34e640 1 -- 172.21.15.115:0/2201709434 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa834199810 con 0x7fa834105410 2024-09-13T16:57:24.528 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:23.703+0000 7fa83b34e640 1 -- 172.21.15.115:0/2201709434 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa834199c30 con 0x7fa834105410 2024-09-13T16:57:24.528 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:23.704+0000 7fa82a7fc640 1 -- 172.21.15.115:0/2201709434 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa83003a7a0 con 0x7fa834105410 2024-09-13T16:57:24.528 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:23.704+0000 7fa82a7fc640 1 -- 172.21.15.115:0/2201709434 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 9) v1 ==== 45569+0+0 (secure 0 0 0) 0x7fa830039040 con 0x7fa834105410 2024-09-13T16:57:24.528 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:23.704+0000 7fa83b34e640 1 -- 172.21.15.115:0/2201709434 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa818005280 con 0x7fa834105410 2024-09-13T16:57:24.528 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:23.704+0000 7fa82a7fc640 1 --2- 172.21.15.115:0/2201709434 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7fa8200386a0 0x7fa82003ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:24.528 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:23.704+0000 7fa8388e9640 1 -- 172.21.15.115:0/2201709434 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7fa8200386a0 msgr2=0x7fa82003ab60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6800/2943337696 2024-09-13T16:57:24.529 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:23.704+0000 7fa82a7fc640 1 -- 172.21.15.115:0/2201709434 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fa83003b680 con 0x7fa834105410 2024-09-13T16:57:24.529 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:23.705+0000 7fa8388e9640 1 --2- 172.21.15.115:0/2201709434 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7fa8200386a0 0x7fa82003ab60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T16:57:24.529 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:23.709+0000 7fa82a7fc640 1 -- 172.21.15.115:0/2201709434 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa830041900 con 0x7fa834105410 2024-09-13T16:57:24.529 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:23.906+0000 7fa8388e9640 1 -- 172.21.15.115:0/2201709434 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7fa8200386a0 msgr2=0x7fa82003ab60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6800/2943337696 2024-09-13T16:57:24.529 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:23.906+0000 7fa8388e9640 1 --2- 172.21.15.115:0/2201709434 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7fa8200386a0 0x7fa82003ab60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T16:57:24.529 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:23.920+0000 7fa83b34e640 1 -- 172.21.15.115:0/2201709434 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fa818005d40 con 0x7fa834105410 2024-09-13T16:57:24.529 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:23.920+0000 7fa82a7fc640 1 -- 172.21.15.115:0/2201709434 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+103 (secure 0 0 0) 0x7fa83003f030 con 0x7fa834105410 2024-09-13T16:57:24.529 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:23.922+0000 7fa83b34e640 1 -- 172.21.15.115:0/2201709434 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7fa8200386a0 msgr2=0x7fa82003ab60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T16:57:24.529 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:23.922+0000 7fa83b34e640 1 --2- 172.21.15.115:0/2201709434 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7fa8200386a0 0x7fa82003ab60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:24.529 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:23.922+0000 7fa83b34e640 1 -- 172.21.15.115:0/2201709434 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa834105410 msgr2=0x7fa8341990d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:24.529 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:23.922+0000 7fa83b34e640 1 --2- 172.21.15.115:0/2201709434 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa834105410 0x7fa8341990d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa8300097f0 tx=0x7fa830032670 comp rx=0 tx=0).stop 2024-09-13T16:57:24.529 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:23.922+0000 7fa83b34e640 1 -- 172.21.15.115:0/2201709434 shutdown_connections 2024-09-13T16:57:24.530 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:23.922+0000 7fa83b34e640 1 --2- 172.21.15.115:0/2201709434 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7fa8200386a0 0x7fa82003ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:24.530 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:23.922+0000 7fa83b34e640 1 --2- 172.21.15.115:0/2201709434 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa834105410 0x7fa8341990d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:24.530 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:23.922+0000 7fa83b34e640 1 -- 172.21.15.115:0/2201709434 >> 172.21.15.115:0/2201709434 conn(0x7fa834100c00 msgr2=0x7fa834101710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:57:24.530 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:23.922+0000 7fa83b34e640 1 -- 172.21.15.115:0/2201709434 shutdown_connections 2024-09-13T16:57:24.530 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:23.922+0000 7fa83b34e640 1 -- 172.21.15.115:0/2201709434 wait complete. 2024-09-13T16:57:24.530 INFO:teuthology.orchestra.run.smithi115.stdout:Waiting for the mgr to restart... 2024-09-13T16:57:24.530 INFO:teuthology.orchestra.run.smithi115.stdout:Waiting for mgr epoch 9... 2024-09-13T16:57:24.788 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:24 smithi115 ceph-mon[27708]: from='client.? 172.21.15.115:0/2201709434' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-13T16:57:27.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:27 smithi115 ceph-mon[27708]: Active manager daemon smithi115.hetcni restarted 2024-09-13T16:57:27.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:27 smithi115 ceph-mon[27708]: Activating manager daemon smithi115.hetcni 2024-09-13T16:57:27.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:27 smithi115 ceph-mon[27708]: osdmap e3: 0 total, 0 up, 0 in 2024-09-13T16:57:27.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:27 smithi115 ceph-mon[27708]: mgrmap e10: smithi115.hetcni(active, starting, since 0.0030237s) 2024-09-13T16:57:27.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:27 smithi115 ceph-mon[27708]: from='mgr.14160 172.21.15.115:0/3221480175' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mon metadata", "id": "smithi115"}]: dispatch 2024-09-13T16:57:27.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:27 smithi115 ceph-mon[27708]: from='mgr.14160 172.21.15.115:0/3221480175' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mgr metadata", "who": "smithi115.hetcni", "id": "smithi115.hetcni"}]: dispatch 2024-09-13T16:57:27.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:27 smithi115 ceph-mon[27708]: from='mgr.14160 172.21.15.115:0/3221480175' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T16:57:27.680 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:27 smithi115 ceph-mon[27708]: from='mgr.14160 172.21.15.115:0/3221480175' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T16:57:27.680 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:27 smithi115 ceph-mon[27708]: from='mgr.14160 172.21.15.115:0/3221480175' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T16:57:27.680 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:27 smithi115 ceph-mon[27708]: Manager daemon smithi115.hetcni is now available 2024-09-13T16:57:27.680 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:27 smithi115 ceph-mon[27708]: from='mgr.14160 172.21.15.115:0/3221480175' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:57:27.680 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:27 smithi115 ceph-mon[27708]: from='mgr.14160 172.21.15.115:0/3221480175' entity='mgr.smithi115.hetcni' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi115.hetcni/mirror_snapshot_schedule"}]: dispatch 2024-09-13T16:57:27.680 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:27 smithi115 ceph-mon[27708]: from='mgr.14160 172.21.15.115:0/3221480175' entity='mgr.smithi115.hetcni' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi115.hetcni/trash_purge_schedule"}]: dispatch 2024-09-13T16:57:29.020 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout { 2024-09-13T16:57:29.021 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-13T16:57:29.021 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-13T16:57:29.021 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout } 2024-09-13T16:57:29.021 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:24.907+0000 7fa6c074c640 1 Processor -- start 2024-09-13T16:57:29.021 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:24.907+0000 7fa6c074c640 1 -- start start 2024-09-13T16:57:29.021 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:24.907+0000 7fa6c074c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6b8104300 0x7fa6b8104700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:29.021 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:24.907+0000 7fa6c074c640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b8104cd0 con 0x7fa6b8104300 2024-09-13T16:57:29.021 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:24.907+0000 7fa6be4e8640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6b8104300 0x7fa6b8104700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:29.021 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:24.907+0000 7fa6be4e8640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6b8104300 0x7fa6b8104700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:36388/0 (socket says 172.21.15.115:36388) 2024-09-13T16:57:29.021 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:24.907+0000 7fa6be4e8640 1 -- 172.21.15.115:0/3420198397 learned_addr learned my addr 172.21.15.115:0/3420198397 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T16:57:29.021 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:24.908+0000 7fa6be4e8640 1 -- 172.21.15.115:0/3420198397 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6b8105500 con 0x7fa6b8104300 2024-09-13T16:57:29.021 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:24.908+0000 7fa6be4e8640 1 --2- 172.21.15.115:0/3420198397 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6b8104300 0x7fa6b8104700 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa6b4009820 tx=0x7fa6b402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e55e95cbb406ca7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:29.022 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:24.909+0000 7fa6bd4e6640 1 -- 172.21.15.115:0/3420198397 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa6b402ad40 con 0x7fa6b8104300 2024-09-13T16:57:29.022 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:24.909+0000 7fa6bd4e6640 1 -- 172.21.15.115:0/3420198397 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa6b40328e0 con 0x7fa6b8104300 2024-09-13T16:57:29.022 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:24.909+0000 7fa6bd4e6640 1 -- 172.21.15.115:0/3420198397 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa6b40307d0 con 0x7fa6b8104300 2024-09-13T16:57:29.022 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:24.909+0000 7fa6c074c640 1 -- 172.21.15.115:0/3420198397 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6b8104300 msgr2=0x7fa6b8104700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:29.022 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:24.909+0000 7fa6c074c640 1 --2- 172.21.15.115:0/3420198397 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6b8104300 0x7fa6b8104700 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa6b4009820 tx=0x7fa6b402a270 comp rx=0 tx=0).stop 2024-09-13T16:57:29.022 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:24.909+0000 7fa6c074c640 1 -- 172.21.15.115:0/3420198397 shutdown_connections 2024-09-13T16:57:29.022 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:24.909+0000 7fa6c074c640 1 --2- 172.21.15.115:0/3420198397 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6b8104300 0x7fa6b8104700 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:29.022 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:24.909+0000 7fa6c074c640 1 -- 172.21.15.115:0/3420198397 >> 172.21.15.115:0/3420198397 conn(0x7fa6b80ffaf0 msgr2=0x7fa6b8101f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:57:29.022 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:24.909+0000 7fa6c074c640 1 -- 172.21.15.115:0/3420198397 shutdown_connections 2024-09-13T16:57:29.022 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:24.909+0000 7fa6c074c640 1 -- 172.21.15.115:0/3420198397 wait complete. 2024-09-13T16:57:29.022 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:24.910+0000 7fa6c074c640 1 Processor -- start 2024-09-13T16:57:29.022 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:24.910+0000 7fa6c074c640 1 -- start start 2024-09-13T16:57:29.022 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:24.910+0000 7fa6c074c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6b8104300 0x7fa6b818f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:29.023 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:24.910+0000 7fa6c074c640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b818f9f0 con 0x7fa6b8104300 2024-09-13T16:57:29.023 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:24.910+0000 7fa6be4e8640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6b8104300 0x7fa6b818f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:29.023 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:24.910+0000 7fa6be4e8640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6b8104300 0x7fa6b818f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:36390/0 (socket says 172.21.15.115:36390) 2024-09-13T16:57:29.023 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:24.910+0000 7fa6be4e8640 1 -- 172.21.15.115:0/434842323 learned_addr learned my addr 172.21.15.115:0/434842323 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T16:57:29.023 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:24.911+0000 7fa6be4e8640 1 -- 172.21.15.115:0/434842323 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6b40094d0 con 0x7fa6b8104300 2024-09-13T16:57:29.023 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:24.911+0000 7fa6be4e8640 1 --2- 172.21.15.115:0/434842323 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6b8104300 0x7fa6b818f4b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa6b4009940 tx=0x7fa6b4032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:29.023 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:24.911+0000 7fa6af7fe640 1 -- 172.21.15.115:0/434842323 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa6b4030e40 con 0x7fa6b8104300 2024-09-13T16:57:29.023 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:24.911+0000 7fa6af7fe640 1 -- 172.21.15.115:0/434842323 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa6b403b8b0 con 0x7fa6b8104300 2024-09-13T16:57:29.023 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:24.911+0000 7fa6af7fe640 1 -- 172.21.15.115:0/434842323 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa6b403a620 con 0x7fa6b8104300 2024-09-13T16:57:29.023 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:24.911+0000 7fa6c074c640 1 -- 172.21.15.115:0/434842323 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6b818dbe0 con 0x7fa6b8104300 2024-09-13T16:57:29.023 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:24.911+0000 7fa6c074c640 1 -- 172.21.15.115:0/434842323 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6b818e000 con 0x7fa6b8104300 2024-09-13T16:57:29.023 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:24.912+0000 7fa6af7fe640 1 -- 172.21.15.115:0/434842323 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 9) v1 ==== 45569+0+0 (secure 0 0 0) 0x7fa6b4039040 con 0x7fa6b8104300 2024-09-13T16:57:29.023 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:24.912+0000 7fa6af7fe640 1 --2- 172.21.15.115:0/434842323 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7fa6a40386a0 0x7fa6a403ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:29.024 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:24.912+0000 7fa6af7fe640 1 -- 172.21.15.115:0/434842323 --> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa6a403b270 con 0x7fa6a40386a0 2024-09-13T16:57:29.024 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:24.913+0000 7fa6af7fe640 1 -- 172.21.15.115:0/434842323 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fa6b406b750 con 0x7fa6b8104300 2024-09-13T16:57:29.024 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:24.913+0000 7fa6bdce7640 1 -- 172.21.15.115:0/434842323 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7fa6a40386a0 msgr2=0x7fa6a403ab60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6800/2943337696 2024-09-13T16:57:29.024 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:24.913+0000 7fa6bdce7640 1 --2- 172.21.15.115:0/434842323 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7fa6a40386a0 0x7fa6a403ab60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T16:57:29.024 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:25.114+0000 7fa6bdce7640 1 -- 172.21.15.115:0/434842323 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7fa6a40386a0 msgr2=0x7fa6a403ab60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6800/2943337696 2024-09-13T16:57:29.024 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:25.114+0000 7fa6bdce7640 1 --2- 172.21.15.115:0/434842323 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7fa6a40386a0 0x7fa6a403ab60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T16:57:29.024 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:25.515+0000 7fa6bdce7640 1 -- 172.21.15.115:0/434842323 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7fa6a40386a0 msgr2=0x7fa6a403ab60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6800/2943337696 2024-09-13T16:57:29.024 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:25.515+0000 7fa6bdce7640 1 --2- 172.21.15.115:0/434842323 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7fa6a40386a0 0x7fa6a403ab60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-13T16:57:29.024 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:26.316+0000 7fa6bdce7640 1 -- 172.21.15.115:0/434842323 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7fa6a40386a0 msgr2=0x7fa6a403ab60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6800/2943337696 2024-09-13T16:57:29.024 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:26.316+0000 7fa6bdce7640 1 --2- 172.21.15.115:0/434842323 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7fa6a40386a0 0x7fa6a403ab60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-13T16:57:29.024 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:27.334+0000 7fa6af7fe640 1 -- 172.21.15.115:0/434842323 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mgrmap(e 10) v1 ==== 45336+0+0 (secure 0 0 0) 0x7fa6b406a580 con 0x7fa6b8104300 2024-09-13T16:57:29.024 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:27.334+0000 7fa6af7fe640 1 -- 172.21.15.115:0/434842323 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7fa6a40386a0 msgr2=0x7fa6a403ab60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T16:57:29.024 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:27.334+0000 7fa6af7fe640 1 --2- 172.21.15.115:0/434842323 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7fa6a40386a0 0x7fa6a403ab60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:29.025 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:28.336+0000 7fa6af7fe640 1 -- 172.21.15.115:0/434842323 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mgrmap(e 11) v1 ==== 45463+0+0 (secure 0 0 0) 0x7fa6b4038d20 con 0x7fa6b8104300 2024-09-13T16:57:29.025 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:28.336+0000 7fa6af7fe640 1 --2- 172.21.15.115:0/434842323 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7fa6a403bfe0 0x7fa6a403e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:29.025 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:28.336+0000 7fa6af7fe640 1 -- 172.21.15.115:0/434842323 --> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa6a403b270 con 0x7fa6a403bfe0 2024-09-13T16:57:29.025 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:28.336+0000 7fa6bdce7640 1 --2- 172.21.15.115:0/434842323 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7fa6a403bfe0 0x7fa6a403e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:29.025 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:28.337+0000 7fa6bdce7640 1 --2- 172.21.15.115:0/434842323 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7fa6a403bfe0 0x7fa6a403e3d0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fa6a8003980 tx=0x7fa6a8006e10 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:29.025 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:28.337+0000 7fa6af7fe640 1 -- 172.21.15.115:0/434842323 <== mgr.14160 v2:172.21.15.115:6800/3889408988 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+7774 (secure 0 0 0) 0x7fa6a403b270 con 0x7fa6a403bfe0 2024-09-13T16:57:29.025 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:28.343+0000 7fa6c074c640 1 -- 172.21.15.115:0/434842323 --> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7fa6b8106370 con 0x7fa6a403bfe0 2024-09-13T16:57:29.025 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:28.343+0000 7fa6af7fe640 1 -- 172.21.15.115:0/434842323 <== mgr.14160 v2:172.21.15.115:6800/3889408988 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7fa6a800a040 con 0x7fa6a403bfe0 2024-09-13T16:57:29.025 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:28.343+0000 7fa6c074c640 1 -- 172.21.15.115:0/434842323 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7fa6a403bfe0 msgr2=0x7fa6a403e3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:29.025 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:28.343+0000 7fa6c074c640 1 --2- 172.21.15.115:0/434842323 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7fa6a403bfe0 0x7fa6a403e3d0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fa6a8003980 tx=0x7fa6a8006e10 comp rx=0 tx=0).stop 2024-09-13T16:57:29.025 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:28.343+0000 7fa6c074c640 1 -- 172.21.15.115:0/434842323 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6b8104300 msgr2=0x7fa6b818f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:29.026 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:28.343+0000 7fa6c074c640 1 --2- 172.21.15.115:0/434842323 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6b8104300 0x7fa6b818f4b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa6b4009940 tx=0x7fa6b4032670 comp rx=0 tx=0).stop 2024-09-13T16:57:29.026 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:28.343+0000 7fa6c074c640 1 -- 172.21.15.115:0/434842323 shutdown_connections 2024-09-13T16:57:29.026 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:28.343+0000 7fa6c074c640 1 --2- 172.21.15.115:0/434842323 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7fa6a403bfe0 0x7fa6a403e3d0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:29.027 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:28.343+0000 7fa6c074c640 1 --2- 172.21.15.115:0/434842323 >> [v2:172.21.15.115:6800/2943337696,v1:172.21.15.115:6801/2943337696] conn(0x7fa6a40386a0 0x7fa6a403ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:29.027 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:28.343+0000 7fa6c074c640 1 --2- 172.21.15.115:0/434842323 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6b8104300 0x7fa6b818f4b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:29.027 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:28.343+0000 7fa6c074c640 1 -- 172.21.15.115:0/434842323 >> 172.21.15.115:0/434842323 conn(0x7fa6b80ffaf0 msgr2=0x7fa6b8100a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:57:29.027 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:28.344+0000 7fa6c074c640 1 -- 172.21.15.115:0/434842323 shutdown_connections 2024-09-13T16:57:29.027 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:28.344+0000 7fa6c074c640 1 -- 172.21.15.115:0/434842323 wait complete. 2024-09-13T16:57:29.027 INFO:teuthology.orchestra.run.smithi115.stdout:mgr epoch 9 is available 2024-09-13T16:57:29.027 INFO:teuthology.orchestra.run.smithi115.stdout:Generating a dashboard self-signed certificate... 2024-09-13T16:57:29.580 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:29 smithi115 ceph-mon[27708]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-13T16:57:29.581 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:29 smithi115 ceph-mon[27708]: mgrmap e11: smithi115.hetcni(active, since 1.00568s) 2024-09-13T16:57:29.581 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:29 smithi115 ceph-mon[27708]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-13T16:57:29.581 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:29 smithi115 ceph-mon[27708]: from='mgr.14160 172.21.15.115:0/3221480175' entity='mgr.smithi115.hetcni' 2024-09-13T16:57:30.225 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-13T16:57:30.226 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:29.392+0000 7fb99219e640 1 Processor -- start 2024-09-13T16:57:30.226 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:29.392+0000 7fb99219e640 1 -- start start 2024-09-13T16:57:30.226 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:29.392+0000 7fb99219e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb98c1042e0 0x7fb98c1046e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:30.226 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:29.392+0000 7fb99219e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb98c104cb0 con 0x7fb98c1042e0 2024-09-13T16:57:30.226 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:29.392+0000 7fb98b7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb98c1042e0 0x7fb98c1046e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:30.226 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:29.392+0000 7fb98b7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb98c1042e0 0x7fb98c1046e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:36468/0 (socket says 172.21.15.115:36468) 2024-09-13T16:57:30.226 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:29.393+0000 7fb98b7fe640 1 -- 172.21.15.115:0/3154972724 learned_addr learned my addr 172.21.15.115:0/3154972724 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T16:57:30.226 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:29.393+0000 7fb98b7fe640 1 -- 172.21.15.115:0/3154972724 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb98c1054e0 con 0x7fb98c1042e0 2024-09-13T16:57:30.226 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:29.393+0000 7fb98b7fe640 1 --2- 172.21.15.115:0/3154972724 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb98c1042e0 0x7fb98c1046e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb97c009820 tx=0x7fb97c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b4f8a2cb8b46cae server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:30.226 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:29.394+0000 7fb98a7fc640 1 -- 172.21.15.115:0/3154972724 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb97c02ad40 con 0x7fb98c1042e0 2024-09-13T16:57:30.227 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:29.394+0000 7fb98a7fc640 1 -- 172.21.15.115:0/3154972724 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb97c0328e0 con 0x7fb98c1042e0 2024-09-13T16:57:30.227 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:29.394+0000 7fb98a7fc640 1 -- 172.21.15.115:0/3154972724 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb97c0307d0 con 0x7fb98c1042e0 2024-09-13T16:57:30.227 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:29.394+0000 7fb99219e640 1 -- 172.21.15.115:0/3154972724 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb98c1042e0 msgr2=0x7fb98c1046e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:30.227 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:29.394+0000 7fb99219e640 1 --2- 172.21.15.115:0/3154972724 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb98c1042e0 0x7fb98c1046e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb97c009820 tx=0x7fb97c02a270 comp rx=0 tx=0).stop 2024-09-13T16:57:30.227 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:29.394+0000 7fb99219e640 1 -- 172.21.15.115:0/3154972724 shutdown_connections 2024-09-13T16:57:30.227 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:29.394+0000 7fb99219e640 1 --2- 172.21.15.115:0/3154972724 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb98c1042e0 0x7fb98c1046e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:30.227 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:29.394+0000 7fb99219e640 1 -- 172.21.15.115:0/3154972724 >> 172.21.15.115:0/3154972724 conn(0x7fb98c0ffa70 msgr2=0x7fb98c101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:57:30.227 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:29.394+0000 7fb99219e640 1 -- 172.21.15.115:0/3154972724 shutdown_connections 2024-09-13T16:57:30.227 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:29.394+0000 7fb99219e640 1 -- 172.21.15.115:0/3154972724 wait complete. 2024-09-13T16:57:30.227 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:29.395+0000 7fb99219e640 1 Processor -- start 2024-09-13T16:57:30.227 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:29.395+0000 7fb99219e640 1 -- start start 2024-09-13T16:57:30.227 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:29.395+0000 7fb99219e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb98c1042e0 0x7fb98c199230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:30.227 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:29.395+0000 7fb99219e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb98c199770 con 0x7fb98c1042e0 2024-09-13T16:57:30.228 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:29.395+0000 7fb98b7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb98c1042e0 0x7fb98c199230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:30.228 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:29.395+0000 7fb98b7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb98c1042e0 0x7fb98c199230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:36474/0 (socket says 172.21.15.115:36474) 2024-09-13T16:57:30.228 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:29.395+0000 7fb98b7fe640 1 -- 172.21.15.115:0/216744896 learned_addr learned my addr 172.21.15.115:0/216744896 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T16:57:30.228 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:29.396+0000 7fb98b7fe640 1 -- 172.21.15.115:0/216744896 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb97c0094d0 con 0x7fb98c1042e0 2024-09-13T16:57:30.228 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:29.396+0000 7fb98b7fe640 1 --2- 172.21.15.115:0/216744896 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb98c1042e0 0x7fb98c199230 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb97c009940 tx=0x7fb97c032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:30.228 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:29.396+0000 7fb988ff9640 1 -- 172.21.15.115:0/216744896 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb97c030e40 con 0x7fb98c1042e0 2024-09-13T16:57:30.228 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:29.396+0000 7fb99219e640 1 -- 172.21.15.115:0/216744896 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb98c199970 con 0x7fb98c1042e0 2024-09-13T16:57:30.228 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:29.396+0000 7fb988ff9640 1 -- 172.21.15.115:0/216744896 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb97c03b8b0 con 0x7fb98c1042e0 2024-09-13T16:57:30.228 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:29.396+0000 7fb988ff9640 1 -- 172.21.15.115:0/216744896 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb97c03a620 con 0x7fb98c1042e0 2024-09-13T16:57:30.228 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:29.396+0000 7fb99219e640 1 -- 172.21.15.115:0/216744896 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb98c199d90 con 0x7fb98c1042e0 2024-09-13T16:57:30.228 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:29.397+0000 7fb988ff9640 1 -- 172.21.15.115:0/216744896 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 11) v1 ==== 45463+0+0 (secure 0 0 0) 0x7fb97c039040 con 0x7fb98c1042e0 2024-09-13T16:57:30.228 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:29.397+0000 7fb988ff9640 1 --2- 172.21.15.115:0/216744896 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7fb978038580 0x7fb97803aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:30.228 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:29.397+0000 7fb99219e640 1 -- 172.21.15.115:0/216744896 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb98c1046e0 con 0x7fb98c1042e0 2024-09-13T16:57:30.229 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:29.397+0000 7fb988ff9640 1 -- 172.21.15.115:0/216744896 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fb97c06b650 con 0x7fb98c1042e0 2024-09-13T16:57:30.229 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:29.397+0000 7fb98affd640 1 --2- 172.21.15.115:0/216744896 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7fb978038580 0x7fb97803aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:30.229 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:29.398+0000 7fb98affd640 1 --2- 172.21.15.115:0/216744896 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7fb978038580 0x7fb97803aa40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb9740098c0 tx=0x7fb974006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:30.229 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:29.403+0000 7fb988ff9640 1 -- 172.21.15.115:0/216744896 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fb97c03f070 con 0x7fb98c1042e0 2024-09-13T16:57:30.229 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:29.577+0000 7fb99219e640 1 -- 172.21.15.115:0/216744896 --> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7fb98c02c4f0 con 0x7fb978038580 2024-09-13T16:57:30.229 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:29.645+0000 7fb988ff9640 1 -- 172.21.15.115:0/216744896 <== mgr.14160 v2:172.21.15.115:6800/3889408988 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7fb98c02c4f0 con 0x7fb978038580 2024-09-13T16:57:30.229 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:29.647+0000 7fb99219e640 1 -- 172.21.15.115:0/216744896 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7fb978038580 msgr2=0x7fb97803aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:30.229 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:29.647+0000 7fb99219e640 1 --2- 172.21.15.115:0/216744896 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7fb978038580 0x7fb97803aa40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb9740098c0 tx=0x7fb974006db0 comp rx=0 tx=0).stop 2024-09-13T16:57:30.229 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:29.647+0000 7fb99219e640 1 -- 172.21.15.115:0/216744896 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb98c1042e0 msgr2=0x7fb98c199230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:30.230 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:29.647+0000 7fb99219e640 1 --2- 172.21.15.115:0/216744896 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb98c1042e0 0x7fb98c199230 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb97c009940 tx=0x7fb97c032670 comp rx=0 tx=0).stop 2024-09-13T16:57:30.230 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:29.647+0000 7fb99219e640 1 -- 172.21.15.115:0/216744896 shutdown_connections 2024-09-13T16:57:30.230 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:29.647+0000 7fb99219e640 1 --2- 172.21.15.115:0/216744896 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7fb978038580 0x7fb97803aa40 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:30.230 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:29.647+0000 7fb99219e640 1 --2- 172.21.15.115:0/216744896 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb98c1042e0 0x7fb98c199230 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:30.230 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:29.647+0000 7fb99219e640 1 -- 172.21.15.115:0/216744896 >> 172.21.15.115:0/216744896 conn(0x7fb98c0ffa70 msgr2=0x7fb98c1009f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:57:30.230 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:29.647+0000 7fb99219e640 1 -- 172.21.15.115:0/216744896 shutdown_connections 2024-09-13T16:57:30.230 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:29.647+0000 7fb99219e640 1 -- 172.21.15.115:0/216744896 wait complete. 2024-09-13T16:57:30.230 INFO:teuthology.orchestra.run.smithi115.stdout:Creating initial admin user... 2024-09-13T16:57:30.822 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:30 smithi115 ceph-mon[27708]: [13/Sep/2024:16:57:28] ENGINE Bus STARTING 2024-09-13T16:57:30.822 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:30 smithi115 ceph-mon[27708]: [13/Sep/2024:16:57:28] ENGINE Serving on http://172.21.15.115:8765 2024-09-13T16:57:30.822 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:30 smithi115 ceph-mon[27708]: [13/Sep/2024:16:57:28] ENGINE Serving on https://172.21.15.115:7150 2024-09-13T16:57:30.822 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:30 smithi115 ceph-mon[27708]: [13/Sep/2024:16:57:28] ENGINE Bus STARTED 2024-09-13T16:57:30.822 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:30 smithi115 ceph-mon[27708]: [13/Sep/2024:16:57:28] ENGINE Error in HTTPServer.serve 2024-09-13T16:57:30.822 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Traceback (most recent call last): 2024-09-13T16:57:30.822 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T16:57:30.822 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: self._connections.run(self.expiration_interval) 2024-09-13T16:57:30.822 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T16:57:30.822 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: self._run(expiration_interval) 2024-09-13T16:57:30.822 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T16:57:30.823 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T16:57:30.823 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T16:57:30.823 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T16:57:30.823 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T16:57:30.823 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: s = self.context.wrap_socket( 2024-09-13T16:57:30.823 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T16:57:30.823 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: return self.sslsocket_class._create( 2024-09-13T16:57:30.823 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T16:57:30.823 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: self.do_handshake() 2024-09-13T16:57:30.823 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T16:57:30.823 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: self._sslobj.do_handshake() 2024-09-13T16:57:30.823 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T16:57:30.823 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:30 smithi115 ceph-mon[27708]: from='mgr.14160 172.21.15.115:0/3221480175' entity='mgr.smithi115.hetcni' 2024-09-13T16:57:30.823 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:30 smithi115 ceph-mon[27708]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:57:30.824 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:30 smithi115 ceph-mon[27708]: from='mgr.14160 172.21.15.115:0/3221480175' entity='mgr.smithi115.hetcni' 2024-09-13T16:57:30.824 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:30 smithi115 ceph-mon[27708]: from='mgr.14160 172.21.15.115:0/3221480175' entity='mgr.smithi115.hetcni' 2024-09-13T16:57:30.824 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:30 smithi115 ceph-mon[27708]: mgrmap e12: smithi115.hetcni(active, since 2s) 2024-09-13T16:57:31.651 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$au3B2sQ5FIx7oLjl1GGaauj9WvMwS7pEfLyA9CXIaIHKHU3VaWpzG", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726246651, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-13T16:57:31.652 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:30.619+0000 7f26a2089640 1 Processor -- start 2024-09-13T16:57:31.652 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:30.619+0000 7f26a2089640 1 -- start start 2024-09-13T16:57:31.652 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:30.619+0000 7f26a2089640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f269c1053e0 0x7f269c1057e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:31.652 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:30.619+0000 7f26a2089640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f269c105db0 con 0x7f269c1053e0 2024-09-13T16:57:31.652 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:30.619+0000 7f269b7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f269c1053e0 0x7f269c1057e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:31.652 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:30.619+0000 7f269b7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f269c1053e0 0x7f269c1057e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:36484/0 (socket says 172.21.15.115:36484) 2024-09-13T16:57:31.652 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:30.619+0000 7f269b7fe640 1 -- 172.21.15.115:0/2440105818 learned_addr learned my addr 172.21.15.115:0/2440105818 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T16:57:31.653 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:30.620+0000 7f269b7fe640 1 -- 172.21.15.115:0/2440105818 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f269c106590 con 0x7f269c1053e0 2024-09-13T16:57:31.653 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:30.620+0000 7f269b7fe640 1 --2- 172.21.15.115:0/2440105818 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f269c1053e0 0x7f269c1057e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f268c009820 tx=0x7f268c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=968bc62b0ad1af65 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:31.653 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:30.621+0000 7f269a7fc640 1 -- 172.21.15.115:0/2440105818 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f268c02ad40 con 0x7f269c1053e0 2024-09-13T16:57:31.653 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:30.621+0000 7f269a7fc640 1 -- 172.21.15.115:0/2440105818 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f268c0328e0 con 0x7f269c1053e0 2024-09-13T16:57:31.653 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:30.621+0000 7f269a7fc640 1 -- 172.21.15.115:0/2440105818 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f268c0307d0 con 0x7f269c1053e0 2024-09-13T16:57:31.653 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:30.621+0000 7f26a2089640 1 -- 172.21.15.115:0/2440105818 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f269c1053e0 msgr2=0x7f269c1057e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:31.653 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:30.621+0000 7f26a2089640 1 --2- 172.21.15.115:0/2440105818 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f269c1053e0 0x7f269c1057e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f268c009820 tx=0x7f268c02a270 comp rx=0 tx=0).stop 2024-09-13T16:57:31.653 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:30.621+0000 7f26a2089640 1 -- 172.21.15.115:0/2440105818 shutdown_connections 2024-09-13T16:57:31.653 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:30.621+0000 7f26a2089640 1 --2- 172.21.15.115:0/2440105818 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f269c1053e0 0x7f269c1057e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:31.653 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:30.621+0000 7f26a2089640 1 -- 172.21.15.115:0/2440105818 >> 172.21.15.115:0/2440105818 conn(0x7f269c100bd0 msgr2=0x7f269c102ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:57:31.653 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:30.621+0000 7f26a2089640 1 -- 172.21.15.115:0/2440105818 shutdown_connections 2024-09-13T16:57:31.653 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:30.621+0000 7f26a2089640 1 -- 172.21.15.115:0/2440105818 wait complete. 2024-09-13T16:57:31.653 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:30.622+0000 7f26a2089640 1 Processor -- start 2024-09-13T16:57:31.654 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:30.622+0000 7f26a2089640 1 -- start start 2024-09-13T16:57:31.654 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:30.622+0000 7f26a2089640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f269c1053e0 0x7f269c199170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:31.654 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:30.622+0000 7f26a2089640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f269c1996b0 con 0x7f269c1053e0 2024-09-13T16:57:31.654 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:30.622+0000 7f269b7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f269c1053e0 0x7f269c199170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:31.654 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:30.622+0000 7f269b7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f269c1053e0 0x7f269c199170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:36500/0 (socket says 172.21.15.115:36500) 2024-09-13T16:57:31.654 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:30.622+0000 7f269b7fe640 1 -- 172.21.15.115:0/619880754 learned_addr learned my addr 172.21.15.115:0/619880754 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T16:57:31.654 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:30.623+0000 7f269b7fe640 1 -- 172.21.15.115:0/619880754 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f268c0094d0 con 0x7f269c1053e0 2024-09-13T16:57:31.654 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:30.623+0000 7f269b7fe640 1 --2- 172.21.15.115:0/619880754 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f269c1053e0 0x7f269c199170 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f268c009940 tx=0x7f268c032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:31.654 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:30.623+0000 7f2698ff9640 1 -- 172.21.15.115:0/619880754 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f268c030e40 con 0x7f269c1053e0 2024-09-13T16:57:31.654 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:30.623+0000 7f2698ff9640 1 -- 172.21.15.115:0/619880754 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f268c03b8b0 con 0x7f269c1053e0 2024-09-13T16:57:31.654 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:30.623+0000 7f26a2089640 1 -- 172.21.15.115:0/619880754 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f269c1998b0 con 0x7f269c1053e0 2024-09-13T16:57:31.654 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:30.623+0000 7f2698ff9640 1 -- 172.21.15.115:0/619880754 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f268c03a620 con 0x7f269c1053e0 2024-09-13T16:57:31.654 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:30.623+0000 7f26a2089640 1 -- 172.21.15.115:0/619880754 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f269c199cd0 con 0x7f269c1053e0 2024-09-13T16:57:31.654 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:30.624+0000 7f2698ff9640 1 -- 172.21.15.115:0/619880754 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 12) v1 ==== 45569+0+0 (secure 0 0 0) 0x7f268c039040 con 0x7f269c1053e0 2024-09-13T16:57:31.655 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:30.624+0000 7f26a2089640 1 -- 172.21.15.115:0/619880754 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f269c1057e0 con 0x7f269c1053e0 2024-09-13T16:57:31.655 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:30.624+0000 7f2698ff9640 1 --2- 172.21.15.115:0/619880754 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7f26840386a0 0x7f268403ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:31.655 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:30.624+0000 7f2698ff9640 1 -- 172.21.15.115:0/619880754 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f268c06b9a0 con 0x7f269c1053e0 2024-09-13T16:57:31.655 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:30.624+0000 7f269affd640 1 --2- 172.21.15.115:0/619880754 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7f26840386a0 0x7f268403ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:31.655 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:30.624+0000 7f269affd640 1 --2- 172.21.15.115:0/619880754 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7f26840386a0 0x7f268403ab60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f26900098c0 tx=0x7f2690006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:31.655 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:30.628+0000 7f2698ff9640 1 -- 172.21.15.115:0/619880754 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f268c04b710 con 0x7f269c1053e0 2024-09-13T16:57:31.655 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:30.820+0000 7f26a2089640 1 -- 172.21.15.115:0/619880754 --> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f269c061900 con 0x7f26840386a0 2024-09-13T16:57:31.656 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:31.046+0000 7f2698ff9640 1 -- 172.21.15.115:0/619880754 <== mgr.14160 v2:172.21.15.115:6800/3889408988 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7f269c061900 con 0x7f26840386a0 2024-09-13T16:57:31.656 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:31.048+0000 7f26a2089640 1 -- 172.21.15.115:0/619880754 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7f26840386a0 msgr2=0x7f268403ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:31.656 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:31.048+0000 7f26a2089640 1 --2- 172.21.15.115:0/619880754 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7f26840386a0 0x7f268403ab60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f26900098c0 tx=0x7f2690006db0 comp rx=0 tx=0).stop 2024-09-13T16:57:31.656 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:31.048+0000 7f26a2089640 1 -- 172.21.15.115:0/619880754 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f269c1053e0 msgr2=0x7f269c199170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:31.656 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:31.048+0000 7f26a2089640 1 --2- 172.21.15.115:0/619880754 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f269c1053e0 0x7f269c199170 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f268c009940 tx=0x7f268c032670 comp rx=0 tx=0).stop 2024-09-13T16:57:31.656 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:31.048+0000 7f26a2089640 1 -- 172.21.15.115:0/619880754 shutdown_connections 2024-09-13T16:57:31.656 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:31.048+0000 7f26a2089640 1 --2- 172.21.15.115:0/619880754 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7f26840386a0 0x7f268403ab60 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:31.656 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:31.048+0000 7f26a2089640 1 --2- 172.21.15.115:0/619880754 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f269c1053e0 0x7f269c199170 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:31.656 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:31.048+0000 7f26a2089640 1 -- 172.21.15.115:0/619880754 >> 172.21.15.115:0/619880754 conn(0x7f269c100bd0 msgr2=0x7f269c101810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:57:31.656 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:31.048+0000 7f26a2089640 1 -- 172.21.15.115:0/619880754 shutdown_connections 2024-09-13T16:57:31.656 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:31.048+0000 7f26a2089640 1 -- 172.21.15.115:0/619880754 wait complete. 2024-09-13T16:57:31.656 INFO:teuthology.orchestra.run.smithi115.stdout:Fetching dashboard port number... 2024-09-13T16:57:32.224 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:32 smithi115 ceph-mon[27708]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:57:32.225 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:32 smithi115 ceph-mon[27708]: from='mgr.14160 172.21.15.115:0/3221480175' entity='mgr.smithi115.hetcni' 2024-09-13T16:57:33.338 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:33 smithi115 ceph-mon[27708]: from='client.? 172.21.15.115:0/1214033150' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-13T16:57:33.345 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout 8443 2024-09-13T16:57:33.345 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:32.043+0000 7f6295272640 1 Processor -- start 2024-09-13T16:57:33.345 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:32.043+0000 7f6295272640 1 -- start start 2024-09-13T16:57:33.345 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:32.043+0000 7f6295272640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f62901042c0 0x7f62901046c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:33.345 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:32.043+0000 7f6295272640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6290104c90 con 0x7f62901042c0 2024-09-13T16:57:33.345 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:32.044+0000 7f628effd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f62901042c0 0x7f62901046c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:33.345 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:32.044+0000 7f628effd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f62901042c0 0x7f62901046c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:36512/0 (socket says 172.21.15.115:36512) 2024-09-13T16:57:33.345 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:32.044+0000 7f628effd640 1 -- 172.21.15.115:0/3293822060 learned_addr learned my addr 172.21.15.115:0/3293822060 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T16:57:33.346 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:32.044+0000 7f628effd640 1 -- 172.21.15.115:0/3293822060 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62901054c0 con 0x7f62901042c0 2024-09-13T16:57:33.346 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:32.045+0000 7f628effd640 1 --2- 172.21.15.115:0/3293822060 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f62901042c0 0x7f62901046c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f628000d180 tx=0x7f628002c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b2457ac915f4cea server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:33.346 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:32.049+0000 7f628dffb640 1 -- 172.21.15.115:0/3293822060 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f628002f070 con 0x7f62901042c0 2024-09-13T16:57:33.346 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:32.049+0000 7f628dffb640 1 -- 172.21.15.115:0/3293822060 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f628000b2e0 con 0x7f62901042c0 2024-09-13T16:57:33.346 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:32.049+0000 7f628dffb640 1 -- 172.21.15.115:0/3293822060 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6280033850 con 0x7f62901042c0 2024-09-13T16:57:33.346 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:32.049+0000 7f6295272640 1 -- 172.21.15.115:0/3293822060 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f62901042c0 msgr2=0x7f62901046c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:33.346 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:32.049+0000 7f6295272640 1 --2- 172.21.15.115:0/3293822060 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f62901042c0 0x7f62901046c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f628000d180 tx=0x7f628002c9a0 comp rx=0 tx=0).stop 2024-09-13T16:57:33.346 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:32.050+0000 7f6295272640 1 -- 172.21.15.115:0/3293822060 shutdown_connections 2024-09-13T16:57:33.346 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:32.050+0000 7f6295272640 1 --2- 172.21.15.115:0/3293822060 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f62901042c0 0x7f62901046c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:33.346 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:32.050+0000 7f6295272640 1 -- 172.21.15.115:0/3293822060 >> 172.21.15.115:0/3293822060 conn(0x7f62900ffa10 msgr2=0x7f6290101e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:57:33.346 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:32.050+0000 7f6295272640 1 -- 172.21.15.115:0/3293822060 shutdown_connections 2024-09-13T16:57:33.346 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:32.050+0000 7f6295272640 1 -- 172.21.15.115:0/3293822060 wait complete. 2024-09-13T16:57:33.346 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:32.050+0000 7f6295272640 1 Processor -- start 2024-09-13T16:57:33.347 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:32.050+0000 7f6295272640 1 -- start start 2024-09-13T16:57:33.347 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:32.051+0000 7f6295272640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f62901042c0 0x7f6290196f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:33.347 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:32.051+0000 7f6295272640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62901974d0 con 0x7f62901042c0 2024-09-13T16:57:33.347 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:32.051+0000 7f628effd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f62901042c0 0x7f6290196f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:33.347 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:32.051+0000 7f628effd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f62901042c0 0x7f6290196f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:36516/0 (socket says 172.21.15.115:36516) 2024-09-13T16:57:33.347 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:32.051+0000 7f628effd640 1 -- 172.21.15.115:0/1214033150 learned_addr learned my addr 172.21.15.115:0/1214033150 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T16:57:33.347 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:32.051+0000 7f628effd640 1 -- 172.21.15.115:0/1214033150 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f628000bd40 con 0x7f62901042c0 2024-09-13T16:57:33.347 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:32.051+0000 7f628effd640 1 --2- 172.21.15.115:0/1214033150 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f62901042c0 0x7f6290196f90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f628000d150 tx=0x7f6280009830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:33.347 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:32.051+0000 7f6287fff640 1 -- 172.21.15.115:0/1214033150 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6280033e30 con 0x7f62901042c0 2024-09-13T16:57:33.347 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:32.051+0000 7f6287fff640 1 -- 172.21.15.115:0/1214033150 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6280009bb0 con 0x7f62901042c0 2024-09-13T16:57:33.347 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:32.051+0000 7f6287fff640 1 -- 172.21.15.115:0/1214033150 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f628003c6a0 con 0x7f62901042c0 2024-09-13T16:57:33.347 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:32.051+0000 7f6295272640 1 -- 172.21.15.115:0/1214033150 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62901976d0 con 0x7f62901042c0 2024-09-13T16:57:33.347 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:32.051+0000 7f6295272640 1 -- 172.21.15.115:0/1214033150 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6290197bd0 con 0x7f62901042c0 2024-09-13T16:57:33.348 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:32.052+0000 7f6287fff640 1 -- 172.21.15.115:0/1214033150 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 12) v1 ==== 45569+0+0 (secure 0 0 0) 0x7f628003c960 con 0x7f62901042c0 2024-09-13T16:57:33.348 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:32.052+0000 7f6287fff640 1 --2- 172.21.15.115:0/1214033150 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7f627c0386a0 0x7f627c03ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:33.348 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:32.052+0000 7f6295272640 1 -- 172.21.15.115:0/1214033150 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6290077fe0 con 0x7f62901042c0 2024-09-13T16:57:33.348 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:32.053+0000 7f6287fff640 1 -- 172.21.15.115:0/1214033150 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f628006e880 con 0x7f62901042c0 2024-09-13T16:57:33.348 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:32.053+0000 7f628e7fc640 1 --2- 172.21.15.115:0/1214033150 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7f627c0386a0 0x7f627c03ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:33.348 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:32.053+0000 7f628e7fc640 1 --2- 172.21.15.115:0/1214033150 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7f627c0386a0 0x7f627c03ab60 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f62780098c0 tx=0x7f6278006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:33.348 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:32.057+0000 7f6287fff640 1 -- 172.21.15.115:0/1214033150 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f628004fb80 con 0x7f62901042c0 2024-09-13T16:57:33.348 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:32.223+0000 7f6295272640 1 -- 172.21.15.115:0/1214033150 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f6290190630 con 0x7f62901042c0 2024-09-13T16:57:33.348 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:32.223+0000 7f6287fff640 1 -- 172.21.15.115:0/1214033150 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f6280042070 con 0x7f62901042c0 2024-09-13T16:57:33.348 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:32.225+0000 7f6295272640 1 -- 172.21.15.115:0/1214033150 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7f627c0386a0 msgr2=0x7f627c03ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:33.348 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:32.225+0000 7f6295272640 1 --2- 172.21.15.115:0/1214033150 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7f627c0386a0 0x7f627c03ab60 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f62780098c0 tx=0x7f6278006db0 comp rx=0 tx=0).stop 2024-09-13T16:57:33.348 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:32.225+0000 7f6295272640 1 -- 172.21.15.115:0/1214033150 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f62901042c0 msgr2=0x7f6290196f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:33.349 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:32.225+0000 7f6295272640 1 --2- 172.21.15.115:0/1214033150 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f62901042c0 0x7f6290196f90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f628000d150 tx=0x7f6280009830 comp rx=0 tx=0).stop 2024-09-13T16:57:33.349 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:32.225+0000 7f6295272640 1 -- 172.21.15.115:0/1214033150 shutdown_connections 2024-09-13T16:57:33.349 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:32.225+0000 7f6295272640 1 --2- 172.21.15.115:0/1214033150 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7f627c0386a0 0x7f627c03ab60 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:33.349 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:32.225+0000 7f6295272640 1 --2- 172.21.15.115:0/1214033150 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f62901042c0 0x7f6290196f90 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:33.349 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:32.225+0000 7f6295272640 1 -- 172.21.15.115:0/1214033150 >> 172.21.15.115:0/1214033150 conn(0x7f62900ffa10 msgr2=0x7f629018d7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:57:33.349 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:32.226+0000 7f6295272640 1 -- 172.21.15.115:0/1214033150 shutdown_connections 2024-09-13T16:57:33.349 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:32.226+0000 7f6295272640 1 -- 172.21.15.115:0/1214033150 wait complete. 2024-09-13T16:57:33.353 INFO:teuthology.orchestra.run.smithi115.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-13T16:57:33.353 INFO:teuthology.orchestra.run.smithi115.stdout:systemctl: stdout disabled 2024-09-13T16:57:33.360 INFO:teuthology.orchestra.run.smithi115.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-13T16:57:33.360 INFO:teuthology.orchestra.run.smithi115.stdout:systemctl: stdout inactive 2024-09-13T16:57:33.360 INFO:teuthology.orchestra.run.smithi115.stdout:firewalld.service is not enabled 2024-09-13T16:57:33.360 INFO:teuthology.orchestra.run.smithi115.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-13T16:57:33.362 INFO:teuthology.orchestra.run.smithi115.stdout:Ceph Dashboard is now available at: 2024-09-13T16:57:33.362 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T16:57:33.362 INFO:teuthology.orchestra.run.smithi115.stdout: URL: https://smithi115.front.sepia.ceph.com:8443/ 2024-09-13T16:57:33.362 INFO:teuthology.orchestra.run.smithi115.stdout: User: admin 2024-09-13T16:57:33.362 INFO:teuthology.orchestra.run.smithi115.stdout: Password: khbp18lmct 2024-09-13T16:57:33.362 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T16:57:33.363 INFO:teuthology.orchestra.run.smithi115.stdout:Saving cluster configuration to /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/config directory 2024-09-13T16:57:33.363 INFO:teuthology.orchestra.run.smithi115.stdout:Enabling autotune for osd_memory_target 2024-09-13T16:57:34.477 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:33.761+0000 7f0199ad9640 1 Processor -- start 2024-09-13T16:57:34.477 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:33.761+0000 7f0199ad9640 1 -- start start 2024-09-13T16:57:34.477 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:33.761+0000 7f0199ad9640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f019407ae20 0x7f01940792d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:34.477 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:33.761+0000 7f0199ad9640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0194079810 con 0x7f019407ae20 2024-09-13T16:57:34.477 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:33.761+0000 7f01937fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f019407ae20 0x7f01940792d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:34.478 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:33.761+0000 7f01937fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f019407ae20 0x7f01940792d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:36526/0 (socket says 172.21.15.115:36526) 2024-09-13T16:57:34.478 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:33.761+0000 7f01937fe640 1 -- 172.21.15.115:0/3649875057 learned_addr learned my addr 172.21.15.115:0/3649875057 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T16:57:34.478 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:33.761+0000 7f01937fe640 1 -- 172.21.15.115:0/3649875057 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0194079950 con 0x7f019407ae20 2024-09-13T16:57:34.478 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:33.762+0000 7f01937fe640 1 --2- 172.21.15.115:0/3649875057 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f019407ae20 0x7f01940792d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0184009820 tx=0x7f018402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e990582260dc043 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:34.478 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:33.762+0000 7f01927fc640 1 -- 172.21.15.115:0/3649875057 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f018402ad40 con 0x7f019407ae20 2024-09-13T16:57:34.478 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:33.762+0000 7f01927fc640 1 -- 172.21.15.115:0/3649875057 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f01840328e0 con 0x7f019407ae20 2024-09-13T16:57:34.478 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:33.762+0000 7f01927fc640 1 -- 172.21.15.115:0/3649875057 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f01840307d0 con 0x7f019407ae20 2024-09-13T16:57:34.478 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:33.763+0000 7f0199ad9640 1 -- 172.21.15.115:0/3649875057 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f019407ae20 msgr2=0x7f01940792d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:34.478 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:33.763+0000 7f0199ad9640 1 --2- 172.21.15.115:0/3649875057 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f019407ae20 0x7f01940792d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0184009820 tx=0x7f018402a270 comp rx=0 tx=0).stop 2024-09-13T16:57:34.478 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:33.763+0000 7f0199ad9640 1 -- 172.21.15.115:0/3649875057 shutdown_connections 2024-09-13T16:57:34.478 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:33.763+0000 7f0199ad9640 1 --2- 172.21.15.115:0/3649875057 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f019407ae20 0x7f01940792d0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:34.478 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:33.763+0000 7f0199ad9640 1 -- 172.21.15.115:0/3649875057 >> 172.21.15.115:0/3649875057 conn(0x7f0194100c30 msgr2=0x7f0194103050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:57:34.478 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:33.763+0000 7f0199ad9640 1 -- 172.21.15.115:0/3649875057 shutdown_connections 2024-09-13T16:57:34.479 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:33.763+0000 7f0199ad9640 1 -- 172.21.15.115:0/3649875057 wait complete. 2024-09-13T16:57:34.479 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:33.764+0000 7f0199ad9640 1 Processor -- start 2024-09-13T16:57:34.479 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:33.764+0000 7f0199ad9640 1 -- start start 2024-09-13T16:57:34.479 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:33.764+0000 7f0199ad9640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f019407ae20 0x7f019419b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:34.479 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:33.764+0000 7f0199ad9640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f019419b860 con 0x7f019407ae20 2024-09-13T16:57:34.479 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:33.764+0000 7f01937fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f019407ae20 0x7f019419b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:34.479 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:33.764+0000 7f01937fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f019407ae20 0x7f019419b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:36540/0 (socket says 172.21.15.115:36540) 2024-09-13T16:57:34.479 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:33.764+0000 7f01937fe640 1 -- 172.21.15.115:0/320585600 learned_addr learned my addr 172.21.15.115:0/320585600 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T16:57:34.479 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:33.764+0000 7f01937fe640 1 -- 172.21.15.115:0/320585600 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01840094d0 con 0x7f019407ae20 2024-09-13T16:57:34.479 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:33.764+0000 7f01937fe640 1 --2- 172.21.15.115:0/320585600 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f019407ae20 0x7f019419b320 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0184032670 tx=0x7f01840326a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:34.479 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:33.765+0000 7f0190ff9640 1 -- 172.21.15.115:0/320585600 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0184030e40 con 0x7f019407ae20 2024-09-13T16:57:34.479 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:33.765+0000 7f0190ff9640 1 -- 172.21.15.115:0/320585600 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f018403b8b0 con 0x7f019407ae20 2024-09-13T16:57:34.479 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:33.765+0000 7f0199ad9640 1 -- 172.21.15.115:0/320585600 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f019419ba60 con 0x7f019407ae20 2024-09-13T16:57:34.479 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:33.765+0000 7f0190ff9640 1 -- 172.21.15.115:0/320585600 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f018403a650 con 0x7f019407ae20 2024-09-13T16:57:34.480 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:33.765+0000 7f0199ad9640 1 -- 172.21.15.115:0/320585600 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f019419be80 con 0x7f019407ae20 2024-09-13T16:57:34.480 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:33.766+0000 7f0190ff9640 1 -- 172.21.15.115:0/320585600 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 12) v1 ==== 45569+0+0 (secure 0 0 0) 0x7f0184039040 con 0x7f019407ae20 2024-09-13T16:57:34.480 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:33.766+0000 7f0199ad9640 1 -- 172.21.15.115:0/320585600 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f019410b740 con 0x7f019407ae20 2024-09-13T16:57:34.480 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:33.766+0000 7f0190ff9640 1 --2- 172.21.15.115:0/320585600 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7f01800386f0 0x7f018003abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:34.480 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:33.766+0000 7f0190ff9640 1 -- 172.21.15.115:0/320585600 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f018406b7f0 con 0x7f019407ae20 2024-09-13T16:57:34.480 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:33.766+0000 7f0192ffd640 1 --2- 172.21.15.115:0/320585600 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7f01800386f0 0x7f018003abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:34.480 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:33.766+0000 7f0192ffd640 1 --2- 172.21.15.115:0/320585600 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7f01800386f0 0x7f018003abb0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f017c0098c0 tx=0x7f017c006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:34.480 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:33.771+0000 7f0190ff9640 1 -- 172.21.15.115:0/320585600 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f018404b710 con 0x7f019407ae20 2024-09-13T16:57:34.480 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:33.932+0000 7f0199ad9640 1 -- 172.21.15.115:0/320585600 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7f019410b980 con 0x7f019407ae20 2024-09-13T16:57:34.480 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:33.932+0000 7f0190ff9640 1 -- 172.21.15.115:0/320585600 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7f018403f030 con 0x7f019407ae20 2024-09-13T16:57:34.480 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:33.935+0000 7f0199ad9640 1 -- 172.21.15.115:0/320585600 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7f01800386f0 msgr2=0x7f018003abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:34.480 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:33.935+0000 7f0199ad9640 1 --2- 172.21.15.115:0/320585600 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7f01800386f0 0x7f018003abb0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f017c0098c0 tx=0x7f017c006db0 comp rx=0 tx=0).stop 2024-09-13T16:57:34.480 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:33.935+0000 7f0199ad9640 1 -- 172.21.15.115:0/320585600 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f019407ae20 msgr2=0x7f019419b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:34.481 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:33.935+0000 7f0199ad9640 1 --2- 172.21.15.115:0/320585600 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f019407ae20 0x7f019419b320 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0184032670 tx=0x7f01840326a0 comp rx=0 tx=0).stop 2024-09-13T16:57:34.481 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:33.935+0000 7f0199ad9640 1 -- 172.21.15.115:0/320585600 shutdown_connections 2024-09-13T16:57:34.481 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:33.935+0000 7f0199ad9640 1 --2- 172.21.15.115:0/320585600 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7f01800386f0 0x7f018003abb0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:34.481 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:33.935+0000 7f0199ad9640 1 --2- 172.21.15.115:0/320585600 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f019407ae20 0x7f019419b320 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:34.481 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:33.935+0000 7f0199ad9640 1 -- 172.21.15.115:0/320585600 >> 172.21.15.115:0/320585600 conn(0x7f0194100c30 msgr2=0x7f01941017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:57:34.481 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:33.935+0000 7f0199ad9640 1 -- 172.21.15.115:0/320585600 shutdown_connections 2024-09-13T16:57:34.481 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:33.935+0000 7f0199ad9640 1 -- 172.21.15.115:0/320585600 wait complete. 2024-09-13T16:57:35.425 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:35 smithi115 ceph-mon[27708]: mgrmap e13: smithi115.hetcni(active, since 6s) 2024-09-13T16:57:35.718 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:34.849+0000 7f19b326b640 1 Processor -- start 2024-09-13T16:57:35.718 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:34.850+0000 7f19b326b640 1 -- start start 2024-09-13T16:57:35.718 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:34.850+0000 7f19b326b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19ac105ed0 0x7f19ac1082c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:35.718 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:34.850+0000 7f19b326b640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19ac078e80 con 0x7f19ac105ed0 2024-09-13T16:57:35.718 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:34.850+0000 7f19b1007640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19ac105ed0 0x7f19ac1082c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:35.718 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:34.850+0000 7f19b1007640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19ac105ed0 0x7f19ac1082c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47528/0 (socket says 172.21.15.115:47528) 2024-09-13T16:57:35.718 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:34.850+0000 7f19b1007640 1 -- 172.21.15.115:0/4092303725 learned_addr learned my addr 172.21.15.115:0/4092303725 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T16:57:35.718 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:34.850+0000 7f19b1007640 1 -- 172.21.15.115:0/4092303725 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19ac108800 con 0x7f19ac105ed0 2024-09-13T16:57:35.718 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:34.851+0000 7f19b1007640 1 --2- 172.21.15.115:0/4092303725 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19ac105ed0 0x7f19ac1082c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f19a0009820 tx=0x7f19a002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab540e9d89c98ef5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:35.719 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:34.851+0000 7f199ffff640 1 -- 172.21.15.115:0/4092303725 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f19a002ad40 con 0x7f19ac105ed0 2024-09-13T16:57:35.719 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:34.851+0000 7f199ffff640 1 -- 172.21.15.115:0/4092303725 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f19a00328e0 con 0x7f19ac105ed0 2024-09-13T16:57:35.719 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:34.851+0000 7f199ffff640 1 -- 172.21.15.115:0/4092303725 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f19a00307d0 con 0x7f19ac105ed0 2024-09-13T16:57:35.719 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:34.852+0000 7f19b326b640 1 -- 172.21.15.115:0/4092303725 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19ac105ed0 msgr2=0x7f19ac1082c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:35.719 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:34.852+0000 7f19b326b640 1 --2- 172.21.15.115:0/4092303725 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19ac105ed0 0x7f19ac1082c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f19a0009820 tx=0x7f19a002a270 comp rx=0 tx=0).stop 2024-09-13T16:57:35.719 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:34.852+0000 7f19b326b640 1 -- 172.21.15.115:0/4092303725 shutdown_connections 2024-09-13T16:57:35.719 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:34.852+0000 7f19b326b640 1 --2- 172.21.15.115:0/4092303725 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19ac105ed0 0x7f19ac1082c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:35.719 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:34.852+0000 7f19b326b640 1 -- 172.21.15.115:0/4092303725 >> 172.21.15.115:0/4092303725 conn(0x7f19ac0ffb30 msgr2=0x7f19ac101f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:57:35.719 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:34.852+0000 7f19b326b640 1 -- 172.21.15.115:0/4092303725 shutdown_connections 2024-09-13T16:57:35.719 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:34.852+0000 7f19b326b640 1 -- 172.21.15.115:0/4092303725 wait complete. 2024-09-13T16:57:35.719 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:34.853+0000 7f19b326b640 1 Processor -- start 2024-09-13T16:57:35.719 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:34.853+0000 7f19b326b640 1 -- start start 2024-09-13T16:57:35.719 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:34.853+0000 7f19b326b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19ac105ed0 0x7f19ac1990f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:35.719 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:34.853+0000 7f19b326b640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19ac199630 con 0x7f19ac105ed0 2024-09-13T16:57:35.720 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:34.853+0000 7f19b1007640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19ac105ed0 0x7f19ac1990f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:35.720 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:34.853+0000 7f19b1007640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19ac105ed0 0x7f19ac1990f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47544/0 (socket says 172.21.15.115:47544) 2024-09-13T16:57:35.720 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:34.853+0000 7f19b1007640 1 -- 172.21.15.115:0/675340284 learned_addr learned my addr 172.21.15.115:0/675340284 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T16:57:35.720 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:34.853+0000 7f19b1007640 1 -- 172.21.15.115:0/675340284 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19a00094d0 con 0x7f19ac105ed0 2024-09-13T16:57:35.720 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:34.853+0000 7f19b1007640 1 --2- 172.21.15.115:0/675340284 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19ac105ed0 0x7f19ac1990f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f19a0032670 tx=0x7f19a00326a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:35.720 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:34.853+0000 7f199e7fc640 1 -- 172.21.15.115:0/675340284 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f19a0030e40 con 0x7f19ac105ed0 2024-09-13T16:57:35.720 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:34.853+0000 7f199e7fc640 1 -- 172.21.15.115:0/675340284 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f19a003b8b0 con 0x7f19ac105ed0 2024-09-13T16:57:35.720 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:34.853+0000 7f19b326b640 1 -- 172.21.15.115:0/675340284 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19ac199830 con 0x7f19ac105ed0 2024-09-13T16:57:35.720 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:34.853+0000 7f199e7fc640 1 -- 172.21.15.115:0/675340284 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f19a003a650 con 0x7f19ac105ed0 2024-09-13T16:57:35.720 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:34.853+0000 7f19b326b640 1 -- 172.21.15.115:0/675340284 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19ac199c50 con 0x7f19ac105ed0 2024-09-13T16:57:35.720 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:34.854+0000 7f199e7fc640 1 -- 172.21.15.115:0/675340284 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 13) v1 ==== 45613+0+0 (secure 0 0 0) 0x7f19a0039040 con 0x7f19ac105ed0 2024-09-13T16:57:35.720 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:34.854+0000 7f199e7fc640 1 --2- 172.21.15.115:0/675340284 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7f1998038740 0x7f199803ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:35.720 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:34.854+0000 7f199e7fc640 1 -- 172.21.15.115:0/675340284 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f19a006b920 con 0x7f19ac105ed0 2024-09-13T16:57:35.721 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:34.854+0000 7f19b326b640 1 -- 172.21.15.115:0/675340284 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19ac109550 con 0x7f19ac105ed0 2024-09-13T16:57:35.721 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:34.854+0000 7f19b0806640 1 --2- 172.21.15.115:0/675340284 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7f1998038740 0x7f199803ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:35.721 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:34.855+0000 7f19b0806640 1 --2- 172.21.15.115:0/675340284 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7f1998038740 0x7f199803ac00 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f19a80098c0 tx=0x7f19a8006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:35.721 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:34.859+0000 7f199e7fc640 1 -- 172.21.15.115:0/675340284 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f19a003f070 con 0x7f19ac105ed0 2024-09-13T16:57:35.724 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:35.102+0000 7f19b326b640 1 -- 172.21.15.115:0/675340284 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7f19ac109740 con 0x7f19ac105ed0 2024-09-13T16:57:35.724 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:35.104+0000 7f199e7fc640 1 -- 172.21.15.115:0/675340284 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v34)=0 set mgr/dashboard/cluster/status v34) v1 ==== 153+0+0 (secure 0 0 0) 0x7f19a0042360 con 0x7f19ac105ed0 2024-09-13T16:57:35.724 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-13T16:57:35.725 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:35.106+0000 7f19b326b640 1 -- 172.21.15.115:0/675340284 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7f1998038740 msgr2=0x7f199803ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:35.725 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:35.106+0000 7f19b326b640 1 --2- 172.21.15.115:0/675340284 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7f1998038740 0x7f199803ac00 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f19a80098c0 tx=0x7f19a8006db0 comp rx=0 tx=0).stop 2024-09-13T16:57:35.725 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:35.106+0000 7f19b326b640 1 -- 172.21.15.115:0/675340284 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19ac105ed0 msgr2=0x7f19ac1990f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:35.725 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:35.106+0000 7f19b326b640 1 --2- 172.21.15.115:0/675340284 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19ac105ed0 0x7f19ac1990f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f19a0032670 tx=0x7f19a00326a0 comp rx=0 tx=0).stop 2024-09-13T16:57:35.725 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:35.106+0000 7f19b326b640 1 -- 172.21.15.115:0/675340284 shutdown_connections 2024-09-13T16:57:35.725 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:35.106+0000 7f19b326b640 1 --2- 172.21.15.115:0/675340284 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7f1998038740 0x7f199803ac00 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:35.725 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:35.106+0000 7f19b326b640 1 --2- 172.21.15.115:0/675340284 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19ac105ed0 0x7f19ac1990f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:35.725 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:35.106+0000 7f19b326b640 1 -- 172.21.15.115:0/675340284 >> 172.21.15.115:0/675340284 conn(0x7f19ac0ffb30 msgr2=0x7f19ac1006e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:57:35.725 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:35.106+0000 7f19b326b640 1 -- 172.21.15.115:0/675340284 shutdown_connections 2024-09-13T16:57:35.725 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T16:57:35.106+0000 7f19b326b640 1 -- 172.21.15.115:0/675340284 wait complete. 2024-09-13T16:57:35.725 INFO:teuthology.orchestra.run.smithi115.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-13T16:57:35.725 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T16:57:35.725 INFO:teuthology.orchestra.run.smithi115.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-13T16:57:35.725 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T16:57:35.726 INFO:teuthology.orchestra.run.smithi115.stdout:Or, if you are only running a single cluster on this host: 2024-09-13T16:57:35.726 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T16:57:35.726 INFO:teuthology.orchestra.run.smithi115.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-13T16:57:35.726 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T16:57:35.726 INFO:teuthology.orchestra.run.smithi115.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-13T16:57:35.726 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T16:57:35.726 INFO:teuthology.orchestra.run.smithi115.stdout: ceph telemetry on 2024-09-13T16:57:35.726 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T16:57:35.726 INFO:teuthology.orchestra.run.smithi115.stdout:For more information see: 2024-09-13T16:57:35.726 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T16:57:35.726 INFO:teuthology.orchestra.run.smithi115.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-13T16:57:35.726 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T16:57:35.726 INFO:teuthology.orchestra.run.smithi115.stdout:Bootstrap complete. 2024-09-13T16:57:35.749 INFO:tasks.cephadm:Fetching config... 2024-09-13T16:57:35.749 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-13T16:57:35.749 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-13T16:57:35.765 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-13T16:57:35.765 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-13T16:57:35.765 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-13T16:57:35.820 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-13T16:57:35.821 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-13T16:57:35.821 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/mon.smithi115/keyring of=/dev/stdout 2024-09-13T16:57:35.887 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-13T16:57:35.887 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-13T16:57:35.887 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-13T16:57:35.944 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-13T16:57:35.944 DEBUG:teuthology.orchestra.run.smithi115:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDL5xgg/ILTITZ3RzY9QT6D5tlO1es36uN8EblRcn4ua7OuEGS3ODgx1yiyhiC3LkDnJQQf+IGO26zPr4Nbg9ySbjnJtXlfVMRTw8Gs5jHNLoSKrS53sHBIrfyO2PRZywvMqD85ZQgiG+uuOub8ByjX0oUkbwmis1+BdSKGHpZHxPafP8dj650BbPjYIYXbf1u1sj3UY8PyGdnxUhRgaF1sj6GPWjG44NY/Ov+ogHePP59wel7Ljf5EM8py4zbgWIDu5/p5XEswd7I3JdJjgfWWWMt3leJ13+2aT0gQpBx6+Asx8Y8Wk0Yt8N4U11hQ8FB0cav3KV+sVNnfJsvw1cKwdFlmLjOHMcco5ZcdLtdmdPSNXI94tb+r+IltCqY2R8K6yVLLZN6rGsU3U0HHZBpOeNYC3M+66hMDRKFY9e6hmPlNphtDO8obs4yn+B7qhd7rhutBQBXHkFn7qlPYrm03ii9XP6URUjwV/YSOw/kfTYtUY95tQlRvwKrme1yVdZs= ceph-ffbd7588-71f0-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-13T16:57:36.021 INFO:teuthology.orchestra.run.smithi115.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDL5xgg/ILTITZ3RzY9QT6D5tlO1es36uN8EblRcn4ua7OuEGS3ODgx1yiyhiC3LkDnJQQf+IGO26zPr4Nbg9ySbjnJtXlfVMRTw8Gs5jHNLoSKrS53sHBIrfyO2PRZywvMqD85ZQgiG+uuOub8ByjX0oUkbwmis1+BdSKGHpZHxPafP8dj650BbPjYIYXbf1u1sj3UY8PyGdnxUhRgaF1sj6GPWjG44NY/Ov+ogHePP59wel7Ljf5EM8py4zbgWIDu5/p5XEswd7I3JdJjgfWWWMt3leJ13+2aT0gQpBx6+Asx8Y8Wk0Yt8N4U11hQ8FB0cav3KV+sVNnfJsvw1cKwdFlmLjOHMcco5ZcdLtdmdPSNXI94tb+r+IltCqY2R8K6yVLLZN6rGsU3U0HHZBpOeNYC3M+66hMDRKFY9e6hmPlNphtDO8obs4yn+B7qhd7rhutBQBXHkFn7qlPYrm03ii9XP6URUjwV/YSOw/kfTYtUY95tQlRvwKrme1yVdZs= ceph-ffbd7588-71f0-11ef-bceb-c7b262605968 2024-09-13T16:57:36.031 DEBUG:teuthology.orchestra.run.smithi195:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDL5xgg/ILTITZ3RzY9QT6D5tlO1es36uN8EblRcn4ua7OuEGS3ODgx1yiyhiC3LkDnJQQf+IGO26zPr4Nbg9ySbjnJtXlfVMRTw8Gs5jHNLoSKrS53sHBIrfyO2PRZywvMqD85ZQgiG+uuOub8ByjX0oUkbwmis1+BdSKGHpZHxPafP8dj650BbPjYIYXbf1u1sj3UY8PyGdnxUhRgaF1sj6GPWjG44NY/Ov+ogHePP59wel7Ljf5EM8py4zbgWIDu5/p5XEswd7I3JdJjgfWWWMt3leJ13+2aT0gQpBx6+Asx8Y8Wk0Yt8N4U11hQ8FB0cav3KV+sVNnfJsvw1cKwdFlmLjOHMcco5ZcdLtdmdPSNXI94tb+r+IltCqY2R8K6yVLLZN6rGsU3U0HHZBpOeNYC3M+66hMDRKFY9e6hmPlNphtDO8obs4yn+B7qhd7rhutBQBXHkFn7qlPYrm03ii9XP6URUjwV/YSOw/kfTYtUY95tQlRvwKrme1yVdZs= ceph-ffbd7588-71f0-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-13T16:57:36.117 INFO:teuthology.orchestra.run.smithi195.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDL5xgg/ILTITZ3RzY9QT6D5tlO1es36uN8EblRcn4ua7OuEGS3ODgx1yiyhiC3LkDnJQQf+IGO26zPr4Nbg9ySbjnJtXlfVMRTw8Gs5jHNLoSKrS53sHBIrfyO2PRZywvMqD85ZQgiG+uuOub8ByjX0oUkbwmis1+BdSKGHpZHxPafP8dj650BbPjYIYXbf1u1sj3UY8PyGdnxUhRgaF1sj6GPWjG44NY/Ov+ogHePP59wel7Ljf5EM8py4zbgWIDu5/p5XEswd7I3JdJjgfWWWMt3leJ13+2aT0gQpBx6+Asx8Y8Wk0Yt8N4U11hQ8FB0cav3KV+sVNnfJsvw1cKwdFlmLjOHMcco5ZcdLtdmdPSNXI94tb+r+IltCqY2R8K6yVLLZN6rGsU3U0HHZBpOeNYC3M+66hMDRKFY9e6hmPlNphtDO8obs4yn+B7qhd7rhutBQBXHkFn7qlPYrm03ii9XP6URUjwV/YSOw/kfTYtUY95tQlRvwKrme1yVdZs= ceph-ffbd7588-71f0-11ef-bceb-c7b262605968 2024-09-13T16:57:36.133 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-13T16:57:36.329 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T16:57:36.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:36 smithi115 ceph-mon[27708]: from='client.? 172.21.15.115:0/675340284' entity='client.admin' 2024-09-13T16:57:38.356 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:38.353+0000 7f70b3665640 1 -- 172.21.15.115:0/3808403630 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70ac0ff7e0 msgr2=0x7f70ac0ffbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:38.357 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:38.353+0000 7f70b3665640 1 --2- 172.21.15.115:0/3808403630 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70ac0ff7e0 0x7f70ac0ffbe0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f70a8009c20 tx=0x7f70a802aa90 comp rx=0 tx=0).stop 2024-09-13T16:57:38.357 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:38.353+0000 7f70b3665640 1 -- 172.21.15.115:0/3808403630 shutdown_connections 2024-09-13T16:57:38.357 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:38.353+0000 7f70b3665640 1 --2- 172.21.15.115:0/3808403630 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70ac0ff7e0 0x7f70ac0ffbe0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:38.357 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:38.353+0000 7f70b3665640 1 -- 172.21.15.115:0/3808403630 >> 172.21.15.115:0/3808403630 conn(0x7f70ac0faf70 msgr2=0x7f70ac0fd3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:57:38.357 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:38.353+0000 7f70b3665640 1 -- 172.21.15.115:0/3808403630 shutdown_connections 2024-09-13T16:57:38.357 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:38.353+0000 7f70b3665640 1 -- 172.21.15.115:0/3808403630 wait complete. 2024-09-13T16:57:38.357 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:38.354+0000 7f70b3665640 1 Processor -- start 2024-09-13T16:57:38.357 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:38.354+0000 7f70b3665640 1 -- start start 2024-09-13T16:57:38.357 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:38.354+0000 7f70b3665640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70ac194e60 0x7f70ac195280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:38.357 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:38.354+0000 7f70b3665640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70ac1957c0 con 0x7f70ac194e60 2024-09-13T16:57:38.357 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:38.354+0000 7f70b1401640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70ac194e60 0x7f70ac195280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:38.358 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:38.354+0000 7f70b1401640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70ac194e60 0x7f70ac195280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47564/0 (socket says 172.21.15.115:47564) 2024-09-13T16:57:38.358 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:38.354+0000 7f70b1401640 1 -- 172.21.15.115:0/3399951019 learned_addr learned my addr 172.21.15.115:0/3399951019 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T16:57:38.358 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:38.354+0000 7f70b1401640 1 -- 172.21.15.115:0/3399951019 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70a8009900 con 0x7f70ac194e60 2024-09-13T16:57:38.358 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:38.355+0000 7f70b1401640 1 --2- 172.21.15.115:0/3399951019 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70ac194e60 0x7f70ac195280 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f70a802ec50 tx=0x7f70a802e5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:38.359 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:38.355+0000 7f70a27fc640 1 -- 172.21.15.115:0/3399951019 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f70a803e070 con 0x7f70ac194e60 2024-09-13T16:57:38.359 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:38.355+0000 7f70a27fc640 1 -- 172.21.15.115:0/3399951019 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f70a802e870 con 0x7f70ac194e60 2024-09-13T16:57:38.359 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:38.355+0000 7f70b3665640 1 -- 172.21.15.115:0/3399951019 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70ac1959c0 con 0x7f70ac194e60 2024-09-13T16:57:38.359 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:38.355+0000 7f70a27fc640 1 -- 172.21.15.115:0/3399951019 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f70a8004750 con 0x7f70ac194e60 2024-09-13T16:57:38.359 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:38.355+0000 7f70b3665640 1 -- 172.21.15.115:0/3399951019 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70ac198530 con 0x7f70ac194e60 2024-09-13T16:57:38.359 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:38.356+0000 7f70b3665640 1 -- 172.21.15.115:0/3399951019 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70ac0ffbe0 con 0x7f70ac194e60 2024-09-13T16:57:38.359 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:38.356+0000 7f70a27fc640 1 -- 172.21.15.115:0/3399951019 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 13) v1 ==== 45613+0+0 (secure 0 0 0) 0x7f70a800a040 con 0x7f70ac194e60 2024-09-13T16:57:38.359 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:38.356+0000 7f70a27fc640 1 --2- 172.21.15.115:0/3399951019 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7f7098038790 0x7f709803ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:38.360 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:38.357+0000 7f70a27fc640 1 -- 172.21.15.115:0/3399951019 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f70a806c1a0 con 0x7f70ac194e60 2024-09-13T16:57:38.360 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:38.357+0000 7f70b0c00640 1 --2- 172.21.15.115:0/3399951019 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7f7098038790 0x7f709803ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:38.360 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:38.357+0000 7f70b0c00640 1 --2- 172.21.15.115:0/3399951019 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7f7098038790 0x7f709803ac50 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f709c0098c0 tx=0x7f709c006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:38.364 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:38.362+0000 7f70a27fc640 1 -- 172.21.15.115:0/3399951019 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f70a802f670 con 0x7f70ac194e60 2024-09-13T16:57:38.535 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:38.533+0000 7f70b3665640 1 -- 172.21.15.115:0/3399951019 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7f70ac18ee80 con 0x7f70ac194e60 2024-09-13T16:57:38.538 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:38.536+0000 7f70a27fc640 1 -- 172.21.15.115:0/3399951019 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7f70a80330c0 con 0x7f70ac194e60 2024-09-13T16:57:38.541 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:38.538+0000 7f70b3665640 1 -- 172.21.15.115:0/3399951019 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7f7098038790 msgr2=0x7f709803ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:38.541 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:38.538+0000 7f70b3665640 1 --2- 172.21.15.115:0/3399951019 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7f7098038790 0x7f709803ac50 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f709c0098c0 tx=0x7f709c006db0 comp rx=0 tx=0).stop 2024-09-13T16:57:38.541 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:38.538+0000 7f70b3665640 1 -- 172.21.15.115:0/3399951019 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70ac194e60 msgr2=0x7f70ac195280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:38.541 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:38.538+0000 7f70b3665640 1 --2- 172.21.15.115:0/3399951019 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70ac194e60 0x7f70ac195280 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f70a802ec50 tx=0x7f70a802e5f0 comp rx=0 tx=0).stop 2024-09-13T16:57:38.541 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:38.538+0000 7f70b3665640 1 -- 172.21.15.115:0/3399951019 shutdown_connections 2024-09-13T16:57:38.541 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:38.538+0000 7f70b3665640 1 --2- 172.21.15.115:0/3399951019 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7f7098038790 0x7f709803ac50 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:38.542 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:38.538+0000 7f70b3665640 1 --2- 172.21.15.115:0/3399951019 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70ac194e60 0x7f70ac195280 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:38.542 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:38.538+0000 7f70b3665640 1 -- 172.21.15.115:0/3399951019 >> 172.21.15.115:0/3399951019 conn(0x7f70ac0faf70 msgr2=0x7f70ac0fb820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:57:38.542 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:38.539+0000 7f70b3665640 1 -- 172.21.15.115:0/3399951019 shutdown_connections 2024-09-13T16:57:38.542 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:38.539+0000 7f70b3665640 1 -- 172.21.15.115:0/3399951019 wait complete. 2024-09-13T16:57:39.341 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-13T16:57:39.342 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-13T16:57:39.412 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:39 smithi115 ceph-mon[27708]: from='mgr.14160 172.21.15.115:0/3221480175' entity='mgr.smithi115.hetcni' 2024-09-13T16:57:39.413 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:39 smithi115 ceph-mon[27708]: from='mgr.14160 172.21.15.115:0/3221480175' entity='mgr.smithi115.hetcni' 2024-09-13T16:57:39.413 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:39 smithi115 ceph-mon[27708]: from='mgr.14160 172.21.15.115:0/3221480175' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "who": "osd/host:smithi115", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:57:39.413 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:39 smithi115 ceph-mon[27708]: from='mgr.14160 172.21.15.115:0/3221480175' entity='mgr.smithi115.hetcni' 2024-09-13T16:57:39.413 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:39 smithi115 ceph-mon[27708]: from='mgr.14160 172.21.15.115:0/3221480175' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi115", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T16:57:39.413 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:39 smithi115 ceph-mon[27708]: from='mgr.14160 172.21.15.115:0/3221480175' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi115", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-13T16:57:39.413 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:39 smithi115 ceph-mon[27708]: from='mgr.14160 172.21.15.115:0/3221480175' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:57:39.413 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:39 smithi115 ceph-mon[27708]: Deploying daemon ceph-exporter.smithi115 on smithi115 2024-09-13T16:57:39.413 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:39 smithi115 ceph-mon[27708]: from='client.? 172.21.15.115:0/3399951019' entity='client.admin' 2024-09-13T16:57:40.075 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T16:57:41.993 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:41.988+0000 7fb39285d640 1 -- 172.21.15.115:0/1845859217 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb38c0ff800 msgr2=0x7fb38c0ffc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:41.993 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:41.988+0000 7fb39285d640 1 --2- 172.21.15.115:0/1845859217 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb38c0ff800 0x7fb38c0ffc00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb37c009880 tx=0x7fb37c02a5d0 comp rx=0 tx=0).stop 2024-09-13T16:57:41.993 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:41.988+0000 7fb39285d640 1 -- 172.21.15.115:0/1845859217 shutdown_connections 2024-09-13T16:57:41.993 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:41.988+0000 7fb39285d640 1 --2- 172.21.15.115:0/1845859217 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb38c0ff800 0x7fb38c0ffc00 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:41.993 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:41.988+0000 7fb39285d640 1 -- 172.21.15.115:0/1845859217 >> 172.21.15.115:0/1845859217 conn(0x7fb38c0faf90 msgr2=0x7fb38c0fd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:57:41.993 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:41.988+0000 7fb39285d640 1 -- 172.21.15.115:0/1845859217 shutdown_connections 2024-09-13T16:57:41.993 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:41.988+0000 7fb39285d640 1 -- 172.21.15.115:0/1845859217 wait complete. 2024-09-13T16:57:41.994 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:41.989+0000 7fb39285d640 1 Processor -- start 2024-09-13T16:57:41.994 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:41.989+0000 7fb39285d640 1 -- start start 2024-09-13T16:57:41.994 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:41.989+0000 7fb39285d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb38c0ff800 0x7fb38c194c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:41.994 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:41.989+0000 7fb39285d640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb38c1951d0 con 0x7fb38c0ff800 2024-09-13T16:57:41.994 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:41.989+0000 7fb38bfff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb38c0ff800 0x7fb38c194c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:41.994 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:41.989+0000 7fb38bfff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb38c0ff800 0x7fb38c194c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47582/0 (socket says 172.21.15.115:47582) 2024-09-13T16:57:41.994 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:41.989+0000 7fb38bfff640 1 -- 172.21.15.115:0/2407631522 learned_addr learned my addr 172.21.15.115:0/2407631522 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T16:57:41.994 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:41.989+0000 7fb38bfff640 1 -- 172.21.15.115:0/2407631522 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb37c009560 con 0x7fb38c0ff800 2024-09-13T16:57:41.994 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:41.989+0000 7fb38bfff640 1 --2- 172.21.15.115:0/2407631522 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb38c0ff800 0x7fb38c194c90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb37c0055c0 tx=0x7fb37c0055f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:41.994 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:41.990+0000 7fb3897fa640 1 -- 172.21.15.115:0/2407631522 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb37c004b20 con 0x7fb38c0ff800 2024-09-13T16:57:41.994 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:41.990+0000 7fb39285d640 1 -- 172.21.15.115:0/2407631522 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb38c1953d0 con 0x7fb38c0ff800 2024-09-13T16:57:41.994 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:41.990+0000 7fb3897fa640 1 -- 172.21.15.115:0/2407631522 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb37c004c80 con 0x7fb38c0ff800 2024-09-13T16:57:41.994 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:41.990+0000 7fb3897fa640 1 -- 172.21.15.115:0/2407631522 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb37c0318a0 con 0x7fb38c0ff800 2024-09-13T16:57:41.995 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:41.990+0000 7fb39285d640 1 -- 172.21.15.115:0/2407631522 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb38c195870 con 0x7fb38c0ff800 2024-09-13T16:57:41.995 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:41.991+0000 7fb3897fa640 1 -- 172.21.15.115:0/2407631522 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 13) v1 ==== 45613+0+0 (secure 0 0 0) 0x7fb37c031b60 con 0x7fb38c0ff800 2024-09-13T16:57:41.995 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:41.991+0000 7fb39285d640 1 -- 172.21.15.115:0/2407631522 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb38c0ffc00 con 0x7fb38c0ff800 2024-09-13T16:57:41.996 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:41.991+0000 7fb3897fa640 1 --2- 172.21.15.115:0/2407631522 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7fb374038740 0x7fb37403ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:41.996 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:41.991+0000 7fb3897fa640 1 -- 172.21.15.115:0/2407631522 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fb37c06c560 con 0x7fb38c0ff800 2024-09-13T16:57:41.996 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:41.991+0000 7fb38b7fe640 1 --2- 172.21.15.115:0/2407631522 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7fb374038740 0x7fb37403ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:41.996 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:41.992+0000 7fb38b7fe640 1 --2- 172.21.15.115:0/2407631522 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7fb374038740 0x7fb37403ac00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb3800098c0 tx=0x7fb380006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:41.998 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:41.996+0000 7fb3897fa640 1 -- 172.21.15.115:0/2407631522 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fb37c0443b0 con 0x7fb38c0ff800 2024-09-13T16:57:42.169 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:42.167+0000 7fb39285d640 1 -- 172.21.15.115:0/2407631522 --> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7fb38c02c530 con 0x7fb374038740 2024-09-13T16:57:42.172 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:42.170+0000 7fb3897fa640 1 -- 172.21.15.115:0/2407631522 <== mgr.14160 v2:172.21.15.115:6800/3889408988 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fb38c02c530 con 0x7fb374038740 2024-09-13T16:57:42.174 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:42.172+0000 7fb39285d640 1 -- 172.21.15.115:0/2407631522 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7fb374038740 msgr2=0x7fb37403ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:42.175 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:42.172+0000 7fb39285d640 1 --2- 172.21.15.115:0/2407631522 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7fb374038740 0x7fb37403ac00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb3800098c0 tx=0x7fb380006db0 comp rx=0 tx=0).stop 2024-09-13T16:57:42.175 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:42.172+0000 7fb39285d640 1 -- 172.21.15.115:0/2407631522 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb38c0ff800 msgr2=0x7fb38c194c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:42.175 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:42.172+0000 7fb39285d640 1 --2- 172.21.15.115:0/2407631522 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb38c0ff800 0x7fb38c194c90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb37c0055c0 tx=0x7fb37c0055f0 comp rx=0 tx=0).stop 2024-09-13T16:57:42.175 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:42.172+0000 7fb39285d640 1 -- 172.21.15.115:0/2407631522 shutdown_connections 2024-09-13T16:57:42.175 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:42.172+0000 7fb39285d640 1 --2- 172.21.15.115:0/2407631522 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7fb374038740 0x7fb37403ac00 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:42.175 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:42.172+0000 7fb39285d640 1 --2- 172.21.15.115:0/2407631522 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb38c0ff800 0x7fb38c194c90 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:42.175 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:42.172+0000 7fb39285d640 1 -- 172.21.15.115:0/2407631522 >> 172.21.15.115:0/2407631522 conn(0x7fb38c0faf90 msgr2=0x7fb38c0fbaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:57:42.175 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:42.172+0000 7fb39285d640 1 -- 172.21.15.115:0/2407631522 shutdown_connections 2024-09-13T16:57:42.175 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:42.172+0000 7fb39285d640 1 -- 172.21.15.115:0/2407631522 wait complete. 2024-09-13T16:57:43.132 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi195 2024-09-13T16:57:43.133 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-09-13T16:57:43.133 DEBUG:teuthology.orchestra.run.smithi195:> dd of=/etc/ceph/ceph.conf 2024-09-13T16:57:43.153 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-09-13T16:57:43.153 DEBUG:teuthology.orchestra.run.smithi195:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-13T16:57:43.212 INFO:tasks.cephadm:Adding host smithi195 to orchestrator... 2024-09-13T16:57:43.212 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -- ceph orch host add smithi195 2024-09-13T16:57:43.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:43 smithi115 ceph-mon[27708]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:57:43.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:43 smithi115 ceph-mon[27708]: from='mgr.14160 172.21.15.115:0/3221480175' entity='mgr.smithi115.hetcni' 2024-09-13T16:57:43.669 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T16:57:44.907 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:44 smithi115 ceph-mon[27708]: from='mgr.14160 172.21.15.115:0/3221480175' entity='mgr.smithi115.hetcni' 2024-09-13T16:57:44.907 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:44 smithi115 ceph-mon[27708]: from='mgr.14160 172.21.15.115:0/3221480175' entity='mgr.smithi115.hetcni' 2024-09-13T16:57:44.907 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:44 smithi115 ceph-mon[27708]: from='mgr.14160 172.21.15.115:0/3221480175' entity='mgr.smithi115.hetcni' 2024-09-13T16:57:44.907 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:44 smithi115 ceph-mon[27708]: from='mgr.14160 172.21.15.115:0/3221480175' entity='mgr.smithi115.hetcni' 2024-09-13T16:57:44.907 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:44 smithi115 ceph-mon[27708]: from='mgr.14160 172.21.15.115:0/3221480175' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi115", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T16:57:44.907 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:44 smithi115 ceph-mon[27708]: from='mgr.14160 172.21.15.115:0/3221480175' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi115", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-13T16:57:44.907 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:44 smithi115 ceph-mon[27708]: from='mgr.14160 172.21.15.115:0/3221480175' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:57:44.908 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:44 smithi115 ceph-mon[27708]: Deploying daemon crash.smithi115 on smithi115 2024-09-13T16:57:46.304 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:46.300+0000 7ff7d128d640 1 -- 172.21.15.115:0/4019410625 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff7cc100ee0 msgr2=0x7ff7cc1012e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:46.304 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:46.300+0000 7ff7d128d640 1 --2- 172.21.15.115:0/4019410625 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff7cc100ee0 0x7ff7cc1012e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc009880 tx=0x7ff7bc02a5d0 comp rx=0 tx=0).stop 2024-09-13T16:57:46.304 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:46.300+0000 7ff7d128d640 1 -- 172.21.15.115:0/4019410625 shutdown_connections 2024-09-13T16:57:46.304 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:46.300+0000 7ff7d128d640 1 --2- 172.21.15.115:0/4019410625 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff7cc100ee0 0x7ff7cc1012e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:46.304 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:46.300+0000 7ff7d128d640 1 -- 172.21.15.115:0/4019410625 >> 172.21.15.115:0/4019410625 conn(0x7ff7cc0faf90 msgr2=0x7ff7cc0fd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:57:46.304 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:46.300+0000 7ff7d128d640 1 -- 172.21.15.115:0/4019410625 shutdown_connections 2024-09-13T16:57:46.305 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:46.300+0000 7ff7d128d640 1 -- 172.21.15.115:0/4019410625 wait complete. 2024-09-13T16:57:46.305 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:46.300+0000 7ff7d128d640 1 Processor -- start 2024-09-13T16:57:46.305 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:46.301+0000 7ff7d128d640 1 -- start start 2024-09-13T16:57:46.305 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:46.301+0000 7ff7d128d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff7cc100ee0 0x7ff7cc074170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:46.305 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:46.301+0000 7ff7d128d640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7cc0746b0 con 0x7ff7cc100ee0 2024-09-13T16:57:46.305 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:46.301+0000 7ff7caffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff7cc100ee0 0x7ff7cc074170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:46.305 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:46.301+0000 7ff7caffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff7cc100ee0 0x7ff7cc074170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:55070/0 (socket says 172.21.15.115:55070) 2024-09-13T16:57:46.305 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:46.301+0000 7ff7caffd640 1 -- 172.21.15.115:0/2250622191 learned_addr learned my addr 172.21.15.115:0/2250622191 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T16:57:46.305 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:46.301+0000 7ff7caffd640 1 -- 172.21.15.115:0/2250622191 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7bc009560 con 0x7ff7cc100ee0 2024-09-13T16:57:46.305 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:46.301+0000 7ff7caffd640 1 --2- 172.21.15.115:0/2250622191 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff7cc100ee0 0x7ff7cc074170 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc0055c0 tx=0x7ff7bc0055f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:46.305 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:46.301+0000 7ff7b3fff640 1 -- 172.21.15.115:0/2250622191 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff7bc004b20 con 0x7ff7cc100ee0 2024-09-13T16:57:46.306 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:46.301+0000 7ff7d128d640 1 -- 172.21.15.115:0/2250622191 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7cc0728a0 con 0x7ff7cc100ee0 2024-09-13T16:57:46.306 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:46.301+0000 7ff7b3fff640 1 -- 172.21.15.115:0/2250622191 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff7bc004c80 con 0x7ff7cc100ee0 2024-09-13T16:57:46.306 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:46.301+0000 7ff7b3fff640 1 -- 172.21.15.115:0/2250622191 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff7bc0318a0 con 0x7ff7cc100ee0 2024-09-13T16:57:46.306 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:46.302+0000 7ff7d128d640 1 -- 172.21.15.115:0/2250622191 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7cc072d40 con 0x7ff7cc100ee0 2024-09-13T16:57:46.306 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:46.302+0000 7ff7b3fff640 1 -- 172.21.15.115:0/2250622191 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 13) v1 ==== 45613+0+0 (secure 0 0 0) 0x7ff7bc031b10 con 0x7ff7cc100ee0 2024-09-13T16:57:46.307 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:46.303+0000 7ff7b3fff640 1 --2- 172.21.15.115:0/2250622191 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7ff7b4038790 0x7ff7b403ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:46.307 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:46.303+0000 7ff7d128d640 1 -- 172.21.15.115:0/2250622191 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7cc073740 con 0x7ff7cc100ee0 2024-09-13T16:57:46.307 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:46.303+0000 7ff7b3fff640 1 -- 172.21.15.115:0/2250622191 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7ff7bc06c380 con 0x7ff7cc100ee0 2024-09-13T16:57:46.307 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:46.303+0000 7ff7ca7fc640 1 --2- 172.21.15.115:0/2250622191 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7ff7b4038790 0x7ff7b403ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:46.307 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:46.303+0000 7ff7ca7fc640 1 --2- 172.21.15.115:0/2250622191 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7ff7b4038790 0x7ff7b403ac50 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff7c00098c0 tx=0x7ff7c0006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:46.310 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:46.307+0000 7ff7b3fff640 1 -- 172.21.15.115:0/2250622191 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff7bc04d530 con 0x7ff7cc100ee0 2024-09-13T16:57:46.492 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:46.489+0000 7ff7d128d640 1 -- 172.21.15.115:0/2250622191 --> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi195", "target": ["mon-mgr", ""]}) v1 -- 0x7ff7cc072f80 con 0x7ff7b4038790 2024-09-13T16:57:46.926 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:46 smithi115 ceph-mon[27708]: from='client.14187 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi195", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:57:48.397 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:48 smithi115 ceph-mon[27708]: from='mgr.14160 172.21.15.115:0/3221480175' entity='mgr.smithi115.hetcni' 2024-09-13T16:57:48.397 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:48 smithi115 ceph-mon[27708]: from='mgr.14160 172.21.15.115:0/3221480175' entity='mgr.smithi115.hetcni' 2024-09-13T16:57:48.397 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:48 smithi115 ceph-mon[27708]: from='mgr.14160 172.21.15.115:0/3221480175' entity='mgr.smithi115.hetcni' 2024-09-13T16:57:48.397 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:48 smithi115 ceph-mon[27708]: from='mgr.14160 172.21.15.115:0/3221480175' entity='mgr.smithi115.hetcni' 2024-09-13T16:57:48.397 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:48 smithi115 ceph-mon[27708]: Deploying daemon node-exporter.smithi115 on smithi115 2024-09-13T16:57:48.397 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:48 smithi115 ceph-mon[27708]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:57:48.397 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:48 smithi115 ceph-mon[27708]: from='mgr.14160 172.21.15.115:0/3221480175' entity='mgr.smithi115.hetcni' 2024-09-13T16:57:48.397 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:48 smithi115 ceph-mon[27708]: Deploying cephadm binary to smithi195 2024-09-13T16:57:49.246 INFO:teuthology.orchestra.run.smithi115.stdout:Added host 'smithi195' with addr '172.21.15.195' 2024-09-13T16:57:49.246 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:49.242+0000 7ff7b3fff640 1 -- 172.21.15.115:0/2250622191 <== mgr.14160 v2:172.21.15.115:6800/3889408988 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7ff7cc072f80 con 0x7ff7b4038790 2024-09-13T16:57:49.247 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:49.245+0000 7ff7d128d640 1 -- 172.21.15.115:0/2250622191 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7ff7b4038790 msgr2=0x7ff7b403ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:49.247 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:49.245+0000 7ff7d128d640 1 --2- 172.21.15.115:0/2250622191 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7ff7b4038790 0x7ff7b403ac50 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff7c00098c0 tx=0x7ff7c0006db0 comp rx=0 tx=0).stop 2024-09-13T16:57:49.247 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:49.245+0000 7ff7d128d640 1 -- 172.21.15.115:0/2250622191 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff7cc100ee0 msgr2=0x7ff7cc074170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:49.247 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:49.245+0000 7ff7d128d640 1 --2- 172.21.15.115:0/2250622191 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff7cc100ee0 0x7ff7cc074170 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc0055c0 tx=0x7ff7bc0055f0 comp rx=0 tx=0).stop 2024-09-13T16:57:49.247 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:49.245+0000 7ff7d128d640 1 -- 172.21.15.115:0/2250622191 shutdown_connections 2024-09-13T16:57:49.248 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:49.245+0000 7ff7d128d640 1 --2- 172.21.15.115:0/2250622191 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7ff7b4038790 0x7ff7b403ac50 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:49.248 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:49.245+0000 7ff7d128d640 1 --2- 172.21.15.115:0/2250622191 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff7cc100ee0 0x7ff7cc074170 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:49.248 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:49.245+0000 7ff7d128d640 1 -- 172.21.15.115:0/2250622191 >> 172.21.15.115:0/2250622191 conn(0x7ff7cc0faf90 msgr2=0x7ff7cc0fba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:57:49.248 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:49.245+0000 7ff7d128d640 1 -- 172.21.15.115:0/2250622191 shutdown_connections 2024-09-13T16:57:49.248 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:49.245+0000 7ff7d128d640 1 -- 172.21.15.115:0/2250622191 wait complete. 2024-09-13T16:57:50.342 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-13T16:57:50.659 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:50 smithi115 ceph-mon[27708]: from='mgr.14160 172.21.15.115:0/3221480175' entity='mgr.smithi115.hetcni' 2024-09-13T16:57:50.659 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:50 smithi115 ceph-mon[27708]: Added host smithi195 2024-09-13T16:57:50.659 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:50 smithi115 ceph-mon[27708]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:57:51.031 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T16:57:52.377 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:52 smithi115 ceph-mon[27708]: from='mgr.14160 172.21.15.115:0/3221480175' entity='mgr.smithi115.hetcni' 2024-09-13T16:57:52.377 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:52 smithi115 ceph-mon[27708]: from='mgr.14160 172.21.15.115:0/3221480175' entity='mgr.smithi115.hetcni' 2024-09-13T16:57:52.378 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:52 smithi115 ceph-mon[27708]: from='mgr.14160 172.21.15.115:0/3221480175' entity='mgr.smithi115.hetcni' 2024-09-13T16:57:52.378 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:52 smithi115 ceph-mon[27708]: from='mgr.14160 172.21.15.115:0/3221480175' entity='mgr.smithi115.hetcni' 2024-09-13T16:57:52.378 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:52 smithi115 ceph-mon[27708]: Deploying daemon alertmanager.smithi115 on smithi115 2024-09-13T16:57:52.378 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:52 smithi115 ceph-mon[27708]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:57:52.475 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:52.473+0000 7f902b8a3640 1 -- 172.21.15.115:0/3291411908 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9024100280 msgr2=0x7f9024102670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:52.475 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:52.473+0000 7f902b8a3640 1 --2- 172.21.15.115:0/3291411908 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9024100280 0x7f9024102670 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f901c009880 tx=0x7f901c02a5d0 comp rx=0 tx=0).stop 2024-09-13T16:57:52.475 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:52.473+0000 7f902b8a3640 1 -- 172.21.15.115:0/3291411908 shutdown_connections 2024-09-13T16:57:52.475 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:52.473+0000 7f902b8a3640 1 --2- 172.21.15.115:0/3291411908 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9024100280 0x7f9024102670 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:52.475 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:52.473+0000 7f902b8a3640 1 -- 172.21.15.115:0/3291411908 >> 172.21.15.115:0/3291411908 conn(0x7f90240f9e80 msgr2=0x7f90240fc2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:57:52.475 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:52.474+0000 7f902b8a3640 1 -- 172.21.15.115:0/3291411908 shutdown_connections 2024-09-13T16:57:52.475 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:52.474+0000 7f902b8a3640 1 -- 172.21.15.115:0/3291411908 wait complete. 2024-09-13T16:57:52.477 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:52.474+0000 7f902b8a3640 1 Processor -- start 2024-09-13T16:57:52.478 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:52.474+0000 7f902b8a3640 1 -- start start 2024-09-13T16:57:52.478 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:52.474+0000 7f902b8a3640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9024100280 0x7f90240ffb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:52.478 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:52.474+0000 7f902b8a3640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9024100040 con 0x7f9024100280 2024-09-13T16:57:52.478 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:52.474+0000 7f902963f640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9024100280 0x7f90240ffb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:52.478 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:52.474+0000 7f902963f640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9024100280 0x7f90240ffb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:55086/0 (socket says 172.21.15.115:55086) 2024-09-13T16:57:52.478 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:52.474+0000 7f902963f640 1 -- 172.21.15.115:0/2000749985 learned_addr learned my addr 172.21.15.115:0/2000749985 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T16:57:52.478 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:52.475+0000 7f902963f640 1 -- 172.21.15.115:0/2000749985 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f901c009560 con 0x7f9024100280 2024-09-13T16:57:52.478 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:52.475+0000 7f902963f640 1 --2- 172.21.15.115:0/2000749985 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9024100280 0x7f90240ffb00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f901c0099a0 tx=0x7f901c004dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:52.478 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:52.475+0000 7f90227fc640 1 -- 172.21.15.115:0/2000749985 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f901c0054d0 con 0x7f9024100280 2024-09-13T16:57:52.478 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:52.475+0000 7f902b8a3640 1 -- 172.21.15.115:0/2000749985 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90240fe230 con 0x7f9024100280 2024-09-13T16:57:52.478 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:52.475+0000 7f90227fc640 1 -- 172.21.15.115:0/2000749985 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f901c003a90 con 0x7f9024100280 2024-09-13T16:57:52.479 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:52.475+0000 7f90227fc640 1 -- 172.21.15.115:0/2000749985 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f901c031a10 con 0x7f9024100280 2024-09-13T16:57:52.479 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:52.475+0000 7f902b8a3640 1 -- 172.21.15.115:0/2000749985 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90240fe6d0 con 0x7f9024100280 2024-09-13T16:57:52.479 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:52.476+0000 7f90227fc640 1 -- 172.21.15.115:0/2000749985 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 13) v1 ==== 45613+0+0 (secure 0 0 0) 0x7f901c031c80 con 0x7f9024100280 2024-09-13T16:57:52.479 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:52.476+0000 7f90227fc640 1 --2- 172.21.15.115:0/2000749985 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7f900c038740 0x7f900c03ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:52.479 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:52.476+0000 7f90227fc640 1 -- 172.21.15.115:0/2000749985 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f901c06c5e0 con 0x7f9024100280 2024-09-13T16:57:52.479 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:52.476+0000 7f9028e3e640 1 --2- 172.21.15.115:0/2000749985 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7f900c038740 0x7f900c03ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:52.479 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:52.476+0000 7f902b8a3640 1 -- 172.21.15.115:0/2000749985 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9024105e80 con 0x7f9024100280 2024-09-13T16:57:52.479 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:52.477+0000 7f9028e3e640 1 --2- 172.21.15.115:0/2000749985 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7f900c038740 0x7f900c03ac00 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f90180098c0 tx=0x7f9018006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:52.482 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:52.481+0000 7f90227fc640 1 -- 172.21.15.115:0/2000749985 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f901c035020 con 0x7f9024100280 2024-09-13T16:57:52.653 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:52.651+0000 7f902b8a3640 1 -- 172.21.15.115:0/2000749985 --> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f90240fe9d0 con 0x7f900c038740 2024-09-13T16:57:52.653 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:52.652+0000 7f90227fc640 1 -- 172.21.15.115:0/2000749985 <== mgr.14160 v2:172.21.15.115:6800/3889408988 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+161 (secure 0 0 0) 0x7f90240fe9d0 con 0x7f900c038740 2024-09-13T16:57:52.654 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T16:57:52.654 INFO:teuthology.orchestra.run.smithi115.stdout:[{"addr": "172.21.15.115", "hostname": "smithi115", "labels": [], "status": ""}, {"addr": "172.21.15.195", "hostname": "smithi195", "labels": [], "status": ""}] 2024-09-13T16:57:52.656 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:52.654+0000 7f902b8a3640 1 -- 172.21.15.115:0/2000749985 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7f900c038740 msgr2=0x7f900c03ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:52.656 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:52.654+0000 7f902b8a3640 1 --2- 172.21.15.115:0/2000749985 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7f900c038740 0x7f900c03ac00 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f90180098c0 tx=0x7f9018006db0 comp rx=0 tx=0).stop 2024-09-13T16:57:52.656 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:52.654+0000 7f902b8a3640 1 -- 172.21.15.115:0/2000749985 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9024100280 msgr2=0x7f90240ffb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:52.656 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:52.654+0000 7f902b8a3640 1 --2- 172.21.15.115:0/2000749985 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9024100280 0x7f90240ffb00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f901c0099a0 tx=0x7f901c004dc0 comp rx=0 tx=0).stop 2024-09-13T16:57:52.656 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:52.654+0000 7f902b8a3640 1 -- 172.21.15.115:0/2000749985 shutdown_connections 2024-09-13T16:57:52.656 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:52.655+0000 7f902b8a3640 1 --2- 172.21.15.115:0/2000749985 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7f900c038740 0x7f900c03ac00 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:52.657 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:52.655+0000 7f902b8a3640 1 --2- 172.21.15.115:0/2000749985 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9024100280 0x7f90240ffb00 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:52.657 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:52.655+0000 7f902b8a3640 1 -- 172.21.15.115:0/2000749985 >> 172.21.15.115:0/2000749985 conn(0x7f90240f9e80 msgr2=0x7f90240fa930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:57:52.657 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:52.655+0000 7f902b8a3640 1 -- 172.21.15.115:0/2000749985 shutdown_connections 2024-09-13T16:57:52.657 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:52.655+0000 7f902b8a3640 1 -- 172.21.15.115:0/2000749985 wait complete. 2024-09-13T16:57:53.456 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-13T16:57:53.457 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -- ceph osd crush tunables default 2024-09-13T16:57:53.660 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T16:57:53.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:53 smithi115 ceph-mon[27708]: from='mgr.14160 172.21.15.115:0/3221480175' entity='mgr.smithi115.hetcni' 2024-09-13T16:57:54.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:54 smithi115 ceph-mon[27708]: from='client.14189 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T16:57:54.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:54 smithi115 ceph-mon[27708]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:57:56.496 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:56 smithi115 ceph-mon[27708]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:57:56.816 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:56.744+0000 7ff1a37e4640 1 -- 172.21.15.115:0/159345738 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff19c0744e0 msgr2=0x7ff19c072940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:56.816 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:56.744+0000 7ff1a37e4640 1 --2- 172.21.15.115:0/159345738 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff19c0744e0 0x7ff19c072940 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff198009880 tx=0x7ff19802a5d0 comp rx=0 tx=0).stop 2024-09-13T16:57:56.816 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:56.744+0000 7ff1a37e4640 1 -- 172.21.15.115:0/159345738 shutdown_connections 2024-09-13T16:57:56.816 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:56.744+0000 7ff1a37e4640 1 --2- 172.21.15.115:0/159345738 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff19c0744e0 0x7ff19c072940 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:56.817 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:56.744+0000 7ff1a37e4640 1 -- 172.21.15.115:0/159345738 >> 172.21.15.115:0/159345738 conn(0x7ff19c0faf90 msgr2=0x7ff19c0fd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:57:56.817 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:56.744+0000 7ff1a37e4640 1 -- 172.21.15.115:0/159345738 shutdown_connections 2024-09-13T16:57:56.817 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:56.744+0000 7ff1a37e4640 1 -- 172.21.15.115:0/159345738 wait complete. 2024-09-13T16:57:56.817 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:56.745+0000 7ff1a37e4640 1 Processor -- start 2024-09-13T16:57:56.817 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:56.745+0000 7ff1a37e4640 1 -- start start 2024-09-13T16:57:56.817 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:56.745+0000 7ff1a37e4640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff19c0744e0 0x7ff19c196e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:56.817 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:56.745+0000 7ff1a37e4640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff19c1973a0 con 0x7ff19c0744e0 2024-09-13T16:57:56.817 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:56.745+0000 7ff1a1580640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff19c0744e0 0x7ff19c196e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:56.817 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:56.745+0000 7ff1a1580640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff19c0744e0 0x7ff19c196e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:43738/0 (socket says 172.21.15.115:43738) 2024-09-13T16:57:56.817 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:56.745+0000 7ff1a1580640 1 -- 172.21.15.115:0/313193589 learned_addr learned my addr 172.21.15.115:0/313193589 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T16:57:56.817 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:56.746+0000 7ff1a1580640 1 -- 172.21.15.115:0/313193589 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff198009560 con 0x7ff19c0744e0 2024-09-13T16:57:56.817 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:56.746+0000 7ff1a1580640 1 --2- 172.21.15.115:0/313193589 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff19c0744e0 0x7ff19c196e60 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff1980055c0 tx=0x7ff1980055f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:56.817 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:56.746+0000 7ff1927fc640 1 -- 172.21.15.115:0/313193589 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff198004b20 con 0x7ff19c0744e0 2024-09-13T16:57:56.818 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:56.746+0000 7ff1927fc640 1 -- 172.21.15.115:0/313193589 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff198004c80 con 0x7ff19c0744e0 2024-09-13T16:57:56.818 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:56.746+0000 7ff1a37e4640 1 -- 172.21.15.115:0/313193589 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff19c1975a0 con 0x7ff19c0744e0 2024-09-13T16:57:56.818 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:56.746+0000 7ff1927fc640 1 -- 172.21.15.115:0/313193589 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff1980318a0 con 0x7ff19c0744e0 2024-09-13T16:57:56.818 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:56.746+0000 7ff1a37e4640 1 -- 172.21.15.115:0/313193589 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff19c197a40 con 0x7ff19c0744e0 2024-09-13T16:57:56.818 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:56.747+0000 7ff1927fc640 1 -- 172.21.15.115:0/313193589 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 13) v1 ==== 45613+0+0 (secure 0 0 0) 0x7ff198031b10 con 0x7ff19c0744e0 2024-09-13T16:57:56.818 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:56.747+0000 7ff1927fc640 1 --2- 172.21.15.115:0/313193589 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7ff188038790 0x7ff18803ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:57:56.818 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:56.747+0000 7ff1a37e4640 1 -- 172.21.15.115:0/313193589 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff19c072940 con 0x7ff19c0744e0 2024-09-13T16:57:56.818 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:56.747+0000 7ff1927fc640 1 -- 172.21.15.115:0/313193589 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7ff19806c350 con 0x7ff19c0744e0 2024-09-13T16:57:56.818 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:56.747+0000 7ff1a0d7f640 1 --2- 172.21.15.115:0/313193589 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7ff188038790 0x7ff18803ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:57:56.818 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:56.748+0000 7ff1a0d7f640 1 --2- 172.21.15.115:0/313193589 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7ff188038790 0x7ff18803ac50 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff18c0098c0 tx=0x7ff18c006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:57:56.818 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:56.752+0000 7ff1927fc640 1 -- 172.21.15.115:0/313193589 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff1980443b0 con 0x7ff19c0744e0 2024-09-13T16:57:56.919 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:56.918+0000 7ff1a37e4640 1 -- 172.21.15.115:0/313193589 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7ff19c1906f0 con 0x7ff19c0744e0 2024-09-13T16:57:57.388 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:57.387+0000 7ff1927fc640 1 -- 172.21.15.115:0/313193589 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7ff198036a90 con 0x7ff19c0744e0 2024-09-13T16:57:57.388 INFO:teuthology.orchestra.run.smithi115.stderr:adjusted tunables profile to default 2024-09-13T16:57:57.390 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:57.389+0000 7ff1a37e4640 1 -- 172.21.15.115:0/313193589 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7ff188038790 msgr2=0x7ff18803ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:57.391 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:57.389+0000 7ff1a37e4640 1 --2- 172.21.15.115:0/313193589 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7ff188038790 0x7ff18803ac50 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff18c0098c0 tx=0x7ff18c006db0 comp rx=0 tx=0).stop 2024-09-13T16:57:57.391 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:57.389+0000 7ff1a37e4640 1 -- 172.21.15.115:0/313193589 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff19c0744e0 msgr2=0x7ff19c196e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:57:57.391 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:57.389+0000 7ff1a37e4640 1 --2- 172.21.15.115:0/313193589 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff19c0744e0 0x7ff19c196e60 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff1980055c0 tx=0x7ff1980055f0 comp rx=0 tx=0).stop 2024-09-13T16:57:57.391 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:57.389+0000 7ff1a37e4640 1 -- 172.21.15.115:0/313193589 shutdown_connections 2024-09-13T16:57:57.391 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:57.389+0000 7ff1a37e4640 1 --2- 172.21.15.115:0/313193589 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7ff188038790 0x7ff18803ac50 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:57.391 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:57.389+0000 7ff1a37e4640 1 --2- 172.21.15.115:0/313193589 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff19c0744e0 0x7ff19c196e60 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:57:57.391 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:57.389+0000 7ff1a37e4640 1 -- 172.21.15.115:0/313193589 >> 172.21.15.115:0/313193589 conn(0x7ff19c0faf90 msgr2=0x7ff19c0fbaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:57:57.391 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:57.389+0000 7ff1a37e4640 1 -- 172.21.15.115:0/313193589 shutdown_connections 2024-09-13T16:57:57.391 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:57:57.389+0000 7ff1a37e4640 1 -- 172.21.15.115:0/313193589 wait complete. 2024-09-13T16:57:57.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:57 smithi115 ceph-mon[27708]: from='client.? 172.21.15.115:0/313193589' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-13T16:57:58.561 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:58 smithi115 ceph-mon[27708]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:57:58.561 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:58 smithi115 ceph-mon[27708]: from='client.? 172.21.15.115:0/313193589' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-13T16:57:58.561 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:57:58 smithi115 ceph-mon[27708]: osdmap e4: 0 total, 0 up, 0 in 2024-09-13T16:58:00.245 INFO:tasks.cephadm:Adding mon.smithi115 on smithi115 2024-09-13T16:58:00.245 INFO:tasks.cephadm:Adding mon.smithi195 on smithi195 2024-09-13T16:58:00.246 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -- ceph orch apply mon '2;smithi115:172.21.15.115=smithi115;smithi195:172.21.15.195=smithi195' 2024-09-13T16:58:00.441 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T16:58:00.554 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T16:58:00.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:00 smithi115 ceph-mon[27708]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:58:02.116 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:02.112+0000 7fde69cfe640 1 -- 172.21.15.195:0/1672104278 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fde640fdaa0 msgr2=0x7fde640fdea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:58:02.117 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:02.112+0000 7fde69cfe640 1 --2- 172.21.15.195:0/1672104278 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fde640fdaa0 0x7fde640fdea0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fde54009880 tx=0x7fde5402a5d0 comp rx=0 tx=0).stop 2024-09-13T16:58:02.117 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:02.113+0000 7fde69cfe640 1 -- 172.21.15.195:0/1672104278 shutdown_connections 2024-09-13T16:58:02.117 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:02.113+0000 7fde69cfe640 1 --2- 172.21.15.195:0/1672104278 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fde640fdaa0 0x7fde640fdea0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:02.117 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:02.113+0000 7fde69cfe640 1 -- 172.21.15.195:0/1672104278 >> 172.21.15.195:0/1672104278 conn(0x7fde640f9650 msgr2=0x7fde640fba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:58:02.117 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:02.113+0000 7fde69cfe640 1 -- 172.21.15.195:0/1672104278 shutdown_connections 2024-09-13T16:58:02.117 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:02.113+0000 7fde69cfe640 1 -- 172.21.15.195:0/1672104278 wait complete. 2024-09-13T16:58:02.117 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:02.113+0000 7fde69cfe640 1 Processor -- start 2024-09-13T16:58:02.117 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:02.114+0000 7fde69cfe640 1 -- start start 2024-09-13T16:58:02.117 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:02.114+0000 7fde69cfe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fde640fdaa0 0x7fde64194be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:58:02.117 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:02.114+0000 7fde69cfe640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde64195120 con 0x7fde640fdaa0 2024-09-13T16:58:02.117 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:02.114+0000 7fde637fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fde640fdaa0 0x7fde64194be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:58:02.117 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:02.114+0000 7fde637fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fde640fdaa0 0x7fde64194be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.195:52132/0 (socket says 172.21.15.195:52132) 2024-09-13T16:58:02.118 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:02.114+0000 7fde637fe640 1 -- 172.21.15.195:0/832801846 learned_addr learned my addr 172.21.15.195:0/832801846 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-09-13T16:58:02.118 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:02.114+0000 7fde637fe640 1 -- 172.21.15.195:0/832801846 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde54009560 con 0x7fde640fdaa0 2024-09-13T16:58:02.118 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:02.114+0000 7fde637fe640 1 --2- 172.21.15.195:0/832801846 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fde640fdaa0 0x7fde64194be0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fde54004cf0 tx=0x7fde54004d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:58:02.118 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:02.115+0000 7fde60ff9640 1 -- 172.21.15.195:0/832801846 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fde540053f0 con 0x7fde640fdaa0 2024-09-13T16:58:02.118 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:02.115+0000 7fde69cfe640 1 -- 172.21.15.195:0/832801846 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde64195320 con 0x7fde640fdaa0 2024-09-13T16:58:02.118 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:02.115+0000 7fde60ff9640 1 -- 172.21.15.195:0/832801846 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fde54005550 con 0x7fde640fdaa0 2024-09-13T16:58:02.118 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:02.115+0000 7fde60ff9640 1 -- 172.21.15.195:0/832801846 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fde540319c0 con 0x7fde640fdaa0 2024-09-13T16:58:02.118 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:02.115+0000 7fde69cfe640 1 -- 172.21.15.195:0/832801846 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde641957c0 con 0x7fde640fdaa0 2024-09-13T16:58:02.119 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:02.116+0000 7fde69cfe640 1 -- 172.21.15.195:0/832801846 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde640fdea0 con 0x7fde640fdaa0 2024-09-13T16:58:02.119 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:02.116+0000 7fde60ff9640 1 -- 172.21.15.195:0/832801846 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 13) v1 ==== 45613+0+0 (secure 0 0 0) 0x7fde54031c30 con 0x7fde640fdaa0 2024-09-13T16:58:02.119 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:02.116+0000 7fde60ff9640 1 --2- 172.21.15.195:0/832801846 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7fde4c038740 0x7fde4c03ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:58:02.119 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:02.116+0000 7fde60ff9640 1 -- 172.21.15.195:0/832801846 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fde5406c440 con 0x7fde640fdaa0 2024-09-13T16:58:02.119 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:02.116+0000 7fde62ffd640 1 --2- 172.21.15.195:0/832801846 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7fde4c038740 0x7fde4c03ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:58:02.119 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:02.117+0000 7fde62ffd640 1 --2- 172.21.15.195:0/832801846 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7fde4c038740 0x7fde4c03ac00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fde580098c0 tx=0x7fde58006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:58:02.123 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:02.122+0000 7fde60ff9640 1 -- 172.21.15.195:0/832801846 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fde5404dce0 con 0x7fde640fdaa0 2024-09-13T16:58:02.293 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:02.292+0000 7fde69cfe640 1 -- 172.21.15.195:0/832801846 --> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi115:172.21.15.115=smithi115;smithi195:172.21.15.195=smithi195", "target": ["mon-mgr", ""]}) v1 -- 0x7fde6402c4a0 con 0x7fde4c038740 2024-09-13T16:58:02.299 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:02.298+0000 7fde60ff9640 1 -- 172.21.15.195:0/832801846 <== mgr.14160 v2:172.21.15.115:6800/3889408988 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fde6402c4a0 con 0x7fde4c038740 2024-09-13T16:58:02.299 INFO:teuthology.orchestra.run.smithi195.stdout:Scheduled mon update... 2024-09-13T16:58:02.301 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:02.300+0000 7fde69cfe640 1 -- 172.21.15.195:0/832801846 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7fde4c038740 msgr2=0x7fde4c03ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:58:02.301 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:02.300+0000 7fde69cfe640 1 --2- 172.21.15.195:0/832801846 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7fde4c038740 0x7fde4c03ac00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fde580098c0 tx=0x7fde58006db0 comp rx=0 tx=0).stop 2024-09-13T16:58:02.302 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:02.300+0000 7fde69cfe640 1 -- 172.21.15.195:0/832801846 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fde640fdaa0 msgr2=0x7fde64194be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:58:02.302 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:02.300+0000 7fde69cfe640 1 --2- 172.21.15.195:0/832801846 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fde640fdaa0 0x7fde64194be0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fde54004cf0 tx=0x7fde54004d20 comp rx=0 tx=0).stop 2024-09-13T16:58:02.302 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:02.300+0000 7fde69cfe640 1 -- 172.21.15.195:0/832801846 shutdown_connections 2024-09-13T16:58:02.302 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:02.300+0000 7fde69cfe640 1 --2- 172.21.15.195:0/832801846 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7fde4c038740 0x7fde4c03ac00 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:02.302 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:02.300+0000 7fde69cfe640 1 --2- 172.21.15.195:0/832801846 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fde640fdaa0 0x7fde64194be0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:02.302 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:02.300+0000 7fde69cfe640 1 -- 172.21.15.195:0/832801846 >> 172.21.15.195:0/832801846 conn(0x7fde640f9650 msgr2=0x7fde640fa090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:58:02.302 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:02.300+0000 7fde69cfe640 1 -- 172.21.15.195:0/832801846 shutdown_connections 2024-09-13T16:58:02.302 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:02.300+0000 7fde69cfe640 1 -- 172.21.15.195:0/832801846 wait complete. 2024-09-13T16:58:02.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:02 smithi115 ceph-mon[27708]: from='mgr.14160 172.21.15.115:0/3221480175' entity='mgr.smithi115.hetcni' 2024-09-13T16:58:02.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:02 smithi115 ceph-mon[27708]: from='mgr.14160 172.21.15.115:0/3221480175' entity='mgr.smithi115.hetcni' 2024-09-13T16:58:02.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:02 smithi115 ceph-mon[27708]: from='mgr.14160 172.21.15.115:0/3221480175' entity='mgr.smithi115.hetcni' 2024-09-13T16:58:02.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:02 smithi115 ceph-mon[27708]: from='mgr.14160 172.21.15.115:0/3221480175' entity='mgr.smithi115.hetcni' 2024-09-13T16:58:02.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:02 smithi115 ceph-mon[27708]: from='mgr.14160 172.21.15.115:0/3221480175' entity='mgr.smithi115.hetcni' 2024-09-13T16:58:02.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:02 smithi115 ceph-mon[27708]: from='mgr.14160 172.21.15.115:0/3221480175' entity='mgr.smithi115.hetcni' 2024-09-13T16:58:02.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:02 smithi115 ceph-mon[27708]: Regenerating cephadm self-signed grafana TLS certificates 2024-09-13T16:58:02.430 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:02 smithi115 ceph-mon[27708]: from='mgr.14160 172.21.15.115:0/3221480175' entity='mgr.smithi115.hetcni' 2024-09-13T16:58:02.430 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:02 smithi115 ceph-mon[27708]: from='mgr.14160 172.21.15.115:0/3221480175' entity='mgr.smithi115.hetcni' 2024-09-13T16:58:02.430 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:02 smithi115 ceph-mon[27708]: from='mgr.14160 172.21.15.115:0/3221480175' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-13T16:58:02.430 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:02 smithi115 ceph-mon[27708]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-13T16:58:02.430 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:02 smithi115 ceph-mon[27708]: from='mgr.14160 172.21.15.115:0/3221480175' entity='mgr.smithi115.hetcni' 2024-09-13T16:58:02.430 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:02 smithi115 ceph-mon[27708]: Deploying daemon grafana.smithi115 on smithi115 2024-09-13T16:58:02.430 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:02 smithi115 ceph-mon[27708]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:58:02.909 DEBUG:teuthology.orchestra.run.smithi195:mon.smithi195> sudo journalctl -f -n 0 -u ceph-ffbd7588-71f0-11ef-bceb-c7b262605968@mon.smithi195.service 2024-09-13T16:58:02.911 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T16:58:02.911 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T16:58:03.133 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T16:58:03.177 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T16:58:03.628 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:03 smithi115 ceph-mon[27708]: from='client.14193 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi115:172.21.15.115=smithi115;smithi195:172.21.15.195=smithi195", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:58:03.628 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:03 smithi115 ceph-mon[27708]: Saving service mon spec with placement smithi115:172.21.15.115=smithi115;smithi195:172.21.15.195=smithi195;count:2 2024-09-13T16:58:03.628 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:03 smithi115 ceph-mon[27708]: from='mgr.14160 172.21.15.115:0/3221480175' entity='mgr.smithi115.hetcni' 2024-09-13T16:58:03.628 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:03 smithi115 ceph-mon[27708]: from='mgr.14160 172.21.15.115:0/3221480175' entity='mgr.smithi115.hetcni' 2024-09-13T16:58:04.570 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:04.563+0000 7f321ccfe640 1 -- 172.21.15.195:0/2977591619 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32180ff7d0 msgr2=0x7f32180ffbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:58:04.570 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:04.563+0000 7f321ccfe640 1 --2- 172.21.15.195:0/2977591619 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32180ff7d0 0x7f32180ffbd0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3208009c20 tx=0x7f320802aa90 comp rx=0 tx=0).stop 2024-09-13T16:58:04.570 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:04.563+0000 7f321ccfe640 1 -- 172.21.15.195:0/2977591619 shutdown_connections 2024-09-13T16:58:04.570 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:04.563+0000 7f321ccfe640 1 --2- 172.21.15.195:0/2977591619 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32180ff7d0 0x7f32180ffbd0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:04.570 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:04.563+0000 7f321ccfe640 1 -- 172.21.15.195:0/2977591619 >> 172.21.15.195:0/2977591619 conn(0x7f32180fafa0 msgr2=0x7f32180fd3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:58:04.570 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:04.563+0000 7f321ccfe640 1 -- 172.21.15.195:0/2977591619 shutdown_connections 2024-09-13T16:58:04.571 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:04.563+0000 7f321ccfe640 1 -- 172.21.15.195:0/2977591619 wait complete. 2024-09-13T16:58:04.571 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:04.564+0000 7f321ccfe640 1 Processor -- start 2024-09-13T16:58:04.571 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:04.564+0000 7f321ccfe640 1 -- start start 2024-09-13T16:58:04.571 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:04.564+0000 7f321ccfe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32180ff7d0 0x7f3218194c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:58:04.571 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:04.564+0000 7f321ccfe640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32181951b0 con 0x7f32180ff7d0 2024-09-13T16:58:04.571 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:04.564+0000 7f321659c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32180ff7d0 0x7f3218194c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:58:04.571 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:04.564+0000 7f321659c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32180ff7d0 0x7f3218194c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.195:52160/0 (socket says 172.21.15.195:52160) 2024-09-13T16:58:04.571 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:04.564+0000 7f321659c640 1 -- 172.21.15.195:0/2900151691 learned_addr learned my addr 172.21.15.195:0/2900151691 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-09-13T16:58:04.571 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:04.564+0000 7f321659c640 1 -- 172.21.15.195:0/2900151691 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3208009900 con 0x7f32180ff7d0 2024-09-13T16:58:04.571 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:04.564+0000 7f321659c640 1 --2- 172.21.15.195:0/2900151691 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32180ff7d0 0x7f3218194c70 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3208005cc0 tx=0x7f320802e5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:58:04.571 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:04.565+0000 7f320f7fe640 1 -- 172.21.15.195:0/2900151691 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f320803e070 con 0x7f32180ff7d0 2024-09-13T16:58:04.571 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:04.565+0000 7f320f7fe640 1 -- 172.21.15.195:0/2900151691 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f320802e910 con 0x7f32180ff7d0 2024-09-13T16:58:04.572 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:04.565+0000 7f321ccfe640 1 -- 172.21.15.195:0/2900151691 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32181953b0 con 0x7f32180ff7d0 2024-09-13T16:58:04.572 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:04.565+0000 7f320f7fe640 1 -- 172.21.15.195:0/2900151691 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3208004840 con 0x7f32180ff7d0 2024-09-13T16:58:04.572 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:04.565+0000 7f321ccfe640 1 -- 172.21.15.195:0/2900151691 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3218195850 con 0x7f32180ff7d0 2024-09-13T16:58:04.572 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:04.566+0000 7f320f7fe640 1 -- 172.21.15.195:0/2900151691 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 13) v1 ==== 45613+0+0 (secure 0 0 0) 0x7f320800a040 con 0x7f32180ff7d0 2024-09-13T16:58:04.572 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:04.566+0000 7f320f7fe640 1 --2- 172.21.15.195:0/2900151691 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7f3204038740 0x7f320403ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:58:04.572 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:04.566+0000 7f320f7fe640 1 -- 172.21.15.195:0/2900151691 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f320806c280 con 0x7f32180ff7d0 2024-09-13T16:58:04.572 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:04.566+0000 7f321ccfe640 1 -- 172.21.15.195:0/2900151691 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32180ffc50 con 0x7f32180ff7d0 2024-09-13T16:58:04.572 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:04.566+0000 7f3215d9b640 1 --2- 172.21.15.195:0/2900151691 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7f3204038740 0x7f320403ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:58:04.572 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:04.566+0000 7f3215d9b640 1 --2- 172.21.15.195:0/2900151691 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7f3204038740 0x7f320403ac00 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f32000098c0 tx=0x7f3200006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:58:04.574 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:04.572+0000 7f320f7fe640 1 -- 172.21.15.195:0/2900151691 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f3208047080 con 0x7f32180ff7d0 2024-09-13T16:58:04.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:04 smithi115 ceph-mon[27708]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:58:04.796 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:04.794+0000 7f321ccfe640 1 -- 172.21.15.195:0/2900151691 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f321818e4c0 con 0x7f32180ff7d0 2024-09-13T16:58:04.796 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:04.795+0000 7f320f7fe640 1 -- 172.21.15.195:0/2900151691 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7f3208033020 con 0x7f32180ff7d0 2024-09-13T16:58:04.797 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:58:04.797 INFO:teuthology.orchestra.run.smithi195.stdout:{"epoch":1,"fsid":"ffbd7588-71f0-11ef-bceb-c7b262605968","modified":"2024-09-13T16:56:25.840154Z","created":"2024-09-13T16:56:25.840154Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi115","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:3300","nonce":0},{"type":"v1","addr":"172.21.15.115:6789","nonce":0}]},"addr":"172.21.15.115:6789/0","public_addr":"172.21.15.115:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T16:58:04.797 INFO:teuthology.orchestra.run.smithi195.stderr:dumped monmap epoch 1 2024-09-13T16:58:04.799 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:04.797+0000 7f321ccfe640 1 -- 172.21.15.195:0/2900151691 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7f3204038740 msgr2=0x7f320403ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:58:04.799 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:04.797+0000 7f321ccfe640 1 --2- 172.21.15.195:0/2900151691 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7f3204038740 0x7f320403ac00 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f32000098c0 tx=0x7f3200006db0 comp rx=0 tx=0).stop 2024-09-13T16:58:04.799 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:04.797+0000 7f321ccfe640 1 -- 172.21.15.195:0/2900151691 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32180ff7d0 msgr2=0x7f3218194c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:58:04.799 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:04.797+0000 7f321ccfe640 1 --2- 172.21.15.195:0/2900151691 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32180ff7d0 0x7f3218194c70 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3208005cc0 tx=0x7f320802e5f0 comp rx=0 tx=0).stop 2024-09-13T16:58:04.799 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:04.797+0000 7f321ccfe640 1 -- 172.21.15.195:0/2900151691 shutdown_connections 2024-09-13T16:58:04.799 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:04.797+0000 7f321ccfe640 1 --2- 172.21.15.195:0/2900151691 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7f3204038740 0x7f320403ac00 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:04.799 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:04.797+0000 7f321ccfe640 1 --2- 172.21.15.195:0/2900151691 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32180ff7d0 0x7f3218194c70 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:04.800 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:04.797+0000 7f321ccfe640 1 -- 172.21.15.195:0/2900151691 >> 172.21.15.195:0/2900151691 conn(0x7f32180fafa0 msgr2=0x7f32180fba80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:58:04.800 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:04.798+0000 7f321ccfe640 1 -- 172.21.15.195:0/2900151691 shutdown_connections 2024-09-13T16:58:04.800 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:04.798+0000 7f321ccfe640 1 -- 172.21.15.195:0/2900151691 wait complete. 2024-09-13T16:58:05.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:05 smithi115 ceph-mon[27708]: from='client.? 172.21.15.195:0/2900151691' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T16:58:06.370 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T16:58:06.371 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T16:58:06.564 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T16:58:06.608 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T16:58:06.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:06 smithi115 ceph-mon[27708]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:58:08.008 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:07.996+0000 7f19e2261640 1 -- 172.21.15.195:0/1350546376 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19dc100ee0 msgr2=0x7f19dc1012e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:58:08.008 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:07.996+0000 7f19e2261640 1 --2- 172.21.15.195:0/1350546376 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19dc100ee0 0x7f19dc1012e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f19d0009880 tx=0x7f19d002a5d0 comp rx=0 tx=0).stop 2024-09-13T16:58:08.008 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:07.996+0000 7f19e2261640 1 -- 172.21.15.195:0/1350546376 shutdown_connections 2024-09-13T16:58:08.008 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:07.996+0000 7f19e2261640 1 --2- 172.21.15.195:0/1350546376 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19dc100ee0 0x7f19dc1012e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:08.008 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:07.996+0000 7f19e2261640 1 -- 172.21.15.195:0/1350546376 >> 172.21.15.195:0/1350546376 conn(0x7f19dc0faf90 msgr2=0x7f19dc0fd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:58:08.008 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:07.996+0000 7f19e2261640 1 -- 172.21.15.195:0/1350546376 shutdown_connections 2024-09-13T16:58:08.008 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:07.996+0000 7f19e2261640 1 -- 172.21.15.195:0/1350546376 wait complete. 2024-09-13T16:58:08.008 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:07.996+0000 7f19e2261640 1 Processor -- start 2024-09-13T16:58:08.009 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:07.997+0000 7f19e2261640 1 -- start start 2024-09-13T16:58:08.009 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:07.997+0000 7f19e2261640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19dc100ee0 0x7f19dc194d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:58:08.009 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:07.997+0000 7f19e2261640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19dc195290 con 0x7f19dc100ee0 2024-09-13T16:58:08.009 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:07.997+0000 7f19db7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19dc100ee0 0x7f19dc194d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:58:08.009 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:07.997+0000 7f19db7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19dc100ee0 0x7f19dc194d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.195:52178/0 (socket says 172.21.15.195:52178) 2024-09-13T16:58:08.009 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:07.997+0000 7f19db7fe640 1 -- 172.21.15.195:0/92733841 learned_addr learned my addr 172.21.15.195:0/92733841 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-09-13T16:58:08.009 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:07.997+0000 7f19db7fe640 1 -- 172.21.15.195:0/92733841 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19d0009560 con 0x7f19dc100ee0 2024-09-13T16:58:08.009 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:07.997+0000 7f19db7fe640 1 --2- 172.21.15.195:0/92733841 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19dc100ee0 0x7f19dc194d50 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f19d00055c0 tx=0x7f19d00055f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:58:08.009 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:07.998+0000 7f19d8ff9640 1 -- 172.21.15.195:0/92733841 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f19d0004b20 con 0x7f19dc100ee0 2024-09-13T16:58:08.009 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:07.998+0000 7f19d8ff9640 1 -- 172.21.15.195:0/92733841 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f19d0004c80 con 0x7f19dc100ee0 2024-09-13T16:58:08.009 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:07.998+0000 7f19e2261640 1 -- 172.21.15.195:0/92733841 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19dc195490 con 0x7f19dc100ee0 2024-09-13T16:58:08.009 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:07.998+0000 7f19d8ff9640 1 -- 172.21.15.195:0/92733841 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f19d00318a0 con 0x7f19dc100ee0 2024-09-13T16:58:08.009 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:07.998+0000 7f19e2261640 1 -- 172.21.15.195:0/92733841 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19dc195930 con 0x7f19dc100ee0 2024-09-13T16:58:08.010 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:07.999+0000 7f19d8ff9640 1 -- 172.21.15.195:0/92733841 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 13) v1 ==== 45613+0+0 (secure 0 0 0) 0x7f19d0031b60 con 0x7f19dc100ee0 2024-09-13T16:58:08.010 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:07.999+0000 7f19d8ff9640 1 --2- 172.21.15.195:0/92733841 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7f19c4038740 0x7f19c403ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:58:08.010 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:07.999+0000 7f19d8ff9640 1 -- 172.21.15.195:0/92733841 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f19d006c6f0 con 0x7f19dc100ee0 2024-09-13T16:58:08.010 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:07.999+0000 7f19e2261640 1 -- 172.21.15.195:0/92733841 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19dc1012e0 con 0x7f19dc100ee0 2024-09-13T16:58:08.010 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:07.999+0000 7f19daffd640 1 --2- 172.21.15.195:0/92733841 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7f19c4038740 0x7f19c403ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:58:08.010 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:07.999+0000 7f19daffd640 1 --2- 172.21.15.195:0/92733841 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7f19c4038740 0x7f19c403ac00 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f19cc0098c0 tx=0x7f19cc006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:58:08.010 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:08.006+0000 7f19d8ff9640 1 -- 172.21.15.195:0/92733841 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f19d0035070 con 0x7f19dc100ee0 2024-09-13T16:58:08.233 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:08.231+0000 7f19e2261640 1 -- 172.21.15.195:0/92733841 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f19dc1058b0 con 0x7f19dc100ee0 2024-09-13T16:58:08.233 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:08.232+0000 7f19d8ff9640 1 -- 172.21.15.195:0/92733841 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7f19d003c470 con 0x7f19dc100ee0 2024-09-13T16:58:08.233 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:58:08.233 INFO:teuthology.orchestra.run.smithi195.stdout:{"epoch":1,"fsid":"ffbd7588-71f0-11ef-bceb-c7b262605968","modified":"2024-09-13T16:56:25.840154Z","created":"2024-09-13T16:56:25.840154Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi115","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:3300","nonce":0},{"type":"v1","addr":"172.21.15.115:6789","nonce":0}]},"addr":"172.21.15.115:6789/0","public_addr":"172.21.15.115:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T16:58:08.234 INFO:teuthology.orchestra.run.smithi195.stderr:dumped monmap epoch 1 2024-09-13T16:58:08.236 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:08.234+0000 7f19e2261640 1 -- 172.21.15.195:0/92733841 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7f19c4038740 msgr2=0x7f19c403ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:58:08.236 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:08.234+0000 7f19e2261640 1 --2- 172.21.15.195:0/92733841 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7f19c4038740 0x7f19c403ac00 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f19cc0098c0 tx=0x7f19cc006db0 comp rx=0 tx=0).stop 2024-09-13T16:58:08.236 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:08.234+0000 7f19e2261640 1 -- 172.21.15.195:0/92733841 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19dc100ee0 msgr2=0x7f19dc194d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:58:08.236 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:08.234+0000 7f19e2261640 1 --2- 172.21.15.195:0/92733841 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19dc100ee0 0x7f19dc194d50 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f19d00055c0 tx=0x7f19d00055f0 comp rx=0 tx=0).stop 2024-09-13T16:58:08.236 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:08.234+0000 7f19e2261640 1 -- 172.21.15.195:0/92733841 shutdown_connections 2024-09-13T16:58:08.236 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:08.234+0000 7f19e2261640 1 --2- 172.21.15.195:0/92733841 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7f19c4038740 0x7f19c403ac00 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:08.236 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:08.234+0000 7f19e2261640 1 --2- 172.21.15.195:0/92733841 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19dc100ee0 0x7f19dc194d50 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:08.237 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:08.234+0000 7f19e2261640 1 -- 172.21.15.195:0/92733841 >> 172.21.15.195:0/92733841 conn(0x7f19dc0faf90 msgr2=0x7f19dc0fba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:58:08.237 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:08.234+0000 7f19e2261640 1 -- 172.21.15.195:0/92733841 shutdown_connections 2024-09-13T16:58:08.237 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:08.234+0000 7f19e2261640 1 -- 172.21.15.195:0/92733841 wait complete. 2024-09-13T16:58:08.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:08 smithi115 ceph-mon[27708]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:58:08.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:08 smithi115 ceph-mon[27708]: from='client.? 172.21.15.195:0/92733841' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T16:58:09.835 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T16:58:09.835 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T16:58:10.034 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T16:58:10.078 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T16:58:10.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:10 smithi115 ceph-mon[27708]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:58:11.561 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:11.559+0000 7f34c8ed1640 1 -- 172.21.15.195:0/153908397 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34c4100dc0 msgr2=0x7f34c41011c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:58:11.562 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:11.559+0000 7f34c8ed1640 1 --2- 172.21.15.195:0/153908397 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34c4100dc0 0x7f34c41011c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f34bc009c20 tx=0x7f34bc02aa90 comp rx=0 tx=0).stop 2024-09-13T16:58:11.562 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:11.559+0000 7f34c8ed1640 1 -- 172.21.15.195:0/153908397 shutdown_connections 2024-09-13T16:58:11.562 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:11.559+0000 7f34c8ed1640 1 --2- 172.21.15.195:0/153908397 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34c4100dc0 0x7f34c41011c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:11.562 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:11.559+0000 7f34c8ed1640 1 -- 172.21.15.195:0/153908397 >> 172.21.15.195:0/153908397 conn(0x7f34c40f9650 msgr2=0x7f34c40fba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:58:11.562 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:11.559+0000 7f34c8ed1640 1 -- 172.21.15.195:0/153908397 shutdown_connections 2024-09-13T16:58:11.562 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:11.559+0000 7f34c8ed1640 1 -- 172.21.15.195:0/153908397 wait complete. 2024-09-13T16:58:11.562 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:11.560+0000 7f34c8ed1640 1 Processor -- start 2024-09-13T16:58:11.562 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:11.560+0000 7f34c8ed1640 1 -- start start 2024-09-13T16:58:11.562 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:11.560+0000 7f34c8ed1640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34c4100dc0 0x7f34c4194c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:58:11.562 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:11.560+0000 7f34c8ed1640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34c41951d0 con 0x7f34c4100dc0 2024-09-13T16:58:11.564 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:11.561+0000 7f34c259c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34c4100dc0 0x7f34c4194c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:58:11.564 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:11.561+0000 7f34c259c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34c4100dc0 0x7f34c4194c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.195:37438/0 (socket says 172.21.15.195:37438) 2024-09-13T16:58:11.564 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:11.561+0000 7f34c259c640 1 -- 172.21.15.195:0/2465527629 learned_addr learned my addr 172.21.15.195:0/2465527629 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-09-13T16:58:11.564 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:11.561+0000 7f34c259c640 1 -- 172.21.15.195:0/2465527629 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34bc009900 con 0x7f34c4100dc0 2024-09-13T16:58:11.564 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:11.561+0000 7f34c259c640 1 --2- 172.21.15.195:0/2465527629 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34c4100dc0 0x7f34c4194c90 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f34bc005cc0 tx=0x7f34bc02e5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:58:11.564 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:11.561+0000 7f34bb7fe640 1 -- 172.21.15.195:0/2465527629 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f34bc03e070 con 0x7f34c4100dc0 2024-09-13T16:58:11.564 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:11.561+0000 7f34bb7fe640 1 -- 172.21.15.195:0/2465527629 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f34bc02e910 con 0x7f34c4100dc0 2024-09-13T16:58:11.564 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:11.561+0000 7f34c8ed1640 1 -- 172.21.15.195:0/2465527629 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34c41953d0 con 0x7f34c4100dc0 2024-09-13T16:58:11.565 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:11.561+0000 7f34bb7fe640 1 -- 172.21.15.195:0/2465527629 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f34bc004840 con 0x7f34c4100dc0 2024-09-13T16:58:11.565 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:11.561+0000 7f34c8ed1640 1 -- 172.21.15.195:0/2465527629 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34c4195870 con 0x7f34c4100dc0 2024-09-13T16:58:11.565 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:11.562+0000 7f34bb7fe640 1 -- 172.21.15.195:0/2465527629 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 13) v1 ==== 45613+0+0 (secure 0 0 0) 0x7f34bc00a040 con 0x7f34c4100dc0 2024-09-13T16:58:11.565 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:11.562+0000 7f34c8ed1640 1 -- 172.21.15.195:0/2465527629 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34c4101240 con 0x7f34c4100dc0 2024-09-13T16:58:11.565 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:11.562+0000 7f34bb7fe640 1 --2- 172.21.15.195:0/2465527629 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7f34b0038740 0x7f34b003ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:58:11.565 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:11.562+0000 7f34bb7fe640 1 -- 172.21.15.195:0/2465527629 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f34bc06c2c0 con 0x7f34c4100dc0 2024-09-13T16:58:11.565 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:11.563+0000 7f34c1d9b640 1 --2- 172.21.15.195:0/2465527629 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7f34b0038740 0x7f34b003ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:58:11.565 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:11.563+0000 7f34c1d9b640 1 --2- 172.21.15.195:0/2465527629 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7f34b0038740 0x7f34b003ac00 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f34ac0098c0 tx=0x7f34ac006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:58:11.569 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:11.567+0000 7f34bb7fe640 1 -- 172.21.15.195:0/2465527629 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f34bc037d80 con 0x7f34c4100dc0 2024-09-13T16:58:11.789 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:11.788+0000 7f34c8ed1640 1 -- 172.21.15.195:0/2465527629 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f34c402c3e0 con 0x7f34c4100dc0 2024-09-13T16:58:11.790 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:11.789+0000 7f34bb7fe640 1 -- 172.21.15.195:0/2465527629 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7f34bc047300 con 0x7f34c4100dc0 2024-09-13T16:58:11.790 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:58:11.791 INFO:teuthology.orchestra.run.smithi195.stdout:{"epoch":1,"fsid":"ffbd7588-71f0-11ef-bceb-c7b262605968","modified":"2024-09-13T16:56:25.840154Z","created":"2024-09-13T16:56:25.840154Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi115","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:3300","nonce":0},{"type":"v1","addr":"172.21.15.115:6789","nonce":0}]},"addr":"172.21.15.115:6789/0","public_addr":"172.21.15.115:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T16:58:11.791 INFO:teuthology.orchestra.run.smithi195.stderr:dumped monmap epoch 1 2024-09-13T16:58:11.792 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:11.791+0000 7f34c8ed1640 1 -- 172.21.15.195:0/2465527629 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7f34b0038740 msgr2=0x7f34b003ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:58:11.792 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:11.791+0000 7f34c8ed1640 1 --2- 172.21.15.195:0/2465527629 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7f34b0038740 0x7f34b003ac00 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f34ac0098c0 tx=0x7f34ac006db0 comp rx=0 tx=0).stop 2024-09-13T16:58:11.793 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:11.791+0000 7f34c8ed1640 1 -- 172.21.15.195:0/2465527629 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34c4100dc0 msgr2=0x7f34c4194c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:58:11.793 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:11.791+0000 7f34c8ed1640 1 --2- 172.21.15.195:0/2465527629 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34c4100dc0 0x7f34c4194c90 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f34bc005cc0 tx=0x7f34bc02e5f0 comp rx=0 tx=0).stop 2024-09-13T16:58:11.793 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:11.791+0000 7f34c8ed1640 1 -- 172.21.15.195:0/2465527629 shutdown_connections 2024-09-13T16:58:11.793 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:11.791+0000 7f34c8ed1640 1 --2- 172.21.15.195:0/2465527629 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7f34b0038740 0x7f34b003ac00 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:11.793 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:11.791+0000 7f34c8ed1640 1 --2- 172.21.15.195:0/2465527629 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34c4100dc0 0x7f34c4194c90 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:11.793 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:11.791+0000 7f34c8ed1640 1 -- 172.21.15.195:0/2465527629 >> 172.21.15.195:0/2465527629 conn(0x7f34c40f9650 msgr2=0x7f34c40fa170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:58:11.793 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:11.791+0000 7f34c8ed1640 1 -- 172.21.15.195:0/2465527629 shutdown_connections 2024-09-13T16:58:11.793 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:11.791+0000 7f34c8ed1640 1 -- 172.21.15.195:0/2465527629 wait complete. 2024-09-13T16:58:12.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:12 smithi115 ceph-mon[27708]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:58:12.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:12 smithi115 ceph-mon[27708]: from='client.? 172.21.15.195:0/2465527629' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T16:58:13.372 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T16:58:13.372 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T16:58:13.568 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T16:58:13.611 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T16:58:14.618 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:14 smithi115 ceph-mon[27708]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:58:14.618 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:14 smithi115 ceph-mon[27708]: from='mgr.14160 172.21.15.115:0/3221480175' entity='mgr.smithi115.hetcni' 2024-09-13T16:58:14.618 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:14 smithi115 ceph-mon[27708]: from='mgr.14160 172.21.15.115:0/3221480175' entity='mgr.smithi115.hetcni' 2024-09-13T16:58:14.618 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:14 smithi115 ceph-mon[27708]: from='mgr.14160 172.21.15.115:0/3221480175' entity='mgr.smithi115.hetcni' 2024-09-13T16:58:14.618 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:14 smithi115 ceph-mon[27708]: from='mgr.14160 172.21.15.115:0/3221480175' entity='mgr.smithi115.hetcni' 2024-09-13T16:58:14.618 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:14 smithi115 ceph-mon[27708]: from='mgr.14160 172.21.15.115:0/3221480175' entity='mgr.smithi115.hetcni' 2024-09-13T16:58:14.618 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:14 smithi115 ceph-mon[27708]: from='mgr.14160 172.21.15.115:0/3221480175' entity='mgr.smithi115.hetcni' 2024-09-13T16:58:14.618 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:14 smithi115 ceph-mon[27708]: from='mgr.14160 172.21.15.115:0/3221480175' entity='mgr.smithi115.hetcni' 2024-09-13T16:58:14.619 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:14 smithi115 ceph-mon[27708]: from='mgr.14160 172.21.15.115:0/3221480175' entity='mgr.smithi115.hetcni' 2024-09-13T16:58:15.086 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:15.083+0000 7f3cdf1f4640 1 -- 172.21.15.195:0/4203326977 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3cd80fe6d0 msgr2=0x7f3cd80fead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:58:15.086 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:15.083+0000 7f3cdf1f4640 1 --2- 172.21.15.195:0/4203326977 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3cd80fe6d0 0x7f3cd80fead0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc009880 tx=0x7f3ccc02a5d0 comp rx=0 tx=0).stop 2024-09-13T16:58:15.086 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:15.083+0000 7f3cdf1f4640 1 -- 172.21.15.195:0/4203326977 shutdown_connections 2024-09-13T16:58:15.086 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:15.083+0000 7f3cdf1f4640 1 --2- 172.21.15.195:0/4203326977 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3cd80fe6d0 0x7f3cd80fead0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:15.086 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:15.083+0000 7f3cdf1f4640 1 -- 172.21.15.195:0/4203326977 >> 172.21.15.195:0/4203326977 conn(0x7f3cd80f9e80 msgr2=0x7f3cd80fc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:58:15.086 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:15.083+0000 7f3cdf1f4640 1 -- 172.21.15.195:0/4203326977 shutdown_connections 2024-09-13T16:58:15.086 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:15.083+0000 7f3cdf1f4640 1 -- 172.21.15.195:0/4203326977 wait complete. 2024-09-13T16:58:15.088 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:15.084+0000 7f3cdf1f4640 1 Processor -- start 2024-09-13T16:58:15.088 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:15.084+0000 7f3cdf1f4640 1 -- start start 2024-09-13T16:58:15.088 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:15.084+0000 7f3cdf1f4640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3cd80fe6d0 0x7f3cd8194c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:58:15.088 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:15.084+0000 7f3cdf1f4640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd8195160 con 0x7f3cd80fe6d0 2024-09-13T16:58:15.088 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:15.084+0000 7f3cdcf90640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3cd80fe6d0 0x7f3cd8194c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:58:15.088 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:15.084+0000 7f3cdcf90640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3cd80fe6d0 0x7f3cd8194c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.195:37454/0 (socket says 172.21.15.195:37454) 2024-09-13T16:58:15.088 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:15.084+0000 7f3cdcf90640 1 -- 172.21.15.195:0/3607549521 learned_addr learned my addr 172.21.15.195:0/3607549521 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-09-13T16:58:15.088 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:15.085+0000 7f3cdcf90640 1 -- 172.21.15.195:0/3607549521 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ccc009560 con 0x7f3cd80fe6d0 2024-09-13T16:58:15.088 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:15.085+0000 7f3cdcf90640 1 --2- 172.21.15.195:0/3607549521 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3cd80fe6d0 0x7f3cd8194c20 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc02aaf0 tx=0x7f3ccc004da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:58:15.088 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:15.085+0000 7f3cd5ffb640 1 -- 172.21.15.195:0/3607549521 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3ccc005440 con 0x7f3cd80fe6d0 2024-09-13T16:58:15.089 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:15.085+0000 7f3cd5ffb640 1 -- 172.21.15.195:0/3607549521 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3ccc0055a0 con 0x7f3cd80fe6d0 2024-09-13T16:58:15.089 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:15.085+0000 7f3cdf1f4640 1 -- 172.21.15.195:0/3607549521 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cd8195360 con 0x7f3cd80fe6d0 2024-09-13T16:58:15.089 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:15.085+0000 7f3cd5ffb640 1 -- 172.21.15.195:0/3607549521 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3ccc031ac0 con 0x7f3cd80fe6d0 2024-09-13T16:58:15.089 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:15.085+0000 7f3cdf1f4640 1 -- 172.21.15.195:0/3607549521 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cd8195800 con 0x7f3cd80fe6d0 2024-09-13T16:58:15.090 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:15.086+0000 7f3cd5ffb640 1 -- 172.21.15.195:0/3607549521 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 13) v1 ==== 45613+0+0 (secure 0 0 0) 0x7f3ccc031cc0 con 0x7f3cd80fe6d0 2024-09-13T16:58:15.090 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:15.086+0000 7f3cdf1f4640 1 -- 172.21.15.195:0/3607549521 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cd80fead0 con 0x7f3cd80fe6d0 2024-09-13T16:58:15.090 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:15.086+0000 7f3cd5ffb640 1 --2- 172.21.15.195:0/3607549521 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7f3cc8038740 0x7f3cc803ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:58:15.090 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:15.086+0000 7f3cd5ffb640 1 -- 172.21.15.195:0/3607549521 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f3ccc06c4e0 con 0x7f3cd80fe6d0 2024-09-13T16:58:15.090 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:15.087+0000 7f3cd7fff640 1 --2- 172.21.15.195:0/3607549521 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7f3cc8038740 0x7f3cc803ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:58:15.090 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:15.087+0000 7f3cd7fff640 1 --2- 172.21.15.195:0/3607549521 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7f3cc8038740 0x7f3cc803ac00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3cc40098c0 tx=0x7f3cc4006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:58:15.093 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:15.091+0000 7f3cd5ffb640 1 -- 172.21.15.195:0/3607549521 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f3ccc04d7c0 con 0x7f3cd80fe6d0 2024-09-13T16:58:15.322 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:15.319+0000 7f3cdf1f4640 1 -- 172.21.15.195:0/3607549521 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f3cd802c3e0 con 0x7f3cd80fe6d0 2024-09-13T16:58:15.322 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:15.320+0000 7f3cd5ffb640 1 -- 172.21.15.195:0/3607549521 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7f3ccc035070 con 0x7f3cd80fe6d0 2024-09-13T16:58:15.323 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:58:15.323 INFO:teuthology.orchestra.run.smithi195.stdout:{"epoch":1,"fsid":"ffbd7588-71f0-11ef-bceb-c7b262605968","modified":"2024-09-13T16:56:25.840154Z","created":"2024-09-13T16:56:25.840154Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi115","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:3300","nonce":0},{"type":"v1","addr":"172.21.15.115:6789","nonce":0}]},"addr":"172.21.15.115:6789/0","public_addr":"172.21.15.115:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T16:58:15.323 INFO:teuthology.orchestra.run.smithi195.stderr:dumped monmap epoch 1 2024-09-13T16:58:15.325 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:15.322+0000 7f3cdf1f4640 1 -- 172.21.15.195:0/3607549521 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7f3cc8038740 msgr2=0x7f3cc803ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:58:15.325 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:15.322+0000 7f3cdf1f4640 1 --2- 172.21.15.195:0/3607549521 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7f3cc8038740 0x7f3cc803ac00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3cc40098c0 tx=0x7f3cc4006db0 comp rx=0 tx=0).stop 2024-09-13T16:58:15.325 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:15.322+0000 7f3cdf1f4640 1 -- 172.21.15.195:0/3607549521 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3cd80fe6d0 msgr2=0x7f3cd8194c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:58:15.325 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:15.322+0000 7f3cdf1f4640 1 --2- 172.21.15.195:0/3607549521 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3cd80fe6d0 0x7f3cd8194c20 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc02aaf0 tx=0x7f3ccc004da0 comp rx=0 tx=0).stop 2024-09-13T16:58:15.325 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:15.322+0000 7f3cdf1f4640 1 -- 172.21.15.195:0/3607549521 shutdown_connections 2024-09-13T16:58:15.325 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:15.322+0000 7f3cdf1f4640 1 --2- 172.21.15.195:0/3607549521 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7f3cc8038740 0x7f3cc803ac00 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:15.325 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:15.322+0000 7f3cdf1f4640 1 --2- 172.21.15.195:0/3607549521 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3cd80fe6d0 0x7f3cd8194c20 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:15.325 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:15.322+0000 7f3cdf1f4640 1 -- 172.21.15.195:0/3607549521 >> 172.21.15.195:0/3607549521 conn(0x7f3cd80f9e80 msgr2=0x7f3cd8067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:58:15.325 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:15.322+0000 7f3cdf1f4640 1 -- 172.21.15.195:0/3607549521 shutdown_connections 2024-09-13T16:58:15.325 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:15.322+0000 7f3cdf1f4640 1 -- 172.21.15.195:0/3607549521 wait complete. 2024-09-13T16:58:15.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:15 smithi115 ceph-mon[27708]: Deploying daemon prometheus.smithi115 on smithi115 2024-09-13T16:58:15.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:15 smithi115 ceph-mon[27708]: from='client.? 172.21.15.195:0/3607549521' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T16:58:16.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:16 smithi115 ceph-mon[27708]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:58:16.926 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T16:58:16.926 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T16:58:17.122 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T16:58:17.166 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T16:58:18.667 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:18 smithi115 ceph-mon[27708]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:58:18.667 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:18 smithi115 ceph-mon[27708]: from='mgr.14160 172.21.15.115:0/3221480175' entity='mgr.smithi115.hetcni' 2024-09-13T16:58:18.736 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:18.729+0000 7f8fd4a8e640 1 -- 172.21.15.195:0/3982589575 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fd00fe6d0 msgr2=0x7f8fd00fead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:58:18.736 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:18.729+0000 7f8fd4a8e640 1 --2- 172.21.15.195:0/3982589575 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fd00fe6d0 0x7f8fd00fead0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8fc0009880 tx=0x7f8fc002a5d0 comp rx=0 tx=0).stop 2024-09-13T16:58:18.736 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:18.729+0000 7f8fd4a8e640 1 -- 172.21.15.195:0/3982589575 shutdown_connections 2024-09-13T16:58:18.737 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:18.729+0000 7f8fd4a8e640 1 --2- 172.21.15.195:0/3982589575 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fd00fe6d0 0x7f8fd00fead0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:18.737 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:18.729+0000 7f8fd4a8e640 1 -- 172.21.15.195:0/3982589575 >> 172.21.15.195:0/3982589575 conn(0x7f8fd00f9e80 msgr2=0x7f8fd00fc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:58:18.737 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:18.729+0000 7f8fd4a8e640 1 -- 172.21.15.195:0/3982589575 shutdown_connections 2024-09-13T16:58:18.737 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:18.729+0000 7f8fd4a8e640 1 -- 172.21.15.195:0/3982589575 wait complete. 2024-09-13T16:58:18.737 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:18.730+0000 7f8fd4a8e640 1 Processor -- start 2024-09-13T16:58:18.737 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:18.730+0000 7f8fd4a8e640 1 -- start start 2024-09-13T16:58:18.737 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:18.730+0000 7f8fd4a8e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fd00fe6d0 0x7f8fd0196dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:58:18.737 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:18.730+0000 7f8fd4a8e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd0197310 con 0x7f8fd00fe6d0 2024-09-13T16:58:18.737 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:18.730+0000 7f8fce59c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fd00fe6d0 0x7f8fd0196dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:58:18.737 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:18.730+0000 7f8fce59c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fd00fe6d0 0x7f8fd0196dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.195:37474/0 (socket says 172.21.15.195:37474) 2024-09-13T16:58:18.737 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:18.730+0000 7f8fce59c640 1 -- 172.21.15.195:0/3552744593 learned_addr learned my addr 172.21.15.195:0/3552744593 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-09-13T16:58:18.737 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:18.731+0000 7f8fce59c640 1 -- 172.21.15.195:0/3552744593 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fc0009560 con 0x7f8fd00fe6d0 2024-09-13T16:58:18.737 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:18.731+0000 7f8fce59c640 1 --2- 172.21.15.195:0/3552744593 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fd00fe6d0 0x7f8fd0196dd0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8fc0004cf0 tx=0x7f8fc0004d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:58:18.737 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:18.731+0000 7f8fc77fe640 1 -- 172.21.15.195:0/3552744593 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8fc00053f0 con 0x7f8fd00fe6d0 2024-09-13T16:58:18.738 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:18.731+0000 7f8fc77fe640 1 -- 172.21.15.195:0/3552744593 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8fc0005550 con 0x7f8fd00fe6d0 2024-09-13T16:58:18.738 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:18.731+0000 7f8fd4a8e640 1 -- 172.21.15.195:0/3552744593 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fd0197510 con 0x7f8fd00fe6d0 2024-09-13T16:58:18.738 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:18.731+0000 7f8fc77fe640 1 -- 172.21.15.195:0/3552744593 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8fc00319c0 con 0x7f8fd00fe6d0 2024-09-13T16:58:18.738 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:18.731+0000 7f8fd4a8e640 1 -- 172.21.15.195:0/3552744593 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fd01979b0 con 0x7f8fd00fe6d0 2024-09-13T16:58:18.738 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:18.732+0000 7f8fc77fe640 1 -- 172.21.15.195:0/3552744593 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 13) v1 ==== 45613+0+0 (secure 0 0 0) 0x7f8fc0031c30 con 0x7f8fd00fe6d0 2024-09-13T16:58:18.738 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:18.732+0000 7f8fd4a8e640 1 -- 172.21.15.195:0/3552744593 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fd00fead0 con 0x7f8fd00fe6d0 2024-09-13T16:58:18.738 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:18.732+0000 7f8fc77fe640 1 --2- 172.21.15.195:0/3552744593 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7f8fbc038740 0x7f8fbc03ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:58:18.738 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:18.732+0000 7f8fc77fe640 1 -- 172.21.15.195:0/3552744593 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f8fc006c520 con 0x7f8fd00fe6d0 2024-09-13T16:58:18.738 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:18.732+0000 7f8fcdd9b640 1 --2- 172.21.15.195:0/3552744593 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7f8fbc038740 0x7f8fbc03ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:58:18.738 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:18.733+0000 7f8fcdd9b640 1 --2- 172.21.15.195:0/3552744593 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7f8fbc038740 0x7f8fbc03ac00 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f8fb80098c0 tx=0x7f8fb8006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:58:18.738 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:18.737+0000 7f8fc77fe640 1 -- 172.21.15.195:0/3552744593 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f8fc004d7c0 con 0x7f8fd00fe6d0 2024-09-13T16:58:18.964 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:18.962+0000 7f8fd4a8e640 1 -- 172.21.15.195:0/3552744593 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f8fd019a450 con 0x7f8fd00fe6d0 2024-09-13T16:58:18.965 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:18.963+0000 7f8fc77fe640 1 -- 172.21.15.195:0/3552744593 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7f8fc0035020 con 0x7f8fd00fe6d0 2024-09-13T16:58:18.965 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:58:18.965 INFO:teuthology.orchestra.run.smithi195.stdout:{"epoch":1,"fsid":"ffbd7588-71f0-11ef-bceb-c7b262605968","modified":"2024-09-13T16:56:25.840154Z","created":"2024-09-13T16:56:25.840154Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi115","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:3300","nonce":0},{"type":"v1","addr":"172.21.15.115:6789","nonce":0}]},"addr":"172.21.15.115:6789/0","public_addr":"172.21.15.115:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T16:58:18.965 INFO:teuthology.orchestra.run.smithi195.stderr:dumped monmap epoch 1 2024-09-13T16:58:18.967 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:18.965+0000 7f8fd4a8e640 1 -- 172.21.15.195:0/3552744593 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7f8fbc038740 msgr2=0x7f8fbc03ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:58:18.967 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:18.965+0000 7f8fd4a8e640 1 --2- 172.21.15.195:0/3552744593 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7f8fbc038740 0x7f8fbc03ac00 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f8fb80098c0 tx=0x7f8fb8006db0 comp rx=0 tx=0).stop 2024-09-13T16:58:18.967 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:18.965+0000 7f8fd4a8e640 1 -- 172.21.15.195:0/3552744593 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fd00fe6d0 msgr2=0x7f8fd0196dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:58:18.967 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:18.965+0000 7f8fd4a8e640 1 --2- 172.21.15.195:0/3552744593 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fd00fe6d0 0x7f8fd0196dd0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8fc0004cf0 tx=0x7f8fc0004d20 comp rx=0 tx=0).stop 2024-09-13T16:58:18.967 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:18.965+0000 7f8fd4a8e640 1 -- 172.21.15.195:0/3552744593 shutdown_connections 2024-09-13T16:58:18.967 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:18.965+0000 7f8fd4a8e640 1 --2- 172.21.15.195:0/3552744593 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7f8fbc038740 0x7f8fbc03ac00 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:18.967 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:18.965+0000 7f8fd4a8e640 1 --2- 172.21.15.195:0/3552744593 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fd00fe6d0 0x7f8fd0196dd0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:18.967 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:18.965+0000 7f8fd4a8e640 1 -- 172.21.15.195:0/3552744593 >> 172.21.15.195:0/3552744593 conn(0x7f8fd00f9e80 msgr2=0x7f8fd00fa9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:58:18.967 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:18.965+0000 7f8fd4a8e640 1 -- 172.21.15.195:0/3552744593 shutdown_connections 2024-09-13T16:58:18.968 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:18.965+0000 7f8fd4a8e640 1 -- 172.21.15.195:0/3552744593 wait complete. 2024-09-13T16:58:19.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:19 smithi115 ceph-mon[27708]: from='client.? 172.21.15.195:0/3552744593' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T16:58:20.504 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:20 smithi115 ceph-mon[27708]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:58:20.562 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T16:58:20.562 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T16:58:20.758 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T16:58:20.801 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T16:58:22.215 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:22.213+0000 7ffa064b1640 1 -- 172.21.15.195:0/1601014775 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa000fe6d0 msgr2=0x7ffa000fead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:58:22.215 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:22.213+0000 7ffa064b1640 1 --2- 172.21.15.195:0/1601014775 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa000fe6d0 0x7ffa000fead0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff9f0009880 tx=0x7ff9f002a5d0 comp rx=0 tx=0).stop 2024-09-13T16:58:22.215 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:22.213+0000 7ffa064b1640 1 -- 172.21.15.195:0/1601014775 shutdown_connections 2024-09-13T16:58:22.215 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:22.213+0000 7ffa064b1640 1 --2- 172.21.15.195:0/1601014775 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa000fe6d0 0x7ffa000fead0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:22.215 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:22.213+0000 7ffa064b1640 1 -- 172.21.15.195:0/1601014775 >> 172.21.15.195:0/1601014775 conn(0x7ffa000f9e80 msgr2=0x7ffa000fc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:58:22.215 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:22.213+0000 7ffa064b1640 1 -- 172.21.15.195:0/1601014775 shutdown_connections 2024-09-13T16:58:22.215 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:22.213+0000 7ffa064b1640 1 -- 172.21.15.195:0/1601014775 wait complete. 2024-09-13T16:58:22.217 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:22.214+0000 7ffa064b1640 1 Processor -- start 2024-09-13T16:58:22.217 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:22.214+0000 7ffa064b1640 1 -- start start 2024-09-13T16:58:22.217 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:22.214+0000 7ffa064b1640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa000fe6d0 0x7ffa00193ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:58:22.217 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:22.214+0000 7ffa064b1640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa00194020 con 0x7ffa000fe6d0 2024-09-13T16:58:22.217 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:22.215+0000 7ff9fffff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa000fe6d0 0x7ffa00193ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:58:22.218 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:22.215+0000 7ff9fffff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa000fe6d0 0x7ffa00193ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.195:42172/0 (socket says 172.21.15.195:42172) 2024-09-13T16:58:22.218 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:22.215+0000 7ff9fffff640 1 -- 172.21.15.195:0/3368980504 learned_addr learned my addr 172.21.15.195:0/3368980504 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-09-13T16:58:22.218 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:22.215+0000 7ff9fffff640 1 -- 172.21.15.195:0/3368980504 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9f0009560 con 0x7ffa000fe6d0 2024-09-13T16:58:22.218 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:22.215+0000 7ff9fffff640 1 --2- 172.21.15.195:0/3368980504 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa000fe6d0 0x7ffa00193ae0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff9f002aaf0 tx=0x7ff9f0004da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:58:22.218 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:22.215+0000 7ff9fdffb640 1 -- 172.21.15.195:0/3368980504 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff9f0005440 con 0x7ffa000fe6d0 2024-09-13T16:58:22.218 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:22.215+0000 7ff9fdffb640 1 -- 172.21.15.195:0/3368980504 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff9f00055a0 con 0x7ffa000fe6d0 2024-09-13T16:58:22.218 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:22.215+0000 7ffa064b1640 1 -- 172.21.15.195:0/3368980504 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa00194220 con 0x7ffa000fe6d0 2024-09-13T16:58:22.218 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:22.215+0000 7ff9fdffb640 1 -- 172.21.15.195:0/3368980504 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff9f0031ac0 con 0x7ffa000fe6d0 2024-09-13T16:58:22.218 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:22.215+0000 7ffa064b1640 1 -- 172.21.15.195:0/3368980504 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa001946c0 con 0x7ffa000fe6d0 2024-09-13T16:58:22.219 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:22.216+0000 7ff9fdffb640 1 -- 172.21.15.195:0/3368980504 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 13) v1 ==== 45613+0+0 (secure 0 0 0) 0x7ff9f0031cc0 con 0x7ffa000fe6d0 2024-09-13T16:58:22.219 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:22.216+0000 7ffa064b1640 1 -- 172.21.15.195:0/3368980504 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa000fead0 con 0x7ffa000fe6d0 2024-09-13T16:58:22.219 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:22.216+0000 7ff9fdffb640 1 --2- 172.21.15.195:0/3368980504 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7ff9ec038740 0x7ff9ec03ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:58:22.219 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:22.216+0000 7ff9fdffb640 1 -- 172.21.15.195:0/3368980504 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7ff9f006c4d0 con 0x7ffa000fe6d0 2024-09-13T16:58:22.219 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:22.217+0000 7ff9f7fff640 1 --2- 172.21.15.195:0/3368980504 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7ff9ec038740 0x7ff9ec03ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:58:22.219 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:22.217+0000 7ff9f7fff640 1 --2- 172.21.15.195:0/3368980504 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7ff9ec038740 0x7ff9ec03ac00 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff9e80098c0 tx=0x7ff9e8006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:58:22.223 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:22.221+0000 7ff9fdffb640 1 -- 172.21.15.195:0/3368980504 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff9f003a7d0 con 0x7ffa000fe6d0 2024-09-13T16:58:22.446 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:22.445+0000 7ffa064b1640 1 -- 172.21.15.195:0/3368980504 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7ffa0018d3c0 con 0x7ffa000fe6d0 2024-09-13T16:58:22.447 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:22.446+0000 7ff9fdffb640 1 -- 172.21.15.195:0/3368980504 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7ff9f0035020 con 0x7ffa000fe6d0 2024-09-13T16:58:22.447 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:58:22.447 INFO:teuthology.orchestra.run.smithi195.stdout:{"epoch":1,"fsid":"ffbd7588-71f0-11ef-bceb-c7b262605968","modified":"2024-09-13T16:56:25.840154Z","created":"2024-09-13T16:56:25.840154Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi115","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:3300","nonce":0},{"type":"v1","addr":"172.21.15.115:6789","nonce":0}]},"addr":"172.21.15.115:6789/0","public_addr":"172.21.15.115:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T16:58:22.448 INFO:teuthology.orchestra.run.smithi195.stderr:dumped monmap epoch 1 2024-09-13T16:58:22.450 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:22.448+0000 7ffa064b1640 1 -- 172.21.15.195:0/3368980504 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7ff9ec038740 msgr2=0x7ff9ec03ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:58:22.450 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:22.448+0000 7ffa064b1640 1 --2- 172.21.15.195:0/3368980504 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7ff9ec038740 0x7ff9ec03ac00 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff9e80098c0 tx=0x7ff9e8006db0 comp rx=0 tx=0).stop 2024-09-13T16:58:22.450 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:22.448+0000 7ffa064b1640 1 -- 172.21.15.195:0/3368980504 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa000fe6d0 msgr2=0x7ffa00193ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:58:22.450 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:22.448+0000 7ffa064b1640 1 --2- 172.21.15.195:0/3368980504 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa000fe6d0 0x7ffa00193ae0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff9f002aaf0 tx=0x7ff9f0004da0 comp rx=0 tx=0).stop 2024-09-13T16:58:22.450 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:22.448+0000 7ffa064b1640 1 -- 172.21.15.195:0/3368980504 shutdown_connections 2024-09-13T16:58:22.450 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:22.448+0000 7ffa064b1640 1 --2- 172.21.15.195:0/3368980504 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7ff9ec038740 0x7ff9ec03ac00 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:22.450 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:22.448+0000 7ffa064b1640 1 --2- 172.21.15.195:0/3368980504 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa000fe6d0 0x7ffa00193ae0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:22.450 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:22.448+0000 7ffa064b1640 1 -- 172.21.15.195:0/3368980504 >> 172.21.15.195:0/3368980504 conn(0x7ffa000f9e80 msgr2=0x7ffa000fa8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:58:22.450 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:22.448+0000 7ffa064b1640 1 -- 172.21.15.195:0/3368980504 shutdown_connections 2024-09-13T16:58:22.450 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:22.448+0000 7ffa064b1640 1 -- 172.21.15.195:0/3368980504 wait complete. 2024-09-13T16:58:22.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:22 smithi115 ceph-mon[27708]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:58:23.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:23 smithi115 ceph-mon[27708]: from='client.? 172.21.15.195:0/3368980504' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T16:58:24.032 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T16:58:24.032 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T16:58:24.248 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T16:58:24.292 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T16:58:24.797 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:24 smithi115 ceph-mon[27708]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:58:24.797 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:24 smithi115 ceph-mon[27708]: from='mgr.14160 172.21.15.115:0/3221480175' entity='mgr.smithi115.hetcni' 2024-09-13T16:58:24.797 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:24 smithi115 ceph-mon[27708]: from='mgr.14160 172.21.15.115:0/3221480175' entity='mgr.smithi115.hetcni' 2024-09-13T16:58:24.797 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:24 smithi115 ceph-mon[27708]: from='mgr.14160 172.21.15.115:0/3221480175' entity='mgr.smithi115.hetcni' 2024-09-13T16:58:24.797 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:24 smithi115 ceph-mon[27708]: from='mgr.14160 172.21.15.115:0/3221480175' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-09-13T16:58:25.691 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:25.688+0000 7fef3b109640 1 -- 172.21.15.195:0/3678200059 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef340fe6f0 msgr2=0x7fef340feaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:58:25.691 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:25.688+0000 7fef3b109640 1 --2- 172.21.15.195:0/3678200059 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef340fe6f0 0x7fef340feaf0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fef28009880 tx=0x7fef2802a5d0 comp rx=0 tx=0).stop 2024-09-13T16:58:25.691 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:25.689+0000 7fef3b109640 1 -- 172.21.15.195:0/3678200059 shutdown_connections 2024-09-13T16:58:25.691 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:25.689+0000 7fef3b109640 1 --2- 172.21.15.195:0/3678200059 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef340fe6f0 0x7fef340feaf0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:25.691 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:25.689+0000 7fef3b109640 1 -- 172.21.15.195:0/3678200059 >> 172.21.15.195:0/3678200059 conn(0x7fef340f9e80 msgr2=0x7fef340fc2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:58:25.691 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:25.689+0000 7fef3b109640 1 -- 172.21.15.195:0/3678200059 shutdown_connections 2024-09-13T16:58:25.692 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:25.689+0000 7fef3b109640 1 -- 172.21.15.195:0/3678200059 wait complete. 2024-09-13T16:58:25.692 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:25.689+0000 7fef3b109640 1 Processor -- start 2024-09-13T16:58:25.692 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:25.689+0000 7fef3b109640 1 -- start start 2024-09-13T16:58:25.692 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:25.689+0000 7fef3b109640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef340fe6f0 0x7fef340688f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:58:25.692 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:25.689+0000 7fef3b109640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef34068e30 con 0x7fef340fe6f0 2024-09-13T16:58:25.692 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:25.690+0000 7fef38ea5640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef340fe6f0 0x7fef340688f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:58:25.692 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:25.690+0000 7fef38ea5640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef340fe6f0 0x7fef340688f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.195:42190/0 (socket says 172.21.15.195:42190) 2024-09-13T16:58:25.692 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:25.690+0000 7fef38ea5640 1 -- 172.21.15.195:0/835903665 learned_addr learned my addr 172.21.15.195:0/835903665 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-09-13T16:58:25.692 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:25.690+0000 7fef38ea5640 1 -- 172.21.15.195:0/835903665 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef28009560 con 0x7fef340fe6f0 2024-09-13T16:58:25.693 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:25.690+0000 7fef38ea5640 1 --2- 172.21.15.195:0/835903665 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef340fe6f0 0x7fef340688f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fef28004cf0 tx=0x7fef28004d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:58:25.693 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:25.690+0000 7fef31ffb640 1 -- 172.21.15.195:0/835903665 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fef280052a0 con 0x7fef340fe6f0 2024-09-13T16:58:25.694 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:25.690+0000 7fef3b109640 1 -- 172.21.15.195:0/835903665 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef34197950 con 0x7fef340fe6f0 2024-09-13T16:58:25.694 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:25.690+0000 7fef31ffb640 1 -- 172.21.15.195:0/835903665 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fef28005400 con 0x7fef340fe6f0 2024-09-13T16:58:25.694 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:25.690+0000 7fef31ffb640 1 -- 172.21.15.195:0/835903665 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fef28031820 con 0x7fef340fe6f0 2024-09-13T16:58:25.694 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:25.691+0000 7fef3b109640 1 -- 172.21.15.195:0/835903665 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef34197df0 con 0x7fef340fe6f0 2024-09-13T16:58:25.694 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:25.691+0000 7fef31ffb640 1 -- 172.21.15.195:0/835903665 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 14) v1 ==== 45627+0+0 (secure 0 0 0) 0x7fef28031ae0 con 0x7fef340fe6f0 2024-09-13T16:58:25.694 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:25.692+0000 7fef3b109640 1 -- 172.21.15.195:0/835903665 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef340feaf0 con 0x7fef340fe6f0 2024-09-13T16:58:25.694 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:25.692+0000 7fef31ffb640 1 --2- 172.21.15.195:0/835903665 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7fef24038790 0x7fef2403ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:58:25.694 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:25.692+0000 7fef33fff640 1 -- 172.21.15.195:0/835903665 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7fef24038790 msgr2=0x7fef2403ac50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6800/3889408988 2024-09-13T16:58:25.694 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:25.692+0000 7fef31ffb640 1 -- 172.21.15.195:0/835903665 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fef2806c420 con 0x7fef340fe6f0 2024-09-13T16:58:25.694 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:25.692+0000 7fef33fff640 1 --2- 172.21.15.195:0/835903665 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7fef24038790 0x7fef2403ac50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T16:58:25.702 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:25.700+0000 7fef31ffb640 1 -- 172.21.15.195:0/835903665 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fef280443b0 con 0x7fef340fe6f0 2024-09-13T16:58:25.894 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:25.893+0000 7fef33fff640 1 -- 172.21.15.195:0/835903665 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7fef24038790 msgr2=0x7fef2403ac50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6800/3889408988 2024-09-13T16:58:25.894 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:25.893+0000 7fef33fff640 1 --2- 172.21.15.195:0/835903665 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7fef24038790 0x7fef2403ac50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T16:58:25.927 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:25.925+0000 7fef3b109640 1 -- 172.21.15.195:0/835903665 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fef3418d3e0 con 0x7fef340fe6f0 2024-09-13T16:58:25.927 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:25.926+0000 7fef31ffb640 1 -- 172.21.15.195:0/835903665 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7fef28035020 con 0x7fef340fe6f0 2024-09-13T16:58:25.928 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:58:25.928 INFO:teuthology.orchestra.run.smithi195.stdout:{"epoch":1,"fsid":"ffbd7588-71f0-11ef-bceb-c7b262605968","modified":"2024-09-13T16:56:25.840154Z","created":"2024-09-13T16:56:25.840154Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi115","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:3300","nonce":0},{"type":"v1","addr":"172.21.15.115:6789","nonce":0}]},"addr":"172.21.15.115:6789/0","public_addr":"172.21.15.115:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T16:58:25.928 INFO:teuthology.orchestra.run.smithi195.stderr:dumped monmap epoch 1 2024-09-13T16:58:25.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:25 smithi115 ceph-mon[27708]: from='mgr.14160 172.21.15.115:0/3221480175' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-13T16:58:25.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:25 smithi115 ceph-mon[27708]: mgrmap e14: smithi115.hetcni(active, since 57s) 2024-09-13T16:58:25.930 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:25.928+0000 7fef3b109640 1 -- 172.21.15.195:0/835903665 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7fef24038790 msgr2=0x7fef2403ac50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T16:58:25.930 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:25.928+0000 7fef3b109640 1 --2- 172.21.15.195:0/835903665 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7fef24038790 0x7fef2403ac50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:25.930 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:25.928+0000 7fef3b109640 1 -- 172.21.15.195:0/835903665 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef340fe6f0 msgr2=0x7fef340688f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:58:25.930 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:25.928+0000 7fef3b109640 1 --2- 172.21.15.195:0/835903665 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef340fe6f0 0x7fef340688f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fef28004cf0 tx=0x7fef28004d20 comp rx=0 tx=0).stop 2024-09-13T16:58:25.930 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:25.928+0000 7fef3b109640 1 -- 172.21.15.195:0/835903665 shutdown_connections 2024-09-13T16:58:25.930 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:25.928+0000 7fef3b109640 1 --2- 172.21.15.195:0/835903665 >> [v2:172.21.15.115:6800/3889408988,v1:172.21.15.115:6801/3889408988] conn(0x7fef24038790 0x7fef2403ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:25.930 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:25.928+0000 7fef3b109640 1 --2- 172.21.15.195:0/835903665 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef340fe6f0 0x7fef340688f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:25.930 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:25.928+0000 7fef3b109640 1 -- 172.21.15.195:0/835903665 >> 172.21.15.195:0/835903665 conn(0x7fef340f9e80 msgr2=0x7fef340fa910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:58:25.930 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:25.928+0000 7fef3b109640 1 -- 172.21.15.195:0/835903665 shutdown_connections 2024-09-13T16:58:25.930 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:25.928+0000 7fef3b109640 1 -- 172.21.15.195:0/835903665 wait complete. 2024-09-13T16:58:26.928 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:26 smithi115 ceph-mon[27708]: from='client.? 172.21.15.195:0/835903665' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T16:58:27.513 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T16:58:27.513 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T16:58:27.711 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T16:58:27.756 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T16:58:29.188 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:29.185+0000 7f565f735640 1 -- 172.21.15.195:0/789970300 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f56580fe6f0 msgr2=0x7f56580feaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:58:29.188 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:29.185+0000 7f565f735640 1 --2- 172.21.15.195:0/789970300 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f56580fe6f0 0x7f56580feaf0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5648009880 tx=0x7f564802a5d0 comp rx=0 tx=0).stop 2024-09-13T16:58:29.188 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:29.185+0000 7f565f735640 1 -- 172.21.15.195:0/789970300 shutdown_connections 2024-09-13T16:58:29.189 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:29.185+0000 7f565f735640 1 --2- 172.21.15.195:0/789970300 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f56580fe6f0 0x7f56580feaf0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:29.189 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:29.185+0000 7f565f735640 1 -- 172.21.15.195:0/789970300 >> 172.21.15.195:0/789970300 conn(0x7f56580f9e80 msgr2=0x7f56580fc2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:58:29.189 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:29.185+0000 7f565f735640 1 -- 172.21.15.195:0/789970300 shutdown_connections 2024-09-13T16:58:29.189 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:29.185+0000 7f565f735640 1 -- 172.21.15.195:0/789970300 wait complete. 2024-09-13T16:58:29.189 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:29.186+0000 7f565f735640 1 Processor -- start 2024-09-13T16:58:29.189 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:29.186+0000 7f565f735640 1 -- start start 2024-09-13T16:58:29.189 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:29.186+0000 7f565f735640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f56580fe6f0 0x7f5658193b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:58:29.189 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:29.186+0000 7f565f735640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5658194090 con 0x7f56580fe6f0 2024-09-13T16:58:29.189 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:29.186+0000 7f565d4d1640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f56580fe6f0 0x7f5658193b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:58:29.190 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:29.186+0000 7f565d4d1640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f56580fe6f0 0x7f5658193b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.195:42206/0 (socket says 172.21.15.195:42206) 2024-09-13T16:58:29.190 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:29.186+0000 7f565d4d1640 1 -- 172.21.15.195:0/3172976996 learned_addr learned my addr 172.21.15.195:0/3172976996 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-09-13T16:58:29.190 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:29.186+0000 7f565d4d1640 1 -- 172.21.15.195:0/3172976996 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5648009560 con 0x7f56580fe6f0 2024-09-13T16:58:29.190 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:29.187+0000 7f565d4d1640 1 --2- 172.21.15.195:0/3172976996 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f56580fe6f0 0x7f5658193b50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f56480055c0 tx=0x7f56480055f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:58:29.190 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:29.187+0000 7f564e7fc640 1 -- 172.21.15.195:0/3172976996 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5648004b20 con 0x7f56580fe6f0 2024-09-13T16:58:29.190 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:29.187+0000 7f565f735640 1 -- 172.21.15.195:0/3172976996 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5658194290 con 0x7f56580fe6f0 2024-09-13T16:58:29.190 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:29.187+0000 7f564e7fc640 1 -- 172.21.15.195:0/3172976996 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5648004c80 con 0x7f56580fe6f0 2024-09-13T16:58:29.190 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:29.187+0000 7f564e7fc640 1 -- 172.21.15.195:0/3172976996 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f56480318a0 con 0x7f56580fe6f0 2024-09-13T16:58:29.190 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:29.187+0000 7f565f735640 1 -- 172.21.15.195:0/3172976996 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5658194730 con 0x7f56580fe6f0 2024-09-13T16:58:29.191 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:29.188+0000 7f564e7fc640 1 -- 172.21.15.195:0/3172976996 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 15) v1 ==== 45350+0+0 (secure 0 0 0) 0x7f5648031b60 con 0x7f56580fe6f0 2024-09-13T16:58:29.191 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:29.188+0000 7f565f735640 1 -- 172.21.15.195:0/3172976996 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56580feaf0 con 0x7f56580fe6f0 2024-09-13T16:58:29.191 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:29.188+0000 7f564e7fc640 1 -- 172.21.15.195:0/3172976996 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f564806c130 con 0x7f56580fe6f0 2024-09-13T16:58:29.194 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:29.193+0000 7f564e7fc640 1 -- 172.21.15.195:0/3172976996 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f564803a540 con 0x7f56580fe6f0 2024-09-13T16:58:29.424 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:29.421+0000 7f565f735640 1 -- 172.21.15.195:0/3172976996 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f565802c3e0 con 0x7f56580fe6f0 2024-09-13T16:58:29.424 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:29.422+0000 7f564e7fc640 1 -- 172.21.15.195:0/3172976996 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7f5648035090 con 0x7f56580fe6f0 2024-09-13T16:58:29.424 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:58:29.424 INFO:teuthology.orchestra.run.smithi195.stdout:{"epoch":1,"fsid":"ffbd7588-71f0-11ef-bceb-c7b262605968","modified":"2024-09-13T16:56:25.840154Z","created":"2024-09-13T16:56:25.840154Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi115","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:3300","nonce":0},{"type":"v1","addr":"172.21.15.115:6789","nonce":0}]},"addr":"172.21.15.115:6789/0","public_addr":"172.21.15.115:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T16:58:29.425 INFO:teuthology.orchestra.run.smithi195.stderr:dumped monmap epoch 1 2024-09-13T16:58:29.426 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:29.424+0000 7f565f735640 1 -- 172.21.15.195:0/3172976996 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f56580fe6f0 msgr2=0x7f5658193b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:58:29.426 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:29.424+0000 7f565f735640 1 --2- 172.21.15.195:0/3172976996 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f56580fe6f0 0x7f5658193b50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f56480055c0 tx=0x7f56480055f0 comp rx=0 tx=0).stop 2024-09-13T16:58:29.426 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:29.424+0000 7f565f735640 1 -- 172.21.15.195:0/3172976996 shutdown_connections 2024-09-13T16:58:29.426 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:29.424+0000 7f565f735640 1 --2- 172.21.15.195:0/3172976996 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f56580fe6f0 0x7f5658193b50 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:29.426 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:29.424+0000 7f565f735640 1 -- 172.21.15.195:0/3172976996 >> 172.21.15.195:0/3172976996 conn(0x7f56580f9e80 msgr2=0x7f56580fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:58:29.426 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:29.424+0000 7f565f735640 1 -- 172.21.15.195:0/3172976996 shutdown_connections 2024-09-13T16:58:29.426 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:29.424+0000 7f565f735640 1 -- 172.21.15.195:0/3172976996 wait complete. 2024-09-13T16:58:29.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:29 smithi115 ceph-mon[27708]: Active manager daemon smithi115.hetcni restarted 2024-09-13T16:58:29.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:29 smithi115 ceph-mon[27708]: Activating manager daemon smithi115.hetcni 2024-09-13T16:58:29.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:29 smithi115 ceph-mon[27708]: osdmap e5: 0 total, 0 up, 0 in 2024-09-13T16:58:29.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:29 smithi115 ceph-mon[27708]: mgrmap e15: smithi115.hetcni(active, starting, since 0.00319002s) 2024-09-13T16:58:29.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:29 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mon metadata", "id": "smithi115"}]: dispatch 2024-09-13T16:58:29.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:29 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mgr metadata", "who": "smithi115.hetcni", "id": "smithi115.hetcni"}]: dispatch 2024-09-13T16:58:29.430 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:29 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T16:58:29.430 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:29 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T16:58:29.430 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:29 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T16:58:29.430 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:29 smithi115 ceph-mon[27708]: Manager daemon smithi115.hetcni is now available 2024-09-13T16:58:29.430 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:29 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:58:29.430 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:29 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:58:29.430 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:29 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T16:58:29.430 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:29 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi115.hetcni/mirror_snapshot_schedule"}]: dispatch 2024-09-13T16:58:30.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:30 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi115.hetcni/trash_purge_schedule"}]: dispatch 2024-09-13T16:58:30.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:30 smithi115 ceph-mon[27708]: from='client.? 172.21.15.195:0/3172976996' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T16:58:30.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:30 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:58:30.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:30 smithi115 ceph-mon[27708]: mgrmap e16: smithi115.hetcni(active, since 1.00497s) 2024-09-13T16:58:30.999 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T16:58:30.999 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T16:58:31.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:31 smithi115 ceph-mon[27708]: [13/Sep/2024:16:58:30] ENGINE Bus STARTING 2024-09-13T16:58:31.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:31 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:58:31.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:31 smithi115 ceph-mon[27708]: [13/Sep/2024:16:58:30] ENGINE Serving on http://172.21.15.115:8765 2024-09-13T16:58:31.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:31 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:58:31.731 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T16:58:32.103 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T16:58:32.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:32 smithi115 ceph-mon[27708]: [13/Sep/2024:16:58:30] ENGINE Serving on https://172.21.15.115:7150 2024-09-13T16:58:32.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:32 smithi115 ceph-mon[27708]: [13/Sep/2024:16:58:30] ENGINE Bus STARTED 2024-09-13T16:58:32.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:32 smithi115 ceph-mon[27708]: [13/Sep/2024:16:58:30] ENGINE Error in HTTPServer.serve 2024-09-13T16:58:32.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Traceback (most recent call last): 2024-09-13T16:58:32.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T16:58:32.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: self._connections.run(self.expiration_interval) 2024-09-13T16:58:32.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T16:58:32.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: self._run(expiration_interval) 2024-09-13T16:58:32.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T16:58:32.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T16:58:32.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T16:58:32.680 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T16:58:32.680 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T16:58:32.680 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: s = self.context.wrap_socket( 2024-09-13T16:58:32.680 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T16:58:32.680 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: return self.sslsocket_class._create( 2024-09-13T16:58:32.680 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T16:58:32.680 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: self.do_handshake() 2024-09-13T16:58:32.680 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T16:58:32.680 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: self._sslobj.do_handshake() 2024-09-13T16:58:32.680 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T16:58:32.680 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:32 smithi115 ceph-mon[27708]: mgrmap e17: smithi115.hetcni(active, since 2s) 2024-09-13T16:58:34.020 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:34.009+0000 7f33b0639640 1 -- 172.21.15.195:0/1047677665 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f33a80fe6f0 msgr2=0x7f33a80feaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:58:34.021 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:34.009+0000 7f33b0639640 1 --2- 172.21.15.195:0/1047677665 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f33a80fe6f0 0x7f33a80feaf0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f33a4009880 tx=0x7f33a402a5d0 comp rx=0 tx=0).stop 2024-09-13T16:58:34.021 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:34.009+0000 7f33b0639640 1 -- 172.21.15.195:0/1047677665 shutdown_connections 2024-09-13T16:58:34.021 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:34.009+0000 7f33b0639640 1 --2- 172.21.15.195:0/1047677665 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f33a80fe6f0 0x7f33a80feaf0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:34.021 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:34.009+0000 7f33b0639640 1 -- 172.21.15.195:0/1047677665 >> 172.21.15.195:0/1047677665 conn(0x7f33a80f9e80 msgr2=0x7f33a80fc2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:58:34.021 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:34.009+0000 7f33b0639640 1 -- 172.21.15.195:0/1047677665 shutdown_connections 2024-09-13T16:58:34.021 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:34.009+0000 7f33b0639640 1 -- 172.21.15.195:0/1047677665 wait complete. 2024-09-13T16:58:34.021 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:34.010+0000 7f33b0639640 1 Processor -- start 2024-09-13T16:58:34.021 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:34.010+0000 7f33b0639640 1 -- start start 2024-09-13T16:58:34.021 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:34.010+0000 7f33b0639640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f33a80fe6f0 0x7f33a81929d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:58:34.022 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:34.010+0000 7f33b0639640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33a8192f10 con 0x7f33a80fe6f0 2024-09-13T16:58:34.022 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:34.010+0000 7f33ae3d5640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f33a80fe6f0 0x7f33a81929d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:58:34.022 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:34.010+0000 7f33ae3d5640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f33a80fe6f0 0x7f33a81929d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.195:52836/0 (socket says 172.21.15.195:52836) 2024-09-13T16:58:34.022 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:34.010+0000 7f33ae3d5640 1 -- 172.21.15.195:0/1709388174 learned_addr learned my addr 172.21.15.195:0/1709388174 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-09-13T16:58:34.022 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:34.011+0000 7f33ae3d5640 1 -- 172.21.15.195:0/1709388174 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33a4009560 con 0x7f33a80fe6f0 2024-09-13T16:58:34.022 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:34.011+0000 7f33ae3d5640 1 --2- 172.21.15.195:0/1709388174 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f33a80fe6f0 0x7f33a81929d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f33a4004cf0 tx=0x7f33a4004d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:58:34.022 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:34.011+0000 7f339f7fe640 1 -- 172.21.15.195:0/1709388174 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f33a40053f0 con 0x7f33a80fe6f0 2024-09-13T16:58:34.022 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:34.011+0000 7f339f7fe640 1 -- 172.21.15.195:0/1709388174 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f33a4005550 con 0x7f33a80fe6f0 2024-09-13T16:58:34.022 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:34.011+0000 7f339f7fe640 1 -- 172.21.15.195:0/1709388174 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f33a40319c0 con 0x7f33a80fe6f0 2024-09-13T16:58:34.022 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:34.011+0000 7f33b0639640 1 -- 172.21.15.195:0/1709388174 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33a8193110 con 0x7f33a80fe6f0 2024-09-13T16:58:34.022 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:34.011+0000 7f33b0639640 1 -- 172.21.15.195:0/1709388174 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33a81935b0 con 0x7f33a80fe6f0 2024-09-13T16:58:34.022 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:34.012+0000 7f339f7fe640 1 -- 172.21.15.195:0/1709388174 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 17) v1 ==== 45671+0+0 (secure 0 0 0) 0x7f33a4031b20 con 0x7f33a80fe6f0 2024-09-13T16:58:34.022 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:34.012+0000 7f33b0639640 1 -- 172.21.15.195:0/1709388174 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33a80feaf0 con 0x7f33a80fe6f0 2024-09-13T16:58:34.023 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:34.012+0000 7f339f7fe640 1 --2- 172.21.15.195:0/1709388174 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f339403aad0 0x7f339403cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:58:34.023 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:34.012+0000 7f339f7fe640 1 -- 172.21.15.195:0/1709388174 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f33a406c7d0 con 0x7f33a80fe6f0 2024-09-13T16:58:34.023 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:34.013+0000 7f33adbd4640 1 --2- 172.21.15.195:0/1709388174 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f339403aad0 0x7f339403cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:58:34.023 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:34.013+0000 7f33adbd4640 1 --2- 172.21.15.195:0/1709388174 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f339403aad0 0x7f339403cf90 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f33980098c0 tx=0x7f3398006db0 comp rx=0 tx=0).ready entity=mgr.14207 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:58:34.023 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:34.017+0000 7f339f7fe640 1 -- 172.21.15.195:0/1709388174 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f33a40443b0 con 0x7f33a80fe6f0 2024-09-13T16:58:34.253 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:34.252+0000 7f33b0639640 1 -- 172.21.15.195:0/1709388174 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f33a818c2c0 con 0x7f33a80fe6f0 2024-09-13T16:58:34.254 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:34.252+0000 7f339f7fe640 1 -- 172.21.15.195:0/1709388174 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7f33a4035070 con 0x7f33a80fe6f0 2024-09-13T16:58:34.254 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:58:34.254 INFO:teuthology.orchestra.run.smithi195.stdout:{"epoch":1,"fsid":"ffbd7588-71f0-11ef-bceb-c7b262605968","modified":"2024-09-13T16:56:25.840154Z","created":"2024-09-13T16:56:25.840154Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi115","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:3300","nonce":0},{"type":"v1","addr":"172.21.15.115:6789","nonce":0}]},"addr":"172.21.15.115:6789/0","public_addr":"172.21.15.115:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T16:58:34.255 INFO:teuthology.orchestra.run.smithi195.stderr:dumped monmap epoch 1 2024-09-13T16:58:34.257 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:34.255+0000 7f33b0639640 1 -- 172.21.15.195:0/1709388174 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f339403aad0 msgr2=0x7f339403cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:58:34.257 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:34.255+0000 7f33b0639640 1 --2- 172.21.15.195:0/1709388174 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f339403aad0 0x7f339403cf90 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f33980098c0 tx=0x7f3398006db0 comp rx=0 tx=0).stop 2024-09-13T16:58:34.257 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:34.255+0000 7f33b0639640 1 -- 172.21.15.195:0/1709388174 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f33a80fe6f0 msgr2=0x7f33a81929d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:58:34.257 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:34.255+0000 7f33b0639640 1 --2- 172.21.15.195:0/1709388174 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f33a80fe6f0 0x7f33a81929d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f33a4004cf0 tx=0x7f33a4004d20 comp rx=0 tx=0).stop 2024-09-13T16:58:34.257 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:34.255+0000 7f33b0639640 1 -- 172.21.15.195:0/1709388174 shutdown_connections 2024-09-13T16:58:34.257 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:34.255+0000 7f33b0639640 1 --2- 172.21.15.195:0/1709388174 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f339403aad0 0x7f339403cf90 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:34.257 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:34.255+0000 7f33b0639640 1 --2- 172.21.15.195:0/1709388174 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f33a80fe6f0 0x7f33a81929d0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:34.257 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:34.255+0000 7f33b0639640 1 -- 172.21.15.195:0/1709388174 >> 172.21.15.195:0/1709388174 conn(0x7f33a80f9e80 msgr2=0x7f33a80fa910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:58:34.258 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:34.255+0000 7f33b0639640 1 -- 172.21.15.195:0/1709388174 shutdown_connections 2024-09-13T16:58:34.258 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:34.255+0000 7f33b0639640 1 -- 172.21.15.195:0/1709388174 wait complete. 2024-09-13T16:58:34.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:34 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:58:34.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:34 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:58:34.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:34 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:58:34.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:34 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:58:34.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:34 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "who": "osd/host:smithi115", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:58:34.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:34 smithi115 ceph-mon[27708]: from='client.? 172.21.15.195:0/1709388174' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T16:58:36.048 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T16:58:36.048 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T16:58:36.239 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T16:58:36.930 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:36 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:58:36.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:36 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:58:36.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:36 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:58:36.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:36 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:58:36.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:36 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "who": "osd/host:smithi195", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:58:36.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:36 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:58:36.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:36 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:58:36.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:36 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:58:36.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:36 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:58:36.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:36 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:58:36.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:36 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:58:36.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:36 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:58:36.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:36 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi195", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T16:58:36.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:36 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi195", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-13T16:58:36.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:36 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:58:37.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:37 smithi115 ceph-mon[27708]: Updating smithi115:/etc/ceph/ceph.conf 2024-09-13T16:58:37.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:37 smithi115 ceph-mon[27708]: Updating smithi195:/etc/ceph/ceph.conf 2024-09-13T16:58:37.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:37 smithi115 ceph-mon[27708]: Updating smithi195:/var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T16:58:37.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:37 smithi115 ceph-mon[27708]: Updating smithi115:/var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T16:58:37.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:37 smithi115 ceph-mon[27708]: Updating smithi195:/etc/ceph/ceph.client.admin.keyring 2024-09-13T16:58:37.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:37 smithi115 ceph-mon[27708]: Updating smithi115:/etc/ceph/ceph.client.admin.keyring 2024-09-13T16:58:37.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:37 smithi115 ceph-mon[27708]: Updating smithi195:/var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T16:58:37.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:37 smithi115 ceph-mon[27708]: Updating smithi115:/var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T16:58:37.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:37 smithi115 ceph-mon[27708]: Deploying daemon ceph-exporter.smithi195 on smithi195 2024-09-13T16:58:38.477 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:38.472+0000 7f82bc2ee640 1 -- 172.21.15.195:0/543979619 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82b40fe720 msgr2=0x7f82b40feb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:58:38.477 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:38.472+0000 7f82bc2ee640 1 --2- 172.21.15.195:0/543979619 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82b40fe720 0x7f82b40feb00 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f82b0009880 tx=0x7f82b002a670 comp rx=0 tx=0).stop 2024-09-13T16:58:38.477 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:38.472+0000 7f82bc2ee640 1 -- 172.21.15.195:0/543979619 shutdown_connections 2024-09-13T16:58:38.477 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:38.472+0000 7f82bc2ee640 1 --2- 172.21.15.195:0/543979619 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82b40fe720 0x7f82b40feb00 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:38.477 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:38.472+0000 7f82bc2ee640 1 -- 172.21.15.195:0/543979619 >> 172.21.15.195:0/543979619 conn(0x7f82b40fa350 msgr2=0x7f82b40fc770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:58:38.477 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:38.472+0000 7f82bc2ee640 1 -- 172.21.15.195:0/543979619 shutdown_connections 2024-09-13T16:58:38.477 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:38.472+0000 7f82bc2ee640 1 -- 172.21.15.195:0/543979619 wait complete. 2024-09-13T16:58:38.477 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:38.473+0000 7f82bc2ee640 1 Processor -- start 2024-09-13T16:58:38.478 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:38.473+0000 7f82bc2ee640 1 -- start start 2024-09-13T16:58:38.478 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:38.473+0000 7f82bc2ee640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82b40fe720 0x7f82b419b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:58:38.478 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:38.473+0000 7f82bc2ee640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82b419bb20 con 0x7f82b40fe720 2024-09-13T16:58:38.478 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:38.473+0000 7f82ba08a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82b40fe720 0x7f82b419b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:58:38.478 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:38.473+0000 7f82ba08a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82b40fe720 0x7f82b419b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.195:52848/0 (socket says 172.21.15.195:52848) 2024-09-13T16:58:38.478 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:38.473+0000 7f82ba08a640 1 -- 172.21.15.195:0/1064039462 learned_addr learned my addr 172.21.15.195:0/1064039462 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-09-13T16:58:38.478 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:38.474+0000 7f82ba08a640 1 -- 172.21.15.195:0/1064039462 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82b0009560 con 0x7f82b40fe720 2024-09-13T16:58:38.478 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:38.474+0000 7f82ba08a640 1 --2- 172.21.15.195:0/1064039462 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82b40fe720 0x7f82b419b5e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f82b0009230 tx=0x7f82b0005650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:58:38.478 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:38.474+0000 7f82ab7fe640 1 -- 172.21.15.195:0/1064039462 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f82b0004b70 con 0x7f82b40fe720 2024-09-13T16:58:38.478 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:38.474+0000 7f82bc2ee640 1 -- 172.21.15.195:0/1064039462 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82b419bd20 con 0x7f82b40fe720 2024-09-13T16:58:38.478 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:38.474+0000 7f82bc2ee640 1 -- 172.21.15.195:0/1064039462 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82b419c0e0 con 0x7f82b40fe720 2024-09-13T16:58:38.478 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:38.474+0000 7f82ab7fe640 1 -- 172.21.15.195:0/1064039462 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f82b0004cd0 con 0x7f82b40fe720 2024-09-13T16:58:38.478 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:38.474+0000 7f82ab7fe640 1 -- 172.21.15.195:0/1064039462 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f82b003c750 con 0x7f82b40fe720 2024-09-13T16:58:38.479 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:38.475+0000 7f82ab7fe640 1 -- 172.21.15.195:0/1064039462 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 17) v1 ==== 45671+0+0 (secure 0 0 0) 0x7f82b00035f0 con 0x7f82b40fe720 2024-09-13T16:58:38.479 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:38.475+0000 7f82bc2ee640 1 -- 172.21.15.195:0/1064039462 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82b4068750 con 0x7f82b40fe720 2024-09-13T16:58:38.479 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:38.475+0000 7f82ab7fe640 1 --2- 172.21.15.195:0/1064039462 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f82a0038830 0x7f82a003acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:58:38.479 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:38.475+0000 7f82ab7fe640 1 -- 172.21.15.195:0/1064039462 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f82b006c690 con 0x7f82b40fe720 2024-09-13T16:58:38.479 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:38.476+0000 7f82b9889640 1 --2- 172.21.15.195:0/1064039462 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f82a0038830 0x7f82a003acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:58:38.479 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:38.476+0000 7f82b9889640 1 --2- 172.21.15.195:0/1064039462 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f82a0038830 0x7f82a003acf0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f82a40098c0 tx=0x7f82a4006db0 comp rx=0 tx=0).ready entity=mgr.14207 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:58:38.482 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:38.481+0000 7f82ab7fe640 1 -- 172.21.15.195:0/1064039462 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f82b0043b50 con 0x7f82b40fe720 2024-09-13T16:58:38.711 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:38.710+0000 7f82bc2ee640 1 -- 172.21.15.195:0/1064039462 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f82b4110100 con 0x7f82b40fe720 2024-09-13T16:58:38.712 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:38.710+0000 7f82ab7fe640 1 -- 172.21.15.195:0/1064039462 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7f82b0035030 con 0x7f82b40fe720 2024-09-13T16:58:38.712 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:58:38.712 INFO:teuthology.orchestra.run.smithi195.stdout:{"epoch":1,"fsid":"ffbd7588-71f0-11ef-bceb-c7b262605968","modified":"2024-09-13T16:56:25.840154Z","created":"2024-09-13T16:56:25.840154Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi115","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:3300","nonce":0},{"type":"v1","addr":"172.21.15.115:6789","nonce":0}]},"addr":"172.21.15.115:6789/0","public_addr":"172.21.15.115:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T16:58:38.712 INFO:teuthology.orchestra.run.smithi195.stderr:dumped monmap epoch 1 2024-09-13T16:58:38.714 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:38.712+0000 7f82bc2ee640 1 -- 172.21.15.195:0/1064039462 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f82a0038830 msgr2=0x7f82a003acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:58:38.714 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:38.712+0000 7f82bc2ee640 1 --2- 172.21.15.195:0/1064039462 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f82a0038830 0x7f82a003acf0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f82a40098c0 tx=0x7f82a4006db0 comp rx=0 tx=0).stop 2024-09-13T16:58:38.714 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:38.712+0000 7f82bc2ee640 1 -- 172.21.15.195:0/1064039462 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82b40fe720 msgr2=0x7f82b419b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:58:38.714 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:38.712+0000 7f82bc2ee640 1 --2- 172.21.15.195:0/1064039462 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82b40fe720 0x7f82b419b5e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f82b0009230 tx=0x7f82b0005650 comp rx=0 tx=0).stop 2024-09-13T16:58:38.714 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:38.712+0000 7f82bc2ee640 1 -- 172.21.15.195:0/1064039462 shutdown_connections 2024-09-13T16:58:38.714 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:38.712+0000 7f82bc2ee640 1 --2- 172.21.15.195:0/1064039462 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f82a0038830 0x7f82a003acf0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:38.714 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:38.712+0000 7f82bc2ee640 1 --2- 172.21.15.195:0/1064039462 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82b40fe720 0x7f82b419b5e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:38.714 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:38.712+0000 7f82bc2ee640 1 -- 172.21.15.195:0/1064039462 >> 172.21.15.195:0/1064039462 conn(0x7f82b40fa350 msgr2=0x7f82b40fa730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:58:38.715 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:38.712+0000 7f82bc2ee640 1 -- 172.21.15.195:0/1064039462 shutdown_connections 2024-09-13T16:58:38.715 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:38.712+0000 7f82bc2ee640 1 -- 172.21.15.195:0/1064039462 wait complete. 2024-09-13T16:58:39.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:38 smithi115 ceph-mon[27708]: from='client.? 172.21.15.195:0/1064039462' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T16:58:40.632 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T16:58:40.632 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T16:58:41.770 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T16:58:41.881 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:41 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:58:41.882 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:41 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:58:41.882 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:41 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:58:41.882 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:41 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:58:41.882 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:41 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi195", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T16:58:41.882 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:41 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi195", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-13T16:58:41.882 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:41 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:58:41.882 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:41 smithi115 ceph-mon[27708]: Deploying daemon crash.smithi195 on smithi195 2024-09-13T16:58:43.834 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:43.824+0000 7f7158dcf640 1 -- 172.21.15.195:0/3985671726 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7154104670 msgr2=0x7f7154104a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:58:43.835 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:43.824+0000 7f7158dcf640 1 --2- 172.21.15.195:0/3985671726 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7154104670 0x7f7154104a50 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7144009880 tx=0x7f714402a5d0 comp rx=0 tx=0).stop 2024-09-13T16:58:43.835 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:43.824+0000 7f7158dcf640 1 -- 172.21.15.195:0/3985671726 shutdown_connections 2024-09-13T16:58:43.835 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:43.824+0000 7f7158dcf640 1 --2- 172.21.15.195:0/3985671726 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7154104670 0x7f7154104a50 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:43.835 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:43.824+0000 7f7158dcf640 1 -- 172.21.15.195:0/3985671726 >> 172.21.15.195:0/3985671726 conn(0x7f7154075460 msgr2=0x7f71540fc820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:58:43.835 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:43.824+0000 7f7158dcf640 1 -- 172.21.15.195:0/3985671726 shutdown_connections 2024-09-13T16:58:43.835 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:43.824+0000 7f7158dcf640 1 -- 172.21.15.195:0/3985671726 wait complete. 2024-09-13T16:58:43.835 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:43.825+0000 7f7158dcf640 1 Processor -- start 2024-09-13T16:58:43.835 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:43.825+0000 7f7158dcf640 1 -- start start 2024-09-13T16:58:43.835 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:43.825+0000 7f7158dcf640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7154104670 0x7f7154193bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:58:43.835 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:43.825+0000 7f7158dcf640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71540684c0 con 0x7f7154104670 2024-09-13T16:58:43.835 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:43.825+0000 7f715259c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7154104670 0x7f7154193bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:58:43.836 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:43.826+0000 7f715259c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7154104670 0x7f7154193bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.195:40418/0 (socket says 172.21.15.195:40418) 2024-09-13T16:58:43.836 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:43.826+0000 7f715259c640 1 -- 172.21.15.195:0/1380878409 learned_addr learned my addr 172.21.15.195:0/1380878409 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-09-13T16:58:43.836 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:43.826+0000 7f715259c640 1 -- 172.21.15.195:0/1380878409 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7144009560 con 0x7f7154104670 2024-09-13T16:58:43.836 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:43.826+0000 7f715259c640 1 --2- 172.21.15.195:0/1380878409 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7154104670 0x7f7154193bd0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7144009230 tx=0x7f7144005650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:58:43.836 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:43.826+0000 7f714b7fe640 1 -- 172.21.15.195:0/1380878409 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7144004b70 con 0x7f7154104670 2024-09-13T16:58:43.836 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:43.826+0000 7f7158dcf640 1 -- 172.21.15.195:0/1380878409 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7154194110 con 0x7f7154104670 2024-09-13T16:58:43.836 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:43.826+0000 7f714b7fe640 1 -- 172.21.15.195:0/1380878409 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7144004cd0 con 0x7f7154104670 2024-09-13T16:58:43.836 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:43.826+0000 7f714b7fe640 1 -- 172.21.15.195:0/1380878409 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f714403c910 con 0x7f7154104670 2024-09-13T16:58:43.836 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:43.826+0000 7f7158dcf640 1 -- 172.21.15.195:0/1380878409 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7154194590 con 0x7f7154104670 2024-09-13T16:58:43.836 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:43.827+0000 7f7158dcf640 1 -- 172.21.15.195:0/1380878409 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71540ffdb0 con 0x7f7154104670 2024-09-13T16:58:43.836 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:43.827+0000 7f714b7fe640 1 -- 172.21.15.195:0/1380878409 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 17) v1 ==== 45671+0+0 (secure 0 0 0) 0x7f71440035f0 con 0x7f7154104670 2024-09-13T16:58:43.836 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:43.827+0000 7f714b7fe640 1 --2- 172.21.15.195:0/1380878409 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f7140038830 0x7f714003acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:58:43.836 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:43.827+0000 7f714b7fe640 1 -- 172.21.15.195:0/1380878409 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f714406c720 con 0x7f7154104670 2024-09-13T16:58:43.837 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:43.828+0000 7f7151d9b640 1 --2- 172.21.15.195:0/1380878409 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f7140038830 0x7f714003acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:58:43.837 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:43.828+0000 7f7151d9b640 1 --2- 172.21.15.195:0/1380878409 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f7140038830 0x7f714003acf0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f713c0098c0 tx=0x7f713c006db0 comp rx=0 tx=0).ready entity=mgr.14207 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:58:43.837 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:43.833+0000 7f714b7fe640 1 -- 172.21.15.195:0/1380878409 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f714403a540 con 0x7f7154104670 2024-09-13T16:58:44.073 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:44.068+0000 7f7158dcf640 1 -- 172.21.15.195:0/1380878409 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f7154104a50 con 0x7f7154104670 2024-09-13T16:58:44.073 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:44.069+0000 7f714b7fe640 1 -- 172.21.15.195:0/1380878409 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7f714404a090 con 0x7f7154104670 2024-09-13T16:58:44.073 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:58:44.074 INFO:teuthology.orchestra.run.smithi195.stdout:{"epoch":1,"fsid":"ffbd7588-71f0-11ef-bceb-c7b262605968","modified":"2024-09-13T16:56:25.840154Z","created":"2024-09-13T16:56:25.840154Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi115","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:3300","nonce":0},{"type":"v1","addr":"172.21.15.115:6789","nonce":0}]},"addr":"172.21.15.115:6789/0","public_addr":"172.21.15.115:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T16:58:44.074 INFO:teuthology.orchestra.run.smithi195.stderr:dumped monmap epoch 1 2024-09-13T16:58:44.074 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:44.071+0000 7f7158dcf640 1 -- 172.21.15.195:0/1380878409 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f7140038830 msgr2=0x7f714003acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:58:44.074 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:44.071+0000 7f7158dcf640 1 --2- 172.21.15.195:0/1380878409 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f7140038830 0x7f714003acf0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f713c0098c0 tx=0x7f713c006db0 comp rx=0 tx=0).stop 2024-09-13T16:58:44.074 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:44.071+0000 7f7158dcf640 1 -- 172.21.15.195:0/1380878409 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7154104670 msgr2=0x7f7154193bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:58:44.074 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:44.071+0000 7f7158dcf640 1 --2- 172.21.15.195:0/1380878409 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7154104670 0x7f7154193bd0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7144009230 tx=0x7f7144005650 comp rx=0 tx=0).stop 2024-09-13T16:58:44.075 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:44.071+0000 7f7158dcf640 1 -- 172.21.15.195:0/1380878409 shutdown_connections 2024-09-13T16:58:44.075 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:44.071+0000 7f7158dcf640 1 --2- 172.21.15.195:0/1380878409 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f7140038830 0x7f714003acf0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:44.075 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:44.071+0000 7f7158dcf640 1 --2- 172.21.15.195:0/1380878409 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7154104670 0x7f7154193bd0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:44.075 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:44.071+0000 7f7158dcf640 1 -- 172.21.15.195:0/1380878409 >> 172.21.15.195:0/1380878409 conn(0x7f7154075460 msgr2=0x7f71540fa810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:58:44.075 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:44.071+0000 7f7158dcf640 1 -- 172.21.15.195:0/1380878409 shutdown_connections 2024-09-13T16:58:44.075 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:44.071+0000 7f7158dcf640 1 -- 172.21.15.195:0/1380878409 wait complete. 2024-09-13T16:58:44.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:44 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:58:44.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:44 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:58:44.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:44 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:58:44.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:44 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:58:44.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:44 smithi115 ceph-mon[27708]: Deploying daemon node-exporter.smithi195 on smithi195 2024-09-13T16:58:44.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:44 smithi115 ceph-mon[27708]: from='client.? 172.21.15.195:0/1380878409' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T16:58:44.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:44 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:58:44.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:44 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T16:58:45.746 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T16:58:45.746 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T16:58:46.494 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T16:58:48.691 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:48.689+0000 7f15f4a85640 1 -- 172.21.15.195:0/832092892 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15f0104660 msgr2=0x7f15f0104a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:58:48.691 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:48.689+0000 7f15f4a85640 1 --2- 172.21.15.195:0/832092892 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15f0104660 0x7f15f0104a40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f15e0009880 tx=0x7f15e002a5d0 comp rx=0 tx=0).stop 2024-09-13T16:58:48.691 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:48.689+0000 7f15f4a85640 1 -- 172.21.15.195:0/832092892 shutdown_connections 2024-09-13T16:58:48.692 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:48.689+0000 7f15f4a85640 1 --2- 172.21.15.195:0/832092892 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15f0104660 0x7f15f0104a40 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:48.692 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:48.689+0000 7f15f4a85640 1 -- 172.21.15.195:0/832092892 >> 172.21.15.195:0/832092892 conn(0x7f15f00fa360 msgr2=0x7f15f00fc780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:58:48.692 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:48.689+0000 7f15f4a85640 1 -- 172.21.15.195:0/832092892 shutdown_connections 2024-09-13T16:58:48.692 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:48.689+0000 7f15f4a85640 1 -- 172.21.15.195:0/832092892 wait complete. 2024-09-13T16:58:48.692 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:48.690+0000 7f15f4a85640 1 Processor -- start 2024-09-13T16:58:48.692 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:48.690+0000 7f15f4a85640 1 -- start start 2024-09-13T16:58:48.692 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:48.690+0000 7f15f4a85640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15f0104660 0x7f15f0195d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:58:48.692 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:48.690+0000 7f15f4a85640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f0068e40 con 0x7f15f0104660 2024-09-13T16:58:48.694 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:48.690+0000 7f15ee59c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15f0104660 0x7f15f0195d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:58:48.694 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:48.690+0000 7f15ee59c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15f0104660 0x7f15f0195d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.195:40430/0 (socket says 172.21.15.195:40430) 2024-09-13T16:58:48.694 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:48.690+0000 7f15ee59c640 1 -- 172.21.15.195:0/4199209040 learned_addr learned my addr 172.21.15.195:0/4199209040 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-09-13T16:58:48.694 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:48.690+0000 7f15ee59c640 1 -- 172.21.15.195:0/4199209040 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15e0009560 con 0x7f15f0104660 2024-09-13T16:58:48.694 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:48.691+0000 7f15ee59c640 1 --2- 172.21.15.195:0/4199209040 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15f0104660 0x7f15f0195d80 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f15e0009230 tx=0x7f15e0005650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:58:48.694 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:48.691+0000 7f15e77fe640 1 -- 172.21.15.195:0/4199209040 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f15e0004b70 con 0x7f15f0104660 2024-09-13T16:58:48.695 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:48.691+0000 7f15e77fe640 1 -- 172.21.15.195:0/4199209040 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f15e0004cd0 con 0x7f15f0104660 2024-09-13T16:58:48.695 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:48.691+0000 7f15f4a85640 1 -- 172.21.15.195:0/4199209040 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15f0196320 con 0x7f15f0104660 2024-09-13T16:58:48.695 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:48.691+0000 7f15e77fe640 1 -- 172.21.15.195:0/4199209040 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f15e003c910 con 0x7f15f0104660 2024-09-13T16:58:48.695 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:48.691+0000 7f15f4a85640 1 -- 172.21.15.195:0/4199209040 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15f01967a0 con 0x7f15f0104660 2024-09-13T16:58:48.695 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:48.692+0000 7f15e77fe640 1 -- 172.21.15.195:0/4199209040 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 17) v1 ==== 45671+0+0 (secure 0 0 0) 0x7f15e00035f0 con 0x7f15f0104660 2024-09-13T16:58:48.695 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:48.692+0000 7f15f4a85640 1 -- 172.21.15.195:0/4199209040 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15f0103420 con 0x7f15f0104660 2024-09-13T16:58:48.695 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:48.692+0000 7f15e77fe640 1 --2- 172.21.15.195:0/4199209040 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f15dc038830 0x7f15dc03acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:58:48.695 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:48.692+0000 7f15e77fe640 1 -- 172.21.15.195:0/4199209040 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f15e006c720 con 0x7f15f0104660 2024-09-13T16:58:48.695 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:48.692+0000 7f15e7fff640 1 --2- 172.21.15.195:0/4199209040 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f15dc038830 0x7f15dc03acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:58:48.695 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:48.693+0000 7f15e7fff640 1 --2- 172.21.15.195:0/4199209040 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f15dc038830 0x7f15dc03acf0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f15d80098c0 tx=0x7f15d8006db0 comp rx=0 tx=0).ready entity=mgr.14207 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:58:48.699 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:48.697+0000 7f15e77fe640 1 -- 172.21.15.195:0/4199209040 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f15e003a540 con 0x7f15f0104660 2024-09-13T16:58:48.953 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:48.952+0000 7f15f4a85640 1 -- 172.21.15.195:0/4199209040 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f15f00ffda0 con 0x7f15f0104660 2024-09-13T16:58:48.954 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:48.953+0000 7f15e77fe640 1 -- 172.21.15.195:0/4199209040 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7f15e004a090 con 0x7f15f0104660 2024-09-13T16:58:48.954 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:58:48.954 INFO:teuthology.orchestra.run.smithi195.stdout:{"epoch":1,"fsid":"ffbd7588-71f0-11ef-bceb-c7b262605968","modified":"2024-09-13T16:56:25.840154Z","created":"2024-09-13T16:56:25.840154Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi115","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:3300","nonce":0},{"type":"v1","addr":"172.21.15.115:6789","nonce":0}]},"addr":"172.21.15.115:6789/0","public_addr":"172.21.15.115:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T16:58:48.955 INFO:teuthology.orchestra.run.smithi195.stderr:dumped monmap epoch 1 2024-09-13T16:58:48.957 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:48.955+0000 7f15f4a85640 1 -- 172.21.15.195:0/4199209040 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f15dc038830 msgr2=0x7f15dc03acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:58:48.957 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:48.955+0000 7f15f4a85640 1 --2- 172.21.15.195:0/4199209040 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f15dc038830 0x7f15dc03acf0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f15d80098c0 tx=0x7f15d8006db0 comp rx=0 tx=0).stop 2024-09-13T16:58:48.957 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:48.955+0000 7f15f4a85640 1 -- 172.21.15.195:0/4199209040 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15f0104660 msgr2=0x7f15f0195d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:58:48.957 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:48.955+0000 7f15f4a85640 1 --2- 172.21.15.195:0/4199209040 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15f0104660 0x7f15f0195d80 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f15e0009230 tx=0x7f15e0005650 comp rx=0 tx=0).stop 2024-09-13T16:58:48.957 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:48.955+0000 7f15f4a85640 1 -- 172.21.15.195:0/4199209040 shutdown_connections 2024-09-13T16:58:48.957 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:48.955+0000 7f15f4a85640 1 --2- 172.21.15.195:0/4199209040 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f15dc038830 0x7f15dc03acf0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:48.957 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:48.955+0000 7f15f4a85640 1 --2- 172.21.15.195:0/4199209040 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15f0104660 0x7f15f0195d80 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:48.957 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:48.955+0000 7f15f4a85640 1 -- 172.21.15.195:0/4199209040 >> 172.21.15.195:0/4199209040 conn(0x7f15f00fa360 msgr2=0x7f15f0102170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:58:48.957 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:48.955+0000 7f15f4a85640 1 -- 172.21.15.195:0/4199209040 shutdown_connections 2024-09-13T16:58:48.957 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:48.955+0000 7f15f4a85640 1 -- 172.21.15.195:0/4199209040 wait complete. 2024-09-13T16:58:49.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:48 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:58:49.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:48 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:58:49.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:48 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:58:49.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:48 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:58:49.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:48 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi195.hjjifz", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T16:58:49.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:48 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi195.hjjifz", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-13T16:58:49.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:48 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T16:58:49.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:48 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:58:49.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:48 smithi115 ceph-mon[27708]: Deploying daemon mgr.smithi195.hjjifz on smithi195 2024-09-13T16:58:50.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:49 smithi115 ceph-mon[27708]: from='client.? 172.21.15.195:0/4199209040' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T16:58:50.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:49 smithi115 ceph-mon[27708]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:58:50.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:49 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:58:51.020 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T16:58:51.021 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T16:58:51.665 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T16:58:52.601 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:52 smithi115 ceph-mon[27708]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:58:52.601 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:52 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:58:52.601 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:52 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:58:52.601 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:52 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:58:52.601 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:52 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:58:52.601 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:52 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T16:58:52.601 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:52 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:58:53.119 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:53.117+0000 7f779b541640 1 -- 172.21.15.195:0/3945967371 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77941057a0 msgr2=0x7f7794105b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:58:53.119 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:53.117+0000 7f779b541640 1 --2- 172.21.15.195:0/3945967371 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77941057a0 0x7f7794105b80 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7790009880 tx=0x7f779002a5d0 comp rx=0 tx=0).stop 2024-09-13T16:58:53.119 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:53.117+0000 7f779b541640 1 -- 172.21.15.195:0/3945967371 shutdown_connections 2024-09-13T16:58:53.119 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:53.117+0000 7f779b541640 1 --2- 172.21.15.195:0/3945967371 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77941057a0 0x7f7794105b80 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:53.119 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:53.117+0000 7f779b541640 1 -- 172.21.15.195:0/3945967371 >> 172.21.15.195:0/3945967371 conn(0x7f7794076550 msgr2=0x7f7794076960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:58:53.119 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:53.117+0000 7f779b541640 1 -- 172.21.15.195:0/3945967371 shutdown_connections 2024-09-13T16:58:53.120 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:53.117+0000 7f779b541640 1 -- 172.21.15.195:0/3945967371 wait complete. 2024-09-13T16:58:53.120 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:53.118+0000 7f779b541640 1 Processor -- start 2024-09-13T16:58:53.120 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:53.118+0000 7f779b541640 1 -- start start 2024-09-13T16:58:53.120 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:53.118+0000 7f779b541640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77941057a0 0x7f7794194eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:58:53.120 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:53.118+0000 7f779b541640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77941953f0 con 0x7f77941057a0 2024-09-13T16:58:53.121 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:53.118+0000 7f77992dd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77941057a0 0x7f7794194eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:58:53.121 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:53.118+0000 7f77992dd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77941057a0 0x7f7794194eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.195:33992/0 (socket says 172.21.15.195:33992) 2024-09-13T16:58:53.121 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:53.118+0000 7f77992dd640 1 -- 172.21.15.195:0/910285396 learned_addr learned my addr 172.21.15.195:0/910285396 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-09-13T16:58:53.121 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:53.119+0000 7f77992dd640 1 -- 172.21.15.195:0/910285396 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7790009560 con 0x7f77941057a0 2024-09-13T16:58:53.121 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:53.119+0000 7f77992dd640 1 --2- 172.21.15.195:0/910285396 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77941057a0 0x7f7794194eb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7790009230 tx=0x7f7790005650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:58:53.121 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:53.119+0000 7f778a7fc640 1 -- 172.21.15.195:0/910285396 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7790004b70 con 0x7f77941057a0 2024-09-13T16:58:53.121 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:53.119+0000 7f778a7fc640 1 -- 172.21.15.195:0/910285396 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7790004cd0 con 0x7f77941057a0 2024-09-13T16:58:53.122 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:53.119+0000 7f778a7fc640 1 -- 172.21.15.195:0/910285396 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f779003c910 con 0x7f77941057a0 2024-09-13T16:58:53.122 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:53.119+0000 7f779b541640 1 -- 172.21.15.195:0/910285396 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7794195650 con 0x7f77941057a0 2024-09-13T16:58:53.122 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:53.119+0000 7f779b541640 1 -- 172.21.15.195:0/910285396 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7794195ad0 con 0x7f77941057a0 2024-09-13T16:58:53.123 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:53.120+0000 7f778a7fc640 1 -- 172.21.15.195:0/910285396 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 17) v1 ==== 45671+0+0 (secure 0 0 0) 0x7f779003cb40 con 0x7f77941057a0 2024-09-13T16:58:53.123 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:53.120+0000 7f778a7fc640 1 --2- 172.21.15.195:0/910285396 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f7780038880 0x7f778003ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:58:53.123 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:53.120+0000 7f779b541640 1 -- 172.21.15.195:0/910285396 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7794100e70 con 0x7f77941057a0 2024-09-13T16:58:53.123 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:53.120+0000 7f778a7fc640 1 -- 172.21.15.195:0/910285396 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f779006c680 con 0x7f77941057a0 2024-09-13T16:58:53.123 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:53.120+0000 7f7798adc640 1 --2- 172.21.15.195:0/910285396 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f7780038880 0x7f778003ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:58:53.123 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:53.121+0000 7f7798adc640 1 --2- 172.21.15.195:0/910285396 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f7780038880 0x7f778003ad40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f77840098c0 tx=0x7f7784006db0 comp rx=0 tx=0).ready entity=mgr.14207 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:58:53.127 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:53.125+0000 7f778a7fc640 1 -- 172.21.15.195:0/910285396 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f7790031400 con 0x7f77941057a0 2024-09-13T16:58:53.366 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:53.364+0000 7f779b541640 1 -- 172.21.15.195:0/910285396 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f7794109ad0 con 0x7f77941057a0 2024-09-13T16:58:53.366 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:53.365+0000 7f778a7fc640 1 -- 172.21.15.195:0/910285396 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7f7790040090 con 0x7f77941057a0 2024-09-13T16:58:53.366 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:58:53.366 INFO:teuthology.orchestra.run.smithi195.stdout:{"epoch":1,"fsid":"ffbd7588-71f0-11ef-bceb-c7b262605968","modified":"2024-09-13T16:56:25.840154Z","created":"2024-09-13T16:56:25.840154Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi115","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:3300","nonce":0},{"type":"v1","addr":"172.21.15.115:6789","nonce":0}]},"addr":"172.21.15.115:6789/0","public_addr":"172.21.15.115:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T16:58:53.367 INFO:teuthology.orchestra.run.smithi195.stderr:dumped monmap epoch 1 2024-09-13T16:58:53.368 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:53.367+0000 7f779b541640 1 -- 172.21.15.195:0/910285396 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f7780038880 msgr2=0x7f778003ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:58:53.368 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:53.367+0000 7f779b541640 1 --2- 172.21.15.195:0/910285396 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f7780038880 0x7f778003ad40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f77840098c0 tx=0x7f7784006db0 comp rx=0 tx=0).stop 2024-09-13T16:58:53.368 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:53.367+0000 7f779b541640 1 -- 172.21.15.195:0/910285396 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77941057a0 msgr2=0x7f7794194eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:58:53.368 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:53.367+0000 7f779b541640 1 --2- 172.21.15.195:0/910285396 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77941057a0 0x7f7794194eb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7790009230 tx=0x7f7790005650 comp rx=0 tx=0).stop 2024-09-13T16:58:53.369 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:53.367+0000 7f779b541640 1 -- 172.21.15.195:0/910285396 shutdown_connections 2024-09-13T16:58:53.369 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:53.367+0000 7f779b541640 1 --2- 172.21.15.195:0/910285396 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f7780038880 0x7f778003ad40 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:53.369 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:53.367+0000 7f779b541640 1 --2- 172.21.15.195:0/910285396 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77941057a0 0x7f7794194eb0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:58:53.369 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:53.367+0000 7f779b541640 1 -- 172.21.15.195:0/910285396 >> 172.21.15.195:0/910285396 conn(0x7f7794076550 msgr2=0x7f7794103240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:58:53.369 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:53.367+0000 7f779b541640 1 -- 172.21.15.195:0/910285396 shutdown_connections 2024-09-13T16:58:53.369 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:58:53.367+0000 7f779b541640 1 -- 172.21.15.195:0/910285396 wait complete. 2024-09-13T16:58:53.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:53 smithi115 ceph-mon[27708]: Deploying daemon mon.smithi195 on smithi195 2024-09-13T16:58:54.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:54 smithi115 ceph-mon[27708]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:58:54.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:54 smithi115 ceph-mon[27708]: from='client.? 172.21.15.195:0/910285396' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T16:58:54.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:54 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:58:54.950 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T16:58:54.951 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T16:58:55.785 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/mon.smithi195/config 2024-09-13T16:58:56.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:56 smithi115 ceph-mon[27708]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:58:57.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:57 smithi115 ceph-mon[27708]: Standby manager daemon smithi195.hjjifz started 2024-09-13T16:58:57.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:57 smithi115 ceph-mon[27708]: from='mgr.? 172.21.15.195:0/1055594041' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi195.hjjifz/crt"}]: dispatch 2024-09-13T16:58:57.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:57 smithi115 ceph-mon[27708]: from='mgr.? 172.21.15.195:0/1055594041' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T16:58:57.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:57 smithi115 ceph-mon[27708]: from='mgr.? 172.21.15.195:0/1055594041' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi195.hjjifz/key"}]: dispatch 2024-09-13T16:58:57.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:58:57 smithi115 ceph-mon[27708]: from='mgr.? 172.21.15.195:0/1055594041' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T16:58:57.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:58:57 smithi195 systemd[1]: Started Ceph mon.smithi195 for ffbd7588-71f0-11ef-bceb-c7b262605968. 2024-09-13T16:59:03.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:02 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mon metadata", "id": "smithi115"}]: dispatch 2024-09-13T16:59:03.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:02 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-09-13T16:59:03.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:02 smithi195 ceph-mon[34981]: mon.smithi115 calling monitor election 2024-09-13T16:59:03.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:02 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-09-13T16:59:03.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:02 smithi195 ceph-mon[34981]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:59:03.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:02 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T16:59:03.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:02 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-09-13T16:59:03.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:02 smithi195 ceph-mon[34981]: mon.smithi195 calling monitor election 2024-09-13T16:59:03.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:02 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-09-13T16:59:03.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:02 smithi195 ceph-mon[34981]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:59:03.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:02 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-09-13T16:59:03.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:02 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-09-13T16:59:03.079 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:02 smithi195 ceph-mon[34981]: mon.smithi115 is new leader, mons smithi115,smithi195 in quorum (ranks 0,1) 2024-09-13T16:59:03.079 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:02 smithi195 ceph-mon[34981]: monmap e2: 2 mons at {smithi115=[v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0],smithi195=[v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T16:59:03.079 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:02 smithi195 ceph-mon[34981]: fsmap 2024-09-13T16:59:03.079 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:02 smithi195 ceph-mon[34981]: osdmap e5: 0 total, 0 up, 0 in 2024-09-13T16:59:03.079 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:02 smithi195 ceph-mon[34981]: mgrmap e18: smithi115.hetcni(active, since 33s), standbys: smithi195.hjjifz 2024-09-13T16:59:03.079 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:02 smithi195 ceph-mon[34981]: overall HEALTH_OK 2024-09-13T16:59:03.079 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:02 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:03.079 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:02 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:03.079 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:02 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:03.079 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:02 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:03.079 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:02 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:03.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:02 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mon metadata", "id": "smithi115"}]: dispatch 2024-09-13T16:59:03.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:02 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-09-13T16:59:03.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:02 smithi115 ceph-mon[27708]: mon.smithi115 calling monitor election 2024-09-13T16:59:03.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:02 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-09-13T16:59:03.180 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:02 smithi115 ceph-mon[27708]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:59:03.180 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:02 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T16:59:03.180 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:02 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-09-13T16:59:03.180 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:02 smithi115 ceph-mon[27708]: mon.smithi195 calling monitor election 2024-09-13T16:59:03.180 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:02 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-09-13T16:59:03.180 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:02 smithi115 ceph-mon[27708]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:59:03.180 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:02 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-09-13T16:59:03.180 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:02 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-09-13T16:59:03.180 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:02 smithi115 ceph-mon[27708]: mon.smithi115 is new leader, mons smithi115,smithi195 in quorum (ranks 0,1) 2024-09-13T16:59:03.180 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:02 smithi115 ceph-mon[27708]: monmap e2: 2 mons at {smithi115=[v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0],smithi195=[v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T16:59:03.180 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:02 smithi115 ceph-mon[27708]: fsmap 2024-09-13T16:59:03.180 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:02 smithi115 ceph-mon[27708]: osdmap e5: 0 total, 0 up, 0 in 2024-09-13T16:59:03.180 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:02 smithi115 ceph-mon[27708]: mgrmap e18: smithi115.hetcni(active, since 33s), standbys: smithi195.hjjifz 2024-09-13T16:59:03.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:02 smithi115 ceph-mon[27708]: overall HEALTH_OK 2024-09-13T16:59:03.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:02 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:03.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:02 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:03.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:02 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:03.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:02 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:03.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:02 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:03.967 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:59:03.966+0000 7f4f64b22640 1 -- 172.21.15.195:0/3525844834 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f48006210 msgr2=0x7f4f48008680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:59:03.968 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:59:03.966+0000 7f4f64b22640 1 --2- 172.21.15.195:0/3525844834 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f48006210 0x7f4f48008680 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4f601009f0 tx=0x7f4f5002c4a0 comp rx=0 tx=0).stop 2024-09-13T16:59:03.968 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:59:03.966+0000 7f4f64b22640 1 -- 172.21.15.195:0/3525844834 shutdown_connections 2024-09-13T16:59:03.968 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:59:03.966+0000 7f4f64b22640 1 --2- 172.21.15.195:0/3525844834 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f48006210 0x7f4f48008680 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:03.968 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:59:03.966+0000 7f4f64b22640 1 -- 172.21.15.195:0/3525844834 >> 172.21.15.195:0/3525844834 conn(0x7f4f600fb540 msgr2=0x7f4f600fd960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:59:03.968 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:59:03.966+0000 7f4f64b22640 1 -- 172.21.15.195:0/3525844834 shutdown_connections 2024-09-13T16:59:03.968 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:59:03.966+0000 7f4f64b22640 1 -- 172.21.15.195:0/3525844834 wait complete. 2024-09-13T16:59:03.970 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:59:03.967+0000 7f4f64b22640 1 Processor -- start 2024-09-13T16:59:03.970 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:59:03.967+0000 7f4f64b22640 1 -- start start 2024-09-13T16:59:03.970 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:59:03.967+0000 7f4f64b22640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f48006210 0x7f4f600727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:59:03.970 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:59:03.967+0000 7f4f64b22640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f60072cf0 0x7f4f60073150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:59:03.970 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:59:03.967+0000 7f4f64b22640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f600747a0 con 0x7f4f60072cf0 2024-09-13T16:59:03.970 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:59:03.967+0000 7f4f64b22640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f601a1500 con 0x7f4f48006210 2024-09-13T16:59:03.970 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:59:03.967+0000 7f4f5e59c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f48006210 0x7f4f600727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:59:03.970 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:59:03.967+0000 7f4f5e59c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f48006210 0x7f4f600727b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:38410/0 (socket says 172.21.15.195:38410) 2024-09-13T16:59:03.970 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:59:03.967+0000 7f4f5e59c640 1 -- 172.21.15.195:0/1154159673 learned_addr learned my addr 172.21.15.195:0/1154159673 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-09-13T16:59:03.970 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:59:03.967+0000 7f4f5e59c640 1 -- 172.21.15.195:0/1154159673 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f48006210 msgr2=0x7f4f600727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-13T16:59:03.970 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:59:03.967+0000 7f4f5e59c640 1 -- 172.21.15.195:0/1154159673 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f48006210 msgr2=0x7f4f600727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-13T16:59:03.971 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:59:03.967+0000 7f4f5e59c640 1 --2- 172.21.15.195:0/1154159673 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f48006210 0x7f4f600727b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T16:59:03.971 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:59:03.967+0000 7f4f5e59c640 1 --2- 172.21.15.195:0/1154159673 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f48006210 0x7f4f600727b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T16:59:03.971 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:59:03.967+0000 7f4f5dd9b640 1 --2- 172.21.15.195:0/1154159673 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f60072cf0 0x7f4f60073150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:59:03.971 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:59:03.968+0000 7f4f5dd9b640 1 -- 172.21.15.195:0/1154159673 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f48006210 msgr2=0x7f4f600727b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T16:59:03.971 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:59:03.968+0000 7f4f5dd9b640 1 --2- 172.21.15.195:0/1154159673 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f48006210 0x7f4f600727b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:03.971 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:59:03.968+0000 7f4f5dd9b640 1 -- 172.21.15.195:0/1154159673 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f500128b0 con 0x7f4f60072cf0 2024-09-13T16:59:03.971 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:59:03.968+0000 7f4f5dd9b640 1 --2- 172.21.15.195:0/1154159673 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f60072cf0 0x7f4f60073150 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4f5400b400 tx=0x7f4f5400b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:59:03.971 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:59:03.968+0000 7f4f4f7fe640 1 -- 172.21.15.195:0/1154159673 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f54011800 con 0x7f4f60072cf0 2024-09-13T16:59:03.971 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:59:03.968+0000 7f4f64b22640 1 -- 172.21.15.195:0/1154159673 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f601a1760 con 0x7f4f60072cf0 2024-09-13T16:59:03.971 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:59:03.968+0000 7f4f4f7fe640 1 -- 172.21.15.195:0/1154159673 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4f54011e00 con 0x7f4f60072cf0 2024-09-13T16:59:03.971 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:59:03.968+0000 7f4f4f7fe640 1 -- 172.21.15.195:0/1154159673 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f5400f2e0 con 0x7f4f60072cf0 2024-09-13T16:59:03.971 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:59:03.968+0000 7f4f64b22640 1 -- 172.21.15.195:0/1154159673 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f601a1cb0 con 0x7f4f60072cf0 2024-09-13T16:59:03.972 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:59:03.969+0000 7f4f64b22640 1 -- 172.21.15.195:0/1154159673 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f60100fc0 con 0x7f4f60072cf0 2024-09-13T16:59:03.972 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:59:03.970+0000 7f4f4f7fe640 1 -- 172.21.15.195:0/1154159673 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 18) v1 ==== 90796+0+0 (secure 0 0 0) 0x7f4f54010380 con 0x7f4f60072cf0 2024-09-13T16:59:03.972 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:59:03.970+0000 7f4f4f7fe640 1 --2- 172.21.15.195:0/1154159673 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f4f4006cd20 0x7f4f4006f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:59:03.972 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:59:03.970+0000 7f4f4f7fe640 1 -- 172.21.15.195:0/1154159673 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f4f5408afe0 con 0x7f4f60072cf0 2024-09-13T16:59:03.973 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:59:03.970+0000 7f4f5e59c640 1 --2- 172.21.15.195:0/1154159673 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f4f4006cd20 0x7f4f4006f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:59:03.973 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:59:03.971+0000 7f4f5e59c640 1 --2- 172.21.15.195:0/1154159673 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f4f4006cd20 0x7f4f4006f1e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4f50005940 tx=0x7f4f50005870 comp rx=0 tx=0).ready entity=mgr.14207 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:59:03.976 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:59:03.975+0000 7f4f4f7fe640 1 -- 172.21.15.195:0/1154159673 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f4f540564b0 con 0x7f4f60072cf0 2024-09-13T16:59:04.024 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:03 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:59:04.024 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:03 smithi195 ceph-mon[34981]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:59:04.025 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:03 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-09-13T16:59:04.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:03 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:59:04.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:03 smithi115 ceph-mon[27708]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:59:04.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:03 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-09-13T16:59:04.211 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:59:04.209+0000 7f4f64b22640 1 -- 172.21.15.195:0/1154159673 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f4f601088b0 con 0x7f4f60072cf0 2024-09-13T16:59:04.212 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:59:04.210+0000 7f4f4f7fe640 1 -- 172.21.15.195:0/1154159673 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1026 (secure 0 0 0) 0x7f4f54015090 con 0x7f4f60072cf0 2024-09-13T16:59:04.212 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T16:59:04.212 INFO:teuthology.orchestra.run.smithi195.stdout:{"epoch":2,"fsid":"ffbd7588-71f0-11ef-bceb-c7b262605968","modified":"2024-09-13T16:58:57.685437Z","created":"2024-09-13T16:56:25.840154Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi115","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:3300","nonce":0},{"type":"v1","addr":"172.21.15.115:6789","nonce":0}]},"addr":"172.21.15.115:6789/0","public_addr":"172.21.15.115:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi195","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:3300","nonce":0},{"type":"v1","addr":"172.21.15.195:6789","nonce":0}]},"addr":"172.21.15.195:6789/0","public_addr":"172.21.15.195:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-13T16:59:04.212 INFO:teuthology.orchestra.run.smithi195.stderr:dumped monmap epoch 2 2024-09-13T16:59:04.215 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:59:04.212+0000 7f4f64b22640 1 -- 172.21.15.195:0/1154159673 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f4f4006cd20 msgr2=0x7f4f4006f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:59:04.215 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:59:04.212+0000 7f4f64b22640 1 --2- 172.21.15.195:0/1154159673 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f4f4006cd20 0x7f4f4006f1e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4f50005940 tx=0x7f4f50005870 comp rx=0 tx=0).stop 2024-09-13T16:59:04.215 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:59:04.212+0000 7f4f64b22640 1 -- 172.21.15.195:0/1154159673 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f60072cf0 msgr2=0x7f4f60073150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:59:04.215 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:59:04.212+0000 7f4f64b22640 1 --2- 172.21.15.195:0/1154159673 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f60072cf0 0x7f4f60073150 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4f5400b400 tx=0x7f4f5400b8c0 comp rx=0 tx=0).stop 2024-09-13T16:59:04.215 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:59:04.213+0000 7f4f64b22640 1 -- 172.21.15.195:0/1154159673 shutdown_connections 2024-09-13T16:59:04.215 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:59:04.213+0000 7f4f64b22640 1 --2- 172.21.15.195:0/1154159673 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f4f4006cd20 0x7f4f4006f1e0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:04.215 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:59:04.213+0000 7f4f64b22640 1 --2- 172.21.15.195:0/1154159673 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f60072cf0 0x7f4f60073150 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:04.215 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:59:04.213+0000 7f4f64b22640 1 --2- 172.21.15.195:0/1154159673 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f48006210 0x7f4f600727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:04.215 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:59:04.213+0000 7f4f64b22640 1 -- 172.21.15.195:0/1154159673 >> 172.21.15.195:0/1154159673 conn(0x7f4f600fb540 msgr2=0x7f4f60104b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:59:04.215 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:59:04.213+0000 7f4f64b22640 1 -- 172.21.15.195:0/1154159673 shutdown_connections 2024-09-13T16:59:04.215 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T16:59:04.213+0000 7f4f64b22640 1 -- 172.21.15.195:0/1154159673 wait complete. 2024-09-13T16:59:05.155 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-13T16:59:05.155 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -- ceph config generate-minimal-conf 2024-09-13T16:59:05.356 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T16:59:05.411 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:05 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:05.411 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:05 smithi195 ceph-mon[34981]: from='client.? 172.21.15.195:0/1154159673' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T16:59:05.411 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:05 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:05.411 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:05 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:05.411 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:05 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:59:05.412 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:05 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:59:05.412 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:05 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:05.412 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:05 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:05.412 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:05 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:05.412 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:05 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:05.412 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:05 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:05.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:05 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:05.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:05 smithi115 ceph-mon[27708]: from='client.? 172.21.15.195:0/1154159673' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T16:59:05.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:05 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:05.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:05 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:05.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:05 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:59:05.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:05 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:59:05.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:05 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:05.430 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:05 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:05.430 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:05 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:05.430 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:05 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:05.430 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:05 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:06.413 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:06 smithi115 ceph-mon[27708]: Updating smithi115:/etc/ceph/ceph.conf 2024-09-13T16:59:06.413 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:06 smithi115 ceph-mon[27708]: Updating smithi195:/etc/ceph/ceph.conf 2024-09-13T16:59:06.413 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:06 smithi115 ceph-mon[27708]: Updating smithi195:/var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T16:59:06.413 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:06 smithi115 ceph-mon[27708]: Updating smithi115:/var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T16:59:06.413 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:06 smithi115 ceph-mon[27708]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:59:06.413 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:06 smithi115 ceph-mon[27708]: Reconfiguring mon.smithi115 (unknown last config time)... 2024-09-13T16:59:06.413 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:06 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T16:59:06.413 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:06 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T16:59:06.413 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:06 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:59:06.413 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:06 smithi115 ceph-mon[27708]: Reconfiguring daemon mon.smithi115 on smithi115 2024-09-13T16:59:06.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:06 smithi195 ceph-mon[34981]: Updating smithi115:/etc/ceph/ceph.conf 2024-09-13T16:59:06.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:06 smithi195 ceph-mon[34981]: Updating smithi195:/etc/ceph/ceph.conf 2024-09-13T16:59:06.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:06 smithi195 ceph-mon[34981]: Updating smithi195:/var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T16:59:06.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:06 smithi195 ceph-mon[34981]: Updating smithi115:/var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T16:59:06.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:06 smithi195 ceph-mon[34981]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:59:06.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:06 smithi195 ceph-mon[34981]: Reconfiguring mon.smithi115 (unknown last config time)... 2024-09-13T16:59:06.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:06 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T16:59:06.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:06 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T16:59:06.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:06 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:59:06.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:06 smithi195 ceph-mon[34981]: Reconfiguring daemon mon.smithi115 on smithi115 2024-09-13T16:59:07.511 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:07.507+0000 7f2a67786640 1 -- 172.21.15.115:0/1221095634 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a60104670 msgr2=0x7f2a60104a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:59:07.511 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:07.507+0000 7f2a67786640 1 --2- 172.21.15.115:0/1221095634 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a60104670 0x7f2a60104a50 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2a50009880 tx=0x7f2a5002a5d0 comp rx=0 tx=0).stop 2024-09-13T16:59:07.511 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:07.508+0000 7f2a67786640 1 -- 172.21.15.115:0/1221095634 shutdown_connections 2024-09-13T16:59:07.511 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:07.508+0000 7f2a67786640 1 --2- 172.21.15.115:0/1221095634 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a60104670 0x7f2a60104a50 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:07.511 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:07.508+0000 7f2a67786640 1 -- 172.21.15.115:0/1221095634 >> 172.21.15.115:0/1221095634 conn(0x7f2a60075460 msgr2=0x7f2a600fc820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:59:07.512 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:07.508+0000 7f2a67786640 1 -- 172.21.15.115:0/1221095634 shutdown_connections 2024-09-13T16:59:07.512 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:07.508+0000 7f2a67786640 1 -- 172.21.15.115:0/1221095634 wait complete. 2024-09-13T16:59:07.512 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:07.508+0000 7f2a67786640 1 Processor -- start 2024-09-13T16:59:07.512 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:07.508+0000 7f2a67786640 1 -- start start 2024-09-13T16:59:07.512 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:07.508+0000 7f2a67786640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2a60104670 0x7f2a600fa8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:59:07.512 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:07.508+0000 7f2a67786640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a600fae20 0x7f2a600fb280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:59:07.512 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:07.508+0000 7f2a67786640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a600fc880 con 0x7f2a600fae20 2024-09-13T16:59:07.512 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:07.508+0000 7f2a67786640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a601a1300 con 0x7f2a60104670 2024-09-13T16:59:07.512 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:07.509+0000 7f2a64d21640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a600fae20 0x7f2a600fb280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:59:07.512 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:07.509+0000 7f2a64d21640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a600fae20 0x7f2a600fb280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:59130/0 (socket says 172.21.15.115:59130) 2024-09-13T16:59:07.512 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:07.509+0000 7f2a64d21640 1 -- 172.21.15.115:0/3110217168 learned_addr learned my addr 172.21.15.115:0/3110217168 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T16:59:07.512 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:07.509+0000 7f2a64d21640 1 -- 172.21.15.115:0/3110217168 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2a60104670 msgr2=0x7f2a600fa8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:59:07.513 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:07.509+0000 7f2a64d21640 1 --2- 172.21.15.115:0/3110217168 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2a60104670 0x7f2a600fa8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:07.513 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:07.509+0000 7f2a64d21640 1 -- 172.21.15.115:0/3110217168 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a50009560 con 0x7f2a600fae20 2024-09-13T16:59:07.513 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:07.509+0000 7f2a64d21640 1 --2- 172.21.15.115:0/3110217168 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a600fae20 0x7f2a600fb280 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c00b4a0 tx=0x7f2a5c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:59:07.513 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:07.509+0000 7f2a567fc640 1 -- 172.21.15.115:0/3110217168 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a5c0107e0 con 0x7f2a600fae20 2024-09-13T16:59:07.513 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:07.509+0000 7f2a567fc640 1 -- 172.21.15.115:0/3110217168 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2a5c010de0 con 0x7f2a600fae20 2024-09-13T16:59:07.513 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:07.509+0000 7f2a567fc640 1 -- 172.21.15.115:0/3110217168 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a5c00f360 con 0x7f2a600fae20 2024-09-13T16:59:07.513 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:07.509+0000 7f2a67786640 1 -- 172.21.15.115:0/3110217168 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a601a1500 con 0x7f2a600fae20 2024-09-13T16:59:07.513 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:07.509+0000 7f2a67786640 1 -- 172.21.15.115:0/3110217168 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a601a1a50 con 0x7f2a600fae20 2024-09-13T16:59:07.514 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:07.511+0000 7f2a67786640 1 -- 172.21.15.115:0/3110217168 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a600ffdb0 con 0x7f2a600fae20 2024-09-13T16:59:07.514 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:07.511+0000 7f2a567fc640 1 -- 172.21.15.115:0/3110217168 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 18) v1 ==== 90796+0+0 (secure 0 0 0) 0x7f2a5c017360 con 0x7f2a600fae20 2024-09-13T16:59:07.514 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:07.512+0000 7f2a567fc640 1 --2- 172.21.15.115:0/3110217168 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f2a4c06cd20 0x7f2a4c06f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:59:07.514 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:07.512+0000 7f2a567fc640 1 -- 172.21.15.115:0/3110217168 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f2a5c08aba0 con 0x7f2a600fae20 2024-09-13T16:59:07.514 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:07.512+0000 7f2a65522640 1 --2- 172.21.15.115:0/3110217168 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f2a4c06cd20 0x7f2a4c06f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:59:07.514 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:07.512+0000 7f2a65522640 1 --2- 172.21.15.115:0/3110217168 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f2a4c06cd20 0x7f2a4c06f1e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2a50009880 tx=0x7f2a50000bc0 comp rx=0 tx=0).ready entity=mgr.14207 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:59:07.521 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:07.520+0000 7f2a567fc640 1 -- 172.21.15.115:0/3110217168 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f2a5c055fb0 con 0x7f2a600fae20 2024-09-13T16:59:07.692 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:07.691+0000 7f2a67786640 1 -- 172.21.15.115:0/3110217168 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f2a60108990 con 0x7f2a600fae20 2024-09-13T16:59:07.693 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:07.692+0000 7f2a567fc640 1 -- 172.21.15.115:0/3110217168 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v10) v1 ==== 76+0+227 (secure 0 0 0) 0x7f2a5c0595d0 con 0x7f2a600fae20 2024-09-13T16:59:07.693 INFO:teuthology.orchestra.run.smithi115.stdout:# minimal ceph.conf for ffbd7588-71f0-11ef-bceb-c7b262605968 2024-09-13T16:59:07.693 INFO:teuthology.orchestra.run.smithi115.stdout:[global] 2024-09-13T16:59:07.693 INFO:teuthology.orchestra.run.smithi115.stdout: fsid = ffbd7588-71f0-11ef-bceb-c7b262605968 2024-09-13T16:59:07.693 INFO:teuthology.orchestra.run.smithi115.stdout: mon_host = [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] 2024-09-13T16:59:07.695 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:07.694+0000 7f2a67786640 1 -- 172.21.15.115:0/3110217168 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f2a4c06cd20 msgr2=0x7f2a4c06f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:59:07.695 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:07.694+0000 7f2a67786640 1 --2- 172.21.15.115:0/3110217168 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f2a4c06cd20 0x7f2a4c06f1e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2a50009880 tx=0x7f2a50000bc0 comp rx=0 tx=0).stop 2024-09-13T16:59:07.695 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:07.694+0000 7f2a67786640 1 -- 172.21.15.115:0/3110217168 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a600fae20 msgr2=0x7f2a600fb280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:59:07.695 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:07.694+0000 7f2a67786640 1 --2- 172.21.15.115:0/3110217168 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a600fae20 0x7f2a600fb280 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c00b4a0 tx=0x7f2a5c00b960 comp rx=0 tx=0).stop 2024-09-13T16:59:07.695 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:07.694+0000 7f2a67786640 1 -- 172.21.15.115:0/3110217168 shutdown_connections 2024-09-13T16:59:07.695 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:07.694+0000 7f2a67786640 1 --2- 172.21.15.115:0/3110217168 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f2a4c06cd20 0x7f2a4c06f1e0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:07.695 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:07.694+0000 7f2a67786640 1 --2- 172.21.15.115:0/3110217168 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a600fae20 0x7f2a600fb280 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:07.696 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:07.694+0000 7f2a67786640 1 --2- 172.21.15.115:0/3110217168 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2a60104670 0x7f2a600fa8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:07.696 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:07.694+0000 7f2a67786640 1 -- 172.21.15.115:0/3110217168 >> 172.21.15.115:0/3110217168 conn(0x7f2a60075460 msgr2=0x7f2a60067650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:59:07.696 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:07.694+0000 7f2a67786640 1 -- 172.21.15.115:0/3110217168 shutdown_connections 2024-09-13T16:59:07.696 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:07.694+0000 7f2a67786640 1 -- 172.21.15.115:0/3110217168 wait complete. 2024-09-13T16:59:08.259 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:08 smithi115 ceph-mon[27708]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:59:08.259 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:08 smithi115 ceph-mon[27708]: from='client.? 172.21.15.115:0/3110217168' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:59:08.259 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:08 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:08.259 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:08 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:08.259 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:08 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi115.hetcni", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T16:59:08.259 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:08 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T16:59:08.259 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:08 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:59:08.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:08 smithi195 ceph-mon[34981]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:59:08.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:08 smithi195 ceph-mon[34981]: from='client.? 172.21.15.115:0/3110217168' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:59:08.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:08 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:08.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:08 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:08.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:08 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi115.hetcni", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T16:59:08.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:08 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T16:59:08.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:08 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:59:08.673 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-13T16:59:08.673 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-13T16:59:08.673 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/etc/ceph/ceph.conf 2024-09-13T16:59:08.700 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-13T16:59:08.701 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-13T16:59:08.766 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-09-13T16:59:08.766 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/ceph/ceph.conf 2024-09-13T16:59:08.796 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-09-13T16:59:08.796 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-13T16:59:08.861 INFO:tasks.cephadm:Deploying OSDs... 2024-09-13T16:59:08.862 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-13T16:59:08.862 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T16:59:08.878 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T16:59:08.878 DEBUG:teuthology.orchestra.run.smithi115:> stat /dev/vg_nvme/lv_1 2024-09-13T16:59:08.934 INFO:teuthology.orchestra.run.smithi115.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T16:59:08.934 INFO:teuthology.orchestra.run.smithi115.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T16:59:08.934 INFO:teuthology.orchestra.run.smithi115.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-13T16:59:08.934 INFO:teuthology.orchestra.run.smithi115.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T16:59:08.934 INFO:teuthology.orchestra.run.smithi115.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T16:59:08.934 INFO:teuthology.orchestra.run.smithi115.stdout:Access: 2024-09-13 16:58:22.864174908 +0000 2024-09-13T16:59:08.934 INFO:teuthology.orchestra.run.smithi115.stdout:Modify: 2024-09-13 16:53:09.424065313 +0000 2024-09-13T16:59:08.934 INFO:teuthology.orchestra.run.smithi115.stdout:Change: 2024-09-13 16:53:09.424065313 +0000 2024-09-13T16:59:08.935 INFO:teuthology.orchestra.run.smithi115.stdout: Birth: 2024-09-13 16:53:09.424065313 +0000 2024-09-13T16:59:08.935 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T16:59:08.998 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2024-09-13T16:59:08.998 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2024-09-13T16:59:08.998 INFO:teuthology.orchestra.run.smithi115.stderr:512 bytes copied, 0.00021795 s, 2.3 MB/s 2024-09-13T16:59:09.000 DEBUG:teuthology.orchestra.run.smithi115:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T16:59:09.056 DEBUG:teuthology.orchestra.run.smithi115:> stat /dev/vg_nvme/lv_2 2024-09-13T16:59:09.111 INFO:teuthology.orchestra.run.smithi115.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T16:59:09.111 INFO:teuthology.orchestra.run.smithi115.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T16:59:09.112 INFO:teuthology.orchestra.run.smithi115.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-13T16:59:09.112 INFO:teuthology.orchestra.run.smithi115.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T16:59:09.112 INFO:teuthology.orchestra.run.smithi115.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T16:59:09.112 INFO:teuthology.orchestra.run.smithi115.stdout:Access: 2024-09-13 16:58:22.864174908 +0000 2024-09-13T16:59:09.112 INFO:teuthology.orchestra.run.smithi115.stdout:Modify: 2024-09-13 16:53:09.762059016 +0000 2024-09-13T16:59:09.112 INFO:teuthology.orchestra.run.smithi115.stdout:Change: 2024-09-13 16:53:09.762059016 +0000 2024-09-13T16:59:09.112 INFO:teuthology.orchestra.run.smithi115.stdout: Birth: 2024-09-13 16:53:09.762059016 +0000 2024-09-13T16:59:09.112 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T16:59:09.175 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2024-09-13T16:59:09.175 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2024-09-13T16:59:09.175 INFO:teuthology.orchestra.run.smithi115.stderr:512 bytes copied, 0.000198481 s, 2.6 MB/s 2024-09-13T16:59:09.176 DEBUG:teuthology.orchestra.run.smithi115:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T16:59:09.233 DEBUG:teuthology.orchestra.run.smithi115:> stat /dev/vg_nvme/lv_3 2024-09-13T16:59:09.289 INFO:teuthology.orchestra.run.smithi115.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T16:59:09.289 INFO:teuthology.orchestra.run.smithi115.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T16:59:09.289 INFO:teuthology.orchestra.run.smithi115.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-13T16:59:09.289 INFO:teuthology.orchestra.run.smithi115.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T16:59:09.289 INFO:teuthology.orchestra.run.smithi115.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T16:59:09.290 INFO:teuthology.orchestra.run.smithi115.stdout:Access: 2024-09-13 16:58:22.865174890 +0000 2024-09-13T16:59:09.290 INFO:teuthology.orchestra.run.smithi115.stdout:Modify: 2024-09-13 16:53:10.070053279 +0000 2024-09-13T16:59:09.290 INFO:teuthology.orchestra.run.smithi115.stdout:Change: 2024-09-13 16:53:10.070053279 +0000 2024-09-13T16:59:09.290 INFO:teuthology.orchestra.run.smithi115.stdout: Birth: 2024-09-13 16:53:10.070053279 +0000 2024-09-13T16:59:09.290 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T16:59:09.352 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2024-09-13T16:59:09.353 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2024-09-13T16:59:09.353 INFO:teuthology.orchestra.run.smithi115.stderr:512 bytes copied, 0.000225427 s, 2.3 MB/s 2024-09-13T16:59:09.354 DEBUG:teuthology.orchestra.run.smithi115:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T16:59:09.410 DEBUG:teuthology.orchestra.run.smithi115:> stat /dev/vg_nvme/lv_4 2024-09-13T16:59:09.465 INFO:teuthology.orchestra.run.smithi115.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T16:59:09.465 INFO:teuthology.orchestra.run.smithi115.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T16:59:09.465 INFO:teuthology.orchestra.run.smithi115.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-13T16:59:09.465 INFO:teuthology.orchestra.run.smithi115.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T16:59:09.465 INFO:teuthology.orchestra.run.smithi115.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T16:59:09.465 INFO:teuthology.orchestra.run.smithi115.stdout:Access: 2024-09-13 16:58:22.865174890 +0000 2024-09-13T16:59:09.465 INFO:teuthology.orchestra.run.smithi115.stdout:Modify: 2024-09-13 16:53:10.400047131 +0000 2024-09-13T16:59:09.465 INFO:teuthology.orchestra.run.smithi115.stdout:Change: 2024-09-13 16:53:10.400047131 +0000 2024-09-13T16:59:09.465 INFO:teuthology.orchestra.run.smithi115.stdout: Birth: 2024-09-13 16:53:10.400047131 +0000 2024-09-13T16:59:09.466 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T16:59:09.526 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:09 smithi115 ceph-mon[27708]: Reconfiguring mgr.smithi115.hetcni (unknown last config time)... 2024-09-13T16:59:09.526 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:09 smithi115 ceph-mon[27708]: Reconfiguring daemon mgr.smithi115.hetcni on smithi115 2024-09-13T16:59:09.528 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2024-09-13T16:59:09.528 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2024-09-13T16:59:09.528 INFO:teuthology.orchestra.run.smithi115.stderr:512 bytes copied, 0.000187754 s, 2.7 MB/s 2024-09-13T16:59:09.529 DEBUG:teuthology.orchestra.run.smithi115:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T16:59:09.576 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:09 smithi195 ceph-mon[34981]: Reconfiguring mgr.smithi115.hetcni (unknown last config time)... 2024-09-13T16:59:09.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:09 smithi195 ceph-mon[34981]: Reconfiguring daemon mgr.smithi115.hetcni on smithi115 2024-09-13T16:59:09.585 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-09-13T16:59:09.585 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T16:59:09.603 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T16:59:09.604 DEBUG:teuthology.orchestra.run.smithi195:> stat /dev/vg_nvme/lv_1 2024-09-13T16:59:09.661 INFO:teuthology.orchestra.run.smithi195.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T16:59:09.661 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T16:59:09.661 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-13T16:59:09.661 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T16:59:09.661 INFO:teuthology.orchestra.run.smithi195.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T16:59:09.661 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2024-09-13 16:58:56.163158459 +0000 2024-09-13T16:59:09.661 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2024-09-13 16:53:09.411011226 +0000 2024-09-13T16:59:09.661 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2024-09-13 16:53:09.411011226 +0000 2024-09-13T16:59:09.661 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: 2024-09-13 16:53:09.411011226 +0000 2024-09-13T16:59:09.662 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T16:59:09.727 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records in 2024-09-13T16:59:09.727 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records out 2024-09-13T16:59:09.727 INFO:teuthology.orchestra.run.smithi195.stderr:512 bytes copied, 0.000120801 s, 4.2 MB/s 2024-09-13T16:59:09.728 DEBUG:teuthology.orchestra.run.smithi195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T16:59:09.787 DEBUG:teuthology.orchestra.run.smithi195:> stat /dev/vg_nvme/lv_2 2024-09-13T16:59:09.844 INFO:teuthology.orchestra.run.smithi195.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T16:59:09.845 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T16:59:09.845 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-13T16:59:09.845 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T16:59:09.845 INFO:teuthology.orchestra.run.smithi195.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T16:59:09.845 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2024-09-13 16:58:56.163158459 +0000 2024-09-13T16:59:09.845 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2024-09-13 16:53:09.719005175 +0000 2024-09-13T16:59:09.845 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2024-09-13 16:53:09.719005175 +0000 2024-09-13T16:59:09.845 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: 2024-09-13 16:53:09.719005175 +0000 2024-09-13T16:59:09.845 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T16:59:09.911 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records in 2024-09-13T16:59:09.911 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records out 2024-09-13T16:59:09.911 INFO:teuthology.orchestra.run.smithi195.stderr:512 bytes copied, 0.00010002 s, 5.1 MB/s 2024-09-13T16:59:09.912 DEBUG:teuthology.orchestra.run.smithi195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T16:59:09.969 DEBUG:teuthology.orchestra.run.smithi195:> stat /dev/vg_nvme/lv_3 2024-09-13T16:59:10.026 INFO:teuthology.orchestra.run.smithi195.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T16:59:10.026 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T16:59:10.027 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-13T16:59:10.027 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T16:59:10.027 INFO:teuthology.orchestra.run.smithi195.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T16:59:10.027 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2024-09-13 16:58:56.164158439 +0000 2024-09-13T16:59:10.027 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2024-09-13 16:53:10.028999085 +0000 2024-09-13T16:59:10.027 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2024-09-13 16:53:10.028999085 +0000 2024-09-13T16:59:10.027 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: 2024-09-13 16:53:10.028999085 +0000 2024-09-13T16:59:10.027 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T16:59:10.090 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records in 2024-09-13T16:59:10.090 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records out 2024-09-13T16:59:10.090 INFO:teuthology.orchestra.run.smithi195.stderr:512 bytes copied, 9.5866e-05 s, 5.3 MB/s 2024-09-13T16:59:10.091 DEBUG:teuthology.orchestra.run.smithi195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T16:59:10.148 DEBUG:teuthology.orchestra.run.smithi195:> stat /dev/vg_nvme/lv_4 2024-09-13T16:59:10.204 INFO:teuthology.orchestra.run.smithi195.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T16:59:10.204 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T16:59:10.204 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-13T16:59:10.204 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T16:59:10.204 INFO:teuthology.orchestra.run.smithi195.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T16:59:10.204 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2024-09-13 16:58:56.164158439 +0000 2024-09-13T16:59:10.204 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2024-09-13 16:53:10.383992109 +0000 2024-09-13T16:59:10.204 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2024-09-13 16:53:10.383992109 +0000 2024-09-13T16:59:10.204 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: 2024-09-13 16:53:10.383992109 +0000 2024-09-13T16:59:10.205 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T16:59:10.268 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records in 2024-09-13T16:59:10.268 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records out 2024-09-13T16:59:10.268 INFO:teuthology.orchestra.run.smithi195.stderr:512 bytes copied, 9.3517e-05 s, 5.5 MB/s 2024-09-13T16:59:10.269 DEBUG:teuthology.orchestra.run.smithi195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T16:59:10.326 INFO:tasks.cephadm:Deploying osd.0 on smithi115 with /dev/vg_nvme/lv_4... 2024-09-13T16:59:10.326 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-09-13T16:59:10.421 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:10 smithi195 ceph-mon[34981]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:59:10.421 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:10 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:10.421 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:10 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:10.421 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:10 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi115", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T16:59:10.421 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:10 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:59:10.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:10 smithi115 ceph-mon[27708]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:59:10.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:10 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:10.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:10 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:10.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:10 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi115", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T16:59:10.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:10 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:59:11.186 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T16:59:11.412 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:11 smithi115 ceph-mon[27708]: Reconfiguring ceph-exporter.smithi115 (monmap changed)... 2024-09-13T16:59:11.412 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:11 smithi115 ceph-mon[27708]: Reconfiguring daemon ceph-exporter.smithi115 on smithi115 2024-09-13T16:59:11.413 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:11 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:11.413 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:11 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:11.413 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:11 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi115", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T16:59:11.413 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:11 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:59:11.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:11 smithi195 ceph-mon[34981]: Reconfiguring ceph-exporter.smithi115 (monmap changed)... 2024-09-13T16:59:11.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:11 smithi195 ceph-mon[34981]: Reconfiguring daemon ceph-exporter.smithi115 on smithi115 2024-09-13T16:59:11.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:11 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:11.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:11 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:11.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:11 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi115", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T16:59:11.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:11 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:59:12.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:12 smithi195 ceph-mon[34981]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:59:12.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:12 smithi195 ceph-mon[34981]: Reconfiguring crash.smithi115 (monmap changed)... 2024-09-13T16:59:12.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:12 smithi195 ceph-mon[34981]: Reconfiguring daemon crash.smithi115 on smithi115 2024-09-13T16:59:12.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:12 smithi115 ceph-mon[27708]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:59:12.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:12 smithi115 ceph-mon[27708]: Reconfiguring crash.smithi115 (monmap changed)... 2024-09-13T16:59:12.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:12 smithi115 ceph-mon[27708]: Reconfiguring daemon crash.smithi115 on smithi115 2024-09-13T16:59:13.525 INFO:teuthology.orchestra.run.smithi115.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-09-13T16:59:13.603 INFO:teuthology.orchestra.run.smithi115.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-09-13T16:59:13.616 INFO:teuthology.orchestra.run.smithi115.stderr: stderr: 10+0 records in 2024-09-13T16:59:13.617 INFO:teuthology.orchestra.run.smithi115.stderr:10+0 records out 2024-09-13T16:59:13.617 INFO:teuthology.orchestra.run.smithi115.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0115512 s, 908 MB/s 2024-09-13T16:59:13.617 INFO:teuthology.orchestra.run.smithi115.stderr:--> Zapping successful for: 2024-09-13T16:59:14.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:14 smithi115 ceph-mon[27708]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:59:14.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:14 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:14.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:14 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:14.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:14 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T16:59:14.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:14 smithi195 ceph-mon[34981]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:59:14.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:14 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:14.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:14 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:14.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:14 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T16:59:15.278 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:15 smithi115 ceph-mon[27708]: Reconfiguring alertmanager.smithi115 (dependencies changed)... 2024-09-13T16:59:15.278 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:15 smithi115 ceph-mon[27708]: Reconfiguring daemon alertmanager.smithi115 on smithi115 2024-09-13T16:59:15.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:15 smithi195 ceph-mon[34981]: Reconfiguring alertmanager.smithi115 (dependencies changed)... 2024-09-13T16:59:15.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:15 smithi195 ceph-mon[34981]: Reconfiguring daemon alertmanager.smithi115 on smithi115 2024-09-13T16:59:16.402 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:16 smithi115 ceph-mon[27708]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:59:16.426 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi115:vg_nvme/lv_4 2024-09-13T16:59:16.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:16 smithi195 ceph-mon[34981]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:59:16.962 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T16:59:18.323 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:18 smithi115 ceph-mon[27708]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:59:18.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:18 smithi195 ceph-mon[34981]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:59:19.444 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:19.441+0000 7f84f4d09640 1 -- 172.21.15.115:0/3410226987 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84f0102f40 msgr2=0x7f84f0105330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:59:19.444 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:19.441+0000 7f84f4d09640 1 --2- 172.21.15.115:0/3410226987 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84f0102f40 0x7f84f0105330 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f84e40098b0 tx=0x7f84e402a4d0 comp rx=0 tx=0).stop 2024-09-13T16:59:19.444 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:19.441+0000 7f84f4d09640 1 -- 172.21.15.115:0/3410226987 shutdown_connections 2024-09-13T16:59:19.445 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:19.441+0000 7f84f4d09640 1 --2- 172.21.15.115:0/3410226987 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84f0102f40 0x7f84f0105330 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:19.445 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:19.441+0000 7f84f4d09640 1 --2- 172.21.15.115:0/3410226987 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f84f0100610 0x7f84f0102a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:19.445 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:19.441+0000 7f84f4d09640 1 -- 172.21.15.115:0/3410226987 >> 172.21.15.115:0/3410226987 conn(0x7f84f00fa230 msgr2=0x7f84f00fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:59:19.445 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:19.441+0000 7f84f4d09640 1 -- 172.21.15.115:0/3410226987 shutdown_connections 2024-09-13T16:59:19.445 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:19.441+0000 7f84f4d09640 1 -- 172.21.15.115:0/3410226987 wait complete. 2024-09-13T16:59:19.445 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:19.442+0000 7f84f4d09640 1 Processor -- start 2024-09-13T16:59:19.445 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:19.442+0000 7f84f4d09640 1 -- start start 2024-09-13T16:59:19.445 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:19.443+0000 7f84f4d09640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84f0100610 0x7f84f0195660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:59:19.445 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:19.443+0000 7f84f4d09640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f84f0102f40 0x7f84f0195ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:59:19.445 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:19.443+0000 7f84f4d09640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84f0196170 con 0x7f84f0100610 2024-09-13T16:59:19.446 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:19.443+0000 7f84f4d09640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84f01962e0 con 0x7f84f0102f40 2024-09-13T16:59:19.446 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:19.443+0000 7f84ee59c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84f0100610 0x7f84f0195660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:59:19.446 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:19.443+0000 7f84ee59c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84f0100610 0x7f84f0195660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:42850/0 (socket says 172.21.15.115:42850) 2024-09-13T16:59:19.446 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:19.443+0000 7f84ee59c640 1 -- 172.21.15.115:0/2058736407 learned_addr learned my addr 172.21.15.115:0/2058736407 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T16:59:19.446 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:19.443+0000 7f84edd9b640 1 --2- 172.21.15.115:0/2058736407 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f84f0102f40 0x7f84f0195ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:59:19.446 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:19.443+0000 7f84ee59c640 1 -- 172.21.15.115:0/2058736407 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f84f0102f40 msgr2=0x7f84f0195ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:59:19.446 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:19.443+0000 7f84ee59c640 1 --2- 172.21.15.115:0/2058736407 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f84f0102f40 0x7f84f0195ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:19.446 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:19.443+0000 7f84ee59c640 1 -- 172.21.15.115:0/2058736407 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84e4009560 con 0x7f84f0100610 2024-09-13T16:59:19.448 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:19.443+0000 7f84ee59c640 1 --2- 172.21.15.115:0/2058736407 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84f0100610 0x7f84f0195660 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f84e000b450 tx=0x7f84e000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:59:19.448 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:19.443+0000 7f84df7fe640 1 -- 172.21.15.115:0/2058736407 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84e0011860 con 0x7f84f0100610 2024-09-13T16:59:19.448 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:19.443+0000 7f84f4d09640 1 -- 172.21.15.115:0/2058736407 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84f019ad80 con 0x7f84f0100610 2024-09-13T16:59:19.448 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:19.443+0000 7f84df7fe640 1 -- 172.21.15.115:0/2058736407 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f84e0011e60 con 0x7f84f0100610 2024-09-13T16:59:19.448 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:19.444+0000 7f84df7fe640 1 -- 172.21.15.115:0/2058736407 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84e000f340 con 0x7f84f0100610 2024-09-13T16:59:19.448 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:19.444+0000 7f84f4d09640 1 -- 172.21.15.115:0/2058736407 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84f019b2c0 con 0x7f84f0100610 2024-09-13T16:59:19.448 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:19.445+0000 7f84f4d09640 1 -- 172.21.15.115:0/2058736407 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84f0100a70 con 0x7f84f0100610 2024-09-13T16:59:19.448 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:19.445+0000 7f84df7fe640 1 -- 172.21.15.115:0/2058736407 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 18) v1 ==== 90796+0+0 (secure 0 0 0) 0x7f84e00103e0 con 0x7f84f0100610 2024-09-13T16:59:19.448 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:19.446+0000 7f84df7fe640 1 --2- 172.21.15.115:0/2058736407 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f84d806cbc0 0x7f84d806f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:59:19.448 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:19.446+0000 7f84df7fe640 1 -- 172.21.15.115:0/2058736407 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f84e008b040 con 0x7f84f0100610 2024-09-13T16:59:19.449 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:19.446+0000 7f84edd9b640 1 --2- 172.21.15.115:0/2058736407 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f84d806cbc0 0x7f84d806f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:59:19.449 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:19.446+0000 7f84edd9b640 1 --2- 172.21.15.115:0/2058736407 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f84d806cbc0 0x7f84d806f080 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f84e4006010 tx=0x7f84e4031420 comp rx=0 tx=0).ready entity=mgr.14207 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:59:19.451 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:19.450+0000 7f84df7fe640 1 -- 172.21.15.115:0/2058736407 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f84e00564f0 con 0x7f84f0100610 2024-09-13T16:59:19.626 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:19.625+0000 7f84f4d09640 1 -- 172.21.15.115:0/2058736407 --> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi115:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f84f01039c0 con 0x7f84d806cbc0 2024-09-13T16:59:20.274 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:20 smithi115 ceph-mon[27708]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:59:20.274 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:20 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T16:59:20.274 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:20 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T16:59:20.274 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:20 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:59:20.274 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:20 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:20.274 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:20 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:20.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:20 smithi195 ceph-mon[34981]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:59:20.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:20 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T16:59:20.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:20 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T16:59:20.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:20 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:59:20.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:20 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:20.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:20 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:21.370 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:21 smithi115 ceph-mon[27708]: from='client.14242 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi115:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:59:21.370 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:21 smithi115 ceph-mon[27708]: Reconfiguring grafana.smithi115 (dependencies changed)... 2024-09-13T16:59:21.370 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:21 smithi115 ceph-mon[27708]: Reconfiguring daemon grafana.smithi115 on smithi115 2024-09-13T16:59:21.576 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:21 smithi195 ceph-mon[34981]: from='client.14242 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi115:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:59:21.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:21 smithi195 ceph-mon[34981]: Reconfiguring grafana.smithi115 (dependencies changed)... 2024-09-13T16:59:21.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:21 smithi195 ceph-mon[34981]: Reconfiguring daemon grafana.smithi115 on smithi115 2024-09-13T16:59:22.351 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:22 smithi115 ceph-mon[27708]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:59:22.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:22 smithi195 ceph-mon[34981]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:59:24.569 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:24 smithi115 ceph-mon[27708]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:59:24.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:24 smithi195 ceph-mon[34981]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:59:26.477 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:26 smithi115 ceph-mon[27708]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:59:26.477 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:26 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:26.477 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:26 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:26.477 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:26 smithi115 ceph-mon[27708]: Reconfiguring prometheus.smithi115 (dependencies changed)... 2024-09-13T16:59:26.477 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:26 smithi115 ceph-mon[27708]: from='client.? 172.21.15.115:0/3535789569' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9fb96264-a71d-43b2-8d65-b4280a8ad8ee"}]: dispatch 2024-09-13T16:59:26.477 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:26 smithi115 ceph-mon[27708]: from='client.? 172.21.15.115:0/3535789569' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9fb96264-a71d-43b2-8d65-b4280a8ad8ee"}]': finished 2024-09-13T16:59:26.477 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:26 smithi115 ceph-mon[27708]: osdmap e6: 1 total, 0 up, 1 in 2024-09-13T16:59:26.477 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:26 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T16:59:26.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:26 smithi195 ceph-mon[34981]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:59:26.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:26 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:26.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:26 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:26.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:26 smithi195 ceph-mon[34981]: Reconfiguring prometheus.smithi115 (dependencies changed)... 2024-09-13T16:59:26.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:26 smithi195 ceph-mon[34981]: from='client.? 172.21.15.115:0/3535789569' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9fb96264-a71d-43b2-8d65-b4280a8ad8ee"}]: dispatch 2024-09-13T16:59:26.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:26 smithi195 ceph-mon[34981]: from='client.? 172.21.15.115:0/3535789569' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9fb96264-a71d-43b2-8d65-b4280a8ad8ee"}]': finished 2024-09-13T16:59:26.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:26 smithi195 ceph-mon[34981]: osdmap e6: 1 total, 0 up, 1 in 2024-09-13T16:59:26.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:26 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T16:59:27.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:27 smithi195 ceph-mon[34981]: Reconfiguring daemon prometheus.smithi115 on smithi115 2024-09-13T16:59:27.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:27 smithi195 ceph-mon[34981]: from='client.? 172.21.15.115:0/3333541374' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T16:59:27.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:27 smithi115 ceph-mon[27708]: Reconfiguring daemon prometheus.smithi115 on smithi115 2024-09-13T16:59:27.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:27 smithi115 ceph-mon[27708]: from='client.? 172.21.15.115:0/3333541374' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T16:59:28.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:28 smithi195 ceph-mon[34981]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:59:28.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:28 smithi115 ceph-mon[27708]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:59:29.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:29 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T16:59:29.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:29 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T16:59:30.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:30 smithi195 ceph-mon[34981]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:59:30.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:30 smithi115 ceph-mon[27708]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:59:32.428 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:32 smithi115 ceph-mon[27708]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:59:32.576 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:32 smithi195 ceph-mon[34981]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:59:34.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:34 smithi195 ceph-mon[34981]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:59:34.611 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:34 smithi115 ceph-mon[27708]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:59:36.555 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:36 smithi115 ceph-mon[27708]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:59:36.555 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:36 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:36.555 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:36 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:36.555 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:36 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi195", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T16:59:36.555 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:36 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:59:36.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:36 smithi195 ceph-mon[34981]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:59:36.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:36 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:36.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:36 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:36.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:36 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi195", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T16:59:36.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:36 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:59:37.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:37 smithi115 ceph-mon[27708]: Reconfiguring ceph-exporter.smithi195 (monmap changed)... 2024-09-13T16:59:37.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:37 smithi115 ceph-mon[27708]: Reconfiguring daemon ceph-exporter.smithi195 on smithi195 2024-09-13T16:59:37.718 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:37 smithi195 ceph-mon[34981]: Reconfiguring ceph-exporter.smithi195 (monmap changed)... 2024-09-13T16:59:37.719 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:37 smithi195 ceph-mon[34981]: Reconfiguring daemon ceph-exporter.smithi195 on smithi195 2024-09-13T16:59:38.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:38 smithi115 ceph-mon[27708]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:59:38.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:38 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:38.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:38 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:38.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:38 smithi115 ceph-mon[27708]: Reconfiguring crash.smithi195 (monmap changed)... 2024-09-13T16:59:38.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:38 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi195", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T16:59:38.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:38 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:59:38.680 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:38 smithi115 ceph-mon[27708]: Reconfiguring daemon crash.smithi195 on smithi195 2024-09-13T16:59:38.680 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:38 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-13T16:59:38.680 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:38 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:59:38.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:38 smithi195 ceph-mon[34981]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:59:38.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:38 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:38.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:38 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:38.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:38 smithi195 ceph-mon[34981]: Reconfiguring crash.smithi195 (monmap changed)... 2024-09-13T16:59:38.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:38 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi195", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T16:59:38.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:38 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:59:38.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:38 smithi195 ceph-mon[34981]: Reconfiguring daemon crash.smithi195 on smithi195 2024-09-13T16:59:38.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:38 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-13T16:59:38.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:38 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:59:39.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:39 smithi115 ceph-mon[27708]: Deploying daemon osd.0 on smithi115 2024-09-13T16:59:39.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:39 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:39.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:39 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:39.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:39 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi195.hjjifz", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T16:59:39.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:39 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T16:59:39.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:39 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:59:39.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:39 smithi195 ceph-mon[34981]: Deploying daemon osd.0 on smithi115 2024-09-13T16:59:39.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:39 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:39.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:39 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:39.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:39 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi195.hjjifz", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T16:59:39.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:39 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T16:59:39.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:39 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:59:40.458 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:40 smithi195 ceph-mon[34981]: Reconfiguring mgr.smithi195.hjjifz (monmap changed)... 2024-09-13T16:59:40.459 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:40 smithi195 ceph-mon[34981]: Reconfiguring daemon mgr.smithi195.hjjifz on smithi195 2024-09-13T16:59:40.459 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:40 smithi195 ceph-mon[34981]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:59:40.459 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:40 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:40.459 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:40 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:40.459 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:40 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T16:59:40.459 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:40 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T16:59:40.459 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:40 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:59:40.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:40 smithi115 ceph-mon[27708]: Reconfiguring mgr.smithi195.hjjifz (monmap changed)... 2024-09-13T16:59:40.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:40 smithi115 ceph-mon[27708]: Reconfiguring daemon mgr.smithi195.hjjifz on smithi195 2024-09-13T16:59:40.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:40 smithi115 ceph-mon[27708]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:59:40.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:40 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:40.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:40 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:40.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:40 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T16:59:40.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:40 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T16:59:40.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:40 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:59:41.663 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:41 smithi195 ceph-mon[34981]: Reconfiguring mon.smithi195 (monmap changed)... 2024-09-13T16:59:41.663 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:41 smithi195 ceph-mon[34981]: Reconfiguring daemon mon.smithi195 on smithi195 2024-09-13T16:59:41.664 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:41 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:41.664 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:41 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:41.664 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:41 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-13T16:59:41.664 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:41 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi115.front.sepia.ceph.com:9093"}]: dispatch 2024-09-13T16:59:41.664 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:41 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:41.664 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:41 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T16:59:41.664 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:41 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi115.front.sepia.ceph.com:3000"}]: dispatch 2024-09-13T16:59:41.664 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:41 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:41.664 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:41 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T16:59:41.664 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:41 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi115.front.sepia.ceph.com:9095"}]: dispatch 2024-09-13T16:59:41.664 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:41 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:41.664 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:41 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:59:41.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:41 smithi115 ceph-mon[27708]: Reconfiguring mon.smithi195 (monmap changed)... 2024-09-13T16:59:41.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:41 smithi115 ceph-mon[27708]: Reconfiguring daemon mon.smithi195 on smithi195 2024-09-13T16:59:41.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:41 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:41.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:41 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:41.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:41 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-13T16:59:41.680 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:41 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi115.front.sepia.ceph.com:9093"}]: dispatch 2024-09-13T16:59:41.680 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:41 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:41.680 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:41 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T16:59:41.680 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:41 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi115.front.sepia.ceph.com:3000"}]: dispatch 2024-09-13T16:59:41.680 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:41 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:41.680 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:41 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T16:59:41.680 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:41 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi115.front.sepia.ceph.com:9095"}]: dispatch 2024-09-13T16:59:41.680 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:41 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:41.680 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:41 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:59:42.624 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:42 smithi115 ceph-mon[27708]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-13T16:59:42.624 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:42 smithi115 ceph-mon[27708]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi115.front.sepia.ceph.com:9093"}]: dispatch 2024-09-13T16:59:42.625 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:42 smithi115 ceph-mon[27708]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T16:59:42.625 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:42 smithi115 ceph-mon[27708]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi115.front.sepia.ceph.com:3000"}]: dispatch 2024-09-13T16:59:42.625 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:42 smithi115 ceph-mon[27708]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T16:59:42.625 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:42 smithi115 ceph-mon[27708]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi115.front.sepia.ceph.com:9095"}]: dispatch 2024-09-13T16:59:42.625 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:42 smithi115 ceph-mon[27708]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:59:42.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:42 smithi195 ceph-mon[34981]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-13T16:59:42.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:42 smithi195 ceph-mon[34981]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi115.front.sepia.ceph.com:9093"}]: dispatch 2024-09-13T16:59:42.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:42 smithi195 ceph-mon[34981]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T16:59:42.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:42 smithi195 ceph-mon[34981]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi115.front.sepia.ceph.com:3000"}]: dispatch 2024-09-13T16:59:42.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:42 smithi195 ceph-mon[34981]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T16:59:42.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:42 smithi195 ceph-mon[34981]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi115.front.sepia.ceph.com:9095"}]: dispatch 2024-09-13T16:59:42.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:42 smithi195 ceph-mon[34981]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:59:44.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:43 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:44.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:43 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:44.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:43 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:44.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:43 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:44.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:43 smithi195 ceph-mon[34981]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:59:44.126 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:43 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:44.126 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:43 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:44.126 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:43 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:44.126 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:43 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:44.126 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:43 smithi115 ceph-mon[27708]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:59:45.178 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:44 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T16:59:45.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:44 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T16:59:46.121 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:45 smithi115 ceph-mon[27708]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:59:46.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:45 smithi195 ceph-mon[34981]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:59:46.928 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:46 smithi115 ceph-mon[27708]: from='osd.0 [v2:172.21.15.115:6802/2697967112,v1:172.21.15.115:6803/2697967112]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-13T16:59:47.296 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:46 smithi195 ceph-mon[34981]: from='osd.0 [v2:172.21.15.115:6802/2697967112,v1:172.21.15.115:6803/2697967112]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-13T16:59:48.031 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:47 smithi115 ceph-mon[27708]: from='osd.0 [v2:172.21.15.115:6802/2697967112,v1:172.21.15.115:6803/2697967112]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-13T16:59:48.031 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:47 smithi115 ceph-mon[27708]: osdmap e7: 1 total, 0 up, 1 in 2024-09-13T16:59:48.031 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:47 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T16:59:48.031 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:47 smithi115 ceph-mon[27708]: from='osd.0 [v2:172.21.15.115:6802/2697967112,v1:172.21.15.115:6803/2697967112]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-13T16:59:48.031 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:47 smithi115 ceph-mon[27708]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:59:48.064 INFO:teuthology.orchestra.run.smithi115.stdout:Created osd(s) 0 on host 'smithi115' 2024-09-13T16:59:48.064 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:48.062+0000 7f84df7fe640 1 -- 172.21.15.115:0/2058736407 <== mgr.14207 v2:172.21.15.115:6800/244039928 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f84f01039c0 con 0x7f84d806cbc0 2024-09-13T16:59:48.066 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:48.064+0000 7f84f4d09640 1 -- 172.21.15.115:0/2058736407 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f84d806cbc0 msgr2=0x7f84d806f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:59:48.067 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:48.064+0000 7f84f4d09640 1 --2- 172.21.15.115:0/2058736407 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f84d806cbc0 0x7f84d806f080 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f84e4006010 tx=0x7f84e4031420 comp rx=0 tx=0).stop 2024-09-13T16:59:48.067 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:48.064+0000 7f84f4d09640 1 -- 172.21.15.115:0/2058736407 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84f0100610 msgr2=0x7f84f0195660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:59:48.067 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:48.064+0000 7f84f4d09640 1 --2- 172.21.15.115:0/2058736407 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84f0100610 0x7f84f0195660 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f84e000b450 tx=0x7f84e000b910 comp rx=0 tx=0).stop 2024-09-13T16:59:48.067 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:48.064+0000 7f84f4d09640 1 -- 172.21.15.115:0/2058736407 shutdown_connections 2024-09-13T16:59:48.067 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:48.064+0000 7f84f4d09640 1 --2- 172.21.15.115:0/2058736407 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f84d806cbc0 0x7f84d806f080 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:48.067 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:48.064+0000 7f84f4d09640 1 --2- 172.21.15.115:0/2058736407 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f84f0102f40 0x7f84f0195ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:48.067 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:48.064+0000 7f84f4d09640 1 --2- 172.21.15.115:0/2058736407 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84f0100610 0x7f84f0195660 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:48.067 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:48.064+0000 7f84f4d09640 1 -- 172.21.15.115:0/2058736407 >> 172.21.15.115:0/2058736407 conn(0x7f84f00fa230 msgr2=0x7f84f00fc620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:59:48.067 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:48.064+0000 7f84f4d09640 1 -- 172.21.15.115:0/2058736407 shutdown_connections 2024-09-13T16:59:48.067 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:48.064+0000 7f84f4d09640 1 -- 172.21.15.115:0/2058736407 wait complete. 2024-09-13T16:59:48.328 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:47 smithi195 ceph-mon[34981]: from='osd.0 [v2:172.21.15.115:6802/2697967112,v1:172.21.15.115:6803/2697967112]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-13T16:59:48.328 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:47 smithi195 ceph-mon[34981]: osdmap e7: 1 total, 0 up, 1 in 2024-09-13T16:59:48.328 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:47 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T16:59:48.328 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:47 smithi195 ceph-mon[34981]: from='osd.0 [v2:172.21.15.115:6802/2697967112,v1:172.21.15.115:6803/2697967112]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-13T16:59:48.328 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:47 smithi195 ceph-mon[34981]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:59:48.675 DEBUG:teuthology.orchestra.run.smithi115:osd.0> sudo journalctl -f -n 0 -u ceph-ffbd7588-71f0-11ef-bceb-c7b262605968@osd.0.service 2024-09-13T16:59:48.677 INFO:tasks.cephadm:Deploying osd.1 on smithi115 with /dev/vg_nvme/lv_3... 2024-09-13T16:59:48.677 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-09-13T16:59:48.919 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T16:59:49.178 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:48 smithi115 ceph-mon[27708]: from='osd.0 [v2:172.21.15.115:6802/2697967112,v1:172.21.15.115:6803/2697967112]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]': finished 2024-09-13T16:59:49.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:48 smithi115 ceph-mon[27708]: osdmap e8: 1 total, 0 up, 1 in 2024-09-13T16:59:49.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:48 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T16:59:49.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:48 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T16:59:49.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:48 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:49.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:48 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:49.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:48 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:49.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:48 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:49.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:48 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T16:59:49.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:48 smithi195 ceph-mon[34981]: from='osd.0 [v2:172.21.15.115:6802/2697967112,v1:172.21.15.115:6803/2697967112]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]': finished 2024-09-13T16:59:49.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:48 smithi195 ceph-mon[34981]: osdmap e8: 1 total, 0 up, 1 in 2024-09-13T16:59:49.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:48 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T16:59:49.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:48 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T16:59:49.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:48 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:49.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:48 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:49.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:48 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:49.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:48 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:49.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:48 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T16:59:50.178 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:49 smithi115 ceph-mon[27708]: purged_snaps scrub starts 2024-09-13T16:59:50.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:49 smithi115 ceph-mon[27708]: purged_snaps scrub ok 2024-09-13T16:59:50.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:49 smithi115 ceph-mon[27708]: osd.0 [v2:172.21.15.115:6802/2697967112,v1:172.21.15.115:6803/2697967112] boot 2024-09-13T16:59:50.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:49 smithi115 ceph-mon[27708]: osdmap e9: 1 total, 1 up, 1 in 2024-09-13T16:59:50.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:49 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T16:59:50.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:49 smithi115 ceph-mon[27708]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:59:50.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:49 smithi195 ceph-mon[34981]: purged_snaps scrub starts 2024-09-13T16:59:50.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:49 smithi195 ceph-mon[34981]: purged_snaps scrub ok 2024-09-13T16:59:50.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:49 smithi195 ceph-mon[34981]: osd.0 [v2:172.21.15.115:6802/2697967112,v1:172.21.15.115:6803/2697967112] boot 2024-09-13T16:59:50.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:49 smithi195 ceph-mon[34981]: osdmap e9: 1 total, 1 up, 1 in 2024-09-13T16:59:50.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:49 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T16:59:50.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:49 smithi195 ceph-mon[34981]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T16:59:50.652 INFO:teuthology.orchestra.run.smithi115.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-09-13T16:59:50.746 INFO:teuthology.orchestra.run.smithi115.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-09-13T16:59:50.763 INFO:teuthology.orchestra.run.smithi115.stderr: stderr: 10+0 records in 2024-09-13T16:59:50.763 INFO:teuthology.orchestra.run.smithi115.stderr:10+0 records out 2024-09-13T16:59:50.763 INFO:teuthology.orchestra.run.smithi115.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.014244 s, 736 MB/s 2024-09-13T16:59:50.763 INFO:teuthology.orchestra.run.smithi115.stderr:--> Zapping successful for: 2024-09-13T16:59:51.231 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:50 smithi115 ceph-mon[27708]: osdmap e10: 1 total, 1 up, 1 in 2024-09-13T16:59:51.326 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:50 smithi195 ceph-mon[34981]: osdmap e10: 1 total, 1 up, 1 in 2024-09-13T16:59:51.823 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi115:vg_nvme/lv_3 2024-09-13T16:59:52.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:51 smithi115 ceph-mon[27708]: pgmap v39: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T16:59:52.326 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:51 smithi195 ceph-mon[34981]: pgmap v39: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T16:59:52.798 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T16:59:54.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:54 smithi195 ceph-mon[34981]: pgmap v40: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T16:59:54.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:54 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:54.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:54 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:54.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:54 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:59:54.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:54 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:54.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:54 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:59:54.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:54 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:59:54.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:54 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:54.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:54 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:59:54.637 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:54 smithi115 ceph-mon[27708]: pgmap v40: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T16:59:54.637 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:54 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:54.637 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:54 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:54.638 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:54 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:59:54.638 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:54 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:54.638 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:54 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:59:54.638 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:54 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:59:54.638 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:54 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:54.638 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:54 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:59:54.952 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:54.945+0000 7fcca0649640 1 -- 172.21.15.115:0/4088755814 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc980ffca0 msgr2=0x7fcc98100120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:59:54.952 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:54.945+0000 7fcca0649640 1 --2- 172.21.15.115:0/4088755814 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc980ffca0 0x7fcc98100120 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcc88009880 tx=0x7fcc8802a4a0 comp rx=0 tx=0).stop 2024-09-13T16:59:54.952 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:54.945+0000 7fcca0649640 1 -- 172.21.15.115:0/4088755814 shutdown_connections 2024-09-13T16:59:54.952 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:54.945+0000 7fcca0649640 1 --2- 172.21.15.115:0/4088755814 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc980ffca0 0x7fcc98100120 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:54.952 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:54.945+0000 7fcca0649640 1 --2- 172.21.15.115:0/4088755814 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc980feaa0 0x7fcc980feea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:54.952 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:54.945+0000 7fcca0649640 1 -- 172.21.15.115:0/4088755814 >> 172.21.15.115:0/4088755814 conn(0x7fcc980fa230 msgr2=0x7fcc980fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:59:54.952 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:54.945+0000 7fcca0649640 1 -- 172.21.15.115:0/4088755814 shutdown_connections 2024-09-13T16:59:54.952 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:54.945+0000 7fcca0649640 1 -- 172.21.15.115:0/4088755814 wait complete. 2024-09-13T16:59:54.953 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:54.946+0000 7fcca0649640 1 Processor -- start 2024-09-13T16:59:54.953 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:54.946+0000 7fcca0649640 1 -- start start 2024-09-13T16:59:54.953 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:54.946+0000 7fcca0649640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc980feaa0 0x7fcc98197740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:59:54.953 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:54.946+0000 7fcca0649640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc980ffca0 0x7fcc98197c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:59:54.953 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:54.946+0000 7fcca0649640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc981981c0 con 0x7fcc980feaa0 2024-09-13T16:59:54.953 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:54.946+0000 7fcca0649640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc98198330 con 0x7fcc980ffca0 2024-09-13T16:59:54.953 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:54.946+0000 7fcc9e3e5640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc980feaa0 0x7fcc98197740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:59:54.953 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:54.946+0000 7fcc9e3e5640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc980feaa0 0x7fcc98197740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:40812/0 (socket says 172.21.15.115:40812) 2024-09-13T16:59:54.953 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:54.946+0000 7fcc9e3e5640 1 -- 172.21.15.115:0/267576886 learned_addr learned my addr 172.21.15.115:0/267576886 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T16:59:54.953 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:54.946+0000 7fcc9dbe4640 1 --2- 172.21.15.115:0/267576886 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc980ffca0 0x7fcc98197c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:59:54.953 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:54.946+0000 7fcc9e3e5640 1 -- 172.21.15.115:0/267576886 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc980ffca0 msgr2=0x7fcc98197c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:59:54.954 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:54.946+0000 7fcc9e3e5640 1 --2- 172.21.15.115:0/267576886 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc980ffca0 0x7fcc98197c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:59:54.954 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:54.946+0000 7fcc9e3e5640 1 -- 172.21.15.115:0/267576886 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc88009560 con 0x7fcc980feaa0 2024-09-13T16:59:54.954 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:54.946+0000 7fcc9e3e5640 1 --2- 172.21.15.115:0/267576886 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc980feaa0 0x7fcc98197740 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fcc9400c8f0 tx=0x7fcc9400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:59:54.954 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:54.946+0000 7fcc8f7fe640 1 -- 172.21.15.115:0/267576886 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc940041f0 con 0x7fcc980feaa0 2024-09-13T16:59:54.954 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:54.946+0000 7fcca0649640 1 -- 172.21.15.115:0/267576886 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc9819ce10 con 0x7fcc980feaa0 2024-09-13T16:59:54.954 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:54.947+0000 7fcc8f7fe640 1 -- 172.21.15.115:0/267576886 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcc94007df0 con 0x7fcc980feaa0 2024-09-13T16:59:54.954 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:54.947+0000 7fcc8f7fe640 1 -- 172.21.15.115:0/267576886 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc9400f450 con 0x7fcc980feaa0 2024-09-13T16:59:54.954 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:54.947+0000 7fcca0649640 1 -- 172.21.15.115:0/267576886 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc9819d300 con 0x7fcc980feaa0 2024-09-13T16:59:54.954 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:54.948+0000 7fcca0649640 1 -- 172.21.15.115:0/267576886 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc9810a850 con 0x7fcc980feaa0 2024-09-13T16:59:54.954 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:54.948+0000 7fcc8f7fe640 1 -- 172.21.15.115:0/267576886 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 18) v1 ==== 90796+0+0 (secure 0 0 0) 0x7fcc94007950 con 0x7fcc980feaa0 2024-09-13T16:59:54.954 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:54.948+0000 7fcc8f7fe640 1 --2- 172.21.15.115:0/267576886 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fcc8406cbd0 0x7fcc8406f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:59:54.954 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:54.949+0000 7fcc9dbe4640 1 --2- 172.21.15.115:0/267576886 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fcc8406cbd0 0x7fcc8406f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:59:54.954 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:54.949+0000 7fcc8f7fe640 1 -- 172.21.15.115:0/267576886 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1982+0+0 (secure 0 0 0) 0x7fcc94013070 con 0x7fcc980feaa0 2024-09-13T16:59:54.955 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:54.949+0000 7fcc9dbe4640 1 --2- 172.21.15.115:0/267576886 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fcc8406cbd0 0x7fcc8406f090 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fcc98198c60 tx=0x7fcc88031400 comp rx=0 tx=0).ready entity=mgr.14207 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:59:54.955 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:54.953+0000 7fcc8f7fe640 1 -- 172.21.15.115:0/267576886 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fcc940566a0 con 0x7fcc980feaa0 2024-09-13T16:59:55.159 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T16:59:55.158+0000 7fcca0649640 1 -- 172.21.15.115:0/267576886 --> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi115:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fcc981045f0 con 0x7fcc8406cbd0 2024-09-13T16:59:55.500 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:55 smithi115 ceph-mon[27708]: Detected new or changed devices on smithi115 2024-09-13T16:59:55.501 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:55 smithi115 ceph-mon[27708]: Adjusting osd_memory_target on smithi115 to 11840M 2024-09-13T16:59:55.501 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:55 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T16:59:55.501 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:55 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T16:59:55.501 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:55 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:59:55.510 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:55 smithi195 ceph-mon[34981]: Detected new or changed devices on smithi115 2024-09-13T16:59:55.510 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:55 smithi195 ceph-mon[34981]: Adjusting osd_memory_target on smithi115 to 11840M 2024-09-13T16:59:55.510 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:55 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T16:59:55.510 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:55 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T16:59:55.510 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:55 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:59:56.425 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:56 smithi115 ceph-mon[27708]: from='client.14260 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi115:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:59:56.425 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:56 smithi115 ceph-mon[27708]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T16:59:56.425 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:56 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:56.425 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:56 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:56.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:56 smithi195 ceph-mon[34981]: from='client.14260 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi115:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T16:59:56.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:56 smithi195 ceph-mon[34981]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T16:59:56.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:56 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:56.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:56 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T16:59:58.527 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:58 smithi115 ceph-mon[27708]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T16:59:58.528 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:58 smithi115 ceph-mon[27708]: from='client.? 172.21.15.115:0/1847938217' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "876bf075-f0e1-49dc-90cc-aedccbd19b2a"}]: dispatch 2024-09-13T16:59:58.528 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:58 smithi115 ceph-mon[27708]: from='client.? 172.21.15.115:0/1847938217' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "876bf075-f0e1-49dc-90cc-aedccbd19b2a"}]': finished 2024-09-13T16:59:58.528 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:58 smithi115 ceph-mon[27708]: osdmap e11: 2 total, 1 up, 2 in 2024-09-13T16:59:58.528 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:58 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T16:59:58.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:58 smithi195 ceph-mon[34981]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T16:59:58.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:58 smithi195 ceph-mon[34981]: from='client.? 172.21.15.115:0/1847938217' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "876bf075-f0e1-49dc-90cc-aedccbd19b2a"}]: dispatch 2024-09-13T16:59:58.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:58 smithi195 ceph-mon[34981]: from='client.? 172.21.15.115:0/1847938217' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "876bf075-f0e1-49dc-90cc-aedccbd19b2a"}]': finished 2024-09-13T16:59:58.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:58 smithi195 ceph-mon[34981]: osdmap e11: 2 total, 1 up, 2 in 2024-09-13T16:59:58.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:58 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T16:59:59.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:59 smithi195 ceph-mon[34981]: from='client.? 172.21.15.115:0/3955672154' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T16:59:59.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 16:59:59 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T16:59:59.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:59 smithi115 ceph-mon[27708]: from='client.? 172.21.15.115:0/3955672154' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T16:59:59.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 16:59:59 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:00:00.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:00 smithi115 ceph-mon[27708]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T17:00:00.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:00 smithi115 ceph-mon[27708]: overall HEALTH_OK 2024-09-13T17:00:00.520 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:00 smithi195 ceph-mon[34981]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T17:00:00.520 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:00 smithi195 ceph-mon[34981]: overall HEALTH_OK 2024-09-13T17:00:01.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:01 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:00:01.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:01 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:00:01.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:01 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:00:01.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:01 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:00:01.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:01 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:00:01.872 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:01 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:00:01.872 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:01 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:00:01.872 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:01 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:00:01.873 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:01 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:00:01.873 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:01 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:00:02.699 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:02 smithi115 ceph-mon[27708]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T17:00:02.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:02 smithi195 ceph-mon[34981]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T17:00:04.786 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:04 smithi115 ceph-mon[27708]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T17:00:04.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:04 smithi195 ceph-mon[34981]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T17:00:05.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:05 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-13T17:00:05.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:05 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:00:05.851 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:05 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-13T17:00:05.851 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:05 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:00:06.728 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:06 smithi195 ceph-mon[34981]: Deploying daemon osd.1 on smithi115 2024-09-13T17:00:06.729 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:06 smithi195 ceph-mon[34981]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T17:00:06.743 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:06 smithi115 ceph-mon[27708]: Deploying daemon osd.1 on smithi115 2024-09-13T17:00:06.743 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:06 smithi115 ceph-mon[27708]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T17:00:08.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:08 smithi195 ceph-mon[34981]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T17:00:08.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:08 smithi115 ceph-mon[27708]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T17:00:10.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:10 smithi195 ceph-mon[34981]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T17:00:10.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:10 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:00:10.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:10 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:00:10.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:10 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:00:10.926 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:10 smithi115 ceph-mon[27708]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T17:00:10.926 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:10 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:00:10.926 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:10 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:00:10.926 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:10 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:00:12.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:12 smithi115 ceph-mon[27708]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T17:00:12.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:12 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:00:12.801 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:12 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:00:12.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:12 smithi195 ceph-mon[34981]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T17:00:12.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:12 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:00:12.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:12 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:00:13.728 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:00:13.727+0000 7fcc8f7fe640 1 -- 172.21.15.115:0/267576886 <== mgr.14207 v2:172.21.15.115:6800/244039928 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fcc981045f0 con 0x7fcc8406cbd0 2024-09-13T17:00:13.729 INFO:teuthology.orchestra.run.smithi115.stdout:Created osd(s) 1 on host 'smithi115' 2024-09-13T17:00:13.731 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:00:13.729+0000 7fcca0649640 1 -- 172.21.15.115:0/267576886 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fcc8406cbd0 msgr2=0x7fcc8406f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:00:13.731 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:00:13.729+0000 7fcca0649640 1 --2- 172.21.15.115:0/267576886 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fcc8406cbd0 0x7fcc8406f090 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fcc98198c60 tx=0x7fcc88031400 comp rx=0 tx=0).stop 2024-09-13T17:00:13.731 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:00:13.729+0000 7fcca0649640 1 -- 172.21.15.115:0/267576886 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc980feaa0 msgr2=0x7fcc98197740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:00:13.731 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:00:13.729+0000 7fcca0649640 1 --2- 172.21.15.115:0/267576886 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc980feaa0 0x7fcc98197740 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fcc9400c8f0 tx=0x7fcc9400cdb0 comp rx=0 tx=0).stop 2024-09-13T17:00:13.731 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:00:13.729+0000 7fcca0649640 1 -- 172.21.15.115:0/267576886 shutdown_connections 2024-09-13T17:00:13.731 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:00:13.729+0000 7fcca0649640 1 --2- 172.21.15.115:0/267576886 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fcc8406cbd0 0x7fcc8406f090 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:13.731 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:00:13.729+0000 7fcca0649640 1 --2- 172.21.15.115:0/267576886 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc980ffca0 0x7fcc98197c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:13.731 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:00:13.729+0000 7fcca0649640 1 --2- 172.21.15.115:0/267576886 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc980feaa0 0x7fcc98197740 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:13.731 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:00:13.729+0000 7fcca0649640 1 -- 172.21.15.115:0/267576886 >> 172.21.15.115:0/267576886 conn(0x7fcc980fa230 msgr2=0x7fcc98102ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:00:13.731 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:00:13.729+0000 7fcca0649640 1 -- 172.21.15.115:0/267576886 shutdown_connections 2024-09-13T17:00:13.731 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:00:13.729+0000 7fcca0649640 1 -- 172.21.15.115:0/267576886 wait complete. 2024-09-13T17:00:14.392 DEBUG:teuthology.orchestra.run.smithi115:osd.1> sudo journalctl -f -n 0 -u ceph-ffbd7588-71f0-11ef-bceb-c7b262605968@osd.1.service 2024-09-13T17:00:14.399 INFO:tasks.cephadm:Deploying osd.2 on smithi115 with /dev/vg_nvme/lv_2... 2024-09-13T17:00:14.399 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-09-13T17:00:14.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:14 smithi115 ceph-mon[27708]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T17:00:14.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:14 smithi115 ceph-mon[27708]: from='osd.1 [v2:172.21.15.115:6810/3928285174,v1:172.21.15.115:6811/3928285174]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-13T17:00:14.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:14 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:00:14.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:14 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:00:14.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:14 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:00:14.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:14 smithi195 ceph-mon[34981]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T17:00:14.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:14 smithi195 ceph-mon[34981]: from='osd.1 [v2:172.21.15.115:6810/3928285174,v1:172.21.15.115:6811/3928285174]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-13T17:00:14.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:14 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:00:14.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:14 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:00:14.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:14 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:00:15.041 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T17:00:15.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:15 smithi195 ceph-mon[34981]: from='osd.1 [v2:172.21.15.115:6810/3928285174,v1:172.21.15.115:6811/3928285174]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-13T17:00:15.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:15 smithi195 ceph-mon[34981]: osdmap e12: 2 total, 1 up, 2 in 2024-09-13T17:00:15.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:15 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T17:00:15.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:15 smithi195 ceph-mon[34981]: from='osd.1 [v2:172.21.15.115:6810/3928285174,v1:172.21.15.115:6811/3928285174]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-13T17:00:15.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:15 smithi115 ceph-mon[27708]: from='osd.1 [v2:172.21.15.115:6810/3928285174,v1:172.21.15.115:6811/3928285174]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-13T17:00:15.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:15 smithi115 ceph-mon[27708]: osdmap e12: 2 total, 1 up, 2 in 2024-09-13T17:00:15.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:15 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T17:00:15.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:15 smithi115 ceph-mon[27708]: from='osd.1 [v2:172.21.15.115:6810/3928285174,v1:172.21.15.115:6811/3928285174]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-13T17:00:15.929 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 17:00:15 smithi115 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-1[53752]: 2024-09-13T17:00:15.522+0000 7fed028df640 -1 osd.1 0 waiting for initial osdmap 2024-09-13T17:00:15.929 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 17:00:15 smithi115 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-1[53752]: 2024-09-13T17:00:15.530+0000 7fecfef1a640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T17:00:16.810 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:16 smithi115 ceph-mon[27708]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T17:00:16.810 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:16 smithi115 ceph-mon[27708]: from='osd.1 [v2:172.21.15.115:6810/3928285174,v1:172.21.15.115:6811/3928285174]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]': finished 2024-09-13T17:00:16.810 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:16 smithi115 ceph-mon[27708]: osdmap e13: 2 total, 1 up, 2 in 2024-09-13T17:00:16.811 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:16 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T17:00:16.811 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:16 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T17:00:16.811 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:16 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T17:00:16.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:16 smithi195 ceph-mon[34981]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T17:00:16.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:16 smithi195 ceph-mon[34981]: from='osd.1 [v2:172.21.15.115:6810/3928285174,v1:172.21.15.115:6811/3928285174]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]': finished 2024-09-13T17:00:16.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:16 smithi195 ceph-mon[34981]: osdmap e13: 2 total, 1 up, 2 in 2024-09-13T17:00:16.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:16 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T17:00:16.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:16 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T17:00:16.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:16 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T17:00:17.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:17 smithi195 ceph-mon[34981]: purged_snaps scrub starts 2024-09-13T17:00:17.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:17 smithi195 ceph-mon[34981]: purged_snaps scrub ok 2024-09-13T17:00:17.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:17 smithi195 ceph-mon[34981]: osd.1 [v2:172.21.15.115:6810/3928285174,v1:172.21.15.115:6811/3928285174] boot 2024-09-13T17:00:17.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:17 smithi195 ceph-mon[34981]: osdmap e14: 2 total, 2 up, 2 in 2024-09-13T17:00:17.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:17 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T17:00:17.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:17 smithi195 ceph-mon[34981]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T17:00:17.859 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:17 smithi115 ceph-mon[27708]: purged_snaps scrub starts 2024-09-13T17:00:17.859 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:17 smithi115 ceph-mon[27708]: purged_snaps scrub ok 2024-09-13T17:00:17.859 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:17 smithi115 ceph-mon[27708]: osd.1 [v2:172.21.15.115:6810/3928285174,v1:172.21.15.115:6811/3928285174] boot 2024-09-13T17:00:17.859 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:17 smithi115 ceph-mon[27708]: osdmap e14: 2 total, 2 up, 2 in 2024-09-13T17:00:17.859 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:17 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T17:00:17.859 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:17 smithi115 ceph-mon[27708]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T17:00:18.102 INFO:teuthology.orchestra.run.smithi115.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-09-13T17:00:18.204 INFO:teuthology.orchestra.run.smithi115.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-09-13T17:00:18.219 INFO:teuthology.orchestra.run.smithi115.stderr: stderr: 10+0 records in 2024-09-13T17:00:18.220 INFO:teuthology.orchestra.run.smithi115.stderr:10+0 records out 2024-09-13T17:00:18.220 INFO:teuthology.orchestra.run.smithi115.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0125495 s, 836 MB/s 2024-09-13T17:00:18.220 INFO:teuthology.orchestra.run.smithi115.stderr:--> Zapping successful for: 2024-09-13T17:00:18.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:18 smithi195 ceph-mon[34981]: osdmap e15: 2 total, 2 up, 2 in 2024-09-13T17:00:18.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:18 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:00:18.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:18 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:00:18.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:18 smithi115 ceph-mon[27708]: osdmap e15: 2 total, 2 up, 2 in 2024-09-13T17:00:18.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:18 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:00:18.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:18 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:00:19.068 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi115:vg_nvme/lv_2 2024-09-13T17:00:19.669 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:19 smithi115 ceph-mon[27708]: pgmap v58: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:00:19.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:19 smithi195 ceph-mon[34981]: pgmap v58: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:00:20.021 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T17:00:22.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:22 smithi115 ceph-mon[27708]: pgmap v59: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:00:22.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:22 smithi195 ceph-mon[34981]: pgmap v59: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:00:22.655 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:00:22.651+0000 7f491d878640 1 -- 172.21.15.115:0/1341616934 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49180fea30 msgr2=0x7f49180fee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:00:22.655 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:00:22.651+0000 7f491d878640 1 --2- 172.21.15.115:0/1341616934 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49180fea30 0x7f49180fee30 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f4908009880 tx=0x7f490802a4a0 comp rx=0 tx=0).stop 2024-09-13T17:00:22.655 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:00:22.651+0000 7f491d878640 1 -- 172.21.15.115:0/1341616934 shutdown_connections 2024-09-13T17:00:22.655 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:00:22.651+0000 7f491d878640 1 --2- 172.21.15.115:0/1341616934 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f49180ffc30 0x7f49181000b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:22.655 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:00:22.651+0000 7f491d878640 1 --2- 172.21.15.115:0/1341616934 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49180fea30 0x7f49180fee30 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:22.655 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:00:22.651+0000 7f491d878640 1 -- 172.21.15.115:0/1341616934 >> 172.21.15.115:0/1341616934 conn(0x7f49180fa1c0 msgr2=0x7f49180fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:00:22.656 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:00:22.651+0000 7f491d878640 1 -- 172.21.15.115:0/1341616934 shutdown_connections 2024-09-13T17:00:22.656 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:00:22.651+0000 7f491d878640 1 -- 172.21.15.115:0/1341616934 wait complete. 2024-09-13T17:00:22.656 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:00:22.652+0000 7f491d878640 1 Processor -- start 2024-09-13T17:00:22.656 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:00:22.652+0000 7f491d878640 1 -- start start 2024-09-13T17:00:22.656 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:00:22.652+0000 7f491d878640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49180fea30 0x7f4918068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:00:22.656 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:00:22.652+0000 7f491d878640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f49180ffc30 0x7f491819a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:00:22.656 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:00:22.652+0000 7f491d878640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f491819a8a0 con 0x7f49180fea30 2024-09-13T17:00:22.656 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:00:22.652+0000 7f491d878640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f491819a9e0 con 0x7f49180ffc30 2024-09-13T17:00:22.656 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:00:22.652+0000 7f4916ffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49180fea30 0x7f4918068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:00:22.657 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:00:22.652+0000 7f4916ffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49180fea30 0x7f4918068740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:46480/0 (socket says 172.21.15.115:46480) 2024-09-13T17:00:22.657 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:00:22.652+0000 7f4916ffd640 1 -- 172.21.15.115:0/2884720793 learned_addr learned my addr 172.21.15.115:0/2884720793 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:00:22.657 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:00:22.652+0000 7f49167fc640 1 --2- 172.21.15.115:0/2884720793 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f49180ffc30 0x7f491819a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:00:22.657 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:00:22.652+0000 7f4916ffd640 1 -- 172.21.15.115:0/2884720793 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f49180ffc30 msgr2=0x7f491819a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:00:22.657 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:00:22.652+0000 7f4916ffd640 1 --2- 172.21.15.115:0/2884720793 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f49180ffc30 0x7f491819a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:22.657 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:00:22.652+0000 7f4916ffd640 1 -- 172.21.15.115:0/2884720793 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4908009560 con 0x7f49180fea30 2024-09-13T17:00:22.657 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:00:22.653+0000 7f4916ffd640 1 --2- 172.21.15.115:0/2884720793 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49180fea30 0x7f4918068740 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f49080054f0 tx=0x7f4908005520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:00:22.657 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:00:22.653+0000 7f491c876640 1 -- 172.21.15.115:0/2884720793 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4908004aa0 con 0x7f49180fea30 2024-09-13T17:00:22.657 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:00:22.653+0000 7f491c876640 1 -- 172.21.15.115:0/2884720793 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4908004c00 con 0x7f49180fea30 2024-09-13T17:00:22.657 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:00:22.653+0000 7f491c876640 1 -- 172.21.15.115:0/2884720793 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49080319f0 con 0x7f49180fea30 2024-09-13T17:00:22.657 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:00:22.653+0000 7f491d878640 1 -- 172.21.15.115:0/2884720793 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f491819ac30 con 0x7f49180fea30 2024-09-13T17:00:22.657 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:00:22.653+0000 7f491d878640 1 -- 172.21.15.115:0/2884720793 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f491819b1a0 con 0x7f49180fea30 2024-09-13T17:00:22.658 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:00:22.654+0000 7f491d878640 1 -- 172.21.15.115:0/2884720793 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4918107500 con 0x7f49180fea30 2024-09-13T17:00:22.658 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:00:22.654+0000 7f491c876640 1 -- 172.21.15.115:0/2884720793 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 18) v1 ==== 90796+0+0 (secure 0 0 0) 0x7f4908003c90 con 0x7f49180fea30 2024-09-13T17:00:22.658 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:00:22.655+0000 7f491c876640 1 --2- 172.21.15.115:0/2884720793 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f490406cbd0 0x7f490406f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:00:22.658 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:00:22.655+0000 7f491c876640 1 -- 172.21.15.115:0/2884720793 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2414+0+0 (secure 0 0 0) 0x7f49080ac650 con 0x7f49180fea30 2024-09-13T17:00:22.659 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:00:22.655+0000 7f49167fc640 1 --2- 172.21.15.115:0/2884720793 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f490406cbd0 0x7f490406f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:00:22.659 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:00:22.655+0000 7f49167fc640 1 --2- 172.21.15.115:0/2884720793 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f490406cbd0 0x7f490406f090 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4918068cc0 tx=0x7f490000b390 comp rx=0 tx=0).ready entity=mgr.14207 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:00:22.661 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:00:22.659+0000 7f491c876640 1 -- 172.21.15.115:0/2884720793 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f49080777a0 con 0x7f49180fea30 2024-09-13T17:00:22.849 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:00:22.846+0000 7f491d878640 1 -- 172.21.15.115:0/2884720793 --> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi115:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f491819b390 con 0x7f490406cbd0 2024-09-13T17:00:23.735 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:23 smithi115 ceph-mon[27708]: Detected new or changed devices on smithi115 2024-09-13T17:00:23.735 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:23 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:00:23.735 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:23 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:00:23.735 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:23 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:00:23.735 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:23 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:00:23.735 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:23 smithi115 ceph-mon[27708]: Adjusting osd_memory_target on smithi115 to 5920M 2024-09-13T17:00:23.735 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:23 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:00:23.735 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:23 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:00:23.736 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:23 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:00:23.736 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:23 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:00:23.736 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:23 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:00:23.736 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:23 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T17:00:23.736 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:23 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T17:00:23.736 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:23 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:00:23.801 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:23 smithi195 ceph-mon[34981]: Detected new or changed devices on smithi115 2024-09-13T17:00:23.801 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:23 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:00:23.801 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:23 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:00:23.801 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:23 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:00:23.801 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:23 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:00:23.801 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:23 smithi195 ceph-mon[34981]: Adjusting osd_memory_target on smithi115 to 5920M 2024-09-13T17:00:23.802 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:23 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:00:23.802 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:23 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:00:23.802 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:23 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:00:23.802 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:23 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:00:23.802 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:23 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:00:23.802 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:23 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T17:00:23.802 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:23 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T17:00:23.802 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:23 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:00:24.738 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:24 smithi115 ceph-mon[27708]: from='client.14278 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi115:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:00:24.738 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:24 smithi115 ceph-mon[27708]: pgmap v60: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:00:24.738 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:24 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:00:24.738 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:24 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:00:24.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:24 smithi195 ceph-mon[34981]: from='client.14278 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi115:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:00:24.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:24 smithi195 ceph-mon[34981]: pgmap v60: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:00:24.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:24 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:00:24.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:24 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:00:26.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:26 smithi195 ceph-mon[34981]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:00:26.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:26 smithi195 ceph-mon[34981]: from='client.? 172.21.15.115:0/1590974248' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "40bc0278-21e6-4863-86bf-f5ee3bfc2fbe"}]: dispatch 2024-09-13T17:00:26.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:26 smithi195 ceph-mon[34981]: from='client.? 172.21.15.115:0/1590974248' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "40bc0278-21e6-4863-86bf-f5ee3bfc2fbe"}]': finished 2024-09-13T17:00:26.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:26 smithi195 ceph-mon[34981]: osdmap e16: 3 total, 2 up, 3 in 2024-09-13T17:00:26.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:26 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T17:00:26.839 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:26 smithi115 ceph-mon[27708]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:00:26.839 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:26 smithi115 ceph-mon[27708]: from='client.? 172.21.15.115:0/1590974248' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "40bc0278-21e6-4863-86bf-f5ee3bfc2fbe"}]: dispatch 2024-09-13T17:00:26.839 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:26 smithi115 ceph-mon[27708]: from='client.? 172.21.15.115:0/1590974248' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "40bc0278-21e6-4863-86bf-f5ee3bfc2fbe"}]': finished 2024-09-13T17:00:26.839 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:26 smithi115 ceph-mon[27708]: osdmap e16: 3 total, 2 up, 3 in 2024-09-13T17:00:26.839 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:26 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T17:00:27.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:27 smithi195 ceph-mon[34981]: from='client.? 172.21.15.115:0/582109345' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T17:00:27.928 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:27 smithi115 ceph-mon[27708]: from='client.? 172.21.15.115:0/582109345' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T17:00:28.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:28 smithi195 ceph-mon[34981]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:00:28.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:28 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:00:28.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:28 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:00:28.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:28 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:00:28.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:28 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:00:28.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:28 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:00:28.928 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:28 smithi115 ceph-mon[27708]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:00:28.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:28 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:00:28.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:28 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:00:28.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:28 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:00:28.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:28 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:00:28.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:28 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:00:29.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:29 smithi195 ceph-mon[34981]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:00:29.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:29 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:00:29.928 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:29 smithi115 ceph-mon[27708]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:00:29.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:29 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:00:32.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:32 smithi115 ceph-mon[27708]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:00:32.576 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:32 smithi195 ceph-mon[34981]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:00:34.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:34 smithi115 ceph-mon[27708]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:00:34.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:34 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-13T17:00:34.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:34 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:00:34.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:34 smithi195 ceph-mon[34981]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:00:34.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:34 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-13T17:00:34.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:34 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:00:35.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:35 smithi195 ceph-mon[34981]: Deploying daemon osd.2 on smithi115 2024-09-13T17:00:35.595 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:35 smithi115 ceph-mon[27708]: Deploying daemon osd.2 on smithi115 2024-09-13T17:00:36.343 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:36 smithi195 ceph-mon[34981]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:00:36.428 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:36 smithi115 ceph-mon[27708]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:00:38.301 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:38 smithi115 ceph-mon[27708]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:00:38.576 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:38 smithi195 ceph-mon[34981]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:00:39.423 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:39 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:00:39.423 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:39 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:00:39.423 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:39 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:00:39.576 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:39 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:00:39.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:39 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:00:39.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:39 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:00:40.576 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:40 smithi195 ceph-mon[34981]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:00:40.607 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:40 smithi115 ceph-mon[27708]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:00:42.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:42 smithi115 ceph-mon[27708]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:00:42.576 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:42 smithi195 ceph-mon[34981]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:00:42.867 INFO:teuthology.orchestra.run.smithi115.stdout:Created osd(s) 2 on host 'smithi115' 2024-09-13T17:00:42.867 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:00:42.865+0000 7f491c876640 1 -- 172.21.15.115:0/2884720793 <== mgr.14207 v2:172.21.15.115:6800/244039928 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f491819b390 con 0x7f490406cbd0 2024-09-13T17:00:42.869 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:00:42.868+0000 7f491d878640 1 -- 172.21.15.115:0/2884720793 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f490406cbd0 msgr2=0x7f490406f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:00:42.869 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:00:42.868+0000 7f491d878640 1 --2- 172.21.15.115:0/2884720793 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f490406cbd0 0x7f490406f090 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4918068cc0 tx=0x7f490000b390 comp rx=0 tx=0).stop 2024-09-13T17:00:42.869 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:00:42.868+0000 7f491d878640 1 -- 172.21.15.115:0/2884720793 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49180fea30 msgr2=0x7f4918068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:00:42.870 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:00:42.868+0000 7f491d878640 1 --2- 172.21.15.115:0/2884720793 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49180fea30 0x7f4918068740 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f49080054f0 tx=0x7f4908005520 comp rx=0 tx=0).stop 2024-09-13T17:00:42.870 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:00:42.868+0000 7f491d878640 1 -- 172.21.15.115:0/2884720793 shutdown_connections 2024-09-13T17:00:42.870 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:00:42.868+0000 7f491d878640 1 --2- 172.21.15.115:0/2884720793 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f490406cbd0 0x7f490406f090 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:42.870 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:00:42.868+0000 7f491d878640 1 --2- 172.21.15.115:0/2884720793 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f49180ffc30 0x7f491819a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:42.870 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:00:42.868+0000 7f491d878640 1 --2- 172.21.15.115:0/2884720793 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49180fea30 0x7f4918068740 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:42.870 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:00:42.868+0000 7f491d878640 1 -- 172.21.15.115:0/2884720793 >> 172.21.15.115:0/2884720793 conn(0x7f49180fa1c0 msgr2=0x7f4918102e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:00:42.870 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:00:42.868+0000 7f491d878640 1 -- 172.21.15.115:0/2884720793 shutdown_connections 2024-09-13T17:00:42.870 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:00:42.868+0000 7f491d878640 1 -- 172.21.15.115:0/2884720793 wait complete. 2024-09-13T17:00:43.428 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:43 smithi115 ceph-mon[27708]: from='osd.2 [v2:172.21.15.115:6818/1608421656,v1:172.21.15.115:6819/1608421656]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-13T17:00:43.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:43 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:00:43.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:43 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:00:43.475 DEBUG:teuthology.orchestra.run.smithi115:osd.2> sudo journalctl -f -n 0 -u ceph-ffbd7588-71f0-11ef-bceb-c7b262605968@osd.2.service 2024-09-13T17:00:43.478 INFO:tasks.cephadm:Deploying osd.3 on smithi195 with /dev/vg_nvme/lv_4... 2024-09-13T17:00:43.478 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-09-13T17:00:43.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:43 smithi195 ceph-mon[34981]: from='osd.2 [v2:172.21.15.115:6818/1608421656,v1:172.21.15.115:6819/1608421656]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-13T17:00:43.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:43 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:00:43.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:43 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:00:43.685 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/mon.smithi195/config 2024-09-13T17:00:44.571 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:44 smithi115 ceph-mon[27708]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:00:44.572 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:44 smithi115 ceph-mon[27708]: from='osd.2 [v2:172.21.15.115:6818/1608421656,v1:172.21.15.115:6819/1608421656]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-13T17:00:44.572 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:44 smithi115 ceph-mon[27708]: osdmap e17: 3 total, 2 up, 3 in 2024-09-13T17:00:44.572 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:44 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T17:00:44.572 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:44 smithi115 ceph-mon[27708]: from='osd.2 [v2:172.21.15.115:6818/1608421656,v1:172.21.15.115:6819/1608421656]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-13T17:00:44.572 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:44 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:00:44.576 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:44 smithi195 ceph-mon[34981]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:00:44.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:44 smithi195 ceph-mon[34981]: from='osd.2 [v2:172.21.15.115:6818/1608421656,v1:172.21.15.115:6819/1608421656]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-13T17:00:44.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:44 smithi195 ceph-mon[34981]: osdmap e17: 3 total, 2 up, 3 in 2024-09-13T17:00:44.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:44 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T17:00:44.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:44 smithi195 ceph-mon[34981]: from='osd.2 [v2:172.21.15.115:6818/1608421656,v1:172.21.15.115:6819/1608421656]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-13T17:00:44.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:44 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:00:45.273 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 17:00:45 smithi115 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-2[61042]: 2024-09-13T17:00:45.068+0000 7f10fff92640 -1 osd.2 0 waiting for initial osdmap 2024-09-13T17:00:45.273 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 17:00:45 smithi115 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-2[61042]: 2024-09-13T17:00:45.073+0000 7f10f85c5640 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T17:00:45.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:45 smithi195 ceph-mon[34981]: from='osd.2 [v2:172.21.15.115:6818/1608421656,v1:172.21.15.115:6819/1608421656]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]': finished 2024-09-13T17:00:45.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:45 smithi195 ceph-mon[34981]: osdmap e18: 3 total, 2 up, 3 in 2024-09-13T17:00:45.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:45 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T17:00:45.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:45 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T17:00:45.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:45 smithi195 ceph-mon[34981]: from='osd.2 [v2:172.21.15.115:6818/1608421656,v1:172.21.15.115:6819/1608421656]' entity='osd.2' 2024-09-13T17:00:45.402 INFO:teuthology.orchestra.run.smithi195.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-09-13T17:00:45.486 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-09-13T17:00:45.496 INFO:teuthology.orchestra.run.smithi195.stderr: stderr: 10+0 records in 2024-09-13T17:00:45.496 INFO:teuthology.orchestra.run.smithi195.stderr:10+0 records out 2024-09-13T17:00:45.496 INFO:teuthology.orchestra.run.smithi195.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00865287 s, 1.2 GB/s 2024-09-13T17:00:45.496 INFO:teuthology.orchestra.run.smithi195.stderr:--> Zapping successful for: 2024-09-13T17:00:45.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:45 smithi115 ceph-mon[27708]: from='osd.2 [v2:172.21.15.115:6818/1608421656,v1:172.21.15.115:6819/1608421656]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]': finished 2024-09-13T17:00:45.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:45 smithi115 ceph-mon[27708]: osdmap e18: 3 total, 2 up, 3 in 2024-09-13T17:00:45.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:45 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T17:00:45.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:45 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T17:00:45.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:45 smithi115 ceph-mon[27708]: from='osd.2 [v2:172.21.15.115:6818/1608421656,v1:172.21.15.115:6819/1608421656]' entity='osd.2' 2024-09-13T17:00:46.069 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi195:vg_nvme/lv_4 2024-09-13T17:00:46.261 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/mon.smithi195/config 2024-09-13T17:00:46.373 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:46 smithi115 ceph-mon[27708]: purged_snaps scrub starts 2024-09-13T17:00:46.373 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:46 smithi115 ceph-mon[27708]: purged_snaps scrub ok 2024-09-13T17:00:46.374 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:46 smithi115 ceph-mon[27708]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:00:46.374 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:46 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T17:00:46.374 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:46 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:00:46.374 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:46 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:00:46.374 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:46 smithi115 ceph-mon[27708]: osd.2 [v2:172.21.15.115:6818/1608421656,v1:172.21.15.115:6819/1608421656] boot 2024-09-13T17:00:46.374 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:46 smithi115 ceph-mon[27708]: osdmap e19: 3 total, 3 up, 3 in 2024-09-13T17:00:46.374 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:46 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T17:00:46.551 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:46 smithi195 ceph-mon[34981]: purged_snaps scrub starts 2024-09-13T17:00:46.551 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:46 smithi195 ceph-mon[34981]: purged_snaps scrub ok 2024-09-13T17:00:46.551 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:46 smithi195 ceph-mon[34981]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:00:46.551 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:46 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T17:00:46.551 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:46 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:00:46.551 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:46 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:00:46.551 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:46 smithi195 ceph-mon[34981]: osd.2 [v2:172.21.15.115:6818/1608421656,v1:172.21.15.115:6819/1608421656] boot 2024-09-13T17:00:46.551 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:46 smithi195 ceph-mon[34981]: osdmap e19: 3 total, 3 up, 3 in 2024-09-13T17:00:46.551 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:46 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T17:00:47.650 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:00:47.646+0000 7fe0e9fbc640 1 -- 172.21.15.195:0/329685899 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0e4101280 msgr2=0x7fe0e4101680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:00:47.650 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:00:47.646+0000 7fe0e9fbc640 1 --2- 172.21.15.195:0/329685899 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0e4101280 0x7fe0e4101680 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fe0d4009880 tx=0x7fe0d402a4a0 comp rx=0 tx=0).stop 2024-09-13T17:00:47.651 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:00:47.646+0000 7fe0e9fbc640 1 -- 172.21.15.195:0/329685899 shutdown_connections 2024-09-13T17:00:47.651 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:00:47.646+0000 7fe0e9fbc640 1 --2- 172.21.15.195:0/329685899 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0e40ff7c0 0x7fe0e40ffc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:47.651 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:00:47.646+0000 7fe0e9fbc640 1 --2- 172.21.15.195:0/329685899 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0e4101280 0x7fe0e4101680 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:47.651 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:00:47.646+0000 7fe0e9fbc640 1 -- 172.21.15.195:0/329685899 >> 172.21.15.195:0/329685899 conn(0x7fe0e40fb330 msgr2=0x7fe0e40fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:00:47.651 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:00:47.646+0000 7fe0e9fbc640 1 -- 172.21.15.195:0/329685899 shutdown_connections 2024-09-13T17:00:47.651 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:00:47.646+0000 7fe0e9fbc640 1 -- 172.21.15.195:0/329685899 wait complete. 2024-09-13T17:00:47.651 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:00:47.647+0000 7fe0e9fbc640 1 Processor -- start 2024-09-13T17:00:47.651 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:00:47.647+0000 7fe0e9fbc640 1 -- start start 2024-09-13T17:00:47.651 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:00:47.647+0000 7fe0e9fbc640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0e40ff7c0 0x7fe0e4195620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:00:47.651 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:00:47.647+0000 7fe0e9fbc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0e4101280 0x7fe0e4195b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:00:47.651 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:00:47.647+0000 7fe0e9fbc640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e4196130 con 0x7fe0e4101280 2024-09-13T17:00:47.651 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:00:47.647+0000 7fe0e9fbc640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e41962a0 con 0x7fe0e40ff7c0 2024-09-13T17:00:47.651 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:00:47.647+0000 7fe0e37fe640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0e40ff7c0 0x7fe0e4195620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:00:47.652 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:00:47.647+0000 7fe0e37fe640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0e40ff7c0 0x7fe0e4195620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:40262/0 (socket says 172.21.15.195:40262) 2024-09-13T17:00:47.652 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:00:47.647+0000 7fe0e37fe640 1 -- 172.21.15.195:0/866342686 learned_addr learned my addr 172.21.15.195:0/866342686 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-09-13T17:00:47.652 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:00:47.647+0000 7fe0dbfff640 1 --2- 172.21.15.195:0/866342686 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0e4101280 0x7fe0e4195b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:00:47.652 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:00:47.647+0000 7fe0e37fe640 1 -- 172.21.15.195:0/866342686 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0e4101280 msgr2=0x7fe0e4195b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:00:47.652 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:00:47.647+0000 7fe0e37fe640 1 --2- 172.21.15.195:0/866342686 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0e4101280 0x7fe0e4195b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:00:47.652 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:00:47.647+0000 7fe0e37fe640 1 -- 172.21.15.195:0/866342686 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0d4009560 con 0x7fe0e40ff7c0 2024-09-13T17:00:47.652 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:00:47.647+0000 7fe0e37fe640 1 --2- 172.21.15.195:0/866342686 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0e40ff7c0 0x7fe0e4195620 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fe0d40054f0 tx=0x7fe0d4005520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:00:47.652 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:00:47.647+0000 7fe0e17fa640 1 -- 172.21.15.195:0/866342686 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0d4004aa0 con 0x7fe0e40ff7c0 2024-09-13T17:00:47.652 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:00:47.648+0000 7fe0e17fa640 1 -- 172.21.15.195:0/866342686 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe0d4004c00 con 0x7fe0e40ff7c0 2024-09-13T17:00:47.652 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:00:47.648+0000 7fe0e17fa640 1 -- 172.21.15.195:0/866342686 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0d40319f0 con 0x7fe0e40ff7c0 2024-09-13T17:00:47.652 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:00:47.648+0000 7fe0e9fbc640 1 -- 172.21.15.195:0/866342686 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0e419ace0 con 0x7fe0e40ff7c0 2024-09-13T17:00:47.652 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:00:47.648+0000 7fe0e9fbc640 1 -- 172.21.15.195:0/866342686 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0e419b180 con 0x7fe0e40ff7c0 2024-09-13T17:00:47.653 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:00:47.649+0000 7fe0e9fbc640 1 -- 172.21.15.195:0/866342686 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0e40ffc40 con 0x7fe0e40ff7c0 2024-09-13T17:00:47.653 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:00:47.649+0000 7fe0e17fa640 1 -- 172.21.15.195:0/866342686 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 18) v1 ==== 90796+0+0 (secure 0 0 0) 0x7fe0d4031be0 con 0x7fe0e40ff7c0 2024-09-13T17:00:47.653 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:00:47.649+0000 7fe0e17fa640 1 --2- 172.21.15.195:0/866342686 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fe0d006cbd0 0x7fe0d006f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:00:47.654 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:00:47.650+0000 7fe0e17fa640 1 -- 172.21.15.195:0/866342686 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3221+0+0 (secure 0 0 0) 0x7fe0d40ac8f0 con 0x7fe0e40ff7c0 2024-09-13T17:00:47.654 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:00:47.650+0000 7fe0dbfff640 1 --2- 172.21.15.195:0/866342686 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fe0d006cbd0 0x7fe0d006f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:00:47.654 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:00:47.650+0000 7fe0dbfff640 1 --2- 172.21.15.195:0/866342686 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fe0d006cbd0 0x7fe0d006f090 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe0e4196b40 tx=0x7fe0cc00b410 comp rx=0 tx=0).ready entity=mgr.14207 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:00:47.656 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:00:47.654+0000 7fe0e17fa640 1 -- 172.21.15.195:0/866342686 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe0d4077790 con 0x7fe0e40ff7c0 2024-09-13T17:00:47.826 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:00:47.823+0000 7fe0e9fbc640 1 -- 172.21.15.195:0/866342686 --> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fe0e41056f0 con 0x7fe0d006cbd0 2024-09-13T17:00:47.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:47 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-13T17:00:47.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:47 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-13T17:00:47.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:47 smithi195 ceph-mon[34981]: osdmap e20: 3 total, 3 up, 3 in 2024-09-13T17:00:47.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:47 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-13T17:00:47.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:47 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-13T17:00:47.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:47 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-13T17:00:47.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:47 smithi115 ceph-mon[27708]: osdmap e20: 3 total, 3 up, 3 in 2024-09-13T17:00:47.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:47 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-13T17:00:48.633 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:48 smithi115 ceph-mon[27708]: pgmap v76: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-13T17:00:48.633 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:48 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T17:00:48.633 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:48 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T17:00:48.633 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:48 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:00:48.634 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:48 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-13T17:00:48.634 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:48 smithi115 ceph-mon[27708]: osdmap e21: 3 total, 3 up, 3 in 2024-09-13T17:00:48.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:48 smithi195 ceph-mon[34981]: pgmap v76: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-13T17:00:48.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:48 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T17:00:48.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:48 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T17:00:48.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:48 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:00:48.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:48 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-13T17:00:48.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:48 smithi195 ceph-mon[34981]: osdmap e21: 3 total, 3 up, 3 in 2024-09-13T17:00:48.888 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 17:00:48 smithi115 sudo[65545]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-13T17:00:48.888 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 17:00:48 smithi115 sudo[65545]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T17:00:48.888 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 17:00:48 smithi115 sudo[65545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T17:00:48.888 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 17:00:48 smithi115 sudo[65545]: pam_unix(sudo:session): session closed for user root 2024-09-13T17:00:49.428 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 17:00:49 smithi115 sudo[65634]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-13T17:00:49.429 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 17:00:49 smithi115 sudo[65634]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T17:00:49.429 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 17:00:49 smithi115 sudo[65634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T17:00:49.429 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 17:00:49 smithi115 sudo[65634]: pam_unix(sudo:session): session closed for user root 2024-09-13T17:00:49.694 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 17:00:49 smithi115 sudo[65653]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-13T17:00:49.694 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 17:00:49 smithi115 sudo[65653]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T17:00:49.694 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 17:00:49 smithi115 sudo[65653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T17:00:49.695 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 17:00:49 smithi115 sudo[65653]: pam_unix(sudo:session): session closed for user root 2024-09-13T17:00:49.695 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:49 smithi115 ceph-mon[27708]: from='client.24129 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:00:49.695 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:49 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:00:49.695 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:49 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:00:49.696 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:49 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:00:49.696 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:49 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:00:49.696 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:49 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:00:49.696 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:49 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:00:49.696 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:49 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:00:49.697 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:49 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:00:49.697 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:49 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:00:49.697 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:49 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:00:49.697 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:49 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:00:49.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:49 smithi195 ceph-mon[34981]: from='client.24129 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:00:49.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:49 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:00:49.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:49 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:00:49.828 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:49 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:00:49.828 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:49 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:00:49.828 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:49 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:00:49.828 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:49 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:00:49.828 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:49 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:00:49.828 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:49 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:00:49.829 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:49 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:00:49.829 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:49 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:00:49.829 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:49 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:00:49.962 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 17:00:49 smithi115 sudo[65656]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-13T17:00:49.962 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 17:00:49 smithi115 sudo[65656]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T17:00:49.962 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 17:00:49 smithi115 sudo[65656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T17:00:49.962 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 17:00:49 smithi115 sudo[65656]: pam_unix(sudo:session): session closed for user root 2024-09-13T17:00:50.187 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:00:50.185+0000 7fe0e17fa640 1 -- 172.21.15.195:0/866342686 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fe0d4077b60 con 0x7fe0e40ff7c0 2024-09-13T17:00:50.227 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 17:00:49 smithi115 sudo[65757]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-13T17:00:50.227 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 17:00:49 smithi115 sudo[65757]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T17:00:50.227 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 17:00:49 smithi115 sudo[65757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T17:00:50.227 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 17:00:49 smithi115 sudo[65757]: pam_unix(sudo:session): session closed for user root 2024-09-13T17:00:50.484 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 17:00:50 smithi115 sudo[65779]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-13T17:00:50.776 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 17:00:50 smithi115 sudo[65779]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T17:00:50.776 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 17:00:50 smithi115 sudo[65779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T17:00:50.776 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 17:00:50 smithi115 sudo[65779]: pam_unix(sudo:session): session closed for user root 2024-09-13T17:00:50.777 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:50 smithi115 sudo[65783]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-13T17:00:50.777 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:50 smithi115 sudo[65783]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T17:00:50.777 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:50 smithi115 sudo[65783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T17:00:50.777 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:50 smithi115 sudo[65783]: pam_unix(sudo:session): session closed for user root 2024-09-13T17:00:50.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:50 smithi195 ceph-mon[34981]: Detected new or changed devices on smithi115 2024-09-13T17:00:50.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:50 smithi195 ceph-mon[34981]: Adjusting osd_memory_target on smithi115 to 3946M 2024-09-13T17:00:50.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:50 smithi195 ceph-mon[34981]: pgmap v79: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-13T17:00:50.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:50 smithi195 ceph-mon[34981]: osdmap e22: 3 total, 3 up, 3 in 2024-09-13T17:00:50.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:50 smithi195 ceph-mon[34981]: from='client.? 172.21.15.195:0/3170416696' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "af3d701a-1c69-4cf2-a343-938ac1bbb34a"}]: dispatch 2024-09-13T17:00:50.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:50 smithi195 ceph-mon[34981]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "af3d701a-1c69-4cf2-a343-938ac1bbb34a"}]: dispatch 2024-09-13T17:00:50.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:50 smithi195 ceph-mon[34981]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "af3d701a-1c69-4cf2-a343-938ac1bbb34a"}]': finished 2024-09-13T17:00:50.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:50 smithi195 ceph-mon[34981]: osdmap e23: 4 total, 3 up, 4 in 2024-09-13T17:00:50.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:50 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T17:00:50.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:50 smithi195 ceph-mon[34981]: mgrmap e19: smithi115.hetcni(active, since 2m), standbys: smithi195.hjjifz 2024-09-13T17:00:50.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:50 smithi195 ceph-mon[34981]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T17:00:51.062 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:50 smithi115 sudo[65830]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-13T17:00:51.063 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:50 smithi115 sudo[65830]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T17:00:51.063 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:50 smithi115 sudo[65830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T17:00:51.063 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:50 smithi115 sudo[65830]: pam_unix(sudo:session): session closed for user root 2024-09-13T17:00:51.063 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:50 smithi115 ceph-mon[27708]: Detected new or changed devices on smithi115 2024-09-13T17:00:51.063 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:50 smithi115 ceph-mon[27708]: Adjusting osd_memory_target on smithi115 to 3946M 2024-09-13T17:00:51.063 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:50 smithi115 ceph-mon[27708]: pgmap v79: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-13T17:00:51.063 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:50 smithi115 ceph-mon[27708]: osdmap e22: 3 total, 3 up, 3 in 2024-09-13T17:00:51.063 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:50 smithi115 ceph-mon[27708]: from='client.? 172.21.15.195:0/3170416696' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "af3d701a-1c69-4cf2-a343-938ac1bbb34a"}]: dispatch 2024-09-13T17:00:51.063 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:50 smithi115 ceph-mon[27708]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "af3d701a-1c69-4cf2-a343-938ac1bbb34a"}]: dispatch 2024-09-13T17:00:51.063 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:50 smithi115 ceph-mon[27708]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "af3d701a-1c69-4cf2-a343-938ac1bbb34a"}]': finished 2024-09-13T17:00:51.063 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:50 smithi115 ceph-mon[27708]: osdmap e23: 4 total, 3 up, 4 in 2024-09-13T17:00:51.064 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:50 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T17:00:51.064 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:50 smithi115 ceph-mon[27708]: mgrmap e19: smithi115.hetcni(active, since 2m), standbys: smithi195.hjjifz 2024-09-13T17:00:51.064 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:50 smithi115 ceph-mon[27708]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T17:00:51.255 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:50 smithi195 sudo[38830]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-13T17:00:51.255 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:50 smithi195 sudo[38830]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T17:00:51.255 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:50 smithi195 sudo[38830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T17:00:51.255 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:51 smithi195 sudo[38830]: pam_unix(sudo:session): session closed for user root 2024-09-13T17:00:51.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:51 smithi195 sudo[39018]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-13T17:00:51.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:51 smithi195 sudo[39018]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T17:00:51.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:51 smithi195 sudo[39018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T17:00:51.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:51 smithi195 sudo[39018]: pam_unix(sudo:session): session closed for user root 2024-09-13T17:00:51.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:51 smithi115 ceph-mon[27708]: from='client.? 172.21.15.195:0/2361281559' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T17:00:51.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:51 smithi115 ceph-mon[27708]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T17:00:51.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:51 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mon metadata", "id": "smithi115"}]: dispatch 2024-09-13T17:00:51.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:51 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-09-13T17:00:51.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:51 smithi115 ceph-mon[27708]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T17:00:51.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:51 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mon metadata", "id": "smithi115"}]: dispatch 2024-09-13T17:00:51.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:51 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-09-13T17:00:51.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:51 smithi115 ceph-mon[27708]: pgmap v82: 1 pgs: 1 creating+peering; 0 B data, 85 MiB used, 268 GiB / 268 GiB avail 2024-09-13T17:00:51.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:51 smithi115 ceph-mon[27708]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T17:00:51.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:51 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:00:52.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:51 smithi195 ceph-mon[34981]: from='client.? 172.21.15.195:0/2361281559' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T17:00:52.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:51 smithi195 ceph-mon[34981]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T17:00:52.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:51 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mon metadata", "id": "smithi115"}]: dispatch 2024-09-13T17:00:52.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:51 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-09-13T17:00:52.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:51 smithi195 ceph-mon[34981]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T17:00:52.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:51 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mon metadata", "id": "smithi115"}]: dispatch 2024-09-13T17:00:52.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:51 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-09-13T17:00:52.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:51 smithi195 ceph-mon[34981]: pgmap v82: 1 pgs: 1 creating+peering; 0 B data, 85 MiB used, 268 GiB / 268 GiB avail 2024-09-13T17:00:52.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:51 smithi195 ceph-mon[34981]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T17:00:52.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:51 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:00:54.155 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:53 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:00:54.155 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:53 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:00:54.155 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:53 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:00:54.156 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:53 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:00:54.156 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:53 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:00:54.156 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:53 smithi195 ceph-mon[34981]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-13T17:00:54.178 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:53 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:00:54.178 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:53 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:00:54.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:53 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:00:54.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:53 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:00:54.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:53 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:00:54.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:53 smithi115 ceph-mon[27708]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-13T17:00:56.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:56 smithi195 ceph-mon[34981]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-13T17:00:56.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:56 smithi115 ceph-mon[27708]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-13T17:00:57.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:57 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-13T17:00:57.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:57 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:00:57.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:57 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-13T17:00:57.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:57 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:00:58.423 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:58 smithi195 ceph-mon[34981]: Deploying daemon osd.3 on smithi195 2024-09-13T17:00:58.423 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:58 smithi195 ceph-mon[34981]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-13T17:00:58.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:58 smithi115 ceph-mon[27708]: Deploying daemon osd.3 on smithi195 2024-09-13T17:00:58.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:58 smithi115 ceph-mon[27708]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-13T17:00:59.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:00:59 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:00:59.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:00:59 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:01:00.556 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:00 smithi195 ceph-mon[34981]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-13T17:01:00.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:00 smithi115 ceph-mon[27708]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-13T17:01:02.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:02 smithi195 ceph-mon[34981]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-13T17:01:02.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:02 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:01:02.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:02 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:01:02.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:02 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:01:02.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:02 smithi115 ceph-mon[27708]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-13T17:01:02.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:02 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:01:02.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:02 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:01:02.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:02 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:01:04.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:04 smithi195 ceph-mon[34981]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-13T17:01:04.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:04 smithi115 ceph-mon[27708]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-13T17:01:05.140 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:05.138+0000 7fe0e17fa640 1 -- 172.21.15.195:0/866342686 <== mgr.14207 v2:172.21.15.115:6800/244039928 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fe0e41056f0 con 0x7fe0d006cbd0 2024-09-13T17:01:05.140 INFO:teuthology.orchestra.run.smithi195.stdout:Created osd(s) 3 on host 'smithi195' 2024-09-13T17:01:05.142 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:05.140+0000 7fe0e9fbc640 1 -- 172.21.15.195:0/866342686 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fe0d006cbd0 msgr2=0x7fe0d006f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:01:05.142 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:05.140+0000 7fe0e9fbc640 1 --2- 172.21.15.195:0/866342686 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fe0d006cbd0 0x7fe0d006f090 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe0e4196b40 tx=0x7fe0cc00b410 comp rx=0 tx=0).stop 2024-09-13T17:01:05.142 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:05.140+0000 7fe0e9fbc640 1 -- 172.21.15.195:0/866342686 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0e40ff7c0 msgr2=0x7fe0e4195620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:01:05.142 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:05.140+0000 7fe0e9fbc640 1 --2- 172.21.15.195:0/866342686 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0e40ff7c0 0x7fe0e4195620 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fe0d40054f0 tx=0x7fe0d4005520 comp rx=0 tx=0).stop 2024-09-13T17:01:05.142 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:05.140+0000 7fe0e9fbc640 1 -- 172.21.15.195:0/866342686 shutdown_connections 2024-09-13T17:01:05.142 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:05.140+0000 7fe0e9fbc640 1 --2- 172.21.15.195:0/866342686 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fe0d006cbd0 0x7fe0d006f090 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:05.143 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:05.140+0000 7fe0e9fbc640 1 --2- 172.21.15.195:0/866342686 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0e4101280 0x7fe0e4195b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:05.143 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:05.140+0000 7fe0e9fbc640 1 --2- 172.21.15.195:0/866342686 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0e40ff7c0 0x7fe0e4195620 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:05.143 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:05.140+0000 7fe0e9fbc640 1 -- 172.21.15.195:0/866342686 >> 172.21.15.195:0/866342686 conn(0x7fe0e40fb330 msgr2=0x7fe0e4103fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:01:05.143 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:05.140+0000 7fe0e9fbc640 1 -- 172.21.15.195:0/866342686 shutdown_connections 2024-09-13T17:01:05.143 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:05.141+0000 7fe0e9fbc640 1 -- 172.21.15.195:0/866342686 wait complete. 2024-09-13T17:01:05.722 DEBUG:teuthology.orchestra.run.smithi195:osd.3> sudo journalctl -f -n 0 -u ceph-ffbd7588-71f0-11ef-bceb-c7b262605968@osd.3.service 2024-09-13T17:01:05.724 INFO:tasks.cephadm:Deploying osd.4 on smithi195 with /dev/vg_nvme/lv_3... 2024-09-13T17:01:05.724 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-09-13T17:01:05.978 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/mon.smithi195/config 2024-09-13T17:01:06.413 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:06 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:01:06.413 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:06 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:01:06.413 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:06 smithi195 ceph-mon[34981]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-13T17:01:06.413 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:06 smithi195 ceph-mon[34981]: from='osd.3 [v2:172.21.15.195:6800/3054971968,v1:172.21.15.195:6801/3054971968]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T17:01:06.413 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:06 smithi195 ceph-mon[34981]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T17:01:06.413 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:06 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:01:06.414 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:06 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:01:06.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:06 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:01:06.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:06 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:01:06.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:06 smithi115 ceph-mon[27708]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-13T17:01:06.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:06 smithi115 ceph-mon[27708]: from='osd.3 [v2:172.21.15.195:6800/3054971968,v1:172.21.15.195:6801/3054971968]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T17:01:06.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:06 smithi115 ceph-mon[27708]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T17:01:06.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:06 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:01:06.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:06 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:01:07.265 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:07 smithi195 ceph-mon[34981]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-13T17:01:07.265 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:07 smithi195 ceph-mon[34981]: osdmap e24: 4 total, 3 up, 4 in 2024-09-13T17:01:07.266 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:07 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T17:01:07.266 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:07 smithi195 ceph-mon[34981]: from='osd.3 [v2:172.21.15.195:6800/3054971968,v1:172.21.15.195:6801/3054971968]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-09-13T17:01:07.266 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:07 smithi195 ceph-mon[34981]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-09-13T17:01:07.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:07 smithi115 ceph-mon[27708]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-13T17:01:07.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:07 smithi115 ceph-mon[27708]: osdmap e24: 4 total, 3 up, 4 in 2024-09-13T17:01:07.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:07 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T17:01:07.430 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:07 smithi115 ceph-mon[27708]: from='osd.3 [v2:172.21.15.195:6800/3054971968,v1:172.21.15.195:6801/3054971968]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-09-13T17:01:07.430 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:07 smithi115 ceph-mon[27708]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-09-13T17:01:08.134 INFO:journalctl@ceph.osd.3.smithi195.stdout:Sep 13 17:01:07 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-3[40836]: 2024-09-13T17:01:07.866+0000 7ff11c813640 -1 osd.3 0 waiting for initial osdmap 2024-09-13T17:01:08.134 INFO:journalctl@ceph.osd.3.smithi195.stdout:Sep 13 17:01:07 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-3[40836]: 2024-09-13T17:01:07.874+0000 7ff114e46640 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T17:01:08.303 INFO:teuthology.orchestra.run.smithi195.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-09-13T17:01:08.392 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:08 smithi195 ceph-mon[34981]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2024-09-13T17:01:08.392 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:08 smithi195 ceph-mon[34981]: osdmap e25: 4 total, 3 up, 4 in 2024-09-13T17:01:08.393 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:08 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T17:01:08.393 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:08 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T17:01:08.393 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:08 smithi195 ceph-mon[34981]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-13T17:01:08.393 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:08 smithi195 ceph-mon[34981]: from='osd.3 ' entity='osd.3' 2024-09-13T17:01:08.393 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-09-13T17:01:08.404 INFO:teuthology.orchestra.run.smithi195.stderr: stderr: 10+0 records in 2024-09-13T17:01:08.404 INFO:teuthology.orchestra.run.smithi195.stderr:10+0 records out 2024-09-13T17:01:08.404 INFO:teuthology.orchestra.run.smithi195.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00982003 s, 1.1 GB/s 2024-09-13T17:01:08.405 INFO:teuthology.orchestra.run.smithi195.stderr:--> Zapping successful for: 2024-09-13T17:01:08.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:08 smithi115 ceph-mon[27708]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2024-09-13T17:01:08.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:08 smithi115 ceph-mon[27708]: osdmap e25: 4 total, 3 up, 4 in 2024-09-13T17:01:08.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:08 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T17:01:08.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:08 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T17:01:08.430 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:08 smithi115 ceph-mon[27708]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-13T17:01:08.430 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:08 smithi115 ceph-mon[27708]: from='osd.3 ' entity='osd.3' 2024-09-13T17:01:09.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:09 smithi115 ceph-mon[27708]: purged_snaps scrub starts 2024-09-13T17:01:09.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:09 smithi115 ceph-mon[27708]: purged_snaps scrub ok 2024-09-13T17:01:09.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:09 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T17:01:09.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:09 smithi115 ceph-mon[27708]: osd.3 [v2:172.21.15.195:6800/3054971968,v1:172.21.15.195:6801/3054971968] boot 2024-09-13T17:01:09.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:09 smithi115 ceph-mon[27708]: osdmap e26: 4 total, 4 up, 4 in 2024-09-13T17:01:09.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:09 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T17:01:09.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:09 smithi115 ceph-mon[27708]: osdmap e27: 4 total, 4 up, 4 in 2024-09-13T17:01:09.493 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:09 smithi195 ceph-mon[34981]: purged_snaps scrub starts 2024-09-13T17:01:09.493 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:09 smithi195 ceph-mon[34981]: purged_snaps scrub ok 2024-09-13T17:01:09.493 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:09 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T17:01:09.493 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:09 smithi195 ceph-mon[34981]: osd.3 [v2:172.21.15.195:6800/3054971968,v1:172.21.15.195:6801/3054971968] boot 2024-09-13T17:01:09.493 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:09 smithi195 ceph-mon[34981]: osdmap e26: 4 total, 4 up, 4 in 2024-09-13T17:01:09.493 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:09 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T17:01:09.493 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:09 smithi195 ceph-mon[34981]: osdmap e27: 4 total, 4 up, 4 in 2024-09-13T17:01:09.520 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi195:vg_nvme/lv_3 2024-09-13T17:01:10.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:10 smithi195 ceph-mon[34981]: pgmap v95: 1 pgs: 1 peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-13T17:01:10.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:10 smithi195 ceph-mon[34981]: osdmap e28: 4 total, 4 up, 4 in 2024-09-13T17:01:10.360 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/mon.smithi195/config 2024-09-13T17:01:10.428 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:10 smithi115 ceph-mon[27708]: pgmap v95: 1 pgs: 1 peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-13T17:01:10.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:10 smithi115 ceph-mon[27708]: osdmap e28: 4 total, 4 up, 4 in 2024-09-13T17:01:11.630 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:11 smithi195 ceph-mon[34981]: Detected new or changed devices on smithi195 2024-09-13T17:01:11.630 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:11 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:01:11.630 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:11 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:01:11.630 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:11 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:01:11.630 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:11 smithi195 ceph-mon[34981]: Adjusting osd_memory_target on smithi195 to 14912M 2024-09-13T17:01:11.630 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:11 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:01:11.630 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:11 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:01:11.631 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:11 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:01:11.631 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:11 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:01:11.631 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:11 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:01:11.631 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:11 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:01:11.631 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:11 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:01:11.631 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:11 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:01:11.631 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:11 smithi195 ceph-mon[34981]: osdmap e29: 4 total, 4 up, 4 in 2024-09-13T17:01:11.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:11 smithi115 ceph-mon[27708]: Detected new or changed devices on smithi195 2024-09-13T17:01:11.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:11 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:01:11.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:11 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:01:11.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:11 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:01:11.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:11 smithi115 ceph-mon[27708]: Adjusting osd_memory_target on smithi195 to 14912M 2024-09-13T17:01:11.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:11 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:01:11.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:11 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:01:11.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:11 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:01:11.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:11 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:01:11.680 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:11 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:01:11.680 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:11 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:01:11.680 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:11 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:01:11.680 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:11 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:01:11.680 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:11 smithi115 ceph-mon[27708]: osdmap e29: 4 total, 4 up, 4 in 2024-09-13T17:01:11.942 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:11.936+0000 7f7172bc5640 1 -- 172.21.15.195:0/3043762714 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f716c0fea30 msgr2=0x7f716c0fee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:01:11.943 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:11.936+0000 7f7172bc5640 1 --2- 172.21.15.195:0/3043762714 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f716c0fea30 0x7f716c0fee30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7160009880 tx=0x7f716002a4a0 comp rx=0 tx=0).stop 2024-09-13T17:01:11.943 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:11.936+0000 7f7172bc5640 1 -- 172.21.15.195:0/3043762714 shutdown_connections 2024-09-13T17:01:11.943 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:11.936+0000 7f7172bc5640 1 --2- 172.21.15.195:0/3043762714 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f716c0ffc30 0x7f716c1000b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:11.943 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:11.936+0000 7f7172bc5640 1 --2- 172.21.15.195:0/3043762714 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f716c0fea30 0x7f716c0fee30 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:11.943 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:11.936+0000 7f7172bc5640 1 -- 172.21.15.195:0/3043762714 >> 172.21.15.195:0/3043762714 conn(0x7f716c0fa1c0 msgr2=0x7f716c0fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:01:11.943 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:11.936+0000 7f7172bc5640 1 -- 172.21.15.195:0/3043762714 shutdown_connections 2024-09-13T17:01:11.943 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:11.936+0000 7f7172bc5640 1 -- 172.21.15.195:0/3043762714 wait complete. 2024-09-13T17:01:11.943 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:11.937+0000 7f7172bc5640 1 Processor -- start 2024-09-13T17:01:11.943 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:11.937+0000 7f7172bc5640 1 -- start start 2024-09-13T17:01:11.943 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:11.937+0000 7f7172bc5640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f716c0fea30 0x7f716c068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:01:11.943 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:11.937+0000 7f7172bc5640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f716c0ffc30 0x7f716c19a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:01:11.943 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:11.937+0000 7f7172bc5640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f716c19a9b0 con 0x7f716c0ffc30 2024-09-13T17:01:11.943 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:11.937+0000 7f7172bc5640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f716c19aaf0 con 0x7f716c0fea30 2024-09-13T17:01:11.944 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:11.937+0000 7f7170961640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f716c0fea30 0x7f716c068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:01:11.944 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:11.937+0000 7f7170961640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f716c0fea30 0x7f716c068740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:58606/0 (socket says 172.21.15.195:58606) 2024-09-13T17:01:11.944 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:11.937+0000 7f7170961640 1 -- 172.21.15.195:0/4145465525 learned_addr learned my addr 172.21.15.195:0/4145465525 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-09-13T17:01:11.944 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:11.937+0000 7f716bfff640 1 --2- 172.21.15.195:0/4145465525 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f716c0ffc30 0x7f716c19a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:01:11.944 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:11.937+0000 7f7170961640 1 -- 172.21.15.195:0/4145465525 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f716c0ffc30 msgr2=0x7f716c19a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:01:11.944 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:11.937+0000 7f7170961640 1 --2- 172.21.15.195:0/4145465525 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f716c0ffc30 0x7f716c19a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:11.944 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:11.937+0000 7f7170961640 1 -- 172.21.15.195:0/4145465525 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7160009560 con 0x7f716c0fea30 2024-09-13T17:01:11.944 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:11.938+0000 7f7170961640 1 --2- 172.21.15.195:0/4145465525 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f716c0fea30 0x7f716c068740 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7160005610 tx=0x7f7160005640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:01:11.944 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:11.938+0000 7f7169ffb640 1 -- 172.21.15.195:0/4145465525 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7160004b20 con 0x7f716c0fea30 2024-09-13T17:01:11.944 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:11.938+0000 7f7169ffb640 1 -- 172.21.15.195:0/4145465525 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7160004c80 con 0x7f716c0fea30 2024-09-13T17:01:11.944 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:11.938+0000 7f7172bc5640 1 -- 172.21.15.195:0/4145465525 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f716c19ad40 con 0x7f716c0fea30 2024-09-13T17:01:11.945 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:11.938+0000 7f7169ffb640 1 -- 172.21.15.195:0/4145465525 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7160031af0 con 0x7f716c0fea30 2024-09-13T17:01:11.945 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:11.938+0000 7f7172bc5640 1 -- 172.21.15.195:0/4145465525 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f716c19b2b0 con 0x7f716c0fea30 2024-09-13T17:01:11.945 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:11.939+0000 7f7172bc5640 1 -- 172.21.15.195:0/4145465525 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f716c107560 con 0x7f716c0fea30 2024-09-13T17:01:11.945 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:11.940+0000 7f7169ffb640 1 -- 172.21.15.195:0/4145465525 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f71600035f0 con 0x7f716c0fea30 2024-09-13T17:01:11.945 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:11.940+0000 7f7169ffb640 1 --2- 172.21.15.195:0/4145465525 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f715c06cc50 0x7f715c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:01:11.945 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:11.940+0000 7f7169ffb640 1 -- 172.21.15.195:0/4145465525 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 3774+0+0 (secure 0 0 0) 0x7f71600aced0 con 0x7f716c0fea30 2024-09-13T17:01:11.945 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:11.940+0000 7f716bfff640 1 --2- 172.21.15.195:0/4145465525 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f715c06cc50 0x7f715c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:01:11.945 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:11.941+0000 7f716bfff640 1 --2- 172.21.15.195:0/4145465525 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f715c06cc50 0x7f715c06f110 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f716c068cc0 tx=0x7f7158008040 comp rx=0 tx=0).ready entity=mgr.14207 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:01:11.946 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:11.945+0000 7f7169ffb640 1 -- 172.21.15.195:0/4145465525 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f7160077940 con 0x7f716c0fea30 2024-09-13T17:01:12.117 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:12.115+0000 7f7172bc5640 1 -- 172.21.15.195:0/4145465525 --> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f716c1045a0 con 0x7f715c06cc50 2024-09-13T17:01:12.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:12 smithi115 ceph-mon[27708]: pgmap v98: 1 pgs: 1 peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-13T17:01:12.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:12 smithi115 ceph-mon[27708]: osdmap e30: 4 total, 4 up, 4 in 2024-09-13T17:01:12.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:12 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T17:01:12.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:12 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T17:01:12.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:12 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:01:12.692 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:12 smithi195 ceph-mon[34981]: pgmap v98: 1 pgs: 1 peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-13T17:01:12.692 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:12 smithi195 ceph-mon[34981]: osdmap e30: 4 total, 4 up, 4 in 2024-09-13T17:01:12.692 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:12 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T17:01:12.692 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:12 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T17:01:12.692 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:12 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:01:13.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:13 smithi115 ceph-mon[27708]: from='client.24149 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:01:13.542 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:13 smithi195 ceph-mon[34981]: from='client.24149 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:01:14.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:14 smithi115 ceph-mon[27708]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 127 KiB/s, 0 objects/s recovering 2024-09-13T17:01:14.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:14 smithi115 ceph-mon[27708]: from='client.? 172.21.15.195:0/2462581810' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7bf484b6-6ed5-4fe7-8aa4-505853e2cd1d"}]: dispatch 2024-09-13T17:01:14.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:14 smithi115 ceph-mon[27708]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7bf484b6-6ed5-4fe7-8aa4-505853e2cd1d"}]: dispatch 2024-09-13T17:01:14.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:14 smithi115 ceph-mon[27708]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7bf484b6-6ed5-4fe7-8aa4-505853e2cd1d"}]': finished 2024-09-13T17:01:14.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:14 smithi115 ceph-mon[27708]: osdmap e31: 5 total, 4 up, 5 in 2024-09-13T17:01:14.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:14 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T17:01:14.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:14 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:01:14.763 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:14 smithi195 ceph-mon[34981]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 127 KiB/s, 0 objects/s recovering 2024-09-13T17:01:14.763 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:14 smithi195 ceph-mon[34981]: from='client.? 172.21.15.195:0/2462581810' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7bf484b6-6ed5-4fe7-8aa4-505853e2cd1d"}]: dispatch 2024-09-13T17:01:14.764 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:14 smithi195 ceph-mon[34981]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7bf484b6-6ed5-4fe7-8aa4-505853e2cd1d"}]: dispatch 2024-09-13T17:01:14.764 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:14 smithi195 ceph-mon[34981]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7bf484b6-6ed5-4fe7-8aa4-505853e2cd1d"}]': finished 2024-09-13T17:01:14.764 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:14 smithi195 ceph-mon[34981]: osdmap e31: 5 total, 4 up, 5 in 2024-09-13T17:01:14.764 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:14 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T17:01:14.764 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:14 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:01:15.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:15 smithi115 ceph-mon[27708]: from='client.? 172.21.15.195:0/4287632958' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T17:01:15.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:15 smithi195 ceph-mon[34981]: from='client.? 172.21.15.195:0/4287632958' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T17:01:16.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:16 smithi115 ceph-mon[27708]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 121 MiB used, 357 GiB / 358 GiB avail; 104 KiB/s, 0 objects/s recovering 2024-09-13T17:01:16.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:16 smithi195 ceph-mon[34981]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 121 MiB used, 357 GiB / 358 GiB avail; 104 KiB/s, 0 objects/s recovering 2024-09-13T17:01:18.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:18 smithi115 ceph-mon[27708]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 88 KiB/s, 0 objects/s recovering 2024-09-13T17:01:18.710 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:18 smithi195 ceph-mon[34981]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 88 KiB/s, 0 objects/s recovering 2024-09-13T17:01:20.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:20 smithi195 ceph-mon[34981]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-13T17:01:20.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:20 smithi115 ceph-mon[27708]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-13T17:01:21.579 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:21 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-13T17:01:21.579 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:21 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:01:21.680 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:21 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-13T17:01:21.680 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:21 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:01:22.528 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:22 smithi195 ceph-mon[34981]: Deploying daemon osd.4 on smithi195 2024-09-13T17:01:22.528 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:22 smithi195 ceph-mon[34981]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-09-13T17:01:22.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:22 smithi115 ceph-mon[27708]: Deploying daemon osd.4 on smithi195 2024-09-13T17:01:22.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:22 smithi115 ceph-mon[27708]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-09-13T17:01:24.627 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:24 smithi195 ceph-mon[34981]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-13T17:01:24.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:24 smithi115 ceph-mon[27708]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-13T17:01:26.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:26 smithi115 ceph-mon[27708]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-13T17:01:26.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:26 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:01:26.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:26 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:01:26.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:26 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:01:26.807 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:26 smithi195 ceph-mon[34981]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-13T17:01:26.807 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:26 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:01:26.807 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:26 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:01:26.807 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:26 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:01:28.609 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:28 smithi195 ceph-mon[34981]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-13T17:01:28.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:28 smithi115 ceph-mon[27708]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-13T17:01:28.938 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:28.937+0000 7f7169ffb640 1 -- 172.21.15.195:0/4145465525 <== mgr.14207 v2:172.21.15.115:6800/244039928 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f716c1045a0 con 0x7f715c06cc50 2024-09-13T17:01:28.939 INFO:teuthology.orchestra.run.smithi195.stdout:Created osd(s) 4 on host 'smithi195' 2024-09-13T17:01:28.941 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:28.940+0000 7f7172bc5640 1 -- 172.21.15.195:0/4145465525 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f715c06cc50 msgr2=0x7f715c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:01:28.941 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:28.940+0000 7f7172bc5640 1 --2- 172.21.15.195:0/4145465525 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f715c06cc50 0x7f715c06f110 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f716c068cc0 tx=0x7f7158008040 comp rx=0 tx=0).stop 2024-09-13T17:01:28.941 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:28.940+0000 7f7172bc5640 1 -- 172.21.15.195:0/4145465525 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f716c0fea30 msgr2=0x7f716c068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:01:28.941 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:28.940+0000 7f7172bc5640 1 --2- 172.21.15.195:0/4145465525 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f716c0fea30 0x7f716c068740 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7160005610 tx=0x7f7160005640 comp rx=0 tx=0).stop 2024-09-13T17:01:28.941 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:28.940+0000 7f7172bc5640 1 -- 172.21.15.195:0/4145465525 shutdown_connections 2024-09-13T17:01:28.942 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:28.940+0000 7f7172bc5640 1 --2- 172.21.15.195:0/4145465525 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f715c06cc50 0x7f715c06f110 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:28.942 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:28.940+0000 7f7172bc5640 1 --2- 172.21.15.195:0/4145465525 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f716c0ffc30 0x7f716c19a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:28.942 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:28.940+0000 7f7172bc5640 1 --2- 172.21.15.195:0/4145465525 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f716c0fea30 0x7f716c068740 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:28.942 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:28.940+0000 7f7172bc5640 1 -- 172.21.15.195:0/4145465525 >> 172.21.15.195:0/4145465525 conn(0x7f716c0fa1c0 msgr2=0x7f716c102e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:01:28.942 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:28.940+0000 7f7172bc5640 1 -- 172.21.15.195:0/4145465525 shutdown_connections 2024-09-13T17:01:28.942 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:28.940+0000 7f7172bc5640 1 -- 172.21.15.195:0/4145465525 wait complete. 2024-09-13T17:01:30.317 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:29 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:01:30.317 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:29 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:01:30.317 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:29 smithi195 ceph-mon[34981]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-13T17:01:30.317 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:29 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:01:30.317 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:29 smithi195 ceph-mon[34981]: from='osd.4 [v2:172.21.15.195:6808/1840094638,v1:172.21.15.195:6809/1840094638]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T17:01:30.317 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:29 smithi195 ceph-mon[34981]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T17:01:30.341 DEBUG:teuthology.orchestra.run.smithi195:osd.4> sudo journalctl -f -n 0 -u ceph-ffbd7588-71f0-11ef-bceb-c7b262605968@osd.4.service 2024-09-13T17:01:30.344 INFO:tasks.cephadm:Deploying osd.5 on smithi195 with /dev/vg_nvme/lv_2... 2024-09-13T17:01:30.344 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-09-13T17:01:30.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:29 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:01:30.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:29 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:01:30.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:29 smithi115 ceph-mon[27708]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-13T17:01:30.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:29 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:01:30.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:29 smithi115 ceph-mon[27708]: from='osd.4 [v2:172.21.15.195:6808/1840094638,v1:172.21.15.195:6809/1840094638]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T17:01:30.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:29 smithi115 ceph-mon[27708]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T17:01:30.584 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/mon.smithi195/config 2024-09-13T17:01:30.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:30 smithi195 ceph-mon[34981]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-13T17:01:30.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:30 smithi195 ceph-mon[34981]: osdmap e32: 5 total, 4 up, 5 in 2024-09-13T17:01:30.957 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:30 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T17:01:30.957 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:30 smithi195 ceph-mon[34981]: from='osd.4 [v2:172.21.15.195:6808/1840094638,v1:172.21.15.195:6809/1840094638]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-09-13T17:01:30.957 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:30 smithi195 ceph-mon[34981]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-09-13T17:01:30.957 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:30 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:01:30.957 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:30 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:01:30.957 INFO:journalctl@ceph.osd.4.smithi195.stdout:Sep 13 17:01:30 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-4[47256]: 2024-09-13T17:01:30.947+0000 7f07c0407640 -1 osd.4 0 waiting for initial osdmap 2024-09-13T17:01:30.957 INFO:journalctl@ceph.osd.4.smithi195.stdout:Sep 13 17:01:30 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-4[47256]: 2024-09-13T17:01:30.954+0000 7f07bca42640 -1 osd.4 33 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T17:01:31.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:30 smithi115 ceph-mon[27708]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-13T17:01:31.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:30 smithi115 ceph-mon[27708]: osdmap e32: 5 total, 4 up, 5 in 2024-09-13T17:01:31.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:30 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T17:01:31.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:30 smithi115 ceph-mon[27708]: from='osd.4 [v2:172.21.15.195:6808/1840094638,v1:172.21.15.195:6809/1840094638]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-09-13T17:01:31.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:30 smithi115 ceph-mon[27708]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-09-13T17:01:31.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:30 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:01:31.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:30 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:01:32.060 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:31 smithi195 ceph-mon[34981]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2024-09-13T17:01:32.060 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:31 smithi195 ceph-mon[34981]: osdmap e33: 5 total, 4 up, 5 in 2024-09-13T17:01:32.061 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:31 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T17:01:32.061 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:31 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T17:01:32.061 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:31 smithi195 ceph-mon[34981]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-13T17:01:32.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:31 smithi115 ceph-mon[27708]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2024-09-13T17:01:32.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:31 smithi115 ceph-mon[27708]: osdmap e33: 5 total, 4 up, 5 in 2024-09-13T17:01:32.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:31 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T17:01:32.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:31 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T17:01:32.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:31 smithi115 ceph-mon[27708]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-13T17:01:33.237 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:32 smithi195 ceph-mon[34981]: purged_snaps scrub starts 2024-09-13T17:01:33.237 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:32 smithi195 ceph-mon[34981]: purged_snaps scrub ok 2024-09-13T17:01:33.237 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:32 smithi195 ceph-mon[34981]: osd.4 [v2:172.21.15.195:6808/1840094638,v1:172.21.15.195:6809/1840094638] boot 2024-09-13T17:01:33.237 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:32 smithi195 ceph-mon[34981]: osdmap e34: 5 total, 5 up, 5 in 2024-09-13T17:01:33.237 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:32 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T17:01:33.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:32 smithi115 ceph-mon[27708]: purged_snaps scrub starts 2024-09-13T17:01:33.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:32 smithi115 ceph-mon[27708]: purged_snaps scrub ok 2024-09-13T17:01:33.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:32 smithi115 ceph-mon[27708]: osd.4 [v2:172.21.15.195:6808/1840094638,v1:172.21.15.195:6809/1840094638] boot 2024-09-13T17:01:33.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:32 smithi115 ceph-mon[27708]: osdmap e34: 5 total, 5 up, 5 in 2024-09-13T17:01:33.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:32 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T17:01:33.755 INFO:teuthology.orchestra.run.smithi195.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-09-13T17:01:33.831 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-09-13T17:01:33.843 INFO:teuthology.orchestra.run.smithi195.stderr: stderr: 10+0 records in 2024-09-13T17:01:33.843 INFO:teuthology.orchestra.run.smithi195.stderr:10+0 records out 2024-09-13T17:01:33.843 INFO:teuthology.orchestra.run.smithi195.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0100749 s, 1.0 GB/s 2024-09-13T17:01:33.843 INFO:teuthology.orchestra.run.smithi195.stderr:--> Zapping successful for: 2024-09-13T17:01:34.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:33 smithi195 ceph-mon[34981]: osdmap e35: 5 total, 5 up, 5 in 2024-09-13T17:01:34.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:33 smithi195 ceph-mon[34981]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:01:34.428 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:33 smithi115 ceph-mon[27708]: osdmap e35: 5 total, 5 up, 5 in 2024-09-13T17:01:34.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:33 smithi115 ceph-mon[27708]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:01:34.966 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi195:vg_nvme/lv_2 2024-09-13T17:01:35.159 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/mon.smithi195/config 2024-09-13T17:01:35.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:35 smithi195 ceph-mon[34981]: Detected new or changed devices on smithi195 2024-09-13T17:01:35.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:35 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:01:35.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:35 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:01:35.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:35 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:01:35.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:35 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:01:35.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:35 smithi195 ceph-mon[34981]: Adjusting osd_memory_target on smithi195 to 7456M 2024-09-13T17:01:35.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:35 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:01:35.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:35 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:01:35.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:35 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:01:35.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:35 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:01:35.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:35 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:01:35.578 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:35 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:01:35.578 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:35 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:01:35.578 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:35 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:01:35.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:35 smithi115 ceph-mon[27708]: Detected new or changed devices on smithi195 2024-09-13T17:01:35.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:35 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:01:35.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:35 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:01:35.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:35 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:01:35.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:35 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:01:35.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:35 smithi115 ceph-mon[27708]: Adjusting osd_memory_target on smithi195 to 7456M 2024-09-13T17:01:35.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:35 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:01:35.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:35 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:01:35.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:35 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:01:35.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:35 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:01:35.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:35 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:01:35.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:35 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:01:35.680 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:35 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:01:35.680 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:35 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:01:36.638 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:36 smithi195 ceph-mon[34981]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:01:36.646 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:36.643+0000 7ff295e6b640 1 -- 172.21.15.195:0/2561296335 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff2900ffb90 msgr2=0x7ff2900fff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:01:36.646 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:36.643+0000 7ff295e6b640 1 --2- 172.21.15.195:0/2561296335 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff2900ffb90 0x7ff2900fff90 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff278009880 tx=0x7ff27802a4a0 comp rx=0 tx=0).stop 2024-09-13T17:01:36.646 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:36.643+0000 7ff295e6b640 1 -- 172.21.15.195:0/2561296335 shutdown_connections 2024-09-13T17:01:36.646 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:36.643+0000 7ff295e6b640 1 --2- 172.21.15.195:0/2561296335 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff290100d90 0x7ff290101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:36.646 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:36.643+0000 7ff295e6b640 1 --2- 172.21.15.195:0/2561296335 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff2900ffb90 0x7ff2900fff90 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:36.646 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:36.643+0000 7ff295e6b640 1 -- 172.21.15.195:0/2561296335 >> 172.21.15.195:0/2561296335 conn(0x7ff2900fb320 msgr2=0x7ff2900fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:01:36.646 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:36.643+0000 7ff295e6b640 1 -- 172.21.15.195:0/2561296335 shutdown_connections 2024-09-13T17:01:36.646 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:36.643+0000 7ff295e6b640 1 -- 172.21.15.195:0/2561296335 wait complete. 2024-09-13T17:01:36.646 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:36.643+0000 7ff295e6b640 1 Processor -- start 2024-09-13T17:01:36.646 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:36.644+0000 7ff295e6b640 1 -- start start 2024-09-13T17:01:36.648 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:36.644+0000 7ff295e6b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff2900ffb90 0x7ff290195650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:01:36.648 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:36.644+0000 7ff295e6b640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff290100d90 0x7ff290195b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:01:36.648 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:36.644+0000 7ff295e6b640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff290196160 con 0x7ff2900ffb90 2024-09-13T17:01:36.648 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:36.644+0000 7ff295e6b640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2901962d0 con 0x7ff290100d90 2024-09-13T17:01:36.649 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:36.644+0000 7ff28effd640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff290100d90 0x7ff290195b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:01:36.649 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:36.644+0000 7ff28effd640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff290100d90 0x7ff290195b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:55224/0 (socket says 172.21.15.195:55224) 2024-09-13T17:01:36.649 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:36.644+0000 7ff28effd640 1 -- 172.21.15.195:0/4007544335 learned_addr learned my addr 172.21.15.195:0/4007544335 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-09-13T17:01:36.649 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:36.644+0000 7ff28f7fe640 1 --2- 172.21.15.195:0/4007544335 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff2900ffb90 0x7ff290195650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:01:36.649 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:36.644+0000 7ff28effd640 1 -- 172.21.15.195:0/4007544335 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff2900ffb90 msgr2=0x7ff290195650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:01:36.649 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:36.644+0000 7ff28effd640 1 --2- 172.21.15.195:0/4007544335 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff2900ffb90 0x7ff290195650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:36.649 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:36.644+0000 7ff28effd640 1 -- 172.21.15.195:0/4007544335 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff278009560 con 0x7ff290100d90 2024-09-13T17:01:36.649 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:36.644+0000 7ff28f7fe640 1 --2- 172.21.15.195:0/4007544335 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff2900ffb90 0x7ff290195650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:01:36.649 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:36.644+0000 7ff28effd640 1 --2- 172.21.15.195:0/4007544335 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff290100d90 0x7ff290195b90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff28000b420 tx=0x7ff28000b8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:01:36.649 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:36.645+0000 7ff28cff9640 1 -- 172.21.15.195:0/4007544335 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff280011800 con 0x7ff290100d90 2024-09-13T17:01:36.649 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:36.645+0000 7ff295e6b640 1 -- 172.21.15.195:0/4007544335 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff29019ad70 con 0x7ff290100d90 2024-09-13T17:01:36.649 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:36.645+0000 7ff28cff9640 1 -- 172.21.15.195:0/4007544335 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff280011e00 con 0x7ff290100d90 2024-09-13T17:01:36.649 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:36.645+0000 7ff28cff9640 1 -- 172.21.15.195:0/4007544335 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff28000f2e0 con 0x7ff290100d90 2024-09-13T17:01:36.650 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:36.645+0000 7ff295e6b640 1 -- 172.21.15.195:0/4007544335 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff29019b340 con 0x7ff290100d90 2024-09-13T17:01:36.650 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:36.646+0000 7ff295e6b640 1 -- 172.21.15.195:0/4007544335 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2901086c0 con 0x7ff290100d90 2024-09-13T17:01:36.650 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:36.646+0000 7ff28cff9640 1 -- 172.21.15.195:0/4007544335 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7ff280010380 con 0x7ff290100d90 2024-09-13T17:01:36.650 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:36.647+0000 7ff28cff9640 1 --2- 172.21.15.195:0/4007544335 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7ff27c06cc50 0x7ff27c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:01:36.650 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:36.647+0000 7ff28cff9640 1 -- 172.21.15.195:0/4007544335 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4206+0+0 (secure 0 0 0) 0x7ff28008b6b0 con 0x7ff290100d90 2024-09-13T17:01:36.650 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:36.647+0000 7ff28f7fe640 1 --2- 172.21.15.195:0/4007544335 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7ff27c06cc50 0x7ff27c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:01:36.650 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:36.647+0000 7ff28f7fe640 1 --2- 172.21.15.195:0/4007544335 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7ff27c06cc50 0x7ff27c06f110 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff278031460 tx=0x7ff278005de0 comp rx=0 tx=0).ready entity=mgr.14207 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:01:36.653 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:36.651+0000 7ff28cff9640 1 -- 172.21.15.195:0/4007544335 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff280055f70 con 0x7ff290100d90 2024-09-13T17:01:36.823 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:36.821+0000 7ff295e6b640 1 -- 172.21.15.195:0/4007544335 --> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7ff29019b590 con 0x7ff27c06cc50 2024-09-13T17:01:36.928 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:36 smithi115 ceph-mon[27708]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:01:37.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:37 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T17:01:37.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:37 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T17:01:37.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:37 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:01:37.928 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:37 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T17:01:37.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:37 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T17:01:37.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:37 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:01:38.784 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:38 smithi195 ceph-mon[34981]: from='client.24167 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:01:38.784 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:38 smithi195 ceph-mon[34981]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:01:38.928 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:38 smithi115 ceph-mon[27708]: from='client.24167 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:01:38.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:38 smithi115 ceph-mon[27708]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:01:39.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:39 smithi195 ceph-mon[34981]: from='client.? 172.21.15.195:0/2997029173' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1eb8bcc4-dc9b-4a00-bf43-a707da3c141f"}]: dispatch 2024-09-13T17:01:39.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:39 smithi195 ceph-mon[34981]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1eb8bcc4-dc9b-4a00-bf43-a707da3c141f"}]: dispatch 2024-09-13T17:01:39.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:39 smithi195 ceph-mon[34981]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1eb8bcc4-dc9b-4a00-bf43-a707da3c141f"}]': finished 2024-09-13T17:01:39.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:39 smithi195 ceph-mon[34981]: osdmap e36: 6 total, 5 up, 6 in 2024-09-13T17:01:39.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:39 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T17:01:39.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:39 smithi115 ceph-mon[27708]: from='client.? 172.21.15.195:0/2997029173' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1eb8bcc4-dc9b-4a00-bf43-a707da3c141f"}]: dispatch 2024-09-13T17:01:39.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:39 smithi115 ceph-mon[27708]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1eb8bcc4-dc9b-4a00-bf43-a707da3c141f"}]: dispatch 2024-09-13T17:01:39.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:39 smithi115 ceph-mon[27708]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1eb8bcc4-dc9b-4a00-bf43-a707da3c141f"}]': finished 2024-09-13T17:01:39.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:39 smithi115 ceph-mon[27708]: osdmap e36: 6 total, 5 up, 6 in 2024-09-13T17:01:39.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:39 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T17:01:40.808 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:40 smithi115 ceph-mon[27708]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:01:40.808 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:40 smithi115 ceph-mon[27708]: from='client.? 172.21.15.195:0/666679542' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T17:01:40.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:40 smithi195 ceph-mon[34981]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:01:40.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:40 smithi195 ceph-mon[34981]: from='client.? 172.21.15.195:0/666679542' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T17:01:42.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:42 smithi195 ceph-mon[34981]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:01:42.928 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:42 smithi115 ceph-mon[27708]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:01:44.746 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:44 smithi195 ceph-mon[34981]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:01:44.747 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:44 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:01:44.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:44 smithi115 ceph-mon[27708]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:01:44.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:44 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:01:45.635 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:45 smithi195 ceph-mon[34981]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:01:45.868 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:45 smithi115 ceph-mon[27708]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:01:46.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:46 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-13T17:01:46.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:46 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:01:46.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:46 smithi195 ceph-mon[34981]: Deploying daemon osd.5 on smithi195 2024-09-13T17:01:46.928 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:46 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-13T17:01:46.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:46 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:01:46.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:46 smithi115 ceph-mon[27708]: Deploying daemon osd.5 on smithi195 2024-09-13T17:01:47.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:47 smithi195 ceph-mon[34981]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:01:47.928 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:47 smithi115 ceph-mon[27708]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:01:50.533 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:50 smithi195 ceph-mon[34981]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:01:50.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:50 smithi115 ceph-mon[27708]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:01:51.568 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:51 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:01:51.568 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:51 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:01:51.568 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:51 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:01:51.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:51 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:01:51.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:51 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:01:51.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:51 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:01:52.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:52 smithi195 ceph-mon[34981]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:01:52.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:52 smithi115 ceph-mon[27708]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:01:53.983 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:53.982+0000 7ff28cff9640 1 -- 172.21.15.195:0/4007544335 <== mgr.14207 v2:172.21.15.115:6800/244039928 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7ff29019b590 con 0x7ff27c06cc50 2024-09-13T17:01:53.984 INFO:teuthology.orchestra.run.smithi195.stdout:Created osd(s) 5 on host 'smithi195' 2024-09-13T17:01:53.986 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:53.984+0000 7ff295e6b640 1 -- 172.21.15.195:0/4007544335 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7ff27c06cc50 msgr2=0x7ff27c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:01:53.986 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:53.984+0000 7ff295e6b640 1 --2- 172.21.15.195:0/4007544335 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7ff27c06cc50 0x7ff27c06f110 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff278031460 tx=0x7ff278005de0 comp rx=0 tx=0).stop 2024-09-13T17:01:53.986 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:53.984+0000 7ff295e6b640 1 -- 172.21.15.195:0/4007544335 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff290100d90 msgr2=0x7ff290195b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:01:53.986 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:53.984+0000 7ff295e6b640 1 --2- 172.21.15.195:0/4007544335 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff290100d90 0x7ff290195b90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff28000b420 tx=0x7ff28000b8e0 comp rx=0 tx=0).stop 2024-09-13T17:01:53.986 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:53.984+0000 7ff295e6b640 1 -- 172.21.15.195:0/4007544335 shutdown_connections 2024-09-13T17:01:53.986 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:53.984+0000 7ff295e6b640 1 --2- 172.21.15.195:0/4007544335 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7ff27c06cc50 0x7ff27c06f110 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:53.986 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:53.984+0000 7ff295e6b640 1 --2- 172.21.15.195:0/4007544335 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff290100d90 0x7ff290195b90 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:53.986 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:53.984+0000 7ff295e6b640 1 --2- 172.21.15.195:0/4007544335 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff2900ffb90 0x7ff290195650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:53.986 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:53.984+0000 7ff295e6b640 1 -- 172.21.15.195:0/4007544335 >> 172.21.15.195:0/4007544335 conn(0x7ff2900fb320 msgr2=0x7ff290103fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:01:53.986 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:53.984+0000 7ff295e6b640 1 -- 172.21.15.195:0/4007544335 shutdown_connections 2024-09-13T17:01:53.986 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:01:53.984+0000 7ff295e6b640 1 -- 172.21.15.195:0/4007544335 wait complete. 2024-09-13T17:01:54.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:54 smithi195 ceph-mon[34981]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:01:54.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:54 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:01:54.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:54 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:01:54.630 DEBUG:teuthology.orchestra.run.smithi195:osd.5> sudo journalctl -f -n 0 -u ceph-ffbd7588-71f0-11ef-bceb-c7b262605968@osd.5.service 2024-09-13T17:01:54.633 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2024-09-13T17:01:54.633 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-13T17:01:54.661 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:54 smithi115 ceph-mon[27708]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:01:54.661 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:54 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:01:54.661 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:54 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:01:54.846 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T17:01:55.576 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:55 smithi195 ceph-mon[34981]: from='osd.5 [v2:172.21.15.195:6816/1862675419,v1:172.21.15.195:6817/1862675419]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T17:01:55.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:55 smithi195 ceph-mon[34981]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T17:01:55.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:55 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:01:55.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:55 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:01:55.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:55 smithi115 ceph-mon[27708]: from='osd.5 [v2:172.21.15.195:6816/1862675419,v1:172.21.15.195:6817/1862675419]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T17:01:55.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:55 smithi115 ceph-mon[27708]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T17:01:55.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:55 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:01:55.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:55 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:01:56.524 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:56 smithi115 ceph-mon[27708]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:01:56.524 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:56 smithi115 ceph-mon[27708]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-13T17:01:56.524 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:56 smithi115 ceph-mon[27708]: osdmap e37: 6 total, 5 up, 6 in 2024-09-13T17:01:56.524 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:56 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T17:01:56.524 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:56 smithi115 ceph-mon[27708]: from='osd.5 [v2:172.21.15.195:6816/1862675419,v1:172.21.15.195:6817/1862675419]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-09-13T17:01:56.524 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:56 smithi115 ceph-mon[27708]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-09-13T17:01:56.527 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:01:56.522+0000 7f948efb8640 1 -- 172.21.15.115:0/655075115 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94880fea30 msgr2=0x7f94880fee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:01:56.527 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:01:56.522+0000 7f948efb8640 1 --2- 172.21.15.115:0/655075115 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94880fea30 0x7f94880fee30 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f947c009c20 tx=0x7f947c02a970 comp rx=0 tx=0).stop 2024-09-13T17:01:56.527 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:01:56.522+0000 7f948efb8640 1 -- 172.21.15.115:0/655075115 shutdown_connections 2024-09-13T17:01:56.527 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:01:56.522+0000 7f948efb8640 1 --2- 172.21.15.115:0/655075115 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f94880ffc30 0x7f94881000b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:56.527 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:01:56.522+0000 7f948efb8640 1 --2- 172.21.15.115:0/655075115 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94880fea30 0x7f94880fee30 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:56.527 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:01:56.522+0000 7f948efb8640 1 -- 172.21.15.115:0/655075115 >> 172.21.15.115:0/655075115 conn(0x7f94880fa1c0 msgr2=0x7f94880fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:01:56.527 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:01:56.522+0000 7f948efb8640 1 -- 172.21.15.115:0/655075115 shutdown_connections 2024-09-13T17:01:56.527 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:01:56.522+0000 7f948efb8640 1 -- 172.21.15.115:0/655075115 wait complete. 2024-09-13T17:01:56.528 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:01:56.522+0000 7f948efb8640 1 Processor -- start 2024-09-13T17:01:56.528 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:01:56.522+0000 7f948efb8640 1 -- start start 2024-09-13T17:01:56.528 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:01:56.523+0000 7f948efb8640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f94880fea30 0x7f9488068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:01:56.528 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:01:56.523+0000 7f948efb8640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94880ffc30 0x7f948819a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:01:56.528 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:01:56.523+0000 7f948efb8640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f948819a9d0 con 0x7f94880ffc30 2024-09-13T17:01:56.528 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:01:56.523+0000 7f948efb8640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f948819ab10 con 0x7f94880fea30 2024-09-13T17:01:56.528 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:01:56.523+0000 7f9487fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94880ffc30 0x7f948819a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:01:56.528 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:01:56.523+0000 7f9487fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94880ffc30 0x7f948819a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:55206/0 (socket says 172.21.15.115:55206) 2024-09-13T17:01:56.528 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:01:56.523+0000 7f9487fff640 1 -- 172.21.15.115:0/1665309623 learned_addr learned my addr 172.21.15.115:0/1665309623 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:01:56.528 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:01:56.523+0000 7f948cd54640 1 --2- 172.21.15.115:0/1665309623 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f94880fea30 0x7f9488068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:01:56.528 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:01:56.523+0000 7f9487fff640 1 -- 172.21.15.115:0/1665309623 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f94880fea30 msgr2=0x7f9488068740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:01:56.528 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:01:56.523+0000 7f9487fff640 1 --2- 172.21.15.115:0/1665309623 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f94880fea30 0x7f9488068740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:56.529 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:01:56.523+0000 7f9487fff640 1 -- 172.21.15.115:0/1665309623 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f947c009900 con 0x7f94880ffc30 2024-09-13T17:01:56.529 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:01:56.523+0000 7f9487fff640 1 --2- 172.21.15.115:0/1665309623 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94880ffc30 0x7f948819a400 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f947400b420 tx=0x7f947400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:01:56.529 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:01:56.523+0000 7f9485ffb640 1 -- 172.21.15.115:0/1665309623 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9474011800 con 0x7f94880ffc30 2024-09-13T17:01:56.529 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:01:56.523+0000 7f948efb8640 1 -- 172.21.15.115:0/1665309623 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f948819adc0 con 0x7f94880ffc30 2024-09-13T17:01:56.529 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:01:56.523+0000 7f9485ffb640 1 -- 172.21.15.115:0/1665309623 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9474011e00 con 0x7f94880ffc30 2024-09-13T17:01:56.529 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:01:56.523+0000 7f9485ffb640 1 -- 172.21.15.115:0/1665309623 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f947400f2e0 con 0x7f94880ffc30 2024-09-13T17:01:56.529 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:01:56.524+0000 7f948efb8640 1 -- 172.21.15.115:0/1665309623 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f948819b360 con 0x7f94880ffc30 2024-09-13T17:01:56.529 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:01:56.525+0000 7f948efb8640 1 -- 172.21.15.115:0/1665309623 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94880feeb0 con 0x7f94880ffc30 2024-09-13T17:01:56.529 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:01:56.525+0000 7f9485ffb640 1 -- 172.21.15.115:0/1665309623 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f9474010380 con 0x7f94880ffc30 2024-09-13T17:01:56.529 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:01:56.525+0000 7f9485ffb640 1 --2- 172.21.15.115:0/1665309623 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f947806cc50 0x7f947806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:01:56.529 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:01:56.526+0000 7f9485ffb640 1 -- 172.21.15.115:0/1665309623 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4358+0+0 (secure 0 0 0) 0x7f947408b690 con 0x7f94880ffc30 2024-09-13T17:01:56.529 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:01:56.526+0000 7f948cd54640 1 --2- 172.21.15.115:0/1665309623 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f947806cc50 0x7f947806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:01:56.530 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:01:56.526+0000 7f948cd54640 1 --2- 172.21.15.115:0/1665309623 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f947806cc50 0x7f947806f110 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f947c02ae90 tx=0x7f947c03d040 comp rx=0 tx=0).ready entity=mgr.14207 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:01:56.532 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:01:56.531+0000 7f9485ffb640 1 -- 172.21.15.115:0/1665309623 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f9474055eb0 con 0x7f94880ffc30 2024-09-13T17:01:56.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:56 smithi195 ceph-mon[34981]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:01:56.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:56 smithi195 ceph-mon[34981]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-13T17:01:56.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:56 smithi195 ceph-mon[34981]: osdmap e37: 6 total, 5 up, 6 in 2024-09-13T17:01:56.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:56 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T17:01:56.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:56 smithi195 ceph-mon[34981]: from='osd.5 [v2:172.21.15.195:6816/1862675419,v1:172.21.15.195:6817/1862675419]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-09-13T17:01:56.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:56 smithi195 ceph-mon[34981]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-09-13T17:01:56.577 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:01:56 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-5[54144]: 2024-09-13T17:01:56.277+0000 7f3afbb1f640 -1 osd.5 0 waiting for initial osdmap 2024-09-13T17:01:56.578 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:01:56 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-5[54144]: 2024-09-13T17:01:56.285+0000 7f3af815a640 -1 osd.5 38 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T17:01:56.695 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:01:56.693+0000 7f948efb8640 1 -- 172.21.15.115:0/1665309623 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f9488107560 con 0x7f94880ffc30 2024-09-13T17:01:56.695 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:01:56.694+0000 7f9485ffb640 1 -- 172.21.15.115:0/1665309623 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v38) v1 ==== 74+0+130 (secure 0 0 0) 0x7f94740594d0 con 0x7f94880ffc30 2024-09-13T17:01:56.695 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:01:56.697 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:01:56.696+0000 7f948efb8640 1 -- 172.21.15.115:0/1665309623 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f947806cc50 msgr2=0x7f947806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:01:56.698 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:01:56.696+0000 7f948efb8640 1 --2- 172.21.15.115:0/1665309623 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f947806cc50 0x7f947806f110 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f947c02ae90 tx=0x7f947c03d040 comp rx=0 tx=0).stop 2024-09-13T17:01:56.698 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:01:56.696+0000 7f948efb8640 1 -- 172.21.15.115:0/1665309623 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94880ffc30 msgr2=0x7f948819a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:01:56.698 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:01:56.696+0000 7f948efb8640 1 --2- 172.21.15.115:0/1665309623 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94880ffc30 0x7f948819a400 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f947400b420 tx=0x7f947400b8e0 comp rx=0 tx=0).stop 2024-09-13T17:01:56.698 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:01:56.696+0000 7f948efb8640 1 -- 172.21.15.115:0/1665309623 shutdown_connections 2024-09-13T17:01:56.698 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:01:56.696+0000 7f948efb8640 1 --2- 172.21.15.115:0/1665309623 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f947806cc50 0x7f947806f110 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:56.698 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:01:56.696+0000 7f948efb8640 1 --2- 172.21.15.115:0/1665309623 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94880ffc30 0x7f948819a400 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:56.698 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:01:56.696+0000 7f948efb8640 1 --2- 172.21.15.115:0/1665309623 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f94880fea30 0x7f9488068740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:01:56.698 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:01:56.696+0000 7f948efb8640 1 -- 172.21.15.115:0/1665309623 >> 172.21.15.115:0/1665309623 conn(0x7f94880fa1c0 msgr2=0x7f9488102e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:01:56.698 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:01:56.696+0000 7f948efb8640 1 -- 172.21.15.115:0/1665309623 shutdown_connections 2024-09-13T17:01:56.698 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:01:56.696+0000 7f948efb8640 1 -- 172.21.15.115:0/1665309623 wait complete. 2024-09-13T17:01:57.323 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:57 smithi115 ceph-mon[27708]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2024-09-13T17:01:57.323 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:57 smithi115 ceph-mon[27708]: osdmap e38: 6 total, 5 up, 6 in 2024-09-13T17:01:57.324 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:57 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T17:01:57.324 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:57 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T17:01:57.324 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:57 smithi115 ceph-mon[27708]: from='client.? 172.21.15.115:0/1665309623' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-13T17:01:57.346 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":38,"num_osds":6,"num_up_osds":5,"osd_up_since":1726246891,"num_in_osds":6,"osd_in_since":1726246899,"num_remapped_pgs":0} 2024-09-13T17:01:57.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:57 smithi195 ceph-mon[34981]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2024-09-13T17:01:57.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:57 smithi195 ceph-mon[34981]: osdmap e38: 6 total, 5 up, 6 in 2024-09-13T17:01:57.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:57 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T17:01:57.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:57 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T17:01:57.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:57 smithi195 ceph-mon[34981]: from='client.? 172.21.15.115:0/1665309623' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-13T17:01:58.347 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-13T17:01:58.552 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T17:01:58.558 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:58 smithi195 ceph-mon[34981]: purged_snaps scrub starts 2024-09-13T17:01:58.558 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:58 smithi195 ceph-mon[34981]: purged_snaps scrub ok 2024-09-13T17:01:58.558 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:58 smithi195 ceph-mon[34981]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:01:58.558 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:58 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T17:01:58.558 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:58 smithi195 ceph-mon[34981]: osd.5 [v2:172.21.15.195:6816/1862675419,v1:172.21.15.195:6817/1862675419] boot 2024-09-13T17:01:58.558 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:58 smithi195 ceph-mon[34981]: osdmap e39: 6 total, 6 up, 6 in 2024-09-13T17:01:58.558 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:58 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T17:01:58.567 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:58 smithi115 ceph-mon[27708]: purged_snaps scrub starts 2024-09-13T17:01:58.567 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:58 smithi115 ceph-mon[27708]: purged_snaps scrub ok 2024-09-13T17:01:58.567 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:58 smithi115 ceph-mon[27708]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:01:58.567 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:58 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T17:01:58.567 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:58 smithi115 ceph-mon[27708]: osd.5 [v2:172.21.15.195:6816/1862675419,v1:172.21.15.195:6817/1862675419] boot 2024-09-13T17:01:58.567 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:58 smithi115 ceph-mon[27708]: osdmap e39: 6 total, 6 up, 6 in 2024-09-13T17:01:58.567 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:58 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T17:01:59.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:59 smithi195 ceph-mon[34981]: osdmap e40: 6 total, 6 up, 6 in 2024-09-13T17:01:59.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:59 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:01:59.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:59 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:01:59.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:59 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:01:59.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:59 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:01:59.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:59 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:01:59.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:59 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:01:59.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:59 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:01:59.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:59 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:01:59.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:59 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:01:59.578 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:59 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:01:59.578 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:01:59 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:01:59.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:59 smithi115 ceph-mon[27708]: osdmap e40: 6 total, 6 up, 6 in 2024-09-13T17:01:59.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:59 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:01:59.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:59 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:01:59.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:59 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:01:59.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:59 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:01:59.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:59 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:01:59.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:59 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:01:59.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:59 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:01:59.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:59 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:01:59.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:59 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:01:59.680 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:59 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:01:59.680 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:01:59 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:02:00.428 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:00.363+0000 7fc3a747a640 1 -- 172.21.15.115:0/3561706975 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc3a0100d70 msgr2=0x7fc3a01011f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:00.428 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:00.363+0000 7fc3a747a640 1 --2- 172.21.15.115:0/3561706975 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc3a0100d70 0x7fc3a01011f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc390009880 tx=0x7fc39002a4a0 comp rx=0 tx=0).stop 2024-09-13T17:02:00.428 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:00.363+0000 7fc3a747a640 1 -- 172.21.15.115:0/3561706975 shutdown_connections 2024-09-13T17:02:00.428 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:00.363+0000 7fc3a747a640 1 --2- 172.21.15.115:0/3561706975 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc3a0100d70 0x7fc3a01011f0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:00.428 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:00.363+0000 7fc3a747a640 1 --2- 172.21.15.115:0/3561706975 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc3a00ffb70 0x7fc3a00fff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:00.428 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:00.363+0000 7fc3a747a640 1 -- 172.21.15.115:0/3561706975 >> 172.21.15.115:0/3561706975 conn(0x7fc3a00fb2e0 msgr2=0x7fc3a00fd740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:02:00.428 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:00.363+0000 7fc3a747a640 1 -- 172.21.15.115:0/3561706975 shutdown_connections 2024-09-13T17:02:00.428 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:00.363+0000 7fc3a747a640 1 -- 172.21.15.115:0/3561706975 wait complete. 2024-09-13T17:02:00.429 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:00.364+0000 7fc3a747a640 1 Processor -- start 2024-09-13T17:02:00.429 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:00.364+0000 7fc3a747a640 1 -- start start 2024-09-13T17:02:00.429 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:00.364+0000 7fc3a747a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc3a00ffb70 0x7fc3a0195510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:00.429 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:00.364+0000 7fc3a747a640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc3a0100d70 0x7fc3a0195a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:00.429 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:00.364+0000 7fc3a747a640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a0195f90 con 0x7fc3a00ffb70 2024-09-13T17:02:00.429 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:00.364+0000 7fc3a747a640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a0196100 con 0x7fc3a0100d70 2024-09-13T17:02:00.429 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:00.364+0000 7fc3a5216640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc3a00ffb70 0x7fc3a0195510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:00.429 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:00.364+0000 7fc3a5216640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc3a00ffb70 0x7fc3a0195510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:55218/0 (socket says 172.21.15.115:55218) 2024-09-13T17:02:00.429 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:00.364+0000 7fc3a5216640 1 -- 172.21.15.115:0/4174928014 learned_addr learned my addr 172.21.15.115:0/4174928014 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:02:00.429 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:00.364+0000 7fc3a4a15640 1 --2- 172.21.15.115:0/4174928014 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc3a0100d70 0x7fc3a0195a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:00.429 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:00.364+0000 7fc3a5216640 1 -- 172.21.15.115:0/4174928014 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc3a0100d70 msgr2=0x7fc3a0195a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:00.429 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:00.364+0000 7fc3a5216640 1 --2- 172.21.15.115:0/4174928014 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc3a0100d70 0x7fc3a0195a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:00.430 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:00.364+0000 7fc3a5216640 1 -- 172.21.15.115:0/4174928014 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc390009560 con 0x7fc3a00ffb70 2024-09-13T17:02:00.430 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:00.364+0000 7fc3a4a15640 1 --2- 172.21.15.115:0/4174928014 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc3a0100d70 0x7fc3a0195a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:02:00.430 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:00.365+0000 7fc3a5216640 1 --2- 172.21.15.115:0/4174928014 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc3a00ffb70 0x7fc3a0195510 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc39c00c8f0 tx=0x7fc39c00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:02:00.430 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:00.365+0000 7fc3967fc640 1 -- 172.21.15.115:0/4174928014 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc39c0041f0 con 0x7fc3a00ffb70 2024-09-13T17:02:00.430 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:00.365+0000 7fc3967fc640 1 -- 172.21.15.115:0/4174928014 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc39c007df0 con 0x7fc3a00ffb70 2024-09-13T17:02:00.430 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:00.365+0000 7fc3967fc640 1 -- 172.21.15.115:0/4174928014 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc39c00f450 con 0x7fc3a00ffb70 2024-09-13T17:02:00.430 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:00.365+0000 7fc3a747a640 1 -- 172.21.15.115:0/4174928014 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3a019ab70 con 0x7fc3a00ffb70 2024-09-13T17:02:00.430 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:00.365+0000 7fc3a747a640 1 -- 172.21.15.115:0/4174928014 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3a019b070 con 0x7fc3a00ffb70 2024-09-13T17:02:00.430 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:00.366+0000 7fc3a747a640 1 -- 172.21.15.115:0/4174928014 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3a0108620 con 0x7fc3a00ffb70 2024-09-13T17:02:00.430 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:00.366+0000 7fc3967fc640 1 -- 172.21.15.115:0/4174928014 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fc39c007950 con 0x7fc3a00ffb70 2024-09-13T17:02:00.430 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:00.367+0000 7fc3967fc640 1 --2- 172.21.15.115:0/4174928014 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fc38c06cc50 0x7fc38c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:00.430 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:00.367+0000 7fc3967fc640 1 -- 172.21.15.115:0/4174928014 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fc39c013070 con 0x7fc3a00ffb70 2024-09-13T17:02:00.430 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:00.367+0000 7fc3a4a15640 1 --2- 172.21.15.115:0/4174928014 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fc38c06cc50 0x7fc38c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:00.431 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:00.367+0000 7fc3a4a15640 1 --2- 172.21.15.115:0/4174928014 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fc38c06cc50 0x7fc38c06f110 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc390031460 tx=0x7fc390005de0 comp rx=0 tx=0).ready entity=mgr.14207 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:02:00.431 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:00.371+0000 7fc3967fc640 1 -- 172.21.15.115:0/4174928014 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc39c056690 con 0x7fc3a00ffb70 2024-09-13T17:02:00.536 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:00.535+0000 7fc3a747a640 1 -- 172.21.15.115:0/4174928014 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7fc3a019b340 con 0x7fc3a00ffb70 2024-09-13T17:02:00.536 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:02:00 smithi115 ceph-mon[27708]: Detected new or changed devices on smithi195 2024-09-13T17:02:00.537 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:02:00 smithi115 ceph-mon[27708]: Adjusting osd_memory_target on smithi195 to 4970M 2024-09-13T17:02:00.537 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:02:00 smithi115 ceph-mon[27708]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:02:00.537 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:02:00 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:02:00.537 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:02:00 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:02:00.537 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:02:00 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:02:00.537 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:00.535+0000 7fc3967fc640 1 -- 172.21.15.115:0/4174928014 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v40) v1 ==== 74+0+130 (secure 0 0 0) 0x7fc39c059cb0 con 0x7fc3a00ffb70 2024-09-13T17:02:00.537 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:02:00.539 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:00.537+0000 7fc3a747a640 1 -- 172.21.15.115:0/4174928014 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fc38c06cc50 msgr2=0x7fc38c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:00.539 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:00.537+0000 7fc3a747a640 1 --2- 172.21.15.115:0/4174928014 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fc38c06cc50 0x7fc38c06f110 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc390031460 tx=0x7fc390005de0 comp rx=0 tx=0).stop 2024-09-13T17:02:00.539 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:00.537+0000 7fc3a747a640 1 -- 172.21.15.115:0/4174928014 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc3a00ffb70 msgr2=0x7fc3a0195510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:00.539 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:00.537+0000 7fc3a747a640 1 --2- 172.21.15.115:0/4174928014 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc3a00ffb70 0x7fc3a0195510 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc39c00c8f0 tx=0x7fc39c00cdb0 comp rx=0 tx=0).stop 2024-09-13T17:02:00.539 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:00.537+0000 7fc3a747a640 1 -- 172.21.15.115:0/4174928014 shutdown_connections 2024-09-13T17:02:00.539 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:00.537+0000 7fc3a747a640 1 --2- 172.21.15.115:0/4174928014 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fc38c06cc50 0x7fc38c06f110 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:00.539 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:00.537+0000 7fc3a747a640 1 --2- 172.21.15.115:0/4174928014 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc3a0100d70 0x7fc3a0195a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:00.539 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:00.537+0000 7fc3a747a640 1 --2- 172.21.15.115:0/4174928014 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc3a00ffb70 0x7fc3a0195510 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:00.539 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:00.537+0000 7fc3a747a640 1 -- 172.21.15.115:0/4174928014 >> 172.21.15.115:0/4174928014 conn(0x7fc3a00fb2e0 msgr2=0x7fc3a0103fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:02:00.539 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:00.538+0000 7fc3a747a640 1 -- 172.21.15.115:0/4174928014 shutdown_connections 2024-09-13T17:02:00.540 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:00.538+0000 7fc3a747a640 1 -- 172.21.15.115:0/4174928014 wait complete. 2024-09-13T17:02:00.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:02:00 smithi195 ceph-mon[34981]: Detected new or changed devices on smithi195 2024-09-13T17:02:00.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:02:00 smithi195 ceph-mon[34981]: Adjusting osd_memory_target on smithi195 to 4970M 2024-09-13T17:02:00.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:02:00 smithi195 ceph-mon[34981]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:02:00.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:02:00 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:02:00.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:02:00 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:02:00.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:02:00 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:02:01.312 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":40,"num_osds":6,"num_up_osds":6,"osd_up_since":1726246917,"num_in_osds":6,"osd_in_since":1726246899,"num_remapped_pgs":0} 2024-09-13T17:02:01.312 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-13T17:02:01.508 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T17:02:01.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:02:01 smithi195 ceph-mon[34981]: from='client.? 172.21.15.115:0/4174928014' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-13T17:02:01.628 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:02:01 smithi115 ceph-mon[27708]: from='client.? 172.21.15.115:0/4174928014' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-13T17:02:02.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:02:02 smithi195 ceph-mon[34981]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:02:02.582 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:02:02 smithi115 ceph-mon[27708]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:02:03.096 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:03.089+0000 7fae171ae640 1 -- 172.21.15.115:0/1108633940 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae101049a0 msgr2=0x7fae10104d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:03.096 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:03.089+0000 7fae171ae640 1 --2- 172.21.15.115:0/1108633940 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae101049a0 0x7fae10104d80 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fae0c009880 tx=0x7fae0c02a4a0 comp rx=0 tx=0).stop 2024-09-13T17:02:03.096 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:03.089+0000 7fae171ae640 1 -- 172.21.15.115:0/1108633940 shutdown_connections 2024-09-13T17:02:03.096 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:03.089+0000 7fae171ae640 1 --2- 172.21.15.115:0/1108633940 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fae100fe9a0 0x7fae100fee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:03.096 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:03.089+0000 7fae171ae640 1 --2- 172.21.15.115:0/1108633940 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae101049a0 0x7fae10104d80 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:03.096 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:03.089+0000 7fae171ae640 1 -- 172.21.15.115:0/1108633940 >> 172.21.15.115:0/1108633940 conn(0x7fae100758c0 msgr2=0x7fae100fcc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:02:03.096 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:03.089+0000 7fae171ae640 1 -- 172.21.15.115:0/1108633940 shutdown_connections 2024-09-13T17:02:03.096 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:03.089+0000 7fae171ae640 1 -- 172.21.15.115:0/1108633940 wait complete. 2024-09-13T17:02:03.097 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:03.090+0000 7fae171ae640 1 Processor -- start 2024-09-13T17:02:03.097 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:03.090+0000 7fae171ae640 1 -- start start 2024-09-13T17:02:03.097 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:03.090+0000 7fae171ae640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae100fe9a0 0x7fae10196810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:03.097 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:03.090+0000 7fae171ae640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fae101049a0 0x7fae10196d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:03.097 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:03.090+0000 7fae171ae640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae10197290 con 0x7fae100fe9a0 2024-09-13T17:02:03.097 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:03.090+0000 7fae171ae640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae10197400 con 0x7fae101049a0 2024-09-13T17:02:03.097 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:03.090+0000 7fae14f4a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae100fe9a0 0x7fae10196810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:03.097 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:03.090+0000 7fae14f4a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae100fe9a0 0x7fae10196810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:55238/0 (socket says 172.21.15.115:55238) 2024-09-13T17:02:03.097 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:03.090+0000 7fae14f4a640 1 -- 172.21.15.115:0/2550128670 learned_addr learned my addr 172.21.15.115:0/2550128670 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:02:03.097 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:03.091+0000 7fae14f4a640 1 -- 172.21.15.115:0/2550128670 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fae101049a0 msgr2=0x7fae10196d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:03.098 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:03.091+0000 7fae14f4a640 1 --2- 172.21.15.115:0/2550128670 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fae101049a0 0x7fae10196d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:03.098 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:03.091+0000 7fae14f4a640 1 -- 172.21.15.115:0/2550128670 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae0c009560 con 0x7fae100fe9a0 2024-09-13T17:02:03.098 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:03.091+0000 7fae14f4a640 1 --2- 172.21.15.115:0/2550128670 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae100fe9a0 0x7fae10196810 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fae0c006010 tx=0x7fae0c0056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:02:03.098 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:03.091+0000 7fae05ffb640 1 -- 172.21.15.115:0/2550128670 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae0c004ba0 con 0x7fae100fe9a0 2024-09-13T17:02:03.098 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:03.091+0000 7fae05ffb640 1 -- 172.21.15.115:0/2550128670 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fae0c004d00 con 0x7fae100fe9a0 2024-09-13T17:02:03.098 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:03.091+0000 7fae171ae640 1 -- 172.21.15.115:0/2550128670 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae10197680 con 0x7fae100fe9a0 2024-09-13T17:02:03.098 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:03.091+0000 7fae05ffb640 1 -- 172.21.15.115:0/2550128670 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae0c031910 con 0x7fae100fe9a0 2024-09-13T17:02:03.098 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:03.091+0000 7fae171ae640 1 -- 172.21.15.115:0/2550128670 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae1019fb60 con 0x7fae100fe9a0 2024-09-13T17:02:03.098 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:03.092+0000 7fae171ae640 1 -- 172.21.15.115:0/2550128670 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae101000e0 con 0x7fae100fe9a0 2024-09-13T17:02:03.098 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:03.093+0000 7fae05ffb640 1 -- 172.21.15.115:0/2550128670 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fae0c031b80 con 0x7fae100fe9a0 2024-09-13T17:02:03.099 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:03.093+0000 7fae05ffb640 1 --2- 172.21.15.115:0/2550128670 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fadf806cc50 0x7fadf806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:03.099 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:03.093+0000 7fae05ffb640 1 -- 172.21.15.115:0/2550128670 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fae0c0acf70 con 0x7fae100fe9a0 2024-09-13T17:02:03.099 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:03.093+0000 7fae07fff640 1 --2- 172.21.15.115:0/2550128670 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fadf806cc50 0x7fadf806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:03.099 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:03.094+0000 7fae07fff640 1 --2- 172.21.15.115:0/2550128670 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fadf806cc50 0x7fadf806f110 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fae10068420 tx=0x7fae00005c70 comp rx=0 tx=0).ready entity=mgr.14207 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:02:03.099 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:03.097+0000 7fae05ffb640 1 -- 172.21.15.115:0/2550128670 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fae0c0e0e20 con 0x7fae100fe9a0 2024-09-13T17:02:03.263 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:03.262+0000 7fae171ae640 1 -- 172.21.15.115:0/2550128670 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fae10197680 con 0x7fae100fe9a0 2024-09-13T17:02:03.264 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:03.263+0000 7fae05ffb640 1 -- 172.21.15.115:0/2550128670 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11398 (secure 0 0 0) 0x7fae10197680 con 0x7fae100fe9a0 2024-09-13T17:02:03.264 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:02:03.264 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":40,"fsid":"ffbd7588-71f0-11ef-bceb-c7b262605968","created":"2024-09-13T16:56:28.790927+0000","modified":"2024-09-13T17:01:58.280281+0000","last_up_change":"2024-09-13T17:01:57.275978+0000","last_in_change":"2024-09-13T17:01:39.088735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:00:47.472140+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9fb96264-a71d-43b2-8d65-b4280a8ad8ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":2697967112},{"type":"v1","addr":"172.21.15.115:6803","nonce":2697967112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":2697967112},{"type":"v1","addr":"172.21.15.115:6805","nonce":2697967112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":2697967112},{"type":"v1","addr":"172.21.15.115:6809","nonce":2697967112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":2697967112},{"type":"v1","addr":"172.21.15.115:6807","nonce":2697967112}]},"public_addr":"172.21.15.115:6803/2697967112","cluster_addr":"172.21.15.115:6805/2697967112","heartbeat_back_addr":"172.21.15.115:6809/2697967112","heartbeat_front_addr":"172.21.15.115:6807/2697967112","state":["exists","up"]},{"osd":1,"uuid":"876bf075-f0e1-49dc-90cc-aedccbd19b2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":3928285174},{"type":"v1","addr":"172.21.15.115:6811","nonce":3928285174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":3928285174},{"type":"v1","addr":"172.21.15.115:6813","nonce":3928285174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":3928285174},{"type":"v1","addr":"172.21.15.115:6817","nonce":3928285174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":3928285174},{"type":"v1","addr":"172.21.15.115:6815","nonce":3928285174}]},"public_addr":"172.21.15.115:6811/3928285174","cluster_addr":"172.21.15.115:6813/3928285174","heartbeat_back_addr":"172.21.15.115:6817/3928285174","heartbeat_front_addr":"172.21.15.115:6815/3928285174","state":["exists","up"]},{"osd":2,"uuid":"40bc0278-21e6-4863-86bf-f5ee3bfc2fbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":1608421656},{"type":"v1","addr":"172.21.15.115:6819","nonce":1608421656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":1608421656},{"type":"v1","addr":"172.21.15.115:6821","nonce":1608421656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":1608421656},{"type":"v1","addr":"172.21.15.115:6825","nonce":1608421656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":1608421656},{"type":"v1","addr":"172.21.15.115:6823","nonce":1608421656}]},"public_addr":"172.21.15.115:6819/1608421656","cluster_addr":"172.21.15.115:6821/1608421656","heartbeat_back_addr":"172.21.15.115:6825/1608421656","heartbeat_front_addr":"172.21.15.115:6823/1608421656","state":["exists","up"]},{"osd":3,"uuid":"af3d701a-1c69-4cf2-a343-938ac1bbb34a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3054971968},{"type":"v1","addr":"172.21.15.195:6801","nonce":3054971968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3054971968},{"type":"v1","addr":"172.21.15.195:6803","nonce":3054971968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3054971968},{"type":"v1","addr":"172.21.15.195:6807","nonce":3054971968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3054971968},{"type":"v1","addr":"172.21.15.195:6805","nonce":3054971968}]},"public_addr":"172.21.15.195:6801/3054971968","cluster_addr":"172.21.15.195:6803/3054971968","heartbeat_back_addr":"172.21.15.195:6807/3054971968","heartbeat_front_addr":"172.21.15.195:6805/3054971968","state":["exists","up"]},{"osd":4,"uuid":"7bf484b6-6ed5-4fe7-8aa4-505853e2cd1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":1840094638},{"type":"v1","addr":"172.21.15.195:6809","nonce":1840094638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":1840094638},{"type":"v1","addr":"172.21.15.195:6811","nonce":1840094638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":1840094638},{"type":"v1","addr":"172.21.15.195:6815","nonce":1840094638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":1840094638},{"type":"v1","addr":"172.21.15.195:6813","nonce":1840094638}]},"public_addr":"172.21.15.195:6809/1840094638","cluster_addr":"172.21.15.195:6811/1840094638","heartbeat_back_addr":"172.21.15.195:6815/1840094638","heartbeat_front_addr":"172.21.15.195:6813/1840094638","state":["exists","up"]},{"osd":5,"uuid":"1eb8bcc4-dc9b-4a00-bf43-a707da3c141f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1862675419},{"type":"v1","addr":"172.21.15.195:6817","nonce":1862675419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1862675419},{"type":"v1","addr":"172.21.15.195:6819","nonce":1862675419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1862675419},{"type":"v1","addr":"172.21.15.195:6823","nonce":1862675419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1862675419},{"type":"v1","addr":"172.21.15.195:6821","nonce":1862675419}]},"public_addr":"172.21.15.195:6817/1862675419","cluster_addr":"172.21.15.195:6819/1862675419","heartbeat_back_addr":"172.21.15.195:6823/1862675419","heartbeat_front_addr":"172.21.15.195:6821/1862675419","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:59:47.662383+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:00:14.730551+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:00:43.856416+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:01:06.336209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:01:30.680442+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:01:55.518043+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.115:0/2751677160":"2024-09-14T16:58:29.159373+0000","172.21.15.115:6800/1463863592":"2024-09-14T16:56:57.112847+0000","172.21.15.115:0/3723628457":"2024-09-14T16:56:57.112847+0000","172.21.15.115:6801/1463863592":"2024-09-14T16:56:57.112847+0000","172.21.15.115:0/376622152":"2024-09-14T16:57:27.333203+0000","172.21.15.115:0/648599851":"2024-09-14T16:56:57.112847+0000","172.21.15.115:0/3791301867":"2024-09-14T16:57:27.333203+0000","172.21.15.115:0/2966038005":"2024-09-14T16:56:57.112847+0000","172.21.15.115:6801/3889408988":"2024-09-14T16:58:29.159373+0000","172.21.15.115:0/3586970461":"2024-09-14T16:57:27.333203+0000","172.21.15.115:6800/2943337696":"2024-09-14T16:57:27.333203+0000","172.21.15.115:6801/2943337696":"2024-09-14T16:57:27.333203+0000","172.21.15.115:0/247720257":"2024-09-14T16:58:29.159373+0000","172.21.15.115:0/931588236":"2024-09-14T16:58:29.159373+0000","172.21.15.115:6800/3889408988":"2024-09-14T16:58:29.159373+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:02:03.266 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:03.265+0000 7fae171ae640 1 -- 172.21.15.115:0/2550128670 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fadf806cc50 msgr2=0x7fadf806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:03.266 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:03.265+0000 7fae171ae640 1 --2- 172.21.15.115:0/2550128670 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fadf806cc50 0x7fadf806f110 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fae10068420 tx=0x7fae00005c70 comp rx=0 tx=0).stop 2024-09-13T17:02:03.266 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:03.265+0000 7fae171ae640 1 -- 172.21.15.115:0/2550128670 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae100fe9a0 msgr2=0x7fae10196810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:03.266 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:03.265+0000 7fae171ae640 1 --2- 172.21.15.115:0/2550128670 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae100fe9a0 0x7fae10196810 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fae0c006010 tx=0x7fae0c0056e0 comp rx=0 tx=0).stop 2024-09-13T17:02:03.267 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:03.265+0000 7fae171ae640 1 -- 172.21.15.115:0/2550128670 shutdown_connections 2024-09-13T17:02:03.267 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:03.265+0000 7fae171ae640 1 --2- 172.21.15.115:0/2550128670 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fadf806cc50 0x7fadf806f110 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:03.267 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:03.265+0000 7fae171ae640 1 --2- 172.21.15.115:0/2550128670 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fae101049a0 0x7fae10196d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:03.267 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:03.265+0000 7fae171ae640 1 --2- 172.21.15.115:0/2550128670 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae100fe9a0 0x7fae10196810 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:03.267 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:03.265+0000 7fae171ae640 1 -- 172.21.15.115:0/2550128670 >> 172.21.15.115:0/2550128670 conn(0x7fae100758c0 msgr2=0x7fae100fd740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:02:03.267 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:03.265+0000 7fae171ae640 1 -- 172.21.15.115:0/2550128670 shutdown_connections 2024-09-13T17:02:03.267 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:03.265+0000 7fae171ae640 1 -- 172.21.15.115:0/2550128670 wait complete. 2024-09-13T17:02:03.576 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:02:03 smithi195 ceph-mon[34981]: from='client.? 172.21.15.115:0/2550128670' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:02:03.658 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:02:03 smithi115 ceph-mon[27708]: from='client.? 172.21.15.115:0/2550128670' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:02:04.088 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:00:47.472140+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:02:04.089 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-13T17:02:04.284 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T17:02:04.406 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:02:04 smithi115 ceph-mon[27708]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:02:04.576 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:02:04 smithi195 ceph-mon[34981]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:02:05.862 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:05.859+0000 7f414f9c5640 1 -- 172.21.15.115:0/2066889455 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f41480fea10 msgr2=0x7f41480fee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:05.863 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:05.859+0000 7f414f9c5640 1 --2- 172.21.15.115:0/2066889455 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f41480fea10 0x7f41480fee70 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4144009880 tx=0x7f414402a4a0 comp rx=0 tx=0).stop 2024-09-13T17:02:05.863 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:05.859+0000 7f414f9c5640 1 -- 172.21.15.115:0/2066889455 shutdown_connections 2024-09-13T17:02:05.863 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:05.859+0000 7f414f9c5640 1 --2- 172.21.15.115:0/2066889455 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f41480fea10 0x7f41480fee70 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:05.863 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:05.859+0000 7f414f9c5640 1 --2- 172.21.15.115:0/2066889455 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4148104a10 0x7f4148104df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:05.863 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:05.859+0000 7f414f9c5640 1 -- 172.21.15.115:0/2066889455 >> 172.21.15.115:0/2066889455 conn(0x7f41480fa730 msgr2=0x7f41480fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:02:05.863 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:05.859+0000 7f414f9c5640 1 -- 172.21.15.115:0/2066889455 shutdown_connections 2024-09-13T17:02:05.863 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:05.859+0000 7f414f9c5640 1 -- 172.21.15.115:0/2066889455 wait complete. 2024-09-13T17:02:05.863 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:05.860+0000 7f414f9c5640 1 Processor -- start 2024-09-13T17:02:05.863 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:05.860+0000 7f414f9c5640 1 -- start start 2024-09-13T17:02:05.863 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:05.860+0000 7f414f9c5640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f41480fea10 0x7f414819b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:05.864 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:05.860+0000 7f414f9c5640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4148104a10 0x7f414819bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:05.864 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:05.860+0000 7f414f9c5640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f414819c3c0 con 0x7f4148104a10 2024-09-13T17:02:05.864 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:05.860+0000 7f414f9c5640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4148195950 con 0x7f41480fea10 2024-09-13T17:02:05.864 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:05.860+0000 7f414cf60640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4148104a10 0x7f414819bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:05.864 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:05.860+0000 7f414cf60640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4148104a10 0x7f414819bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:45986/0 (socket says 172.21.15.115:45986) 2024-09-13T17:02:05.864 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:05.860+0000 7f414cf60640 1 -- 172.21.15.115:0/2786476813 learned_addr learned my addr 172.21.15.115:0/2786476813 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:02:05.864 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:05.860+0000 7f414d761640 1 --2- 172.21.15.115:0/2786476813 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f41480fea10 0x7f414819b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:05.864 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:05.860+0000 7f414cf60640 1 -- 172.21.15.115:0/2786476813 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f41480fea10 msgr2=0x7f414819b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:05.864 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:05.860+0000 7f414cf60640 1 --2- 172.21.15.115:0/2786476813 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f41480fea10 0x7f414819b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:05.864 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:05.860+0000 7f414cf60640 1 -- 172.21.15.115:0/2786476813 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4144009560 con 0x7f4148104a10 2024-09-13T17:02:05.864 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:05.861+0000 7f414cf60640 1 --2- 172.21.15.115:0/2786476813 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4148104a10 0x7f414819bda0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4144006010 tx=0x7f41440056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:02:05.865 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:05.861+0000 7f413a7fc640 1 -- 172.21.15.115:0/2786476813 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4144004ba0 con 0x7f4148104a10 2024-09-13T17:02:05.865 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:05.861+0000 7f413a7fc640 1 -- 172.21.15.115:0/2786476813 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4144004d00 con 0x7f4148104a10 2024-09-13T17:02:05.865 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:05.861+0000 7f414f9c5640 1 -- 172.21.15.115:0/2786476813 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4148195bd0 con 0x7f4148104a10 2024-09-13T17:02:05.865 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:05.861+0000 7f413a7fc640 1 -- 172.21.15.115:0/2786476813 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4144031910 con 0x7f4148104a10 2024-09-13T17:02:05.865 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:05.861+0000 7f414f9c5640 1 -- 172.21.15.115:0/2786476813 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41481960c0 con 0x7f4148104a10 2024-09-13T17:02:05.866 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:05.862+0000 7f414f9c5640 1 -- 172.21.15.115:0/2786476813 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4148100150 con 0x7f4148104a10 2024-09-13T17:02:05.866 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:05.862+0000 7f413a7fc640 1 -- 172.21.15.115:0/2786476813 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f4144031af0 con 0x7f4148104a10 2024-09-13T17:02:05.866 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:05.863+0000 7f413a7fc640 1 --2- 172.21.15.115:0/2786476813 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f413406cc50 0x7f413406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:05.866 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:05.863+0000 7f413a7fc640 1 -- 172.21.15.115:0/2786476813 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f41440ad040 con 0x7f4148104a10 2024-09-13T17:02:05.866 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:05.863+0000 7f414d761640 1 --2- 172.21.15.115:0/2786476813 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f413406cc50 0x7f413406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:05.866 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:05.863+0000 7f414d761640 1 --2- 172.21.15.115:0/2786476813 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f413406cc50 0x7f413406f110 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f413c00a810 tx=0x7f413c008040 comp rx=0 tx=0).ready entity=mgr.14207 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:02:05.868 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:05.867+0000 7f413a7fc640 1 -- 172.21.15.115:0/2786476813 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f41440777d0 con 0x7f4148104a10 2024-09-13T17:02:06.037 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:06.035+0000 7f414f9c5640 1 -- 172.21.15.115:0/2786476813 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f414810bbc0 con 0x7f4148104a10 2024-09-13T17:02:06.037 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:06.036+0000 7f413a7fc640 1 -- 172.21.15.115:0/2786476813 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7f414407adf0 con 0x7f4148104a10 2024-09-13T17:02:06.037 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 1 2024-09-13T17:02:06.040 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:06.038+0000 7f414f9c5640 1 -- 172.21.15.115:0/2786476813 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f413406cc50 msgr2=0x7f413406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:06.040 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:06.038+0000 7f414f9c5640 1 --2- 172.21.15.115:0/2786476813 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f413406cc50 0x7f413406f110 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f413c00a810 tx=0x7f413c008040 comp rx=0 tx=0).stop 2024-09-13T17:02:06.040 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:06.038+0000 7f414f9c5640 1 -- 172.21.15.115:0/2786476813 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4148104a10 msgr2=0x7f414819bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:06.040 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:06.038+0000 7f414f9c5640 1 --2- 172.21.15.115:0/2786476813 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4148104a10 0x7f414819bda0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4144006010 tx=0x7f41440056e0 comp rx=0 tx=0).stop 2024-09-13T17:02:06.040 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:06.038+0000 7f414f9c5640 1 -- 172.21.15.115:0/2786476813 shutdown_connections 2024-09-13T17:02:06.040 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:06.038+0000 7f414f9c5640 1 --2- 172.21.15.115:0/2786476813 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f413406cc50 0x7f413406f110 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:06.040 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:06.038+0000 7f414f9c5640 1 --2- 172.21.15.115:0/2786476813 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4148104a10 0x7f414819bda0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:06.040 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:06.038+0000 7f414f9c5640 1 --2- 172.21.15.115:0/2786476813 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f41480fea10 0x7f414819b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:06.040 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:06.038+0000 7f414f9c5640 1 -- 172.21.15.115:0/2786476813 >> 172.21.15.115:0/2786476813 conn(0x7f41480fa730 msgr2=0x7f41480fb900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:02:06.040 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:06.038+0000 7f414f9c5640 1 -- 172.21.15.115:0/2786476813 shutdown_connections 2024-09-13T17:02:06.040 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:06.038+0000 7f414f9c5640 1 -- 172.21.15.115:0/2786476813 wait complete. 2024-09-13T17:02:06.303 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:02:06 smithi115 ceph-mon[27708]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:02:06.303 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:02:06 smithi115 ceph-mon[27708]: from='client.? 172.21.15.115:0/2786476813' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T17:02:06.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:02:06 smithi195 ceph-mon[34981]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:02:06.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:02:06 smithi195 ceph-mon[34981]: from='client.? 172.21.15.115:0/2786476813' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T17:02:06.774 INFO:tasks.cephadm:Setting up client nodes... 2024-09-13T17:02:06.774 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-13T17:02:06.973 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T17:02:08.333 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:02:08 smithi115 ceph-mon[27708]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:02:08.531 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:08.527+0000 7fd0a32f2640 1 -- 172.21.15.115:0/441185532 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd09c0ffc70 msgr2=0x7fd09c1000f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:08.531 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:08.527+0000 7fd0a32f2640 1 --2- 172.21.15.115:0/441185532 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd09c0ffc70 0x7fd09c1000f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd08c009880 tx=0x7fd08c02a4a0 comp rx=0 tx=0).stop 2024-09-13T17:02:08.532 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:08.527+0000 7fd0a32f2640 1 -- 172.21.15.115:0/441185532 shutdown_connections 2024-09-13T17:02:08.532 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:08.527+0000 7fd0a32f2640 1 --2- 172.21.15.115:0/441185532 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd09c0ffc70 0x7fd09c1000f0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:08.532 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:08.527+0000 7fd0a32f2640 1 --2- 172.21.15.115:0/441185532 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd09c0fea70 0x7fd09c0fee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:08.532 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:08.527+0000 7fd0a32f2640 1 -- 172.21.15.115:0/441185532 >> 172.21.15.115:0/441185532 conn(0x7fd09c0fa200 msgr2=0x7fd09c0fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:02:08.532 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:08.528+0000 7fd0a32f2640 1 -- 172.21.15.115:0/441185532 shutdown_connections 2024-09-13T17:02:08.532 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:08.528+0000 7fd0a32f2640 1 -- 172.21.15.115:0/441185532 wait complete. 2024-09-13T17:02:08.532 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:08.528+0000 7fd0a32f2640 1 Processor -- start 2024-09-13T17:02:08.532 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:08.528+0000 7fd0a32f2640 1 -- start start 2024-09-13T17:02:08.532 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:08.528+0000 7fd0a32f2640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd09c0fea70 0x7fd09c194420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:08.532 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:08.528+0000 7fd0a32f2640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd09c0ffc70 0x7fd09c194960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:08.533 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:08.528+0000 7fd0a32f2640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd09c194f30 con 0x7fd09c0ffc70 2024-09-13T17:02:08.533 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:08.528+0000 7fd0a32f2640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd09c1950a0 con 0x7fd09c0fea70 2024-09-13T17:02:08.533 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:08.528+0000 7fd0a088d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd09c0ffc70 0x7fd09c194960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:08.533 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:08.529+0000 7fd0a108e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd09c0fea70 0x7fd09c194420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:08.533 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:08.529+0000 7fd0a088d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd09c0ffc70 0x7fd09c194960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:45992/0 (socket says 172.21.15.115:45992) 2024-09-13T17:02:08.533 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:08.529+0000 7fd0a108e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd09c0fea70 0x7fd09c194420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.115:46156/0 (socket says 172.21.15.115:46156) 2024-09-13T17:02:08.533 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:08.529+0000 7fd0a088d640 1 -- 172.21.15.115:0/545888717 learned_addr learned my addr 172.21.15.115:0/545888717 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:02:08.533 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:08.529+0000 7fd0a108e640 1 -- 172.21.15.115:0/545888717 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd09c0ffc70 msgr2=0x7fd09c194960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:08.533 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:08.529+0000 7fd0a108e640 1 --2- 172.21.15.115:0/545888717 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd09c0ffc70 0x7fd09c194960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:08.533 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:08.529+0000 7fd0a108e640 1 -- 172.21.15.115:0/545888717 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd08c009560 con 0x7fd09c0fea70 2024-09-13T17:02:08.533 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:08.529+0000 7fd0a088d640 1 --2- 172.21.15.115:0/545888717 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd09c0ffc70 0x7fd09c194960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:02:08.534 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:08.529+0000 7fd0a108e640 1 --2- 172.21.15.115:0/545888717 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd09c0fea70 0x7fd09c194420 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd09800e940 tx=0x7fd09800ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:02:08.534 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:08.529+0000 7fd0927fc640 1 -- 172.21.15.115:0/545888717 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd09800cc90 con 0x7fd09c0fea70 2024-09-13T17:02:08.534 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:08.529+0000 7fd0927fc640 1 -- 172.21.15.115:0/545888717 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd0980044d0 con 0x7fd09c0fea70 2024-09-13T17:02:08.534 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:08.529+0000 7fd0a32f2640 1 -- 172.21.15.115:0/545888717 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd09c199b40 con 0x7fd09c0fea70 2024-09-13T17:02:08.534 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:08.529+0000 7fd0927fc640 1 -- 172.21.15.115:0/545888717 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd098010430 con 0x7fd09c0fea70 2024-09-13T17:02:08.534 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:08.529+0000 7fd0a32f2640 1 -- 172.21.15.115:0/545888717 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd09c067ac0 con 0x7fd09c0fea70 2024-09-13T17:02:08.535 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:08.530+0000 7fd0a32f2640 1 -- 172.21.15.115:0/545888717 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd09c107540 con 0x7fd09c0fea70 2024-09-13T17:02:08.535 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:08.531+0000 7fd0927fc640 1 -- 172.21.15.115:0/545888717 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fd098003f10 con 0x7fd09c0fea70 2024-09-13T17:02:08.535 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:08.531+0000 7fd0927fc640 1 --2- 172.21.15.115:0/545888717 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fd08806ee60 0x7fd088071320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:08.535 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:08.531+0000 7fd0927fc640 1 -- 172.21.15.115:0/545888717 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fd098014070 con 0x7fd09c0fea70 2024-09-13T17:02:08.535 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:08.531+0000 7fd0a088d640 1 --2- 172.21.15.115:0/545888717 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fd08806ee60 0x7fd088071320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:08.535 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:08.532+0000 7fd0a088d640 1 --2- 172.21.15.115:0/545888717 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fd08806ee60 0x7fd088071320 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd09c195940 tx=0x7fd08c0058d0 comp rx=0 tx=0).ready entity=mgr.14207 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:02:08.537 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:08.535+0000 7fd0927fc640 1 -- 172.21.15.115:0/545888717 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd0980569c0 con 0x7fd09c0fea70 2024-09-13T17:02:08.576 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:02:08 smithi195 ceph-mon[34981]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:02:08.762 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:08.760+0000 7fd0a32f2640 1 -- 172.21.15.115:0/545888717 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7fd09c067ff0 con 0x7fd09c0fea70 2024-09-13T17:02:08.766 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:08.764+0000 7fd0927fc640 1 -- 172.21.15.115:0/545888717 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v16) v1 ==== 170+0+59 (secure 0 0 0) 0x7fd098059fe0 con 0x7fd09c0fea70 2024-09-13T17:02:08.767 INFO:teuthology.orchestra.run.smithi115.stdout:[client.0] 2024-09-13T17:02:08.767 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQAQcORme6t5LRAAV746KDq0T4BiOxoXlDZBgw== 2024-09-13T17:02:08.769 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:08.766+0000 7fd0a32f2640 1 -- 172.21.15.115:0/545888717 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fd08806ee60 msgr2=0x7fd088071320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:08.769 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:08.766+0000 7fd0a32f2640 1 --2- 172.21.15.115:0/545888717 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fd08806ee60 0x7fd088071320 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd09c195940 tx=0x7fd08c0058d0 comp rx=0 tx=0).stop 2024-09-13T17:02:08.769 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:08.767+0000 7fd0a32f2640 1 -- 172.21.15.115:0/545888717 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd09c0fea70 msgr2=0x7fd09c194420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:08.769 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:08.767+0000 7fd0a32f2640 1 --2- 172.21.15.115:0/545888717 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd09c0fea70 0x7fd09c194420 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd09800e940 tx=0x7fd09800ee00 comp rx=0 tx=0).stop 2024-09-13T17:02:08.769 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:08.767+0000 7fd0a32f2640 1 -- 172.21.15.115:0/545888717 shutdown_connections 2024-09-13T17:02:08.769 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:08.767+0000 7fd0a32f2640 1 --2- 172.21.15.115:0/545888717 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fd08806ee60 0x7fd088071320 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:08.769 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:08.767+0000 7fd0a32f2640 1 --2- 172.21.15.115:0/545888717 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd09c0ffc70 0x7fd09c194960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:08.770 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:08.767+0000 7fd0a32f2640 1 --2- 172.21.15.115:0/545888717 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd09c0fea70 0x7fd09c194420 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:08.770 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:08.767+0000 7fd0a32f2640 1 -- 172.21.15.115:0/545888717 >> 172.21.15.115:0/545888717 conn(0x7fd09c0fa200 msgr2=0x7fd09c102ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:02:08.770 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:08.767+0000 7fd0a32f2640 1 -- 172.21.15.115:0/545888717 shutdown_connections 2024-09-13T17:02:08.770 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:08.767+0000 7fd0a32f2640 1 -- 172.21.15.115:0/545888717 wait complete. 2024-09-13T17:02:09.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:02:09 smithi115 ceph-mon[27708]: from='client.? 172.21.15.115:0/545888717' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-13T17:02:09.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:02:09 smithi115 ceph-mon[27708]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-13T17:02:09.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:02:09 smithi115 ceph-mon[27708]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-13T17:02:09.493 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-13T17:02:09.493 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-13T17:02:09.493 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-13T17:02:09.530 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-13T17:02:09.559 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:02:09 smithi195 ceph-mon[34981]: from='client.? 172.21.15.115:0/545888717' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-13T17:02:09.559 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:02:09 smithi195 ceph-mon[34981]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-13T17:02:09.559 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:02:09 smithi195 ceph-mon[34981]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-13T17:02:09.741 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/mon.smithi195/config 2024-09-13T17:02:10.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:02:10 smithi195 ceph-mon[34981]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:02:10.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:02:10 smithi115 ceph-mon[27708]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:02:11.326 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:02:11.315+0000 7f03e26f8640 1 -- 172.21.15.195:0/2903991766 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f03dc100630 msgr2=0x7f03dc102a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:11.326 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:02:11.315+0000 7f03e26f8640 1 --2- 172.21.15.195:0/2903991766 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f03dc100630 0x7f03dc102a20 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f03cc009880 tx=0x7f03cc02a4a0 comp rx=0 tx=0).stop 2024-09-13T17:02:11.326 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:02:11.315+0000 7f03e26f8640 1 -- 172.21.15.195:0/2903991766 shutdown_connections 2024-09-13T17:02:11.326 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:02:11.315+0000 7f03e26f8640 1 --2- 172.21.15.195:0/2903991766 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f03dc102f60 0x7f03dc105350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:11.326 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:02:11.315+0000 7f03e26f8640 1 --2- 172.21.15.195:0/2903991766 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f03dc100630 0x7f03dc102a20 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:11.327 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:02:11.315+0000 7f03e26f8640 1 -- 172.21.15.195:0/2903991766 >> 172.21.15.195:0/2903991766 conn(0x7f03dc0fa230 msgr2=0x7f03dc0fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:02:11.327 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:02:11.315+0000 7f03e26f8640 1 -- 172.21.15.195:0/2903991766 shutdown_connections 2024-09-13T17:02:11.327 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:02:11.315+0000 7f03e26f8640 1 -- 172.21.15.195:0/2903991766 wait complete. 2024-09-13T17:02:11.327 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:02:11.316+0000 7f03e26f8640 1 Processor -- start 2024-09-13T17:02:11.327 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:02:11.316+0000 7f03e26f8640 1 -- start start 2024-09-13T17:02:11.327 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:02:11.316+0000 7f03e26f8640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f03dc100630 0x7f03dc195630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:11.327 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:02:11.316+0000 7f03e26f8640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f03dc102f60 0x7f03dc195b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:11.327 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:02:11.316+0000 7f03e26f8640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03dc196140 con 0x7f03dc102f60 2024-09-13T17:02:11.327 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:02:11.316+0000 7f03e26f8640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03dc1962b0 con 0x7f03dc100630 2024-09-13T17:02:11.327 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:02:11.316+0000 7f03dbfff640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f03dc100630 0x7f03dc195630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:11.327 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:02:11.316+0000 7f03dbfff640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f03dc100630 0x7f03dc195630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:42382/0 (socket says 172.21.15.195:42382) 2024-09-13T17:02:11.327 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:02:11.316+0000 7f03dbfff640 1 -- 172.21.15.195:0/1954501971 learned_addr learned my addr 172.21.15.195:0/1954501971 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-09-13T17:02:11.327 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:02:11.316+0000 7f03dbfff640 1 -- 172.21.15.195:0/1954501971 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f03dc102f60 msgr2=0x7f03dc195b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:11.328 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:02:11.316+0000 7f03dbfff640 1 --2- 172.21.15.195:0/1954501971 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f03dc102f60 0x7f03dc195b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:11.328 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:02:11.316+0000 7f03dbfff640 1 -- 172.21.15.195:0/1954501971 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03cc009560 con 0x7f03dc100630 2024-09-13T17:02:11.328 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:02:11.317+0000 7f03dbfff640 1 --2- 172.21.15.195:0/1954501971 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f03dc100630 0x7f03dc195630 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f03cc031460 tx=0x7f03cc004da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:02:11.328 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:02:11.317+0000 7f03d97fa640 1 -- 172.21.15.195:0/1954501971 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03cc005560 con 0x7f03dc100630 2024-09-13T17:02:11.328 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:02:11.317+0000 7f03d97fa640 1 -- 172.21.15.195:0/1954501971 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f03cc003a90 con 0x7f03dc100630 2024-09-13T17:02:11.328 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:02:11.317+0000 7f03e26f8640 1 -- 172.21.15.195:0/1954501971 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03dc19acf0 con 0x7f03dc100630 2024-09-13T17:02:11.328 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:02:11.317+0000 7f03d97fa640 1 -- 172.21.15.195:0/1954501971 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03cc031b10 con 0x7f03dc100630 2024-09-13T17:02:11.328 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:02:11.317+0000 7f03e26f8640 1 -- 172.21.15.195:0/1954501971 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03dc19b260 con 0x7f03dc100630 2024-09-13T17:02:11.328 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:02:11.318+0000 7f03e26f8640 1 -- 172.21.15.195:0/1954501971 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03dc1086f0 con 0x7f03dc100630 2024-09-13T17:02:11.328 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:02:11.318+0000 7f03d97fa640 1 -- 172.21.15.195:0/1954501971 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f03cc031d40 con 0x7f03dc100630 2024-09-13T17:02:11.328 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:02:11.319+0000 7f03d97fa640 1 --2- 172.21.15.195:0/1954501971 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f03c406cc50 0x7f03c406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:11.328 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:02:11.319+0000 7f03d97fa640 1 -- 172.21.15.195:0/1954501971 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f03cc0ad230 con 0x7f03dc100630 2024-09-13T17:02:11.328 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:02:11.319+0000 7f03db7fe640 1 --2- 172.21.15.195:0/1954501971 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f03c406cc50 0x7f03c406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:11.328 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:02:11.319+0000 7f03db7fe640 1 --2- 172.21.15.195:0/1954501971 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f03c406cc50 0x7f03c406f110 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f03dc196b50 tx=0x7f03d0006c90 comp rx=0 tx=0).ready entity=mgr.14207 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:02:11.329 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:02:11.323+0000 7f03d97fa640 1 -- 172.21.15.195:0/1954501971 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f03cc077940 con 0x7f03dc100630 2024-09-13T17:02:11.545 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:02:11.544+0000 7f03e26f8640 1 -- 172.21.15.195:0/1954501971 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f03dc19b450 con 0x7f03dc100630 2024-09-13T17:02:11.552 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:02:11.551+0000 7f03d97fa640 1 -- 172.21.15.195:0/1954501971 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v17) v1 ==== 170+0+59 (secure 0 0 0) 0x7f03cc07af60 con 0x7f03dc100630 2024-09-13T17:02:11.553 INFO:teuthology.orchestra.run.smithi195.stdout:[client.1] 2024-09-13T17:02:11.553 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQATcORmZlyQIBAAUc2BT4dMEksg5hfTxzcxNQ== 2024-09-13T17:02:11.555 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:02:11.553+0000 7f03e26f8640 1 -- 172.21.15.195:0/1954501971 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f03c406cc50 msgr2=0x7f03c406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:11.555 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:02:11.553+0000 7f03e26f8640 1 --2- 172.21.15.195:0/1954501971 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f03c406cc50 0x7f03c406f110 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f03dc196b50 tx=0x7f03d0006c90 comp rx=0 tx=0).stop 2024-09-13T17:02:11.555 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:02:11.553+0000 7f03e26f8640 1 -- 172.21.15.195:0/1954501971 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f03dc100630 msgr2=0x7f03dc195630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:11.555 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:02:11.553+0000 7f03e26f8640 1 --2- 172.21.15.195:0/1954501971 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f03dc100630 0x7f03dc195630 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f03cc031460 tx=0x7f03cc004da0 comp rx=0 tx=0).stop 2024-09-13T17:02:11.555 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:02:11.553+0000 7f03e26f8640 1 -- 172.21.15.195:0/1954501971 shutdown_connections 2024-09-13T17:02:11.555 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:02:11.553+0000 7f03e26f8640 1 --2- 172.21.15.195:0/1954501971 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f03c406cc50 0x7f03c406f110 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:11.555 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:02:11.553+0000 7f03e26f8640 1 --2- 172.21.15.195:0/1954501971 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f03dc102f60 0x7f03dc195b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:11.555 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:02:11.553+0000 7f03e26f8640 1 --2- 172.21.15.195:0/1954501971 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f03dc100630 0x7f03dc195630 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:11.555 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:02:11.553+0000 7f03e26f8640 1 -- 172.21.15.195:0/1954501971 >> 172.21.15.195:0/1954501971 conn(0x7f03dc0fa230 msgr2=0x7f03dc0fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:02:11.555 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:02:11.553+0000 7f03e26f8640 1 -- 172.21.15.195:0/1954501971 shutdown_connections 2024-09-13T17:02:11.555 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T17:02:11.553+0000 7f03e26f8640 1 -- 172.21.15.195:0/1954501971 wait complete. 2024-09-13T17:02:12.151 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-09-13T17:02:12.151 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-09-13T17:02:12.152 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-13T17:02:12.230 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-13T17:02:12.230 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-13T17:02:12.230 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -- ceph mgr dump --format=json 2024-09-13T17:02:12.433 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T17:02:12.555 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:02:12 smithi115 ceph-mon[27708]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:02:12.555 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:02:12 smithi115 ceph-mon[27708]: from='client.? 172.21.15.195:0/1954501971' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-13T17:02:12.555 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:02:12 smithi115 ceph-mon[27708]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-13T17:02:12.555 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:02:12 smithi115 ceph-mon[27708]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-13T17:02:12.576 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:02:12 smithi195 ceph-mon[34981]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:02:12.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:02:12 smithi195 ceph-mon[34981]: from='client.? 172.21.15.195:0/1954501971' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-13T17:02:12.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:02:12 smithi195 ceph-mon[34981]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-13T17:02:12.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:02:12 smithi195 ceph-mon[34981]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-13T17:02:14.083 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:14.076+0000 7f417dbf5640 1 -- 172.21.15.115:0/3895490459 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4178101670 msgr2=0x7f4178109b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:14.083 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:14.076+0000 7f417dbf5640 1 --2- 172.21.15.115:0/3895490459 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4178101670 0x7f4178109b60 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4160009880 tx=0x7f416002a530 comp rx=0 tx=0).stop 2024-09-13T17:02:14.083 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:14.076+0000 7f417dbf5640 1 -- 172.21.15.115:0/3895490459 shutdown_connections 2024-09-13T17:02:14.083 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:14.076+0000 7f417dbf5640 1 --2- 172.21.15.115:0/3895490459 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4178101670 0x7f4178109b60 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:14.084 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:14.076+0000 7f417dbf5640 1 --2- 172.21.15.115:0/3895490459 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4178100d50 0x7f4178101130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:14.084 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:14.076+0000 7f417dbf5640 1 -- 172.21.15.115:0/3895490459 >> 172.21.15.115:0/3895490459 conn(0x7f41780fa6d0 msgr2=0x7f41780fcaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:02:14.084 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:14.076+0000 7f417dbf5640 1 -- 172.21.15.115:0/3895490459 shutdown_connections 2024-09-13T17:02:14.084 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:14.076+0000 7f417dbf5640 1 -- 172.21.15.115:0/3895490459 wait complete. 2024-09-13T17:02:14.084 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:14.077+0000 7f417dbf5640 1 Processor -- start 2024-09-13T17:02:14.084 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:14.077+0000 7f417dbf5640 1 -- start start 2024-09-13T17:02:14.084 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:14.077+0000 7f417dbf5640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4178100d50 0x7f41780fe9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:14.084 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:14.077+0000 7f417dbf5640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4178101670 0x7f41780feef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:14.084 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:14.077+0000 7f417dbf5640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41780ff430 con 0x7f4178100d50 2024-09-13T17:02:14.084 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:14.077+0000 7f417dbf5640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41780ff5a0 con 0x7f4178101670 2024-09-13T17:02:14.084 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:14.077+0000 7f41777fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4178100d50 0x7f41780fe9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:14.084 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:14.077+0000 7f41777fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4178100d50 0x7f41780fe9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:55522/0 (socket says 172.21.15.115:55522) 2024-09-13T17:02:14.085 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:14.077+0000 7f41777fe640 1 -- 172.21.15.115:0/768695176 learned_addr learned my addr 172.21.15.115:0/768695176 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:02:14.085 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:14.077+0000 7f416ffff640 1 --2- 172.21.15.115:0/768695176 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4178101670 0x7f41780feef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:14.085 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:14.077+0000 7f41777fe640 1 -- 172.21.15.115:0/768695176 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4178101670 msgr2=0x7f41780feef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:14.085 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:14.077+0000 7f41777fe640 1 --2- 172.21.15.115:0/768695176 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4178101670 0x7f41780feef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:14.085 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:14.077+0000 7f41777fe640 1 -- 172.21.15.115:0/768695176 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4160009560 con 0x7f4178100d50 2024-09-13T17:02:14.085 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:14.077+0000 7f41777fe640 1 --2- 172.21.15.115:0/768695176 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4178100d50 0x7f41780fe9b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f416800b420 tx=0x7f416800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:02:14.085 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:14.077+0000 7f41757fa640 1 -- 172.21.15.115:0/768695176 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4168011800 con 0x7f4178100d50 2024-09-13T17:02:14.085 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:14.078+0000 7f417dbf5640 1 -- 172.21.15.115:0/768695176 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41781a1ce0 con 0x7f4178100d50 2024-09-13T17:02:14.085 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:14.078+0000 7f41757fa640 1 -- 172.21.15.115:0/768695176 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4168011e00 con 0x7f4178100d50 2024-09-13T17:02:14.085 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:14.078+0000 7f41757fa640 1 -- 172.21.15.115:0/768695176 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f416800f2e0 con 0x7f4178100d50 2024-09-13T17:02:14.085 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:14.078+0000 7f417dbf5640 1 -- 172.21.15.115:0/768695176 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41781a2040 con 0x7f4178100d50 2024-09-13T17:02:14.086 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:14.078+0000 7f417dbf5640 1 -- 172.21.15.115:0/768695176 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4178068c40 con 0x7f4178100d50 2024-09-13T17:02:14.086 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:14.079+0000 7f41757fa640 1 -- 172.21.15.115:0/768695176 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f4168010380 con 0x7f4178100d50 2024-09-13T17:02:14.086 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:14.079+0000 7f41757fa640 1 --2- 172.21.15.115:0/768695176 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f416406cc50 0x7f416406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:14.086 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:14.080+0000 7f41757fa640 1 -- 172.21.15.115:0/768695176 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f416808b8c0 con 0x7f4178100d50 2024-09-13T17:02:14.086 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:14.080+0000 7f416ffff640 1 --2- 172.21.15.115:0/768695176 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f416406cc50 0x7f416406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:14.086 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:14.080+0000 7f416ffff640 1 --2- 172.21.15.115:0/768695176 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f416406cc50 0x7f416406f110 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4178100130 tx=0x7f4160005a20 comp rx=0 tx=0).ready entity=mgr.14207 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:02:14.086 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:14.084+0000 7f41757fa640 1 -- 172.21.15.115:0/768695176 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f4168055fd0 con 0x7f4178100d50 2024-09-13T17:02:14.300 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:14.298+0000 7f417dbf5640 1 -- 172.21.15.115:0/768695176 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f41780ff760 con 0x7f4178100d50 2024-09-13T17:02:14.303 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:14.301+0000 7f41757fa640 1 -- 172.21.15.115:0/768695176 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) v1 ==== 74+0+174019 (secure 0 0 0) 0x7f41680595f0 con 0x7f4178100d50 2024-09-13T17:02:14.306 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:02:14.307 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:14.304+0000 7f417dbf5640 1 -- 172.21.15.115:0/768695176 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f416406cc50 msgr2=0x7f416406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:14.307 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:14.304+0000 7f417dbf5640 1 --2- 172.21.15.115:0/768695176 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f416406cc50 0x7f416406f110 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4178100130 tx=0x7f4160005a20 comp rx=0 tx=0).stop 2024-09-13T17:02:14.307 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:14.304+0000 7f417dbf5640 1 -- 172.21.15.115:0/768695176 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4178100d50 msgr2=0x7f41780fe9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:14.307 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:14.304+0000 7f417dbf5640 1 --2- 172.21.15.115:0/768695176 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4178100d50 0x7f41780fe9b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f416800b420 tx=0x7f416800b8e0 comp rx=0 tx=0).stop 2024-09-13T17:02:14.308 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:14.304+0000 7f417dbf5640 1 -- 172.21.15.115:0/768695176 shutdown_connections 2024-09-13T17:02:14.308 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:14.304+0000 7f417dbf5640 1 --2- 172.21.15.115:0/768695176 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f416406cc50 0x7f416406f110 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:14.308 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:14.304+0000 7f417dbf5640 1 --2- 172.21.15.115:0/768695176 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4178101670 0x7f41780feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:14.308 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:14.304+0000 7f417dbf5640 1 --2- 172.21.15.115:0/768695176 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4178100d50 0x7f41780fe9b0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:14.308 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:14.304+0000 7f417dbf5640 1 -- 172.21.15.115:0/768695176 >> 172.21.15.115:0/768695176 conn(0x7f41780fa6d0 msgr2=0x7f4178101f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:02:14.308 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:14.304+0000 7f417dbf5640 1 -- 172.21.15.115:0/768695176 shutdown_connections 2024-09-13T17:02:14.308 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:14.304+0000 7f417dbf5640 1 -- 172.21.15.115:0/768695176 wait complete. 2024-09-13T17:02:14.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:02:14 smithi195 ceph-mon[34981]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:02:14.580 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:02:14 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:02:14.580 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:02:14 smithi195 ceph-mon[34981]: from='client.? 172.21.15.115:0/768695176' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-13T17:02:14.611 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:02:14 smithi115 ceph-mon[27708]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:02:14.612 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:02:14 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:02:14.612 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:02:14 smithi115 ceph-mon[27708]: from='client.? 172.21.15.115:0/768695176' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-13T17:02:15.035 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":19,"flags":0,"active_gid":14207,"active_name":"smithi115.hetcni","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":244039928},{"type":"v1","addr":"172.21.15.115:6801","nonce":244039928}]},"active_addr":"172.21.15.115:6801/244039928","active_change":"2024-09-13T16:58:29.159480+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":14228,"name":"smithi195.hjjifz","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.115:8443/","prometheus":"http://172.21.15.115:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.115:0","nonce":1473439240}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.115:0","nonce":3967447202}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.115:0","nonce":3268617158}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.115:0","nonce":1641850753}]}]} 2024-09-13T17:02:15.041 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-13T17:02:15.041 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-13T17:02:15.041 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-13T17:02:15.239 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T17:02:16.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:02:16 smithi195 ceph-mon[34981]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:02:16.594 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:02:16 smithi115 ceph-mon[27708]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:02:16.942 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:16.934+0000 7f0a0ff84640 1 -- 172.21.15.115:0/3795660028 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a08101670 msgr2=0x7f0a08109b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:16.942 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:16.934+0000 7f0a0ff84640 1 --2- 172.21.15.115:0/3795660028 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a08101670 0x7f0a08109b60 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0a04009880 tx=0x7f0a0402a530 comp rx=0 tx=0).stop 2024-09-13T17:02:16.942 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:16.934+0000 7f0a0ff84640 1 -- 172.21.15.115:0/3795660028 shutdown_connections 2024-09-13T17:02:16.942 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:16.934+0000 7f0a0ff84640 1 --2- 172.21.15.115:0/3795660028 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a08101670 0x7f0a08109b60 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:16.943 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:16.934+0000 7f0a0ff84640 1 --2- 172.21.15.115:0/3795660028 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0a08100d50 0x7f0a08101130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:16.943 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:16.934+0000 7f0a0ff84640 1 -- 172.21.15.115:0/3795660028 >> 172.21.15.115:0/3795660028 conn(0x7f0a080fa730 msgr2=0x7f0a080fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:02:16.943 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:16.934+0000 7f0a0ff84640 1 -- 172.21.15.115:0/3795660028 shutdown_connections 2024-09-13T17:02:16.943 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:16.934+0000 7f0a0ff84640 1 -- 172.21.15.115:0/3795660028 wait complete. 2024-09-13T17:02:16.943 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:16.935+0000 7f0a0ff84640 1 Processor -- start 2024-09-13T17:02:16.943 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:16.935+0000 7f0a0ff84640 1 -- start start 2024-09-13T17:02:16.943 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:16.935+0000 7f0a0ff84640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a08100d50 0x7f0a0819b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:16.943 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:16.935+0000 7f0a0ff84640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0a08101670 0x7f0a0819bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:16.943 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:16.935+0000 7f0a0ff84640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0819c2f0 con 0x7f0a08100d50 2024-09-13T17:02:16.943 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:16.935+0000 7f0a0ff84640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a08195880 con 0x7f0a08101670 2024-09-13T17:02:16.943 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:16.935+0000 7f0a0dd20640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a08100d50 0x7f0a0819b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:16.944 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:16.935+0000 7f0a0dd20640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a08100d50 0x7f0a0819b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:55526/0 (socket says 172.21.15.115:55526) 2024-09-13T17:02:16.944 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:16.935+0000 7f0a0dd20640 1 -- 172.21.15.115:0/762155406 learned_addr learned my addr 172.21.15.115:0/762155406 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:02:16.944 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:16.935+0000 7f0a0d51f640 1 --2- 172.21.15.115:0/762155406 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0a08101670 0x7f0a0819bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:16.944 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:16.935+0000 7f0a0dd20640 1 -- 172.21.15.115:0/762155406 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0a08101670 msgr2=0x7f0a0819bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:16.944 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:16.935+0000 7f0a0dd20640 1 --2- 172.21.15.115:0/762155406 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0a08101670 0x7f0a0819bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:16.944 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:16.935+0000 7f0a0dd20640 1 -- 172.21.15.115:0/762155406 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a04009560 con 0x7f0a08100d50 2024-09-13T17:02:16.944 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:16.935+0000 7f0a0dd20640 1 --2- 172.21.15.115:0/762155406 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a08100d50 0x7f0a0819b790 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f09f800c8f0 tx=0x7f09f800cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:02:16.944 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:16.936+0000 7f09feffd640 1 -- 172.21.15.115:0/762155406 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f09f8007b80 con 0x7f0a08100d50 2024-09-13T17:02:16.944 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:16.936+0000 7f09feffd640 1 -- 172.21.15.115:0/762155406 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f09f8007ce0 con 0x7f0a08100d50 2024-09-13T17:02:16.944 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:16.936+0000 7f0a0ff84640 1 -- 172.21.15.115:0/762155406 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a08195b60 con 0x7f0a08100d50 2024-09-13T17:02:16.944 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:16.936+0000 7f09feffd640 1 -- 172.21.15.115:0/762155406 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f09f800f450 con 0x7f0a08100d50 2024-09-13T17:02:16.944 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:16.936+0000 7f0a0ff84640 1 -- 172.21.15.115:0/762155406 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a081960b0 con 0x7f0a08100d50 2024-09-13T17:02:16.944 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:16.937+0000 7f0a0ff84640 1 -- 172.21.15.115:0/762155406 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a08068c60 con 0x7f0a08100d50 2024-09-13T17:02:16.945 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:16.937+0000 7f09feffd640 1 -- 172.21.15.115:0/762155406 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f09f8004f10 con 0x7f0a08100d50 2024-09-13T17:02:16.945 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:16.938+0000 7f09feffd640 1 --2- 172.21.15.115:0/762155406 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f09f406cc50 0x7f09f406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:16.945 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:16.938+0000 7f09feffd640 1 -- 172.21.15.115:0/762155406 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f09f808bd70 con 0x7f0a08100d50 2024-09-13T17:02:16.945 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:16.938+0000 7f0a0d51f640 1 --2- 172.21.15.115:0/762155406 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f09f406cc50 0x7f09f406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:16.945 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:16.938+0000 7f0a0d51f640 1 --2- 172.21.15.115:0/762155406 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f09f406cc50 0x7f09f406f110 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0a08196cf0 tx=0x7f0a04005a20 comp rx=0 tx=0).ready entity=mgr.14207 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:02:16.945 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:16.942+0000 7f09feffd640 1 -- 172.21.15.115:0/762155406 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f09f8056480 con 0x7f0a08100d50 2024-09-13T17:02:17.105 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:17.103+0000 7f0a0ff84640 1 -- 172.21.15.115:0/762155406 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0a08101130 con 0x7f0a08100d50 2024-09-13T17:02:17.106 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:17.104+0000 7f09feffd640 1 -- 172.21.15.115:0/762155406 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11398 (secure 0 0 0) 0x7f09f8059aa0 con 0x7f0a08100d50 2024-09-13T17:02:17.106 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:02:17.106 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":40,"fsid":"ffbd7588-71f0-11ef-bceb-c7b262605968","created":"2024-09-13T16:56:28.790927+0000","modified":"2024-09-13T17:01:58.280281+0000","last_up_change":"2024-09-13T17:01:57.275978+0000","last_in_change":"2024-09-13T17:01:39.088735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:00:47.472140+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9fb96264-a71d-43b2-8d65-b4280a8ad8ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":2697967112},{"type":"v1","addr":"172.21.15.115:6803","nonce":2697967112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":2697967112},{"type":"v1","addr":"172.21.15.115:6805","nonce":2697967112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":2697967112},{"type":"v1","addr":"172.21.15.115:6809","nonce":2697967112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":2697967112},{"type":"v1","addr":"172.21.15.115:6807","nonce":2697967112}]},"public_addr":"172.21.15.115:6803/2697967112","cluster_addr":"172.21.15.115:6805/2697967112","heartbeat_back_addr":"172.21.15.115:6809/2697967112","heartbeat_front_addr":"172.21.15.115:6807/2697967112","state":["exists","up"]},{"osd":1,"uuid":"876bf075-f0e1-49dc-90cc-aedccbd19b2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":3928285174},{"type":"v1","addr":"172.21.15.115:6811","nonce":3928285174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":3928285174},{"type":"v1","addr":"172.21.15.115:6813","nonce":3928285174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":3928285174},{"type":"v1","addr":"172.21.15.115:6817","nonce":3928285174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":3928285174},{"type":"v1","addr":"172.21.15.115:6815","nonce":3928285174}]},"public_addr":"172.21.15.115:6811/3928285174","cluster_addr":"172.21.15.115:6813/3928285174","heartbeat_back_addr":"172.21.15.115:6817/3928285174","heartbeat_front_addr":"172.21.15.115:6815/3928285174","state":["exists","up"]},{"osd":2,"uuid":"40bc0278-21e6-4863-86bf-f5ee3bfc2fbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":1608421656},{"type":"v1","addr":"172.21.15.115:6819","nonce":1608421656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":1608421656},{"type":"v1","addr":"172.21.15.115:6821","nonce":1608421656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":1608421656},{"type":"v1","addr":"172.21.15.115:6825","nonce":1608421656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":1608421656},{"type":"v1","addr":"172.21.15.115:6823","nonce":1608421656}]},"public_addr":"172.21.15.115:6819/1608421656","cluster_addr":"172.21.15.115:6821/1608421656","heartbeat_back_addr":"172.21.15.115:6825/1608421656","heartbeat_front_addr":"172.21.15.115:6823/1608421656","state":["exists","up"]},{"osd":3,"uuid":"af3d701a-1c69-4cf2-a343-938ac1bbb34a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3054971968},{"type":"v1","addr":"172.21.15.195:6801","nonce":3054971968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3054971968},{"type":"v1","addr":"172.21.15.195:6803","nonce":3054971968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3054971968},{"type":"v1","addr":"172.21.15.195:6807","nonce":3054971968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3054971968},{"type":"v1","addr":"172.21.15.195:6805","nonce":3054971968}]},"public_addr":"172.21.15.195:6801/3054971968","cluster_addr":"172.21.15.195:6803/3054971968","heartbeat_back_addr":"172.21.15.195:6807/3054971968","heartbeat_front_addr":"172.21.15.195:6805/3054971968","state":["exists","up"]},{"osd":4,"uuid":"7bf484b6-6ed5-4fe7-8aa4-505853e2cd1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":1840094638},{"type":"v1","addr":"172.21.15.195:6809","nonce":1840094638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":1840094638},{"type":"v1","addr":"172.21.15.195:6811","nonce":1840094638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":1840094638},{"type":"v1","addr":"172.21.15.195:6815","nonce":1840094638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":1840094638},{"type":"v1","addr":"172.21.15.195:6813","nonce":1840094638}]},"public_addr":"172.21.15.195:6809/1840094638","cluster_addr":"172.21.15.195:6811/1840094638","heartbeat_back_addr":"172.21.15.195:6815/1840094638","heartbeat_front_addr":"172.21.15.195:6813/1840094638","state":["exists","up"]},{"osd":5,"uuid":"1eb8bcc4-dc9b-4a00-bf43-a707da3c141f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1862675419},{"type":"v1","addr":"172.21.15.195:6817","nonce":1862675419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1862675419},{"type":"v1","addr":"172.21.15.195:6819","nonce":1862675419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1862675419},{"type":"v1","addr":"172.21.15.195:6823","nonce":1862675419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1862675419},{"type":"v1","addr":"172.21.15.195:6821","nonce":1862675419}]},"public_addr":"172.21.15.195:6817/1862675419","cluster_addr":"172.21.15.195:6819/1862675419","heartbeat_back_addr":"172.21.15.195:6823/1862675419","heartbeat_front_addr":"172.21.15.195:6821/1862675419","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:59:47.662383+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:00:14.730551+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:00:43.856416+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:01:06.336209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:01:30.680442+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:01:55.518043+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.115:0/2751677160":"2024-09-14T16:58:29.159373+0000","172.21.15.115:6800/1463863592":"2024-09-14T16:56:57.112847+0000","172.21.15.115:0/3723628457":"2024-09-14T16:56:57.112847+0000","172.21.15.115:6801/1463863592":"2024-09-14T16:56:57.112847+0000","172.21.15.115:0/376622152":"2024-09-14T16:57:27.333203+0000","172.21.15.115:0/648599851":"2024-09-14T16:56:57.112847+0000","172.21.15.115:0/3791301867":"2024-09-14T16:57:27.333203+0000","172.21.15.115:0/2966038005":"2024-09-14T16:56:57.112847+0000","172.21.15.115:6801/3889408988":"2024-09-14T16:58:29.159373+0000","172.21.15.115:0/3586970461":"2024-09-14T16:57:27.333203+0000","172.21.15.115:6800/2943337696":"2024-09-14T16:57:27.333203+0000","172.21.15.115:6801/2943337696":"2024-09-14T16:57:27.333203+0000","172.21.15.115:0/247720257":"2024-09-14T16:58:29.159373+0000","172.21.15.115:0/931588236":"2024-09-14T16:58:29.159373+0000","172.21.15.115:6800/3889408988":"2024-09-14T16:58:29.159373+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:02:17.108 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:17.106+0000 7f0a0ff84640 1 -- 172.21.15.115:0/762155406 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f09f406cc50 msgr2=0x7f09f406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:17.109 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:17.106+0000 7f0a0ff84640 1 --2- 172.21.15.115:0/762155406 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f09f406cc50 0x7f09f406f110 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0a08196cf0 tx=0x7f0a04005a20 comp rx=0 tx=0).stop 2024-09-13T17:02:17.109 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:17.106+0000 7f0a0ff84640 1 -- 172.21.15.115:0/762155406 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a08100d50 msgr2=0x7f0a0819b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:17.109 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:17.106+0000 7f0a0ff84640 1 --2- 172.21.15.115:0/762155406 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a08100d50 0x7f0a0819b790 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f09f800c8f0 tx=0x7f09f800cdb0 comp rx=0 tx=0).stop 2024-09-13T17:02:17.109 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:17.106+0000 7f0a0ff84640 1 -- 172.21.15.115:0/762155406 shutdown_connections 2024-09-13T17:02:17.109 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:17.106+0000 7f0a0ff84640 1 --2- 172.21.15.115:0/762155406 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f09f406cc50 0x7f09f406f110 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:17.109 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:17.106+0000 7f0a0ff84640 1 --2- 172.21.15.115:0/762155406 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0a08101670 0x7f0a0819bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:17.109 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:17.106+0000 7f0a0ff84640 1 --2- 172.21.15.115:0/762155406 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a08100d50 0x7f0a0819b790 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:17.109 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:17.106+0000 7f0a0ff84640 1 -- 172.21.15.115:0/762155406 >> 172.21.15.115:0/762155406 conn(0x7f0a080fa730 msgr2=0x7f0a08101f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:02:17.109 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:17.106+0000 7f0a0ff84640 1 -- 172.21.15.115:0/762155406 shutdown_connections 2024-09-13T17:02:17.109 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:17.106+0000 7f0a0ff84640 1 -- 172.21.15.115:0/762155406 wait complete. 2024-09-13T17:02:17.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:02:17 smithi115 ceph-mon[27708]: from='client.? 172.21.15.115:0/762155406' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:02:17.576 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:02:17 smithi195 ceph-mon[34981]: from='client.? 172.21.15.115:0/762155406' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:02:17.878 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-13T17:02:17.879 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-13T17:02:18.077 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T17:02:18.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:02:18 smithi115 ceph-mon[27708]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:02:18.576 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:02:18 smithi195 ceph-mon[34981]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:02:19.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:19.750+0000 7fc2fa970640 1 -- 172.21.15.115:0/967791704 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2f41049a0 msgr2=0x7fc2f4104d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:19.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:19.750+0000 7fc2fa970640 1 --2- 172.21.15.115:0/967791704 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2f41049a0 0x7fc2f4104d80 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc2e4009880 tx=0x7fc2e402a4a0 comp rx=0 tx=0).stop 2024-09-13T17:02:19.757 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:19.750+0000 7fc2fa970640 1 -- 172.21.15.115:0/967791704 shutdown_connections 2024-09-13T17:02:19.757 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:19.750+0000 7fc2fa970640 1 --2- 172.21.15.115:0/967791704 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc2f40fe9a0 0x7fc2f40fee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:19.757 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:19.750+0000 7fc2fa970640 1 --2- 172.21.15.115:0/967791704 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2f41049a0 0x7fc2f4104d80 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:19.757 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:19.750+0000 7fc2fa970640 1 -- 172.21.15.115:0/967791704 >> 172.21.15.115:0/967791704 conn(0x7fc2f40758c0 msgr2=0x7fc2f40fcc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:02:19.757 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:19.750+0000 7fc2fa970640 1 -- 172.21.15.115:0/967791704 shutdown_connections 2024-09-13T17:02:19.757 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:19.750+0000 7fc2fa970640 1 -- 172.21.15.115:0/967791704 wait complete. 2024-09-13T17:02:19.757 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:19.750+0000 7fc2fa970640 1 Processor -- start 2024-09-13T17:02:19.757 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:19.750+0000 7fc2fa970640 1 -- start start 2024-09-13T17:02:19.757 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:19.751+0000 7fc2fa970640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2f40fe9a0 0x7fc2f419a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:19.757 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:19.751+0000 7fc2fa970640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc2f41049a0 0x7fc2f419acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:19.757 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:19.751+0000 7fc2fa970640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f419b2f0 con 0x7fc2f40fe9a0 2024-09-13T17:02:19.757 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:19.751+0000 7fc2fa970640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f41948d0 con 0x7fc2f41049a0 2024-09-13T17:02:19.758 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:19.751+0000 7fc2f3fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2f40fe9a0 0x7fc2f419a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:19.758 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:19.751+0000 7fc2f3fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2f40fe9a0 0x7fc2f419a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:55546/0 (socket says 172.21.15.115:55546) 2024-09-13T17:02:19.758 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:19.751+0000 7fc2f3fff640 1 -- 172.21.15.115:0/4261725110 learned_addr learned my addr 172.21.15.115:0/4261725110 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:02:19.758 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:19.751+0000 7fc2f3fff640 1 -- 172.21.15.115:0/4261725110 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc2f41049a0 msgr2=0x7fc2f419acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:19.758 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:19.751+0000 7fc2f3fff640 1 --2- 172.21.15.115:0/4261725110 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc2f41049a0 0x7fc2f419acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:19.758 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:19.751+0000 7fc2f3fff640 1 -- 172.21.15.115:0/4261725110 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2e4009560 con 0x7fc2f40fe9a0 2024-09-13T17:02:19.758 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:19.751+0000 7fc2f3fff640 1 --2- 172.21.15.115:0/4261725110 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2f40fe9a0 0x7fc2f419a790 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc2e4006010 tx=0x7fc2e40056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:02:19.758 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:19.751+0000 7fc2f1ffb640 1 -- 172.21.15.115:0/4261725110 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2e4004ba0 con 0x7fc2f40fe9a0 2024-09-13T17:02:19.758 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:19.751+0000 7fc2fa970640 1 -- 172.21.15.115:0/4261725110 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2f4194b50 con 0x7fc2f40fe9a0 2024-09-13T17:02:19.758 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:19.751+0000 7fc2f1ffb640 1 -- 172.21.15.115:0/4261725110 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc2e4004d00 con 0x7fc2f40fe9a0 2024-09-13T17:02:19.758 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:19.751+0000 7fc2f1ffb640 1 -- 172.21.15.115:0/4261725110 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2e4031910 con 0x7fc2f40fe9a0 2024-09-13T17:02:19.758 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:19.751+0000 7fc2fa970640 1 -- 172.21.15.115:0/4261725110 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2f4195040 con 0x7fc2f40fe9a0 2024-09-13T17:02:19.758 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:19.752+0000 7fc2fa970640 1 -- 172.21.15.115:0/4261725110 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2f41000e0 con 0x7fc2f40fe9a0 2024-09-13T17:02:19.759 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:19.753+0000 7fc2f1ffb640 1 -- 172.21.15.115:0/4261725110 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fc2e4031b80 con 0x7fc2f40fe9a0 2024-09-13T17:02:19.759 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:19.753+0000 7fc2f1ffb640 1 --2- 172.21.15.115:0/4261725110 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fc2e006cc50 0x7fc2e006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:19.759 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:19.753+0000 7fc2f1ffb640 1 -- 172.21.15.115:0/4261725110 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fc2e40ad130 con 0x7fc2f40fe9a0 2024-09-13T17:02:19.759 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:19.753+0000 7fc2ebfff640 1 --2- 172.21.15.115:0/4261725110 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fc2e006cc50 0x7fc2e006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:19.759 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:19.754+0000 7fc2ebfff640 1 --2- 172.21.15.115:0/4261725110 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fc2e006cc50 0x7fc2e006f110 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc2f4195cf0 tx=0x7fc2dc006c90 comp rx=0 tx=0).ready entity=mgr.14207 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:02:19.760 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:19.758+0000 7fc2f1ffb640 1 -- 172.21.15.115:0/4261725110 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc2e4077840 con 0x7fc2f40fe9a0 2024-09-13T17:02:19.921 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:19.920+0000 7fc2fa970640 1 -- 172.21.15.115:0/4261725110 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc2f40fee80 con 0x7fc2f40fe9a0 2024-09-13T17:02:19.922 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:19.921+0000 7fc2f1ffb640 1 -- 172.21.15.115:0/4261725110 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11398 (secure 0 0 0) 0x7fc2e407ae60 con 0x7fc2f40fe9a0 2024-09-13T17:02:19.922 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:02:19.922 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":40,"fsid":"ffbd7588-71f0-11ef-bceb-c7b262605968","created":"2024-09-13T16:56:28.790927+0000","modified":"2024-09-13T17:01:58.280281+0000","last_up_change":"2024-09-13T17:01:57.275978+0000","last_in_change":"2024-09-13T17:01:39.088735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:00:47.472140+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9fb96264-a71d-43b2-8d65-b4280a8ad8ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":2697967112},{"type":"v1","addr":"172.21.15.115:6803","nonce":2697967112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":2697967112},{"type":"v1","addr":"172.21.15.115:6805","nonce":2697967112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":2697967112},{"type":"v1","addr":"172.21.15.115:6809","nonce":2697967112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":2697967112},{"type":"v1","addr":"172.21.15.115:6807","nonce":2697967112}]},"public_addr":"172.21.15.115:6803/2697967112","cluster_addr":"172.21.15.115:6805/2697967112","heartbeat_back_addr":"172.21.15.115:6809/2697967112","heartbeat_front_addr":"172.21.15.115:6807/2697967112","state":["exists","up"]},{"osd":1,"uuid":"876bf075-f0e1-49dc-90cc-aedccbd19b2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":3928285174},{"type":"v1","addr":"172.21.15.115:6811","nonce":3928285174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":3928285174},{"type":"v1","addr":"172.21.15.115:6813","nonce":3928285174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":3928285174},{"type":"v1","addr":"172.21.15.115:6817","nonce":3928285174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":3928285174},{"type":"v1","addr":"172.21.15.115:6815","nonce":3928285174}]},"public_addr":"172.21.15.115:6811/3928285174","cluster_addr":"172.21.15.115:6813/3928285174","heartbeat_back_addr":"172.21.15.115:6817/3928285174","heartbeat_front_addr":"172.21.15.115:6815/3928285174","state":["exists","up"]},{"osd":2,"uuid":"40bc0278-21e6-4863-86bf-f5ee3bfc2fbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":1608421656},{"type":"v1","addr":"172.21.15.115:6819","nonce":1608421656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":1608421656},{"type":"v1","addr":"172.21.15.115:6821","nonce":1608421656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":1608421656},{"type":"v1","addr":"172.21.15.115:6825","nonce":1608421656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":1608421656},{"type":"v1","addr":"172.21.15.115:6823","nonce":1608421656}]},"public_addr":"172.21.15.115:6819/1608421656","cluster_addr":"172.21.15.115:6821/1608421656","heartbeat_back_addr":"172.21.15.115:6825/1608421656","heartbeat_front_addr":"172.21.15.115:6823/1608421656","state":["exists","up"]},{"osd":3,"uuid":"af3d701a-1c69-4cf2-a343-938ac1bbb34a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3054971968},{"type":"v1","addr":"172.21.15.195:6801","nonce":3054971968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3054971968},{"type":"v1","addr":"172.21.15.195:6803","nonce":3054971968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3054971968},{"type":"v1","addr":"172.21.15.195:6807","nonce":3054971968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3054971968},{"type":"v1","addr":"172.21.15.195:6805","nonce":3054971968}]},"public_addr":"172.21.15.195:6801/3054971968","cluster_addr":"172.21.15.195:6803/3054971968","heartbeat_back_addr":"172.21.15.195:6807/3054971968","heartbeat_front_addr":"172.21.15.195:6805/3054971968","state":["exists","up"]},{"osd":4,"uuid":"7bf484b6-6ed5-4fe7-8aa4-505853e2cd1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":1840094638},{"type":"v1","addr":"172.21.15.195:6809","nonce":1840094638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":1840094638},{"type":"v1","addr":"172.21.15.195:6811","nonce":1840094638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":1840094638},{"type":"v1","addr":"172.21.15.195:6815","nonce":1840094638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":1840094638},{"type":"v1","addr":"172.21.15.195:6813","nonce":1840094638}]},"public_addr":"172.21.15.195:6809/1840094638","cluster_addr":"172.21.15.195:6811/1840094638","heartbeat_back_addr":"172.21.15.195:6815/1840094638","heartbeat_front_addr":"172.21.15.195:6813/1840094638","state":["exists","up"]},{"osd":5,"uuid":"1eb8bcc4-dc9b-4a00-bf43-a707da3c141f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1862675419},{"type":"v1","addr":"172.21.15.195:6817","nonce":1862675419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1862675419},{"type":"v1","addr":"172.21.15.195:6819","nonce":1862675419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1862675419},{"type":"v1","addr":"172.21.15.195:6823","nonce":1862675419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1862675419},{"type":"v1","addr":"172.21.15.195:6821","nonce":1862675419}]},"public_addr":"172.21.15.195:6817/1862675419","cluster_addr":"172.21.15.195:6819/1862675419","heartbeat_back_addr":"172.21.15.195:6823/1862675419","heartbeat_front_addr":"172.21.15.195:6821/1862675419","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:59:47.662383+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:00:14.730551+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:00:43.856416+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:01:06.336209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:01:30.680442+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:01:55.518043+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.115:0/2751677160":"2024-09-14T16:58:29.159373+0000","172.21.15.115:6800/1463863592":"2024-09-14T16:56:57.112847+0000","172.21.15.115:0/3723628457":"2024-09-14T16:56:57.112847+0000","172.21.15.115:6801/1463863592":"2024-09-14T16:56:57.112847+0000","172.21.15.115:0/376622152":"2024-09-14T16:57:27.333203+0000","172.21.15.115:0/648599851":"2024-09-14T16:56:57.112847+0000","172.21.15.115:0/3791301867":"2024-09-14T16:57:27.333203+0000","172.21.15.115:0/2966038005":"2024-09-14T16:56:57.112847+0000","172.21.15.115:6801/3889408988":"2024-09-14T16:58:29.159373+0000","172.21.15.115:0/3586970461":"2024-09-14T16:57:27.333203+0000","172.21.15.115:6800/2943337696":"2024-09-14T16:57:27.333203+0000","172.21.15.115:6801/2943337696":"2024-09-14T16:57:27.333203+0000","172.21.15.115:0/247720257":"2024-09-14T16:58:29.159373+0000","172.21.15.115:0/931588236":"2024-09-14T16:58:29.159373+0000","172.21.15.115:6800/3889408988":"2024-09-14T16:58:29.159373+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:02:19.924 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:19.923+0000 7fc2fa970640 1 -- 172.21.15.115:0/4261725110 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fc2e006cc50 msgr2=0x7fc2e006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:19.925 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:19.923+0000 7fc2fa970640 1 --2- 172.21.15.115:0/4261725110 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fc2e006cc50 0x7fc2e006f110 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc2f4195cf0 tx=0x7fc2dc006c90 comp rx=0 tx=0).stop 2024-09-13T17:02:19.925 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:19.923+0000 7fc2fa970640 1 -- 172.21.15.115:0/4261725110 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2f40fe9a0 msgr2=0x7fc2f419a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:19.925 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:19.923+0000 7fc2fa970640 1 --2- 172.21.15.115:0/4261725110 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2f40fe9a0 0x7fc2f419a790 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc2e4006010 tx=0x7fc2e40056e0 comp rx=0 tx=0).stop 2024-09-13T17:02:19.925 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:19.923+0000 7fc2fa970640 1 -- 172.21.15.115:0/4261725110 shutdown_connections 2024-09-13T17:02:19.925 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:19.923+0000 7fc2fa970640 1 --2- 172.21.15.115:0/4261725110 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fc2e006cc50 0x7fc2e006f110 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:19.925 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:19.923+0000 7fc2fa970640 1 --2- 172.21.15.115:0/4261725110 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc2f41049a0 0x7fc2f419acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:19.925 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:19.923+0000 7fc2fa970640 1 --2- 172.21.15.115:0/4261725110 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2f40fe9a0 0x7fc2f419a790 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:19.925 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:19.923+0000 7fc2fa970640 1 -- 172.21.15.115:0/4261725110 >> 172.21.15.115:0/4261725110 conn(0x7fc2f40758c0 msgr2=0x7fc2f40fcc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:02:19.925 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:19.923+0000 7fc2fa970640 1 -- 172.21.15.115:0/4261725110 shutdown_connections 2024-09-13T17:02:19.925 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:19.923+0000 7fc2fa970640 1 -- 172.21.15.115:0/4261725110 wait complete. 2024-09-13T17:02:20.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:02:20 smithi195 ceph-mon[34981]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:02:20.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:02:20 smithi195 ceph-mon[34981]: from='client.? 172.21.15.115:0/4261725110' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:02:20.652 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:02:20 smithi115 ceph-mon[27708]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:02:20.652 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:02:20 smithi115 ceph-mon[27708]: from='client.? 172.21.15.115:0/4261725110' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:02:20.673 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-13T17:02:20.674 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-13T17:02:20.674 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-13T17:02:20.674 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-13T17:02:20.675 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-13T17:02:20.675 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-13T17:02:20.961 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T17:02:20.962 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T17:02:21.038 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T17:02:21.039 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T17:02:21.040 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T17:02:21.041 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T17:02:22.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:02:22 smithi115 ceph-mon[27708]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:02:22.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:02:22 smithi195 ceph-mon[34981]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:02:24.634 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:02:24 smithi115 ceph-mon[27708]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:02:24.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:02:24 smithi195 ceph-mon[34981]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:02:26.604 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:02:26 smithi115 ceph-mon[27708]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:02:26.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:02:26 smithi195 ceph-mon[34981]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:02:28.344 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.326+0000 7f9b2a31a640 1 -- 172.21.15.115:0/4214631859 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9b241049a0 msgr2=0x7f9b24104d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:28.344 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.326+0000 7f9b2a31a640 1 --2- 172.21.15.115:0/4214631859 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9b241049a0 0x7f9b24104d80 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9b14009880 tx=0x7f9b1402a4a0 comp rx=0 tx=0).stop 2024-09-13T17:02:28.344 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.326+0000 7f9b2a31a640 1 -- 172.21.15.115:0/4214631859 shutdown_connections 2024-09-13T17:02:28.344 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.326+0000 7f9b2a31a640 1 --2- 172.21.15.115:0/4214631859 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9b240fe9a0 0x7f9b240fee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:28.344 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.326+0000 7f9b2a31a640 1 --2- 172.21.15.115:0/4214631859 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9b241049a0 0x7f9b24104d80 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:28.344 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.326+0000 7f9b2a31a640 1 -- 172.21.15.115:0/4214631859 >> 172.21.15.115:0/4214631859 conn(0x7f9b240758c0 msgr2=0x7f9b240fcc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:02:28.344 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.326+0000 7f9b2a31a640 1 -- 172.21.15.115:0/4214631859 shutdown_connections 2024-09-13T17:02:28.344 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.326+0000 7f9b2a31a640 1 -- 172.21.15.115:0/4214631859 wait complete. 2024-09-13T17:02:28.345 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.327+0000 7f9b2a31a640 1 Processor -- start 2024-09-13T17:02:28.345 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.327+0000 7f9b2a31a640 1 -- start start 2024-09-13T17:02:28.345 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.327+0000 7f9b2a31a640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9b240fe9a0 0x7f9b2419a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:28.345 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.327+0000 7f9b2a31a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9b241049a0 0x7f9b2419acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:28.345 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.327+0000 7f9b2a31a640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b2419b2f0 con 0x7f9b241049a0 2024-09-13T17:02:28.345 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.327+0000 7f9b2a31a640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b241948d0 con 0x7f9b240fe9a0 2024-09-13T17:02:28.345 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.328+0000 7f9b237fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9b241049a0 0x7f9b2419acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:28.345 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.328+0000 7f9b237fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9b241049a0 0x7f9b2419acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60550/0 (socket says 172.21.15.115:60550) 2024-09-13T17:02:28.345 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.328+0000 7f9b237fe640 1 -- 172.21.15.115:0/3191871270 learned_addr learned my addr 172.21.15.115:0/3191871270 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:02:28.345 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.328+0000 7f9b23fff640 1 --2- 172.21.15.115:0/3191871270 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9b240fe9a0 0x7f9b2419a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:28.345 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.328+0000 7f9b237fe640 1 -- 172.21.15.115:0/3191871270 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9b240fe9a0 msgr2=0x7f9b2419a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:28.345 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.328+0000 7f9b237fe640 1 --2- 172.21.15.115:0/3191871270 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9b240fe9a0 0x7f9b2419a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:28.345 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.328+0000 7f9b237fe640 1 -- 172.21.15.115:0/3191871270 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b14009560 con 0x7f9b241049a0 2024-09-13T17:02:28.346 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.328+0000 7f9b237fe640 1 --2- 172.21.15.115:0/3191871270 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9b241049a0 0x7f9b2419acd0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9b1800b420 tx=0x7f9b1800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:02:28.346 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.328+0000 7f9b217fa640 1 -- 172.21.15.115:0/3191871270 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b18011800 con 0x7f9b241049a0 2024-09-13T17:02:28.346 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.328+0000 7f9b217fa640 1 -- 172.21.15.115:0/3191871270 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9b18011e00 con 0x7f9b241049a0 2024-09-13T17:02:28.346 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.328+0000 7f9b2a31a640 1 -- 172.21.15.115:0/3191871270 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b24194bb0 con 0x7f9b241049a0 2024-09-13T17:02:28.346 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.328+0000 7f9b2a31a640 1 -- 172.21.15.115:0/3191871270 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b24195100 con 0x7f9b241049a0 2024-09-13T17:02:28.346 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.328+0000 7f9b217fa640 1 -- 172.21.15.115:0/3191871270 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b1800f2e0 con 0x7f9b241049a0 2024-09-13T17:02:28.346 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.329+0000 7f9b2a31a640 1 -- 172.21.15.115:0/3191871270 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9b2410be50 con 0x7f9b241049a0 2024-09-13T17:02:28.346 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.330+0000 7f9b217fa640 1 -- 172.21.15.115:0/3191871270 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f9b18010380 con 0x7f9b241049a0 2024-09-13T17:02:28.346 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.330+0000 7f9b217fa640 1 --2- 172.21.15.115:0/3191871270 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f9b0c06cc50 0x7f9b0c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:28.346 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.331+0000 7f9b23fff640 1 --2- 172.21.15.115:0/3191871270 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f9b0c06cc50 0x7f9b0c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:28.346 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.331+0000 7f9b217fa640 1 -- 172.21.15.115:0/3191871270 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f9b1808b760 con 0x7f9b241049a0 2024-09-13T17:02:28.346 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.331+0000 7f9b217fa640 1 --2- 172.21.15.115:0/3191871270 >> [v2:172.21.15.195:6800/3054971968,v1:172.21.15.195:6801/3054971968] conn(0x7f9b0c0729e0 0x7f9b0c074e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:28.346 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.331+0000 7f9b217fa640 1 -- 172.21.15.115:0/3191871270 --> [v2:172.21.15.195:6800/3054971968,v1:172.21.15.195:6801/3054971968] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9b0c0754b0 con 0x7f9b0c0729e0 2024-09-13T17:02:28.347 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.331+0000 7f9b217fa640 1 -- 172.21.15.115:0/3191871270 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9b1808de30 con 0x7f9b241049a0 2024-09-13T17:02:28.347 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.331+0000 7f9b23fff640 1 --2- 172.21.15.115:0/3191871270 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f9b0c06cc50 0x7f9b0c06f110 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9b14000c00 tx=0x7f9b140058d0 comp rx=0 tx=0).ready entity=mgr.14207 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:02:28.347 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.331+0000 7f9b288b7640 1 --2- 172.21.15.115:0/3191871270 >> [v2:172.21.15.195:6800/3054971968,v1:172.21.15.195:6801/3054971968] conn(0x7f9b0c0729e0 0x7f9b0c074e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:28.347 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.332+0000 7f9b288b7640 1 --2- 172.21.15.115:0/3191871270 >> [v2:172.21.15.195:6800/3054971968,v1:172.21.15.195:6801/3054971968] conn(0x7f9b0c0729e0 0x7f9b0c074e00 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:02:28.347 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.332+0000 7f9b217fa640 1 -- 172.21.15.115:0/3191871270 <== osd.3 v2:172.21.15.195:6800/3054971968 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f9b0c0754b0 con 0x7f9b0c0729e0 2024-09-13T17:02:28.347 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.346+0000 7f9b2a31a640 1 -- 172.21.15.115:0/3191871270 --> [v2:172.21.15.195:6800/3054971968,v1:172.21.15.195:6801/3054971968] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9b241955b0 con 0x7f9b0c0729e0 2024-09-13T17:02:28.348 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.346+0000 7f9b217fa640 1 -- 172.21.15.115:0/3191871270 <== osd.3 v2:172.21.15.195:6800/3054971968 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f9b241955b0 con 0x7f9b0c0729e0 2024-09-13T17:02:28.348 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.346+0000 7f9b2a31a640 1 -- 172.21.15.115:0/3191871270 >> [v2:172.21.15.195:6800/3054971968,v1:172.21.15.195:6801/3054971968] conn(0x7f9b0c0729e0 msgr2=0x7f9b0c074e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:28.349 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.347+0000 7f9b2a31a640 1 --2- 172.21.15.115:0/3191871270 >> [v2:172.21.15.195:6800/3054971968,v1:172.21.15.195:6801/3054971968] conn(0x7f9b0c0729e0 0x7f9b0c074e00 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:28.349 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.347+0000 7f9b2a31a640 1 -- 172.21.15.115:0/3191871270 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f9b0c06cc50 msgr2=0x7f9b0c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:28.349 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.347+0000 7f9b2a31a640 1 --2- 172.21.15.115:0/3191871270 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f9b0c06cc50 0x7f9b0c06f110 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9b14000c00 tx=0x7f9b140058d0 comp rx=0 tx=0).stop 2024-09-13T17:02:28.349 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.347+0000 7f9b2a31a640 1 -- 172.21.15.115:0/3191871270 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9b241049a0 msgr2=0x7f9b2419acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:28.349 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.347+0000 7f9b2a31a640 1 --2- 172.21.15.115:0/3191871270 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9b241049a0 0x7f9b2419acd0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9b1800b420 tx=0x7f9b1800b8e0 comp rx=0 tx=0).stop 2024-09-13T17:02:28.349 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.347+0000 7f9b2a31a640 1 -- 172.21.15.115:0/3191871270 shutdown_connections 2024-09-13T17:02:28.349 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.347+0000 7f9b2a31a640 1 --2- 172.21.15.115:0/3191871270 >> [v2:172.21.15.195:6800/3054971968,v1:172.21.15.195:6801/3054971968] conn(0x7f9b0c0729e0 0x7f9b0c074e00 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:28.349 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.347+0000 7f9b2a31a640 1 --2- 172.21.15.115:0/3191871270 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f9b0c06cc50 0x7f9b0c06f110 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:28.349 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.347+0000 7f9b2a31a640 1 --2- 172.21.15.115:0/3191871270 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9b241049a0 0x7f9b2419acd0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:28.349 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.347+0000 7f9b2a31a640 1 --2- 172.21.15.115:0/3191871270 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9b240fe9a0 0x7f9b2419a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:28.349 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.347+0000 7f9b2a31a640 1 -- 172.21.15.115:0/3191871270 >> 172.21.15.115:0/3191871270 conn(0x7f9b240758c0 msgr2=0x7f9b240fcc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:02:28.349 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.347+0000 7f9b2a31a640 1 -- 172.21.15.115:0/3191871270 shutdown_connections 2024-09-13T17:02:28.350 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.347+0000 7f9b2a31a640 1 -- 172.21.15.115:0/3191871270 wait complete. 2024-09-13T17:02:28.428 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:02:28 smithi115 ceph-mon[27708]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:02:28.553 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.550+0000 7f34a8999640 1 -- 172.21.15.115:0/3573064620 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34a41049a0 msgr2=0x7f34a4104d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:28.553 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.550+0000 7f34a8999640 1 --2- 172.21.15.115:0/3573064620 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34a41049a0 0x7f34a4104d80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3494009880 tx=0x7f349402a4a0 comp rx=0 tx=0).stop 2024-09-13T17:02:28.553 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.550+0000 7f34a8999640 1 -- 172.21.15.115:0/3573064620 shutdown_connections 2024-09-13T17:02:28.553 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.550+0000 7f34a8999640 1 --2- 172.21.15.115:0/3573064620 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34a40fe9a0 0x7f34a40fee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:28.553 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.550+0000 7f34a8999640 1 --2- 172.21.15.115:0/3573064620 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34a41049a0 0x7f34a4104d80 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:28.553 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.550+0000 7f34a8999640 1 -- 172.21.15.115:0/3573064620 >> 172.21.15.115:0/3573064620 conn(0x7f34a40758c0 msgr2=0x7f34a40fcc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:02:28.553 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.550+0000 7f34a8999640 1 -- 172.21.15.115:0/3573064620 shutdown_connections 2024-09-13T17:02:28.553 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.550+0000 7f34a8999640 1 -- 172.21.15.115:0/3573064620 wait complete. 2024-09-13T17:02:28.553 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.551+0000 7f34a8999640 1 Processor -- start 2024-09-13T17:02:28.554 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.551+0000 7f34a8999640 1 -- start start 2024-09-13T17:02:28.554 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.551+0000 7f34a8999640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34a40fe9a0 0x7f34a419b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:28.554 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.551+0000 7f34a8999640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34a41049a0 0x7f34a419bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:28.554 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.551+0000 7f34a8999640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a419c340 con 0x7f34a40fe9a0 2024-09-13T17:02:28.554 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.551+0000 7f34a8999640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a4195930 con 0x7f34a41049a0 2024-09-13T17:02:28.554 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.551+0000 7f34a259c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34a40fe9a0 0x7f34a419b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:28.554 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.551+0000 7f34a259c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34a40fe9a0 0x7f34a419b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60570/0 (socket says 172.21.15.115:60570) 2024-09-13T17:02:28.555 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.551+0000 7f34a259c640 1 -- 172.21.15.115:0/2950495196 learned_addr learned my addr 172.21.15.115:0/2950495196 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:02:28.555 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.552+0000 7f349bfff640 1 --2- 172.21.15.115:0/2950495196 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34a41049a0 0x7f34a419bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:28.555 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.552+0000 7f34a259c640 1 -- 172.21.15.115:0/2950495196 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34a41049a0 msgr2=0x7f34a419bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:28.556 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.552+0000 7f34a259c640 1 --2- 172.21.15.115:0/2950495196 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34a41049a0 0x7f34a419bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:28.556 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.552+0000 7f34a259c640 1 -- 172.21.15.115:0/2950495196 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3494009560 con 0x7f34a40fe9a0 2024-09-13T17:02:28.556 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.552+0000 7f349bfff640 1 --2- 172.21.15.115:0/2950495196 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34a41049a0 0x7f34a419bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:02:28.556 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.553+0000 7f34a259c640 1 --2- 172.21.15.115:0/2950495196 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34a40fe9a0 0x7f34a419b770 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3494006010 tx=0x7f34940056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:02:28.556 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.553+0000 7f349b7fe640 1 -- 172.21.15.115:0/2950495196 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3494004ba0 con 0x7f34a40fe9a0 2024-09-13T17:02:28.556 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.553+0000 7f349b7fe640 1 -- 172.21.15.115:0/2950495196 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3494005d50 con 0x7f34a40fe9a0 2024-09-13T17:02:28.556 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.553+0000 7f349b7fe640 1 -- 172.21.15.115:0/2950495196 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f34940318b0 con 0x7f34a40fe9a0 2024-09-13T17:02:28.556 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.553+0000 7f34a8999640 1 -- 172.21.15.115:0/2950495196 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34a4195bb0 con 0x7f34a40fe9a0 2024-09-13T17:02:28.556 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.553+0000 7f34a8999640 1 -- 172.21.15.115:0/2950495196 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34a41960a0 con 0x7f34a40fe9a0 2024-09-13T17:02:28.556 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.554+0000 7f34a8999640 1 -- 172.21.15.115:0/2950495196 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f34a410be50 con 0x7f34a40fe9a0 2024-09-13T17:02:28.556 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.554+0000 7f349b7fe640 1 -- 172.21.15.115:0/2950495196 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f3494003b90 con 0x7f34a40fe9a0 2024-09-13T17:02:28.557 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.555+0000 7f349b7fe640 1 --2- 172.21.15.115:0/2950495196 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f349006cc50 0x7f349006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:28.558 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.555+0000 7f349bfff640 1 --2- 172.21.15.115:0/2950495196 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f349006cc50 0x7f349006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:28.558 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.555+0000 7f349b7fe640 1 -- 172.21.15.115:0/2950495196 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f34940acf30 con 0x7f34a40fe9a0 2024-09-13T17:02:28.558 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.555+0000 7f349b7fe640 1 --2- 172.21.15.115:0/2950495196 >> [v2:172.21.15.115:6810/3928285174,v1:172.21.15.115:6811/3928285174] conn(0x7f34900729e0 0x7f3490074e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:28.558 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.555+0000 7f349b7fe640 1 -- 172.21.15.115:0/2950495196 --> [v2:172.21.15.115:6810/3928285174,v1:172.21.15.115:6811/3928285174] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f34900754b0 con 0x7f34900729e0 2024-09-13T17:02:28.558 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.555+0000 7f349b7fe640 1 -- 172.21.15.115:0/2950495196 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f34940af5a0 con 0x7f34a40fe9a0 2024-09-13T17:02:28.558 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.555+0000 7f34a2d9d640 1 --2- 172.21.15.115:0/2950495196 >> [v2:172.21.15.115:6810/3928285174,v1:172.21.15.115:6811/3928285174] conn(0x7f34900729e0 0x7f3490074e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:28.558 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.556+0000 7f349bfff640 1 --2- 172.21.15.115:0/2950495196 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f349006cc50 0x7f349006f110 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f34a40fd140 tx=0x7f348c009110 comp rx=0 tx=0).ready entity=mgr.14207 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:02:28.558 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.556+0000 7f34a2d9d640 1 --2- 172.21.15.115:0/2950495196 >> [v2:172.21.15.115:6810/3928285174,v1:172.21.15.115:6811/3928285174] conn(0x7f34900729e0 0x7f3490074e00 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:02:28.558 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.556+0000 7f349b7fe640 1 -- 172.21.15.115:0/2950495196 <== osd.1 v2:172.21.15.115:6810/3928285174 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f34900754b0 con 0x7f34900729e0 2024-09-13T17:02:28.571 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.570+0000 7f34a8999640 1 -- 172.21.15.115:0/2950495196 --> [v2:172.21.15.115:6810/3928285174,v1:172.21.15.115:6811/3928285174] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f34a4196550 con 0x7f34900729e0 2024-09-13T17:02:28.572 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.570+0000 7f349b7fe640 1 -- 172.21.15.115:0/2950495196 <== osd.1 v2:172.21.15.115:6810/3928285174 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f34a4196550 con 0x7f34900729e0 2024-09-13T17:02:28.572 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.570+0000 7f34a8999640 1 -- 172.21.15.115:0/2950495196 >> [v2:172.21.15.115:6810/3928285174,v1:172.21.15.115:6811/3928285174] conn(0x7f34900729e0 msgr2=0x7f3490074e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:28.572 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.570+0000 7f34a8999640 1 --2- 172.21.15.115:0/2950495196 >> [v2:172.21.15.115:6810/3928285174,v1:172.21.15.115:6811/3928285174] conn(0x7f34900729e0 0x7f3490074e00 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:28.572 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.570+0000 7f34a8999640 1 -- 172.21.15.115:0/2950495196 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f349006cc50 msgr2=0x7f349006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:28.572 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.570+0000 7f34a8999640 1 --2- 172.21.15.115:0/2950495196 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f349006cc50 0x7f349006f110 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f34a40fd140 tx=0x7f348c009110 comp rx=0 tx=0).stop 2024-09-13T17:02:28.573 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.570+0000 7f34a8999640 1 -- 172.21.15.115:0/2950495196 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34a40fe9a0 msgr2=0x7f34a419b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:28.573 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.570+0000 7f34a8999640 1 --2- 172.21.15.115:0/2950495196 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34a40fe9a0 0x7f34a419b770 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3494006010 tx=0x7f34940056e0 comp rx=0 tx=0).stop 2024-09-13T17:02:28.573 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.571+0000 7f34a8999640 1 -- 172.21.15.115:0/2950495196 shutdown_connections 2024-09-13T17:02:28.573 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.571+0000 7f34a8999640 1 --2- 172.21.15.115:0/2950495196 >> [v2:172.21.15.115:6810/3928285174,v1:172.21.15.115:6811/3928285174] conn(0x7f34900729e0 0x7f3490074e00 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:28.573 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.571+0000 7f34a8999640 1 --2- 172.21.15.115:0/2950495196 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f349006cc50 0x7f349006f110 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:28.573 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.571+0000 7f34a8999640 1 --2- 172.21.15.115:0/2950495196 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34a41049a0 0x7f34a419bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:28.573 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.571+0000 7f34a8999640 1 --2- 172.21.15.115:0/2950495196 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34a40fe9a0 0x7f34a419b770 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:28.573 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.571+0000 7f34a8999640 1 -- 172.21.15.115:0/2950495196 >> 172.21.15.115:0/2950495196 conn(0x7f34a40758c0 msgr2=0x7f34a40fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:02:28.573 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.571+0000 7f34a8999640 1 -- 172.21.15.115:0/2950495196 shutdown_connections 2024-09-13T17:02:28.573 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.571+0000 7f34a8999640 1 -- 172.21.15.115:0/2950495196 wait complete. 2024-09-13T17:02:28.770 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.740+0000 7f7613a79640 1 -- 172.21.15.115:0/1244097924 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f760c100ce0 msgr2=0x7f760c1010c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:28.771 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.740+0000 7f7613a79640 1 --2- 172.21.15.115:0/1244097924 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f760c100ce0 0x7f760c1010c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7600009880 tx=0x7f760002a530 comp rx=0 tx=0).stop 2024-09-13T17:02:28.771 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.740+0000 7f7613a79640 1 -- 172.21.15.115:0/1244097924 shutdown_connections 2024-09-13T17:02:28.771 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.740+0000 7f7613a79640 1 --2- 172.21.15.115:0/1244097924 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f760c101600 0x7f760c109af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:28.771 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.740+0000 7f7613a79640 1 --2- 172.21.15.115:0/1244097924 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f760c100ce0 0x7f760c1010c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:28.771 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.741+0000 7f7613a79640 1 -- 172.21.15.115:0/1244097924 >> 172.21.15.115:0/1244097924 conn(0x7f760c0758c0 msgr2=0x7f760c0fcc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:02:28.771 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.741+0000 7f7613a79640 1 -- 172.21.15.115:0/1244097924 shutdown_connections 2024-09-13T17:02:28.771 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.741+0000 7f7613a79640 1 -- 172.21.15.115:0/1244097924 wait complete. 2024-09-13T17:02:28.771 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.741+0000 7f7613a79640 1 Processor -- start 2024-09-13T17:02:28.771 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.741+0000 7f7613a79640 1 -- start start 2024-09-13T17:02:28.771 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.741+0000 7f7613a79640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f760c100ce0 0x7f760c19b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:28.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.741+0000 7f7613a79640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f760c101600 0x7f760c19bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:28.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.741+0000 7f7613a79640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f760c19c3a0 con 0x7f760c100ce0 2024-09-13T17:02:28.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.741+0000 7f7613a79640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f760c195930 con 0x7f760c101600 2024-09-13T17:02:28.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.741+0000 7f7611815640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f760c100ce0 0x7f760c19b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:28.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.742+0000 7f7611815640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f760c100ce0 0x7f760c19b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60592/0 (socket says 172.21.15.115:60592) 2024-09-13T17:02:28.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.742+0000 7f7611815640 1 -- 172.21.15.115:0/3395071876 learned_addr learned my addr 172.21.15.115:0/3395071876 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:02:28.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.742+0000 7f7611815640 1 -- 172.21.15.115:0/3395071876 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f760c101600 msgr2=0x7f760c19bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:28.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.742+0000 7f7611014640 1 --2- 172.21.15.115:0/3395071876 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f760c101600 0x7f760c19bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:28.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.742+0000 7f7611815640 1 --2- 172.21.15.115:0/3395071876 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f760c101600 0x7f760c19bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:28.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.742+0000 7f7611815640 1 -- 172.21.15.115:0/3395071876 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7600009560 con 0x7f760c100ce0 2024-09-13T17:02:28.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.742+0000 7f7611014640 1 --2- 172.21.15.115:0/3395071876 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f760c101600 0x7f760c19bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:02:28.773 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.742+0000 7f7611815640 1 --2- 172.21.15.115:0/3395071876 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f760c100ce0 0x7f760c19b840 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7600006010 tx=0x7f7600004da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:02:28.773 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.742+0000 7f75feffd640 1 -- 172.21.15.115:0/3395071876 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76000053b0 con 0x7f760c100ce0 2024-09-13T17:02:28.773 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.742+0000 7f75feffd640 1 -- 172.21.15.115:0/3395071876 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7600005510 con 0x7f760c100ce0 2024-09-13T17:02:28.773 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.742+0000 7f7613a79640 1 -- 172.21.15.115:0/3395071876 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f760c195bb0 con 0x7f760c100ce0 2024-09-13T17:02:28.773 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.742+0000 7f75feffd640 1 -- 172.21.15.115:0/3395071876 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76000319f0 con 0x7f760c100ce0 2024-09-13T17:02:28.773 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.742+0000 7f7613a79640 1 -- 172.21.15.115:0/3395071876 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f760c1960a0 con 0x7f760c100ce0 2024-09-13T17:02:28.773 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.743+0000 7f7613a79640 1 -- 172.21.15.115:0/3395071876 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f760c10cf70 con 0x7f760c100ce0 2024-09-13T17:02:28.773 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.744+0000 7f75feffd640 1 -- 172.21.15.115:0/3395071876 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f760002ad50 con 0x7f760c100ce0 2024-09-13T17:02:28.773 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.744+0000 7f75feffd640 1 --2- 172.21.15.115:0/3395071876 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f75f806cc50 0x7f75f806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:28.773 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.744+0000 7f75feffd640 1 -- 172.21.15.115:0/3395071876 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f76000ad210 con 0x7f760c100ce0 2024-09-13T17:02:28.774 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.744+0000 7f7611014640 1 --2- 172.21.15.115:0/3395071876 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f75f806cc50 0x7f75f806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:28.774 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.745+0000 7f75feffd640 1 --2- 172.21.15.115:0/3395071876 >> [v2:172.21.15.115:6802/2697967112,v1:172.21.15.115:6803/2697967112] conn(0x7f75f80729e0 0x7f75f8074e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:28.774 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.745+0000 7f75feffd640 1 -- 172.21.15.115:0/3395071876 --> [v2:172.21.15.115:6802/2697967112,v1:172.21.15.115:6803/2697967112] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f75f80754b0 con 0x7f75f80729e0 2024-09-13T17:02:28.774 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.745+0000 7f75feffd640 1 -- 172.21.15.115:0/3395071876 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f76000ad670 con 0x7f760c100ce0 2024-09-13T17:02:28.774 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.745+0000 7f7612016640 1 --2- 172.21.15.115:0/3395071876 >> [v2:172.21.15.115:6802/2697967112,v1:172.21.15.115:6803/2697967112] conn(0x7f75f80729e0 0x7f75f8074e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:28.774 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.745+0000 7f7611014640 1 --2- 172.21.15.115:0/3395071876 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f75f806cc50 0x7f75f806f110 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7608006fd0 tx=0x7f7608008040 comp rx=0 tx=0).ready entity=mgr.14207 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:02:28.774 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.745+0000 7f7612016640 1 --2- 172.21.15.115:0/3395071876 >> [v2:172.21.15.115:6802/2697967112,v1:172.21.15.115:6803/2697967112] conn(0x7f75f80729e0 0x7f75f8074e00 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:02:28.774 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.746+0000 7f75feffd640 1 -- 172.21.15.115:0/3395071876 <== osd.0 v2:172.21.15.115:6802/2697967112 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f75f80754b0 con 0x7f75f80729e0 2024-09-13T17:02:28.774 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.758+0000 7f7613a79640 1 -- 172.21.15.115:0/3395071876 --> [v2:172.21.15.115:6802/2697967112,v1:172.21.15.115:6803/2697967112] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f760c068440 con 0x7f75f80729e0 2024-09-13T17:02:28.774 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.759+0000 7f75feffd640 1 -- 172.21.15.115:0/3395071876 <== osd.0 v2:172.21.15.115:6802/2697967112 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f760c068440 con 0x7f75f80729e0 2024-09-13T17:02:28.775 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.759+0000 7f7613a79640 1 -- 172.21.15.115:0/3395071876 >> [v2:172.21.15.115:6802/2697967112,v1:172.21.15.115:6803/2697967112] conn(0x7f75f80729e0 msgr2=0x7f75f8074e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:28.775 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.759+0000 7f7613a79640 1 --2- 172.21.15.115:0/3395071876 >> [v2:172.21.15.115:6802/2697967112,v1:172.21.15.115:6803/2697967112] conn(0x7f75f80729e0 0x7f75f8074e00 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:28.775 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.759+0000 7f7613a79640 1 -- 172.21.15.115:0/3395071876 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f75f806cc50 msgr2=0x7f75f806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:28.775 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.759+0000 7f7613a79640 1 --2- 172.21.15.115:0/3395071876 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f75f806cc50 0x7f75f806f110 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7608006fd0 tx=0x7f7608008040 comp rx=0 tx=0).stop 2024-09-13T17:02:28.775 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.759+0000 7f7613a79640 1 -- 172.21.15.115:0/3395071876 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f760c100ce0 msgr2=0x7f760c19b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:28.775 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.759+0000 7f7613a79640 1 --2- 172.21.15.115:0/3395071876 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f760c100ce0 0x7f760c19b840 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7600006010 tx=0x7f7600004da0 comp rx=0 tx=0).stop 2024-09-13T17:02:28.775 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.759+0000 7f7613a79640 1 -- 172.21.15.115:0/3395071876 shutdown_connections 2024-09-13T17:02:28.775 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.759+0000 7f7613a79640 1 --2- 172.21.15.115:0/3395071876 >> [v2:172.21.15.115:6802/2697967112,v1:172.21.15.115:6803/2697967112] conn(0x7f75f80729e0 0x7f75f8074e00 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:28.775 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.759+0000 7f7613a79640 1 --2- 172.21.15.115:0/3395071876 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f75f806cc50 0x7f75f806f110 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:28.775 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.759+0000 7f7613a79640 1 --2- 172.21.15.115:0/3395071876 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f760c101600 0x7f760c19bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:28.775 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.759+0000 7f7613a79640 1 --2- 172.21.15.115:0/3395071876 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f760c100ce0 0x7f760c19b840 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:28.775 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.759+0000 7f7613a79640 1 -- 172.21.15.115:0/3395071876 >> 172.21.15.115:0/3395071876 conn(0x7f760c0758c0 msgr2=0x7f760c101f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:02:28.775 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.759+0000 7f7613a79640 1 -- 172.21.15.115:0/3395071876 shutdown_connections 2024-09-13T17:02:28.776 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:28.759+0000 7f7613a79640 1 -- 172.21.15.115:0/3395071876 wait complete. 2024-09-13T17:02:28.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:02:28 smithi195 ceph-mon[34981]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:02:29.428 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:02:29 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:02:29.655 INFO:teuthology.orchestra.run.smithi115.stdout:111669149715 2024-09-13T17:02:29.655 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-13T17:02:29.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:02:29 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:02:30.087 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:30.083+0000 7fb80194f640 1 -- 172.21.15.115:0/2296429465 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb7fc101740 msgr2=0x7fb7fc109c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:30.088 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:30.083+0000 7fb80194f640 1 --2- 172.21.15.115:0/2296429465 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb7fc101740 0x7fb7fc109c30 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb7e4009880 tx=0x7fb7e402a530 comp rx=0 tx=0).stop 2024-09-13T17:02:30.088 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:30.083+0000 7fb80194f640 1 -- 172.21.15.115:0/2296429465 shutdown_connections 2024-09-13T17:02:30.088 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:30.083+0000 7fb80194f640 1 --2- 172.21.15.115:0/2296429465 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb7fc101740 0x7fb7fc109c30 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:30.088 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:30.083+0000 7fb80194f640 1 --2- 172.21.15.115:0/2296429465 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7fc100e20 0x7fb7fc101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:30.088 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:30.083+0000 7fb80194f640 1 -- 172.21.15.115:0/2296429465 >> 172.21.15.115:0/2296429465 conn(0x7fb7fc0fa780 msgr2=0x7fb7fc0fcba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:02:30.088 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:30.083+0000 7fb80194f640 1 -- 172.21.15.115:0/2296429465 shutdown_connections 2024-09-13T17:02:30.088 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:30.083+0000 7fb80194f640 1 -- 172.21.15.115:0/2296429465 wait complete. 2024-09-13T17:02:30.088 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:30.084+0000 7fb80194f640 1 Processor -- start 2024-09-13T17:02:30.088 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:30.084+0000 7fb80194f640 1 -- start start 2024-09-13T17:02:30.088 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:30.084+0000 7fb80194f640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7fc100e20 0x7fb7fc19b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:30.088 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:30.084+0000 7fb80194f640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb7fc101740 0x7fb7fc19bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:30.089 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:30.084+0000 7fb80194f640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7fc19c2b0 con 0x7fb7fc101740 2024-09-13T17:02:30.089 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:30.084+0000 7fb80194f640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7fc1958d0 con 0x7fb7fc100e20 2024-09-13T17:02:30.089 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:30.084+0000 7fb7f27fc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb7fc101740 0x7fb7fc19bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:30.089 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:30.084+0000 7fb7f27fc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb7fc101740 0x7fb7fc19bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60600/0 (socket says 172.21.15.115:60600) 2024-09-13T17:02:30.089 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:30.084+0000 7fb7f27fc640 1 -- 172.21.15.115:0/570931822 learned_addr learned my addr 172.21.15.115:0/570931822 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:02:30.089 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:30.084+0000 7fb7faffd640 1 --2- 172.21.15.115:0/570931822 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7fc100e20 0x7fb7fc19b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:30.089 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:30.084+0000 7fb7f27fc640 1 -- 172.21.15.115:0/570931822 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7fc100e20 msgr2=0x7fb7fc19b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:30.089 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:30.084+0000 7fb7f27fc640 1 --2- 172.21.15.115:0/570931822 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7fc100e20 0x7fb7fc19b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:30.089 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:30.084+0000 7fb7f27fc640 1 -- 172.21.15.115:0/570931822 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7e4009560 con 0x7fb7fc101740 2024-09-13T17:02:30.089 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:30.085+0000 7fb7f27fc640 1 --2- 172.21.15.115:0/570931822 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb7fc101740 0x7fb7fc19bd20 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb7e4006010 tx=0x7fb7e4004da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:02:30.089 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:30.085+0000 7fb80094d640 1 -- 172.21.15.115:0/570931822 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb7e40053b0 con 0x7fb7fc101740 2024-09-13T17:02:30.089 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:30.085+0000 7fb80194f640 1 -- 172.21.15.115:0/570931822 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7fc195b50 con 0x7fb7fc101740 2024-09-13T17:02:30.089 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:30.085+0000 7fb80094d640 1 -- 172.21.15.115:0/570931822 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb7e4005d50 con 0x7fb7fc101740 2024-09-13T17:02:30.089 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:30.085+0000 7fb80094d640 1 -- 172.21.15.115:0/570931822 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb7e40318b0 con 0x7fb7fc101740 2024-09-13T17:02:30.090 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:30.085+0000 7fb80194f640 1 -- 172.21.15.115:0/570931822 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7fc196040 con 0x7fb7fc101740 2024-09-13T17:02:30.090 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:30.086+0000 7fb80194f640 1 -- 172.21.15.115:0/570931822 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb7fc10cf70 con 0x7fb7fc101740 2024-09-13T17:02:30.090 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:30.087+0000 7fb80094d640 1 -- 172.21.15.115:0/570931822 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fb7e402ad50 con 0x7fb7fc101740 2024-09-13T17:02:30.091 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:30.087+0000 7fb80094d640 1 --2- 172.21.15.115:0/570931822 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fb7e806cc50 0x7fb7e806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:30.091 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:30.087+0000 7fb80094d640 1 -- 172.21.15.115:0/570931822 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fb7e40acd20 con 0x7fb7fc101740 2024-09-13T17:02:30.091 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:30.087+0000 7fb7faffd640 1 --2- 172.21.15.115:0/570931822 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fb7e806cc50 0x7fb7e806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:30.091 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:30.087+0000 7fb80094d640 1 --2- 172.21.15.115:0/570931822 >> [v2:172.21.15.195:6816/1862675419,v1:172.21.15.195:6817/1862675419] conn(0x7fb7e80729e0 0x7fb7e8074e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:30.091 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:30.087+0000 7fb80094d640 1 -- 172.21.15.115:0/570931822 --> [v2:172.21.15.195:6816/1862675419,v1:172.21.15.195:6817/1862675419] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb7e80754b0 con 0x7fb7e80729e0 2024-09-13T17:02:30.091 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:30.087+0000 7fb80094d640 1 -- 172.21.15.115:0/570931822 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb7e40b2400 con 0x7fb7fc101740 2024-09-13T17:02:30.091 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:30.087+0000 7fb7faffd640 1 --2- 172.21.15.115:0/570931822 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fb7e806cc50 0x7fb7e806f110 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec00abe0 tx=0x7fb7ec00a2d0 comp rx=0 tx=0).ready entity=mgr.14207 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:02:30.091 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:30.088+0000 7fb7fb7fe640 1 --2- 172.21.15.115:0/570931822 >> [v2:172.21.15.195:6816/1862675419,v1:172.21.15.195:6817/1862675419] conn(0x7fb7e80729e0 0x7fb7e8074e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:30.091 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:30.088+0000 7fb7fb7fe640 1 --2- 172.21.15.115:0/570931822 >> [v2:172.21.15.195:6816/1862675419,v1:172.21.15.195:6817/1862675419] conn(0x7fb7e80729e0 0x7fb7e8074e00 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:02:30.092 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:30.089+0000 7fb80094d640 1 -- 172.21.15.115:0/570931822 <== osd.5 v2:172.21.15.195:6816/1862675419 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fb7e80754b0 con 0x7fb7e80729e0 2024-09-13T17:02:30.103 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:30.102+0000 7fb80194f640 1 -- 172.21.15.115:0/570931822 --> [v2:172.21.15.195:6816/1862675419,v1:172.21.15.195:6817/1862675419] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb7fc1964a0 con 0x7fb7e80729e0 2024-09-13T17:02:30.103 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:30.102+0000 7fb80094d640 1 -- 172.21.15.115:0/570931822 <== osd.5 v2:172.21.15.195:6816/1862675419 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fb7fc1964a0 con 0x7fb7e80729e0 2024-09-13T17:02:30.104 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:30.103+0000 7fb80194f640 1 -- 172.21.15.115:0/570931822 >> [v2:172.21.15.195:6816/1862675419,v1:172.21.15.195:6817/1862675419] conn(0x7fb7e80729e0 msgr2=0x7fb7e8074e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:30.104 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:30.103+0000 7fb80194f640 1 --2- 172.21.15.115:0/570931822 >> [v2:172.21.15.195:6816/1862675419,v1:172.21.15.195:6817/1862675419] conn(0x7fb7e80729e0 0x7fb7e8074e00 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:30.105 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:30.103+0000 7fb80194f640 1 -- 172.21.15.115:0/570931822 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fb7e806cc50 msgr2=0x7fb7e806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:30.105 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:30.103+0000 7fb80194f640 1 --2- 172.21.15.115:0/570931822 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fb7e806cc50 0x7fb7e806f110 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec00abe0 tx=0x7fb7ec00a2d0 comp rx=0 tx=0).stop 2024-09-13T17:02:30.105 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:30.103+0000 7fb80194f640 1 -- 172.21.15.115:0/570931822 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb7fc101740 msgr2=0x7fb7fc19bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:30.105 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:30.103+0000 7fb80194f640 1 --2- 172.21.15.115:0/570931822 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb7fc101740 0x7fb7fc19bd20 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb7e4006010 tx=0x7fb7e4004da0 comp rx=0 tx=0).stop 2024-09-13T17:02:30.105 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:30.103+0000 7fb80194f640 1 -- 172.21.15.115:0/570931822 shutdown_connections 2024-09-13T17:02:30.105 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:30.103+0000 7fb80194f640 1 --2- 172.21.15.115:0/570931822 >> [v2:172.21.15.195:6816/1862675419,v1:172.21.15.195:6817/1862675419] conn(0x7fb7e80729e0 0x7fb7e8074e00 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:30.105 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:30.103+0000 7fb80194f640 1 --2- 172.21.15.115:0/570931822 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fb7e806cc50 0x7fb7e806f110 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:30.105 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:30.103+0000 7fb80194f640 1 --2- 172.21.15.115:0/570931822 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb7fc101740 0x7fb7fc19bd20 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:30.105 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:30.103+0000 7fb80194f640 1 --2- 172.21.15.115:0/570931822 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7fc100e20 0x7fb7fc19b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:30.105 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:30.103+0000 7fb80194f640 1 -- 172.21.15.115:0/570931822 >> 172.21.15.115:0/570931822 conn(0x7fb7fc0fa780 msgr2=0x7fb7fc102060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:02:30.106 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:30.103+0000 7fb80194f640 1 -- 172.21.15.115:0/570931822 shutdown_connections 2024-09-13T17:02:30.106 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:30.103+0000 7fb80194f640 1 -- 172.21.15.115:0/570931822 wait complete. 2024-09-13T17:02:30.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:02:30 smithi115 ceph-mon[27708]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:02:30.765 INFO:teuthology.orchestra.run.smithi115.stdout:38654705699 2024-09-13T17:02:30.765 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-13T17:02:30.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:02:30 smithi195 ceph-mon[34981]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:02:31.533 INFO:teuthology.orchestra.run.smithi115.stdout:167503724554 2024-09-13T17:02:31.534 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-13T17:02:32.152 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.131+0000 7f979b654640 1 -- 172.21.15.115:0/3361272280 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9794101600 msgr2=0x7f9794109af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:32.152 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.131+0000 7f979b654640 1 --2- 172.21.15.115:0/3361272280 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9794101600 0x7f9794109af0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9790009880 tx=0x7f979002a530 comp rx=0 tx=0).stop 2024-09-13T17:02:32.153 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.131+0000 7f979b654640 1 -- 172.21.15.115:0/3361272280 shutdown_connections 2024-09-13T17:02:32.153 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.131+0000 7f979b654640 1 --2- 172.21.15.115:0/3361272280 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9794101600 0x7f9794109af0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:32.153 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.131+0000 7f979b654640 1 --2- 172.21.15.115:0/3361272280 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9794100ce0 0x7f97941010c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:32.153 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.131+0000 7f979b654640 1 -- 172.21.15.115:0/3361272280 >> 172.21.15.115:0/3361272280 conn(0x7f97940fa720 msgr2=0x7f97940fcb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:02:32.153 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.131+0000 7f979b654640 1 -- 172.21.15.115:0/3361272280 shutdown_connections 2024-09-13T17:02:32.153 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.131+0000 7f979b654640 1 -- 172.21.15.115:0/3361272280 wait complete. 2024-09-13T17:02:32.153 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.132+0000 7f979b654640 1 Processor -- start 2024-09-13T17:02:32.153 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.132+0000 7f979b654640 1 -- start start 2024-09-13T17:02:32.153 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.132+0000 7f979b654640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9794100ce0 0x7f979419b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:32.153 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.132+0000 7f979b654640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9794101600 0x7f979419bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:32.153 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.132+0000 7f979b654640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f979419c320 con 0x7f9794100ce0 2024-09-13T17:02:32.153 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.132+0000 7f979b654640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97941958b0 con 0x7f9794101600 2024-09-13T17:02:32.154 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.132+0000 7f97993f0640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9794100ce0 0x7f979419b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:32.154 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.132+0000 7f97993f0640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9794100ce0 0x7f979419b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60624/0 (socket says 172.21.15.115:60624) 2024-09-13T17:02:32.154 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.132+0000 7f97993f0640 1 -- 172.21.15.115:0/3443325314 learned_addr learned my addr 172.21.15.115:0/3443325314 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:02:32.154 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.132+0000 7f97993f0640 1 -- 172.21.15.115:0/3443325314 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9794101600 msgr2=0x7f979419bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:32.154 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.132+0000 7f97993f0640 1 --2- 172.21.15.115:0/3443325314 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9794101600 0x7f979419bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:32.154 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.132+0000 7f97993f0640 1 -- 172.21.15.115:0/3443325314 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9790009560 con 0x7f9794100ce0 2024-09-13T17:02:32.155 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.132+0000 7f97993f0640 1 --2- 172.21.15.115:0/3443325314 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9794100ce0 0x7f979419b7c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f978400d6f0 tx=0x7f978400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:02:32.155 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.132+0000 7f978a7fc640 1 -- 172.21.15.115:0/3443325314 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9784009a30 con 0x7f9794100ce0 2024-09-13T17:02:32.155 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.132+0000 7f978a7fc640 1 -- 172.21.15.115:0/3443325314 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f97840054c0 con 0x7f9794100ce0 2024-09-13T17:02:32.155 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.133+0000 7f979b654640 1 -- 172.21.15.115:0/3443325314 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9794195b90 con 0x7f9794100ce0 2024-09-13T17:02:32.155 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.133+0000 7f978a7fc640 1 -- 172.21.15.115:0/3443325314 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9784004db0 con 0x7f9794100ce0 2024-09-13T17:02:32.155 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.133+0000 7f979b654640 1 -- 172.21.15.115:0/3443325314 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97941960e0 con 0x7f9794100ce0 2024-09-13T17:02:32.155 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.133+0000 7f979b654640 1 -- 172.21.15.115:0/3443325314 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f979410cf90 con 0x7f9794100ce0 2024-09-13T17:02:32.155 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.134+0000 7f978a7fc640 1 -- 172.21.15.115:0/3443325314 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f9784004f10 con 0x7f9794100ce0 2024-09-13T17:02:32.155 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.134+0000 7f978a7fc640 1 --2- 172.21.15.115:0/3443325314 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f978006cc50 0x7f978006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:32.155 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.134+0000 7f978a7fc640 1 -- 172.21.15.115:0/3443325314 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f978408b970 con 0x7f9794100ce0 2024-09-13T17:02:32.155 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.134+0000 7f9798bef640 1 --2- 172.21.15.115:0/3443325314 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f978006cc50 0x7f978006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:32.156 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.135+0000 7f978a7fc640 1 --2- 172.21.15.115:0/3443325314 >> [v2:172.21.15.115:6818/1608421656,v1:172.21.15.115:6819/1608421656] conn(0x7f97800729e0 0x7f9780074e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:32.156 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.135+0000 7f978a7fc640 1 -- 172.21.15.115:0/3443325314 --> [v2:172.21.15.115:6818/1608421656,v1:172.21.15.115:6819/1608421656] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f97800754b0 con 0x7f97800729e0 2024-09-13T17:02:32.156 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.135+0000 7f978a7fc640 1 -- 172.21.15.115:0/3443325314 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f97840902a0 con 0x7f9794100ce0 2024-09-13T17:02:32.156 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.135+0000 7f9799bf1640 1 --2- 172.21.15.115:0/3443325314 >> [v2:172.21.15.115:6818/1608421656,v1:172.21.15.115:6819/1608421656] conn(0x7f97800729e0 0x7f9780074e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:32.156 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.135+0000 7f9798bef640 1 --2- 172.21.15.115:0/3443325314 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f978006cc50 0x7f978006f110 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9794196d20 tx=0x7f9790000bc0 comp rx=0 tx=0).ready entity=mgr.14207 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:02:32.156 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.135+0000 7f9799bf1640 1 --2- 172.21.15.115:0/3443325314 >> [v2:172.21.15.115:6818/1608421656,v1:172.21.15.115:6819/1608421656] conn(0x7f97800729e0 0x7f9780074e00 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:02:32.156 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.136+0000 7f978a7fc640 1 -- 172.21.15.115:0/3443325314 <== osd.2 v2:172.21.15.115:6818/1608421656 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f97800754b0 con 0x7f97800729e0 2024-09-13T17:02:32.156 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.149+0000 7f979b654640 1 -- 172.21.15.115:0/3443325314 --> [v2:172.21.15.115:6818/1608421656,v1:172.21.15.115:6819/1608421656] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9794196650 con 0x7f97800729e0 2024-09-13T17:02:32.156 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.149+0000 7f978a7fc640 1 -- 172.21.15.115:0/3443325314 <== osd.2 v2:172.21.15.115:6818/1608421656 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9794196650 con 0x7f97800729e0 2024-09-13T17:02:32.156 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.149+0000 7f979b654640 1 -- 172.21.15.115:0/3443325314 >> [v2:172.21.15.115:6818/1608421656,v1:172.21.15.115:6819/1608421656] conn(0x7f97800729e0 msgr2=0x7f9780074e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:32.156 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.149+0000 7f979b654640 1 --2- 172.21.15.115:0/3443325314 >> [v2:172.21.15.115:6818/1608421656,v1:172.21.15.115:6819/1608421656] conn(0x7f97800729e0 0x7f9780074e00 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:32.156 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.149+0000 7f979b654640 1 -- 172.21.15.115:0/3443325314 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f978006cc50 msgr2=0x7f978006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:32.157 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.149+0000 7f979b654640 1 --2- 172.21.15.115:0/3443325314 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f978006cc50 0x7f978006f110 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9794196d20 tx=0x7f9790000bc0 comp rx=0 tx=0).stop 2024-09-13T17:02:32.157 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.149+0000 7f979b654640 1 -- 172.21.15.115:0/3443325314 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9794100ce0 msgr2=0x7f979419b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:32.157 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.149+0000 7f979b654640 1 --2- 172.21.15.115:0/3443325314 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9794100ce0 0x7f979419b7c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f978400d6f0 tx=0x7f978400dbb0 comp rx=0 tx=0).stop 2024-09-13T17:02:32.157 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.149+0000 7f979b654640 1 -- 172.21.15.115:0/3443325314 shutdown_connections 2024-09-13T17:02:32.157 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.149+0000 7f979b654640 1 --2- 172.21.15.115:0/3443325314 >> [v2:172.21.15.115:6818/1608421656,v1:172.21.15.115:6819/1608421656] conn(0x7f97800729e0 0x7f9780074e00 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:32.157 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.149+0000 7f979b654640 1 --2- 172.21.15.115:0/3443325314 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f978006cc50 0x7f978006f110 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:32.157 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.149+0000 7f979b654640 1 --2- 172.21.15.115:0/3443325314 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9794101600 0x7f979419bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:32.157 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.149+0000 7f979b654640 1 --2- 172.21.15.115:0/3443325314 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9794100ce0 0x7f979419b7c0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:32.157 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.149+0000 7f979b654640 1 -- 172.21.15.115:0/3443325314 >> 172.21.15.115:0/3443325314 conn(0x7f97940fa720 msgr2=0x7f9794101fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:02:32.157 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.149+0000 7f979b654640 1 -- 172.21.15.115:0/3443325314 shutdown_connections 2024-09-13T17:02:32.157 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.149+0000 7f979b654640 1 -- 172.21.15.115:0/3443325314 wait complete. 2024-09-13T17:02:32.597 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:02:32 smithi115 ceph-mon[27708]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:02:32.681 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.675+0000 7f0671f84640 1 -- 172.21.15.115:0/1376498419 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f066c1049a0 msgr2=0x7f066c104d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:32.681 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.675+0000 7f0671f84640 1 --2- 172.21.15.115:0/1376498419 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f066c1049a0 0x7f066c104d80 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f065c009880 tx=0x7f065c02a4a0 comp rx=0 tx=0).stop 2024-09-13T17:02:32.681 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.675+0000 7f0671f84640 1 -- 172.21.15.115:0/1376498419 shutdown_connections 2024-09-13T17:02:32.681 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.675+0000 7f0671f84640 1 --2- 172.21.15.115:0/1376498419 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f066c0fe9a0 0x7f066c0fee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:32.681 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.675+0000 7f0671f84640 1 --2- 172.21.15.115:0/1376498419 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f066c1049a0 0x7f066c104d80 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:32.681 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.675+0000 7f0671f84640 1 -- 172.21.15.115:0/1376498419 >> 172.21.15.115:0/1376498419 conn(0x7f066c0758c0 msgr2=0x7f066c0fcc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:02:32.681 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.675+0000 7f0671f84640 1 -- 172.21.15.115:0/1376498419 shutdown_connections 2024-09-13T17:02:32.681 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.675+0000 7f0671f84640 1 -- 172.21.15.115:0/1376498419 wait complete. 2024-09-13T17:02:32.681 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.675+0000 7f0671f84640 1 Processor -- start 2024-09-13T17:02:32.682 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.676+0000 7f0671f84640 1 -- start start 2024-09-13T17:02:32.682 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.676+0000 7f0671f84640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f066c0fe9a0 0x7f066c0facf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:32.682 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.676+0000 7f0671f84640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f066c1049a0 0x7f066c0fb230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:32.682 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.676+0000 7f0671f84640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f066c0fb770 con 0x7f066c1049a0 2024-09-13T17:02:32.682 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.676+0000 7f0671f84640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f066c0fb8b0 con 0x7f066c0fe9a0 2024-09-13T17:02:32.682 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.676+0000 7f0662ffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f066c1049a0 0x7f066c0fb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:32.682 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.676+0000 7f0662ffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f066c1049a0 0x7f066c0fb230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60644/0 (socket says 172.21.15.115:60644) 2024-09-13T17:02:32.682 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.676+0000 7f0662ffd640 1 -- 172.21.15.115:0/4033485840 learned_addr learned my addr 172.21.15.115:0/4033485840 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:02:32.682 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.676+0000 7f066b7fe640 1 --2- 172.21.15.115:0/4033485840 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f066c0fe9a0 0x7f066c0facf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:32.682 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.676+0000 7f0662ffd640 1 -- 172.21.15.115:0/4033485840 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f066c0fe9a0 msgr2=0x7f066c0facf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:32.682 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.676+0000 7f0662ffd640 1 --2- 172.21.15.115:0/4033485840 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f066c0fe9a0 0x7f066c0facf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:32.682 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.676+0000 7f0662ffd640 1 -- 172.21.15.115:0/4033485840 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f065c009560 con 0x7f066c1049a0 2024-09-13T17:02:32.682 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.676+0000 7f0662ffd640 1 --2- 172.21.15.115:0/4033485840 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f066c1049a0 0x7f066c0fb230 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f065400b420 tx=0x7f065400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:02:32.682 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.677+0000 7f06697fa640 1 -- 172.21.15.115:0/4033485840 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0654011800 con 0x7f066c1049a0 2024-09-13T17:02:32.683 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.677+0000 7f06697fa640 1 -- 172.21.15.115:0/4033485840 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0654011e00 con 0x7f066c1049a0 2024-09-13T17:02:32.683 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.677+0000 7f0671f84640 1 -- 172.21.15.115:0/4033485840 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f066c1a1cd0 con 0x7f066c1049a0 2024-09-13T17:02:32.683 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.677+0000 7f06697fa640 1 -- 172.21.15.115:0/4033485840 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f065400f2e0 con 0x7f066c1049a0 2024-09-13T17:02:32.683 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.677+0000 7f0671f84640 1 -- 172.21.15.115:0/4033485840 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f066c1a20e0 con 0x7f066c1049a0 2024-09-13T17:02:32.683 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.677+0000 7f0671f84640 1 -- 172.21.15.115:0/4033485840 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f066c10bd90 con 0x7f066c1049a0 2024-09-13T17:02:32.683 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.678+0000 7f06697fa640 1 -- 172.21.15.115:0/4033485840 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f0654010380 con 0x7f066c1049a0 2024-09-13T17:02:32.683 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.678+0000 7f06697fa640 1 --2- 172.21.15.115:0/4033485840 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f065806cc50 0x7f065806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:32.683 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.678+0000 7f066b7fe640 1 --2- 172.21.15.115:0/4033485840 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f065806cc50 0x7f065806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:32.683 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.679+0000 7f06697fa640 1 -- 172.21.15.115:0/4033485840 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f065408b7e0 con 0x7f066c1049a0 2024-09-13T17:02:32.683 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.679+0000 7f06697fa640 1 --2- 172.21.15.115:0/4033485840 >> [v2:172.21.15.195:6808/1840094638,v1:172.21.15.195:6809/1840094638] conn(0x7f06580729e0 0x7f0658074e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:32.683 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.679+0000 7f06697fa640 1 -- 172.21.15.115:0/4033485840 --> [v2:172.21.15.195:6808/1840094638,v1:172.21.15.195:6809/1840094638] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f06580754b0 con 0x7f06580729e0 2024-09-13T17:02:32.683 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.679+0000 7f06697fa640 1 -- 172.21.15.115:0/4033485840 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f06540902a0 con 0x7f066c1049a0 2024-09-13T17:02:32.683 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.679+0000 7f066b7fe640 1 --2- 172.21.15.115:0/4033485840 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f065806cc50 0x7f065806f110 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f065c000c00 tx=0x7f065c005df0 comp rx=0 tx=0).ready entity=mgr.14207 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:02:32.684 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.679+0000 7f066bfff640 1 --2- 172.21.15.115:0/4033485840 >> [v2:172.21.15.195:6808/1840094638,v1:172.21.15.195:6809/1840094638] conn(0x7f06580729e0 0x7f0658074e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:32.684 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.679+0000 7f066bfff640 1 --2- 172.21.15.115:0/4033485840 >> [v2:172.21.15.195:6808/1840094638,v1:172.21.15.195:6809/1840094638] conn(0x7f06580729e0 0x7f0658074e00 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:02:32.684 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.680+0000 7f06697fa640 1 -- 172.21.15.115:0/4033485840 <== osd.4 v2:172.21.15.195:6808/1840094638 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f06580754b0 con 0x7f06580729e0 2024-09-13T17:02:32.694 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.693+0000 7f0671f84640 1 -- 172.21.15.115:0/4033485840 --> [v2:172.21.15.195:6808/1840094638,v1:172.21.15.195:6809/1840094638] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f066c101c90 con 0x7f06580729e0 2024-09-13T17:02:32.695 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.694+0000 7f06697fa640 1 -- 172.21.15.115:0/4033485840 <== osd.4 v2:172.21.15.195:6808/1840094638 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f066c101c90 con 0x7f06580729e0 2024-09-13T17:02:32.696 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.694+0000 7f0671f84640 1 -- 172.21.15.115:0/4033485840 >> [v2:172.21.15.195:6808/1840094638,v1:172.21.15.195:6809/1840094638] conn(0x7f06580729e0 msgr2=0x7f0658074e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:32.697 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.694+0000 7f0671f84640 1 --2- 172.21.15.115:0/4033485840 >> [v2:172.21.15.195:6808/1840094638,v1:172.21.15.195:6809/1840094638] conn(0x7f06580729e0 0x7f0658074e00 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:32.697 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.694+0000 7f0671f84640 1 -- 172.21.15.115:0/4033485840 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f065806cc50 msgr2=0x7f065806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:32.697 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.694+0000 7f0671f84640 1 --2- 172.21.15.115:0/4033485840 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f065806cc50 0x7f065806f110 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f065c000c00 tx=0x7f065c005df0 comp rx=0 tx=0).stop 2024-09-13T17:02:32.697 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.694+0000 7f0671f84640 1 -- 172.21.15.115:0/4033485840 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f066c1049a0 msgr2=0x7f066c0fb230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:32.697 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.694+0000 7f0671f84640 1 --2- 172.21.15.115:0/4033485840 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f066c1049a0 0x7f066c0fb230 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f065400b420 tx=0x7f065400b8e0 comp rx=0 tx=0).stop 2024-09-13T17:02:32.697 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.695+0000 7f0671f84640 1 -- 172.21.15.115:0/4033485840 shutdown_connections 2024-09-13T17:02:32.697 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.695+0000 7f0671f84640 1 --2- 172.21.15.115:0/4033485840 >> [v2:172.21.15.195:6808/1840094638,v1:172.21.15.195:6809/1840094638] conn(0x7f06580729e0 0x7f0658074e00 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:32.697 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.695+0000 7f0671f84640 1 --2- 172.21.15.115:0/4033485840 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f065806cc50 0x7f065806f110 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:32.697 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.695+0000 7f0671f84640 1 --2- 172.21.15.115:0/4033485840 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f066c1049a0 0x7f066c0fb230 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:32.697 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.695+0000 7f0671f84640 1 --2- 172.21.15.115:0/4033485840 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f066c0fe9a0 0x7f066c0facf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:32.697 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.695+0000 7f0671f84640 1 -- 172.21.15.115:0/4033485840 >> 172.21.15.115:0/4033485840 conn(0x7f066c0758c0 msgr2=0x7f066c0fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:02:32.697 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.695+0000 7f0671f84640 1 -- 172.21.15.115:0/4033485840 shutdown_connections 2024-09-13T17:02:32.698 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:32.695+0000 7f0671f84640 1 -- 172.21.15.115:0/4033485840 wait complete. 2024-09-13T17:02:32.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:02:32 smithi195 ceph-mon[34981]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:02:33.219 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T17:02:33.223 INFO:teuthology.orchestra.run.smithi115.stdout:60129542174 2024-09-13T17:02:33.223 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-13T17:02:33.951 INFO:teuthology.orchestra.run.smithi115.stdout:146028888079 2024-09-13T17:02:33.952 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-13T17:02:34.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:02:34 smithi115 ceph-mon[27708]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:02:34.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:02:34 smithi195 ceph-mon[34981]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:02:35.068 INFO:teuthology.orchestra.run.smithi115.stdout:81604378649 2024-09-13T17:02:35.068 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-13T17:02:35.611 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T17:02:35.848 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T17:02:36.038 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:36.034+0000 7f99e4a8c640 1 -- 172.21.15.115:0/3492613184 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f99e00fdff0 msgr2=0x7f99e00fe450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:36.038 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:36.034+0000 7f99e4a8c640 1 --2- 172.21.15.115:0/3492613184 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f99e00fdff0 0x7f99e00fe450 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f99c8009880 tx=0x7f99c802a4a0 comp rx=0 tx=0).stop 2024-09-13T17:02:36.038 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:36.034+0000 7f99e4a8c640 1 -- 172.21.15.115:0/3492613184 shutdown_connections 2024-09-13T17:02:36.038 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:36.034+0000 7f99e4a8c640 1 --2- 172.21.15.115:0/3492613184 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f99e00fdff0 0x7f99e00fe450 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:36.038 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:36.034+0000 7f99e4a8c640 1 --2- 172.21.15.115:0/3492613184 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99e0104bd0 0x7f99e0104fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:36.038 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:36.034+0000 7f99e4a8c640 1 -- 172.21.15.115:0/3492613184 >> 172.21.15.115:0/3492613184 conn(0x7f99e00f9ec0 msgr2=0x7f99e00fc2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:02:36.038 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:36.034+0000 7f99e4a8c640 1 -- 172.21.15.115:0/3492613184 shutdown_connections 2024-09-13T17:02:36.038 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:36.034+0000 7f99e4a8c640 1 -- 172.21.15.115:0/3492613184 wait complete. 2024-09-13T17:02:36.038 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:36.035+0000 7f99e4a8c640 1 Processor -- start 2024-09-13T17:02:36.038 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:36.035+0000 7f99e4a8c640 1 -- start start 2024-09-13T17:02:36.039 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:36.035+0000 7f99e4a8c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f99e00fdff0 0x7f99e019b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:36.039 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:36.035+0000 7f99e4a8c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99e0104bd0 0x7f99e019be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:36.039 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:36.035+0000 7f99e4a8c640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e019c460 con 0x7f99e00fdff0 2024-09-13T17:02:36.039 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:36.035+0000 7f99e4a8c640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e01959f0 con 0x7f99e0104bd0 2024-09-13T17:02:36.039 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:36.035+0000 7f99de59c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f99e00fdff0 0x7f99e019b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:36.039 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:36.035+0000 7f99de59c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f99e00fdff0 0x7f99e019b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:40048/0 (socket says 172.21.15.115:40048) 2024-09-13T17:02:36.039 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:36.035+0000 7f99de59c640 1 -- 172.21.15.115:0/1332441364 learned_addr learned my addr 172.21.15.115:0/1332441364 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:02:36.039 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:36.035+0000 7f99d7fff640 1 --2- 172.21.15.115:0/1332441364 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99e0104bd0 0x7f99e019be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:36.039 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:36.036+0000 7f99de59c640 1 -- 172.21.15.115:0/1332441364 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99e0104bd0 msgr2=0x7f99e019be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:36.039 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:36.036+0000 7f99de59c640 1 --2- 172.21.15.115:0/1332441364 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99e0104bd0 0x7f99e019be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:36.039 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:36.036+0000 7f99de59c640 1 -- 172.21.15.115:0/1332441364 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99c8009560 con 0x7f99e00fdff0 2024-09-13T17:02:36.039 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:36.036+0000 7f99d7fff640 1 --2- 172.21.15.115:0/1332441364 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99e0104bd0 0x7f99e019be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:02:36.039 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:36.036+0000 7f99de59c640 1 --2- 172.21.15.115:0/1332441364 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f99e00fdff0 0x7f99e019b900 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f99d000c8f0 tx=0x7f99d000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:02:36.040 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:36.036+0000 7f99d77fe640 1 -- 172.21.15.115:0/1332441364 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f99d0007b80 con 0x7f99e00fdff0 2024-09-13T17:02:36.040 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:36.036+0000 7f99d77fe640 1 -- 172.21.15.115:0/1332441364 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f99d0007ce0 con 0x7f99e00fdff0 2024-09-13T17:02:36.040 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:36.036+0000 7f99e4a8c640 1 -- 172.21.15.115:0/1332441364 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99e0195cd0 con 0x7f99e00fdff0 2024-09-13T17:02:36.040 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:36.036+0000 7f99d77fe640 1 -- 172.21.15.115:0/1332441364 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f99d000f450 con 0x7f99e00fdff0 2024-09-13T17:02:36.040 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:36.036+0000 7f99e4a8c640 1 -- 172.21.15.115:0/1332441364 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99e0196220 con 0x7f99e00fdff0 2024-09-13T17:02:36.041 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:36.037+0000 7f99e4a8c640 1 -- 172.21.15.115:0/1332441364 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99e0101310 con 0x7f99e00fdff0 2024-09-13T17:02:36.041 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:36.038+0000 7f99d77fe640 1 -- 172.21.15.115:0/1332441364 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f99d0004f10 con 0x7f99e00fdff0 2024-09-13T17:02:36.041 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:36.039+0000 7f99d77fe640 1 --2- 172.21.15.115:0/1332441364 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f99cc06cca0 0x7f99cc06f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:36.041 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:36.039+0000 7f99d77fe640 1 -- 172.21.15.115:0/1332441364 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f99d008be10 con 0x7f99e00fdff0 2024-09-13T17:02:36.041 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:36.039+0000 7f99d7fff640 1 --2- 172.21.15.115:0/1332441364 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f99cc06cca0 0x7f99cc06f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:36.041 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:36.039+0000 7f99d7fff640 1 --2- 172.21.15.115:0/1332441364 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f99cc06cca0 0x7f99cc06f160 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f99e0196e60 tx=0x7f99c8005a20 comp rx=0 tx=0).ready entity=mgr.14207 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:02:36.046 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T17:02:36.046 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T17:02:36.047 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:36.045+0000 7f99d77fe640 1 -- 172.21.15.115:0/1332441364 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f99d0056480 con 0x7f99e00fdff0 2024-09-13T17:02:36.047 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T17:02:36.227 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:36.226+0000 7f99e4a8c640 1 -- 172.21.15.115:0/1332441364 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f99e00fe450 con 0x7f99e00fdff0 2024-09-13T17:02:36.227 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:36.226+0000 7f99d77fe640 1 -- 172.21.15.115:0/1332441364 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f99d001d020 con 0x7f99e00fdff0 2024-09-13T17:02:36.228 INFO:teuthology.orchestra.run.smithi115.stdout:111669149717 2024-09-13T17:02:36.230 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:36.229+0000 7f99e4a8c640 1 -- 172.21.15.115:0/1332441364 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f99cc06cca0 msgr2=0x7f99cc06f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:36.230 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:36.229+0000 7f99e4a8c640 1 --2- 172.21.15.115:0/1332441364 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f99cc06cca0 0x7f99cc06f160 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f99e0196e60 tx=0x7f99c8005a20 comp rx=0 tx=0).stop 2024-09-13T17:02:36.230 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:36.229+0000 7f99e4a8c640 1 -- 172.21.15.115:0/1332441364 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f99e00fdff0 msgr2=0x7f99e019b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:36.230 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:36.229+0000 7f99e4a8c640 1 --2- 172.21.15.115:0/1332441364 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f99e00fdff0 0x7f99e019b900 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f99d000c8f0 tx=0x7f99d000cdb0 comp rx=0 tx=0).stop 2024-09-13T17:02:36.230 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:36.229+0000 7f99e4a8c640 1 -- 172.21.15.115:0/1332441364 shutdown_connections 2024-09-13T17:02:36.230 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:36.229+0000 7f99e4a8c640 1 --2- 172.21.15.115:0/1332441364 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f99cc06cca0 0x7f99cc06f160 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:36.231 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:36.229+0000 7f99e4a8c640 1 --2- 172.21.15.115:0/1332441364 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99e0104bd0 0x7f99e019be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:36.231 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:36.229+0000 7f99e4a8c640 1 --2- 172.21.15.115:0/1332441364 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f99e00fdff0 0x7f99e019b900 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:36.231 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:36.229+0000 7f99e4a8c640 1 -- 172.21.15.115:0/1332441364 >> 172.21.15.115:0/1332441364 conn(0x7f99e00f9ec0 msgr2=0x7f99e00fb050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:02:36.231 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:36.229+0000 7f99e4a8c640 1 -- 172.21.15.115:0/1332441364 shutdown_connections 2024-09-13T17:02:36.231 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:36.229+0000 7f99e4a8c640 1 -- 172.21.15.115:0/1332441364 wait complete. 2024-09-13T17:02:36.405 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:02:36 smithi115 ceph-mon[27708]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:02:36.405 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:02:36 smithi115 ceph-mon[27708]: from='client.? 172.21.15.115:0/1332441364' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-13T17:02:36.628 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:02:36 smithi195 ceph-mon[34981]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:02:36.629 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:02:36 smithi195 ceph-mon[34981]: from='client.? 172.21.15.115:0/1332441364' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-13T17:02:37.021 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149715 got 111669149717 for osd.3 2024-09-13T17:02:37.021 DEBUG:teuthology.parallel:result is None 2024-09-13T17:02:38.420 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:02:38 smithi115 ceph-mon[27708]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:02:38.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:02:38 smithi195 ceph-mon[34981]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:02:40.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:02:40 smithi115 ceph-mon[27708]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:02:40.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:02:40 smithi195 ceph-mon[34981]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:02:42.197 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:41.749+0000 7f3aff1a5640 1 -- 172.21.15.115:0/4192588309 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3af81015e0 msgr2=0x7f3af8109ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:42.198 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:41.749+0000 7f3aff1a5640 1 --2- 172.21.15.115:0/4192588309 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3af81015e0 0x7f3af8109ad0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3ae40098b0 tx=0x7f3ae402a560 comp rx=0 tx=0).stop 2024-09-13T17:02:42.198 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:41.749+0000 7f3aff1a5640 1 -- 172.21.15.115:0/4192588309 shutdown_connections 2024-09-13T17:02:42.198 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:41.749+0000 7f3aff1a5640 1 --2- 172.21.15.115:0/4192588309 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3af81015e0 0x7f3af8109ad0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:42.198 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:41.749+0000 7f3aff1a5640 1 --2- 172.21.15.115:0/4192588309 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3af8100cc0 0x7f3af81010a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:42.198 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:41.749+0000 7f3aff1a5640 1 -- 172.21.15.115:0/4192588309 >> 172.21.15.115:0/4192588309 conn(0x7f3af80758c0 msgr2=0x7f3af80fcc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:02:42.198 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:41.749+0000 7f3aff1a5640 1 -- 172.21.15.115:0/4192588309 shutdown_connections 2024-09-13T17:02:42.198 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:41.750+0000 7f3aff1a5640 1 -- 172.21.15.115:0/4192588309 wait complete. 2024-09-13T17:02:42.198 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:41.750+0000 7f3aff1a5640 1 Processor -- start 2024-09-13T17:02:42.198 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:41.750+0000 7f3aff1a5640 1 -- start start 2024-09-13T17:02:42.198 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:41.750+0000 7f3aff1a5640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3af8100cc0 0x7f3af80fe920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:42.198 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:41.750+0000 7f3aff1a5640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3af81015e0 0x7f3af80fee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:42.198 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:41.750+0000 7f3aff1a5640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3af80ff3a0 con 0x7f3af81015e0 2024-09-13T17:02:42.199 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:41.750+0000 7f3aff1a5640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3af80ff510 con 0x7f3af8100cc0 2024-09-13T17:02:42.199 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:41.750+0000 7f3af7fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3af81015e0 0x7f3af80fee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:42.199 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:41.750+0000 7f3af7fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3af81015e0 0x7f3af80fee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:40062/0 (socket says 172.21.15.115:40062) 2024-09-13T17:02:42.199 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:41.750+0000 7f3af7fff640 1 -- 172.21.15.115:0/2165161633 learned_addr learned my addr 172.21.15.115:0/2165161633 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:02:42.199 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:41.751+0000 7f3afcf41640 1 --2- 172.21.15.115:0/2165161633 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3af8100cc0 0x7f3af80fe920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:42.199 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:41.751+0000 7f3af7fff640 1 -- 172.21.15.115:0/2165161633 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3af8100cc0 msgr2=0x7f3af80fe920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:42.199 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:41.751+0000 7f3af7fff640 1 --2- 172.21.15.115:0/2165161633 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3af8100cc0 0x7f3af80fe920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:42.199 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:41.751+0000 7f3af7fff640 1 -- 172.21.15.115:0/2165161633 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ae4009560 con 0x7f3af81015e0 2024-09-13T17:02:42.199 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:41.751+0000 7f3afcf41640 1 --2- 172.21.15.115:0/2165161633 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3af8100cc0 0x7f3af80fe920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:02:42.199 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:41.751+0000 7f3af7fff640 1 --2- 172.21.15.115:0/2165161633 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3af81015e0 0x7f3af80fee60 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3ae4006010 tx=0x7f3ae4005610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:02:42.199 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:41.751+0000 7f3af5ffb640 1 -- 172.21.15.115:0/2165161633 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ae4004b20 con 0x7f3af81015e0 2024-09-13T17:02:42.199 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:41.751+0000 7f3af5ffb640 1 -- 172.21.15.115:0/2165161633 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3ae4004c80 con 0x7f3af81015e0 2024-09-13T17:02:42.199 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:41.751+0000 7f3af5ffb640 1 -- 172.21.15.115:0/2165161633 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ae4031990 con 0x7f3af81015e0 2024-09-13T17:02:42.199 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:41.751+0000 7f3aff1a5640 1 -- 172.21.15.115:0/2165161633 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3af80ff790 con 0x7f3af81015e0 2024-09-13T17:02:42.200 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:41.751+0000 7f3aff1a5640 1 -- 172.21.15.115:0/2165161633 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3af81a1fd0 con 0x7f3af81015e0 2024-09-13T17:02:42.200 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:41.752+0000 7f3aff1a5640 1 -- 172.21.15.115:0/2165161633 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3af8068460 con 0x7f3af81015e0 2024-09-13T17:02:42.200 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:41.753+0000 7f3af5ffb640 1 -- 172.21.15.115:0/2165161633 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f3ae4031c00 con 0x7f3af81015e0 2024-09-13T17:02:42.200 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:41.753+0000 7f3af5ffb640 1 --2- 172.21.15.115:0/2165161633 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f3ae806cc50 0x7f3ae806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:42.200 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:41.753+0000 7f3af5ffb640 1 -- 172.21.15.115:0/2165161633 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f3ae40aced0 con 0x7f3af81015e0 2024-09-13T17:02:42.200 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:41.753+0000 7f3afcf41640 1 --2- 172.21.15.115:0/2165161633 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f3ae806cc50 0x7f3ae806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:42.200 INFO:teuthology.orchestra.run.smithi115.stdout:81604378650 2024-09-13T17:02:42.201 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:41.754+0000 7f3afcf41640 1 --2- 172.21.15.115:0/2165161633 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f3ae806cc50 0x7f3ae806f110 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3aec006fd0 tx=0x7f3aec008040 comp rx=0 tx=0).ready entity=mgr.14207 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:02:42.201 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:41.757+0000 7f3af5ffb640 1 -- 172.21.15.115:0/2165161633 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f3ae40775e0 con 0x7f3af81015e0 2024-09-13T17:02:42.201 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:41.932+0000 7f3aff1a5640 1 -- 172.21.15.115:0/2165161633 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3af80ff790 con 0x7f3af81015e0 2024-09-13T17:02:42.201 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:41.932+0000 7f3af5ffb640 1 -- 172.21.15.115:0/2165161633 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3af80ff790 con 0x7f3af81015e0 2024-09-13T17:02:42.201 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:41.934+0000 7f3aff1a5640 1 -- 172.21.15.115:0/2165161633 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f3ae806cc50 msgr2=0x7f3ae806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:42.201 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:41.934+0000 7f3aff1a5640 1 --2- 172.21.15.115:0/2165161633 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f3ae806cc50 0x7f3ae806f110 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3aec006fd0 tx=0x7f3aec008040 comp rx=0 tx=0).stop 2024-09-13T17:02:42.201 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:41.934+0000 7f3aff1a5640 1 -- 172.21.15.115:0/2165161633 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3af81015e0 msgr2=0x7f3af80fee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:42.201 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:41.934+0000 7f3aff1a5640 1 --2- 172.21.15.115:0/2165161633 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3af81015e0 0x7f3af80fee60 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3ae4006010 tx=0x7f3ae4005610 comp rx=0 tx=0).stop 2024-09-13T17:02:42.201 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:41.934+0000 7f3aff1a5640 1 -- 172.21.15.115:0/2165161633 shutdown_connections 2024-09-13T17:02:42.201 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:41.934+0000 7f3aff1a5640 1 --2- 172.21.15.115:0/2165161633 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f3ae806cc50 0x7f3ae806f110 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:42.201 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:41.934+0000 7f3aff1a5640 1 --2- 172.21.15.115:0/2165161633 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3af81015e0 0x7f3af80fee60 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:42.201 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:41.934+0000 7f3aff1a5640 1 --2- 172.21.15.115:0/2165161633 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3af8100cc0 0x7f3af80fe920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:42.202 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:41.934+0000 7f3aff1a5640 1 -- 172.21.15.115:0/2165161633 >> 172.21.15.115:0/2165161633 conn(0x7f3af80758c0 msgr2=0x7f3af8101f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:02:42.202 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:41.934+0000 7f3aff1a5640 1 -- 172.21.15.115:0/2165161633 shutdown_connections 2024-09-13T17:02:42.202 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:41.934+0000 7f3aff1a5640 1 -- 172.21.15.115:0/2165161633 wait complete. 2024-09-13T17:02:42.518 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:02:42 smithi115 ceph-mon[27708]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:02:42.518 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:02:42 smithi115 ceph-mon[27708]: from='client.? 172.21.15.115:0/2165161633' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-13T17:02:42.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:02:42 smithi195 ceph-mon[34981]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:02:42.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:02:42 smithi195 ceph-mon[34981]: from='client.? 172.21.15.115:0/2165161633' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-13T17:02:42.950 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378649 got 81604378650 for osd.2 2024-09-13T17:02:42.950 DEBUG:teuthology.parallel:result is None 2024-09-13T17:02:43.531 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:43.384+0000 7fcab96df640 1 -- 172.21.15.115:0/3438627159 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcab40fe9a0 msgr2=0x7fcab40fee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:43.531 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:43.384+0000 7fcab96df640 1 --2- 172.21.15.115:0/3438627159 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcab40fe9a0 0x7fcab40fee00 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fca9c009880 tx=0x7fca9c02a4a0 comp rx=0 tx=0).stop 2024-09-13T17:02:43.531 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:43.384+0000 7fcab96df640 1 -- 172.21.15.115:0/3438627159 shutdown_connections 2024-09-13T17:02:43.531 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:43.384+0000 7fcab96df640 1 --2- 172.21.15.115:0/3438627159 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcab40fe9a0 0x7fcab40fee00 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:43.531 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:43.384+0000 7fcab96df640 1 --2- 172.21.15.115:0/3438627159 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcab41049a0 0x7fcab4104d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:43.531 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:43.384+0000 7fcab96df640 1 -- 172.21.15.115:0/3438627159 >> 172.21.15.115:0/3438627159 conn(0x7fcab40758c0 msgr2=0x7fcab40fcc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:02:43.531 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:43.384+0000 7fcab96df640 1 -- 172.21.15.115:0/3438627159 shutdown_connections 2024-09-13T17:02:43.531 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:43.384+0000 7fcab96df640 1 -- 172.21.15.115:0/3438627159 wait complete. 2024-09-13T17:02:43.531 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:43.384+0000 7fcab96df640 1 Processor -- start 2024-09-13T17:02:43.532 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:43.385+0000 7fcab96df640 1 -- start start 2024-09-13T17:02:43.532 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:43.385+0000 7fcab96df640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcab40fe9a0 0x7fcab4194760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:43.532 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:43.385+0000 7fcab96df640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcab41049a0 0x7fcab4194ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:43.532 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:43.385+0000 7fcab96df640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcab41951e0 con 0x7fcab41049a0 2024-09-13T17:02:43.532 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:43.385+0000 7fcab96df640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcab4195350 con 0x7fcab40fe9a0 2024-09-13T17:02:43.532 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:43.385+0000 7fcab27fc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcab41049a0 0x7fcab4194ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:43.532 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:43.385+0000 7fcab27fc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcab41049a0 0x7fcab4194ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:40080/0 (socket says 172.21.15.115:40080) 2024-09-13T17:02:43.532 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:43.385+0000 7fcab27fc640 1 -- 172.21.15.115:0/157041640 learned_addr learned my addr 172.21.15.115:0/157041640 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:02:43.532 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:43.385+0000 7fcab2ffd640 1 --2- 172.21.15.115:0/157041640 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcab40fe9a0 0x7fcab4194760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:43.532 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:43.385+0000 7fcab27fc640 1 -- 172.21.15.115:0/157041640 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcab40fe9a0 msgr2=0x7fcab4194760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:43.532 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:43.385+0000 7fcab27fc640 1 --2- 172.21.15.115:0/157041640 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcab40fe9a0 0x7fcab4194760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:43.532 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:43.385+0000 7fcab27fc640 1 -- 172.21.15.115:0/157041640 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca9c009560 con 0x7fcab41049a0 2024-09-13T17:02:43.533 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:43.385+0000 7fcab27fc640 1 --2- 172.21.15.115:0/157041640 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcab41049a0 0x7fcab4194ca0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fca9c02a9c0 tx=0x7fca9c0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:02:43.533 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:43.386+0000 7fcaabfff640 1 -- 172.21.15.115:0/157041640 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca9c004b60 con 0x7fcab41049a0 2024-09-13T17:02:43.533 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:43.386+0000 7fcaabfff640 1 -- 172.21.15.115:0/157041640 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fca9c004cc0 con 0x7fcab41049a0 2024-09-13T17:02:43.533 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:43.386+0000 7fcab96df640 1 -- 172.21.15.115:0/157041640 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcab41955d0 con 0x7fcab41049a0 2024-09-13T17:02:43.533 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:43.386+0000 7fcaabfff640 1 -- 172.21.15.115:0/157041640 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca9c031950 con 0x7fcab41049a0 2024-09-13T17:02:43.533 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:43.386+0000 7fcab96df640 1 -- 172.21.15.115:0/157041640 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcab41a1ff0 con 0x7fcab41049a0 2024-09-13T17:02:43.533 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:43.387+0000 7fcab96df640 1 -- 172.21.15.115:0/157041640 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcab41000e0 con 0x7fcab41049a0 2024-09-13T17:02:43.533 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:43.387+0000 7fcaabfff640 1 -- 172.21.15.115:0/157041640 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fca9c003c20 con 0x7fcab41049a0 2024-09-13T17:02:43.533 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:43.387+0000 7fcaabfff640 1 --2- 172.21.15.115:0/157041640 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fcaa006cc50 0x7fcaa006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:43.533 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:43.388+0000 7fcab2ffd640 1 --2- 172.21.15.115:0/157041640 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fcaa006cc50 0x7fcaa006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:43.533 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:43.388+0000 7fcaabfff640 1 -- 172.21.15.115:0/157041640 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fca9c0ace60 con 0x7fcab41049a0 2024-09-13T17:02:43.533 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:43.388+0000 7fcab2ffd640 1 --2- 172.21.15.115:0/157041640 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fcaa006cc50 0x7fcaa006f110 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fcaa4005fd0 tx=0x7fcaa4005850 comp rx=0 tx=0).ready entity=mgr.14207 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:02:43.533 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:43.392+0000 7fcaabfff640 1 -- 172.21.15.115:0/157041640 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fca9c077570 con 0x7fcab41049a0 2024-09-13T17:02:43.557 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:43.556+0000 7fcab96df640 1 -- 172.21.15.115:0/157041640 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fcab41955d0 con 0x7fcab41049a0 2024-09-13T17:02:43.557 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:43.556+0000 7fcaabfff640 1 -- 172.21.15.115:0/157041640 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcab41955d0 con 0x7fcab41049a0 2024-09-13T17:02:43.557 INFO:teuthology.orchestra.run.smithi115.stdout:60129542177 2024-09-13T17:02:43.559 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:43.558+0000 7fcab96df640 1 -- 172.21.15.115:0/157041640 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fcaa006cc50 msgr2=0x7fcaa006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:43.559 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:43.558+0000 7fcab96df640 1 --2- 172.21.15.115:0/157041640 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fcaa006cc50 0x7fcaa006f110 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fcaa4005fd0 tx=0x7fcaa4005850 comp rx=0 tx=0).stop 2024-09-13T17:02:43.559 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:43.558+0000 7fcab96df640 1 -- 172.21.15.115:0/157041640 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcab41049a0 msgr2=0x7fcab4194ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:43.559 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:43.558+0000 7fcab96df640 1 --2- 172.21.15.115:0/157041640 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcab41049a0 0x7fcab4194ca0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fca9c02a9c0 tx=0x7fca9c0055a0 comp rx=0 tx=0).stop 2024-09-13T17:02:43.559 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:43.558+0000 7fcab96df640 1 -- 172.21.15.115:0/157041640 shutdown_connections 2024-09-13T17:02:43.560 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:43.558+0000 7fcab96df640 1 --2- 172.21.15.115:0/157041640 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fcaa006cc50 0x7fcaa006f110 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:43.560 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:43.558+0000 7fcab96df640 1 --2- 172.21.15.115:0/157041640 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcab41049a0 0x7fcab4194ca0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:43.560 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:43.558+0000 7fcab96df640 1 --2- 172.21.15.115:0/157041640 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcab40fe9a0 0x7fcab4194760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:43.560 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:43.558+0000 7fcab96df640 1 -- 172.21.15.115:0/157041640 >> 172.21.15.115:0/157041640 conn(0x7fcab40758c0 msgr2=0x7fcab4102240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:02:43.560 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:43.558+0000 7fcab96df640 1 -- 172.21.15.115:0/157041640 shutdown_connections 2024-09-13T17:02:43.560 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:43.558+0000 7fcab96df640 1 -- 172.21.15.115:0/157041640 wait complete. 2024-09-13T17:02:44.147 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542174 got 60129542177 for osd.1 2024-09-13T17:02:44.148 DEBUG:teuthology.parallel:result is None 2024-09-13T17:02:44.625 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:02:44 smithi115 ceph-mon[27708]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:02:44.625 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:02:44 smithi115 ceph-mon[27708]: from='client.? 172.21.15.115:0/157041640' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-13T17:02:44.625 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:02:44 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:02:44.629 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:44.624+0000 7fe6f79a4640 1 -- 172.21.15.115:0/3450335629 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6f0100cd0 msgr2=0x7fe6f01010b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:44.629 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:44.624+0000 7fe6f79a4640 1 --2- 172.21.15.115:0/3450335629 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6f0100cd0 0x7fe6f01010b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe6e0009880 tx=0x7fe6e002a530 comp rx=0 tx=0).stop 2024-09-13T17:02:44.629 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:44.624+0000 7fe6f79a4640 1 -- 172.21.15.115:0/3450335629 shutdown_connections 2024-09-13T17:02:44.629 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:44.624+0000 7fe6f79a4640 1 --2- 172.21.15.115:0/3450335629 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe6f01015f0 0x7fe6f0109ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:44.630 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:44.624+0000 7fe6f79a4640 1 --2- 172.21.15.115:0/3450335629 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6f0100cd0 0x7fe6f01010b0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:44.630 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:44.624+0000 7fe6f79a4640 1 -- 172.21.15.115:0/3450335629 >> 172.21.15.115:0/3450335629 conn(0x7fe6f00fa730 msgr2=0x7fe6f00fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:02:44.630 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:44.624+0000 7fe6f79a4640 1 -- 172.21.15.115:0/3450335629 shutdown_connections 2024-09-13T17:02:44.630 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:44.624+0000 7fe6f79a4640 1 -- 172.21.15.115:0/3450335629 wait complete. 2024-09-13T17:02:44.630 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:44.624+0000 7fe6f79a4640 1 Processor -- start 2024-09-13T17:02:44.630 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:44.625+0000 7fe6f79a4640 1 -- start start 2024-09-13T17:02:44.630 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:44.625+0000 7fe6f79a4640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe6f0100cd0 0x7fe6f00fe930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:44.630 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:44.625+0000 7fe6f79a4640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6f01015f0 0x7fe6f00fee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:44.630 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:44.625+0000 7fe6f79a4640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f00ff3b0 con 0x7fe6f01015f0 2024-09-13T17:02:44.630 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:44.625+0000 7fe6f79a4640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f00ff520 con 0x7fe6f0100cd0 2024-09-13T17:02:44.630 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:44.625+0000 7fe6f4f3f640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6f01015f0 0x7fe6f00fee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:44.630 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:44.625+0000 7fe6f4f3f640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6f01015f0 0x7fe6f00fee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:33452/0 (socket says 172.21.15.115:33452) 2024-09-13T17:02:44.630 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:44.625+0000 7fe6f4f3f640 1 -- 172.21.15.115:0/1163640818 learned_addr learned my addr 172.21.15.115:0/1163640818 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:02:44.630 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:44.625+0000 7fe6f5740640 1 --2- 172.21.15.115:0/1163640818 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe6f0100cd0 0x7fe6f00fe930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:44.631 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:44.625+0000 7fe6f4f3f640 1 -- 172.21.15.115:0/1163640818 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe6f0100cd0 msgr2=0x7fe6f00fe930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:44.631 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:44.625+0000 7fe6f4f3f640 1 --2- 172.21.15.115:0/1163640818 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe6f0100cd0 0x7fe6f00fe930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:44.631 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:44.625+0000 7fe6f4f3f640 1 -- 172.21.15.115:0/1163640818 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6e0009560 con 0x7fe6f01015f0 2024-09-13T17:02:44.631 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:44.625+0000 7fe6f4f3f640 1 --2- 172.21.15.115:0/1163640818 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6f01015f0 0x7fe6f00fee70 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec00b370 tx=0x7fe6ec00b830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:02:44.631 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:44.625+0000 7fe6e67fc640 1 -- 172.21.15.115:0/1163640818 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe6ec011800 con 0x7fe6f01015f0 2024-09-13T17:02:44.631 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:44.625+0000 7fe6e67fc640 1 -- 172.21.15.115:0/1163640818 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe6ec011e00 con 0x7fe6f01015f0 2024-09-13T17:02:44.631 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:44.625+0000 7fe6e67fc640 1 -- 172.21.15.115:0/1163640818 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe6ec00f2e0 con 0x7fe6f01015f0 2024-09-13T17:02:44.631 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:44.625+0000 7fe6f79a4640 1 -- 172.21.15.115:0/1163640818 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6f01a1ce0 con 0x7fe6f01015f0 2024-09-13T17:02:44.631 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:44.626+0000 7fe6f79a4640 1 -- 172.21.15.115:0/1163640818 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6f01a2040 con 0x7fe6f01015f0 2024-09-13T17:02:44.631 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:44.627+0000 7fe6f79a4640 1 -- 172.21.15.115:0/1163640818 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6f0068ce0 con 0x7fe6f01015f0 2024-09-13T17:02:44.631 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:44.627+0000 7fe6e67fc640 1 -- 172.21.15.115:0/1163640818 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fe6ec010380 con 0x7fe6f01015f0 2024-09-13T17:02:44.631 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:44.627+0000 7fe6e67fc640 1 --2- 172.21.15.115:0/1163640818 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fe6dc06cc50 0x7fe6dc06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:44.631 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:44.628+0000 7fe6e67fc640 1 -- 172.21.15.115:0/1163640818 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fe6ec08ba50 con 0x7fe6f01015f0 2024-09-13T17:02:44.632 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:44.628+0000 7fe6f5740640 1 --2- 172.21.15.115:0/1163640818 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fe6dc06cc50 0x7fe6dc06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:44.632 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:44.628+0000 7fe6f5740640 1 --2- 172.21.15.115:0/1163640818 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fe6dc06cc50 0x7fe6dc06f110 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe6e0005ab0 tx=0x7fe6e0005a20 comp rx=0 tx=0).ready entity=mgr.14207 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:02:44.633 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:44.632+0000 7fe6e67fc640 1 -- 172.21.15.115:0/1163640818 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe6ec0561e0 con 0x7fe6f01015f0 2024-09-13T17:02:44.799 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:44.797+0000 7fe6f79a4640 1 -- 172.21.15.115:0/1163640818 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fe6f00ff6e0 con 0x7fe6f01015f0 2024-09-13T17:02:44.799 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:44.798+0000 7fe6e67fc640 1 -- 172.21.15.115:0/1163640818 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe6f00ff6e0 con 0x7fe6f01015f0 2024-09-13T17:02:44.799 INFO:teuthology.orchestra.run.smithi115.stdout:167503724556 2024-09-13T17:02:44.801 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:44.799+0000 7fe6f79a4640 1 -- 172.21.15.115:0/1163640818 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fe6dc06cc50 msgr2=0x7fe6dc06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:44.801 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:44.799+0000 7fe6f79a4640 1 --2- 172.21.15.115:0/1163640818 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fe6dc06cc50 0x7fe6dc06f110 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe6e0005ab0 tx=0x7fe6e0005a20 comp rx=0 tx=0).stop 2024-09-13T17:02:44.801 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:44.799+0000 7fe6f79a4640 1 -- 172.21.15.115:0/1163640818 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6f01015f0 msgr2=0x7fe6f00fee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:44.801 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:44.799+0000 7fe6f79a4640 1 --2- 172.21.15.115:0/1163640818 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6f01015f0 0x7fe6f00fee70 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec00b370 tx=0x7fe6ec00b830 comp rx=0 tx=0).stop 2024-09-13T17:02:44.801 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:44.799+0000 7fe6f79a4640 1 -- 172.21.15.115:0/1163640818 shutdown_connections 2024-09-13T17:02:44.801 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:44.800+0000 7fe6f79a4640 1 --2- 172.21.15.115:0/1163640818 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fe6dc06cc50 0x7fe6dc06f110 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:44.801 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:44.800+0000 7fe6f79a4640 1 --2- 172.21.15.115:0/1163640818 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6f01015f0 0x7fe6f00fee70 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:44.801 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:44.800+0000 7fe6f79a4640 1 --2- 172.21.15.115:0/1163640818 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe6f0100cd0 0x7fe6f00fe930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:44.802 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:44.800+0000 7fe6f79a4640 1 -- 172.21.15.115:0/1163640818 >> 172.21.15.115:0/1163640818 conn(0x7fe6f00fa730 msgr2=0x7fe6f0101fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:02:44.802 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:44.800+0000 7fe6f79a4640 1 -- 172.21.15.115:0/1163640818 shutdown_connections 2024-09-13T17:02:44.802 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:44.800+0000 7fe6f79a4640 1 -- 172.21.15.115:0/1163640818 wait complete. 2024-09-13T17:02:44.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:02:44 smithi195 ceph-mon[34981]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:02:44.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:02:44 smithi195 ceph-mon[34981]: from='client.? 172.21.15.115:0/157041640' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-13T17:02:44.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:02:44 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:02:45.556 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:02:45 smithi115 ceph-mon[27708]: from='client.? 172.21.15.115:0/1163640818' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-13T17:02:45.717 INFO:tasks.cephadm.ceph_manager.ceph:need seq 167503724554 got 167503724556 for osd.5 2024-09-13T17:02:45.717 DEBUG:teuthology.parallel:result is None 2024-09-13T17:02:45.797 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:45.380+0000 7fb54816d640 1 -- 172.21.15.115:0/1113587381 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb540101600 msgr2=0x7fb540109af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:45.797 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:45.380+0000 7fb54816d640 1 --2- 172.21.15.115:0/1113587381 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb540101600 0x7fb540109af0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb534009880 tx=0x7fb53402a530 comp rx=0 tx=0).stop 2024-09-13T17:02:45.797 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:45.380+0000 7fb54816d640 1 -- 172.21.15.115:0/1113587381 shutdown_connections 2024-09-13T17:02:45.797 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:45.380+0000 7fb54816d640 1 --2- 172.21.15.115:0/1113587381 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb540101600 0x7fb540109af0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:45.797 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:45.380+0000 7fb54816d640 1 --2- 172.21.15.115:0/1113587381 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb540100ce0 0x7fb5401010c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:45.797 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:45.380+0000 7fb54816d640 1 -- 172.21.15.115:0/1113587381 >> 172.21.15.115:0/1113587381 conn(0x7fb5400758c0 msgr2=0x7fb5400fcc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:02:45.797 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:45.381+0000 7fb54816d640 1 -- 172.21.15.115:0/1113587381 shutdown_connections 2024-09-13T17:02:45.797 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:45.381+0000 7fb54816d640 1 -- 172.21.15.115:0/1113587381 wait complete. 2024-09-13T17:02:45.797 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:45.381+0000 7fb54816d640 1 Processor -- start 2024-09-13T17:02:45.797 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:45.381+0000 7fb54816d640 1 -- start start 2024-09-13T17:02:45.798 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:45.381+0000 7fb54816d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb540100ce0 0x7fb54019b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:45.798 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:45.381+0000 7fb54816d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb540101600 0x7fb54019be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:45.798 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:45.381+0000 7fb54816d640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5401959f0 con 0x7fb540101600 2024-09-13T17:02:45.798 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:45.381+0000 7fb54816d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb540195b60 con 0x7fb540100ce0 2024-09-13T17:02:45.798 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:45.381+0000 7fb545708640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb540101600 0x7fb54019be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:45.798 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:45.381+0000 7fb545708640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb540101600 0x7fb54019be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:33478/0 (socket says 172.21.15.115:33478) 2024-09-13T17:02:45.798 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:45.381+0000 7fb545708640 1 -- 172.21.15.115:0/2174070194 learned_addr learned my addr 172.21.15.115:0/2174070194 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:02:45.798 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:45.382+0000 7fb545f09640 1 --2- 172.21.15.115:0/2174070194 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb540100ce0 0x7fb54019b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:45.798 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:45.382+0000 7fb545708640 1 -- 172.21.15.115:0/2174070194 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb540100ce0 msgr2=0x7fb54019b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:45.798 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:45.382+0000 7fb545708640 1 --2- 172.21.15.115:0/2174070194 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb540100ce0 0x7fb54019b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:45.798 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:45.382+0000 7fb545708640 1 -- 172.21.15.115:0/2174070194 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb534009560 con 0x7fb540101600 2024-09-13T17:02:45.798 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:45.382+0000 7fb545708640 1 --2- 172.21.15.115:0/2174070194 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb540101600 0x7fb54019be40 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb534006010 tx=0x7fb534004da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:02:45.799 INFO:teuthology.orchestra.run.smithi115.stdout:38654705703 2024-09-13T17:02:45.799 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:45.382+0000 7fb53effd640 1 -- 172.21.15.115:0/2174070194 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5340053b0 con 0x7fb540101600 2024-09-13T17:02:45.799 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:45.382+0000 7fb53effd640 1 -- 172.21.15.115:0/2174070194 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb534005510 con 0x7fb540101600 2024-09-13T17:02:45.799 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:45.382+0000 7fb54816d640 1 -- 172.21.15.115:0/2174070194 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb540195de0 con 0x7fb540101600 2024-09-13T17:02:45.799 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:45.382+0000 7fb53effd640 1 -- 172.21.15.115:0/2174070194 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5340319f0 con 0x7fb540101600 2024-09-13T17:02:45.799 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:45.382+0000 7fb54816d640 1 -- 172.21.15.115:0/2174070194 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5401962d0 con 0x7fb540101600 2024-09-13T17:02:45.799 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:45.383+0000 7fb54816d640 1 -- 172.21.15.115:0/2174070194 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb540068440 con 0x7fb540101600 2024-09-13T17:02:45.799 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:45.383+0000 7fb53effd640 1 -- 172.21.15.115:0/2174070194 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fb53402ad50 con 0x7fb540101600 2024-09-13T17:02:45.800 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:45.384+0000 7fb53effd640 1 --2- 172.21.15.115:0/2174070194 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fb52806cc50 0x7fb52806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:45.800 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:45.384+0000 7fb53effd640 1 -- 172.21.15.115:0/2174070194 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fb5340acdc0 con 0x7fb540101600 2024-09-13T17:02:45.800 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:45.384+0000 7fb545f09640 1 --2- 172.21.15.115:0/2174070194 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fb52806cc50 0x7fb52806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:45.800 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:45.384+0000 7fb545f09640 1 --2- 172.21.15.115:0/2174070194 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fb52806cc50 0x7fb52806f110 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb530009f20 tx=0x7fb5300094f0 comp rx=0 tx=0).ready entity=mgr.14207 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:02:45.800 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:45.388+0000 7fb53effd640 1 -- 172.21.15.115:0/2174070194 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fb5340774d0 con 0x7fb540101600 2024-09-13T17:02:45.800 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:45.555+0000 7fb54816d640 1 -- 172.21.15.115:0/2174070194 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb540196f60 con 0x7fb540101600 2024-09-13T17:02:45.800 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:45.555+0000 7fb53effd640 1 -- 172.21.15.115:0/2174070194 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb53407aaf0 con 0x7fb540101600 2024-09-13T17:02:45.800 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:45.557+0000 7fb54816d640 1 -- 172.21.15.115:0/2174070194 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fb52806cc50 msgr2=0x7fb52806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:45.800 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:45.557+0000 7fb54816d640 1 --2- 172.21.15.115:0/2174070194 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fb52806cc50 0x7fb52806f110 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb530009f20 tx=0x7fb5300094f0 comp rx=0 tx=0).stop 2024-09-13T17:02:45.800 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:45.557+0000 7fb54816d640 1 -- 172.21.15.115:0/2174070194 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb540101600 msgr2=0x7fb54019be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:45.800 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:45.557+0000 7fb54816d640 1 --2- 172.21.15.115:0/2174070194 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb540101600 0x7fb54019be40 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb534006010 tx=0x7fb534004da0 comp rx=0 tx=0).stop 2024-09-13T17:02:45.800 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:45.557+0000 7fb54816d640 1 -- 172.21.15.115:0/2174070194 shutdown_connections 2024-09-13T17:02:45.800 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:45.557+0000 7fb54816d640 1 --2- 172.21.15.115:0/2174070194 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fb52806cc50 0x7fb52806f110 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:45.801 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:45.557+0000 7fb54816d640 1 --2- 172.21.15.115:0/2174070194 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb540101600 0x7fb54019be40 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:45.801 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:45.557+0000 7fb54816d640 1 --2- 172.21.15.115:0/2174070194 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb540100ce0 0x7fb54019b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:45.801 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:45.557+0000 7fb54816d640 1 -- 172.21.15.115:0/2174070194 >> 172.21.15.115:0/2174070194 conn(0x7fb5400758c0 msgr2=0x7fb540101f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:02:45.801 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:45.557+0000 7fb54816d640 1 -- 172.21.15.115:0/2174070194 shutdown_connections 2024-09-13T17:02:45.801 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:45.557+0000 7fb54816d640 1 -- 172.21.15.115:0/2174070194 wait complete. 2024-09-13T17:02:45.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:02:45 smithi195 ceph-mon[34981]: from='client.? 172.21.15.115:0/1163640818' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-13T17:02:46.353 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705699 got 38654705703 for osd.0 2024-09-13T17:02:46.353 DEBUG:teuthology.parallel:result is None 2024-09-13T17:02:46.583 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:02:46 smithi115 ceph-mon[27708]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:02:46.583 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:02:46 smithi115 ceph-mon[27708]: from='client.? 172.21.15.115:0/2174070194' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-13T17:02:46.638 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:02:46 smithi195 ceph-mon[34981]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:02:46.638 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:02:46 smithi195 ceph-mon[34981]: from='client.? 172.21.15.115:0/2174070194' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-13T17:02:47.331 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:47.318+0000 7fc1b1ea9640 1 -- 172.21.15.115:0/839085330 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1ac101580 msgr2=0x7fc1ac109a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:47.332 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:47.318+0000 7fc1b1ea9640 1 --2- 172.21.15.115:0/839085330 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1ac101580 0x7fc1ac109a70 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc194009880 tx=0x7fc19402a530 comp rx=0 tx=0).stop 2024-09-13T17:02:47.332 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:47.318+0000 7fc1b1ea9640 1 -- 172.21.15.115:0/839085330 shutdown_connections 2024-09-13T17:02:47.332 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:47.318+0000 7fc1b1ea9640 1 --2- 172.21.15.115:0/839085330 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1ac101580 0x7fc1ac109a70 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:47.332 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:47.318+0000 7fc1b1ea9640 1 --2- 172.21.15.115:0/839085330 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1ac100c60 0x7fc1ac101040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:47.332 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:47.318+0000 7fc1b1ea9640 1 -- 172.21.15.115:0/839085330 >> 172.21.15.115:0/839085330 conn(0x7fc1ac0758c0 msgr2=0x7fc1ac0fcc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:02:47.332 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:47.318+0000 7fc1b1ea9640 1 -- 172.21.15.115:0/839085330 shutdown_connections 2024-09-13T17:02:47.332 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:47.318+0000 7fc1b1ea9640 1 -- 172.21.15.115:0/839085330 wait complete. 2024-09-13T17:02:47.332 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:47.318+0000 7fc1b1ea9640 1 Processor -- start 2024-09-13T17:02:47.332 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:47.318+0000 7fc1b1ea9640 1 -- start start 2024-09-13T17:02:47.332 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:47.319+0000 7fc1b1ea9640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1ac100c60 0x7fc1ac19b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:47.332 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:47.319+0000 7fc1b1ea9640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1ac101580 0x7fc1ac19bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:47.333 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:47.319+0000 7fc1b1ea9640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ac19c2e0 con 0x7fc1ac100c60 2024-09-13T17:02:47.333 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:47.319+0000 7fc1b1ea9640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ac195870 con 0x7fc1ac101580 2024-09-13T17:02:47.333 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:47.319+0000 7fc1ab7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1ac100c60 0x7fc1ac19b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:47.333 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:47.319+0000 7fc1ab7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1ac100c60 0x7fc1ac19b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:33506/0 (socket says 172.21.15.115:33506) 2024-09-13T17:02:47.333 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:47.319+0000 7fc1ab7fe640 1 -- 172.21.15.115:0/3366658566 learned_addr learned my addr 172.21.15.115:0/3366658566 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:02:47.333 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:47.319+0000 7fc1a3fff640 1 --2- 172.21.15.115:0/3366658566 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1ac101580 0x7fc1ac19bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:47.333 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:47.319+0000 7fc1ab7fe640 1 -- 172.21.15.115:0/3366658566 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1ac101580 msgr2=0x7fc1ac19bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:47.333 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:47.319+0000 7fc1ab7fe640 1 --2- 172.21.15.115:0/3366658566 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1ac101580 0x7fc1ac19bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:47.333 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:47.319+0000 7fc1ab7fe640 1 -- 172.21.15.115:0/3366658566 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc194009560 con 0x7fc1ac100c60 2024-09-13T17:02:47.333 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:47.319+0000 7fc1a3fff640 1 --2- 172.21.15.115:0/3366658566 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1ac101580 0x7fc1ac19bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:02:47.333 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:47.319+0000 7fc1ab7fe640 1 --2- 172.21.15.115:0/3366658566 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1ac100c60 0x7fc1ac19b780 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc19c00d8d0 tx=0x7fc19c00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:02:47.333 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:47.319+0000 7fc1a97fa640 1 -- 172.21.15.115:0/3366658566 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc19c00bea0 con 0x7fc1ac100c60 2024-09-13T17:02:47.333 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:47.319+0000 7fc1b1ea9640 1 -- 172.21.15.115:0/3366658566 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1ac195b50 con 0x7fc1ac100c60 2024-09-13T17:02:47.334 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:47.319+0000 7fc1a97fa640 1 -- 172.21.15.115:0/3366658566 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc19c009c00 con 0x7fc1ac100c60 2024-09-13T17:02:47.334 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:47.319+0000 7fc1a97fa640 1 -- 172.21.15.115:0/3366658566 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc19c00f680 con 0x7fc1ac100c60 2024-09-13T17:02:47.334 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:47.319+0000 7fc1b1ea9640 1 -- 172.21.15.115:0/3366658566 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1ac1960a0 con 0x7fc1ac100c60 2024-09-13T17:02:47.334 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:47.320+0000 7fc1b1ea9640 1 -- 172.21.15.115:0/3366658566 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1ac0684c0 con 0x7fc1ac100c60 2024-09-13T17:02:47.334 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:47.321+0000 7fc1a97fa640 1 -- 172.21.15.115:0/3366658566 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fc19c010460 con 0x7fc1ac100c60 2024-09-13T17:02:47.334 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:47.321+0000 7fc1a97fa640 1 --2- 172.21.15.115:0/3366658566 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fc19806cc50 0x7fc19806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:47.334 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:47.322+0000 7fc1a3fff640 1 --2- 172.21.15.115:0/3366658566 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fc19806cc50 0x7fc19806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:47.334 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:47.322+0000 7fc1a97fa640 1 -- 172.21.15.115:0/3366658566 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fc19c08bd10 con 0x7fc1ac100c60 2024-09-13T17:02:47.334 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:47.322+0000 7fc1a3fff640 1 --2- 172.21.15.115:0/3366658566 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fc19806cc50 0x7fc19806f110 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac196ce0 tx=0x7fc194005a20 comp rx=0 tx=0).ready entity=mgr.14207 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:02:47.334 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:47.326+0000 7fc1a97fa640 1 -- 172.21.15.115:0/3366658566 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc19c059eb0 con 0x7fc1ac100c60 2024-09-13T17:02:47.493 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:47.491+0000 7fc1b1ea9640 1 -- 172.21.15.115:0/3366658566 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fc1ac101040 con 0x7fc1ac100c60 2024-09-13T17:02:47.493 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:47.491+0000 7fc1a97fa640 1 -- 172.21.15.115:0/3366658566 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc19c059a40 con 0x7fc1ac100c60 2024-09-13T17:02:47.493 INFO:teuthology.orchestra.run.smithi115.stdout:146028888082 2024-09-13T17:02:47.495 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:47.493+0000 7fc1b1ea9640 1 -- 172.21.15.115:0/3366658566 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fc19806cc50 msgr2=0x7fc19806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:47.495 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:47.493+0000 7fc1b1ea9640 1 --2- 172.21.15.115:0/3366658566 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fc19806cc50 0x7fc19806f110 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac196ce0 tx=0x7fc194005a20 comp rx=0 tx=0).stop 2024-09-13T17:02:47.495 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:47.493+0000 7fc1b1ea9640 1 -- 172.21.15.115:0/3366658566 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1ac100c60 msgr2=0x7fc1ac19b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:47.495 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:47.493+0000 7fc1b1ea9640 1 --2- 172.21.15.115:0/3366658566 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1ac100c60 0x7fc1ac19b780 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc19c00d8d0 tx=0x7fc19c00dd90 comp rx=0 tx=0).stop 2024-09-13T17:02:47.495 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:47.494+0000 7fc1b1ea9640 1 -- 172.21.15.115:0/3366658566 shutdown_connections 2024-09-13T17:02:47.495 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:47.494+0000 7fc1b1ea9640 1 --2- 172.21.15.115:0/3366658566 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fc19806cc50 0x7fc19806f110 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:47.495 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:47.494+0000 7fc1b1ea9640 1 --2- 172.21.15.115:0/3366658566 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1ac101580 0x7fc1ac19bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:47.495 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:47.494+0000 7fc1b1ea9640 1 --2- 172.21.15.115:0/3366658566 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1ac100c60 0x7fc1ac19b780 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:47.495 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:47.494+0000 7fc1b1ea9640 1 -- 172.21.15.115:0/3366658566 >> 172.21.15.115:0/3366658566 conn(0x7fc1ac0758c0 msgr2=0x7fc1ac101f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:02:47.495 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:47.494+0000 7fc1b1ea9640 1 -- 172.21.15.115:0/3366658566 shutdown_connections 2024-09-13T17:02:47.496 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:47.494+0000 7fc1b1ea9640 1 -- 172.21.15.115:0/3366658566 wait complete. 2024-09-13T17:02:48.166 INFO:tasks.cephadm.ceph_manager.ceph:need seq 146028888079 got 146028888082 for osd.4 2024-09-13T17:02:48.166 DEBUG:teuthology.parallel:result is None 2024-09-13T17:02:48.166 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-13T17:02:48.166 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-13T17:02:48.365 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T17:02:48.428 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:02:48 smithi115 ceph-mon[27708]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:02:48.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:02:48 smithi115 ceph-mon[27708]: from='client.? 172.21.15.115:0/3366658566' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-13T17:02:48.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:02:48 smithi195 ceph-mon[34981]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:02:48.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:02:48 smithi195 ceph-mon[34981]: from='client.? 172.21.15.115:0/3366658566' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-13T17:02:50.027 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:50.025+0000 7fc4617bf640 1 -- 172.21.15.115:0/613287778 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc45c100d00 msgr2=0x7fc45c1010e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:50.027 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:50.025+0000 7fc4617bf640 1 --2- 172.21.15.115:0/613287778 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc45c100d00 0x7fc45c1010e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc44c009c20 tx=0x7fc44c02aa00 comp rx=0 tx=0).stop 2024-09-13T17:02:50.027 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:50.025+0000 7fc4617bf640 1 -- 172.21.15.115:0/613287778 shutdown_connections 2024-09-13T17:02:50.027 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:50.025+0000 7fc4617bf640 1 --2- 172.21.15.115:0/613287778 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc45c101620 0x7fc45c109b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:50.027 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:50.025+0000 7fc4617bf640 1 --2- 172.21.15.115:0/613287778 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc45c100d00 0x7fc45c1010e0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:50.027 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:50.025+0000 7fc4617bf640 1 -- 172.21.15.115:0/613287778 >> 172.21.15.115:0/613287778 conn(0x7fc45c0758c0 msgr2=0x7fc45c0fcc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:02:50.027 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:50.025+0000 7fc4617bf640 1 -- 172.21.15.115:0/613287778 shutdown_connections 2024-09-13T17:02:50.027 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:50.025+0000 7fc4617bf640 1 -- 172.21.15.115:0/613287778 wait complete. 2024-09-13T17:02:50.029 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:50.026+0000 7fc4617bf640 1 Processor -- start 2024-09-13T17:02:50.029 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:50.026+0000 7fc4617bf640 1 -- start start 2024-09-13T17:02:50.029 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:50.027+0000 7fc4617bf640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc45c100d00 0x7fc45c19b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:50.029 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:50.027+0000 7fc4617bf640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc45c101620 0x7fc45c19bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:50.029 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:50.027+0000 7fc4617bf640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc45c19c400 con 0x7fc45c100d00 2024-09-13T17:02:50.029 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:50.027+0000 7fc4617bf640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc45c195990 con 0x7fc45c101620 2024-09-13T17:02:50.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:50.027+0000 7fc45affd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc45c100d00 0x7fc45c19b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:50.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:50.027+0000 7fc45affd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc45c100d00 0x7fc45c19b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:33520/0 (socket says 172.21.15.115:33520) 2024-09-13T17:02:50.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:50.027+0000 7fc45affd640 1 -- 172.21.15.115:0/582176006 learned_addr learned my addr 172.21.15.115:0/582176006 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:02:50.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:50.027+0000 7fc45a7fc640 1 --2- 172.21.15.115:0/582176006 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc45c101620 0x7fc45c19bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:50.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:50.027+0000 7fc45affd640 1 -- 172.21.15.115:0/582176006 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc45c101620 msgr2=0x7fc45c19bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:50.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:50.027+0000 7fc45affd640 1 --2- 172.21.15.115:0/582176006 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc45c101620 0x7fc45c19bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:50.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:50.027+0000 7fc45affd640 1 -- 172.21.15.115:0/582176006 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc44c009900 con 0x7fc45c100d00 2024-09-13T17:02:50.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:50.027+0000 7fc45a7fc640 1 --2- 172.21.15.115:0/582176006 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc45c101620 0x7fc45c19bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:02:50.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:50.027+0000 7fc45affd640 1 --2- 172.21.15.115:0/582176006 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc45c100d00 0x7fc45c19b8a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc44c006010 tx=0x7fc44c02f890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:02:50.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:50.027+0000 7fc443fff640 1 -- 172.21.15.115:0/582176006 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc44c03e070 con 0x7fc45c100d00 2024-09-13T17:02:50.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:50.027+0000 7fc443fff640 1 -- 172.21.15.115:0/582176006 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc44c02e850 con 0x7fc45c100d00 2024-09-13T17:02:50.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:50.027+0000 7fc4617bf640 1 -- 172.21.15.115:0/582176006 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc45c195c10 con 0x7fc45c100d00 2024-09-13T17:02:50.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:50.027+0000 7fc443fff640 1 -- 172.21.15.115:0/582176006 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc44c038450 con 0x7fc45c100d00 2024-09-13T17:02:50.031 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:50.027+0000 7fc4617bf640 1 -- 172.21.15.115:0/582176006 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc45c196100 con 0x7fc45c100d00 2024-09-13T17:02:50.031 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:50.028+0000 7fc4617bf640 1 -- 172.21.15.115:0/582176006 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc45c068420 con 0x7fc45c100d00 2024-09-13T17:02:50.032 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:50.029+0000 7fc443fff640 1 -- 172.21.15.115:0/582176006 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fc44c00a040 con 0x7fc45c100d00 2024-09-13T17:02:50.032 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:50.029+0000 7fc443fff640 1 --2- 172.21.15.115:0/582176006 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fc44406cc50 0x7fc44406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:50.032 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:50.030+0000 7fc443fff640 1 -- 172.21.15.115:0/582176006 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fc44c0aced0 con 0x7fc45c100d00 2024-09-13T17:02:50.032 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:50.030+0000 7fc45a7fc640 1 --2- 172.21.15.115:0/582176006 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fc44406cc50 0x7fc44406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:50.032 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:50.030+0000 7fc45a7fc640 1 --2- 172.21.15.115:0/582176006 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fc44406cc50 0x7fc44406f110 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc45c196e00 tx=0x7fc450008040 comp rx=0 tx=0).ready entity=mgr.14207 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:02:50.035 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:50.034+0000 7fc443fff640 1 -- 172.21.15.115:0/582176006 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc44c077700 con 0x7fc45c100d00 2024-09-13T17:02:50.200 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:50.198+0000 7fc4617bf640 1 -- 172.21.15.115:0/582176006 --> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc45c10cc70 con 0x7fc44406cc50 2024-09-13T17:02:50.200 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:50.199+0000 7fc443fff640 1 -- 172.21.15.115:0/582176006 <== mgr.14207 v2:172.21.15.115:6800/244039928 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+28098 (secure 0 0 0) 0x7fc45c10cc70 con 0x7fc44406cc50 2024-09-13T17:02:50.201 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:02:50.201 INFO:teuthology.orchestra.run.smithi115.stderr:dumped all 2024-09-13T17:02:50.203 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:50.202+0000 7fc4617bf640 1 -- 172.21.15.115:0/582176006 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fc44406cc50 msgr2=0x7fc44406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:50.203 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:50.202+0000 7fc4617bf640 1 --2- 172.21.15.115:0/582176006 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fc44406cc50 0x7fc44406f110 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc45c196e00 tx=0x7fc450008040 comp rx=0 tx=0).stop 2024-09-13T17:02:50.203 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:50.202+0000 7fc4617bf640 1 -- 172.21.15.115:0/582176006 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc45c100d00 msgr2=0x7fc45c19b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:50.203 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:50.202+0000 7fc4617bf640 1 --2- 172.21.15.115:0/582176006 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc45c100d00 0x7fc45c19b8a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc44c006010 tx=0x7fc44c02f890 comp rx=0 tx=0).stop 2024-09-13T17:02:50.204 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:50.202+0000 7fc4617bf640 1 -- 172.21.15.115:0/582176006 shutdown_connections 2024-09-13T17:02:50.204 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:50.202+0000 7fc4617bf640 1 --2- 172.21.15.115:0/582176006 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fc44406cc50 0x7fc44406f110 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:50.204 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:50.202+0000 7fc4617bf640 1 --2- 172.21.15.115:0/582176006 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc45c101620 0x7fc45c19bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:50.204 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:50.202+0000 7fc4617bf640 1 --2- 172.21.15.115:0/582176006 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc45c100d00 0x7fc45c19b8a0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:50.204 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:50.202+0000 7fc4617bf640 1 -- 172.21.15.115:0/582176006 >> 172.21.15.115:0/582176006 conn(0x7fc45c0758c0 msgr2=0x7fc45c101f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:02:50.204 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:50.202+0000 7fc4617bf640 1 -- 172.21.15.115:0/582176006 shutdown_connections 2024-09-13T17:02:50.204 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:50.202+0000 7fc4617bf640 1 -- 172.21.15.115:0/582176006 wait complete. 2024-09-13T17:02:50.559 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:02:50 smithi115 ceph-mon[27708]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:02:50.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:02:50 smithi195 ceph-mon[34981]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:02:50.900 INFO:teuthology.orchestra.run.smithi115.stdout:{"pg_ready":true,"pg_map":{"version":158,"stamp":"2024-09-13T17:02:49.217636+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":178292,"kb_used_data":3872,"kb_used_omap":9,"kb_used_meta":174326,"kb_avail":562292620,"statfs":{"total":575970213888,"available":575787642880,"internally_reserved":0,"allocated":3964928,"data_stored":2608497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9562,"internal_metadata":178510502},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001894"},"pg_stats":[{"pgid":"1.0","version":"23'117","reported_seq":186,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:01:57.282139+0000","last_change":"2024-09-13T17:01:31.946946+0000","last_active":"2024-09-13T17:01:57.282139+0000","last_peered":"2024-09-13T17:01:57.282139+0000","last_clean":"2024-09-13T17:01:57.282139+0000","last_became_active":"2024-09-13T17:01:31.946667+0000","last_became_peered":"2024-09-13T17:01:31.946667+0000","last_unstale":"2024-09-13T17:01:57.282139+0000","last_undegraded":"2024-09-13T17:01:57.282139+0000","last_fullsized":"2024-09-13T17:01:57.282139+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:00:47.472510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:00:47.472510+0000","last_clean_scrub_stamp":"2024-09-13T17:00:47.472510+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:01:31.029150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":39,"seq":167503724558,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27376,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717776,"statfs":{"total":95995035648,"available":95967002624,"internally_reserved":0,"allocated":364544,"data_stored":139677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]}]},{"osd":4,"up_from":34,"seq":146028888082,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27380,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717772,"statfs":{"total":95995035648,"available":95966998528,"internally_reserved":0,"allocated":364544,"data_stored":139677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:02:36 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.435},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.63,"5min":0.63,"15min":0.63},"last":0.52100000000000002}]},{"osd":1,"last update":"Fri Sep 13 17:02:36 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.48099999999999998}]},{"osd":2,"last update":"Fri Sep 13 17:02:36 2024","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.502},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.53600000000000003}]},{"osd":3,"last update":"Fri Sep 13 17:02:36 2024","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"last":0.318},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"last":0.35999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]}]},{"osd":3,"up_from":26,"seq":111669149720,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36156,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708996,"statfs":{"total":95995035648,"available":95958011904,"internally_reserved":0,"allocated":958464,"data_stored":730045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36043208},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:02:10 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.54400000000000004}]},{"osd":1,"last update":"Fri Sep 13 17:02:10 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.48899999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:02:10 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.47499999999999998}]},{"osd":4,"last update":"Fri Sep 13 17:02:34 2024","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.503},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.36599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]}]},{"osd":2,"up_from":19,"seq":81604378652,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":31468,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713684,"statfs":{"total":95995035648,"available":95962812416,"internally_reserved":0,"allocated":360448,"data_stored":139008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:01:46 2024","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"last":0.27800000000000002}]},{"osd":1,"last update":"Fri Sep 13 17:01:46 2024","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"last":0.24299999999999999},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"last":0.318}]},{"osd":3,"last update":"Fri Sep 13 17:02:09 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.498}]},{"osd":4,"last update":"Fri Sep 13 17:02:33 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":6.5549999999999997,"5min":6.5549999999999997,"15min":6.5549999999999997},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.45700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542178,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":958464,"data_stored":730045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:02:18 2024","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.309,"15min":0.30299999999999999},"min":{"1min":0.24199999999999999,"5min":0.218,"15min":0.218},"max":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.312,"15min":0.307},"min":{"1min":0.25900000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.35899999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:01:48 2024","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.505,"5min":0.505,"15min":0.505},"last":0.32100000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:02:11 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":2.806,"5min":2.806,"15min":2.806},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.69599999999999995}]},{"osd":4,"last update":"Fri Sep 13 17:02:37 2024","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.68200000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705703,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":958464,"data_stored":730045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:02:20 2024","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.315,"15min":0.313},"min":{"1min":0.22800000000000001,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.185},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.32500000000000001,"15min":0.32300000000000001},"min":{"1min":0.17999999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.33100000000000002}]},{"osd":2,"last update":"Fri Sep 13 17:01:52 2024","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.24099999999999999},{"interface":"front","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.30199999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:02:09 2024","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.378}]},{"osd":4,"last update":"Fri Sep 13 17:02:32 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.33900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:02:50.901 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-13T17:02:51.100 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T17:02:51.487 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:02:51 smithi115 ceph-mon[27708]: from='client.14416 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T17:02:51.698 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:02:51 smithi195 ceph-mon[34981]: from='client.14416 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T17:02:52.641 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:02:52 smithi115 ceph-mon[27708]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:02:52.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:02:52 smithi195 ceph-mon[34981]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:02:52.894 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:52.888+0000 7f08ec72e640 1 -- 172.21.15.115:0/2633835688 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08e41049a0 msgr2=0x7f08e4104d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:52.894 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:52.888+0000 7f08ec72e640 1 --2- 172.21.15.115:0/2633835688 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08e41049a0 0x7f08e4104d80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f08e0009880 tx=0x7f08e002a4a0 comp rx=0 tx=0).stop 2024-09-13T17:02:52.894 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:52.888+0000 7f08ec72e640 1 -- 172.21.15.115:0/2633835688 shutdown_connections 2024-09-13T17:02:52.895 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:52.888+0000 7f08ec72e640 1 --2- 172.21.15.115:0/2633835688 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f08e40fe9a0 0x7f08e40fee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:52.895 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:52.888+0000 7f08ec72e640 1 --2- 172.21.15.115:0/2633835688 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08e41049a0 0x7f08e4104d80 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:52.895 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:52.888+0000 7f08ec72e640 1 -- 172.21.15.115:0/2633835688 >> 172.21.15.115:0/2633835688 conn(0x7f08e40758c0 msgr2=0x7f08e40fcc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:02:52.895 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:52.888+0000 7f08ec72e640 1 -- 172.21.15.115:0/2633835688 shutdown_connections 2024-09-13T17:02:52.895 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:52.888+0000 7f08ec72e640 1 -- 172.21.15.115:0/2633835688 wait complete. 2024-09-13T17:02:52.895 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:52.888+0000 7f08ec72e640 1 Processor -- start 2024-09-13T17:02:52.895 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:52.888+0000 7f08ec72e640 1 -- start start 2024-09-13T17:02:52.895 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:52.889+0000 7f08ec72e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f08e40fe9a0 0x7f08e419a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:52.895 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:52.889+0000 7f08ec72e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08e41049a0 0x7f08e419acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:52.895 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:52.889+0000 7f08ec72e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e419b2f0 con 0x7f08e41049a0 2024-09-13T17:02:52.895 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:52.889+0000 7f08ec72e640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e41948d0 con 0x7f08e40fe9a0 2024-09-13T17:02:52.895 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:52.889+0000 7f08e9cc9640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08e41049a0 0x7f08e419acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:52.895 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:52.889+0000 7f08e9cc9640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08e41049a0 0x7f08e419acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:33536/0 (socket says 172.21.15.115:33536) 2024-09-13T17:02:52.896 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:52.889+0000 7f08e9cc9640 1 -- 172.21.15.115:0/228460219 learned_addr learned my addr 172.21.15.115:0/228460219 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:02:52.896 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:52.889+0000 7f08ea4ca640 1 --2- 172.21.15.115:0/228460219 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f08e40fe9a0 0x7f08e419a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:52.896 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:52.889+0000 7f08e9cc9640 1 -- 172.21.15.115:0/228460219 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f08e40fe9a0 msgr2=0x7f08e419a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:52.896 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:52.889+0000 7f08e9cc9640 1 --2- 172.21.15.115:0/228460219 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f08e40fe9a0 0x7f08e419a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:52.896 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:52.889+0000 7f08e9cc9640 1 -- 172.21.15.115:0/228460219 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08e0009560 con 0x7f08e41049a0 2024-09-13T17:02:52.896 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:52.889+0000 7f08ea4ca640 1 --2- 172.21.15.115:0/228460219 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f08e40fe9a0 0x7f08e419a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:02:52.896 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:52.889+0000 7f08e9cc9640 1 --2- 172.21.15.115:0/228460219 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08e41049a0 0x7f08e419acd0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f08d800b420 tx=0x7f08d800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:02:52.896 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:52.889+0000 7f08d77fe640 1 -- 172.21.15.115:0/228460219 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08d8011800 con 0x7f08e41049a0 2024-09-13T17:02:52.896 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:52.889+0000 7f08d77fe640 1 -- 172.21.15.115:0/228460219 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f08d8011e00 con 0x7f08e41049a0 2024-09-13T17:02:52.896 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:52.889+0000 7f08ec72e640 1 -- 172.21.15.115:0/228460219 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08e4194bb0 con 0x7f08e41049a0 2024-09-13T17:02:52.896 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:52.889+0000 7f08d77fe640 1 -- 172.21.15.115:0/228460219 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08d800f2e0 con 0x7f08e41049a0 2024-09-13T17:02:52.896 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:52.889+0000 7f08ec72e640 1 -- 172.21.15.115:0/228460219 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08e4195100 con 0x7f08e41049a0 2024-09-13T17:02:52.896 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:52.890+0000 7f08ec72e640 1 -- 172.21.15.115:0/228460219 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08e41000e0 con 0x7f08e41049a0 2024-09-13T17:02:52.897 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:52.891+0000 7f08d77fe640 1 -- 172.21.15.115:0/228460219 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f08d8010380 con 0x7f08e41049a0 2024-09-13T17:02:52.897 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:52.891+0000 7f08d77fe640 1 --2- 172.21.15.115:0/228460219 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f08d006cc50 0x7f08d006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:52.897 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:52.891+0000 7f08d77fe640 1 -- 172.21.15.115:0/228460219 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f08d808b8c0 con 0x7f08e41049a0 2024-09-13T17:02:52.897 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:52.891+0000 7f08ea4ca640 1 --2- 172.21.15.115:0/228460219 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f08d006cc50 0x7f08d006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:52.897 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:52.892+0000 7f08ea4ca640 1 --2- 172.21.15.115:0/228460219 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f08d006cc50 0x7f08d006f110 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f08e0005ab0 tx=0x7f08e0005a20 comp rx=0 tx=0).ready entity=mgr.14207 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:02:52.897 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:52.896+0000 7f08d77fe640 1 -- 172.21.15.115:0/228460219 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f08d8055fd0 con 0x7f08e41049a0 2024-09-13T17:02:53.057 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:53.055+0000 7f08ec72e640 1 -- 172.21.15.115:0/228460219 --> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f08e410bb50 con 0x7f08d006cc50 2024-09-13T17:02:53.058 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:53.057+0000 7f08d77fe640 1 -- 172.21.15.115:0/228460219 <== mgr.14207 v2:172.21.15.115:6800/244039928 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+28112 (secure 0 0 0) 0x7f08e410bb50 con 0x7f08d006cc50 2024-09-13T17:02:53.058 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:02:53.059 INFO:teuthology.orchestra.run.smithi115.stderr:dumped all 2024-09-13T17:02:53.060 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:53.059+0000 7f08ec72e640 1 -- 172.21.15.115:0/228460219 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f08d006cc50 msgr2=0x7f08d006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:53.060 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:53.059+0000 7f08ec72e640 1 --2- 172.21.15.115:0/228460219 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f08d006cc50 0x7f08d006f110 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f08e0005ab0 tx=0x7f08e0005a20 comp rx=0 tx=0).stop 2024-09-13T17:02:53.060 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:53.059+0000 7f08ec72e640 1 -- 172.21.15.115:0/228460219 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08e41049a0 msgr2=0x7f08e419acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:53.061 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:53.059+0000 7f08ec72e640 1 --2- 172.21.15.115:0/228460219 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08e41049a0 0x7f08e419acd0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f08d800b420 tx=0x7f08d800b8e0 comp rx=0 tx=0).stop 2024-09-13T17:02:53.061 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:53.059+0000 7f08ec72e640 1 -- 172.21.15.115:0/228460219 shutdown_connections 2024-09-13T17:02:53.061 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:53.059+0000 7f08ec72e640 1 --2- 172.21.15.115:0/228460219 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f08d006cc50 0x7f08d006f110 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:53.061 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:53.059+0000 7f08ec72e640 1 --2- 172.21.15.115:0/228460219 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08e41049a0 0x7f08e419acd0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:53.061 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:53.059+0000 7f08ec72e640 1 --2- 172.21.15.115:0/228460219 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f08e40fe9a0 0x7f08e419a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:53.061 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:53.059+0000 7f08ec72e640 1 -- 172.21.15.115:0/228460219 >> 172.21.15.115:0/228460219 conn(0x7f08e40758c0 msgr2=0x7f08e40fcc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:02:53.061 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:53.059+0000 7f08ec72e640 1 -- 172.21.15.115:0/228460219 shutdown_connections 2024-09-13T17:02:53.061 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:53.059+0000 7f08ec72e640 1 -- 172.21.15.115:0/228460219 wait complete. 2024-09-13T17:02:53.703 INFO:teuthology.orchestra.run.smithi115.stdout:{"pg_ready":true,"pg_map":{"version":159,"stamp":"2024-09-13T17:02:51.218089+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":178292,"kb_used_data":3872,"kb_used_omap":9,"kb_used_meta":174326,"kb_avail":562292620,"statfs":{"total":575970213888,"available":575787642880,"internally_reserved":0,"allocated":3964928,"data_stored":2608497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9562,"internal_metadata":178510502},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002052"},"pg_stats":[{"pgid":"1.0","version":"23'117","reported_seq":186,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:01:57.282139+0000","last_change":"2024-09-13T17:01:31.946946+0000","last_active":"2024-09-13T17:01:57.282139+0000","last_peered":"2024-09-13T17:01:57.282139+0000","last_clean":"2024-09-13T17:01:57.282139+0000","last_became_active":"2024-09-13T17:01:31.946667+0000","last_became_peered":"2024-09-13T17:01:31.946667+0000","last_unstale":"2024-09-13T17:01:57.282139+0000","last_undegraded":"2024-09-13T17:01:57.282139+0000","last_fullsized":"2024-09-13T17:01:57.282139+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:00:47.472510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:00:47.472510+0000","last_clean_scrub_stamp":"2024-09-13T17:00:47.472510+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:01:31.029150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":39,"seq":167503724558,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27376,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717776,"statfs":{"total":95995035648,"available":95967002624,"internally_reserved":0,"allocated":364544,"data_stored":139677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]}]},{"osd":4,"up_from":34,"seq":146028888082,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27380,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717772,"statfs":{"total":95995035648,"available":95966998528,"internally_reserved":0,"allocated":364544,"data_stored":139677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:02:36 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.435},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.63,"5min":0.63,"15min":0.63},"last":0.52100000000000002}]},{"osd":1,"last update":"Fri Sep 13 17:02:36 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.48099999999999998}]},{"osd":2,"last update":"Fri Sep 13 17:02:36 2024","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.502},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.53600000000000003}]},{"osd":3,"last update":"Fri Sep 13 17:02:36 2024","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"last":0.318},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"last":0.35999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]}]},{"osd":3,"up_from":26,"seq":111669149720,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36156,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708996,"statfs":{"total":95995035648,"available":95958011904,"internally_reserved":0,"allocated":958464,"data_stored":730045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36043208},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:02:10 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.54400000000000004}]},{"osd":1,"last update":"Fri Sep 13 17:02:10 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.48899999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:02:10 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.47499999999999998}]},{"osd":4,"last update":"Fri Sep 13 17:02:34 2024","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.503},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.36599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]}]},{"osd":2,"up_from":19,"seq":81604378652,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":31468,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713684,"statfs":{"total":95995035648,"available":95962812416,"internally_reserved":0,"allocated":360448,"data_stored":139008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:01:46 2024","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"last":0.27800000000000002}]},{"osd":1,"last update":"Fri Sep 13 17:01:46 2024","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"last":0.24299999999999999},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"last":0.318}]},{"osd":3,"last update":"Fri Sep 13 17:02:09 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.498}]},{"osd":4,"last update":"Fri Sep 13 17:02:33 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":6.5549999999999997,"5min":6.5549999999999997,"15min":6.5549999999999997},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.45700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542178,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":958464,"data_stored":730045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:02:18 2024","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.309,"15min":0.30299999999999999},"min":{"1min":0.24199999999999999,"5min":0.218,"15min":0.218},"max":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.312,"15min":0.307},"min":{"1min":0.25900000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.35899999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:01:48 2024","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.505,"5min":0.505,"15min":0.505},"last":0.32100000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:02:11 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":2.806,"5min":2.806,"15min":2.806},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.69599999999999995}]},{"osd":4,"last update":"Fri Sep 13 17:02:37 2024","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.68200000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705704,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":958464,"data_stored":730045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:02:20 2024","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.315,"15min":0.313},"min":{"1min":0.22800000000000001,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.23000000000000001},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.32500000000000001,"15min":0.32300000000000001},"min":{"1min":0.17999999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.27900000000000003}]},{"osd":2,"last update":"Fri Sep 13 17:01:52 2024","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.313}]},{"osd":3,"last update":"Fri Sep 13 17:02:09 2024","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.48699999999999999}]},{"osd":4,"last update":"Fri Sep 13 17:02:32 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.41999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:02:53.704 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-13T17:02:53.704 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-13T17:02:53.704 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-13T17:02:53.704 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -- ceph health --format=json 2024-09-13T17:02:53.901 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T17:02:54.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:02:54 smithi115 ceph-mon[27708]: from='client.14420 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T17:02:54.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:02:54 smithi115 ceph-mon[27708]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:02:54.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:02:54 smithi195 ceph-mon[34981]: from='client.14420 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T17:02:54.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:02:54 smithi195 ceph-mon[34981]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:02:55.737 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:55.712+0000 7fed49867640 1 -- 172.21.15.115:0/2563312295 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed440feaa0 msgr2=0x7fed440fef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:55.737 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:55.712+0000 7fed49867640 1 --2- 172.21.15.115:0/2563312295 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed440feaa0 0x7fed440fef00 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fed2c009880 tx=0x7fed2c02a4a0 comp rx=0 tx=0).stop 2024-09-13T17:02:55.737 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:55.712+0000 7fed49867640 1 -- 172.21.15.115:0/2563312295 shutdown_connections 2024-09-13T17:02:55.737 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:55.712+0000 7fed49867640 1 --2- 172.21.15.115:0/2563312295 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed440feaa0 0x7fed440fef00 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:55.738 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:55.712+0000 7fed49867640 1 --2- 172.21.15.115:0/2563312295 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed44104aa0 0x7fed44104e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:55.738 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:55.712+0000 7fed49867640 1 -- 172.21.15.115:0/2563312295 >> 172.21.15.115:0/2563312295 conn(0x7fed440fa780 msgr2=0x7fed440fcba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:02:55.738 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:55.712+0000 7fed49867640 1 -- 172.21.15.115:0/2563312295 shutdown_connections 2024-09-13T17:02:55.738 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:55.712+0000 7fed49867640 1 -- 172.21.15.115:0/2563312295 wait complete. 2024-09-13T17:02:55.738 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:55.713+0000 7fed49867640 1 Processor -- start 2024-09-13T17:02:55.738 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:55.713+0000 7fed49867640 1 -- start start 2024-09-13T17:02:55.738 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:55.713+0000 7fed49867640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed440feaa0 0x7fed4419a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:55.738 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:55.713+0000 7fed49867640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed44104aa0 0x7fed4419ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:55.738 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:55.713+0000 7fed49867640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed4419b270 con 0x7fed44104aa0 2024-09-13T17:02:55.738 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:55.713+0000 7fed49867640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed441947d0 con 0x7fed440feaa0 2024-09-13T17:02:55.738 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:55.713+0000 7fed3a7fc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed44104aa0 0x7fed4419ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:55.738 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:55.713+0000 7fed3a7fc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed44104aa0 0x7fed4419ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:46686/0 (socket says 172.21.15.115:46686) 2024-09-13T17:02:55.738 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:55.713+0000 7fed3a7fc640 1 -- 172.21.15.115:0/83224474 learned_addr learned my addr 172.21.15.115:0/83224474 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:02:55.739 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:55.714+0000 7fed42ffd640 1 --2- 172.21.15.115:0/83224474 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed440feaa0 0x7fed4419a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:55.739 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:55.714+0000 7fed3a7fc640 1 -- 172.21.15.115:0/83224474 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed440feaa0 msgr2=0x7fed4419a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:55.739 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:55.714+0000 7fed3a7fc640 1 --2- 172.21.15.115:0/83224474 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed440feaa0 0x7fed4419a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:55.739 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:55.714+0000 7fed3a7fc640 1 -- 172.21.15.115:0/83224474 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed2c009560 con 0x7fed44104aa0 2024-09-13T17:02:55.739 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:55.714+0000 7fed42ffd640 1 --2- 172.21.15.115:0/83224474 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed440feaa0 0x7fed4419a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:02:55.739 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:55.714+0000 7fed3a7fc640 1 --2- 172.21.15.115:0/83224474 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed44104aa0 0x7fed4419ac20 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fed2c006010 tx=0x7fed2c0056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:02:55.739 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:55.714+0000 7fed48865640 1 -- 172.21.15.115:0/83224474 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed2c004ba0 con 0x7fed44104aa0 2024-09-13T17:02:55.739 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:55.714+0000 7fed49867640 1 -- 172.21.15.115:0/83224474 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed44194a50 con 0x7fed44104aa0 2024-09-13T17:02:55.739 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:55.714+0000 7fed48865640 1 -- 172.21.15.115:0/83224474 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fed2c004d00 con 0x7fed44104aa0 2024-09-13T17:02:55.739 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:55.714+0000 7fed48865640 1 -- 172.21.15.115:0/83224474 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed2c031910 con 0x7fed44104aa0 2024-09-13T17:02:55.740 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:55.714+0000 7fed49867640 1 -- 172.21.15.115:0/83224474 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed44194f40 con 0x7fed44104aa0 2024-09-13T17:02:55.740 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:55.715+0000 7fed49867640 1 -- 172.21.15.115:0/83224474 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed441001e0 con 0x7fed44104aa0 2024-09-13T17:02:55.740 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:55.716+0000 7fed48865640 1 -- 172.21.15.115:0/83224474 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fed2c031ba0 con 0x7fed44104aa0 2024-09-13T17:02:55.740 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:55.716+0000 7fed48865640 1 --2- 172.21.15.115:0/83224474 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fed3006cc50 0x7fed3006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:55.740 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:55.716+0000 7fed48865640 1 -- 172.21.15.115:0/83224474 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fed2c0ad160 con 0x7fed44104aa0 2024-09-13T17:02:55.740 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:55.716+0000 7fed42ffd640 1 --2- 172.21.15.115:0/83224474 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fed3006cc50 0x7fed3006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:55.740 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:55.717+0000 7fed42ffd640 1 --2- 172.21.15.115:0/83224474 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fed3006cc50 0x7fed3006f110 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fed3400baa0 tx=0x7fed34005d90 comp rx=0 tx=0).ready entity=mgr.14207 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:02:55.740 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:55.720+0000 7fed48865640 1 -- 172.21.15.115:0/83224474 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fed2c077870 con 0x7fed44104aa0 2024-09-13T17:02:55.919 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:55.917+0000 7fed49867640 1 -- 172.21.15.115:0/83224474 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fed441070d0 con 0x7fed44104aa0 2024-09-13T17:02:55.919 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:55.918+0000 7fed48865640 1 -- 172.21.15.115:0/83224474 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fed2c07ae90 con 0x7fed44104aa0 2024-09-13T17:02:55.919 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:02:55.920 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-13T17:02:55.921 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:55.920+0000 7fed49867640 1 -- 172.21.15.115:0/83224474 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fed3006cc50 msgr2=0x7fed3006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:55.922 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:55.920+0000 7fed49867640 1 --2- 172.21.15.115:0/83224474 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fed3006cc50 0x7fed3006f110 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fed3400baa0 tx=0x7fed34005d90 comp rx=0 tx=0).stop 2024-09-13T17:02:55.922 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:55.920+0000 7fed49867640 1 -- 172.21.15.115:0/83224474 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed44104aa0 msgr2=0x7fed4419ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:55.922 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:55.920+0000 7fed49867640 1 --2- 172.21.15.115:0/83224474 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed44104aa0 0x7fed4419ac20 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fed2c006010 tx=0x7fed2c0056e0 comp rx=0 tx=0).stop 2024-09-13T17:02:55.922 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:55.920+0000 7fed49867640 1 -- 172.21.15.115:0/83224474 shutdown_connections 2024-09-13T17:02:55.922 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:55.920+0000 7fed49867640 1 --2- 172.21.15.115:0/83224474 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fed3006cc50 0x7fed3006f110 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:55.922 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:55.920+0000 7fed49867640 1 --2- 172.21.15.115:0/83224474 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed44104aa0 0x7fed4419ac20 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:55.922 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:55.920+0000 7fed49867640 1 --2- 172.21.15.115:0/83224474 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed440feaa0 0x7fed4419a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:55.922 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:55.920+0000 7fed49867640 1 -- 172.21.15.115:0/83224474 >> 172.21.15.115:0/83224474 conn(0x7fed440fa780 msgr2=0x7fed440fb550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:02:55.922 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:55.920+0000 7fed49867640 1 -- 172.21.15.115:0/83224474 shutdown_connections 2024-09-13T17:02:55.922 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:55.920+0000 7fed49867640 1 -- 172.21.15.115:0/83224474 wait complete. 2024-09-13T17:02:56.556 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:02:56 smithi115 ceph-mon[27708]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:02:56.556 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:02:56 smithi115 ceph-mon[27708]: from='client.? 172.21.15.115:0/83224474' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-13T17:02:56.578 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-13T17:02:56.579 INFO:tasks.cephadm:Setup complete, yielding 2024-09-13T17:02:56.579 INFO:teuthology.run_tasks:Running task print... 2024-09-13T17:02:56.588 INFO:teuthology.task.print:**** done end installing reef cephadm ... 2024-09-13T17:02:56.588 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T17:02:56.597 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi115.front.sepia.ceph.com 2024-09-13T17:02:56.599 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2024-09-13T17:02:56.758 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:02:56 smithi195 ceph-mon[34981]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:02:56.758 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:02:56 smithi195 ceph-mon[34981]: from='client.? 172.21.15.115:0/83224474' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-13T17:02:56.798 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T17:02:58.483 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:02:58 smithi115 ceph-mon[27708]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:02:58.570 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:58.569+0000 7f53bbd1d640 1 -- 172.21.15.115:0/3021724515 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f53b4100d70 msgr2=0x7f53b41011f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:58.571 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:58.569+0000 7f53bbd1d640 1 --2- 172.21.15.115:0/3021724515 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f53b4100d70 0x7f53b41011f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f53a4009880 tx=0x7f53a402a4a0 comp rx=0 tx=0).stop 2024-09-13T17:02:58.571 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:58.569+0000 7f53bbd1d640 1 -- 172.21.15.115:0/3021724515 shutdown_connections 2024-09-13T17:02:58.571 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:58.569+0000 7f53bbd1d640 1 --2- 172.21.15.115:0/3021724515 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f53b4100d70 0x7f53b41011f0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:58.571 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:58.569+0000 7f53bbd1d640 1 --2- 172.21.15.115:0/3021724515 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f53b40ffb70 0x7f53b40fff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:58.571 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:58.569+0000 7f53bbd1d640 1 -- 172.21.15.115:0/3021724515 >> 172.21.15.115:0/3021724515 conn(0x7f53b40fb2e0 msgr2=0x7f53b40fd740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:02:58.571 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:58.569+0000 7f53bbd1d640 1 -- 172.21.15.115:0/3021724515 shutdown_connections 2024-09-13T17:02:58.571 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:58.569+0000 7f53bbd1d640 1 -- 172.21.15.115:0/3021724515 wait complete. 2024-09-13T17:02:58.571 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:58.569+0000 7f53bbd1d640 1 Processor -- start 2024-09-13T17:02:58.571 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:58.570+0000 7f53bbd1d640 1 -- start start 2024-09-13T17:02:58.573 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:58.570+0000 7f53bbd1d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f53b40ffb70 0x7f53b4195530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:58.573 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:58.570+0000 7f53bbd1d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f53b4100d70 0x7f53b4195a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:58.573 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:58.570+0000 7f53bbd1d640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53b4196040 con 0x7f53b4100d70 2024-09-13T17:02:58.573 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:58.570+0000 7f53bbd1d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53b41961b0 con 0x7f53b40ffb70 2024-09-13T17:02:58.573 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:58.570+0000 7f53b92b8640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f53b4100d70 0x7f53b4195a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:58.573 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:58.570+0000 7f53b92b8640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f53b4100d70 0x7f53b4195a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:46710/0 (socket says 172.21.15.115:46710) 2024-09-13T17:02:58.573 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:58.570+0000 7f53b92b8640 1 -- 172.21.15.115:0/1018743796 learned_addr learned my addr 172.21.15.115:0/1018743796 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:02:58.573 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:58.570+0000 7f53b9ab9640 1 --2- 172.21.15.115:0/1018743796 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f53b40ffb70 0x7f53b4195530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:58.573 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:58.570+0000 7f53b92b8640 1 -- 172.21.15.115:0/1018743796 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f53b40ffb70 msgr2=0x7f53b4195530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:58.573 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:58.570+0000 7f53b92b8640 1 --2- 172.21.15.115:0/1018743796 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f53b40ffb70 0x7f53b4195530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:58.574 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:58.570+0000 7f53b92b8640 1 -- 172.21.15.115:0/1018743796 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53a4009560 con 0x7f53b4100d70 2024-09-13T17:02:58.574 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:58.570+0000 7f53b9ab9640 1 --2- 172.21.15.115:0/1018743796 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f53b40ffb70 0x7f53b4195530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:02:58.574 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:58.570+0000 7f53b92b8640 1 --2- 172.21.15.115:0/1018743796 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f53b4100d70 0x7f53b4195a70 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f53a4006010 tx=0x7f53a40056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:02:58.574 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:58.570+0000 7f53aaffd640 1 -- 172.21.15.115:0/1018743796 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f53a4004c60 con 0x7f53b4100d70 2024-09-13T17:02:58.574 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:58.570+0000 7f53bbd1d640 1 -- 172.21.15.115:0/1018743796 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53b419abf0 con 0x7f53b4100d70 2024-09-13T17:02:58.574 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:58.570+0000 7f53aaffd640 1 -- 172.21.15.115:0/1018743796 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f53a4031a00 con 0x7f53b4100d70 2024-09-13T17:02:58.574 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:58.571+0000 7f53aaffd640 1 -- 172.21.15.115:0/1018743796 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f53a4003bc0 con 0x7f53b4100d70 2024-09-13T17:02:58.574 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:58.571+0000 7f53bbd1d640 1 -- 172.21.15.115:0/1018743796 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53b419b160 con 0x7f53b4100d70 2024-09-13T17:02:58.574 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:58.572+0000 7f53bbd1d640 1 -- 172.21.15.115:0/1018743796 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53b4108640 con 0x7f53b4100d70 2024-09-13T17:02:58.575 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:58.572+0000 7f53aaffd640 1 -- 172.21.15.115:0/1018743796 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f53a4003df0 con 0x7f53b4100d70 2024-09-13T17:02:58.575 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:58.572+0000 7f53aaffd640 1 --2- 172.21.15.115:0/1018743796 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f53a006cc50 0x7f53a006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:02:58.575 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:58.573+0000 7f53aaffd640 1 -- 172.21.15.115:0/1018743796 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f53a40ad1d0 con 0x7f53b4100d70 2024-09-13T17:02:58.575 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:58.573+0000 7f53b9ab9640 1 --2- 172.21.15.115:0/1018743796 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f53a006cc50 0x7f53a006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:02:58.575 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:58.573+0000 7f53b9ab9640 1 --2- 172.21.15.115:0/1018743796 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f53a006cc50 0x7f53a006f110 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f53b00058c0 tx=0x7f53b0005ec0 comp rx=0 tx=0).ready entity=mgr.14207 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:02:58.578 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:58.577+0000 7f53aaffd640 1 -- 172.21.15.115:0/1018743796 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f53a40778e0 con 0x7f53b4100d70 2024-09-13T17:02:58.741 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:58.739+0000 7f53bbd1d640 1 -- 172.21.15.115:0/1018743796 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) v1 -- 0x7f53b419b350 con 0x7f53b4100d70 2024-09-13T17:02:58.745 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:58.744+0000 7f53aaffd640 1 -- 172.21.15.115:0/1018743796 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v22)=0 v22) v1 ==== 143+0+0 (secure 0 0 0) 0x7f53a407af00 con 0x7f53b4100d70 2024-09-13T17:02:58.748 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:58.746+0000 7f53bbd1d640 1 -- 172.21.15.115:0/1018743796 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f53a006cc50 msgr2=0x7f53a006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:58.748 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:58.746+0000 7f53bbd1d640 1 --2- 172.21.15.115:0/1018743796 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f53a006cc50 0x7f53a006f110 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f53b00058c0 tx=0x7f53b0005ec0 comp rx=0 tx=0).stop 2024-09-13T17:02:58.748 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:58.746+0000 7f53bbd1d640 1 -- 172.21.15.115:0/1018743796 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f53b4100d70 msgr2=0x7f53b4195a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:02:58.748 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:58.746+0000 7f53bbd1d640 1 --2- 172.21.15.115:0/1018743796 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f53b4100d70 0x7f53b4195a70 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f53a4006010 tx=0x7f53a40056e0 comp rx=0 tx=0).stop 2024-09-13T17:02:58.748 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:58.746+0000 7f53bbd1d640 1 -- 172.21.15.115:0/1018743796 shutdown_connections 2024-09-13T17:02:58.748 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:58.746+0000 7f53bbd1d640 1 --2- 172.21.15.115:0/1018743796 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f53a006cc50 0x7f53a006f110 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:58.748 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:58.746+0000 7f53bbd1d640 1 --2- 172.21.15.115:0/1018743796 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f53b4100d70 0x7f53b4195a70 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:58.748 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:58.746+0000 7f53bbd1d640 1 --2- 172.21.15.115:0/1018743796 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f53b40ffb70 0x7f53b4195530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:02:58.748 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:58.746+0000 7f53bbd1d640 1 -- 172.21.15.115:0/1018743796 >> 172.21.15.115:0/1018743796 conn(0x7f53b40fb2e0 msgr2=0x7f53b4103fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:02:58.748 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:58.746+0000 7f53bbd1d640 1 -- 172.21.15.115:0/1018743796 shutdown_connections 2024-09-13T17:02:58.749 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:02:58.746+0000 7f53bbd1d640 1 -- 172.21.15.115:0/1018743796 wait complete. 2024-09-13T17:02:58.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:02:58 smithi195 ceph-mon[34981]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:02:59.435 INFO:teuthology.run_tasks:Running task print... 2024-09-13T17:02:59.448 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2024-09-13T17:02:59.448 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T17:02:59.462 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi115.front.sepia.ceph.com 2024-09-13T17:02:59.462 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -- bash -c 'ceph orch status' 2024-09-13T17:02:59.666 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T17:03:00.033 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:02:59 smithi115 ceph-mon[27708]: from='client.? 172.21.15.115:0/1018743796' entity='client.admin' 2024-09-13T17:03:00.033 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:02:59 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:03:00.033 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:02:59 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:03:00.034 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:02:59 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:03:00.034 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:02:59 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:03:00.034 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:02:59 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:03:00.034 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:02:59 smithi115 ceph-mon[27708]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:03:00.076 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:02:59 smithi195 ceph-mon[34981]: from='client.? 172.21.15.115:0/1018743796' entity='client.admin' 2024-09-13T17:03:00.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:02:59 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:03:00.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:02:59 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:03:00.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:02:59 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:03:00.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:02:59 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:03:00.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:02:59 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:03:00.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:02:59 smithi195 ceph-mon[34981]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:03:01.223 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:01.220+0000 7f8d0df05640 1 -- 172.21.15.115:0/1105139740 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8d080fea80 msgr2=0x7f8d080fee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:01.224 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:01.220+0000 7f8d0df05640 1 --2- 172.21.15.115:0/1105139740 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8d080fea80 0x7f8d080fee80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8cf8009880 tx=0x7f8cf802a4a0 comp rx=0 tx=0).stop 2024-09-13T17:03:01.224 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:01.220+0000 7f8d0df05640 1 -- 172.21.15.115:0/1105139740 shutdown_connections 2024-09-13T17:03:01.224 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:01.220+0000 7f8d0df05640 1 --2- 172.21.15.115:0/1105139740 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8d080ffc80 0x7f8d08100100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:01.224 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:01.220+0000 7f8d0df05640 1 --2- 172.21.15.115:0/1105139740 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8d080fea80 0x7f8d080fee80 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:01.224 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:01.220+0000 7f8d0df05640 1 -- 172.21.15.115:0/1105139740 >> 172.21.15.115:0/1105139740 conn(0x7f8d080fa230 msgr2=0x7f8d080fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:03:01.224 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:01.220+0000 7f8d0df05640 1 -- 172.21.15.115:0/1105139740 shutdown_connections 2024-09-13T17:03:01.224 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:01.220+0000 7f8d0df05640 1 -- 172.21.15.115:0/1105139740 wait complete. 2024-09-13T17:03:01.224 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:01.220+0000 7f8d0df05640 1 Processor -- start 2024-09-13T17:03:01.224 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:01.220+0000 7f8d0df05640 1 -- start start 2024-09-13T17:03:01.224 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:01.221+0000 7f8d0df05640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8d080fea80 0x7f8d081945a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:03:01.225 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:01.221+0000 7f8d0df05640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8d080ffc80 0x7f8d08194ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:03:01.225 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:01.221+0000 7f8d0df05640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d081950b0 con 0x7f8d080ffc80 2024-09-13T17:03:01.225 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:01.221+0000 7f8d0df05640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d08195220 con 0x7f8d080fea80 2024-09-13T17:03:01.225 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:01.221+0000 7f8d06ffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8d080ffc80 0x7f8d08194ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:03:01.225 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:01.221+0000 7f8d06ffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8d080ffc80 0x7f8d08194ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:46728/0 (socket says 172.21.15.115:46728) 2024-09-13T17:03:01.225 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:01.221+0000 7f8d06ffd640 1 -- 172.21.15.115:0/362212827 learned_addr learned my addr 172.21.15.115:0/362212827 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:03:01.225 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:01.221+0000 7f8d077fe640 1 --2- 172.21.15.115:0/362212827 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8d080fea80 0x7f8d081945a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:03:01.225 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:01.221+0000 7f8d06ffd640 1 -- 172.21.15.115:0/362212827 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8d080fea80 msgr2=0x7f8d081945a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:01.225 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:01.221+0000 7f8d06ffd640 1 --2- 172.21.15.115:0/362212827 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8d080fea80 0x7f8d081945a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:01.225 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:01.221+0000 7f8d06ffd640 1 -- 172.21.15.115:0/362212827 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cf8009560 con 0x7f8d080ffc80 2024-09-13T17:03:01.225 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:01.221+0000 7f8d077fe640 1 --2- 172.21.15.115:0/362212827 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8d080fea80 0x7f8d081945a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:03:01.225 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:01.221+0000 7f8d06ffd640 1 --2- 172.21.15.115:0/362212827 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8d080ffc80 0x7f8d08194ae0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8cfc00b450 tx=0x7f8cfc00b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:03:01.226 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:01.221+0000 7f8d04ff9640 1 -- 172.21.15.115:0/362212827 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8cfc011860 con 0x7f8d080ffc80 2024-09-13T17:03:01.226 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:01.221+0000 7f8d0df05640 1 -- 172.21.15.115:0/362212827 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d08199c50 con 0x7f8d080ffc80 2024-09-13T17:03:01.226 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:01.221+0000 7f8d04ff9640 1 -- 172.21.15.115:0/362212827 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8cfc011e60 con 0x7f8d080ffc80 2024-09-13T17:03:01.226 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:01.221+0000 7f8d04ff9640 1 -- 172.21.15.115:0/362212827 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8cfc00f340 con 0x7f8d080ffc80 2024-09-13T17:03:01.226 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:01.221+0000 7f8d0df05640 1 -- 172.21.15.115:0/362212827 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d0819a220 con 0x7f8d080ffc80 2024-09-13T17:03:01.226 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:01.222+0000 7f8d0df05640 1 -- 172.21.15.115:0/362212827 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d081075b0 con 0x7f8d080ffc80 2024-09-13T17:03:01.227 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:01.223+0000 7f8d04ff9640 1 -- 172.21.15.115:0/362212827 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f8cfc0103e0 con 0x7f8d080ffc80 2024-09-13T17:03:01.227 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:01.223+0000 7f8d04ff9640 1 --2- 172.21.15.115:0/362212827 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f8cf006cc50 0x7f8cf006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:03:01.227 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:01.223+0000 7f8d04ff9640 1 -- 172.21.15.115:0/362212827 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f8cfc08be20 con 0x7f8d080ffc80 2024-09-13T17:03:01.227 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:01.223+0000 7f8d077fe640 1 --2- 172.21.15.115:0/362212827 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f8cf006cc50 0x7f8cf006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:03:01.227 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:01.224+0000 7f8d077fe640 1 --2- 172.21.15.115:0/362212827 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f8cf006cc50 0x7f8cf006f110 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8cf8031460 tx=0x7f8cf8005de0 comp rx=0 tx=0).ready entity=mgr.14207 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:03:01.229 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:01.228+0000 7f8d04ff9640 1 -- 172.21.15.115:0/362212827 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f8cfc056530 con 0x7f8d080ffc80 2024-09-13T17:03:01.404 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:01.403+0000 7f8d0df05640 1 -- 172.21.15.115:0/362212827 --> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8d081045d0 con 0x7f8cf006cc50 2024-09-13T17:03:01.405 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:01.404+0000 7f8d04ff9640 1 -- 172.21.15.115:0/362212827 <== mgr.14207 v2:172.21.15.115:6800/244039928 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f8d081045d0 con 0x7f8cf006cc50 2024-09-13T17:03:01.405 INFO:teuthology.orchestra.run.smithi115.stdout:Backend: cephadm 2024-09-13T17:03:01.405 INFO:teuthology.orchestra.run.smithi115.stdout:Available: Yes 2024-09-13T17:03:01.405 INFO:teuthology.orchestra.run.smithi115.stdout:Paused: No 2024-09-13T17:03:01.407 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:01.406+0000 7f8d0df05640 1 -- 172.21.15.115:0/362212827 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f8cf006cc50 msgr2=0x7f8cf006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:01.407 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:01.406+0000 7f8d0df05640 1 --2- 172.21.15.115:0/362212827 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f8cf006cc50 0x7f8cf006f110 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8cf8031460 tx=0x7f8cf8005de0 comp rx=0 tx=0).stop 2024-09-13T17:03:01.407 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:01.406+0000 7f8d0df05640 1 -- 172.21.15.115:0/362212827 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8d080ffc80 msgr2=0x7f8d08194ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:01.407 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:01.406+0000 7f8d0df05640 1 --2- 172.21.15.115:0/362212827 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8d080ffc80 0x7f8d08194ae0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8cfc00b450 tx=0x7f8cfc00b910 comp rx=0 tx=0).stop 2024-09-13T17:03:01.407 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:01.406+0000 7f8d0df05640 1 -- 172.21.15.115:0/362212827 shutdown_connections 2024-09-13T17:03:01.407 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:01.406+0000 7f8d0df05640 1 --2- 172.21.15.115:0/362212827 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f8cf006cc50 0x7f8cf006f110 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:01.407 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:01.406+0000 7f8d0df05640 1 --2- 172.21.15.115:0/362212827 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8d080ffc80 0x7f8d08194ae0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:01.407 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:01.406+0000 7f8d0df05640 1 --2- 172.21.15.115:0/362212827 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8d080fea80 0x7f8d081945a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:01.407 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:01.406+0000 7f8d0df05640 1 -- 172.21.15.115:0/362212827 >> 172.21.15.115:0/362212827 conn(0x7f8d080fa230 msgr2=0x7f8d08102eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:03:01.408 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:01.406+0000 7f8d0df05640 1 -- 172.21.15.115:0/362212827 shutdown_connections 2024-09-13T17:03:01.408 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:01.406+0000 7f8d0df05640 1 -- 172.21.15.115:0/362212827 wait complete. 2024-09-13T17:03:02.106 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-13T17:03:02.304 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T17:03:02.424 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:02 smithi115 ceph-mon[27708]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:03:02.424 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:02 smithi115 ceph-mon[27708]: from='client.14432 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:03:02.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:02 smithi195 ceph-mon[34981]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:03:02.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:02 smithi195 ceph-mon[34981]: from='client.14432 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:03:03.904 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:03.901+0000 7f3f955bf640 1 -- 172.21.15.115:0/2238154967 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3f900ffc30 msgr2=0x7f3f901000b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:03.904 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:03.901+0000 7f3f955bf640 1 --2- 172.21.15.115:0/2238154967 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3f900ffc30 0x7f3f901000b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3f78009880 tx=0x7f3f7802a4a0 comp rx=0 tx=0).stop 2024-09-13T17:03:03.905 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:03.901+0000 7f3f955bf640 1 -- 172.21.15.115:0/2238154967 shutdown_connections 2024-09-13T17:03:03.905 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:03.901+0000 7f3f955bf640 1 --2- 172.21.15.115:0/2238154967 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3f900ffc30 0x7f3f901000b0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:03.905 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:03.901+0000 7f3f955bf640 1 --2- 172.21.15.115:0/2238154967 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f900fea30 0x7f3f900fee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:03.905 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:03.901+0000 7f3f955bf640 1 -- 172.21.15.115:0/2238154967 >> 172.21.15.115:0/2238154967 conn(0x7f3f900fa1c0 msgr2=0x7f3f900fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:03:03.905 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:03.901+0000 7f3f955bf640 1 -- 172.21.15.115:0/2238154967 shutdown_connections 2024-09-13T17:03:03.905 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:03.901+0000 7f3f955bf640 1 -- 172.21.15.115:0/2238154967 wait complete. 2024-09-13T17:03:03.905 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:03.901+0000 7f3f955bf640 1 Processor -- start 2024-09-13T17:03:03.905 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:03.902+0000 7f3f955bf640 1 -- start start 2024-09-13T17:03:03.905 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:03.902+0000 7f3f955bf640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3f900fea30 0x7f3f901029c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:03:03.905 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:03.902+0000 7f3f955bf640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f900ffc30 0x7f3f90101010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:03:03.905 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:03.902+0000 7f3f955bf640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f90101550 con 0x7f3f900fea30 2024-09-13T17:03:03.905 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:03.902+0000 7f3f955bf640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f901016c0 con 0x7f3f900ffc30 2024-09-13T17:03:03.905 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:03.902+0000 7f3f8effd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3f900fea30 0x7f3f901029c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:03:03.906 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:03.902+0000 7f3f8effd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3f900fea30 0x7f3f901029c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:46744/0 (socket says 172.21.15.115:46744) 2024-09-13T17:03:03.906 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:03.902+0000 7f3f8effd640 1 -- 172.21.15.115:0/1349412428 learned_addr learned my addr 172.21.15.115:0/1349412428 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:03:03.906 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:03.902+0000 7f3f8effd640 1 -- 172.21.15.115:0/1349412428 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f900ffc30 msgr2=0x7f3f90101010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:03.906 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:03.902+0000 7f3f8effd640 1 --2- 172.21.15.115:0/1349412428 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f900ffc30 0x7f3f90101010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:03.906 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:03.902+0000 7f3f8effd640 1 -- 172.21.15.115:0/1349412428 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f78009560 con 0x7f3f900fea30 2024-09-13T17:03:03.906 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:03.902+0000 7f3f8effd640 1 --2- 172.21.15.115:0/1349412428 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3f900fea30 0x7f3f901029c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3f8000c8f0 tx=0x7f3f8000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:03:03.907 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:03.903+0000 7f3f87fff640 1 -- 172.21.15.115:0/1349412428 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f800041f0 con 0x7f3f900fea30 2024-09-13T17:03:03.907 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:03.903+0000 7f3f87fff640 1 -- 172.21.15.115:0/1349412428 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3f80007e50 con 0x7f3f900fea30 2024-09-13T17:03:03.907 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:03.903+0000 7f3f955bf640 1 -- 172.21.15.115:0/1349412428 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f901019a0 con 0x7f3f900fea30 2024-09-13T17:03:03.907 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:03.903+0000 7f3f87fff640 1 -- 172.21.15.115:0/1349412428 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f800049d0 con 0x7f3f900fea30 2024-09-13T17:03:03.907 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:03.903+0000 7f3f955bf640 1 -- 172.21.15.115:0/1349412428 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f9019d5e0 con 0x7f3f900fea30 2024-09-13T17:03:03.907 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:03.904+0000 7f3f955bf640 1 -- 172.21.15.115:0/1349412428 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f900fee30 con 0x7f3f900fea30 2024-09-13T17:03:03.907 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:03.904+0000 7f3f87fff640 1 -- 172.21.15.115:0/1349412428 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f3f80004350 con 0x7f3f900fea30 2024-09-13T17:03:03.907 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:03.905+0000 7f3f87fff640 1 --2- 172.21.15.115:0/1349412428 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f3f7c06cc50 0x7f3f7c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:03:03.908 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:03.905+0000 7f3f87fff640 1 -- 172.21.15.115:0/1349412428 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f3f8008bd10 con 0x7f3f900fea30 2024-09-13T17:03:03.908 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:03.905+0000 7f3f8e7fc640 1 --2- 172.21.15.115:0/1349412428 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f3f7c06cc50 0x7f3f7c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:03:03.908 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:03.905+0000 7f3f8e7fc640 1 --2- 172.21.15.115:0/1349412428 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f3f7c06cc50 0x7f3f7c06f110 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3f7802a9c0 tx=0x7f3f78000bc0 comp rx=0 tx=0).ready entity=mgr.14207 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:03:03.911 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:03.909+0000 7f3f87fff640 1 -- 172.21.15.115:0/1349412428 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f3f80056420 con 0x7f3f900fea30 2024-09-13T17:03:04.083 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:04.081+0000 7f3f955bf640 1 -- 172.21.15.115:0/1349412428 --> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f3f900682f0 con 0x7f3f7c06cc50 2024-09-13T17:03:04.091 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:04.088+0000 7f3f87fff640 1 -- 172.21.15.115:0/1349412428 <== mgr.14207 v2:172.21.15.115:6800/244039928 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3080 (secure 0 0 0) 0x7f3f900682f0 con 0x7f3f7c06cc50 2024-09-13T17:03:04.091 INFO:teuthology.orchestra.run.smithi115.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T17:03:04.091 INFO:teuthology.orchestra.run.smithi115.stdout:alertmanager.smithi115 smithi115 *:9093,9094 running (3m) 2m ago 5m 26.5M - 0.25.0 c8568f914cd2 cbe091cee151 2024-09-13T17:03:04.091 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-exporter.smithi115 smithi115 running (5m) 2m ago 5m 7117k - 18.2.4-843-g2c01458a c129f5a2fd4e 0f1eebeaf9bb 2024-09-13T17:03:04.091 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-exporter.smithi195 smithi195 running (4m) 68s ago 4m 7033k - 18.2.4-843-g2c01458a c129f5a2fd4e 6d05bafbac8a 2024-09-13T17:03:04.091 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi115 smithi115 running (5m) 2m ago 5m 6899k - 18.2.4-843-g2c01458a c129f5a2fd4e 624a903fec23 2024-09-13T17:03:04.091 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi195 smithi195 running (4m) 68s ago 4m 6891k - 18.2.4-843-g2c01458a c129f5a2fd4e 42e6ce26130d 2024-09-13T17:03:04.091 INFO:teuthology.orchestra.run.smithi115.stdout:grafana.smithi115 smithi115 *:3000 running (3m) 2m ago 4m 82.6M - 9.4.7 954c08fa6188 41183f0705c8 2024-09-13T17:03:04.091 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi115.hetcni smithi115 *:9283,8765,8443 running (6m) 2m ago 6m 479M - 18.2.4-843-g2c01458a c129f5a2fd4e f2f0af4ec38c 2024-09-13T17:03:04.091 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi195.hjjifz smithi195 *:8443,9283,8765 running (4m) 68s ago 4m 439M - 18.2.4-843-g2c01458a c129f5a2fd4e 17f4cb7219e4 2024-09-13T17:03:04.092 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi115 smithi115 running (6m) 2m ago 6m 44.7M 2048M 18.2.4-843-g2c01458a c129f5a2fd4e 202375d41e68 2024-09-13T17:03:04.092 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi195 smithi195 running (4m) 68s ago 4m 39.9M 2048M 18.2.4-843-g2c01458a c129f5a2fd4e 0f54c30e5970 2024-09-13T17:03:04.092 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi115 smithi115 *:9100 running (5m) 2m ago 5m 16.2M - 1.5.0 0da6a335fe13 9074300dbe31 2024-09-13T17:03:04.092 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi195 smithi195 *:9100 running (4m) 68s ago 4m 15.4M - 1.5.0 0da6a335fe13 d7b54e5d8c97 2024-09-13T17:03:04.092 INFO:teuthology.orchestra.run.smithi115.stdout:osd.0 smithi115 running (3m) 2m ago 3m 42.2M 3946M 18.2.4-843-g2c01458a c129f5a2fd4e 8a8ad231962e 2024-09-13T17:03:04.092 INFO:teuthology.orchestra.run.smithi115.stdout:osd.1 smithi115 running (2m) 2m ago 2m 40.0M 3946M 18.2.4-843-g2c01458a c129f5a2fd4e 3fbc020102a0 2024-09-13T17:03:04.092 INFO:teuthology.orchestra.run.smithi115.stdout:osd.2 smithi115 running (2m) 2m ago 2m 45.9M 3946M 18.2.4-843-g2c01458a c129f5a2fd4e 7c623823e920 2024-09-13T17:03:04.092 INFO:teuthology.orchestra.run.smithi115.stdout:osd.3 smithi195 running (2m) 68s ago 2m 49.0M 4970M 18.2.4-843-g2c01458a c129f5a2fd4e 10ea833fd5c5 2024-09-13T17:03:04.092 INFO:teuthology.orchestra.run.smithi115.stdout:osd.4 smithi195 running (98s) 68s ago 98s 38.6M 4970M 18.2.4-843-g2c01458a c129f5a2fd4e 4bbc3acb9aff 2024-09-13T17:03:04.092 INFO:teuthology.orchestra.run.smithi115.stdout:osd.5 smithi195 running (73s) 68s ago 73s 12.1M 4970M 18.2.4-843-g2c01458a c129f5a2fd4e 4bd1b3a232d0 2024-09-13T17:03:04.092 INFO:teuthology.orchestra.run.smithi115.stdout:prometheus.smithi115 smithi115 *:9095 running (3m) 2m ago 4m 42.7M - 2.43.0 a07b618ecd1d e91d39286d6c 2024-09-13T17:03:04.093 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:04.090+0000 7f3f955bf640 1 -- 172.21.15.115:0/1349412428 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f3f7c06cc50 msgr2=0x7f3f7c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:04.093 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:04.090+0000 7f3f955bf640 1 --2- 172.21.15.115:0/1349412428 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f3f7c06cc50 0x7f3f7c06f110 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3f7802a9c0 tx=0x7f3f78000bc0 comp rx=0 tx=0).stop 2024-09-13T17:03:04.093 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:04.090+0000 7f3f955bf640 1 -- 172.21.15.115:0/1349412428 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3f900fea30 msgr2=0x7f3f901029c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:04.093 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:04.090+0000 7f3f955bf640 1 --2- 172.21.15.115:0/1349412428 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3f900fea30 0x7f3f901029c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3f8000c8f0 tx=0x7f3f8000cdb0 comp rx=0 tx=0).stop 2024-09-13T17:03:04.093 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:04.090+0000 7f3f955bf640 1 -- 172.21.15.115:0/1349412428 shutdown_connections 2024-09-13T17:03:04.093 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:04.090+0000 7f3f955bf640 1 --2- 172.21.15.115:0/1349412428 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f3f7c06cc50 0x7f3f7c06f110 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:04.094 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:04.090+0000 7f3f955bf640 1 --2- 172.21.15.115:0/1349412428 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f900ffc30 0x7f3f90101010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:04.094 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:04.090+0000 7f3f955bf640 1 --2- 172.21.15.115:0/1349412428 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3f900fea30 0x7f3f901029c0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:04.094 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:04.091+0000 7f3f955bf640 1 -- 172.21.15.115:0/1349412428 >> 172.21.15.115:0/1349412428 conn(0x7f3f900fa1c0 msgr2=0x7f3f90067be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:03:04.094 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:04.091+0000 7f3f955bf640 1 -- 172.21.15.115:0/1349412428 shutdown_connections 2024-09-13T17:03:04.094 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:04.091+0000 7f3f955bf640 1 -- 172.21.15.115:0/1349412428 wait complete. 2024-09-13T17:03:04.428 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:04 smithi115 ceph-mon[27708]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:03:04.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:04 smithi195 ceph-mon[34981]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:03:04.755 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-13T17:03:04.954 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T17:03:05.576 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:05 smithi195 ceph-mon[34981]: from='client.14436 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:03:05.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:05 smithi115 ceph-mon[27708]: from='client.14436 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:03:06.306 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:06 smithi115 ceph-mon[27708]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:03:06.541 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:06.537+0000 7fe24e3cf640 1 -- 172.21.15.115:0/99808573 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2480ffc80 msgr2=0x7fe248100100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:06.541 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:06.537+0000 7fe24e3cf640 1 --2- 172.21.15.115:0/99808573 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2480ffc80 0x7fe248100100 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe23c009880 tx=0x7fe23c02a4a0 comp rx=0 tx=0).stop 2024-09-13T17:03:06.542 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:06.537+0000 7fe24e3cf640 1 -- 172.21.15.115:0/99808573 shutdown_connections 2024-09-13T17:03:06.542 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:06.537+0000 7fe24e3cf640 1 --2- 172.21.15.115:0/99808573 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2480ffc80 0x7fe248100100 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:06.542 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:06.537+0000 7fe24e3cf640 1 --2- 172.21.15.115:0/99808573 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe2480fea80 0x7fe2480fee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:06.542 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:06.537+0000 7fe24e3cf640 1 -- 172.21.15.115:0/99808573 >> 172.21.15.115:0/99808573 conn(0x7fe2480fa230 msgr2=0x7fe2480fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:03:06.542 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:06.537+0000 7fe24e3cf640 1 -- 172.21.15.115:0/99808573 shutdown_connections 2024-09-13T17:03:06.542 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:06.537+0000 7fe24e3cf640 1 -- 172.21.15.115:0/99808573 wait complete. 2024-09-13T17:03:06.542 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:06.538+0000 7fe24e3cf640 1 Processor -- start 2024-09-13T17:03:06.542 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:06.538+0000 7fe24e3cf640 1 -- start start 2024-09-13T17:03:06.542 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:06.538+0000 7fe24e3cf640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe2480fea80 0x7fe2481943e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:03:06.542 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:06.538+0000 7fe24e3cf640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2480ffc80 0x7fe248194920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:03:06.542 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:06.538+0000 7fe24e3cf640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe248194e60 con 0x7fe2480ffc80 2024-09-13T17:03:06.542 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:06.538+0000 7fe24e3cf640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe248194fd0 con 0x7fe2480fea80 2024-09-13T17:03:06.543 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:06.538+0000 7fe2477fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2480ffc80 0x7fe248194920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:03:06.543 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:06.538+0000 7fe2477fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2480ffc80 0x7fe248194920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:37632/0 (socket says 172.21.15.115:37632) 2024-09-13T17:03:06.543 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:06.538+0000 7fe2477fe640 1 -- 172.21.15.115:0/1959268927 learned_addr learned my addr 172.21.15.115:0/1959268927 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:03:06.543 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:06.539+0000 7fe247fff640 1 --2- 172.21.15.115:0/1959268927 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe2480fea80 0x7fe2481943e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:03:06.543 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:06.539+0000 7fe2477fe640 1 -- 172.21.15.115:0/1959268927 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe2480fea80 msgr2=0x7fe2481943e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:06.543 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:06.539+0000 7fe2477fe640 1 --2- 172.21.15.115:0/1959268927 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe2480fea80 0x7fe2481943e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:06.543 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:06.539+0000 7fe2477fe640 1 -- 172.21.15.115:0/1959268927 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe23c009560 con 0x7fe2480ffc80 2024-09-13T17:03:06.543 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:06.539+0000 7fe2477fe640 1 --2- 172.21.15.115:0/1959268927 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2480ffc80 0x7fe248194920 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe23c031460 tx=0x7fe23c0056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:03:06.543 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:06.539+0000 7fe2457fa640 1 -- 172.21.15.115:0/1959268927 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe23c004c60 con 0x7fe2480ffc80 2024-09-13T17:03:06.543 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:06.539+0000 7fe24e3cf640 1 -- 172.21.15.115:0/1959268927 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe248199a50 con 0x7fe2480ffc80 2024-09-13T17:03:06.543 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:06.539+0000 7fe2457fa640 1 -- 172.21.15.115:0/1959268927 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe23c003a90 con 0x7fe2480ffc80 2024-09-13T17:03:06.543 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:06.539+0000 7fe2457fa640 1 -- 172.21.15.115:0/1959268927 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe23c031b10 con 0x7fe2480ffc80 2024-09-13T17:03:06.543 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:06.539+0000 7fe24e3cf640 1 -- 172.21.15.115:0/1959268927 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe248199f70 con 0x7fe2480ffc80 2024-09-13T17:03:06.544 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:06.540+0000 7fe24e3cf640 1 -- 172.21.15.115:0/1959268927 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe248107530 con 0x7fe2480ffc80 2024-09-13T17:03:06.544 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:06.541+0000 7fe2457fa640 1 -- 172.21.15.115:0/1959268927 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fe23c003c00 con 0x7fe2480ffc80 2024-09-13T17:03:06.544 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:06.541+0000 7fe2457fa640 1 --2- 172.21.15.115:0/1959268927 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fe23006cc50 0x7fe23006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:03:06.544 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:06.541+0000 7fe247fff640 1 --2- 172.21.15.115:0/1959268927 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fe23006cc50 0x7fe23006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:03:06.545 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:06.541+0000 7fe2457fa640 1 -- 172.21.15.115:0/1959268927 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fe23c0ad200 con 0x7fe2480ffc80 2024-09-13T17:03:06.545 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:06.542+0000 7fe247fff640 1 --2- 172.21.15.115:0/1959268927 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fe23006cc50 0x7fe23006f110 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe2480ffae0 tx=0x7fe238005f90 comp rx=0 tx=0).ready entity=mgr.14207 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:03:06.547 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:06.545+0000 7fe2457fa640 1 -- 172.21.15.115:0/1959268927 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe23c0779c0 con 0x7fe2480ffc80 2024-09-13T17:03:06.576 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:06 smithi195 ceph-mon[34981]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:03:06.719 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:06.717+0000 7fe24e3cf640 1 -- 172.21.15.115:0/1959268927 --> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fe2481045d0 con 0x7fe23006cc50 2024-09-13T17:03:06.723 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:06.721+0000 7fe2457fa640 1 -- 172.21.15.115:0/1959268927 <== mgr.14207 v2:172.21.15.115:6800/244039928 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+1310 (secure 0 0 0) 0x7fe2481045d0 con 0x7fe23006cc50 2024-09-13T17:03:06.723 INFO:teuthology.orchestra.run.smithi115.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-13T17:03:06.723 INFO:teuthology.orchestra.run.smithi115.stdout:alertmanager ?:9093,9094 1/1 2m ago 5m count:1 2024-09-13T17:03:06.723 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-exporter 2/2 2m ago 5m * 2024-09-13T17:03:06.723 INFO:teuthology.orchestra.run.smithi115.stdout:crash 2/2 2m ago 5m * 2024-09-13T17:03:06.724 INFO:teuthology.orchestra.run.smithi115.stdout:grafana ?:3000 1/1 2m ago 5m count:1 2024-09-13T17:03:06.724 INFO:teuthology.orchestra.run.smithi115.stdout:mgr 2/2 2m ago 5m count:2 2024-09-13T17:03:06.724 INFO:teuthology.orchestra.run.smithi115.stdout:mon 2/2 2m ago 5m smithi115:172.21.15.115=smithi115;smithi195:172.21.15.195=smithi195;count:2 2024-09-13T17:03:06.724 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter ?:9100 2/2 2m ago 5m * 2024-09-13T17:03:06.724 INFO:teuthology.orchestra.run.smithi115.stdout:osd 6 2m ago - 2024-09-13T17:03:06.724 INFO:teuthology.orchestra.run.smithi115.stdout:prometheus ?:9095 1/1 2m ago 5m count:1 2024-09-13T17:03:06.725 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:06.723+0000 7fe24e3cf640 1 -- 172.21.15.115:0/1959268927 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fe23006cc50 msgr2=0x7fe23006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:06.725 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:06.723+0000 7fe24e3cf640 1 --2- 172.21.15.115:0/1959268927 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fe23006cc50 0x7fe23006f110 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe2480ffae0 tx=0x7fe238005f90 comp rx=0 tx=0).stop 2024-09-13T17:03:06.725 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:06.723+0000 7fe24e3cf640 1 -- 172.21.15.115:0/1959268927 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2480ffc80 msgr2=0x7fe248194920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:06.726 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:06.723+0000 7fe24e3cf640 1 --2- 172.21.15.115:0/1959268927 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2480ffc80 0x7fe248194920 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe23c031460 tx=0x7fe23c0056e0 comp rx=0 tx=0).stop 2024-09-13T17:03:06.726 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:06.723+0000 7fe24e3cf640 1 -- 172.21.15.115:0/1959268927 shutdown_connections 2024-09-13T17:03:06.726 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:06.723+0000 7fe24e3cf640 1 --2- 172.21.15.115:0/1959268927 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fe23006cc50 0x7fe23006f110 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:06.726 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:06.723+0000 7fe24e3cf640 1 --2- 172.21.15.115:0/1959268927 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2480ffc80 0x7fe248194920 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:06.726 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:06.723+0000 7fe24e3cf640 1 --2- 172.21.15.115:0/1959268927 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe2480fea80 0x7fe2481943e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:06.726 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:06.723+0000 7fe24e3cf640 1 -- 172.21.15.115:0/1959268927 >> 172.21.15.115:0/1959268927 conn(0x7fe2480fa230 msgr2=0x7fe248102eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:03:06.726 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:06.723+0000 7fe24e3cf640 1 -- 172.21.15.115:0/1959268927 shutdown_connections 2024-09-13T17:03:06.726 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:06.723+0000 7fe24e3cf640 1 -- 172.21.15.115:0/1959268927 wait complete. 2024-09-13T17:03:07.393 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-13T17:03:07.591 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T17:03:08.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:08 smithi115 ceph-mon[27708]: from='client.14440 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:03:08.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:08 smithi115 ceph-mon[27708]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:03:08.576 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:08 smithi195 ceph-mon[34981]: from='client.14440 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:03:08.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:08 smithi195 ceph-mon[34981]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:03:09.100 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:09.078+0000 7f374aa50640 1 -- 172.21.15.115:0/554323326 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37440ffca0 msgr2=0x7f3744100120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:09.100 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:09.078+0000 7f374aa50640 1 --2- 172.21.15.115:0/554323326 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37440ffca0 0x7f3744100120 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3738009880 tx=0x7f373802a4a0 comp rx=0 tx=0).stop 2024-09-13T17:03:09.100 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:09.078+0000 7f374aa50640 1 -- 172.21.15.115:0/554323326 shutdown_connections 2024-09-13T17:03:09.100 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:09.078+0000 7f374aa50640 1 --2- 172.21.15.115:0/554323326 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37440ffca0 0x7f3744100120 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:09.100 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:09.078+0000 7f374aa50640 1 --2- 172.21.15.115:0/554323326 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37440feaa0 0x7f37440feea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:09.101 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:09.078+0000 7f374aa50640 1 -- 172.21.15.115:0/554323326 >> 172.21.15.115:0/554323326 conn(0x7f37440fa230 msgr2=0x7f37440fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:03:09.101 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:09.078+0000 7f374aa50640 1 -- 172.21.15.115:0/554323326 shutdown_connections 2024-09-13T17:03:09.101 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:09.078+0000 7f374aa50640 1 -- 172.21.15.115:0/554323326 wait complete. 2024-09-13T17:03:09.101 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:09.079+0000 7f374aa50640 1 Processor -- start 2024-09-13T17:03:09.101 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:09.079+0000 7f374aa50640 1 -- start start 2024-09-13T17:03:09.101 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:09.079+0000 7f374aa50640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37440feaa0 0x7f3744195570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:03:09.101 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:09.079+0000 7f374aa50640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37440ffca0 0x7f3744195ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:03:09.101 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:09.079+0000 7f374aa50640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3744196080 con 0x7f37440ffca0 2024-09-13T17:03:09.102 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:09.079+0000 7f374aa50640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37441961f0 con 0x7f37440feaa0 2024-09-13T17:03:09.102 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:09.079+0000 7f37437fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37440ffca0 0x7f3744195ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:03:09.102 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:09.079+0000 7f37437fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37440ffca0 0x7f3744195ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:37648/0 (socket says 172.21.15.115:37648) 2024-09-13T17:03:09.102 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:09.079+0000 7f37437fe640 1 -- 172.21.15.115:0/3932561823 learned_addr learned my addr 172.21.15.115:0/3932561823 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:03:09.102 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:09.080+0000 7f3743fff640 1 --2- 172.21.15.115:0/3932561823 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37440feaa0 0x7f3744195570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:03:09.102 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:09.080+0000 7f37437fe640 1 -- 172.21.15.115:0/3932561823 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37440feaa0 msgr2=0x7f3744195570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:09.102 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:09.080+0000 7f37437fe640 1 --2- 172.21.15.115:0/3932561823 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37440feaa0 0x7f3744195570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:09.102 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:09.080+0000 7f37437fe640 1 -- 172.21.15.115:0/3932561823 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3738009560 con 0x7f37440ffca0 2024-09-13T17:03:09.102 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:09.080+0000 7f37437fe640 1 --2- 172.21.15.115:0/3932561823 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37440ffca0 0x7f3744195ab0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3738006010 tx=0x7f37380056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:03:09.102 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:09.080+0000 7f37417fa640 1 -- 172.21.15.115:0/3932561823 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3738004c60 con 0x7f37440ffca0 2024-09-13T17:03:09.102 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:09.080+0000 7f374aa50640 1 -- 172.21.15.115:0/3932561823 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f374419ac30 con 0x7f37440ffca0 2024-09-13T17:03:09.102 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:09.080+0000 7f37417fa640 1 -- 172.21.15.115:0/3932561823 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3738031a00 con 0x7f37440ffca0 2024-09-13T17:03:09.102 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:09.080+0000 7f37417fa640 1 -- 172.21.15.115:0/3932561823 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3738003bc0 con 0x7f37440ffca0 2024-09-13T17:03:09.102 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:09.080+0000 7f374aa50640 1 -- 172.21.15.115:0/3932561823 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f374419b1a0 con 0x7f37440ffca0 2024-09-13T17:03:09.103 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:09.081+0000 7f374aa50640 1 -- 172.21.15.115:0/3932561823 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3744107570 con 0x7f37440ffca0 2024-09-13T17:03:09.103 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:09.081+0000 7f37417fa640 1 -- 172.21.15.115:0/3932561823 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f3738003df0 con 0x7f37440ffca0 2024-09-13T17:03:09.103 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:09.082+0000 7f37417fa640 1 --2- 172.21.15.115:0/3932561823 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f372c06cc50 0x7f372c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:03:09.103 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:09.082+0000 7f37417fa640 1 -- 172.21.15.115:0/3932561823 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f37380ad1d0 con 0x7f37440ffca0 2024-09-13T17:03:09.103 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:09.082+0000 7f3743fff640 1 --2- 172.21.15.115:0/3932561823 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f372c06cc50 0x7f372c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:03:09.103 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:09.082+0000 7f3743fff640 1 --2- 172.21.15.115:0/3932561823 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f372c06cc50 0x7f372c06f110 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f37340058c0 tx=0x7f373400a4c0 comp rx=0 tx=0).ready entity=mgr.14207 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:03:09.103 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:09.086+0000 7f37417fa640 1 -- 172.21.15.115:0/3932561823 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f37380778e0 con 0x7f37440ffca0 2024-09-13T17:03:09.258 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:09.255+0000 7f374aa50640 1 -- 172.21.15.115:0/3932561823 --> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f374419b390 con 0x7f372c06cc50 2024-09-13T17:03:09.259 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:09.257+0000 7f37417fa640 1 -- 172.21.15.115:0/3932561823 <== mgr.14207 v2:172.21.15.115:6800/244039928 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+148 (secure 0 0 0) 0x7f374419b390 con 0x7f372c06cc50 2024-09-13T17:03:09.259 INFO:teuthology.orchestra.run.smithi115.stdout:HOST ADDR LABELS STATUS 2024-09-13T17:03:09.259 INFO:teuthology.orchestra.run.smithi115.stdout:smithi115 172.21.15.115 2024-09-13T17:03:09.259 INFO:teuthology.orchestra.run.smithi115.stdout:smithi195 172.21.15.195 2024-09-13T17:03:09.259 INFO:teuthology.orchestra.run.smithi115.stdout:2 hosts in cluster 2024-09-13T17:03:09.261 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:09.259+0000 7f374aa50640 1 -- 172.21.15.115:0/3932561823 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f372c06cc50 msgr2=0x7f372c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:09.261 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:09.259+0000 7f374aa50640 1 --2- 172.21.15.115:0/3932561823 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f372c06cc50 0x7f372c06f110 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f37340058c0 tx=0x7f373400a4c0 comp rx=0 tx=0).stop 2024-09-13T17:03:09.261 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:09.259+0000 7f374aa50640 1 -- 172.21.15.115:0/3932561823 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37440ffca0 msgr2=0x7f3744195ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:09.261 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:09.259+0000 7f374aa50640 1 --2- 172.21.15.115:0/3932561823 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37440ffca0 0x7f3744195ab0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3738006010 tx=0x7f37380056e0 comp rx=0 tx=0).stop 2024-09-13T17:03:09.261 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:09.259+0000 7f374aa50640 1 -- 172.21.15.115:0/3932561823 shutdown_connections 2024-09-13T17:03:09.262 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:09.259+0000 7f374aa50640 1 --2- 172.21.15.115:0/3932561823 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f372c06cc50 0x7f372c06f110 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:09.262 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:09.259+0000 7f374aa50640 1 --2- 172.21.15.115:0/3932561823 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37440ffca0 0x7f3744195ab0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:09.262 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:09.259+0000 7f374aa50640 1 --2- 172.21.15.115:0/3932561823 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37440feaa0 0x7f3744195570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:09.262 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:09.259+0000 7f374aa50640 1 -- 172.21.15.115:0/3932561823 >> 172.21.15.115:0/3932561823 conn(0x7f37440fa230 msgr2=0x7f37440fc5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:03:09.262 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:09.259+0000 7f374aa50640 1 -- 172.21.15.115:0/3932561823 shutdown_connections 2024-09-13T17:03:09.262 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:09.259+0000 7f374aa50640 1 -- 172.21.15.115:0/3932561823 wait complete. 2024-09-13T17:03:09.898 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-13T17:03:10.093 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T17:03:10.473 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:10 smithi115 ceph-mon[27708]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:03:10.473 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:10 smithi115 ceph-mon[27708]: from='client.14444 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:03:10.576 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:10 smithi195 ceph-mon[34981]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:03:10.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:10 smithi195 ceph-mon[34981]: from='client.14444 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:03:11.855 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:11.834+0000 7f102be4d640 1 -- 172.21.15.115:0/211818321 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10240ffc30 msgr2=0x7f10241000b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:11.855 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:11.834+0000 7f102be4d640 1 --2- 172.21.15.115:0/211818321 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10240ffc30 0x7f10241000b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1014009880 tx=0x7f101402a4a0 comp rx=0 tx=0).stop 2024-09-13T17:03:11.855 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:11.835+0000 7f102be4d640 1 -- 172.21.15.115:0/211818321 shutdown_connections 2024-09-13T17:03:11.856 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:11.835+0000 7f102be4d640 1 --2- 172.21.15.115:0/211818321 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10240ffc30 0x7f10241000b0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:11.856 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:11.835+0000 7f102be4d640 1 --2- 172.21.15.115:0/211818321 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10240fea30 0x7f10240fee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:11.856 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:11.835+0000 7f102be4d640 1 -- 172.21.15.115:0/211818321 >> 172.21.15.115:0/211818321 conn(0x7f10240fa1c0 msgr2=0x7f10240fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:03:11.856 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:11.835+0000 7f102be4d640 1 -- 172.21.15.115:0/211818321 shutdown_connections 2024-09-13T17:03:11.856 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:11.835+0000 7f102be4d640 1 -- 172.21.15.115:0/211818321 wait complete. 2024-09-13T17:03:11.856 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:11.835+0000 7f102be4d640 1 Processor -- start 2024-09-13T17:03:11.856 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:11.835+0000 7f102be4d640 1 -- start start 2024-09-13T17:03:11.856 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:11.835+0000 7f102be4d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10240fea30 0x7f1024195580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:03:11.856 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:11.835+0000 7f102be4d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10240ffc30 0x7f1024195ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:03:11.856 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:11.836+0000 7f102be4d640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1024196090 con 0x7f10240ffc30 2024-09-13T17:03:11.856 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:11.836+0000 7f102be4d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1024196200 con 0x7f10240fea30 2024-09-13T17:03:11.856 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:11.836+0000 7f10293e8640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10240ffc30 0x7f1024195ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:03:11.857 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:11.836+0000 7f10293e8640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10240ffc30 0x7f1024195ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:37674/0 (socket says 172.21.15.115:37674) 2024-09-13T17:03:11.857 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:11.836+0000 7f10293e8640 1 -- 172.21.15.115:0/279092883 learned_addr learned my addr 172.21.15.115:0/279092883 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:03:11.857 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:11.836+0000 7f10293e8640 1 -- 172.21.15.115:0/279092883 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10240fea30 msgr2=0x7f1024195580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:11.857 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:11.836+0000 7f1029be9640 1 --2- 172.21.15.115:0/279092883 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10240fea30 0x7f1024195580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:03:11.857 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:11.836+0000 7f10293e8640 1 --2- 172.21.15.115:0/279092883 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10240fea30 0x7f1024195580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:11.857 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:11.836+0000 7f10293e8640 1 -- 172.21.15.115:0/279092883 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1014009560 con 0x7f10240ffc30 2024-09-13T17:03:11.857 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:11.836+0000 7f1029be9640 1 --2- 172.21.15.115:0/279092883 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10240fea30 0x7f1024195580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:03:11.857 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:11.836+0000 7f10293e8640 1 --2- 172.21.15.115:0/279092883 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10240ffc30 0x7f1024195ac0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1014006010 tx=0x7f10140056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:03:11.857 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:11.836+0000 7f101affd640 1 -- 172.21.15.115:0/279092883 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1014004c60 con 0x7f10240ffc30 2024-09-13T17:03:11.857 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:11.836+0000 7f101affd640 1 -- 172.21.15.115:0/279092883 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1014031a00 con 0x7f10240ffc30 2024-09-13T17:03:11.857 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:11.836+0000 7f101affd640 1 -- 172.21.15.115:0/279092883 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1014003bc0 con 0x7f10240ffc30 2024-09-13T17:03:11.857 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:11.836+0000 7f102be4d640 1 -- 172.21.15.115:0/279092883 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f102419ac40 con 0x7f10240ffc30 2024-09-13T17:03:11.858 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:11.836+0000 7f102be4d640 1 -- 172.21.15.115:0/279092883 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f102419b1b0 con 0x7f10240ffc30 2024-09-13T17:03:11.858 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:11.837+0000 7f102be4d640 1 -- 172.21.15.115:0/279092883 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1024107500 con 0x7f10240ffc30 2024-09-13T17:03:11.858 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:11.838+0000 7f101affd640 1 -- 172.21.15.115:0/279092883 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f1014003df0 con 0x7f10240ffc30 2024-09-13T17:03:11.858 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:11.838+0000 7f101affd640 1 --2- 172.21.15.115:0/279092883 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f101006cc50 0x7f101006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:03:11.858 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:11.838+0000 7f101affd640 1 -- 172.21.15.115:0/279092883 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f10140ad1d0 con 0x7f10240ffc30 2024-09-13T17:03:11.858 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:11.838+0000 7f1029be9640 1 --2- 172.21.15.115:0/279092883 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f101006cc50 0x7f101006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:03:11.858 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:11.839+0000 7f1029be9640 1 --2- 172.21.15.115:0/279092883 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f101006cc50 0x7f101006f110 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1020005fd0 tx=0x7f1020008310 comp rx=0 tx=0).ready entity=mgr.14207 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:03:11.858 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:11.842+0000 7f101affd640 1 -- 172.21.15.115:0/279092883 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f10140778e0 con 0x7f10240ffc30 2024-09-13T17:03:12.021 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:12.019+0000 7f102be4d640 1 -- 172.21.15.115:0/279092883 --> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f102419b3a0 con 0x7f101006cc50 2024-09-13T17:03:12.022 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:12.020+0000 7f101affd640 1 -- 172.21.15.115:0/279092883 <== mgr.14207 v2:172.21.15.115:6800/244039928 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+399 (secure 0 0 0) 0x7f102419b3a0 con 0x7f101006cc50 2024-09-13T17:03:12.022 INFO:teuthology.orchestra.run.smithi115.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-13T17:03:12.022 INFO:teuthology.orchestra.run.smithi115.stdout:smithi115 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400UU400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-13T17:03:12.022 INFO:teuthology.orchestra.run.smithi115.stdout:smithi195 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB751300FS480DGN 447G No 73s ago Has a FileSystem, LVM detected 2024-09-13T17:03:12.024 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:12.022+0000 7f102be4d640 1 -- 172.21.15.115:0/279092883 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f101006cc50 msgr2=0x7f101006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:12.024 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:12.022+0000 7f102be4d640 1 --2- 172.21.15.115:0/279092883 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f101006cc50 0x7f101006f110 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1020005fd0 tx=0x7f1020008310 comp rx=0 tx=0).stop 2024-09-13T17:03:12.025 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:12.022+0000 7f102be4d640 1 -- 172.21.15.115:0/279092883 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10240ffc30 msgr2=0x7f1024195ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:12.025 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:12.022+0000 7f102be4d640 1 --2- 172.21.15.115:0/279092883 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10240ffc30 0x7f1024195ac0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1014006010 tx=0x7f10140056e0 comp rx=0 tx=0).stop 2024-09-13T17:03:12.025 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:12.022+0000 7f102be4d640 1 -- 172.21.15.115:0/279092883 shutdown_connections 2024-09-13T17:03:12.025 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:12.022+0000 7f102be4d640 1 --2- 172.21.15.115:0/279092883 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f101006cc50 0x7f101006f110 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:12.025 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:12.022+0000 7f102be4d640 1 --2- 172.21.15.115:0/279092883 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10240ffc30 0x7f1024195ac0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:12.025 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:12.022+0000 7f102be4d640 1 --2- 172.21.15.115:0/279092883 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10240fea30 0x7f1024195580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:12.025 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:12.022+0000 7f102be4d640 1 -- 172.21.15.115:0/279092883 >> 172.21.15.115:0/279092883 conn(0x7f10240fa1c0 msgr2=0x7f1024067be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:03:12.025 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:12.022+0000 7f102be4d640 1 -- 172.21.15.115:0/279092883 shutdown_connections 2024-09-13T17:03:12.025 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:12.022+0000 7f102be4d640 1 -- 172.21.15.115:0/279092883 wait complete. 2024-09-13T17:03:12.578 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:12 smithi195 ceph-mon[34981]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:03:12.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:12 smithi115 ceph-mon[27708]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:03:12.841 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T17:03:12.852 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi115.front.sepia.ceph.com 2024-09-13T17:03:12.852 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -- bash -c 'ceph fs volume create cephfs --placement=4' 2024-09-13T17:03:13.053 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T17:03:13.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:13 smithi115 ceph-mon[27708]: from='client.14448 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:03:13.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:13 smithi195 ceph-mon[34981]: from='client.14448 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:03:14.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:14 smithi115 ceph-mon[27708]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:03:14.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:14 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:03:14.576 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:14 smithi195 ceph-mon[34981]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:03:14.576 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:14 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:03:14.812 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:14.668+0000 7fe866b67640 1 -- 172.21.15.115:0/3379032390 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe860100d90 msgr2=0x7fe860101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:14.812 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:14.668+0000 7fe866b67640 1 --2- 172.21.15.115:0/3379032390 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe860100d90 0x7fe860101210 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe848009880 tx=0x7fe84802a4a0 comp rx=0 tx=0).stop 2024-09-13T17:03:14.812 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:14.669+0000 7fe866b67640 1 -- 172.21.15.115:0/3379032390 shutdown_connections 2024-09-13T17:03:14.812 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:14.669+0000 7fe866b67640 1 --2- 172.21.15.115:0/3379032390 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe860100d90 0x7fe860101210 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:14.813 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:14.669+0000 7fe866b67640 1 --2- 172.21.15.115:0/3379032390 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe8600ffb90 0x7fe8600fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:14.813 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:14.669+0000 7fe866b67640 1 -- 172.21.15.115:0/3379032390 >> 172.21.15.115:0/3379032390 conn(0x7fe8600fb320 msgr2=0x7fe8600fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:03:14.813 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:14.669+0000 7fe866b67640 1 -- 172.21.15.115:0/3379032390 shutdown_connections 2024-09-13T17:03:14.813 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:14.669+0000 7fe866b67640 1 -- 172.21.15.115:0/3379032390 wait complete. 2024-09-13T17:03:14.813 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:14.669+0000 7fe866b67640 1 Processor -- start 2024-09-13T17:03:14.813 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:14.669+0000 7fe866b67640 1 -- start start 2024-09-13T17:03:14.813 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:14.670+0000 7fe866b67640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8600ffb90 0x7fe860195530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:03:14.813 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:14.670+0000 7fe866b67640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe860100d90 0x7fe860195a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:03:14.813 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:14.670+0000 7fe866b67640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe860195fb0 con 0x7fe8600ffb90 2024-09-13T17:03:14.813 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:14.670+0000 7fe866b67640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe860196120 con 0x7fe860100d90 2024-09-13T17:03:14.813 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:14.670+0000 7fe864903640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8600ffb90 0x7fe860195530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:03:14.813 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:14.670+0000 7fe864903640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8600ffb90 0x7fe860195530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52066/0 (socket says 172.21.15.115:52066) 2024-09-13T17:03:14.813 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:14.670+0000 7fe864903640 1 -- 172.21.15.115:0/948639373 learned_addr learned my addr 172.21.15.115:0/948639373 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:03:14.814 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:14.670+0000 7fe85ffff640 1 --2- 172.21.15.115:0/948639373 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe860100d90 0x7fe860195a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:03:14.814 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:14.670+0000 7fe864903640 1 -- 172.21.15.115:0/948639373 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe860100d90 msgr2=0x7fe860195a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:14.814 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:14.670+0000 7fe864903640 1 --2- 172.21.15.115:0/948639373 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe860100d90 0x7fe860195a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:14.814 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:14.670+0000 7fe864903640 1 -- 172.21.15.115:0/948639373 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe848009560 con 0x7fe8600ffb90 2024-09-13T17:03:14.814 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:14.670+0000 7fe864903640 1 --2- 172.21.15.115:0/948639373 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8600ffb90 0x7fe860195530 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe85000cc30 tx=0x7fe85000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:03:14.814 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:14.670+0000 7fe85dffb640 1 -- 172.21.15.115:0/948639373 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe850003b40 con 0x7fe8600ffb90 2024-09-13T17:03:14.814 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:14.670+0000 7fe866b67640 1 -- 172.21.15.115:0/948639373 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe86019ac00 con 0x7fe8600ffb90 2024-09-13T17:03:14.814 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:14.670+0000 7fe85dffb640 1 -- 172.21.15.115:0/948639373 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe85000ce70 con 0x7fe8600ffb90 2024-09-13T17:03:14.814 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:14.670+0000 7fe85dffb640 1 -- 172.21.15.115:0/948639373 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe85000f640 con 0x7fe8600ffb90 2024-09-13T17:03:14.814 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:14.670+0000 7fe866b67640 1 -- 172.21.15.115:0/948639373 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe86019b100 con 0x7fe8600ffb90 2024-09-13T17:03:14.814 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:14.671+0000 7fe866b67640 1 -- 172.21.15.115:0/948639373 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe86018f5d0 con 0x7fe8600ffb90 2024-09-13T17:03:14.814 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:14.672+0000 7fe85dffb640 1 -- 172.21.15.115:0/948639373 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fe850004000 con 0x7fe8600ffb90 2024-09-13T17:03:14.815 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:14.672+0000 7fe85dffb640 1 --2- 172.21.15.115:0/948639373 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fe84c06cc50 0x7fe84c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:03:14.815 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:14.672+0000 7fe85dffb640 1 -- 172.21.15.115:0/948639373 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fe85008c1e0 con 0x7fe8600ffb90 2024-09-13T17:03:14.815 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:14.672+0000 7fe85ffff640 1 --2- 172.21.15.115:0/948639373 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fe84c06cc50 0x7fe84c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:03:14.815 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:14.673+0000 7fe85ffff640 1 --2- 172.21.15.115:0/948639373 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fe84c06cc50 0x7fe84c06f110 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe860196a50 tx=0x7fe848031400 comp rx=0 tx=0).ready entity=mgr.14207 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:03:14.815 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:14.676+0000 7fe85dffb640 1 -- 172.21.15.115:0/948639373 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe8500568f0 con 0x7fe8600ffb90 2024-09-13T17:03:14.862 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:14.861+0000 7fe866b67640 1 -- 172.21.15.115:0/948639373 --> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fe86002c640 con 0x7fe84c06cc50 2024-09-13T17:03:15.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:15 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-09-13T17:03:15.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:15 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-09-13T17:03:16.332 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:16.331+0000 7fe85dffb640 1 -- 172.21.15.115:0/948639373 <== mgr.14207 v2:172.21.15.115:6800/244039928 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fe86002c640 con 0x7fe84c06cc50 2024-09-13T17:03:16.335 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:16.333+0000 7fe866b67640 1 -- 172.21.15.115:0/948639373 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fe84c06cc50 msgr2=0x7fe84c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:16.335 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:16.333+0000 7fe866b67640 1 --2- 172.21.15.115:0/948639373 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fe84c06cc50 0x7fe84c06f110 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe860196a50 tx=0x7fe848031400 comp rx=0 tx=0).stop 2024-09-13T17:03:16.335 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:16.333+0000 7fe866b67640 1 -- 172.21.15.115:0/948639373 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8600ffb90 msgr2=0x7fe860195530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:16.335 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:16.333+0000 7fe866b67640 1 --2- 172.21.15.115:0/948639373 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8600ffb90 0x7fe860195530 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe85000cc30 tx=0x7fe85000a620 comp rx=0 tx=0).stop 2024-09-13T17:03:16.335 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:16.334+0000 7fe866b67640 1 -- 172.21.15.115:0/948639373 shutdown_connections 2024-09-13T17:03:16.335 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:16.334+0000 7fe866b67640 1 --2- 172.21.15.115:0/948639373 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fe84c06cc50 0x7fe84c06f110 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:16.335 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:16.334+0000 7fe866b67640 1 --2- 172.21.15.115:0/948639373 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe860100d90 0x7fe860195a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:16.335 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:16.334+0000 7fe866b67640 1 --2- 172.21.15.115:0/948639373 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8600ffb90 0x7fe860195530 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:16.335 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:16.334+0000 7fe866b67640 1 -- 172.21.15.115:0/948639373 >> 172.21.15.115:0/948639373 conn(0x7fe8600fb320 msgr2=0x7fe8601044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:03:16.335 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:16.334+0000 7fe866b67640 1 -- 172.21.15.115:0/948639373 shutdown_connections 2024-09-13T17:03:16.336 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:16.334+0000 7fe866b67640 1 -- 172.21.15.115:0/948639373 wait complete. 2024-09-13T17:03:16.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:16 smithi195 ceph-mon[34981]: from='client.14452 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:03:16.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:16 smithi195 ceph-mon[34981]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:03:16.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:16 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-09-13T17:03:16.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:16 smithi195 ceph-mon[34981]: osdmap e41: 6 total, 6 up, 6 in 2024-09-13T17:03:16.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:16 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-09-13T17:03:16.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:16 smithi115 ceph-mon[27708]: from='client.14452 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:03:16.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:16 smithi115 ceph-mon[27708]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:03:16.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:16 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-09-13T17:03:16.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:16 smithi115 ceph-mon[27708]: osdmap e41: 6 total, 6 up, 6 in 2024-09-13T17:03:16.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:16 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-09-13T17:03:16.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:16 smithi115 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-mon-smithi115[27704]: 2024-09-13T17:03:16.312+0000 7fb99d2d4640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T17:03:16.996 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-13T17:03:17.479 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:17 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-09-13T17:03:17.479 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:17 smithi115 ceph-mon[27708]: osdmap e42: 6 total, 6 up, 6 in 2024-09-13T17:03:17.479 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:17 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-09-13T17:03:17.479 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:17 smithi115 ceph-mon[27708]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T17:03:17.479 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:17 smithi115 ceph-mon[27708]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-13T17:03:17.479 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:17 smithi115 ceph-mon[27708]: osdmap e43: 6 total, 6 up, 6 in 2024-09-13T17:03:17.479 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:17 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-09-13T17:03:17.479 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:17 smithi115 ceph-mon[27708]: fsmap cephfs:0 2024-09-13T17:03:17.479 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:17 smithi115 ceph-mon[27708]: Saving service mds.cephfs spec with placement count:4 2024-09-13T17:03:17.479 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:17 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:03:17.480 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:17 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:03:17.480 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:17 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:03:17.480 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:17 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:03:17.480 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:17 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:03:17.480 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:17 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi115.hbtxod", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T17:03:17.480 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:17 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi115.hbtxod", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T17:03:17.480 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:17 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:03:17.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:17 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-09-13T17:03:17.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:17 smithi195 ceph-mon[34981]: osdmap e42: 6 total, 6 up, 6 in 2024-09-13T17:03:17.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:17 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-09-13T17:03:17.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:17 smithi195 ceph-mon[34981]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T17:03:17.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:17 smithi195 ceph-mon[34981]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-13T17:03:17.578 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:17 smithi195 ceph-mon[34981]: osdmap e43: 6 total, 6 up, 6 in 2024-09-13T17:03:17.578 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:17 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-09-13T17:03:17.578 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:17 smithi195 ceph-mon[34981]: fsmap cephfs:0 2024-09-13T17:03:17.578 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:17 smithi195 ceph-mon[34981]: Saving service mds.cephfs spec with placement count:4 2024-09-13T17:03:17.578 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:17 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:03:17.578 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:17 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:03:17.578 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:17 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:03:17.578 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:17 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:03:17.578 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:17 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:03:17.578 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:17 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi115.hbtxod", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T17:03:17.578 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:17 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi115.hbtxod", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T17:03:17.579 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:17 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:03:18.352 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T17:03:18.474 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:18 smithi115 ceph-mon[27708]: Deploying daemon mds.cephfs.smithi115.hbtxod on smithi115 2024-09-13T17:03:18.475 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:18 smithi115 ceph-mon[27708]: pgmap v175: 65 pgs: 8 creating+peering, 53 unknown, 4 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:03:18.475 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:18 smithi115 ceph-mon[27708]: osdmap e44: 6 total, 6 up, 6 in 2024-09-13T17:03:18.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:18 smithi195 ceph-mon[34981]: Deploying daemon mds.cephfs.smithi115.hbtxod on smithi115 2024-09-13T17:03:18.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:18 smithi195 ceph-mon[34981]: pgmap v175: 65 pgs: 8 creating+peering, 53 unknown, 4 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:03:18.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:18 smithi195 ceph-mon[34981]: osdmap e44: 6 total, 6 up, 6 in 2024-09-13T17:03:19.515 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:19 smithi115 ceph-mon[27708]: osdmap e45: 6 total, 6 up, 6 in 2024-09-13T17:03:19.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:19 smithi195 ceph-mon[34981]: osdmap e45: 6 total, 6 up, 6 in 2024-09-13T17:03:20.523 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:20 smithi115 ceph-mon[27708]: pgmap v178: 65 pgs: 8 creating+peering, 13 unknown, 44 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:03:20.523 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:20 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:03:20.523 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:20 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:03:20.523 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:20 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:03:20.523 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:20 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi195.qzghxj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T17:03:20.523 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:20 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi195.qzghxj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T17:03:20.523 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:20 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:03:20.637 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:20 smithi195 ceph-mon[34981]: pgmap v178: 65 pgs: 8 creating+peering, 13 unknown, 44 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:03:20.638 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:20 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:03:20.638 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:20 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:03:20.638 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:20 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:03:20.638 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:20 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi195.qzghxj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T17:03:20.638 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:20 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi195.qzghxj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T17:03:20.638 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:20 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:03:20.647 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:20.603+0000 7f21c1e8b640 1 -- 172.21.15.115:0/1325176841 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21bc102fc0 msgr2=0x7f21bc1053b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:20.648 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:20.603+0000 7f21c1e8b640 1 --2- 172.21.15.115:0/1325176841 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21bc102fc0 0x7f21bc1053b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f21b0009880 tx=0x7f21b002a4a0 comp rx=0 tx=0).stop 2024-09-13T17:03:20.648 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:20.603+0000 7f21c1e8b640 1 -- 172.21.15.115:0/1325176841 shutdown_connections 2024-09-13T17:03:20.648 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:20.603+0000 7f21c1e8b640 1 --2- 172.21.15.115:0/1325176841 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21bc102fc0 0x7f21bc1053b0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:20.648 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:20.603+0000 7f21c1e8b640 1 --2- 172.21.15.115:0/1325176841 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f21bc100690 0x7f21bc102a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:20.648 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:20.603+0000 7f21c1e8b640 1 -- 172.21.15.115:0/1325176841 >> 172.21.15.115:0/1325176841 conn(0x7f21bc0fa230 msgr2=0x7f21bc0fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:03:20.648 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:20.603+0000 7f21c1e8b640 1 -- 172.21.15.115:0/1325176841 shutdown_connections 2024-09-13T17:03:20.648 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:20.603+0000 7f21c1e8b640 1 -- 172.21.15.115:0/1325176841 wait complete. 2024-09-13T17:03:20.648 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:20.604+0000 7f21c1e8b640 1 Processor -- start 2024-09-13T17:03:20.648 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:20.604+0000 7f21c1e8b640 1 -- start start 2024-09-13T17:03:20.648 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:20.604+0000 7f21c1e8b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21bc100690 0x7f21bc195600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:03:20.648 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:20.604+0000 7f21c1e8b640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f21bc102fc0 0x7f21bc195b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:03:20.649 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:20.604+0000 7f21c1e8b640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21bc196110 con 0x7f21bc100690 2024-09-13T17:03:20.649 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:20.604+0000 7f21c1e8b640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21bc196280 con 0x7f21bc102fc0 2024-09-13T17:03:20.649 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:20.604+0000 7f21bb7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21bc100690 0x7f21bc195600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:03:20.649 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:20.604+0000 7f21bb7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21bc100690 0x7f21bc195600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52104/0 (socket says 172.21.15.115:52104) 2024-09-13T17:03:20.649 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:20.604+0000 7f21bb7fe640 1 -- 172.21.15.115:0/806529123 learned_addr learned my addr 172.21.15.115:0/806529123 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:03:20.649 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:20.604+0000 7f21baffd640 1 --2- 172.21.15.115:0/806529123 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f21bc102fc0 0x7f21bc195b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:03:20.649 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:20.604+0000 7f21bb7fe640 1 -- 172.21.15.115:0/806529123 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f21bc102fc0 msgr2=0x7f21bc195b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:20.649 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:20.604+0000 7f21bb7fe640 1 --2- 172.21.15.115:0/806529123 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f21bc102fc0 0x7f21bc195b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:20.649 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:20.604+0000 7f21bb7fe640 1 -- 172.21.15.115:0/806529123 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21b0009560 con 0x7f21bc100690 2024-09-13T17:03:20.649 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:20.605+0000 7f21bb7fe640 1 --2- 172.21.15.115:0/806529123 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21bc100690 0x7f21bc195600 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f21ac00b450 tx=0x7f21ac00b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:03:20.649 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:20.605+0000 7f21b8ff9640 1 -- 172.21.15.115:0/806529123 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f21ac011860 con 0x7f21bc100690 2024-09-13T17:03:20.649 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:20.605+0000 7f21b8ff9640 1 -- 172.21.15.115:0/806529123 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f21ac011e60 con 0x7f21bc100690 2024-09-13T17:03:20.650 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:20.605+0000 7f21c1e8b640 1 -- 172.21.15.115:0/806529123 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21bc19ad20 con 0x7f21bc100690 2024-09-13T17:03:20.650 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:20.605+0000 7f21b8ff9640 1 -- 172.21.15.115:0/806529123 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f21ac00f340 con 0x7f21bc100690 2024-09-13T17:03:20.650 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:20.605+0000 7f21c1e8b640 1 -- 172.21.15.115:0/806529123 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21bc19b260 con 0x7f21bc100690 2024-09-13T17:03:20.650 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:20.606+0000 7f21c1e8b640 1 -- 172.21.15.115:0/806529123 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21bc108660 con 0x7f21bc100690 2024-09-13T17:03:20.650 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:20.606+0000 7f21b8ff9640 1 -- 172.21.15.115:0/806529123 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f21ac0103e0 con 0x7f21bc100690 2024-09-13T17:03:20.650 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:20.607+0000 7f21b8ff9640 1 --2- 172.21.15.115:0/806529123 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f21a406cc60 0x7f21a406f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:03:20.650 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:20.607+0000 7f21baffd640 1 --2- 172.21.15.115:0/806529123 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f21a406cc60 0x7f21a406f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:03:20.650 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:20.607+0000 7f21b8ff9640 1 -- 172.21.15.115:0/806529123 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f21ac08bfd0 con 0x7f21bc100690 2024-09-13T17:03:20.650 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:20.607+0000 7f21baffd640 1 --2- 172.21.15.115:0/806529123 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f21a406cc60 0x7f21a406f120 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f21b0000c00 tx=0x7f21b0031400 comp rx=0 tx=0).ready entity=mgr.14207 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:03:20.650 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:20.611+0000 7f21b8ff9640 1 -- 172.21.15.115:0/806529123 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f21ac056420 con 0x7f21bc100690 2024-09-13T17:03:20.807 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:20.806+0000 7f21c1e8b640 1 -- 172.21.15.115:0/806529123 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f21bc19b8b0 con 0x7f21bc100690 2024-09-13T17:03:20.807 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:20.806+0000 7f21b8ff9640 1 -- 172.21.15.115:0/806529123 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 4 v4) v1 ==== 75+0+1287 (secure 0 0 0) 0x7f21ac059a40 con 0x7f21bc100690 2024-09-13T17:03:20.808 INFO:teuthology.orchestra.run.smithi115.stdout:e4 2024-09-13T17:03:20.808 INFO:teuthology.orchestra.run.smithi115.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T17:03:20.808 INFO:teuthology.orchestra.run.smithi115.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T17:03:20.808 INFO:teuthology.orchestra.run.smithi115.stdout:legacy client fscid: 1 2024-09-13T17:03:20.808 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:03:20.808 INFO:teuthology.orchestra.run.smithi115.stdout:Filesystem 'cephfs' (1) 2024-09-13T17:03:20.808 INFO:teuthology.orchestra.run.smithi115.stdout:fs_name cephfs 2024-09-13T17:03:20.808 INFO:teuthology.orchestra.run.smithi115.stdout:epoch 4 2024-09-13T17:03:20.808 INFO:teuthology.orchestra.run.smithi115.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T17:03:20.808 INFO:teuthology.orchestra.run.smithi115.stdout:created 2024-09-13T17:03:16.313116+0000 2024-09-13T17:03:20.809 INFO:teuthology.orchestra.run.smithi115.stdout:modified 2024-09-13T17:03:20.333512+0000 2024-09-13T17:03:20.809 INFO:teuthology.orchestra.run.smithi115.stdout:tableserver 0 2024-09-13T17:03:20.809 INFO:teuthology.orchestra.run.smithi115.stdout:root 0 2024-09-13T17:03:20.809 INFO:teuthology.orchestra.run.smithi115.stdout:session_timeout 60 2024-09-13T17:03:20.809 INFO:teuthology.orchestra.run.smithi115.stdout:session_autoclose 300 2024-09-13T17:03:20.809 INFO:teuthology.orchestra.run.smithi115.stdout:max_file_size 1099511627776 2024-09-13T17:03:20.809 INFO:teuthology.orchestra.run.smithi115.stdout:max_xattr_size 65536 2024-09-13T17:03:20.809 INFO:teuthology.orchestra.run.smithi115.stdout:required_client_features {} 2024-09-13T17:03:20.809 INFO:teuthology.orchestra.run.smithi115.stdout:last_failure 0 2024-09-13T17:03:20.809 INFO:teuthology.orchestra.run.smithi115.stdout:last_failure_osd_epoch 0 2024-09-13T17:03:20.809 INFO:teuthology.orchestra.run.smithi115.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T17:03:20.809 INFO:teuthology.orchestra.run.smithi115.stdout:max_mds 1 2024-09-13T17:03:20.809 INFO:teuthology.orchestra.run.smithi115.stdout:in 0 2024-09-13T17:03:20.810 INFO:teuthology.orchestra.run.smithi115.stdout:up {0=14456} 2024-09-13T17:03:20.810 INFO:teuthology.orchestra.run.smithi115.stdout:failed 2024-09-13T17:03:20.810 INFO:teuthology.orchestra.run.smithi115.stdout:damaged 2024-09-13T17:03:20.810 INFO:teuthology.orchestra.run.smithi115.stdout:stopped 2024-09-13T17:03:20.810 INFO:teuthology.orchestra.run.smithi115.stdout:data_pools [3] 2024-09-13T17:03:20.810 INFO:teuthology.orchestra.run.smithi115.stdout:metadata_pool 2 2024-09-13T17:03:20.810 INFO:teuthology.orchestra.run.smithi115.stdout:inline_data disabled 2024-09-13T17:03:20.810 INFO:teuthology.orchestra.run.smithi115.stdout:balancer 2024-09-13T17:03:20.810 INFO:teuthology.orchestra.run.smithi115.stdout:bal_rank_mask -1 2024-09-13T17:03:20.810 INFO:teuthology.orchestra.run.smithi115.stdout:standby_count_wanted 0 2024-09-13T17:03:20.810 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi115.hbtxod{0:14456} state up:creating seq 1 addr [v2:172.21.15.115:6826/1900336545,v1:172.21.15.115:6827/1900336545] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T17:03:20.810 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:03:20.810 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:03:20.811 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 4 2024-09-13T17:03:20.811 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:20.808+0000 7f21c1e8b640 1 -- 172.21.15.115:0/806529123 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f21a406cc60 msgr2=0x7f21a406f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:20.811 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:20.808+0000 7f21c1e8b640 1 --2- 172.21.15.115:0/806529123 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f21a406cc60 0x7f21a406f120 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f21b0000c00 tx=0x7f21b0031400 comp rx=0 tx=0).stop 2024-09-13T17:03:20.811 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:20.808+0000 7f21c1e8b640 1 -- 172.21.15.115:0/806529123 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21bc100690 msgr2=0x7f21bc195600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:20.811 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:20.808+0000 7f21c1e8b640 1 --2- 172.21.15.115:0/806529123 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21bc100690 0x7f21bc195600 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f21ac00b450 tx=0x7f21ac00b910 comp rx=0 tx=0).stop 2024-09-13T17:03:20.811 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:20.809+0000 7f21c1e8b640 1 -- 172.21.15.115:0/806529123 shutdown_connections 2024-09-13T17:03:20.812 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:20.809+0000 7f21c1e8b640 1 --2- 172.21.15.115:0/806529123 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f21a406cc60 0x7f21a406f120 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:20.812 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:20.809+0000 7f21c1e8b640 1 --2- 172.21.15.115:0/806529123 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f21bc102fc0 0x7f21bc195b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:20.812 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:20.809+0000 7f21c1e8b640 1 --2- 172.21.15.115:0/806529123 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21bc100690 0x7f21bc195600 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:20.812 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:20.809+0000 7f21c1e8b640 1 -- 172.21.15.115:0/806529123 >> 172.21.15.115:0/806529123 conn(0x7f21bc0fa230 msgr2=0x7f21bc0fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:03:20.812 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:20.809+0000 7f21c1e8b640 1 -- 172.21.15.115:0/806529123 shutdown_connections 2024-09-13T17:03:20.812 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:20.809+0000 7f21c1e8b640 1 -- 172.21.15.115:0/806529123 wait complete. 2024-09-13T17:03:21.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:21 smithi115 ceph-mon[27708]: Deploying daemon mds.cephfs.smithi195.qzghxj on smithi195 2024-09-13T17:03:21.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:21 smithi115 ceph-mon[27708]: mds.? [v2:172.21.15.115:6826/1900336545,v1:172.21.15.115:6827/1900336545] up:boot 2024-09-13T17:03:21.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:21 smithi115 ceph-mon[27708]: daemon mds.cephfs.smithi115.hbtxod assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-09-13T17:03:21.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:21 smithi115 ceph-mon[27708]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-13T17:03:21.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:21 smithi115 ceph-mon[27708]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-13T17:03:21.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:21 smithi115 ceph-mon[27708]: Cluster is now healthy 2024-09-13T17:03:21.430 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:21 smithi115 ceph-mon[27708]: fsmap cephfs:0 1 up:standby 2024-09-13T17:03:21.430 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:21 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi115.hbtxod"}]: dispatch 2024-09-13T17:03:21.430 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:21 smithi115 ceph-mon[27708]: fsmap cephfs:1 {0=cephfs.smithi115.hbtxod=up:creating} 2024-09-13T17:03:21.430 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:21 smithi115 ceph-mon[27708]: daemon mds.cephfs.smithi115.hbtxod is now active in filesystem cephfs as rank 0 2024-09-13T17:03:21.430 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:21 smithi115 ceph-mon[27708]: from='client.? 172.21.15.115:0/806529123' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T17:03:21.600 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:21 smithi195 ceph-mon[34981]: Deploying daemon mds.cephfs.smithi195.qzghxj on smithi195 2024-09-13T17:03:21.600 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:21 smithi195 ceph-mon[34981]: mds.? [v2:172.21.15.115:6826/1900336545,v1:172.21.15.115:6827/1900336545] up:boot 2024-09-13T17:03:21.601 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:21 smithi195 ceph-mon[34981]: daemon mds.cephfs.smithi115.hbtxod assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-09-13T17:03:21.601 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:21 smithi195 ceph-mon[34981]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-13T17:03:21.601 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:21 smithi195 ceph-mon[34981]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-13T17:03:21.601 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:21 smithi195 ceph-mon[34981]: Cluster is now healthy 2024-09-13T17:03:21.601 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:21 smithi195 ceph-mon[34981]: fsmap cephfs:0 1 up:standby 2024-09-13T17:03:21.601 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:21 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi115.hbtxod"}]: dispatch 2024-09-13T17:03:21.601 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:21 smithi195 ceph-mon[34981]: fsmap cephfs:1 {0=cephfs.smithi115.hbtxod=up:creating} 2024-09-13T17:03:21.601 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:21 smithi195 ceph-mon[34981]: daemon mds.cephfs.smithi115.hbtxod is now active in filesystem cephfs as rank 0 2024-09-13T17:03:21.601 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:21 smithi195 ceph-mon[34981]: from='client.? 172.21.15.115:0/806529123' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T17:03:21.623 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T17:03:21.633 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi115.front.sepia.ceph.com 2024-09-13T17:03:21.634 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -- bash -c 'ceph fs set cephfs max_mds 1' 2024-09-13T17:03:21.833 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T17:03:22.576 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:22 smithi195 ceph-mon[34981]: pgmap v179: 65 pgs: 8 creating+peering, 4 unknown, 53 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:03:22.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:22 smithi195 ceph-mon[34981]: mds.? [v2:172.21.15.115:6826/1900336545,v1:172.21.15.115:6827/1900336545] up:active 2024-09-13T17:03:22.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:22 smithi195 ceph-mon[34981]: fsmap cephfs:1 {0=cephfs.smithi115.hbtxod=up:active} 2024-09-13T17:03:22.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:22 smithi115 ceph-mon[27708]: pgmap v179: 65 pgs: 8 creating+peering, 4 unknown, 53 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:03:22.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:22 smithi115 ceph-mon[27708]: mds.? [v2:172.21.15.115:6826/1900336545,v1:172.21.15.115:6827/1900336545] up:active 2024-09-13T17:03:22.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:22 smithi115 ceph-mon[27708]: fsmap cephfs:1 {0=cephfs.smithi115.hbtxod=up:active} 2024-09-13T17:03:23.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:23 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:03:23.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:23 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:03:23.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:23 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:03:23.930 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:23 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi115.ijznvr", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T17:03:23.930 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:23 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi115.ijznvr", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T17:03:23.930 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:23 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:03:23.930 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:23 smithi115 ceph-mon[27708]: Deploying daemon mds.cephfs.smithi115.ijznvr on smithi115 2024-09-13T17:03:23.930 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:23 smithi115 ceph-mon[27708]: pgmap v180: 65 pgs: 65 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 444 B/s wr, 3 op/s 2024-09-13T17:03:23.930 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:23 smithi115 ceph-mon[27708]: mds.? [v2:172.21.15.195:6824/844627158,v1:172.21.15.195:6825/844627158] up:boot 2024-09-13T17:03:23.930 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:23 smithi115 ceph-mon[27708]: fsmap cephfs:1 {0=cephfs.smithi115.hbtxod=up:active} 1 up:standby 2024-09-13T17:03:23.930 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:23 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.qzghxj"}]: dispatch 2024-09-13T17:03:23.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:23 smithi115 ceph-mon[27708]: fsmap cephfs:1 {0=cephfs.smithi115.hbtxod=up:active} 1 up:standby 2024-09-13T17:03:23.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:23 smithi115 ceph-mon[27708]: from='client.? 172.21.15.115:0/3357317032' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-09-13T17:03:24.058 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:23.432+0000 7fe123083640 1 -- 172.21.15.115:0/3320089940 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe11c0ffc80 msgr2=0x7fe11c100100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:24.058 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:23.432+0000 7fe123083640 1 --2- 172.21.15.115:0/3320089940 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe11c0ffc80 0x7fe11c100100 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe108009880 tx=0x7fe10802a4a0 comp rx=0 tx=0).stop 2024-09-13T17:03:24.058 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:23.432+0000 7fe123083640 1 -- 172.21.15.115:0/3320089940 shutdown_connections 2024-09-13T17:03:24.058 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:23.432+0000 7fe123083640 1 --2- 172.21.15.115:0/3320089940 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe11c0ffc80 0x7fe11c100100 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:24.058 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:23.432+0000 7fe123083640 1 --2- 172.21.15.115:0/3320089940 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe11c0fea80 0x7fe11c0fee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:24.058 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:23.432+0000 7fe123083640 1 -- 172.21.15.115:0/3320089940 >> 172.21.15.115:0/3320089940 conn(0x7fe11c0fa230 msgr2=0x7fe11c0fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:03:24.058 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:23.432+0000 7fe123083640 1 -- 172.21.15.115:0/3320089940 shutdown_connections 2024-09-13T17:03:24.058 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:23.432+0000 7fe123083640 1 -- 172.21.15.115:0/3320089940 wait complete. 2024-09-13T17:03:24.059 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:23.432+0000 7fe123083640 1 Processor -- start 2024-09-13T17:03:24.059 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:23.433+0000 7fe123083640 1 -- start start 2024-09-13T17:03:24.059 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:23.433+0000 7fe123083640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe11c0fea80 0x7fe11c1943f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:03:24.059 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:23.433+0000 7fe123083640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe11c0ffc80 0x7fe11c194930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:03:24.059 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:23.433+0000 7fe123083640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe11c194e70 con 0x7fe11c0ffc80 2024-09-13T17:03:24.059 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:23.433+0000 7fe123083640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe11c194fe0 con 0x7fe11c0fea80 2024-09-13T17:03:24.059 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:23.433+0000 7fe11bfff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe11c0ffc80 0x7fe11c194930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:03:24.059 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:23.433+0000 7fe11bfff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe11c0ffc80 0x7fe11c194930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52124/0 (socket says 172.21.15.115:52124) 2024-09-13T17:03:24.059 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:23.433+0000 7fe11bfff640 1 -- 172.21.15.115:0/3357317032 learned_addr learned my addr 172.21.15.115:0/3357317032 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:03:24.059 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:23.433+0000 7fe120e1f640 1 --2- 172.21.15.115:0/3357317032 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe11c0fea80 0x7fe11c1943f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:03:24.059 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:23.433+0000 7fe11bfff640 1 -- 172.21.15.115:0/3357317032 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe11c0fea80 msgr2=0x7fe11c1943f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:24.059 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:23.433+0000 7fe11bfff640 1 --2- 172.21.15.115:0/3357317032 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe11c0fea80 0x7fe11c1943f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:24.059 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:23.433+0000 7fe11bfff640 1 -- 172.21.15.115:0/3357317032 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe108009560 con 0x7fe11c0ffc80 2024-09-13T17:03:24.060 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:23.433+0000 7fe11bfff640 1 --2- 172.21.15.115:0/3357317032 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe11c0ffc80 0x7fe11c194930 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe108031460 tx=0x7fe1080056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:03:24.060 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:23.433+0000 7fe119ffb640 1 -- 172.21.15.115:0/3357317032 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe10803e070 con 0x7fe11c0ffc80 2024-09-13T17:03:24.060 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:23.434+0000 7fe119ffb640 1 -- 172.21.15.115:0/3357317032 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe108004be0 con 0x7fe11c0ffc80 2024-09-13T17:03:24.060 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:23.434+0000 7fe123083640 1 -- 172.21.15.115:0/3357317032 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe11c068400 con 0x7fe11c0ffc80 2024-09-13T17:03:24.060 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:23.434+0000 7fe119ffb640 1 -- 172.21.15.115:0/3357317032 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe108031990 con 0x7fe11c0ffc80 2024-09-13T17:03:24.060 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:23.434+0000 7fe123083640 1 -- 172.21.15.115:0/3357317032 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe11c068920 con 0x7fe11c0ffc80 2024-09-13T17:03:24.060 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:23.435+0000 7fe123083640 1 -- 172.21.15.115:0/3357317032 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe11c107530 con 0x7fe11c0ffc80 2024-09-13T17:03:24.060 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:23.435+0000 7fe119ffb640 1 -- 172.21.15.115:0/3357317032 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fe108003c00 con 0x7fe11c0ffc80 2024-09-13T17:03:24.060 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:23.436+0000 7fe119ffb640 1 --2- 172.21.15.115:0/3357317032 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fe10c06cc50 0x7fe10c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:03:24.060 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:23.436+0000 7fe120e1f640 1 --2- 172.21.15.115:0/3357317032 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fe10c06cc50 0x7fe10c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:03:24.060 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:23.436+0000 7fe119ffb640 1 -- 172.21.15.115:0/3357317032 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7fe1080ae830 con 0x7fe11c0ffc80 2024-09-13T17:03:24.060 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:23.436+0000 7fe120e1f640 1 --2- 172.21.15.115:0/3357317032 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fe10c06cc50 0x7fe10c06f110 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe11c0ffae0 tx=0x7fe110005f90 comp rx=0 tx=0).ready entity=mgr.14207 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:03:24.061 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:23.440+0000 7fe119ffb640 1 -- 172.21.15.115:0/3357317032 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe108078c00 con 0x7fe11c0ffc80 2024-09-13T17:03:24.061 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:23.644+0000 7fe123083640 1 -- 172.21.15.115:0/3357317032 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) v1 -- 0x7fe11c068df0 con 0x7fe11c0ffc80 2024-09-13T17:03:24.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:23 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:03:24.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:23 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:03:24.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:23 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:03:24.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:23 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi115.ijznvr", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T17:03:24.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:23 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi115.ijznvr", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T17:03:24.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:23 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:03:24.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:23 smithi195 ceph-mon[34981]: Deploying daemon mds.cephfs.smithi115.ijznvr on smithi115 2024-09-13T17:03:24.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:23 smithi195 ceph-mon[34981]: pgmap v180: 65 pgs: 65 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 444 B/s wr, 3 op/s 2024-09-13T17:03:24.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:23 smithi195 ceph-mon[34981]: mds.? [v2:172.21.15.195:6824/844627158,v1:172.21.15.195:6825/844627158] up:boot 2024-09-13T17:03:24.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:23 smithi195 ceph-mon[34981]: fsmap cephfs:1 {0=cephfs.smithi115.hbtxod=up:active} 1 up:standby 2024-09-13T17:03:24.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:23 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.qzghxj"}]: dispatch 2024-09-13T17:03:24.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:23 smithi195 ceph-mon[34981]: fsmap cephfs:1 {0=cephfs.smithi115.hbtxod=up:active} 1 up:standby 2024-09-13T17:03:24.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:23 smithi195 ceph-mon[34981]: from='client.? 172.21.15.115:0/3357317032' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-09-13T17:03:24.353 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:24.352+0000 7fe119ffb640 1 -- 172.21.15.115:0/3357317032 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v8) v1 ==== 105+0+0 (secure 0 0 0) 0x7fe10807c220 con 0x7fe11c0ffc80 2024-09-13T17:03:24.357 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:24.355+0000 7fe123083640 1 -- 172.21.15.115:0/3357317032 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fe10c06cc50 msgr2=0x7fe10c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:24.357 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:24.355+0000 7fe123083640 1 --2- 172.21.15.115:0/3357317032 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fe10c06cc50 0x7fe10c06f110 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe11c0ffae0 tx=0x7fe110005f90 comp rx=0 tx=0).stop 2024-09-13T17:03:24.357 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:24.355+0000 7fe123083640 1 -- 172.21.15.115:0/3357317032 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe11c0ffc80 msgr2=0x7fe11c194930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:24.357 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:24.355+0000 7fe123083640 1 --2- 172.21.15.115:0/3357317032 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe11c0ffc80 0x7fe11c194930 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe108031460 tx=0x7fe1080056e0 comp rx=0 tx=0).stop 2024-09-13T17:03:24.358 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:24.355+0000 7fe123083640 1 -- 172.21.15.115:0/3357317032 shutdown_connections 2024-09-13T17:03:24.358 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:24.355+0000 7fe123083640 1 --2- 172.21.15.115:0/3357317032 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fe10c06cc50 0x7fe10c06f110 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:24.358 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:24.355+0000 7fe123083640 1 --2- 172.21.15.115:0/3357317032 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe11c0ffc80 0x7fe11c194930 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:24.358 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:24.355+0000 7fe123083640 1 --2- 172.21.15.115:0/3357317032 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe11c0fea80 0x7fe11c1943f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:24.358 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:24.355+0000 7fe123083640 1 -- 172.21.15.115:0/3357317032 >> 172.21.15.115:0/3357317032 conn(0x7fe11c0fa230 msgr2=0x7fe11c102eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:03:24.358 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:24.355+0000 7fe123083640 1 -- 172.21.15.115:0/3357317032 shutdown_connections 2024-09-13T17:03:24.358 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:24.355+0000 7fe123083640 1 -- 172.21.15.115:0/3357317032 wait complete. 2024-09-13T17:03:25.237 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T17:03:25.248 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi115.front.sepia.ceph.com 2024-09-13T17:03:25.248 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -- bash -c 'ceph fs set cephfs allow_standby_replay true' 2024-09-13T17:03:25.576 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:25 smithi195 ceph-mon[34981]: from='client.? 172.21.15.115:0/3357317032' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-09-13T17:03:25.576 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:25 smithi195 ceph-mon[34981]: fsmap cephfs:1 {0=cephfs.smithi115.hbtxod=up:active} 1 up:standby 2024-09-13T17:03:25.627 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:25 smithi115 ceph-mon[27708]: from='client.? 172.21.15.115:0/3357317032' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-09-13T17:03:25.627 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:25 smithi115 ceph-mon[27708]: fsmap cephfs:1 {0=cephfs.smithi115.hbtxod=up:active} 1 up:standby 2024-09-13T17:03:25.943 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T17:03:26.576 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:26 smithi195 ceph-mon[34981]: pgmap v181: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-13T17:03:26.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:26 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:03:26.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:26 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:03:26.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:26 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:03:26.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:26 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi195.aevvgz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T17:03:26.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:26 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi195.aevvgz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T17:03:26.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:26 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:03:26.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:26 smithi115 ceph-mon[27708]: pgmap v181: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-13T17:03:26.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:26 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:03:26.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:26 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:03:26.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:26 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:03:26.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:26 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi195.aevvgz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T17:03:26.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:26 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi195.aevvgz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T17:03:26.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:26 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:03:27.471 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:27 smithi195 ceph-mon[34981]: Deploying daemon mds.cephfs.smithi195.aevvgz on smithi195 2024-09-13T17:03:27.471 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:27 smithi195 ceph-mon[34981]: mds.? [v2:172.21.15.115:6828/4128583274,v1:172.21.15.115:6829/4128583274] up:boot 2024-09-13T17:03:27.471 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:27 smithi195 ceph-mon[34981]: fsmap cephfs:1 {0=cephfs.smithi115.hbtxod=up:active} 2 up:standby 2024-09-13T17:03:27.471 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:27 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi115.ijznvr"}]: dispatch 2024-09-13T17:03:27.530 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:27 smithi115 ceph-mon[27708]: Deploying daemon mds.cephfs.smithi195.aevvgz on smithi195 2024-09-13T17:03:27.530 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:27 smithi115 ceph-mon[27708]: mds.? [v2:172.21.15.115:6828/4128583274,v1:172.21.15.115:6829/4128583274] up:boot 2024-09-13T17:03:27.530 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:27 smithi115 ceph-mon[27708]: fsmap cephfs:1 {0=cephfs.smithi115.hbtxod=up:active} 2 up:standby 2024-09-13T17:03:27.530 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:27 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi115.ijznvr"}]: dispatch 2024-09-13T17:03:27.532 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:27.529+0000 7f2e52142640 1 -- 172.21.15.115:0/1053812554 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e4c100640 msgr2=0x7f2e4c102a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:27.532 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:27.529+0000 7f2e52142640 1 --2- 172.21.15.115:0/1053812554 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e4c100640 0x7f2e4c102a30 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c009c20 tx=0x7f2e3c02a970 comp rx=0 tx=0).stop 2024-09-13T17:03:27.532 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:27.529+0000 7f2e52142640 1 -- 172.21.15.115:0/1053812554 shutdown_connections 2024-09-13T17:03:27.532 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:27.529+0000 7f2e52142640 1 --2- 172.21.15.115:0/1053812554 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2e4c102f70 0x7f2e4c105360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:27.532 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:27.529+0000 7f2e52142640 1 --2- 172.21.15.115:0/1053812554 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e4c100640 0x7f2e4c102a30 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:27.532 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:27.529+0000 7f2e52142640 1 -- 172.21.15.115:0/1053812554 >> 172.21.15.115:0/1053812554 conn(0x7f2e4c0fa1c0 msgr2=0x7f2e4c0fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:03:27.532 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:27.529+0000 7f2e52142640 1 -- 172.21.15.115:0/1053812554 shutdown_connections 2024-09-13T17:03:27.532 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:27.529+0000 7f2e52142640 1 -- 172.21.15.115:0/1053812554 wait complete. 2024-09-13T17:03:27.533 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:27.530+0000 7f2e52142640 1 Processor -- start 2024-09-13T17:03:27.533 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:27.530+0000 7f2e52142640 1 -- start start 2024-09-13T17:03:27.533 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:27.530+0000 7f2e52142640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e4c100640 0x7f2e4c0fffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:03:27.533 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:27.530+0000 7f2e52142640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2e4c102f70 0x7f2e4c0fe5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:03:27.533 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:27.530+0000 7f2e52142640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4c0feb30 con 0x7f2e4c100640 2024-09-13T17:03:27.533 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:27.530+0000 7f2e52142640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4c0feca0 con 0x7f2e4c102f70 2024-09-13T17:03:27.533 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:27.530+0000 7f2e4b7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e4c100640 0x7f2e4c0fffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:03:27.533 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:27.530+0000 7f2e4b7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e4c100640 0x7f2e4c0fffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:53942/0 (socket says 172.21.15.115:53942) 2024-09-13T17:03:27.533 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:27.530+0000 7f2e4b7fe640 1 -- 172.21.15.115:0/3908133213 learned_addr learned my addr 172.21.15.115:0/3908133213 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:03:27.533 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:27.530+0000 7f2e4affd640 1 --2- 172.21.15.115:0/3908133213 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2e4c102f70 0x7f2e4c0fe5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:03:27.533 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:27.531+0000 7f2e4b7fe640 1 -- 172.21.15.115:0/3908133213 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2e4c102f70 msgr2=0x7f2e4c0fe5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:27.533 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:27.531+0000 7f2e4b7fe640 1 --2- 172.21.15.115:0/3908133213 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2e4c102f70 0x7f2e4c0fe5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:27.533 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:27.531+0000 7f2e4b7fe640 1 -- 172.21.15.115:0/3908133213 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e3c009900 con 0x7f2e4c100640 2024-09-13T17:03:27.534 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:27.531+0000 7f2e4b7fe640 1 --2- 172.21.15.115:0/3908133213 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e4c100640 0x7f2e4c0fffa0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c02fb90 tx=0x7f2e3c02f5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:03:27.534 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:27.531+0000 7f2e48ff9640 1 -- 172.21.15.115:0/3908133213 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e3c030840 con 0x7f2e4c100640 2024-09-13T17:03:27.534 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:27.531+0000 7f2e52142640 1 -- 172.21.15.115:0/3908133213 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e4c0fef20 con 0x7f2e4c100640 2024-09-13T17:03:27.534 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:27.531+0000 7f2e48ff9640 1 -- 172.21.15.115:0/3908133213 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2e3c004040 con 0x7f2e4c100640 2024-09-13T17:03:27.534 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:27.531+0000 7f2e48ff9640 1 -- 172.21.15.115:0/3908133213 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e3c039680 con 0x7f2e4c100640 2024-09-13T17:03:27.534 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:27.531+0000 7f2e52142640 1 -- 172.21.15.115:0/3908133213 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e4c19d600 con 0x7f2e4c100640 2024-09-13T17:03:27.535 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:27.532+0000 7f2e52142640 1 -- 172.21.15.115:0/3908133213 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e4c100a20 con 0x7f2e4c100640 2024-09-13T17:03:27.535 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:27.532+0000 7f2e48ff9640 1 -- 172.21.15.115:0/3908133213 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f2e3c00a040 con 0x7f2e4c100640 2024-09-13T17:03:27.535 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:27.533+0000 7f2e48ff9640 1 --2- 172.21.15.115:0/3908133213 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f2e3406cc50 0x7f2e3406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:03:27.535 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:27.533+0000 7f2e48ff9640 1 -- 172.21.15.115:0/3908133213 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f2e3c02c040 con 0x7f2e4c100640 2024-09-13T17:03:27.535 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:27.533+0000 7f2e4affd640 1 --2- 172.21.15.115:0/3908133213 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f2e3406cc50 0x7f2e3406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:03:27.535 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:27.533+0000 7f2e4affd640 1 --2- 172.21.15.115:0/3908133213 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f2e3406cc50 0x7f2e3406f110 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2e40005fd0 tx=0x7f2e40005850 comp rx=0 tx=0).ready entity=mgr.14207 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:03:27.538 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:27.537+0000 7f2e48ff9640 1 -- 172.21.15.115:0/3908133213 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f2e3c077ac0 con 0x7f2e4c100640 2024-09-13T17:03:27.737 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:27.735+0000 7f2e52142640 1 -- 172.21.15.115:0/3908133213 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7f2e4c108620 con 0x7f2e4c100640 2024-09-13T17:03:28.370 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:28.369+0000 7f2e48ff9640 1 -- 172.21.15.115:0/3908133213 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v10) v1 ==== 121+0+0 (secure 0 0 0) 0x7f2e3c07b0e0 con 0x7f2e4c100640 2024-09-13T17:03:28.372 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:28.371+0000 7f2e52142640 1 -- 172.21.15.115:0/3908133213 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f2e3406cc50 msgr2=0x7f2e3406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:28.373 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:28.371+0000 7f2e52142640 1 --2- 172.21.15.115:0/3908133213 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f2e3406cc50 0x7f2e3406f110 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2e40005fd0 tx=0x7f2e40005850 comp rx=0 tx=0).stop 2024-09-13T17:03:28.373 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:28.371+0000 7f2e52142640 1 -- 172.21.15.115:0/3908133213 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e4c100640 msgr2=0x7f2e4c0fffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:28.373 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:28.371+0000 7f2e52142640 1 --2- 172.21.15.115:0/3908133213 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e4c100640 0x7f2e4c0fffa0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c02fb90 tx=0x7f2e3c02f5f0 comp rx=0 tx=0).stop 2024-09-13T17:03:28.373 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:28.371+0000 7f2e52142640 1 -- 172.21.15.115:0/3908133213 shutdown_connections 2024-09-13T17:03:28.373 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:28.371+0000 7f2e52142640 1 --2- 172.21.15.115:0/3908133213 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f2e3406cc50 0x7f2e3406f110 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:28.373 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:28.371+0000 7f2e52142640 1 --2- 172.21.15.115:0/3908133213 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2e4c102f70 0x7f2e4c0fe5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:28.373 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:28.371+0000 7f2e52142640 1 --2- 172.21.15.115:0/3908133213 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e4c100640 0x7f2e4c0fffa0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:28.373 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:28.371+0000 7f2e52142640 1 -- 172.21.15.115:0/3908133213 >> 172.21.15.115:0/3908133213 conn(0x7f2e4c0fa1c0 msgr2=0x7f2e4c0fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:03:28.373 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:28.372+0000 7f2e52142640 1 -- 172.21.15.115:0/3908133213 shutdown_connections 2024-09-13T17:03:28.374 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:28.372+0000 7f2e52142640 1 -- 172.21.15.115:0/3908133213 wait complete. 2024-09-13T17:03:28.401 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:28 smithi195 ceph-mon[34981]: pgmap v182: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s wr, 4 op/s 2024-09-13T17:03:28.401 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:28 smithi195 ceph-mon[34981]: from='client.? 172.21.15.115:0/3908133213' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-13T17:03:28.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:28 smithi115 ceph-mon[27708]: pgmap v182: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s wr, 4 op/s 2024-09-13T17:03:28.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:28 smithi115 ceph-mon[27708]: from='client.? 172.21.15.115:0/3908133213' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-13T17:03:29.047 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T17:03:29.060 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi115.front.sepia.ceph.com 2024-09-13T17:03:29.060 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -- bash -c 'ceph fs set cephfs inline_data true --yes-i-really-really-mean-it' 2024-09-13T17:03:29.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:29 smithi195 ceph-mon[34981]: from='client.? 172.21.15.115:0/3908133213' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-13T17:03:29.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:29 smithi195 ceph-mon[34981]: fsmap cephfs:1 {0=cephfs.smithi115.hbtxod=up:active} 2 up:standby 2024-09-13T17:03:29.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:29 smithi195 ceph-mon[34981]: fsmap cephfs:1 {0=cephfs.smithi115.hbtxod=up:active} 1 up:standby-replay 1 up:standby 2024-09-13T17:03:29.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:29 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:03:29.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:29 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:03:29.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:29 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:03:29.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:29 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:03:29.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:29 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:03:29.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:29 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:03:29.578 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:29 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:03:29.578 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:29 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:03:29.637 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:29 smithi115 ceph-mon[27708]: from='client.? 172.21.15.115:0/3908133213' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-13T17:03:29.637 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:29 smithi115 ceph-mon[27708]: fsmap cephfs:1 {0=cephfs.smithi115.hbtxod=up:active} 2 up:standby 2024-09-13T17:03:29.637 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:29 smithi115 ceph-mon[27708]: fsmap cephfs:1 {0=cephfs.smithi115.hbtxod=up:active} 1 up:standby-replay 1 up:standby 2024-09-13T17:03:29.637 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:29 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:03:29.637 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:29 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:03:29.637 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:29 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:03:29.637 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:29 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:03:29.637 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:29 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:03:29.637 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:29 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:03:29.637 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:29 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:03:29.637 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:29 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:03:29.844 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T17:03:30.620 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:30 smithi115 ceph-mon[27708]: pgmap v183: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 469 B/s rd, 1.3 KiB/s wr, 4 op/s 2024-09-13T17:03:30.620 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:30 smithi115 ceph-mon[27708]: mds.? [v2:172.21.15.195:6826/8826118,v1:172.21.15.195:6827/8826118] up:boot 2024-09-13T17:03:30.620 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:30 smithi115 ceph-mon[27708]: fsmap cephfs:1 {0=cephfs.smithi115.hbtxod=up:active} 1 up:standby-replay 2 up:standby 2024-09-13T17:03:30.620 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:30 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.aevvgz"}]: dispatch 2024-09-13T17:03:30.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:30 smithi195 ceph-mon[34981]: pgmap v183: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 469 B/s rd, 1.3 KiB/s wr, 4 op/s 2024-09-13T17:03:30.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:30 smithi195 ceph-mon[34981]: mds.? [v2:172.21.15.195:6826/8826118,v1:172.21.15.195:6827/8826118] up:boot 2024-09-13T17:03:30.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:30 smithi195 ceph-mon[34981]: fsmap cephfs:1 {0=cephfs.smithi115.hbtxod=up:active} 1 up:standby-replay 2 up:standby 2024-09-13T17:03:30.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:30 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.aevvgz"}]: dispatch 2024-09-13T17:03:31.423 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:31 smithi115 ceph-mon[27708]: mds.? [v2:172.21.15.115:6828/4128583274,v1:172.21.15.115:6829/4128583274] up:standby 2024-09-13T17:03:31.424 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:31 smithi115 ceph-mon[27708]: Dropping low affinity standby-replay daemon mds.cephfs.smithi195.qzghxj in favor of higher affinity standby. 2024-09-13T17:03:31.424 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:31 smithi115 ceph-mon[27708]: fsmap cephfs:1 {0=cephfs.smithi115.hbtxod=up:active} 1 up:standby-replay 2 up:standby 2024-09-13T17:03:31.424 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:31 smithi115 ceph-mon[27708]: Dropping low affinity active daemon mds.cephfs.smithi115.hbtxod in favor of higher affinity standby. 2024-09-13T17:03:31.424 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:31 smithi115 ceph-mon[27708]: Replacing daemon mds.cephfs.smithi115.hbtxod as rank 0 with standby daemon mds.cephfs.smithi115.ijznvr 2024-09-13T17:03:31.424 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:31 smithi115 ceph-mon[27708]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-13T17:03:31.424 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:31 smithi115 ceph-mon[27708]: fsmap cephfs:1 {0=cephfs.smithi115.hbtxod=up:active} 1 up:standby-replay 1 up:standby 2024-09-13T17:03:31.424 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:31 smithi115 ceph-mon[27708]: osdmap e46: 6 total, 6 up, 6 in 2024-09-13T17:03:31.424 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:31 smithi115 ceph-mon[27708]: fsmap cephfs:1/1 {0=cephfs.smithi115.ijznvr=up:replay} 1 up:standby 2024-09-13T17:03:31.424 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:31 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:03:31.425 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:31 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:03:31.456 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:31.418+0000 7fb39bf9c640 1 -- 172.21.15.115:0/1053832294 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3940fe420 msgr2=0x7fb394100830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:31.456 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:31.418+0000 7fb39bf9c640 1 --2- 172.21.15.115:0/1053832294 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3940fe420 0x7fb394100830 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb384009880 tx=0x7fb38402a4a0 comp rx=0 tx=0).stop 2024-09-13T17:03:31.456 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:31.418+0000 7fb39bf9c640 1 -- 172.21.15.115:0/1053832294 shutdown_connections 2024-09-13T17:03:31.457 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:31.418+0000 7fb39bf9c640 1 --2- 172.21.15.115:0/1053832294 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb394100d70 0x7fb3941031e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:31.457 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:31.418+0000 7fb39bf9c640 1 --2- 172.21.15.115:0/1053832294 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3940fe420 0x7fb394100830 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:31.457 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:31.418+0000 7fb39bf9c640 1 -- 172.21.15.115:0/1053832294 >> 172.21.15.115:0/1053832294 conn(0x7fb3940fa230 msgr2=0x7fb3940fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:03:31.457 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:31.418+0000 7fb39bf9c640 1 -- 172.21.15.115:0/1053832294 shutdown_connections 2024-09-13T17:03:31.457 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:31.418+0000 7fb39bf9c640 1 -- 172.21.15.115:0/1053832294 wait complete. 2024-09-13T17:03:31.457 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:31.419+0000 7fb39bf9c640 1 Processor -- start 2024-09-13T17:03:31.457 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:31.419+0000 7fb39bf9c640 1 -- start start 2024-09-13T17:03:31.457 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:31.419+0000 7fb39bf9c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb3940fe420 0x7fb39419bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:03:31.457 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:31.419+0000 7fb39bf9c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb394100d70 0x7fb39419c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:03:31.457 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:31.419+0000 7fb39bf9c640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb39419c6e0 con 0x7fb394100d70 2024-09-13T17:03:31.457 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:31.419+0000 7fb39bf9c640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb39419c850 con 0x7fb3940fe420 2024-09-13T17:03:31.457 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:31.419+0000 7fb399537640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb394100d70 0x7fb39419c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:03:31.458 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:31.419+0000 7fb399537640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb394100d70 0x7fb39419c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:53988/0 (socket says 172.21.15.115:53988) 2024-09-13T17:03:31.458 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:31.419+0000 7fb399537640 1 -- 172.21.15.115:0/1103310631 learned_addr learned my addr 172.21.15.115:0/1103310631 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:03:31.458 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:31.419+0000 7fb399d38640 1 --2- 172.21.15.115:0/1103310631 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb3940fe420 0x7fb39419bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:03:31.458 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:31.419+0000 7fb399537640 1 -- 172.21.15.115:0/1103310631 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb3940fe420 msgr2=0x7fb39419bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:31.458 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:31.419+0000 7fb399537640 1 --2- 172.21.15.115:0/1103310631 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb3940fe420 0x7fb39419bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:31.458 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:31.419+0000 7fb399537640 1 -- 172.21.15.115:0/1103310631 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb384009560 con 0x7fb394100d70 2024-09-13T17:03:31.458 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:31.419+0000 7fb399d38640 1 --2- 172.21.15.115:0/1103310631 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb3940fe420 0x7fb39419bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:03:31.458 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:31.419+0000 7fb399537640 1 --2- 172.21.15.115:0/1103310631 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb394100d70 0x7fb39419c110 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb39000b450 tx=0x7fb39000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:03:31.458 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:31.419+0000 7fb38affd640 1 -- 172.21.15.115:0/1103310631 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb390011860 con 0x7fb394100d70 2024-09-13T17:03:31.458 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:31.420+0000 7fb38affd640 1 -- 172.21.15.115:0/1103310631 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb390011e60 con 0x7fb394100d70 2024-09-13T17:03:31.459 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:31.420+0000 7fb38affd640 1 -- 172.21.15.115:0/1103310631 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb39000f340 con 0x7fb394100d70 2024-09-13T17:03:31.459 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:31.420+0000 7fb39bf9c640 1 -- 172.21.15.115:0/1103310631 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3941a12f0 con 0x7fb394100d70 2024-09-13T17:03:31.459 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:31.420+0000 7fb39bf9c640 1 -- 172.21.15.115:0/1103310631 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3941a18c0 con 0x7fb394100d70 2024-09-13T17:03:31.459 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:31.421+0000 7fb39bf9c640 1 -- 172.21.15.115:0/1103310631 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb39410ecb0 con 0x7fb394100d70 2024-09-13T17:03:31.459 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:31.421+0000 7fb38affd640 1 -- 172.21.15.115:0/1103310631 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fb3900103e0 con 0x7fb394100d70 2024-09-13T17:03:31.459 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:31.421+0000 7fb38affd640 1 --2- 172.21.15.115:0/1103310631 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fb38006cc50 0x7fb38006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:03:31.459 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:31.422+0000 7fb38affd640 1 -- 172.21.15.115:0/1103310631 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fb39008c0b0 con 0x7fb394100d70 2024-09-13T17:03:31.459 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:31.422+0000 7fb399d38640 1 --2- 172.21.15.115:0/1103310631 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fb38006cc50 0x7fb38006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:03:31.459 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:31.422+0000 7fb399d38640 1 --2- 172.21.15.115:0/1103310631 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fb38006cc50 0x7fb38006f110 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb384031460 tx=0x7fb384005de0 comp rx=0 tx=0).ready entity=mgr.14207 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:03:31.459 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:31.426+0000 7fb38affd640 1 -- 172.21.15.115:0/1103310631 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fb3900564a0 con 0x7fb394100d70 2024-09-13T17:03:31.631 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:31.630+0000 7fb39bf9c640 1 -- 172.21.15.115:0/1103310631 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb39410ee40 con 0x7fb394100d70 2024-09-13T17:03:31.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:31 smithi195 ceph-mon[34981]: mds.? [v2:172.21.15.115:6828/4128583274,v1:172.21.15.115:6829/4128583274] up:standby 2024-09-13T17:03:31.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:31 smithi195 ceph-mon[34981]: Dropping low affinity standby-replay daemon mds.cephfs.smithi195.qzghxj in favor of higher affinity standby. 2024-09-13T17:03:31.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:31 smithi195 ceph-mon[34981]: fsmap cephfs:1 {0=cephfs.smithi115.hbtxod=up:active} 1 up:standby-replay 2 up:standby 2024-09-13T17:03:31.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:31 smithi195 ceph-mon[34981]: Dropping low affinity active daemon mds.cephfs.smithi115.hbtxod in favor of higher affinity standby. 2024-09-13T17:03:31.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:31 smithi195 ceph-mon[34981]: Replacing daemon mds.cephfs.smithi115.hbtxod as rank 0 with standby daemon mds.cephfs.smithi115.ijznvr 2024-09-13T17:03:31.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:31 smithi195 ceph-mon[34981]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-13T17:03:31.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:31 smithi195 ceph-mon[34981]: fsmap cephfs:1 {0=cephfs.smithi115.hbtxod=up:active} 1 up:standby-replay 1 up:standby 2024-09-13T17:03:31.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:31 smithi195 ceph-mon[34981]: osdmap e46: 6 total, 6 up, 6 in 2024-09-13T17:03:31.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:31 smithi195 ceph-mon[34981]: fsmap cephfs:1/1 {0=cephfs.smithi115.ijznvr=up:replay} 1 up:standby 2024-09-13T17:03:31.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:31 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:03:31.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:31 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:03:32.400 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:32.399+0000 7fb38affd640 1 -- 172.21.15.115:0/1103310631 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]=0 inline data enabled v17) v1 ==== 168+0+0 (secure 0 0 0) 0x7fb390059ac0 con 0x7fb394100d70 2024-09-13T17:03:32.400 INFO:teuthology.orchestra.run.smithi115.stderr:inline data enabled 2024-09-13T17:03:32.401 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:32 smithi115 ceph-mon[27708]: pgmap v185: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 716 B/s rd, 1.4 KiB/s wr, 5 op/s 2024-09-13T17:03:32.401 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:32 smithi115 ceph-mon[27708]: mds.? [v2:172.21.15.115:6828/4128583274,v1:172.21.15.115:6829/4128583274] up:reconnect 2024-09-13T17:03:32.401 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:32 smithi115 ceph-mon[27708]: mds.? [v2:172.21.15.195:6824/3335357704,v1:172.21.15.195:6825/3335357704] up:boot 2024-09-13T17:03:32.401 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:32 smithi115 ceph-mon[27708]: mds.? [v2:172.21.15.115:6826/1977394649,v1:172.21.15.115:6827/1977394649] up:boot 2024-09-13T17:03:32.401 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:32 smithi115 ceph-mon[27708]: fsmap cephfs:1/1 {0=cephfs.smithi115.ijznvr=up:reconnect} 3 up:standby 2024-09-13T17:03:32.401 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:32 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi115.hbtxod"}]: dispatch 2024-09-13T17:03:32.401 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:32 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.qzghxj"}]: dispatch 2024-09-13T17:03:32.401 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:32 smithi115 ceph-mon[27708]: from='client.? 172.21.15.115:0/1103310631' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-13T17:03:32.403 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:32.402+0000 7fb39bf9c640 1 -- 172.21.15.115:0/1103310631 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fb38006cc50 msgr2=0x7fb38006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:32.403 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:32.402+0000 7fb39bf9c640 1 --2- 172.21.15.115:0/1103310631 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fb38006cc50 0x7fb38006f110 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb384031460 tx=0x7fb384005de0 comp rx=0 tx=0).stop 2024-09-13T17:03:32.403 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:32.402+0000 7fb39bf9c640 1 -- 172.21.15.115:0/1103310631 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb394100d70 msgr2=0x7fb39419c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:32.403 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:32.402+0000 7fb39bf9c640 1 --2- 172.21.15.115:0/1103310631 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb394100d70 0x7fb39419c110 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb39000b450 tx=0x7fb39000b910 comp rx=0 tx=0).stop 2024-09-13T17:03:32.403 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:32.402+0000 7fb39bf9c640 1 -- 172.21.15.115:0/1103310631 shutdown_connections 2024-09-13T17:03:32.403 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:32.402+0000 7fb39bf9c640 1 --2- 172.21.15.115:0/1103310631 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fb38006cc50 0x7fb38006f110 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:32.403 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:32.402+0000 7fb39bf9c640 1 --2- 172.21.15.115:0/1103310631 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb394100d70 0x7fb39419c110 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:32.404 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:32.402+0000 7fb39bf9c640 1 --2- 172.21.15.115:0/1103310631 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb3940fe420 0x7fb39419bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:32.404 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:32.402+0000 7fb39bf9c640 1 -- 172.21.15.115:0/1103310631 >> 172.21.15.115:0/1103310631 conn(0x7fb3940fa230 msgr2=0x7fb3940fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:03:32.404 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:32.402+0000 7fb39bf9c640 1 -- 172.21.15.115:0/1103310631 shutdown_connections 2024-09-13T17:03:32.404 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:32.402+0000 7fb39bf9c640 1 -- 172.21.15.115:0/1103310631 wait complete. 2024-09-13T17:03:32.576 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:32 smithi195 ceph-mon[34981]: pgmap v185: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 716 B/s rd, 1.4 KiB/s wr, 5 op/s 2024-09-13T17:03:32.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:32 smithi195 ceph-mon[34981]: mds.? [v2:172.21.15.115:6828/4128583274,v1:172.21.15.115:6829/4128583274] up:reconnect 2024-09-13T17:03:32.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:32 smithi195 ceph-mon[34981]: mds.? [v2:172.21.15.195:6824/3335357704,v1:172.21.15.195:6825/3335357704] up:boot 2024-09-13T17:03:32.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:32 smithi195 ceph-mon[34981]: mds.? [v2:172.21.15.115:6826/1977394649,v1:172.21.15.115:6827/1977394649] up:boot 2024-09-13T17:03:32.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:32 smithi195 ceph-mon[34981]: fsmap cephfs:1/1 {0=cephfs.smithi115.ijznvr=up:reconnect} 3 up:standby 2024-09-13T17:03:32.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:32 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi115.hbtxod"}]: dispatch 2024-09-13T17:03:32.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:32 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.qzghxj"}]: dispatch 2024-09-13T17:03:32.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:32 smithi195 ceph-mon[34981]: from='client.? 172.21.15.115:0/1103310631' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-13T17:03:33.173 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T17:03:33.183 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi115.front.sepia.ceph.com 2024-09-13T17:03:33.183 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-13T17:03:33.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:33 smithi115 ceph-mon[27708]: Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2024-09-13T17:03:33.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:33 smithi115 ceph-mon[27708]: mds.? [v2:172.21.15.115:6828/4128583274,v1:172.21.15.115:6829/4128583274] up:rejoin 2024-09-13T17:03:33.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:33 smithi115 ceph-mon[27708]: from='client.? 172.21.15.115:0/1103310631' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2024-09-13T17:03:33.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:33 smithi115 ceph-mon[27708]: fsmap cephfs:1/1 {0=cephfs.smithi115.ijznvr=up:rejoin} 3 up:standby 2024-09-13T17:03:33.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:33 smithi115 ceph-mon[27708]: daemon mds.cephfs.smithi115.ijznvr is now active in filesystem cephfs as rank 0 2024-09-13T17:03:33.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:33 smithi195 ceph-mon[34981]: Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2024-09-13T17:03:33.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:33 smithi195 ceph-mon[34981]: mds.? [v2:172.21.15.115:6828/4128583274,v1:172.21.15.115:6829/4128583274] up:rejoin 2024-09-13T17:03:33.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:33 smithi195 ceph-mon[34981]: from='client.? 172.21.15.115:0/1103310631' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2024-09-13T17:03:33.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:33 smithi195 ceph-mon[34981]: fsmap cephfs:1/1 {0=cephfs.smithi115.ijznvr=up:rejoin} 3 up:standby 2024-09-13T17:03:33.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:33 smithi195 ceph-mon[34981]: daemon mds.cephfs.smithi115.ijznvr is now active in filesystem cephfs as rank 0 2024-09-13T17:03:34.387 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T17:03:34.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:34 smithi115 ceph-mon[27708]: pgmap v186: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2024-09-13T17:03:34.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:34 smithi115 ceph-mon[27708]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-13T17:03:34.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:34 smithi115 ceph-mon[27708]: mds.? [v2:172.21.15.115:6828/4128583274,v1:172.21.15.115:6829/4128583274] up:active 2024-09-13T17:03:34.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:34 smithi115 ceph-mon[27708]: mds.? [v2:172.21.15.195:6826/8826118,v1:172.21.15.195:6827/8826118] up:standby 2024-09-13T17:03:34.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:34 smithi115 ceph-mon[27708]: fsmap cephfs:1 {0=cephfs.smithi115.ijznvr=up:active} 3 up:standby 2024-09-13T17:03:34.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:34 smithi115 ceph-mon[27708]: fsmap cephfs:1 {0=cephfs.smithi115.ijznvr=up:active} 1 up:standby-replay 2 up:standby 2024-09-13T17:03:34.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:34 smithi195 ceph-mon[34981]: pgmap v186: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2024-09-13T17:03:34.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:34 smithi195 ceph-mon[34981]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-13T17:03:34.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:34 smithi195 ceph-mon[34981]: mds.? [v2:172.21.15.115:6828/4128583274,v1:172.21.15.115:6829/4128583274] up:active 2024-09-13T17:03:34.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:34 smithi195 ceph-mon[34981]: mds.? [v2:172.21.15.195:6826/8826118,v1:172.21.15.195:6827/8826118] up:standby 2024-09-13T17:03:34.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:34 smithi195 ceph-mon[34981]: fsmap cephfs:1 {0=cephfs.smithi115.ijznvr=up:active} 3 up:standby 2024-09-13T17:03:34.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:34 smithi195 ceph-mon[34981]: fsmap cephfs:1 {0=cephfs.smithi115.ijznvr=up:active} 1 up:standby-replay 2 up:standby 2024-09-13T17:03:36.591 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:36 smithi195 ceph-mon[34981]: pgmap v187: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 5.9 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-13T17:03:36.622 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:36.599+0000 7f6163470640 1 -- 172.21.15.115:0/2613992386 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f615c0fed60 msgr2=0x7f615c0ff1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:36.623 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:36.599+0000 7f6163470640 1 --2- 172.21.15.115:0/2613992386 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f615c0fed60 0x7f615c0ff1c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f614c009880 tx=0x7f614c02a4a0 comp rx=0 tx=0).stop 2024-09-13T17:03:36.623 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:36.600+0000 7f6163470640 1 -- 172.21.15.115:0/2613992386 shutdown_connections 2024-09-13T17:03:36.623 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:36.600+0000 7f6163470640 1 --2- 172.21.15.115:0/2613992386 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f615c0fed60 0x7f615c0ff1c0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:36.623 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:36.600+0000 7f6163470640 1 --2- 172.21.15.115:0/2613992386 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f615c0fe420 0x7f615c0fe820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:36.623 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:36.600+0000 7f6163470640 1 -- 172.21.15.115:0/2613992386 >> 172.21.15.115:0/2613992386 conn(0x7f615c0fa230 msgr2=0x7f615c0fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:03:36.623 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:36.600+0000 7f6163470640 1 -- 172.21.15.115:0/2613992386 shutdown_connections 2024-09-13T17:03:36.623 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:36.600+0000 7f6163470640 1 -- 172.21.15.115:0/2613992386 wait complete. 2024-09-13T17:03:36.623 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:36.600+0000 7f6163470640 1 Processor -- start 2024-09-13T17:03:36.623 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:36.600+0000 7f6163470640 1 -- start start 2024-09-13T17:03:36.623 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:36.600+0000 7f6163470640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f615c0fe420 0x7f615c197750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:03:36.623 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:36.600+0000 7f6163470640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f615c0fed60 0x7f615c197c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:03:36.624 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:36.600+0000 7f6163470640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f615c198260 con 0x7f615c0fed60 2024-09-13T17:03:36.624 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:36.600+0000 7f6163470640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f615c1983d0 con 0x7f615c0fe420 2024-09-13T17:03:36.624 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:36.600+0000 7f6160a0b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f615c0fed60 0x7f615c197c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:03:36.624 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:36.600+0000 7f616120c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f615c0fe420 0x7f615c197750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:03:36.624 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:36.601+0000 7f616120c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f615c0fe420 0x7f615c197750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.115:34230/0 (socket says 172.21.15.115:34230) 2024-09-13T17:03:36.624 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:36.601+0000 7f6160a0b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f615c0fed60 0x7f615c197c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:32820/0 (socket says 172.21.15.115:32820) 2024-09-13T17:03:36.624 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:36.601+0000 7f616120c640 1 -- 172.21.15.115:0/4099677856 learned_addr learned my addr 172.21.15.115:0/4099677856 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:03:36.624 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:36.601+0000 7f6160a0b640 1 -- 172.21.15.115:0/4099677856 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f615c0fe420 msgr2=0x7f615c197750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:36.624 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:36.601+0000 7f6160a0b640 1 --2- 172.21.15.115:0/4099677856 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f615c0fe420 0x7f615c197750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:36.624 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:36.601+0000 7f6160a0b640 1 -- 172.21.15.115:0/4099677856 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f614c009560 con 0x7f615c0fed60 2024-09-13T17:03:36.624 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:36.601+0000 7f616120c640 1 --2- 172.21.15.115:0/4099677856 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f615c0fe420 0x7f615c197750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:03:36.624 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:36.601+0000 7f6160a0b640 1 --2- 172.21.15.115:0/4099677856 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f615c0fed60 0x7f615c197c90 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f614c009880 tx=0x7f614c0054f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:03:36.625 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:36.601+0000 7f61527fc640 1 -- 172.21.15.115:0/4099677856 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f614c004aa0 con 0x7f615c0fed60 2024-09-13T17:03:36.625 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:36.601+0000 7f61527fc640 1 -- 172.21.15.115:0/4099677856 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f614c004c00 con 0x7f615c0fed60 2024-09-13T17:03:36.625 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:36.601+0000 7f61527fc640 1 -- 172.21.15.115:0/4099677856 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f614c0318b0 con 0x7f615c0fed60 2024-09-13T17:03:36.625 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:36.601+0000 7f6163470640 1 -- 172.21.15.115:0/4099677856 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f615c19cdc0 con 0x7f615c0fed60 2024-09-13T17:03:36.625 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:36.601+0000 7f6163470640 1 -- 172.21.15.115:0/4099677856 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f615c19d330 con 0x7f615c0fed60 2024-09-13T17:03:36.625 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:36.602+0000 7f6163470640 1 -- 172.21.15.115:0/4099677856 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f615c1917e0 con 0x7f615c0fed60 2024-09-13T17:03:36.625 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:36.603+0000 7f61527fc640 1 -- 172.21.15.115:0/4099677856 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f614c031b20 con 0x7f615c0fed60 2024-09-13T17:03:36.625 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:36.603+0000 7f61527fc640 1 --2- 172.21.15.115:0/4099677856 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f614806cc50 0x7f614806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:03:36.625 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:36.603+0000 7f616120c640 1 --2- 172.21.15.115:0/4099677856 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f614806cc50 0x7f614806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:03:36.625 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:36.603+0000 7f61527fc640 1 -- 172.21.15.115:0/4099677856 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f614c0ad380 con 0x7f615c0fed60 2024-09-13T17:03:36.625 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:36.604+0000 7f616120c640 1 --2- 172.21.15.115:0/4099677856 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f614806cc50 0x7f614806f110 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f61580104e0 tx=0x7f615800b410 comp rx=0 tx=0).ready entity=mgr.14207 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:03:36.625 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:36.608+0000 7f61527fc640 1 -- 172.21.15.115:0/4099677856 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f614c077820 con 0x7f615c0fed60 2024-09-13T17:03:36.626 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:36 smithi115 ceph-mon[27708]: pgmap v187: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 5.9 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-13T17:03:36.832 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:36.830+0000 7f6163470640 1 -- 172.21.15.115:0/4099677856 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f615c10a850 con 0x7f615c0fed60 2024-09-13T17:03:36.832 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:36.831+0000 7f61527fc640 1 -- 172.21.15.115:0/4099677856 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1874 (secure 0 0 0) 0x7f614c07ae40 con 0x7f615c0fed60 2024-09-13T17:03:36.832 INFO:teuthology.orchestra.run.smithi115.stdout:e19 2024-09-13T17:03:36.832 INFO:teuthology.orchestra.run.smithi115.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T17:03:36.832 INFO:teuthology.orchestra.run.smithi115.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T17:03:36.832 INFO:teuthology.orchestra.run.smithi115.stdout:legacy client fscid: 1 2024-09-13T17:03:36.832 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:03:36.833 INFO:teuthology.orchestra.run.smithi115.stdout:Filesystem 'cephfs' (1) 2024-09-13T17:03:36.833 INFO:teuthology.orchestra.run.smithi115.stdout:fs_name cephfs 2024-09-13T17:03:36.833 INFO:teuthology.orchestra.run.smithi115.stdout:epoch 19 2024-09-13T17:03:36.833 INFO:teuthology.orchestra.run.smithi115.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T17:03:36.833 INFO:teuthology.orchestra.run.smithi115.stdout:created 2024-09-13T17:03:16.313116+0000 2024-09-13T17:03:36.833 INFO:teuthology.orchestra.run.smithi115.stdout:modified 2024-09-13T17:03:33.410348+0000 2024-09-13T17:03:36.833 INFO:teuthology.orchestra.run.smithi115.stdout:tableserver 0 2024-09-13T17:03:36.833 INFO:teuthology.orchestra.run.smithi115.stdout:root 0 2024-09-13T17:03:36.833 INFO:teuthology.orchestra.run.smithi115.stdout:session_timeout 60 2024-09-13T17:03:36.833 INFO:teuthology.orchestra.run.smithi115.stdout:session_autoclose 300 2024-09-13T17:03:36.833 INFO:teuthology.orchestra.run.smithi115.stdout:max_file_size 1099511627776 2024-09-13T17:03:36.833 INFO:teuthology.orchestra.run.smithi115.stdout:max_xattr_size 65536 2024-09-13T17:03:36.834 INFO:teuthology.orchestra.run.smithi115.stdout:required_client_features {} 2024-09-13T17:03:36.834 INFO:teuthology.orchestra.run.smithi115.stdout:last_failure 0 2024-09-13T17:03:36.834 INFO:teuthology.orchestra.run.smithi115.stdout:last_failure_osd_epoch 46 2024-09-13T17:03:36.834 INFO:teuthology.orchestra.run.smithi115.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T17:03:36.834 INFO:teuthology.orchestra.run.smithi115.stdout:max_mds 1 2024-09-13T17:03:36.834 INFO:teuthology.orchestra.run.smithi115.stdout:in 0 2024-09-13T17:03:36.834 INFO:teuthology.orchestra.run.smithi115.stdout:up {0=14470} 2024-09-13T17:03:36.834 INFO:teuthology.orchestra.run.smithi115.stdout:failed 2024-09-13T17:03:36.834 INFO:teuthology.orchestra.run.smithi115.stdout:damaged 2024-09-13T17:03:36.834 INFO:teuthology.orchestra.run.smithi115.stdout:stopped 2024-09-13T17:03:36.834 INFO:teuthology.orchestra.run.smithi115.stdout:data_pools [3] 2024-09-13T17:03:36.834 INFO:teuthology.orchestra.run.smithi115.stdout:metadata_pool 2 2024-09-13T17:03:36.834 INFO:teuthology.orchestra.run.smithi115.stdout:inline_data enabled 2024-09-13T17:03:36.835 INFO:teuthology.orchestra.run.smithi115.stdout:balancer 2024-09-13T17:03:36.835 INFO:teuthology.orchestra.run.smithi115.stdout:bal_rank_mask -1 2024-09-13T17:03:36.835 INFO:teuthology.orchestra.run.smithi115.stdout:standby_count_wanted 1 2024-09-13T17:03:36.835 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi115.ijznvr{0:14470} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.115:6828/4128583274,v1:172.21.15.115:6829/4128583274] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T17:03:36.835 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi115.hbtxod{0:14486} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.115:6826/1977394649,v1:172.21.15.115:6827/1977394649] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T17:03:36.835 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:03:36.835 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:03:36.835 INFO:teuthology.orchestra.run.smithi115.stdout:Standby daemons: 2024-09-13T17:03:36.835 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:03:36.835 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi195.aevvgz{-1:24253} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.195:6826/8826118,v1:172.21.15.195:6827/8826118] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T17:03:36.835 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi195.qzghxj{-1:24259} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.195:6824/3335357704,v1:172.21.15.195:6825/3335357704] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T17:03:36.836 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 19 2024-09-13T17:03:36.836 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:36.832+0000 7f6163470640 1 -- 172.21.15.115:0/4099677856 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f614806cc50 msgr2=0x7f614806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:36.836 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:36.832+0000 7f6163470640 1 --2- 172.21.15.115:0/4099677856 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f614806cc50 0x7f614806f110 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f61580104e0 tx=0x7f615800b410 comp rx=0 tx=0).stop 2024-09-13T17:03:36.836 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:36.832+0000 7f6163470640 1 -- 172.21.15.115:0/4099677856 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f615c0fed60 msgr2=0x7f615c197c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:36.836 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:36.832+0000 7f6163470640 1 --2- 172.21.15.115:0/4099677856 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f615c0fed60 0x7f615c197c90 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f614c009880 tx=0x7f614c0054f0 comp rx=0 tx=0).stop 2024-09-13T17:03:36.836 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:36.833+0000 7f6163470640 1 -- 172.21.15.115:0/4099677856 shutdown_connections 2024-09-13T17:03:36.837 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:36.833+0000 7f6163470640 1 --2- 172.21.15.115:0/4099677856 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f614806cc50 0x7f614806f110 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:36.837 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:36.833+0000 7f6163470640 1 --2- 172.21.15.115:0/4099677856 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f615c0fed60 0x7f615c197c90 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:36.837 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:36.833+0000 7f6163470640 1 --2- 172.21.15.115:0/4099677856 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f615c0fe420 0x7f615c197750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:36.837 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:36.833+0000 7f6163470640 1 -- 172.21.15.115:0/4099677856 >> 172.21.15.115:0/4099677856 conn(0x7f615c0fa230 msgr2=0x7f615c106f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:03:36.837 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:36.833+0000 7f6163470640 1 -- 172.21.15.115:0/4099677856 shutdown_connections 2024-09-13T17:03:36.837 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:36.833+0000 7f6163470640 1 -- 172.21.15.115:0/4099677856 wait complete. 2024-09-13T17:03:37.572 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2024-09-13T17:03:37.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:37 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:03:37.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:37 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:03:37.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:37 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:03:37.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:37 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:03:37.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:37 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:03:37.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:37 smithi195 ceph-mon[34981]: from='client.? 172.21.15.115:0/4099677856' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T17:03:37.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:37 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:03:37.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:37 smithi195 ceph-mon[34981]: pgmap v188: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 9.6 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-13T17:03:37.928 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:37 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:03:37.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:37 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:03:37.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:37 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:03:37.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:37 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:03:37.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:37 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:03:37.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:37 smithi115 ceph-mon[27708]: from='client.? 172.21.15.115:0/4099677856' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T17:03:37.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:37 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:03:37.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:37 smithi115 ceph-mon[27708]: pgmap v188: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 9.6 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-13T17:03:38.119 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T17:03:40.065 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:40.060+0000 7f299c6be640 1 -- 172.21.15.115:0/2328668211 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29940ffc80 msgr2=0x7f2994100100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:40.065 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:40.060+0000 7f299c6be640 1 --2- 172.21.15.115:0/2328668211 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29940ffc80 0x7f2994100100 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f2984009880 tx=0x7f298402a4a0 comp rx=0 tx=0).stop 2024-09-13T17:03:40.066 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:40.060+0000 7f299c6be640 1 -- 172.21.15.115:0/2328668211 shutdown_connections 2024-09-13T17:03:40.066 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:40.060+0000 7f299c6be640 1 --2- 172.21.15.115:0/2328668211 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29940ffc80 0x7f2994100100 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:40.066 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:40.060+0000 7f299c6be640 1 --2- 172.21.15.115:0/2328668211 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f29940fea80 0x7f29940fee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:40.066 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:40.060+0000 7f299c6be640 1 -- 172.21.15.115:0/2328668211 >> 172.21.15.115:0/2328668211 conn(0x7f29940fa230 msgr2=0x7f29940fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:03:40.066 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:40.060+0000 7f299c6be640 1 -- 172.21.15.115:0/2328668211 shutdown_connections 2024-09-13T17:03:40.066 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:40.060+0000 7f299c6be640 1 -- 172.21.15.115:0/2328668211 wait complete. 2024-09-13T17:03:40.066 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:40.061+0000 7f299c6be640 1 Processor -- start 2024-09-13T17:03:40.066 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:40.061+0000 7f299c6be640 1 -- start start 2024-09-13T17:03:40.066 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:40.061+0000 7f299c6be640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f29940fea80 0x7f2994194420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:03:40.066 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:40.061+0000 7f299c6be640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29940ffc80 0x7f2994194960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:03:40.066 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:40.061+0000 7f299c6be640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2994194f30 con 0x7f29940ffc80 2024-09-13T17:03:40.066 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:40.061+0000 7f299c6be640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29941950a0 con 0x7f29940fea80 2024-09-13T17:03:40.066 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:40.061+0000 7f2999c59640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29940ffc80 0x7f2994194960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:03:40.067 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:40.061+0000 7f2999c59640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29940ffc80 0x7f2994194960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:32838/0 (socket says 172.21.15.115:32838) 2024-09-13T17:03:40.067 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:40.061+0000 7f2999c59640 1 -- 172.21.15.115:0/3368863617 learned_addr learned my addr 172.21.15.115:0/3368863617 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:03:40.067 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:40.061+0000 7f299a45a640 1 --2- 172.21.15.115:0/3368863617 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f29940fea80 0x7f2994194420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:03:40.067 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:40.061+0000 7f2999c59640 1 -- 172.21.15.115:0/3368863617 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f29940fea80 msgr2=0x7f2994194420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:40.067 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:40.061+0000 7f2999c59640 1 --2- 172.21.15.115:0/3368863617 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f29940fea80 0x7f2994194420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:40.067 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:40.061+0000 7f2999c59640 1 -- 172.21.15.115:0/3368863617 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2984009560 con 0x7f29940ffc80 2024-09-13T17:03:40.067 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:40.062+0000 7f2999c59640 1 --2- 172.21.15.115:0/3368863617 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29940ffc80 0x7f2994194960 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f2984006010 tx=0x7f2984005610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:03:40.067 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:40.062+0000 7f298b7fe640 1 -- 172.21.15.115:0/3368863617 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2984004b20 con 0x7f29940ffc80 2024-09-13T17:03:40.067 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:40.062+0000 7f298b7fe640 1 -- 172.21.15.115:0/3368863617 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2984004c80 con 0x7f29940ffc80 2024-09-13T17:03:40.067 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:40.062+0000 7f299c6be640 1 -- 172.21.15.115:0/3368863617 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2994199ae0 con 0x7f29940ffc80 2024-09-13T17:03:40.067 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:40.062+0000 7f298b7fe640 1 -- 172.21.15.115:0/3368863617 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29840319f0 con 0x7f29940ffc80 2024-09-13T17:03:40.067 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:40.062+0000 7f299c6be640 1 -- 172.21.15.115:0/3368863617 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f299419a050 con 0x7f29940ffc80 2024-09-13T17:03:40.067 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:40.063+0000 7f299c6be640 1 -- 172.21.15.115:0/3368863617 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f299418e4e0 con 0x7f29940ffc80 2024-09-13T17:03:40.067 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:40.063+0000 7f298b7fe640 1 -- 172.21.15.115:0/3368863617 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f2984003d00 con 0x7f29940ffc80 2024-09-13T17:03:40.068 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:40.064+0000 7f298b7fe640 1 --2- 172.21.15.115:0/3368863617 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f298006cc50 0x7f298006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:03:40.068 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:40.064+0000 7f299a45a640 1 --2- 172.21.15.115:0/3368863617 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f298006cc50 0x7f298006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:03:40.068 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:40.064+0000 7f298b7fe640 1 -- 172.21.15.115:0/3368863617 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f29840ad490 con 0x7f29940ffc80 2024-09-13T17:03:40.068 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:40.064+0000 7f299a45a640 1 --2- 172.21.15.115:0/3368863617 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f298006cc50 0x7f298006f110 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2990005fd0 tx=0x7f2990005850 comp rx=0 tx=0).ready entity=mgr.14207 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:03:40.069 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:40.068+0000 7f298b7fe640 1 -- 172.21.15.115:0/3368863617 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f2984077800 con 0x7f29940ffc80 2024-09-13T17:03:40.178 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:39 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:03:40.178 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:39 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:03:40.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:39 smithi115 ceph-mon[27708]: pgmap v189: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 10 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-13T17:03:40.287 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:40.285+0000 7f299c6be640 1 -- 172.21.15.115:0/3368863617 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2994107740 con 0x7f29940ffc80 2024-09-13T17:03:40.287 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:40.285+0000 7f298b7fe640 1 -- 172.21.15.115:0/3368863617 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4836 (secure 0 0 0) 0x7f298407ae20 con 0x7f29940ffc80 2024-09-13T17:03:40.287 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 19 2024-09-13T17:03:40.289 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:40.288+0000 7f299c6be640 1 -- 172.21.15.115:0/3368863617 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f298006cc50 msgr2=0x7f298006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:40.289 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:40.288+0000 7f299c6be640 1 --2- 172.21.15.115:0/3368863617 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f298006cc50 0x7f298006f110 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2990005fd0 tx=0x7f2990005850 comp rx=0 tx=0).stop 2024-09-13T17:03:40.289 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:40.288+0000 7f299c6be640 1 -- 172.21.15.115:0/3368863617 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29940ffc80 msgr2=0x7f2994194960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:40.289 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:40.288+0000 7f299c6be640 1 --2- 172.21.15.115:0/3368863617 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29940ffc80 0x7f2994194960 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f2984006010 tx=0x7f2984005610 comp rx=0 tx=0).stop 2024-09-13T17:03:40.289 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:40.288+0000 7f299c6be640 1 -- 172.21.15.115:0/3368863617 shutdown_connections 2024-09-13T17:03:40.290 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:40.288+0000 7f299c6be640 1 --2- 172.21.15.115:0/3368863617 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f298006cc50 0x7f298006f110 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:40.290 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:40.288+0000 7f299c6be640 1 --2- 172.21.15.115:0/3368863617 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29940ffc80 0x7f2994194960 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:40.290 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:40.288+0000 7f299c6be640 1 --2- 172.21.15.115:0/3368863617 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f29940fea80 0x7f2994194420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:40.290 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:40.288+0000 7f299c6be640 1 -- 172.21.15.115:0/3368863617 >> 172.21.15.115:0/3368863617 conn(0x7f29940fa230 msgr2=0x7f29941033c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:03:40.290 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:40.288+0000 7f299c6be640 1 -- 172.21.15.115:0/3368863617 shutdown_connections 2024-09-13T17:03:40.290 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:40.288+0000 7f299c6be640 1 -- 172.21.15.115:0/3368863617 wait complete. 2024-09-13T17:03:40.298 INFO:teuthology.orchestra.run.smithi115.stdout:true 2024-09-13T17:03:40.326 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:39 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:03:40.326 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:39 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:03:40.326 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:39 smithi195 ceph-mon[34981]: pgmap v189: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 10 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-13T17:03:40.996 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:40 smithi115 ceph-mon[27708]: from='client.? 172.21.15.115:0/3368863617' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:03:41.021 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2024-09-13T17:03:41.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:40 smithi195 ceph-mon[34981]: from='client.? 172.21.15.115:0/3368863617' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:03:41.758 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T17:03:42.178 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:41 smithi115 ceph-mon[27708]: pgmap v190: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 9.3 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-13T17:03:42.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:41 smithi195 ceph-mon[34981]: pgmap v190: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 9.3 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-13T17:03:44.248 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:44.232+0000 7ff7339ad640 1 -- 172.21.15.115:0/1762350681 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff72c100d70 msgr2=0x7ff72c1011f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:44.248 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:44.232+0000 7ff7339ad640 1 --2- 172.21.15.115:0/1762350681 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff72c100d70 0x7ff72c1011f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff71c009880 tx=0x7ff71c02a4a0 comp rx=0 tx=0).stop 2024-09-13T17:03:44.248 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:44.232+0000 7ff7339ad640 1 -- 172.21.15.115:0/1762350681 shutdown_connections 2024-09-13T17:03:44.248 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:44.232+0000 7ff7339ad640 1 --2- 172.21.15.115:0/1762350681 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff72c100d70 0x7ff72c1011f0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:44.248 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:44.232+0000 7ff7339ad640 1 --2- 172.21.15.115:0/1762350681 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff72c0ffb70 0x7ff72c0fff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:44.248 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:44.232+0000 7ff7339ad640 1 -- 172.21.15.115:0/1762350681 >> 172.21.15.115:0/1762350681 conn(0x7ff72c0fb2e0 msgr2=0x7ff72c0fd740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:03:44.248 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:44.233+0000 7ff7339ad640 1 -- 172.21.15.115:0/1762350681 shutdown_connections 2024-09-13T17:03:44.249 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:44.233+0000 7ff7339ad640 1 -- 172.21.15.115:0/1762350681 wait complete. 2024-09-13T17:03:44.249 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:44.233+0000 7ff7339ad640 1 Processor -- start 2024-09-13T17:03:44.249 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:44.233+0000 7ff7339ad640 1 -- start start 2024-09-13T17:03:44.249 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:44.233+0000 7ff7339ad640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff72c0ffb70 0x7ff72c074250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:03:44.249 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:44.233+0000 7ff7339ad640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff72c100d70 0x7ff72c0728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:03:44.249 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:44.233+0000 7ff7339ad640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff72c072de0 con 0x7ff72c0ffb70 2024-09-13T17:03:44.249 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:44.233+0000 7ff7339ad640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff72c072f50 con 0x7ff72c100d70 2024-09-13T17:03:44.249 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:44.233+0000 7ff731749640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff72c0ffb70 0x7ff72c074250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:03:44.249 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:44.234+0000 7ff731749640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff72c0ffb70 0x7ff72c074250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:34568/0 (socket says 172.21.15.115:34568) 2024-09-13T17:03:44.249 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:44.234+0000 7ff731749640 1 -- 172.21.15.115:0/149300347 learned_addr learned my addr 172.21.15.115:0/149300347 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:03:44.249 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:44.234+0000 7ff731749640 1 -- 172.21.15.115:0/149300347 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff72c100d70 msgr2=0x7ff72c0728a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:44.249 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:44.234+0000 7ff731749640 1 --2- 172.21.15.115:0/149300347 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff72c100d70 0x7ff72c0728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:44.249 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:44.234+0000 7ff731749640 1 -- 172.21.15.115:0/149300347 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff71c009560 con 0x7ff72c0ffb70 2024-09-13T17:03:44.250 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:44.234+0000 7ff731749640 1 --2- 172.21.15.115:0/149300347 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff72c0ffb70 0x7ff72c074250 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff72800b9c0 tx=0x7ff72800be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:03:44.250 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:44.234+0000 7ff7227fc640 1 -- 172.21.15.115:0/149300347 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff72800caf0 con 0x7ff72c0ffb70 2024-09-13T17:03:44.250 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:44.234+0000 7ff7339ad640 1 -- 172.21.15.115:0/149300347 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff72c073230 con 0x7ff72c0ffb70 2024-09-13T17:03:44.250 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:44.234+0000 7ff7227fc640 1 -- 172.21.15.115:0/149300347 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff72800cc50 con 0x7ff72c0ffb70 2024-09-13T17:03:44.250 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:44.234+0000 7ff7227fc640 1 -- 172.21.15.115:0/149300347 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7280126d0 con 0x7ff72c0ffb70 2024-09-13T17:03:44.250 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:44.234+0000 7ff7339ad640 1 -- 172.21.15.115:0/149300347 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff72c19d6b0 con 0x7ff72c0ffb70 2024-09-13T17:03:44.250 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:44.235+0000 7ff7339ad640 1 -- 172.21.15.115:0/149300347 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff72c1086c0 con 0x7ff72c0ffb70 2024-09-13T17:03:44.250 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:44.236+0000 7ff7227fc640 1 -- 172.21.15.115:0/149300347 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7ff728014440 con 0x7ff72c0ffb70 2024-09-13T17:03:44.250 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:44.236+0000 7ff7227fc640 1 --2- 172.21.15.115:0/149300347 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7ff71806cc50 0x7ff71806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:03:44.250 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:44.236+0000 7ff730f48640 1 --2- 172.21.15.115:0/149300347 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7ff71806cc50 0x7ff71806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:03:44.250 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:44.236+0000 7ff7227fc640 1 -- 172.21.15.115:0/149300347 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7ff72808bc50 con 0x7ff72c0ffb70 2024-09-13T17:03:44.250 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:44.237+0000 7ff730f48640 1 --2- 172.21.15.115:0/149300347 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7ff71806cc50 0x7ff71806f110 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff71c02a9c0 tx=0x7ff71c000bc0 comp rx=0 tx=0).ready entity=mgr.14207 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:03:44.250 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:44.241+0000 7ff7227fc640 1 -- 172.21.15.115:0/149300347 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff728056070 con 0x7ff72c0ffb70 2024-09-13T17:03:44.485 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:44.483+0000 7ff7339ad640 1 -- 172.21.15.115:0/149300347 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) v1 -- 0x7ff72c1088a0 con 0x7ff72c0ffb70 2024-09-13T17:03:44.485 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:44.484+0000 7ff7227fc640 1 -- 172.21.15.115:0/149300347 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v19) v1 ==== 78+0+97 (secure 0 0 0) 0x7ff728059690 con 0x7ff72c0ffb70 2024-09-13T17:03:44.487 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:44.486+0000 7ff7339ad640 1 -- 172.21.15.115:0/149300347 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7ff71806cc50 msgr2=0x7ff71806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:44.487 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:44.486+0000 7ff7339ad640 1 --2- 172.21.15.115:0/149300347 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7ff71806cc50 0x7ff71806f110 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff71c02a9c0 tx=0x7ff71c000bc0 comp rx=0 tx=0).stop 2024-09-13T17:03:44.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:44.486+0000 7ff7339ad640 1 -- 172.21.15.115:0/149300347 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff72c0ffb70 msgr2=0x7ff72c074250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:44.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:44.486+0000 7ff7339ad640 1 --2- 172.21.15.115:0/149300347 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff72c0ffb70 0x7ff72c074250 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff72800b9c0 tx=0x7ff72800be80 comp rx=0 tx=0).stop 2024-09-13T17:03:44.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:44.486+0000 7ff7339ad640 1 -- 172.21.15.115:0/149300347 shutdown_connections 2024-09-13T17:03:44.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:44.486+0000 7ff7339ad640 1 --2- 172.21.15.115:0/149300347 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7ff71806cc50 0x7ff71806f110 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:44.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:44.486+0000 7ff7339ad640 1 --2- 172.21.15.115:0/149300347 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff72c100d70 0x7ff72c0728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:44.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:44.486+0000 7ff7339ad640 1 --2- 172.21.15.115:0/149300347 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff72c0ffb70 0x7ff72c074250 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:44.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:44.486+0000 7ff7339ad640 1 -- 172.21.15.115:0/149300347 >> 172.21.15.115:0/149300347 conn(0x7ff72c0fb2e0 msgr2=0x7ff72c103fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:03:44.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:44.486+0000 7ff7339ad640 1 -- 172.21.15.115:0/149300347 shutdown_connections 2024-09-13T17:03:44.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:44.486+0000 7ff7339ad640 1 -- 172.21.15.115:0/149300347 wait complete. 2024-09-13T17:03:44.495 INFO:teuthology.orchestra.run.smithi115.stdout:true 2024-09-13T17:03:44.534 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:44 smithi115 ceph-mon[27708]: pgmap v191: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 8.4 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-13T17:03:44.534 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:44 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:03:44.534 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:44 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:03:44.576 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:44 smithi195 ceph-mon[34981]: pgmap v191: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 8.4 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-13T17:03:44.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:44 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:03:44.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:44 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:03:45.176 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2024-09-13T17:03:45.208 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:03:45.342 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.339+0000 7f491c453640 1 -- 172.21.15.115:0/3316389257 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49140ffb80 msgr2=0x7f4914100000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:45.342 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.339+0000 7f491c453640 1 --2- 172.21.15.115:0/3316389257 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49140ffb80 0x7f4914100000 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f4908009880 tx=0x7f490802a4a0 comp rx=0 tx=0).stop 2024-09-13T17:03:45.342 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.339+0000 7f491c453640 1 -- 172.21.15.115:0/3316389257 shutdown_connections 2024-09-13T17:03:45.342 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.339+0000 7f491c453640 1 --2- 172.21.15.115:0/3316389257 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49140ffb80 0x7f4914100000 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:45.342 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.339+0000 7f491c453640 1 --2- 172.21.15.115:0/3316389257 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f49140fe990 0x7f49140fed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:45.342 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.339+0000 7f491c453640 1 -- 172.21.15.115:0/3316389257 >> 172.21.15.115:0/3316389257 conn(0x7f49140fa0f0 msgr2=0x7f49140fc530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:03:45.343 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.339+0000 7f491c453640 1 -- 172.21.15.115:0/3316389257 shutdown_connections 2024-09-13T17:03:45.343 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.339+0000 7f491c453640 1 -- 172.21.15.115:0/3316389257 wait complete. 2024-09-13T17:03:45.343 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.340+0000 7f491c453640 1 Processor -- start 2024-09-13T17:03:45.343 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.340+0000 7f491c453640 1 -- start start 2024-09-13T17:03:45.343 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.340+0000 7f491c453640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49140fe990 0x7f49141944e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:03:45.343 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.340+0000 7f491c453640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f49140ffb80 0x7f4914194a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:03:45.343 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.340+0000 7f491c453640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4914194ff0 con 0x7f49140fe990 2024-09-13T17:03:45.343 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.340+0000 7f491c453640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4914195160 con 0x7f49140ffb80 2024-09-13T17:03:45.343 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.340+0000 7f491a1ef640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49140fe990 0x7f49141944e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:03:45.343 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.340+0000 7f491a1ef640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49140fe990 0x7f49141944e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:34580/0 (socket says 172.21.15.115:34580) 2024-09-13T17:03:45.343 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.340+0000 7f491a1ef640 1 -- 172.21.15.115:0/1654409812 learned_addr learned my addr 172.21.15.115:0/1654409812 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:03:45.343 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.340+0000 7f49199ee640 1 --2- 172.21.15.115:0/1654409812 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f49140ffb80 0x7f4914194a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:03:45.343 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.340+0000 7f491a1ef640 1 -- 172.21.15.115:0/1654409812 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f49140ffb80 msgr2=0x7f4914194a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:45.344 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.340+0000 7f491a1ef640 1 --2- 172.21.15.115:0/1654409812 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f49140ffb80 0x7f4914194a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:45.344 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.340+0000 7f491a1ef640 1 -- 172.21.15.115:0/1654409812 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4908009560 con 0x7f49140fe990 2024-09-13T17:03:45.344 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.340+0000 7f49199ee640 1 --2- 172.21.15.115:0/1654409812 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f49140ffb80 0x7f4914194a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:03:45.344 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.340+0000 7f491a1ef640 1 --2- 172.21.15.115:0/1654409812 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49140fe990 0x7f49141944e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f491000b3d0 tx=0x7f491000b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:03:45.344 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.340+0000 7f49077fe640 1 -- 172.21.15.115:0/1654409812 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4910011800 con 0x7f49140fe990 2024-09-13T17:03:45.344 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.340+0000 7f491c453640 1 -- 172.21.15.115:0/1654409812 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4914199bf0 con 0x7f49140fe990 2024-09-13T17:03:45.344 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.340+0000 7f49077fe640 1 -- 172.21.15.115:0/1654409812 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4910011e00 con 0x7f49140fe990 2024-09-13T17:03:45.344 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.340+0000 7f49077fe640 1 -- 172.21.15.115:0/1654409812 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f491000f2e0 con 0x7f49140fe990 2024-09-13T17:03:45.344 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.340+0000 7f491c453640 1 -- 172.21.15.115:0/1654409812 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f491419a150 con 0x7f49140fe990 2024-09-13T17:03:45.345 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.341+0000 7f491c453640 1 -- 172.21.15.115:0/1654409812 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49141074d0 con 0x7f49140fe990 2024-09-13T17:03:45.345 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.342+0000 7f49077fe640 1 -- 172.21.15.115:0/1654409812 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f4910010380 con 0x7f49140fe990 2024-09-13T17:03:45.345 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.342+0000 7f49077fe640 1 --2- 172.21.15.115:0/1654409812 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f490006cc50 0x7f490006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:03:45.345 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.342+0000 7f49077fe640 1 -- 172.21.15.115:0/1654409812 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f491008c010 con 0x7f49140fe990 2024-09-13T17:03:45.345 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.342+0000 7f49199ee640 1 --2- 172.21.15.115:0/1654409812 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f490006cc50 0x7f490006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:03:45.345 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.343+0000 7f49199ee640 1 --2- 172.21.15.115:0/1654409812 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f490006cc50 0x7f490006f110 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f49141959f0 tx=0x7f4908031400 comp rx=0 tx=0).ready entity=mgr.14207 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:03:45.347 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.346+0000 7f49077fe640 1 -- 172.21.15.115:0/1654409812 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f4910056380 con 0x7f49140fe990 2024-09-13T17:03:45.428 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:45 smithi115 ceph-mon[27708]: from='client.? 172.21.15.115:0/149300347' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-09-13T17:03:45.512 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.511+0000 7f491c453640 1 -- 172.21.15.115:0/1654409812 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4914107660 con 0x7f49140fe990 2024-09-13T17:03:45.514 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.513+0000 7f49077fe640 1 -- 172.21.15.115:0/1654409812 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+15203 (secure 0 0 0) 0x7f49100599a0 con 0x7f49140fe990 2024-09-13T17:03:45.514 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:03:45.514 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":46,"fsid":"ffbd7588-71f0-11ef-bceb-c7b262605968","created":"2024-09-13T16:56:28.790927+0000","modified":"2024-09-13T17:03:30.385452+0000","last_up_change":"2024-09-13T17:01:57.275978+0000","last_in_change":"2024-09-13T17:01:39.088735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:00:47.472140+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-09-13T17:03:15.097618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-09-13T17:03:15.539103+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9fb96264-a71d-43b2-8d65-b4280a8ad8ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":2697967112},{"type":"v1","addr":"172.21.15.115:6803","nonce":2697967112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":2697967112},{"type":"v1","addr":"172.21.15.115:6805","nonce":2697967112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":2697967112},{"type":"v1","addr":"172.21.15.115:6809","nonce":2697967112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":2697967112},{"type":"v1","addr":"172.21.15.115:6807","nonce":2697967112}]},"public_addr":"172.21.15.115:6803/2697967112","cluster_addr":"172.21.15.115:6805/2697967112","heartbeat_back_addr":"172.21.15.115:6809/2697967112","heartbeat_front_addr":"172.21.15.115:6807/2697967112","state":["exists","up"]},{"osd":1,"uuid":"876bf075-f0e1-49dc-90cc-aedccbd19b2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":3928285174},{"type":"v1","addr":"172.21.15.115:6811","nonce":3928285174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":3928285174},{"type":"v1","addr":"172.21.15.115:6813","nonce":3928285174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":3928285174},{"type":"v1","addr":"172.21.15.115:6817","nonce":3928285174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":3928285174},{"type":"v1","addr":"172.21.15.115:6815","nonce":3928285174}]},"public_addr":"172.21.15.115:6811/3928285174","cluster_addr":"172.21.15.115:6813/3928285174","heartbeat_back_addr":"172.21.15.115:6817/3928285174","heartbeat_front_addr":"172.21.15.115:6815/3928285174","state":["exists","up"]},{"osd":2,"uuid":"40bc0278-21e6-4863-86bf-f5ee3bfc2fbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":1608421656},{"type":"v1","addr":"172.21.15.115:6819","nonce":1608421656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":1608421656},{"type":"v1","addr":"172.21.15.115:6821","nonce":1608421656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":1608421656},{"type":"v1","addr":"172.21.15.115:6825","nonce":1608421656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":1608421656},{"type":"v1","addr":"172.21.15.115:6823","nonce":1608421656}]},"public_addr":"172.21.15.115:6819/1608421656","cluster_addr":"172.21.15.115:6821/1608421656","heartbeat_back_addr":"172.21.15.115:6825/1608421656","heartbeat_front_addr":"172.21.15.115:6823/1608421656","state":["exists","up"]},{"osd":3,"uuid":"af3d701a-1c69-4cf2-a343-938ac1bbb34a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3054971968},{"type":"v1","addr":"172.21.15.195:6801","nonce":3054971968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3054971968},{"type":"v1","addr":"172.21.15.195:6803","nonce":3054971968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3054971968},{"type":"v1","addr":"172.21.15.195:6807","nonce":3054971968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3054971968},{"type":"v1","addr":"172.21.15.195:6805","nonce":3054971968}]},"public_addr":"172.21.15.195:6801/3054971968","cluster_addr":"172.21.15.195:6803/3054971968","heartbeat_back_addr":"172.21.15.195:6807/3054971968","heartbeat_front_addr":"172.21.15.195:6805/3054971968","state":["exists","up"]},{"osd":4,"uuid":"7bf484b6-6ed5-4fe7-8aa4-505853e2cd1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":1840094638},{"type":"v1","addr":"172.21.15.195:6809","nonce":1840094638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":1840094638},{"type":"v1","addr":"172.21.15.195:6811","nonce":1840094638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":1840094638},{"type":"v1","addr":"172.21.15.195:6815","nonce":1840094638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":1840094638},{"type":"v1","addr":"172.21.15.195:6813","nonce":1840094638}]},"public_addr":"172.21.15.195:6809/1840094638","cluster_addr":"172.21.15.195:6811/1840094638","heartbeat_back_addr":"172.21.15.195:6815/1840094638","heartbeat_front_addr":"172.21.15.195:6813/1840094638","state":["exists","up"]},{"osd":5,"uuid":"1eb8bcc4-dc9b-4a00-bf43-a707da3c141f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1862675419},{"type":"v1","addr":"172.21.15.195:6817","nonce":1862675419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1862675419},{"type":"v1","addr":"172.21.15.195:6819","nonce":1862675419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1862675419},{"type":"v1","addr":"172.21.15.195:6823","nonce":1862675419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1862675419},{"type":"v1","addr":"172.21.15.195:6821","nonce":1862675419}]},"public_addr":"172.21.15.195:6817/1862675419","cluster_addr":"172.21.15.195:6819/1862675419","heartbeat_back_addr":"172.21.15.195:6823/1862675419","heartbeat_front_addr":"172.21.15.195:6821/1862675419","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:59:47.662383+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:00:14.730551+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:00:43.856416+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:01:06.336209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:01:30.680442+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:01:55.518043+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.115:6827/1900336545":"2024-09-14T17:03:30.385433+0000","172.21.15.115:0/2751677160":"2024-09-14T16:58:29.159373+0000","172.21.15.115:6800/1463863592":"2024-09-14T16:56:57.112847+0000","172.21.15.115:0/3723628457":"2024-09-14T16:56:57.112847+0000","172.21.15.115:6801/1463863592":"2024-09-14T16:56:57.112847+0000","172.21.15.115:0/376622152":"2024-09-14T16:57:27.333203+0000","172.21.15.115:0/648599851":"2024-09-14T16:56:57.112847+0000","172.21.15.115:0/3791301867":"2024-09-14T16:57:27.333203+0000","172.21.15.115:0/2966038005":"2024-09-14T16:56:57.112847+0000","172.21.15.115:6801/3889408988":"2024-09-14T16:58:29.159373+0000","172.21.15.115:0/3586970461":"2024-09-14T16:57:27.333203+0000","172.21.15.115:6800/2943337696":"2024-09-14T16:57:27.333203+0000","172.21.15.115:6801/2943337696":"2024-09-14T16:57:27.333203+0000","172.21.15.115:0/247720257":"2024-09-14T16:58:29.159373+0000","172.21.15.115:6826/1900336545":"2024-09-14T17:03:30.385433+0000","172.21.15.115:0/931588236":"2024-09-14T16:58:29.159373+0000","172.21.15.115:6800/3889408988":"2024-09-14T16:58:29.159373+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:03:45.516 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.514+0000 7f491c453640 1 -- 172.21.15.115:0/1654409812 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f490006cc50 msgr2=0x7f490006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:45.516 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.514+0000 7f491c453640 1 --2- 172.21.15.115:0/1654409812 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f490006cc50 0x7f490006f110 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f49141959f0 tx=0x7f4908031400 comp rx=0 tx=0).stop 2024-09-13T17:03:45.516 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.514+0000 7f491c453640 1 -- 172.21.15.115:0/1654409812 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49140fe990 msgr2=0x7f49141944e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:45.516 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.514+0000 7f491c453640 1 --2- 172.21.15.115:0/1654409812 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49140fe990 0x7f49141944e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f491000b3d0 tx=0x7f491000b890 comp rx=0 tx=0).stop 2024-09-13T17:03:45.516 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.515+0000 7f491c453640 1 -- 172.21.15.115:0/1654409812 shutdown_connections 2024-09-13T17:03:45.516 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.515+0000 7f491c453640 1 --2- 172.21.15.115:0/1654409812 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f490006cc50 0x7f490006f110 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:45.516 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.515+0000 7f491c453640 1 --2- 172.21.15.115:0/1654409812 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f49140ffb80 0x7f4914194a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:45.516 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.515+0000 7f491c453640 1 --2- 172.21.15.115:0/1654409812 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49140fe990 0x7f49141944e0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:45.517 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.515+0000 7f491c453640 1 -- 172.21.15.115:0/1654409812 >> 172.21.15.115:0/1654409812 conn(0x7f49140fa0f0 msgr2=0x7f4914102db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:03:45.517 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.515+0000 7f491c453640 1 -- 172.21.15.115:0/1654409812 shutdown_connections 2024-09-13T17:03:45.517 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.515+0000 7f491c453640 1 -- 172.21.15.115:0/1654409812 wait complete. 2024-09-13T17:03:45.527 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:00:47.472140+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-09-13T17:03:15.097618+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-09-13T17:03:15.539103+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:03:45.527 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:03:45.576 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:45 smithi195 ceph-mon[34981]: from='client.? 172.21.15.115:0/149300347' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-09-13T17:03:45.631 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.628+0000 7fdb20be2640 1 -- 172.21.15.115:0/3187433796 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb1c0fe970 msgr2=0x7fdb1c0fed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:45.631 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.628+0000 7fdb20be2640 1 --2- 172.21.15.115:0/3187433796 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb1c0fe970 0x7fdb1c0fed70 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c009880 tx=0x7fdb0c02a4a0 comp rx=0 tx=0).stop 2024-09-13T17:03:45.632 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.628+0000 7fdb20be2640 1 -- 172.21.15.115:0/3187433796 shutdown_connections 2024-09-13T17:03:45.632 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.628+0000 7fdb20be2640 1 --2- 172.21.15.115:0/3187433796 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdb1c0ffb60 0x7fdb1c0fffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:45.632 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.628+0000 7fdb20be2640 1 --2- 172.21.15.115:0/3187433796 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb1c0fe970 0x7fdb1c0fed70 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:45.632 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.628+0000 7fdb20be2640 1 -- 172.21.15.115:0/3187433796 >> 172.21.15.115:0/3187433796 conn(0x7fdb1c0fa0f0 msgr2=0x7fdb1c0fc510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:03:45.632 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.628+0000 7fdb20be2640 1 -- 172.21.15.115:0/3187433796 shutdown_connections 2024-09-13T17:03:45.632 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.628+0000 7fdb20be2640 1 -- 172.21.15.115:0/3187433796 wait complete. 2024-09-13T17:03:45.632 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.628+0000 7fdb20be2640 1 Processor -- start 2024-09-13T17:03:45.632 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.629+0000 7fdb20be2640 1 -- start start 2024-09-13T17:03:45.632 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.629+0000 7fdb20be2640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdb1c0fe970 0x7fdb1c194390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:03:45.632 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.629+0000 7fdb20be2640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb1c0ffb60 0x7fdb1c1948d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:03:45.632 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.629+0000 7fdb20be2640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1c194e10 con 0x7fdb1c0ffb60 2024-09-13T17:03:45.632 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.629+0000 7fdb20be2640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1c194f80 con 0x7fdb1c0fe970 2024-09-13T17:03:45.633 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.629+0000 7fdb19d9b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb1c0ffb60 0x7fdb1c1948d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:03:45.633 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.629+0000 7fdb19d9b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb1c0ffb60 0x7fdb1c1948d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:34590/0 (socket says 172.21.15.115:34590) 2024-09-13T17:03:45.633 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.629+0000 7fdb19d9b640 1 -- 172.21.15.115:0/4160954005 learned_addr learned my addr 172.21.15.115:0/4160954005 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:03:45.633 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.629+0000 7fdb1a59c640 1 --2- 172.21.15.115:0/4160954005 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdb1c0fe970 0x7fdb1c194390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:03:45.633 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.629+0000 7fdb19d9b640 1 -- 172.21.15.115:0/4160954005 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdb1c0fe970 msgr2=0x7fdb1c194390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:45.633 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.629+0000 7fdb19d9b640 1 --2- 172.21.15.115:0/4160954005 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdb1c0fe970 0x7fdb1c194390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:45.633 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.629+0000 7fdb19d9b640 1 -- 172.21.15.115:0/4160954005 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb0c009560 con 0x7fdb1c0ffb60 2024-09-13T17:03:45.633 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.629+0000 7fdb19d9b640 1 --2- 172.21.15.115:0/4160954005 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb1c0ffb60 0x7fdb1c1948d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fdb1000c8a0 tx=0x7fdb1000cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:03:45.633 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.629+0000 7fdb0b7fe640 1 -- 172.21.15.115:0/4160954005 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb10007b80 con 0x7fdb1c0ffb60 2024-09-13T17:03:45.633 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.629+0000 7fdb0b7fe640 1 -- 172.21.15.115:0/4160954005 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdb10007ce0 con 0x7fdb1c0ffb60 2024-09-13T17:03:45.633 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.629+0000 7fdb20be2640 1 -- 172.21.15.115:0/4160954005 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb1c199a50 con 0x7fdb1c0ffb60 2024-09-13T17:03:45.633 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.629+0000 7fdb0b7fe640 1 -- 172.21.15.115:0/4160954005 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb10018770 con 0x7fdb1c0ffb60 2024-09-13T17:03:45.634 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.629+0000 7fdb20be2640 1 -- 172.21.15.115:0/4160954005 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb1c19a000 con 0x7fdb1c0ffb60 2024-09-13T17:03:45.634 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.630+0000 7fdb20be2640 1 -- 172.21.15.115:0/4160954005 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb1c0fed70 con 0x7fdb1c0ffb60 2024-09-13T17:03:45.634 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.631+0000 7fdb0b7fe640 1 -- 172.21.15.115:0/4160954005 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fdb100189e0 con 0x7fdb1c0ffb60 2024-09-13T17:03:45.634 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.631+0000 7fdb0b7fe640 1 --2- 172.21.15.115:0/4160954005 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fdb0406cc50 0x7fdb0406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:03:45.635 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.631+0000 7fdb0b7fe640 1 -- 172.21.15.115:0/4160954005 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fdb1008c4f0 con 0x7fdb1c0ffb60 2024-09-13T17:03:45.635 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.631+0000 7fdb1a59c640 1 --2- 172.21.15.115:0/4160954005 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fdb0406cc50 0x7fdb0406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:03:45.635 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.632+0000 7fdb1a59c640 1 --2- 172.21.15.115:0/4160954005 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fdb0406cc50 0x7fdb0406f110 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c000c00 tx=0x7fdb0c031400 comp rx=0 tx=0).ready entity=mgr.14207 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:03:45.637 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.636+0000 7fdb0b7fe640 1 -- 172.21.15.115:0/4160954005 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fdb10056860 con 0x7fdb1c0ffb60 2024-09-13T17:03:45.812 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.811+0000 7fdb20be2640 1 -- 172.21.15.115:0/4160954005 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdb1c107620 con 0x7fdb1c0ffb60 2024-09-13T17:03:45.812 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.811+0000 7fdb0b7fe640 1 -- 172.21.15.115:0/4160954005 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v46) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdb10059e80 con 0x7fdb1c0ffb60 2024-09-13T17:03:45.812 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 1 2024-09-13T17:03:45.815 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.813+0000 7fdb20be2640 1 -- 172.21.15.115:0/4160954005 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fdb0406cc50 msgr2=0x7fdb0406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:45.815 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.813+0000 7fdb20be2640 1 --2- 172.21.15.115:0/4160954005 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fdb0406cc50 0x7fdb0406f110 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c000c00 tx=0x7fdb0c031400 comp rx=0 tx=0).stop 2024-09-13T17:03:45.815 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.813+0000 7fdb20be2640 1 -- 172.21.15.115:0/4160954005 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb1c0ffb60 msgr2=0x7fdb1c1948d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:45.815 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.813+0000 7fdb20be2640 1 --2- 172.21.15.115:0/4160954005 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb1c0ffb60 0x7fdb1c1948d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fdb1000c8a0 tx=0x7fdb1000cd60 comp rx=0 tx=0).stop 2024-09-13T17:03:45.815 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.813+0000 7fdb20be2640 1 -- 172.21.15.115:0/4160954005 shutdown_connections 2024-09-13T17:03:45.815 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.813+0000 7fdb20be2640 1 --2- 172.21.15.115:0/4160954005 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fdb0406cc50 0x7fdb0406f110 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:45.815 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.813+0000 7fdb20be2640 1 --2- 172.21.15.115:0/4160954005 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb1c0ffb60 0x7fdb1c1948d0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:45.815 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.813+0000 7fdb20be2640 1 --2- 172.21.15.115:0/4160954005 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdb1c0fe970 0x7fdb1c194390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:45.815 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.813+0000 7fdb20be2640 1 -- 172.21.15.115:0/4160954005 >> 172.21.15.115:0/4160954005 conn(0x7fdb1c0fa0f0 msgr2=0x7fdb1c102d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:03:45.815 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.813+0000 7fdb20be2640 1 -- 172.21.15.115:0/4160954005 shutdown_connections 2024-09-13T17:03:45.815 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.814+0000 7fdb20be2640 1 -- 172.21.15.115:0/4160954005 wait complete. 2024-09-13T17:03:45.826 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-09-13T17:03:45.934 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.931+0000 7fce60c80640 1 -- 172.21.15.115:0/2402559649 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce5c0ffb80 msgr2=0x7fce5c100000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:45.935 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.931+0000 7fce60c80640 1 --2- 172.21.15.115:0/2402559649 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce5c0ffb80 0x7fce5c100000 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fce50009880 tx=0x7fce5002a4a0 comp rx=0 tx=0).stop 2024-09-13T17:03:45.935 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.932+0000 7fce60c80640 1 -- 172.21.15.115:0/2402559649 shutdown_connections 2024-09-13T17:03:45.935 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.932+0000 7fce60c80640 1 --2- 172.21.15.115:0/2402559649 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce5c0ffb80 0x7fce5c100000 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:45.935 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.932+0000 7fce60c80640 1 --2- 172.21.15.115:0/2402559649 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce5c0fe990 0x7fce5c0fed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:45.935 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.932+0000 7fce60c80640 1 -- 172.21.15.115:0/2402559649 >> 172.21.15.115:0/2402559649 conn(0x7fce5c0fa0f0 msgr2=0x7fce5c0fc530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:03:45.935 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.932+0000 7fce60c80640 1 -- 172.21.15.115:0/2402559649 shutdown_connections 2024-09-13T17:03:45.935 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.932+0000 7fce60c80640 1 -- 172.21.15.115:0/2402559649 wait complete. 2024-09-13T17:03:45.935 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.932+0000 7fce60c80640 1 Processor -- start 2024-09-13T17:03:45.935 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.932+0000 7fce60c80640 1 -- start start 2024-09-13T17:03:45.935 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.933+0000 7fce60c80640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce5c0fe990 0x7fce5c194380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:03:45.935 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.933+0000 7fce60c80640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce5c0ffb80 0x7fce5c1948c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:03:45.935 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.933+0000 7fce60c80640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce5c194e90 con 0x7fce5c0fe990 2024-09-13T17:03:45.936 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.933+0000 7fce60c80640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce5c195000 con 0x7fce5c0ffb80 2024-09-13T17:03:45.936 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.933+0000 7fce5a59c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce5c0fe990 0x7fce5c194380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:03:45.936 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.933+0000 7fce5a59c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce5c0fe990 0x7fce5c194380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:34606/0 (socket says 172.21.15.115:34606) 2024-09-13T17:03:45.936 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.933+0000 7fce5a59c640 1 -- 172.21.15.115:0/2355696003 learned_addr learned my addr 172.21.15.115:0/2355696003 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:03:45.936 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.933+0000 7fce59d9b640 1 --2- 172.21.15.115:0/2355696003 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce5c0ffb80 0x7fce5c1948c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:03:45.936 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.933+0000 7fce5a59c640 1 -- 172.21.15.115:0/2355696003 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce5c0ffb80 msgr2=0x7fce5c1948c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:45.936 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.933+0000 7fce5a59c640 1 --2- 172.21.15.115:0/2355696003 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce5c0ffb80 0x7fce5c1948c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:45.936 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.933+0000 7fce5a59c640 1 -- 172.21.15.115:0/2355696003 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce50009560 con 0x7fce5c0fe990 2024-09-13T17:03:45.936 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.933+0000 7fce59d9b640 1 --2- 172.21.15.115:0/2355696003 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce5c0ffb80 0x7fce5c1948c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:03:45.936 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.933+0000 7fce5a59c640 1 --2- 172.21.15.115:0/2355696003 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce5c0fe990 0x7fce5c194380 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fce4c00d8d0 tx=0x7fce4c00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:03:45.936 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.933+0000 7fce4b7fe640 1 -- 172.21.15.115:0/2355696003 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce4c009a30 con 0x7fce5c0fe990 2024-09-13T17:03:45.936 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.933+0000 7fce60c80640 1 -- 172.21.15.115:0/2355696003 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce5c199a90 con 0x7fce5c0fe990 2024-09-13T17:03:45.936 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.933+0000 7fce4b7fe640 1 -- 172.21.15.115:0/2355696003 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fce4c009b90 con 0x7fce5c0fe990 2024-09-13T17:03:45.936 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.933+0000 7fce4b7fe640 1 -- 172.21.15.115:0/2355696003 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce4c00f5f0 con 0x7fce5c0fe990 2024-09-13T17:03:45.936 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.933+0000 7fce60c80640 1 -- 172.21.15.115:0/2355696003 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce5c19a070 con 0x7fce5c0fe990 2024-09-13T17:03:45.937 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.934+0000 7fce60c80640 1 -- 172.21.15.115:0/2355696003 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce5c18e3e0 con 0x7fce5c0fe990 2024-09-13T17:03:45.937 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.935+0000 7fce4b7fe640 1 -- 172.21.15.115:0/2355696003 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fce4c009d00 con 0x7fce5c0fe990 2024-09-13T17:03:45.937 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.935+0000 7fce4b7fe640 1 --2- 172.21.15.115:0/2355696003 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fce4406cc60 0x7fce4406f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:03:45.938 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.935+0000 7fce4b7fe640 1 -- 172.21.15.115:0/2355696003 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fce4c08c110 con 0x7fce5c0fe990 2024-09-13T17:03:45.938 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.935+0000 7fce59d9b640 1 --2- 172.21.15.115:0/2355696003 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fce4406cc60 0x7fce4406f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:03:45.938 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.936+0000 7fce59d9b640 1 --2- 172.21.15.115:0/2355696003 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fce4406cc60 0x7fce4406f120 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fce5c195890 tx=0x7fce50031400 comp rx=0 tx=0).ready entity=mgr.14207 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:03:45.940 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:45.939+0000 7fce4b7fe640 1 -- 172.21.15.115:0/2355696003 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fce4c056480 con 0x7fce5c0fe990 2024-09-13T17:03:46.104 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.103+0000 7fce60c80640 1 -- 172.21.15.115:0/2355696003 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7fce5c107450 con 0x7fce5c0fe990 2024-09-13T17:03:46.104 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.103+0000 7fce4b7fe640 1 -- 172.21.15.115:0/2355696003 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v46) v1 ==== 107+0+11 (secure 0 0 0) 0x7fce4c059aa0 con 0x7fce5c0fe990 2024-09-13T17:03:46.105 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 32 2024-09-13T17:03:46.107 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.105+0000 7fce60c80640 1 -- 172.21.15.115:0/2355696003 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fce4406cc60 msgr2=0x7fce4406f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:46.107 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.105+0000 7fce60c80640 1 --2- 172.21.15.115:0/2355696003 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fce4406cc60 0x7fce4406f120 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fce5c195890 tx=0x7fce50031400 comp rx=0 tx=0).stop 2024-09-13T17:03:46.107 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.105+0000 7fce60c80640 1 -- 172.21.15.115:0/2355696003 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce5c0fe990 msgr2=0x7fce5c194380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:46.107 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.105+0000 7fce60c80640 1 --2- 172.21.15.115:0/2355696003 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce5c0fe990 0x7fce5c194380 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fce4c00d8d0 tx=0x7fce4c00dd90 comp rx=0 tx=0).stop 2024-09-13T17:03:46.107 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.105+0000 7fce60c80640 1 -- 172.21.15.115:0/2355696003 shutdown_connections 2024-09-13T17:03:46.107 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.105+0000 7fce60c80640 1 --2- 172.21.15.115:0/2355696003 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fce4406cc60 0x7fce4406f120 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:46.107 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.105+0000 7fce60c80640 1 --2- 172.21.15.115:0/2355696003 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce5c0ffb80 0x7fce5c1948c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:46.107 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.105+0000 7fce60c80640 1 --2- 172.21.15.115:0/2355696003 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce5c0fe990 0x7fce5c194380 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:46.107 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.105+0000 7fce60c80640 1 -- 172.21.15.115:0/2355696003 >> 172.21.15.115:0/2355696003 conn(0x7fce5c0fa0f0 msgr2=0x7fce5c1032c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:03:46.108 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.105+0000 7fce60c80640 1 -- 172.21.15.115:0/2355696003 shutdown_connections 2024-09-13T17:03:46.108 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.105+0000 7fce60c80640 1 -- 172.21.15.115:0/2355696003 wait complete. 2024-09-13T17:03:46.117 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-09-13T17:03:46.220 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.217+0000 7f5603f7d640 1 -- 172.21.15.115:0/4192502818 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f55fc0ffa90 msgr2=0x7f55fc0ffe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:46.221 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.217+0000 7f5603f7d640 1 --2- 172.21.15.115:0/4192502818 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f55fc0ffa90 0x7f55fc0ffe90 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f55f8009880 tx=0x7f55f802a4a0 comp rx=0 tx=0).stop 2024-09-13T17:03:46.221 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.217+0000 7f5603f7d640 1 -- 172.21.15.115:0/4192502818 shutdown_connections 2024-09-13T17:03:46.221 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.217+0000 7f5603f7d640 1 --2- 172.21.15.115:0/4192502818 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f55fc100c80 0x7f55fc101100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:46.221 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.217+0000 7f5603f7d640 1 --2- 172.21.15.115:0/4192502818 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f55fc0ffa90 0x7f55fc0ffe90 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:46.221 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.217+0000 7f5603f7d640 1 -- 172.21.15.115:0/4192502818 >> 172.21.15.115:0/4192502818 conn(0x7f55fc0fb1f0 msgr2=0x7f55fc0fd630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:03:46.221 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.218+0000 7f5603f7d640 1 -- 172.21.15.115:0/4192502818 shutdown_connections 2024-09-13T17:03:46.221 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.218+0000 7f5603f7d640 1 -- 172.21.15.115:0/4192502818 wait complete. 2024-09-13T17:03:46.221 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.218+0000 7f5603f7d640 1 Processor -- start 2024-09-13T17:03:46.221 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.218+0000 7f5603f7d640 1 -- start start 2024-09-13T17:03:46.221 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.218+0000 7f5603f7d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f55fc0ffa90 0x7f55fc1955a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:03:46.221 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.218+0000 7f5603f7d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f55fc100c80 0x7f55fc195ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:03:46.221 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.218+0000 7f5603f7d640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55fc1960b0 con 0x7f55fc0ffa90 2024-09-13T17:03:46.222 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.218+0000 7f5603f7d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55fc196220 con 0x7f55fc100c80 2024-09-13T17:03:46.222 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.218+0000 7f5601d19640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f55fc0ffa90 0x7f55fc1955a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:03:46.222 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.218+0000 7f5601d19640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f55fc0ffa90 0x7f55fc1955a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:34626/0 (socket says 172.21.15.115:34626) 2024-09-13T17:03:46.222 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.218+0000 7f5601d19640 1 -- 172.21.15.115:0/2715267420 learned_addr learned my addr 172.21.15.115:0/2715267420 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:03:46.222 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.218+0000 7f5601518640 1 --2- 172.21.15.115:0/2715267420 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f55fc100c80 0x7f55fc195ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:03:46.222 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.219+0000 7f5601d19640 1 -- 172.21.15.115:0/2715267420 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f55fc100c80 msgr2=0x7f55fc195ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:46.222 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.219+0000 7f5601d19640 1 --2- 172.21.15.115:0/2715267420 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f55fc100c80 0x7f55fc195ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:46.222 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.219+0000 7f5601d19640 1 -- 172.21.15.115:0/2715267420 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55f8009560 con 0x7f55fc0ffa90 2024-09-13T17:03:46.222 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.219+0000 7f5601d19640 1 --2- 172.21.15.115:0/2715267420 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f55fc0ffa90 0x7f55fc1955a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f55f8005610 tx=0x7f55f8005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:03:46.222 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.219+0000 7f55f2ffd640 1 -- 172.21.15.115:0/2715267420 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55f8004b20 con 0x7f55fc0ffa90 2024-09-13T17:03:46.222 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.219+0000 7f5603f7d640 1 -- 172.21.15.115:0/2715267420 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55fc19ac50 con 0x7f55fc0ffa90 2024-09-13T17:03:46.222 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.219+0000 7f55f2ffd640 1 -- 172.21.15.115:0/2715267420 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f55f8004c80 con 0x7f55fc0ffa90 2024-09-13T17:03:46.222 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.219+0000 7f55f2ffd640 1 -- 172.21.15.115:0/2715267420 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55f8031af0 con 0x7f55fc0ffa90 2024-09-13T17:03:46.222 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.219+0000 7f5603f7d640 1 -- 172.21.15.115:0/2715267420 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55fc19b150 con 0x7f55fc0ffa90 2024-09-13T17:03:46.223 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.220+0000 7f5603f7d640 1 -- 172.21.15.115:0/2715267420 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55fc1085b0 con 0x7f55fc0ffa90 2024-09-13T17:03:46.223 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.220+0000 7f55f2ffd640 1 -- 172.21.15.115:0/2715267420 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f55f80035f0 con 0x7f55fc0ffa90 2024-09-13T17:03:46.223 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.221+0000 7f55f2ffd640 1 --2- 172.21.15.115:0/2715267420 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f55e806cc60 0x7f55e806f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:03:46.223 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.221+0000 7f55f2ffd640 1 -- 172.21.15.115:0/2715267420 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f55f80ad610 con 0x7f55fc0ffa90 2024-09-13T17:03:46.224 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.221+0000 7f5601518640 1 --2- 172.21.15.115:0/2715267420 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f55e806cc60 0x7f55e806f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:03:46.224 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.221+0000 7f5601518640 1 --2- 172.21.15.115:0/2715267420 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f55e806cc60 0x7f55e806f120 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f55fc196ab0 tx=0x7f55ec008040 comp rx=0 tx=0).ready entity=mgr.14207 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:03:46.226 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.225+0000 7f55f2ffd640 1 -- 172.21.15.115:0/2715267420 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f55f8077980 con 0x7f55fc0ffa90 2024-09-13T17:03:46.390 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.389+0000 7f5603f7d640 1 -- 172.21.15.115:0/2715267420 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f55fc19b370 con 0x7f55fc0ffa90 2024-09-13T17:03:46.390 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.389+0000 7f55f2ffd640 1 -- 172.21.15.115:0/2715267420 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v46) v1 ==== 107+0+11 (secure 0 0 0) 0x7f55f807afa0 con 0x7f55fc0ffa90 2024-09-13T17:03:46.391 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 32 2024-09-13T17:03:46.393 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.391+0000 7f5603f7d640 1 -- 172.21.15.115:0/2715267420 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f55e806cc60 msgr2=0x7f55e806f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:46.393 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.391+0000 7f5603f7d640 1 --2- 172.21.15.115:0/2715267420 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f55e806cc60 0x7f55e806f120 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f55fc196ab0 tx=0x7f55ec008040 comp rx=0 tx=0).stop 2024-09-13T17:03:46.393 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.391+0000 7f5603f7d640 1 -- 172.21.15.115:0/2715267420 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f55fc0ffa90 msgr2=0x7f55fc1955a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:46.393 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.391+0000 7f5603f7d640 1 --2- 172.21.15.115:0/2715267420 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f55fc0ffa90 0x7f55fc1955a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f55f8005610 tx=0x7f55f8005640 comp rx=0 tx=0).stop 2024-09-13T17:03:46.393 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.391+0000 7f5603f7d640 1 -- 172.21.15.115:0/2715267420 shutdown_connections 2024-09-13T17:03:46.393 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.391+0000 7f5603f7d640 1 --2- 172.21.15.115:0/2715267420 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f55e806cc60 0x7f55e806f120 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:46.393 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.391+0000 7f5603f7d640 1 --2- 172.21.15.115:0/2715267420 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f55fc100c80 0x7f55fc195ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:46.393 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.391+0000 7f5603f7d640 1 --2- 172.21.15.115:0/2715267420 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f55fc0ffa90 0x7f55fc1955a0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:46.393 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.391+0000 7f5603f7d640 1 -- 172.21.15.115:0/2715267420 >> 172.21.15.115:0/2715267420 conn(0x7f55fc0fb1f0 msgr2=0x7f55fc103eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:03:46.393 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.392+0000 7f5603f7d640 1 -- 172.21.15.115:0/2715267420 shutdown_connections 2024-09-13T17:03:46.393 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.392+0000 7f5603f7d640 1 -- 172.21.15.115:0/2715267420 wait complete. 2024-09-13T17:03:46.402 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:46 smithi115 ceph-mon[27708]: pgmap v192: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 8.2 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-13T17:03:46.403 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:46 smithi115 ceph-mon[27708]: from='client.? 172.21.15.115:0/1654409812' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:03:46.403 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:46 smithi115 ceph-mon[27708]: from='client.? 172.21.15.115:0/4160954005' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T17:03:46.403 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:46 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:03:46.403 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:46 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:03:46.403 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:46 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:03:46.403 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:46 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:03:46.403 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:46 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:03:46.403 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:46 smithi115 ceph-mon[27708]: from='client.? 172.21.15.115:0/2355696003' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-09-13T17:03:46.404 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:03:46.504 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.501+0000 7fa5ced9c640 1 -- 172.21.15.115:0/4205226493 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5c80ffba0 msgr2=0x7fa5c8100020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:46.504 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.501+0000 7fa5ced9c640 1 --2- 172.21.15.115:0/4205226493 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5c80ffba0 0x7fa5c8100020 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa5b4009880 tx=0x7fa5b402a4a0 comp rx=0 tx=0).stop 2024-09-13T17:03:46.504 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.501+0000 7fa5ced9c640 1 -- 172.21.15.115:0/4205226493 shutdown_connections 2024-09-13T17:03:46.504 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.501+0000 7fa5ced9c640 1 --2- 172.21.15.115:0/4205226493 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5c80ffba0 0x7fa5c8100020 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:46.504 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.501+0000 7fa5ced9c640 1 --2- 172.21.15.115:0/4205226493 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa5c80fe9b0 0x7fa5c80fedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:46.504 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.501+0000 7fa5ced9c640 1 -- 172.21.15.115:0/4205226493 >> 172.21.15.115:0/4205226493 conn(0x7fa5c80fa130 msgr2=0x7fa5c80fc550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:03:46.504 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.501+0000 7fa5ced9c640 1 -- 172.21.15.115:0/4205226493 shutdown_connections 2024-09-13T17:03:46.505 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.501+0000 7fa5ced9c640 1 -- 172.21.15.115:0/4205226493 wait complete. 2024-09-13T17:03:46.505 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.501+0000 7fa5ced9c640 1 Processor -- start 2024-09-13T17:03:46.505 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.501+0000 7fa5ced9c640 1 -- start start 2024-09-13T17:03:46.505 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.502+0000 7fa5ced9c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa5c80fe9b0 0x7fa5c8068b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:03:46.505 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.502+0000 7fa5ced9c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5c80ffba0 0x7fa5c819a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:03:46.505 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.502+0000 7fa5ced9c640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c819a880 con 0x7fa5c80ffba0 2024-09-13T17:03:46.505 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.502+0000 7fa5ced9c640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c819a9c0 con 0x7fa5c80fe9b0 2024-09-13T17:03:46.505 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.502+0000 7fa5c7fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5c80ffba0 0x7fa5c819a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:03:46.505 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.502+0000 7fa5c7fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5c80ffba0 0x7fa5c819a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:34650/0 (socket says 172.21.15.115:34650) 2024-09-13T17:03:46.505 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.502+0000 7fa5c7fff640 1 -- 172.21.15.115:0/2365479147 learned_addr learned my addr 172.21.15.115:0/2365479147 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:03:46.505 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.502+0000 7fa5ccb38640 1 --2- 172.21.15.115:0/2365479147 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa5c80fe9b0 0x7fa5c8068b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:03:46.505 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.502+0000 7fa5c7fff640 1 -- 172.21.15.115:0/2365479147 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa5c80fe9b0 msgr2=0x7fa5c8068b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:46.505 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.502+0000 7fa5c7fff640 1 --2- 172.21.15.115:0/2365479147 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa5c80fe9b0 0x7fa5c8068b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:46.506 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.502+0000 7fa5c7fff640 1 -- 172.21.15.115:0/2365479147 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5b4009560 con 0x7fa5c80ffba0 2024-09-13T17:03:46.506 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.502+0000 7fa5c7fff640 1 --2- 172.21.15.115:0/2365479147 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5c80ffba0 0x7fa5c819a2b0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fa5b4031460 tx=0x7fa5b40056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:03:46.506 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.502+0000 7fa5c5ffb640 1 -- 172.21.15.115:0/2365479147 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5b4004c60 con 0x7fa5c80ffba0 2024-09-13T17:03:46.506 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.502+0000 7fa5ced9c640 1 -- 172.21.15.115:0/2365479147 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5c819ac10 con 0x7fa5c80ffba0 2024-09-13T17:03:46.506 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.502+0000 7fa5c5ffb640 1 -- 172.21.15.115:0/2365479147 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa5b4004dc0 con 0x7fa5c80ffba0 2024-09-13T17:03:46.506 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.502+0000 7fa5c5ffb640 1 -- 172.21.15.115:0/2365479147 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5b4031a90 con 0x7fa5c80ffba0 2024-09-13T17:03:46.506 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.503+0000 7fa5ced9c640 1 -- 172.21.15.115:0/2365479147 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5c819b190 con 0x7fa5c80ffba0 2024-09-13T17:03:46.507 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.503+0000 7fa5ced9c640 1 -- 172.21.15.115:0/2365479147 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5c8107470 con 0x7fa5c80ffba0 2024-09-13T17:03:46.507 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.504+0000 7fa5c5ffb640 1 -- 172.21.15.115:0/2365479147 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fa5b4031d10 con 0x7fa5c80ffba0 2024-09-13T17:03:46.507 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.504+0000 7fa5c5ffb640 1 --2- 172.21.15.115:0/2365479147 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fa5b806cc50 0x7fa5b806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:03:46.507 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.504+0000 7fa5c5ffb640 1 -- 172.21.15.115:0/2365479147 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fa5b40ad5a0 con 0x7fa5c80ffba0 2024-09-13T17:03:46.507 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.504+0000 7fa5ccb38640 1 --2- 172.21.15.115:0/2365479147 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fa5b806cc50 0x7fa5b806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:03:46.507 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.505+0000 7fa5ccb38640 1 --2- 172.21.15.115:0/2365479147 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fa5b806cc50 0x7fa5b806f110 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc0058c0 tx=0x7fa5bc00a4c0 comp rx=0 tx=0).ready entity=mgr.14207 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:03:46.510 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.509+0000 7fa5c5ffb640 1 -- 172.21.15.115:0/2365479147 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa5b4077910 con 0x7fa5c80ffba0 2024-09-13T17:03:46.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:46 smithi195 ceph-mon[34981]: pgmap v192: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 8.2 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-13T17:03:46.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:46 smithi195 ceph-mon[34981]: from='client.? 172.21.15.115:0/1654409812' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:03:46.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:46 smithi195 ceph-mon[34981]: from='client.? 172.21.15.115:0/4160954005' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T17:03:46.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:46 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:03:46.580 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:46 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:03:46.580 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:46 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:03:46.580 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:46 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:03:46.580 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:46 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:03:46.580 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:46 smithi195 ceph-mon[34981]: from='client.? 172.21.15.115:0/2355696003' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-09-13T17:03:46.705 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.704+0000 7fa5ced9c640 1 -- 172.21.15.115:0/2365479147 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa5c8107600 con 0x7fa5c80ffba0 2024-09-13T17:03:46.706 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.705+0000 7fa5c5ffb640 1 -- 172.21.15.115:0/2365479147 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4836 (secure 0 0 0) 0x7fa5b407af30 con 0x7fa5c80ffba0 2024-09-13T17:03:46.706 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:03:46.706 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24253,"name":"cephfs.smithi195.aevvgz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.195:6827/8826118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":8826118},{"type":"v1","addr":"172.21.15.195:6827","nonce":8826118}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":24259,"name":"cephfs.smithi195.qzghxj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6825/3335357704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3335357704},{"type":"v1","addr":"172.21.15.195:6825","nonce":3335357704}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T17:03:16.313116+0000","modified":"2024-09-13T17:03:33.410348+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":46,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14470":{"gid":14470,"name":"cephfs.smithi115.ijznvr","rank":0,"incarnation":15,"state":"up:active","state_seq":5,"addr":"172.21.15.115:6829/4128583274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":4128583274},{"type":"v1","addr":"172.21.15.115:6829","nonce":4128583274}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14486":{"gid":14486,"name":"cephfs.smithi115.hbtxod","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.115:6827/1977394649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":1977394649},{"type":"v1","addr":"172.21.15.115:6827","nonce":1977394649}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-13T17:03:46.707 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 19 2024-09-13T17:03:46.708 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.707+0000 7fa5ced9c640 1 -- 172.21.15.115:0/2365479147 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fa5b806cc50 msgr2=0x7fa5b806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:46.709 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.707+0000 7fa5ced9c640 1 --2- 172.21.15.115:0/2365479147 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fa5b806cc50 0x7fa5b806f110 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc0058c0 tx=0x7fa5bc00a4c0 comp rx=0 tx=0).stop 2024-09-13T17:03:46.709 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.707+0000 7fa5ced9c640 1 -- 172.21.15.115:0/2365479147 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5c80ffba0 msgr2=0x7fa5c819a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:46.709 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.707+0000 7fa5ced9c640 1 --2- 172.21.15.115:0/2365479147 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5c80ffba0 0x7fa5c819a2b0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fa5b4031460 tx=0x7fa5b40056e0 comp rx=0 tx=0).stop 2024-09-13T17:03:46.709 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.707+0000 7fa5ced9c640 1 -- 172.21.15.115:0/2365479147 shutdown_connections 2024-09-13T17:03:46.709 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.707+0000 7fa5ced9c640 1 --2- 172.21.15.115:0/2365479147 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fa5b806cc50 0x7fa5b806f110 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:46.709 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.707+0000 7fa5ced9c640 1 --2- 172.21.15.115:0/2365479147 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5c80ffba0 0x7fa5c819a2b0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:46.709 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.707+0000 7fa5ced9c640 1 --2- 172.21.15.115:0/2365479147 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa5c80fe9b0 0x7fa5c8068b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:46.709 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.707+0000 7fa5ced9c640 1 -- 172.21.15.115:0/2365479147 >> 172.21.15.115:0/2365479147 conn(0x7fa5c80fa130 msgr2=0x7fa5c8102dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:03:46.709 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.707+0000 7fa5ced9c640 1 -- 172.21.15.115:0/2365479147 shutdown_connections 2024-09-13T17:03:46.709 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:46.707+0000 7fa5ced9c640 1 -- 172.21.15.115:0/2365479147 wait complete. 2024-09-13T17:03:46.719 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 19, 'max_mds': 1, 'flags': 50} 2024-09-13T17:03:46.719 INFO:teuthology.run_tasks:Running task kclient... 2024-09-13T17:03:46.749 INFO:tasks.kclient:Mounting kernel clients... 2024-09-13T17:03:46.749 INFO:tasks.kclient:config is {'client.0': {}, 'client.1': {}} 2024-09-13T17:03:46.750 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:03:46.750 DEBUG:teuthology.orchestra.run.smithi115:> ip netns list 2024-09-13T17:03:46.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:03:46.766 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link delete ceph-brx 2024-09-13T17:03:46.833 INFO:teuthology.orchestra.run.smithi115.stderr:Cannot find device "ceph-brx" 2024-09-13T17:03:46.834 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:03:46.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:03:46.835 DEBUG:teuthology.orchestra.run.smithi195:> ip netns list 2024-09-13T17:03:46.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:03:46.855 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link delete ceph-brx 2024-09-13T17:03:46.931 INFO:teuthology.orchestra.run.smithi195.stderr:Cannot find device "ceph-brx" 2024-09-13T17:03:46.932 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:03:46.933 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-09-13T17:03:46.933 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T17:03:46.933 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T17:03:46.933 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-13T17:03:47.128 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T17:03:47.474 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:47 smithi115 ceph-mon[27708]: from='client.? 172.21.15.115:0/2715267420' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-09-13T17:03:47.474 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:47 smithi115 ceph-mon[27708]: from='client.? 172.21.15.115:0/2365479147' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:03:47.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:47 smithi195 ceph-mon[34981]: from='client.? 172.21.15.115:0/2715267420' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-09-13T17:03:47.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:47 smithi195 ceph-mon[34981]: from='client.? 172.21.15.115:0/2365479147' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:03:48.554 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:48 smithi115 ceph-mon[27708]: pgmap v193: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 4.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-13T17:03:48.576 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:48 smithi195 ceph-mon[34981]: pgmap v193: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 4.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-13T17:03:48.816 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:48.794+0000 7fa42b4ec640 1 -- 172.21.15.115:0/950557632 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa4240ff3e0 msgr2=0x7fa4241038b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:48.817 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:48.794+0000 7fa42b4ec640 1 --2- 172.21.15.115:0/950557632 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa4240ff3e0 0x7fa4241038b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fa414009880 tx=0x7fa41402a530 comp rx=0 tx=0).stop 2024-09-13T17:03:48.817 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:48.794+0000 7fa42b4ec640 1 -- 172.21.15.115:0/950557632 shutdown_connections 2024-09-13T17:03:48.817 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:48.794+0000 7fa42b4ec640 1 --2- 172.21.15.115:0/950557632 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa4240ff3e0 0x7fa4241038b0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:48.817 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:48.794+0000 7fa42b4ec640 1 --2- 172.21.15.115:0/950557632 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa4240feac0 0x7fa4240feea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:48.817 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:48.794+0000 7fa42b4ec640 1 -- 172.21.15.115:0/950557632 >> 172.21.15.115:0/950557632 conn(0x7fa4240fa730 msgr2=0x7fa4240fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:03:48.817 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:48.794+0000 7fa42b4ec640 1 -- 172.21.15.115:0/950557632 shutdown_connections 2024-09-13T17:03:48.817 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:48.794+0000 7fa42b4ec640 1 -- 172.21.15.115:0/950557632 wait complete. 2024-09-13T17:03:48.817 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:48.795+0000 7fa42b4ec640 1 Processor -- start 2024-09-13T17:03:48.817 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:48.795+0000 7fa42b4ec640 1 -- start start 2024-09-13T17:03:48.817 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:48.795+0000 7fa42b4ec640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa4240feac0 0x7fa42419c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:03:48.817 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:48.795+0000 7fa42b4ec640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa4240ff3e0 0x7fa42419c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:03:48.818 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:48.795+0000 7fa42b4ec640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa42419cbe0 con 0x7fa4240feac0 2024-09-13T17:03:48.818 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:48.795+0000 7fa42b4ec640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4241a0950 con 0x7fa4240ff3e0 2024-09-13T17:03:48.818 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:48.795+0000 7fa429288640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa4240feac0 0x7fa42419c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:03:48.818 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:48.795+0000 7fa429288640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa4240feac0 0x7fa42419c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:34660/0 (socket says 172.21.15.115:34660) 2024-09-13T17:03:48.818 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:48.795+0000 7fa429288640 1 -- 172.21.15.115:0/4229337281 learned_addr learned my addr 172.21.15.115:0/4229337281 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:03:48.818 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:48.795+0000 7fa428a87640 1 --2- 172.21.15.115:0/4229337281 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa4240ff3e0 0x7fa42419c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:03:48.818 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:48.795+0000 7fa429288640 1 -- 172.21.15.115:0/4229337281 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa4240ff3e0 msgr2=0x7fa42419c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:48.818 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:48.795+0000 7fa429288640 1 --2- 172.21.15.115:0/4229337281 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa4240ff3e0 0x7fa42419c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:48.818 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:48.795+0000 7fa429288640 1 -- 172.21.15.115:0/4229337281 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa414009560 con 0x7fa4240feac0 2024-09-13T17:03:48.818 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:48.796+0000 7fa428a87640 1 --2- 172.21.15.115:0/4229337281 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa4240ff3e0 0x7fa42419c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:03:48.818 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:48.796+0000 7fa429288640 1 --2- 172.21.15.115:0/4229337281 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa4240feac0 0x7fa42419c010 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa42000d8d0 tx=0x7fa42000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:03:48.818 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:48.796+0000 7fa41a7fc640 1 -- 172.21.15.115:0/4229337281 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa42000bea0 con 0x7fa4240feac0 2024-09-13T17:03:48.818 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:48.796+0000 7fa42b4ec640 1 -- 172.21.15.115:0/4229337281 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4241a0c30 con 0x7fa4240feac0 2024-09-13T17:03:48.819 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:48.796+0000 7fa41a7fc640 1 -- 172.21.15.115:0/4229337281 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa420009c00 con 0x7fa4240feac0 2024-09-13T17:03:48.819 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:48.796+0000 7fa41a7fc640 1 -- 172.21.15.115:0/4229337281 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa42000f680 con 0x7fa4240feac0 2024-09-13T17:03:48.819 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:48.796+0000 7fa42b4ec640 1 -- 172.21.15.115:0/4229337281 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4241a1180 con 0x7fa4240feac0 2024-09-13T17:03:48.819 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:48.797+0000 7fa42b4ec640 1 -- 172.21.15.115:0/4229337281 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa424068ce0 con 0x7fa4240feac0 2024-09-13T17:03:48.819 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:48.797+0000 7fa41a7fc640 1 -- 172.21.15.115:0/4229337281 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fa420010460 con 0x7fa4240feac0 2024-09-13T17:03:48.819 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:48.798+0000 7fa41a7fc640 1 --2- 172.21.15.115:0/4229337281 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fa41006cc50 0x7fa41006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:03:48.819 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:48.798+0000 7fa41a7fc640 1 -- 172.21.15.115:0/4229337281 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fa42008c0d0 con 0x7fa4240feac0 2024-09-13T17:03:48.819 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:48.798+0000 7fa428a87640 1 --2- 172.21.15.115:0/4229337281 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fa41006cc50 0x7fa41006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:03:48.819 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:48.798+0000 7fa428a87640 1 --2- 172.21.15.115:0/4229337281 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fa41006cc50 0x7fa41006f110 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa42419d5c0 tx=0x7fa414005a20 comp rx=0 tx=0).ready entity=mgr.14207 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:03:48.819 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:48.802+0000 7fa41a7fc640 1 -- 172.21.15.115:0/4229337281 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa420059ed0 con 0x7fa4240feac0 2024-09-13T17:03:49.004 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:49.002+0000 7fa42b4ec640 1 -- 172.21.15.115:0/4229337281 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa424113260 con 0x7fa4240feac0 2024-09-13T17:03:49.004 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:49.003+0000 7fa41a7fc640 1 -- 172.21.15.115:0/4229337281 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v19) v1 ==== 53+0+83 (secure 0 0 0) 0x7fa420059a60 con 0x7fa4240feac0 2024-09-13T17:03:49.004 INFO:teuthology.orchestra.run.smithi115.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-09-13T17:03:49.006 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:49.005+0000 7fa42b4ec640 1 -- 172.21.15.115:0/4229337281 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fa41006cc50 msgr2=0x7fa41006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:49.006 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:49.005+0000 7fa42b4ec640 1 --2- 172.21.15.115:0/4229337281 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fa41006cc50 0x7fa41006f110 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa42419d5c0 tx=0x7fa414005a20 comp rx=0 tx=0).stop 2024-09-13T17:03:49.006 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:49.005+0000 7fa42b4ec640 1 -- 172.21.15.115:0/4229337281 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa4240feac0 msgr2=0x7fa42419c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:49.006 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:49.005+0000 7fa42b4ec640 1 --2- 172.21.15.115:0/4229337281 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa4240feac0 0x7fa42419c010 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa42000d8d0 tx=0x7fa42000dd90 comp rx=0 tx=0).stop 2024-09-13T17:03:49.006 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:49.005+0000 7fa42b4ec640 1 -- 172.21.15.115:0/4229337281 shutdown_connections 2024-09-13T17:03:49.007 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:49.005+0000 7fa42b4ec640 1 --2- 172.21.15.115:0/4229337281 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fa41006cc50 0x7fa41006f110 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:49.007 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:49.005+0000 7fa42b4ec640 1 --2- 172.21.15.115:0/4229337281 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa4240ff3e0 0x7fa42419c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:49.007 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:49.005+0000 7fa42b4ec640 1 --2- 172.21.15.115:0/4229337281 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa4240feac0 0x7fa42419c010 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:49.007 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:49.005+0000 7fa42b4ec640 1 -- 172.21.15.115:0/4229337281 >> 172.21.15.115:0/4229337281 conn(0x7fa4240fa730 msgr2=0x7fa42410d690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:03:49.007 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:49.005+0000 7fa42b4ec640 1 -- 172.21.15.115:0/4229337281 shutdown_connections 2024-09-13T17:03:49.007 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:49.005+0000 7fa42b4ec640 1 -- 172.21.15.115:0/4229337281 wait complete. 2024-09-13T17:03:49.576 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:49 smithi195 ceph-mon[34981]: from='client.? 172.21.15.115:0/4229337281' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-13T17:03:49.621 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:49 smithi115 ceph-mon[27708]: from='client.? 172.21.15.115:0/4229337281' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-13T17:03:49.642 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T17:03:49.642 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T17:03:49.642 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi115.front.sepia.ceph.com 2024-09-13T17:03:49.642 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T17:03:49.642 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T17:03:49.642 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T17:03:49.642 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T17:03:49.642 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T17:03:49.643 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T17:03:49.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:03:49.643 DEBUG:teuthology.orchestra.run.smithi115:> ip addr 2024-09-13T17:03:49.660 INFO:teuthology.orchestra.run.smithi115.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T17:03:49.660 INFO:teuthology.orchestra.run.smithi115.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T17:03:49.660 INFO:teuthology.orchestra.run.smithi115.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T17:03:49.660 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:03:49.660 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 ::1/128 scope host 2024-09-13T17:03:49.660 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:03:49.660 INFO:teuthology.orchestra.run.smithi115.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T17:03:49.660 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:d8:a5:44 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:03:49.660 INFO:teuthology.orchestra.run.smithi115.stdout: altname enp7s0f0 2024-09-13T17:03:49.660 INFO:teuthology.orchestra.run.smithi115.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T17:03:49.661 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:d8:a5:45 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:03:49.661 INFO:teuthology.orchestra.run.smithi115.stdout: altname enp7s0f1 2024-09-13T17:03:49.661 INFO:teuthology.orchestra.run.smithi115.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T17:03:49.661 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:8f:ce:8e brd ff:ff:ff:ff:ff:ff 2024-09-13T17:03:49.661 INFO:teuthology.orchestra.run.smithi115.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T17:03:49.661 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:8f:ce:8f brd ff:ff:ff:ff:ff:ff 2024-09-13T17:03:49.661 INFO:teuthology.orchestra.run.smithi115.stdout: inet 172.21.15.115/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-13T17:03:49.661 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft 42339sec preferred_lft 42339sec 2024-09-13T17:03:49.661 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::ec4:7aff:fe8f:ce8f/64 scope link noprefixroute 2024-09-13T17:03:49.661 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:03:49.662 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-13T17:03:49.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:03:49.662 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec bash -c ' 2024-09-13T17:03:49.662 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2024-09-13T17:03:49.662 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link add name ceph-brx type bridge 2024-09-13T17:03:49.662 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip addr flush dev ceph-brx 2024-09-13T17:03:49.662 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link set ceph-brx up 2024-09-13T17:03:49.662 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-13T17:03:49.662 DEBUG:teuthology.orchestra.run.smithi115:> ') 2024-09-13T17:03:49.834 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:03:49.834 DEBUG:teuthology.orchestra.run.smithi115:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T17:03:49.858 INFO:teuthology.orchestra.run.smithi115.stdout:1 2024-09-13T17:03:49.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:03:49.859 DEBUG:teuthology.orchestra.run.smithi115:> route 2024-09-13T17:03:49.949 INFO:teuthology.orchestra.run.smithi115.stdout:Kernel IP routing table 2024-09-13T17:03:49.949 INFO:teuthology.orchestra.run.smithi115.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T17:03:49.949 INFO:teuthology.orchestra.run.smithi115.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T17:03:49.949 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T17:03:49.949 INFO:teuthology.orchestra.run.smithi115.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T17:03:49.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:03:49.950 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec bash -c ' 2024-09-13T17:03:49.950 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2024-09-13T17:03:49.950 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T17:03:49.950 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T17:03:49.950 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T17:03:49.950 DEBUG:teuthology.orchestra.run.smithi115:> ') 2024-09-13T17:03:50.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:03:50.159 DEBUG:teuthology.orchestra.run.smithi115:> ip netns list 2024-09-13T17:03:50.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:03:50.174 DEBUG:teuthology.orchestra.run.smithi115:> ip netns list-id 2024-09-13T17:03:50.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:03:50.230 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec bash -c ' 2024-09-13T17:03:50.230 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2024-09-13T17:03:50.230 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T17:03:50.230 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-13T17:03:50.230 DEBUG:teuthology.orchestra.run.smithi115:> ') 2024-09-13T17:03:50.308 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-13T17:03:50.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:03:50.309 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec bash -c ' 2024-09-13T17:03:50.309 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2024-09-13T17:03:50.309 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-13T17:03:50.309 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-13T17:03:50.310 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-13T17:03:50.310 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-13T17:03:50.310 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-13T17:03:50.310 DEBUG:teuthology.orchestra.run.smithi115:> ') 2024-09-13T17:03:50.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:03:50.437 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec bash -c ' 2024-09-13T17:03:50.437 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2024-09-13T17:03:50.437 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link set brx.0 up 2024-09-13T17:03:50.437 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link set dev brx.0 master ceph-brx 2024-09-13T17:03:50.438 DEBUG:teuthology.orchestra.run.smithi115:> ') 2024-09-13T17:03:50.474 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:03:50.474 DEBUG:teuthology.orchestra.run.smithi115:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T17:03:50.530 INFO:teuthology.orchestra.run.smithi115.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T17:03:50.531 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:03:50.531 DEBUG:teuthology.orchestra.run.smithi115:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T17:03:50.576 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:50 smithi195 ceph-mon[34981]: pgmap v194: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-13T17:03:50.585 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-13T17:03:50.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:03:50.586 DEBUG:teuthology.orchestra.run.smithi115:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-13T17:03:50.647 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:50 smithi115 ceph-mon[27708]: pgmap v194: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-13T17:03:50.680 INFO:teuthology.orchestra.run.smithi115.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-13T17:03:50.681 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-13T17:03:50.681 INFO:teuthology.orchestra.run.smithi115.stdout:invalid new device string format 2024-09-13T17:03:50.808 INFO:teuthology.orchestra.run.smithi115.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-13T17:03:50.809 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-13T17:03:50.809 INFO:teuthology.orchestra.run.smithi115.stdout:invalid new device string format 2024-09-13T17:03:50.809 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: resolved to: "172.21.15.115:3300,172.21.15.195:3300" 2024-09-13T17:03:50.809 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-13T17:03:50.815 INFO:teuthology.orchestra.run.smithi115.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-13T17:03:50.815 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-13T17:03:50.815 INFO:teuthology.orchestra.run.smithi115.stdout:invalid new device string format 2024-09-13T17:03:50.815 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: resolved to: "172.21.15.115:3300,172.21.15.195:3300" 2024-09-13T17:03:50.815 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-13T17:03:50.816 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: resolved to: "172.21.15.115:6789,172.21.15.195:6789" 2024-09-13T17:03:50.816 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.115:6789,172.21.15.195:6789:/ 2024-09-13T17:03:50.816 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=ffbd7588-71f0-11ef-bceb-c7b262605968" will pass to kernel 2024-09-13T17:03:50.816 INFO:teuthology.orchestra.run.smithi115.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-13T17:03:50.816 INFO:teuthology.orchestra.run.smithi115.stdout: You just mounted a file system that supports labels which does not 2024-09-13T17:03:50.816 INFO:teuthology.orchestra.run.smithi115.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-13T17:03:50.817 INFO:teuthology.orchestra.run.smithi115.stdout: applications will generate AVC messages and not be allowed access to 2024-09-13T17:03:50.817 INFO:teuthology.orchestra.run.smithi115.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-13T17:03:50.819 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T17:03:50.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:03:50.820 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T17:03:50.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:03:50.886 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T17:03:50.946 INFO:teuthology.orchestra.run.smithi115.stdout:client24287 2024-09-13T17:03:50.946 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-13T17:03:50.946 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:03:51.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:03:51.003 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T17:03:51.064 INFO:teuthology.orchestra.run.smithi115.stdout:client24287 2024-09-13T17:03:51.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:03:51.065 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T17:03:51.124 INFO:teuthology.orchestra.run.smithi115.stdout:client24287 2024-09-13T17:03:51.124 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:03:51.125 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968.client24287/status') 2024-09-13T17:03:51.191 INFO:teuthology.orchestra.run.smithi115.stdout:instance: client.24287 (3)172.21.15.115:0/693373336 2024-09-13T17:03:51.191 INFO:teuthology.orchestra.run.smithi115.stdout:blocklisted: false 2024-09-13T17:03:51.193 INFO:teuthology.orchestra.run.smithi115.stderr:0+1 records in 2024-09-13T17:03:51.193 INFO:teuthology.orchestra.run.smithi115.stderr:0+1 records out 2024-09-13T17:03:51.193 INFO:teuthology.orchestra.run.smithi115.stderr:71 bytes copied, 2.3194e-05 s, 3.1 MB/s 2024-09-13T17:03:51.194 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-09-13T17:03:51.194 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T17:03:51.194 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T17:03:51.195 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-13T17:03:51.431 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T17:03:52.483 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:52 smithi115 ceph-mon[27708]: pgmap v195: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:03:52.576 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:52 smithi195 ceph-mon[34981]: pgmap v195: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:03:52.995 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:52.994+0000 7f611922a640 1 -- 172.21.15.115:0/2717667210 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61140ff1a0 msgr2=0x7f611410be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:52.995 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:52.994+0000 7f611922a640 1 --2- 172.21.15.115:0/2717667210 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61140ff1a0 0x7f611410be60 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f60fc009880 tx=0x7f60fc02a490 comp rx=0 tx=0).stop 2024-09-13T17:03:52.995 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:52.994+0000 7f611922a640 1 -- 172.21.15.115:0/2717667210 shutdown_connections 2024-09-13T17:03:52.995 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:52.994+0000 7f611922a640 1 --2- 172.21.15.115:0/2717667210 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61140ff1a0 0x7f611410be60 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:52.995 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:52.994+0000 7f611922a640 1 --2- 172.21.15.115:0/2717667210 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61140fe7f0 0x7f61140febd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:52.996 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:52.994+0000 7f611922a640 1 -- 172.21.15.115:0/2717667210 >> 172.21.15.115:0/2717667210 conn(0x7f61140758c0 msgr2=0x7f61140fcc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:03:52.996 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:52.994+0000 7f611922a640 1 -- 172.21.15.115:0/2717667210 shutdown_connections 2024-09-13T17:03:52.996 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:52.994+0000 7f611922a640 1 -- 172.21.15.115:0/2717667210 wait complete. 2024-09-13T17:03:52.997 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:52.994+0000 7f611922a640 1 Processor -- start 2024-09-13T17:03:52.997 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:52.995+0000 7f611922a640 1 -- start start 2024-09-13T17:03:52.997 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:52.995+0000 7f611922a640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61140fe7f0 0x7f6114197ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:03:52.998 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:52.995+0000 7f611922a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61140ff1a0 0x7f61141981e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:03:52.998 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:52.995+0000 7f611922a640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61141988c0 con 0x7f61140ff1a0 2024-09-13T17:03:52.998 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:52.995+0000 7f611922a640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f611419b530 con 0x7f61140fe7f0 2024-09-13T17:03:52.998 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:52.995+0000 7f610a59c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61140ff1a0 0x7f61141981e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:03:52.998 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:52.995+0000 7f610a59c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61140ff1a0 0x7f61141981e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:34670/0 (socket says 172.21.15.115:34670) 2024-09-13T17:03:52.998 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:52.995+0000 7f610a59c640 1 -- 172.21.15.115:0/1115120584 learned_addr learned my addr 172.21.15.115:0/1115120584 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:03:52.998 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:52.995+0000 7f6112d9d640 1 --2- 172.21.15.115:0/1115120584 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61140fe7f0 0x7f6114197ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:03:52.998 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:52.995+0000 7f610a59c640 1 -- 172.21.15.115:0/1115120584 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61140fe7f0 msgr2=0x7f6114197ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:52.998 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:52.995+0000 7f610a59c640 1 --2- 172.21.15.115:0/1115120584 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61140fe7f0 0x7f6114197ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:52.998 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:52.995+0000 7f610a59c640 1 -- 172.21.15.115:0/1115120584 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60fc009560 con 0x7f61140ff1a0 2024-09-13T17:03:52.998 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:52.995+0000 7f6112d9d640 1 --2- 172.21.15.115:0/1115120584 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61140fe7f0 0x7f6114197ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:03:52.998 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:52.995+0000 7f610a59c640 1 --2- 172.21.15.115:0/1115120584 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61140ff1a0 0x7f61141981e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f60fc006010 tx=0x7f60fc0056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:03:52.999 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:52.996+0000 7f6110d99640 1 -- 172.21.15.115:0/1115120584 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f60fc004ba0 con 0x7f61140ff1a0 2024-09-13T17:03:52.999 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:52.996+0000 7f6110d99640 1 -- 172.21.15.115:0/1115120584 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f60fc004d00 con 0x7f61140ff1a0 2024-09-13T17:03:52.999 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:52.996+0000 7f611922a640 1 -- 172.21.15.115:0/1115120584 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f611419b7b0 con 0x7f61140ff1a0 2024-09-13T17:03:52.999 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:52.996+0000 7f6110d99640 1 -- 172.21.15.115:0/1115120584 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f60fc031910 con 0x7f61140ff1a0 2024-09-13T17:03:52.999 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:52.996+0000 7f611922a640 1 -- 172.21.15.115:0/1115120584 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f611419bd00 con 0x7f61140ff1a0 2024-09-13T17:03:53.000 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:52.997+0000 7f611922a640 1 -- 172.21.15.115:0/1115120584 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61140684c0 con 0x7f61140ff1a0 2024-09-13T17:03:53.000 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:52.997+0000 7f6110d99640 1 -- 172.21.15.115:0/1115120584 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f60fc031af0 con 0x7f61140ff1a0 2024-09-13T17:03:53.000 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:52.998+0000 7f6110d99640 1 --2- 172.21.15.115:0/1115120584 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f610006cc50 0x7f610006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:03:53.000 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:52.998+0000 7f6110d99640 1 -- 172.21.15.115:0/1115120584 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f60fc0ad3e0 con 0x7f61140ff1a0 2024-09-13T17:03:53.000 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:52.998+0000 7f6112d9d640 1 --2- 172.21.15.115:0/1115120584 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f610006cc50 0x7f610006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:03:53.000 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:52.998+0000 7f6112d9d640 1 --2- 172.21.15.115:0/1115120584 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f610006cc50 0x7f610006f110 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6104009930 tx=0x7f6104008040 comp rx=0 tx=0).ready entity=mgr.14207 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:03:53.003 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:53.002+0000 7f6110d99640 1 -- 172.21.15.115:0/1115120584 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f60fc0777d0 con 0x7f61140ff1a0 2024-09-13T17:03:53.200 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:53.199+0000 7f611922a640 1 -- 172.21.15.115:0/1115120584 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6114106740 con 0x7f61140ff1a0 2024-09-13T17:03:53.201 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:53.199+0000 7f6110d99640 1 -- 172.21.15.115:0/1115120584 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v19) v1 ==== 53+0+83 (secure 0 0 0) 0x7f60fc07adf0 con 0x7f61140ff1a0 2024-09-13T17:03:53.201 INFO:teuthology.orchestra.run.smithi115.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-09-13T17:03:53.203 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:53.201+0000 7f611922a640 1 -- 172.21.15.115:0/1115120584 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f610006cc50 msgr2=0x7f610006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:53.203 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:53.201+0000 7f611922a640 1 --2- 172.21.15.115:0/1115120584 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f610006cc50 0x7f610006f110 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6104009930 tx=0x7f6104008040 comp rx=0 tx=0).stop 2024-09-13T17:03:53.203 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:53.201+0000 7f611922a640 1 -- 172.21.15.115:0/1115120584 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61140ff1a0 msgr2=0x7f61141981e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:53.203 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:53.201+0000 7f611922a640 1 --2- 172.21.15.115:0/1115120584 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61140ff1a0 0x7f61141981e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f60fc006010 tx=0x7f60fc0056e0 comp rx=0 tx=0).stop 2024-09-13T17:03:53.203 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:53.201+0000 7f611922a640 1 -- 172.21.15.115:0/1115120584 shutdown_connections 2024-09-13T17:03:53.203 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:53.201+0000 7f611922a640 1 --2- 172.21.15.115:0/1115120584 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f610006cc50 0x7f610006f110 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:53.203 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:53.201+0000 7f611922a640 1 --2- 172.21.15.115:0/1115120584 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61140ff1a0 0x7f61141981e0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:53.203 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:53.201+0000 7f611922a640 1 --2- 172.21.15.115:0/1115120584 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61140fe7f0 0x7f6114197ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:53.203 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:53.201+0000 7f611922a640 1 -- 172.21.15.115:0/1115120584 >> 172.21.15.115:0/1115120584 conn(0x7f61140758c0 msgr2=0x7f61140fcd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:03:53.203 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:53.202+0000 7f611922a640 1 -- 172.21.15.115:0/1115120584 shutdown_connections 2024-09-13T17:03:53.204 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:53.202+0000 7f611922a640 1 -- 172.21.15.115:0/1115120584 wait complete. 2024-09-13T17:03:53.576 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:53 smithi195 ceph-mon[34981]: from='client.? 172.21.15.115:0/1115120584' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-13T17:03:53.657 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:53 smithi115 ceph-mon[27708]: from='client.? 172.21.15.115:0/1115120584' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-13T17:03:53.891 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T17:03:53.891 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T17:03:53.891 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi195.front.sepia.ceph.com 2024-09-13T17:03:53.892 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-13T17:03:53.892 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T17:03:53.892 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T17:03:53.892 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T17:03:53.892 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T17:03:53.892 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T17:03:53.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:03:53.892 DEBUG:teuthology.orchestra.run.smithi195:> ip addr 2024-09-13T17:03:53.912 INFO:teuthology.orchestra.run.smithi195.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T17:03:53.912 INFO:teuthology.orchestra.run.smithi195.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T17:03:53.912 INFO:teuthology.orchestra.run.smithi195.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T17:03:53.912 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:03:53.912 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 ::1/128 scope host 2024-09-13T17:03:53.912 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:03:53.913 INFO:teuthology.orchestra.run.smithi195.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T17:03:53.913 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:d9:36:f0 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:03:53.913 INFO:teuthology.orchestra.run.smithi195.stdout: altname enp7s0f0 2024-09-13T17:03:53.913 INFO:teuthology.orchestra.run.smithi195.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T17:03:53.913 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:d9:36:f1 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:03:53.913 INFO:teuthology.orchestra.run.smithi195.stdout: altname enp7s0f1 2024-09-13T17:03:53.913 INFO:teuthology.orchestra.run.smithi195.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T17:03:53.913 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:88:80:80 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:03:53.913 INFO:teuthology.orchestra.run.smithi195.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T17:03:53.913 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:88:80:81 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:03:53.913 INFO:teuthology.orchestra.run.smithi195.stdout: inet 172.21.15.195/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-13T17:03:53.913 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft 42323sec preferred_lft 42323sec 2024-09-13T17:03:53.913 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 fe80::ec4:7aff:fe88:8081/64 scope link noprefixroute 2024-09-13T17:03:53.914 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:03:53.914 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-13T17:03:53.914 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:03:53.914 DEBUG:teuthology.orchestra.run.smithi195:> (cd / && exec bash -c ' 2024-09-13T17:03:53.914 DEBUG:teuthology.orchestra.run.smithi195:> set -e 2024-09-13T17:03:53.914 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link add name ceph-brx type bridge 2024-09-13T17:03:53.914 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip addr flush dev ceph-brx 2024-09-13T17:03:53.914 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link set ceph-brx up 2024-09-13T17:03:53.915 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-13T17:03:53.915 DEBUG:teuthology.orchestra.run.smithi195:> ') 2024-09-13T17:03:54.088 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:03:54.088 DEBUG:teuthology.orchestra.run.smithi195:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T17:03:54.115 INFO:teuthology.orchestra.run.smithi195.stdout:1 2024-09-13T17:03:54.117 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:03:54.117 DEBUG:teuthology.orchestra.run.smithi195:> route 2024-09-13T17:03:54.191 INFO:teuthology.orchestra.run.smithi195.stdout:Kernel IP routing table 2024-09-13T17:03:54.191 INFO:teuthology.orchestra.run.smithi195.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T17:03:54.191 INFO:teuthology.orchestra.run.smithi195.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T17:03:54.191 INFO:teuthology.orchestra.run.smithi195.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T17:03:54.192 INFO:teuthology.orchestra.run.smithi195.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T17:03:54.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:03:54.192 DEBUG:teuthology.orchestra.run.smithi195:> (cd / && exec bash -c ' 2024-09-13T17:03:54.192 DEBUG:teuthology.orchestra.run.smithi195:> set -e 2024-09-13T17:03:54.192 DEBUG:teuthology.orchestra.run.smithi195:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T17:03:54.192 DEBUG:teuthology.orchestra.run.smithi195:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T17:03:54.192 DEBUG:teuthology.orchestra.run.smithi195:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T17:03:54.192 DEBUG:teuthology.orchestra.run.smithi195:> ') 2024-09-13T17:03:54.441 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:03:54.441 DEBUG:teuthology.orchestra.run.smithi195:> ip netns list 2024-09-13T17:03:54.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:03:54.456 DEBUG:teuthology.orchestra.run.smithi195:> ip netns list-id 2024-09-13T17:03:54.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:03:54.512 DEBUG:teuthology.orchestra.run.smithi195:> (cd / && exec bash -c ' 2024-09-13T17:03:54.512 DEBUG:teuthology.orchestra.run.smithi195:> set -e 2024-09-13T17:03:54.512 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T17:03:54.512 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-13T17:03:54.512 DEBUG:teuthology.orchestra.run.smithi195:> ') 2024-09-13T17:03:54.517 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:54 smithi195 ceph-mon[34981]: pgmap v196: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:03:54.556 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-13T17:03:54.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:03:54.557 DEBUG:teuthology.orchestra.run.smithi195:> (cd / && exec bash -c ' 2024-09-13T17:03:54.557 DEBUG:teuthology.orchestra.run.smithi195:> set -e 2024-09-13T17:03:54.557 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-13T17:03:54.557 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-13T17:03:54.557 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-13T17:03:54.557 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-13T17:03:54.557 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-13T17:03:54.558 DEBUG:teuthology.orchestra.run.smithi195:> ') 2024-09-13T17:03:54.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:54 smithi115 ceph-mon[27708]: pgmap v196: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:03:54.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:03:54.683 DEBUG:teuthology.orchestra.run.smithi195:> (cd / && exec bash -c ' 2024-09-13T17:03:54.683 DEBUG:teuthology.orchestra.run.smithi195:> set -e 2024-09-13T17:03:54.683 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link set brx.0 up 2024-09-13T17:03:54.683 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link set dev brx.0 master ceph-brx 2024-09-13T17:03:54.684 DEBUG:teuthology.orchestra.run.smithi195:> ') 2024-09-13T17:03:54.721 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:03:54.721 DEBUG:teuthology.orchestra.run.smithi195:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-13T17:03:54.777 INFO:teuthology.orchestra.run.smithi195.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-13T17:03:54.778 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:03:54.778 DEBUG:teuthology.orchestra.run.smithi195:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-13T17:03:54.833 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-13T17:03:54.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:03:54.834 DEBUG:teuthology.orchestra.run.smithi195:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-13T17:03:54.927 INFO:teuthology.orchestra.run.smithi195.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-13T17:03:54.927 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-13T17:03:54.927 INFO:teuthology.orchestra.run.smithi195.stdout:invalid new device string format 2024-09-13T17:03:55.054 INFO:teuthology.orchestra.run.smithi195.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-13T17:03:55.054 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-13T17:03:55.054 INFO:teuthology.orchestra.run.smithi195.stdout:invalid new device string format 2024-09-13T17:03:55.054 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: resolved to: "172.21.15.115:3300,172.21.15.195:3300" 2024-09-13T17:03:55.054 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-13T17:03:55.059 INFO:teuthology.orchestra.run.smithi195.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-13T17:03:55.059 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-13T17:03:55.059 INFO:teuthology.orchestra.run.smithi195.stdout:invalid new device string format 2024-09-13T17:03:55.059 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: resolved to: "172.21.15.115:3300,172.21.15.195:3300" 2024-09-13T17:03:55.059 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-13T17:03:55.060 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: resolved to: "172.21.15.115:6789,172.21.15.195:6789" 2024-09-13T17:03:55.060 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.115:6789,172.21.15.195:6789:/ 2024-09-13T17:03:55.060 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=ffbd7588-71f0-11ef-bceb-c7b262605968" will pass to kernel 2024-09-13T17:03:55.060 INFO:teuthology.orchestra.run.smithi195.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-13T17:03:55.061 INFO:teuthology.orchestra.run.smithi195.stdout: You just mounted a file system that supports labels which does not 2024-09-13T17:03:55.061 INFO:teuthology.orchestra.run.smithi195.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-13T17:03:55.061 INFO:teuthology.orchestra.run.smithi195.stdout: applications will generate AVC messages and not be allowed access to 2024-09-13T17:03:55.061 INFO:teuthology.orchestra.run.smithi195.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-13T17:03:55.062 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T17:03:55.062 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:03:55.062 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-13T17:03:55.088 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:03:55.088 DEBUG:teuthology.orchestra.run.smithi195:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T17:03:55.145 INFO:teuthology.orchestra.run.smithi195.stdout:client24291 2024-09-13T17:03:55.145 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-09-13T17:03:55.145 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:03:55.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:03:55.202 DEBUG:teuthology.orchestra.run.smithi195:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T17:03:55.258 INFO:teuthology.orchestra.run.smithi195.stdout:client24291 2024-09-13T17:03:55.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:03:55.259 DEBUG:teuthology.orchestra.run.smithi195:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T17:03:55.315 INFO:teuthology.orchestra.run.smithi195.stdout:client24291 2024-09-13T17:03:55.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:03:55.316 DEBUG:teuthology.orchestra.run.smithi195:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968.client24291/status') 2024-09-13T17:03:55.380 INFO:teuthology.orchestra.run.smithi195.stdout:instance: client.24291 (3)192.168.0.1:0/3568065273 2024-09-13T17:03:55.380 INFO:teuthology.orchestra.run.smithi195.stdout:blocklisted: false 2024-09-13T17:03:55.381 INFO:teuthology.orchestra.run.smithi195.stderr:0+1 records in 2024-09-13T17:03:55.381 INFO:teuthology.orchestra.run.smithi195.stderr:0+1 records out 2024-09-13T17:03:55.381 INFO:teuthology.orchestra.run.smithi195.stderr:70 bytes copied, 3.9433e-05 s, 1.8 MB/s 2024-09-13T17:03:55.382 INFO:teuthology.run_tasks:Running task print... 2024-09-13T17:03:55.394 INFO:teuthology.task.print:**** done client 2024-09-13T17:03:55.394 INFO:teuthology.run_tasks:Running task parallel... 2024-09-13T17:03:55.404 INFO:teuthology.task.parallel:starting parallel... 2024-09-13T17:03:55.405 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-09-13T17:03:55.406 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-13T17:03:55.406 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi115.front.sepia.ceph.com 2024-09-13T17:03:55.406 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -e sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-09-13T17:03:55.407 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-09-13T17:03:55.408 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-09-13T17:03:55.417 INFO:tasks.workunit:Pulling workunits from ref 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T17:03:55.417 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-13T17:03:55.418 INFO:tasks.workunit:timeout=3h 2024-09-13T17:03:55.418 INFO:tasks.workunit:cleanup=True 2024-09-13T17:03:55.418 DEBUG:teuthology.orchestra.run.smithi115:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-13T17:03:55.440 INFO:teuthology.orchestra.run.smithi115.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-13T17:03:55.440 INFO:teuthology.orchestra.run.smithi115.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-13T17:03:55.441 INFO:teuthology.orchestra.run.smithi115.stdout:Device: a5h/165d Inode: 1 Links: 2 2024-09-13T17:03:55.441 INFO:teuthology.orchestra.run.smithi115.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T17:03:55.441 INFO:teuthology.orchestra.run.smithi115.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-13T17:03:55.441 INFO:teuthology.orchestra.run.smithi115.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-13T17:03:55.441 INFO:teuthology.orchestra.run.smithi115.stdout:Modify: 2024-09-13 17:03:20.337998619 +0000 2024-09-13T17:03:55.441 INFO:teuthology.orchestra.run.smithi115.stdout:Change: 2024-09-13 17:03:50.883090623 +0000 2024-09-13T17:03:55.441 INFO:teuthology.orchestra.run.smithi115.stdout: Birth: 2024-09-13 17:03:20.337998619 +0000 2024-09-13T17:03:55.441 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-13T17:03:55.441 DEBUG:teuthology.orchestra.run.smithi115:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-13T17:03:55.512 DEBUG:teuthology.orchestra.run.smithi195:> stat -- /home/ubuntu/cephtest/mnt.1 2024-09-13T17:03:55.529 INFO:teuthology.orchestra.run.smithi195.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-09-13T17:03:55.529 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 1 Blocks: 0 IO Block: 65536 directory 2024-09-13T17:03:55.529 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 81h/129d Inode: 1 Links: 3 2024-09-13T17:03:55.529 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T17:03:55.529 INFO:teuthology.orchestra.run.smithi195.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-13T17:03:55.529 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-13T17:03:55.529 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2024-09-13 17:03:55.505004361 +0000 2024-09-13T17:03:55.529 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2024-09-13 17:03:55.505004361 +0000 2024-09-13T17:03:55.529 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: 2024-09-13 17:03:20.337998619 +0000 2024-09-13T17:03:55.529 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-09-13T17:03:55.530 DEBUG:teuthology.orchestra.run.smithi195:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-09-13T17:03:55.597 DEBUG:teuthology.orchestra.run.smithi115:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T17:03:55.598 DEBUG:teuthology.orchestra.run.smithi195:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T17:03:55.615 INFO:tasks.workunit.client.0.smithi115.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-13T17:03:55.641 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T17:03:55.653 INFO:tasks.workunit.client.1.smithi195.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-09-13T17:03:56.428 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:56 smithi115 ceph-mon[27708]: pgmap v197: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-13T17:03:56.576 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:56 smithi195 ceph-mon[34981]: pgmap v197: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-13T17:03:57.285 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:57.281+0000 7f68674c1640 1 -- 172.21.15.115:0/1247824412 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6860100620 msgr2=0x7f6860102a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:57.285 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:57.281+0000 7f68674c1640 1 --2- 172.21.15.115:0/1247824412 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6860100620 0x7f6860102a10 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f685c009880 tx=0x7f685c02a4a0 comp rx=0 tx=0).stop 2024-09-13T17:03:57.285 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:57.281+0000 7f68674c1640 1 -- 172.21.15.115:0/1247824412 shutdown_connections 2024-09-13T17:03:57.285 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:57.281+0000 7f68674c1640 1 --2- 172.21.15.115:0/1247824412 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6860102f50 0x7f6860105340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:57.285 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:57.281+0000 7f68674c1640 1 --2- 172.21.15.115:0/1247824412 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6860100620 0x7f6860102a10 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:57.285 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:57.281+0000 7f68674c1640 1 -- 172.21.15.115:0/1247824412 >> 172.21.15.115:0/1247824412 conn(0x7f68600fa1c0 msgr2=0x7f68600fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:03:57.286 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:57.281+0000 7f68674c1640 1 -- 172.21.15.115:0/1247824412 shutdown_connections 2024-09-13T17:03:57.286 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:57.281+0000 7f68674c1640 1 -- 172.21.15.115:0/1247824412 wait complete. 2024-09-13T17:03:57.286 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:57.281+0000 7f68674c1640 1 Processor -- start 2024-09-13T17:03:57.286 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:57.281+0000 7f68674c1640 1 -- start start 2024-09-13T17:03:57.286 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:57.282+0000 7f68674c1640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6860100620 0x7f68601955e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:03:57.286 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:57.282+0000 7f68674c1640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6860102f50 0x7f6860195b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:03:57.286 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:57.282+0000 7f68674c1640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68601960f0 con 0x7f6860100620 2024-09-13T17:03:57.286 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:57.282+0000 7f68674c1640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6860196260 con 0x7f6860102f50 2024-09-13T17:03:57.286 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:57.282+0000 7f686525d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6860100620 0x7f68601955e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:03:57.286 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:57.282+0000 7f686525d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6860100620 0x7f68601955e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56388/0 (socket says 172.21.15.115:56388) 2024-09-13T17:03:57.286 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:57.282+0000 7f686525d640 1 -- 172.21.15.115:0/2874312282 learned_addr learned my addr 172.21.15.115:0/2874312282 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:03:57.286 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:57.282+0000 7f6864a5c640 1 --2- 172.21.15.115:0/2874312282 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6860102f50 0x7f6860195b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:03:57.286 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:57.282+0000 7f686525d640 1 -- 172.21.15.115:0/2874312282 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6860102f50 msgr2=0x7f6860195b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:57.287 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:57.282+0000 7f686525d640 1 --2- 172.21.15.115:0/2874312282 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6860102f50 0x7f6860195b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:57.287 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:57.282+0000 7f686525d640 1 -- 172.21.15.115:0/2874312282 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f685c009560 con 0x7f6860100620 2024-09-13T17:03:57.287 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:57.282+0000 7f686525d640 1 --2- 172.21.15.115:0/2874312282 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6860100620 0x7f68601955e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f685c006010 tx=0x7f685c0056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:03:57.287 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:57.282+0000 7f68567fc640 1 -- 172.21.15.115:0/2874312282 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f685c004c60 con 0x7f6860100620 2024-09-13T17:03:57.287 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:57.282+0000 7f68674c1640 1 -- 172.21.15.115:0/2874312282 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f686019ac90 con 0x7f6860100620 2024-09-13T17:03:57.287 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:57.282+0000 7f68567fc640 1 -- 172.21.15.115:0/2874312282 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f685c031a00 con 0x7f6860100620 2024-09-13T17:03:57.287 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:57.282+0000 7f68567fc640 1 -- 172.21.15.115:0/2874312282 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f685c003bc0 con 0x7f6860100620 2024-09-13T17:03:57.287 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:57.282+0000 7f68674c1640 1 -- 172.21.15.115:0/2874312282 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f686019b210 con 0x7f6860100620 2024-09-13T17:03:57.288 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:57.284+0000 7f68674c1640 1 -- 172.21.15.115:0/2874312282 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6860108610 con 0x7f6860100620 2024-09-13T17:03:57.288 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:57.284+0000 7f68567fc640 1 -- 172.21.15.115:0/2874312282 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f685c003df0 con 0x7f6860100620 2024-09-13T17:03:57.288 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:57.284+0000 7f68567fc640 1 --2- 172.21.15.115:0/2874312282 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f684c06cc50 0x7f684c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:03:57.288 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:57.284+0000 7f68567fc640 1 -- 172.21.15.115:0/2874312282 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f685c0ad530 con 0x7f6860100620 2024-09-13T17:03:57.288 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:57.284+0000 7f6864a5c640 1 --2- 172.21.15.115:0/2874312282 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f684c06cc50 0x7f684c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:03:57.288 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:57.285+0000 7f6864a5c640 1 --2- 172.21.15.115:0/2874312282 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f684c06cc50 0x7f684c06f110 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6860196a90 tx=0x7f6850008040 comp rx=0 tx=0).ready entity=mgr.14207 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:03:57.291 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:57.289+0000 7f68567fc640 1 -- 172.21.15.115:0/2874312282 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f685c0778a0 con 0x7f6860100620 2024-09-13T17:03:57.457 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:57.455+0000 7f68674c1640 1 -- 172.21.15.115:0/2874312282 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7f6860108850 con 0x7f6860100620 2024-09-13T17:03:57.457 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:57.455+0000 7f68567fc640 1 -- 172.21.15.115:0/2874312282 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v23)=0 v23) v1 ==== 155+0+0 (secure 0 0 0) 0x7f6860108850 con 0x7f6860100620 2024-09-13T17:03:57.459 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:57.457+0000 7f68674c1640 1 -- 172.21.15.115:0/2874312282 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f684c06cc50 msgr2=0x7f684c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:57.459 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:57.457+0000 7f68674c1640 1 --2- 172.21.15.115:0/2874312282 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f684c06cc50 0x7f684c06f110 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6860196a90 tx=0x7f6850008040 comp rx=0 tx=0).stop 2024-09-13T17:03:57.459 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:57.457+0000 7f68674c1640 1 -- 172.21.15.115:0/2874312282 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6860100620 msgr2=0x7f68601955e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:57.460 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:57.457+0000 7f68674c1640 1 --2- 172.21.15.115:0/2874312282 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6860100620 0x7f68601955e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f685c006010 tx=0x7f685c0056e0 comp rx=0 tx=0).stop 2024-09-13T17:03:57.460 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:57.457+0000 7f68674c1640 1 -- 172.21.15.115:0/2874312282 shutdown_connections 2024-09-13T17:03:57.460 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:57.457+0000 7f68674c1640 1 --2- 172.21.15.115:0/2874312282 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f684c06cc50 0x7f684c06f110 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:57.460 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:57.457+0000 7f68674c1640 1 --2- 172.21.15.115:0/2874312282 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6860102f50 0x7f6860195b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:57.460 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:57.457+0000 7f68674c1640 1 --2- 172.21.15.115:0/2874312282 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6860100620 0x7f68601955e0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:57.460 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:57.457+0000 7f68674c1640 1 -- 172.21.15.115:0/2874312282 >> 172.21.15.115:0/2874312282 conn(0x7f68600fa1c0 msgr2=0x7f68600fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:03:57.460 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:57.457+0000 7f68674c1640 1 -- 172.21.15.115:0/2874312282 shutdown_connections 2024-09-13T17:03:57.460 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:57.457+0000 7f68674c1640 1 -- 172.21.15.115:0/2874312282 wait complete. 2024-09-13T17:03:58.089 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -e sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-09-13T17:03:58.330 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T17:03:58.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:58 smithi115 ceph-mon[27708]: pgmap v198: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-09-13T17:03:58.576 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:58 smithi195 ceph-mon[34981]: pgmap v198: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-09-13T17:03:59.428 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:03:59 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:03:59.576 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:03:59 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:03:59.940 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:59.935+0000 7f8cc7e7c640 1 -- 172.21.15.115:0/3878250187 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8cc00ffca0 msgr2=0x7f8cc0100120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:59.940 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:59.935+0000 7f8cc7e7c640 1 --2- 172.21.15.115:0/3878250187 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8cc00ffca0 0x7f8cc0100120 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f8cb0009880 tx=0x7f8cb002a4a0 comp rx=0 tx=0).stop 2024-09-13T17:03:59.940 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:59.935+0000 7f8cc7e7c640 1 -- 172.21.15.115:0/3878250187 shutdown_connections 2024-09-13T17:03:59.940 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:59.935+0000 7f8cc7e7c640 1 --2- 172.21.15.115:0/3878250187 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8cc00ffca0 0x7f8cc0100120 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:59.940 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:59.935+0000 7f8cc7e7c640 1 --2- 172.21.15.115:0/3878250187 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8cc00feaa0 0x7f8cc00feea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:59.940 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:59.935+0000 7f8cc7e7c640 1 -- 172.21.15.115:0/3878250187 >> 172.21.15.115:0/3878250187 conn(0x7f8cc00fa230 msgr2=0x7f8cc00fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:03:59.940 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:59.935+0000 7f8cc7e7c640 1 -- 172.21.15.115:0/3878250187 shutdown_connections 2024-09-13T17:03:59.940 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:59.935+0000 7f8cc7e7c640 1 -- 172.21.15.115:0/3878250187 wait complete. 2024-09-13T17:03:59.940 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:59.936+0000 7f8cc7e7c640 1 Processor -- start 2024-09-13T17:03:59.940 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:59.936+0000 7f8cc7e7c640 1 -- start start 2024-09-13T17:03:59.941 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:59.936+0000 7f8cc7e7c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8cc00feaa0 0x7f8cc0194450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:03:59.941 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:59.936+0000 7f8cc7e7c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8cc00ffca0 0x7f8cc0194990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:03:59.941 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:59.936+0000 7f8cc7e7c640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc0194f60 con 0x7f8cc00ffca0 2024-09-13T17:03:59.941 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:59.936+0000 7f8cc7e7c640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc01950d0 con 0x7f8cc00feaa0 2024-09-13T17:03:59.941 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:59.936+0000 7f8cc5417640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8cc00ffca0 0x7f8cc0194990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:03:59.941 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:59.936+0000 7f8cc5417640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8cc00ffca0 0x7f8cc0194990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56398/0 (socket says 172.21.15.115:56398) 2024-09-13T17:03:59.941 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:59.936+0000 7f8cc5417640 1 -- 172.21.15.115:0/3842759479 learned_addr learned my addr 172.21.15.115:0/3842759479 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:03:59.941 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:59.937+0000 7f8cc5c18640 1 --2- 172.21.15.115:0/3842759479 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8cc00feaa0 0x7f8cc0194450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:03:59.941 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:59.937+0000 7f8cc5417640 1 -- 172.21.15.115:0/3842759479 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8cc00feaa0 msgr2=0x7f8cc0194450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:59.941 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:59.937+0000 7f8cc5417640 1 --2- 172.21.15.115:0/3842759479 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8cc00feaa0 0x7f8cc0194450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:59.941 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:59.937+0000 7f8cc5417640 1 -- 172.21.15.115:0/3842759479 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cb0009560 con 0x7f8cc00ffca0 2024-09-13T17:03:59.941 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:59.937+0000 7f8cc5c18640 1 --2- 172.21.15.115:0/3842759479 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8cc00feaa0 0x7f8cc0194450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:03:59.942 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:59.937+0000 7f8cc5417640 1 --2- 172.21.15.115:0/3842759479 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8cc00ffca0 0x7f8cc0194990 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f8cb0006010 tx=0x7f8cb00056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:03:59.942 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:59.937+0000 7f8cb6ffd640 1 -- 172.21.15.115:0/3842759479 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8cb0004c60 con 0x7f8cc00ffca0 2024-09-13T17:03:59.942 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:59.937+0000 7f8cb6ffd640 1 -- 172.21.15.115:0/3842759479 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8cb0031a00 con 0x7f8cc00ffca0 2024-09-13T17:03:59.942 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:59.937+0000 7f8cc7e7c640 1 -- 172.21.15.115:0/3842759479 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cc0199b10 con 0x7f8cc00ffca0 2024-09-13T17:03:59.942 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:59.937+0000 7f8cb6ffd640 1 -- 172.21.15.115:0/3842759479 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8cb0003bc0 con 0x7f8cc00ffca0 2024-09-13T17:03:59.942 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:59.937+0000 7f8cc7e7c640 1 -- 172.21.15.115:0/3842759479 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cc019a080 con 0x7f8cc00ffca0 2024-09-13T17:03:59.943 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:59.938+0000 7f8cc7e7c640 1 -- 172.21.15.115:0/3842759479 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cc0107570 con 0x7f8cc00ffca0 2024-09-13T17:03:59.943 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:59.938+0000 7f8cb6ffd640 1 -- 172.21.15.115:0/3842759479 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f8cb0003df0 con 0x7f8cc00ffca0 2024-09-13T17:03:59.943 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:59.939+0000 7f8cb6ffd640 1 --2- 172.21.15.115:0/3842759479 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f8cac06cc50 0x7f8cac06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:03:59.943 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:59.939+0000 7f8cb6ffd640 1 -- 172.21.15.115:0/3842759479 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f8cb00ad570 con 0x7f8cc00ffca0 2024-09-13T17:03:59.943 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:59.939+0000 7f8cc5c18640 1 --2- 172.21.15.115:0/3842759479 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f8cac06cc50 0x7f8cac06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:03:59.943 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:59.939+0000 7f8cc5c18640 1 --2- 172.21.15.115:0/3842759479 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f8cac06cc50 0x7f8cac06f110 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc0058c0 tx=0x7f8cbc005d50 comp rx=0 tx=0).ready entity=mgr.14207 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:03:59.945 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:03:59.943+0000 7f8cb6ffd640 1 -- 172.21.15.115:0/3842759479 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f8cb00778e0 con 0x7f8cc00ffca0 2024-09-13T17:04:00.108 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:00.106+0000 7f8cc7e7c640 1 -- 172.21.15.115:0/3842759479 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7f8cc0107700 con 0x7f8cc00ffca0 2024-09-13T17:04:00.108 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:00.106+0000 7f8cb6ffd640 1 -- 172.21.15.115:0/3842759479 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v23)=0 v23) v1 ==== 163+0+0 (secure 0 0 0) 0x7f8cb007af00 con 0x7f8cc00ffca0 2024-09-13T17:04:00.111 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:00.108+0000 7f8cc7e7c640 1 -- 172.21.15.115:0/3842759479 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f8cac06cc50 msgr2=0x7f8cac06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:00.111 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:00.108+0000 7f8cc7e7c640 1 --2- 172.21.15.115:0/3842759479 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f8cac06cc50 0x7f8cac06f110 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc0058c0 tx=0x7f8cbc005d50 comp rx=0 tx=0).stop 2024-09-13T17:04:00.111 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:00.108+0000 7f8cc7e7c640 1 -- 172.21.15.115:0/3842759479 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8cc00ffca0 msgr2=0x7f8cc0194990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:00.111 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:00.108+0000 7f8cc7e7c640 1 --2- 172.21.15.115:0/3842759479 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8cc00ffca0 0x7f8cc0194990 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f8cb0006010 tx=0x7f8cb00056e0 comp rx=0 tx=0).stop 2024-09-13T17:04:00.111 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:00.108+0000 7f8cc7e7c640 1 -- 172.21.15.115:0/3842759479 shutdown_connections 2024-09-13T17:04:00.111 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:00.108+0000 7f8cc7e7c640 1 --2- 172.21.15.115:0/3842759479 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f8cac06cc50 0x7f8cac06f110 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:00.111 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:00.108+0000 7f8cc7e7c640 1 --2- 172.21.15.115:0/3842759479 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8cc00ffca0 0x7f8cc0194990 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:00.111 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:00.108+0000 7f8cc7e7c640 1 --2- 172.21.15.115:0/3842759479 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8cc00feaa0 0x7f8cc0194450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:00.111 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:00.108+0000 7f8cc7e7c640 1 -- 172.21.15.115:0/3842759479 >> 172.21.15.115:0/3842759479 conn(0x7f8cc00fa230 msgr2=0x7f8cc0102ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:04:00.111 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:00.109+0000 7f8cc7e7c640 1 -- 172.21.15.115:0/3842759479 shutdown_connections 2024-09-13T17:04:00.111 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:00.109+0000 7f8cc7e7c640 1 -- 172.21.15.115:0/3842759479 wait complete. 2024-09-13T17:04:00.428 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:04:00 smithi115 ceph-mon[27708]: pgmap v199: 65 pgs: 65 active+clean; 584 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.9 KiB/s rd, 938 B/s wr, 3 op/s 2024-09-13T17:04:00.576 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:04:00 smithi195 ceph-mon[34981]: pgmap v199: 65 pgs: 65 active+clean; 584 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.9 KiB/s rd, 938 B/s wr, 3 op/s 2024-09-13T17:04:00.745 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -e sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 -- bash -c 'ceph config set global log_to_journald false --force' 2024-09-13T17:04:00.943 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T17:04:02.487 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:02.483+0000 7f9718b0a640 1 -- 172.21.15.115:0/2765626541 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9714100670 msgr2=0x7f9714102a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:02.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:02.483+0000 7f9718b0a640 1 --2- 172.21.15.115:0/2765626541 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9714100670 0x7f9714102a60 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9704009880 tx=0x7f970402a4a0 comp rx=0 tx=0).stop 2024-09-13T17:04:02.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:02.483+0000 7f9718b0a640 1 -- 172.21.15.115:0/2765626541 shutdown_connections 2024-09-13T17:04:02.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:02.483+0000 7f9718b0a640 1 --2- 172.21.15.115:0/2765626541 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9714102fa0 0x7f9714105390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:02.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:02.483+0000 7f9718b0a640 1 --2- 172.21.15.115:0/2765626541 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9714100670 0x7f9714102a60 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:02.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:02.483+0000 7f9718b0a640 1 -- 172.21.15.115:0/2765626541 >> 172.21.15.115:0/2765626541 conn(0x7f97140fa230 msgr2=0x7f97140fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:04:02.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:02.483+0000 7f9718b0a640 1 -- 172.21.15.115:0/2765626541 shutdown_connections 2024-09-13T17:04:02.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:02.483+0000 7f9718b0a640 1 -- 172.21.15.115:0/2765626541 wait complete. 2024-09-13T17:04:02.489 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:02.484+0000 7f9718b0a640 1 Processor -- start 2024-09-13T17:04:02.489 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:02.484+0000 7f9718b0a640 1 -- start start 2024-09-13T17:04:02.489 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:02.484+0000 7f9718b0a640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9714100670 0x7f97141977a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:02.489 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:02.484+0000 7f9718b0a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9714102fa0 0x7f9714197ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:02.489 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:02.484+0000 7f9718b0a640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97141982b0 con 0x7f9714102fa0 2024-09-13T17:04:02.489 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:02.484+0000 7f9718b0a640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9714198420 con 0x7f9714100670 2024-09-13T17:04:02.489 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:02.484+0000 7f970bfff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9714102fa0 0x7f9714197ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:02.489 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:02.484+0000 7f970bfff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9714102fa0 0x7f9714197ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56422/0 (socket says 172.21.15.115:56422) 2024-09-13T17:04:02.489 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:02.484+0000 7f970bfff640 1 -- 172.21.15.115:0/3255964039 learned_addr learned my addr 172.21.15.115:0/3255964039 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:04:02.489 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:02.484+0000 7f971259c640 1 --2- 172.21.15.115:0/3255964039 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9714100670 0x7f97141977a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:02.490 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:02.485+0000 7f970bfff640 1 -- 172.21.15.115:0/3255964039 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9714100670 msgr2=0x7f97141977a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:02.490 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:02.485+0000 7f970bfff640 1 --2- 172.21.15.115:0/3255964039 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9714100670 0x7f97141977a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:02.490 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:02.485+0000 7f970bfff640 1 -- 172.21.15.115:0/3255964039 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9704009560 con 0x7f9714102fa0 2024-09-13T17:04:02.490 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:02.485+0000 7f970bfff640 1 --2- 172.21.15.115:0/3255964039 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9714102fa0 0x7f9714197ce0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f96fc00b400 tx=0x7f96fc00b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:02.490 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:02.485+0000 7f970b7fe640 1 -- 172.21.15.115:0/3255964039 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f96fc011800 con 0x7f9714102fa0 2024-09-13T17:04:02.490 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:02.485+0000 7f970b7fe640 1 -- 172.21.15.115:0/3255964039 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f96fc011e00 con 0x7f9714102fa0 2024-09-13T17:04:02.490 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:02.485+0000 7f9718b0a640 1 -- 172.21.15.115:0/3255964039 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f971419cec0 con 0x7f9714102fa0 2024-09-13T17:04:02.490 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:02.485+0000 7f970b7fe640 1 -- 172.21.15.115:0/3255964039 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f96fc00f2e0 con 0x7f9714102fa0 2024-09-13T17:04:02.490 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:02.485+0000 7f9718b0a640 1 -- 172.21.15.115:0/3255964039 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f971419d460 con 0x7f9714102fa0 2024-09-13T17:04:02.491 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:02.486+0000 7f9718b0a640 1 -- 172.21.15.115:0/3255964039 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9714100ad0 con 0x7f9714102fa0 2024-09-13T17:04:02.491 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:02.486+0000 7f970b7fe640 1 -- 172.21.15.115:0/3255964039 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f96fc010380 con 0x7f9714102fa0 2024-09-13T17:04:02.491 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:02.487+0000 7f970b7fe640 1 --2- 172.21.15.115:0/3255964039 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f970006cc50 0x7f970006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:02.492 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:02.487+0000 7f970b7fe640 1 -- 172.21.15.115:0/3255964039 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f96fc08bde0 con 0x7f9714102fa0 2024-09-13T17:04:02.492 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:02.487+0000 7f971259c640 1 --2- 172.21.15.115:0/3255964039 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f970006cc50 0x7f970006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:02.492 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:02.487+0000 7f971259c640 1 --2- 172.21.15.115:0/3255964039 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f970006cc50 0x7f970006f110 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9704000c00 tx=0x7f9704031400 comp rx=0 tx=0).ready entity=mgr.14207 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:02.493 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:02.491+0000 7f970b7fe640 1 -- 172.21.15.115:0/3255964039 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f96fc0561d0 con 0x7f9714102fa0 2024-09-13T17:04:02.576 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:04:02 smithi195 ceph-mon[34981]: pgmap v200: 65 pgs: 65 active+clean; 584 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.5 KiB/s rd, 938 B/s wr, 2 op/s 2024-09-13T17:04:02.652 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:04:02 smithi115 ceph-mon[27708]: pgmap v200: 65 pgs: 65 active+clean; 584 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.5 KiB/s rd, 938 B/s wr, 2 op/s 2024-09-13T17:04:02.657 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:02.655+0000 7f9718b0a640 1 -- 172.21.15.115:0/3255964039 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7f97140fbd20 con 0x7f9714102fa0 2024-09-13T17:04:02.657 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:02.655+0000 7f970b7fe640 1 -- 172.21.15.115:0/3255964039 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v23)=0 v23) v1 ==== 135+0+0 (secure 0 0 0) 0x7f96fc0597f0 con 0x7f9714102fa0 2024-09-13T17:04:02.660 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:02.657+0000 7f9718b0a640 1 -- 172.21.15.115:0/3255964039 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f970006cc50 msgr2=0x7f970006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:02.660 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:02.657+0000 7f9718b0a640 1 --2- 172.21.15.115:0/3255964039 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f970006cc50 0x7f970006f110 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9704000c00 tx=0x7f9704031400 comp rx=0 tx=0).stop 2024-09-13T17:04:02.660 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:02.657+0000 7f9718b0a640 1 -- 172.21.15.115:0/3255964039 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9714102fa0 msgr2=0x7f9714197ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:02.660 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:02.657+0000 7f9718b0a640 1 --2- 172.21.15.115:0/3255964039 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9714102fa0 0x7f9714197ce0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f96fc00b400 tx=0x7f96fc00b8c0 comp rx=0 tx=0).stop 2024-09-13T17:04:02.660 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:02.658+0000 7f9718b0a640 1 -- 172.21.15.115:0/3255964039 shutdown_connections 2024-09-13T17:04:02.660 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:02.658+0000 7f9718b0a640 1 --2- 172.21.15.115:0/3255964039 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f970006cc50 0x7f970006f110 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:02.661 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:02.658+0000 7f9718b0a640 1 --2- 172.21.15.115:0/3255964039 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9714102fa0 0x7f9714197ce0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:02.661 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:02.658+0000 7f9718b0a640 1 --2- 172.21.15.115:0/3255964039 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9714100670 0x7f97141977a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:02.661 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:02.658+0000 7f9718b0a640 1 -- 172.21.15.115:0/3255964039 >> 172.21.15.115:0/3255964039 conn(0x7f97140fa230 msgr2=0x7f97141039a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:04:02.661 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:02.658+0000 7f9718b0a640 1 -- 172.21.15.115:0/3255964039 shutdown_connections 2024-09-13T17:04:02.661 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:02.658+0000 7f9718b0a640 1 -- 172.21.15.115:0/3255964039 wait complete. 2024-09-13T17:04:03.360 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -e sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr' 2024-09-13T17:04:03.564 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T17:04:04.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:04:04 smithi195 ceph-mon[34981]: pgmap v201: 65 pgs: 65 active+clean; 584 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.5 KiB/s rd, 938 B/s wr, 2 op/s 2024-09-13T17:04:04.587 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:04:04 smithi115 ceph-mon[27708]: pgmap v201: 65 pgs: 65 active+clean; 584 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.5 KiB/s rd, 938 B/s wr, 2 op/s 2024-09-13T17:04:05.265 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:05.248+0000 7f334c57f640 1 -- 172.21.15.115:0/1415055069 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f33440ffca0 msgr2=0x7f3344100120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:05.265 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:05.248+0000 7f334c57f640 1 --2- 172.21.15.115:0/1415055069 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f33440ffca0 0x7f3344100120 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f3334009880 tx=0x7f333402a4a0 comp rx=0 tx=0).stop 2024-09-13T17:04:05.265 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:05.248+0000 7f334c57f640 1 -- 172.21.15.115:0/1415055069 shutdown_connections 2024-09-13T17:04:05.265 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:05.248+0000 7f334c57f640 1 --2- 172.21.15.115:0/1415055069 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f33440ffca0 0x7f3344100120 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:05.266 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:05.248+0000 7f334c57f640 1 --2- 172.21.15.115:0/1415055069 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f33440feaa0 0x7f33440feea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:05.266 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:05.248+0000 7f334c57f640 1 -- 172.21.15.115:0/1415055069 >> 172.21.15.115:0/1415055069 conn(0x7f33440fa230 msgr2=0x7f33440fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:04:05.266 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:05.248+0000 7f334c57f640 1 -- 172.21.15.115:0/1415055069 shutdown_connections 2024-09-13T17:04:05.266 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:05.248+0000 7f334c57f640 1 -- 172.21.15.115:0/1415055069 wait complete. 2024-09-13T17:04:05.266 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:05.249+0000 7f334c57f640 1 Processor -- start 2024-09-13T17:04:05.266 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:05.249+0000 7f334c57f640 1 -- start start 2024-09-13T17:04:05.266 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:05.249+0000 7f334c57f640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f33440feaa0 0x7f3344194540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:05.266 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:05.249+0000 7f334c57f640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f33440ffca0 0x7f3344194a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:05.266 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:05.249+0000 7f334c57f640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3344195050 con 0x7f33440feaa0 2024-09-13T17:04:05.266 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:05.249+0000 7f334c57f640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33441951c0 con 0x7f33440ffca0 2024-09-13T17:04:05.266 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:05.249+0000 7f334a31b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f33440feaa0 0x7f3344194540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:05.266 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:05.249+0000 7f334a31b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f33440feaa0 0x7f3344194540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:38710/0 (socket says 172.21.15.115:38710) 2024-09-13T17:04:05.267 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:05.249+0000 7f334a31b640 1 -- 172.21.15.115:0/2198596841 learned_addr learned my addr 172.21.15.115:0/2198596841 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:04:05.267 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:05.249+0000 7f334a31b640 1 -- 172.21.15.115:0/2198596841 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f33440ffca0 msgr2=0x7f3344194a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:05.267 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:05.249+0000 7f334a31b640 1 --2- 172.21.15.115:0/2198596841 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f33440ffca0 0x7f3344194a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:05.267 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:05.249+0000 7f334a31b640 1 -- 172.21.15.115:0/2198596841 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3334009560 con 0x7f33440feaa0 2024-09-13T17:04:05.267 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:05.249+0000 7f334a31b640 1 --2- 172.21.15.115:0/2198596841 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f33440feaa0 0x7f3344194540 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f334000b400 tx=0x7f334000b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:05.267 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:05.250+0000 7f333b7fe640 1 -- 172.21.15.115:0/2198596841 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3340011800 con 0x7f33440feaa0 2024-09-13T17:04:05.267 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:05.250+0000 7f333b7fe640 1 -- 172.21.15.115:0/2198596841 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3340011e00 con 0x7f33440feaa0 2024-09-13T17:04:05.267 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:05.250+0000 7f333b7fe640 1 -- 172.21.15.115:0/2198596841 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f334000f2e0 con 0x7f33440feaa0 2024-09-13T17:04:05.267 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:05.250+0000 7f334c57f640 1 -- 172.21.15.115:0/2198596841 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3344199c60 con 0x7f33440feaa0 2024-09-13T17:04:05.267 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:05.250+0000 7f334c57f640 1 -- 172.21.15.115:0/2198596841 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f334419a230 con 0x7f33440feaa0 2024-09-13T17:04:05.267 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:05.251+0000 7f334c57f640 1 -- 172.21.15.115:0/2198596841 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33441075f0 con 0x7f33440feaa0 2024-09-13T17:04:05.267 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:05.251+0000 7f333b7fe640 1 -- 172.21.15.115:0/2198596841 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f3340010380 con 0x7f33440feaa0 2024-09-13T17:04:05.267 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:05.252+0000 7f333b7fe640 1 --2- 172.21.15.115:0/2198596841 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f333006cc50 0x7f333006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:05.268 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:05.252+0000 7f333b7fe640 1 -- 172.21.15.115:0/2198596841 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f334008bf90 con 0x7f33440feaa0 2024-09-13T17:04:05.268 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:05.252+0000 7f3349b1a640 1 --2- 172.21.15.115:0/2198596841 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f333006cc50 0x7f333006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:05.268 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:05.252+0000 7f3349b1a640 1 --2- 172.21.15.115:0/2198596841 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f333006cc50 0x7f333006f110 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f333402a9c0 tx=0x7f3334000bc0 comp rx=0 tx=0).ready entity=mgr.14207 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:05.268 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:05.256+0000 7f333b7fe640 1 -- 172.21.15.115:0/2198596841 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f3340056300 con 0x7f33440feaa0 2024-09-13T17:04:05.441 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:05.439+0000 7f334c57f640 1 -- 172.21.15.115:0/2198596841 --> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", "daemon_types": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7f334419a480 con 0x7f333006cc50 2024-09-13T17:04:06.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:04:06 smithi115 ceph-mon[27708]: pgmap v202: 65 pgs: 65 active+clean; 584 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.9 KiB/s rd, 938 B/s wr, 3 op/s 2024-09-13T17:04:06.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:04:06 smithi115 ceph-mon[27708]: from='client.14546 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:04:06.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:04:06 smithi195 ceph-mon[34981]: pgmap v202: 65 pgs: 65 active+clean; 584 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.9 KiB/s rd, 938 B/s wr, 3 op/s 2024-09-13T17:04:06.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:04:06 smithi195 ceph-mon[34981]: from='client.14546 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:04:08.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:04:08 smithi115 ceph-mon[27708]: pgmap v203: 65 pgs: 65 active+clean; 584 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-13T17:04:08.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:04:08 smithi195 ceph-mon[34981]: pgmap v203: 65 pgs: 65 active+clean; 584 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-13T17:04:10.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:04:10 smithi115 ceph-mon[27708]: pgmap v204: 65 pgs: 65 active+clean; 584 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s rd, 767 B/s wr, 3 op/s 2024-09-13T17:04:10.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:04:10 smithi195 ceph-mon[34981]: pgmap v204: 65 pgs: 65 active+clean; 584 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s rd, 767 B/s wr, 3 op/s 2024-09-13T17:04:12.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:04:12 smithi115 ceph-mon[27708]: pgmap v205: 65 pgs: 65 active+clean; 584 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:04:12.751 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:04:12 smithi195 ceph-mon[34981]: pgmap v205: 65 pgs: 65 active+clean; 584 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:04:14.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:04:14 smithi115 ceph-mon[27708]: pgmap v206: 65 pgs: 65 active+clean; 584 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:04:14.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:04:14 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:04:14.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:04:14 smithi195 ceph-mon[34981]: pgmap v206: 65 pgs: 65 active+clean; 584 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:04:14.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:04:14 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:04:16.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:04:16 smithi115 ceph-mon[27708]: pgmap v207: 65 pgs: 65 active+clean; 584 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:04:16.802 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:04:16 smithi195 ceph-mon[34981]: pgmap v207: 65 pgs: 65 active+clean; 584 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:04:18.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:04:18 smithi115 ceph-mon[27708]: pgmap v208: 65 pgs: 65 active+clean; 584 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:04:18.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:04:18 smithi195 ceph-mon[34981]: pgmap v208: 65 pgs: 65 active+clean; 584 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:04:20.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:04:20 smithi115 ceph-mon[27708]: pgmap v209: 65 pgs: 65 active+clean; 584 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:04:20.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:04:20 smithi195 ceph-mon[34981]: pgmap v209: 65 pgs: 65 active+clean; 584 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:04:22.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:04:22 smithi115 ceph-mon[27708]: pgmap v210: 65 pgs: 65 active+clean; 584 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:04:22.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:04:22 smithi195 ceph-mon[34981]: pgmap v210: 65 pgs: 65 active+clean; 584 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:04:24.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:04:24 smithi115 ceph-mon[27708]: pgmap v211: 65 pgs: 65 active+clean; 584 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:04:24.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:04:24 smithi195 ceph-mon[34981]: pgmap v211: 65 pgs: 65 active+clean; 584 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:04:26.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:04:26 smithi115 ceph-mon[27708]: pgmap v212: 65 pgs: 65 active+clean; 584 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:04:26.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:04:26 smithi195 ceph-mon[34981]: pgmap v212: 65 pgs: 65 active+clean; 584 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:04:28.428 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:04:28 smithi115 ceph-mon[27708]: pgmap v213: 65 pgs: 65 active+clean; 584 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:04:28.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:04:28 smithi195 ceph-mon[34981]: pgmap v213: 65 pgs: 65 active+clean; 584 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:04:29.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:04:29 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:04:29.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:04:29 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:04:30.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:04:30 smithi115 ceph-mon[27708]: pgmap v214: 65 pgs: 65 active+clean; 586 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-13T17:04:30.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:04:30 smithi195 ceph-mon[34981]: pgmap v214: 65 pgs: 65 active+clean; 586 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-13T17:04:32.404 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:32.403+0000 7f333b7fe640 1 -- 172.21.15.115:0/2198596841 <== mgr.14207 v2:172.21.15.115:6800/244039928 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7f334419a480 con 0x7f333006cc50 2024-09-13T17:04:32.404 INFO:teuthology.orchestra.run.smithi115.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T17:04:32.407 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:32.406+0000 7f334c57f640 1 -- 172.21.15.115:0/2198596841 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f333006cc50 msgr2=0x7f333006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:32.407 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:32.406+0000 7f334c57f640 1 --2- 172.21.15.115:0/2198596841 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f333006cc50 0x7f333006f110 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f333402a9c0 tx=0x7f3334000bc0 comp rx=0 tx=0).stop 2024-09-13T17:04:32.407 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:32.406+0000 7f334c57f640 1 -- 172.21.15.115:0/2198596841 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f33440feaa0 msgr2=0x7f3344194540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:32.407 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:32.406+0000 7f334c57f640 1 --2- 172.21.15.115:0/2198596841 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f33440feaa0 0x7f3344194540 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f334000b400 tx=0x7f334000b8c0 comp rx=0 tx=0).stop 2024-09-13T17:04:32.407 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:32.406+0000 7f334c57f640 1 -- 172.21.15.115:0/2198596841 shutdown_connections 2024-09-13T17:04:32.407 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:32.406+0000 7f334c57f640 1 --2- 172.21.15.115:0/2198596841 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f333006cc50 0x7f333006f110 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:32.408 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:32.406+0000 7f334c57f640 1 --2- 172.21.15.115:0/2198596841 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f33440ffca0 0x7f3344194a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:32.408 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:32.406+0000 7f334c57f640 1 --2- 172.21.15.115:0/2198596841 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f33440feaa0 0x7f3344194540 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:32.408 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:32.406+0000 7f334c57f640 1 -- 172.21.15.115:0/2198596841 >> 172.21.15.115:0/2198596841 conn(0x7f33440fa230 msgr2=0x7f3344102ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:04:32.408 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:32.406+0000 7f334c57f640 1 -- 172.21.15.115:0/2198596841 shutdown_connections 2024-09-13T17:04:32.408 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:32.406+0000 7f334c57f640 1 -- 172.21.15.115:0/2198596841 wait complete. 2024-09-13T17:04:32.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:04:32 smithi115 ceph-mon[27708]: pgmap v215: 65 pgs: 65 active+clean; 586 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1023 B/s rd, 255 B/s wr, 1 op/s 2024-09-13T17:04:32.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:04:32 smithi195 ceph-mon[34981]: pgmap v215: 65 pgs: 65 active+clean; 586 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1023 B/s rd, 255 B/s wr, 1 op/s 2024-09-13T17:04:33.404 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:04:33 smithi115 ceph-mon[27708]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T17:04:33.404 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:04:33 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:04:33.404 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:04:33 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:04:33.404 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:04:33 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:04:33.404 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:04:33 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:04:33.405 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:04:33 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:04:33.570 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -e sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done' 2024-09-13T17:04:33.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:04:33 smithi195 ceph-mon[34981]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T17:04:33.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:04:33 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:04:33.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:04:33 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:04:33.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:04:33 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:04:33.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:04:33 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:04:33.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:04:33 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:04:34.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:04:34 smithi115 ceph-mon[27708]: pgmap v216: 65 pgs: 65 active+clean; 586 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1023 B/s rd, 341 B/s wr, 2 op/s 2024-09-13T17:04:34.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:04:34 smithi115 ceph-mon[27708]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T17:04:34.804 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T17:04:34.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:04:34 smithi195 ceph-mon[34981]: pgmap v216: 65 pgs: 65 active+clean; 586 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1023 B/s rd, 341 B/s wr, 2 op/s 2024-09-13T17:04:34.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:04:34 smithi195 ceph-mon[34981]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T17:04:35.976 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:04:35 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:04:35.976 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:04:35 smithi115 ceph-mon[27708]: Upgrade: Target is version 18.2.4-860-g6c6b083f (reef) 2024-09-13T17:04:35.976 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:04:35 smithi115 ceph-mon[27708]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, digests ['quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256'] 2024-09-13T17:04:35.976 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:04:35 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:04:35.976 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:04:35 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:04:35.977 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:04:35 smithi115 ceph-mon[27708]: Upgrade: Need to upgrade myself (mgr.smithi115.hetcni) 2024-09-13T17:04:35.977 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:04:35 smithi115 ceph-mon[27708]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 on smithi195 2024-09-13T17:04:35.977 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:04:35 smithi115 ceph-mon[27708]: pgmap v217: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 511 B/s wr, 3 op/s 2024-09-13T17:04:36.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:04:35 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:04:36.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:04:35 smithi195 ceph-mon[34981]: Upgrade: Target is version 18.2.4-860-g6c6b083f (reef) 2024-09-13T17:04:36.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:04:35 smithi195 ceph-mon[34981]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, digests ['quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256'] 2024-09-13T17:04:36.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:04:35 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:04:36.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:04:35 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:04:36.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:04:35 smithi195 ceph-mon[34981]: Upgrade: Need to upgrade myself (mgr.smithi115.hetcni) 2024-09-13T17:04:36.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:04:35 smithi195 ceph-mon[34981]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 on smithi195 2024-09-13T17:04:36.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:04:35 smithi195 ceph-mon[34981]: pgmap v217: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 511 B/s wr, 3 op/s 2024-09-13T17:04:36.542 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:36.532+0000 7f09ad253640 1 -- 172.21.15.115:0/1265559115 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09a8100d70 msgr2=0x7f09a81011f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:36.542 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:36.532+0000 7f09ad253640 1 --2- 172.21.15.115:0/1265559115 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09a8100d70 0x7f09a81011f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f099c009880 tx=0x7f099c02a4a0 comp rx=0 tx=0).stop 2024-09-13T17:04:36.542 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:36.533+0000 7f09ad253640 1 -- 172.21.15.115:0/1265559115 shutdown_connections 2024-09-13T17:04:36.542 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:36.533+0000 7f09ad253640 1 --2- 172.21.15.115:0/1265559115 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09a8100d70 0x7f09a81011f0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:36.543 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:36.533+0000 7f09ad253640 1 --2- 172.21.15.115:0/1265559115 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f09a80ffb70 0x7f09a80fff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:36.543 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:36.533+0000 7f09ad253640 1 -- 172.21.15.115:0/1265559115 >> 172.21.15.115:0/1265559115 conn(0x7f09a80fb2e0 msgr2=0x7f09a80fd740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:04:36.543 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:36.533+0000 7f09ad253640 1 -- 172.21.15.115:0/1265559115 shutdown_connections 2024-09-13T17:04:36.543 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:36.533+0000 7f09ad253640 1 -- 172.21.15.115:0/1265559115 wait complete. 2024-09-13T17:04:36.543 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:36.534+0000 7f09ad253640 1 Processor -- start 2024-09-13T17:04:36.543 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:36.534+0000 7f09ad253640 1 -- start start 2024-09-13T17:04:36.543 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:36.534+0000 7f09ad253640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f09a80ffb70 0x7f09a8195530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:36.543 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:36.534+0000 7f09ad253640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09a8100d70 0x7f09a8195a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:36.543 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:36.534+0000 7f09ad253640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09a8196040 con 0x7f09a8100d70 2024-09-13T17:04:36.543 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:36.534+0000 7f09ad253640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09a81961b0 con 0x7f09a80ffb70 2024-09-13T17:04:36.543 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:36.534+0000 7f09a659c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09a8100d70 0x7f09a8195a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:36.543 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:36.534+0000 7f09a659c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09a8100d70 0x7f09a8195a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:33428/0 (socket says 172.21.15.115:33428) 2024-09-13T17:04:36.544 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:36.534+0000 7f09a659c640 1 -- 172.21.15.115:0/3295909737 learned_addr learned my addr 172.21.15.115:0/3295909737 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:04:36.544 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:36.535+0000 7f09a6d9d640 1 --2- 172.21.15.115:0/3295909737 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f09a80ffb70 0x7f09a8195530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:36.544 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:36.535+0000 7f09a659c640 1 -- 172.21.15.115:0/3295909737 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f09a80ffb70 msgr2=0x7f09a8195530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:36.544 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:36.535+0000 7f09a659c640 1 --2- 172.21.15.115:0/3295909737 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f09a80ffb70 0x7f09a8195530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:36.544 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:36.535+0000 7f09a659c640 1 -- 172.21.15.115:0/3295909737 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f099c009560 con 0x7f09a8100d70 2024-09-13T17:04:36.544 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:36.535+0000 7f09a659c640 1 --2- 172.21.15.115:0/3295909737 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09a8100d70 0x7f09a8195a70 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f099c006010 tx=0x7f099c0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:36.544 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:36.535+0000 7f098ffff640 1 -- 172.21.15.115:0/3295909737 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f099c004aa0 con 0x7f09a8100d70 2024-09-13T17:04:36.544 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:36.535+0000 7f09ad253640 1 -- 172.21.15.115:0/3295909737 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09a819abf0 con 0x7f09a8100d70 2024-09-13T17:04:36.544 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:36.535+0000 7f098ffff640 1 -- 172.21.15.115:0/3295909737 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f099c004c00 con 0x7f09a8100d70 2024-09-13T17:04:36.544 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:36.535+0000 7f098ffff640 1 -- 172.21.15.115:0/3295909737 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f099c031990 con 0x7f09a8100d70 2024-09-13T17:04:36.544 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:36.535+0000 7f09ad253640 1 -- 172.21.15.115:0/3295909737 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09a819b160 con 0x7f09a8100d70 2024-09-13T17:04:36.544 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:36.537+0000 7f09ad253640 1 -- 172.21.15.115:0/3295909737 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09a8108640 con 0x7f09a8100d70 2024-09-13T17:04:36.544 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:36.538+0000 7f098ffff640 1 -- 172.21.15.115:0/3295909737 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f099c031af0 con 0x7f09a8100d70 2024-09-13T17:04:36.545 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:36.538+0000 7f098ffff640 1 --2- 172.21.15.115:0/3295909737 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f099006cc50 0x7f099006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:36.545 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:36.538+0000 7f09a6d9d640 1 --2- 172.21.15.115:0/3295909737 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f099006cc50 0x7f099006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:36.545 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:36.539+0000 7f098ffff640 1 -- 172.21.15.115:0/3295909737 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f099c0ad430 con 0x7f09a8100d70 2024-09-13T17:04:36.545 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:36.539+0000 7f09a6d9d640 1 --2- 172.21.15.115:0/3295909737 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f099006cc50 0x7f099006f110 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f09a8100bd0 tx=0x7f0998005f90 comp rx=0 tx=0).ready entity=mgr.14207 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:36.545 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:36.544+0000 7f098ffff640 1 -- 172.21.15.115:0/3295909737 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f099c07b2b0 con 0x7f09a8100d70 2024-09-13T17:04:36.733 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:36.732+0000 7f09ad253640 1 -- 172.21.15.115:0/3295909737 --> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f09a81056c0 con 0x7f099006cc50 2024-09-13T17:04:36.734 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:36.734+0000 7f098ffff640 1 -- 172.21.15.115:0/3295909737 <== mgr.14207 v2:172.21.15.115:6800/244039928 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7f09a81056c0 con 0x7f099006cc50 2024-09-13T17:04:36.737 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:36.736+0000 7f09ad253640 1 -- 172.21.15.115:0/3295909737 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f099006cc50 msgr2=0x7f099006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:36.737 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:36.736+0000 7f09ad253640 1 --2- 172.21.15.115:0/3295909737 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f099006cc50 0x7f099006f110 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f09a8100bd0 tx=0x7f0998005f90 comp rx=0 tx=0).stop 2024-09-13T17:04:36.737 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:36.736+0000 7f09ad253640 1 -- 172.21.15.115:0/3295909737 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09a8100d70 msgr2=0x7f09a8195a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:36.737 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:36.736+0000 7f09ad253640 1 --2- 172.21.15.115:0/3295909737 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09a8100d70 0x7f09a8195a70 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f099c006010 tx=0x7f099c0055a0 comp rx=0 tx=0).stop 2024-09-13T17:04:36.737 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:36.736+0000 7f09ad253640 1 -- 172.21.15.115:0/3295909737 shutdown_connections 2024-09-13T17:04:36.737 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:36.736+0000 7f09ad253640 1 --2- 172.21.15.115:0/3295909737 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f099006cc50 0x7f099006f110 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:36.737 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:36.736+0000 7f09ad253640 1 --2- 172.21.15.115:0/3295909737 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09a8100d70 0x7f09a8195a70 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:36.737 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:36.736+0000 7f09ad253640 1 --2- 172.21.15.115:0/3295909737 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f09a80ffb70 0x7f09a8195530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:36.738 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:36.736+0000 7f09ad253640 1 -- 172.21.15.115:0/3295909737 >> 172.21.15.115:0/3295909737 conn(0x7f09a80fb2e0 msgr2=0x7f09a8103fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:04:36.738 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:36.736+0000 7f09ad253640 1 -- 172.21.15.115:0/3295909737 shutdown_connections 2024-09-13T17:04:36.738 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:36.736+0000 7f09ad253640 1 -- 172.21.15.115:0/3295909737 wait complete. 2024-09-13T17:04:36.747 INFO:teuthology.orchestra.run.smithi115.stdout:true 2024-09-13T17:04:36.823 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:36.822+0000 7fd5101d6640 1 -- 172.21.15.115:0/1837834310 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd508100d40 msgr2=0x7fd5081011c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:36.824 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:36.822+0000 7fd5101d6640 1 --2- 172.21.15.115:0/1837834310 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd508100d40 0x7fd5081011c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fd4f8009880 tx=0x7fd4f802a4a0 comp rx=0 tx=0).stop 2024-09-13T17:04:36.824 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:36.822+0000 7fd5101d6640 1 -- 172.21.15.115:0/1837834310 shutdown_connections 2024-09-13T17:04:36.824 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:36.822+0000 7fd5101d6640 1 --2- 172.21.15.115:0/1837834310 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd508100d40 0x7fd5081011c0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:36.824 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:36.822+0000 7fd5101d6640 1 --2- 172.21.15.115:0/1837834310 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd5080ffb40 0x7fd5080fff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:36.824 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:36.822+0000 7fd5101d6640 1 -- 172.21.15.115:0/1837834310 >> 172.21.15.115:0/1837834310 conn(0x7fd5080fb2f0 msgr2=0x7fd5080fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:04:36.824 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:36.823+0000 7fd5101d6640 1 -- 172.21.15.115:0/1837834310 shutdown_connections 2024-09-13T17:04:36.825 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:36.823+0000 7fd5101d6640 1 -- 172.21.15.115:0/1837834310 wait complete. 2024-09-13T17:04:36.825 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:36.824+0000 7fd5101d6640 1 Processor -- start 2024-09-13T17:04:36.826 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:36.824+0000 7fd5101d6640 1 -- start start 2024-09-13T17:04:36.826 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:36.824+0000 7fd5101d6640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5080ffb40 0x7fd508074250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:36.826 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:36.824+0000 7fd5101d6640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd508100d40 0x7fd5080728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:36.826 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:36.824+0000 7fd5101d6640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd508072de0 con 0x7fd5080ffb40 2024-09-13T17:04:36.826 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:36.824+0000 7fd5101d6640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd508072f50 con 0x7fd508100d40 2024-09-13T17:04:36.827 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:36.824+0000 7fd50df72640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5080ffb40 0x7fd508074250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:36.827 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:36.824+0000 7fd50df72640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5080ffb40 0x7fd508074250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:33458/0 (socket says 172.21.15.115:33458) 2024-09-13T17:04:36.827 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:36.824+0000 7fd50df72640 1 -- 172.21.15.115:0/843066345 learned_addr learned my addr 172.21.15.115:0/843066345 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:04:36.827 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:36.825+0000 7fd50d771640 1 --2- 172.21.15.115:0/843066345 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd508100d40 0x7fd5080728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:36.827 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:36.825+0000 7fd50df72640 1 -- 172.21.15.115:0/843066345 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd508100d40 msgr2=0x7fd5080728a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:36.827 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:36.825+0000 7fd50df72640 1 --2- 172.21.15.115:0/843066345 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd508100d40 0x7fd5080728a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:36.827 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:36.825+0000 7fd50df72640 1 -- 172.21.15.115:0/843066345 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4f8009560 con 0x7fd5080ffb40 2024-09-13T17:04:36.827 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:36.825+0000 7fd50df72640 1 --2- 172.21.15.115:0/843066345 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5080ffb40 0x7fd508074250 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd50400d8d0 tx=0x7fd50400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:36.828 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:36.826+0000 7fd4feffd640 1 -- 172.21.15.115:0/843066345 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd50400bea0 con 0x7fd5080ffb40 2024-09-13T17:04:36.828 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:36.826+0000 7fd5101d6640 1 -- 172.21.15.115:0/843066345 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd508073230 con 0x7fd5080ffb40 2024-09-13T17:04:36.828 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:36.826+0000 7fd4feffd640 1 -- 172.21.15.115:0/843066345 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd504009c00 con 0x7fd5080ffb40 2024-09-13T17:04:36.828 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:36.826+0000 7fd4feffd640 1 -- 172.21.15.115:0/843066345 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd50400f710 con 0x7fd5080ffb40 2024-09-13T17:04:36.828 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:36.826+0000 7fd5101d6640 1 -- 172.21.15.115:0/843066345 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd50819d560 con 0x7fd5080ffb40 2024-09-13T17:04:36.828 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:36.827+0000 7fd5101d6640 1 -- 172.21.15.115:0/843066345 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5081085f0 con 0x7fd5080ffb40 2024-09-13T17:04:36.830 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:36.829+0000 7fd4feffd640 1 -- 172.21.15.115:0/843066345 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fd504010460 con 0x7fd5080ffb40 2024-09-13T17:04:36.831 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:36.829+0000 7fd4feffd640 1 --2- 172.21.15.115:0/843066345 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fd4f406cca0 0x7fd4f406f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:36.831 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:36.829+0000 7fd4feffd640 1 -- 172.21.15.115:0/843066345 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fd50408c980 con 0x7fd5080ffb40 2024-09-13T17:04:36.838 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:36.836+0000 7fd50d771640 1 --2- 172.21.15.115:0/843066345 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fd4f406cca0 0x7fd4f406f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:36.838 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:36.837+0000 7fd4feffd640 1 -- 172.21.15.115:0/843066345 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd504056d50 con 0x7fd5080ffb40 2024-09-13T17:04:36.838 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:36.837+0000 7fd50d771640 1 --2- 172.21.15.115:0/843066345 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fd4f406cca0 0x7fd4f406f160 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd508073fd0 tx=0x7fd4f8031400 comp rx=0 tx=0).ready entity=mgr.14207 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:37.024 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.023+0000 7fd5101d6640 1 -- 172.21.15.115:0/843066345 --> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd508105690 con 0x7fd4f406cca0 2024-09-13T17:04:37.025 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.024+0000 7fd4feffd640 1 -- 172.21.15.115:0/843066345 <== mgr.14207 v2:172.21.15.115:6800/244039928 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7fd508105690 con 0x7fd4f406cca0 2024-09-13T17:04:37.029 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.027+0000 7fd5101d6640 1 -- 172.21.15.115:0/843066345 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fd4f406cca0 msgr2=0x7fd4f406f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:37.029 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.027+0000 7fd5101d6640 1 --2- 172.21.15.115:0/843066345 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fd4f406cca0 0x7fd4f406f160 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd508073fd0 tx=0x7fd4f8031400 comp rx=0 tx=0).stop 2024-09-13T17:04:37.029 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.027+0000 7fd5101d6640 1 -- 172.21.15.115:0/843066345 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5080ffb40 msgr2=0x7fd508074250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:37.029 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.027+0000 7fd5101d6640 1 --2- 172.21.15.115:0/843066345 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5080ffb40 0x7fd508074250 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd50400d8d0 tx=0x7fd50400dd90 comp rx=0 tx=0).stop 2024-09-13T17:04:37.029 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.027+0000 7fd5101d6640 1 -- 172.21.15.115:0/843066345 shutdown_connections 2024-09-13T17:04:37.029 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.027+0000 7fd5101d6640 1 --2- 172.21.15.115:0/843066345 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fd4f406cca0 0x7fd4f406f160 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:37.029 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.027+0000 7fd5101d6640 1 --2- 172.21.15.115:0/843066345 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd508100d40 0x7fd5080728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:37.029 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.027+0000 7fd5101d6640 1 --2- 172.21.15.115:0/843066345 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5080ffb40 0x7fd508074250 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:37.029 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.027+0000 7fd5101d6640 1 -- 172.21.15.115:0/843066345 >> 172.21.15.115:0/843066345 conn(0x7fd5080fb2f0 msgr2=0x7fd508103f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:04:37.029 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.028+0000 7fd5101d6640 1 -- 172.21.15.115:0/843066345 shutdown_connections 2024-09-13T17:04:37.029 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.028+0000 7fd5101d6640 1 -- 172.21.15.115:0/843066345 wait complete. 2024-09-13T17:04:37.154 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.152+0000 7f5a6ba41640 1 -- 172.21.15.115:0/2845985776 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5a641005c0 msgr2=0x7f5a641029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:37.154 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.152+0000 7f5a6ba41640 1 --2- 172.21.15.115:0/2845985776 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5a641005c0 0x7f5a641029b0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f5a600098b0 tx=0x7f5a6002a4d0 comp rx=0 tx=0).stop 2024-09-13T17:04:37.154 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.152+0000 7f5a6ba41640 1 -- 172.21.15.115:0/2845985776 shutdown_connections 2024-09-13T17:04:37.154 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.152+0000 7f5a6ba41640 1 --2- 172.21.15.115:0/2845985776 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5a64102ef0 0x7f5a641052e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:37.154 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.152+0000 7f5a6ba41640 1 --2- 172.21.15.115:0/2845985776 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5a641005c0 0x7f5a641029b0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:37.155 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.152+0000 7f5a6ba41640 1 -- 172.21.15.115:0/2845985776 >> 172.21.15.115:0/2845985776 conn(0x7f5a640fa1c0 msgr2=0x7f5a640fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:04:37.155 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.152+0000 7f5a6ba41640 1 -- 172.21.15.115:0/2845985776 shutdown_connections 2024-09-13T17:04:37.155 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.152+0000 7f5a6ba41640 1 -- 172.21.15.115:0/2845985776 wait complete. 2024-09-13T17:04:37.155 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.153+0000 7f5a6ba41640 1 Processor -- start 2024-09-13T17:04:37.155 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.153+0000 7f5a6ba41640 1 -- start start 2024-09-13T17:04:37.156 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.154+0000 7f5a6ba41640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5a641005c0 0x7f5a640fff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:37.156 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.154+0000 7f5a6ba41640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5a64102ef0 0x7f5a640fe570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:37.156 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.154+0000 7f5a68fdc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5a64102ef0 0x7f5a640fe570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:37.156 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.154+0000 7f5a68fdc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5a64102ef0 0x7f5a640fe570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:33472/0 (socket says 172.21.15.115:33472) 2024-09-13T17:04:37.156 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.154+0000 7f5a697dd640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5a641005c0 0x7f5a640fff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:37.156 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.154+0000 7f5a68fdc640 1 -- 172.21.15.115:0/3657872755 learned_addr learned my addr 172.21.15.115:0/3657872755 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:04:37.156 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.154+0000 7f5a6ba41640 1 -- 172.21.15.115:0/3657872755 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a640feab0 con 0x7f5a64102ef0 2024-09-13T17:04:37.156 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.154+0000 7f5a6ba41640 1 -- 172.21.15.115:0/3657872755 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a640fec20 con 0x7f5a641005c0 2024-09-13T17:04:37.156 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.154+0000 7f5a68fdc640 1 -- 172.21.15.115:0/3657872755 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5a641005c0 msgr2=0x7f5a640fff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:37.156 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.154+0000 7f5a68fdc640 1 --2- 172.21.15.115:0/3657872755 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5a641005c0 0x7f5a640fff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:37.156 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.154+0000 7f5a68fdc640 1 -- 172.21.15.115:0/3657872755 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a60009560 con 0x7f5a64102ef0 2024-09-13T17:04:37.157 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.155+0000 7f5a68fdc640 1 --2- 172.21.15.115:0/3657872755 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5a64102ef0 0x7f5a640fe570 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f5a5400d950 tx=0x7f5a5400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:37.157 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.155+0000 7f5a5a7fc640 1 -- 172.21.15.115:0/3657872755 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a54009ab0 con 0x7f5a64102ef0 2024-09-13T17:04:37.157 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.155+0000 7f5a5a7fc640 1 -- 172.21.15.115:0/3657872755 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5a54009c10 con 0x7f5a64102ef0 2024-09-13T17:04:37.157 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.155+0000 7f5a6ba41640 1 -- 172.21.15.115:0/3657872755 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a640fef00 con 0x7f5a64102ef0 2024-09-13T17:04:37.157 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.156+0000 7f5a5a7fc640 1 -- 172.21.15.115:0/3657872755 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a5400f5f0 con 0x7f5a64102ef0 2024-09-13T17:04:37.157 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.156+0000 7f5a6ba41640 1 -- 172.21.15.115:0/3657872755 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a6419d610 con 0x7f5a64102ef0 2024-09-13T17:04:37.159 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.158+0000 7f5a6ba41640 1 -- 172.21.15.115:0/3657872755 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a64108610 con 0x7f5a64102ef0 2024-09-13T17:04:37.159 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.158+0000 7f5a5a7fc640 1 -- 172.21.15.115:0/3657872755 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f5a54010460 con 0x7f5a64102ef0 2024-09-13T17:04:37.160 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.159+0000 7f5a5a7fc640 1 --2- 172.21.15.115:0/3657872755 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f5a5006cca0 0x7f5a5006f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:37.160 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.159+0000 7f5a5a7fc640 1 -- 172.21.15.115:0/3657872755 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f5a5408b870 con 0x7f5a64102ef0 2024-09-13T17:04:37.160 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.159+0000 7f5a697dd640 1 --2- 172.21.15.115:0/3657872755 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f5a5006cca0 0x7f5a5006f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:37.160 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.159+0000 7f5a697dd640 1 --2- 172.21.15.115:0/3657872755 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f5a5006cca0 0x7f5a5006f160 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5a60031460 tx=0x7f5a60000bc0 comp rx=0 tx=0).ready entity=mgr.14207 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:37.168 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.167+0000 7f5a5a7fc640 1 -- 172.21.15.115:0/3657872755 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f5a54055c80 con 0x7f5a64102ef0 2024-09-13T17:04:37.521 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.519+0000 7f5a6ba41640 1 -- 172.21.15.115:0/3657872755 --> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5a64103990 con 0x7f5a5006cca0 2024-09-13T17:04:37.537 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.536+0000 7f5a5a7fc640 1 -- 172.21.15.115:0/3657872755 <== mgr.14207 v2:172.21.15.115:6800/244039928 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7f5a64103990 con 0x7f5a5006cca0 2024-09-13T17:04:37.538 INFO:teuthology.orchestra.run.smithi115.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T17:04:37.538 INFO:teuthology.orchestra.run.smithi115.stdout:alertmanager.smithi115 smithi115 *:9093,9094 running (5m) 51s ago 6m 25.5M - 0.25.0 c8568f914cd2 cbe091cee151 2024-09-13T17:04:37.538 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-exporter.smithi115 smithi115 running (6m) 51s ago 6m 7566k - 18.2.4-843-g2c01458a c129f5a2fd4e 0f1eebeaf9bb 2024-09-13T17:04:37.538 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-exporter.smithi195 smithi195 running (5m) 58s ago 5m 7247k - 18.2.4-843-g2c01458a c129f5a2fd4e 6d05bafbac8a 2024-09-13T17:04:37.538 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi115 smithi115 running (6m) 51s ago 6m 6899k - 18.2.4-843-g2c01458a c129f5a2fd4e 624a903fec23 2024-09-13T17:04:37.538 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi195 smithi195 running (5m) 58s ago 5m 6891k - 18.2.4-843-g2c01458a c129f5a2fd4e 42e6ce26130d 2024-09-13T17:04:37.538 INFO:teuthology.orchestra.run.smithi115.stdout:grafana.smithi115 smithi115 *:3000 running (5m) 51s ago 6m 85.1M - 9.4.7 954c08fa6188 41183f0705c8 2024-09-13T17:04:37.538 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi115.hbtxod smithi115 running (77s) 51s ago 77s 13.4M - 18.2.4-843-g2c01458a c129f5a2fd4e 12b4f4874491 2024-09-13T17:04:37.538 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi115.ijznvr smithi115 running (72s) 51s ago 71s 16.8M - 18.2.4-843-g2c01458a c129f5a2fd4e 2d552564a9f4 2024-09-13T17:04:37.538 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi195.aevvgz smithi195 running (69s) 58s ago 69s 13.5M - 18.2.4-843-g2c01458a c129f5a2fd4e 299b9ad657c9 2024-09-13T17:04:37.538 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi195.qzghxj smithi195 running (75s) 58s ago 74s 11.7M - 18.2.4-843-g2c01458a c129f5a2fd4e fb16b16181ff 2024-09-13T17:04:37.538 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi115.hetcni smithi115 *:9283,8765,8443 running (8m) 51s ago 7m 486M - 18.2.4-843-g2c01458a c129f5a2fd4e f2f0af4ec38c 2024-09-13T17:04:37.538 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi195.hjjifz smithi195 *:8443,9283,8765 running (5m) 58s ago 5m 440M - 18.2.4-843-g2c01458a c129f5a2fd4e 17f4cb7219e4 2024-09-13T17:04:37.539 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi115 smithi115 running (8m) 51s ago 8m 46.1M 2048M 18.2.4-843-g2c01458a c129f5a2fd4e 202375d41e68 2024-09-13T17:04:37.539 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi195 smithi195 running (5m) 58s ago 5m 34.2M 2048M 18.2.4-843-g2c01458a c129f5a2fd4e 0f54c30e5970 2024-09-13T17:04:37.539 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi115 smithi115 *:9100 running (6m) 51s ago 6m 15.9M - 1.5.0 0da6a335fe13 9074300dbe31 2024-09-13T17:04:37.539 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi195 smithi195 *:9100 running (5m) 58s ago 5m 15.5M - 1.5.0 0da6a335fe13 d7b54e5d8c97 2024-09-13T17:04:37.539 INFO:teuthology.orchestra.run.smithi115.stdout:osd.0 smithi115 running (4m) 51s ago 4m 49.0M 3946M 18.2.4-843-g2c01458a c129f5a2fd4e 8a8ad231962e 2024-09-13T17:04:37.539 INFO:teuthology.orchestra.run.smithi115.stdout:osd.1 smithi115 running (4m) 51s ago 4m 49.2M 3946M 18.2.4-843-g2c01458a c129f5a2fd4e 3fbc020102a0 2024-09-13T17:04:37.539 INFO:teuthology.orchestra.run.smithi115.stdout:osd.2 smithi115 running (3m) 51s ago 3m 53.9M 3946M 18.2.4-843-g2c01458a c129f5a2fd4e 7c623823e920 2024-09-13T17:04:37.539 INFO:teuthology.orchestra.run.smithi115.stdout:osd.3 smithi195 running (3m) 58s ago 3m 53.1M 4970M 18.2.4-843-g2c01458a c129f5a2fd4e 10ea833fd5c5 2024-09-13T17:04:37.539 INFO:teuthology.orchestra.run.smithi115.stdout:osd.4 smithi195 running (3m) 58s ago 3m 43.8M 4970M 18.2.4-843-g2c01458a c129f5a2fd4e 4bbc3acb9aff 2024-09-13T17:04:37.539 INFO:teuthology.orchestra.run.smithi115.stdout:osd.5 smithi195 running (2m) 58s ago 2m 44.0M 4970M 18.2.4-843-g2c01458a c129f5a2fd4e 4bd1b3a232d0 2024-09-13T17:04:37.539 INFO:teuthology.orchestra.run.smithi115.stdout:prometheus.smithi115 smithi115 *:9095 running (5m) 51s ago 6m 60.7M - 2.43.0 a07b618ecd1d e91d39286d6c 2024-09-13T17:04:37.540 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.539+0000 7f5a6ba41640 1 -- 172.21.15.115:0/3657872755 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f5a5006cca0 msgr2=0x7f5a5006f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:37.541 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.539+0000 7f5a6ba41640 1 --2- 172.21.15.115:0/3657872755 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f5a5006cca0 0x7f5a5006f160 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5a60031460 tx=0x7f5a60000bc0 comp rx=0 tx=0).stop 2024-09-13T17:04:37.541 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.539+0000 7f5a6ba41640 1 -- 172.21.15.115:0/3657872755 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5a64102ef0 msgr2=0x7f5a640fe570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:37.541 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.539+0000 7f5a6ba41640 1 --2- 172.21.15.115:0/3657872755 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5a64102ef0 0x7f5a640fe570 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f5a5400d950 tx=0x7f5a5400de10 comp rx=0 tx=0).stop 2024-09-13T17:04:37.541 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.539+0000 7f5a6ba41640 1 -- 172.21.15.115:0/3657872755 shutdown_connections 2024-09-13T17:04:37.541 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.539+0000 7f5a6ba41640 1 --2- 172.21.15.115:0/3657872755 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f5a5006cca0 0x7f5a5006f160 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:37.541 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.539+0000 7f5a6ba41640 1 --2- 172.21.15.115:0/3657872755 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5a64102ef0 0x7f5a640fe570 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:37.541 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.539+0000 7f5a6ba41640 1 --2- 172.21.15.115:0/3657872755 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5a641005c0 0x7f5a640fff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:37.541 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.539+0000 7f5a6ba41640 1 -- 172.21.15.115:0/3657872755 >> 172.21.15.115:0/3657872755 conn(0x7f5a640fa1c0 msgr2=0x7f5a640fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:04:37.541 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.540+0000 7f5a6ba41640 1 -- 172.21.15.115:0/3657872755 shutdown_connections 2024-09-13T17:04:37.542 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.540+0000 7f5a6ba41640 1 -- 172.21.15.115:0/3657872755 wait complete. 2024-09-13T17:04:37.669 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.667+0000 7f31e20ae640 1 -- 172.21.15.115:0/138896407 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31dc0fea30 msgr2=0x7f31dc0fee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:37.669 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.667+0000 7f31e20ae640 1 --2- 172.21.15.115:0/138896407 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31dc0fea30 0x7f31dc0fee30 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f31cc009880 tx=0x7f31cc02a4a0 comp rx=0 tx=0).stop 2024-09-13T17:04:37.670 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.668+0000 7f31e20ae640 1 -- 172.21.15.115:0/138896407 shutdown_connections 2024-09-13T17:04:37.670 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.668+0000 7f31e20ae640 1 --2- 172.21.15.115:0/138896407 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f31dc0ffc30 0x7f31dc1000b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:37.670 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.668+0000 7f31e20ae640 1 --2- 172.21.15.115:0/138896407 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31dc0fea30 0x7f31dc0fee30 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:37.670 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.668+0000 7f31e20ae640 1 -- 172.21.15.115:0/138896407 >> 172.21.15.115:0/138896407 conn(0x7f31dc0fa1c0 msgr2=0x7f31dc0fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:04:37.670 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.668+0000 7f31e20ae640 1 -- 172.21.15.115:0/138896407 shutdown_connections 2024-09-13T17:04:37.670 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.668+0000 7f31e20ae640 1 -- 172.21.15.115:0/138896407 wait complete. 2024-09-13T17:04:37.673 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.669+0000 7f31e20ae640 1 Processor -- start 2024-09-13T17:04:37.673 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.669+0000 7f31e20ae640 1 -- start start 2024-09-13T17:04:37.673 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.670+0000 7f31e20ae640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31dc0fea30 0x7f31dc1955a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:37.674 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.670+0000 7f31e20ae640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f31dc0ffc30 0x7f31dc195ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:37.674 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.670+0000 7f31e20ae640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31dc1960b0 con 0x7f31dc0fea30 2024-09-13T17:04:37.674 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.670+0000 7f31e20ae640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31dc196220 con 0x7f31dc0ffc30 2024-09-13T17:04:37.674 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.670+0000 7f31db7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31dc0fea30 0x7f31dc1955a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:37.674 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.670+0000 7f31daffd640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f31dc0ffc30 0x7f31dc195ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:37.674 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.670+0000 7f31daffd640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f31dc0ffc30 0x7f31dc195ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.115:45340/0 (socket says 172.21.15.115:45340) 2024-09-13T17:04:37.674 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.670+0000 7f31db7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31dc0fea30 0x7f31dc1955a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:33498/0 (socket says 172.21.15.115:33498) 2024-09-13T17:04:37.674 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.670+0000 7f31daffd640 1 -- 172.21.15.115:0/1256150936 learned_addr learned my addr 172.21.15.115:0/1256150936 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:04:37.674 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.671+0000 7f31db7fe640 1 -- 172.21.15.115:0/1256150936 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f31dc0ffc30 msgr2=0x7f31dc195ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:37.674 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.671+0000 7f31db7fe640 1 --2- 172.21.15.115:0/1256150936 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f31dc0ffc30 0x7f31dc195ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:37.674 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.671+0000 7f31db7fe640 1 -- 172.21.15.115:0/1256150936 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31cc009560 con 0x7f31dc0fea30 2024-09-13T17:04:37.675 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.671+0000 7f31db7fe640 1 --2- 172.21.15.115:0/1256150936 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31dc0fea30 0x7f31dc1955a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f31cc009880 tx=0x7f31cc004940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:37.675 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.671+0000 7f31d8ff9640 1 -- 172.21.15.115:0/1256150936 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f31cc004d00 con 0x7f31dc0fea30 2024-09-13T17:04:37.675 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.671+0000 7f31d8ff9640 1 -- 172.21.15.115:0/1256150936 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f31cc0044f0 con 0x7f31dc0fea30 2024-09-13T17:04:37.675 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.671+0000 7f31e20ae640 1 -- 172.21.15.115:0/1256150936 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31dc100e50 con 0x7f31dc0fea30 2024-09-13T17:04:37.675 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.672+0000 7f31e20ae640 1 -- 172.21.15.115:0/1256150936 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31dc1013c0 con 0x7f31dc0fea30 2024-09-13T17:04:37.676 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.672+0000 7f31d8ff9640 1 -- 172.21.15.115:0/1256150936 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f31cc031860 con 0x7f31dc0fea30 2024-09-13T17:04:37.676 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.674+0000 7f31d8ff9640 1 -- 172.21.15.115:0/1256150936 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f31cc0319c0 con 0x7f31dc0fea30 2024-09-13T17:04:37.676 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.674+0000 7f31e20ae640 1 -- 172.21.15.115:0/1256150936 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31bc005280 con 0x7f31dc0fea30 2024-09-13T17:04:37.676 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.674+0000 7f31d8ff9640 1 --2- 172.21.15.115:0/1256150936 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f31c806cca0 0x7f31c806f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:37.676 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.675+0000 7f31daffd640 1 --2- 172.21.15.115:0/1256150936 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f31c806cca0 0x7f31c806f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:37.676 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.675+0000 7f31d8ff9640 1 -- 172.21.15.115:0/1256150936 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f31cc0ad2b0 con 0x7f31dc0fea30 2024-09-13T17:04:37.677 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.675+0000 7f31daffd640 1 --2- 172.21.15.115:0/1256150936 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f31c806cca0 0x7f31c806f160 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f31dc196a50 tx=0x7f31c4005f90 comp rx=0 tx=0).ready entity=mgr.14207 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:37.684 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:37.683+0000 7f31d8ff9640 1 -- 172.21.15.115:0/1256150936 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f31cc078590 con 0x7f31dc0fea30 2024-09-13T17:04:38.153 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:38.152+0000 7f31e20ae640 1 -- 172.21.15.115:0/1256150936 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f31bc005d40 con 0x7f31dc0fea30 2024-09-13T17:04:38.154 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:38.153+0000 7f31d8ff9640 1 -- 172.21.15.115:0/1256150936 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7f31cc076e60 con 0x7f31dc0fea30 2024-09-13T17:04:38.155 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-13T17:04:38.155 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": { 2024-09-13T17:04:38.155 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-843-g2c01458a (2c01458affee2b2435cd231b6e392435c1c21661) reef (stable)": 2 2024-09-13T17:04:38.155 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T17:04:38.155 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": { 2024-09-13T17:04:38.155 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-843-g2c01458a (2c01458affee2b2435cd231b6e392435c1c21661) reef (stable)": 2 2024-09-13T17:04:38.155 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T17:04:38.155 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": { 2024-09-13T17:04:38.155 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-843-g2c01458a (2c01458affee2b2435cd231b6e392435c1c21661) reef (stable)": 6 2024-09-13T17:04:38.155 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T17:04:38.156 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": { 2024-09-13T17:04:38.156 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-843-g2c01458a (2c01458affee2b2435cd231b6e392435c1c21661) reef (stable)": 4 2024-09-13T17:04:38.156 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T17:04:38.156 INFO:teuthology.orchestra.run.smithi115.stdout: "overall": { 2024-09-13T17:04:38.156 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-843-g2c01458a (2c01458affee2b2435cd231b6e392435c1c21661) reef (stable)": 14 2024-09-13T17:04:38.156 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-13T17:04:38.156 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-13T17:04:38.158 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:38.156+0000 7f31e20ae640 1 -- 172.21.15.115:0/1256150936 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f31c806cca0 msgr2=0x7f31c806f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:38.158 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:38.156+0000 7f31e20ae640 1 --2- 172.21.15.115:0/1256150936 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f31c806cca0 0x7f31c806f160 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f31dc196a50 tx=0x7f31c4005f90 comp rx=0 tx=0).stop 2024-09-13T17:04:38.158 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:38.156+0000 7f31e20ae640 1 -- 172.21.15.115:0/1256150936 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31dc0fea30 msgr2=0x7f31dc1955a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:38.158 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:38.156+0000 7f31e20ae640 1 --2- 172.21.15.115:0/1256150936 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31dc0fea30 0x7f31dc1955a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f31cc009880 tx=0x7f31cc004940 comp rx=0 tx=0).stop 2024-09-13T17:04:38.159 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:38.156+0000 7f31e20ae640 1 -- 172.21.15.115:0/1256150936 shutdown_connections 2024-09-13T17:04:38.159 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:38.156+0000 7f31e20ae640 1 --2- 172.21.15.115:0/1256150936 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f31c806cca0 0x7f31c806f160 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:38.159 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:38.156+0000 7f31e20ae640 1 --2- 172.21.15.115:0/1256150936 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f31dc0ffc30 0x7f31dc195ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:38.159 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:38.156+0000 7f31e20ae640 1 --2- 172.21.15.115:0/1256150936 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31dc0fea30 0x7f31dc1955a0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:38.159 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:38.156+0000 7f31e20ae640 1 -- 172.21.15.115:0/1256150936 >> 172.21.15.115:0/1256150936 conn(0x7f31dc0fa1c0 msgr2=0x7f31dc067be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:04:38.159 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:38.157+0000 7f31e20ae640 1 -- 172.21.15.115:0/1256150936 shutdown_connections 2024-09-13T17:04:38.159 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:38.157+0000 7f31e20ae640 1 -- 172.21.15.115:0/1256150936 wait complete. 2024-09-13T17:04:38.288 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:38.286+0000 7f6d628cd640 1 -- 172.21.15.115:0/256715452 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d5c0fed00 msgr2=0x7f6d5c0ff180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:38.288 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:38.286+0000 7f6d628cd640 1 --2- 172.21.15.115:0/256715452 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d5c0fed00 0x7f6d5c0ff180 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6d50009880 tx=0x7f6d5002a4a0 comp rx=0 tx=0).stop 2024-09-13T17:04:38.288 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:38.286+0000 7f6d628cd640 1 -- 172.21.15.115:0/256715452 shutdown_connections 2024-09-13T17:04:38.288 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:38.286+0000 7f6d628cd640 1 --2- 172.21.15.115:0/256715452 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d5c0fed00 0x7f6d5c0ff180 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:38.288 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:38.286+0000 7f6d628cd640 1 --2- 172.21.15.115:0/256715452 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6d5c0fffc0 0x7f6d5c1003c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:38.288 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:38.286+0000 7f6d628cd640 1 -- 172.21.15.115:0/256715452 >> 172.21.15.115:0/256715452 conn(0x7f6d5c0f9940 msgr2=0x7f6d5c0fbd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:04:38.288 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:38.286+0000 7f6d628cd640 1 -- 172.21.15.115:0/256715452 shutdown_connections 2024-09-13T17:04:38.288 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:38.286+0000 7f6d628cd640 1 -- 172.21.15.115:0/256715452 wait complete. 2024-09-13T17:04:38.289 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:38.287+0000 7f6d628cd640 1 Processor -- start 2024-09-13T17:04:38.289 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:38.287+0000 7f6d628cd640 1 -- start start 2024-09-13T17:04:38.289 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:38.288+0000 7f6d628cd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d5c0fed00 0x7f6d5c195580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:38.289 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:38.288+0000 7f6d628cd640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6d5c0fffc0 0x7f6d5c195ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:38.289 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:38.288+0000 7f6d628cd640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5c196090 con 0x7f6d5c0fed00 2024-09-13T17:04:38.290 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:38.288+0000 7f6d628cd640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5c196200 con 0x7f6d5c0fffc0 2024-09-13T17:04:38.291 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:38.288+0000 7f6d5bfff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d5c0fed00 0x7f6d5c195580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:38.291 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:38.288+0000 7f6d5b7fe640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6d5c0fffc0 0x7f6d5c195ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:38.291 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:38.288+0000 7f6d5bfff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d5c0fed00 0x7f6d5c195580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:33526/0 (socket says 172.21.15.115:33526) 2024-09-13T17:04:38.291 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:38.288+0000 7f6d5bfff640 1 -- 172.21.15.115:0/3941457038 learned_addr learned my addr 172.21.15.115:0/3941457038 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:04:38.291 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:38.289+0000 7f6d5b7fe640 1 -- 172.21.15.115:0/3941457038 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d5c0fed00 msgr2=0x7f6d5c195580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:38.291 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:38.289+0000 7f6d5b7fe640 1 --2- 172.21.15.115:0/3941457038 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d5c0fed00 0x7f6d5c195580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:38.291 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:38.289+0000 7f6d5b7fe640 1 -- 172.21.15.115:0/3941457038 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d50009560 con 0x7f6d5c0fffc0 2024-09-13T17:04:38.291 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:38.289+0000 7f6d5bfff640 1 --2- 172.21.15.115:0/3941457038 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d5c0fed00 0x7f6d5c195580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:04:38.291 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:38.289+0000 7f6d5b7fe640 1 --2- 172.21.15.115:0/3941457038 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6d5c0fffc0 0x7f6d5c195ac0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6d5002a9c0 tx=0x7f6d500054f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:38.291 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:38.290+0000 7f6d597fa640 1 -- 172.21.15.115:0/3941457038 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d50004aa0 con 0x7f6d5c0fffc0 2024-09-13T17:04:38.291 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:38.290+0000 7f6d597fa640 1 -- 172.21.15.115:0/3941457038 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6d50004c00 con 0x7f6d5c0fffc0 2024-09-13T17:04:38.292 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:38.290+0000 7f6d597fa640 1 -- 172.21.15.115:0/3941457038 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d50031950 con 0x7f6d5c0fffc0 2024-09-13T17:04:38.292 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:38.290+0000 7f6d628cd640 1 -- 172.21.15.115:0/3941457038 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d5c19abf0 con 0x7f6d5c0fffc0 2024-09-13T17:04:38.292 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:38.290+0000 7f6d628cd640 1 -- 172.21.15.115:0/3941457038 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d5c19b0a0 con 0x7f6d5c0fffc0 2024-09-13T17:04:38.293 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:38.292+0000 7f6d42ffd640 1 -- 172.21.15.115:0/3941457038 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d5c1085d0 con 0x7f6d5c0fffc0 2024-09-13T17:04:38.294 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:38.293+0000 7f6d597fa640 1 -- 172.21.15.115:0/3941457038 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f6d50003c20 con 0x7f6d5c0fffc0 2024-09-13T17:04:38.294 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:38.293+0000 7f6d597fa640 1 --2- 172.21.15.115:0/3941457038 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f6d4406cca0 0x7f6d4406f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:38.294 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:38.293+0000 7f6d597fa640 1 -- 172.21.15.115:0/3941457038 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f6d500ad540 con 0x7f6d5c0fffc0 2024-09-13T17:04:38.295 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:38.293+0000 7f6d5bfff640 1 --2- 172.21.15.115:0/3941457038 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f6d4406cca0 0x7f6d4406f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:38.295 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:38.294+0000 7f6d5bfff640 1 --2- 172.21.15.115:0/3941457038 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f6d4406cca0 0x7f6d4406f160 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c0104e0 tx=0x7f6d4c00b410 comp rx=0 tx=0).ready entity=mgr.14207 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:38.304 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:38.303+0000 7f6d597fa640 1 -- 172.21.15.115:0/3941457038 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f6d500779c0 con 0x7f6d5c0fffc0 2024-09-13T17:04:38.523 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:38.522+0000 7f6d42ffd640 1 -- 172.21.15.115:0/3941457038 --> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6d5c108810 con 0x7f6d4406cca0 2024-09-13T17:04:38.524 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:04:38 smithi115 ceph-mon[27708]: from='client.14550 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:04:38.524 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:04:38 smithi115 ceph-mon[27708]: from='client.14554 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:04:38.524 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:04:38 smithi115 ceph-mon[27708]: pgmap v218: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-13T17:04:38.524 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:04:38 smithi115 ceph-mon[27708]: from='client.14558 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:04:38.524 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:04:38 smithi115 ceph-mon[27708]: from='client.? 172.21.15.115:0/1256150936' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:04:38.525 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:38.523+0000 7f6d597fa640 1 -- 172.21.15.115:0/3941457038 <== mgr.14207 v2:172.21.15.115:6800/244039928 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7f6d5c108810 con 0x7f6d4406cca0 2024-09-13T17:04:38.525 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-13T17:04:38.525 INFO:teuthology.orchestra.run.smithi115.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256", 2024-09-13T17:04:38.525 INFO:teuthology.orchestra.run.smithi115.stdout: "in_progress": true, 2024-09-13T17:04:38.525 INFO:teuthology.orchestra.run.smithi115.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-13T17:04:38.525 INFO:teuthology.orchestra.run.smithi115.stdout: "services_complete": [], 2024-09-13T17:04:38.525 INFO:teuthology.orchestra.run.smithi115.stdout: "progress": "0/2 daemons upgraded", 2024-09-13T17:04:38.526 INFO:teuthology.orchestra.run.smithi115.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 image on host smithi195", 2024-09-13T17:04:38.526 INFO:teuthology.orchestra.run.smithi115.stdout: "is_paused": false 2024-09-13T17:04:38.526 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-13T17:04:38.527 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:38.526+0000 7f6d42ffd640 1 -- 172.21.15.115:0/3941457038 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f6d4406cca0 msgr2=0x7f6d4406f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:38.527 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:38.526+0000 7f6d42ffd640 1 --2- 172.21.15.115:0/3941457038 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f6d4406cca0 0x7f6d4406f160 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c0104e0 tx=0x7f6d4c00b410 comp rx=0 tx=0).stop 2024-09-13T17:04:38.528 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:38.526+0000 7f6d42ffd640 1 -- 172.21.15.115:0/3941457038 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6d5c0fffc0 msgr2=0x7f6d5c195ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:38.528 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:38.526+0000 7f6d42ffd640 1 --2- 172.21.15.115:0/3941457038 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6d5c0fffc0 0x7f6d5c195ac0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6d5002a9c0 tx=0x7f6d500054f0 comp rx=0 tx=0).stop 2024-09-13T17:04:38.528 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:38.527+0000 7f6d42ffd640 1 -- 172.21.15.115:0/3941457038 shutdown_connections 2024-09-13T17:04:38.528 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:38.527+0000 7f6d42ffd640 1 --2- 172.21.15.115:0/3941457038 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f6d4406cca0 0x7f6d4406f160 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:38.528 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:38.527+0000 7f6d42ffd640 1 --2- 172.21.15.115:0/3941457038 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6d5c0fffc0 0x7f6d5c195ac0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:38.528 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:38.527+0000 7f6d42ffd640 1 --2- 172.21.15.115:0/3941457038 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d5c0fed00 0x7f6d5c195580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:38.529 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:38.527+0000 7f6d42ffd640 1 -- 172.21.15.115:0/3941457038 >> 172.21.15.115:0/3941457038 conn(0x7f6d5c0f9940 msgr2=0x7f6d5c102f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:04:38.529 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:38.527+0000 7f6d42ffd640 1 -- 172.21.15.115:0/3941457038 shutdown_connections 2024-09-13T17:04:38.529 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:04:38.527+0000 7f6d42ffd640 1 -- 172.21.15.115:0/3941457038 wait complete. 2024-09-13T17:04:38.576 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:04:38 smithi195 ceph-mon[34981]: from='client.14550 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:04:38.576 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:04:38 smithi195 ceph-mon[34981]: from='client.14554 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:04:38.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:04:38 smithi195 ceph-mon[34981]: pgmap v218: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-13T17:04:38.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:04:38 smithi195 ceph-mon[34981]: from='client.14558 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:04:38.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:04:38 smithi195 ceph-mon[34981]: from='client.? 172.21.15.115:0/1256150936' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:04:39.576 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:04:39 smithi195 ceph-mon[34981]: from='client.24313 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:04:39.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:04:39 smithi115 ceph-mon[27708]: from='client.24313 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:04:40.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:04:40 smithi195 ceph-mon[34981]: pgmap v219: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 597 B/s wr, 3 op/s 2024-09-13T17:04:40.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:04:40 smithi115 ceph-mon[27708]: pgmap v219: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 597 B/s wr, 3 op/s 2024-09-13T17:04:42.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:04:42 smithi195 ceph-mon[34981]: pgmap v220: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1023 B/s rd, 341 B/s wr, 2 op/s 2024-09-13T17:04:42.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:04:42 smithi115 ceph-mon[27708]: pgmap v220: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1023 B/s rd, 341 B/s wr, 2 op/s 2024-09-13T17:04:44.576 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:04:44 smithi195 ceph-mon[34981]: pgmap v221: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1023 B/s rd, 341 B/s wr, 2 op/s 2024-09-13T17:04:44.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:04:44 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:04:44.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:04:44 smithi115 ceph-mon[27708]: pgmap v221: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1023 B/s rd, 341 B/s wr, 2 op/s 2024-09-13T17:04:44.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:04:44 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:04:46.576 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:04:46 smithi195 ceph-mon[34981]: pgmap v222: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-13T17:04:46.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:04:46 smithi115 ceph-mon[27708]: pgmap v222: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-13T17:04:48.326 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:04:48 smithi195 ceph-mon[34981]: pgmap v223: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-09-13T17:04:48.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:04:48 smithi115 ceph-mon[27708]: pgmap v223: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-09-13T17:04:50.576 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:04:50 smithi195 ceph-mon[34981]: pgmap v224: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-13T17:04:50.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:04:50 smithi115 ceph-mon[27708]: pgmap v224: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-13T17:04:52.576 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:04:52 smithi195 ceph-mon[34981]: pgmap v225: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:04:52.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:04:52 smithi115 ceph-mon[27708]: pgmap v225: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:04:54.576 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:04:54 smithi195 ceph-mon[34981]: pgmap v226: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:04:54.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:04:54 smithi115 ceph-mon[27708]: pgmap v226: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:04:56.576 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:04:56 smithi195 ceph-mon[34981]: pgmap v227: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:04:56.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:04:56 smithi115 ceph-mon[27708]: pgmap v227: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:04:58.576 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:04:58 smithi195 ceph-mon[34981]: pgmap v228: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:04:58.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:04:58 smithi115 ceph-mon[27708]: pgmap v228: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:04:59.374 INFO:tasks.workunit.client.0.smithi115.stderr:Note: switching to '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'. 2024-09-13T17:04:59.374 INFO:tasks.workunit.client.0.smithi115.stderr: 2024-09-13T17:04:59.374 INFO:tasks.workunit.client.0.smithi115.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-13T17:04:59.374 INFO:tasks.workunit.client.0.smithi115.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-13T17:04:59.375 INFO:tasks.workunit.client.0.smithi115.stderr:state without impacting any branches by switching back to a branch. 2024-09-13T17:04:59.375 INFO:tasks.workunit.client.0.smithi115.stderr: 2024-09-13T17:04:59.375 INFO:tasks.workunit.client.0.smithi115.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-13T17:04:59.375 INFO:tasks.workunit.client.0.smithi115.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-13T17:04:59.375 INFO:tasks.workunit.client.0.smithi115.stderr: 2024-09-13T17:04:59.375 INFO:tasks.workunit.client.0.smithi115.stderr: git switch -c 2024-09-13T17:04:59.375 INFO:tasks.workunit.client.0.smithi115.stderr: 2024-09-13T17:04:59.375 INFO:tasks.workunit.client.0.smithi115.stderr:Or undo this operation with: 2024-09-13T17:04:59.375 INFO:tasks.workunit.client.0.smithi115.stderr: 2024-09-13T17:04:59.375 INFO:tasks.workunit.client.0.smithi115.stderr: git switch - 2024-09-13T17:04:59.375 INFO:tasks.workunit.client.0.smithi115.stderr: 2024-09-13T17:04:59.375 INFO:tasks.workunit.client.0.smithi115.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-13T17:04:59.375 INFO:tasks.workunit.client.0.smithi115.stderr: 2024-09-13T17:04:59.376 INFO:tasks.workunit.client.0.smithi115.stderr:HEAD is now at 6c6b083f148 Merge PR #56690 into wip-rishabh-testing-20240910.100730-reef 2024-09-13T17:04:59.381 DEBUG:teuthology.orchestra.run.smithi115:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-13T17:04:59.421 INFO:tasks.workunit.client.0.smithi115.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-13T17:04:59.423 INFO:tasks.workunit.client.0.smithi115.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-13T17:04:59.423 INFO:tasks.workunit.client.0.smithi115.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-13T17:04:59.428 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:04:59 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:04:59.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:04:59 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:05:00.084 INFO:tasks.workunit.client.0.smithi115.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-13T17:05:00.149 INFO:tasks.workunit.client.0.smithi115.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-13T17:05:00.190 INFO:tasks.workunit.client.0.smithi115.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-13T17:05:00.191 INFO:tasks.workunit.client.0.smithi115.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-13T17:05:00.192 INFO:tasks.workunit.client.0.smithi115.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-13T17:05:00.230 INFO:tasks.workunit.client.0.smithi115.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-13T17:05:00.233 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-13T17:05:00.234 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-13T17:05:00.291 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-09-13T17:05:00.292 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-13T17:05:00.292 DEBUG:teuthology.orchestra.run.smithi115:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-09-13T17:05:00.351 INFO:tasks.workunit.client.0.smithi115.stderr:+ mkdir -p fsstress 2024-09-13T17:05:00.353 INFO:tasks.workunit.client.0.smithi115.stderr:+ pushd fsstress 2024-09-13T17:05:00.353 INFO:tasks.workunit.client.0.smithi115.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-13T17:05:00.353 INFO:tasks.workunit.client.0.smithi115.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-13T17:05:00.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:00 smithi115 ceph-mon[27708]: pgmap v229: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:05:00.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:00 smithi195 ceph-mon[34981]: pgmap v229: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:05:01.460 INFO:tasks.workunit.client.0.smithi115.stderr:+ tar xzf ltp-full.tgz 2024-09-13T17:05:02.576 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:02 smithi195 ceph-mon[34981]: pgmap v230: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:05:02.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:02 smithi115 ceph-mon[27708]: pgmap v230: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:05:02.963 INFO:tasks.workunit.client.1.smithi195.stderr:Updating files: 93% (11862/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-13T17:05:03.928 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:03 smithi115 ceph-mon[27708]: Upgrade: Updating mgr.smithi195.hjjifz 2024-09-13T17:05:03.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:03 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:05:03.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:03 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi195.hjjifz", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T17:05:03.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:03 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T17:05:03.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:03 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:05:03.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:03 smithi115 ceph-mon[27708]: Deploying daemon mgr.smithi195.hjjifz on smithi195 2024-09-13T17:05:03.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:03 smithi115 ceph-mon[27708]: pgmap v231: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-09-13T17:05:04.033 INFO:tasks.workunit.client.1.smithi195.stderr:Note: switching to '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'. 2024-09-13T17:05:04.033 INFO:tasks.workunit.client.1.smithi195.stderr: 2024-09-13T17:05:04.033 INFO:tasks.workunit.client.1.smithi195.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-13T17:05:04.033 INFO:tasks.workunit.client.1.smithi195.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-13T17:05:04.033 INFO:tasks.workunit.client.1.smithi195.stderr:state without impacting any branches by switching back to a branch. 2024-09-13T17:05:04.033 INFO:tasks.workunit.client.1.smithi195.stderr: 2024-09-13T17:05:04.034 INFO:tasks.workunit.client.1.smithi195.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-13T17:05:04.034 INFO:tasks.workunit.client.1.smithi195.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-13T17:05:04.034 INFO:tasks.workunit.client.1.smithi195.stderr: 2024-09-13T17:05:04.034 INFO:tasks.workunit.client.1.smithi195.stderr: git switch -c 2024-09-13T17:05:04.034 INFO:tasks.workunit.client.1.smithi195.stderr: 2024-09-13T17:05:04.034 INFO:tasks.workunit.client.1.smithi195.stderr:Or undo this operation with: 2024-09-13T17:05:04.034 INFO:tasks.workunit.client.1.smithi195.stderr: 2024-09-13T17:05:04.034 INFO:tasks.workunit.client.1.smithi195.stderr: git switch - 2024-09-13T17:05:04.034 INFO:tasks.workunit.client.1.smithi195.stderr: 2024-09-13T17:05:04.034 INFO:tasks.workunit.client.1.smithi195.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-13T17:05:04.034 INFO:tasks.workunit.client.1.smithi195.stderr: 2024-09-13T17:05:04.034 INFO:tasks.workunit.client.1.smithi195.stderr:HEAD is now at 6c6b083f148 Merge PR #56690 into wip-rishabh-testing-20240910.100730-reef 2024-09-13T17:05:04.038 DEBUG:teuthology.orchestra.run.smithi195:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-09-13T17:05:04.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:03 smithi195 ceph-mon[34981]: Upgrade: Updating mgr.smithi195.hjjifz 2024-09-13T17:05:04.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:03 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:05:04.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:03 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi195.hjjifz", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T17:05:04.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:03 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T17:05:04.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:03 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:05:04.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:03 smithi195 ceph-mon[34981]: Deploying daemon mgr.smithi195.hjjifz on smithi195 2024-09-13T17:05:04.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:03 smithi195 ceph-mon[34981]: pgmap v231: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-09-13T17:05:04.147 INFO:tasks.workunit.client.1.smithi195.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-13T17:05:04.149 INFO:tasks.workunit.client.1.smithi195.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-13T17:05:04.149 INFO:tasks.workunit.client.1.smithi195.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-13T17:05:05.409 INFO:tasks.workunit.client.1.smithi195.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-13T17:05:05.533 INFO:tasks.workunit.client.1.smithi195.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-13T17:05:05.573 INFO:tasks.workunit.client.1.smithi195.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-13T17:05:05.575 INFO:tasks.workunit.client.1.smithi195.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-13T17:05:05.575 INFO:tasks.workunit.client.1.smithi195.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-13T17:05:05.631 INFO:tasks.workunit.client.1.smithi195.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-13T17:05:05.634 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-09-13T17:05:05.634 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-09-13T17:05:05.650 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2024-09-13T17:05:05.651 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-13T17:05:05.651 DEBUG:teuthology.orchestra.run.smithi195:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2024-09-13T17:05:05.732 INFO:tasks.workunit.client.1.smithi195.stderr:+ mkdir -p fsstress 2024-09-13T17:05:05.737 INFO:tasks.workunit.client.1.smithi195.stderr:+ pushd fsstress 2024-09-13T17:05:05.738 INFO:tasks.workunit.client.1.smithi195.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-13T17:05:05.738 INFO:tasks.workunit.client.1.smithi195.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-13T17:05:06.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:06 smithi195 ceph-mon[34981]: pgmap v232: 65 pgs: 65 active+clean; 5.1 MiB data, 189 MiB used, 536 GiB / 536 GiB avail; 342 KiB/s rd, 383 KiB/s wr, 3 op/s 2024-09-13T17:05:06.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:06 smithi115 ceph-mon[27708]: pgmap v232: 65 pgs: 65 active+clean; 5.1 MiB data, 189 MiB used, 536 GiB / 536 GiB avail; 342 KiB/s rd, 383 KiB/s wr, 3 op/s 2024-09-13T17:05:07.441 INFO:tasks.workunit.client.1.smithi195.stderr:+ tar xzf ltp-full.tgz 2024-09-13T17:05:08.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:08 smithi195 ceph-mon[34981]: pgmap v233: 65 pgs: 65 active+clean; 9.8 MiB data, 219 MiB used, 536 GiB / 536 GiB avail; 342 KiB/s rd, 820 KiB/s wr, 70 op/s 2024-09-13T17:05:08.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:08 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:05:08.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:08 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:05:08.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:08 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:05:08.631 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:08.629+0000 7f9a33bfa640 1 -- 172.21.15.115:0/786022077 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a2c0ffc30 msgr2=0x7f9a2c1000b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:05:08.631 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:08.629+0000 7f9a33bfa640 1 --2- 172.21.15.115:0/786022077 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a2c0ffc30 0x7f9a2c1000b0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c009880 tx=0x7f9a1c02a4a0 comp rx=0 tx=0).stop 2024-09-13T17:05:08.631 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:08.629+0000 7f9a33bfa640 1 -- 172.21.15.115:0/786022077 shutdown_connections 2024-09-13T17:05:08.631 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:08.629+0000 7f9a33bfa640 1 --2- 172.21.15.115:0/786022077 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a2c0ffc30 0x7f9a2c1000b0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:08.631 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:08.629+0000 7f9a33bfa640 1 --2- 172.21.15.115:0/786022077 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9a2c0fea30 0x7f9a2c0fee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:08.631 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:08.629+0000 7f9a33bfa640 1 -- 172.21.15.115:0/786022077 >> 172.21.15.115:0/786022077 conn(0x7f9a2c0fa1c0 msgr2=0x7f9a2c0fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:05:08.632 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:08.629+0000 7f9a33bfa640 1 -- 172.21.15.115:0/786022077 shutdown_connections 2024-09-13T17:05:08.632 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:08.629+0000 7f9a33bfa640 1 -- 172.21.15.115:0/786022077 wait complete. 2024-09-13T17:05:08.632 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:08 smithi115 ceph-mon[27708]: pgmap v233: 65 pgs: 65 active+clean; 9.8 MiB data, 219 MiB used, 536 GiB / 536 GiB avail; 342 KiB/s rd, 820 KiB/s wr, 70 op/s 2024-09-13T17:05:08.632 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:08 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:05:08.632 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:08 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:05:08.632 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:08 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:05:08.634 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:08.630+0000 7f9a33bfa640 1 Processor -- start 2024-09-13T17:05:08.634 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:08.630+0000 7f9a33bfa640 1 -- start start 2024-09-13T17:05:08.634 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:08.630+0000 7f9a33bfa640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a2c0fea30 0x7f9a2c1029c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:05:08.634 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:08.630+0000 7f9a33bfa640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9a2c0ffc30 0x7f9a2c101010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:05:08.634 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:08.630+0000 7f9a33bfa640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2c101550 con 0x7f9a2c0fea30 2024-09-13T17:05:08.634 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:08.630+0000 7f9a33bfa640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2c1016c0 con 0x7f9a2c0ffc30 2024-09-13T17:05:08.634 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:08.630+0000 7f9a31996640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a2c0fea30 0x7f9a2c1029c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:05:08.634 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:08.630+0000 7f9a31996640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a2c0fea30 0x7f9a2c1029c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:41942/0 (socket says 172.21.15.115:41942) 2024-09-13T17:05:08.635 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:08.630+0000 7f9a31996640 1 -- 172.21.15.115:0/1835001227 learned_addr learned my addr 172.21.15.115:0/1835001227 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:05:08.635 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:08.630+0000 7f9a31195640 1 --2- 172.21.15.115:0/1835001227 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9a2c0ffc30 0x7f9a2c101010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:05:08.635 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:08.631+0000 7f9a31996640 1 -- 172.21.15.115:0/1835001227 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9a2c0ffc30 msgr2=0x7f9a2c101010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:05:08.635 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:08.631+0000 7f9a31996640 1 --2- 172.21.15.115:0/1835001227 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9a2c0ffc30 0x7f9a2c101010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:08.635 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:08.631+0000 7f9a31996640 1 -- 172.21.15.115:0/1835001227 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a1c009560 con 0x7f9a2c0fea30 2024-09-13T17:05:08.635 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:08.631+0000 7f9a31996640 1 --2- 172.21.15.115:0/1835001227 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a2c0fea30 0x7f9a2c1029c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f9a2800d8d0 tx=0x7f9a2800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:05:08.635 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:08.631+0000 7f9a22ffd640 1 -- 172.21.15.115:0/1835001227 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a2800bea0 con 0x7f9a2c0fea30 2024-09-13T17:05:08.635 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:08.631+0000 7f9a22ffd640 1 -- 172.21.15.115:0/1835001227 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9a28009c00 con 0x7f9a2c0fea30 2024-09-13T17:05:08.635 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:08.631+0000 7f9a22ffd640 1 -- 172.21.15.115:0/1835001227 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a2800f710 con 0x7f9a2c0fea30 2024-09-13T17:05:08.635 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:08.631+0000 7f9a33bfa640 1 -- 172.21.15.115:0/1835001227 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a2c1019a0 con 0x7f9a2c0fea30 2024-09-13T17:05:08.635 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:08.631+0000 7f9a33bfa640 1 -- 172.21.15.115:0/1835001227 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a2c19d5a0 con 0x7f9a2c0fea30 2024-09-13T17:05:08.635 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:08.632+0000 7f9a33bfa640 1 -- 172.21.15.115:0/1835001227 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a2c0fee30 con 0x7f9a2c0fea30 2024-09-13T17:05:08.635 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:08.633+0000 7f9a22ffd640 1 -- 172.21.15.115:0/1835001227 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f9a28010460 con 0x7f9a2c0fea30 2024-09-13T17:05:08.636 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:08.634+0000 7f9a22ffd640 1 --2- 172.21.15.115:0/1835001227 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f9a1806cc50 0x7f9a1806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:05:08.636 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:08.634+0000 7f9a22ffd640 1 -- 172.21.15.115:0/1835001227 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f9a2808c240 con 0x7f9a2c0fea30 2024-09-13T17:05:08.636 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:08.634+0000 7f9a31195640 1 --2- 172.21.15.115:0/1835001227 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f9a1806cc50 0x7f9a1806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:05:08.636 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:08.634+0000 7f9a31195640 1 --2- 172.21.15.115:0/1835001227 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f9a1806cc50 0x7f9a1806f110 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c102740 tx=0x7f9a1c031400 comp rx=0 tx=0).ready entity=mgr.14207 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:05:08.639 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:08.638+0000 7f9a22ffd640 1 -- 172.21.15.115:0/1835001227 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f9a280565b0 con 0x7f9a2c0fea30 2024-09-13T17:05:08.948 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:08.947+0000 7f9a33bfa640 1 -- 172.21.15.115:0/1835001227 --> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9a2c0682f0 con 0x7f9a1806cc50 2024-09-13T17:05:08.949 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:08.948+0000 7f9a22ffd640 1 -- 172.21.15.115:0/1835001227 <== mgr.14207 v2:172.21.15.115:6800/244039928 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+321 (secure 0 0 0) 0x7f9a2c0682f0 con 0x7f9a1806cc50 2024-09-13T17:05:08.951 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:08.950+0000 7f9a33bfa640 1 -- 172.21.15.115:0/1835001227 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f9a1806cc50 msgr2=0x7f9a1806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:05:08.952 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:08.950+0000 7f9a33bfa640 1 --2- 172.21.15.115:0/1835001227 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f9a1806cc50 0x7f9a1806f110 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c102740 tx=0x7f9a1c031400 comp rx=0 tx=0).stop 2024-09-13T17:05:08.952 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:08.950+0000 7f9a33bfa640 1 -- 172.21.15.115:0/1835001227 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a2c0fea30 msgr2=0x7f9a2c1029c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:05:08.952 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:08.950+0000 7f9a33bfa640 1 --2- 172.21.15.115:0/1835001227 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a2c0fea30 0x7f9a2c1029c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f9a2800d8d0 tx=0x7f9a2800dd90 comp rx=0 tx=0).stop 2024-09-13T17:05:08.952 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:08.950+0000 7f9a33bfa640 1 -- 172.21.15.115:0/1835001227 shutdown_connections 2024-09-13T17:05:08.952 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:08.950+0000 7f9a33bfa640 1 --2- 172.21.15.115:0/1835001227 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f9a1806cc50 0x7f9a1806f110 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:08.952 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:08.950+0000 7f9a33bfa640 1 --2- 172.21.15.115:0/1835001227 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9a2c0ffc30 0x7f9a2c101010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:08.952 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:08.950+0000 7f9a33bfa640 1 --2- 172.21.15.115:0/1835001227 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a2c0fea30 0x7f9a2c1029c0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:08.952 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:08.950+0000 7f9a33bfa640 1 -- 172.21.15.115:0/1835001227 >> 172.21.15.115:0/1835001227 conn(0x7f9a2c0fa1c0 msgr2=0x7f9a2c067be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:05:08.952 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:08.950+0000 7f9a33bfa640 1 -- 172.21.15.115:0/1835001227 shutdown_connections 2024-09-13T17:05:08.952 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:08.950+0000 7f9a33bfa640 1 -- 172.21.15.115:0/1835001227 wait complete. 2024-09-13T17:05:08.960 INFO:teuthology.orchestra.run.smithi115.stdout:true 2024-09-13T17:05:09.042 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.037+0000 7fc805a5a640 1 -- 172.21.15.115:0/3009057813 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc8000ffc30 msgr2=0x7fc8001000b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:05:09.042 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.037+0000 7fc805a5a640 1 --2- 172.21.15.115:0/3009057813 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc8000ffc30 0x7fc8001000b0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fc7e8009880 tx=0x7fc7e802a4a0 comp rx=0 tx=0).stop 2024-09-13T17:05:09.042 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.037+0000 7fc805a5a640 1 -- 172.21.15.115:0/3009057813 shutdown_connections 2024-09-13T17:05:09.042 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.037+0000 7fc805a5a640 1 --2- 172.21.15.115:0/3009057813 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc8000ffc30 0x7fc8001000b0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:09.042 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.037+0000 7fc805a5a640 1 --2- 172.21.15.115:0/3009057813 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc8000fea30 0x7fc8000fee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:09.042 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.037+0000 7fc805a5a640 1 -- 172.21.15.115:0/3009057813 >> 172.21.15.115:0/3009057813 conn(0x7fc8000fa1c0 msgr2=0x7fc8000fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:05:09.043 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.037+0000 7fc805a5a640 1 -- 172.21.15.115:0/3009057813 shutdown_connections 2024-09-13T17:05:09.043 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.037+0000 7fc805a5a640 1 -- 172.21.15.115:0/3009057813 wait complete. 2024-09-13T17:05:09.043 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.038+0000 7fc805a5a640 1 Processor -- start 2024-09-13T17:05:09.043 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.038+0000 7fc805a5a640 1 -- start start 2024-09-13T17:05:09.043 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.038+0000 7fc805a5a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc8000fea30 0x7fc8000686f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:05:09.043 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.038+0000 7fc805a5a640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc8000ffc30 0x7fc80019c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:05:09.043 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.039+0000 7fc805a5a640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8001960d0 con 0x7fc8000fea30 2024-09-13T17:05:09.043 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.039+0000 7fc805a5a640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc80019cc30 con 0x7fc8000ffc30 2024-09-13T17:05:09.043 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.039+0000 7fc7feffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc8000fea30 0x7fc8000686f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:05:09.043 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.039+0000 7fc7feffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc8000fea30 0x7fc8000686f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:41948/0 (socket says 172.21.15.115:41948) 2024-09-13T17:05:09.043 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.039+0000 7fc7feffd640 1 -- 172.21.15.115:0/1108408735 learned_addr learned my addr 172.21.15.115:0/1108408735 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:05:09.043 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.039+0000 7fc7f7fff640 1 --2- 172.21.15.115:0/1108408735 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc8000ffc30 0x7fc80019c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:05:09.043 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.039+0000 7fc7feffd640 1 -- 172.21.15.115:0/1108408735 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc8000ffc30 msgr2=0x7fc80019c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:05:09.044 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.039+0000 7fc7feffd640 1 --2- 172.21.15.115:0/1108408735 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc8000ffc30 0x7fc80019c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:09.044 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.039+0000 7fc7feffd640 1 -- 172.21.15.115:0/1108408735 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7e8009560 con 0x7fc8000fea30 2024-09-13T17:05:09.044 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.039+0000 7fc7feffd640 1 --2- 172.21.15.115:0/1108408735 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc8000fea30 0x7fc8000686f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc7f000e970 tx=0x7fc7f000ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:05:09.044 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.039+0000 7fc804a58640 1 -- 172.21.15.115:0/1108408735 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc7f0009700 con 0x7fc8000fea30 2024-09-13T17:05:09.044 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.039+0000 7fc805a5a640 1 -- 172.21.15.115:0/1108408735 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc80019ce90 con 0x7fc8000fea30 2024-09-13T17:05:09.044 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.039+0000 7fc804a58640 1 -- 172.21.15.115:0/1108408735 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc7f00044c0 con 0x7fc8000fea30 2024-09-13T17:05:09.044 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.039+0000 7fc804a58640 1 -- 172.21.15.115:0/1108408735 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc7f0003ea0 con 0x7fc8000fea30 2024-09-13T17:05:09.044 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.040+0000 7fc805a5a640 1 -- 172.21.15.115:0/1108408735 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc80019d3d0 con 0x7fc8000fea30 2024-09-13T17:05:09.044 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.041+0000 7fc805a5a640 1 -- 172.21.15.115:0/1108408735 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8000fee30 con 0x7fc8000fea30 2024-09-13T17:05:09.045 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.041+0000 7fc804a58640 1 -- 172.21.15.115:0/1108408735 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fc7f000cc90 con 0x7fc8000fea30 2024-09-13T17:05:09.045 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.042+0000 7fc804a58640 1 --2- 172.21.15.115:0/1108408735 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fc7ec06cc50 0x7fc7ec06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:05:09.045 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.042+0000 7fc804a58640 1 -- 172.21.15.115:0/1108408735 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fc7f0014070 con 0x7fc8000fea30 2024-09-13T17:05:09.045 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.042+0000 7fc7f7fff640 1 --2- 172.21.15.115:0/1108408735 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fc7ec06cc50 0x7fc7ec06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:05:09.045 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.043+0000 7fc7f7fff640 1 --2- 172.21.15.115:0/1108408735 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fc7ec06cc50 0x7fc7ec06f110 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc800068470 tx=0x7fc7e8031400 comp rx=0 tx=0).ready entity=mgr.14207 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:05:09.049 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.048+0000 7fc804a58640 1 -- 172.21.15.115:0/1108408735 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc7f0056b20 con 0x7fc8000fea30 2024-09-13T17:05:09.277 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.275+0000 7fc805a5a640 1 -- 172.21.15.115:0/1108408735 --> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc800104580 con 0x7fc7ec06cc50 2024-09-13T17:05:09.278 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.277+0000 7fc804a58640 1 -- 172.21.15.115:0/1108408735 <== mgr.14207 v2:172.21.15.115:6800/244039928 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+321 (secure 0 0 0) 0x7fc800104580 con 0x7fc7ec06cc50 2024-09-13T17:05:09.280 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.279+0000 7fc805a5a640 1 -- 172.21.15.115:0/1108408735 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fc7ec06cc50 msgr2=0x7fc7ec06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:05:09.281 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.279+0000 7fc805a5a640 1 --2- 172.21.15.115:0/1108408735 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fc7ec06cc50 0x7fc7ec06f110 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc800068470 tx=0x7fc7e8031400 comp rx=0 tx=0).stop 2024-09-13T17:05:09.281 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.279+0000 7fc805a5a640 1 -- 172.21.15.115:0/1108408735 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc8000fea30 msgr2=0x7fc8000686f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:05:09.281 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.279+0000 7fc805a5a640 1 --2- 172.21.15.115:0/1108408735 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc8000fea30 0x7fc8000686f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc7f000e970 tx=0x7fc7f000ee30 comp rx=0 tx=0).stop 2024-09-13T17:05:09.281 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.279+0000 7fc805a5a640 1 -- 172.21.15.115:0/1108408735 shutdown_connections 2024-09-13T17:05:09.281 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.279+0000 7fc805a5a640 1 --2- 172.21.15.115:0/1108408735 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fc7ec06cc50 0x7fc7ec06f110 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:09.281 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.279+0000 7fc805a5a640 1 --2- 172.21.15.115:0/1108408735 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc8000ffc30 0x7fc80019c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:09.281 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.279+0000 7fc805a5a640 1 --2- 172.21.15.115:0/1108408735 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc8000fea30 0x7fc8000686f0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:09.281 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.279+0000 7fc805a5a640 1 -- 172.21.15.115:0/1108408735 >> 172.21.15.115:0/1108408735 conn(0x7fc8000fa1c0 msgr2=0x7fc800102e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:05:09.281 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.279+0000 7fc805a5a640 1 -- 172.21.15.115:0/1108408735 shutdown_connections 2024-09-13T17:05:09.281 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.279+0000 7fc805a5a640 1 -- 172.21.15.115:0/1108408735 wait complete. 2024-09-13T17:05:09.379 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.375+0000 7f961b507640 1 -- 172.21.15.115:0/2573608254 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f96141005c0 msgr2=0x7f96141029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:05:09.379 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.375+0000 7f961b507640 1 --2- 172.21.15.115:0/2573608254 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f96141005c0 0x7f96141029b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f96100098b0 tx=0x7f961002a4d0 comp rx=0 tx=0).stop 2024-09-13T17:05:09.379 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.375+0000 7f961b507640 1 -- 172.21.15.115:0/2573608254 shutdown_connections 2024-09-13T17:05:09.379 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.375+0000 7f961b507640 1 --2- 172.21.15.115:0/2573608254 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9614102ef0 0x7f96141052e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:09.379 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.375+0000 7f961b507640 1 --2- 172.21.15.115:0/2573608254 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f96141005c0 0x7f96141029b0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:09.379 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.375+0000 7f961b507640 1 -- 172.21.15.115:0/2573608254 >> 172.21.15.115:0/2573608254 conn(0x7f96140fa1c0 msgr2=0x7f96140fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:05:09.380 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.375+0000 7f961b507640 1 -- 172.21.15.115:0/2573608254 shutdown_connections 2024-09-13T17:05:09.380 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.375+0000 7f961b507640 1 -- 172.21.15.115:0/2573608254 wait complete. 2024-09-13T17:05:09.380 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.376+0000 7f961b507640 1 Processor -- start 2024-09-13T17:05:09.380 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.376+0000 7f961b507640 1 -- start start 2024-09-13T17:05:09.380 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.376+0000 7f961b507640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f96141005c0 0x7f96141955d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:05:09.380 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.376+0000 7f961b507640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9614102ef0 0x7f9614195b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:05:09.380 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.376+0000 7f961b507640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96141960e0 con 0x7f9614102ef0 2024-09-13T17:05:09.380 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.376+0000 7f961b507640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9614196250 con 0x7f96141005c0 2024-09-13T17:05:09.380 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.376+0000 7f9618aa2640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9614102ef0 0x7f9614195b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:05:09.380 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.376+0000 7f9618aa2640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9614102ef0 0x7f9614195b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:41972/0 (socket says 172.21.15.115:41972) 2024-09-13T17:05:09.380 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.376+0000 7f9618aa2640 1 -- 172.21.15.115:0/142667217 learned_addr learned my addr 172.21.15.115:0/142667217 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:05:09.380 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.376+0000 7f96192a3640 1 --2- 172.21.15.115:0/142667217 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f96141005c0 0x7f96141955d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:05:09.380 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.376+0000 7f9618aa2640 1 -- 172.21.15.115:0/142667217 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f96141005c0 msgr2=0x7f96141955d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:05:09.381 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.376+0000 7f9618aa2640 1 --2- 172.21.15.115:0/142667217 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f96141005c0 0x7f96141955d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:09.381 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.376+0000 7f9618aa2640 1 -- 172.21.15.115:0/142667217 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9610009560 con 0x7f9614102ef0 2024-09-13T17:05:09.381 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.377+0000 7f9618aa2640 1 --2- 172.21.15.115:0/142667217 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9614102ef0 0x7f9614195b10 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f960400e9a0 tx=0x7f960400ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:05:09.381 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.377+0000 7f960a7fc640 1 -- 172.21.15.115:0/142667217 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f960400cc90 con 0x7f9614102ef0 2024-09-13T17:05:09.381 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.377+0000 7f961b507640 1 -- 172.21.15.115:0/142667217 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f961419acf0 con 0x7f9614102ef0 2024-09-13T17:05:09.381 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.377+0000 7f960a7fc640 1 -- 172.21.15.115:0/142667217 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f960400cdf0 con 0x7f9614102ef0 2024-09-13T17:05:09.381 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.377+0000 7f960a7fc640 1 -- 172.21.15.115:0/142667217 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9604010430 con 0x7f9614102ef0 2024-09-13T17:05:09.381 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.377+0000 7f961b507640 1 -- 172.21.15.115:0/142667217 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f961419b2c0 con 0x7f9614102ef0 2024-09-13T17:05:09.382 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.378+0000 7f961b507640 1 -- 172.21.15.115:0/142667217 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9614108630 con 0x7f9614102ef0 2024-09-13T17:05:09.382 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.379+0000 7f960a7fc640 1 -- 172.21.15.115:0/142667217 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f96040046c0 con 0x7f9614102ef0 2024-09-13T17:05:09.382 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.379+0000 7f960a7fc640 1 --2- 172.21.15.115:0/142667217 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f960006cc50 0x7f960006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:05:09.382 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.380+0000 7f960a7fc640 1 -- 172.21.15.115:0/142667217 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f9604014070 con 0x7f9614102ef0 2024-09-13T17:05:09.382 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.380+0000 7f96192a3640 1 --2- 172.21.15.115:0/142667217 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f960006cc50 0x7f960006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:05:09.382 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.380+0000 7f96192a3640 1 --2- 172.21.15.115:0/142667217 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f960006cc50 0x7f960006f110 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9610000c00 tx=0x7f9610031400 comp rx=0 tx=0).ready entity=mgr.14207 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:05:09.387 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.386+0000 7f960a7fc640 1 -- 172.21.15.115:0/142667217 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f9604056a00 con 0x7f9614102ef0 2024-09-13T17:05:09.635 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.634+0000 7f961b507640 1 -- 172.21.15.115:0/142667217 --> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9614103990 con 0x7f960006cc50 2024-09-13T17:05:09.646 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.645+0000 7f960a7fc640 1 -- 172.21.15.115:0/142667217 <== mgr.14207 v2:172.21.15.115:6800/244039928 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f9614103990 con 0x7f960006cc50 2024-09-13T17:05:09.646 INFO:teuthology.orchestra.run.smithi115.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T17:05:09.646 INFO:teuthology.orchestra.run.smithi115.stdout:alertmanager.smithi115 smithi115 *:9093,9094 running (5m) 83s ago 7m 25.5M - 0.25.0 c8568f914cd2 cbe091cee151 2024-09-13T17:05:09.646 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-exporter.smithi115 smithi115 running (7m) 83s ago 7m 7566k - 18.2.4-843-g2c01458a c129f5a2fd4e 0f1eebeaf9bb 2024-09-13T17:05:09.646 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-exporter.smithi195 smithi195 running (6m) 90s ago 6m 7247k - 18.2.4-843-g2c01458a c129f5a2fd4e 6d05bafbac8a 2024-09-13T17:05:09.646 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi115 smithi115 running (7m) 83s ago 7m 6899k - 18.2.4-843-g2c01458a c129f5a2fd4e 624a903fec23 2024-09-13T17:05:09.646 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi195 smithi195 running (6m) 90s ago 6m 6891k - 18.2.4-843-g2c01458a c129f5a2fd4e 42e6ce26130d 2024-09-13T17:05:09.646 INFO:teuthology.orchestra.run.smithi115.stdout:grafana.smithi115 smithi115 *:3000 running (5m) 83s ago 6m 85.1M - 9.4.7 954c08fa6188 41183f0705c8 2024-09-13T17:05:09.647 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi115.hbtxod smithi115 running (110s) 83s ago 109s 13.4M - 18.2.4-843-g2c01458a c129f5a2fd4e 12b4f4874491 2024-09-13T17:05:09.647 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi115.ijznvr smithi115 running (104s) 83s ago 103s 16.8M - 18.2.4-843-g2c01458a c129f5a2fd4e 2d552564a9f4 2024-09-13T17:05:09.647 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi195.aevvgz smithi195 running (101s) 90s ago 101s 13.5M - 18.2.4-843-g2c01458a c129f5a2fd4e 299b9ad657c9 2024-09-13T17:05:09.647 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi195.qzghxj smithi195 running (107s) 90s ago 107s 11.7M - 18.2.4-843-g2c01458a c129f5a2fd4e fb16b16181ff 2024-09-13T17:05:09.647 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi115.hetcni smithi115 *:9283,8765,8443 running (8m) 83s ago 8m 486M - 18.2.4-843-g2c01458a c129f5a2fd4e f2f0af4ec38c 2024-09-13T17:05:09.647 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi195.hjjifz smithi195 *:8443,9283,8765 starting - - - - 2024-09-13T17:05:09.647 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi115 smithi115 running (8m) 83s ago 8m 46.1M 2048M 18.2.4-843-g2c01458a c129f5a2fd4e 202375d41e68 2024-09-13T17:05:09.647 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi195 smithi195 running (6m) 90s ago 6m 34.2M 2048M 18.2.4-843-g2c01458a c129f5a2fd4e 0f54c30e5970 2024-09-13T17:05:09.647 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi115 smithi115 *:9100 running (7m) 83s ago 7m 15.9M - 1.5.0 0da6a335fe13 9074300dbe31 2024-09-13T17:05:09.647 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi195 smithi195 *:9100 running (6m) 90s ago 6m 15.5M - 1.5.0 0da6a335fe13 d7b54e5d8c97 2024-09-13T17:05:09.647 INFO:teuthology.orchestra.run.smithi115.stdout:osd.0 smithi115 running (5m) 83s ago 5m 49.0M 3946M 18.2.4-843-g2c01458a c129f5a2fd4e 8a8ad231962e 2024-09-13T17:05:09.647 INFO:teuthology.orchestra.run.smithi115.stdout:osd.1 smithi115 running (5m) 83s ago 4m 49.2M 3946M 18.2.4-843-g2c01458a c129f5a2fd4e 3fbc020102a0 2024-09-13T17:05:09.648 INFO:teuthology.orchestra.run.smithi115.stdout:osd.2 smithi115 running (4m) 83s ago 4m 53.9M 3946M 18.2.4-843-g2c01458a c129f5a2fd4e 7c623823e920 2024-09-13T17:05:09.648 INFO:teuthology.orchestra.run.smithi115.stdout:osd.3 smithi195 running (4m) 90s ago 4m 53.1M 4970M 18.2.4-843-g2c01458a c129f5a2fd4e 10ea833fd5c5 2024-09-13T17:05:09.648 INFO:teuthology.orchestra.run.smithi115.stdout:osd.4 smithi195 running (3m) 90s ago 3m 43.8M 4970M 18.2.4-843-g2c01458a c129f5a2fd4e 4bbc3acb9aff 2024-09-13T17:05:09.648 INFO:teuthology.orchestra.run.smithi115.stdout:osd.5 smithi195 running (3m) 90s ago 3m 44.0M 4970M 18.2.4-843-g2c01458a c129f5a2fd4e 4bd1b3a232d0 2024-09-13T17:05:09.648 INFO:teuthology.orchestra.run.smithi115.stdout:prometheus.smithi115 smithi115 *:9095 running (5m) 83s ago 6m 60.7M - 2.43.0 a07b618ecd1d e91d39286d6c 2024-09-13T17:05:09.649 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.647+0000 7f961b507640 1 -- 172.21.15.115:0/142667217 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f960006cc50 msgr2=0x7f960006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:05:09.649 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.647+0000 7f961b507640 1 --2- 172.21.15.115:0/142667217 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f960006cc50 0x7f960006f110 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9610000c00 tx=0x7f9610031400 comp rx=0 tx=0).stop 2024-09-13T17:05:09.649 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.647+0000 7f961b507640 1 -- 172.21.15.115:0/142667217 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9614102ef0 msgr2=0x7f9614195b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:05:09.649 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.647+0000 7f961b507640 1 --2- 172.21.15.115:0/142667217 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9614102ef0 0x7f9614195b10 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f960400e9a0 tx=0x7f960400ee60 comp rx=0 tx=0).stop 2024-09-13T17:05:09.649 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.647+0000 7f961b507640 1 -- 172.21.15.115:0/142667217 shutdown_connections 2024-09-13T17:05:09.649 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.647+0000 7f961b507640 1 --2- 172.21.15.115:0/142667217 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f960006cc50 0x7f960006f110 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:09.649 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.647+0000 7f961b507640 1 --2- 172.21.15.115:0/142667217 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9614102ef0 0x7f9614195b10 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:09.652 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.647+0000 7f961b507640 1 --2- 172.21.15.115:0/142667217 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f96141005c0 0x7f96141955d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:09.652 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.647+0000 7f961b507640 1 -- 172.21.15.115:0/142667217 >> 172.21.15.115:0/142667217 conn(0x7f96140fa1c0 msgr2=0x7f96140fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:05:09.652 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.647+0000 7f961b507640 1 -- 172.21.15.115:0/142667217 shutdown_connections 2024-09-13T17:05:09.652 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.647+0000 7f961b507640 1 -- 172.21.15.115:0/142667217 wait complete. 2024-09-13T17:05:09.736 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.735+0000 7fddd2748640 1 -- 172.21.15.115:0/2018508190 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fddcc0ffc30 msgr2=0x7fddcc1000b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:05:09.736 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.735+0000 7fddd2748640 1 --2- 172.21.15.115:0/2018508190 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fddcc0ffc30 0x7fddcc1000b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fddb4009880 tx=0x7fddb402a4a0 comp rx=0 tx=0).stop 2024-09-13T17:05:09.736 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.735+0000 7fddd2748640 1 -- 172.21.15.115:0/2018508190 shutdown_connections 2024-09-13T17:05:09.736 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.735+0000 7fddd2748640 1 --2- 172.21.15.115:0/2018508190 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fddcc0ffc30 0x7fddcc1000b0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:09.736 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.735+0000 7fddd2748640 1 --2- 172.21.15.115:0/2018508190 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fddcc0fea30 0x7fddcc0fee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:09.737 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.735+0000 7fddd2748640 1 -- 172.21.15.115:0/2018508190 >> 172.21.15.115:0/2018508190 conn(0x7fddcc0fa1c0 msgr2=0x7fddcc0fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:05:09.737 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.735+0000 7fddd2748640 1 -- 172.21.15.115:0/2018508190 shutdown_connections 2024-09-13T17:05:09.737 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.735+0000 7fddd2748640 1 -- 172.21.15.115:0/2018508190 wait complete. 2024-09-13T17:05:09.737 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.736+0000 7fddd2748640 1 Processor -- start 2024-09-13T17:05:09.738 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.736+0000 7fddd2748640 1 -- start start 2024-09-13T17:05:09.738 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.736+0000 7fddd2748640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fddcc0fea30 0x7fddcc108e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:05:09.738 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.736+0000 7fddd2748640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fddcc0ffc30 0x7fddcc1074c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:05:09.738 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.736+0000 7fddd2748640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddcc1093b0 con 0x7fddcc0fea30 2024-09-13T17:05:09.738 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.736+0000 7fddd2748640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddcc107a30 con 0x7fddcc0ffc30 2024-09-13T17:05:09.738 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.736+0000 7fddcbfff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fddcc0fea30 0x7fddcc108e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:05:09.738 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.736+0000 7fddc37fe640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fddcc0ffc30 0x7fddcc1074c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:05:09.738 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.736+0000 7fddcbfff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fddcc0fea30 0x7fddcc108e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:41980/0 (socket says 172.21.15.115:41980) 2024-09-13T17:05:09.738 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.736+0000 7fddcbfff640 1 -- 172.21.15.115:0/1507984773 learned_addr learned my addr 172.21.15.115:0/1507984773 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:05:09.739 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.736+0000 7fddcbfff640 1 -- 172.21.15.115:0/1507984773 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fddcc0ffc30 msgr2=0x7fddcc1074c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:05:09.739 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.736+0000 7fddcbfff640 1 --2- 172.21.15.115:0/1507984773 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fddcc0ffc30 0x7fddcc1074c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:09.739 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.737+0000 7fddcbfff640 1 -- 172.21.15.115:0/1507984773 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddb4009560 con 0x7fddcc0fea30 2024-09-13T17:05:09.739 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.737+0000 7fddcbfff640 1 --2- 172.21.15.115:0/1507984773 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fddcc0fea30 0x7fddcc108e70 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fddbc00c8f0 tx=0x7fddbc00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:05:09.739 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.737+0000 7fddc9ffb640 1 -- 172.21.15.115:0/1507984773 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fddbc0041f0 con 0x7fddcc0fea30 2024-09-13T17:05:09.739 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.737+0000 7fddd2748640 1 -- 172.21.15.115:0/1507984773 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddcc107d10 con 0x7fddcc0fea30 2024-09-13T17:05:09.740 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.737+0000 7fddc9ffb640 1 -- 172.21.15.115:0/1507984773 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fddbc007df0 con 0x7fddcc0fea30 2024-09-13T17:05:09.740 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.737+0000 7fddc9ffb640 1 -- 172.21.15.115:0/1507984773 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fddbc00f450 con 0x7fddcc0fea30 2024-09-13T17:05:09.740 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.737+0000 7fddd2748640 1 -- 172.21.15.115:0/1507984773 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddcc1082e0 con 0x7fddcc0fea30 2024-09-13T17:05:09.740 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.738+0000 7fddd2748640 1 -- 172.21.15.115:0/1507984773 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddcc18f930 con 0x7fddcc0fea30 2024-09-13T17:05:09.740 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.739+0000 7fddc9ffb640 1 -- 172.21.15.115:0/1507984773 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fddbc007950 con 0x7fddcc0fea30 2024-09-13T17:05:09.741 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.739+0000 7fddc9ffb640 1 --2- 172.21.15.115:0/1507984773 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fddb806cc50 0x7fddb806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:05:09.741 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.739+0000 7fddc9ffb640 1 -- 172.21.15.115:0/1507984773 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fddbc013070 con 0x7fddcc0fea30 2024-09-13T17:05:09.741 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.740+0000 7fddc37fe640 1 --2- 172.21.15.115:0/1507984773 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fddb806cc50 0x7fddb806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:05:09.741 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.740+0000 7fddc37fe640 1 --2- 172.21.15.115:0/1507984773 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fddb806cc50 0x7fddb806f110 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fddcc108bf0 tx=0x7fddb4031400 comp rx=0 tx=0).ready entity=mgr.14207 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:05:09.745 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:09.744+0000 7fddc9ffb640 1 -- 172.21.15.115:0/1507984773 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fddbc056630 con 0x7fddcc0fea30 2024-09-13T17:05:10.075 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:10.074+0000 7fddd2748640 1 -- 172.21.15.115:0/1507984773 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fddcc02c4b0 con 0x7fddcc0fea30 2024-09-13T17:05:10.076 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:10.075+0000 7fddc9ffb640 1 -- 172.21.15.115:0/1507984773 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7fddbc059c50 con 0x7fddcc0fea30 2024-09-13T17:05:10.076 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-13T17:05:10.076 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": { 2024-09-13T17:05:10.076 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-843-g2c01458a (2c01458affee2b2435cd231b6e392435c1c21661) reef (stable)": 2 2024-09-13T17:05:10.076 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T17:05:10.076 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": { 2024-09-13T17:05:10.076 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-843-g2c01458a (2c01458affee2b2435cd231b6e392435c1c21661) reef (stable)": 2 2024-09-13T17:05:10.076 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T17:05:10.077 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": { 2024-09-13T17:05:10.077 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-843-g2c01458a (2c01458affee2b2435cd231b6e392435c1c21661) reef (stable)": 6 2024-09-13T17:05:10.077 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T17:05:10.077 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": { 2024-09-13T17:05:10.077 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-843-g2c01458a (2c01458affee2b2435cd231b6e392435c1c21661) reef (stable)": 4 2024-09-13T17:05:10.077 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T17:05:10.077 INFO:teuthology.orchestra.run.smithi115.stdout: "overall": { 2024-09-13T17:05:10.077 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-843-g2c01458a (2c01458affee2b2435cd231b6e392435c1c21661) reef (stable)": 14 2024-09-13T17:05:10.077 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-13T17:05:10.077 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-13T17:05:10.078 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:10.077+0000 7fddd2748640 1 -- 172.21.15.115:0/1507984773 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fddb806cc50 msgr2=0x7fddb806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:05:10.078 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:10.077+0000 7fddd2748640 1 --2- 172.21.15.115:0/1507984773 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fddb806cc50 0x7fddb806f110 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fddcc108bf0 tx=0x7fddb4031400 comp rx=0 tx=0).stop 2024-09-13T17:05:10.078 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:10.077+0000 7fddd2748640 1 -- 172.21.15.115:0/1507984773 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fddcc0fea30 msgr2=0x7fddcc108e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:05:10.078 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:10.077+0000 7fddd2748640 1 --2- 172.21.15.115:0/1507984773 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fddcc0fea30 0x7fddcc108e70 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fddbc00c8f0 tx=0x7fddbc00cdb0 comp rx=0 tx=0).stop 2024-09-13T17:05:10.079 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:10.077+0000 7fddd2748640 1 -- 172.21.15.115:0/1507984773 shutdown_connections 2024-09-13T17:05:10.079 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:10.077+0000 7fddd2748640 1 --2- 172.21.15.115:0/1507984773 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7fddb806cc50 0x7fddb806f110 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:10.079 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:10.077+0000 7fddd2748640 1 --2- 172.21.15.115:0/1507984773 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fddcc0ffc30 0x7fddcc1074c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:10.079 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:10.077+0000 7fddd2748640 1 --2- 172.21.15.115:0/1507984773 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fddcc0fea30 0x7fddcc108e70 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:10.079 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:10.077+0000 7fddd2748640 1 -- 172.21.15.115:0/1507984773 >> 172.21.15.115:0/1507984773 conn(0x7fddcc0fa1c0 msgr2=0x7fddcc1030c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:05:10.079 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:10.077+0000 7fddd2748640 1 -- 172.21.15.115:0/1507984773 shutdown_connections 2024-09-13T17:05:10.079 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:10.077+0000 7fddd2748640 1 -- 172.21.15.115:0/1507984773 wait complete. 2024-09-13T17:05:10.171 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:10.170+0000 7f8663e2a640 1 -- 172.21.15.115:0/151615873 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f865c102ef0 msgr2=0x7f865c1052e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:05:10.171 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:10.170+0000 7f8663e2a640 1 --2- 172.21.15.115:0/151615873 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f865c102ef0 0x7f865c1052e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f864c0098b0 tx=0x7f864c02a4d0 comp rx=0 tx=0).stop 2024-09-13T17:05:10.171 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:10.170+0000 7f8663e2a640 1 -- 172.21.15.115:0/151615873 shutdown_connections 2024-09-13T17:05:10.171 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:10.170+0000 7f8663e2a640 1 --2- 172.21.15.115:0/151615873 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f865c102ef0 0x7f865c1052e0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:10.172 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:10.170+0000 7f8663e2a640 1 --2- 172.21.15.115:0/151615873 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f865c1005c0 0x7f865c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:10.172 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:10.170+0000 7f8663e2a640 1 -- 172.21.15.115:0/151615873 >> 172.21.15.115:0/151615873 conn(0x7f865c0fa1c0 msgr2=0x7f865c0fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:05:10.172 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:10.170+0000 7f8663e2a640 1 -- 172.21.15.115:0/151615873 shutdown_connections 2024-09-13T17:05:10.172 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:10.170+0000 7f8663e2a640 1 -- 172.21.15.115:0/151615873 wait complete. 2024-09-13T17:05:10.173 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:10.170+0000 7f8663e2a640 1 Processor -- start 2024-09-13T17:05:10.173 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:10.171+0000 7f8663e2a640 1 -- start start 2024-09-13T17:05:10.173 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:10.171+0000 7f8663e2a640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f865c1005c0 0x7f865c0fff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:05:10.173 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:10.171+0000 7f8663e2a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f865c102ef0 0x7f865c0fe570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:05:10.173 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:10.171+0000 7f8663e2a640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f865c0feab0 con 0x7f865c102ef0 2024-09-13T17:05:10.173 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:10.171+0000 7f8663e2a640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f865c0fec20 con 0x7f865c1005c0 2024-09-13T17:05:10.174 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:10.171+0000 7f86613c5640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f865c102ef0 0x7f865c0fe570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:05:10.174 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:10.171+0000 7f86613c5640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f865c102ef0 0x7f865c0fe570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:42004/0 (socket says 172.21.15.115:42004) 2024-09-13T17:05:10.174 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:10.171+0000 7f8661bc6640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f865c1005c0 0x7f865c0fff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:05:10.174 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:10.171+0000 7f86613c5640 1 -- 172.21.15.115:0/2893311109 learned_addr learned my addr 172.21.15.115:0/2893311109 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:05:10.174 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:10.171+0000 7f8661bc6640 1 -- 172.21.15.115:0/2893311109 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f865c102ef0 msgr2=0x7f865c0fe570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:05:10.174 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:10.171+0000 7f8661bc6640 1 --2- 172.21.15.115:0/2893311109 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f865c102ef0 0x7f865c0fe570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:10.174 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:10.171+0000 7f8661bc6640 1 -- 172.21.15.115:0/2893311109 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f864c009560 con 0x7f865c1005c0 2024-09-13T17:05:10.174 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:10.171+0000 7f86613c5640 1 --2- 172.21.15.115:0/2893311109 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f865c102ef0 0x7f865c0fe570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:05:10.174 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:10.171+0000 7f8661bc6640 1 --2- 172.21.15.115:0/2893311109 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f865c1005c0 0x7f865c0fff20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f865800e970 tx=0x7f865800ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:05:10.174 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:10.172+0000 7f8652ffd640 1 -- 172.21.15.115:0/2893311109 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8658009620 con 0x7f865c1005c0 2024-09-13T17:05:10.174 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:10.172+0000 7f8652ffd640 1 -- 172.21.15.115:0/2893311109 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f86580044d0 con 0x7f865c1005c0 2024-09-13T17:05:10.174 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:10.172+0000 7f8663e2a640 1 -- 172.21.15.115:0/2893311109 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f865c0fef00 con 0x7f865c1005c0 2024-09-13T17:05:10.174 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:10.172+0000 7f8652ffd640 1 -- 172.21.15.115:0/2893311109 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f86580049d0 con 0x7f865c1005c0 2024-09-13T17:05:10.175 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:10.172+0000 7f8663e2a640 1 -- 172.21.15.115:0/2893311109 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f865c19d630 con 0x7f865c1005c0 2024-09-13T17:05:10.175 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:10.173+0000 7f8663e2a640 1 -- 172.21.15.115:0/2893311109 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f865c1009a0 con 0x7f865c1005c0 2024-09-13T17:05:10.175 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:10.173+0000 7f8652ffd640 1 -- 172.21.15.115:0/2893311109 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f8658004c40 con 0x7f865c1005c0 2024-09-13T17:05:10.176 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:10.174+0000 7f8652ffd640 1 --2- 172.21.15.115:0/2893311109 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f864806cc50 0x7f864806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:05:10.176 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:10.174+0000 7f8652ffd640 1 -- 172.21.15.115:0/2893311109 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f8658014070 con 0x7f865c1005c0 2024-09-13T17:05:10.176 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:10.174+0000 7f86613c5640 1 --2- 172.21.15.115:0/2893311109 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f864806cc50 0x7f864806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:05:10.176 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:10.174+0000 7f86613c5640 1 --2- 172.21.15.115:0/2893311109 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f864806cc50 0x7f864806f110 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f865c0ffca0 tx=0x7f864c031400 comp rx=0 tx=0).ready entity=mgr.14207 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:05:10.179 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:10.178+0000 7f8652ffd640 1 -- 172.21.15.115:0/2893311109 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f8658056990 con 0x7f865c1005c0 2024-09-13T17:05:10.325 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:10 smithi115 ceph-mon[27708]: from='client.14574 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:05:10.325 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:10 smithi115 ceph-mon[27708]: pgmap v234: 65 pgs: 65 active+clean; 40 MiB data, 313 MiB used, 536 GiB / 536 GiB avail; 1.3 MiB/s rd, 3.4 MiB/s wr, 258 op/s 2024-09-13T17:05:10.326 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:10 smithi115 ceph-mon[27708]: from='client.14578 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:05:10.378 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:10.377+0000 7f8663e2a640 1 -- 172.21.15.115:0/2893311109 --> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f865c1039b0 con 0x7f864806cc50 2024-09-13T17:05:10.379 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:10.378+0000 7f8652ffd640 1 -- 172.21.15.115:0/2893311109 <== mgr.14207 v2:172.21.15.115:6800/244039928 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+321 (secure 0 0 0) 0x7f865c1039b0 con 0x7f864806cc50 2024-09-13T17:05:10.379 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-13T17:05:10.379 INFO:teuthology.orchestra.run.smithi115.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256", 2024-09-13T17:05:10.379 INFO:teuthology.orchestra.run.smithi115.stdout: "in_progress": true, 2024-09-13T17:05:10.379 INFO:teuthology.orchestra.run.smithi115.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-13T17:05:10.379 INFO:teuthology.orchestra.run.smithi115.stdout: "services_complete": [], 2024-09-13T17:05:10.379 INFO:teuthology.orchestra.run.smithi115.stdout: "progress": "", 2024-09-13T17:05:10.379 INFO:teuthology.orchestra.run.smithi115.stdout: "message": "Currently upgrading mgr daemons", 2024-09-13T17:05:10.379 INFO:teuthology.orchestra.run.smithi115.stdout: "is_paused": false 2024-09-13T17:05:10.379 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-13T17:05:10.381 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:10.380+0000 7f8663e2a640 1 -- 172.21.15.115:0/2893311109 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f864806cc50 msgr2=0x7f864806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:05:10.381 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:10.380+0000 7f8663e2a640 1 --2- 172.21.15.115:0/2893311109 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f864806cc50 0x7f864806f110 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f865c0ffca0 tx=0x7f864c031400 comp rx=0 tx=0).stop 2024-09-13T17:05:10.382 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:10.380+0000 7f8663e2a640 1 -- 172.21.15.115:0/2893311109 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f865c1005c0 msgr2=0x7f865c0fff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:05:10.382 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:10.380+0000 7f8663e2a640 1 --2- 172.21.15.115:0/2893311109 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f865c1005c0 0x7f865c0fff20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f865800e970 tx=0x7f865800ee30 comp rx=0 tx=0).stop 2024-09-13T17:05:10.382 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:10.380+0000 7f8663e2a640 1 -- 172.21.15.115:0/2893311109 shutdown_connections 2024-09-13T17:05:10.382 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:10.380+0000 7f8663e2a640 1 --2- 172.21.15.115:0/2893311109 >> [v2:172.21.15.115:6800/244039928,v1:172.21.15.115:6801/244039928] conn(0x7f864806cc50 0x7f864806f110 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:10.382 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:10.380+0000 7f8663e2a640 1 --2- 172.21.15.115:0/2893311109 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f865c102ef0 0x7f865c0fe570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:10.382 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:10.380+0000 7f8663e2a640 1 --2- 172.21.15.115:0/2893311109 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f865c1005c0 0x7f865c0fff20 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:10.382 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:10.380+0000 7f8663e2a640 1 -- 172.21.15.115:0/2893311109 >> 172.21.15.115:0/2893311109 conn(0x7f865c0fa1c0 msgr2=0x7f865c0fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:05:10.382 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:10.381+0000 7f8663e2a640 1 -- 172.21.15.115:0/2893311109 shutdown_connections 2024-09-13T17:05:10.382 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:10.381+0000 7f8663e2a640 1 -- 172.21.15.115:0/2893311109 wait complete. 2024-09-13T17:05:10.500 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:10 smithi195 ceph-mon[34981]: from='client.14574 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:05:10.500 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:10 smithi195 ceph-mon[34981]: pgmap v234: 65 pgs: 65 active+clean; 40 MiB data, 313 MiB used, 536 GiB / 536 GiB avail; 1.3 MiB/s rd, 3.4 MiB/s wr, 258 op/s 2024-09-13T17:05:10.500 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:10 smithi195 ceph-mon[34981]: from='client.14578 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:05:10.500 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:10 smithi195 ceph-mon[34981]: from='client.? 172.21.15.115:0/1507984773' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:05:10.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:10 smithi115 ceph-mon[27708]: from='client.? 172.21.15.115:0/1507984773' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:05:11.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:11 smithi195 ceph-mon[34981]: from='client.14582 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:05:11.411 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:11 smithi195 ceph-mon[34981]: from='client.24335 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:05:11.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:11 smithi115 ceph-mon[27708]: from='client.14582 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:05:11.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:11 smithi115 ceph-mon[27708]: from='client.24335 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:05:12.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:12 smithi195 ceph-mon[34981]: pgmap v235: 65 pgs: 65 active+clean; 52 MiB data, 341 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 4.4 MiB/s wr, 320 op/s 2024-09-13T17:05:12.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:12 smithi115 ceph-mon[27708]: pgmap v235: 65 pgs: 65 active+clean; 52 MiB data, 341 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 4.4 MiB/s wr, 320 op/s 2024-09-13T17:05:13.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:13 smithi115 ceph-mon[27708]: Standby manager daemon smithi195.hjjifz restarted 2024-09-13T17:05:13.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:13 smithi115 ceph-mon[27708]: Standby manager daemon smithi195.hjjifz started 2024-09-13T17:05:13.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:13 smithi115 ceph-mon[27708]: from='mgr.? 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi195.hjjifz/crt"}]: dispatch 2024-09-13T17:05:13.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:13 smithi115 ceph-mon[27708]: from='mgr.? 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T17:05:13.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:13 smithi115 ceph-mon[27708]: from='mgr.? 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi195.hjjifz/key"}]: dispatch 2024-09-13T17:05:13.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:13 smithi115 ceph-mon[27708]: from='mgr.? 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T17:05:13.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:13 smithi195 ceph-mon[34981]: Standby manager daemon smithi195.hjjifz restarted 2024-09-13T17:05:13.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:13 smithi195 ceph-mon[34981]: Standby manager daemon smithi195.hjjifz started 2024-09-13T17:05:13.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:13 smithi195 ceph-mon[34981]: from='mgr.? 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi195.hjjifz/crt"}]: dispatch 2024-09-13T17:05:13.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:13 smithi195 ceph-mon[34981]: from='mgr.? 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T17:05:13.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:13 smithi195 ceph-mon[34981]: from='mgr.? 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi195.hjjifz/key"}]: dispatch 2024-09-13T17:05:13.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:13 smithi195 ceph-mon[34981]: from='mgr.? 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T17:05:14.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:14 smithi115 ceph-mon[27708]: pgmap v236: 65 pgs: 65 active+clean; 63 MiB data, 394 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 5.5 MiB/s wr, 355 op/s 2024-09-13T17:05:14.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:14 smithi115 ceph-mon[27708]: mgrmap e20: smithi115.hetcni(active, since 6m), standbys: smithi195.hjjifz 2024-09-13T17:05:14.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:14 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:05:14.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:14 smithi195 ceph-mon[34981]: pgmap v236: 65 pgs: 65 active+clean; 63 MiB data, 394 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 5.5 MiB/s wr, 355 op/s 2024-09-13T17:05:14.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:14 smithi195 ceph-mon[34981]: mgrmap e20: smithi115.hetcni(active, since 6m), standbys: smithi195.hjjifz 2024-09-13T17:05:14.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:14 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:05:16.326 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:16 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:05:16.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:16 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:05:16.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:16 smithi195 ceph-mon[34981]: pgmap v237: 65 pgs: 65 active+clean; 86 MiB data, 464 MiB used, 536 GiB / 536 GiB avail; 3.3 MiB/s rd, 7.4 MiB/s wr, 439 op/s 2024-09-13T17:05:16.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:16 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:05:16.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:16 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:05:16.428 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:16 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:05:16.428 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:16 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:05:16.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:16 smithi115 ceph-mon[27708]: pgmap v237: 65 pgs: 65 active+clean; 86 MiB data, 464 MiB used, 536 GiB / 536 GiB avail; 3.3 MiB/s rd, 7.4 MiB/s wr, 439 op/s 2024-09-13T17:05:16.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:16 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:05:16.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:16 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:05:18.576 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:18 smithi195 ceph-mon[34981]: pgmap v238: 65 pgs: 65 active+clean; 87 MiB data, 480 MiB used, 536 GiB / 536 GiB avail; 3.0 MiB/s rd, 7.1 MiB/s wr, 449 op/s 2024-09-13T17:05:18.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:18 smithi115 ceph-mon[27708]: pgmap v238: 65 pgs: 65 active+clean; 87 MiB data, 480 MiB used, 536 GiB / 536 GiB avail; 3.0 MiB/s rd, 7.1 MiB/s wr, 449 op/s 2024-09-13T17:05:20.576 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:20 smithi195 ceph-mon[34981]: pgmap v239: 65 pgs: 65 active+clean; 104 MiB data, 517 MiB used, 536 GiB / 536 GiB avail; 3.7 MiB/s rd, 8.2 MiB/s wr, 606 op/s 2024-09-13T17:05:20.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:20 smithi115 ceph-mon[27708]: pgmap v239: 65 pgs: 65 active+clean; 104 MiB data, 517 MiB used, 536 GiB / 536 GiB avail; 3.7 MiB/s rd, 8.2 MiB/s wr, 606 op/s 2024-09-13T17:05:22.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:22 smithi195 ceph-mon[34981]: pgmap v240: 65 pgs: 65 active+clean; 111 MiB data, 542 MiB used, 536 GiB / 536 GiB avail; 3.0 MiB/s rd, 6.2 MiB/s wr, 490 op/s 2024-09-13T17:05:22.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:22 smithi115 ceph-mon[27708]: pgmap v240: 65 pgs: 65 active+clean; 111 MiB data, 542 MiB used, 536 GiB / 536 GiB avail; 3.0 MiB/s rd, 6.2 MiB/s wr, 490 op/s 2024-09-13T17:05:24.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:24 smithi195 ceph-mon[34981]: pgmap v241: 65 pgs: 65 active+clean; 123 MiB data, 604 MiB used, 536 GiB / 536 GiB avail; 3.0 MiB/s rd, 6.3 MiB/s wr, 579 op/s 2024-09-13T17:05:24.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:24 smithi115 ceph-mon[27708]: pgmap v241: 65 pgs: 65 active+clean; 123 MiB data, 604 MiB used, 536 GiB / 536 GiB avail; 3.0 MiB/s rd, 6.3 MiB/s wr, 579 op/s 2024-09-13T17:05:26.576 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:26 smithi195 ceph-mon[34981]: pgmap v242: 65 pgs: 65 active+clean; 149 MiB data, 680 MiB used, 536 GiB / 536 GiB avail; 3.6 MiB/s rd, 7.5 MiB/s wr, 767 op/s 2024-09-13T17:05:26.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:26 smithi115 ceph-mon[27708]: pgmap v242: 65 pgs: 65 active+clean; 149 MiB data, 680 MiB used, 536 GiB / 536 GiB avail; 3.6 MiB/s rd, 7.5 MiB/s wr, 767 op/s 2024-09-13T17:05:28.355 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:28 smithi115 ceph-mon[27708]: pgmap v243: 65 pgs: 65 active+clean; 160 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.6 MiB/s rd, 6.6 MiB/s wr, 765 op/s 2024-09-13T17:05:28.355 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:28 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:05:28.355 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:28 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:05:28.355 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:28 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:05:28.355 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:28 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:05:28.355 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:28 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:05:28.356 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:28 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:05:28.356 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:28 smithi115 ceph-mon[27708]: Upgrade: Need to upgrade myself (mgr.smithi115.hetcni) 2024-09-13T17:05:28.356 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:28 smithi115 ceph-mon[27708]: Failing over to other MGR 2024-09-13T17:05:28.356 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:28 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mgr fail", "who": "smithi115.hetcni"}]: dispatch 2024-09-13T17:05:28.356 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:28 smithi115 ceph-mon[27708]: Activating manager daemon smithi195.hjjifz 2024-09-13T17:05:28.356 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:28 smithi115 ceph-mon[27708]: from='mgr.24317 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "mon metadata", "id": "smithi115"}]: dispatch 2024-09-13T17:05:28.356 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:28 smithi115 ceph-mon[27708]: from='mgr.24317 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-09-13T17:05:28.356 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:28 smithi115 ceph-mon[27708]: from='mgr.24317 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi115.ijznvr"}]: dispatch 2024-09-13T17:05:28.356 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:28 smithi115 ceph-mon[27708]: from='mgr.24317 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi115.hbtxod"}]: dispatch 2024-09-13T17:05:28.357 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:28 smithi115 ceph-mon[27708]: from='mgr.24317 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.aevvgz"}]: dispatch 2024-09-13T17:05:28.357 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:28 smithi115 ceph-mon[27708]: from='mgr.24317 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.qzghxj"}]: dispatch 2024-09-13T17:05:28.357 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:28 smithi115 ceph-mon[27708]: from='mgr.24317 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "mgr metadata", "who": "smithi195.hjjifz", "id": "smithi195.hjjifz"}]: dispatch 2024-09-13T17:05:28.357 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:28 smithi115 ceph-mon[27708]: from='mgr.24317 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T17:05:28.357 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:28 smithi115 ceph-mon[27708]: from='mgr.24317 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T17:05:28.357 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:28 smithi115 ceph-mon[27708]: from='mgr.24317 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T17:05:28.357 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:28 smithi115 ceph-mon[27708]: from='mgr.24317 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T17:05:28.357 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:28 smithi115 ceph-mon[27708]: from='mgr.24317 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T17:05:28.357 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:28 smithi115 ceph-mon[27708]: from='mgr.24317 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T17:05:28.357 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:28 smithi115 ceph-mon[27708]: osdmap e47: 6 total, 6 up, 6 in 2024-09-13T17:05:28.357 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:28 smithi115 ceph-mon[27708]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "mgr fail", "who": "smithi115.hetcni"}]': finished 2024-09-13T17:05:28.358 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:28 smithi115 ceph-mon[27708]: mgrmap e21: smithi195.hjjifz(active, starting, since 0.0131233s) 2024-09-13T17:05:28.358 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:28 smithi115 ceph-mon[27708]: from='mgr.24317 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T17:05:28.358 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:28 smithi115 ceph-mon[27708]: from='mgr.24317 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T17:05:28.358 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:28 smithi115 ceph-mon[27708]: from='mgr.24317 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T17:05:28.358 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:28 smithi115 ceph-mon[27708]: Manager daemon smithi195.hjjifz is now available 2024-09-13T17:05:28.358 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:28 smithi115 ceph-mon[27708]: from='mgr.24317 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:05:28.358 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:28 smithi115 ceph-mon[27708]: from='mgr.24317 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:05:28.358 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:28 smithi115 ceph-mon[27708]: from='mgr.24317 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi195.hjjifz/mirror_snapshot_schedule"}]: dispatch 2024-09-13T17:05:28.358 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:28 smithi115 ceph-mon[27708]: from='mgr.24317 ' entity='mgr.smithi195.hjjifz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi195.hjjifz/mirror_snapshot_schedule"}]: dispatch 2024-09-13T17:05:28.358 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:28 smithi115 ceph-mon[27708]: from='mgr.24317 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi195.hjjifz/trash_purge_schedule"}]: dispatch 2024-09-13T17:05:28.358 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:28 smithi115 ceph-mon[27708]: from='mgr.24317 ' entity='mgr.smithi195.hjjifz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi195.hjjifz/trash_purge_schedule"}]: dispatch 2024-09-13T17:05:28.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:28 smithi195 ceph-mon[34981]: pgmap v243: 65 pgs: 65 active+clean; 160 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.6 MiB/s rd, 6.6 MiB/s wr, 765 op/s 2024-09-13T17:05:28.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:28 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:05:28.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:28 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:05:28.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:28 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:05:28.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:28 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:05:28.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:28 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' 2024-09-13T17:05:28.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:28 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:05:28.578 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:28 smithi195 ceph-mon[34981]: Upgrade: Need to upgrade myself (mgr.smithi115.hetcni) 2024-09-13T17:05:28.578 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:28 smithi195 ceph-mon[34981]: Failing over to other MGR 2024-09-13T17:05:28.578 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:28 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mgr fail", "who": "smithi115.hetcni"}]: dispatch 2024-09-13T17:05:28.578 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:28 smithi195 ceph-mon[34981]: Activating manager daemon smithi195.hjjifz 2024-09-13T17:05:28.578 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:28 smithi195 ceph-mon[34981]: from='mgr.24317 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "mon metadata", "id": "smithi115"}]: dispatch 2024-09-13T17:05:28.578 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:28 smithi195 ceph-mon[34981]: from='mgr.24317 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-09-13T17:05:28.578 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:28 smithi195 ceph-mon[34981]: from='mgr.24317 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi115.ijznvr"}]: dispatch 2024-09-13T17:05:28.578 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:28 smithi195 ceph-mon[34981]: from='mgr.24317 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi115.hbtxod"}]: dispatch 2024-09-13T17:05:28.578 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:28 smithi195 ceph-mon[34981]: from='mgr.24317 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.aevvgz"}]: dispatch 2024-09-13T17:05:28.578 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:28 smithi195 ceph-mon[34981]: from='mgr.24317 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.qzghxj"}]: dispatch 2024-09-13T17:05:28.578 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:28 smithi195 ceph-mon[34981]: from='mgr.24317 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "mgr metadata", "who": "smithi195.hjjifz", "id": "smithi195.hjjifz"}]: dispatch 2024-09-13T17:05:28.578 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:28 smithi195 ceph-mon[34981]: from='mgr.24317 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T17:05:28.578 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:28 smithi195 ceph-mon[34981]: from='mgr.24317 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T17:05:28.578 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:28 smithi195 ceph-mon[34981]: from='mgr.24317 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T17:05:28.579 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:28 smithi195 ceph-mon[34981]: from='mgr.24317 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T17:05:28.579 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:28 smithi195 ceph-mon[34981]: from='mgr.24317 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T17:05:28.579 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:28 smithi195 ceph-mon[34981]: from='mgr.24317 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T17:05:28.579 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:28 smithi195 ceph-mon[34981]: osdmap e47: 6 total, 6 up, 6 in 2024-09-13T17:05:28.579 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:28 smithi195 ceph-mon[34981]: from='mgr.14207 172.21.15.115:0/2544441248' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "mgr fail", "who": "smithi115.hetcni"}]': finished 2024-09-13T17:05:28.579 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:28 smithi195 ceph-mon[34981]: mgrmap e21: smithi195.hjjifz(active, starting, since 0.0131233s) 2024-09-13T17:05:28.579 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:28 smithi195 ceph-mon[34981]: from='mgr.24317 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T17:05:28.579 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:28 smithi195 ceph-mon[34981]: from='mgr.24317 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T17:05:28.579 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:28 smithi195 ceph-mon[34981]: from='mgr.24317 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T17:05:28.579 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:28 smithi195 ceph-mon[34981]: Manager daemon smithi195.hjjifz is now available 2024-09-13T17:05:28.579 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:28 smithi195 ceph-mon[34981]: from='mgr.24317 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:05:28.579 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:28 smithi195 ceph-mon[34981]: from='mgr.24317 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:05:28.579 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:28 smithi195 ceph-mon[34981]: from='mgr.24317 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi195.hjjifz/mirror_snapshot_schedule"}]: dispatch 2024-09-13T17:05:28.579 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:28 smithi195 ceph-mon[34981]: from='mgr.24317 ' entity='mgr.smithi195.hjjifz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi195.hjjifz/mirror_snapshot_schedule"}]: dispatch 2024-09-13T17:05:28.580 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:28 smithi195 ceph-mon[34981]: from='mgr.24317 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi195.hjjifz/trash_purge_schedule"}]: dispatch 2024-09-13T17:05:28.580 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:28 smithi195 ceph-mon[34981]: from='mgr.24317 ' entity='mgr.smithi195.hjjifz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi195.hjjifz/trash_purge_schedule"}]: dispatch 2024-09-13T17:05:28.975 INFO:tasks.workunit.client.0.smithi115.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-13T17:05:28.976 INFO:tasks.workunit.client.0.smithi115.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-13T17:05:28.976 INFO:tasks.workunit.client.0.smithi115.stderr:+ make 2024-09-13T17:05:29.672 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:29 smithi115 ceph-mon[27708]: Deploying cephadm binary to smithi195 2024-09-13T17:05:29.672 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:29 smithi115 ceph-mon[27708]: Deploying cephadm binary to smithi115 2024-09-13T17:05:29.672 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:29 smithi115 ceph-mon[27708]: mgrmap e22: smithi195.hjjifz(active, since 1.00971s) 2024-09-13T17:05:29.672 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:29 smithi115 ceph-mon[27708]: pgmap v3: 65 pgs: 65 active+clean; 182 MiB data, 858 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:05:29.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:29 smithi195 ceph-mon[34981]: Deploying cephadm binary to smithi195 2024-09-13T17:05:29.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:29 smithi195 ceph-mon[34981]: Deploying cephadm binary to smithi115 2024-09-13T17:05:29.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:29 smithi195 ceph-mon[34981]: mgrmap e22: smithi195.hjjifz(active, since 1.00971s) 2024-09-13T17:05:29.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:29 smithi195 ceph-mon[34981]: pgmap v3: 65 pgs: 65 active+clean; 182 MiB data, 858 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:05:29.899 INFO:tasks.workunit.client.0.smithi115.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-13T17:05:30.359 INFO:tasks.workunit.client.0.smithi115.stderr:++ readlink -f fsstress 2024-09-13T17:05:30.359 INFO:tasks.workunit.client.0.smithi115.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-13T17:05:30.360 INFO:tasks.workunit.client.0.smithi115.stderr:+ popd 2024-09-13T17:05:30.360 INFO:tasks.workunit.client.0.smithi115.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-13T17:05:30.360 INFO:tasks.workunit.client.0.smithi115.stderr:+ popd 2024-09-13T17:05:30.360 INFO:tasks.workunit.client.0.smithi115.stdout:~/cephtest/mnt.0/client.0/tmp 2024-09-13T17:05:30.361 INFO:tasks.workunit.client.0.smithi115.stderr:++ mktemp -d -p . 2024-09-13T17:05:30.362 INFO:tasks.workunit.client.0.smithi115.stderr:+ T=./tmp.UwJuJJp2BL 2024-09-13T17:05:30.362 INFO:tasks.workunit.client.0.smithi115.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.UwJuJJp2BL -l 1 -n 1000 -p 10 -v 2024-09-13T17:05:30.363 INFO:tasks.workunit.client.0.smithi115.stdout:seed = 1726085739 2024-09-13T17:05:30.366 INFO:tasks.workunit.client.0.smithi115.stdout:0/0: unlink - no file 2024-09-13T17:05:30.366 INFO:tasks.workunit.client.0.smithi115.stdout:0/1: dwrite - no filename 2024-09-13T17:05:30.366 INFO:tasks.workunit.client.0.smithi115.stdout:0/2: link - no file 2024-09-13T17:05:30.366 INFO:tasks.workunit.client.0.smithi115.stdout:0/3: fdatasync - no filename 2024-09-13T17:05:30.366 INFO:tasks.workunit.client.0.smithi115.stdout:0/4: rename - no filename 2024-09-13T17:05:30.366 INFO:tasks.workunit.client.0.smithi115.stdout:0/5: write - no filename 2024-09-13T17:05:30.366 INFO:tasks.workunit.client.0.smithi115.stdout:0/6: rename - no filename 2024-09-13T17:05:30.366 INFO:tasks.workunit.client.0.smithi115.stdout:0/7: write - no filename 2024-09-13T17:05:30.367 INFO:tasks.workunit.client.0.smithi115.stdout:1/0: unlink - no file 2024-09-13T17:05:30.367 INFO:tasks.workunit.client.0.smithi115.stdout:1/1: chown . 7174071 1 2024-09-13T17:05:30.367 INFO:tasks.workunit.client.0.smithi115.stdout:1/2: getdents . 0 2024-09-13T17:05:30.372 INFO:tasks.workunit.client.0.smithi115.stdout:1/3: creat f0 x:0 0 0 2024-09-13T17:05:30.372 INFO:tasks.workunit.client.0.smithi115.stdout:1/4: truncate f0 16009 0 2024-09-13T17:05:30.372 INFO:tasks.workunit.client.0.smithi115.stdout:1/5: write f0 [900896,28092] 0 2024-09-13T17:05:30.387 INFO:tasks.workunit.client.0.smithi115.stdout:1/6: unlink f0 0 2024-09-13T17:05:30.399 INFO:tasks.workunit.client.0.smithi115.stdout:1/7: symlink l1 0 2024-09-13T17:05:30.406 INFO:tasks.workunit.client.0.smithi115.stdout:1/8: rename l1 to l2 0 2024-09-13T17:05:30.406 INFO:tasks.workunit.client.0.smithi115.stdout:1/9: dread - no filename 2024-09-13T17:05:30.429 INFO:tasks.workunit.client.0.smithi115.stdout:2/0: getdents . 0 2024-09-13T17:05:30.429 INFO:tasks.workunit.client.0.smithi115.stdout:2/1: write - no filename 2024-09-13T17:05:30.430 INFO:tasks.workunit.client.0.smithi115.stdout:2/2: link - no file 2024-09-13T17:05:30.430 INFO:tasks.workunit.client.0.smithi115.stdout:2/3: fdatasync - no filename 2024-09-13T17:05:30.430 INFO:tasks.workunit.client.0.smithi115.stdout:4/0: fsync - no filename 2024-09-13T17:05:30.430 INFO:tasks.workunit.client.0.smithi115.stdout:4/1: dwrite - no filename 2024-09-13T17:05:30.430 INFO:tasks.workunit.client.0.smithi115.stdout:4/2: truncate - no filename 2024-09-13T17:05:30.430 INFO:tasks.workunit.client.0.smithi115.stdout:4/3: truncate - no filename 2024-09-13T17:05:30.430 INFO:tasks.workunit.client.0.smithi115.stdout:4/4: truncate - no filename 2024-09-13T17:05:30.430 INFO:tasks.workunit.client.0.smithi115.stdout:4/5: getdents . 0 2024-09-13T17:05:30.430 INFO:tasks.workunit.client.0.smithi115.stdout:4/6: write - no filename 2024-09-13T17:05:30.430 INFO:tasks.workunit.client.0.smithi115.stdout:7/0: write - no filename 2024-09-13T17:05:30.430 INFO:tasks.workunit.client.0.smithi115.stdout:7/1: link - no file 2024-09-13T17:05:30.430 INFO:tasks.workunit.client.0.smithi115.stdout:7/2: chown . 38242 1 2024-09-13T17:05:30.430 INFO:tasks.workunit.client.0.smithi115.stdout:7/3: read - no filename 2024-09-13T17:05:30.431 INFO:tasks.workunit.client.0.smithi115.stdout:7/4: dread - no filename 2024-09-13T17:05:30.431 INFO:tasks.workunit.client.0.smithi115.stdout:7/5: fsync - no filename 2024-09-13T17:05:30.431 INFO:tasks.workunit.client.0.smithi115.stdout:7/6: chown . 1 1 2024-09-13T17:05:30.431 INFO:tasks.workunit.client.0.smithi115.stdout:5/0: dwrite - no filename 2024-09-13T17:05:30.431 INFO:tasks.workunit.client.0.smithi115.stdout:5/1: write - no filename 2024-09-13T17:05:30.431 INFO:tasks.workunit.client.0.smithi115.stdout:5/2: rename - no filename 2024-09-13T17:05:30.431 INFO:tasks.workunit.client.0.smithi115.stdout:5/3: unlink - no file 2024-09-13T17:05:30.431 INFO:tasks.workunit.client.0.smithi115.stdout:5/4: dread - no filename 2024-09-13T17:05:30.431 INFO:tasks.workunit.client.0.smithi115.stdout:5/5: dread - no filename 2024-09-13T17:05:30.431 INFO:tasks.workunit.client.0.smithi115.stdout:5/6: chown . 163217 1 2024-09-13T17:05:30.431 INFO:tasks.workunit.client.0.smithi115.stdout:5/7: link - no file 2024-09-13T17:05:30.431 INFO:tasks.workunit.client.0.smithi115.stdout:5/8: write - no filename 2024-09-13T17:05:30.437 INFO:tasks.workunit.client.0.smithi115.stdout:3/0: symlink l0 0 2024-09-13T17:05:30.439 INFO:tasks.workunit.client.0.smithi115.stdout:2/4: symlink l0 0 2024-09-13T17:05:30.439 INFO:tasks.workunit.client.0.smithi115.stdout:4/7: creat f0 x:0 0 0 2024-09-13T17:05:30.439 INFO:tasks.workunit.client.0.smithi115.stdout:4/8: chown f0 29 1 2024-09-13T17:05:30.441 INFO:tasks.workunit.client.0.smithi115.stdout:7/7: mkdir d0 0 2024-09-13T17:05:30.442 INFO:tasks.workunit.client.0.smithi115.stdout:5/9: creat f0 x:0 0 0 2024-09-13T17:05:30.442 INFO:tasks.workunit.client.0.smithi115.stdout:5/10: dread - f0 zero size 2024-09-13T17:05:30.442 INFO:tasks.workunit.client.0.smithi115.stdout:5/11: creat f1 x:0 0 0 2024-09-13T17:05:30.442 INFO:tasks.workunit.client.0.smithi115.stdout:5/12: dread - f1 zero size 2024-09-13T17:05:30.442 INFO:tasks.workunit.client.0.smithi115.stdout:5/13: creat f2 x:0 0 0 2024-09-13T17:05:30.443 INFO:tasks.workunit.client.0.smithi115.stdout:8/0: mkdir d0 0 2024-09-13T17:05:30.443 INFO:tasks.workunit.client.0.smithi115.stdout:8/1: write - no filename 2024-09-13T17:05:30.443 INFO:tasks.workunit.client.0.smithi115.stdout:8/2: dread - no filename 2024-09-13T17:05:30.443 INFO:tasks.workunit.client.0.smithi115.stdout:8/3: rename d0 to d0/d1 22 2024-09-13T17:05:30.443 INFO:tasks.workunit.client.0.smithi115.stdout:8/4: dwrite - no filename 2024-09-13T17:05:30.443 INFO:tasks.workunit.client.0.smithi115.stdout:8/5: readlink - no filename 2024-09-13T17:05:30.443 INFO:tasks.workunit.client.0.smithi115.stdout:8/6: readlink - no filename 2024-09-13T17:05:30.443 INFO:tasks.workunit.client.0.smithi115.stdout:8/7: write - no filename 2024-09-13T17:05:30.444 INFO:tasks.workunit.client.0.smithi115.stdout:6/0: symlink l0 0 2024-09-13T17:05:30.444 INFO:tasks.workunit.client.0.smithi115.stdout:6/1: truncate - no filename 2024-09-13T17:05:30.444 INFO:tasks.workunit.client.0.smithi115.stdout:6/2: write - no filename 2024-09-13T17:05:30.444 INFO:tasks.workunit.client.0.smithi115.stdout:6/3: stat l0 0 2024-09-13T17:05:30.445 INFO:tasks.workunit.client.0.smithi115.stdout:6/4: dwrite - no filename 2024-09-13T17:05:30.445 INFO:tasks.workunit.client.0.smithi115.stdout:6/5: read - no filename 2024-09-13T17:05:30.445 INFO:tasks.workunit.client.0.smithi115.stdout:6/6: chown l0 14835183 1 2024-09-13T17:05:30.445 INFO:tasks.workunit.client.0.smithi115.stdout:6/7: readlink l0 0 2024-09-13T17:05:30.445 INFO:tasks.workunit.client.0.smithi115.stdout:6/8: write - no filename 2024-09-13T17:05:30.445 INFO:tasks.workunit.client.0.smithi115.stdout:6/9: read - no filename 2024-09-13T17:05:30.446 INFO:tasks.workunit.client.0.smithi115.stdout:9/0: mkdir d0 0 2024-09-13T17:05:30.450 INFO:tasks.workunit.client.0.smithi115.stdout:3/1: mkdir d1 0 2024-09-13T17:05:30.459 INFO:tasks.workunit.client.0.smithi115.stdout:2/5: creat f1 x:0 0 0 2024-09-13T17:05:30.459 INFO:tasks.workunit.client.0.smithi115.stdout:2/6: creat f2 x:0 0 0 2024-09-13T17:05:30.460 INFO:tasks.workunit.client.0.smithi115.stdout:4/9: mknod c1 0 2024-09-13T17:05:30.461 INFO:tasks.workunit.client.0.smithi115.stdout:4/10: chown f0 40318531 1 2024-09-13T17:05:30.462 INFO:tasks.workunit.client.0.smithi115.stdout:7/8: creat d0/f1 x:0 0 0 2024-09-13T17:05:30.466 INFO:tasks.workunit.client.0.smithi115.stdout:8/8: mknod d0/c2 0 2024-09-13T17:05:30.466 INFO:tasks.workunit.client.0.smithi115.stdout:8/9: write - no filename 2024-09-13T17:05:30.467 INFO:tasks.workunit.client.0.smithi115.stdout:6/10: mknod c1 0 2024-09-13T17:05:30.467 INFO:tasks.workunit.client.0.smithi115.stdout:6/11: dread - no filename 2024-09-13T17:05:30.468 INFO:tasks.workunit.client.0.smithi115.stdout:9/1: symlink d0/l1 0 2024-09-13T17:05:30.470 INFO:tasks.workunit.client.0.smithi115.stdout:3/2: creat d1/f2 x:0 0 0 2024-09-13T17:05:30.470 INFO:tasks.workunit.client.0.smithi115.stdout:3/3: readlink l0 0 2024-09-13T17:05:30.472 INFO:tasks.workunit.client.0.smithi115.stdout:2/7: mkdir d3 0 2024-09-13T17:05:30.474 INFO:tasks.workunit.client.0.smithi115.stdout:4/11: symlink l2 0 2024-09-13T17:05:30.474 INFO:tasks.workunit.client.0.smithi115.stdout:4/12: dread - f0 zero size 2024-09-13T17:05:30.474 INFO:tasks.workunit.client.0.smithi115.stdout:4/13: rmdir - no directory 2024-09-13T17:05:30.474 INFO:tasks.workunit.client.0.smithi115.stdout:4/14: creat f3 x:0 0 0 2024-09-13T17:05:30.474 INFO:tasks.workunit.client.0.smithi115.stdout:4/15: dread - f3 zero size 2024-09-13T17:05:30.474 INFO:tasks.workunit.client.0.smithi115.stdout:4/16: dread - f0 zero size 2024-09-13T17:05:30.475 INFO:tasks.workunit.client.0.smithi115.stdout:4/17: write f3 [604790,114137] 0 2024-09-13T17:05:30.475 INFO:tasks.workunit.client.0.smithi115.stdout:7/9: mkdir d0/d2 0 2024-09-13T17:05:30.475 INFO:tasks.workunit.client.0.smithi115.stdout:7/10: write d0/f1 [612052,70606] 0 2024-09-13T17:05:30.475 INFO:tasks.workunit.client.0.smithi115.stdout:7/11: chown d0/f1 1035386 1 2024-09-13T17:05:30.475 INFO:tasks.workunit.client.0.smithi115.stdout:7/12: chown d0 9741 1 2024-09-13T17:05:30.476 INFO:tasks.workunit.client.0.smithi115.stdout:5/14: unlink f2 0 2024-09-13T17:05:30.478 INFO:tasks.workunit.client.0.smithi115.stdout:4/18: dread f3 [0,4194304] 0 2024-09-13T17:05:30.478 INFO:tasks.workunit.client.0.smithi115.stdout:4/19: readlink l2 0 2024-09-13T17:05:30.478 INFO:tasks.workunit.client.0.smithi115.stdout:4/20: rmdir - no directory 2024-09-13T17:05:30.478 INFO:tasks.workunit.client.0.smithi115.stdout:4/21: write f3 [1388683,103156] 0 2024-09-13T17:05:30.478 INFO:tasks.workunit.client.0.smithi115.stdout:4/22: creat f4 x:0 0 0 2024-09-13T17:05:30.479 INFO:tasks.workunit.client.0.smithi115.stdout:4/23: creat f5 x:0 0 0 2024-09-13T17:05:30.479 INFO:tasks.workunit.client.0.smithi115.stdout:8/10: symlink d0/l3 0 2024-09-13T17:05:30.480 INFO:tasks.workunit.client.0.smithi115.stdout:6/12: unlink c1 0 2024-09-13T17:05:30.483 INFO:tasks.workunit.client.0.smithi115.stdout:3/4: link l0 d1/l3 0 2024-09-13T17:05:30.483 INFO:tasks.workunit.client.0.smithi115.stdout:3/5: chown d1/f2 1998 1 2024-09-13T17:05:30.484 INFO:tasks.workunit.client.0.smithi115.stdout:2/8: link f2 d3/f4 0 2024-09-13T17:05:30.484 INFO:tasks.workunit.client.0.smithi115.stdout:2/9: write f1 [979697,65959] 0 2024-09-13T17:05:30.487 INFO:tasks.workunit.client.0.smithi115.stdout:7/13: symlink d0/l3 0 2024-09-13T17:05:30.487 INFO:tasks.workunit.client.0.smithi115.stdout:7/14: stat d0/f1 0 2024-09-13T17:05:30.497 INFO:tasks.workunit.client.0.smithi115.stdout:8/11: symlink d0/l4 0 2024-09-13T17:05:30.497 INFO:tasks.workunit.client.0.smithi115.stdout:8/12: fsync - no filename 2024-09-13T17:05:30.499 INFO:tasks.workunit.client.0.smithi115.stdout:6/13: rename l0 to l2 0 2024-09-13T17:05:30.499 INFO:tasks.workunit.client.0.smithi115.stdout:6/14: fdatasync - no filename 2024-09-13T17:05:30.501 INFO:tasks.workunit.client.0.smithi115.stdout:2/10: mkdir d3/d5 0 2024-09-13T17:05:30.502 INFO:tasks.workunit.client.0.smithi115.stdout:3/6: dwrite d1/f2 [0,4194304] 0 2024-09-13T17:05:30.504 INFO:tasks.workunit.client.0.smithi115.stdout:4/24: rename f4 to f6 0 2024-09-13T17:05:30.505 INFO:tasks.workunit.client.0.smithi115.stdout:4/25: fdatasync f0 0 2024-09-13T17:05:30.506 INFO:tasks.workunit.client.0.smithi115.stdout:8/13: mknod d0/c5 0 2024-09-13T17:05:30.507 INFO:tasks.workunit.client.0.smithi115.stdout:6/15: creat f3 x:0 0 0 2024-09-13T17:05:30.508 INFO:tasks.workunit.client.0.smithi115.stdout:7/15: dwrite d0/f1 [0,4194304] 0 2024-09-13T17:05:30.511 INFO:tasks.workunit.client.0.smithi115.stdout:2/11: dread f1 [0,4194304] 0 2024-09-13T17:05:30.512 INFO:tasks.workunit.client.0.smithi115.stdout:3/7: write d1/f2 [2869709,61466] 0 2024-09-13T17:05:30.512 INFO:tasks.workunit.client.0.smithi115.stdout:3/8: read d1/f2 [3920045,25385] 0 2024-09-13T17:05:30.512 INFO:tasks.workunit.client.0.smithi115.stdout:3/9: stat d1 0 2024-09-13T17:05:30.513 INFO:tasks.workunit.client.0.smithi115.stdout:2/12: dread f1 [0,4194304] 0 2024-09-13T17:05:30.514 INFO:tasks.workunit.client.0.smithi115.stdout:4/26: mkdir d7 0 2024-09-13T17:05:30.514 INFO:tasks.workunit.client.0.smithi115.stdout:4/27: chown l2 2 1 2024-09-13T17:05:30.514 INFO:tasks.workunit.client.0.smithi115.stdout:4/28: truncate f5 107924 0 2024-09-13T17:05:30.515 INFO:tasks.workunit.client.0.smithi115.stdout:2/13: dread f1 [0,4194304] 0 2024-09-13T17:05:30.516 INFO:tasks.workunit.client.0.smithi115.stdout:8/14: mknod d0/c6 0 2024-09-13T17:05:30.516 INFO:tasks.workunit.client.0.smithi115.stdout:8/15: dwrite - no filename 2024-09-13T17:05:30.516 INFO:tasks.workunit.client.0.smithi115.stdout:8/16: read - no filename 2024-09-13T17:05:30.520 INFO:tasks.workunit.client.0.smithi115.stdout:7/16: link d0/l3 d0/l4 0 2024-09-13T17:05:30.521 INFO:tasks.workunit.client.0.smithi115.stdout:7/17: chown d0/f1 574 1 2024-09-13T17:05:30.522 INFO:tasks.workunit.client.0.smithi115.stdout:3/10: mknod d1/c4 0 2024-09-13T17:05:30.525 INFO:tasks.workunit.client.0.smithi115.stdout:2/14: creat d3/f6 x:0 0 0 2024-09-13T17:05:30.525 INFO:tasks.workunit.client.0.smithi115.stdout:2/15: write f2 [455489,98250] 0 2024-09-13T17:05:30.525 INFO:tasks.workunit.client.0.smithi115.stdout:2/16: write d3/f4 [738357,28446] 0 2024-09-13T17:05:30.525 INFO:tasks.workunit.client.0.smithi115.stdout:2/17: dread - d3/f6 zero size 2024-09-13T17:05:30.527 INFO:tasks.workunit.client.0.smithi115.stdout:8/17: rename d0/c5 to d0/c7 0 2024-09-13T17:05:30.529 INFO:tasks.workunit.client.0.smithi115.stdout:2/18: mknod d3/c7 0 2024-09-13T17:05:30.529 INFO:tasks.workunit.client.0.smithi115.stdout:2/19: fdatasync d3/f6 0 2024-09-13T17:05:30.531 INFO:tasks.workunit.client.0.smithi115.stdout:8/18: rmdir d0 39 2024-09-13T17:05:30.531 INFO:tasks.workunit.client.0.smithi115.stdout:8/19: write - no filename 2024-09-13T17:05:30.531 INFO:tasks.workunit.client.0.smithi115.stdout:8/20: truncate - no filename 2024-09-13T17:05:30.531 INFO:tasks.workunit.client.0.smithi115.stdout:8/21: truncate - no filename 2024-09-13T17:05:30.533 INFO:tasks.workunit.client.0.smithi115.stdout:2/20: creat d3/d5/f8 x:0 0 0 2024-09-13T17:05:30.535 INFO:tasks.workunit.client.0.smithi115.stdout:3/11: dread d1/f2 [0,4194304] 0 2024-09-13T17:05:30.535 INFO:tasks.workunit.client.0.smithi115.stdout:6/16: dwrite f3 [0,4194304] 0 2024-09-13T17:05:30.535 INFO:tasks.workunit.client.0.smithi115.stdout:3/12: write d1/f2 [3091802,24639] 0 2024-09-13T17:05:30.535 INFO:tasks.workunit.client.0.smithi115.stdout:3/13: chown d1/c4 323 1 2024-09-13T17:05:30.535 INFO:tasks.workunit.client.0.smithi115.stdout:3/14: write d1/f2 [276257,130849] 0 2024-09-13T17:05:30.536 INFO:tasks.workunit.client.0.smithi115.stdout:8/22: symlink d0/l8 0 2024-09-13T17:05:30.536 INFO:tasks.workunit.client.0.smithi115.stdout:8/23: dwrite - no filename 2024-09-13T17:05:30.537 INFO:tasks.workunit.client.0.smithi115.stdout:4/29: dwrite f3 [0,4194304] 0 2024-09-13T17:05:30.539 INFO:tasks.workunit.client.0.smithi115.stdout:2/21: link d3/f4 d3/d5/f9 0 2024-09-13T17:05:30.544 INFO:tasks.workunit.client.0.smithi115.stdout:7/18: dwrite d0/f1 [0,4194304] 0 2024-09-13T17:05:30.546 INFO:tasks.workunit.client.0.smithi115.stdout:4/30: rename f0 to d7/f8 0 2024-09-13T17:05:30.550 INFO:tasks.workunit.client.0.smithi115.stdout:3/15: dread d1/f2 [0,4194304] 0 2024-09-13T17:05:30.550 INFO:tasks.workunit.client.0.smithi115.stdout:3/16: write d1/f2 [1818749,27675] 0 2024-09-13T17:05:30.551 INFO:tasks.workunit.client.0.smithi115.stdout:4/31: creat d7/f9 x:0 0 0 2024-09-13T17:05:30.551 INFO:tasks.workunit.client.0.smithi115.stdout:4/32: creat d7/fa x:0 0 0 2024-09-13T17:05:30.563 INFO:tasks.workunit.client.0.smithi115.stdout:2/22: dwrite d3/d5/f9 [0,4194304] 0 2024-09-13T17:05:30.564 INFO:tasks.workunit.client.0.smithi115.stdout:6/17: dwrite f3 [0,4194304] 0 2024-09-13T17:05:30.570 INFO:tasks.workunit.client.0.smithi115.stdout:6/18: mknod c4 0 2024-09-13T17:05:30.590 INFO:tasks.workunit.client.0.smithi115.stdout:6/19: dwrite f3 [0,4194304] 0 2024-09-13T17:05:30.590 INFO:tasks.workunit.client.0.smithi115.stdout:6/20: rmdir - no directory 2024-09-13T17:05:30.590 INFO:tasks.workunit.client.0.smithi115.stdout:6/21: creat f5 x:0 0 0 2024-09-13T17:05:30.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:30 smithi195 ceph-mon[34981]: pgmap v4: 65 pgs: 65 active+clean; 182 MiB data, 858 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:05:30.928 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:30 smithi115 ceph-mon[27708]: pgmap v4: 65 pgs: 65 active+clean; 182 MiB data, 858 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:05:31.182 INFO:tasks.workunit.client.0.smithi115.stdout:1/10: rename l2 to l3 0 2024-09-13T17:05:31.182 INFO:tasks.workunit.client.0.smithi115.stdout:1/11: dread - no filename 2024-09-13T17:05:31.182 INFO:tasks.workunit.client.0.smithi115.stdout:1/12: chown l3 18 1 2024-09-13T17:05:31.182 INFO:tasks.workunit.client.0.smithi115.stdout:1/13: write - no filename 2024-09-13T17:05:31.182 INFO:tasks.workunit.client.0.smithi115.stdout:1/14: dwrite - no filename 2024-09-13T17:05:31.184 INFO:tasks.workunit.client.0.smithi115.stdout:1/15: symlink l4 0 2024-09-13T17:05:31.186 INFO:tasks.workunit.client.0.smithi115.stdout:1/16: stat l3 0 2024-09-13T17:05:31.186 INFO:tasks.workunit.client.0.smithi115.stdout:1/17: dwrite - no filename 2024-09-13T17:05:31.188 INFO:tasks.workunit.client.0.smithi115.stdout:1/18: mkdir d5 0 2024-09-13T17:05:31.188 INFO:tasks.workunit.client.0.smithi115.stdout:1/19: chown l4 223 1 2024-09-13T17:05:31.188 INFO:tasks.workunit.client.0.smithi115.stdout:1/20: fdatasync - no filename 2024-09-13T17:05:31.191 INFO:tasks.workunit.client.0.smithi115.stdout:1/21: creat d5/f6 x:0 0 0 2024-09-13T17:05:31.211 INFO:tasks.workunit.client.0.smithi115.stdout:1/22: dwrite d5/f6 [0,4194304] 0 2024-09-13T17:05:31.219 INFO:tasks.workunit.client.0.smithi115.stdout:1/23: write d5/f6 [286059,110501] 0 2024-09-13T17:05:31.222 INFO:tasks.workunit.client.0.smithi115.stdout:5/15: fsync f0 0 2024-09-13T17:05:31.224 INFO:tasks.workunit.client.0.smithi115.stdout:8/24: rmdir d0 39 2024-09-13T17:05:31.224 INFO:tasks.workunit.client.0.smithi115.stdout:8/25: stat d0/l8 0 2024-09-13T17:05:31.224 INFO:tasks.workunit.client.0.smithi115.stdout:8/26: chown d0/c2 0 1 2024-09-13T17:05:31.225 INFO:tasks.workunit.client.0.smithi115.stdout:5/16: rename f1 to f3 0 2024-09-13T17:05:31.225 INFO:tasks.workunit.client.0.smithi115.stdout:5/17: dread - f3 zero size 2024-09-13T17:05:31.226 INFO:tasks.workunit.client.0.smithi115.stdout:5/18: dread - f0 zero size 2024-09-13T17:05:31.226 INFO:tasks.workunit.client.0.smithi115.stdout:5/19: dread - f3 zero size 2024-09-13T17:05:31.226 INFO:tasks.workunit.client.0.smithi115.stdout:8/27: symlink d0/l9 0 2024-09-13T17:05:31.229 INFO:tasks.workunit.client.0.smithi115.stdout:5/20: mknod c4 0 2024-09-13T17:05:31.229 INFO:tasks.workunit.client.0.smithi115.stdout:5/21: readlink - no filename 2024-09-13T17:05:31.229 INFO:tasks.workunit.client.0.smithi115.stdout:5/22: write f3 [607657,69186] 0 2024-09-13T17:05:31.229 INFO:tasks.workunit.client.0.smithi115.stdout:5/23: creat f5 x:0 0 0 2024-09-13T17:05:31.229 INFO:tasks.workunit.client.0.smithi115.stdout:5/24: creat f6 x:0 0 0 2024-09-13T17:05:31.229 INFO:tasks.workunit.client.0.smithi115.stdout:5/25: creat f7 x:0 0 0 2024-09-13T17:05:31.239 INFO:tasks.workunit.client.0.smithi115.stdout:5/26: rename f7 to f8 0 2024-09-13T17:05:31.239 INFO:tasks.workunit.client.0.smithi115.stdout:5/27: dread - f0 zero size 2024-09-13T17:05:31.239 INFO:tasks.workunit.client.0.smithi115.stdout:5/28: creat f9 x:0 0 0 2024-09-13T17:05:31.240 INFO:tasks.workunit.client.0.smithi115.stdout:5/29: creat fa x:0 0 0 2024-09-13T17:05:31.245 INFO:tasks.workunit.client.0.smithi115.stdout:5/30: symlink lb 0 2024-09-13T17:05:31.245 INFO:tasks.workunit.client.0.smithi115.stdout:5/31: write f8 [310721,3489] 0 2024-09-13T17:05:31.256 INFO:tasks.workunit.client.0.smithi115.stdout:9/2: getdents d0 0 2024-09-13T17:05:31.256 INFO:tasks.workunit.client.0.smithi115.stdout:9/3: dwrite - no filename 2024-09-13T17:05:31.258 INFO:tasks.workunit.client.0.smithi115.stdout:9/4: mknod d0/c2 0 2024-09-13T17:05:31.260 INFO:tasks.workunit.client.0.smithi115.stdout:9/5: creat d0/f3 x:0 0 0 2024-09-13T17:05:31.261 INFO:tasks.workunit.client.0.smithi115.stdout:9/6: dread - d0/f3 zero size 2024-09-13T17:05:31.261 INFO:tasks.workunit.client.0.smithi115.stdout:9/7: truncate d0/f3 664777 0 2024-09-13T17:05:31.261 INFO:tasks.workunit.client.0.smithi115.stdout:9/8: chown d0/c2 1 1 2024-09-13T17:05:31.266 INFO:tasks.workunit.client.0.smithi115.stdout:9/9: rename d0/l1 to d0/l4 0 2024-09-13T17:05:31.292 INFO:tasks.workunit.client.0.smithi115.stdout:3/17: getdents d1 0 2024-09-13T17:05:31.309 INFO:tasks.workunit.client.0.smithi115.stdout:3/18: dwrite d1/f2 [0,4194304] 0 2024-09-13T17:05:31.311 INFO:tasks.workunit.client.0.smithi115.stdout:3/19: symlink d1/l5 0 2024-09-13T17:05:31.315 INFO:tasks.workunit.client.0.smithi115.stdout:4/33: getdents d7 0 2024-09-13T17:05:31.315 INFO:tasks.workunit.client.0.smithi115.stdout:4/34: write d7/f8 [338737,29921] 0 2024-09-13T17:05:31.315 INFO:tasks.workunit.client.0.smithi115.stdout:4/35: write d7/fa [749960,61295] 0 2024-09-13T17:05:31.318 INFO:tasks.workunit.client.0.smithi115.stdout:4/36: creat d7/fb x:0 0 0 2024-09-13T17:05:31.318 INFO:tasks.workunit.client.0.smithi115.stdout:4/37: fdatasync f5 0 2024-09-13T17:05:31.318 INFO:tasks.workunit.client.0.smithi115.stdout:4/38: dread - d7/f9 zero size 2024-09-13T17:05:31.318 INFO:tasks.workunit.client.0.smithi115.stdout:4/39: truncate d7/fb 745459 0 2024-09-13T17:05:31.319 INFO:tasks.workunit.client.0.smithi115.stdout:3/20: dread d1/f2 [0,4194304] 0 2024-09-13T17:05:31.322 INFO:tasks.workunit.client.0.smithi115.stdout:3/21: symlink d1/l6 0 2024-09-13T17:05:31.323 INFO:tasks.workunit.client.0.smithi115.stdout:4/40: dread d7/f8 [0,4194304] 0 2024-09-13T17:05:31.323 INFO:tasks.workunit.client.0.smithi115.stdout:3/22: creat d1/f7 x:0 0 0 2024-09-13T17:05:31.330 INFO:tasks.workunit.client.0.smithi115.stdout:2/23: truncate d3/d5/f9 2509706 0 2024-09-13T17:05:31.330 INFO:tasks.workunit.client.0.smithi115.stdout:2/24: creat d3/d5/fa x:0 0 0 2024-09-13T17:05:31.331 INFO:tasks.workunit.client.0.smithi115.stdout:2/25: write d3/d5/f8 [1002833,56581] 0 2024-09-13T17:05:31.331 INFO:tasks.workunit.client.0.smithi115.stdout:2/26: read - d3/d5/fa zero size 2024-09-13T17:05:31.337 INFO:tasks.workunit.client.0.smithi115.stdout:2/27: rename d3/f6 to d3/fb 0 2024-09-13T17:05:31.337 INFO:tasks.workunit.client.0.smithi115.stdout:2/28: creat d3/fc x:0 0 0 2024-09-13T17:05:31.343 INFO:tasks.workunit.client.0.smithi115.stdout:2/29: mkdir d3/d5/dd 0 2024-09-13T17:05:31.343 INFO:tasks.workunit.client.0.smithi115.stdout:2/30: chown d3/d5 6 1 2024-09-13T17:05:31.343 INFO:tasks.workunit.client.0.smithi115.stdout:4/41: dwrite f5 [0,4194304] 0 2024-09-13T17:05:31.343 INFO:tasks.workunit.client.0.smithi115.stdout:4/42: creat d7/fc x:0 0 0 2024-09-13T17:05:31.343 INFO:tasks.workunit.client.0.smithi115.stdout:3/23: dwrite d1/f7 [0,4194304] 0 2024-09-13T17:05:31.351 INFO:tasks.workunit.client.0.smithi115.stdout:4/43: mkdir d7/dd 0 2024-09-13T17:05:31.356 INFO:tasks.workunit.client.0.smithi115.stdout:3/24: symlink d1/l8 0 2024-09-13T17:05:31.356 INFO:tasks.workunit.client.0.smithi115.stdout:3/25: readlink d1/l5 0 2024-09-13T17:05:31.358 INFO:tasks.workunit.client.0.smithi115.stdout:4/44: mkdir d7/dd/de 0 2024-09-13T17:05:31.358 INFO:tasks.workunit.client.0.smithi115.stdout:4/45: readlink l2 0 2024-09-13T17:05:31.361 INFO:tasks.workunit.client.0.smithi115.stdout:3/26: unlink l0 0 2024-09-13T17:05:31.373 INFO:tasks.workunit.client.0.smithi115.stdout:4/46: dwrite d7/fb [0,4194304] 0 2024-09-13T17:05:31.775 INFO:tasks.workunit.client.0.smithi115.stdout:1/24: write d5/f6 [4558022,67139] 0 2024-09-13T17:05:31.778 INFO:tasks.workunit.client.0.smithi115.stdout:1/25: mkdir d5/d7 0 2024-09-13T17:05:31.778 INFO:tasks.workunit.client.0.smithi115.stdout:1/26: chown l4 47990 1 2024-09-13T17:05:31.778 INFO:tasks.workunit.client.0.smithi115.stdout:1/27: write d5/f6 [1152674,109005] 0 2024-09-13T17:05:31.778 INFO:tasks.workunit.client.0.smithi115.stdout:1/28: chown d5/d7 5 1 2024-09-13T17:05:31.779 INFO:tasks.workunit.client.0.smithi115.stdout:1/29: mknod d5/d7/c8 0 2024-09-13T17:05:31.779 INFO:tasks.workunit.client.0.smithi115.stdout:1/30: read d5/f6 [2437174,2690] 0 2024-09-13T17:05:31.786 INFO:tasks.workunit.client.0.smithi115.stdout:1/31: dread d5/f6 [0,4194304] 0 2024-09-13T17:05:31.790 INFO:tasks.workunit.client.0.smithi115.stdout:1/32: link l3 d5/l9 0 2024-09-13T17:05:31.821 INFO:tasks.workunit.client.0.smithi115.stdout:9/10: rmdir d0 39 2024-09-13T17:05:31.821 INFO:tasks.workunit.client.0.smithi115.stdout:9/11: chown d0/l4 311043 1 2024-09-13T17:05:31.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:31 smithi195 ceph-mon[34981]: mgrmap e23: smithi195.hjjifz(active, since 3s) 2024-09-13T17:05:31.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:31 smithi195 ceph-mon[34981]: [13/Sep/2024:17:05:30] ENGINE Bus STARTING 2024-09-13T17:05:31.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:31 smithi195 ceph-mon[34981]: [13/Sep/2024:17:05:30] ENGINE Serving on http://172.21.15.195:8765 2024-09-13T17:05:31.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:31 smithi195 ceph-mon[34981]: [13/Sep/2024:17:05:30] ENGINE Serving on https://172.21.15.195:7150 2024-09-13T17:05:31.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:31 smithi195 ceph-mon[34981]: [13/Sep/2024:17:05:30] ENGINE Bus STARTED 2024-09-13T17:05:31.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:31 smithi195 ceph-mon[34981]: [13/Sep/2024:17:05:30] ENGINE Error in HTTPServer.serve 2024-09-13T17:05:31.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Traceback (most recent call last): 2024-09-13T17:05:31.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T17:05:31.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: self._connections.run(self.expiration_interval) 2024-09-13T17:05:31.828 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T17:05:31.828 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: self._run(expiration_interval) 2024-09-13T17:05:31.828 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T17:05:31.828 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T17:05:31.828 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T17:05:31.828 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T17:05:31.828 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T17:05:31.828 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: s = self.context.wrap_socket( 2024-09-13T17:05:31.828 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T17:05:31.828 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: return self.sslsocket_class._create( 2024-09-13T17:05:31.828 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T17:05:31.829 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: self.do_handshake() 2024-09-13T17:05:31.829 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T17:05:31.829 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: self._sslobj.do_handshake() 2024-09-13T17:05:31.829 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T17:05:31.836 INFO:tasks.workunit.client.0.smithi115.stdout:9/12: dwrite d0/f3 [0,4194304] 0 2024-09-13T17:05:31.853 INFO:tasks.workunit.client.0.smithi115.stdout:9/13: dwrite d0/f3 [0,4194304] 0 2024-09-13T17:05:31.860 INFO:tasks.workunit.client.0.smithi115.stdout:4/47: getdents d7 0 2024-09-13T17:05:31.861 INFO:tasks.workunit.client.0.smithi115.stdout:4/48: readlink l2 0 2024-09-13T17:05:31.861 INFO:tasks.workunit.client.0.smithi115.stdout:4/49: fdatasync d7/f8 0 2024-09-13T17:05:31.861 INFO:tasks.workunit.client.0.smithi115.stdout:4/50: creat d7/dd/ff x:0 0 0 2024-09-13T17:05:31.862 INFO:tasks.workunit.client.0.smithi115.stdout:4/51: creat d7/dd/de/f10 x:0 0 0 2024-09-13T17:05:31.862 INFO:tasks.workunit.client.0.smithi115.stdout:4/52: fdatasync d7/f9 0 2024-09-13T17:05:31.862 INFO:tasks.workunit.client.0.smithi115.stdout:3/27: write d1/f7 [5060634,37886] 0 2024-09-13T17:05:31.863 INFO:tasks.workunit.client.0.smithi115.stdout:4/53: read d7/f8 [153044,123889] 0 2024-09-13T17:05:31.863 INFO:tasks.workunit.client.0.smithi115.stdout:4/54: dread - d7/dd/ff zero size 2024-09-13T17:05:31.863 INFO:tasks.workunit.client.0.smithi115.stdout:4/55: write d7/f9 [941933,113326] 0 2024-09-13T17:05:31.864 INFO:tasks.workunit.client.0.smithi115.stdout:3/28: link d1/f7 d1/f9 0 2024-09-13T17:05:31.865 INFO:tasks.workunit.client.0.smithi115.stdout:3/29: creat d1/fa x:0 0 0 2024-09-13T17:05:31.865 INFO:tasks.workunit.client.0.smithi115.stdout:2/31: dwrite f2 [0,4194304] 0 2024-09-13T17:05:31.865 INFO:tasks.workunit.client.0.smithi115.stdout:2/32: truncate d3/f4 4804894 0 2024-09-13T17:05:31.865 INFO:tasks.workunit.client.0.smithi115.stdout:2/33: write d3/d5/f8 [186073,98277] 0 2024-09-13T17:05:31.866 INFO:tasks.workunit.client.0.smithi115.stdout:4/56: link d7/fb d7/dd/f11 0 2024-09-13T17:05:31.868 INFO:tasks.workunit.client.0.smithi115.stdout:4/57: creat d7/f12 x:0 0 0 2024-09-13T17:05:31.870 INFO:tasks.workunit.client.0.smithi115.stdout:4/58: rename d7/f8 to d7/dd/de/f13 0 2024-09-13T17:05:31.871 INFO:tasks.workunit.client.0.smithi115.stdout:4/59: dread - d7/f12 zero size 2024-09-13T17:05:31.871 INFO:tasks.workunit.client.0.smithi115.stdout:4/60: write d7/dd/ff [351621,39316] 0 2024-09-13T17:05:31.876 INFO:tasks.workunit.client.0.smithi115.stdout:2/34: write d3/f4 [67453,91554] 0 2024-09-13T17:05:31.876 INFO:tasks.workunit.client.0.smithi115.stdout:2/35: dread - d3/d5/fa zero size 2024-09-13T17:05:31.878 INFO:tasks.workunit.client.0.smithi115.stdout:2/36: mkdir d3/d5/de 0 2024-09-13T17:05:31.878 INFO:tasks.workunit.client.0.smithi115.stdout:2/37: write d3/f4 [5048999,33427] 0 2024-09-13T17:05:31.895 INFO:tasks.workunit.client.0.smithi115.stdout:2/38: dwrite f2 [0,4194304] 0 2024-09-13T17:05:31.895 INFO:tasks.workunit.client.0.smithi115.stdout:2/39: write d3/d5/fa [24585,55759] 0 2024-09-13T17:05:31.895 INFO:tasks.workunit.client.0.smithi115.stdout:2/40: chown d3/d5/de 6895488 1 2024-09-13T17:05:31.896 INFO:tasks.workunit.client.0.smithi115.stdout:2/41: mkdir d3/d5/dd/df 0 2024-09-13T17:05:31.896 INFO:tasks.workunit.client.0.smithi115.stdout:2/42: dread - d3/fb zero size 2024-09-13T17:05:31.909 INFO:tasks.workunit.client.0.smithi115.stdout:2/43: dwrite f1 [0,4194304] 0 2024-09-13T17:05:31.911 INFO:tasks.workunit.client.0.smithi115.stdout:2/44: creat d3/d5/de/f10 x:0 0 0 2024-09-13T17:05:31.912 INFO:tasks.workunit.client.0.smithi115.stdout:2/45: mknod d3/c11 0 2024-09-13T17:05:31.914 INFO:tasks.workunit.client.0.smithi115.stdout:2/46: unlink d3/fb 0 2024-09-13T17:05:31.914 INFO:tasks.workunit.client.0.smithi115.stdout:2/47: write d3/d5/de/f10 [104270,82885] 0 2024-09-13T17:05:31.914 INFO:tasks.workunit.client.0.smithi115.stdout:2/48: stat d3 0 2024-09-13T17:05:31.914 INFO:tasks.workunit.client.0.smithi115.stdout:2/49: chown d3/d5/f9 85280826 1 2024-09-13T17:05:31.914 INFO:tasks.workunit.client.0.smithi115.stdout:2/50: mknod d3/c12 0 2024-09-13T17:05:31.914 INFO:tasks.workunit.client.0.smithi115.stdout:2/51: stat d3/d5/fa 0 2024-09-13T17:05:31.915 INFO:tasks.workunit.client.0.smithi115.stdout:2/52: unlink d3/fc 0 2024-09-13T17:05:31.928 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:31 smithi115 ceph-mon[27708]: mgrmap e23: smithi195.hjjifz(active, since 3s) 2024-09-13T17:05:31.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:31 smithi115 ceph-mon[27708]: [13/Sep/2024:17:05:30] ENGINE Bus STARTING 2024-09-13T17:05:31.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:31 smithi115 ceph-mon[27708]: [13/Sep/2024:17:05:30] ENGINE Serving on http://172.21.15.195:8765 2024-09-13T17:05:31.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:31 smithi115 ceph-mon[27708]: [13/Sep/2024:17:05:30] ENGINE Serving on https://172.21.15.195:7150 2024-09-13T17:05:31.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:31 smithi115 ceph-mon[27708]: [13/Sep/2024:17:05:30] ENGINE Bus STARTED 2024-09-13T17:05:31.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:31 smithi115 ceph-mon[27708]: [13/Sep/2024:17:05:30] ENGINE Error in HTTPServer.serve 2024-09-13T17:05:31.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Traceback (most recent call last): 2024-09-13T17:05:31.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T17:05:31.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: self._connections.run(self.expiration_interval) 2024-09-13T17:05:31.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T17:05:31.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: self._run(expiration_interval) 2024-09-13T17:05:31.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T17:05:31.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T17:05:31.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T17:05:31.930 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T17:05:31.930 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T17:05:31.930 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: s = self.context.wrap_socket( 2024-09-13T17:05:31.930 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T17:05:31.930 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: return self.sslsocket_class._create( 2024-09-13T17:05:31.930 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T17:05:31.930 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: self.do_handshake() 2024-09-13T17:05:31.930 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T17:05:31.930 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: self._sslobj.do_handshake() 2024-09-13T17:05:31.930 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T17:05:32.068 INFO:tasks.workunit.client.0.smithi115.stdout:3/30: rmdir d1 39 2024-09-13T17:05:32.071 INFO:tasks.workunit.client.0.smithi115.stdout:3/31: rmdir d1 39 2024-09-13T17:05:32.076 INFO:tasks.workunit.client.0.smithi115.stdout:2/53: getdents d3/d5 0 2024-09-13T17:05:32.080 INFO:tasks.workunit.client.0.smithi115.stdout:2/54: unlink f1 0 2024-09-13T17:05:32.081 INFO:tasks.workunit.client.0.smithi115.stdout:9/14: dwrite d0/f3 [4194304,4194304] 0 2024-09-13T17:05:32.087 INFO:tasks.workunit.client.0.smithi115.stdout:9/15: mknod d0/c5 0 2024-09-13T17:05:32.088 INFO:tasks.workunit.client.0.smithi115.stdout:2/55: write d3/f4 [1214370,2468] 0 2024-09-13T17:05:32.091 INFO:tasks.workunit.client.0.smithi115.stdout:2/56: mkdir d3/d5/d13 0 2024-09-13T17:05:32.091 INFO:tasks.workunit.client.0.smithi115.stdout:2/57: truncate d3/d5/de/f10 926387 0 2024-09-13T17:05:32.100 INFO:tasks.workunit.client.0.smithi115.stdout:3/32: mknod d1/cb 0 2024-09-13T17:05:32.103 INFO:tasks.workunit.client.0.smithi115.stdout:3/33: fsync d1/f7 0 2024-09-13T17:05:32.111 INFO:tasks.workunit.client.0.smithi115.stdout:9/16: getdents d0 0 2024-09-13T17:05:32.115 INFO:tasks.workunit.client.0.smithi115.stdout:9/17: creat d0/f6 x:0 0 0 2024-09-13T17:05:32.115 INFO:tasks.workunit.client.0.smithi115.stdout:9/18: stat d0 0 2024-09-13T17:05:32.122 INFO:tasks.workunit.client.0.smithi115.stdout:2/58: truncate d3/d5/de/f10 321148 0 2024-09-13T17:05:32.125 INFO:tasks.workunit.client.0.smithi115.stdout:2/59: rename d3/d5/f8 to d3/f14 0 2024-09-13T17:05:32.126 INFO:tasks.workunit.client.0.smithi115.stdout:9/19: dread d0/f3 [0,4194304] 0 2024-09-13T17:05:32.126 INFO:tasks.workunit.client.0.smithi115.stdout:3/34: getdents d1 0 2024-09-13T17:05:32.127 INFO:tasks.workunit.client.0.smithi115.stdout:3/35: getdents d1 0 2024-09-13T17:05:32.127 INFO:tasks.workunit.client.0.smithi115.stdout:3/36: truncate d1/fa 867052 0 2024-09-13T17:05:32.130 INFO:tasks.workunit.client.0.smithi115.stdout:3/37: symlink d1/lc 0 2024-09-13T17:05:32.138 INFO:tasks.workunit.client.0.smithi115.stdout:9/20: mknod d0/c7 0 2024-09-13T17:05:32.140 INFO:tasks.workunit.client.0.smithi115.stdout:3/38: rename d1 to d1/dd 22 2024-09-13T17:05:32.142 INFO:tasks.workunit.client.0.smithi115.stdout:3/39: read d1/fa [457745,43683] 0 2024-09-13T17:05:32.145 INFO:tasks.workunit.client.0.smithi115.stdout:3/40: write d1/f9 [4422086,10198] 0 2024-09-13T17:05:32.147 INFO:tasks.workunit.client.0.smithi115.stdout:2/60: rmdir d3 39 2024-09-13T17:05:32.153 INFO:tasks.workunit.client.0.smithi115.stdout:2/61: unlink l0 0 2024-09-13T17:05:32.153 INFO:tasks.workunit.client.0.smithi115.stdout:2/62: stat d3/d5/dd/df 0 2024-09-13T17:05:32.154 INFO:tasks.workunit.client.0.smithi115.stdout:2/63: rmdir d3 39 2024-09-13T17:05:32.175 INFO:tasks.workunit.client.0.smithi115.stdout:3/41: dwrite d1/f9 [0,4194304] 0 2024-09-13T17:05:32.176 INFO:tasks.workunit.client.0.smithi115.stdout:9/21: dwrite d0/f3 [4194304,4194304] 0 2024-09-13T17:05:32.180 INFO:tasks.workunit.client.0.smithi115.stdout:2/64: dwrite d3/f14 [0,4194304] 0 2024-09-13T17:05:32.181 INFO:tasks.workunit.client.0.smithi115.stdout:9/22: write d0/f3 [3089983,15001] 0 2024-09-13T17:05:32.181 INFO:tasks.workunit.client.0.smithi115.stdout:3/42: symlink d1/le 0 2024-09-13T17:05:32.194 INFO:tasks.workunit.client.0.smithi115.stdout:3/43: dread d1/f9 [0,4194304] 0 2024-09-13T17:05:32.210 INFO:tasks.workunit.client.0.smithi115.stdout:3/44: write d1/f9 [3903822,70549] 0 2024-09-13T17:05:32.212 INFO:tasks.workunit.client.0.smithi115.stdout:2/65: dwrite d3/d5/de/f10 [0,4194304] 0 2024-09-13T17:05:32.213 INFO:tasks.workunit.client.0.smithi115.stdout:9/23: dwrite d0/f3 [0,4194304] 0 2024-09-13T17:05:32.216 INFO:tasks.workunit.client.0.smithi115.stdout:3/45: dread d1/f9 [4194304,4194304] 0 2024-09-13T17:05:32.217 INFO:tasks.workunit.client.0.smithi115.stdout:2/66: creat d3/d5/de/f15 x:0 0 0 2024-09-13T17:05:32.221 INFO:tasks.workunit.client.0.smithi115.stdout:2/67: symlink d3/l16 0 2024-09-13T17:05:32.223 INFO:tasks.workunit.client.0.smithi115.stdout:9/24: link d0/f6 d0/f8 0 2024-09-13T17:05:32.224 INFO:tasks.workunit.client.0.smithi115.stdout:9/25: write d0/f6 [316487,47073] 0 2024-09-13T17:05:32.225 INFO:tasks.workunit.client.0.smithi115.stdout:3/46: mknod d1/cf 0 2024-09-13T17:05:32.228 INFO:tasks.workunit.client.0.smithi115.stdout:9/26: dread d0/f6 [0,4194304] 0 2024-09-13T17:05:32.228 INFO:tasks.workunit.client.0.smithi115.stdout:3/47: creat d1/f10 x:0 0 0 2024-09-13T17:05:32.229 INFO:tasks.workunit.client.0.smithi115.stdout:2/68: dread d3/f14 [0,4194304] 0 2024-09-13T17:05:32.234 INFO:tasks.workunit.client.0.smithi115.stdout:2/69: unlink d3/l16 0 2024-09-13T17:05:32.236 INFO:tasks.workunit.client.0.smithi115.stdout:3/48: symlink d1/l11 0 2024-09-13T17:05:32.237 INFO:tasks.workunit.client.0.smithi115.stdout:2/70: creat d3/d5/d13/f17 x:0 0 0 2024-09-13T17:05:32.240 INFO:tasks.workunit.client.0.smithi115.stdout:2/71: creat d3/f18 x:0 0 0 2024-09-13T17:05:32.242 INFO:tasks.workunit.client.0.smithi115.stdout:3/49: mkdir d1/d12 0 2024-09-13T17:05:32.243 INFO:tasks.workunit.client.0.smithi115.stdout:2/72: mknod d3/d5/dd/c19 0 2024-09-13T17:05:32.244 INFO:tasks.workunit.client.0.smithi115.stdout:2/73: creat d3/d5/d13/f1a x:0 0 0 2024-09-13T17:05:32.248 INFO:tasks.workunit.client.0.smithi115.stdout:2/74: truncate d3/f14 1243865 0 2024-09-13T17:05:32.248 INFO:tasks.workunit.client.0.smithi115.stdout:2/75: dread - d3/d5/de/f15 zero size 2024-09-13T17:05:32.250 INFO:tasks.workunit.client.0.smithi115.stdout:2/76: rename d3/d5/d13/f1a to d3/d5/dd/df/f1b 0 2024-09-13T17:05:32.252 INFO:tasks.workunit.client.0.smithi115.stdout:2/77: mkdir d3/d5/d13/d1c 0 2024-09-13T17:05:32.259 INFO:tasks.workunit.client.0.smithi115.stdout:9/27: getdents d0 0 2024-09-13T17:05:32.262 INFO:tasks.workunit.client.0.smithi115.stdout:3/50: dwrite d1/f10 [0,4194304] 0 2024-09-13T17:05:32.263 INFO:tasks.workunit.client.0.smithi115.stdout:9/28: mknod d0/c9 0 2024-09-13T17:05:32.265 INFO:tasks.workunit.client.0.smithi115.stdout:2/78: dread d3/d5/de/f10 [0,4194304] 0 2024-09-13T17:05:32.265 INFO:tasks.workunit.client.0.smithi115.stdout:2/79: fdatasync d3/f18 0 2024-09-13T17:05:32.277 INFO:tasks.workunit.client.0.smithi115.stdout:3/51: write d1/f10 [3831447,64791] 0 2024-09-13T17:05:32.277 INFO:tasks.workunit.client.0.smithi115.stdout:3/52: stat d1 0 2024-09-13T17:05:32.278 INFO:tasks.workunit.client.0.smithi115.stdout:9/29: dwrite d0/f6 [0,4194304] 0 2024-09-13T17:05:32.279 INFO:tasks.workunit.client.0.smithi115.stdout:2/80: mknod d3/d5/de/c1d 0 2024-09-13T17:05:32.279 INFO:tasks.workunit.client.0.smithi115.stdout:2/81: dread - d3/d5/de/f15 zero size 2024-09-13T17:05:32.279 INFO:tasks.workunit.client.0.smithi115.stdout:2/82: write f2 [3206939,130454] 0 2024-09-13T17:05:32.279 INFO:tasks.workunit.client.0.smithi115.stdout:2/83: stat d3/d5 0 2024-09-13T17:05:32.279 INFO:tasks.workunit.client.0.smithi115.stdout:2/84: write d3/f18 [42634,7600] 0 2024-09-13T17:05:32.280 INFO:tasks.workunit.client.0.smithi115.stdout:2/85: chown d3/d5/de/c1d 26793 1 2024-09-13T17:05:32.285 INFO:tasks.workunit.client.0.smithi115.stdout:3/53: read d1/f2 [3950837,83238] 0 2024-09-13T17:05:32.291 INFO:tasks.workunit.client.0.smithi115.stdout:3/54: dread d1/f2 [0,4194304] 0 2024-09-13T17:05:32.293 INFO:tasks.workunit.client.0.smithi115.stdout:9/30: mknod d0/ca 0 2024-09-13T17:05:32.300 INFO:tasks.workunit.client.0.smithi115.stdout:3/55: symlink d1/l13 0 2024-09-13T17:05:32.303 INFO:tasks.workunit.client.0.smithi115.stdout:3/56: chown d1/l3 135666 1 2024-09-13T17:05:32.305 INFO:tasks.workunit.client.0.smithi115.stdout:3/57: mkdir d1/d12/d14 0 2024-09-13T17:05:32.309 INFO:tasks.workunit.client.0.smithi115.stdout:3/58: symlink d1/d12/l15 0 2024-09-13T17:05:32.316 INFO:tasks.workunit.client.0.smithi115.stdout:3/59: dread d1/f10 [0,4194304] 0 2024-09-13T17:05:32.319 INFO:tasks.workunit.client.0.smithi115.stdout:9/31: write d0/f6 [4470761,39753] 0 2024-09-13T17:05:32.321 INFO:tasks.workunit.client.0.smithi115.stdout:3/60: dread d1/f2 [0,4194304] 0 2024-09-13T17:05:32.321 INFO:tasks.workunit.client.0.smithi115.stdout:3/61: chown d1 10649 1 2024-09-13T17:05:32.331 INFO:tasks.workunit.client.0.smithi115.stdout:2/86: truncate f2 3967886 0 2024-09-13T17:05:32.334 INFO:tasks.workunit.client.0.smithi115.stdout:2/87: fsync d3/f18 0 2024-09-13T17:05:32.340 INFO:tasks.workunit.client.0.smithi115.stdout:9/32: dwrite d0/f6 [4194304,4194304] 0 2024-09-13T17:05:32.341 INFO:tasks.workunit.client.0.smithi115.stdout:3/62: dwrite d1/fa [0,4194304] 0 2024-09-13T17:05:32.345 INFO:tasks.workunit.client.0.smithi115.stdout:9/33: creat d0/fb x:0 0 0 2024-09-13T17:05:32.349 INFO:tasks.workunit.client.0.smithi115.stdout:9/34: symlink d0/lc 0 2024-09-13T17:05:32.358 INFO:tasks.workunit.client.0.smithi115.stdout:2/88: write d3/d5/f9 [3721186,88624] 0 2024-09-13T17:05:32.359 INFO:tasks.workunit.client.0.smithi115.stdout:3/63: dwrite d1/f9 [0,4194304] 0 2024-09-13T17:05:32.360 INFO:tasks.workunit.client.0.smithi115.stdout:2/89: symlink d3/d5/d13/l1e 0 2024-09-13T17:05:32.360 INFO:tasks.workunit.client.0.smithi115.stdout:2/90: write d3/d5/f9 [2624175,19316] 0 2024-09-13T17:05:32.361 INFO:tasks.workunit.client.0.smithi115.stdout:2/91: dread d3/f18 [0,4194304] 0 2024-09-13T17:05:32.361 INFO:tasks.workunit.client.0.smithi115.stdout:2/92: chown d3/f4 26 1 2024-09-13T17:05:32.361 INFO:tasks.workunit.client.0.smithi115.stdout:2/93: chown d3/d5/dd/df 307073658 1 2024-09-13T17:05:32.362 INFO:tasks.workunit.client.0.smithi115.stdout:3/64: creat d1/f16 x:0 0 0 2024-09-13T17:05:32.364 INFO:tasks.workunit.client.0.smithi115.stdout:2/94: mkdir d3/d5/dd/d1f 0 2024-09-13T17:05:32.364 INFO:tasks.workunit.client.0.smithi115.stdout:2/95: chown d3/d5/d13/l1e 40 1 2024-09-13T17:05:32.366 INFO:tasks.workunit.client.0.smithi115.stdout:3/65: truncate d1/f2 1098155 0 2024-09-13T17:05:32.366 INFO:tasks.workunit.client.0.smithi115.stdout:3/66: dread - d1/f16 zero size 2024-09-13T17:05:32.366 INFO:tasks.workunit.client.0.smithi115.stdout:3/67: readlink d1/le 0 2024-09-13T17:05:32.366 INFO:tasks.workunit.client.0.smithi115.stdout:3/68: fdatasync d1/f2 0 2024-09-13T17:05:32.368 INFO:tasks.workunit.client.0.smithi115.stdout:2/96: mknod d3/c20 0 2024-09-13T17:05:32.368 INFO:tasks.workunit.client.0.smithi115.stdout:2/97: write f2 [2289655,96360] 0 2024-09-13T17:05:32.368 INFO:tasks.workunit.client.0.smithi115.stdout:3/69: mknod d1/d12/c17 0 2024-09-13T17:05:32.369 INFO:tasks.workunit.client.0.smithi115.stdout:2/98: mknod d3/d5/dd/d1f/c21 0 2024-09-13T17:05:32.369 INFO:tasks.workunit.client.0.smithi115.stdout:2/99: chown d3 0 1 2024-09-13T17:05:32.371 INFO:tasks.workunit.client.0.smithi115.stdout:9/35: rmdir d0 39 2024-09-13T17:05:32.371 INFO:tasks.workunit.client.0.smithi115.stdout:9/36: chown d0/f8 347486 1 2024-09-13T17:05:32.371 INFO:tasks.workunit.client.0.smithi115.stdout:9/37: fsync d0/f8 0 2024-09-13T17:05:32.372 INFO:tasks.workunit.client.0.smithi115.stdout:2/100: mkdir d3/d5/dd/df/d22 0 2024-09-13T17:05:32.375 INFO:tasks.workunit.client.0.smithi115.stdout:2/101: mknod d3/d5/d13/d1c/c23 0 2024-09-13T17:05:32.375 INFO:tasks.workunit.client.0.smithi115.stdout:2/102: write d3/d5/d13/f17 [171641,65001] 0 2024-09-13T17:05:32.375 INFO:tasks.workunit.client.0.smithi115.stdout:2/103: write d3/d5/fa [479134,114754] 0 2024-09-13T17:05:32.377 INFO:tasks.workunit.client.0.smithi115.stdout:9/38: rename d0/c9 to d0/cd 0 2024-09-13T17:05:32.377 INFO:tasks.workunit.client.0.smithi115.stdout:9/39: fdatasync d0/f8 0 2024-09-13T17:05:32.378 INFO:tasks.workunit.client.0.smithi115.stdout:2/104: unlink d3/d5/dd/c19 0 2024-09-13T17:05:32.381 INFO:tasks.workunit.client.0.smithi115.stdout:2/105: fsync d3/d5/f9 0 2024-09-13T17:05:32.383 INFO:tasks.workunit.client.0.smithi115.stdout:9/40: mkdir d0/de 0 2024-09-13T17:05:32.384 INFO:tasks.workunit.client.0.smithi115.stdout:9/41: truncate d0/fb 742223 0 2024-09-13T17:05:32.384 INFO:tasks.workunit.client.0.smithi115.stdout:9/42: chown d0/c7 2283172 1 2024-09-13T17:05:32.388 INFO:tasks.workunit.client.0.smithi115.stdout:2/106: rename d3/d5/d13/f17 to d3/d5/dd/df/f24 0 2024-09-13T17:05:32.393 INFO:tasks.workunit.client.0.smithi115.stdout:2/107: dread d3/d5/de/f10 [0,4194304] 0 2024-09-13T17:05:32.393 INFO:tasks.workunit.client.0.smithi115.stdout:2/108: fsync d3/f14 0 2024-09-13T17:05:32.393 INFO:tasks.workunit.client.0.smithi115.stdout:3/70: getdents d1/d12 0 2024-09-13T17:05:32.393 INFO:tasks.workunit.client.0.smithi115.stdout:3/71: read - d1/f16 zero size 2024-09-13T17:05:32.393 INFO:tasks.workunit.client.0.smithi115.stdout:3/72: write d1/f2 [1051293,33226] 0 2024-09-13T17:05:32.393 INFO:tasks.workunit.client.0.smithi115.stdout:3/73: fsync d1/fa 0 2024-09-13T17:05:32.396 INFO:tasks.workunit.client.0.smithi115.stdout:2/109: symlink d3/d5/dd/l25 0 2024-09-13T17:05:32.397 INFO:tasks.workunit.client.0.smithi115.stdout:2/110: write d3/d5/dd/df/f1b [792697,74143] 0 2024-09-13T17:05:32.400 INFO:tasks.workunit.client.0.smithi115.stdout:2/111: creat d3/d5/dd/df/d22/f26 x:0 0 0 2024-09-13T17:05:32.400 INFO:tasks.workunit.client.0.smithi115.stdout:2/112: chown d3/f4 1664 1 2024-09-13T17:05:32.400 INFO:tasks.workunit.client.0.smithi115.stdout:2/113: write d3/d5/dd/df/f1b [1066417,61600] 0 2024-09-13T17:05:32.403 INFO:tasks.workunit.client.0.smithi115.stdout:2/114: dread d3/f14 [0,4194304] 0 2024-09-13T17:05:32.409 INFO:tasks.workunit.client.0.smithi115.stdout:2/115: rmdir d3/d5/de 39 2024-09-13T17:05:32.409 INFO:tasks.workunit.client.0.smithi115.stdout:2/116: truncate d3/d5/fa 992897 0 2024-09-13T17:05:32.409 INFO:tasks.workunit.client.0.smithi115.stdout:2/117: write d3/d5/de/f15 [469659,63236] 0 2024-09-13T17:05:32.417 INFO:tasks.workunit.client.0.smithi115.stdout:3/74: dwrite d1/f7 [0,4194304] 0 2024-09-13T17:05:32.417 INFO:tasks.workunit.client.0.smithi115.stdout:3/75: dread - d1/f16 zero size 2024-09-13T17:05:32.422 INFO:tasks.workunit.client.0.smithi115.stdout:3/76: mkdir d1/d18 0 2024-09-13T17:05:32.422 INFO:tasks.workunit.client.0.smithi115.stdout:3/77: write d1/f2 [969680,85348] 0 2024-09-13T17:05:32.430 INFO:tasks.workunit.client.0.smithi115.stdout:2/118: dwrite d3/d5/de/f15 [0,4194304] 0 2024-09-13T17:05:32.436 INFO:tasks.workunit.client.0.smithi115.stdout:3/78: rmdir d1 39 2024-09-13T17:05:32.446 INFO:tasks.workunit.client.0.smithi115.stdout:2/119: dwrite d3/d5/dd/df/f24 [0,4194304] 0 2024-09-13T17:05:32.446 INFO:tasks.workunit.client.0.smithi115.stdout:2/120: stat d3/d5/dd/df 0 2024-09-13T17:05:32.446 INFO:tasks.workunit.client.0.smithi115.stdout:2/121: write d3/d5/f9 [1116598,117909] 0 2024-09-13T17:05:32.446 INFO:tasks.workunit.client.0.smithi115.stdout:2/122: write d3/d5/fa [825707,65298] 0 2024-09-13T17:05:32.454 INFO:tasks.workunit.client.0.smithi115.stdout:3/79: dwrite d1/f10 [0,4194304] 0 2024-09-13T17:05:32.466 INFO:tasks.workunit.client.0.smithi115.stdout:2/123: truncate d3/d5/dd/df/f24 2098483 0 2024-09-13T17:05:32.466 INFO:tasks.workunit.client.0.smithi115.stdout:2/124: readlink d3/d5/dd/l25 0 2024-09-13T17:05:32.468 INFO:tasks.workunit.client.0.smithi115.stdout:2/125: mknod d3/d5/de/c27 0 2024-09-13T17:05:32.470 INFO:tasks.workunit.client.0.smithi115.stdout:2/126: creat d3/d5/dd/df/f28 x:0 0 0 2024-09-13T17:05:32.470 INFO:tasks.workunit.client.0.smithi115.stdout:2/127: chown d3/d5/f9 459 1 2024-09-13T17:05:32.470 INFO:tasks.workunit.client.0.smithi115.stdout:2/128: creat d3/d5/dd/df/d22/f29 x:0 0 0 2024-09-13T17:05:32.473 INFO:tasks.workunit.client.0.smithi115.stdout:3/80: dwrite d1/f10 [0,4194304] 0 2024-09-13T17:05:32.474 INFO:tasks.workunit.client.0.smithi115.stdout:2/129: creat d3/d5/de/f2a x:0 0 0 2024-09-13T17:05:32.475 INFO:tasks.workunit.client.0.smithi115.stdout:3/81: creat d1/d12/d14/f19 x:0 0 0 2024-09-13T17:05:32.475 INFO:tasks.workunit.client.0.smithi115.stdout:3/82: write d1/f16 [143185,42770] 0 2024-09-13T17:05:32.475 INFO:tasks.workunit.client.0.smithi115.stdout:3/83: read - d1/d12/d14/f19 zero size 2024-09-13T17:05:32.477 INFO:tasks.workunit.client.0.smithi115.stdout:3/84: mkdir d1/d18/d1a 0 2024-09-13T17:05:32.485 INFO:tasks.workunit.client.0.smithi115.stdout:3/85: write d1/f10 [1616695,100735] 0 2024-09-13T17:05:32.487 INFO:tasks.workunit.client.0.smithi115.stdout:3/86: rmdir d1 39 2024-09-13T17:05:32.487 INFO:tasks.workunit.client.0.smithi115.stdout:3/87: write d1/f2 [1178031,122881] 0 2024-09-13T17:05:32.487 INFO:tasks.workunit.client.0.smithi115.stdout:2/130: fsync d3/d5/dd/df/f28 0 2024-09-13T17:05:32.487 INFO:tasks.workunit.client.0.smithi115.stdout:2/131: creat d3/d5/dd/df/d22/f2b x:0 0 0 2024-09-13T17:05:32.489 INFO:tasks.workunit.client.0.smithi115.stdout:3/88: link d1/f7 d1/d18/f1b 0 2024-09-13T17:05:32.489 INFO:tasks.workunit.client.0.smithi115.stdout:3/89: truncate d1/f16 196110 0 2024-09-13T17:05:32.491 INFO:tasks.workunit.client.0.smithi115.stdout:3/90: fsync d1/f10 0 2024-09-13T17:05:32.491 INFO:tasks.workunit.client.0.smithi115.stdout:3/91: truncate d1/d18/f1b 5215339 0 2024-09-13T17:05:32.491 INFO:tasks.workunit.client.0.smithi115.stdout:3/92: write d1/d12/d14/f19 [70204,62845] 0 2024-09-13T17:05:32.491 INFO:tasks.workunit.client.0.smithi115.stdout:2/132: mknod d3/d5/d13/d1c/c2c 0 2024-09-13T17:05:32.493 INFO:tasks.workunit.client.0.smithi115.stdout:3/93: fsync d1/f2 0 2024-09-13T17:05:32.495 INFO:tasks.workunit.client.0.smithi115.stdout:2/133: rename d3/d5/dd/df/f1b to d3/d5/dd/f2d 0 2024-09-13T17:05:32.506 INFO:tasks.workunit.client.0.smithi115.stdout:3/94: rename d1/d18 to d1/d1c 0 2024-09-13T17:05:32.509 INFO:tasks.workunit.client.0.smithi115.stdout:3/95: rename d1/f7 to d1/f1d 0 2024-09-13T17:05:32.515 INFO:tasks.workunit.client.0.smithi115.stdout:2/134: truncate d3/d5/dd/f2d 300809 0 2024-09-13T17:05:32.517 INFO:tasks.workunit.client.0.smithi115.stdout:2/135: mknod d3/d5/dd/df/d22/c2e 0 2024-09-13T17:05:32.524 INFO:tasks.workunit.client.0.smithi115.stdout:3/96: dwrite d1/d1c/f1b [0,4194304] 0 2024-09-13T17:05:32.528 INFO:tasks.workunit.client.0.smithi115.stdout:3/97: rename d1/lc to d1/l1e 0 2024-09-13T17:05:32.534 INFO:tasks.workunit.client.0.smithi115.stdout:3/98: dread d1/d12/d14/f19 [0,4194304] 0 2024-09-13T17:05:32.539 INFO:tasks.workunit.client.0.smithi115.stdout:3/99: rename d1/c4 to d1/c1f 0 2024-09-13T17:05:32.539 INFO:tasks.workunit.client.0.smithi115.stdout:3/100: truncate d1/f16 254249 0 2024-09-13T17:05:32.542 INFO:tasks.workunit.client.0.smithi115.stdout:3/101: creat d1/d1c/d1a/f20 x:0 0 0 2024-09-13T17:05:32.549 INFO:tasks.workunit.client.0.smithi115.stdout:2/136: dwrite d3/d5/dd/f2d [0,4194304] 0 2024-09-13T17:05:32.550 INFO:tasks.workunit.client.0.smithi115.stdout:2/137: fsync d3/d5/de/f10 0 2024-09-13T17:05:32.552 INFO:tasks.workunit.client.0.smithi115.stdout:3/102: dread d1/d1c/f1b [0,4194304] 0 2024-09-13T17:05:32.552 INFO:tasks.workunit.client.0.smithi115.stdout:3/103: fsync d1/d12/d14/f19 0 2024-09-13T17:05:32.554 INFO:tasks.workunit.client.0.smithi115.stdout:2/138: mkdir d3/d5/dd/d1f/d2f 0 2024-09-13T17:05:32.554 INFO:tasks.workunit.client.0.smithi115.stdout:2/139: chown d3/d5/dd/df/d22/f2b 19 1 2024-09-13T17:05:32.557 INFO:tasks.workunit.client.0.smithi115.stdout:3/104: creat d1/d1c/f21 x:0 0 0 2024-09-13T17:05:32.559 INFO:tasks.workunit.client.0.smithi115.stdout:2/140: getdents d3/d5 0 2024-09-13T17:05:32.562 INFO:tasks.workunit.client.0.smithi115.stdout:3/105: dread d1/f9 [0,4194304] 0 2024-09-13T17:05:32.562 INFO:tasks.workunit.client.0.smithi115.stdout:2/141: symlink d3/d5/dd/l30 0 2024-09-13T17:05:32.562 INFO:tasks.workunit.client.0.smithi115.stdout:2/142: rename d3/d5 to d3/d5/d13/d31 22 2024-09-13T17:05:32.565 INFO:tasks.workunit.client.0.smithi115.stdout:3/106: symlink d1/d12/d14/l22 0 2024-09-13T17:05:32.565 INFO:tasks.workunit.client.0.smithi115.stdout:3/107: stat d1/d12/d14/l22 0 2024-09-13T17:05:32.568 INFO:tasks.workunit.client.0.smithi115.stdout:3/108: mkdir d1/d12/d23 0 2024-09-13T17:05:32.589 INFO:tasks.workunit.client.0.smithi115.stdout:3/109: dwrite d1/f10 [0,4194304] 0 2024-09-13T17:05:32.603 INFO:tasks.workunit.client.0.smithi115.stdout:3/110: dwrite d1/d1c/d1a/f20 [0,4194304] 0 2024-09-13T17:05:32.603 INFO:tasks.workunit.client.0.smithi115.stdout:3/111: readlink d1/le 0 2024-09-13T17:05:32.608 INFO:tasks.workunit.client.0.smithi115.stdout:3/112: dread d1/f9 [0,4194304] 0 2024-09-13T17:05:32.608 INFO:tasks.workunit.client.0.smithi115.stdout:3/113: chown d1/d1c/d1a 142 1 2024-09-13T17:05:32.611 INFO:tasks.workunit.client.0.smithi115.stdout:3/114: rename d1/d12/d14/l22 to d1/d1c/l24 0 2024-09-13T17:05:32.616 INFO:tasks.workunit.client.0.smithi115.stdout:3/115: getdents d1/d12 0 2024-09-13T17:05:32.663 INFO:tasks.workunit.client.0.smithi115.stdout:3/116: rename d1/d1c to d1/d12/d23/d25 0 2024-09-13T17:05:32.666 INFO:tasks.workunit.client.0.smithi115.stdout:3/117: dread d1/f2 [0,4194304] 0 2024-09-13T17:05:32.675 INFO:tasks.workunit.client.0.smithi115.stdout:3/118: dread d1/f10 [0,4194304] 0 2024-09-13T17:05:32.675 INFO:tasks.workunit.client.0.smithi115.stdout:3/119: fdatasync d1/f9 0 2024-09-13T17:05:32.675 INFO:tasks.workunit.client.0.smithi115.stdout:3/120: readlink d1/l1e 0 2024-09-13T17:05:32.676 INFO:tasks.workunit.client.0.smithi115.stdout:3/121: rmdir d1/d12 39 2024-09-13T17:05:32.676 INFO:tasks.workunit.client.0.smithi115.stdout:3/122: write d1/d12/d23/d25/f21 [532906,96231] 0 2024-09-13T17:05:32.693 INFO:tasks.workunit.client.0.smithi115.stdout:3/123: dwrite d1/f1d [0,4194304] 0 2024-09-13T17:05:32.693 INFO:tasks.workunit.client.0.smithi115.stdout:3/124: stat d1/d12/c17 0 2024-09-13T17:05:32.701 INFO:tasks.workunit.client.0.smithi115.stdout:3/125: dread d1/d12/d23/d25/d1a/f20 [0,4194304] 0 2024-09-13T17:05:32.701 INFO:tasks.workunit.client.0.smithi115.stdout:3/126: write d1/d12/d14/f19 [1150077,35727] 0 2024-09-13T17:05:32.701 INFO:tasks.workunit.client.0.smithi115.stdout:3/127: readlink d1/le 0 2024-09-13T17:05:32.817 INFO:tasks.workunit.client.0.smithi115.stdout:3/128: mknod d1/d12/c26 0 2024-09-13T17:05:32.825 INFO:tasks.workunit.client.0.smithi115.stdout:3/129: creat d1/d12/d23/d25/d1a/f27 x:0 0 0 2024-09-13T17:05:32.826 INFO:tasks.workunit.client.0.smithi115.stdout:3/130: symlink d1/d12/d23/l28 0 2024-09-13T17:05:32.923 INFO:tasks.workunit.client.0.smithi115.stdout:3/131: getdents d1/d12/d23/d25/d1a 0 2024-09-13T17:05:32.924 INFO:tasks.workunit.client.0.smithi115.stdout:3/132: write d1/d12/d14/f19 [291936,11708] 0 2024-09-13T17:05:32.924 INFO:tasks.workunit.client.0.smithi115.stdout:3/133: stat d1/l11 0 2024-09-13T17:05:32.932 INFO:tasks.workunit.client.0.smithi115.stdout:3/134: write d1/f1d [819691,50001] 0 2024-09-13T17:05:32.934 INFO:tasks.workunit.client.0.smithi115.stdout:3/135: symlink d1/d12/d23/l29 0 2024-09-13T17:05:32.935 INFO:tasks.workunit.client.0.smithi115.stdout:3/136: rmdir d1 39 2024-09-13T17:05:32.935 INFO:tasks.workunit.client.0.smithi115.stdout:3/137: write d1/f2 [2239040,105133] 0 2024-09-13T17:05:32.935 INFO:tasks.workunit.client.0.smithi115.stdout:3/138: fsync d1/d12/d23/d25/d1a/f27 0 2024-09-13T17:05:32.935 INFO:tasks.workunit.client.0.smithi115.stdout:3/139: chown d1/d12/d23/d25/d1a 7 1 2024-09-13T17:05:32.956 INFO:tasks.workunit.client.0.smithi115.stdout:3/140: dwrite d1/d12/d23/d25/d1a/f27 [0,4194304] 0 2024-09-13T17:05:32.957 INFO:tasks.workunit.client.0.smithi115.stdout:3/141: readlink d1/l3 0 2024-09-13T17:05:32.957 INFO:tasks.workunit.client.0.smithi115.stdout:3/142: creat d1/d12/d14/f2a x:0 0 0 2024-09-13T17:05:32.962 INFO:tasks.workunit.client.0.smithi115.stdout:3/143: creat d1/d12/d23/d25/f2b x:0 0 0 2024-09-13T17:05:32.962 INFO:tasks.workunit.client.0.smithi115.stdout:3/144: write d1/d12/d23/d25/f1b [2563265,33104] 0 2024-09-13T17:05:32.980 INFO:tasks.workunit.client.0.smithi115.stdout:3/145: dwrite d1/f10 [0,4194304] 0 2024-09-13T17:05:32.982 INFO:tasks.workunit.client.0.smithi115.stdout:3/146: unlink d1/cf 0 2024-09-13T17:05:32.997 INFO:tasks.workunit.client.0.smithi115.stdout:3/147: dwrite d1/d12/d23/d25/d1a/f20 [4194304,4194304] 0 2024-09-13T17:05:32.997 INFO:tasks.workunit.client.0.smithi115.stdout:3/148: write d1/f16 [764190,106299] 0 2024-09-13T17:05:32.997 INFO:tasks.workunit.client.0.smithi115.stdout:3/149: chown d1/l1e 22 1 2024-09-13T17:05:33.054 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:32 smithi115 ceph-mon[27708]: pgmap v5: 65 pgs: 65 active+clean; 182 MiB data, 858 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:05:33.054 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:32 smithi115 ceph-mon[27708]: from='mgr.24317 ' entity='mgr.smithi195.hjjifz' 2024-09-13T17:05:33.055 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:32 smithi115 ceph-mon[27708]: from='mgr.24317 ' entity='mgr.smithi195.hjjifz' 2024-09-13T17:05:33.055 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:32 smithi115 ceph-mon[27708]: from='mgr.24317 ' entity='mgr.smithi195.hjjifz' 2024-09-13T17:05:33.055 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:32 smithi115 ceph-mon[27708]: from='mgr.24317 ' entity='mgr.smithi195.hjjifz' 2024-09-13T17:05:33.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:32 smithi195 ceph-mon[34981]: pgmap v5: 65 pgs: 65 active+clean; 182 MiB data, 858 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:05:33.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:32 smithi195 ceph-mon[34981]: from='mgr.24317 ' entity='mgr.smithi195.hjjifz' 2024-09-13T17:05:33.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:32 smithi195 ceph-mon[34981]: from='mgr.24317 ' entity='mgr.smithi195.hjjifz' 2024-09-13T17:05:33.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:32 smithi195 ceph-mon[34981]: from='mgr.24317 ' entity='mgr.smithi195.hjjifz' 2024-09-13T17:05:33.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:32 smithi195 ceph-mon[34981]: from='mgr.24317 ' entity='mgr.smithi195.hjjifz' 2024-09-13T17:05:33.180 INFO:tasks.workunit.client.0.smithi115.stdout:3/150: truncate d1/f2 1710753 0 2024-09-13T17:05:33.180 INFO:tasks.workunit.client.0.smithi115.stdout:3/151: stat d1/d12/d14/f2a 0 2024-09-13T17:05:33.181 INFO:tasks.workunit.client.0.smithi115.stdout:3/152: chown d1/d12/d23 8450425 1 2024-09-13T17:05:33.181 INFO:tasks.workunit.client.0.smithi115.stdout:3/153: write d1/d12/d23/d25/f1b [3174831,39479] 0 2024-09-13T17:05:33.181 INFO:tasks.workunit.client.0.smithi115.stdout:3/154: fdatasync d1/fa 0 2024-09-13T17:05:33.182 INFO:tasks.workunit.client.0.smithi115.stdout:3/155: creat d1/d12/d23/d25/d1a/f2c x:0 0 0 2024-09-13T17:05:33.182 INFO:tasks.workunit.client.0.smithi115.stdout:3/156: creat d1/d12/d14/f2d x:0 0 0 2024-09-13T17:05:33.188 INFO:tasks.workunit.client.0.smithi115.stdout:3/157: dread d1/d12/d14/f19 [0,4194304] 0 2024-09-13T17:05:33.293 INFO:tasks.workunit.client.0.smithi115.stdout:3/158: rmdir d1 39 2024-09-13T17:05:33.296 INFO:tasks.workunit.client.0.smithi115.stdout:3/159: creat d1/d12/d14/f2e x:0 0 0 2024-09-13T17:05:33.298 INFO:tasks.workunit.client.0.smithi115.stdout:3/160: mknod d1/d12/d23/d25/d1a/c2f 0 2024-09-13T17:05:33.305 INFO:tasks.workunit.client.0.smithi115.stdout:3/161: write d1/d12/d23/d25/d1a/f20 [7229489,71233] 0 2024-09-13T17:05:33.320 INFO:tasks.workunit.client.0.smithi115.stdout:3/162: dwrite d1/d12/d14/f2a [0,4194304] 0 2024-09-13T17:05:33.324 INFO:tasks.workunit.client.0.smithi115.stdout:3/163: mkdir d1/d12/d23/d25/d1a/d30 0 2024-09-13T17:05:33.324 INFO:tasks.workunit.client.0.smithi115.stdout:3/164: write d1/fa [4946936,4846] 0 2024-09-13T17:05:33.416 INFO:tasks.workunit.client.0.smithi115.stdout:3/165: getdents d1/d12/d23/d25/d1a 0 2024-09-13T17:05:33.418 INFO:tasks.workunit.client.0.smithi115.stdout:3/166: mknod d1/d12/d23/d25/d1a/d30/c31 0 2024-09-13T17:05:33.422 INFO:tasks.workunit.client.0.smithi115.stdout:3/167: mknod d1/c32 0 2024-09-13T17:05:33.561 INFO:tasks.workunit.client.0.smithi115.stdout:3/168: truncate d1/f1d 1428591 0 2024-09-13T17:05:33.561 INFO:tasks.workunit.client.0.smithi115.stdout:3/169: mknod d1/d12/d23/d25/c33 0 2024-09-13T17:05:33.561 INFO:tasks.workunit.client.0.smithi115.stdout:3/170: write d1/d12/d23/d25/d1a/f27 [5077985,118600] 0 2024-09-13T17:05:33.563 INFO:tasks.workunit.client.0.smithi115.stdout:3/171: rename d1/l13 to d1/d12/d14/l34 0 2024-09-13T17:05:33.563 INFO:tasks.workunit.client.0.smithi115.stdout:3/172: fsync d1/d12/d14/f2a 0 2024-09-13T17:05:33.563 INFO:tasks.workunit.client.0.smithi115.stdout:3/173: creat d1/d12/d14/f35 x:0 0 0 2024-09-13T17:05:33.566 INFO:tasks.workunit.client.0.smithi115.stdout:3/174: creat d1/d12/d23/d25/d1a/d30/f36 x:0 0 0 2024-09-13T17:05:33.566 INFO:tasks.workunit.client.0.smithi115.stdout:3/175: creat d1/d12/d23/d25/d1a/d30/f37 x:0 0 0 2024-09-13T17:05:33.566 INFO:tasks.workunit.client.0.smithi115.stdout:3/176: chown d1/d12/d23/l29 0 1 2024-09-13T17:05:33.566 INFO:tasks.workunit.client.0.smithi115.stdout:3/177: creat d1/d12/d23/d25/d1a/d30/f38 x:0 0 0 2024-09-13T17:05:33.566 INFO:tasks.workunit.client.0.smithi115.stdout:3/178: creat d1/d12/d23/d25/d1a/d30/f39 x:0 0 0 2024-09-13T17:05:33.566 INFO:tasks.workunit.client.0.smithi115.stdout:3/179: chown d1/d12/d23/d25/d1a/f2c 23329606 1 2024-09-13T17:05:33.566 INFO:tasks.workunit.client.0.smithi115.stdout:3/180: fdatasync d1/d12/d23/d25/d1a/d30/f38 0 2024-09-13T17:05:33.584 INFO:tasks.workunit.client.0.smithi115.stdout:3/181: dwrite d1/d12/d23/d25/d1a/f20 [0,4194304] 0 2024-09-13T17:05:33.663 INFO:tasks.workunit.client.0.smithi115.stdout:3/182: read d1/f1d [1076370,110221] 0 2024-09-13T17:05:33.663 INFO:tasks.workunit.client.0.smithi115.stdout:3/183: write d1/d12/d23/d25/d1a/d30/f36 [470124,78353] 0 2024-09-13T17:05:33.663 INFO:tasks.workunit.client.0.smithi115.stdout:3/184: dread - d1/d12/d14/f2e zero size 2024-09-13T17:05:33.663 INFO:tasks.workunit.client.0.smithi115.stdout:3/185: truncate d1/d12/d23/d25/f1b 2062512 0 2024-09-13T17:05:33.664 INFO:tasks.workunit.client.0.smithi115.stdout:3/186: readlink d1/l5 0 2024-09-13T17:05:33.666 INFO:tasks.workunit.client.0.smithi115.stdout:3/187: creat d1/d12/d23/f3a x:0 0 0 2024-09-13T17:05:33.667 INFO:tasks.workunit.client.0.smithi115.stdout:3/188: symlink d1/d12/d23/d25/d1a/d30/l3b 0 2024-09-13T17:05:33.668 INFO:tasks.workunit.client.0.smithi115.stdout:3/189: rename d1/d12/d23/d25/d1a/d30/f38 to d1/d12/d23/d25/d1a/d30/f3c 0 2024-09-13T17:05:33.670 INFO:tasks.workunit.client.0.smithi115.stdout:3/190: symlink d1/d12/d23/d25/d1a/d30/l3d 0 2024-09-13T17:05:33.670 INFO:tasks.workunit.client.0.smithi115.stdout:3/191: creat d1/d12/d14/f3e x:0 0 0 2024-09-13T17:05:33.679 INFO:tasks.workunit.client.0.smithi115.stdout:3/192: fsync d1/d12/d23/d25/d1a/d30/f39 0 2024-09-13T17:05:33.679 INFO:tasks.workunit.client.0.smithi115.stdout:3/193: stat d1/c1f 0 2024-09-13T17:05:33.681 INFO:tasks.workunit.client.0.smithi115.stdout:3/194: write d1/d12/d14/f19 [1099196,33790] 0 2024-09-13T17:05:33.681 INFO:tasks.workunit.client.0.smithi115.stdout:3/195: write d1/d12/d23/d25/f1b [130870,81082] 0 2024-09-13T17:05:33.683 INFO:tasks.workunit.client.0.smithi115.stdout:3/196: mknod d1/d12/d23/d25/c3f 0 2024-09-13T17:05:33.683 INFO:tasks.workunit.client.0.smithi115.stdout:3/197: chown d1/d12/d14 399542 1 2024-09-13T17:05:33.687 INFO:tasks.workunit.client.0.smithi115.stdout:3/198: symlink d1/l40 0 2024-09-13T17:05:33.756 INFO:tasks.workunit.client.0.smithi115.stdout:3/199: fsync d1/d12/d23/f3a 0 2024-09-13T17:05:33.756 INFO:tasks.workunit.client.0.smithi115.stdout:3/200: fdatasync d1/d12/d14/f2d 0 2024-09-13T17:05:33.756 INFO:tasks.workunit.client.0.smithi115.stdout:3/201: stat d1/d12/c26 0 2024-09-13T17:05:33.760 INFO:tasks.workunit.client.0.smithi115.stdout:3/202: symlink d1/l41 0 2024-09-13T17:05:33.760 INFO:tasks.workunit.client.0.smithi115.stdout:3/203: fsync d1/d12/d14/f35 0 2024-09-13T17:05:33.762 INFO:tasks.workunit.client.0.smithi115.stdout:3/204: mknod d1/d12/d14/c42 0 2024-09-13T17:05:33.763 INFO:tasks.workunit.client.0.smithi115.stdout:3/205: stat d1/d12/d14/l34 0 2024-09-13T17:05:33.763 INFO:tasks.workunit.client.0.smithi115.stdout:3/206: chown d1/f10 0 1 2024-09-13T17:05:33.781 INFO:tasks.workunit.client.0.smithi115.stdout:3/207: dwrite d1/d12/d23/d25/f21 [0,4194304] 0 2024-09-13T17:05:33.783 INFO:tasks.workunit.client.0.smithi115.stdout:3/208: symlink d1/d12/d23/d25/l43 0 2024-09-13T17:05:33.785 INFO:tasks.workunit.client.0.smithi115.stdout:3/209: symlink d1/d12/d23/d25/l44 0 2024-09-13T17:05:33.787 INFO:tasks.workunit.client.0.smithi115.stdout:3/210: link d1/d12/d23/d25/f1b d1/d12/f45 0 2024-09-13T17:05:33.790 INFO:tasks.workunit.client.0.smithi115.stdout:3/211: mknod d1/d12/c46 0 2024-09-13T17:05:33.790 INFO:tasks.workunit.client.0.smithi115.stdout:3/212: fsync d1/d12/d14/f35 0 2024-09-13T17:05:33.791 INFO:tasks.workunit.client.0.smithi115.stdout:3/213: chown d1/d12 801292901 1 2024-09-13T17:05:33.807 INFO:tasks.workunit.client.0.smithi115.stdout:3/214: dwrite d1/d12/d23/d25/f21 [0,4194304] 0 2024-09-13T17:05:33.809 INFO:tasks.workunit.client.0.smithi115.stdout:3/215: mknod d1/d12/d14/c47 0 2024-09-13T17:05:33.809 INFO:tasks.workunit.client.0.smithi115.stdout:3/216: dread - d1/d12/d23/d25/d1a/d30/f3c zero size 2024-09-13T17:05:33.809 INFO:tasks.workunit.client.0.smithi115.stdout:3/217: creat d1/d12/d23/f48 x:0 0 0 2024-09-13T17:05:33.810 INFO:tasks.workunit.client.0.smithi115.stdout:3/218: write d1/f1d [1545671,59857] 0 2024-09-13T17:05:33.899 INFO:tasks.workunit.client.0.smithi115.stdout:3/219: truncate d1/d12/d14/f19 607166 0 2024-09-13T17:05:33.900 INFO:tasks.workunit.client.0.smithi115.stdout:3/220: rmdir d1 39 2024-09-13T17:05:35.076 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:34 smithi195 ceph-mon[34981]: pgmap v6: 65 pgs: 65 active+clean; 214 MiB data, 950 MiB used, 535 GiB / 536 GiB avail; 5.8 MiB/s rd, 9.2 MiB/s wr, 29 op/s 2024-09-13T17:05:35.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:34 smithi195 ceph-mon[34981]: Standby manager daemon smithi115.hetcni started 2024-09-13T17:05:35.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:34 smithi195 ceph-mon[34981]: from='mgr.? 172.21.15.115:0/11734999' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi115.hetcni/crt"}]: dispatch 2024-09-13T17:05:35.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:34 smithi195 ceph-mon[34981]: from='mgr.? 172.21.15.115:0/11734999' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T17:05:35.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:34 smithi195 ceph-mon[34981]: from='mgr.? 172.21.15.115:0/11734999' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi115.hetcni/key"}]: dispatch 2024-09-13T17:05:35.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:34 smithi195 ceph-mon[34981]: from='mgr.? 172.21.15.115:0/11734999' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T17:05:35.178 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:34 smithi115 ceph-mon[27708]: pgmap v6: 65 pgs: 65 active+clean; 214 MiB data, 950 MiB used, 535 GiB / 536 GiB avail; 5.8 MiB/s rd, 9.2 MiB/s wr, 29 op/s 2024-09-13T17:05:35.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:34 smithi115 ceph-mon[27708]: Standby manager daemon smithi115.hetcni started 2024-09-13T17:05:35.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:34 smithi115 ceph-mon[27708]: from='mgr.? 172.21.15.115:0/11734999' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi115.hetcni/crt"}]: dispatch 2024-09-13T17:05:35.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:34 smithi115 ceph-mon[27708]: from='mgr.? 172.21.15.115:0/11734999' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T17:05:35.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:34 smithi115 ceph-mon[27708]: from='mgr.? 172.21.15.115:0/11734999' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi115.hetcni/key"}]: dispatch 2024-09-13T17:05:35.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:34 smithi115 ceph-mon[27708]: from='mgr.? 172.21.15.115:0/11734999' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T17:05:35.260 INFO:tasks.workunit.client.1.smithi195.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-13T17:05:35.260 INFO:tasks.workunit.client.1.smithi195.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-13T17:05:35.261 INFO:tasks.workunit.client.1.smithi195.stderr:+ make 2024-09-13T17:05:35.512 INFO:tasks.workunit.client.1.smithi195.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-13T17:05:35.899 INFO:tasks.workunit.client.1.smithi195.stderr:++ readlink -f fsstress 2024-09-13T17:05:35.900 INFO:tasks.workunit.client.1.smithi195.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-13T17:05:35.901 INFO:tasks.workunit.client.1.smithi195.stderr:+ popd 2024-09-13T17:05:35.901 INFO:tasks.workunit.client.1.smithi195.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-13T17:05:35.901 INFO:tasks.workunit.client.1.smithi195.stderr:+ popd 2024-09-13T17:05:35.901 INFO:tasks.workunit.client.1.smithi195.stdout:~/cephtest/mnt.1/client.1/tmp 2024-09-13T17:05:35.902 INFO:tasks.workunit.client.1.smithi195.stderr:++ mktemp -d -p . 2024-09-13T17:05:35.902 INFO:tasks.workunit.client.1.smithi195.stderr:+ T=./tmp.TwgO5kqBcR 2024-09-13T17:05:35.902 INFO:tasks.workunit.client.1.smithi195.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.TwgO5kqBcR -l 1 -n 1000 -p 10 -v 2024-09-13T17:05:35.903 INFO:tasks.workunit.client.1.smithi195.stdout:seed = 1726593640 2024-09-13T17:05:35.905 INFO:tasks.workunit.client.1.smithi195.stdout:0/0: truncate - no filename 2024-09-13T17:05:35.905 INFO:tasks.workunit.client.1.smithi195.stdout:0/1: write - no filename 2024-09-13T17:05:35.905 INFO:tasks.workunit.client.1.smithi195.stdout:0/2: dwrite - no filename 2024-09-13T17:05:35.905 INFO:tasks.workunit.client.1.smithi195.stdout:0/3: rename - no filename 2024-09-13T17:05:35.905 INFO:tasks.workunit.client.1.smithi195.stdout:0/4: rename - no filename 2024-09-13T17:05:35.906 INFO:tasks.workunit.client.1.smithi195.stdout:1/0: dwrite - no filename 2024-09-13T17:05:35.906 INFO:tasks.workunit.client.1.smithi195.stdout:1/1: link - no file 2024-09-13T17:05:35.906 INFO:tasks.workunit.client.1.smithi195.stdout:1/2: write - no filename 2024-09-13T17:05:35.906 INFO:tasks.workunit.client.1.smithi195.stdout:1/3: dwrite - no filename 2024-09-13T17:05:36.049 INFO:tasks.workunit.client.1.smithi195.stdout:0/5: creat f0 x:0 0 0 2024-09-13T17:05:36.049 INFO:tasks.workunit.client.1.smithi195.stdout:2/0: chown . 8582238 1 2024-09-13T17:05:36.049 INFO:tasks.workunit.client.1.smithi195.stdout:2/1: rmdir - no directory 2024-09-13T17:05:36.049 INFO:tasks.workunit.client.1.smithi195.stdout:2/2: fdatasync - no filename 2024-09-13T17:05:36.049 INFO:tasks.workunit.client.1.smithi195.stdout:2/3: truncate - no filename 2024-09-13T17:05:36.050 INFO:tasks.workunit.client.1.smithi195.stdout:1/4: mknod c0 0 2024-09-13T17:05:36.052 INFO:tasks.workunit.client.1.smithi195.stdout:2/4: mkdir d0 0 2024-09-13T17:05:36.052 INFO:tasks.workunit.client.1.smithi195.stdout:2/5: unlink - no file 2024-09-13T17:05:36.052 INFO:tasks.workunit.client.1.smithi195.stdout:2/6: dread - no filename 2024-09-13T17:05:36.052 INFO:tasks.workunit.client.1.smithi195.stdout:2/7: truncate - no filename 2024-09-13T17:05:36.052 INFO:tasks.workunit.client.1.smithi195.stdout:2/8: stat d0 0 2024-09-13T17:05:36.052 INFO:tasks.workunit.client.1.smithi195.stdout:2/9: chown d0 3314852 1 2024-09-13T17:05:36.052 INFO:tasks.workunit.client.1.smithi195.stdout:2/10: getdents d0 0 2024-09-13T17:05:36.053 INFO:tasks.workunit.client.1.smithi195.stdout:2/11: write - no filename 2024-09-13T17:05:36.053 INFO:tasks.workunit.client.1.smithi195.stdout:2/12: write - no filename 2024-09-13T17:05:36.053 INFO:tasks.workunit.client.1.smithi195.stdout:1/5: mknod c1 0 2024-09-13T17:05:36.056 INFO:tasks.workunit.client.1.smithi195.stdout:4/0: read - no filename 2024-09-13T17:05:36.057 INFO:tasks.workunit.client.1.smithi195.stdout:3/0: mkdir d0 0 2024-09-13T17:05:36.057 INFO:tasks.workunit.client.1.smithi195.stdout:3/1: getdents d0 0 2024-09-13T17:05:36.057 INFO:tasks.workunit.client.1.smithi195.stdout:3/2: truncate - no filename 2024-09-13T17:05:36.057 INFO:tasks.workunit.client.1.smithi195.stdout:3/3: getdents d0 0 2024-09-13T17:05:36.057 INFO:tasks.workunit.client.1.smithi195.stdout:3/4: dwrite - no filename 2024-09-13T17:05:36.057 INFO:tasks.workunit.client.1.smithi195.stdout:3/5: fsync - no filename 2024-09-13T17:05:36.057 INFO:tasks.workunit.client.1.smithi195.stdout:3/6: dwrite - no filename 2024-09-13T17:05:36.057 INFO:tasks.workunit.client.1.smithi195.stdout:3/7: chown d0 2 1 2024-09-13T17:05:36.057 INFO:tasks.workunit.client.1.smithi195.stdout:2/13: mknod d0/c1 0 2024-09-13T17:05:36.057 INFO:tasks.workunit.client.1.smithi195.stdout:1/6: creat f2 x:0 0 0 2024-09-13T17:05:36.057 INFO:tasks.workunit.client.1.smithi195.stdout:1/7: chown c1 246191209 1 2024-09-13T17:05:36.057 INFO:tasks.workunit.client.1.smithi195.stdout:5/0: truncate - no filename 2024-09-13T17:05:36.058 INFO:tasks.workunit.client.1.smithi195.stdout:4/1: creat f0 x:0 0 0 2024-09-13T17:05:36.058 INFO:tasks.workunit.client.1.smithi195.stdout:4/2: creat f1 x:0 0 0 2024-09-13T17:05:36.058 INFO:tasks.workunit.client.1.smithi195.stdout:4/3: creat f2 x:0 0 0 2024-09-13T17:05:36.058 INFO:tasks.workunit.client.1.smithi195.stdout:2/14: creat d0/f2 x:0 0 0 2024-09-13T17:05:36.058 INFO:tasks.workunit.client.1.smithi195.stdout:2/15: chown d0/f2 1900 1 2024-09-13T17:05:36.059 INFO:tasks.workunit.client.1.smithi195.stdout:6/0: truncate - no filename 2024-09-13T17:05:36.059 INFO:tasks.workunit.client.1.smithi195.stdout:6/1: dwrite - no filename 2024-09-13T17:05:36.059 INFO:tasks.workunit.client.1.smithi195.stdout:6/2: chown . 2872473 1 2024-09-13T17:05:36.059 INFO:tasks.workunit.client.1.smithi195.stdout:6/3: dread - no filename 2024-09-13T17:05:36.059 INFO:tasks.workunit.client.1.smithi195.stdout:5/1: creat f0 x:0 0 0 2024-09-13T17:05:36.061 INFO:tasks.workunit.client.1.smithi195.stdout:4/4: mknod c3 0 2024-09-13T17:05:36.062 INFO:tasks.workunit.client.1.smithi195.stdout:2/16: unlink d0/f2 0 2024-09-13T17:05:36.062 INFO:tasks.workunit.client.1.smithi195.stdout:2/17: fdatasync - no filename 2024-09-13T17:05:36.062 INFO:tasks.workunit.client.1.smithi195.stdout:7/0: chown . 20 1 2024-09-13T17:05:36.062 INFO:tasks.workunit.client.1.smithi195.stdout:7/1: getdents . 0 2024-09-13T17:05:36.063 INFO:tasks.workunit.client.1.smithi195.stdout:6/4: creat f0 x:0 0 0 2024-09-13T17:05:36.063 INFO:tasks.workunit.client.1.smithi195.stdout:5/2: unlink f0 0 2024-09-13T17:05:36.064 INFO:tasks.workunit.client.1.smithi195.stdout:5/3: fdatasync - no filename 2024-09-13T17:05:36.064 INFO:tasks.workunit.client.1.smithi195.stdout:5/4: creat f1 x:0 0 0 2024-09-13T17:05:36.064 INFO:tasks.workunit.client.1.smithi195.stdout:5/5: dread - f1 zero size 2024-09-13T17:05:36.064 INFO:tasks.workunit.client.1.smithi195.stdout:3/8: rmdir d0 0 2024-09-13T17:05:36.064 INFO:tasks.workunit.client.1.smithi195.stdout:3/9: fsync - no filename 2024-09-13T17:05:36.065 INFO:tasks.workunit.client.1.smithi195.stdout:3/10: unlink - no file 2024-09-13T17:05:36.065 INFO:tasks.workunit.client.1.smithi195.stdout:3/11: dread - no filename 2024-09-13T17:05:36.065 INFO:tasks.workunit.client.1.smithi195.stdout:2/18: mkdir d0/d3 0 2024-09-13T17:05:36.066 INFO:tasks.workunit.client.1.smithi195.stdout:7/2: symlink l0 0 2024-09-13T17:05:36.066 INFO:tasks.workunit.client.1.smithi195.stdout:6/5: mknod c1 0 2024-09-13T17:05:36.070 INFO:tasks.workunit.client.1.smithi195.stdout:8/0: chown . 0 1 2024-09-13T17:05:36.070 INFO:tasks.workunit.client.1.smithi195.stdout:8/1: link - no file 2024-09-13T17:05:36.070 INFO:tasks.workunit.client.1.smithi195.stdout:5/6: mkdir d2 0 2024-09-13T17:05:36.070 INFO:tasks.workunit.client.1.smithi195.stdout:5/7: read - f1 zero size 2024-09-13T17:05:36.071 INFO:tasks.workunit.client.1.smithi195.stdout:2/19: creat d0/d3/f4 x:0 0 0 2024-09-13T17:05:36.071 INFO:tasks.workunit.client.1.smithi195.stdout:2/20: chown d0/d3 26 1 2024-09-13T17:05:36.071 INFO:tasks.workunit.client.1.smithi195.stdout:2/21: stat d0/d3/f4 0 2024-09-13T17:05:36.073 INFO:tasks.workunit.client.1.smithi195.stdout:7/3: link l0 l1 0 2024-09-13T17:05:36.073 INFO:tasks.workunit.client.1.smithi195.stdout:7/4: fdatasync - no filename 2024-09-13T17:05:36.074 INFO:tasks.workunit.client.1.smithi195.stdout:8/2: mkdir d0 0 2024-09-13T17:05:36.075 INFO:tasks.workunit.client.1.smithi195.stdout:8/3: truncate - no filename 2024-09-13T17:05:36.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:35 smithi195 ceph-mon[34981]: mgrmap e24: smithi195.hjjifz(active, since 7s), standbys: smithi115.hetcni 2024-09-13T17:05:36.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:35 smithi195 ceph-mon[34981]: from='mgr.24317 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "mgr metadata", "who": "smithi115.hetcni", "id": "smithi115.hetcni"}]: dispatch 2024-09-13T17:05:36.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:35 smithi195 ceph-mon[34981]: from='mgr.24317 ' entity='mgr.smithi195.hjjifz' 2024-09-13T17:05:36.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:35 smithi195 ceph-mon[34981]: from='mgr.24317 ' entity='mgr.smithi195.hjjifz' 2024-09-13T17:05:36.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:35 smithi195 ceph-mon[34981]: from='mgr.24317 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:05:36.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:35 smithi195 ceph-mon[34981]: from='mgr.24317 ' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:05:36.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:35 smithi195 ceph-mon[34981]: from='mgr.24317 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:05:36.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:35 smithi195 ceph-mon[34981]: from='mgr.24317 ' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:05:36.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:35 smithi195 ceph-mon[34981]: from='mgr.24317 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:05:36.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:35 smithi195 ceph-mon[34981]: from='mgr.24317 ' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:05:36.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:35 smithi195 ceph-mon[34981]: from='mgr.24317 ' entity='mgr.smithi195.hjjifz' 2024-09-13T17:05:36.078 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:35 smithi115 ceph-mon[27708]: mgrmap e24: smithi195.hjjifz(active, since 7s), standbys: smithi115.hetcni 2024-09-13T17:05:36.078 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:35 smithi115 ceph-mon[27708]: from='mgr.24317 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "mgr metadata", "who": "smithi115.hetcni", "id": "smithi115.hetcni"}]: dispatch 2024-09-13T17:05:36.078 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:35 smithi115 ceph-mon[27708]: from='mgr.24317 ' entity='mgr.smithi195.hjjifz' 2024-09-13T17:05:36.078 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:35 smithi115 ceph-mon[27708]: from='mgr.24317 ' entity='mgr.smithi195.hjjifz' 2024-09-13T17:05:36.078 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:35 smithi115 ceph-mon[27708]: from='mgr.24317 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:05:36.078 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:35 smithi115 ceph-mon[27708]: from='mgr.24317 ' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:05:36.078 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:35 smithi115 ceph-mon[27708]: from='mgr.24317 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:05:36.078 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:35 smithi115 ceph-mon[27708]: from='mgr.24317 ' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:05:36.078 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:35 smithi115 ceph-mon[27708]: from='mgr.24317 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:05:36.078 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:35 smithi115 ceph-mon[27708]: from='mgr.24317 ' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:05:36.079 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:35 smithi115 ceph-mon[27708]: from='mgr.24317 ' entity='mgr.smithi195.hjjifz' 2024-09-13T17:05:36.079 INFO:tasks.workunit.client.1.smithi195.stdout:7/5: rename l1 to l2 0 2024-09-13T17:05:36.079 INFO:tasks.workunit.client.1.smithi195.stdout:7/6: write - no filename 2024-09-13T17:05:36.081 INFO:tasks.workunit.client.1.smithi195.stdout:8/4: mknod d0/c1 0 2024-09-13T17:05:36.081 INFO:tasks.workunit.client.1.smithi195.stdout:8/5: fsync - no filename 2024-09-13T17:05:36.081 INFO:tasks.workunit.client.1.smithi195.stdout:8/6: dread - no filename 2024-09-13T17:05:36.084 INFO:tasks.workunit.client.1.smithi195.stdout:8/7: symlink d0/l2 0 2024-09-13T17:05:36.084 INFO:tasks.workunit.client.1.smithi195.stdout:8/8: chown d0 4142967 1 2024-09-13T17:05:36.085 INFO:tasks.workunit.client.1.smithi195.stdout:8/9: truncate - no filename 2024-09-13T17:05:36.085 INFO:tasks.workunit.client.1.smithi195.stdout:8/10: truncate - no filename 2024-09-13T17:05:36.149 INFO:tasks.workunit.client.1.smithi195.stdout:0/6: dwrite f0 [0,4194304] 0 2024-09-13T17:05:36.439 INFO:tasks.workunit.client.1.smithi195.stdout:5/8: dwrite f1 [0,4194304] 0 2024-09-13T17:05:36.880 INFO:tasks.workunit.client.1.smithi195.stdout:0/7: write f0 [398061,112421] 0 2024-09-13T17:05:36.880 INFO:tasks.workunit.client.1.smithi195.stdout:0/8: rmdir - no directory 2024-09-13T17:05:36.890 INFO:tasks.workunit.client.1.smithi195.stdout:4/5: getdents . 0 2024-09-13T17:05:36.895 INFO:tasks.workunit.client.1.smithi195.stdout:6/6: getdents . 0 2024-09-13T17:05:36.895 INFO:tasks.workunit.client.1.smithi195.stdout:2/22: rmdir d0/d3 39 2024-09-13T17:05:36.895 INFO:tasks.workunit.client.1.smithi195.stdout:2/23: fsync d0/d3/f4 0 2024-09-13T17:05:36.895 INFO:tasks.workunit.client.1.smithi195.stdout:7/7: getdents . 0 2024-09-13T17:05:36.937 INFO:tasks.workunit.client.1.smithi195.stdout:0/9: dwrite f0 [0,4194304] 0 2024-09-13T17:05:36.974 INFO:tasks.workunit.client.1.smithi195.stdout:5/9: dread f1 [0,4194304] 0 2024-09-13T17:05:36.979 INFO:tasks.workunit.client.1.smithi195.stdout:5/10: read f1 [663576,90475] 0 2024-09-13T17:05:37.076 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:36 smithi195 ceph-mon[34981]: Adjusting osd_memory_target on smithi195 to 2240M 2024-09-13T17:05:37.076 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:36 smithi195 ceph-mon[34981]: pgmap v7: 65 pgs: 65 active+clean; 299 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 28 MiB/s wr, 113 op/s 2024-09-13T17:05:37.178 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:36 smithi115 ceph-mon[27708]: Adjusting osd_memory_target on smithi195 to 2240M 2024-09-13T17:05:37.178 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:36 smithi115 ceph-mon[27708]: pgmap v7: 65 pgs: 65 active+clean; 299 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 28 MiB/s wr, 113 op/s 2024-09-13T17:05:38.990 INFO:tasks.workunit.client.1.smithi195.stdout:4/6: mknod c4 0 2024-09-13T17:05:38.990 INFO:tasks.workunit.client.1.smithi195.stdout:4/7: fdatasync f1 0 2024-09-13T17:05:38.990 INFO:tasks.workunit.client.1.smithi195.stdout:6/7: rename f0 to f2 0 2024-09-13T17:05:38.991 INFO:tasks.workunit.client.1.smithi195.stdout:2/24: mknod d0/d3/c5 0 2024-09-13T17:05:38.991 INFO:tasks.workunit.client.1.smithi195.stdout:2/25: chown d0/d3/c5 47982 1 2024-09-13T17:05:38.991 INFO:tasks.workunit.client.1.smithi195.stdout:2/26: dread - d0/d3/f4 zero size 2024-09-13T17:05:38.991 INFO:tasks.workunit.client.1.smithi195.stdout:2/27: write d0/d3/f4 [890383,58960] 0 2024-09-13T17:05:38.992 INFO:tasks.workunit.client.1.smithi195.stdout:7/8: creat f3 x:0 0 0 2024-09-13T17:05:38.992 INFO:tasks.workunit.client.1.smithi195.stdout:7/9: creat f4 x:0 0 0 2024-09-13T17:05:39.016 INFO:tasks.workunit.client.1.smithi195.stdout:6/8: dwrite f2 [0,4194304] 0 2024-09-13T17:05:39.016 INFO:tasks.workunit.client.1.smithi195.stdout:4/8: dwrite f0 [0,4194304] 0 2024-09-13T17:05:39.016 INFO:tasks.workunit.client.1.smithi195.stdout:4/9: write f2 [664460,105422] 0 2024-09-13T17:05:39.016 INFO:tasks.workunit.client.1.smithi195.stdout:4/10: fsync f0 0 2024-09-13T17:05:39.024 INFO:tasks.workunit.client.1.smithi195.stdout:6/9: dread f2 [0,4194304] 0 2024-09-13T17:05:39.029 INFO:tasks.workunit.client.1.smithi195.stdout:6/10: dread f2 [0,4194304] 0 2024-09-13T17:05:39.034 INFO:tasks.workunit.client.1.smithi195.stdout:6/11: dread f2 [0,4194304] 0 2024-09-13T17:05:39.048 INFO:tasks.workunit.client.1.smithi195.stdout:0/10: rename f0 to f1 0 2024-09-13T17:05:39.059 INFO:tasks.workunit.client.1.smithi195.stdout:0/11: read f1 [3575563,109223] 0 2024-09-13T17:05:39.059 INFO:tasks.workunit.client.1.smithi195.stdout:0/12: write f1 [763262,43923] 0 2024-09-13T17:05:39.059 INFO:tasks.workunit.client.1.smithi195.stdout:0/13: write f1 [1894456,45164] 0 2024-09-13T17:05:39.059 INFO:tasks.workunit.client.1.smithi195.stdout:0/14: write f1 [1791182,39020] 0 2024-09-13T17:05:39.059 INFO:tasks.workunit.client.1.smithi195.stdout:0/15: write f1 [1548481,114896] 0 2024-09-13T17:05:39.062 INFO:tasks.workunit.client.1.smithi195.stdout:0/16: fdatasync f1 0 2024-09-13T17:05:39.076 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:38 smithi195 ceph-mon[34981]: pgmap v8: 65 pgs: 65 active+clean; 299 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 15 MiB/s rd, 21 MiB/s wr, 87 op/s 2024-09-13T17:05:39.091 INFO:tasks.workunit.client.1.smithi195.stdout:5/11: creat d2/f3 x:0 0 0 2024-09-13T17:05:39.091 INFO:tasks.workunit.client.1.smithi195.stdout:5/12: write d2/f3 [1019308,60168] 0 2024-09-13T17:05:39.095 INFO:tasks.workunit.client.1.smithi195.stdout:5/13: dread d2/f3 [0,4194304] 0 2024-09-13T17:05:39.163 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:38 smithi115 ceph-mon[27708]: pgmap v8: 65 pgs: 65 active+clean; 299 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 15 MiB/s rd, 21 MiB/s wr, 87 op/s 2024-09-13T17:05:39.269 INFO:tasks.workunit.client.0.smithi115.stdout:1/33: sync 2024-09-13T17:05:39.269 INFO:tasks.workunit.client.0.smithi115.stdout:3/221: sync 2024-09-13T17:05:39.269 INFO:tasks.workunit.client.0.smithi115.stdout:5/32: sync 2024-09-13T17:05:39.269 INFO:tasks.workunit.client.0.smithi115.stdout:8/28: sync 2024-09-13T17:05:39.269 INFO:tasks.workunit.client.0.smithi115.stdout:8/29: dread - no filename 2024-09-13T17:05:39.270 INFO:tasks.workunit.client.0.smithi115.stdout:3/222: read - d1/d12/d23/f3a zero size 2024-09-13T17:05:39.270 INFO:tasks.workunit.client.0.smithi115.stdout:1/34: fdatasync d5/f6 0 2024-09-13T17:05:39.270 INFO:tasks.workunit.client.0.smithi115.stdout:6/22: sync 2024-09-13T17:05:39.270 INFO:tasks.workunit.client.0.smithi115.stdout:4/61: sync 2024-09-13T17:05:39.270 INFO:tasks.workunit.client.0.smithi115.stdout:0/8: sync 2024-09-13T17:05:39.270 INFO:tasks.workunit.client.0.smithi115.stdout:0/9: rmdir - no directory 2024-09-13T17:05:39.270 INFO:tasks.workunit.client.0.smithi115.stdout:7/19: sync 2024-09-13T17:05:39.270 INFO:tasks.workunit.client.0.smithi115.stdout:9/43: sync 2024-09-13T17:05:39.270 INFO:tasks.workunit.client.0.smithi115.stdout:2/143: sync 2024-09-13T17:05:39.270 INFO:tasks.workunit.client.0.smithi115.stdout:9/44: dread d0/fb [0,4194304] 0 2024-09-13T17:05:39.277 INFO:tasks.workunit.client.0.smithi115.stdout:4/62: write d7/fb [2999737,3859] 0 2024-09-13T17:05:39.277 INFO:tasks.workunit.client.0.smithi115.stdout:5/33: rename fa to fc 0 2024-09-13T17:05:39.277 INFO:tasks.workunit.client.0.smithi115.stdout:5/34: creat fd x:0 0 0 2024-09-13T17:05:39.277 INFO:tasks.workunit.client.0.smithi115.stdout:5/35: chown f3 471 1 2024-09-13T17:05:39.277 INFO:tasks.workunit.client.0.smithi115.stdout:5/36: dread - f0 zero size 2024-09-13T17:05:39.277 INFO:tasks.workunit.client.0.smithi115.stdout:5/37: chown f3 250406 1 2024-09-13T17:05:39.278 INFO:tasks.workunit.client.0.smithi115.stdout:8/30: link d0/c6 d0/ca 0 2024-09-13T17:05:39.281 INFO:tasks.workunit.client.0.smithi115.stdout:3/223: symlink d1/d12/d14/l49 0 2024-09-13T17:05:39.287 INFO:tasks.workunit.client.0.smithi115.stdout:0/10: creat f0 x:0 0 0 2024-09-13T17:05:39.288 INFO:tasks.workunit.client.0.smithi115.stdout:0/11: chown f0 195320043 1 2024-09-13T17:05:39.288 INFO:tasks.workunit.client.0.smithi115.stdout:0/12: rmdir - no directory 2024-09-13T17:05:39.288 INFO:tasks.workunit.client.0.smithi115.stdout:0/13: dread - f0 zero size 2024-09-13T17:05:39.288 INFO:tasks.workunit.client.0.smithi115.stdout:0/14: rmdir - no directory 2024-09-13T17:05:39.288 INFO:tasks.workunit.client.0.smithi115.stdout:0/15: creat f1 x:0 0 0 2024-09-13T17:05:39.288 INFO:tasks.workunit.client.0.smithi115.stdout:0/16: creat f2 x:0 0 0 2024-09-13T17:05:39.297 INFO:tasks.workunit.client.0.smithi115.stdout:3/224: dwrite d1/d12/d14/f35 [0,4194304] 0 2024-09-13T17:05:39.298 INFO:tasks.workunit.client.0.smithi115.stdout:5/38: unlink f6 0 2024-09-13T17:05:39.299 INFO:tasks.workunit.client.0.smithi115.stdout:5/39: write f8 [775857,15520] 0 2024-09-13T17:05:39.299 INFO:tasks.workunit.client.0.smithi115.stdout:5/40: read - f9 zero size 2024-09-13T17:05:39.299 INFO:tasks.workunit.client.0.smithi115.stdout:5/41: creat fe x:0 0 0 2024-09-13T17:05:39.299 INFO:tasks.workunit.client.0.smithi115.stdout:5/42: dread - f0 zero size 2024-09-13T17:05:39.299 INFO:tasks.workunit.client.0.smithi115.stdout:5/43: fsync f0 0 2024-09-13T17:05:39.300 INFO:tasks.workunit.client.0.smithi115.stdout:8/31: creat d0/fb x:0 0 0 2024-09-13T17:05:39.300 INFO:tasks.workunit.client.0.smithi115.stdout:8/32: dread - d0/fb zero size 2024-09-13T17:05:39.300 INFO:tasks.workunit.client.0.smithi115.stdout:8/33: creat d0/fc x:0 0 0 2024-09-13T17:05:39.300 INFO:tasks.workunit.client.0.smithi115.stdout:8/34: read - d0/fc zero size 2024-09-13T17:05:39.300 INFO:tasks.workunit.client.0.smithi115.stdout:8/35: write d0/fc [349237,70738] 0 2024-09-13T17:05:39.301 INFO:tasks.workunit.client.0.smithi115.stdout:8/36: read - d0/fb zero size 2024-09-13T17:05:39.301 INFO:tasks.workunit.client.0.smithi115.stdout:8/37: creat d0/fd x:0 0 0 2024-09-13T17:05:39.306 INFO:tasks.workunit.client.0.smithi115.stdout:3/225: dread d1/d12/d23/d25/d1a/f27 [0,4194304] 0 2024-09-13T17:05:39.306 INFO:tasks.workunit.client.0.smithi115.stdout:6/23: getdents . 0 2024-09-13T17:05:39.311 INFO:tasks.workunit.client.0.smithi115.stdout:0/17: symlink l3 0 2024-09-13T17:05:39.312 INFO:tasks.workunit.client.0.smithi115.stdout:2/144: rmdir d3/d5/de 39 2024-09-13T17:05:39.313 INFO:tasks.workunit.client.0.smithi115.stdout:9/45: symlink d0/lf 0 2024-09-13T17:05:39.315 INFO:tasks.workunit.client.0.smithi115.stdout:4/63: getdents d7 0 2024-09-13T17:05:39.315 INFO:tasks.workunit.client.0.smithi115.stdout:4/64: read d7/dd/de/f13 [231701,94055] 0 2024-09-13T17:05:39.315 INFO:tasks.workunit.client.0.smithi115.stdout:4/65: readlink l2 0 2024-09-13T17:05:39.315 INFO:tasks.workunit.client.0.smithi115.stdout:4/66: readlink l2 0 2024-09-13T17:05:39.316 INFO:tasks.workunit.client.0.smithi115.stdout:4/67: fdatasync f5 0 2024-09-13T17:05:39.318 INFO:tasks.workunit.client.0.smithi115.stdout:5/44: dwrite f0 [0,4194304] 0 2024-09-13T17:05:39.323 INFO:tasks.workunit.client.0.smithi115.stdout:4/68: dread d7/fb [0,4194304] 0 2024-09-13T17:05:39.324 INFO:tasks.workunit.client.0.smithi115.stdout:3/226: rename d1/l1e to d1/d12/d14/l4a 0 2024-09-13T17:05:39.329 INFO:tasks.workunit.client.0.smithi115.stdout:2/145: truncate d3/d5/fa 390349 0 2024-09-13T17:05:39.330 INFO:tasks.workunit.client.0.smithi115.stdout:9/46: mkdir d0/de/d10 0 2024-09-13T17:05:39.334 INFO:tasks.workunit.client.0.smithi115.stdout:5/45: mknod cf 0 2024-09-13T17:05:39.335 INFO:tasks.workunit.client.0.smithi115.stdout:5/46: creat f10 x:0 0 0 2024-09-13T17:05:39.335 INFO:tasks.workunit.client.0.smithi115.stdout:5/47: chown c4 29 1 2024-09-13T17:05:39.343 INFO:tasks.workunit.client.0.smithi115.stdout:9/47: unlink d0/cd 0 2024-09-13T17:05:39.347 INFO:tasks.workunit.client.0.smithi115.stdout:5/48: symlink l11 0 2024-09-13T17:05:39.350 INFO:tasks.workunit.client.0.smithi115.stdout:4/69: rmdir d7/dd 39 2024-09-13T17:05:39.355 INFO:tasks.workunit.client.0.smithi115.stdout:5/49: rename f9 to f12 0 2024-09-13T17:05:39.356 INFO:tasks.workunit.client.0.smithi115.stdout:5/50: chown l11 11807769 1 2024-09-13T17:05:39.356 INFO:tasks.workunit.client.0.smithi115.stdout:5/51: write fc [795928,17983] 0 2024-09-13T17:05:39.358 INFO:tasks.workunit.client.0.smithi115.stdout:9/48: dwrite d0/f6 [0,4194304] 0 2024-09-13T17:05:39.358 INFO:tasks.workunit.client.0.smithi115.stdout:9/49: stat d0/lf 0 2024-09-13T17:05:39.359 INFO:tasks.workunit.client.0.smithi115.stdout:3/227: rename d1/d12/d23/d25 to d1/d4b 0 2024-09-13T17:05:39.359 INFO:tasks.workunit.client.0.smithi115.stdout:3/228: fdatasync d1/d12/d14/f35 0 2024-09-13T17:05:39.359 INFO:tasks.workunit.client.0.smithi115.stdout:3/229: fdatasync d1/d4b/d1a/d30/f3c 0 2024-09-13T17:05:39.364 INFO:tasks.workunit.client.0.smithi115.stdout:5/52: mknod c13 0 2024-09-13T17:05:39.364 INFO:tasks.workunit.client.0.smithi115.stdout:5/53: creat f14 x:0 0 0 2024-09-13T17:05:39.369 INFO:tasks.workunit.client.0.smithi115.stdout:2/146: rename d3/c20 to d3/d5/dd/d1f/c32 0 2024-09-13T17:05:39.369 INFO:tasks.workunit.client.0.smithi115.stdout:2/147: chown d3/d5/fa 8547 1 2024-09-13T17:05:39.372 INFO:tasks.workunit.client.0.smithi115.stdout:3/230: rename d1/d12/d14/f35 to d1/d4b/d1a/f4c 0 2024-09-13T17:05:39.374 INFO:tasks.workunit.client.0.smithi115.stdout:2/148: symlink d3/d5/dd/d1f/d2f/l33 0 2024-09-13T17:05:39.377 INFO:tasks.workunit.client.0.smithi115.stdout:3/231: rename d1/d12/d14/f2d to d1/d4b/f4d 0 2024-09-13T17:05:39.377 INFO:tasks.workunit.client.0.smithi115.stdout:3/232: write d1/d12/f45 [2494943,55621] 0 2024-09-13T17:05:39.377 INFO:tasks.workunit.client.0.smithi115.stdout:4/70: dwrite d7/fb [0,4194304] 0 2024-09-13T17:05:39.378 INFO:tasks.workunit.client.0.smithi115.stdout:4/71: write d7/dd/de/f10 [610485,52404] 0 2024-09-13T17:05:39.378 INFO:tasks.workunit.client.0.smithi115.stdout:9/50: dwrite d0/f8 [0,4194304] 0 2024-09-13T17:05:39.381 INFO:tasks.workunit.client.0.smithi115.stdout:3/233: creat d1/d4b/d1a/f4e x:0 0 0 2024-09-13T17:05:39.381 INFO:tasks.workunit.client.0.smithi115.stdout:3/234: readlink d1/l3 0 2024-09-13T17:05:39.386 INFO:tasks.workunit.client.0.smithi115.stdout:5/54: dwrite f10 [0,4194304] 0 2024-09-13T17:05:39.387 INFO:tasks.workunit.client.0.smithi115.stdout:5/55: write fd [214627,71777] 0 2024-09-13T17:05:39.388 INFO:tasks.workunit.client.0.smithi115.stdout:4/72: dread f5 [0,4194304] 0 2024-09-13T17:05:39.391 INFO:tasks.workunit.client.0.smithi115.stdout:2/149: write d3/d5/de/f15 [2881181,78097] 0 2024-09-13T17:05:39.391 INFO:tasks.workunit.client.0.smithi115.stdout:2/150: stat d3/d5/d13 0 2024-09-13T17:05:39.391 INFO:tasks.workunit.client.0.smithi115.stdout:2/151: fsync d3/d5/dd/df/f24 0 2024-09-13T17:05:39.392 INFO:tasks.workunit.client.0.smithi115.stdout:9/51: write d0/f3 [2459455,23584] 0 2024-09-13T17:05:39.397 INFO:tasks.workunit.client.0.smithi115.stdout:9/52: creat d0/f11 x:0 0 0 2024-09-13T17:05:39.397 INFO:tasks.workunit.client.0.smithi115.stdout:3/235: dwrite d1/d12/d14/f3e [0,4194304] 0 2024-09-13T17:05:39.400 INFO:tasks.workunit.client.0.smithi115.stdout:4/73: dread d7/dd/f11 [0,4194304] 0 2024-09-13T17:05:39.400 INFO:tasks.workunit.client.0.smithi115.stdout:4/74: chown l2 3226841 1 2024-09-13T17:05:39.401 INFO:tasks.workunit.client.0.smithi115.stdout:9/53: rename d0/c2 to d0/de/d10/c12 0 2024-09-13T17:05:39.408 INFO:tasks.workunit.client.0.smithi115.stdout:3/236: mknod d1/d12/c4f 0 2024-09-13T17:05:39.410 INFO:tasks.workunit.client.0.smithi115.stdout:2/152: write d3/d5/dd/f2d [235752,94205] 0 2024-09-13T17:05:39.411 INFO:tasks.workunit.client.0.smithi115.stdout:2/153: fsync d3/d5/de/f10 0 2024-09-13T17:05:39.412 INFO:tasks.workunit.client.0.smithi115.stdout:9/54: creat d0/de/d10/f13 x:0 0 0 2024-09-13T17:05:39.412 INFO:tasks.workunit.client.0.smithi115.stdout:9/55: creat d0/de/d10/f14 x:0 0 0 2024-09-13T17:05:39.414 INFO:tasks.workunit.client.0.smithi115.stdout:3/237: symlink d1/d12/d23/l50 0 2024-09-13T17:05:39.414 INFO:tasks.workunit.client.0.smithi115.stdout:3/238: read - d1/d4b/d1a/f2c zero size 2024-09-13T17:05:39.414 INFO:tasks.workunit.client.0.smithi115.stdout:3/239: creat d1/d12/d14/f51 x:0 0 0 2024-09-13T17:05:39.418 INFO:tasks.workunit.client.0.smithi115.stdout:5/56: dwrite f12 [0,4194304] 0 2024-09-13T17:05:39.418 INFO:tasks.workunit.client.0.smithi115.stdout:4/75: dwrite d7/dd/de/f13 [0,4194304] 0 2024-09-13T17:05:39.421 INFO:tasks.workunit.client.0.smithi115.stdout:9/56: mkdir d0/de/d10/d15 0 2024-09-13T17:05:39.422 INFO:tasks.workunit.client.0.smithi115.stdout:2/154: dread f2 [0,4194304] 0 2024-09-13T17:05:39.422 INFO:tasks.workunit.client.0.smithi115.stdout:2/155: creat d3/d5/dd/df/d22/f34 x:0 0 0 2024-09-13T17:05:39.430 INFO:tasks.workunit.client.0.smithi115.stdout:5/57: mknod c15 0 2024-09-13T17:05:39.440 INFO:tasks.workunit.client.0.smithi115.stdout:9/57: creat d0/f16 x:0 0 0 2024-09-13T17:05:39.447 INFO:tasks.workunit.client.0.smithi115.stdout:2/156: creat d3/d5/d13/d1c/f35 x:0 0 0 2024-09-13T17:05:39.452 INFO:tasks.workunit.client.0.smithi115.stdout:5/58: dwrite f14 [0,4194304] 0 2024-09-13T17:05:39.460 INFO:tasks.workunit.client.0.smithi115.stdout:5/59: dread f12 [0,4194304] 0 2024-09-13T17:05:39.461 INFO:tasks.workunit.client.0.smithi115.stdout:9/58: dwrite d0/de/d10/f13 [0,4194304] 0 2024-09-13T17:05:39.475 INFO:tasks.workunit.client.0.smithi115.stdout:9/59: dwrite d0/f3 [8388608,4194304] 0 2024-09-13T17:05:39.483 INFO:tasks.workunit.client.0.smithi115.stdout:9/60: dread d0/f8 [4194304,4194304] 0 2024-09-13T17:05:39.487 INFO:tasks.workunit.client.0.smithi115.stdout:9/61: creat d0/de/d10/d15/f17 x:0 0 0 2024-09-13T17:05:39.937 INFO:tasks.workunit.client.1.smithi195.stdout:2/28: link d0/d3/f4 d0/f6 0 2024-09-13T17:05:39.937 INFO:tasks.workunit.client.1.smithi195.stdout:7/10: stat l0 0 2024-09-13T17:05:39.941 INFO:tasks.workunit.client.1.smithi195.stdout:6/12: symlink l3 0 2024-09-13T17:05:39.943 INFO:tasks.workunit.client.1.smithi195.stdout:5/14: mkdir d2/d4 0 2024-09-13T17:05:39.945 INFO:tasks.workunit.client.1.smithi195.stdout:2/29: unlink d0/d3/c5 0 2024-09-13T17:05:39.946 INFO:tasks.workunit.client.1.smithi195.stdout:7/11: mkdir d5 0 2024-09-13T17:05:39.947 INFO:tasks.workunit.client.1.smithi195.stdout:5/15: creat d2/d4/f5 x:0 0 0 2024-09-13T17:05:39.948 INFO:tasks.workunit.client.1.smithi195.stdout:2/30: link d0/c1 d0/c7 0 2024-09-13T17:05:39.948 INFO:tasks.workunit.client.1.smithi195.stdout:5/16: mknod d2/d4/c6 0 2024-09-13T17:05:39.949 INFO:tasks.workunit.client.1.smithi195.stdout:5/17: mkdir d2/d7 0 2024-09-13T17:05:39.951 INFO:tasks.workunit.client.1.smithi195.stdout:2/31: dread d0/f6 [0,4194304] 0 2024-09-13T17:05:39.953 INFO:tasks.workunit.client.1.smithi195.stdout:5/18: dread d2/f3 [0,4194304] 0 2024-09-13T17:05:39.953 INFO:tasks.workunit.client.1.smithi195.stdout:5/19: truncate f1 16083 0 2024-09-13T17:05:39.961 INFO:tasks.workunit.client.1.smithi195.stdout:7/12: dwrite f3 [0,4194304] 0 2024-09-13T17:05:39.964 INFO:tasks.workunit.client.1.smithi195.stdout:7/13: rename f3 to d5/f6 0 2024-09-13T17:05:39.965 INFO:tasks.workunit.client.1.smithi195.stdout:7/14: creat d5/f7 x:0 0 0 2024-09-13T17:05:39.966 INFO:tasks.workunit.client.1.smithi195.stdout:7/15: symlink d5/l8 0 2024-09-13T17:05:39.966 INFO:tasks.workunit.client.1.smithi195.stdout:7/16: write d5/f7 [17952,125385] 0 2024-09-13T17:05:39.967 INFO:tasks.workunit.client.1.smithi195.stdout:7/17: mknod d5/c9 0 2024-09-13T17:05:39.967 INFO:tasks.workunit.client.1.smithi195.stdout:7/18: write f4 [556493,120264] 0 2024-09-13T17:05:39.967 INFO:tasks.workunit.client.1.smithi195.stdout:7/19: write f4 [927904,5409] 0 2024-09-13T17:05:39.967 INFO:tasks.workunit.client.1.smithi195.stdout:7/20: chown d5 2030 1 2024-09-13T17:05:39.967 INFO:tasks.workunit.client.1.smithi195.stdout:7/21: creat d5/fa x:0 0 0 2024-09-13T17:05:39.967 INFO:tasks.workunit.client.1.smithi195.stdout:7/22: truncate f4 1772048 0 2024-09-13T17:05:39.967 INFO:tasks.workunit.client.1.smithi195.stdout:7/23: write d5/f7 [1038111,67492] 0 2024-09-13T17:05:39.968 INFO:tasks.workunit.client.1.smithi195.stdout:7/24: mkdir d5/db 0 2024-09-13T17:05:39.968 INFO:tasks.workunit.client.1.smithi195.stdout:7/25: chown d5/l8 788786 1 2024-09-13T17:05:40.000 INFO:tasks.workunit.client.1.smithi195.stdout:4/11: getdents . 0 2024-09-13T17:05:40.001 INFO:tasks.workunit.client.1.smithi195.stdout:4/12: write f2 [459878,11554] 0 2024-09-13T17:05:40.002 INFO:tasks.workunit.client.1.smithi195.stdout:4/13: creat f5 x:0 0 0 2024-09-13T17:05:40.027 INFO:tasks.workunit.client.1.smithi195.stdout:4/14: dwrite f0 [0,4194304] 0 2024-09-13T17:05:40.028 INFO:tasks.workunit.client.1.smithi195.stdout:4/15: symlink l6 0 2024-09-13T17:05:40.028 INFO:tasks.workunit.client.1.smithi195.stdout:4/16: creat f7 x:0 0 0 2024-09-13T17:05:40.028 INFO:tasks.workunit.client.1.smithi195.stdout:4/17: truncate f5 154012 0 2024-09-13T17:05:40.028 INFO:tasks.workunit.client.1.smithi195.stdout:4/18: truncate f2 1693550 0 2024-09-13T17:05:40.111 INFO:tasks.workunit.client.0.smithi115.stdout:1/35: truncate d5/f6 4251898 0 2024-09-13T17:05:40.111 INFO:tasks.workunit.client.0.smithi115.stdout:1/36: chown l3 17297 1 2024-09-13T17:05:40.115 INFO:tasks.workunit.client.0.smithi115.stdout:7/20: write d0/f1 [5225918,59035] 0 2024-09-13T17:05:40.116 INFO:tasks.workunit.client.0.smithi115.stdout:7/21: stat d0/d2 0 2024-09-13T17:05:40.124 INFO:tasks.workunit.client.0.smithi115.stdout:0/18: getdents . 0 2024-09-13T17:05:40.125 INFO:tasks.workunit.client.0.smithi115.stdout:0/19: rename l3 to l4 0 2024-09-13T17:05:40.126 INFO:tasks.workunit.client.0.smithi115.stdout:0/20: dread - f1 zero size 2024-09-13T17:05:40.126 INFO:tasks.workunit.client.0.smithi115.stdout:0/21: truncate f1 104986 0 2024-09-13T17:05:40.126 INFO:tasks.workunit.client.0.smithi115.stdout:0/22: readlink l4 0 2024-09-13T17:05:40.127 INFO:tasks.workunit.client.0.smithi115.stdout:0/23: dread f1 [0,4194304] 0 2024-09-13T17:05:40.131 INFO:tasks.workunit.client.0.smithi115.stdout:8/38: getdents d0 0 2024-09-13T17:05:40.131 INFO:tasks.workunit.client.0.smithi115.stdout:8/39: fsync d0/fd 0 2024-09-13T17:05:40.135 INFO:tasks.workunit.client.0.smithi115.stdout:8/40: symlink d0/le 0 2024-09-13T17:05:40.136 INFO:tasks.workunit.client.0.smithi115.stdout:8/41: mknod d0/cf 0 2024-09-13T17:05:40.136 INFO:tasks.workunit.client.0.smithi115.stdout:8/42: rmdir d0 39 2024-09-13T17:05:40.136 INFO:tasks.workunit.client.0.smithi115.stdout:7/22: dwrite d0/f1 [0,4194304] 0 2024-09-13T17:05:40.136 INFO:tasks.workunit.client.0.smithi115.stdout:7/23: getdents d0/d2 0 2024-09-13T17:05:40.139 INFO:tasks.workunit.client.0.smithi115.stdout:8/43: dread d0/fc [0,4194304] 0 2024-09-13T17:05:40.139 INFO:tasks.workunit.client.0.smithi115.stdout:8/44: readlink d0/l4 0 2024-09-13T17:05:40.139 INFO:tasks.workunit.client.0.smithi115.stdout:8/45: fdatasync d0/fb 0 2024-09-13T17:05:40.140 INFO:tasks.workunit.client.0.smithi115.stdout:8/46: link d0/ca d0/c10 0 2024-09-13T17:05:40.140 INFO:tasks.workunit.client.0.smithi115.stdout:8/47: read - d0/fb zero size 2024-09-13T17:05:40.141 INFO:tasks.workunit.client.0.smithi115.stdout:8/48: rmdir d0 39 2024-09-13T17:05:40.141 INFO:tasks.workunit.client.0.smithi115.stdout:8/49: truncate d0/fd 702948 0 2024-09-13T17:05:40.142 INFO:tasks.workunit.client.0.smithi115.stdout:8/50: mknod d0/c11 0 2024-09-13T17:05:40.143 INFO:tasks.workunit.client.0.smithi115.stdout:8/51: truncate d0/fc 336097 0 2024-09-13T17:05:40.144 INFO:tasks.workunit.client.0.smithi115.stdout:8/52: link d0/c7 d0/c12 0 2024-09-13T17:05:40.145 INFO:tasks.workunit.client.0.smithi115.stdout:0/24: dwrite f0 [0,4194304] 0 2024-09-13T17:05:40.146 INFO:tasks.workunit.client.0.smithi115.stdout:8/53: unlink d0/c11 0 2024-09-13T17:05:40.146 INFO:tasks.workunit.client.0.smithi115.stdout:8/54: read - d0/fb zero size 2024-09-13T17:05:40.146 INFO:tasks.workunit.client.0.smithi115.stdout:8/55: readlink d0/l9 0 2024-09-13T17:05:40.146 INFO:tasks.workunit.client.0.smithi115.stdout:8/56: read - d0/fb zero size 2024-09-13T17:05:40.146 INFO:tasks.workunit.client.0.smithi115.stdout:8/57: read - d0/fb zero size 2024-09-13T17:05:40.146 INFO:tasks.workunit.client.0.smithi115.stdout:8/58: chown d0/c2 28 1 2024-09-13T17:05:40.147 INFO:tasks.workunit.client.0.smithi115.stdout:8/59: fdatasync d0/fd 0 2024-09-13T17:05:40.147 INFO:tasks.workunit.client.0.smithi115.stdout:8/60: write d0/fb [837473,73909] 0 2024-09-13T17:05:40.148 INFO:tasks.workunit.client.0.smithi115.stdout:0/25: dread - f2 zero size 2024-09-13T17:05:40.148 INFO:tasks.workunit.client.0.smithi115.stdout:0/26: write f2 [76417,96588] 0 2024-09-13T17:05:40.150 INFO:tasks.workunit.client.0.smithi115.stdout:0/27: rename f1 to f5 0 2024-09-13T17:05:40.150 INFO:tasks.workunit.client.0.smithi115.stdout:0/28: chown f2 123902580 1 2024-09-13T17:05:40.150 INFO:tasks.workunit.client.0.smithi115.stdout:0/29: write f5 [810080,66084] 0 2024-09-13T17:05:40.153 INFO:tasks.workunit.client.0.smithi115.stdout:8/61: dread d0/fb [0,4194304] 0 2024-09-13T17:05:40.153 INFO:tasks.workunit.client.0.smithi115.stdout:8/62: write d0/fd [963531,117037] 0 2024-09-13T17:05:40.153 INFO:tasks.workunit.client.0.smithi115.stdout:8/63: stat d0/cf 0 2024-09-13T17:05:40.153 INFO:tasks.workunit.client.0.smithi115.stdout:6/24: dwrite f3 [0,4194304] 0 2024-09-13T17:05:40.154 INFO:tasks.workunit.client.0.smithi115.stdout:6/25: creat f6 x:0 0 0 2024-09-13T17:05:40.156 INFO:tasks.workunit.client.0.smithi115.stdout:5/60: unlink f12 0 2024-09-13T17:05:40.156 INFO:tasks.workunit.client.0.smithi115.stdout:5/61: creat f16 x:0 0 0 2024-09-13T17:05:40.156 INFO:tasks.workunit.client.0.smithi115.stdout:0/30: dread f2 [0,4194304] 0 2024-09-13T17:05:40.158 INFO:tasks.workunit.client.0.smithi115.stdout:8/64: dread d0/fd [0,4194304] 0 2024-09-13T17:05:40.159 INFO:tasks.workunit.client.0.smithi115.stdout:0/31: symlink l6 0 2024-09-13T17:05:40.159 INFO:tasks.workunit.client.0.smithi115.stdout:5/62: write fc [272857,17787] 0 2024-09-13T17:05:40.160 INFO:tasks.workunit.client.0.smithi115.stdout:0/32: dread f2 [0,4194304] 0 2024-09-13T17:05:40.160 INFO:tasks.workunit.client.0.smithi115.stdout:5/63: symlink l17 0 2024-09-13T17:05:40.160 INFO:tasks.workunit.client.0.smithi115.stdout:8/65: write d0/fb [267716,28753] 0 2024-09-13T17:05:40.161 INFO:tasks.workunit.client.0.smithi115.stdout:5/64: symlink l18 0 2024-09-13T17:05:40.162 INFO:tasks.workunit.client.0.smithi115.stdout:0/33: mkdir d7 0 2024-09-13T17:05:40.162 INFO:tasks.workunit.client.0.smithi115.stdout:0/34: stat f5 0 2024-09-13T17:05:40.162 INFO:tasks.workunit.client.0.smithi115.stdout:0/35: readlink l4 0 2024-09-13T17:05:40.163 INFO:tasks.workunit.client.0.smithi115.stdout:5/65: mkdir d19 0 2024-09-13T17:05:40.164 INFO:tasks.workunit.client.0.smithi115.stdout:5/66: creat d19/f1a x:0 0 0 2024-09-13T17:05:40.166 INFO:tasks.workunit.client.0.smithi115.stdout:5/67: symlink d19/l1b 0 2024-09-13T17:05:40.166 INFO:tasks.workunit.client.0.smithi115.stdout:5/68: chown d19/f1a 12100870 1 2024-09-13T17:05:40.166 INFO:tasks.workunit.client.0.smithi115.stdout:5/69: chown f16 126 1 2024-09-13T17:05:40.167 INFO:tasks.workunit.client.0.smithi115.stdout:5/70: mknod d19/c1c 0 2024-09-13T17:05:40.167 INFO:tasks.workunit.client.0.smithi115.stdout:5/71: fsync f14 0 2024-09-13T17:05:40.168 INFO:tasks.workunit.client.0.smithi115.stdout:5/72: mkdir d19/d1d 0 2024-09-13T17:05:40.168 INFO:tasks.workunit.client.0.smithi115.stdout:5/73: fdatasync f3 0 2024-09-13T17:05:40.171 INFO:tasks.workunit.client.0.smithi115.stdout:5/74: truncate f10 775171 0 2024-09-13T17:05:40.172 INFO:tasks.workunit.client.0.smithi115.stdout:5/75: creat d19/f1e x:0 0 0 2024-09-13T17:05:40.172 INFO:tasks.workunit.client.0.smithi115.stdout:6/26: dwrite f3 [0,4194304] 0 2024-09-13T17:05:40.173 INFO:tasks.workunit.client.0.smithi115.stdout:5/76: mknod d19/c1f 0 2024-09-13T17:05:40.173 INFO:tasks.workunit.client.0.smithi115.stdout:5/77: chown d19/f1e 812 1 2024-09-13T17:05:40.173 INFO:tasks.workunit.client.0.smithi115.stdout:5/78: truncate d19/f1e 1013560 0 2024-09-13T17:05:40.174 INFO:tasks.workunit.client.0.smithi115.stdout:6/27: symlink l7 0 2024-09-13T17:05:40.182 INFO:tasks.workunit.client.0.smithi115.stdout:5/79: write f14 [660555,18179] 0 2024-09-13T17:05:40.182 INFO:tasks.workunit.client.0.smithi115.stdout:5/80: fdatasync d19/f1a 0 2024-09-13T17:05:40.183 INFO:tasks.workunit.client.0.smithi115.stdout:5/81: creat d19/d1d/f20 x:0 0 0 2024-09-13T17:05:40.183 INFO:tasks.workunit.client.0.smithi115.stdout:5/82: write f16 [138739,20746] 0 2024-09-13T17:05:40.183 INFO:tasks.workunit.client.0.smithi115.stdout:5/83: write fe [828552,82770] 0 2024-09-13T17:05:40.199 INFO:tasks.workunit.client.0.smithi115.stdout:5/84: dwrite d19/f1a [0,4194304] 0 2024-09-13T17:05:40.202 INFO:tasks.workunit.client.0.smithi115.stdout:5/85: read f3 [50863,18168] 0 2024-09-13T17:05:40.312 INFO:tasks.workunit.client.1.smithi195.stdout:1/8: sync 2024-09-13T17:05:40.312 INFO:tasks.workunit.client.1.smithi195.stdout:3/12: sync 2024-09-13T17:05:40.312 INFO:tasks.workunit.client.1.smithi195.stdout:8/11: sync 2024-09-13T17:05:40.312 INFO:tasks.workunit.client.1.smithi195.stdout:8/12: truncate - no filename 2024-09-13T17:05:40.312 INFO:tasks.workunit.client.1.smithi195.stdout:9/0: sync 2024-09-13T17:05:40.313 INFO:tasks.workunit.client.1.smithi195.stdout:3/13: symlink l1 0 2024-09-13T17:05:40.313 INFO:tasks.workunit.client.1.smithi195.stdout:3/14: chown l1 172948462 1 2024-09-13T17:05:40.313 INFO:tasks.workunit.client.1.smithi195.stdout:3/15: rmdir - no directory 2024-09-13T17:05:40.313 INFO:tasks.workunit.client.1.smithi195.stdout:3/16: dread - no filename 2024-09-13T17:05:40.313 INFO:tasks.workunit.client.1.smithi195.stdout:3/17: truncate - no filename 2024-09-13T17:05:40.313 INFO:tasks.workunit.client.1.smithi195.stdout:0/17: sync 2024-09-13T17:05:40.314 INFO:tasks.workunit.client.1.smithi195.stdout:1/9: symlink l3 0 2024-09-13T17:05:40.314 INFO:tasks.workunit.client.1.smithi195.stdout:1/10: rmdir - no directory 2024-09-13T17:05:40.316 INFO:tasks.workunit.client.1.smithi195.stdout:8/13: creat d0/f3 x:0 0 0 2024-09-13T17:05:40.317 INFO:tasks.workunit.client.1.smithi195.stdout:9/1: mknod c0 0 2024-09-13T17:05:40.317 INFO:tasks.workunit.client.1.smithi195.stdout:9/2: write - no filename 2024-09-13T17:05:40.318 INFO:tasks.workunit.client.1.smithi195.stdout:3/18: rename l1 to l2 0 2024-09-13T17:05:40.319 INFO:tasks.workunit.client.1.smithi195.stdout:3/19: dwrite - no filename 2024-09-13T17:05:40.319 INFO:tasks.workunit.client.1.smithi195.stdout:3/20: rmdir - no directory 2024-09-13T17:05:40.319 INFO:tasks.workunit.client.1.smithi195.stdout:3/21: dread - no filename 2024-09-13T17:05:40.319 INFO:tasks.workunit.client.1.smithi195.stdout:3/22: read - no filename 2024-09-13T17:05:40.319 INFO:tasks.workunit.client.1.smithi195.stdout:3/23: write - no filename 2024-09-13T17:05:40.319 INFO:tasks.workunit.client.1.smithi195.stdout:3/24: dread - no filename 2024-09-13T17:05:40.319 INFO:tasks.workunit.client.1.smithi195.stdout:3/25: write - no filename 2024-09-13T17:05:40.319 INFO:tasks.workunit.client.1.smithi195.stdout:0/18: dread f1 [0,4194304] 0 2024-09-13T17:05:40.320 INFO:tasks.workunit.client.1.smithi195.stdout:0/19: chown f1 0 1 2024-09-13T17:05:40.320 INFO:tasks.workunit.client.1.smithi195.stdout:1/11: rename c0 to c4 0 2024-09-13T17:05:40.320 INFO:tasks.workunit.client.1.smithi195.stdout:1/12: creat f5 x:0 0 0 2024-09-13T17:05:40.320 INFO:tasks.workunit.client.1.smithi195.stdout:1/13: readlink l3 0 2024-09-13T17:05:40.322 INFO:tasks.workunit.client.1.smithi195.stdout:8/14: mkdir d0/d4 0 2024-09-13T17:05:40.322 INFO:tasks.workunit.client.1.smithi195.stdout:8/15: dread - d0/f3 zero size 2024-09-13T17:05:40.322 INFO:tasks.workunit.client.1.smithi195.stdout:8/16: truncate d0/f3 169131 0 2024-09-13T17:05:40.322 INFO:tasks.workunit.client.1.smithi195.stdout:8/17: creat d0/f5 x:0 0 0 2024-09-13T17:05:40.322 INFO:tasks.workunit.client.1.smithi195.stdout:8/18: write d0/f5 [799487,18343] 0 2024-09-13T17:05:40.322 INFO:tasks.workunit.client.1.smithi195.stdout:8/19: truncate d0/f3 417417 0 2024-09-13T17:05:40.323 INFO:tasks.workunit.client.1.smithi195.stdout:9/3: unlink c0 0 2024-09-13T17:05:40.324 INFO:tasks.workunit.client.1.smithi195.stdout:6/13: dwrite f2 [4194304,4194304] 0 2024-09-13T17:05:40.324 INFO:tasks.workunit.client.1.smithi195.stdout:0/20: dread f1 [0,4194304] 0 2024-09-13T17:05:40.325 INFO:tasks.workunit.client.1.smithi195.stdout:0/21: read f1 [77174,18211] 0 2024-09-13T17:05:40.325 INFO:tasks.workunit.client.1.smithi195.stdout:3/26: mknod c3 0 2024-09-13T17:05:40.325 INFO:tasks.workunit.client.1.smithi195.stdout:3/27: write - no filename 2024-09-13T17:05:40.326 INFO:tasks.workunit.client.1.smithi195.stdout:5/20: dread f1 [0,4194304] 0 2024-09-13T17:05:40.326 INFO:tasks.workunit.client.1.smithi195.stdout:5/21: chown d2/d7 2854 1 2024-09-13T17:05:40.327 INFO:tasks.workunit.client.1.smithi195.stdout:1/14: rename l3 to l6 0 2024-09-13T17:05:40.327 INFO:tasks.workunit.client.1.smithi195.stdout:1/15: dread - f2 zero size 2024-09-13T17:05:40.327 INFO:tasks.workunit.client.1.smithi195.stdout:1/16: rmdir - no directory 2024-09-13T17:05:40.327 INFO:tasks.workunit.client.1.smithi195.stdout:5/22: dread f1 [0,4194304] 0 2024-09-13T17:05:40.327 INFO:tasks.workunit.client.1.smithi195.stdout:5/23: chown f1 52889 1 2024-09-13T17:05:40.328 INFO:tasks.workunit.client.1.smithi195.stdout:8/20: symlink d0/d4/l6 0 2024-09-13T17:05:40.329 INFO:tasks.workunit.client.1.smithi195.stdout:9/4: creat f1 x:0 0 0 2024-09-13T17:05:40.329 INFO:tasks.workunit.client.1.smithi195.stdout:9/5: creat f2 x:0 0 0 2024-09-13T17:05:40.329 INFO:tasks.workunit.client.1.smithi195.stdout:9/6: fdatasync f1 0 2024-09-13T17:05:40.330 INFO:tasks.workunit.client.1.smithi195.stdout:6/14: mknod c4 0 2024-09-13T17:05:40.331 INFO:tasks.workunit.client.1.smithi195.stdout:0/22: symlink l2 0 2024-09-13T17:05:40.331 INFO:tasks.workunit.client.1.smithi195.stdout:0/23: fdatasync f1 0 2024-09-13T17:05:40.334 INFO:tasks.workunit.client.1.smithi195.stdout:5/24: mkdir d2/d4/d8 0 2024-09-13T17:05:40.334 INFO:tasks.workunit.client.1.smithi195.stdout:5/25: fdatasync d2/f3 0 2024-09-13T17:05:40.336 INFO:tasks.workunit.client.1.smithi195.stdout:6/15: dread f2 [0,4194304] 0 2024-09-13T17:05:40.336 INFO:tasks.workunit.client.1.smithi195.stdout:4/19: truncate f2 657061 0 2024-09-13T17:05:40.338 INFO:tasks.workunit.client.1.smithi195.stdout:9/7: mknod c3 0 2024-09-13T17:05:40.340 INFO:tasks.workunit.client.1.smithi195.stdout:5/26: symlink d2/l9 0 2024-09-13T17:05:40.340 INFO:tasks.workunit.client.1.smithi195.stdout:6/16: symlink l5 0 2024-09-13T17:05:40.346 INFO:tasks.workunit.client.0.smithi115.stdout:1/37: dread d5/f6 [0,4194304] 0 2024-09-13T17:05:40.347 INFO:tasks.workunit.client.0.smithi115.stdout:1/38: creat d5/fa x:0 0 0 2024-09-13T17:05:40.347 INFO:tasks.workunit.client.0.smithi115.stdout:1/39: creat d5/fb x:0 0 0 2024-09-13T17:05:40.347 INFO:tasks.workunit.client.0.smithi115.stdout:1/40: chown d5/f6 11 1 2024-09-13T17:05:40.347 INFO:tasks.workunit.client.0.smithi115.stdout:1/41: creat d5/fc x:0 0 0 2024-09-13T17:05:40.347 INFO:tasks.workunit.client.0.smithi115.stdout:0/36: truncate f0 264839 0 2024-09-13T17:05:40.352 INFO:tasks.workunit.client.0.smithi115.stdout:8/66: dread d0/fc [0,4194304] 0 2024-09-13T17:05:40.352 INFO:tasks.workunit.client.0.smithi115.stdout:8/67: chown d0/fd 944193 1 2024-09-13T17:05:40.354 INFO:tasks.workunit.client.0.smithi115.stdout:1/42: rename l4 to d5/d7/ld 0 2024-09-13T17:05:40.354 INFO:tasks.workunit.client.0.smithi115.stdout:0/37: rename d7 to d7/d8 22 2024-09-13T17:05:40.356 INFO:tasks.workunit.client.0.smithi115.stdout:8/68: creat d0/f13 x:0 0 0 2024-09-13T17:05:40.356 INFO:tasks.workunit.client.0.smithi115.stdout:8/69: write d0/fd [1172575,95366] 0 2024-09-13T17:05:40.360 INFO:tasks.workunit.client.1.smithi195.stdout:0/24: dwrite f1 [0,4194304] 0 2024-09-13T17:05:40.362 INFO:tasks.workunit.client.1.smithi195.stdout:0/25: unlink l2 0 2024-09-13T17:05:40.365 INFO:tasks.workunit.client.0.smithi115.stdout:6/28: getdents . 0 2024-09-13T17:05:40.370 INFO:tasks.workunit.client.1.smithi195.stdout:3/28: getdents . 0 2024-09-13T17:05:40.370 INFO:tasks.workunit.client.1.smithi195.stdout:3/29: dwrite - no filename 2024-09-13T17:05:40.371 INFO:tasks.workunit.client.1.smithi195.stdout:4/20: dwrite f0 [0,4194304] 0 2024-09-13T17:05:40.371 INFO:tasks.workunit.client.1.smithi195.stdout:4/21: chown f1 1403 1 2024-09-13T17:05:40.372 INFO:tasks.workunit.client.1.smithi195.stdout:6/17: dwrite f2 [0,4194304] 0 2024-09-13T17:05:40.372 INFO:tasks.workunit.client.1.smithi195.stdout:1/17: link l6 l7 0 2024-09-13T17:05:40.373 INFO:tasks.workunit.client.0.smithi115.stdout:0/38: dwrite f5 [0,4194304] 0 2024-09-13T17:05:40.373 INFO:tasks.workunit.client.0.smithi115.stdout:0/39: fdatasync f0 0 2024-09-13T17:05:40.374 INFO:tasks.workunit.client.1.smithi195.stdout:8/21: rmdir d0 39 2024-09-13T17:05:40.375 INFO:tasks.workunit.client.1.smithi195.stdout:8/22: read d0/f3 [166376,96556] 0 2024-09-13T17:05:40.375 INFO:tasks.workunit.client.1.smithi195.stdout:8/23: write d0/f5 [931827,107709] 0 2024-09-13T17:05:40.375 INFO:tasks.workunit.client.1.smithi195.stdout:8/24: write d0/f5 [1903167,74111] 0 2024-09-13T17:05:40.375 INFO:tasks.workunit.client.1.smithi195.stdout:8/25: fsync d0/f3 0 2024-09-13T17:05:40.376 INFO:tasks.workunit.client.1.smithi195.stdout:1/18: symlink l8 0 2024-09-13T17:05:40.381 INFO:tasks.workunit.client.1.smithi195.stdout:8/26: rmdir d0 39 2024-09-13T17:05:40.381 INFO:tasks.workunit.client.1.smithi195.stdout:9/8: fsync f2 0 2024-09-13T17:05:40.381 INFO:tasks.workunit.client.1.smithi195.stdout:9/9: rmdir - no directory 2024-09-13T17:05:40.381 INFO:tasks.workunit.client.1.smithi195.stdout:9/10: readlink - no filename 2024-09-13T17:05:40.381 INFO:tasks.workunit.client.1.smithi195.stdout:9/11: write f1 [630653,130654] 0 2024-09-13T17:05:40.381 INFO:tasks.workunit.client.1.smithi195.stdout:9/12: creat f4 x:0 0 0 2024-09-13T17:05:40.381 INFO:tasks.workunit.client.1.smithi195.stdout:9/13: rmdir - no directory 2024-09-13T17:05:40.382 INFO:tasks.workunit.client.1.smithi195.stdout:1/19: mknod c9 0 2024-09-13T17:05:40.382 INFO:tasks.workunit.client.1.smithi195.stdout:1/20: creat fa x:0 0 0 2024-09-13T17:05:40.382 INFO:tasks.workunit.client.1.smithi195.stdout:1/21: dread - f5 zero size 2024-09-13T17:05:40.383 INFO:tasks.workunit.client.1.smithi195.stdout:8/27: mknod d0/c7 0 2024-09-13T17:05:40.384 INFO:tasks.workunit.client.1.smithi195.stdout:6/18: write f2 [8373586,36748] 0 2024-09-13T17:05:40.384 INFO:tasks.workunit.client.1.smithi195.stdout:6/19: stat l5 0 2024-09-13T17:05:40.384 INFO:tasks.workunit.client.1.smithi195.stdout:5/27: dwrite d2/f3 [0,4194304] 0 2024-09-13T17:05:40.384 INFO:tasks.workunit.client.1.smithi195.stdout:6/20: write f2 [5546392,113962] 0 2024-09-13T17:05:40.384 INFO:tasks.workunit.client.1.smithi195.stdout:6/21: stat c4 0 2024-09-13T17:05:40.384 INFO:tasks.workunit.client.1.smithi195.stdout:6/22: write f2 [5905014,74926] 0 2024-09-13T17:05:40.384 INFO:tasks.workunit.client.1.smithi195.stdout:7/26: sync 2024-09-13T17:05:40.385 INFO:tasks.workunit.client.1.smithi195.stdout:2/32: sync 2024-09-13T17:05:40.386 INFO:tasks.workunit.client.0.smithi115.stdout:6/29: dwrite f6 [0,4194304] 0 2024-09-13T17:05:40.386 INFO:tasks.workunit.client.0.smithi115.stdout:6/30: dread - f5 zero size 2024-09-13T17:05:40.388 INFO:tasks.workunit.client.1.smithi195.stdout:4/22: dwrite f1 [0,4194304] 0 2024-09-13T17:05:40.389 INFO:tasks.workunit.client.1.smithi195.stdout:5/28: creat d2/d4/d8/fa x:0 0 0 2024-09-13T17:05:40.389 INFO:tasks.workunit.client.1.smithi195.stdout:5/29: creat d2/fb x:0 0 0 2024-09-13T17:05:40.390 INFO:tasks.workunit.client.1.smithi195.stdout:4/23: dread f5 [0,4194304] 0 2024-09-13T17:05:40.390 INFO:tasks.workunit.client.1.smithi195.stdout:4/24: creat f8 x:0 0 0 2024-09-13T17:05:40.390 INFO:tasks.workunit.client.1.smithi195.stdout:6/23: creat f6 x:0 0 0 2024-09-13T17:05:40.395 INFO:tasks.workunit.client.1.smithi195.stdout:7/27: creat d5/db/fc x:0 0 0 2024-09-13T17:05:40.396 INFO:tasks.workunit.client.1.smithi195.stdout:7/28: fsync d5/f7 0 2024-09-13T17:05:40.396 INFO:tasks.workunit.client.1.smithi195.stdout:7/29: creat d5/db/fd x:0 0 0 2024-09-13T17:05:40.396 INFO:tasks.workunit.client.1.smithi195.stdout:2/33: symlink d0/d3/l8 0 2024-09-13T17:05:40.397 INFO:tasks.workunit.client.1.smithi195.stdout:0/26: getdents . 0 2024-09-13T17:05:40.397 INFO:tasks.workunit.client.1.smithi195.stdout:0/27: write f1 [4583643,6590] 0 2024-09-13T17:05:40.397 INFO:tasks.workunit.client.1.smithi195.stdout:0/28: chown f1 0 1 2024-09-13T17:05:40.397 INFO:tasks.workunit.client.1.smithi195.stdout:0/29: chown f1 0 1 2024-09-13T17:05:40.398 INFO:tasks.workunit.client.1.smithi195.stdout:1/22: dwrite f5 [0,4194304] 0 2024-09-13T17:05:40.402 INFO:tasks.workunit.client.1.smithi195.stdout:4/25: write f1 [827425,32910] 0 2024-09-13T17:05:40.408 INFO:tasks.workunit.client.1.smithi195.stdout:5/30: dwrite f1 [0,4194304] 0 2024-09-13T17:05:40.410 INFO:tasks.workunit.client.1.smithi195.stdout:4/26: symlink l9 0 2024-09-13T17:05:40.412 INFO:tasks.workunit.client.1.smithi195.stdout:1/23: fsync fa 0 2024-09-13T17:05:40.414 INFO:tasks.workunit.client.1.smithi195.stdout:1/24: mkdir db 0 2024-09-13T17:05:40.416 INFO:tasks.workunit.client.1.smithi195.stdout:5/31: rmdir d2/d4 39 2024-09-13T17:05:40.416 INFO:tasks.workunit.client.1.smithi195.stdout:5/32: write d2/d4/f5 [510943,53884] 0 2024-09-13T17:05:40.416 INFO:tasks.workunit.client.1.smithi195.stdout:2/34: dwrite d0/f6 [0,4194304] 0 2024-09-13T17:05:40.417 INFO:tasks.workunit.client.1.smithi195.stdout:2/35: fsync d0/d3/f4 0 2024-09-13T17:05:40.417 INFO:tasks.workunit.client.1.smithi195.stdout:5/33: mknod d2/d4/cc 0 2024-09-13T17:05:40.418 INFO:tasks.workunit.client.1.smithi195.stdout:6/24: fsync f6 0 2024-09-13T17:05:40.418 INFO:tasks.workunit.client.1.smithi195.stdout:7/30: dwrite d5/f6 [0,4194304] 0 2024-09-13T17:05:40.418 INFO:tasks.workunit.client.1.smithi195.stdout:7/31: write d5/fa [976645,63102] 0 2024-09-13T17:05:40.419 INFO:tasks.workunit.client.0.smithi115.stdout:6/31: truncate f6 846335 0 2024-09-13T17:05:40.421 INFO:tasks.workunit.client.1.smithi195.stdout:9/14: truncate f1 94340 0 2024-09-13T17:05:40.422 INFO:tasks.workunit.client.0.smithi115.stdout:6/32: unlink l7 0 2024-09-13T17:05:40.423 INFO:tasks.workunit.client.1.smithi195.stdout:9/15: symlink l5 0 2024-09-13T17:05:40.423 INFO:tasks.workunit.client.1.smithi195.stdout:9/16: fsync f2 0 2024-09-13T17:05:40.423 INFO:tasks.workunit.client.1.smithi195.stdout:9/17: readlink l5 0 2024-09-13T17:05:40.425 INFO:tasks.workunit.client.0.smithi115.stdout:6/33: mkdir d8 0 2024-09-13T17:05:40.427 INFO:tasks.workunit.client.1.smithi195.stdout:9/18: mkdir d6 0 2024-09-13T17:05:40.428 INFO:tasks.workunit.client.0.smithi115.stdout:6/34: mkdir d8/d9 0 2024-09-13T17:05:40.428 INFO:tasks.workunit.client.1.smithi195.stdout:2/36: read d0/f6 [3382484,59351] 0 2024-09-13T17:05:40.428 INFO:tasks.workunit.client.1.smithi195.stdout:2/37: write d0/f6 [559055,17814] 0 2024-09-13T17:05:40.428 INFO:tasks.workunit.client.1.smithi195.stdout:7/32: fdatasync d5/fa 0 2024-09-13T17:05:40.429 INFO:tasks.workunit.client.0.smithi115.stdout:0/40: truncate f0 92667 0 2024-09-13T17:05:40.431 INFO:tasks.workunit.client.1.smithi195.stdout:9/19: creat d6/f7 x:0 0 0 2024-09-13T17:05:40.432 INFO:tasks.workunit.client.1.smithi195.stdout:4/27: dwrite f0 [0,4194304] 0 2024-09-13T17:05:40.432 INFO:tasks.workunit.client.1.smithi195.stdout:4/28: dread - f8 zero size 2024-09-13T17:05:40.434 INFO:tasks.workunit.client.1.smithi195.stdout:1/25: dwrite f2 [0,4194304] 0 2024-09-13T17:05:40.434 INFO:tasks.workunit.client.1.smithi195.stdout:1/26: dread - fa zero size 2024-09-13T17:05:40.435 INFO:tasks.workunit.client.1.smithi195.stdout:7/33: rename d5/c9 to d5/ce 0 2024-09-13T17:05:40.435 INFO:tasks.workunit.client.1.smithi195.stdout:7/34: creat d5/ff x:0 0 0 2024-09-13T17:05:40.435 INFO:tasks.workunit.client.1.smithi195.stdout:0/30: truncate f1 4026733 0 2024-09-13T17:05:40.437 INFO:tasks.workunit.client.1.smithi195.stdout:2/38: dread d0/f6 [0,4194304] 0 2024-09-13T17:05:40.440 INFO:tasks.workunit.client.1.smithi195.stdout:4/29: link f8 fa 0 2024-09-13T17:05:40.440 INFO:tasks.workunit.client.1.smithi195.stdout:4/30: write f0 [4748863,34045] 0 2024-09-13T17:05:40.440 INFO:tasks.workunit.client.1.smithi195.stdout:4/31: truncate f2 1415944 0 2024-09-13T17:05:40.440 INFO:tasks.workunit.client.1.smithi195.stdout:4/32: readlink l6 0 2024-09-13T17:05:40.440 INFO:tasks.workunit.client.1.smithi195.stdout:4/33: chown c3 1685101 1 2024-09-13T17:05:40.441 INFO:tasks.workunit.client.1.smithi195.stdout:2/39: dread d0/f6 [0,4194304] 0 2024-09-13T17:05:40.443 INFO:tasks.workunit.client.1.smithi195.stdout:1/27: mknod db/cc 0 2024-09-13T17:05:40.443 INFO:tasks.workunit.client.1.smithi195.stdout:6/25: dwrite f2 [4194304,4194304] 0 2024-09-13T17:05:40.443 INFO:tasks.workunit.client.1.smithi195.stdout:6/26: truncate f6 461192 0 2024-09-13T17:05:40.444 INFO:tasks.workunit.client.1.smithi195.stdout:6/27: write f6 [1391385,46338] 0 2024-09-13T17:05:40.445 INFO:tasks.workunit.client.1.smithi195.stdout:7/35: dread d5/f6 [0,4194304] 0 2024-09-13T17:05:40.445 INFO:tasks.workunit.client.1.smithi195.stdout:4/34: link f1 fb 0 2024-09-13T17:05:40.445 INFO:tasks.workunit.client.1.smithi195.stdout:7/36: stat d5/ff 0 2024-09-13T17:05:40.448 INFO:tasks.workunit.client.1.smithi195.stdout:7/37: unlink d5/f7 0 2024-09-13T17:05:40.448 INFO:tasks.workunit.client.1.smithi195.stdout:7/38: dread - d5/db/fd zero size 2024-09-13T17:05:40.448 INFO:tasks.workunit.client.1.smithi195.stdout:7/39: read - d5/db/fc zero size 2024-09-13T17:05:40.448 INFO:tasks.workunit.client.1.smithi195.stdout:7/40: chown d5 1 1 2024-09-13T17:05:40.448 INFO:tasks.workunit.client.1.smithi195.stdout:7/41: creat d5/db/f10 x:0 0 0 2024-09-13T17:05:40.449 INFO:tasks.workunit.client.0.smithi115.stdout:6/35: dread f6 [0,4194304] 0 2024-09-13T17:05:40.449 INFO:tasks.workunit.client.0.smithi115.stdout:6/36: write f6 [1407299,50966] 0 2024-09-13T17:05:40.451 INFO:tasks.workunit.client.0.smithi115.stdout:6/37: symlink d8/d9/la 0 2024-09-13T17:05:40.453 INFO:tasks.workunit.client.1.smithi195.stdout:7/42: mkdir d5/d11 0 2024-09-13T17:05:40.453 INFO:tasks.workunit.client.1.smithi195.stdout:7/43: chown d5/db 7 1 2024-09-13T17:05:40.454 INFO:tasks.workunit.client.1.smithi195.stdout:9/20: getdents d6 0 2024-09-13T17:05:40.454 INFO:tasks.workunit.client.1.smithi195.stdout:9/21: dread - f2 zero size 2024-09-13T17:05:40.454 INFO:tasks.workunit.client.1.smithi195.stdout:9/22: truncate f4 813466 0 2024-09-13T17:05:40.455 INFO:tasks.workunit.client.1.smithi195.stdout:4/35: dread f1 [0,4194304] 0 2024-09-13T17:05:40.455 INFO:tasks.workunit.client.1.smithi195.stdout:7/44: rmdir d5/d11 0 2024-09-13T17:05:40.457 INFO:tasks.workunit.client.1.smithi195.stdout:9/23: symlink d6/l8 0 2024-09-13T17:05:40.457 INFO:tasks.workunit.client.1.smithi195.stdout:9/24: readlink d6/l8 0 2024-09-13T17:05:40.457 INFO:tasks.workunit.client.1.smithi195.stdout:9/25: fdatasync f4 0 2024-09-13T17:05:40.457 INFO:tasks.workunit.client.0.smithi115.stdout:0/41: dwrite f5 [0,4194304] 0 2024-09-13T17:05:40.458 INFO:tasks.workunit.client.1.smithi195.stdout:4/36: mknod cc 0 2024-09-13T17:05:40.458 INFO:tasks.workunit.client.1.smithi195.stdout:4/37: creat fd x:0 0 0 2024-09-13T17:05:40.458 INFO:tasks.workunit.client.1.smithi195.stdout:4/38: chown fa 1 1 2024-09-13T17:05:40.459 INFO:tasks.workunit.client.1.smithi195.stdout:9/26: dread f4 [0,4194304] 0 2024-09-13T17:05:40.460 INFO:tasks.workunit.client.1.smithi195.stdout:1/28: dwrite f2 [0,4194304] 0 2024-09-13T17:05:40.461 INFO:tasks.workunit.client.0.smithi115.stdout:6/38: dread f6 [0,4194304] 0 2024-09-13T17:05:40.461 INFO:tasks.workunit.client.0.smithi115.stdout:6/39: write f5 [525047,51044] 0 2024-09-13T17:05:40.461 INFO:tasks.workunit.client.0.smithi115.stdout:0/42: rmdir d7 0 2024-09-13T17:05:40.461 INFO:tasks.workunit.client.0.smithi115.stdout:0/43: write f0 [132572,110718] 0 2024-09-13T17:05:40.463 INFO:tasks.workunit.client.0.smithi115.stdout:6/40: mkdir d8/db 0 2024-09-13T17:05:40.463 INFO:tasks.workunit.client.0.smithi115.stdout:6/41: readlink l2 0 2024-09-13T17:05:40.467 INFO:tasks.workunit.client.1.smithi195.stdout:4/39: dread f2 [0,4194304] 0 2024-09-13T17:05:40.467 INFO:tasks.workunit.client.1.smithi195.stdout:4/40: creat fe x:0 0 0 2024-09-13T17:05:40.470 INFO:tasks.workunit.client.1.smithi195.stdout:1/29: mknod db/cd 0 2024-09-13T17:05:40.472 INFO:tasks.workunit.client.0.smithi115.stdout:0/44: dread f0 [0,4194304] 0 2024-09-13T17:05:40.472 INFO:tasks.workunit.client.0.smithi115.stdout:0/45: truncate f2 407603 0 2024-09-13T17:05:40.473 INFO:tasks.workunit.client.1.smithi195.stdout:6/28: truncate f2 2558398 0 2024-09-13T17:05:40.473 INFO:tasks.workunit.client.1.smithi195.stdout:6/29: rmdir - no directory 2024-09-13T17:05:40.474 INFO:tasks.workunit.client.1.smithi195.stdout:0/31: dread f1 [0,4194304] 0 2024-09-13T17:05:40.474 INFO:tasks.workunit.client.1.smithi195.stdout:0/32: stat f1 0 2024-09-13T17:05:40.474 INFO:tasks.workunit.client.1.smithi195.stdout:7/45: dwrite d5/db/fd [0,4194304] 0 2024-09-13T17:05:40.474 INFO:tasks.workunit.client.1.smithi195.stdout:7/46: write d5/db/f10 [534235,125351] 0 2024-09-13T17:05:40.475 INFO:tasks.workunit.client.1.smithi195.stdout:7/47: write d5/fa [1537921,21956] 0 2024-09-13T17:05:40.476 INFO:tasks.workunit.client.1.smithi195.stdout:6/30: rename f6 to f7 0 2024-09-13T17:05:40.483 INFO:tasks.workunit.client.1.smithi195.stdout:0/33: read f1 [3991223,89354] 0 2024-09-13T17:05:40.486 INFO:tasks.workunit.client.1.smithi195.stdout:9/27: dwrite f1 [0,4194304] 0 2024-09-13T17:05:40.488 INFO:tasks.workunit.client.1.smithi195.stdout:7/48: rename d5/db/f10 to d5/db/f12 0 2024-09-13T17:05:40.488 INFO:tasks.workunit.client.1.smithi195.stdout:7/49: chown d5/db 7579540 1 2024-09-13T17:05:40.488 INFO:tasks.workunit.client.1.smithi195.stdout:7/50: fdatasync d5/db/fd 0 2024-09-13T17:05:40.495 INFO:tasks.workunit.client.1.smithi195.stdout:9/28: mknod d6/c9 0 2024-09-13T17:05:40.495 INFO:tasks.workunit.client.1.smithi195.stdout:9/29: fsync f1 0 2024-09-13T17:05:40.498 INFO:tasks.workunit.client.1.smithi195.stdout:9/30: unlink f4 0 2024-09-13T17:05:40.498 INFO:tasks.workunit.client.1.smithi195.stdout:9/31: stat d6 0 2024-09-13T17:05:40.498 INFO:tasks.workunit.client.1.smithi195.stdout:9/32: fdatasync f1 0 2024-09-13T17:05:40.498 INFO:tasks.workunit.client.1.smithi195.stdout:9/33: chown d6 1932379 1 2024-09-13T17:05:40.498 INFO:tasks.workunit.client.1.smithi195.stdout:9/34: stat d6/l8 0 2024-09-13T17:05:40.500 INFO:tasks.workunit.client.1.smithi195.stdout:9/35: rename f2 to d6/fa 0 2024-09-13T17:05:40.501 INFO:tasks.workunit.client.1.smithi195.stdout:3/30: sync 2024-09-13T17:05:40.503 INFO:tasks.workunit.client.1.smithi195.stdout:3/31: symlink l4 0 2024-09-13T17:05:40.503 INFO:tasks.workunit.client.1.smithi195.stdout:3/32: truncate - no filename 2024-09-13T17:05:40.503 INFO:tasks.workunit.client.1.smithi195.stdout:3/33: dwrite - no filename 2024-09-13T17:05:40.503 INFO:tasks.workunit.client.1.smithi195.stdout:3/34: write - no filename 2024-09-13T17:05:40.503 INFO:tasks.workunit.client.1.smithi195.stdout:9/36: symlink d6/lb 0 2024-09-13T17:05:40.504 INFO:tasks.workunit.client.1.smithi195.stdout:3/35: unlink l4 0 2024-09-13T17:05:40.505 INFO:tasks.workunit.client.1.smithi195.stdout:9/37: rmdir d6 39 2024-09-13T17:05:40.505 INFO:tasks.workunit.client.1.smithi195.stdout:9/38: chown d6/fa 12282984 1 2024-09-13T17:05:40.506 INFO:tasks.workunit.client.1.smithi195.stdout:4/41: dwrite fe [0,4194304] 0 2024-09-13T17:05:40.507 INFO:tasks.workunit.client.0.smithi115.stdout:6/42: dwrite f5 [0,4194304] 0 2024-09-13T17:05:40.507 INFO:tasks.workunit.client.1.smithi195.stdout:0/34: dwrite f1 [0,4194304] 0 2024-09-13T17:05:40.511 INFO:tasks.workunit.client.1.smithi195.stdout:4/42: link cc cf 0 2024-09-13T17:05:40.511 INFO:tasks.workunit.client.1.smithi195.stdout:4/43: write f2 [120883,83969] 0 2024-09-13T17:05:40.512 INFO:tasks.workunit.client.1.smithi195.stdout:9/39: write f1 [2347175,127975] 0 2024-09-13T17:05:40.514 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:40.513+0000 7fc4b3d9a640 1 -- 172.21.15.115:0/119992531 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4ac0fe930 msgr2=0x7fc4ac1054d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:05:40.514 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:40.513+0000 7fc4b3d9a640 1 --2- 172.21.15.115:0/119992531 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4ac0fe930 0x7fc4ac1054d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fc49c009880 tx=0x7fc49c02a4a0 comp rx=0 tx=0).stop 2024-09-13T17:05:40.514 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:40.513+0000 7fc4b3d9a640 1 -- 172.21.15.115:0/119992531 shutdown_connections 2024-09-13T17:05:40.514 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:40.513+0000 7fc4b3d9a640 1 --2- 172.21.15.115:0/119992531 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4ac0fe930 0x7fc4ac1054d0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:40.514 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:40.513+0000 7fc4b3d9a640 1 --2- 172.21.15.115:0/119992531 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc4ac0fdf60 0x7fc4ac0fe360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:40.515 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:40.513+0000 7fc4b3d9a640 1 -- 172.21.15.115:0/119992531 >> 172.21.15.115:0/119992531 conn(0x7fc4ac0f9540 msgr2=0x7fc4ac0fb980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:05:40.515 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:40.513+0000 7fc4b3d9a640 1 -- 172.21.15.115:0/119992531 shutdown_connections 2024-09-13T17:05:40.515 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:40.513+0000 7fc4b3d9a640 1 -- 172.21.15.115:0/119992531 wait complete. 2024-09-13T17:05:40.516 INFO:tasks.workunit.client.1.smithi195.stdout:6/31: write f2 [843245,130047] 0 2024-09-13T17:05:40.516 INFO:tasks.workunit.client.1.smithi195.stdout:4/44: dread fb [0,4194304] 0 2024-09-13T17:05:40.516 INFO:tasks.workunit.client.1.smithi195.stdout:9/40: unlink f1 0 2024-09-13T17:05:40.516 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:40.514+0000 7fc4b3d9a640 1 Processor -- start 2024-09-13T17:05:40.516 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:40.514+0000 7fc4b3d9a640 1 -- start start 2024-09-13T17:05:40.516 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:40.514+0000 7fc4b3d9a640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc4ac0fdf60 0x7fc4ac19df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:05:40.517 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:40.514+0000 7fc4b3d9a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4ac0fe930 0x7fc4ac19e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:05:40.517 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:40.514+0000 7fc4b3d9a640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ac19eb40 con 0x7fc4ac0fe930 2024-09-13T17:05:40.517 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:40.514+0000 7fc4b3d9a640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ac19ecb0 con 0x7fc4ac0fdf60 2024-09-13T17:05:40.517 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:40.515+0000 7fc4b1b36640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc4ac0fdf60 0x7fc4ac19df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:05:40.517 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:40.515+0000 7fc4b1b36640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc4ac0fdf60 0x7fc4ac19df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.115:54426/0 (socket says 172.21.15.115:54426) 2024-09-13T17:05:40.517 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:40.515+0000 7fc4b1b36640 1 -- 172.21.15.115:0/2264222265 learned_addr learned my addr 172.21.15.115:0/2264222265 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:05:40.518 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:40.516+0000 7fc4b1335640 1 --2- 172.21.15.115:0/2264222265 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4ac0fe930 0x7fc4ac19e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:05:40.518 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:40.517+0000 7fc4b1b36640 1 -- 172.21.15.115:0/2264222265 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4ac0fe930 msgr2=0x7fc4ac19e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:05:40.518 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:40.517+0000 7fc4b1b36640 1 --2- 172.21.15.115:0/2264222265 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4ac0fe930 0x7fc4ac19e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:40.518 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:40.517+0000 7fc4b1b36640 1 -- 172.21.15.115:0/2264222265 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc49c009560 con 0x7fc4ac0fdf60 2024-09-13T17:05:40.519 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:40.517+0000 7fc4b1b36640 1 --2- 172.21.15.115:0/2264222265 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc4ac0fdf60 0x7fc4ac19df40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc4a800ea00 tx=0x7fc4a800eec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:05:40.519 INFO:tasks.workunit.client.1.smithi195.stdout:7/51: unlink d5/db/f12 0 2024-09-13T17:05:40.519 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:40.518+0000 7fc4a2ffd640 1 -- 172.21.15.115:0/2264222265 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc4a800cd50 con 0x7fc4ac0fdf60 2024-09-13T17:05:40.520 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:40.518+0000 7fc4a2ffd640 1 -- 172.21.15.115:0/2264222265 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc4a8011910 con 0x7fc4ac0fdf60 2024-09-13T17:05:40.520 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:40.519+0000 7fc4a2ffd640 1 -- 172.21.15.115:0/2264222265 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc4a801a990 con 0x7fc4ac0fdf60 2024-09-13T17:05:40.520 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:40.519+0000 7fc4b3d9a640 1 -- 172.21.15.115:0/2264222265 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4ac1a3420 con 0x7fc4ac0fdf60 2024-09-13T17:05:40.520 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:40.519+0000 7fc4b3d9a640 1 -- 172.21.15.115:0/2264222265 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4ac1a39f0 con 0x7fc4ac0fdf60 2024-09-13T17:05:40.521 INFO:tasks.workunit.client.1.smithi195.stdout:4/45: symlink l10 0 2024-09-13T17:05:40.521 INFO:tasks.workunit.client.1.smithi195.stdout:4/46: chown f2 123702708 1 2024-09-13T17:05:40.521 INFO:tasks.workunit.client.1.smithi195.stdout:4/47: truncate f7 255848 0 2024-09-13T17:05:40.522 INFO:tasks.workunit.client.1.smithi195.stdout:4/48: creat f11 x:0 0 0 2024-09-13T17:05:40.522 INFO:tasks.workunit.client.1.smithi195.stdout:4/49: fdatasync fe 0 2024-09-13T17:05:40.522 INFO:tasks.workunit.client.1.smithi195.stdout:4/50: read - f8 zero size 2024-09-13T17:05:40.522 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:40.520+0000 7fc4b3d9a640 1 -- 172.21.15.115:0/2264222265 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4ac06bf60 con 0x7fc4ac0fdf60 2024-09-13T17:05:40.523 INFO:tasks.workunit.client.1.smithi195.stdout:7/52: mkdir d5/d13 0 2024-09-13T17:05:40.525 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:40.524+0000 7fc4a2ffd640 1 -- 172.21.15.115:0/2264222265 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 24) v1 ==== 90954+0+0 (secure 0 0 0) 0x7fc4a8011a80 con 0x7fc4ac0fdf60 2024-09-13T17:05:40.525 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:40.524+0000 7fc4a2ffd640 1 --2- 172.21.15.115:0/2264222265 >> [v2:172.21.15.195:6828/1660911692,v1:172.21.15.195:6829/1660911692] conn(0x7fc49806cd80 0x7fc49806f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:05:40.525 INFO:tasks.workunit.client.1.smithi195.stdout:9/41: rename c3 to d6/cc 0 2024-09-13T17:05:40.526 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:40.524+0000 7fc4a2ffd640 1 -- 172.21.15.115:0/2264222265 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fc4a808cfc0 con 0x7fc4ac0fdf60 2024-09-13T17:05:40.526 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:40.525+0000 7fc4b1335640 1 --2- 172.21.15.115:0/2264222265 >> [v2:172.21.15.195:6828/1660911692,v1:172.21.15.195:6829/1660911692] conn(0x7fc49806cd80 0x7fc49806f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:05:40.527 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:40.526+0000 7fc4b1335640 1 --2- 172.21.15.115:0/2264222265 >> [v2:172.21.15.195:6828/1660911692,v1:172.21.15.195:6829/1660911692] conn(0x7fc49806cd80 0x7fc49806f240 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac19f220 tx=0x7fc49c005d90 comp rx=0 tx=0).ready entity=mgr.24317 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:05:40.528 INFO:tasks.workunit.client.1.smithi195.stdout:9/42: mknod d6/cd 0 2024-09-13T17:05:40.529 INFO:tasks.workunit.client.1.smithi195.stdout:9/43: write d6/f7 [537265,72802] 0 2024-09-13T17:05:40.533 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:40.531+0000 7fc4a2ffd640 1 -- 172.21.15.115:0/2264222265 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc4a8057130 con 0x7fc4ac0fdf60 2024-09-13T17:05:40.536 INFO:tasks.workunit.client.1.smithi195.stdout:0/35: dwrite f1 [4194304,4194304] 0 2024-09-13T17:05:40.539 INFO:tasks.workunit.client.1.smithi195.stdout:0/36: creat f3 x:0 0 0 2024-09-13T17:05:40.556 INFO:tasks.workunit.client.1.smithi195.stdout:0/37: read f1 [5439294,109779] 0 2024-09-13T17:05:40.557 INFO:tasks.workunit.client.1.smithi195.stdout:4/51: dwrite f8 [0,4194304] 0 2024-09-13T17:05:40.557 INFO:tasks.workunit.client.1.smithi195.stdout:4/52: chown l6 1019 1 2024-09-13T17:05:40.557 INFO:tasks.workunit.client.1.smithi195.stdout:7/53: dwrite d5/fa [0,4194304] 0 2024-09-13T17:05:40.557 INFO:tasks.workunit.client.1.smithi195.stdout:6/32: dwrite f2 [0,4194304] 0 2024-09-13T17:05:40.559 INFO:tasks.workunit.client.1.smithi195.stdout:9/44: truncate d6/f7 144655 0 2024-09-13T17:05:40.565 INFO:tasks.workunit.client.1.smithi195.stdout:4/53: dread f8 [0,4194304] 0 2024-09-13T17:05:40.565 INFO:tasks.workunit.client.1.smithi195.stdout:9/45: mknod d6/ce 0 2024-09-13T17:05:40.565 INFO:tasks.workunit.client.1.smithi195.stdout:9/46: chown d6/ce 3541 1 2024-09-13T17:05:40.568 INFO:tasks.workunit.client.1.smithi195.stdout:4/54: link f5 f12 0 2024-09-13T17:05:40.570 INFO:tasks.workunit.client.1.smithi195.stdout:6/33: truncate f2 1321335 0 2024-09-13T17:05:40.571 INFO:tasks.workunit.client.1.smithi195.stdout:4/55: dread f5 [0,4194304] 0 2024-09-13T17:05:40.572 INFO:tasks.workunit.client.1.smithi195.stdout:5/34: sync 2024-09-13T17:05:40.572 INFO:tasks.workunit.client.1.smithi195.stdout:8/28: sync 2024-09-13T17:05:40.572 INFO:tasks.workunit.client.1.smithi195.stdout:8/29: chown d0/d4 42269163 1 2024-09-13T17:05:40.574 INFO:tasks.workunit.client.1.smithi195.stdout:5/35: truncate f1 3568096 0 2024-09-13T17:05:40.574 INFO:tasks.workunit.client.1.smithi195.stdout:5/36: chown d2/d4/f5 36839397 1 2024-09-13T17:05:40.583 INFO:tasks.workunit.client.1.smithi195.stdout:0/38: dwrite f1 [4194304,4194304] 0 2024-09-13T17:05:40.584 INFO:tasks.workunit.client.1.smithi195.stdout:0/39: truncate f3 304107 0 2024-09-13T17:05:40.584 INFO:tasks.workunit.client.1.smithi195.stdout:0/40: truncate f3 308820 0 2024-09-13T17:05:40.584 INFO:tasks.workunit.client.1.smithi195.stdout:0/41: chown f3 4123137 1 2024-09-13T17:05:40.586 INFO:tasks.workunit.client.1.smithi195.stdout:0/42: getdents . 0 2024-09-13T17:05:40.587 INFO:tasks.workunit.client.1.smithi195.stdout:7/54: dwrite d5/db/fd [0,4194304] 0 2024-09-13T17:05:40.590 INFO:tasks.workunit.client.1.smithi195.stdout:7/55: mkdir d5/d14 0 2024-09-13T17:05:40.592 INFO:tasks.workunit.client.1.smithi195.stdout:7/56: stat d5/ce 0 2024-09-13T17:05:40.606 INFO:tasks.workunit.client.1.smithi195.stdout:4/56: dwrite f0 [4194304,4194304] 0 2024-09-13T17:05:40.608 INFO:tasks.workunit.client.1.smithi195.stdout:4/57: getdents . 0 2024-09-13T17:05:40.609 INFO:tasks.workunit.client.1.smithi195.stdout:4/58: creat f13 x:0 0 0 2024-09-13T17:05:40.609 INFO:tasks.workunit.client.1.smithi195.stdout:4/59: creat f14 x:0 0 0 2024-09-13T17:05:40.610 INFO:tasks.workunit.client.1.smithi195.stdout:6/34: dwrite f2 [0,4194304] 0 2024-09-13T17:05:40.611 INFO:tasks.workunit.client.1.smithi195.stdout:7/57: dread d5/fa [0,4194304] 0 2024-09-13T17:05:40.612 INFO:tasks.workunit.client.1.smithi195.stdout:7/58: write f4 [1393228,62187] 0 2024-09-13T17:05:40.612 INFO:tasks.workunit.client.1.smithi195.stdout:7/59: fdatasync d5/db/fd 0 2024-09-13T17:05:40.613 INFO:tasks.workunit.client.1.smithi195.stdout:4/60: mknod c15 0 2024-09-13T17:05:40.613 INFO:tasks.workunit.client.1.smithi195.stdout:8/30: dwrite d0/f3 [0,4194304] 0 2024-09-13T17:05:40.614 INFO:tasks.workunit.client.1.smithi195.stdout:0/43: dwrite f1 [0,4194304] 0 2024-09-13T17:05:40.614 INFO:tasks.workunit.client.1.smithi195.stdout:7/60: rename d5/ff to d5/db/f15 0 2024-09-13T17:05:40.614 INFO:tasks.workunit.client.1.smithi195.stdout:7/61: dread - d5/db/f15 zero size 2024-09-13T17:05:40.615 INFO:tasks.workunit.client.1.smithi195.stdout:7/62: write d5/db/f15 [285543,31355] 0 2024-09-13T17:05:40.615 INFO:tasks.workunit.client.1.smithi195.stdout:6/35: dread f7 [0,4194304] 0 2024-09-13T17:05:40.615 INFO:tasks.workunit.client.1.smithi195.stdout:6/36: write f2 [4636124,24710] 0 2024-09-13T17:05:40.615 INFO:tasks.workunit.client.1.smithi195.stdout:0/44: write f3 [221585,76475] 0 2024-09-13T17:05:40.615 INFO:tasks.workunit.client.1.smithi195.stdout:0/45: chown f1 50543 1 2024-09-13T17:05:40.615 INFO:tasks.workunit.client.1.smithi195.stdout:5/37: dwrite d2/d4/d8/fa [0,4194304] 0 2024-09-13T17:05:40.618 INFO:tasks.workunit.client.1.smithi195.stdout:8/31: creat d0/f8 x:0 0 0 2024-09-13T17:05:40.618 INFO:tasks.workunit.client.1.smithi195.stdout:7/63: symlink d5/l16 0 2024-09-13T17:05:40.619 INFO:tasks.workunit.client.1.smithi195.stdout:6/37: symlink l8 0 2024-09-13T17:05:40.619 INFO:tasks.workunit.client.1.smithi195.stdout:6/38: write f7 [2454521,123567] 0 2024-09-13T17:05:40.621 INFO:tasks.workunit.client.1.smithi195.stdout:1/30: sync 2024-09-13T17:05:40.621 INFO:tasks.workunit.client.1.smithi195.stdout:2/40: sync 2024-09-13T17:05:40.622 INFO:tasks.workunit.client.1.smithi195.stdout:5/38: unlink f1 0 2024-09-13T17:05:40.622 INFO:tasks.workunit.client.1.smithi195.stdout:5/39: rename d2/d4 to d2/d4/dd 22 2024-09-13T17:05:40.623 INFO:tasks.workunit.client.1.smithi195.stdout:8/32: truncate d0/f5 463200 0 2024-09-13T17:05:40.623 INFO:tasks.workunit.client.1.smithi195.stdout:8/33: dread - d0/f8 zero size 2024-09-13T17:05:40.623 INFO:tasks.workunit.client.1.smithi195.stdout:8/34: chown d0/d4 89 1 2024-09-13T17:05:40.624 INFO:tasks.workunit.client.1.smithi195.stdout:7/64: symlink d5/db/l17 0 2024-09-13T17:05:40.624 INFO:tasks.workunit.client.1.smithi195.stdout:7/65: truncate d5/db/f15 795233 0 2024-09-13T17:05:40.626 INFO:tasks.workunit.client.1.smithi195.stdout:6/39: mknod c9 0 2024-09-13T17:05:40.626 INFO:tasks.workunit.client.1.smithi195.stdout:0/46: dread f1 [4194304,4194304] 0 2024-09-13T17:05:40.626 INFO:tasks.workunit.client.1.smithi195.stdout:0/47: fdatasync f1 0 2024-09-13T17:05:40.626 INFO:tasks.workunit.client.1.smithi195.stdout:0/48: write f3 [989047,127611] 0 2024-09-13T17:05:40.626 INFO:tasks.workunit.client.1.smithi195.stdout:1/31: symlink db/le 0 2024-09-13T17:05:40.627 INFO:tasks.workunit.client.1.smithi195.stdout:2/41: mkdir d0/d9 0 2024-09-13T17:05:40.629 INFO:tasks.workunit.client.1.smithi195.stdout:5/40: rename d2/fb to d2/d4/d8/fe 0 2024-09-13T17:05:40.629 INFO:tasks.workunit.client.1.smithi195.stdout:4/61: dwrite f8 [0,4194304] 0 2024-09-13T17:05:40.630 INFO:tasks.workunit.client.1.smithi195.stdout:8/35: unlink d0/c1 0 2024-09-13T17:05:40.631 INFO:tasks.workunit.client.1.smithi195.stdout:6/40: mknod ca 0 2024-09-13T17:05:40.632 INFO:tasks.workunit.client.1.smithi195.stdout:1/32: mkdir db/df 0 2024-09-13T17:05:40.632 INFO:tasks.workunit.client.1.smithi195.stdout:7/66: dread d5/fa [0,4194304] 0 2024-09-13T17:05:40.633 INFO:tasks.workunit.client.1.smithi195.stdout:7/67: chown d5/d14 6432 1 2024-09-13T17:05:40.636 INFO:tasks.workunit.client.1.smithi195.stdout:4/62: creat f16 x:0 0 0 2024-09-13T17:05:40.637 INFO:tasks.workunit.client.1.smithi195.stdout:8/36: symlink d0/l9 0 2024-09-13T17:05:40.637 INFO:tasks.workunit.client.1.smithi195.stdout:8/37: dread - d0/f8 zero size 2024-09-13T17:05:40.639 INFO:tasks.workunit.client.1.smithi195.stdout:1/33: creat db/f10 x:0 0 0 2024-09-13T17:05:40.639 INFO:tasks.workunit.client.1.smithi195.stdout:1/34: fdatasync f5 0 2024-09-13T17:05:40.639 INFO:tasks.workunit.client.1.smithi195.stdout:1/35: creat db/f11 x:0 0 0 2024-09-13T17:05:40.639 INFO:tasks.workunit.client.1.smithi195.stdout:4/63: chown f0 12971 1 2024-09-13T17:05:40.640 INFO:tasks.workunit.client.1.smithi195.stdout:2/42: dwrite d0/d3/f4 [4194304,4194304] 0 2024-09-13T17:05:40.641 INFO:tasks.workunit.client.1.smithi195.stdout:8/38: rename d0/l2 to d0/la 0 2024-09-13T17:05:40.641 INFO:tasks.workunit.client.1.smithi195.stdout:6/41: write f2 [273722,33704] 0 2024-09-13T17:05:40.642 INFO:tasks.workunit.client.1.smithi195.stdout:6/42: readlink l3 0 2024-09-13T17:05:40.642 INFO:tasks.workunit.client.1.smithi195.stdout:6/43: creat fb x:0 0 0 2024-09-13T17:05:40.642 INFO:tasks.workunit.client.1.smithi195.stdout:6/44: write f2 [4094212,123743] 0 2024-09-13T17:05:40.645 INFO:tasks.workunit.client.1.smithi195.stdout:5/41: rename d2/d4/d8 to d2/df 0 2024-09-13T17:05:40.645 INFO:tasks.workunit.client.1.smithi195.stdout:4/64: mknod c17 0 2024-09-13T17:05:40.647 INFO:tasks.workunit.client.1.smithi195.stdout:7/68: rename d5/db/fd to d5/d14/f18 0 2024-09-13T17:05:40.649 INFO:tasks.workunit.client.1.smithi195.stdout:1/36: rename c4 to db/df/c12 0 2024-09-13T17:05:40.650 INFO:tasks.workunit.client.1.smithi195.stdout:4/65: link c15 c18 0 2024-09-13T17:05:40.651 INFO:tasks.workunit.client.1.smithi195.stdout:0/49: truncate f1 3466860 0 2024-09-13T17:05:40.653 INFO:tasks.workunit.client.1.smithi195.stdout:5/42: write d2/df/fa [1466271,106602] 0 2024-09-13T17:05:40.653 INFO:tasks.workunit.client.1.smithi195.stdout:8/39: rename d0/f5 to d0/d4/fb 0 2024-09-13T17:05:40.653 INFO:tasks.workunit.client.1.smithi195.stdout:8/40: creat d0/fc x:0 0 0 2024-09-13T17:05:40.653 INFO:tasks.workunit.client.1.smithi195.stdout:1/37: mkdir db/df/d13 0 2024-09-13T17:05:40.655 INFO:tasks.workunit.client.1.smithi195.stdout:0/50: symlink l4 0 2024-09-13T17:05:40.655 INFO:tasks.workunit.client.1.smithi195.stdout:2/43: dwrite d0/d3/f4 [4194304,4194304] 0 2024-09-13T17:05:40.656 INFO:tasks.workunit.client.1.smithi195.stdout:5/43: mkdir d2/d4/d10 0 2024-09-13T17:05:40.660 INFO:tasks.workunit.client.1.smithi195.stdout:8/41: unlink d0/la 0 2024-09-13T17:05:40.660 INFO:tasks.workunit.client.1.smithi195.stdout:8/42: write d0/f3 [4800959,92229] 0 2024-09-13T17:05:40.660 INFO:tasks.workunit.client.1.smithi195.stdout:8/43: chown d0/d4/fb 88 1 2024-09-13T17:05:40.661 INFO:tasks.workunit.client.1.smithi195.stdout:1/38: mknod db/c14 0 2024-09-13T17:05:40.662 INFO:tasks.workunit.client.1.smithi195.stdout:7/69: rename d5/d14 to d5/db/d19 0 2024-09-13T17:05:40.662 INFO:tasks.workunit.client.1.smithi195.stdout:7/70: readlink l0 0 2024-09-13T17:05:40.662 INFO:tasks.workunit.client.1.smithi195.stdout:7/71: rename d5/db/d19 to d5/db/d19/d1a 22 2024-09-13T17:05:40.663 INFO:tasks.workunit.client.1.smithi195.stdout:6/45: dwrite f2 [4194304,4194304] 0 2024-09-13T17:05:40.663 INFO:tasks.workunit.client.1.smithi195.stdout:0/51: mknod c5 0 2024-09-13T17:05:40.663 INFO:tasks.workunit.client.1.smithi195.stdout:0/52: chown f1 59 1 2024-09-13T17:05:40.665 INFO:tasks.workunit.client.1.smithi195.stdout:2/44: mknod d0/d3/ca 0 2024-09-13T17:05:40.667 INFO:tasks.workunit.client.1.smithi195.stdout:8/44: write d0/f3 [399675,63252] 0 2024-09-13T17:05:40.667 INFO:tasks.workunit.client.1.smithi195.stdout:1/39: unlink db/cc 0 2024-09-13T17:05:40.667 INFO:tasks.workunit.client.1.smithi195.stdout:1/40: fsync f2 0 2024-09-13T17:05:40.667 INFO:tasks.workunit.client.1.smithi195.stdout:1/41: dread - db/f10 zero size 2024-09-13T17:05:40.668 INFO:tasks.workunit.client.1.smithi195.stdout:7/72: mknod d5/c1b 0 2024-09-13T17:05:40.669 INFO:tasks.workunit.client.1.smithi195.stdout:4/66: link f5 f19 0 2024-09-13T17:05:40.674 INFO:tasks.workunit.client.1.smithi195.stdout:5/44: dwrite d2/f3 [0,4194304] 0 2024-09-13T17:05:40.674 INFO:tasks.workunit.client.1.smithi195.stdout:5/45: fsync d2/df/fe 0 2024-09-13T17:05:40.674 INFO:tasks.workunit.client.1.smithi195.stdout:5/46: write d2/df/fe [993441,110736] 0 2024-09-13T17:05:40.754 INFO:tasks.workunit.client.1.smithi195.stdout:6/46: mknod cc 0 2024-09-13T17:05:40.757 INFO:tasks.workunit.client.1.smithi195.stdout:7/73: link d5/l8 d5/db/l1c 0 2024-09-13T17:05:40.757 INFO:tasks.workunit.client.1.smithi195.stdout:4/67: chown fa 860 1 2024-09-13T17:05:40.763 INFO:tasks.workunit.client.1.smithi195.stdout:4/68: write f0 [6056734,28303] 0 2024-09-13T17:05:40.766 INFO:tasks.workunit.client.1.smithi195.stdout:5/47: mkdir d2/d4/d11 0 2024-09-13T17:05:40.766 INFO:tasks.workunit.client.1.smithi195.stdout:5/48: truncate d2/df/fa 4461092 0 2024-09-13T17:05:40.767 INFO:tasks.workunit.client.1.smithi195.stdout:6/47: rename fb to fd 0 2024-09-13T17:05:40.768 INFO:tasks.workunit.client.1.smithi195.stdout:6/48: read f7 [2020472,103201] 0 2024-09-13T17:05:40.768 INFO:tasks.workunit.client.1.smithi195.stdout:6/49: chown l5 12577533 1 2024-09-13T17:05:40.770 INFO:tasks.workunit.client.1.smithi195.stdout:7/74: creat d5/d13/f1d x:0 0 0 2024-09-13T17:05:40.771 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:40.770+0000 7fc4b3d9a640 1 -- 172.21.15.115:0/2264222265 --> [v2:172.21.15.195:6828/1660911692,v1:172.21.15.195:6829/1660911692] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc4ac06a560 con 0x7fc49806cd80 2024-09-13T17:05:40.771 INFO:tasks.workunit.client.1.smithi195.stdout:5/49: mkdir d2/d12 0 2024-09-13T17:05:40.771 INFO:tasks.workunit.client.1.smithi195.stdout:5/50: truncate d2/d4/f5 871410 0 2024-09-13T17:05:40.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:40.771+0000 7fc4a2ffd640 1 -- 172.21.15.115:0/2264222265 <== mgr.24317 v2:172.21.15.195:6828/1660911692 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7fc4ac06a560 con 0x7fc49806cd80 2024-09-13T17:05:40.773 INFO:tasks.workunit.client.1.smithi195.stdout:6/50: unlink l8 0 2024-09-13T17:05:40.773 INFO:tasks.workunit.client.1.smithi195.stdout:7/75: unlink d5/db/f15 0 2024-09-13T17:05:40.774 INFO:tasks.workunit.client.1.smithi195.stdout:4/69: mkdir d1a 0 2024-09-13T17:05:40.775 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:40.774+0000 7fc4b3d9a640 1 -- 172.21.15.115:0/2264222265 >> [v2:172.21.15.195:6828/1660911692,v1:172.21.15.195:6829/1660911692] conn(0x7fc49806cd80 msgr2=0x7fc49806f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:05:40.775 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:40.774+0000 7fc4b3d9a640 1 --2- 172.21.15.115:0/2264222265 >> [v2:172.21.15.195:6828/1660911692,v1:172.21.15.195:6829/1660911692] conn(0x7fc49806cd80 0x7fc49806f240 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac19f220 tx=0x7fc49c005d90 comp rx=0 tx=0).stop 2024-09-13T17:05:40.775 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:40.774+0000 7fc4b3d9a640 1 -- 172.21.15.115:0/2264222265 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc4ac0fdf60 msgr2=0x7fc4ac19df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:05:40.775 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:40.774+0000 7fc4b3d9a640 1 --2- 172.21.15.115:0/2264222265 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc4ac0fdf60 0x7fc4ac19df40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc4a800ea00 tx=0x7fc4a800eec0 comp rx=0 tx=0).stop 2024-09-13T17:05:40.775 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:40.774+0000 7fc4b3d9a640 1 -- 172.21.15.115:0/2264222265 shutdown_connections 2024-09-13T17:05:40.775 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:40.774+0000 7fc4b3d9a640 1 --2- 172.21.15.115:0/2264222265 >> [v2:172.21.15.195:6828/1660911692,v1:172.21.15.195:6829/1660911692] conn(0x7fc49806cd80 0x7fc49806f240 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:40.775 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:40.774+0000 7fc4b3d9a640 1 --2- 172.21.15.115:0/2264222265 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4ac0fe930 0x7fc4ac19e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:40.775 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:40.774+0000 7fc4b3d9a640 1 --2- 172.21.15.115:0/2264222265 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc4ac0fdf60 0x7fc4ac19df40 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:40.775 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:40.774+0000 7fc4b3d9a640 1 -- 172.21.15.115:0/2264222265 >> 172.21.15.115:0/2264222265 conn(0x7fc4ac0f9540 msgr2=0x7fc4ac1038e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:05:40.775 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:40.774+0000 7fc4b3d9a640 1 -- 172.21.15.115:0/2264222265 shutdown_connections 2024-09-13T17:05:40.776 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:40.774+0000 7fc4b3d9a640 1 -- 172.21.15.115:0/2264222265 wait complete. 2024-09-13T17:05:40.776 INFO:tasks.workunit.client.1.smithi195.stdout:7/76: rename d5/db/l17 to d5/db/l1e 0 2024-09-13T17:05:40.777 INFO:tasks.workunit.client.1.smithi195.stdout:4/70: write f11 [886612,101326] 0 2024-09-13T17:05:40.780 INFO:tasks.workunit.client.1.smithi195.stdout:4/71: rename c15 to d1a/c1b 0 2024-09-13T17:05:40.780 INFO:tasks.workunit.client.1.smithi195.stdout:4/72: fsync fa 0 2024-09-13T17:05:40.781 INFO:tasks.workunit.client.1.smithi195.stdout:4/73: symlink d1a/l1c 0 2024-09-13T17:05:40.782 INFO:tasks.workunit.client.1.smithi195.stdout:4/74: creat d1a/f1d x:0 0 0 2024-09-13T17:05:40.782 INFO:tasks.workunit.client.1.smithi195.stdout:3/36: sync 2024-09-13T17:05:40.783 INFO:tasks.workunit.client.1.smithi195.stdout:3/37: dwrite - no filename 2024-09-13T17:05:40.783 INFO:tasks.workunit.client.1.smithi195.stdout:3/38: write - no filename 2024-09-13T17:05:40.783 INFO:tasks.workunit.client.1.smithi195.stdout:9/47: sync 2024-09-13T17:05:40.784 INFO:tasks.workunit.client.1.smithi195.stdout:4/75: write fd [905331,120660] 0 2024-09-13T17:05:40.786 INFO:tasks.workunit.client.1.smithi195.stdout:3/39: getdents . 0 2024-09-13T17:05:40.786 INFO:tasks.workunit.client.1.smithi195.stdout:3/40: dread - no filename 2024-09-13T17:05:40.786 INFO:tasks.workunit.client.1.smithi195.stdout:3/41: dwrite - no filename 2024-09-13T17:05:40.786 INFO:tasks.workunit.client.1.smithi195.stdout:3/42: dread - no filename 2024-09-13T17:05:40.788 INFO:tasks.workunit.client.1.smithi195.stdout:3/43: creat f5 x:0 0 0 2024-09-13T17:05:40.788 INFO:teuthology.orchestra.run.smithi115.stdout:true 2024-09-13T17:05:40.789 INFO:tasks.workunit.client.1.smithi195.stdout:5/51: truncate d2/df/fa 721420 0 2024-09-13T17:05:40.794 INFO:tasks.workunit.client.1.smithi195.stdout:5/52: write d2/d4/f5 [605885,122176] 0 2024-09-13T17:05:40.794 INFO:tasks.workunit.client.1.smithi195.stdout:5/53: chown d2/d4 0 1 2024-09-13T17:05:40.810 INFO:tasks.workunit.client.1.smithi195.stdout:7/77: dwrite f4 [0,4194304] 0 2024-09-13T17:05:40.812 INFO:tasks.workunit.client.1.smithi195.stdout:9/48: dwrite d6/fa [0,4194304] 0 2024-09-13T17:05:40.812 INFO:tasks.workunit.client.1.smithi195.stdout:9/49: dread d6/f7 [0,4194304] 0 2024-09-13T17:05:40.814 INFO:tasks.workunit.client.1.smithi195.stdout:3/44: dwrite f5 [0,4194304] 0 2024-09-13T17:05:40.815 INFO:tasks.workunit.client.1.smithi195.stdout:5/54: dwrite d2/f3 [4194304,4194304] 0 2024-09-13T17:05:40.815 INFO:tasks.workunit.client.1.smithi195.stdout:5/55: truncate d2/df/fe 1163976 0 2024-09-13T17:05:40.815 INFO:tasks.workunit.client.1.smithi195.stdout:5/56: readlink d2/l9 0 2024-09-13T17:05:40.816 INFO:tasks.workunit.client.1.smithi195.stdout:5/57: chown d2/f3 660576777 1 2024-09-13T17:05:40.819 INFO:tasks.workunit.client.1.smithi195.stdout:7/78: read d5/db/d19/f18 [3318870,10644] 0 2024-09-13T17:05:40.819 INFO:tasks.workunit.client.1.smithi195.stdout:4/76: dwrite f8 [0,4194304] 0 2024-09-13T17:05:40.819 INFO:tasks.workunit.client.1.smithi195.stdout:4/77: creat d1a/f1e x:0 0 0 2024-09-13T17:05:40.819 INFO:tasks.workunit.client.1.smithi195.stdout:4/78: chown f11 30 1 2024-09-13T17:05:40.861 INFO:tasks.workunit.client.1.smithi195.stdout:9/50: getdents d6 0 2024-09-13T17:05:40.863 INFO:tasks.workunit.client.1.smithi195.stdout:3/45: mknod c6 0 2024-09-13T17:05:40.863 INFO:tasks.workunit.client.1.smithi195.stdout:3/46: readlink l2 0 2024-09-13T17:05:40.863 INFO:tasks.workunit.client.1.smithi195.stdout:3/47: fdatasync f5 0 2024-09-13T17:05:40.864 INFO:tasks.workunit.client.1.smithi195.stdout:5/58: symlink d2/d12/l13 0 2024-09-13T17:05:40.865 INFO:tasks.workunit.client.1.smithi195.stdout:3/48: write f5 [1120840,9699] 0 2024-09-13T17:05:40.865 INFO:tasks.workunit.client.1.smithi195.stdout:3/49: rmdir - no directory 2024-09-13T17:05:40.865 INFO:tasks.workunit.client.1.smithi195.stdout:3/50: write f5 [556105,6554] 0 2024-09-13T17:05:40.867 INFO:tasks.workunit.client.1.smithi195.stdout:4/79: mkdir d1a/d1f 0 2024-09-13T17:05:40.875 INFO:tasks.workunit.client.1.smithi195.stdout:9/51: mkdir d6/df 0 2024-09-13T17:05:40.876 INFO:tasks.workunit.client.1.smithi195.stdout:3/51: mkdir d7 0 2024-09-13T17:05:40.877 INFO:tasks.workunit.client.1.smithi195.stdout:3/52: getdents d7 0 2024-09-13T17:05:40.877 INFO:tasks.workunit.client.1.smithi195.stdout:7/79: rmdir d5/d13 39 2024-09-13T17:05:40.877 INFO:tasks.workunit.client.1.smithi195.stdout:7/80: chown d5/d13/f1d 106032 1 2024-09-13T17:05:40.877 INFO:tasks.workunit.client.1.smithi195.stdout:7/81: read - d5/d13/f1d zero size 2024-09-13T17:05:40.878 INFO:tasks.workunit.client.1.smithi195.stdout:4/80: write fb [2760748,116099] 0 2024-09-13T17:05:40.878 INFO:tasks.workunit.client.1.smithi195.stdout:4/81: chown d1a/c1b 40 1 2024-09-13T17:05:40.878 INFO:tasks.workunit.client.1.smithi195.stdout:5/59: dwrite d2/df/fa [0,4194304] 0 2024-09-13T17:05:40.879 INFO:tasks.workunit.client.1.smithi195.stdout:9/52: chown d6/fa 28865075 1 2024-09-13T17:05:40.881 INFO:tasks.workunit.client.1.smithi195.stdout:4/82: creat d1a/d1f/f20 x:0 0 0 2024-09-13T17:05:40.882 INFO:tasks.workunit.client.1.smithi195.stdout:4/83: read f19 [55227,94130] 0 2024-09-13T17:05:40.882 INFO:tasks.workunit.client.1.smithi195.stdout:9/53: symlink d6/df/l10 0 2024-09-13T17:05:40.884 INFO:tasks.workunit.client.1.smithi195.stdout:9/54: chown d6/cc 1341989 1 2024-09-13T17:05:40.887 INFO:tasks.workunit.client.1.smithi195.stdout:4/84: unlink l6 0 2024-09-13T17:05:40.887 INFO:tasks.workunit.client.1.smithi195.stdout:4/85: write f19 [847259,11954] 0 2024-09-13T17:05:40.887 INFO:tasks.workunit.client.1.smithi195.stdout:4/86: chown c17 934686 1 2024-09-13T17:05:40.888 INFO:tasks.workunit.client.1.smithi195.stdout:4/87: mkdir d1a/d1f/d21 0 2024-09-13T17:05:40.892 INFO:tasks.workunit.client.1.smithi195.stdout:9/55: rename d6/c9 to d6/c11 0 2024-09-13T17:05:40.892 INFO:tasks.workunit.client.1.smithi195.stdout:9/56: chown l5 28206573 1 2024-09-13T17:05:40.892 INFO:tasks.workunit.client.1.smithi195.stdout:9/57: readlink d6/l8 0 2024-09-13T17:05:40.894 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:40.893+0000 7fa72c576640 1 -- 172.21.15.115:0/2945748528 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7240ffc30 msgr2=0x7fa7241000b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:05:40.894 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:40.893+0000 7fa72c576640 1 --2- 172.21.15.115:0/2945748528 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7240ffc30 0x7fa7241000b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa714009880 tx=0x7fa71402a4a0 comp rx=0 tx=0).stop 2024-09-13T17:05:40.895 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:40.893+0000 7fa72c576640 1 -- 172.21.15.115:0/2945748528 shutdown_connections 2024-09-13T17:05:40.895 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:40.893+0000 7fa72c576640 1 --2- 172.21.15.115:0/2945748528 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7240ffc30 0x7fa7241000b0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:40.895 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:40.893+0000 7fa72c576640 1 --2- 172.21.15.115:0/2945748528 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa7240fea30 0x7fa7240fee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:40.895 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:40.893+0000 7fa72c576640 1 -- 172.21.15.115:0/2945748528 >> 172.21.15.115:0/2945748528 conn(0x7fa7240fa1c0 msgr2=0x7fa7240fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:05:40.895 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:40.893+0000 7fa72c576640 1 -- 172.21.15.115:0/2945748528 shutdown_connections 2024-09-13T17:05:40.895 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:40.893+0000 7fa72c576640 1 -- 172.21.15.115:0/2945748528 wait complete. 2024-09-13T17:05:40.896 INFO:tasks.workunit.client.1.smithi195.stdout:9/58: mkdir d6/d12 0 2024-09-13T17:05:40.898 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:40.894+0000 7fa72c576640 1 Processor -- start 2024-09-13T17:05:40.898 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:40.894+0000 7fa72c576640 1 -- start start 2024-09-13T17:05:40.898 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:40.894+0000 7fa72c576640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa7240fea30 0x7fa724195580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:05:40.898 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:40.894+0000 7fa72c576640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7240ffc30 0x7fa724195ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:05:40.898 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:40.894+0000 7fa72c576640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa724196090 con 0x7fa7240ffc30 2024-09-13T17:05:40.898 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:40.894+0000 7fa72c576640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa724196200 con 0x7fa7240fea30 2024-09-13T17:05:40.899 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:40.894+0000 7fa729b11640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7240ffc30 0x7fa724195ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:05:40.899 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:40.894+0000 7fa729b11640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7240ffc30 0x7fa724195ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:41656/0 (socket says 172.21.15.115:41656) 2024-09-13T17:05:40.899 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:40.894+0000 7fa729b11640 1 -- 172.21.15.115:0/629913472 learned_addr learned my addr 172.21.15.115:0/629913472 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:05:40.899 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:40.894+0000 7fa72a312640 1 --2- 172.21.15.115:0/629913472 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa7240fea30 0x7fa724195580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:05:40.899 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:40.895+0000 7fa729b11640 1 -- 172.21.15.115:0/629913472 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa7240fea30 msgr2=0x7fa724195580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:05:40.899 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:40.895+0000 7fa729b11640 1 --2- 172.21.15.115:0/629913472 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa7240fea30 0x7fa724195580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:40.899 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:40.895+0000 7fa729b11640 1 -- 172.21.15.115:0/629913472 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa714009560 con 0x7fa7240ffc30 2024-09-13T17:05:40.899 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:40.895+0000 7fa729b11640 1 --2- 172.21.15.115:0/629913472 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7240ffc30 0x7fa724195ac0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fa714006010 tx=0x7fa7140055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:05:40.900 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:40.895+0000 7fa71b7fe640 1 -- 172.21.15.115:0/629913472 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa714004aa0 con 0x7fa7240ffc30 2024-09-13T17:05:40.900 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:40.895+0000 7fa71b7fe640 1 -- 172.21.15.115:0/629913472 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa714004c00 con 0x7fa7240ffc30 2024-09-13T17:05:40.900 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:40.895+0000 7fa72c576640 1 -- 172.21.15.115:0/629913472 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa72419ac40 con 0x7fa7240ffc30 2024-09-13T17:05:40.900 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:40.895+0000 7fa72c576640 1 -- 172.21.15.115:0/629913472 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa72419b1b0 con 0x7fa7240ffc30 2024-09-13T17:05:40.900 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:40.895+0000 7fa71b7fe640 1 -- 172.21.15.115:0/629913472 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa7140318b0 con 0x7fa7240ffc30 2024-09-13T17:05:40.901 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:40.897+0000 7fa72c576640 1 -- 172.21.15.115:0/629913472 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa724107500 con 0x7fa7240ffc30 2024-09-13T17:05:40.902 INFO:tasks.workunit.client.1.smithi195.stdout:9/59: mkdir d6/df/d13 0 2024-09-13T17:05:40.902 INFO:tasks.workunit.client.1.smithi195.stdout:9/60: truncate d6/fa 2180633 0 2024-09-13T17:05:40.902 INFO:tasks.workunit.client.1.smithi195.stdout:3/53: write f5 [5014181,14977] 0 2024-09-13T17:05:40.902 INFO:tasks.workunit.client.1.smithi195.stdout:9/61: symlink d6/d12/l14 0 2024-09-13T17:05:40.902 INFO:tasks.workunit.client.1.smithi195.stdout:9/62: mknod d6/df/c15 0 2024-09-13T17:05:40.902 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:40.897+0000 7fa71b7fe640 1 -- 172.21.15.115:0/629913472 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 24) v1 ==== 90954+0+0 (secure 0 0 0) 0x7fa714031bf0 con 0x7fa7240ffc30 2024-09-13T17:05:40.902 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:40.898+0000 7fa71b7fe640 1 --2- 172.21.15.115:0/629913472 >> [v2:172.21.15.195:6828/1660911692,v1:172.21.15.195:6829/1660911692] conn(0x7fa71006cd80 0x7fa71006f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:05:40.902 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:40.898+0000 7fa71b7fe640 1 -- 172.21.15.115:0/629913472 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fa7140ad770 con 0x7fa7240ffc30 2024-09-13T17:05:40.903 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:40.898+0000 7fa72a312640 1 --2- 172.21.15.115:0/629913472 >> [v2:172.21.15.195:6828/1660911692,v1:172.21.15.195:6829/1660911692] conn(0x7fa71006cd80 0x7fa71006f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:05:40.903 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:40.899+0000 7fa72a312640 1 --2- 172.21.15.115:0/629913472 >> [v2:172.21.15.195:6828/1660911692,v1:172.21.15.195:6829/1660911692] conn(0x7fa71006cd80 0x7fa71006f240 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa7240ffa90 tx=0x7fa720005f90 comp rx=0 tx=0).ready entity=mgr.24317 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:05:40.903 INFO:tasks.workunit.client.1.smithi195.stdout:9/63: mkdir d6/df/d16 0 2024-09-13T17:05:40.903 INFO:tasks.workunit.client.1.smithi195.stdout:9/64: truncate d6/f7 843707 0 2024-09-13T17:05:40.904 INFO:tasks.workunit.client.1.smithi195.stdout:9/65: link d6/l8 d6/d12/l17 0 2024-09-13T17:05:40.904 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:40.903+0000 7fa71b7fe640 1 -- 172.21.15.115:0/629913472 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa7140777c0 con 0x7fa7240ffc30 2024-09-13T17:05:40.905 INFO:tasks.workunit.client.1.smithi195.stdout:4/88: dwrite f2 [0,4194304] 0 2024-09-13T17:05:40.905 INFO:tasks.workunit.client.1.smithi195.stdout:4/89: read - f14 zero size 2024-09-13T17:05:40.909 INFO:tasks.workunit.client.1.smithi195.stdout:4/90: dread f19 [0,4194304] 0 2024-09-13T17:05:40.909 INFO:tasks.workunit.client.1.smithi195.stdout:4/91: dread - f16 zero size 2024-09-13T17:05:40.910 INFO:tasks.workunit.client.1.smithi195.stdout:0/53: sync 2024-09-13T17:05:40.910 INFO:tasks.workunit.client.1.smithi195.stdout:1/42: sync 2024-09-13T17:05:40.910 INFO:tasks.workunit.client.1.smithi195.stdout:2/45: sync 2024-09-13T17:05:40.910 INFO:tasks.workunit.client.1.smithi195.stdout:2/46: readlink d0/d3/l8 0 2024-09-13T17:05:40.910 INFO:tasks.workunit.client.1.smithi195.stdout:8/45: sync 2024-09-13T17:05:40.911 INFO:tasks.workunit.client.1.smithi195.stdout:1/43: getdents db/df/d13 0 2024-09-13T17:05:40.911 INFO:tasks.workunit.client.1.smithi195.stdout:3/54: dread f5 [0,4194304] 0 2024-09-13T17:05:40.911 INFO:tasks.workunit.client.1.smithi195.stdout:1/44: dread - db/f11 zero size 2024-09-13T17:05:40.911 INFO:tasks.workunit.client.1.smithi195.stdout:1/45: fdatasync fa 0 2024-09-13T17:05:40.911 INFO:tasks.workunit.client.1.smithi195.stdout:3/55: write f5 [6003881,93551] 0 2024-09-13T17:05:40.911 INFO:tasks.workunit.client.1.smithi195.stdout:0/54: unlink l4 0 2024-09-13T17:05:40.912 INFO:tasks.workunit.client.1.smithi195.stdout:8/46: creat d0/d4/fd x:0 0 0 2024-09-13T17:05:40.912 INFO:tasks.workunit.client.1.smithi195.stdout:8/47: creat d0/d4/fe x:0 0 0 2024-09-13T17:05:40.912 INFO:tasks.workunit.client.1.smithi195.stdout:8/48: write d0/d4/fd [805864,78882] 0 2024-09-13T17:05:40.912 INFO:tasks.workunit.client.1.smithi195.stdout:8/49: rename d0 to d0/d4/df 22 2024-09-13T17:05:40.915 INFO:tasks.workunit.client.1.smithi195.stdout:3/56: mknod d7/c8 0 2024-09-13T17:05:40.918 INFO:tasks.workunit.client.1.smithi195.stdout:8/50: mknod d0/d4/c10 0 2024-09-13T17:05:40.918 INFO:tasks.workunit.client.1.smithi195.stdout:2/47: write d0/d3/f4 [5303437,75569] 0 2024-09-13T17:05:40.919 INFO:tasks.workunit.client.1.smithi195.stdout:3/57: mknod d7/c9 0 2024-09-13T17:05:40.921 INFO:tasks.workunit.client.1.smithi195.stdout:8/51: truncate d0/f3 1322521 0 2024-09-13T17:05:40.921 INFO:tasks.workunit.client.1.smithi195.stdout:8/52: truncate d0/d4/fb 635995 0 2024-09-13T17:05:40.922 INFO:tasks.workunit.client.1.smithi195.stdout:2/48: mknod d0/cb 0 2024-09-13T17:05:40.923 INFO:tasks.workunit.client.1.smithi195.stdout:8/53: mknod d0/d4/c11 0 2024-09-13T17:05:40.924 INFO:tasks.workunit.client.1.smithi195.stdout:1/46: dwrite f2 [0,4194304] 0 2024-09-13T17:05:40.924 INFO:tasks.workunit.client.1.smithi195.stdout:1/47: write fa [417120,85631] 0 2024-09-13T17:05:40.924 INFO:tasks.workunit.client.1.smithi195.stdout:8/54: symlink d0/d4/l12 0 2024-09-13T17:05:40.925 INFO:tasks.workunit.client.1.smithi195.stdout:2/49: fdatasync d0/d3/f4 0 2024-09-13T17:05:40.928 INFO:tasks.workunit.client.1.smithi195.stdout:2/50: creat d0/d9/fc x:0 0 0 2024-09-13T17:05:40.928 INFO:tasks.workunit.client.1.smithi195.stdout:2/51: fdatasync d0/f6 0 2024-09-13T17:05:40.928 INFO:tasks.workunit.client.1.smithi195.stdout:2/52: dread - d0/d9/fc zero size 2024-09-13T17:05:40.931 INFO:tasks.workunit.client.1.smithi195.stdout:9/66: truncate d6/f7 686154 0 2024-09-13T17:05:40.931 INFO:tasks.workunit.client.1.smithi195.stdout:9/67: stat d6/df 0 2024-09-13T17:05:40.933 INFO:tasks.workunit.client.1.smithi195.stdout:1/48: read f5 [3567785,100621] 0 2024-09-13T17:05:40.934 INFO:tasks.workunit.client.1.smithi195.stdout:1/49: read - db/f10 zero size 2024-09-13T17:05:40.934 INFO:tasks.workunit.client.1.smithi195.stdout:9/68: rename d6/fa to d6/f18 0 2024-09-13T17:05:40.935 INFO:tasks.workunit.client.1.smithi195.stdout:0/55: getdents . 0 2024-09-13T17:05:40.937 INFO:tasks.workunit.client.1.smithi195.stdout:1/50: rename fa to db/df/d13/f15 0 2024-09-13T17:05:40.937 INFO:tasks.workunit.client.1.smithi195.stdout:1/51: write db/f10 [797135,90261] 0 2024-09-13T17:05:40.937 INFO:tasks.workunit.client.1.smithi195.stdout:3/58: dwrite f5 [4194304,4194304] 0 2024-09-13T17:05:40.937 INFO:tasks.workunit.client.1.smithi195.stdout:3/59: readlink l2 0 2024-09-13T17:05:40.938 INFO:tasks.workunit.client.1.smithi195.stdout:1/52: creat db/df/f16 x:0 0 0 2024-09-13T17:05:40.938 INFO:tasks.workunit.client.1.smithi195.stdout:1/53: dread - db/f11 zero size 2024-09-13T17:05:40.940 INFO:tasks.workunit.client.1.smithi195.stdout:3/60: creat d7/fa x:0 0 0 2024-09-13T17:05:40.940 INFO:tasks.workunit.client.1.smithi195.stdout:2/53: dread d0/f6 [0,4194304] 0 2024-09-13T17:05:40.940 INFO:tasks.workunit.client.1.smithi195.stdout:1/54: unlink db/c14 0 2024-09-13T17:05:40.941 INFO:tasks.workunit.client.1.smithi195.stdout:3/61: symlink d7/lb 0 2024-09-13T17:05:40.941 INFO:tasks.workunit.client.1.smithi195.stdout:3/62: stat c3 0 2024-09-13T17:05:40.942 INFO:tasks.workunit.client.1.smithi195.stdout:2/54: symlink d0/d9/ld 0 2024-09-13T17:05:40.944 INFO:tasks.workunit.client.1.smithi195.stdout:1/55: truncate f5 3968589 0 2024-09-13T17:05:40.944 INFO:tasks.workunit.client.1.smithi195.stdout:1/56: creat db/f17 x:0 0 0 2024-09-13T17:05:40.944 INFO:tasks.workunit.client.1.smithi195.stdout:9/69: dread d6/f18 [0,4194304] 0 2024-09-13T17:05:40.945 INFO:tasks.workunit.client.1.smithi195.stdout:8/55: dwrite d0/d4/fd [0,4194304] 0 2024-09-13T17:05:40.945 INFO:tasks.workunit.client.1.smithi195.stdout:8/56: write d0/f3 [541088,129862] 0 2024-09-13T17:05:40.945 INFO:tasks.workunit.client.1.smithi195.stdout:8/57: truncate d0/d4/fe 707729 0 2024-09-13T17:05:40.945 INFO:tasks.workunit.client.1.smithi195.stdout:8/58: fsync d0/fc 0 2024-09-13T17:05:40.946 INFO:tasks.workunit.client.1.smithi195.stdout:3/63: unlink c3 0 2024-09-13T17:05:40.946 INFO:tasks.workunit.client.1.smithi195.stdout:3/64: chown d7/c8 131798 1 2024-09-13T17:05:40.946 INFO:tasks.workunit.client.1.smithi195.stdout:3/65: read - d7/fa zero size 2024-09-13T17:05:40.947 INFO:tasks.workunit.client.1.smithi195.stdout:2/55: creat d0/d3/fe x:0 0 0 2024-09-13T17:05:40.949 INFO:tasks.workunit.client.1.smithi195.stdout:0/56: dwrite f3 [0,4194304] 0 2024-09-13T17:05:40.951 INFO:tasks.workunit.client.1.smithi195.stdout:8/59: mkdir d0/d13 0 2024-09-13T17:05:40.952 INFO:tasks.workunit.client.1.smithi195.stdout:8/60: write d0/d4/fe [1705762,107974] 0 2024-09-13T17:05:40.955 INFO:tasks.workunit.client.1.smithi195.stdout:2/56: unlink d0/cb 0 2024-09-13T17:05:40.955 INFO:tasks.workunit.client.1.smithi195.stdout:2/57: write d0/f6 [5178611,7377] 0 2024-09-13T17:05:40.956 INFO:tasks.workunit.client.1.smithi195.stdout:2/58: chown d0 5 1 2024-09-13T17:05:40.956 INFO:tasks.workunit.client.1.smithi195.stdout:9/70: mkdir d6/d19 0 2024-09-13T17:05:40.956 INFO:tasks.workunit.client.1.smithi195.stdout:9/71: stat d6/df/d16 0 2024-09-13T17:05:40.956 INFO:tasks.workunit.client.1.smithi195.stdout:9/72: dread d6/f7 [0,4194304] 0 2024-09-13T17:05:40.961 INFO:tasks.workunit.client.1.smithi195.stdout:8/61: mknod d0/d13/c14 0 2024-09-13T17:05:40.968 INFO:tasks.workunit.client.1.smithi195.stdout:0/57: dread f1 [0,4194304] 0 2024-09-13T17:05:40.971 INFO:tasks.workunit.client.1.smithi195.stdout:0/58: creat f6 x:0 0 0 2024-09-13T17:05:40.971 INFO:tasks.workunit.client.1.smithi195.stdout:0/59: chown f3 27317 1 2024-09-13T17:05:40.972 INFO:tasks.workunit.client.1.smithi195.stdout:8/62: getdents d0/d4 0 2024-09-13T17:05:40.974 INFO:tasks.workunit.client.1.smithi195.stdout:3/66: truncate f5 6171547 0 2024-09-13T17:05:40.974 INFO:tasks.workunit.client.1.smithi195.stdout:8/63: write d0/d4/fd [466741,98048] 0 2024-09-13T17:05:40.974 INFO:tasks.workunit.client.1.smithi195.stdout:3/67: mknod d7/cc 0 2024-09-13T17:05:40.975 INFO:tasks.workunit.client.1.smithi195.stdout:8/64: mknod d0/c15 0 2024-09-13T17:05:40.976 INFO:tasks.workunit.client.1.smithi195.stdout:3/68: link l2 d7/ld 0 2024-09-13T17:05:40.977 INFO:tasks.workunit.client.1.smithi195.stdout:8/65: rename d0/d4/fd to d0/d13/f16 0 2024-09-13T17:05:40.977 INFO:tasks.workunit.client.1.smithi195.stdout:8/66: write d0/d13/f16 [288749,84585] 0 2024-09-13T17:05:40.977 INFO:tasks.workunit.client.1.smithi195.stdout:8/67: readlink d0/l9 0 2024-09-13T17:05:40.977 INFO:tasks.workunit.client.1.smithi195.stdout:8/68: read - d0/f8 zero size 2024-09-13T17:05:40.977 INFO:tasks.workunit.client.1.smithi195.stdout:3/69: symlink d7/le 0 2024-09-13T17:05:40.978 INFO:tasks.workunit.client.1.smithi195.stdout:3/70: fsync d7/fa 0 2024-09-13T17:05:40.978 INFO:tasks.workunit.client.1.smithi195.stdout:3/71: symlink d7/lf 0 2024-09-13T17:05:40.978 INFO:tasks.workunit.client.1.smithi195.stdout:3/72: read - d7/fa zero size 2024-09-13T17:05:40.979 INFO:tasks.workunit.client.1.smithi195.stdout:8/69: dread d0/d4/fe [0,4194304] 0 2024-09-13T17:05:40.980 INFO:tasks.workunit.client.1.smithi195.stdout:8/70: mkdir d0/d17 0 2024-09-13T17:05:40.982 INFO:tasks.workunit.client.1.smithi195.stdout:8/71: dread d0/d4/fb [0,4194304] 0 2024-09-13T17:05:40.983 INFO:tasks.workunit.client.1.smithi195.stdout:8/72: mknod d0/d17/c18 0 2024-09-13T17:05:40.983 INFO:tasks.workunit.client.1.smithi195.stdout:8/73: chown d0/c7 6 1 2024-09-13T17:05:40.983 INFO:tasks.workunit.client.1.smithi195.stdout:8/74: read d0/f3 [287790,52931] 0 2024-09-13T17:05:40.983 INFO:tasks.workunit.client.1.smithi195.stdout:8/75: write d0/f3 [1149065,80429] 0 2024-09-13T17:05:40.984 INFO:tasks.workunit.client.1.smithi195.stdout:8/76: unlink d0/d4/l6 0 2024-09-13T17:05:40.984 INFO:tasks.workunit.client.1.smithi195.stdout:8/77: truncate d0/d4/fb 742302 0 2024-09-13T17:05:40.986 INFO:tasks.workunit.client.1.smithi195.stdout:8/78: unlink d0/d13/c14 0 2024-09-13T17:05:40.987 INFO:tasks.workunit.client.1.smithi195.stdout:1/57: dwrite db/f10 [0,4194304] 0 2024-09-13T17:05:40.987 INFO:tasks.workunit.client.1.smithi195.stdout:8/79: rename d0/c15 to d0/c19 0 2024-09-13T17:05:40.989 INFO:tasks.workunit.client.1.smithi195.stdout:1/58: rmdir db/df 39 2024-09-13T17:05:40.989 INFO:tasks.workunit.client.1.smithi195.stdout:1/59: creat db/f18 x:0 0 0 2024-09-13T17:05:40.989 INFO:tasks.workunit.client.1.smithi195.stdout:1/60: readlink l8 0 2024-09-13T17:05:40.989 INFO:tasks.workunit.client.1.smithi195.stdout:1/61: truncate db/df/d13/f15 705673 0 2024-09-13T17:05:40.991 INFO:tasks.workunit.client.1.smithi195.stdout:0/60: fsync f6 0 2024-09-13T17:05:40.992 INFO:tasks.workunit.client.1.smithi195.stdout:0/61: mkdir d7 0 2024-09-13T17:05:40.992 INFO:tasks.workunit.client.1.smithi195.stdout:0/62: stat d7 0 2024-09-13T17:05:40.992 INFO:tasks.workunit.client.1.smithi195.stdout:0/63: write f1 [4286833,19529] 0 2024-09-13T17:05:40.992 INFO:tasks.workunit.client.1.smithi195.stdout:0/64: stat c5 0 2024-09-13T17:05:40.994 INFO:tasks.workunit.client.1.smithi195.stdout:8/80: fsync d0/d13/f16 0 2024-09-13T17:05:40.995 INFO:tasks.workunit.client.1.smithi195.stdout:8/81: rename d0/d4/c11 to d0/d4/c1a 0 2024-09-13T17:05:41.001 INFO:tasks.workunit.client.1.smithi195.stdout:8/82: rmdir d0 39 2024-09-13T17:05:41.002 INFO:tasks.workunit.client.1.smithi195.stdout:8/83: getdents d0 0 2024-09-13T17:05:41.003 INFO:tasks.workunit.client.1.smithi195.stdout:8/84: creat d0/d17/f1b x:0 0 0 2024-09-13T17:05:41.004 INFO:tasks.workunit.client.1.smithi195.stdout:8/85: fsync d0/f3 0 2024-09-13T17:05:41.005 INFO:tasks.workunit.client.1.smithi195.stdout:8/86: symlink d0/l1c 0 2024-09-13T17:05:41.006 INFO:tasks.workunit.client.1.smithi195.stdout:8/87: write d0/d13/f16 [1122402,111998] 0 2024-09-13T17:05:41.007 INFO:tasks.workunit.client.1.smithi195.stdout:8/88: write d0/d4/fb [929653,60461] 0 2024-09-13T17:05:41.016 INFO:tasks.workunit.client.1.smithi195.stdout:0/65: dwrite f1 [0,4194304] 0 2024-09-13T17:05:41.016 INFO:tasks.workunit.client.1.smithi195.stdout:0/66: chown c5 15 1 2024-09-13T17:05:41.020 INFO:tasks.workunit.client.1.smithi195.stdout:6/51: sync 2024-09-13T17:05:41.021 INFO:tasks.workunit.client.1.smithi195.stdout:6/52: mknod ce 0 2024-09-13T17:05:41.021 INFO:tasks.workunit.client.1.smithi195.stdout:6/53: fsync fd 0 2024-09-13T17:05:41.021 INFO:tasks.workunit.client.1.smithi195.stdout:6/54: chown f7 435 1 2024-09-13T17:05:41.076 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:40 smithi195 ceph-mon[34981]: pgmap v9: 65 pgs: 65 active+clean; 349 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 15 MiB/s rd, 24 MiB/s wr, 560 op/s 2024-09-13T17:05:41.121 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.120+0000 7fa72c576640 1 -- 172.21.15.115:0/629913472 --> [v2:172.21.15.195:6828/1660911692,v1:172.21.15.195:6829/1660911692] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa7240682f0 con 0x7fa71006cd80 2024-09-13T17:05:41.122 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:40 smithi115 ceph-mon[27708]: pgmap v9: 65 pgs: 65 active+clean; 349 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 15 MiB/s rd, 24 MiB/s wr, 560 op/s 2024-09-13T17:05:41.123 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.122+0000 7fa71b7fe640 1 -- 172.21.15.115:0/629913472 <== mgr.24317 v2:172.21.15.195:6828/1660911692 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7fa7240682f0 con 0x7fa71006cd80 2024-09-13T17:05:41.125 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.124+0000 7fa72c576640 1 -- 172.21.15.115:0/629913472 >> [v2:172.21.15.195:6828/1660911692,v1:172.21.15.195:6829/1660911692] conn(0x7fa71006cd80 msgr2=0x7fa71006f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:05:41.125 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.124+0000 7fa72c576640 1 --2- 172.21.15.115:0/629913472 >> [v2:172.21.15.195:6828/1660911692,v1:172.21.15.195:6829/1660911692] conn(0x7fa71006cd80 0x7fa71006f240 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa7240ffa90 tx=0x7fa720005f90 comp rx=0 tx=0).stop 2024-09-13T17:05:41.125 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.124+0000 7fa72c576640 1 -- 172.21.15.115:0/629913472 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7240ffc30 msgr2=0x7fa724195ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:05:41.125 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.124+0000 7fa72c576640 1 --2- 172.21.15.115:0/629913472 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7240ffc30 0x7fa724195ac0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fa714006010 tx=0x7fa7140055a0 comp rx=0 tx=0).stop 2024-09-13T17:05:41.125 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.124+0000 7fa72c576640 1 -- 172.21.15.115:0/629913472 shutdown_connections 2024-09-13T17:05:41.125 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.124+0000 7fa72c576640 1 --2- 172.21.15.115:0/629913472 >> [v2:172.21.15.195:6828/1660911692,v1:172.21.15.195:6829/1660911692] conn(0x7fa71006cd80 0x7fa71006f240 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:41.125 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.124+0000 7fa72c576640 1 --2- 172.21.15.115:0/629913472 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7240ffc30 0x7fa724195ac0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:41.125 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.124+0000 7fa72c576640 1 --2- 172.21.15.115:0/629913472 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa7240fea30 0x7fa724195580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:41.125 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.124+0000 7fa72c576640 1 -- 172.21.15.115:0/629913472 >> 172.21.15.115:0/629913472 conn(0x7fa7240fa1c0 msgr2=0x7fa724067be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:05:41.126 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.124+0000 7fa72c576640 1 -- 172.21.15.115:0/629913472 shutdown_connections 2024-09-13T17:05:41.126 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.124+0000 7fa72c576640 1 -- 172.21.15.115:0/629913472 wait complete. 2024-09-13T17:05:41.126 INFO:tasks.workunit.client.1.smithi195.stdout:7/82: sync 2024-09-13T17:05:41.126 INFO:tasks.workunit.client.1.smithi195.stdout:5/60: sync 2024-09-13T17:05:41.127 INFO:tasks.workunit.client.1.smithi195.stdout:4/92: sync 2024-09-13T17:05:41.127 INFO:tasks.workunit.client.1.smithi195.stdout:7/83: readlink d5/db/l1c 0 2024-09-13T17:05:41.127 INFO:tasks.workunit.client.1.smithi195.stdout:4/93: getdents d1a/d1f/d21 0 2024-09-13T17:05:41.127 INFO:tasks.workunit.client.1.smithi195.stdout:7/84: symlink d5/db/l1f 0 2024-09-13T17:05:41.127 INFO:tasks.workunit.client.1.smithi195.stdout:7/85: creat d5/db/f20 x:0 0 0 2024-09-13T17:05:41.127 INFO:tasks.workunit.client.1.smithi195.stdout:7/86: write d5/db/d19/f18 [433718,72770] 0 2024-09-13T17:05:41.127 INFO:tasks.workunit.client.1.smithi195.stdout:5/61: mknod d2/c14 0 2024-09-13T17:05:41.129 INFO:tasks.workunit.client.1.smithi195.stdout:5/62: write d2/d4/f5 [496221,100927] 0 2024-09-13T17:05:41.131 INFO:tasks.workunit.client.1.smithi195.stdout:5/63: creat d2/d4/d10/f15 x:0 0 0 2024-09-13T17:05:41.133 INFO:tasks.workunit.client.1.smithi195.stdout:4/94: write fa [1329874,22599] 0 2024-09-13T17:05:41.134 INFO:tasks.workunit.client.1.smithi195.stdout:4/95: mkdir d1a/d1f/d21/d22 0 2024-09-13T17:05:41.134 INFO:tasks.workunit.client.1.smithi195.stdout:4/96: chown fb 2 1 2024-09-13T17:05:41.134 INFO:tasks.workunit.client.1.smithi195.stdout:4/97: readlink d1a/l1c 0 2024-09-13T17:05:41.135 INFO:tasks.workunit.client.1.smithi195.stdout:4/98: write f7 [674051,62509] 0 2024-09-13T17:05:41.139 INFO:tasks.workunit.client.1.smithi195.stdout:5/64: write d2/df/fa [3302283,112657] 0 2024-09-13T17:05:41.149 INFO:tasks.workunit.client.1.smithi195.stdout:7/87: dwrite d5/db/fc [0,4194304] 0 2024-09-13T17:05:41.150 INFO:tasks.workunit.client.1.smithi195.stdout:7/88: chown d5/db/fc 16796 1 2024-09-13T17:05:41.152 INFO:tasks.workunit.client.1.smithi195.stdout:7/89: unlink d5/l16 0 2024-09-13T17:05:41.153 INFO:tasks.workunit.client.1.smithi195.stdout:7/90: symlink d5/l21 0 2024-09-13T17:05:41.153 INFO:tasks.workunit.client.1.smithi195.stdout:7/91: mkdir d5/db/d19/d22 0 2024-09-13T17:05:41.154 INFO:tasks.workunit.client.1.smithi195.stdout:7/92: mknod d5/c23 0 2024-09-13T17:05:41.155 INFO:tasks.workunit.client.1.smithi195.stdout:7/93: chown d5/fa 1 1 2024-09-13T17:05:41.161 INFO:tasks.workunit.client.1.smithi195.stdout:5/65: dwrite d2/df/fe [0,4194304] 0 2024-09-13T17:05:41.162 INFO:tasks.workunit.client.1.smithi195.stdout:4/99: dwrite f8 [0,4194304] 0 2024-09-13T17:05:41.164 INFO:tasks.workunit.client.1.smithi195.stdout:4/100: dread f11 [0,4194304] 0 2024-09-13T17:05:41.164 INFO:tasks.workunit.client.1.smithi195.stdout:4/101: dread - d1a/f1e zero size 2024-09-13T17:05:41.165 INFO:tasks.workunit.client.1.smithi195.stdout:5/66: creat d2/d7/f16 x:0 0 0 2024-09-13T17:05:41.166 INFO:tasks.workunit.client.1.smithi195.stdout:4/102: mkdir d1a/d1f/d23 0 2024-09-13T17:05:41.167 INFO:tasks.workunit.client.1.smithi195.stdout:4/103: mkdir d1a/d1f/d23/d24 0 2024-09-13T17:05:41.168 INFO:tasks.workunit.client.1.smithi195.stdout:5/67: fsync d2/df/fa 0 2024-09-13T17:05:41.169 INFO:tasks.workunit.client.1.smithi195.stdout:5/68: write d2/d7/f16 [1012434,30125] 0 2024-09-13T17:05:41.169 INFO:tasks.workunit.client.1.smithi195.stdout:4/104: creat d1a/d1f/d23/d24/f25 x:0 0 0 2024-09-13T17:05:41.173 INFO:tasks.workunit.client.1.smithi195.stdout:5/69: rename d2/df/fe to d2/f17 0 2024-09-13T17:05:41.174 INFO:tasks.workunit.client.1.smithi195.stdout:5/70: dread - d2/d4/d10/f15 zero size 2024-09-13T17:05:41.174 INFO:tasks.workunit.client.1.smithi195.stdout:5/71: write d2/d4/d10/f15 [72096,97317] 0 2024-09-13T17:05:41.174 INFO:tasks.workunit.client.1.smithi195.stdout:4/105: creat d1a/d1f/d21/d22/f26 x:0 0 0 2024-09-13T17:05:41.175 INFO:tasks.workunit.client.1.smithi195.stdout:4/106: mknod d1a/c27 0 2024-09-13T17:05:41.175 INFO:tasks.workunit.client.1.smithi195.stdout:4/107: creat d1a/d1f/d21/d22/f28 x:0 0 0 2024-09-13T17:05:41.177 INFO:tasks.workunit.client.1.smithi195.stdout:4/108: mkdir d1a/d1f/d23/d29 0 2024-09-13T17:05:41.177 INFO:tasks.workunit.client.1.smithi195.stdout:7/94: dwrite d5/db/fc [0,4194304] 0 2024-09-13T17:05:41.177 INFO:tasks.workunit.client.1.smithi195.stdout:4/109: creat d1a/d1f/d23/d29/f2a x:0 0 0 2024-09-13T17:05:41.177 INFO:tasks.workunit.client.1.smithi195.stdout:4/110: stat c17 0 2024-09-13T17:05:41.178 INFO:tasks.workunit.client.1.smithi195.stdout:5/72: dread d2/d7/f16 [0,4194304] 0 2024-09-13T17:05:41.180 INFO:tasks.workunit.client.1.smithi195.stdout:7/95: mkdir d5/d13/d24 0 2024-09-13T17:05:41.180 INFO:tasks.workunit.client.1.smithi195.stdout:7/96: chown d5/l21 7858 1 2024-09-13T17:05:41.180 INFO:tasks.workunit.client.1.smithi195.stdout:7/97: chown d5/c1b 0 1 2024-09-13T17:05:41.181 INFO:tasks.workunit.client.1.smithi195.stdout:4/111: truncate f2 425358 0 2024-09-13T17:05:41.181 INFO:tasks.workunit.client.1.smithi195.stdout:4/112: creat d1a/d1f/d21/d22/f2b x:0 0 0 2024-09-13T17:05:41.182 INFO:tasks.workunit.client.1.smithi195.stdout:5/73: mknod d2/d7/c18 0 2024-09-13T17:05:41.188 INFO:tasks.workunit.client.1.smithi195.stdout:7/98: read d5/fa [287839,128953] 0 2024-09-13T17:05:41.191 INFO:tasks.workunit.client.1.smithi195.stdout:2/59: sync 2024-09-13T17:05:41.192 INFO:tasks.workunit.client.1.smithi195.stdout:2/60: mkdir d0/d3/df 0 2024-09-13T17:05:41.195 INFO:tasks.workunit.client.1.smithi195.stdout:2/61: dread d0/d3/f4 [0,4194304] 0 2024-09-13T17:05:41.195 INFO:tasks.workunit.client.1.smithi195.stdout:4/113: dwrite f5 [0,4194304] 0 2024-09-13T17:05:41.199 INFO:tasks.workunit.client.1.smithi195.stdout:7/99: write f4 [1848045,98683] 0 2024-09-13T17:05:41.200 INFO:tasks.workunit.client.1.smithi195.stdout:7/100: fdatasync d5/db/f20 0 2024-09-13T17:05:41.212 INFO:tasks.workunit.client.1.smithi195.stdout:7/101: dread f4 [0,4194304] 0 2024-09-13T17:05:41.212 INFO:tasks.workunit.client.1.smithi195.stdout:7/102: chown d5/l8 4481 1 2024-09-13T17:05:41.212 INFO:tasks.workunit.client.1.smithi195.stdout:7/103: readlink d5/db/l1f 0 2024-09-13T17:05:41.213 INFO:tasks.workunit.client.1.smithi195.stdout:7/104: unlink d5/db/f20 0 2024-09-13T17:05:41.219 INFO:tasks.workunit.client.1.smithi195.stdout:7/105: write d5/f6 [806354,62489] 0 2024-09-13T17:05:41.221 INFO:tasks.workunit.client.1.smithi195.stdout:7/106: mknod d5/db/d19/d22/c25 0 2024-09-13T17:05:41.221 INFO:tasks.workunit.client.1.smithi195.stdout:7/107: mknod d5/d13/c26 0 2024-09-13T17:05:41.222 INFO:tasks.workunit.client.1.smithi195.stdout:7/108: readlink d5/db/l1f 0 2024-09-13T17:05:41.222 INFO:tasks.workunit.client.1.smithi195.stdout:2/62: dwrite d0/f6 [4194304,4194304] 0 2024-09-13T17:05:41.223 INFO:tasks.workunit.client.1.smithi195.stdout:7/109: symlink d5/db/d19/d22/l27 0 2024-09-13T17:05:41.223 INFO:tasks.workunit.client.1.smithi195.stdout:7/110: chown d5/db 3395 1 2024-09-13T17:05:41.223 INFO:tasks.workunit.client.1.smithi195.stdout:4/114: dwrite f8 [4194304,4194304] 0 2024-09-13T17:05:41.223 INFO:tasks.workunit.client.1.smithi195.stdout:4/115: dread - d1a/d1f/d23/d24/f25 zero size 2024-09-13T17:05:41.223 INFO:tasks.workunit.client.1.smithi195.stdout:2/63: link d0/d3/f4 d0/d3/df/f10 0 2024-09-13T17:05:41.224 INFO:tasks.workunit.client.1.smithi195.stdout:7/111: stat d5/db/l1e 0 2024-09-13T17:05:41.226 INFO:tasks.workunit.client.1.smithi195.stdout:7/112: mknod d5/db/c28 0 2024-09-13T17:05:41.227 INFO:tasks.workunit.client.1.smithi195.stdout:7/113: unlink d5/db/c28 0 2024-09-13T17:05:41.229 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.227+0000 7fcc2d178640 1 -- 172.21.15.115:0/1815675462 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc280fea30 msgr2=0x7fcc280fee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:05:41.229 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.227+0000 7fcc2d178640 1 --2- 172.21.15.115:0/1815675462 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc280fea30 0x7fcc280fee30 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fcc18009880 tx=0x7fcc1802a4a0 comp rx=0 tx=0).stop 2024-09-13T17:05:41.229 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.228+0000 7fcc2d178640 1 -- 172.21.15.115:0/1815675462 shutdown_connections 2024-09-13T17:05:41.229 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.228+0000 7fcc2d178640 1 --2- 172.21.15.115:0/1815675462 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc280ffc30 0x7fcc281000b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:41.229 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.228+0000 7fcc2d178640 1 --2- 172.21.15.115:0/1815675462 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc280fea30 0x7fcc280fee30 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:41.229 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.228+0000 7fcc2d178640 1 -- 172.21.15.115:0/1815675462 >> 172.21.15.115:0/1815675462 conn(0x7fcc280fa1c0 msgr2=0x7fcc280fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:05:41.229 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.228+0000 7fcc2d178640 1 -- 172.21.15.115:0/1815675462 shutdown_connections 2024-09-13T17:05:41.229 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.228+0000 7fcc2d178640 1 -- 172.21.15.115:0/1815675462 wait complete. 2024-09-13T17:05:41.231 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.228+0000 7fcc2d178640 1 Processor -- start 2024-09-13T17:05:41.231 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.229+0000 7fcc2d178640 1 -- start start 2024-09-13T17:05:41.231 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.229+0000 7fcc2d178640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc280fea30 0x7fcc28195590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:05:41.231 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.229+0000 7fcc2d178640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc280ffc30 0x7fcc28195ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:05:41.231 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.229+0000 7fcc2d178640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc281960a0 con 0x7fcc280ffc30 2024-09-13T17:05:41.231 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.229+0000 7fcc2d178640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc28196210 con 0x7fcc280fea30 2024-09-13T17:05:41.231 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.229+0000 7fcc2659c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc280ffc30 0x7fcc28195ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:05:41.231 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.229+0000 7fcc2659c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc280ffc30 0x7fcc28195ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:41674/0 (socket says 172.21.15.115:41674) 2024-09-13T17:05:41.232 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.229+0000 7fcc2659c640 1 -- 172.21.15.115:0/4101849652 learned_addr learned my addr 172.21.15.115:0/4101849652 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:05:41.232 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.229+0000 7fcc2659c640 1 -- 172.21.15.115:0/4101849652 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc280fea30 msgr2=0x7fcc28195590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:05:41.232 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.229+0000 7fcc2659c640 1 --2- 172.21.15.115:0/4101849652 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc280fea30 0x7fcc28195590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:41.232 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.229+0000 7fcc2659c640 1 -- 172.21.15.115:0/4101849652 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc18009560 con 0x7fcc280ffc30 2024-09-13T17:05:41.232 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.230+0000 7fcc2659c640 1 --2- 172.21.15.115:0/4101849652 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc280ffc30 0x7fcc28195ad0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c00e9a0 tx=0x7fcc1c00eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:05:41.232 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.230+0000 7fcc0ffff640 1 -- 172.21.15.115:0/4101849652 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc1c00cd50 con 0x7fcc280ffc30 2024-09-13T17:05:41.232 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.230+0000 7fcc2d178640 1 -- 172.21.15.115:0/4101849652 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc2819acb0 con 0x7fcc280ffc30 2024-09-13T17:05:41.232 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.230+0000 7fcc0ffff640 1 -- 172.21.15.115:0/4101849652 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcc1c00ceb0 con 0x7fcc280ffc30 2024-09-13T17:05:41.232 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.230+0000 7fcc0ffff640 1 -- 172.21.15.115:0/4101849652 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc1c010430 con 0x7fcc280ffc30 2024-09-13T17:05:41.232 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.230+0000 7fcc2d178640 1 -- 172.21.15.115:0/4101849652 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc2819b280 con 0x7fcc280ffc30 2024-09-13T17:05:41.234 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.231+0000 7fcc2d178640 1 -- 172.21.15.115:0/4101849652 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc28107500 con 0x7fcc280ffc30 2024-09-13T17:05:41.234 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.231+0000 7fcc0ffff640 1 -- 172.21.15.115:0/4101849652 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 24) v1 ==== 90954+0+0 (secure 0 0 0) 0x7fcc1c0105f0 con 0x7fcc280ffc30 2024-09-13T17:05:41.234 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.232+0000 7fcc0ffff640 1 --2- 172.21.15.115:0/4101849652 >> [v2:172.21.15.195:6828/1660911692,v1:172.21.15.195:6829/1660911692] conn(0x7fcc1006cd90 0x7fcc1006f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:05:41.234 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.232+0000 7fcc0ffff640 1 -- 172.21.15.115:0/4101849652 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fcc1c014070 con 0x7fcc280ffc30 2024-09-13T17:05:41.234 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.232+0000 7fcc26d9d640 1 --2- 172.21.15.115:0/4101849652 >> [v2:172.21.15.195:6828/1660911692,v1:172.21.15.195:6829/1660911692] conn(0x7fcc1006cd90 0x7fcc1006f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:05:41.234 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.233+0000 7fcc26d9d640 1 --2- 172.21.15.115:0/4101849652 >> [v2:172.21.15.195:6828/1660911692,v1:172.21.15.195:6829/1660911692] conn(0x7fcc1006cd90 0x7fcc1006f250 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fcc1802a9c0 tx=0x7fcc18000bc0 comp rx=0 tx=0).ready entity=mgr.24317 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:05:41.238 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.237+0000 7fcc0ffff640 1 -- 172.21.15.115:0/4101849652 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fcc1c056c80 con 0x7fcc280ffc30 2024-09-13T17:05:41.239 INFO:tasks.workunit.client.1.smithi195.stdout:7/114: dwrite d5/d13/f1d [0,4194304] 0 2024-09-13T17:05:41.244 INFO:tasks.workunit.client.1.smithi195.stdout:1/62: sync 2024-09-13T17:05:41.245 INFO:tasks.workunit.client.1.smithi195.stdout:1/63: truncate db/f10 3155565 0 2024-09-13T17:05:41.255 INFO:tasks.workunit.client.1.smithi195.stdout:7/115: dwrite d5/db/d19/f18 [0,4194304] 0 2024-09-13T17:05:41.257 INFO:tasks.workunit.client.1.smithi195.stdout:7/116: unlink d5/c1b 0 2024-09-13T17:05:41.263 INFO:tasks.workunit.client.1.smithi195.stdout:7/117: write d5/d13/f1d [1877408,67080] 0 2024-09-13T17:05:41.263 INFO:tasks.workunit.client.1.smithi195.stdout:7/118: chown f4 0 1 2024-09-13T17:05:41.266 INFO:tasks.workunit.client.1.smithi195.stdout:7/119: dread d5/f6 [0,4194304] 0 2024-09-13T17:05:41.266 INFO:tasks.workunit.client.1.smithi195.stdout:1/64: dwrite db/f17 [0,4194304] 0 2024-09-13T17:05:41.267 INFO:tasks.workunit.client.1.smithi195.stdout:7/120: unlink d5/db/l1c 0 2024-09-13T17:05:41.268 INFO:tasks.workunit.client.1.smithi195.stdout:1/65: mkdir db/d19 0 2024-09-13T17:05:41.269 INFO:tasks.workunit.client.1.smithi195.stdout:7/121: truncate d5/fa 1860349 0 2024-09-13T17:05:41.270 INFO:tasks.workunit.client.1.smithi195.stdout:7/122: write d5/f6 [2977237,100559] 0 2024-09-13T17:05:41.270 INFO:tasks.workunit.client.1.smithi195.stdout:7/123: symlink d5/d13/d24/l29 0 2024-09-13T17:05:41.276 INFO:tasks.workunit.client.1.smithi195.stdout:7/124: write d5/fa [37245,48150] 0 2024-09-13T17:05:41.276 INFO:tasks.workunit.client.1.smithi195.stdout:7/125: chown d5 28 1 2024-09-13T17:05:41.278 INFO:tasks.workunit.client.1.smithi195.stdout:7/126: rename d5/db/d19/d22/c25 to d5/db/c2a 0 2024-09-13T17:05:41.278 INFO:tasks.workunit.client.1.smithi195.stdout:7/127: readlink l0 0 2024-09-13T17:05:41.280 INFO:tasks.workunit.client.1.smithi195.stdout:7/128: rename l2 to d5/db/d19/l2b 0 2024-09-13T17:05:41.284 INFO:tasks.workunit.client.1.smithi195.stdout:1/66: dwrite f2 [0,4194304] 0 2024-09-13T17:05:41.286 INFO:tasks.workunit.client.1.smithi195.stdout:1/67: rename c9 to db/d19/c1a 0 2024-09-13T17:05:41.288 INFO:tasks.workunit.client.1.smithi195.stdout:7/129: dread d5/db/d19/f18 [0,4194304] 0 2024-09-13T17:05:41.288 INFO:tasks.workunit.client.1.smithi195.stdout:7/130: creat d5/db/f2c x:0 0 0 2024-09-13T17:05:41.290 INFO:tasks.workunit.client.1.smithi195.stdout:7/131: creat d5/d13/d24/f2d x:0 0 0 2024-09-13T17:05:41.296 INFO:tasks.workunit.client.1.smithi195.stdout:7/132: getdents d5/d13/d24 0 2024-09-13T17:05:41.297 INFO:tasks.workunit.client.1.smithi195.stdout:7/133: link d5/db/l1e d5/l2e 0 2024-09-13T17:05:41.297 INFO:tasks.workunit.client.1.smithi195.stdout:7/134: fdatasync d5/db/fc 0 2024-09-13T17:05:41.297 INFO:tasks.workunit.client.1.smithi195.stdout:7/135: fdatasync f4 0 2024-09-13T17:05:41.298 INFO:tasks.workunit.client.1.smithi195.stdout:1/68: dwrite f5 [0,4194304] 0 2024-09-13T17:05:41.302 INFO:tasks.workunit.client.1.smithi195.stdout:1/69: truncate f5 3469806 0 2024-09-13T17:05:41.302 INFO:tasks.workunit.client.1.smithi195.stdout:1/70: creat db/f1b x:0 0 0 2024-09-13T17:05:41.302 INFO:tasks.workunit.client.1.smithi195.stdout:1/71: creat db/f1c x:0 0 0 2024-09-13T17:05:41.305 INFO:tasks.workunit.client.1.smithi195.stdout:1/72: getdents db/df 0 2024-09-13T17:05:41.305 INFO:tasks.workunit.client.1.smithi195.stdout:1/73: chown db/f1c 5897819 1 2024-09-13T17:05:41.305 INFO:tasks.workunit.client.1.smithi195.stdout:1/74: truncate db/f11 578697 0 2024-09-13T17:05:41.306 INFO:tasks.workunit.client.1.smithi195.stdout:1/75: symlink db/df/d13/l1d 0 2024-09-13T17:05:41.308 INFO:tasks.workunit.client.1.smithi195.stdout:1/76: creat db/df/d13/f1e x:0 0 0 2024-09-13T17:05:41.308 INFO:tasks.workunit.client.1.smithi195.stdout:1/77: getdents db/df 0 2024-09-13T17:05:41.308 INFO:tasks.workunit.client.1.smithi195.stdout:1/78: read - db/f1b zero size 2024-09-13T17:05:41.318 INFO:tasks.workunit.client.1.smithi195.stdout:7/136: dwrite d5/fa [0,4194304] 0 2024-09-13T17:05:41.328 INFO:tasks.workunit.client.1.smithi195.stdout:7/137: dread d5/db/fc [0,4194304] 0 2024-09-13T17:05:41.329 INFO:tasks.workunit.client.1.smithi195.stdout:1/79: dwrite db/df/d13/f1e [0,4194304] 0 2024-09-13T17:05:41.332 INFO:tasks.workunit.client.1.smithi195.stdout:1/80: rmdir db/df 39 2024-09-13T17:05:41.333 INFO:tasks.workunit.client.1.smithi195.stdout:7/138: read d5/db/fc [2605662,125134] 0 2024-09-13T17:05:41.333 INFO:tasks.workunit.client.1.smithi195.stdout:1/81: creat db/df/f1f x:0 0 0 2024-09-13T17:05:41.341 INFO:tasks.workunit.client.1.smithi195.stdout:1/82: write db/df/d13/f1e [2719836,108817] 0 2024-09-13T17:05:41.341 INFO:tasks.workunit.client.1.smithi195.stdout:5/74: sync 2024-09-13T17:05:41.341 INFO:tasks.workunit.client.1.smithi195.stdout:3/73: sync 2024-09-13T17:05:41.341 INFO:tasks.workunit.client.1.smithi195.stdout:8/89: sync 2024-09-13T17:05:41.341 INFO:tasks.workunit.client.1.smithi195.stdout:0/67: sync 2024-09-13T17:05:41.341 INFO:tasks.workunit.client.1.smithi195.stdout:6/55: sync 2024-09-13T17:05:41.341 INFO:tasks.workunit.client.1.smithi195.stdout:3/74: fdatasync f5 0 2024-09-13T17:05:41.341 INFO:tasks.workunit.client.1.smithi195.stdout:4/116: sync 2024-09-13T17:05:41.341 INFO:tasks.workunit.client.1.smithi195.stdout:2/64: sync 2024-09-13T17:05:41.341 INFO:tasks.workunit.client.1.smithi195.stdout:1/83: creat db/df/f20 x:0 0 0 2024-09-13T17:05:41.341 INFO:tasks.workunit.client.1.smithi195.stdout:6/56: creat ff x:0 0 0 2024-09-13T17:05:41.341 INFO:tasks.workunit.client.1.smithi195.stdout:9/73: sync 2024-09-13T17:05:41.342 INFO:tasks.workunit.client.1.smithi195.stdout:0/68: truncate f3 3829767 0 2024-09-13T17:05:41.343 INFO:tasks.workunit.client.1.smithi195.stdout:8/90: rename d0/d4/fe to d0/d17/f1d 0 2024-09-13T17:05:41.345 INFO:tasks.workunit.client.1.smithi195.stdout:5/75: mknod d2/d7/c19 0 2024-09-13T17:05:41.347 INFO:tasks.workunit.client.1.smithi195.stdout:1/84: unlink db/df/d13/f15 0 2024-09-13T17:05:41.348 INFO:tasks.workunit.client.1.smithi195.stdout:4/117: mknod d1a/d1f/d23/d24/c2c 0 2024-09-13T17:05:41.349 INFO:tasks.workunit.client.1.smithi195.stdout:2/65: mkdir d0/d3/df/d11 0 2024-09-13T17:05:41.350 INFO:tasks.workunit.client.1.smithi195.stdout:9/74: symlink d6/df/d16/l1a 0 2024-09-13T17:05:41.351 INFO:tasks.workunit.client.1.smithi195.stdout:0/69: mkdir d7/d8 0 2024-09-13T17:05:41.352 INFO:tasks.workunit.client.1.smithi195.stdout:1/85: fsync db/df/f20 0 2024-09-13T17:05:41.352 INFO:tasks.workunit.client.1.smithi195.stdout:9/75: write d6/f18 [1437976,111830] 0 2024-09-13T17:05:41.352 INFO:tasks.workunit.client.1.smithi195.stdout:8/91: symlink d0/d17/l1e 0 2024-09-13T17:05:41.354 INFO:tasks.workunit.client.1.smithi195.stdout:3/75: getdents d7 0 2024-09-13T17:05:41.354 INFO:tasks.workunit.client.1.smithi195.stdout:3/76: chown d7/c9 254547 1 2024-09-13T17:05:41.354 INFO:tasks.workunit.client.1.smithi195.stdout:3/77: readlink d7/lf 0 2024-09-13T17:05:41.357 INFO:tasks.workunit.client.1.smithi195.stdout:2/66: unlink d0/c1 0 2024-09-13T17:05:41.357 INFO:tasks.workunit.client.1.smithi195.stdout:0/70: mknod d7/d8/c9 0 2024-09-13T17:05:41.358 INFO:tasks.workunit.client.1.smithi195.stdout:3/78: symlink d7/l10 0 2024-09-13T17:05:41.359 INFO:tasks.workunit.client.1.smithi195.stdout:3/79: rmdir d7 39 2024-09-13T17:05:41.368 INFO:tasks.workunit.client.1.smithi195.stdout:4/118: dread f12 [0,4194304] 0 2024-09-13T17:05:41.369 INFO:tasks.workunit.client.1.smithi195.stdout:4/119: rmdir d1a/d1f/d21 39 2024-09-13T17:05:41.369 INFO:tasks.workunit.client.1.smithi195.stdout:4/120: creat d1a/f2d x:0 0 0 2024-09-13T17:05:41.369 INFO:tasks.workunit.client.1.smithi195.stdout:2/67: write d0/d3/f4 [7621281,37714] 0 2024-09-13T17:05:41.369 INFO:tasks.workunit.client.1.smithi195.stdout:2/68: write d0/f6 [6615966,25576] 0 2024-09-13T17:05:41.369 INFO:tasks.workunit.client.1.smithi195.stdout:6/57: dwrite ff [0,4194304] 0 2024-09-13T17:05:41.369 INFO:tasks.workunit.client.1.smithi195.stdout:6/58: truncate f2 9112248 0 2024-09-13T17:05:41.369 INFO:tasks.workunit.client.1.smithi195.stdout:6/59: truncate fd 6206 0 2024-09-13T17:05:41.370 INFO:tasks.workunit.client.1.smithi195.stdout:5/76: dwrite d2/f17 [0,4194304] 0 2024-09-13T17:05:41.370 INFO:tasks.workunit.client.1.smithi195.stdout:5/77: write d2/d4/f5 [1437897,10290] 0 2024-09-13T17:05:41.370 INFO:tasks.workunit.client.1.smithi195.stdout:0/71: write f3 [2845845,27219] 0 2024-09-13T17:05:41.370 INFO:tasks.workunit.client.1.smithi195.stdout:2/69: rename d0/f6 to d0/d3/df/f12 0 2024-09-13T17:05:41.371 INFO:tasks.workunit.client.1.smithi195.stdout:9/76: dread d6/f18 [0,4194304] 0 2024-09-13T17:05:41.371 INFO:tasks.workunit.client.1.smithi195.stdout:9/77: truncate d6/f18 2615787 0 2024-09-13T17:05:41.375 INFO:tasks.workunit.client.1.smithi195.stdout:5/78: creat d2/df/f1a x:0 0 0 2024-09-13T17:05:41.375 INFO:tasks.workunit.client.1.smithi195.stdout:3/80: dwrite f5 [0,4194304] 0 2024-09-13T17:05:41.375 INFO:tasks.workunit.client.1.smithi195.stdout:3/81: stat d7 0 2024-09-13T17:05:41.376 INFO:tasks.workunit.client.1.smithi195.stdout:4/121: unlink f1 0 2024-09-13T17:05:41.376 INFO:tasks.workunit.client.1.smithi195.stdout:4/122: chown d1a/c1b 3 1 2024-09-13T17:05:41.377 INFO:tasks.workunit.client.1.smithi195.stdout:0/72: mknod d7/ca 0 2024-09-13T17:05:41.377 INFO:tasks.workunit.client.1.smithi195.stdout:0/73: dread - f6 zero size 2024-09-13T17:05:41.378 INFO:tasks.workunit.client.1.smithi195.stdout:0/74: truncate f6 637906 0 2024-09-13T17:05:41.378 INFO:tasks.workunit.client.1.smithi195.stdout:2/70: mknod d0/d3/df/c13 0 2024-09-13T17:05:41.379 INFO:tasks.workunit.client.1.smithi195.stdout:9/78: creat d6/f1b x:0 0 0 2024-09-13T17:05:41.382 INFO:tasks.workunit.client.1.smithi195.stdout:5/79: creat d2/d12/f1b x:0 0 0 2024-09-13T17:05:41.382 INFO:tasks.workunit.client.1.smithi195.stdout:0/75: mkdir d7/db 0 2024-09-13T17:05:41.382 INFO:tasks.workunit.client.1.smithi195.stdout:9/79: symlink d6/d19/l1c 0 2024-09-13T17:05:41.383 INFO:tasks.workunit.client.1.smithi195.stdout:0/76: creat d7/fc x:0 0 0 2024-09-13T17:05:41.383 INFO:tasks.workunit.client.1.smithi195.stdout:0/77: symlink d7/d8/ld 0 2024-09-13T17:05:41.385 INFO:tasks.workunit.client.1.smithi195.stdout:4/123: write f19 [546989,33409] 0 2024-09-13T17:05:41.385 INFO:tasks.workunit.client.1.smithi195.stdout:0/78: creat d7/d8/fe x:0 0 0 2024-09-13T17:05:41.388 INFO:tasks.workunit.client.1.smithi195.stdout:4/124: rename d1a/l1c to d1a/l2e 0 2024-09-13T17:05:41.389 INFO:tasks.workunit.client.1.smithi195.stdout:9/80: dread d6/f18 [0,4194304] 0 2024-09-13T17:05:41.389 INFO:tasks.workunit.client.1.smithi195.stdout:0/79: mkdir d7/d8/df 0 2024-09-13T17:05:41.393 INFO:tasks.workunit.client.1.smithi195.stdout:2/71: mkdir d0/d14 0 2024-09-13T17:05:41.394 INFO:tasks.workunit.client.1.smithi195.stdout:4/125: truncate d1a/d1f/d21/d22/f28 146269 0 2024-09-13T17:05:41.394 INFO:tasks.workunit.client.1.smithi195.stdout:6/60: truncate f2 2365581 0 2024-09-13T17:05:41.396 INFO:tasks.workunit.client.1.smithi195.stdout:9/81: rename l5 to d6/df/d13/l1d 0 2024-09-13T17:05:41.398 INFO:tasks.workunit.client.1.smithi195.stdout:2/72: chown d0/d3/fe 6124 1 2024-09-13T17:05:41.399 INFO:tasks.workunit.client.1.smithi195.stdout:3/82: dwrite d7/fa [0,4194304] 0 2024-09-13T17:05:41.399 INFO:tasks.workunit.client.1.smithi195.stdout:5/80: dwrite d2/d12/f1b [0,4194304] 0 2024-09-13T17:05:41.399 INFO:tasks.workunit.client.1.smithi195.stdout:5/81: stat d2/f3 0 2024-09-13T17:05:41.399 INFO:tasks.workunit.client.1.smithi195.stdout:5/82: creat d2/df/f1c x:0 0 0 2024-09-13T17:05:41.399 INFO:tasks.workunit.client.1.smithi195.stdout:4/126: truncate f16 818035 0 2024-09-13T17:05:41.399 INFO:tasks.workunit.client.1.smithi195.stdout:4/127: truncate d1a/d1f/d21/d22/f2b 66730 0 2024-09-13T17:05:41.399 INFO:tasks.workunit.client.1.smithi195.stdout:4/128: write d1a/d1f/d23/d24/f25 [392830,40010] 0 2024-09-13T17:05:41.400 INFO:tasks.workunit.client.1.smithi195.stdout:9/82: readlink d6/lb 0 2024-09-13T17:05:41.401 INFO:tasks.workunit.client.1.smithi195.stdout:0/80: rmdir d7/d8 39 2024-09-13T17:05:41.402 INFO:tasks.workunit.client.1.smithi195.stdout:2/73: symlink d0/d3/df/d11/l15 0 2024-09-13T17:05:41.407 INFO:tasks.workunit.client.1.smithi195.stdout:3/83: getdents d7 0 2024-09-13T17:05:41.407 INFO:tasks.workunit.client.1.smithi195.stdout:3/84: chown d7 119928062 1 2024-09-13T17:05:41.409 INFO:tasks.workunit.client.1.smithi195.stdout:2/74: dread d0/d3/f4 [0,4194304] 0 2024-09-13T17:05:41.409 INFO:tasks.workunit.client.1.smithi195.stdout:2/75: stat d0/d3/df 0 2024-09-13T17:05:41.409 INFO:tasks.workunit.client.1.smithi195.stdout:2/76: getdents d0/d14 0 2024-09-13T17:05:41.410 INFO:tasks.workunit.client.1.smithi195.stdout:2/77: write d0/d3/f4 [539247,434] 0 2024-09-13T17:05:41.411 INFO:tasks.workunit.client.1.smithi195.stdout:5/83: creat d2/d4/f1d x:0 0 0 2024-09-13T17:05:41.412 INFO:tasks.workunit.client.1.smithi195.stdout:0/81: dread f3 [0,4194304] 0 2024-09-13T17:05:41.412 INFO:tasks.workunit.client.1.smithi195.stdout:4/129: fsync fd 0 2024-09-13T17:05:41.413 INFO:tasks.workunit.client.1.smithi195.stdout:6/61: dread f2 [0,4194304] 0 2024-09-13T17:05:41.414 INFO:tasks.workunit.client.1.smithi195.stdout:9/83: creat d6/f1e x:0 0 0 2024-09-13T17:05:41.414 INFO:tasks.workunit.client.1.smithi195.stdout:4/130: fsync d1a/d1f/d23/d24/f25 0 2024-09-13T17:05:41.415 INFO:tasks.workunit.client.1.smithi195.stdout:3/85: creat d7/f11 x:0 0 0 2024-09-13T17:05:41.417 INFO:tasks.workunit.client.1.smithi195.stdout:5/84: symlink d2/d4/d11/l1e 0 2024-09-13T17:05:41.418 INFO:tasks.workunit.client.1.smithi195.stdout:5/85: fdatasync d2/f17 0 2024-09-13T17:05:41.418 INFO:tasks.workunit.client.1.smithi195.stdout:0/82: mkdir d7/d10 0 2024-09-13T17:05:41.420 INFO:tasks.workunit.client.1.smithi195.stdout:6/62: unlink f7 0 2024-09-13T17:05:41.422 INFO:tasks.workunit.client.1.smithi195.stdout:9/84: creat d6/d19/f1f x:0 0 0 2024-09-13T17:05:41.422 INFO:tasks.workunit.client.1.smithi195.stdout:9/85: write d6/f1b [790977,83339] 0 2024-09-13T17:05:41.424 INFO:tasks.workunit.client.1.smithi195.stdout:4/131: write f13 [463659,74732] 0 2024-09-13T17:05:41.431 INFO:tasks.workunit.client.1.smithi195.stdout:2/78: rmdir d0/d3 39 2024-09-13T17:05:41.431 INFO:tasks.workunit.client.1.smithi195.stdout:2/79: chown d0/d3/fe 9 1 2024-09-13T17:05:41.433 INFO:tasks.workunit.client.1.smithi195.stdout:5/86: symlink d2/d4/l1f 0 2024-09-13T17:05:41.433 INFO:tasks.workunit.client.1.smithi195.stdout:5/87: chown d2/l9 57 1 2024-09-13T17:05:41.434 INFO:tasks.workunit.client.1.smithi195.stdout:0/83: mkdir d7/db/d11 0 2024-09-13T17:05:41.435 INFO:tasks.workunit.client.1.smithi195.stdout:6/63: truncate f2 2311780 0 2024-09-13T17:05:41.437 INFO:tasks.workunit.client.1.smithi195.stdout:9/86: rename d6/df/d13/l1d to d6/df/d16/l20 0 2024-09-13T17:05:41.438 INFO:tasks.workunit.client.1.smithi195.stdout:3/86: truncate d7/fa 1792307 0 2024-09-13T17:05:41.440 INFO:tasks.workunit.client.1.smithi195.stdout:2/80: rename d0/d3/ca to d0/d3/c16 0 2024-09-13T17:05:41.440 INFO:tasks.workunit.client.1.smithi195.stdout:5/88: mknod d2/d4/c20 0 2024-09-13T17:05:41.440 INFO:tasks.workunit.client.1.smithi195.stdout:5/89: chown d2/d4/c20 6698869 1 2024-09-13T17:05:41.441 INFO:tasks.workunit.client.1.smithi195.stdout:9/87: mkdir d6/d19/d21 0 2024-09-13T17:05:41.441 INFO:tasks.workunit.client.1.smithi195.stdout:2/81: chown d0/d9/fc 1756345323 1 2024-09-13T17:05:41.442 INFO:tasks.workunit.client.1.smithi195.stdout:5/90: rmdir d2/d4/d11 39 2024-09-13T17:05:41.442 INFO:tasks.workunit.client.1.smithi195.stdout:9/88: mknod d6/d12/c22 0 2024-09-13T17:05:41.446 INFO:tasks.workunit.client.1.smithi195.stdout:6/64: read ff [1075177,64518] 0 2024-09-13T17:05:41.446 INFO:tasks.workunit.client.1.smithi195.stdout:6/65: fdatasync ff 0 2024-09-13T17:05:41.446 INFO:tasks.workunit.client.1.smithi195.stdout:9/89: mknod d6/c23 0 2024-09-13T17:05:41.447 INFO:tasks.workunit.client.1.smithi195.stdout:9/90: symlink d6/d19/d21/l24 0 2024-09-13T17:05:41.447 INFO:tasks.workunit.client.1.smithi195.stdout:4/132: dread f12 [0,4194304] 0 2024-09-13T17:05:41.449 INFO:tasks.workunit.client.1.smithi195.stdout:4/133: chown c3 109 1 2024-09-13T17:05:41.450 INFO:tasks.workunit.client.1.smithi195.stdout:0/84: dwrite f6 [0,4194304] 0 2024-09-13T17:05:41.451 INFO:tasks.workunit.client.1.smithi195.stdout:9/91: rename d6/f1b to d6/f25 0 2024-09-13T17:05:41.452 INFO:tasks.workunit.client.1.smithi195.stdout:7/139: sync 2024-09-13T17:05:41.454 INFO:tasks.workunit.client.1.smithi195.stdout:4/134: mknod d1a/d1f/c2f 0 2024-09-13T17:05:41.457 INFO:tasks.workunit.client.1.smithi195.stdout:4/135: creat d1a/d1f/d21/f30 x:0 0 0 2024-09-13T17:05:41.458 INFO:tasks.workunit.client.1.smithi195.stdout:0/85: getdents d7 0 2024-09-13T17:05:41.458 INFO:tasks.workunit.client.1.smithi195.stdout:0/86: read - d7/d8/fe zero size 2024-09-13T17:05:41.458 INFO:tasks.workunit.client.1.smithi195.stdout:0/87: fdatasync f1 0 2024-09-13T17:05:41.458 INFO:tasks.workunit.client.1.smithi195.stdout:4/136: dread d1a/d1f/d21/d22/f2b [0,4194304] 0 2024-09-13T17:05:41.459 INFO:tasks.workunit.client.1.smithi195.stdout:0/88: creat d7/d10/f12 x:0 0 0 2024-09-13T17:05:41.463 INFO:tasks.workunit.client.1.smithi195.stdout:0/89: unlink d7/d8/c9 0 2024-09-13T17:05:41.463 INFO:tasks.workunit.client.1.smithi195.stdout:0/90: write d7/d8/fe [771188,84881] 0 2024-09-13T17:05:41.463 INFO:tasks.workunit.client.1.smithi195.stdout:0/91: write d7/d10/f12 [117724,108410] 0 2024-09-13T17:05:41.466 INFO:tasks.workunit.client.1.smithi195.stdout:5/91: dwrite d2/d4/f5 [0,4194304] 0 2024-09-13T17:05:41.468 INFO:tasks.workunit.client.1.smithi195.stdout:4/137: dread fa [0,4194304] 0 2024-09-13T17:05:41.470 INFO:tasks.workunit.client.0.smithi115.stdout:3/240: sync 2024-09-13T17:05:41.470 INFO:tasks.workunit.client.0.smithi115.stdout:3/241: chown d1/d4b/f21 0 1 2024-09-13T17:05:41.470 INFO:tasks.workunit.client.1.smithi195.stdout:4/138: symlink d1a/l31 0 2024-09-13T17:05:41.471 INFO:tasks.workunit.client.0.smithi115.stdout:3/242: stat d1/d12/d14/l4a 0 2024-09-13T17:05:41.472 INFO:tasks.workunit.client.1.smithi195.stdout:5/92: dread d2/df/fa [0,4194304] 0 2024-09-13T17:05:41.472 INFO:tasks.workunit.client.1.smithi195.stdout:4/139: getdents d1a/d1f/d23 0 2024-09-13T17:05:41.473 INFO:tasks.workunit.client.1.smithi195.stdout:4/140: write fb [3087986,75551] 0 2024-09-13T17:05:41.473 INFO:tasks.workunit.client.1.smithi195.stdout:4/141: dread - d1a/d1f/f20 zero size 2024-09-13T17:05:41.474 INFO:tasks.workunit.client.1.smithi195.stdout:0/92: getdents d7/d10 0 2024-09-13T17:05:41.476 INFO:tasks.workunit.client.1.smithi195.stdout:0/93: link d7/ca d7/c13 0 2024-09-13T17:05:41.483 INFO:tasks.workunit.client.1.smithi195.stdout:2/82: dwrite d0/d3/df/f12 [0,4194304] 0 2024-09-13T17:05:41.486 INFO:tasks.workunit.client.1.smithi195.stdout:2/83: symlink d0/d9/l17 0 2024-09-13T17:05:41.488 INFO:tasks.workunit.client.1.smithi195.stdout:5/93: dread d2/f17 [0,4194304] 0 2024-09-13T17:05:41.488 INFO:tasks.workunit.client.1.smithi195.stdout:5/94: write d2/d7/f16 [1126602,56687] 0 2024-09-13T17:05:41.490 INFO:tasks.workunit.client.1.smithi195.stdout:5/95: truncate d2/d12/f1b 1041973 0 2024-09-13T17:05:41.490 INFO:tasks.workunit.client.1.smithi195.stdout:5/96: readlink d2/d4/d11/l1e 0 2024-09-13T17:05:41.490 INFO:tasks.workunit.client.1.smithi195.stdout:5/97: stat d2/d4/d11/l1e 0 2024-09-13T17:05:41.490 INFO:tasks.workunit.client.1.smithi195.stdout:5/98: write d2/df/f1c [1042155,118963] 0 2024-09-13T17:05:41.490 INFO:tasks.workunit.client.1.smithi195.stdout:5/99: stat d2/d4/d10/f15 0 2024-09-13T17:05:41.494 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.493+0000 7fcc2d178640 1 -- 172.21.15.115:0/4101849652 --> [v2:172.21.15.195:6828/1660911692,v1:172.21.15.195:6829/1660911692] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fcc2819b4c0 con 0x7fcc1006cd90 2024-09-13T17:05:41.497 INFO:tasks.workunit.client.1.smithi195.stdout:2/84: dread d0/d3/df/f12 [0,4194304] 0 2024-09-13T17:05:41.498 INFO:tasks.workunit.client.1.smithi195.stdout:2/85: truncate d0/d3/fe 717953 0 2024-09-13T17:05:41.498 INFO:tasks.workunit.client.1.smithi195.stdout:2/86: stat d0/d3/df 0 2024-09-13T17:05:41.501 INFO:tasks.workunit.client.1.smithi195.stdout:6/66: dwrite f2 [0,4194304] 0 2024-09-13T17:05:41.501 INFO:tasks.workunit.client.1.smithi195.stdout:6/67: fdatasync f2 0 2024-09-13T17:05:41.503 INFO:tasks.workunit.client.1.smithi195.stdout:2/87: dread d0/d3/df/f10 [4194304,4194304] 0 2024-09-13T17:05:41.504 INFO:tasks.workunit.client.1.smithi195.stdout:2/88: mknod d0/d9/c18 0 2024-09-13T17:05:41.504 INFO:tasks.workunit.client.1.smithi195.stdout:2/89: creat d0/d14/f19 x:0 0 0 2024-09-13T17:05:41.505 INFO:tasks.workunit.client.1.smithi195.stdout:4/142: dwrite d1a/f2d [0,4194304] 0 2024-09-13T17:05:41.505 INFO:tasks.workunit.client.1.smithi195.stdout:0/94: fsync d7/d10/f12 0 2024-09-13T17:05:41.505 INFO:tasks.workunit.client.1.smithi195.stdout:9/92: dwrite d6/d19/f1f [0,4194304] 0 2024-09-13T17:05:41.505 INFO:tasks.workunit.client.1.smithi195.stdout:0/95: chown c5 12144792 1 2024-09-13T17:05:41.506 INFO:tasks.workunit.client.1.smithi195.stdout:7/140: dwrite f4 [4194304,4194304] 0 2024-09-13T17:05:41.506 INFO:tasks.workunit.client.1.smithi195.stdout:7/141: dread - d5/db/f2c zero size 2024-09-13T17:05:41.507 INFO:tasks.workunit.client.1.smithi195.stdout:5/100: dwrite d2/df/f1a [0,4194304] 0 2024-09-13T17:05:41.507 INFO:tasks.workunit.client.1.smithi195.stdout:5/101: chown d2/d4 5 1 2024-09-13T17:05:41.507 INFO:tasks.workunit.client.0.smithi115.stdout:3/243: dwrite d1/d4b/d1a/d30/f3c [0,4194304] 0 2024-09-13T17:05:41.507 INFO:tasks.workunit.client.0.smithi115.stdout:3/244: dread - d1/d4b/d1a/f4e zero size 2024-09-13T17:05:41.507 INFO:tasks.workunit.client.0.smithi115.stdout:3/245: fsync d1/d4b/f2b 0 2024-09-13T17:05:41.507 INFO:tasks.workunit.client.0.smithi115.stdout:3/246: chown d1/d4b/l44 31045 1 2024-09-13T17:05:41.507 INFO:tasks.workunit.client.0.smithi115.stdout:3/247: write d1/f16 [1765187,118591] 0 2024-09-13T17:05:41.507 INFO:tasks.workunit.client.0.smithi115.stdout:3/248: write d1/d4b/f1b [3231779,29440] 0 2024-09-13T17:05:41.508 INFO:tasks.workunit.client.1.smithi195.stdout:4/143: mkdir d1a/d1f/d21/d32 0 2024-09-13T17:05:41.508 INFO:tasks.workunit.client.1.smithi195.stdout:4/144: fsync d1a/f1e 0 2024-09-13T17:05:41.509 INFO:tasks.workunit.client.1.smithi195.stdout:4/145: dread d1a/d1f/d21/d22/f28 [0,4194304] 0 2024-09-13T17:05:41.509 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.507+0000 7fcc0ffff640 1 -- 172.21.15.115:0/4101849652 <== mgr.24317 v2:172.21.15.195:6828/1660911692 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7fcc2819b4c0 con 0x7fcc1006cd90 2024-09-13T17:05:41.509 INFO:teuthology.orchestra.run.smithi115.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T17:05:41.509 INFO:teuthology.orchestra.run.smithi115.stdout:alertmanager.smithi115 smithi115 *:9093,9094 running (6m) 115s ago 7m 25.5M - 0.25.0 c8568f914cd2 cbe091cee151 2024-09-13T17:05:41.509 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-exporter.smithi115 smithi115 running (7m) 115s ago 7m 7566k - 18.2.4-843-g2c01458a c129f5a2fd4e 0f1eebeaf9bb 2024-09-13T17:05:41.510 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-exporter.smithi195 smithi195 running (7m) 9s ago 7m 7440k - 18.2.4-843-g2c01458a c129f5a2fd4e 6d05bafbac8a 2024-09-13T17:05:41.510 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi115 smithi115 running (7m) 115s ago 7m 6899k - 18.2.4-843-g2c01458a c129f5a2fd4e 624a903fec23 2024-09-13T17:05:41.510 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi195 smithi195 running (6m) 9s ago 6m 6891k - 18.2.4-843-g2c01458a c129f5a2fd4e 42e6ce26130d 2024-09-13T17:05:41.510 INFO:teuthology.orchestra.run.smithi115.stdout:grafana.smithi115 smithi115 *:3000 running (6m) 115s ago 7m 85.1M - 9.4.7 954c08fa6188 41183f0705c8 2024-09-13T17:05:41.510 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi115.hbtxod smithi115 running (2m) 115s ago 2m 13.4M - 18.2.4-843-g2c01458a c129f5a2fd4e 12b4f4874491 2024-09-13T17:05:41.510 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi115.ijznvr smithi115 running (2m) 115s ago 2m 16.8M - 18.2.4-843-g2c01458a c129f5a2fd4e 2d552564a9f4 2024-09-13T17:05:41.510 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi195.aevvgz smithi195 running (2m) 9s ago 2m 15.0M - 18.2.4-843-g2c01458a c129f5a2fd4e 299b9ad657c9 2024-09-13T17:05:41.510 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi195.qzghxj smithi195 running (2m) 9s ago 2m 13.2M - 18.2.4-843-g2c01458a c129f5a2fd4e fb16b16181ff 2024-09-13T17:05:41.510 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi115.hetcni smithi115 *:9283,8765,8443 running (9m) 115s ago 9m 486M - 18.2.4-843-g2c01458a c129f5a2fd4e f2f0af4ec38c 2024-09-13T17:05:41.510 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi195.hjjifz smithi195 *:8443,9283,8765 running (34s) 9s ago 6m 463M - 18.2.4-860-g6c6b083f 8a91f241d7d4 efed836fb2b0 2024-09-13T17:05:41.510 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi115 smithi115 running (9m) 115s ago 9m 46.1M 2048M 18.2.4-843-g2c01458a c129f5a2fd4e 202375d41e68 2024-09-13T17:05:41.510 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi195 smithi195 running (6m) 9s ago 6m 39.7M 2048M 18.2.4-843-g2c01458a c129f5a2fd4e 0f54c30e5970 2024-09-13T17:05:41.510 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi115 smithi115 *:9100 running (7m) 115s ago 7m 15.9M - 1.5.0 0da6a335fe13 9074300dbe31 2024-09-13T17:05:41.510 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi195 smithi195 *:9100 running (6m) 9s ago 6m 15.8M - 1.5.0 0da6a335fe13 d7b54e5d8c97 2024-09-13T17:05:41.511 INFO:teuthology.orchestra.run.smithi115.stdout:osd.0 smithi115 running (5m) 115s ago 5m 49.0M 3946M 18.2.4-843-g2c01458a c129f5a2fd4e 8a8ad231962e 2024-09-13T17:05:41.511 INFO:teuthology.orchestra.run.smithi115.stdout:osd.1 smithi115 running (5m) 115s ago 5m 49.2M 3946M 18.2.4-843-g2c01458a c129f5a2fd4e 3fbc020102a0 2024-09-13T17:05:41.511 INFO:teuthology.orchestra.run.smithi115.stdout:osd.2 smithi115 running (5m) 115s ago 5m 53.9M 3946M 18.2.4-843-g2c01458a c129f5a2fd4e 7c623823e920 2024-09-13T17:05:41.511 INFO:teuthology.orchestra.run.smithi115.stdout:osd.3 smithi195 running (4m) 9s ago 4m 128M 2240M 18.2.4-843-g2c01458a c129f5a2fd4e 10ea833fd5c5 2024-09-13T17:05:41.511 INFO:teuthology.orchestra.run.smithi115.stdout:osd.4 smithi195 running (4m) 9s ago 4m 122M 2240M 18.2.4-843-g2c01458a c129f5a2fd4e 4bbc3acb9aff 2024-09-13T17:05:41.511 INFO:teuthology.orchestra.run.smithi115.stdout:osd.5 smithi195 running (3m) 9s ago 3m 113M 2240M 18.2.4-843-g2c01458a c129f5a2fd4e 4bd1b3a232d0 2024-09-13T17:05:41.511 INFO:teuthology.orchestra.run.smithi115.stdout:prometheus.smithi115 smithi115 *:9095 running (6m) 115s ago 7m 60.7M - 2.43.0 a07b618ecd1d e91d39286d6c 2024-09-13T17:05:41.512 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.511+0000 7fcc2d178640 1 -- 172.21.15.115:0/4101849652 >> [v2:172.21.15.195:6828/1660911692,v1:172.21.15.195:6829/1660911692] conn(0x7fcc1006cd90 msgr2=0x7fcc1006f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:05:41.512 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.511+0000 7fcc2d178640 1 --2- 172.21.15.115:0/4101849652 >> [v2:172.21.15.195:6828/1660911692,v1:172.21.15.195:6829/1660911692] conn(0x7fcc1006cd90 0x7fcc1006f250 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fcc1802a9c0 tx=0x7fcc18000bc0 comp rx=0 tx=0).stop 2024-09-13T17:05:41.513 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.511+0000 7fcc2d178640 1 -- 172.21.15.115:0/4101849652 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc280ffc30 msgr2=0x7fcc28195ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:05:41.513 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.511+0000 7fcc2d178640 1 --2- 172.21.15.115:0/4101849652 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc280ffc30 0x7fcc28195ad0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c00e9a0 tx=0x7fcc1c00eda0 comp rx=0 tx=0).stop 2024-09-13T17:05:41.513 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.511+0000 7fcc2d178640 1 -- 172.21.15.115:0/4101849652 shutdown_connections 2024-09-13T17:05:41.513 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.511+0000 7fcc2d178640 1 --2- 172.21.15.115:0/4101849652 >> [v2:172.21.15.195:6828/1660911692,v1:172.21.15.195:6829/1660911692] conn(0x7fcc1006cd90 0x7fcc1006f250 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:41.513 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.511+0000 7fcc2d178640 1 --2- 172.21.15.115:0/4101849652 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc280ffc30 0x7fcc28195ad0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:41.513 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.511+0000 7fcc2d178640 1 --2- 172.21.15.115:0/4101849652 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc280fea30 0x7fcc28195590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:41.513 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.511+0000 7fcc2d178640 1 -- 172.21.15.115:0/4101849652 >> 172.21.15.115:0/4101849652 conn(0x7fcc280fa1c0 msgr2=0x7fcc28067be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:05:41.513 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.512+0000 7fcc2d178640 1 -- 172.21.15.115:0/4101849652 shutdown_connections 2024-09-13T17:05:41.513 INFO:tasks.workunit.client.0.smithi115.stdout:3/249: symlink d1/d12/d14/l52 0 2024-09-13T17:05:41.514 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.512+0000 7fcc2d178640 1 -- 172.21.15.115:0/4101849652 wait complete. 2024-09-13T17:05:41.515 INFO:tasks.workunit.client.0.smithi115.stdout:3/250: symlink d1/d4b/d1a/l53 0 2024-09-13T17:05:41.517 INFO:tasks.workunit.client.0.smithi115.stdout:3/251: mkdir d1/d12/d14/d54 0 2024-09-13T17:05:41.517 INFO:tasks.workunit.client.0.smithi115.stdout:3/252: write d1/d4b/f4d [714787,40906] 0 2024-09-13T17:05:41.517 INFO:tasks.workunit.client.0.smithi115.stdout:3/253: truncate d1/d4b/d1a/d30/f39 788100 0 2024-09-13T17:05:41.517 INFO:tasks.workunit.client.0.smithi115.stdout:3/254: creat d1/d12/d14/f55 x:0 0 0 2024-09-13T17:05:41.518 INFO:tasks.workunit.client.1.smithi195.stdout:0/96: dread f1 [0,4194304] 0 2024-09-13T17:05:41.519 INFO:tasks.workunit.client.0.smithi115.stdout:3/255: creat d1/d12/f56 x:0 0 0 2024-09-13T17:05:41.521 INFO:tasks.workunit.client.1.smithi195.stdout:7/142: truncate d5/db/fc 598012 0 2024-09-13T17:05:41.521 INFO:tasks.workunit.client.0.smithi115.stdout:3/256: symlink d1/l57 0 2024-09-13T17:05:41.522 INFO:tasks.workunit.client.0.smithi115.stdout:3/257: write d1/f9 [2923106,63837] 0 2024-09-13T17:05:41.522 INFO:tasks.workunit.client.1.smithi195.stdout:5/102: mknod d2/c21 0 2024-09-13T17:05:41.522 INFO:tasks.workunit.client.1.smithi195.stdout:6/68: dwrite fd [0,4194304] 0 2024-09-13T17:05:41.524 INFO:tasks.workunit.client.1.smithi195.stdout:0/97: unlink d7/fc 0 2024-09-13T17:05:41.524 INFO:tasks.workunit.client.1.smithi195.stdout:9/93: mknod d6/c26 0 2024-09-13T17:05:41.524 INFO:tasks.workunit.client.1.smithi195.stdout:7/143: unlink d5/d13/c26 0 2024-09-13T17:05:41.524 INFO:tasks.workunit.client.1.smithi195.stdout:4/146: dwrite d1a/f1e [0,4194304] 0 2024-09-13T17:05:41.526 INFO:tasks.workunit.client.1.smithi195.stdout:6/69: mknod c10 0 2024-09-13T17:05:41.527 INFO:tasks.workunit.client.1.smithi195.stdout:2/90: rename d0/d9 to d0/d1a 0 2024-09-13T17:05:41.530 INFO:tasks.workunit.client.1.smithi195.stdout:0/98: link f1 d7/d8/f14 0 2024-09-13T17:05:41.531 INFO:tasks.workunit.client.1.smithi195.stdout:9/94: creat d6/df/f27 x:0 0 0 2024-09-13T17:05:41.532 INFO:tasks.workunit.client.1.smithi195.stdout:7/144: rename d5/db/c2a to d5/db/d19/c2f 0 2024-09-13T17:05:41.537 INFO:tasks.workunit.client.1.smithi195.stdout:4/147: rename d1a/l2e to d1a/l33 0 2024-09-13T17:05:41.537 INFO:tasks.workunit.client.1.smithi195.stdout:4/148: creat d1a/d1f/f34 x:0 0 0 2024-09-13T17:05:41.538 INFO:tasks.workunit.client.1.smithi195.stdout:6/70: rename c10 to c11 0 2024-09-13T17:05:41.538 INFO:tasks.workunit.client.1.smithi195.stdout:6/71: rmdir - no directory 2024-09-13T17:05:41.540 INFO:tasks.workunit.client.1.smithi195.stdout:9/95: mknod d6/df/d13/c28 0 2024-09-13T17:05:41.540 INFO:tasks.workunit.client.1.smithi195.stdout:9/96: chown d6/d19/l1c 580655 1 2024-09-13T17:05:41.540 INFO:tasks.workunit.client.1.smithi195.stdout:9/97: write d6/f1e [307377,87001] 0 2024-09-13T17:05:41.542 INFO:tasks.workunit.client.1.smithi195.stdout:2/91: rename d0/d3/c16 to d0/d3/df/d11/c1b 0 2024-09-13T17:05:41.542 INFO:tasks.workunit.client.1.smithi195.stdout:2/92: fsync d0/d14/f19 0 2024-09-13T17:05:41.542 INFO:tasks.workunit.client.1.smithi195.stdout:7/145: mkdir d5/d13/d30 0 2024-09-13T17:05:41.545 INFO:tasks.workunit.client.1.smithi195.stdout:5/103: dwrite d2/f3 [4194304,4194304] 0 2024-09-13T17:05:41.545 INFO:tasks.workunit.client.1.smithi195.stdout:5/104: readlink d2/d4/d11/l1e 0 2024-09-13T17:05:41.545 INFO:tasks.workunit.client.1.smithi195.stdout:5/105: write d2/d4/f1d [855436,64627] 0 2024-09-13T17:05:41.547 INFO:tasks.workunit.client.1.smithi195.stdout:4/149: symlink d1a/d1f/d23/d29/l35 0 2024-09-13T17:05:41.547 INFO:tasks.workunit.client.1.smithi195.stdout:6/72: link c4 c12 0 2024-09-13T17:05:41.547 INFO:tasks.workunit.client.1.smithi195.stdout:6/73: fdatasync ff 0 2024-09-13T17:05:41.547 INFO:tasks.workunit.client.1.smithi195.stdout:6/74: read ff [3118979,107491] 0 2024-09-13T17:05:41.549 INFO:tasks.workunit.client.0.smithi115.stdout:3/258: dwrite d1/d4b/d1a/d30/f37 [0,4194304] 0 2024-09-13T17:05:41.550 INFO:tasks.workunit.client.1.smithi195.stdout:0/99: dwrite f6 [0,4194304] 0 2024-09-13T17:05:41.550 INFO:tasks.workunit.client.1.smithi195.stdout:5/106: unlink d2/f3 0 2024-09-13T17:05:41.554 INFO:tasks.workunit.client.1.smithi195.stdout:4/150: rmdir d1a/d1f/d23 39 2024-09-13T17:05:41.554 INFO:tasks.workunit.client.1.smithi195.stdout:6/75: mknod c13 0 2024-09-13T17:05:41.554 INFO:tasks.workunit.client.1.smithi195.stdout:6/76: creat f14 x:0 0 0 2024-09-13T17:05:41.554 INFO:tasks.workunit.client.1.smithi195.stdout:6/77: chown ce 2170 1 2024-09-13T17:05:41.554 INFO:tasks.workunit.client.1.smithi195.stdout:6/78: fdatasync f2 0 2024-09-13T17:05:41.555 INFO:tasks.workunit.client.1.smithi195.stdout:6/79: creat f15 x:0 0 0 2024-09-13T17:05:41.555 INFO:tasks.workunit.client.1.smithi195.stdout:6/80: chown f2 13015 1 2024-09-13T17:05:41.555 INFO:tasks.workunit.client.1.smithi195.stdout:9/98: dread d6/d19/f1f [0,4194304] 0 2024-09-13T17:05:41.557 INFO:tasks.workunit.client.0.smithi115.stdout:3/259: link d1/d4b/d1a/d30/l3b d1/d4b/d1a/d30/l58 0 2024-09-13T17:05:41.560 INFO:tasks.workunit.client.1.smithi195.stdout:4/151: rename d1a/d1f/d21/d32 to d1a/d1f/d21/d36 0 2024-09-13T17:05:41.560 INFO:tasks.workunit.client.1.smithi195.stdout:4/152: read - d1a/d1f/d21/f30 zero size 2024-09-13T17:05:41.561 INFO:tasks.workunit.client.1.smithi195.stdout:4/153: dread d1a/d1f/d21/d22/f28 [0,4194304] 0 2024-09-13T17:05:41.563 INFO:tasks.workunit.client.0.smithi115.stdout:3/260: rename d1/f2 to d1/d12/d23/f59 0 2024-09-13T17:05:41.563 INFO:tasks.workunit.client.1.smithi195.stdout:7/146: dwrite d5/db/d19/f18 [0,4194304] 0 2024-09-13T17:05:41.565 INFO:tasks.workunit.client.1.smithi195.stdout:2/93: dwrite d0/d3/df/f12 [4194304,4194304] 0 2024-09-13T17:05:41.565 INFO:tasks.workunit.client.1.smithi195.stdout:6/81: symlink l16 0 2024-09-13T17:05:41.565 INFO:tasks.workunit.client.0.smithi115.stdout:3/261: mknod d1/d4b/d1a/d30/c5a 0 2024-09-13T17:05:41.567 INFO:tasks.workunit.client.1.smithi195.stdout:4/154: truncate fd 1000035 0 2024-09-13T17:05:41.568 INFO:tasks.workunit.client.1.smithi195.stdout:7/147: rename d5/db/d19/d22/l27 to d5/d13/d24/l31 0 2024-09-13T17:05:41.569 INFO:tasks.workunit.client.1.smithi195.stdout:2/94: read d0/d3/df/f10 [1109082,68171] 0 2024-09-13T17:05:41.573 INFO:tasks.workunit.client.1.smithi195.stdout:6/82: dread ff [0,4194304] 0 2024-09-13T17:05:41.573 INFO:tasks.workunit.client.1.smithi195.stdout:6/83: chown f14 33475 1 2024-09-13T17:05:41.573 INFO:tasks.workunit.client.1.smithi195.stdout:6/84: dread - f15 zero size 2024-09-13T17:05:41.573 INFO:tasks.workunit.client.1.smithi195.stdout:6/85: dread - f14 zero size 2024-09-13T17:05:41.573 INFO:tasks.workunit.client.1.smithi195.stdout:6/86: creat f17 x:0 0 0 2024-09-13T17:05:41.573 INFO:tasks.workunit.client.1.smithi195.stdout:6/87: dread - f17 zero size 2024-09-13T17:05:41.573 INFO:tasks.workunit.client.1.smithi195.stdout:6/88: creat f18 x:0 0 0 2024-09-13T17:05:41.573 INFO:tasks.workunit.client.1.smithi195.stdout:6/89: fdatasync f17 0 2024-09-13T17:05:41.573 INFO:tasks.workunit.client.1.smithi195.stdout:6/90: fsync ff 0 2024-09-13T17:05:41.573 INFO:tasks.workunit.client.1.smithi195.stdout:2/95: mkdir d0/d1a/d1c 0 2024-09-13T17:05:41.575 INFO:tasks.workunit.client.1.smithi195.stdout:1/86: sync 2024-09-13T17:05:41.575 INFO:tasks.workunit.client.1.smithi195.stdout:3/87: sync 2024-09-13T17:05:41.575 INFO:tasks.workunit.client.1.smithi195.stdout:8/92: sync 2024-09-13T17:05:41.575 INFO:tasks.workunit.client.1.smithi195.stdout:3/88: dread - d7/f11 zero size 2024-09-13T17:05:41.575 INFO:tasks.workunit.client.1.smithi195.stdout:8/93: write d0/f3 [1133088,49780] 0 2024-09-13T17:05:41.575 INFO:tasks.workunit.client.1.smithi195.stdout:8/94: dread - d0/f8 zero size 2024-09-13T17:05:41.575 INFO:tasks.workunit.client.1.smithi195.stdout:1/87: creat db/df/d13/f21 x:0 0 0 2024-09-13T17:05:41.575 INFO:tasks.workunit.client.1.smithi195.stdout:7/148: getdents d5 0 2024-09-13T17:05:41.576 INFO:tasks.workunit.client.1.smithi195.stdout:0/100: dwrite f3 [0,4194304] 0 2024-09-13T17:05:41.576 INFO:tasks.workunit.client.1.smithi195.stdout:0/101: chown d7/c13 58766 1 2024-09-13T17:05:41.578 INFO:tasks.workunit.client.1.smithi195.stdout:9/99: dwrite d6/f25 [0,4194304] 0 2024-09-13T17:05:41.578 INFO:tasks.workunit.client.1.smithi195.stdout:5/107: dwrite d2/d4/d10/f15 [0,4194304] 0 2024-09-13T17:05:41.582 INFO:tasks.workunit.client.1.smithi195.stdout:2/96: unlink d0/d1a/l17 0 2024-09-13T17:05:41.583 INFO:tasks.workunit.client.1.smithi195.stdout:3/89: readlink d7/lb 0 2024-09-13T17:05:41.583 INFO:tasks.workunit.client.1.smithi195.stdout:3/90: fsync d7/fa 0 2024-09-13T17:05:41.587 INFO:tasks.workunit.client.1.smithi195.stdout:1/88: truncate db/df/d13/f1e 1549333 0 2024-09-13T17:05:41.587 INFO:tasks.workunit.client.1.smithi195.stdout:1/89: creat db/df/d13/f22 x:0 0 0 2024-09-13T17:05:41.587 INFO:tasks.workunit.client.1.smithi195.stdout:7/149: creat d5/d13/f32 x:0 0 0 2024-09-13T17:05:41.588 INFO:tasks.workunit.client.1.smithi195.stdout:0/102: dread f6 [0,4194304] 0 2024-09-13T17:05:41.588 INFO:tasks.workunit.client.1.smithi195.stdout:0/103: getdents d7/db/d11 0 2024-09-13T17:05:41.588 INFO:tasks.workunit.client.1.smithi195.stdout:2/97: write d0/d3/fe [642182,127672] 0 2024-09-13T17:05:41.588 INFO:tasks.workunit.client.1.smithi195.stdout:0/104: fsync f6 0 2024-09-13T17:05:41.591 INFO:tasks.workunit.client.1.smithi195.stdout:4/155: rmdir d1a/d1f 39 2024-09-13T17:05:41.596 INFO:tasks.workunit.client.1.smithi195.stdout:3/91: creat d7/f12 x:0 0 0 2024-09-13T17:05:41.600 INFO:tasks.workunit.client.1.smithi195.stdout:8/95: rmdir d0/d17 39 2024-09-13T17:05:41.601 INFO:tasks.workunit.client.1.smithi195.stdout:9/100: dwrite d6/f25 [0,4194304] 0 2024-09-13T17:05:41.602 INFO:tasks.workunit.client.1.smithi195.stdout:1/90: mknod db/c23 0 2024-09-13T17:05:41.605 INFO:tasks.workunit.client.1.smithi195.stdout:7/150: creat d5/db/d19/f33 x:0 0 0 2024-09-13T17:05:41.605 INFO:tasks.workunit.client.1.smithi195.stdout:7/151: write d5/d13/f32 [429998,68122] 0 2024-09-13T17:05:41.605 INFO:tasks.workunit.client.1.smithi195.stdout:7/152: chown d5/d13/f1d 3075414 1 2024-09-13T17:05:41.605 INFO:tasks.workunit.client.1.smithi195.stdout:7/153: chown d5/c23 12 1 2024-09-13T17:05:41.607 INFO:tasks.workunit.client.1.smithi195.stdout:2/98: mknod d0/d3/df/c1d 0 2024-09-13T17:05:41.607 INFO:tasks.workunit.client.1.smithi195.stdout:2/99: truncate d0/d14/f19 714256 0 2024-09-13T17:05:41.607 INFO:tasks.workunit.client.1.smithi195.stdout:2/100: write d0/d3/f4 [9299972,5899] 0 2024-09-13T17:05:41.608 INFO:tasks.workunit.client.1.smithi195.stdout:0/105: creat d7/d8/f15 x:0 0 0 2024-09-13T17:05:41.608 INFO:tasks.workunit.client.1.smithi195.stdout:0/106: chown d7/d8/fe 148848 1 2024-09-13T17:05:41.613 INFO:tasks.workunit.client.0.smithi115.stdout:3/262: dwrite d1/d4b/f4d [0,4194304] 0 2024-09-13T17:05:41.613 INFO:tasks.workunit.client.0.smithi115.stdout:3/263: dread - d1/d4b/d1a/f2c zero size 2024-09-13T17:05:41.613 INFO:tasks.workunit.client.0.smithi115.stdout:3/264: creat d1/d12/f5b x:0 0 0 2024-09-13T17:05:41.614 INFO:tasks.workunit.client.0.smithi115.stdout:3/265: chown d1/d12/d14/c47 0 1 2024-09-13T17:05:41.616 INFO:tasks.workunit.client.1.smithi195.stdout:4/156: unlink d1a/f1e 0 2024-09-13T17:05:41.617 INFO:tasks.workunit.client.1.smithi195.stdout:5/108: dwrite d2/df/fa [0,4194304] 0 2024-09-13T17:05:41.618 INFO:tasks.workunit.client.1.smithi195.stdout:3/92: creat d7/f13 x:0 0 0 2024-09-13T17:05:41.618 INFO:tasks.workunit.client.1.smithi195.stdout:3/93: chown d7/f13 36509 1 2024-09-13T17:05:41.618 INFO:tasks.workunit.client.1.smithi195.stdout:3/94: chown d7/f11 597429 1 2024-09-13T17:05:41.619 INFO:tasks.workunit.client.1.smithi195.stdout:8/96: truncate d0/d13/f16 3520995 0 2024-09-13T17:05:41.620 INFO:tasks.workunit.client.1.smithi195.stdout:9/101: dwrite d6/f7 [0,4194304] 0 2024-09-13T17:05:41.623 INFO:tasks.workunit.client.1.smithi195.stdout:1/91: unlink f2 0 2024-09-13T17:05:41.625 INFO:tasks.workunit.client.1.smithi195.stdout:0/107: mkdir d7/d8/d16 0 2024-09-13T17:05:41.627 INFO:tasks.workunit.client.1.smithi195.stdout:4/157: symlink d1a/d1f/d23/d29/l37 0 2024-09-13T17:05:41.627 INFO:tasks.workunit.client.1.smithi195.stdout:4/158: fdatasync d1a/f1d 0 2024-09-13T17:05:41.628 INFO:tasks.workunit.client.1.smithi195.stdout:2/101: dwrite d0/d3/f4 [0,4194304] 0 2024-09-13T17:05:41.628 INFO:tasks.workunit.client.1.smithi195.stdout:5/109: mknod d2/d4/c22 0 2024-09-13T17:05:41.628 INFO:tasks.workunit.client.1.smithi195.stdout:5/110: creat d2/d4/d10/f23 x:0 0 0 2024-09-13T17:05:41.628 INFO:tasks.workunit.client.1.smithi195.stdout:5/111: creat d2/d4/d10/f24 x:0 0 0 2024-09-13T17:05:41.629 INFO:tasks.workunit.client.0.smithi115.stdout:4/76: sync 2024-09-13T17:05:41.629 INFO:tasks.workunit.client.0.smithi115.stdout:2/157: sync 2024-09-13T17:05:41.629 INFO:tasks.workunit.client.0.smithi115.stdout:4/77: fdatasync d7/dd/f11 0 2024-09-13T17:05:41.629 INFO:tasks.workunit.client.0.smithi115.stdout:4/78: fdatasync d7/dd/de/f10 0 2024-09-13T17:05:41.629 INFO:tasks.workunit.client.0.smithi115.stdout:4/79: fdatasync d7/f12 0 2024-09-13T17:05:41.630 INFO:tasks.workunit.client.1.smithi195.stdout:8/97: getdents d0 0 2024-09-13T17:05:41.630 INFO:tasks.workunit.client.1.smithi195.stdout:8/98: truncate d0/f3 1465926 0 2024-09-13T17:05:41.630 INFO:tasks.workunit.client.1.smithi195.stdout:8/99: readlink d0/d17/l1e 0 2024-09-13T17:05:41.632 INFO:tasks.workunit.client.0.smithi115.stdout:3/266: dread d1/d12/d23/f59 [0,4194304] 0 2024-09-13T17:05:41.632 INFO:tasks.workunit.client.0.smithi115.stdout:3/267: dread - d1/d4b/f2b zero size 2024-09-13T17:05:41.634 INFO:tasks.workunit.client.0.smithi115.stdout:2/158: link d3/d5/d13/l1e d3/l36 0 2024-09-13T17:05:41.634 INFO:tasks.workunit.client.0.smithi115.stdout:2/159: read d3/d5/dd/f2d [3359172,39684] 0 2024-09-13T17:05:41.634 INFO:tasks.workunit.client.0.smithi115.stdout:2/160: write d3/d5/dd/df/d22/f34 [964938,18556] 0 2024-09-13T17:05:41.634 INFO:tasks.workunit.client.0.smithi115.stdout:2/161: write d3/d5/de/f2a [279806,111540] 0 2024-09-13T17:05:41.636 INFO:tasks.workunit.client.0.smithi115.stdout:4/80: creat d7/dd/de/f14 x:0 0 0 2024-09-13T17:05:41.637 INFO:tasks.workunit.client.1.smithi195.stdout:1/92: mknod db/d19/c24 0 2024-09-13T17:05:41.637 INFO:tasks.workunit.client.1.smithi195.stdout:1/93: chown db/df/d13/l1d 1648 1 2024-09-13T17:05:41.638 INFO:tasks.workunit.client.1.smithi195.stdout:2/102: dread d0/d3/df/f10 [0,4194304] 0 2024-09-13T17:05:41.638 INFO:tasks.workunit.client.0.smithi115.stdout:3/268: symlink d1/d12/d14/l5c 0 2024-09-13T17:05:41.640 INFO:tasks.workunit.client.0.smithi115.stdout:3/269: dread d1/d12/d14/f19 [0,4194304] 0 2024-09-13T17:05:41.641 INFO:tasks.workunit.client.1.smithi195.stdout:0/108: mknod d7/d8/d16/c17 0 2024-09-13T17:05:41.642 INFO:tasks.workunit.client.0.smithi115.stdout:2/162: creat d3/d5/de/f37 x:0 0 0 2024-09-13T17:05:41.643 INFO:tasks.workunit.client.0.smithi115.stdout:4/81: symlink d7/dd/l15 0 2024-09-13T17:05:41.646 INFO:tasks.workunit.client.1.smithi195.stdout:3/95: dwrite d7/fa [0,4194304] 0 2024-09-13T17:05:41.647 INFO:tasks.workunit.client.1.smithi195.stdout:9/102: dwrite d6/f18 [0,4194304] 0 2024-09-13T17:05:41.647 INFO:tasks.workunit.client.0.smithi115.stdout:3/270: mknod d1/d12/d23/c5d 0 2024-09-13T17:05:41.649 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.648+0000 7fe0346af640 1 -- 172.21.15.115:0/3137942808 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe02c0fddf0 msgr2=0x7fe02c0fe1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:05:41.649 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.648+0000 7fe0346af640 1 --2- 172.21.15.115:0/3137942808 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe02c0fddf0 0x7fe02c0fe1f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fe028009880 tx=0x7fe02802a4b0 comp rx=0 tx=0).stop 2024-09-13T17:05:41.650 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.649+0000 7fe0346af640 1 -- 172.21.15.115:0/3137942808 shutdown_connections 2024-09-13T17:05:41.650 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.649+0000 7fe0346af640 1 --2- 172.21.15.115:0/3137942808 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe02c100dd0 0x7fe02c101250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:41.650 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.649+0000 7fe0346af640 1 --2- 172.21.15.115:0/3137942808 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe02c0fddf0 0x7fe02c0fe1f0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:41.650 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.649+0000 7fe0346af640 1 -- 172.21.15.115:0/3137942808 >> 172.21.15.115:0/3137942808 conn(0x7fe02c0f9940 msgr2=0x7fe02c0fbd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:05:41.650 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.649+0000 7fe0346af640 1 -- 172.21.15.115:0/3137942808 shutdown_connections 2024-09-13T17:05:41.651 INFO:tasks.workunit.client.0.smithi115.stdout:2/163: symlink d3/d5/l38 0 2024-09-13T17:05:41.651 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.650+0000 7fe0346af640 1 -- 172.21.15.115:0/3137942808 wait complete. 2024-09-13T17:05:41.652 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.650+0000 7fe0346af640 1 Processor -- start 2024-09-13T17:05:41.652 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.651+0000 7fe0346af640 1 -- start start 2024-09-13T17:05:41.652 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.651+0000 7fe0346af640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe02c0fddf0 0x7fe02c19bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:05:41.652 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.651+0000 7fe0346af640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe02c100dd0 0x7fe02c19c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:05:41.652 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.651+0000 7fe0346af640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe02c19c650 con 0x7fe02c100dd0 2024-09-13T17:05:41.652 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.651+0000 7fe0346af640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe02c19c7c0 con 0x7fe02c0fddf0 2024-09-13T17:05:41.653 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.652+0000 7fe031c4a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe02c100dd0 0x7fe02c19c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:05:41.655 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.652+0000 7fe031c4a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe02c100dd0 0x7fe02c19c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:41682/0 (socket says 172.21.15.115:41682) 2024-09-13T17:05:41.655 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.652+0000 7fe031c4a640 1 -- 172.21.15.115:0/1959308402 learned_addr learned my addr 172.21.15.115:0/1959308402 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:05:41.655 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.652+0000 7fe03244b640 1 --2- 172.21.15.115:0/1959308402 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe02c0fddf0 0x7fe02c19bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:05:41.655 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.653+0000 7fe031c4a640 1 -- 172.21.15.115:0/1959308402 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe02c0fddf0 msgr2=0x7fe02c19bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:05:41.655 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.653+0000 7fe031c4a640 1 --2- 172.21.15.115:0/1959308402 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe02c0fddf0 0x7fe02c19bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:41.655 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.653+0000 7fe031c4a640 1 -- 172.21.15.115:0/1959308402 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe028009560 con 0x7fe02c100dd0 2024-09-13T17:05:41.655 INFO:tasks.workunit.client.0.smithi115.stdout:3/271: rmdir d1/d12/d23 39 2024-09-13T17:05:41.656 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.654+0000 7fe031c4a640 1 --2- 172.21.15.115:0/1959308402 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe02c100dd0 0x7fe02c19c080 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fe01c00d8d0 tx=0x7fe01c00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:05:41.656 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.655+0000 7fe0237fe640 1 -- 172.21.15.115:0/1959308402 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe01c00bea0 con 0x7fe02c100dd0 2024-09-13T17:05:41.656 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.655+0000 7fe0237fe640 1 -- 172.21.15.115:0/1959308402 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe01c009c00 con 0x7fe02c100dd0 2024-09-13T17:05:41.657 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.655+0000 7fe0237fe640 1 -- 172.21.15.115:0/1959308402 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe01c00f680 con 0x7fe02c100dd0 2024-09-13T17:05:41.657 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.656+0000 7fe0346af640 1 -- 172.21.15.115:0/1959308402 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe02c06a070 con 0x7fe02c100dd0 2024-09-13T17:05:41.657 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.656+0000 7fe0346af640 1 -- 172.21.15.115:0/1959308402 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe02c06a640 con 0x7fe02c100dd0 2024-09-13T17:05:41.661 INFO:tasks.workunit.client.1.smithi195.stdout:5/112: rename d2/d7/c19 to d2/df/c25 0 2024-09-13T17:05:41.661 INFO:tasks.workunit.client.1.smithi195.stdout:5/113: creat d2/f26 x:0 0 0 2024-09-13T17:05:41.661 INFO:tasks.workunit.client.1.smithi195.stdout:5/114: chown d2/d7 226 1 2024-09-13T17:05:41.661 INFO:tasks.workunit.client.1.smithi195.stdout:5/115: write d2/d12/f1b [1781480,119610] 0 2024-09-13T17:05:41.661 INFO:tasks.workunit.client.1.smithi195.stdout:5/116: creat d2/df/f27 x:0 0 0 2024-09-13T17:05:41.661 INFO:tasks.workunit.client.1.smithi195.stdout:5/117: write d2/d4/d10/f23 [104228,84923] 0 2024-09-13T17:05:41.661 INFO:tasks.workunit.client.1.smithi195.stdout:5/118: creat d2/d4/d10/f28 x:0 0 0 2024-09-13T17:05:41.662 INFO:tasks.workunit.client.1.smithi195.stdout:5/119: fdatasync d2/df/f27 0 2024-09-13T17:05:41.662 INFO:tasks.workunit.client.1.smithi195.stdout:5/120: readlink d2/d4/l1f 0 2024-09-13T17:05:41.662 INFO:tasks.workunit.client.1.smithi195.stdout:5/121: write d2/d4/f5 [4398748,5018] 0 2024-09-13T17:05:41.662 INFO:tasks.workunit.client.1.smithi195.stdout:5/122: stat d2/d4/c22 0 2024-09-13T17:05:41.662 INFO:tasks.workunit.client.1.smithi195.stdout:8/100: mknod d0/d13/c1f 0 2024-09-13T17:05:41.663 INFO:tasks.workunit.client.1.smithi195.stdout:1/94: symlink db/df/d13/l25 0 2024-09-13T17:05:41.663 INFO:tasks.workunit.client.1.smithi195.stdout:1/95: truncate db/f1b 480751 0 2024-09-13T17:05:41.663 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.659+0000 7fe0237fe640 1 -- 172.21.15.115:0/1959308402 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 24) v1 ==== 90954+0+0 (secure 0 0 0) 0x7fe01c010460 con 0x7fe02c100dd0 2024-09-13T17:05:41.663 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.660+0000 7fe0237fe640 1 --2- 172.21.15.115:0/1959308402 >> [v2:172.21.15.195:6828/1660911692,v1:172.21.15.195:6829/1660911692] conn(0x7fe01806cee0 0x7fe01806f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:05:41.663 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.661+0000 7fe0346af640 1 -- 172.21.15.115:0/1959308402 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe02c106e30 con 0x7fe02c100dd0 2024-09-13T17:05:41.663 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.661+0000 7fe03244b640 1 --2- 172.21.15.115:0/1959308402 >> [v2:172.21.15.195:6828/1660911692,v1:172.21.15.195:6829/1660911692] conn(0x7fe01806cee0 0x7fe01806f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:05:41.664 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.661+0000 7fe0237fe640 1 -- 172.21.15.115:0/1959308402 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fe01c08c330 con 0x7fe02c100dd0 2024-09-13T17:05:41.664 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.662+0000 7fe03244b640 1 --2- 172.21.15.115:0/1959308402 >> [v2:172.21.15.195:6828/1660911692,v1:172.21.15.195:6829/1660911692] conn(0x7fe01806cee0 0x7fe01806f3a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe028006010 tx=0x7fe028031420 comp rx=0 tx=0).ready entity=mgr.24317 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:05:41.664 INFO:tasks.workunit.client.0.smithi115.stdout:2/164: dread d3/d5/de/f2a [0,4194304] 0 2024-09-13T17:05:41.665 INFO:tasks.workunit.client.0.smithi115.stdout:4/82: dwrite d7/f9 [0,4194304] 0 2024-09-13T17:05:41.665 INFO:tasks.workunit.client.1.smithi195.stdout:0/109: truncate d7/d8/fe 497467 0 2024-09-13T17:05:41.665 INFO:tasks.workunit.client.1.smithi195.stdout:0/110: chown d7/d8/d16/c17 22926 1 2024-09-13T17:05:41.665 INFO:tasks.workunit.client.1.smithi195.stdout:0/111: read - d7/d8/f15 zero size 2024-09-13T17:05:41.665 INFO:tasks.workunit.client.1.smithi195.stdout:3/96: creat d7/f14 x:0 0 0 2024-09-13T17:05:41.666 INFO:tasks.workunit.client.1.smithi195.stdout:0/112: dread d7/d10/f12 [0,4194304] 0 2024-09-13T17:05:41.670 INFO:tasks.workunit.client.1.smithi195.stdout:9/103: dwrite d6/f25 [0,4194304] 0 2024-09-13T17:05:41.672 INFO:tasks.workunit.client.1.smithi195.stdout:9/104: write d6/f1e [33915,10544] 0 2024-09-13T17:05:41.673 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:41.671+0000 7fe0237fe640 1 -- 172.21.15.115:0/1959308402 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe01c059e70 con 0x7fe02c100dd0 2024-09-13T17:05:41.674 INFO:tasks.workunit.client.0.smithi115.stdout:2/165: mkdir d3/d5/d13/d39 0 2024-09-13T17:05:41.678 INFO:tasks.workunit.client.0.smithi115.stdout:4/83: mknod d7/c16 0 2024-09-13T17:05:41.678 INFO:tasks.workunit.client.0.smithi115.stdout:4/84: chown d7 5456903 1 2024-09-13T17:05:41.683 INFO:tasks.workunit.client.1.smithi195.stdout:5/123: symlink d2/d12/l29 0 2024-09-13T17:05:41.683 INFO:tasks.workunit.client.1.smithi195.stdout:5/124: dread - d2/f26 zero size 2024-09-13T17:05:41.684 INFO:tasks.workunit.client.1.smithi195.stdout:8/101: rmdir d0/d13 39 2024-09-13T17:05:41.686 INFO:tasks.workunit.client.1.smithi195.stdout:3/97: creat d7/f15 x:0 0 0 2024-09-13T17:05:41.688 INFO:tasks.workunit.client.0.smithi115.stdout:4/85: dread d7/f9 [0,4194304] 0 2024-09-13T17:05:41.688 INFO:tasks.workunit.client.0.smithi115.stdout:4/86: chown d7/dd/de/f14 58408 1 2024-09-13T17:05:41.688 INFO:tasks.workunit.client.1.smithi195.stdout:0/113: mknod d7/d8/c18 0 2024-09-13T17:05:41.688 INFO:tasks.workunit.client.1.smithi195.stdout:4/159: dwrite f8 [4194304,4194304] 0 2024-09-13T17:05:41.689 INFO:tasks.workunit.client.0.smithi115.stdout:3/272: dwrite d1/f10 [0,4194304] 0 2024-09-13T17:05:41.689 INFO:tasks.workunit.client.0.smithi115.stdout:3/273: creat d1/d12/f5e x:0 0 0 2024-09-13T17:05:41.689 INFO:tasks.workunit.client.0.smithi115.stdout:3/274: dread - d1/d12/d23/f3a zero size 2024-09-13T17:05:41.689 INFO:tasks.workunit.client.1.smithi195.stdout:9/105: rmdir d6/d12 39 2024-09-13T17:05:41.692 INFO:tasks.workunit.client.1.smithi195.stdout:5/125: symlink d2/df/l2a 0 2024-09-13T17:05:41.692 INFO:tasks.workunit.client.1.smithi195.stdout:5/126: dread - d2/d4/d10/f28 zero size 2024-09-13T17:05:41.694 INFO:tasks.workunit.client.0.smithi115.stdout:4/87: rename f6 to d7/dd/de/f17 0 2024-09-13T17:05:41.694 INFO:tasks.workunit.client.1.smithi195.stdout:0/114: write f1 [2853375,50298] 0 2024-09-13T17:05:41.695 INFO:tasks.workunit.client.1.smithi195.stdout:8/102: creat d0/f20 x:0 0 0 2024-09-13T17:05:41.695 INFO:tasks.workunit.client.1.smithi195.stdout:8/103: write d0/d17/f1d [2733193,8153] 0 2024-09-13T17:05:41.696 INFO:tasks.workunit.client.1.smithi195.stdout:0/115: read d7/d8/fe [353589,75266] 0 2024-09-13T17:05:41.701 INFO:tasks.workunit.client.1.smithi195.stdout:1/96: getdents db 0 2024-09-13T17:05:41.703 INFO:tasks.workunit.client.1.smithi195.stdout:2/103: rename d0/d14 to d0/d1a/d1c/d1e 0 2024-09-13T17:05:41.704 INFO:tasks.workunit.client.0.smithi115.stdout:2/166: dwrite d3/f14 [0,4194304] 0 2024-09-13T17:05:41.714 INFO:tasks.workunit.client.1.smithi195.stdout:9/106: link d6/f25 d6/df/d13/f29 0 2024-09-13T17:05:41.714 INFO:tasks.workunit.client.1.smithi195.stdout:3/98: dwrite d7/f12 [0,4194304] 0 2024-09-13T17:05:41.720 INFO:tasks.workunit.client.1.smithi195.stdout:0/116: symlink d7/d8/df/l19 0 2024-09-13T17:05:41.723 INFO:tasks.workunit.client.1.smithi195.stdout:1/97: truncate db/f17 800098 0 2024-09-13T17:05:41.726 INFO:tasks.workunit.client.1.smithi195.stdout:5/127: rename d2/df/f27 to d2/d4/f2b 0 2024-09-13T17:05:41.731 INFO:tasks.workunit.client.1.smithi195.stdout:3/99: unlink d7/f11 0 2024-09-13T17:05:41.734 INFO:tasks.workunit.client.1.smithi195.stdout:0/117: mknod d7/c1a 0 2024-09-13T17:05:41.734 INFO:tasks.workunit.client.1.smithi195.stdout:0/118: chown d7/d8/f14 195038998 1 2024-09-13T17:05:41.735 INFO:tasks.workunit.client.0.smithi115.stdout:4/88: dwrite d7/dd/de/f13 [0,4194304] 0 2024-09-13T17:05:41.736 INFO:tasks.workunit.client.0.smithi115.stdout:4/89: write d7/fa [1306871,85832] 0 2024-09-13T17:05:41.736 INFO:tasks.workunit.client.0.smithi115.stdout:4/90: fsync d7/fc 0 2024-09-13T17:05:41.736 INFO:tasks.workunit.client.0.smithi115.stdout:4/91: rename d7/dd to d7/dd/d18 22 2024-09-13T17:05:41.736 INFO:tasks.workunit.client.1.smithi195.stdout:7/154: sync 2024-09-13T17:05:41.736 INFO:tasks.workunit.client.1.smithi195.stdout:6/91: sync 2024-09-13T17:05:41.736 INFO:tasks.workunit.client.1.smithi195.stdout:7/155: write d5/d13/d24/f2d [926551,94639] 0 2024-09-13T17:05:41.737 INFO:tasks.workunit.client.1.smithi195.stdout:3/100: truncate f5 1087758 0 2024-09-13T17:05:41.737 INFO:tasks.workunit.client.1.smithi195.stdout:1/98: read db/f10 [2513151,1295] 0 2024-09-13T17:05:41.740 INFO:tasks.workunit.client.0.smithi115.stdout:4/92: rename d7/dd/f11 to d7/f19 0 2024-09-13T17:05:41.740 INFO:tasks.workunit.client.0.smithi115.stdout:4/93: readlink d7/dd/l15 0 2024-09-13T17:05:41.740 INFO:tasks.workunit.client.0.smithi115.stdout:4/94: write d7/dd/de/f17 [464826,23674] 0 2024-09-13T17:05:41.744 INFO:tasks.workunit.client.1.smithi195.stdout:1/99: dread db/f10 [0,4194304] 0 2024-09-13T17:05:41.745 INFO:tasks.workunit.client.1.smithi195.stdout:8/104: dwrite d0/d13/f16 [0,4194304] 0 2024-09-13T17:05:41.745 INFO:tasks.workunit.client.1.smithi195.stdout:8/105: chown d0/d17 22508 1 2024-09-13T17:05:41.746 INFO:tasks.workunit.client.0.smithi115.stdout:2/167: dwrite d3/d5/dd/f2d [0,4194304] 0 2024-09-13T17:05:41.746 INFO:tasks.workunit.client.1.smithi195.stdout:4/160: dwrite d1a/d1f/f20 [0,4194304] 0 2024-09-13T17:05:41.747 INFO:tasks.workunit.client.1.smithi195.stdout:5/128: dwrite d2/d7/f16 [0,4194304] 0 2024-09-13T17:05:41.747 INFO:tasks.workunit.client.1.smithi195.stdout:2/104: dwrite d0/d3/df/f12 [4194304,4194304] 0 2024-09-13T17:05:41.748 INFO:tasks.workunit.client.1.smithi195.stdout:1/100: link f5 db/df/f26 0 2024-09-13T17:05:41.750 INFO:tasks.workunit.client.1.smithi195.stdout:9/107: dread d6/f1e [0,4194304] 0 2024-09-13T17:05:41.755 INFO:tasks.workunit.client.0.smithi115.stdout:2/168: unlink d3/d5/f9 0 2024-09-13T17:05:41.757 INFO:tasks.workunit.client.1.smithi195.stdout:8/106: mknod d0/d13/c21 0 2024-09-13T17:05:41.757 INFO:tasks.workunit.client.1.smithi195.stdout:8/107: chown d0/f8 553602 1 2024-09-13T17:05:41.757 INFO:tasks.workunit.client.1.smithi195.stdout:8/108: creat d0/f22 x:0 0 0 2024-09-13T17:05:41.757 INFO:tasks.workunit.client.1.smithi195.stdout:8/109: fsync d0/d4/fb 0 2024-09-13T17:05:41.762 INFO:tasks.workunit.client.0.smithi115.stdout:4/95: dread d7/fb [0,4194304] 0 2024-09-13T17:05:41.762 INFO:tasks.workunit.client.0.smithi115.stdout:4/96: write d7/dd/de/f17 [1513650,70370] 0 2024-09-13T17:05:41.763 INFO:tasks.workunit.client.0.smithi115.stdout:2/169: mkdir d3/d5/de/d3a 0 2024-09-13T17:05:41.764 INFO:tasks.workunit.client.1.smithi195.stdout:2/105: symlink d0/d3/df/l1f 0 2024-09-13T17:05:41.765 INFO:tasks.workunit.client.0.smithi115.stdout:2/170: creat d3/d5/d13/d39/f3b x:0 0 0 2024-09-13T17:05:41.765 INFO:tasks.workunit.client.0.smithi115.stdout:2/171: read - d3/d5/d13/d1c/f35 zero size 2024-09-13T17:05:41.768 INFO:tasks.workunit.client.1.smithi195.stdout:8/110: mknod d0/c23 0 2024-09-13T17:05:41.772 INFO:tasks.workunit.client.1.smithi195.stdout:8/111: rename d0/d13/c1f to d0/d13/c24 0 2024-09-13T17:05:41.772 INFO:tasks.workunit.client.1.smithi195.stdout:4/161: dread d1a/d1f/f20 [0,4194304] 0 2024-09-13T17:05:41.776 INFO:tasks.workunit.client.1.smithi195.stdout:8/112: symlink d0/d17/l25 0 2024-09-13T17:05:41.779 INFO:tasks.workunit.client.1.smithi195.stdout:7/156: dwrite f4 [0,4194304] 0 2024-09-13T17:05:41.779 INFO:tasks.workunit.client.1.smithi195.stdout:7/157: stat d5/f6 0 2024-09-13T17:05:41.781 INFO:tasks.workunit.client.1.smithi195.stdout:9/108: write d6/f7 [3710624,121581] 0 2024-09-13T17:05:41.781 INFO:tasks.workunit.client.1.smithi195.stdout:9/109: fsync d6/d19/f1f 0 2024-09-13T17:05:41.781 INFO:tasks.workunit.client.1.smithi195.stdout:9/110: stat d6/f7 0 2024-09-13T17:05:41.781 INFO:tasks.workunit.client.1.smithi195.stdout:5/129: dwrite d2/df/f1a [0,4194304] 0 2024-09-13T17:05:41.782 INFO:tasks.workunit.client.1.smithi195.stdout:5/130: truncate d2/d4/f2b 293069 0 2024-09-13T17:05:41.782 INFO:tasks.workunit.client.1.smithi195.stdout:7/158: creat d5/d13/d30/f34 x:0 0 0 2024-09-13T17:05:41.785 INFO:tasks.workunit.client.0.smithi115.stdout:6/43: sync 2024-09-13T17:05:41.785 INFO:tasks.workunit.client.1.smithi195.stdout:9/111: chown d6/cd 45823990 1 2024-09-13T17:05:41.785 INFO:tasks.workunit.client.1.smithi195.stdout:5/131: symlink d2/l2c 0 2024-09-13T17:05:41.786 INFO:tasks.workunit.client.1.smithi195.stdout:5/132: chown d2/df/fa 3038543 1 2024-09-13T17:05:41.787 INFO:tasks.workunit.client.0.smithi115.stdout:0/46: sync 2024-09-13T17:05:41.787 INFO:tasks.workunit.client.0.smithi115.stdout:7/24: sync 2024-09-13T17:05:41.787 INFO:tasks.workunit.client.0.smithi115.stdout:6/44: getdents d8 0 2024-09-13T17:05:41.787 INFO:tasks.workunit.client.0.smithi115.stdout:9/62: sync 2024-09-13T17:05:41.787 INFO:tasks.workunit.client.1.smithi195.stdout:7/159: mkdir d5/d35 0 2024-09-13T17:05:41.788 INFO:tasks.workunit.client.1.smithi195.stdout:6/92: dwrite fd [4194304,4194304] 0 2024-09-13T17:05:41.788 INFO:tasks.workunit.client.1.smithi195.stdout:6/93: creat f19 x:0 0 0 2024-09-13T17:05:41.788 INFO:tasks.workunit.client.1.smithi195.stdout:6/94: dread - f15 zero size 2024-09-13T17:05:41.790 INFO:tasks.workunit.client.0.smithi115.stdout:1/43: sync 2024-09-13T17:05:41.790 INFO:tasks.workunit.client.0.smithi115.stdout:8/70: sync 2024-09-13T17:05:41.790 INFO:tasks.workunit.client.0.smithi115.stdout:5/86: sync 2024-09-13T17:05:41.790 INFO:tasks.workunit.client.0.smithi115.stdout:5/87: chown fd 681183 1 2024-09-13T17:05:41.791 INFO:tasks.workunit.client.1.smithi195.stdout:9/112: creat d6/d12/f2a x:0 0 0 2024-09-13T17:05:41.791 INFO:tasks.workunit.client.1.smithi195.stdout:9/113: write d6/df/f27 [1033545,38233] 0 2024-09-13T17:05:41.791 INFO:tasks.workunit.client.0.smithi115.stdout:9/63: creat d0/de/f18 x:0 0 0 2024-09-13T17:05:41.792 INFO:tasks.workunit.client.0.smithi115.stdout:2/172: read d3/d5/dd/df/f24 [506264,115113] 0 2024-09-13T17:05:41.793 INFO:tasks.workunit.client.1.smithi195.stdout:3/101: dwrite d7/f14 [0,4194304] 0 2024-09-13T17:05:41.793 INFO:tasks.workunit.client.1.smithi195.stdout:3/102: chown d7/f12 6968 1 2024-09-13T17:05:41.794 INFO:tasks.workunit.client.1.smithi195.stdout:5/133: creat d2/d4/d11/f2d x:0 0 0 2024-09-13T17:05:41.794 INFO:tasks.workunit.client.1.smithi195.stdout:5/134: truncate d2/d4/d11/f2d 62002 0 2024-09-13T17:05:41.796 INFO:tasks.workunit.client.0.smithi115.stdout:1/44: symlink d5/d7/le 0 2024-09-13T17:05:41.797 INFO:tasks.workunit.client.0.smithi115.stdout:8/71: unlink d0/fd 0 2024-09-13T17:05:41.798 INFO:tasks.workunit.client.1.smithi195.stdout:1/101: dwrite db/f18 [0,4194304] 0 2024-09-13T17:05:41.798 INFO:tasks.workunit.client.1.smithi195.stdout:1/102: creat db/df/d13/f27 x:0 0 0 2024-09-13T17:05:41.798 INFO:tasks.workunit.client.0.smithi115.stdout:2/173: symlink d3/d5/dd/df/d22/l3c 0 2024-09-13T17:05:41.798 INFO:tasks.workunit.client.0.smithi115.stdout:2/174: fdatasync d3/d5/fa 0 2024-09-13T17:05:41.799 INFO:tasks.workunit.client.1.smithi195.stdout:9/114: rmdir d6/df/d16 39 2024-09-13T17:05:41.802 INFO:tasks.workunit.client.0.smithi115.stdout:2/175: symlink d3/d5/d13/d1c/l3d 0 2024-09-13T17:05:41.810 INFO:tasks.workunit.client.1.smithi195.stdout:7/160: read f4 [5755080,8890] 0 2024-09-13T17:05:41.811 INFO:tasks.workunit.client.0.smithi115.stdout:2/176: symlink d3/l3e 0 2024-09-13T17:05:41.815 INFO:tasks.workunit.client.1.smithi195.stdout:9/115: write d6/f18 [3091172,43502] 0 2024-09-13T17:05:41.815 INFO:tasks.workunit.client.1.smithi195.stdout:8/113: dwrite d0/f8 [0,4194304] 0 2024-09-13T17:05:41.815 INFO:tasks.workunit.client.1.smithi195.stdout:8/114: dread - d0/d17/f1b zero size 2024-09-13T17:05:41.815 INFO:tasks.workunit.client.1.smithi195.stdout:8/115: write d0/d17/f1d [2887106,96777] 0 2024-09-13T17:05:41.815 INFO:tasks.workunit.client.1.smithi195.stdout:4/162: dwrite fa [0,4194304] 0 2024-09-13T17:05:41.815 INFO:tasks.workunit.client.1.smithi195.stdout:3/103: rename d7/c9 to d7/c16 0 2024-09-13T17:05:41.816 INFO:tasks.workunit.client.1.smithi195.stdout:7/161: getdents d5/d13 0 2024-09-13T17:05:41.817 INFO:tasks.workunit.client.1.smithi195.stdout:8/116: symlink d0/d13/l26 0 2024-09-13T17:05:41.818 INFO:tasks.workunit.client.1.smithi195.stdout:8/117: truncate d0/f22 169384 0 2024-09-13T17:05:41.818 INFO:tasks.workunit.client.1.smithi195.stdout:8/118: fdatasync d0/f8 0 2024-09-13T17:05:41.818 INFO:tasks.workunit.client.1.smithi195.stdout:8/119: write d0/f3 [2076852,62761] 0 2024-09-13T17:05:41.818 INFO:tasks.workunit.client.1.smithi195.stdout:7/162: write d5/d13/f32 [104102,31300] 0 2024-09-13T17:05:41.819 INFO:tasks.workunit.client.0.smithi115.stdout:6/45: write f5 [2757649,74017] 0 2024-09-13T17:05:41.819 INFO:tasks.workunit.client.0.smithi115.stdout:6/46: fsync f3 0 2024-09-13T17:05:41.820 INFO:tasks.workunit.client.1.smithi195.stdout:2/106: dwrite d0/d3/df/f12 [4194304,4194304] 0 2024-09-13T17:05:41.821 INFO:tasks.workunit.client.1.smithi195.stdout:2/107: write d0/d3/fe [1651653,56230] 0 2024-09-13T17:05:41.823 INFO:tasks.workunit.client.0.smithi115.stdout:7/25: write d0/f1 [1899969,24465] 0 2024-09-13T17:05:41.823 INFO:tasks.workunit.client.0.smithi115.stdout:4/97: dwrite d7/f19 [4194304,4194304] 0 2024-09-13T17:05:41.823 INFO:tasks.workunit.client.0.smithi115.stdout:4/98: fdatasync d7/dd/ff 0 2024-09-13T17:05:41.823 INFO:tasks.workunit.client.0.smithi115.stdout:5/88: dwrite f10 [0,4194304] 0 2024-09-13T17:05:41.823 INFO:tasks.workunit.client.0.smithi115.stdout:5/89: truncate f10 5000316 0 2024-09-13T17:05:41.823 INFO:tasks.workunit.client.0.smithi115.stdout:5/90: dread - f5 zero size 2024-09-13T17:05:41.824 INFO:tasks.workunit.client.1.smithi195.stdout:8/120: unlink d0/f22 0 2024-09-13T17:05:41.825 INFO:tasks.workunit.client.0.smithi115.stdout:6/47: creat d8/d9/fc x:0 0 0 2024-09-13T17:05:41.828 INFO:tasks.workunit.client.0.smithi115.stdout:0/47: dwrite f5 [0,4194304] 0 2024-09-13T17:05:41.830 INFO:tasks.workunit.client.1.smithi195.stdout:9/116: write d6/df/d13/f29 [2366316,48636] 0 2024-09-13T17:05:41.830 INFO:tasks.workunit.client.1.smithi195.stdout:9/117: read d6/f1e [134341,21921] 0 2024-09-13T17:05:41.830 INFO:tasks.workunit.client.1.smithi195.stdout:9/118: stat d6/d19/d21 0 2024-09-13T17:05:41.831 INFO:tasks.workunit.client.1.smithi195.stdout:9/119: truncate d6/d12/f2a 614526 0 2024-09-13T17:05:41.831 INFO:tasks.workunit.client.1.smithi195.stdout:3/104: link d7/lb d7/l17 0 2024-09-13T17:05:41.831 INFO:tasks.workunit.client.0.smithi115.stdout:8/72: rmdir d0 39 2024-09-13T17:05:41.831 INFO:tasks.workunit.client.1.smithi195.stdout:7/163: dread d5/db/d19/f18 [0,4194304] 0 2024-09-13T17:05:41.832 INFO:tasks.workunit.client.1.smithi195.stdout:8/121: dread d0/d4/fb [0,4194304] 0 2024-09-13T17:05:41.832 INFO:tasks.workunit.client.1.smithi195.stdout:7/164: dread - d5/db/f2c zero size 2024-09-13T17:05:41.832 INFO:tasks.workunit.client.1.smithi195.stdout:8/122: chown d0/d17/l1e 17869837 1 2024-09-13T17:05:41.832 INFO:tasks.workunit.client.1.smithi195.stdout:7/165: creat d5/d13/d30/f36 x:0 0 0 2024-09-13T17:05:41.832 INFO:tasks.workunit.client.0.smithi115.stdout:7/26: mknod d0/c5 0 2024-09-13T17:05:41.833 INFO:tasks.workunit.client.0.smithi115.stdout:4/99: mknod d7/dd/de/c1a 0 2024-09-13T17:05:41.833 INFO:tasks.workunit.client.0.smithi115.stdout:4/100: write d7/dd/de/f14 [726205,121038] 0 2024-09-13T17:05:41.835 INFO:tasks.workunit.client.1.smithi195.stdout:2/108: rename d0/d3/df/f12 to d0/d3/df/f20 0 2024-09-13T17:05:41.835 INFO:tasks.workunit.client.0.smithi115.stdout:5/91: mkdir d19/d21 0 2024-09-13T17:05:41.836 INFO:tasks.workunit.client.1.smithi195.stdout:2/109: dread d0/d1a/d1c/d1e/f19 [0,4194304] 0 2024-09-13T17:05:41.836 INFO:tasks.workunit.client.1.smithi195.stdout:2/110: stat d0/d1a/d1c/d1e/f19 0 2024-09-13T17:05:41.836 INFO:tasks.workunit.client.1.smithi195.stdout:2/111: dread - d0/d1a/fc zero size 2024-09-13T17:05:41.838 INFO:tasks.workunit.client.1.smithi195.stdout:5/135: dwrite d2/df/f1c [0,4194304] 0 2024-09-13T17:05:41.838 INFO:tasks.workunit.client.1.smithi195.stdout:5/136: creat d2/f2e x:0 0 0 2024-09-13T17:05:41.839 INFO:tasks.workunit.client.1.smithi195.stdout:5/137: write d2/d4/f5 [4421485,81521] 0 2024-09-13T17:05:41.839 INFO:tasks.workunit.client.1.smithi195.stdout:5/138: dread - d2/f2e zero size 2024-09-13T17:05:41.839 INFO:tasks.workunit.client.1.smithi195.stdout:9/120: rename d6/df/d13/f29 to d6/d12/f2b 0 2024-09-13T17:05:41.841 INFO:tasks.workunit.client.0.smithi115.stdout:8/73: symlink d0/l14 0 2024-09-13T17:05:41.841 INFO:tasks.workunit.client.0.smithi115.stdout:8/74: write d0/fb [258334,2128] 0 2024-09-13T17:05:41.841 INFO:tasks.workunit.client.0.smithi115.stdout:8/75: write d0/f13 [516120,51584] 0 2024-09-13T17:05:41.842 INFO:tasks.workunit.client.1.smithi195.stdout:8/123: symlink d0/d4/l27 0 2024-09-13T17:05:41.843 INFO:tasks.workunit.client.1.smithi195.stdout:8/124: write d0/f20 [513912,123654] 0 2024-09-13T17:05:41.843 INFO:tasks.workunit.client.0.smithi115.stdout:9/64: dwrite d0/f3 [4194304,4194304] 0 2024-09-13T17:05:41.843 INFO:tasks.workunit.client.0.smithi115.stdout:7/27: mknod d0/c6 0 2024-09-13T17:05:41.844 INFO:tasks.workunit.client.1.smithi195.stdout:6/95: dwrite f19 [0,4194304] 0 2024-09-13T17:05:41.846 INFO:tasks.workunit.client.0.smithi115.stdout:4/101: symlink d7/dd/de/l1b 0 2024-09-13T17:05:41.846 INFO:tasks.workunit.client.0.smithi115.stdout:4/102: fsync d7/fa 0 2024-09-13T17:05:41.846 INFO:tasks.workunit.client.0.smithi115.stdout:4/103: write d7/f12 [794743,30347] 0 2024-09-13T17:05:41.846 INFO:tasks.workunit.client.0.smithi115.stdout:4/104: readlink d7/dd/de/l1b 0 2024-09-13T17:05:41.846 INFO:tasks.workunit.client.1.smithi195.stdout:4/163: truncate f8 3915815 0 2024-09-13T17:05:41.847 INFO:tasks.workunit.client.0.smithi115.stdout:1/45: dwrite d5/fa [0,4194304] 0 2024-09-13T17:05:41.847 INFO:tasks.workunit.client.0.smithi115.stdout:2/177: dwrite d3/d5/dd/df/f28 [0,4194304] 0 2024-09-13T17:05:41.848 INFO:tasks.workunit.client.1.smithi195.stdout:7/166: mkdir d5/d35/d37 0 2024-09-13T17:05:41.849 INFO:tasks.workunit.client.1.smithi195.stdout:2/112: dread d0/d3/fe [0,4194304] 0 2024-09-13T17:05:41.849 INFO:tasks.workunit.client.1.smithi195.stdout:2/113: chown d0/d1a 528921 1 2024-09-13T17:05:41.853 INFO:tasks.workunit.client.0.smithi115.stdout:6/48: getdents d8/d9 0 2024-09-13T17:05:41.856 INFO:tasks.workunit.client.0.smithi115.stdout:0/48: mkdir d9 0 2024-09-13T17:05:41.858 INFO:tasks.workunit.client.0.smithi115.stdout:8/76: mkdir d0/d15 0 2024-09-13T17:05:41.859 INFO:tasks.workunit.client.0.smithi115.stdout:0/49: dread f0 [0,4194304] 0 2024-09-13T17:05:41.865 INFO:tasks.workunit.client.1.smithi195.stdout:5/139: rename d2/d4/f5 to d2/d4/d10/f2f 0 2024-09-13T17:05:41.865 INFO:tasks.workunit.client.1.smithi195.stdout:5/140: truncate d2/d4/d10/f24 811321 0 2024-09-13T17:05:41.868 INFO:tasks.workunit.client.1.smithi195.stdout:3/105: symlink d7/l18 0 2024-09-13T17:05:41.870 INFO:tasks.workunit.client.1.smithi195.stdout:9/121: dwrite d6/f1e [0,4194304] 0 2024-09-13T17:05:41.871 INFO:tasks.workunit.client.1.smithi195.stdout:9/122: write d6/f18 [4963573,4252] 0 2024-09-13T17:05:41.871 INFO:tasks.workunit.client.1.smithi195.stdout:9/123: readlink d6/d19/d21/l24 0 2024-09-13T17:05:41.876 INFO:tasks.workunit.client.1.smithi195.stdout:9/124: write d6/d19/f1f [2528978,82438] 0 2024-09-13T17:05:41.876 INFO:tasks.workunit.client.1.smithi195.stdout:6/96: unlink c11 0 2024-09-13T17:05:41.876 INFO:tasks.workunit.client.1.smithi195.stdout:6/97: readlink l3 0 2024-09-13T17:05:41.876 INFO:tasks.workunit.client.1.smithi195.stdout:6/98: chown c4 831246583 1 2024-09-13T17:05:41.876 INFO:tasks.workunit.client.1.smithi195.stdout:6/99: stat f18 0 2024-09-13T17:05:41.876 INFO:tasks.workunit.client.1.smithi195.stdout:6/100: creat f1a x:0 0 0 2024-09-13T17:05:41.876 INFO:tasks.workunit.client.1.smithi195.stdout:6/101: chown f14 39188 1 2024-09-13T17:05:41.880 INFO:tasks.workunit.client.1.smithi195.stdout:8/125: dwrite d0/d13/f16 [4194304,4194304] 0 2024-09-13T17:05:41.882 INFO:tasks.workunit.client.0.smithi115.stdout:0/50: dwrite f5 [0,4194304] 0 2024-09-13T17:05:41.882 INFO:tasks.workunit.client.1.smithi195.stdout:4/164: dwrite f12 [0,4194304] 0 2024-09-13T17:05:41.882 INFO:tasks.workunit.client.1.smithi195.stdout:3/106: write d7/f12 [1340764,92207] 0 2024-09-13T17:05:41.885 INFO:tasks.workunit.client.1.smithi195.stdout:7/167: dwrite d5/d13/d24/f2d [0,4194304] 0 2024-09-13T17:05:41.885 INFO:tasks.workunit.client.1.smithi195.stdout:7/168: read d5/db/fc [296076,124957] 0 2024-09-13T17:05:41.885 INFO:tasks.workunit.client.1.smithi195.stdout:7/169: chown d5/c23 2773 1 2024-09-13T17:05:41.885 INFO:tasks.workunit.client.1.smithi195.stdout:7/170: dread - d5/db/d19/f33 zero size 2024-09-13T17:05:41.886 INFO:tasks.workunit.client.0.smithi115.stdout:9/65: link d0/de/d10/d15/f17 d0/de/d10/d15/f19 0 2024-09-13T17:05:41.887 INFO:tasks.workunit.client.1.smithi195.stdout:7/171: dread d5/d13/f32 [0,4194304] 0 2024-09-13T17:05:41.891 INFO:tasks.workunit.client.0.smithi115.stdout:6/49: dwrite f6 [0,4194304] 0 2024-09-13T17:05:41.891 INFO:tasks.workunit.client.0.smithi115.stdout:4/105: link d7/dd/de/f13 d7/dd/de/f1c 0 2024-09-13T17:05:41.895 INFO:tasks.workunit.client.0.smithi115.stdout:1/46: creat d5/d7/ff x:0 0 0 2024-09-13T17:05:41.899 INFO:tasks.workunit.client.1.smithi195.stdout:9/125: dwrite d6/df/f27 [0,4194304] 0 2024-09-13T17:05:41.899 INFO:tasks.workunit.client.1.smithi195.stdout:5/141: link d2/d4/cc d2/d12/c30 0 2024-09-13T17:05:41.900 INFO:tasks.workunit.client.0.smithi115.stdout:2/178: link d3/d5/dd/l30 d3/l3f 0 2024-09-13T17:05:41.900 INFO:tasks.workunit.client.0.smithi115.stdout:2/179: stat d3/d5/de 0 2024-09-13T17:05:41.901 INFO:tasks.workunit.client.0.smithi115.stdout:5/92: getdents d19 0 2024-09-13T17:05:41.901 INFO:tasks.workunit.client.0.smithi115.stdout:5/93: chown fe 45432 1 2024-09-13T17:05:41.904 INFO:tasks.workunit.client.0.smithi115.stdout:8/77: symlink d0/l16 0 2024-09-13T17:05:41.906 INFO:tasks.workunit.client.0.smithi115.stdout:7/28: truncate d0/f1 536643 0 2024-09-13T17:05:41.907 INFO:tasks.workunit.client.1.smithi195.stdout:6/102: symlink l1b 0 2024-09-13T17:05:41.907 INFO:tasks.workunit.client.0.smithi115.stdout:6/50: mkdir d8/db/dd 0 2024-09-13T17:05:41.907 INFO:tasks.workunit.client.0.smithi115.stdout:6/51: readlink l2 0 2024-09-13T17:05:41.908 INFO:tasks.workunit.client.0.smithi115.stdout:0/51: dwrite f0 [0,4194304] 0 2024-09-13T17:05:41.909 INFO:tasks.workunit.client.0.smithi115.stdout:4/106: mknod d7/dd/de/c1d 0 2024-09-13T17:05:41.910 INFO:tasks.workunit.client.0.smithi115.stdout:1/47: creat d5/f10 x:0 0 0 2024-09-13T17:05:41.913 INFO:tasks.workunit.client.0.smithi115.stdout:9/66: dwrite d0/de/f18 [0,4194304] 0 2024-09-13T17:05:41.913 INFO:tasks.workunit.client.0.smithi115.stdout:9/67: creat d0/de/f1a x:0 0 0 2024-09-13T17:05:41.914 INFO:tasks.workunit.client.0.smithi115.stdout:5/94: link d19/d1d/f20 d19/d21/f22 0 2024-09-13T17:05:41.914 INFO:tasks.workunit.client.0.smithi115.stdout:5/95: chown fd 23514383 1 2024-09-13T17:05:41.914 INFO:tasks.workunit.client.0.smithi115.stdout:5/96: chown c15 88 1 2024-09-13T17:05:41.916 INFO:tasks.workunit.client.0.smithi115.stdout:8/78: rename d0/l14 to d0/d15/l17 0 2024-09-13T17:05:41.917 INFO:tasks.workunit.client.0.smithi115.stdout:5/97: dread fd [0,4194304] 0 2024-09-13T17:05:41.917 INFO:tasks.workunit.client.0.smithi115.stdout:5/98: truncate f5 417574 0 2024-09-13T17:05:41.918 INFO:tasks.workunit.client.0.smithi115.stdout:5/99: write f8 [1046206,87057] 0 2024-09-13T17:05:41.919 INFO:tasks.workunit.client.0.smithi115.stdout:5/100: dread f5 [0,4194304] 0 2024-09-13T17:05:41.919 INFO:tasks.workunit.client.0.smithi115.stdout:2/180: dwrite d3/d5/d13/d39/f3b [0,4194304] 0 2024-09-13T17:05:41.919 INFO:tasks.workunit.client.0.smithi115.stdout:5/101: readlink lb 0 2024-09-13T17:05:41.919 INFO:tasks.workunit.client.0.smithi115.stdout:2/181: chown d3/l3f 85250 1 2024-09-13T17:05:41.919 INFO:tasks.workunit.client.0.smithi115.stdout:2/182: readlink d3/l3f 0 2024-09-13T17:05:41.919 INFO:tasks.workunit.client.0.smithi115.stdout:2/183: chown d3/d5/dd/df/d22/f2b 14 1 2024-09-13T17:05:41.919 INFO:tasks.workunit.client.0.smithi115.stdout:2/184: readlink d3/l3f 0 2024-09-13T17:05:41.919 INFO:tasks.workunit.client.0.smithi115.stdout:7/29: mkdir d0/d2/d7 0 2024-09-13T17:05:41.921 INFO:tasks.workunit.client.0.smithi115.stdout:5/102: read f8 [476095,126909] 0 2024-09-13T17:05:41.921 INFO:tasks.workunit.client.0.smithi115.stdout:5/103: stat f10 0 2024-09-13T17:05:41.922 INFO:tasks.workunit.client.1.smithi195.stdout:8/126: mknod d0/d4/c28 0 2024-09-13T17:05:41.923 INFO:tasks.workunit.client.0.smithi115.stdout:6/52: mkdir d8/d9/de 0 2024-09-13T17:05:41.923 INFO:tasks.workunit.client.0.smithi115.stdout:6/53: getdents d8 0 2024-09-13T17:05:41.924 INFO:tasks.workunit.client.1.smithi195.stdout:4/165: chown f5 0 1 2024-09-13T17:05:41.924 INFO:tasks.workunit.client.1.smithi195.stdout:4/166: chown f8 18336784 1 2024-09-13T17:05:41.925 INFO:tasks.workunit.client.0.smithi115.stdout:0/52: creat d9/fa x:0 0 0 2024-09-13T17:05:41.925 INFO:tasks.workunit.client.0.smithi115.stdout:0/53: creat d9/fb x:0 0 0 2024-09-13T17:05:41.927 INFO:tasks.workunit.client.0.smithi115.stdout:4/107: dwrite f5 [0,4194304] 0 2024-09-13T17:05:41.927 INFO:tasks.workunit.client.0.smithi115.stdout:1/48: symlink d5/l11 0 2024-09-13T17:05:41.933 INFO:tasks.workunit.client.0.smithi115.stdout:6/54: write f3 [2712255,6789] 0 2024-09-13T17:05:41.933 INFO:tasks.workunit.client.0.smithi115.stdout:8/79: dwrite d0/fc [0,4194304] 0 2024-09-13T17:05:41.939 INFO:tasks.workunit.client.0.smithi115.stdout:9/68: link d0/f16 d0/de/d10/f1b 0 2024-09-13T17:05:41.940 INFO:tasks.workunit.client.0.smithi115.stdout:9/69: readlink d0/lf 0 2024-09-13T17:05:41.941 INFO:tasks.workunit.client.0.smithi115.stdout:7/30: dread d0/f1 [0,4194304] 0 2024-09-13T17:05:41.942 INFO:tasks.workunit.client.1.smithi195.stdout:2/114: rename d0/d1a/fc to d0/f21 0 2024-09-13T17:05:41.942 INFO:tasks.workunit.client.1.smithi195.stdout:0/119: sync 2024-09-13T17:05:41.943 INFO:tasks.workunit.client.1.smithi195.stdout:8/127: dwrite d0/d17/f1d [0,4194304] 0 2024-09-13T17:05:41.947 INFO:tasks.workunit.client.0.smithi115.stdout:2/185: truncate d3/d5/dd/f2d 473861 0 2024-09-13T17:05:41.948 INFO:tasks.workunit.client.1.smithi195.stdout:9/126: creat d6/df/d16/f2c x:0 0 0 2024-09-13T17:05:41.949 INFO:tasks.workunit.client.0.smithi115.stdout:1/49: dwrite d5/f6 [0,4194304] 0 2024-09-13T17:05:41.949 INFO:tasks.workunit.client.0.smithi115.stdout:1/50: chown d5 252 1 2024-09-13T17:05:41.949 INFO:tasks.workunit.client.0.smithi115.stdout:1/51: write d5/f10 [68254,20703] 0 2024-09-13T17:05:41.953 INFO:tasks.workunit.client.0.smithi115.stdout:5/104: mknod d19/c23 0 2024-09-13T17:05:41.953 INFO:tasks.workunit.client.0.smithi115.stdout:5/105: stat f14 0 2024-09-13T17:05:41.953 INFO:tasks.workunit.client.1.smithi195.stdout:5/142: mknod d2/d7/c31 0 2024-09-13T17:05:41.954 INFO:tasks.workunit.client.0.smithi115.stdout:9/70: write d0/f6 [6961478,109916] 0 2024-09-13T17:05:41.954 INFO:tasks.workunit.client.1.smithi195.stdout:6/103: mkdir d1c 0 2024-09-13T17:05:41.955 INFO:tasks.workunit.client.1.smithi195.stdout:8/128: read d0/d17/f1d [4139460,92247] 0 2024-09-13T17:05:41.955 INFO:tasks.workunit.client.1.smithi195.stdout:4/167: truncate fd 316445 0 2024-09-13T17:05:41.957 INFO:tasks.workunit.client.0.smithi115.stdout:0/54: rename f5 to d9/fc 0 2024-09-13T17:05:41.959 INFO:tasks.workunit.client.1.smithi195.stdout:3/107: mkdir d7/d19 0 2024-09-13T17:05:41.959 INFO:tasks.workunit.client.1.smithi195.stdout:3/108: write d7/f15 [794947,111312] 0 2024-09-13T17:05:41.959 INFO:tasks.workunit.client.1.smithi195.stdout:3/109: getdents d7/d19 0 2024-09-13T17:05:41.959 INFO:tasks.workunit.client.1.smithi195.stdout:3/110: write d7/f12 [2166479,12185] 0 2024-09-13T17:05:41.959 INFO:tasks.workunit.client.1.smithi195.stdout:3/111: chown d7/f14 1255819 1 2024-09-13T17:05:41.959 INFO:tasks.workunit.client.1.smithi195.stdout:1/103: sync 2024-09-13T17:05:41.964 INFO:tasks.workunit.client.0.smithi115.stdout:7/31: dwrite d0/f1 [0,4194304] 0 2024-09-13T17:05:41.965 INFO:tasks.workunit.client.0.smithi115.stdout:4/108: unlink d7/dd/ff 0 2024-09-13T17:05:41.968 INFO:tasks.workunit.client.1.smithi195.stdout:2/115: creat d0/f22 x:0 0 0 2024-09-13T17:05:41.970 INFO:tasks.workunit.client.1.smithi195.stdout:6/104: mknod d1c/c1d 0 2024-09-13T17:05:41.970 INFO:tasks.workunit.client.1.smithi195.stdout:6/105: fsync ff 0 2024-09-13T17:05:41.973 INFO:tasks.workunit.client.0.smithi115.stdout:8/80: truncate d0/fb 324278 0 2024-09-13T17:05:41.975 INFO:tasks.workunit.client.0.smithi115.stdout:2/186: getdents d3/d5/dd 0 2024-09-13T17:05:41.975 INFO:tasks.workunit.client.0.smithi115.stdout:2/187: write d3/d5/dd/df/d22/f34 [994079,105166] 0 2024-09-13T17:05:41.975 INFO:tasks.workunit.client.1.smithi195.stdout:8/129: rmdir d0/d13 39 2024-09-13T17:05:41.975 INFO:tasks.workunit.client.1.smithi195.stdout:8/130: truncate d0/fc 997301 0 2024-09-13T17:05:41.975 INFO:tasks.workunit.client.1.smithi195.stdout:8/131: write d0/f8 [4799033,36241] 0 2024-09-13T17:05:41.976 INFO:tasks.workunit.client.1.smithi195.stdout:3/112: read d7/f14 [1814988,81156] 0 2024-09-13T17:05:41.976 INFO:tasks.workunit.client.1.smithi195.stdout:7/172: rename d5/d13/d24/f2d to d5/db/d19/d22/f38 0 2024-09-13T17:05:41.976 INFO:tasks.workunit.client.1.smithi195.stdout:7/173: write d5/d13/d30/f34 [601388,50537] 0 2024-09-13T17:05:41.977 INFO:tasks.workunit.client.0.smithi115.stdout:1/52: dwrite d5/f10 [0,4194304] 0 2024-09-13T17:05:41.977 INFO:tasks.workunit.client.0.smithi115.stdout:1/53: write d5/fb [346018,90228] 0 2024-09-13T17:05:41.977 INFO:tasks.workunit.client.0.smithi115.stdout:1/54: creat d5/d7/f12 x:0 0 0 2024-09-13T17:05:41.977 INFO:tasks.workunit.client.0.smithi115.stdout:1/55: creat d5/d7/f13 x:0 0 0 2024-09-13T17:05:41.978 INFO:tasks.workunit.client.0.smithi115.stdout:1/56: readlink l3 0 2024-09-13T17:05:41.978 INFO:tasks.workunit.client.0.smithi115.stdout:1/57: creat d5/f14 x:0 0 0 2024-09-13T17:05:41.978 INFO:tasks.workunit.client.1.smithi195.stdout:5/143: dwrite d2/d4/d10/f28 [0,4194304] 0 2024-09-13T17:05:41.979 INFO:tasks.workunit.client.1.smithi195.stdout:5/144: dread d2/d4/f2b [0,4194304] 0 2024-09-13T17:05:41.979 INFO:tasks.workunit.client.1.smithi195.stdout:5/145: chown d2/d4/c6 1267579 1 2024-09-13T17:05:41.979 INFO:tasks.workunit.client.1.smithi195.stdout:2/116: creat d0/d1a/d1c/f23 x:0 0 0 2024-09-13T17:05:41.979 INFO:tasks.workunit.client.1.smithi195.stdout:2/117: fdatasync d0/d3/fe 0 2024-09-13T17:05:41.979 INFO:tasks.workunit.client.1.smithi195.stdout:4/168: dwrite f13 [0,4194304] 0 2024-09-13T17:05:41.980 INFO:tasks.workunit.client.1.smithi195.stdout:6/106: creat d1c/f1e x:0 0 0 2024-09-13T17:05:41.980 INFO:tasks.workunit.client.1.smithi195.stdout:6/107: dread - d1c/f1e zero size 2024-09-13T17:05:41.986 INFO:tasks.workunit.client.1.smithi195.stdout:0/120: rename d7/d8/f14 to d7/d8/d16/f1b 0 2024-09-13T17:05:41.986 INFO:tasks.workunit.client.1.smithi195.stdout:0/121: truncate d7/d8/f15 99484 0 2024-09-13T17:05:41.987 INFO:tasks.workunit.client.1.smithi195.stdout:7/174: symlink d5/d13/d30/l39 0 2024-09-13T17:05:41.987 INFO:tasks.workunit.client.1.smithi195.stdout:7/175: write f4 [6198072,65583] 0 2024-09-13T17:05:41.987 INFO:tasks.workunit.client.1.smithi195.stdout:7/176: stat d5/f6 0 2024-09-13T17:05:41.987 INFO:tasks.workunit.client.1.smithi195.stdout:7/177: fdatasync d5/db/d19/f33 0 2024-09-13T17:05:41.989 INFO:tasks.workunit.client.0.smithi115.stdout:5/106: mknod d19/d1d/c24 0 2024-09-13T17:05:41.991 INFO:tasks.workunit.client.0.smithi115.stdout:9/71: unlink d0/f6 0 2024-09-13T17:05:41.991 INFO:tasks.workunit.client.0.smithi115.stdout:9/72: write d0/de/d10/f1b [260465,5326] 0 2024-09-13T17:05:41.992 INFO:tasks.workunit.client.0.smithi115.stdout:6/55: rename f3 to d8/db/ff 0 2024-09-13T17:05:41.994 INFO:tasks.workunit.client.1.smithi195.stdout:2/118: creat d0/f24 x:0 0 0 2024-09-13T17:05:41.996 INFO:tasks.workunit.client.0.smithi115.stdout:4/109: link d7/dd/de/f13 d7/dd/f1e 0 2024-09-13T17:05:41.997 INFO:tasks.workunit.client.0.smithi115.stdout:8/81: stat d0/c7 0 2024-09-13T17:05:41.997 INFO:tasks.workunit.client.0.smithi115.stdout:8/82: fdatasync d0/fc 0 2024-09-13T17:05:41.998 INFO:tasks.workunit.client.1.smithi195.stdout:8/132: dwrite d0/f8 [4194304,4194304] 0 2024-09-13T17:05:41.998 INFO:tasks.workunit.client.1.smithi195.stdout:4/169: creat d1a/d1f/d23/d29/f38 x:0 0 0 2024-09-13T17:05:41.999 INFO:tasks.workunit.client.1.smithi195.stdout:6/108: mknod d1c/c1f 0 2024-09-13T17:05:42.000 INFO:tasks.workunit.client.1.smithi195.stdout:5/146: dwrite d2/df/fa [4194304,4194304] 0 2024-09-13T17:05:42.001 INFO:tasks.workunit.client.1.smithi195.stdout:3/113: rename d7/l18 to d7/l1a 0 2024-09-13T17:05:42.003 INFO:tasks.workunit.client.1.smithi195.stdout:0/122: fsync f1 0 2024-09-13T17:05:42.003 INFO:tasks.workunit.client.1.smithi195.stdout:0/123: stat d7/db 0 2024-09-13T17:05:42.003 INFO:tasks.workunit.client.1.smithi195.stdout:7/178: rmdir d5/d35 39 2024-09-13T17:05:42.005 INFO:tasks.workunit.client.1.smithi195.stdout:2/119: link d0/d3/df/f20 d0/d1a/d1c/d1e/f25 0 2024-09-13T17:05:42.005 INFO:tasks.workunit.client.1.smithi195.stdout:2/120: stat d0/d1a/d1c/f23 0 2024-09-13T17:05:42.006 INFO:tasks.workunit.client.1.smithi195.stdout:2/121: dread d0/d1a/d1c/d1e/f19 [0,4194304] 0 2024-09-13T17:05:42.006 INFO:tasks.workunit.client.1.smithi195.stdout:8/133: mknod d0/c29 0 2024-09-13T17:05:42.006 INFO:tasks.workunit.client.1.smithi195.stdout:8/134: read d0/f20 [214367,55231] 0 2024-09-13T17:05:42.008 INFO:tasks.workunit.client.0.smithi115.stdout:5/107: unlink d19/c23 0 2024-09-13T17:05:42.012 INFO:tasks.workunit.client.0.smithi115.stdout:5/108: dread fc [0,4194304] 0 2024-09-13T17:05:42.014 INFO:tasks.workunit.client.1.smithi195.stdout:0/124: dread d7/d8/d16/f1b [0,4194304] 0 2024-09-13T17:05:42.014 INFO:tasks.workunit.client.0.smithi115.stdout:2/188: rename d3/d5/d13/d1c/f35 to d3/f40 0 2024-09-13T17:05:42.016 INFO:tasks.workunit.client.0.smithi115.stdout:6/56: mknod d8/c10 0 2024-09-13T17:05:42.018 INFO:tasks.workunit.client.0.smithi115.stdout:0/55: getdents d9 0 2024-09-13T17:05:42.019 INFO:tasks.workunit.client.0.smithi115.stdout:3/275: sync 2024-09-13T17:05:42.019 INFO:tasks.workunit.client.0.smithi115.stdout:3/276: write d1/f1d [3741210,123352] 0 2024-09-13T17:05:42.019 INFO:tasks.workunit.client.0.smithi115.stdout:3/277: readlink d1/d4b/d1a/d30/l58 0 2024-09-13T17:05:42.020 INFO:tasks.workunit.client.1.smithi195.stdout:7/179: mknod d5/db/c3a 0 2024-09-13T17:05:42.020 INFO:tasks.workunit.client.0.smithi115.stdout:7/32: rmdir d0 39 2024-09-13T17:05:42.022 INFO:tasks.workunit.client.1.smithi195.stdout:2/122: creat d0/d3/f26 x:0 0 0 2024-09-13T17:05:42.022 INFO:tasks.workunit.client.1.smithi195.stdout:2/123: read - d0/d1a/d1c/f23 zero size 2024-09-13T17:05:42.023 INFO:tasks.workunit.client.0.smithi115.stdout:4/110: mknod d7/dd/c1f 0 2024-09-13T17:05:42.023 INFO:tasks.workunit.client.0.smithi115.stdout:4/111: readlink l2 0 2024-09-13T17:05:42.025 INFO:tasks.workunit.client.1.smithi195.stdout:5/147: dwrite d2/f17 [0,4194304] 0 2024-09-13T17:05:42.025 INFO:tasks.workunit.client.1.smithi195.stdout:6/109: getdents d1c 0 2024-09-13T17:05:42.025 INFO:tasks.workunit.client.0.smithi115.stdout:8/83: getdents d0/d15 0 2024-09-13T17:05:42.028 INFO:tasks.workunit.client.0.smithi115.stdout:1/58: unlink d5/d7/f12 0 2024-09-13T17:05:42.029 INFO:tasks.workunit.client.0.smithi115.stdout:1/59: creat d5/d7/f15 x:0 0 0 2024-09-13T17:05:42.029 INFO:tasks.workunit.client.0.smithi115.stdout:1/60: creat d5/d7/f16 x:0 0 0 2024-09-13T17:05:42.029 INFO:tasks.workunit.client.1.smithi195.stdout:0/125: creat d7/d8/d16/f1c x:0 0 0 2024-09-13T17:05:42.029 INFO:tasks.workunit.client.1.smithi195.stdout:0/126: read d7/d8/d16/f1b [3747175,61256] 0 2024-09-13T17:05:42.029 INFO:tasks.workunit.client.1.smithi195.stdout:8/135: dwrite d0/d13/f16 [0,4194304] 0 2024-09-13T17:05:42.029 INFO:tasks.workunit.client.1.smithi195.stdout:8/136: readlink d0/d4/l27 0 2024-09-13T17:05:42.033 INFO:tasks.workunit.client.0.smithi115.stdout:2/189: rename d3/d5/dd/d1f/d2f/l33 to d3/d5/dd/d1f/d2f/l41 0 2024-09-13T17:05:42.033 INFO:tasks.workunit.client.0.smithi115.stdout:2/190: chown d3/d5/d13 214107 1 2024-09-13T17:05:42.034 INFO:tasks.workunit.client.0.smithi115.stdout:2/191: readlink d3/d5/d13/l1e 0 2024-09-13T17:05:42.035 INFO:tasks.workunit.client.1.smithi195.stdout:3/114: mknod d7/c1b 0 2024-09-13T17:05:42.035 INFO:tasks.workunit.client.1.smithi195.stdout:7/180: symlink d5/d35/l3b 0 2024-09-13T17:05:42.037 INFO:tasks.workunit.client.1.smithi195.stdout:4/170: dwrite f2 [0,4194304] 0 2024-09-13T17:05:42.037 INFO:tasks.workunit.client.1.smithi195.stdout:6/110: mknod d1c/c20 0 2024-09-13T17:05:42.038 INFO:tasks.workunit.client.0.smithi115.stdout:5/109: dwrite d19/f1a [4194304,4194304] 0 2024-09-13T17:05:42.041 INFO:tasks.workunit.client.1.smithi195.stdout:0/127: symlink d7/l1d 0 2024-09-13T17:05:42.041 INFO:tasks.workunit.client.1.smithi195.stdout:0/128: stat d7/d8/df 0 2024-09-13T17:05:42.042 INFO:tasks.workunit.client.0.smithi115.stdout:0/56: creat d9/fd x:0 0 0 2024-09-13T17:05:42.043 INFO:tasks.workunit.client.0.smithi115.stdout:3/278: creat d1/d4b/f5f x:0 0 0 2024-09-13T17:05:42.045 INFO:tasks.workunit.client.1.smithi195.stdout:7/181: getdents d5/d13/d24 0 2024-09-13T17:05:42.045 INFO:tasks.workunit.client.0.smithi115.stdout:7/33: creat d0/d2/f8 x:0 0 0 2024-09-13T17:05:42.047 INFO:tasks.workunit.client.1.smithi195.stdout:2/124: dwrite d0/f24 [0,4194304] 0 2024-09-13T17:05:42.047 INFO:tasks.workunit.client.0.smithi115.stdout:4/112: mknod d7/c20 0 2024-09-13T17:05:42.050 INFO:tasks.workunit.client.0.smithi115.stdout:8/84: getdents d0 0 2024-09-13T17:05:42.051 INFO:tasks.workunit.client.1.smithi195.stdout:4/171: unlink d1a/d1f/f34 0 2024-09-13T17:05:42.053 INFO:tasks.workunit.client.1.smithi195.stdout:7/182: mkdir d5/db/d19/d22/d3c 0 2024-09-13T17:05:42.058 INFO:tasks.workunit.client.0.smithi115.stdout:5/110: creat d19/f25 x:0 0 0 2024-09-13T17:05:42.059 INFO:tasks.workunit.client.0.smithi115.stdout:0/57: creat d9/fe x:0 0 0 2024-09-13T17:05:42.060 INFO:tasks.workunit.client.0.smithi115.stdout:3/279: mknod d1/d12/d14/c60 0 2024-09-13T17:05:42.062 INFO:tasks.workunit.client.0.smithi115.stdout:4/113: unlink d7/dd/l15 0 2024-09-13T17:05:42.062 INFO:tasks.workunit.client.0.smithi115.stdout:4/114: fdatasync f3 0 2024-09-13T17:05:42.064 INFO:tasks.workunit.client.0.smithi115.stdout:5/111: read d19/f1a [599579,104132] 0 2024-09-13T17:05:42.064 INFO:tasks.workunit.client.0.smithi115.stdout:5/112: creat d19/d1d/f26 x:0 0 0 2024-09-13T17:05:42.067 INFO:tasks.workunit.client.1.smithi195.stdout:4/172: dread d1a/d1f/f20 [0,4194304] 0 2024-09-13T17:05:42.067 INFO:tasks.workunit.client.1.smithi195.stdout:4/173: stat d1a/d1f/d23/d24/f25 0 2024-09-13T17:05:42.068 INFO:tasks.workunit.client.1.smithi195.stdout:4/174: dread d1a/d1f/d21/d22/f28 [0,4194304] 0 2024-09-13T17:05:42.069 INFO:tasks.workunit.client.1.smithi195.stdout:6/111: mknod d1c/c21 0 2024-09-13T17:05:42.069 INFO:tasks.workunit.client.1.smithi195.stdout:7/183: symlink d5/d13/d30/l3d 0 2024-09-13T17:05:42.069 INFO:tasks.workunit.client.1.smithi195.stdout:5/148: dwrite d2/d4/f1d [0,4194304] 0 2024-09-13T17:05:42.070 INFO:tasks.workunit.client.1.smithi195.stdout:5/149: readlink d2/df/l2a 0 2024-09-13T17:05:42.070 INFO:tasks.workunit.client.0.smithi115.stdout:4/115: symlink d7/dd/de/l21 0 2024-09-13T17:05:42.070 INFO:tasks.workunit.client.0.smithi115.stdout:6/57: dwrite d8/db/ff [0,4194304] 0 2024-09-13T17:05:42.071 INFO:tasks.workunit.client.0.smithi115.stdout:2/192: dwrite d3/d5/d13/d39/f3b [0,4194304] 0 2024-09-13T17:05:42.071 INFO:tasks.workunit.client.0.smithi115.stdout:2/193: write d3/d5/dd/df/f24 [2676246,25621] 0 2024-09-13T17:05:42.073 INFO:tasks.workunit.client.1.smithi195.stdout:4/175: mknod d1a/d1f/c39 0 2024-09-13T17:05:42.073 INFO:tasks.workunit.client.0.smithi115.stdout:0/58: link d9/fe d9/ff 0 2024-09-13T17:05:42.073 INFO:tasks.workunit.client.0.smithi115.stdout:5/113: symlink d19/d21/l27 0 2024-09-13T17:05:42.073 INFO:tasks.workunit.client.0.smithi115.stdout:5/114: creat d19/d1d/f28 x:0 0 0 2024-09-13T17:05:42.074 INFO:tasks.workunit.client.1.smithi195.stdout:7/184: rmdir d5/db/d19/d22 39 2024-09-13T17:05:42.074 INFO:tasks.workunit.client.1.smithi195.stdout:7/185: stat d5/d35/l3b 0 2024-09-13T17:05:42.075 INFO:tasks.workunit.client.0.smithi115.stdout:5/115: write d19/f1e [603678,41046] 0 2024-09-13T17:05:42.075 INFO:tasks.workunit.client.0.smithi115.stdout:5/116: readlink d19/l1b 0 2024-09-13T17:05:42.076 INFO:tasks.workunit.client.0.smithi115.stdout:0/59: fsync d9/fb 0 2024-09-13T17:05:42.078 INFO:tasks.workunit.client.1.smithi195.stdout:6/112: write fd [4742359,60388] 0 2024-09-13T17:05:42.078 INFO:tasks.workunit.client.1.smithi195.stdout:6/113: chown ff 1606 1 2024-09-13T17:05:42.082 INFO:tasks.workunit.client.1.smithi195.stdout:5/150: mkdir d2/d7/d32 0 2024-09-13T17:05:42.082 INFO:tasks.workunit.client.1.smithi195.stdout:5/151: truncate d2/f2e 56633 0 2024-09-13T17:05:42.082 INFO:tasks.workunit.client.0.smithi115.stdout:0/60: chown d9/fc 732909 1 2024-09-13T17:05:42.084 INFO:tasks.workunit.client.1.smithi195.stdout:4/176: mknod d1a/c3a 0 2024-09-13T17:05:42.085 INFO:tasks.workunit.client.1.smithi195.stdout:6/114: fdatasync d1c/f1e 0 2024-09-13T17:05:42.086 INFO:tasks.workunit.client.0.smithi115.stdout:0/61: creat d9/f10 x:0 0 0 2024-09-13T17:05:42.087 INFO:tasks.workunit.client.1.smithi195.stdout:4/177: creat d1a/d1f/d21/d22/f3b x:0 0 0 2024-09-13T17:05:42.089 INFO:tasks.workunit.client.1.smithi195.stdout:4/178: symlink d1a/l3c 0 2024-09-13T17:05:42.090 INFO:tasks.workunit.client.1.smithi195.stdout:6/115: symlink d1c/l22 0 2024-09-13T17:05:42.091 INFO:tasks.workunit.client.1.smithi195.stdout:6/116: write f18 [147203,108506] 0 2024-09-13T17:05:42.091 INFO:tasks.workunit.client.1.smithi195.stdout:6/117: truncate f1a 638513 0 2024-09-13T17:05:42.091 INFO:tasks.workunit.client.0.smithi115.stdout:7/34: read d0/f1 [2672414,23042] 0 2024-09-13T17:05:42.092 INFO:tasks.workunit.client.1.smithi195.stdout:4/179: creat d1a/d1f/d23/f3d x:0 0 0 2024-09-13T17:05:42.094 INFO:tasks.workunit.client.1.smithi195.stdout:6/118: creat d1c/f23 x:0 0 0 2024-09-13T17:05:42.095 INFO:tasks.workunit.client.0.smithi115.stdout:2/194: read d3/d5/de/f10 [2167301,56698] 0 2024-09-13T17:05:42.095 INFO:tasks.workunit.client.0.smithi115.stdout:1/61: dwrite d5/fc [0,4194304] 0 2024-09-13T17:05:42.095 INFO:tasks.workunit.client.1.smithi195.stdout:8/137: dwrite d0/d4/fb [0,4194304] 0 2024-09-13T17:05:42.096 INFO:tasks.workunit.client.1.smithi195.stdout:4/180: stat cc 0 2024-09-13T17:05:42.096 INFO:tasks.workunit.client.0.smithi115.stdout:2/195: dread d3/d5/de/f2a [0,4194304] 0 2024-09-13T17:05:42.097 INFO:tasks.workunit.client.0.smithi115.stdout:2/196: read d3/d5/fa [361544,97712] 0 2024-09-13T17:05:42.099 INFO:tasks.workunit.client.0.smithi115.stdout:9/73: truncate d0/f8 2520158 0 2024-09-13T17:05:42.104 INFO:tasks.workunit.client.1.smithi195.stdout:8/138: mknod d0/d17/c2a 0 2024-09-13T17:05:42.105 INFO:tasks.workunit.client.1.smithi195.stdout:8/139: creat d0/f2b x:0 0 0 2024-09-13T17:05:42.105 INFO:tasks.workunit.client.1.smithi195.stdout:8/140: fsync d0/f20 0 2024-09-13T17:05:42.106 INFO:tasks.workunit.client.1.smithi195.stdout:5/152: write d2/f17 [1812519,56410] 0 2024-09-13T17:05:42.106 INFO:tasks.workunit.client.1.smithi195.stdout:5/153: fdatasync d2/f2e 0 2024-09-13T17:05:42.107 INFO:tasks.workunit.client.1.smithi195.stdout:6/119: mkdir d1c/d24 0 2024-09-13T17:05:42.108 INFO:tasks.workunit.client.0.smithi115.stdout:9/74: chown d0/lf 95581 1 2024-09-13T17:05:42.109 INFO:tasks.workunit.client.0.smithi115.stdout:1/62: dread d5/fc [0,4194304] 0 2024-09-13T17:05:42.112 INFO:tasks.workunit.client.0.smithi115.stdout:2/197: getdents d3/d5/de 0 2024-09-13T17:05:42.112 INFO:tasks.workunit.client.0.smithi115.stdout:2/198: write d3/d5/de/f10 [1842361,3806] 0 2024-09-13T17:05:42.114 INFO:tasks.workunit.client.1.smithi195.stdout:2/125: dwrite d0/d1a/d1c/d1e/f25 [0,4194304] 0 2024-09-13T17:05:42.114 INFO:tasks.workunit.client.1.smithi195.stdout:2/126: fdatasync d0/d1a/d1c/f23 0 2024-09-13T17:05:42.114 INFO:tasks.workunit.client.1.smithi195.stdout:2/127: chown d0/d1a/d1c/d1e 156485 1 2024-09-13T17:05:42.114 INFO:tasks.workunit.client.1.smithi195.stdout:9/127: sync 2024-09-13T17:05:42.114 INFO:tasks.workunit.client.1.smithi195.stdout:9/128: chown d6/d12/l14 3 1 2024-09-13T17:05:42.114 INFO:tasks.workunit.client.0.smithi115.stdout:0/62: dread d9/fc [0,4194304] 0 2024-09-13T17:05:42.117 INFO:tasks.workunit.client.0.smithi115.stdout:1/63: symlink d5/d7/l17 0 2024-09-13T17:05:42.117 INFO:tasks.workunit.client.0.smithi115.stdout:1/64: fdatasync d5/fc 0 2024-09-13T17:05:42.117 INFO:tasks.workunit.client.0.smithi115.stdout:1/65: creat d5/d7/f18 x:0 0 0 2024-09-13T17:05:42.117 INFO:tasks.workunit.client.0.smithi115.stdout:1/66: stat d5/l11 0 2024-09-13T17:05:42.117 INFO:tasks.workunit.client.1.smithi195.stdout:2/128: mknod d0/d1a/c27 0 2024-09-13T17:05:42.117 INFO:tasks.workunit.client.1.smithi195.stdout:2/129: dread - d0/f22 zero size 2024-09-13T17:05:42.119 INFO:tasks.workunit.client.0.smithi115.stdout:2/199: truncate d3/d5/de/f15 758614 0 2024-09-13T17:05:42.120 INFO:tasks.workunit.client.0.smithi115.stdout:2/200: write d3/d5/dd/df/d22/f2b [1014344,40962] 0 2024-09-13T17:05:42.120 INFO:tasks.workunit.client.0.smithi115.stdout:2/201: write d3/d5/dd/df/d22/f29 [872300,43486] 0 2024-09-13T17:05:42.120 INFO:tasks.workunit.client.0.smithi115.stdout:2/202: creat d3/d5/dd/df/d22/f42 x:0 0 0 2024-09-13T17:05:42.121 INFO:tasks.workunit.client.0.smithi115.stdout:4/116: dwrite d7/fb [0,4194304] 0 2024-09-13T17:05:42.124 INFO:tasks.workunit.client.0.smithi115.stdout:3/280: dwrite d1/d12/d14/f51 [0,4194304] 0 2024-09-13T17:05:42.125 INFO:tasks.workunit.client.1.smithi195.stdout:5/154: rmdir d2/d4/d11 39 2024-09-13T17:05:42.128 INFO:tasks.workunit.client.1.smithi195.stdout:2/130: creat d0/d3/df/f28 x:0 0 0 2024-09-13T17:05:42.128 INFO:tasks.workunit.client.1.smithi195.stdout:2/131: stat d0/d3/f4 0 2024-09-13T17:05:42.130 INFO:tasks.workunit.client.1.smithi195.stdout:3/115: dwrite d7/fa [0,4194304] 0 2024-09-13T17:05:42.130 INFO:tasks.workunit.client.1.smithi195.stdout:0/129: dwrite d7/d10/f12 [0,4194304] 0 2024-09-13T17:05:42.131 INFO:tasks.workunit.client.1.smithi195.stdout:9/129: getdents d6/d19 0 2024-09-13T17:05:42.133 INFO:tasks.workunit.client.0.smithi115.stdout:0/63: mknod d9/c11 0 2024-09-13T17:05:42.135 INFO:tasks.workunit.client.0.smithi115.stdout:5/117: dwrite d19/f25 [0,4194304] 0 2024-09-13T17:05:42.135 INFO:tasks.workunit.client.1.smithi195.stdout:2/132: symlink d0/d1a/l29 0 2024-09-13T17:05:42.136 INFO:tasks.workunit.client.1.smithi195.stdout:4/181: dwrite f13 [0,4194304] 0 2024-09-13T17:05:42.138 INFO:tasks.workunit.client.0.smithi115.stdout:4/117: write d7/f19 [8181716,62721] 0 2024-09-13T17:05:42.138 INFO:tasks.workunit.client.0.smithi115.stdout:8/85: dwrite d0/f13 [0,4194304] 0 2024-09-13T17:05:42.138 INFO:tasks.workunit.client.0.smithi115.stdout:8/86: getdents d0 0 2024-09-13T17:05:42.140 INFO:tasks.workunit.client.1.smithi195.stdout:7/186: dwrite d5/d13/d30/f34 [0,4194304] 0 2024-09-13T17:05:42.141 INFO:tasks.workunit.client.0.smithi115.stdout:1/67: getdents d5 0 2024-09-13T17:05:42.142 INFO:tasks.workunit.client.1.smithi195.stdout:0/130: dread f6 [0,4194304] 0 2024-09-13T17:05:42.147 INFO:tasks.workunit.client.1.smithi195.stdout:7/187: dread d5/db/d19/f18 [0,4194304] 0 2024-09-13T17:05:42.150 INFO:tasks.workunit.client.0.smithi115.stdout:9/75: dread d0/de/d10/f1b [0,4194304] 0 2024-09-13T17:05:42.151 INFO:tasks.workunit.client.1.smithi195.stdout:8/141: truncate d0/d4/fb 1887187 0 2024-09-13T17:05:42.152 INFO:tasks.workunit.client.1.smithi195.stdout:7/188: dread d5/db/fc [0,4194304] 0 2024-09-13T17:05:42.153 INFO:tasks.workunit.client.0.smithi115.stdout:3/281: dwrite d1/d12/d14/f51 [0,4194304] 0 2024-09-13T17:05:42.153 INFO:tasks.workunit.client.0.smithi115.stdout:3/282: chown d1/d4b/d1a/d30/f39 6468 1 2024-09-13T17:05:42.153 INFO:tasks.workunit.client.0.smithi115.stdout:3/283: chown d1/d12/d23/l29 334 1 2024-09-13T17:05:42.153 INFO:tasks.workunit.client.0.smithi115.stdout:7/35: truncate d0/f1 4144407 0 2024-09-13T17:05:42.153 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:42.152+0000 7fe0346af640 1 -- 172.21.15.115:0/1959308402 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe02c10aa60 con 0x7fe02c100dd0 2024-09-13T17:05:42.154 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:41 smithi115 ceph-mon[27708]: from='client.24365 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:05:42.154 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:41 smithi115 ceph-mon[27708]: from='client.14624 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:05:42.154 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:42.153+0000 7fe0237fe640 1 -- 172.21.15.115:0/1959308402 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+838 (secure 0 0 0) 0x7fe01c017360 con 0x7fe02c100dd0 2024-09-13T17:05:42.154 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-13T17:05:42.154 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": { 2024-09-13T17:05:42.155 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-843-g2c01458a (2c01458affee2b2435cd231b6e392435c1c21661) reef (stable)": 2 2024-09-13T17:05:42.155 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T17:05:42.155 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": { 2024-09-13T17:05:42.155 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-843-g2c01458a (2c01458affee2b2435cd231b6e392435c1c21661) reef (stable)": 1, 2024-09-13T17:05:42.155 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 1 2024-09-13T17:05:42.155 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T17:05:42.155 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": { 2024-09-13T17:05:42.155 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-843-g2c01458a (2c01458affee2b2435cd231b6e392435c1c21661) reef (stable)": 6 2024-09-13T17:05:42.155 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T17:05:42.155 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": { 2024-09-13T17:05:42.155 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-843-g2c01458a (2c01458affee2b2435cd231b6e392435c1c21661) reef (stable)": 4 2024-09-13T17:05:42.155 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T17:05:42.155 INFO:teuthology.orchestra.run.smithi115.stdout: "overall": { 2024-09-13T17:05:42.155 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-843-g2c01458a (2c01458affee2b2435cd231b6e392435c1c21661) reef (stable)": 13, 2024-09-13T17:05:42.156 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 1 2024-09-13T17:05:42.156 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-13T17:05:42.156 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-13T17:05:42.157 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:42.155+0000 7fe0346af640 1 -- 172.21.15.115:0/1959308402 >> [v2:172.21.15.195:6828/1660911692,v1:172.21.15.195:6829/1660911692] conn(0x7fe01806cee0 msgr2=0x7fe01806f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:05:42.157 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:42.155+0000 7fe0346af640 1 --2- 172.21.15.115:0/1959308402 >> [v2:172.21.15.195:6828/1660911692,v1:172.21.15.195:6829/1660911692] conn(0x7fe01806cee0 0x7fe01806f3a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe028006010 tx=0x7fe028031420 comp rx=0 tx=0).stop 2024-09-13T17:05:42.157 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:42.155+0000 7fe0346af640 1 -- 172.21.15.115:0/1959308402 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe02c100dd0 msgr2=0x7fe02c19c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:05:42.157 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:42.155+0000 7fe0346af640 1 --2- 172.21.15.115:0/1959308402 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe02c100dd0 0x7fe02c19c080 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fe01c00d8d0 tx=0x7fe01c00dd90 comp rx=0 tx=0).stop 2024-09-13T17:05:42.157 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:42.156+0000 7fe0346af640 1 -- 172.21.15.115:0/1959308402 shutdown_connections 2024-09-13T17:05:42.157 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:42.156+0000 7fe0346af640 1 --2- 172.21.15.115:0/1959308402 >> [v2:172.21.15.195:6828/1660911692,v1:172.21.15.195:6829/1660911692] conn(0x7fe01806cee0 0x7fe01806f3a0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:42.158 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:42.156+0000 7fe0346af640 1 --2- 172.21.15.115:0/1959308402 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe02c100dd0 0x7fe02c19c080 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:42.158 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:42.156+0000 7fe0346af640 1 --2- 172.21.15.115:0/1959308402 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe02c0fddf0 0x7fe02c19bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:42.158 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:42.156+0000 7fe0346af640 1 -- 172.21.15.115:0/1959308402 >> 172.21.15.115:0/1959308402 conn(0x7fe02c0f9940 msgr2=0x7fe02c104000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:05:42.158 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:42.156+0000 7fe0346af640 1 -- 172.21.15.115:0/1959308402 shutdown_connections 2024-09-13T17:05:42.158 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:42.156+0000 7fe0346af640 1 -- 172.21.15.115:0/1959308402 wait complete. 2024-09-13T17:05:42.162 INFO:tasks.workunit.client.0.smithi115.stdout:5/118: rename fc to d19/d21/f29 0 2024-09-13T17:05:42.163 INFO:tasks.workunit.client.1.smithi195.stdout:9/130: symlink d6/df/d16/l2d 0 2024-09-13T17:05:42.170 INFO:tasks.workunit.client.1.smithi195.stdout:5/155: dwrite d2/df/f1a [0,4194304] 0 2024-09-13T17:05:42.171 INFO:tasks.workunit.client.1.smithi195.stdout:0/131: rmdir d7/d10 39 2024-09-13T17:05:42.173 INFO:tasks.workunit.client.1.smithi195.stdout:0/132: dread d7/d8/fe [0,4194304] 0 2024-09-13T17:05:42.173 INFO:tasks.workunit.client.1.smithi195.stdout:0/133: stat f1 0 2024-09-13T17:05:42.173 INFO:tasks.workunit.client.1.smithi195.stdout:8/142: symlink d0/l2c 0 2024-09-13T17:05:42.174 INFO:tasks.workunit.client.0.smithi115.stdout:4/118: symlink d7/l22 0 2024-09-13T17:05:42.174 INFO:tasks.workunit.client.0.smithi115.stdout:4/119: readlink l2 0 2024-09-13T17:05:42.174 INFO:tasks.workunit.client.0.smithi115.stdout:4/120: fsync d7/dd/de/f17 0 2024-09-13T17:05:42.175 INFO:tasks.workunit.client.1.smithi195.stdout:7/189: stat d5/l2e 0 2024-09-13T17:05:42.176 INFO:tasks.workunit.client.1.smithi195.stdout:1/104: sync 2024-09-13T17:05:42.177 INFO:tasks.workunit.client.0.smithi115.stdout:0/64: dwrite f0 [0,4194304] 0 2024-09-13T17:05:42.177 INFO:tasks.workunit.client.0.smithi115.stdout:3/284: dread d1/f9 [0,4194304] 0 2024-09-13T17:05:42.177 INFO:tasks.workunit.client.0.smithi115.stdout:0/65: chown d9/fb 13062 1 2024-09-13T17:05:42.177 INFO:tasks.workunit.client.0.smithi115.stdout:0/66: read - d9/fb zero size 2024-09-13T17:05:42.177 INFO:tasks.workunit.client.0.smithi115.stdout:4/121: read d7/dd/de/f10 [29961,125222] 0 2024-09-13T17:05:42.177 INFO:tasks.workunit.client.0.smithi115.stdout:4/122: chown d7/dd/de/f14 5693390 1 2024-09-13T17:05:42.178 INFO:tasks.workunit.client.1.smithi195.stdout:9/131: mknod d6/d19/c2e 0 2024-09-13T17:05:42.178 INFO:tasks.workunit.client.0.smithi115.stdout:8/87: dwrite d0/fc [0,4194304] 0 2024-09-13T17:05:42.179 INFO:tasks.workunit.client.0.smithi115.stdout:6/58: dwrite f5 [0,4194304] 0 2024-09-13T17:05:42.179 INFO:tasks.workunit.client.0.smithi115.stdout:6/59: chown f5 12 1 2024-09-13T17:05:42.179 INFO:tasks.workunit.client.0.smithi115.stdout:6/60: fdatasync d8/db/ff 0 2024-09-13T17:05:42.179 INFO:tasks.workunit.client.0.smithi115.stdout:8/88: dread d0/fb [0,4194304] 0 2024-09-13T17:05:42.180 INFO:tasks.workunit.client.0.smithi115.stdout:8/89: readlink d0/d15/l17 0 2024-09-13T17:05:42.180 INFO:tasks.workunit.client.1.smithi195.stdout:2/133: rename d0/d3/df/f28 to d0/d1a/d1c/d1e/f2a 0 2024-09-13T17:05:42.181 INFO:tasks.workunit.client.0.smithi115.stdout:5/119: creat d19/d21/f2a x:0 0 0 2024-09-13T17:05:42.182 INFO:tasks.workunit.client.1.smithi195.stdout:3/116: dwrite d7/f12 [0,4194304] 0 2024-09-13T17:05:42.183 INFO:tasks.workunit.client.1.smithi195.stdout:3/117: stat d7/fa 0 2024-09-13T17:05:42.183 INFO:tasks.workunit.client.1.smithi195.stdout:5/156: link d2/d12/f1b d2/d7/d32/f33 0 2024-09-13T17:05:42.183 INFO:tasks.workunit.client.0.smithi115.stdout:1/68: dwrite d5/fc [0,4194304] 0 2024-09-13T17:05:42.185 INFO:tasks.workunit.client.0.smithi115.stdout:3/285: mkdir d1/d12/d14/d61 0 2024-09-13T17:05:42.187 INFO:tasks.workunit.client.0.smithi115.stdout:7/36: dread d0/f1 [0,4194304] 0 2024-09-13T17:05:42.188 INFO:tasks.workunit.client.1.smithi195.stdout:0/134: mknod d7/d8/c1e 0 2024-09-13T17:05:42.192 INFO:tasks.workunit.client.0.smithi115.stdout:6/61: unlink d8/d9/fc 0 2024-09-13T17:05:42.193 INFO:tasks.workunit.client.1.smithi195.stdout:8/143: mknod d0/c2d 0 2024-09-13T17:05:42.195 INFO:tasks.workunit.client.1.smithi195.stdout:7/190: link d5/db/c3a d5/c3e 0 2024-09-13T17:05:42.196 INFO:tasks.workunit.client.1.smithi195.stdout:7/191: write d5/d13/f1d [2945125,84766] 0 2024-09-13T17:05:42.197 INFO:tasks.workunit.client.1.smithi195.stdout:7/192: read d5/db/fc [78635,36400] 0 2024-09-13T17:05:42.197 INFO:tasks.workunit.client.0.smithi115.stdout:7/37: rmdir d0/d2/d7 0 2024-09-13T17:05:42.197 INFO:tasks.workunit.client.0.smithi115.stdout:7/38: write d0/d2/f8 [738937,71388] 0 2024-09-13T17:05:42.198 INFO:tasks.workunit.client.1.smithi195.stdout:9/132: link d6/df/f27 d6/d19/d21/f2f 0 2024-09-13T17:05:42.198 INFO:tasks.workunit.client.1.smithi195.stdout:9/133: creat d6/d12/f30 x:0 0 0 2024-09-13T17:05:42.201 INFO:tasks.workunit.client.1.smithi195.stdout:2/134: rename d0/d1a/ld to d0/d1a/d1c/d1e/l2b 0 2024-09-13T17:05:42.203 INFO:tasks.workunit.client.1.smithi195.stdout:3/118: symlink d7/d19/l1c 0 2024-09-13T17:05:42.206 INFO:tasks.workunit.client.1.smithi195.stdout:0/135: link d7/d10/f12 d7/db/d11/f1f 0 2024-09-13T17:05:42.206 INFO:tasks.workunit.client.1.smithi195.stdout:0/136: write d7/d8/fe [138628,100085] 0 2024-09-13T17:05:42.206 INFO:tasks.workunit.client.1.smithi195.stdout:0/137: read d7/d8/d16/f1b [279758,111897] 0 2024-09-13T17:05:42.206 INFO:tasks.workunit.client.1.smithi195.stdout:0/138: write d7/d8/fe [961131,127156] 0 2024-09-13T17:05:42.206 INFO:tasks.workunit.client.1.smithi195.stdout:0/139: truncate d7/d8/d16/f1c 465361 0 2024-09-13T17:05:42.206 INFO:tasks.workunit.client.1.smithi195.stdout:0/140: write f1 [3834466,72551] 0 2024-09-13T17:05:42.206 INFO:tasks.workunit.client.1.smithi195.stdout:0/141: chown d7/d8/d16/f1b 97977093 1 2024-09-13T17:05:42.207 INFO:tasks.workunit.client.1.smithi195.stdout:7/193: creat d5/d13/d24/f3f x:0 0 0 2024-09-13T17:05:42.209 INFO:tasks.workunit.client.1.smithi195.stdout:2/135: mkdir d0/d1a/d1c/d2c 0 2024-09-13T17:05:42.209 INFO:tasks.workunit.client.1.smithi195.stdout:1/105: dwrite f5 [0,4194304] 0 2024-09-13T17:05:42.210 INFO:tasks.workunit.client.0.smithi115.stdout:8/90: dwrite d0/fb [0,4194304] 0 2024-09-13T17:05:42.211 INFO:tasks.workunit.client.1.smithi195.stdout:3/119: truncate d7/f14 3938054 0 2024-09-13T17:05:42.212 INFO:tasks.workunit.client.1.smithi195.stdout:5/157: dwrite d2/d4/d10/f15 [4194304,4194304] 0 2024-09-13T17:05:42.214 INFO:tasks.workunit.client.0.smithi115.stdout:7/39: fdatasync d0/d2/f8 0 2024-09-13T17:05:42.216 INFO:tasks.workunit.client.0.smithi115.stdout:4/123: read f3 [3209040,79552] 0 2024-09-13T17:05:42.216 INFO:tasks.workunit.client.0.smithi115.stdout:4/124: read d7/f19 [4570639,48863] 0 2024-09-13T17:05:42.216 INFO:tasks.workunit.client.0.smithi115.stdout:4/125: fdatasync d7/f12 0 2024-09-13T17:05:42.216 INFO:tasks.workunit.client.0.smithi115.stdout:4/126: fdatasync d7/fb 0 2024-09-13T17:05:42.216 INFO:tasks.workunit.client.0.smithi115.stdout:4/127: creat d7/dd/de/f23 x:0 0 0 2024-09-13T17:05:42.217 INFO:tasks.workunit.client.1.smithi195.stdout:2/136: mknod d0/d1a/c2d 0 2024-09-13T17:05:42.217 INFO:tasks.workunit.client.1.smithi195.stdout:2/137: readlink d0/d1a/l29 0 2024-09-13T17:05:42.218 INFO:tasks.workunit.client.1.smithi195.stdout:9/134: write d6/d19/d21/f2f [3307217,39392] 0 2024-09-13T17:05:42.218 INFO:tasks.workunit.client.1.smithi195.stdout:9/135: write d6/f7 [2614696,130207] 0 2024-09-13T17:05:42.221 INFO:tasks.workunit.client.0.smithi115.stdout:7/40: symlink d0/l9 0 2024-09-13T17:05:42.222 INFO:tasks.workunit.client.1.smithi195.stdout:1/106: write db/df/f26 [2447857,8350] 0 2024-09-13T17:05:42.223 INFO:tasks.workunit.client.1.smithi195.stdout:1/107: write db/df/f16 [605653,30537] 0 2024-09-13T17:05:42.223 INFO:tasks.workunit.client.1.smithi195.stdout:1/108: fdatasync db/df/f1f 0 2024-09-13T17:05:42.223 INFO:tasks.workunit.client.1.smithi195.stdout:1/109: creat db/df/f28 x:0 0 0 2024-09-13T17:05:42.223 INFO:tasks.workunit.client.1.smithi195.stdout:3/120: write d7/fa [900015,38523] 0 2024-09-13T17:05:42.223 INFO:tasks.workunit.client.1.smithi195.stdout:3/121: write f5 [2096162,71861] 0 2024-09-13T17:05:42.224 INFO:tasks.workunit.client.0.smithi115.stdout:9/76: dwrite d0/f11 [0,4194304] 0 2024-09-13T17:05:42.229 INFO:tasks.workunit.client.0.smithi115.stdout:1/69: dread d5/fa [0,4194304] 0 2024-09-13T17:05:42.234 INFO:tasks.workunit.client.0.smithi115.stdout:7/41: creat d0/fa x:0 0 0 2024-09-13T17:05:42.234 INFO:tasks.workunit.client.0.smithi115.stdout:7/42: read d0/f1 [3628438,55297] 0 2024-09-13T17:05:42.236 INFO:tasks.workunit.client.1.smithi195.stdout:9/136: rmdir d6/d19/d21 39 2024-09-13T17:05:42.240 INFO:tasks.workunit.client.0.smithi115.stdout:4/128: dread f3 [0,4194304] 0 2024-09-13T17:05:42.241 INFO:tasks.workunit.client.1.smithi195.stdout:1/110: stat l7 0 2024-09-13T17:05:42.243 INFO:tasks.workunit.client.0.smithi115.stdout:9/77: symlink d0/de/l1c 0 2024-09-13T17:05:42.246 INFO:tasks.workunit.client.0.smithi115.stdout:1/70: read d5/f6 [2410132,27046] 0 2024-09-13T17:05:42.248 INFO:tasks.workunit.client.0.smithi115.stdout:4/129: symlink d7/l24 0 2024-09-13T17:05:42.249 INFO:tasks.workunit.client.1.smithi195.stdout:3/122: unlink d7/d19/l1c 0 2024-09-13T17:05:42.251 INFO:tasks.workunit.client.1.smithi195.stdout:8/144: dwrite d0/f3 [0,4194304] 0 2024-09-13T17:05:42.251 INFO:tasks.workunit.client.1.smithi195.stdout:8/145: creat d0/f2e x:0 0 0 2024-09-13T17:05:42.252 INFO:tasks.workunit.client.1.smithi195.stdout:9/137: mknod d6/d12/c31 0 2024-09-13T17:05:42.253 INFO:tasks.workunit.client.1.smithi195.stdout:9/138: dread d6/d12/f2a [0,4194304] 0 2024-09-13T17:05:42.253 INFO:tasks.workunit.client.1.smithi195.stdout:9/139: creat d6/df/d16/f32 x:0 0 0 2024-09-13T17:05:42.253 INFO:tasks.workunit.client.1.smithi195.stdout:9/140: chown d6/d19 5 1 2024-09-13T17:05:42.253 INFO:tasks.workunit.client.1.smithi195.stdout:9/141: dread - d6/df/d16/f2c zero size 2024-09-13T17:05:42.253 INFO:tasks.workunit.client.1.smithi195.stdout:9/142: dread - d6/df/d16/f2c zero size 2024-09-13T17:05:42.254 INFO:tasks.workunit.client.0.smithi115.stdout:8/91: truncate d0/fb 835936 0 2024-09-13T17:05:42.254 INFO:tasks.workunit.client.0.smithi115.stdout:1/71: rename d5/d7/ld to d5/l19 0 2024-09-13T17:05:42.256 INFO:tasks.workunit.client.0.smithi115.stdout:9/78: link d0/de/f1a d0/f1d 0 2024-09-13T17:05:42.256 INFO:tasks.workunit.client.0.smithi115.stdout:9/79: creat d0/de/f1e x:0 0 0 2024-09-13T17:05:42.258 INFO:tasks.workunit.client.0.smithi115.stdout:8/92: mkdir d0/d18 0 2024-09-13T17:05:42.262 INFO:tasks.workunit.client.0.smithi115.stdout:4/130: dread d7/dd/de/f14 [0,4194304] 0 2024-09-13T17:05:42.262 INFO:tasks.workunit.client.0.smithi115.stdout:1/72: symlink d5/d7/l1a 0 2024-09-13T17:05:42.262 INFO:tasks.workunit.client.0.smithi115.stdout:1/73: fsync d5/fa 0 2024-09-13T17:05:42.273 INFO:tasks.workunit.client.1.smithi195.stdout:8/146: mkdir d0/d17/d2f 0 2024-09-13T17:05:42.274 INFO:tasks.workunit.client.0.smithi115.stdout:3/286: dwrite d1/d4b/f4d [0,4194304] 0 2024-09-13T17:05:42.274 INFO:tasks.workunit.client.0.smithi115.stdout:4/131: dread d7/dd/de/f10 [0,4194304] 0 2024-09-13T17:05:42.275 INFO:tasks.workunit.client.0.smithi115.stdout:8/93: write d0/fc [2467889,90532] 0 2024-09-13T17:05:42.277 INFO:tasks.workunit.client.1.smithi195.stdout:9/143: unlink d6/df/d16/f2c 0 2024-09-13T17:05:42.277 INFO:tasks.workunit.client.1.smithi195.stdout:9/144: fsync d6/f18 0 2024-09-13T17:05:42.277 INFO:tasks.workunit.client.0.smithi115.stdout:6/62: dwrite f5 [0,4194304] 0 2024-09-13T17:05:42.278 INFO:tasks.workunit.client.1.smithi195.stdout:5/158: dwrite d2/f17 [0,4194304] 0 2024-09-13T17:05:42.282 INFO:tasks.workunit.client.1.smithi195.stdout:6/120: sync 2024-09-13T17:05:42.282 INFO:tasks.workunit.client.1.smithi195.stdout:5/159: dread d2/d7/d32/f33 [0,4194304] 0 2024-09-13T17:05:42.282 INFO:tasks.workunit.client.1.smithi195.stdout:4/182: sync 2024-09-13T17:05:42.282 INFO:tasks.workunit.client.1.smithi195.stdout:4/183: stat f2 0 2024-09-13T17:05:42.283 INFO:tasks.workunit.client.1.smithi195.stdout:5/160: symlink d2/d7/l34 0 2024-09-13T17:05:42.284 INFO:tasks.workunit.client.1.smithi195.stdout:4/184: creat d1a/d1f/d23/d24/f3e x:0 0 0 2024-09-13T17:05:42.285 INFO:tasks.workunit.client.1.smithi195.stdout:5/161: rename d2/f2e to d2/d7/f35 0 2024-09-13T17:05:42.285 INFO:tasks.workunit.client.1.smithi195.stdout:5/162: fdatasync d2/d4/d10/f28 0 2024-09-13T17:05:42.285 INFO:tasks.workunit.client.1.smithi195.stdout:5/163: dread d2/d4/f2b [0,4194304] 0 2024-09-13T17:05:42.286 INFO:tasks.workunit.client.1.smithi195.stdout:7/194: dwrite d5/db/f2c [0,4194304] 0 2024-09-13T17:05:42.286 INFO:tasks.workunit.client.1.smithi195.stdout:7/195: stat d5/d13/d30/l3d 0 2024-09-13T17:05:42.287 INFO:tasks.workunit.client.1.smithi195.stdout:5/164: rename d2/d7/c31 to d2/d7/d32/c36 0 2024-09-13T17:05:42.287 INFO:tasks.workunit.client.1.smithi195.stdout:5/165: stat d2/df/fa 0 2024-09-13T17:05:42.288 INFO:tasks.workunit.client.1.smithi195.stdout:7/196: creat d5/d13/f40 x:0 0 0 2024-09-13T17:05:42.290 INFO:tasks.workunit.client.0.smithi115.stdout:7/43: dwrite d0/f1 [0,4194304] 0 2024-09-13T17:05:42.292 INFO:tasks.workunit.client.0.smithi115.stdout:4/132: write d7/dd/de/f13 [2882283,130689] 0 2024-09-13T17:05:42.292 INFO:tasks.workunit.client.0.smithi115.stdout:4/133: stat d7/fc 0 2024-09-13T17:05:42.293 INFO:tasks.workunit.client.1.smithi195.stdout:4/185: write f0 [2568792,40446] 0 2024-09-13T17:05:42.293 INFO:tasks.workunit.client.1.smithi195.stdout:4/186: creat d1a/d1f/d23/d29/f3f x:0 0 0 2024-09-13T17:05:42.294 INFO:tasks.workunit.client.0.smithi115.stdout:3/287: dread d1/fa [0,4194304] 0 2024-09-13T17:05:42.294 INFO:tasks.workunit.client.0.smithi115.stdout:3/288: chown d1/d12/c26 227 1 2024-09-13T17:05:42.294 INFO:tasks.workunit.client.0.smithi115.stdout:3/289: write d1/f1d [1345952,121388] 0 2024-09-13T17:05:42.295 INFO:tasks.workunit.client.0.smithi115.stdout:7/44: link d0/d2/f8 d0/fb 0 2024-09-13T17:05:42.295 INFO:tasks.workunit.client.1.smithi195.stdout:3/123: dread f5 [0,4194304] 0 2024-09-13T17:05:42.296 INFO:tasks.workunit.client.0.smithi115.stdout:7/45: write d0/d2/f8 [137506,102980] 0 2024-09-13T17:05:42.296 INFO:tasks.workunit.client.0.smithi115.stdout:6/63: write f6 [2756714,22149] 0 2024-09-13T17:05:42.296 INFO:tasks.workunit.client.0.smithi115.stdout:6/64: fsync d8/db/ff 0 2024-09-13T17:05:42.297 INFO:tasks.workunit.client.1.smithi195.stdout:8/147: read d0/d13/f16 [4854931,46612] 0 2024-09-13T17:05:42.298 INFO:tasks.workunit.client.0.smithi115.stdout:4/134: creat d7/dd/f25 x:0 0 0 2024-09-13T17:05:42.299 INFO:tasks.workunit.client.1.smithi195.stdout:4/187: mknod d1a/c40 0 2024-09-13T17:05:42.299 INFO:tasks.workunit.client.1.smithi195.stdout:6/121: dread f2 [0,4194304] 0 2024-09-13T17:05:42.299 INFO:tasks.workunit.client.1.smithi195.stdout:6/122: write fd [6909869,100160] 0 2024-09-13T17:05:42.301 INFO:tasks.workunit.client.1.smithi195.stdout:3/124: stat d7/lb 0 2024-09-13T17:05:42.301 INFO:tasks.workunit.client.0.smithi115.stdout:3/290: creat d1/d12/d23/f62 x:0 0 0 2024-09-13T17:05:42.302 INFO:tasks.workunit.client.0.smithi115.stdout:7/46: mkdir d0/dc 0 2024-09-13T17:05:42.303 INFO:tasks.workunit.client.1.smithi195.stdout:8/148: symlink d0/d4/l30 0 2024-09-13T17:05:42.304 INFO:tasks.workunit.client.1.smithi195.stdout:0/142: truncate d7/d8/fe 94833 0 2024-09-13T17:05:42.305 INFO:tasks.workunit.client.0.smithi115.stdout:9/80: dwrite d0/de/d10/d15/f17 [0,4194304] 0 2024-09-13T17:05:42.306 INFO:tasks.workunit.client.0.smithi115.stdout:1/74: dwrite d5/f6 [0,4194304] 0 2024-09-13T17:05:42.306 INFO:tasks.workunit.client.0.smithi115.stdout:5/120: dwrite fd [0,4194304] 0 2024-09-13T17:05:42.306 INFO:tasks.workunit.client.1.smithi195.stdout:6/123: mknod d1c/d24/c25 0 2024-09-13T17:05:42.307 INFO:tasks.workunit.client.1.smithi195.stdout:6/124: write fd [7601761,114840] 0 2024-09-13T17:05:42.307 INFO:tasks.workunit.client.0.smithi115.stdout:6/65: creat d8/db/f11 x:0 0 0 2024-09-13T17:05:42.307 INFO:tasks.workunit.client.0.smithi115.stdout:6/66: truncate d8/db/f11 128701 0 2024-09-13T17:05:42.307 INFO:tasks.workunit.client.0.smithi115.stdout:6/67: creat d8/db/f12 x:0 0 0 2024-09-13T17:05:42.308 INFO:tasks.workunit.client.0.smithi115.stdout:6/68: stat d8 0 2024-09-13T17:05:42.308 INFO:tasks.workunit.client.0.smithi115.stdout:6/69: write d8/db/f12 [305815,97599] 0 2024-09-13T17:05:42.308 INFO:tasks.workunit.client.1.smithi195.stdout:2/138: dwrite d0/d3/df/f20 [4194304,4194304] 0 2024-09-13T17:05:42.309 INFO:tasks.workunit.client.1.smithi195.stdout:8/149: mkdir d0/d17/d2f/d31 0 2024-09-13T17:05:42.309 INFO:tasks.workunit.client.1.smithi195.stdout:8/150: dread - d0/f2b zero size 2024-09-13T17:05:42.309 INFO:tasks.workunit.client.1.smithi195.stdout:8/151: write d0/d17/f1b [16721,105772] 0 2024-09-13T17:05:42.311 INFO:tasks.workunit.client.0.smithi115.stdout:3/291: getdents d1 0 2024-09-13T17:05:42.311 INFO:tasks.workunit.client.1.smithi195.stdout:3/125: dread d7/fa [0,4194304] 0 2024-09-13T17:05:42.312 INFO:tasks.workunit.client.0.smithi115.stdout:4/135: dread d7/f19 [0,4194304] 0 2024-09-13T17:05:42.312 INFO:tasks.workunit.client.0.smithi115.stdout:4/136: read - d7/dd/de/f23 zero size 2024-09-13T17:05:42.312 INFO:tasks.workunit.client.0.smithi115.stdout:4/137: chown d7/f12 2450187 1 2024-09-13T17:05:42.312 INFO:tasks.workunit.client.0.smithi115.stdout:4/138: creat d7/dd/f26 x:0 0 0 2024-09-13T17:05:42.312 INFO:tasks.workunit.client.0.smithi115.stdout:4/139: chown d7/f19 1325 1 2024-09-13T17:05:42.312 INFO:tasks.workunit.client.0.smithi115.stdout:4/140: chown d7/dd/de/f1c 152 1 2024-09-13T17:05:42.312 INFO:tasks.workunit.client.0.smithi115.stdout:8/94: dread d0/fc [0,4194304] 0 2024-09-13T17:05:42.314 INFO:tasks.workunit.client.0.smithi115.stdout:7/47: mknod d0/dc/cd 0 2024-09-13T17:05:42.314 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:42.313+0000 7f0ce7d6b640 1 -- 172.21.15.115:0/3029926582 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ce00ffc80 msgr2=0x7f0ce0100100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:05:42.314 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:42.313+0000 7f0ce7d6b640 1 --2- 172.21.15.115:0/3029926582 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ce00ffc80 0x7f0ce0100100 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0009880 tx=0x7f0cd002a4b0 comp rx=0 tx=0).stop 2024-09-13T17:05:42.314 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:42.313+0000 7f0ce7d6b640 1 -- 172.21.15.115:0/3029926582 shutdown_connections 2024-09-13T17:05:42.315 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:42.313+0000 7f0ce7d6b640 1 --2- 172.21.15.115:0/3029926582 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ce00ffc80 0x7f0ce0100100 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:42.315 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:42.313+0000 7f0ce7d6b640 1 --2- 172.21.15.115:0/3029926582 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0ce00fea80 0x7f0ce00fee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:42.315 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:42.313+0000 7f0ce7d6b640 1 -- 172.21.15.115:0/3029926582 >> 172.21.15.115:0/3029926582 conn(0x7f0ce00fa210 msgr2=0x7f0ce00fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:05:42.315 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:42.313+0000 7f0ce7d6b640 1 -- 172.21.15.115:0/3029926582 shutdown_connections 2024-09-13T17:05:42.315 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:42.313+0000 7f0ce7d6b640 1 -- 172.21.15.115:0/3029926582 wait complete. 2024-09-13T17:05:42.316 INFO:tasks.workunit.client.1.smithi195.stdout:2/139: link d0/d1a/c27 d0/d3/df/c2e 0 2024-09-13T17:05:42.316 INFO:tasks.workunit.client.1.smithi195.stdout:2/140: chown d0/d3 100 1 2024-09-13T17:05:42.316 INFO:tasks.workunit.client.1.smithi195.stdout:5/166: dread d2/d4/d10/f28 [0,4194304] 0 2024-09-13T17:05:42.316 INFO:tasks.workunit.client.1.smithi195.stdout:8/152: truncate d0/d13/f16 3251947 0 2024-09-13T17:05:42.317 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:42.314+0000 7f0ce7d6b640 1 Processor -- start 2024-09-13T17:05:42.317 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:42.314+0000 7f0ce7d6b640 1 -- start start 2024-09-13T17:05:42.317 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:42.314+0000 7f0ce7d6b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ce00fea80 0x7f0ce0194540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:05:42.317 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:42.315+0000 7f0ce7d6b640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0ce00ffc80 0x7f0ce0194a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:05:42.317 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:42.315+0000 7f0ce7d6b640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce0195050 con 0x7f0ce00fea80 2024-09-13T17:05:42.317 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:42.315+0000 7f0ce7d6b640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce01951c0 con 0x7f0ce00ffc80 2024-09-13T17:05:42.317 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:42.315+0000 7f0ce5b07640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ce00fea80 0x7f0ce0194540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:05:42.317 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:42.315+0000 7f0ce5b07640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ce00fea80 0x7f0ce0194540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:41700/0 (socket says 172.21.15.115:41700) 2024-09-13T17:05:42.317 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:42.315+0000 7f0ce5b07640 1 -- 172.21.15.115:0/1949372324 learned_addr learned my addr 172.21.15.115:0/1949372324 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:05:42.318 INFO:tasks.workunit.client.0.smithi115.stdout:3/292: dread d1/f16 [0,4194304] 0 2024-09-13T17:05:42.318 INFO:tasks.workunit.client.0.smithi115.stdout:3/293: chown d1/d4b/d1a 0 1 2024-09-13T17:05:42.319 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:42.315+0000 7f0ce5306640 1 --2- 172.21.15.115:0/1949372324 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0ce00ffc80 0x7f0ce0194a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:05:42.319 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:42.315+0000 7f0ce5b07640 1 -- 172.21.15.115:0/1949372324 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0ce00ffc80 msgr2=0x7f0ce0194a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:05:42.319 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:42.315+0000 7f0ce5b07640 1 --2- 172.21.15.115:0/1949372324 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0ce00ffc80 0x7f0ce0194a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:42.319 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:42.316+0000 7f0ce5b07640 1 -- 172.21.15.115:0/1949372324 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cd0009560 con 0x7f0ce00fea80 2024-09-13T17:05:42.319 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:42.316+0000 7f0ce5b07640 1 --2- 172.21.15.115:0/1949372324 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ce00fea80 0x7f0ce0194540 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc007780 tx=0x7f0cdc007c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:05:42.319 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:42.316+0000 7f0cd6ffd640 1 -- 172.21.15.115:0/1949372324 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0cdc017a30 con 0x7f0ce00fea80 2024-09-13T17:05:42.319 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:42.316+0000 7f0cd6ffd640 1 -- 172.21.15.115:0/1949372324 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0cdc00c070 con 0x7f0ce00fea80 2024-09-13T17:05:42.319 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:42.316+0000 7f0ce7d6b640 1 -- 172.21.15.115:0/1949372324 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ce00685a0 con 0x7f0ce00fea80 2024-09-13T17:05:42.319 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:42.316+0000 7f0cd6ffd640 1 -- 172.21.15.115:0/1949372324 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0cdc01e590 con 0x7f0ce00fea80 2024-09-13T17:05:42.319 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:42.316+0000 7f0ce7d6b640 1 -- 172.21.15.115:0/1949372324 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ce0068b10 con 0x7f0ce00fea80 2024-09-13T17:05:42.319 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:42.318+0000 7f0ce7d6b640 1 -- 172.21.15.115:0/1949372324 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ce01075d0 con 0x7f0ce00fea80 2024-09-13T17:05:42.320 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:42.318+0000 7f0cd6ffd640 1 -- 172.21.15.115:0/1949372324 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 24) v1 ==== 90954+0+0 (secure 0 0 0) 0x7f0cdc01e6f0 con 0x7f0ce00fea80 2024-09-13T17:05:42.320 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:42.319+0000 7f0cd6ffd640 1 --2- 172.21.15.115:0/1949372324 >> [v2:172.21.15.195:6828/1660911692,v1:172.21.15.195:6829/1660911692] conn(0x7f0ccc06cde0 0x7f0ccc06f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:05:42.320 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:42.319+0000 7f0cd6ffd640 1 -- 172.21.15.115:0/1949372324 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f0cdc093bf0 con 0x7f0ce00fea80 2024-09-13T17:05:42.321 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:42.319+0000 7f0ce5306640 1 --2- 172.21.15.115:0/1949372324 >> [v2:172.21.15.195:6828/1660911692,v1:172.21.15.195:6829/1660911692] conn(0x7f0ccc06cde0 0x7f0ccc06f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:05:42.321 INFO:tasks.workunit.client.0.smithi115.stdout:5/121: mkdir d19/d2b 0 2024-09-13T17:05:42.321 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:42.321+0000 7f0ce5306640 1 --2- 172.21.15.115:0/1949372324 >> [v2:172.21.15.195:6828/1660911692,v1:172.21.15.195:6829/1660911692] conn(0x7f0ccc06cde0 0x7f0ccc06f2a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0ce0195a60 tx=0x7f0cd0031400 comp rx=0 tx=0).ready entity=mgr.24317 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:05:42.322 INFO:tasks.workunit.client.1.smithi195.stdout:5/167: mknod d2/d4/c37 0 2024-09-13T17:05:42.323 INFO:tasks.workunit.client.0.smithi115.stdout:4/141: truncate f3 2749400 0 2024-09-13T17:05:42.323 INFO:tasks.workunit.client.0.smithi115.stdout:4/142: write d7/dd/de/f10 [620637,130836] 0 2024-09-13T17:05:42.325 INFO:tasks.workunit.client.0.smithi115.stdout:3/294: symlink d1/d12/d14/d61/l63 0 2024-09-13T17:05:42.325 INFO:tasks.workunit.client.1.smithi195.stdout:8/153: mknod d0/d13/c32 0 2024-09-13T17:05:42.325 INFO:tasks.workunit.client.1.smithi195.stdout:3/126: rename d7/c1b to d7/c1d 0 2024-09-13T17:05:42.326 INFO:tasks.workunit.client.0.smithi115.stdout:9/81: rename d0/de/d10/d15/f17 to d0/f1f 0 2024-09-13T17:05:42.326 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:41 smithi195 ceph-mon[34981]: from='client.24365 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:05:42.326 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:41 smithi195 ceph-mon[34981]: from='client.14624 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:05:42.327 INFO:tasks.workunit.client.0.smithi115.stdout:5/122: mkdir d19/d2c 0 2024-09-13T17:05:42.328 INFO:tasks.workunit.client.1.smithi195.stdout:3/127: mkdir d7/d19/d1e 0 2024-09-13T17:05:42.328 INFO:tasks.workunit.client.1.smithi195.stdout:3/128: chown d7/f13 202821891 1 2024-09-13T17:05:42.328 INFO:tasks.workunit.client.1.smithi195.stdout:3/129: write d7/f14 [895573,99686] 0 2024-09-13T17:05:42.328 INFO:tasks.workunit.client.1.smithi195.stdout:3/130: chown d7/l17 6987290 1 2024-09-13T17:05:42.328 INFO:tasks.workunit.client.0.smithi115.stdout:4/143: symlink d7/dd/de/l27 0 2024-09-13T17:05:42.329 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:42.328+0000 7f0cd6ffd640 1 -- 172.21.15.115:0/1949372324 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f0cdc05dd30 con 0x7f0ce00fea80 2024-09-13T17:05:42.330 INFO:tasks.workunit.client.0.smithi115.stdout:9/82: unlink d0/de/f1a 0 2024-09-13T17:05:42.330 INFO:tasks.workunit.client.0.smithi115.stdout:9/83: creat d0/de/d10/d15/f20 x:0 0 0 2024-09-13T17:05:42.331 INFO:tasks.workunit.client.0.smithi115.stdout:9/84: write d0/de/d10/f14 [83637,43832] 0 2024-09-13T17:05:42.331 INFO:tasks.workunit.client.1.smithi195.stdout:7/197: dread d5/d13/f1d [0,4194304] 0 2024-09-13T17:05:42.331 INFO:tasks.workunit.client.1.smithi195.stdout:7/198: write d5/d13/f1d [2791692,20709] 0 2024-09-13T17:05:42.331 INFO:tasks.workunit.client.1.smithi195.stdout:7/199: chown d5/d35 0 1 2024-09-13T17:05:42.332 INFO:tasks.workunit.client.0.smithi115.stdout:4/144: mknod d7/c28 0 2024-09-13T17:05:42.332 INFO:tasks.workunit.client.1.smithi195.stdout:4/188: dwrite d1a/d1f/d23/d29/f3f [0,4194304] 0 2024-09-13T17:05:42.333 INFO:tasks.workunit.client.1.smithi195.stdout:3/131: mknod d7/d19/c1f 0 2024-09-13T17:05:42.333 INFO:tasks.workunit.client.1.smithi195.stdout:2/141: dread d0/d3/df/f10 [4194304,4194304] 0 2024-09-13T17:05:42.338 INFO:tasks.workunit.client.1.smithi195.stdout:3/132: readlink d7/l10 0 2024-09-13T17:05:42.338 INFO:tasks.workunit.client.1.smithi195.stdout:2/142: rename d0/d3/df/c1d to d0/d3/c2f 0 2024-09-13T17:05:42.338 INFO:tasks.workunit.client.1.smithi195.stdout:2/143: fsync d0/d3/df/f20 0 2024-09-13T17:05:42.340 INFO:tasks.workunit.client.1.smithi195.stdout:6/125: dwrite ff [4194304,4194304] 0 2024-09-13T17:05:42.341 INFO:tasks.workunit.client.1.smithi195.stdout:2/144: rename d0/d3/df/c2e to d0/c30 0 2024-09-13T17:05:42.347 INFO:tasks.workunit.client.0.smithi115.stdout:3/295: fsync d1/d4b/f1b 0 2024-09-13T17:05:42.347 INFO:tasks.workunit.client.0.smithi115.stdout:9/85: dread d0/de/d10/f13 [0,4194304] 0 2024-09-13T17:05:42.348 INFO:tasks.workunit.client.1.smithi195.stdout:6/126: mknod d1c/d24/c26 0 2024-09-13T17:05:42.349 INFO:tasks.workunit.client.0.smithi115.stdout:5/123: dread d19/f25 [0,4194304] 0 2024-09-13T17:05:42.350 INFO:tasks.workunit.client.1.smithi195.stdout:2/145: creat d0/d1a/d1c/d1e/f31 x:0 0 0 2024-09-13T17:05:42.350 INFO:tasks.workunit.client.1.smithi195.stdout:7/200: dread d5/fa [0,4194304] 0 2024-09-13T17:05:42.350 INFO:tasks.workunit.client.1.smithi195.stdout:2/146: chown d0/d3/df/d11/l15 1910165 1 2024-09-13T17:05:42.350 INFO:tasks.workunit.client.0.smithi115.stdout:7/48: getdents d0/dc 0 2024-09-13T17:05:42.351 INFO:tasks.workunit.client.0.smithi115.stdout:7/49: fdatasync d0/f1 0 2024-09-13T17:05:42.354 INFO:tasks.workunit.client.0.smithi115.stdout:3/296: link d1/d12/c17 d1/d4b/d1a/c64 0 2024-09-13T17:05:42.354 INFO:tasks.workunit.client.1.smithi195.stdout:3/133: write d7/f12 [1011620,15400] 0 2024-09-13T17:05:42.355 INFO:tasks.workunit.client.1.smithi195.stdout:7/201: dread d5/db/fc [0,4194304] 0 2024-09-13T17:05:42.355 INFO:tasks.workunit.client.1.smithi195.stdout:7/202: write d5/d13/f1d [3828400,107541] 0 2024-09-13T17:05:42.355 INFO:tasks.workunit.client.0.smithi115.stdout:9/86: rmdir d0 39 2024-09-13T17:05:42.356 INFO:tasks.workunit.client.0.smithi115.stdout:5/124: mknod d19/d2c/c2d 0 2024-09-13T17:05:42.357 INFO:tasks.workunit.client.0.smithi115.stdout:3/297: mknod d1/d12/c65 0 2024-09-13T17:05:42.357 INFO:tasks.workunit.client.0.smithi115.stdout:3/298: read d1/d4b/d1a/f20 [6075714,4831] 0 2024-09-13T17:05:42.357 INFO:tasks.workunit.client.0.smithi115.stdout:3/299: truncate d1/d12/d23/f3a 748650 0 2024-09-13T17:05:42.358 INFO:tasks.workunit.client.1.smithi195.stdout:8/154: write d0/f3 [1669736,74306] 0 2024-09-13T17:05:42.358 INFO:tasks.workunit.client.1.smithi195.stdout:7/203: getdents d5/d35 0 2024-09-13T17:05:42.359 INFO:tasks.workunit.client.1.smithi195.stdout:0/143: dwrite f6 [0,4194304] 0 2024-09-13T17:05:42.360 INFO:tasks.workunit.client.0.smithi115.stdout:5/125: mkdir d19/d2e 0 2024-09-13T17:05:42.361 INFO:tasks.workunit.client.0.smithi115.stdout:5/126: chown f5 129233923 1 2024-09-13T17:05:42.361 INFO:tasks.workunit.client.0.smithi115.stdout:5/127: chown d19/d21/f29 198 1 2024-09-13T17:05:42.361 INFO:tasks.workunit.client.0.smithi115.stdout:5/128: chown d19/d21 22530 1 2024-09-13T17:05:42.365 INFO:tasks.workunit.client.1.smithi195.stdout:8/155: mknod d0/c33 0 2024-09-13T17:05:42.366 INFO:tasks.workunit.client.0.smithi115.stdout:5/129: rename d19/d21/f29 to d19/d1d/f2f 0 2024-09-13T17:05:42.368 INFO:tasks.workunit.client.1.smithi195.stdout:7/204: symlink d5/l41 0 2024-09-13T17:05:42.368 INFO:tasks.workunit.client.1.smithi195.stdout:6/127: write f2 [3553501,94399] 0 2024-09-13T17:05:42.368 INFO:tasks.workunit.client.0.smithi115.stdout:3/300: rmdir d1/d12/d23 39 2024-09-13T17:05:42.369 INFO:tasks.workunit.client.0.smithi115.stdout:1/75: dwrite d5/d7/f16 [0,4194304] 0 2024-09-13T17:05:42.370 INFO:tasks.workunit.client.1.smithi195.stdout:0/144: symlink d7/d8/df/l20 0 2024-09-13T17:05:42.373 INFO:tasks.workunit.client.1.smithi195.stdout:8/156: rmdir d0/d17 39 2024-09-13T17:05:42.374 INFO:tasks.workunit.client.0.smithi115.stdout:3/301: symlink d1/d12/l66 0 2024-09-13T17:05:42.376 INFO:tasks.workunit.client.1.smithi195.stdout:6/128: rmdir d1c/d24 39 2024-09-13T17:05:42.378 INFO:tasks.workunit.client.0.smithi115.stdout:8/95: dwrite d0/fb [0,4194304] 0 2024-09-13T17:05:42.379 INFO:tasks.workunit.client.1.smithi195.stdout:0/145: write f3 [2703459,11347] 0 2024-09-13T17:05:42.379 INFO:tasks.workunit.client.1.smithi195.stdout:0/146: chown d7/d8/df/l19 59566541 1 2024-09-13T17:05:42.379 INFO:tasks.workunit.client.1.smithi195.stdout:0/147: creat d7/d8/d16/f21 x:0 0 0 2024-09-13T17:05:42.380 INFO:tasks.workunit.client.0.smithi115.stdout:1/76: mknod d5/c1b 0 2024-09-13T17:05:42.380 INFO:tasks.workunit.client.0.smithi115.stdout:1/77: fdatasync d5/d7/ff 0 2024-09-13T17:05:42.380 INFO:tasks.workunit.client.0.smithi115.stdout:1/78: dread - d5/d7/ff zero size 2024-09-13T17:05:42.382 INFO:tasks.workunit.client.0.smithi115.stdout:3/302: symlink d1/l67 0 2024-09-13T17:05:42.383 INFO:tasks.workunit.client.1.smithi195.stdout:0/148: mknod d7/db/c22 0 2024-09-13T17:05:42.383 INFO:tasks.workunit.client.1.smithi195.stdout:7/205: read d5/d13/d30/f34 [2481524,112403] 0 2024-09-13T17:05:42.384 INFO:tasks.workunit.client.1.smithi195.stdout:0/149: dread d7/d8/d16/f1c [0,4194304] 0 2024-09-13T17:05:42.385 INFO:tasks.workunit.client.0.smithi115.stdout:1/79: link d5/d7/l17 d5/d7/l1c 0 2024-09-13T17:05:42.386 INFO:tasks.workunit.client.1.smithi195.stdout:5/168: dwrite d2/f17 [0,4194304] 0 2024-09-13T17:05:42.386 INFO:tasks.workunit.client.0.smithi115.stdout:6/70: dwrite d8/db/ff [0,4194304] 0 2024-09-13T17:05:42.387 INFO:tasks.workunit.client.1.smithi195.stdout:2/147: dwrite d0/d1a/d1c/d1e/f19 [0,4194304] 0 2024-09-13T17:05:42.387 INFO:tasks.workunit.client.0.smithi115.stdout:3/303: link d1/d12/c46 d1/d4b/d1a/d30/c68 0 2024-09-13T17:05:42.391 INFO:tasks.workunit.client.1.smithi195.stdout:0/150: unlink d7/d8/f15 0 2024-09-13T17:05:42.391 INFO:tasks.workunit.client.0.smithi115.stdout:8/96: dread d0/f13 [0,4194304] 0 2024-09-13T17:05:42.391 INFO:tasks.workunit.client.0.smithi115.stdout:8/97: chown d0/f13 96 1 2024-09-13T17:05:42.397 INFO:tasks.workunit.client.0.smithi115.stdout:1/80: mknod d5/c1d 0 2024-09-13T17:05:42.397 INFO:tasks.workunit.client.0.smithi115.stdout:1/81: write d5/d7/f15 [24652,118493] 0 2024-09-13T17:05:42.397 INFO:tasks.workunit.client.0.smithi115.stdout:1/82: stat d5/fc 0 2024-09-13T17:05:42.399 INFO:tasks.workunit.client.0.smithi115.stdout:4/145: truncate d7/dd/de/f10 416641 0 2024-09-13T17:05:42.399 INFO:tasks.workunit.client.0.smithi115.stdout:4/146: stat f3 0 2024-09-13T17:05:42.399 INFO:tasks.workunit.client.0.smithi115.stdout:4/147: read d7/dd/f1e [1184001,27730] 0 2024-09-13T17:05:42.399 INFO:tasks.workunit.client.1.smithi195.stdout:6/129: dread f2 [0,4194304] 0 2024-09-13T17:05:42.400 INFO:tasks.workunit.client.1.smithi195.stdout:6/130: write f2 [4882910,128404] 0 2024-09-13T17:05:42.400 INFO:tasks.workunit.client.1.smithi195.stdout:8/157: dwrite d0/f8 [4194304,4194304] 0 2024-09-13T17:05:42.408 INFO:tasks.workunit.client.0.smithi115.stdout:4/148: creat d7/f29 x:0 0 0 2024-09-13T17:05:42.408 INFO:tasks.workunit.client.0.smithi115.stdout:4/149: readlink l2 0 2024-09-13T17:05:42.411 INFO:tasks.workunit.client.1.smithi195.stdout:0/151: dread f6 [0,4194304] 0 2024-09-13T17:05:42.412 INFO:tasks.workunit.client.0.smithi115.stdout:6/71: write d8/db/ff [1620793,9479] 0 2024-09-13T17:05:42.412 INFO:tasks.workunit.client.0.smithi115.stdout:6/72: truncate d8/db/ff 5023863 0 2024-09-13T17:05:42.412 INFO:tasks.workunit.client.0.smithi115.stdout:6/73: stat d8/c10 0 2024-09-13T17:05:42.413 INFO:tasks.workunit.client.0.smithi115.stdout:6/74: chown f6 593 1 2024-09-13T17:05:42.413 INFO:tasks.workunit.client.0.smithi115.stdout:8/98: write d0/f13 [189916,84373] 0 2024-09-13T17:05:42.413 INFO:tasks.workunit.client.0.smithi115.stdout:5/130: rmdir d19/d1d 39 2024-09-13T17:05:42.413 INFO:tasks.workunit.client.0.smithi115.stdout:5/131: write d19/d1d/f26 [17898,26630] 0 2024-09-13T17:05:42.417 INFO:tasks.workunit.client.0.smithi115.stdout:3/304: dwrite d1/d4b/d1a/f27 [4194304,4194304] 0 2024-09-13T17:05:42.421 INFO:tasks.workunit.client.1.smithi195.stdout:3/134: dread d7/f14 [0,4194304] 0 2024-09-13T17:05:42.422 INFO:tasks.workunit.client.1.smithi195.stdout:7/206: dwrite d5/db/d19/f18 [0,4194304] 0 2024-09-13T17:05:42.422 INFO:tasks.workunit.client.1.smithi195.stdout:7/207: chown d5/d13/d24/l29 2134446580 1 2024-09-13T17:05:42.422 INFO:tasks.workunit.client.1.smithi195.stdout:0/152: mkdir d7/d8/d23 0 2024-09-13T17:05:42.424 INFO:tasks.workunit.client.0.smithi115.stdout:3/305: mkdir d1/d4b/d69 0 2024-09-13T17:05:42.426 INFO:tasks.workunit.client.1.smithi195.stdout:3/135: rename d7/c1d to d7/d19/c20 0 2024-09-13T17:05:42.427 INFO:tasks.workunit.client.1.smithi195.stdout:7/208: stat d5/db/c3a 0 2024-09-13T17:05:42.427 INFO:tasks.workunit.client.1.smithi195.stdout:7/209: chown d5/db/d19/f18 22020 1 2024-09-13T17:05:42.429 INFO:tasks.workunit.client.0.smithi115.stdout:3/306: creat d1/d4b/d69/f6a x:0 0 0 2024-09-13T17:05:42.430 INFO:tasks.workunit.client.1.smithi195.stdout:0/153: mknod d7/d8/d23/c24 0 2024-09-13T17:05:42.431 INFO:tasks.workunit.client.0.smithi115.stdout:6/75: write f5 [1966368,89425] 0 2024-09-13T17:05:42.435 INFO:tasks.workunit.client.1.smithi195.stdout:3/136: mkdir d7/d21 0 2024-09-13T17:05:42.435 INFO:tasks.workunit.client.1.smithi195.stdout:3/137: fdatasync f5 0 2024-09-13T17:05:42.435 INFO:tasks.workunit.client.1.smithi195.stdout:3/138: fsync d7/f13 0 2024-09-13T17:05:42.438 INFO:tasks.workunit.client.1.smithi195.stdout:3/139: dread f5 [0,4194304] 0 2024-09-13T17:05:42.439 INFO:tasks.workunit.client.1.smithi195.stdout:4/189: dwrite f0 [8388608,4194304] 0 2024-09-13T17:05:42.440 INFO:tasks.workunit.client.1.smithi195.stdout:8/158: dwrite d0/d17/f1d [0,4194304] 0 2024-09-13T17:05:42.441 INFO:tasks.workunit.client.1.smithi195.stdout:5/169: dwrite d2/d7/d32/f33 [0,4194304] 0 2024-09-13T17:05:42.441 INFO:tasks.workunit.client.0.smithi115.stdout:8/99: dwrite d0/fc [0,4194304] 0 2024-09-13T17:05:42.447 INFO:tasks.workunit.client.0.smithi115.stdout:4/150: dwrite f3 [0,4194304] 0 2024-09-13T17:05:42.447 INFO:tasks.workunit.client.0.smithi115.stdout:4/151: creat d7/dd/f2a x:0 0 0 2024-09-13T17:05:42.447 INFO:tasks.workunit.client.0.smithi115.stdout:4/152: creat d7/dd/f2b x:0 0 0 2024-09-13T17:05:42.447 INFO:tasks.workunit.client.0.smithi115.stdout:4/153: chown d7/dd/f2a 182758693 1 2024-09-13T17:05:42.448 INFO:tasks.workunit.client.0.smithi115.stdout:4/154: write f3 [5166861,108482] 0 2024-09-13T17:05:42.448 INFO:tasks.workunit.client.0.smithi115.stdout:4/155: creat d7/dd/f2c x:0 0 0 2024-09-13T17:05:42.455 INFO:tasks.workunit.client.1.smithi195.stdout:4/190: unlink d1a/d1f/d23/d29/l35 0 2024-09-13T17:05:42.457 INFO:tasks.workunit.client.1.smithi195.stdout:8/159: dread d0/d4/fb [0,4194304] 0 2024-09-13T17:05:42.461 INFO:tasks.workunit.client.0.smithi115.stdout:8/100: write d0/fb [1641382,109854] 0 2024-09-13T17:05:42.461 INFO:tasks.workunit.client.1.smithi195.stdout:1/111: sync 2024-09-13T17:05:42.461 INFO:tasks.workunit.client.1.smithi195.stdout:9/145: sync 2024-09-13T17:05:42.461 INFO:tasks.workunit.client.1.smithi195.stdout:1/112: chown db/df/d13/f21 0 1 2024-09-13T17:05:42.461 INFO:tasks.workunit.client.1.smithi195.stdout:1/113: stat db/f11 0 2024-09-13T17:05:42.461 INFO:tasks.workunit.client.1.smithi195.stdout:1/114: chown db/f1c 16875 1 2024-09-13T17:05:42.461 INFO:tasks.workunit.client.1.smithi195.stdout:1/115: creat db/df/f29 x:0 0 0 2024-09-13T17:05:42.463 INFO:tasks.workunit.client.1.smithi195.stdout:8/160: dread d0/f3 [0,4194304] 0 2024-09-13T17:05:42.463 INFO:tasks.workunit.client.1.smithi195.stdout:8/161: truncate d0/d17/f1b 158293 0 2024-09-13T17:05:42.465 INFO:tasks.workunit.client.0.smithi115.stdout:4/156: rename d7/f9 to d7/f2d 0 2024-09-13T17:05:42.466 INFO:tasks.workunit.client.1.smithi195.stdout:4/191: mkdir d1a/d1f/d23/d24/d41 0 2024-09-13T17:05:42.466 INFO:tasks.workunit.client.1.smithi195.stdout:4/192: fsync fb 0 2024-09-13T17:05:42.466 INFO:tasks.workunit.client.1.smithi195.stdout:4/193: fdatasync d1a/d1f/d23/d24/f25 0 2024-09-13T17:05:42.466 INFO:tasks.workunit.client.1.smithi195.stdout:4/194: creat d1a/d1f/d21/d22/f42 x:0 0 0 2024-09-13T17:05:42.467 INFO:tasks.workunit.client.1.smithi195.stdout:7/210: dwrite f4 [0,4194304] 0 2024-09-13T17:05:42.467 INFO:tasks.workunit.client.1.smithi195.stdout:7/211: write d5/f6 [5108943,90540] 0 2024-09-13T17:05:42.467 INFO:tasks.workunit.client.1.smithi195.stdout:9/146: creat d6/d19/d21/f33 x:0 0 0 2024-09-13T17:05:42.471 INFO:tasks.workunit.client.1.smithi195.stdout:1/116: creat db/d19/f2a x:0 0 0 2024-09-13T17:05:42.472 INFO:tasks.workunit.client.1.smithi195.stdout:0/154: dwrite f1 [0,4194304] 0 2024-09-13T17:05:42.473 INFO:tasks.workunit.client.1.smithi195.stdout:1/117: dread db/df/f16 [0,4194304] 0 2024-09-13T17:05:42.473 INFO:tasks.workunit.client.1.smithi195.stdout:1/118: truncate db/df/f28 384776 0 2024-09-13T17:05:42.474 INFO:tasks.workunit.client.1.smithi195.stdout:1/119: write db/f17 [36557,106877] 0 2024-09-13T17:05:42.475 INFO:tasks.workunit.client.0.smithi115.stdout:4/157: dread d7/f2d [0,4194304] 0 2024-09-13T17:05:42.476 INFO:tasks.workunit.client.0.smithi115.stdout:4/158: creat d7/f2e x:0 0 0 2024-09-13T17:05:42.476 INFO:tasks.workunit.client.0.smithi115.stdout:4/159: write d7/f12 [1815238,58027] 0 2024-09-13T17:05:42.476 INFO:tasks.workunit.client.0.smithi115.stdout:4/160: read d7/dd/de/f1c [2611401,53762] 0 2024-09-13T17:05:42.476 INFO:tasks.workunit.client.0.smithi115.stdout:4/161: dread - d7/dd/f26 zero size 2024-09-13T17:05:42.476 INFO:tasks.workunit.client.0.smithi115.stdout:4/162: stat d7 0 2024-09-13T17:05:42.478 INFO:tasks.workunit.client.1.smithi195.stdout:7/212: stat d5/db/d19/c2f 0 2024-09-13T17:05:42.478 INFO:tasks.workunit.client.1.smithi195.stdout:7/213: write d5/d13/d30/f34 [4735627,69661] 0 2024-09-13T17:05:42.478 INFO:tasks.workunit.client.1.smithi195.stdout:7/214: dread - d5/db/d19/f33 zero size 2024-09-13T17:05:42.478 INFO:tasks.workunit.client.1.smithi195.stdout:7/215: fsync f4 0 2024-09-13T17:05:42.479 INFO:tasks.workunit.client.1.smithi195.stdout:7/216: stat d5/db/l1f 0 2024-09-13T17:05:42.479 INFO:tasks.workunit.client.1.smithi195.stdout:7/217: dread - d5/d13/d30/f36 zero size 2024-09-13T17:05:42.480 INFO:tasks.workunit.client.0.smithi115.stdout:3/307: dwrite d1/d12/f5e [0,4194304] 0 2024-09-13T17:05:42.480 INFO:tasks.workunit.client.0.smithi115.stdout:6/76: dwrite d8/db/f12 [0,4194304] 0 2024-09-13T17:05:42.481 INFO:tasks.workunit.client.1.smithi195.stdout:3/140: dwrite d7/f13 [0,4194304] 0 2024-09-13T17:05:42.481 INFO:tasks.workunit.client.1.smithi195.stdout:5/170: dwrite d2/d7/f16 [0,4194304] 0 2024-09-13T17:05:42.482 INFO:tasks.workunit.client.1.smithi195.stdout:5/171: fsync d2/d4/d10/f24 0 2024-09-13T17:05:42.482 INFO:tasks.workunit.client.1.smithi195.stdout:9/147: link d6/d12/f2a d6/d19/f34 0 2024-09-13T17:05:42.482 INFO:tasks.workunit.client.1.smithi195.stdout:9/148: dread - d6/d19/d21/f33 zero size 2024-09-13T17:05:42.482 INFO:tasks.workunit.client.1.smithi195.stdout:9/149: fdatasync d6/d19/f1f 0 2024-09-13T17:05:42.483 INFO:tasks.workunit.client.1.smithi195.stdout:8/162: dwrite d0/fc [0,4194304] 0 2024-09-13T17:05:42.483 INFO:tasks.workunit.client.1.smithi195.stdout:0/155: creat d7/d8/d23/f25 x:0 0 0 2024-09-13T17:05:42.488 INFO:tasks.workunit.client.1.smithi195.stdout:1/120: creat db/f2b x:0 0 0 2024-09-13T17:05:42.488 INFO:tasks.workunit.client.1.smithi195.stdout:1/121: creat db/f2c x:0 0 0 2024-09-13T17:05:42.492 INFO:tasks.workunit.client.0.smithi115.stdout:8/101: mkdir d0/d18/d19 0 2024-09-13T17:05:42.493 INFO:tasks.workunit.client.0.smithi115.stdout:8/102: read d0/f13 [2916539,122778] 0 2024-09-13T17:05:42.498 INFO:tasks.workunit.client.1.smithi195.stdout:1/122: read db/f18 [948034,90418] 0 2024-09-13T17:05:42.499 INFO:tasks.workunit.client.1.smithi195.stdout:5/172: dwrite d2/d7/f16 [0,4194304] 0 2024-09-13T17:05:42.499 INFO:tasks.workunit.client.0.smithi115.stdout:4/163: mknod d7/dd/c2f 0 2024-09-13T17:05:42.500 INFO:tasks.workunit.client.0.smithi115.stdout:4/164: write d7/dd/de/f10 [1405101,57346] 0 2024-09-13T17:05:42.500 INFO:tasks.workunit.client.0.smithi115.stdout:4/165: truncate d7/dd/de/f23 817796 0 2024-09-13T17:05:42.501 INFO:tasks.workunit.client.1.smithi195.stdout:7/218: symlink d5/d35/l42 0 2024-09-13T17:05:42.503 INFO:tasks.workunit.client.0.smithi115.stdout:8/103: dread d0/f13 [0,4194304] 0 2024-09-13T17:05:42.505 INFO:tasks.workunit.client.0.smithi115.stdout:3/308: rename d1/d12/f5e to d1/d4b/d1a/f6b 0 2024-09-13T17:05:42.506 INFO:tasks.workunit.client.1.smithi195.stdout:3/141: truncate d7/f15 347234 0 2024-09-13T17:05:42.506 INFO:tasks.workunit.client.1.smithi195.stdout:3/142: write d7/fa [1759959,129369] 0 2024-09-13T17:05:42.508 INFO:tasks.workunit.client.1.smithi195.stdout:9/150: link d6/d12/c31 d6/df/c35 0 2024-09-13T17:05:42.510 INFO:tasks.workunit.client.0.smithi115.stdout:6/77: mkdir d8/d13 0 2024-09-13T17:05:42.512 INFO:tasks.workunit.client.1.smithi195.stdout:8/163: link d0/c23 d0/d13/c34 0 2024-09-13T17:05:42.512 INFO:tasks.workunit.client.1.smithi195.stdout:8/164: chown d0/c33 1473 1 2024-09-13T17:05:42.513 INFO:tasks.workunit.client.0.smithi115.stdout:8/104: mknod d0/c1a 0 2024-09-13T17:05:42.513 INFO:tasks.workunit.client.0.smithi115.stdout:8/105: readlink d0/l3 0 2024-09-13T17:05:42.513 INFO:tasks.workunit.client.0.smithi115.stdout:8/106: read d0/f13 [1109143,75147] 0 2024-09-13T17:05:42.514 INFO:tasks.workunit.client.1.smithi195.stdout:0/156: mknod d7/c26 0 2024-09-13T17:05:42.514 INFO:tasks.workunit.client.1.smithi195.stdout:0/157: creat d7/d8/d23/f27 x:0 0 0 2024-09-13T17:05:42.516 INFO:tasks.workunit.client.0.smithi115.stdout:4/166: rename d7/dd/de/f14 to d7/f30 0 2024-09-13T17:05:42.517 INFO:tasks.workunit.client.1.smithi195.stdout:8/165: write d0/d13/f16 [929297,36862] 0 2024-09-13T17:05:42.517 INFO:tasks.workunit.client.1.smithi195.stdout:8/166: truncate d0/f2b 144763 0 2024-09-13T17:05:42.518 INFO:tasks.workunit.client.0.smithi115.stdout:3/309: creat d1/d12/d14/d54/f6c x:0 0 0 2024-09-13T17:05:42.520 INFO:tasks.workunit.client.0.smithi115.stdout:6/78: rmdir d8 39 2024-09-13T17:05:42.520 INFO:tasks.workunit.client.1.smithi195.stdout:4/195: rename d1a/d1f/d23 to d1a/d1f/d43 0 2024-09-13T17:05:42.522 INFO:tasks.workunit.client.1.smithi195.stdout:1/123: truncate db/f18 706077 0 2024-09-13T17:05:42.525 INFO:tasks.workunit.client.0.smithi115.stdout:6/79: unlink d8/c10 0 2024-09-13T17:05:42.525 INFO:tasks.workunit.client.0.smithi115.stdout:6/80: stat d8/d13 0 2024-09-13T17:05:42.525 INFO:tasks.workunit.client.0.smithi115.stdout:6/81: write d8/db/ff [5074795,30592] 0 2024-09-13T17:05:42.530 INFO:tasks.workunit.client.1.smithi195.stdout:3/143: write d7/f13 [4510190,66222] 0 2024-09-13T17:05:42.530 INFO:tasks.workunit.client.1.smithi195.stdout:3/144: chown d7/d19/c1f 1062129343 1 2024-09-13T17:05:42.530 INFO:tasks.workunit.client.0.smithi115.stdout:8/107: dwrite d0/f13 [0,4194304] 0 2024-09-13T17:05:42.532 INFO:tasks.workunit.client.0.smithi115.stdout:6/82: symlink d8/db/l14 0 2024-09-13T17:05:42.534 INFO:tasks.workunit.client.1.smithi195.stdout:5/173: mknod d2/d12/c38 0 2024-09-13T17:05:42.536 INFO:tasks.workunit.client.1.smithi195.stdout:7/219: mknod d5/db/d19/d22/d3c/c43 0 2024-09-13T17:05:42.537 INFO:tasks.workunit.client.1.smithi195.stdout:7/220: write d5/d13/f32 [97193,120806] 0 2024-09-13T17:05:42.540 INFO:tasks.workunit.client.0.smithi115.stdout:8/108: creat d0/d15/f1b x:0 0 0 2024-09-13T17:05:42.542 INFO:tasks.workunit.client.0.smithi115.stdout:6/83: mkdir d8/d13/d15 0 2024-09-13T17:05:42.543 INFO:tasks.workunit.client.1.smithi195.stdout:9/151: creat d6/d19/f36 x:0 0 0 2024-09-13T17:05:42.547 INFO:tasks.workunit.client.0.smithi115.stdout:4/167: rmdir d7 39 2024-09-13T17:05:42.548 INFO:tasks.workunit.client.1.smithi195.stdout:0/158: unlink d7/d8/df/l20 0 2024-09-13T17:05:42.549 INFO:tasks.workunit.client.0.smithi115.stdout:8/109: creat d0/d18/f1c x:0 0 0 2024-09-13T17:05:42.551 INFO:tasks.workunit.client.1.smithi195.stdout:8/167: rename d0/d13/c24 to d0/d13/c35 0 2024-09-13T17:05:42.552 INFO:tasks.workunit.client.1.smithi195.stdout:9/152: dread d6/d19/d21/f2f [0,4194304] 0 2024-09-13T17:05:42.552 INFO:tasks.workunit.client.0.smithi115.stdout:6/84: write d8/db/f12 [3945617,38817] 0 2024-09-13T17:05:42.554 INFO:tasks.workunit.client.0.smithi115.stdout:4/168: link d7/f2e d7/f31 0 2024-09-13T17:05:42.555 INFO:tasks.workunit.client.1.smithi195.stdout:4/196: symlink d1a/l44 0 2024-09-13T17:05:42.555 INFO:tasks.workunit.client.1.smithi195.stdout:4/197: chown d1a/d1f/d43/d24/c2c 1420056 1 2024-09-13T17:05:42.559 INFO:tasks.workunit.client.1.smithi195.stdout:1/124: rename db/d19/f2a to db/df/d13/f2d 0 2024-09-13T17:05:42.560 INFO:tasks.workunit.client.0.smithi115.stdout:6/85: link f6 d8/db/dd/f16 0 2024-09-13T17:05:42.561 INFO:tasks.workunit.client.1.smithi195.stdout:8/168: write d0/fc [3916562,15864] 0 2024-09-13T17:05:42.562 INFO:tasks.workunit.client.0.smithi115.stdout:4/169: creat d7/dd/f32 x:0 0 0 2024-09-13T17:05:42.562 INFO:tasks.workunit.client.0.smithi115.stdout:4/170: fdatasync d7/dd/de/f1c 0 2024-09-13T17:05:42.562 INFO:tasks.workunit.client.0.smithi115.stdout:4/171: creat d7/dd/f33 x:0 0 0 2024-09-13T17:05:42.562 INFO:tasks.workunit.client.0.smithi115.stdout:4/172: write d7/f31 [869940,40763] 0 2024-09-13T17:05:42.563 INFO:tasks.workunit.client.1.smithi195.stdout:6/131: sync 2024-09-13T17:05:42.563 INFO:tasks.workunit.client.1.smithi195.stdout:2/148: sync 2024-09-13T17:05:42.563 INFO:tasks.workunit.client.1.smithi195.stdout:2/149: write d0/d1a/d1c/f23 [869955,35758] 0 2024-09-13T17:05:42.563 INFO:tasks.workunit.client.1.smithi195.stdout:2/150: write d0/d1a/d1c/f23 [1010495,122683] 0 2024-09-13T17:05:42.563 INFO:tasks.workunit.client.1.smithi195.stdout:2/151: stat d0/d1a/d1c/d1e/f2a 0 2024-09-13T17:05:42.565 INFO:tasks.workunit.client.0.smithi115.stdout:8/110: dwrite d0/fc [0,4194304] 0 2024-09-13T17:05:42.566 INFO:tasks.workunit.client.1.smithi195.stdout:5/174: mkdir d2/df/d39 0 2024-09-13T17:05:42.566 INFO:tasks.workunit.client.1.smithi195.stdout:5/175: write d2/d4/d10/f2f [4664754,17846] 0 2024-09-13T17:05:42.566 INFO:tasks.workunit.client.1.smithi195.stdout:5/176: chown d2/d4/f1d 22 1 2024-09-13T17:05:42.567 INFO:tasks.workunit.client.0.smithi115.stdout:6/86: mkdir d8/d9/d17 0 2024-09-13T17:05:42.568 INFO:tasks.workunit.client.1.smithi195.stdout:7/221: truncate d5/fa 2815437 0 2024-09-13T17:05:42.573 INFO:tasks.workunit.client.0.smithi115.stdout:6/87: rmdir d8/d13 39 2024-09-13T17:05:42.573 INFO:tasks.workunit.client.0.smithi115.stdout:8/111: fsync d0/d15/f1b 0 2024-09-13T17:05:42.573 INFO:tasks.workunit.client.0.smithi115.stdout:8/112: dread - d0/d15/f1b zero size 2024-09-13T17:05:42.573 INFO:tasks.workunit.client.0.smithi115.stdout:8/113: truncate d0/fb 5063315 0 2024-09-13T17:05:42.574 INFO:tasks.workunit.client.1.smithi195.stdout:5/177: dread d2/d4/d10/f15 [0,4194304] 0 2024-09-13T17:05:42.575 INFO:tasks.workunit.client.1.smithi195.stdout:0/159: symlink d7/d8/d23/l28 0 2024-09-13T17:05:42.576 INFO:tasks.workunit.client.1.smithi195.stdout:7/222: dread d5/db/d19/f18 [0,4194304] 0 2024-09-13T17:05:42.576 INFO:tasks.workunit.client.1.smithi195.stdout:7/223: fsync d5/db/fc 0 2024-09-13T17:05:42.578 INFO:tasks.workunit.client.1.smithi195.stdout:9/153: unlink d6/d12/f30 0 2024-09-13T17:05:42.578 INFO:tasks.workunit.client.1.smithi195.stdout:9/154: chown d6/d19/d21/f33 6 1 2024-09-13T17:05:42.579 INFO:tasks.workunit.client.1.smithi195.stdout:9/155: dread d6/d12/f2a [0,4194304] 0 2024-09-13T17:05:42.579 INFO:tasks.workunit.client.1.smithi195.stdout:9/156: fsync d6/d19/f36 0 2024-09-13T17:05:42.579 INFO:tasks.workunit.client.1.smithi195.stdout:9/157: fdatasync d6/df/d16/f32 0 2024-09-13T17:05:42.580 INFO:tasks.workunit.client.1.smithi195.stdout:4/198: symlink d1a/d1f/d21/d22/l45 0 2024-09-13T17:05:42.583 INFO:tasks.workunit.client.0.smithi115.stdout:6/88: creat d8/d9/de/f18 x:0 0 0 2024-09-13T17:05:42.583 INFO:tasks.workunit.client.0.smithi115.stdout:6/89: fsync d8/db/ff 0 2024-09-13T17:05:42.583 INFO:tasks.workunit.client.0.smithi115.stdout:6/90: stat d8/d9 0 2024-09-13T17:05:42.584 INFO:tasks.workunit.client.1.smithi195.stdout:0/160: dread f6 [0,4194304] 0 2024-09-13T17:05:42.584 INFO:tasks.workunit.client.1.smithi195.stdout:0/161: write d7/d8/d23/f25 [491032,9451] 0 2024-09-13T17:05:42.584 INFO:tasks.workunit.client.0.smithi115.stdout:8/114: dread d0/fc [0,4194304] 0 2024-09-13T17:05:42.585 INFO:tasks.workunit.client.1.smithi195.stdout:6/132: link l3 d1c/d24/l27 0 2024-09-13T17:05:42.586 INFO:tasks.workunit.client.1.smithi195.stdout:1/125: dwrite db/df/d13/f1e [0,4194304] 0 2024-09-13T17:05:42.587 INFO:tasks.workunit.client.1.smithi195.stdout:2/152: creat d0/d3/df/d11/f32 x:0 0 0 2024-09-13T17:05:42.587 INFO:tasks.workunit.client.1.smithi195.stdout:9/158: dread d6/f25 [0,4194304] 0 2024-09-13T17:05:42.588 INFO:tasks.workunit.client.1.smithi195.stdout:1/126: dread db/f11 [0,4194304] 0 2024-09-13T17:05:42.588 INFO:tasks.workunit.client.1.smithi195.stdout:1/127: creat db/df/d13/f2e x:0 0 0 2024-09-13T17:05:42.588 INFO:tasks.workunit.client.1.smithi195.stdout:1/128: write db/df/f26 [357866,5366] 0 2024-09-13T17:05:42.589 INFO:tasks.workunit.client.1.smithi195.stdout:5/178: unlink d2/d12/f1b 0 2024-09-13T17:05:42.589 INFO:tasks.workunit.client.1.smithi195.stdout:5/179: creat d2/d7/f3a x:0 0 0 2024-09-13T17:05:42.589 INFO:tasks.workunit.client.1.smithi195.stdout:5/180: creat d2/d4/f3b x:0 0 0 2024-09-13T17:05:42.590 INFO:tasks.workunit.client.1.smithi195.stdout:7/224: symlink d5/db/l44 0 2024-09-13T17:05:42.590 INFO:tasks.workunit.client.1.smithi195.stdout:7/225: fsync d5/db/d19/f18 0 2024-09-13T17:05:42.591 INFO:tasks.workunit.client.1.smithi195.stdout:4/199: truncate f7 1144805 0 2024-09-13T17:05:42.591 INFO:tasks.workunit.client.1.smithi195.stdout:4/200: write fb [1592126,45321] 0 2024-09-13T17:05:42.591 INFO:tasks.workunit.client.1.smithi195.stdout:4/201: chown f16 778341517 1 2024-09-13T17:05:42.594 INFO:tasks.workunit.client.1.smithi195.stdout:0/162: mknod d7/db/d11/c29 0 2024-09-13T17:05:42.594 INFO:tasks.workunit.client.1.smithi195.stdout:0/163: fdatasync d7/d8/d16/f21 0 2024-09-13T17:05:42.594 INFO:tasks.workunit.client.1.smithi195.stdout:2/153: stat d0/d1a/c27 0 2024-09-13T17:05:42.595 INFO:tasks.workunit.client.1.smithi195.stdout:8/169: dwrite d0/fc [0,4194304] 0 2024-09-13T17:05:42.595 INFO:tasks.workunit.client.1.smithi195.stdout:8/170: truncate d0/d4/fb 2575148 0 2024-09-13T17:05:42.596 INFO:tasks.workunit.client.1.smithi195.stdout:9/159: mkdir d6/df/d37 0 2024-09-13T17:05:42.596 INFO:tasks.workunit.client.1.smithi195.stdout:9/160: creat d6/df/f38 x:0 0 0 2024-09-13T17:05:42.601 INFO:tasks.workunit.client.1.smithi195.stdout:5/181: symlink d2/l3c 0 2024-09-13T17:05:42.601 INFO:tasks.workunit.client.1.smithi195.stdout:5/182: readlink d2/d12/l13 0 2024-09-13T17:05:42.602 INFO:tasks.workunit.client.1.smithi195.stdout:6/133: dread fd [0,4194304] 0 2024-09-13T17:05:42.602 INFO:tasks.workunit.client.0.smithi115.stdout:6/91: dread d8/db/ff [0,4194304] 0 2024-09-13T17:05:42.603 INFO:tasks.workunit.client.1.smithi195.stdout:4/202: link d1a/d1f/d21/d22/f3b d1a/d1f/d21/d36/f46 0 2024-09-13T17:05:42.605 INFO:tasks.workunit.client.0.smithi115.stdout:8/115: dread d0/fb [0,4194304] 0 2024-09-13T17:05:42.605 INFO:tasks.workunit.client.0.smithi115.stdout:8/116: readlink d0/le 0 2024-09-13T17:05:42.606 INFO:tasks.workunit.client.1.smithi195.stdout:0/164: truncate d7/d8/d16/f1c 336891 0 2024-09-13T17:05:42.606 INFO:tasks.workunit.client.1.smithi195.stdout:0/165: write f3 [3739583,75390] 0 2024-09-13T17:05:42.610 INFO:tasks.workunit.client.0.smithi115.stdout:6/92: creat d8/d13/f19 x:0 0 0 2024-09-13T17:05:42.610 INFO:tasks.workunit.client.0.smithi115.stdout:4/173: fsync d7/dd/f33 0 2024-09-13T17:05:42.612 INFO:tasks.workunit.client.1.smithi195.stdout:2/154: unlink d0/d3/df/d11/c1b 0 2024-09-13T17:05:42.617 INFO:tasks.workunit.client.1.smithi195.stdout:8/171: mknod d0/d17/d2f/d31/c36 0 2024-09-13T17:05:42.618 INFO:tasks.workunit.client.0.smithi115.stdout:8/117: link d0/fc d0/f1d 0 2024-09-13T17:05:42.619 INFO:tasks.workunit.client.1.smithi195.stdout:8/172: write d0/d4/fb [163303,74117] 0 2024-09-13T17:05:42.623 INFO:tasks.workunit.client.1.smithi195.stdout:9/161: mkdir d6/d12/d39 0 2024-09-13T17:05:42.623 INFO:tasks.workunit.client.1.smithi195.stdout:9/162: dread - d6/df/d16/f32 zero size 2024-09-13T17:05:42.624 INFO:tasks.workunit.client.1.smithi195.stdout:1/129: dwrite db/df/d13/f2d [0,4194304] 0 2024-09-13T17:05:42.625 INFO:tasks.workunit.client.1.smithi195.stdout:7/226: dwrite d5/d13/d30/f36 [0,4194304] 0 2024-09-13T17:05:42.627 INFO:tasks.workunit.client.0.smithi115.stdout:8/118: dread d0/fb [0,4194304] 0 2024-09-13T17:05:42.627 INFO:tasks.workunit.client.0.smithi115.stdout:8/119: fdatasync d0/d15/f1b 0 2024-09-13T17:05:42.627 INFO:tasks.workunit.client.0.smithi115.stdout:6/93: unlink d8/db/f11 0 2024-09-13T17:05:42.627 INFO:tasks.workunit.client.0.smithi115.stdout:6/94: truncate d8/d9/de/f18 581613 0 2024-09-13T17:05:42.628 INFO:tasks.workunit.client.1.smithi195.stdout:0/166: rename d7/db/d11/c29 to d7/d10/c2a 0 2024-09-13T17:05:42.630 INFO:tasks.workunit.client.0.smithi115.stdout:4/174: mknod d7/c34 0 2024-09-13T17:05:42.631 INFO:tasks.workunit.client.1.smithi195.stdout:2/155: unlink d0/d1a/d1c/d1e/f19 0 2024-09-13T17:05:42.631 INFO:tasks.workunit.client.1.smithi195.stdout:2/156: stat d0/d3/f26 0 2024-09-13T17:05:42.632 INFO:tasks.workunit.client.0.smithi115.stdout:8/120: symlink d0/d18/d19/l1e 0 2024-09-13T17:05:42.632 INFO:tasks.workunit.client.0.smithi115.stdout:8/121: write d0/d15/f1b [30253,28120] 0 2024-09-13T17:05:42.634 INFO:tasks.workunit.client.1.smithi195.stdout:4/203: dwrite d1a/d1f/d43/f3d [0,4194304] 0 2024-09-13T17:05:42.635 INFO:tasks.workunit.client.0.smithi115.stdout:4/175: rename d7/fa to d7/f35 0 2024-09-13T17:05:42.635 INFO:tasks.workunit.client.0.smithi115.stdout:4/176: dread - d7/fc zero size 2024-09-13T17:05:42.636 INFO:tasks.workunit.client.1.smithi195.stdout:5/183: dwrite d2/d7/f3a [0,4194304] 0 2024-09-13T17:05:42.638 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:42.635+0000 7f0ce7d6b640 1 -- 172.21.15.115:0/1949372324 --> [v2:172.21.15.195:6828/1660911692,v1:172.21.15.195:6829/1660911692] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0ce0069340 con 0x7f0ccc06cde0 2024-09-13T17:05:42.639 INFO:tasks.workunit.client.1.smithi195.stdout:8/173: creat d0/d17/d2f/d31/f37 x:0 0 0 2024-09-13T17:05:42.641 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:42.639+0000 7f0cd6ffd640 1 -- 172.21.15.115:0/1949372324 <== mgr.24317 v2:172.21.15.195:6828/1660911692 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f0ce0069340 con 0x7f0ccc06cde0 2024-09-13T17:05:42.641 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-13T17:05:42.641 INFO:teuthology.orchestra.run.smithi115.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256", 2024-09-13T17:05:42.641 INFO:teuthology.orchestra.run.smithi115.stdout: "in_progress": true, 2024-09-13T17:05:42.641 INFO:teuthology.orchestra.run.smithi115.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-13T17:05:42.641 INFO:teuthology.orchestra.run.smithi115.stdout: "services_complete": [], 2024-09-13T17:05:42.641 INFO:teuthology.orchestra.run.smithi115.stdout: "progress": "1/2 daemons upgraded", 2024-09-13T17:05:42.641 INFO:teuthology.orchestra.run.smithi115.stdout: "message": "", 2024-09-13T17:05:42.641 INFO:teuthology.orchestra.run.smithi115.stdout: "is_paused": false 2024-09-13T17:05:42.642 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-13T17:05:42.642 INFO:tasks.workunit.client.0.smithi115.stdout:4/177: link d7/fc d7/f36 0 2024-09-13T17:05:42.645 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:42.643+0000 7f0ce7d6b640 1 -- 172.21.15.115:0/1949372324 >> [v2:172.21.15.195:6828/1660911692,v1:172.21.15.195:6829/1660911692] conn(0x7f0ccc06cde0 msgr2=0x7f0ccc06f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:05:42.645 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:42.643+0000 7f0ce7d6b640 1 --2- 172.21.15.115:0/1949372324 >> [v2:172.21.15.195:6828/1660911692,v1:172.21.15.195:6829/1660911692] conn(0x7f0ccc06cde0 0x7f0ccc06f2a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0ce0195a60 tx=0x7f0cd0031400 comp rx=0 tx=0).stop 2024-09-13T17:05:42.645 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:42.643+0000 7f0ce7d6b640 1 -- 172.21.15.115:0/1949372324 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ce00fea80 msgr2=0x7f0ce0194540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:05:42.645 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:42.643+0000 7f0ce7d6b640 1 --2- 172.21.15.115:0/1949372324 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ce00fea80 0x7f0ce0194540 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc007780 tx=0x7f0cdc007c40 comp rx=0 tx=0).stop 2024-09-13T17:05:42.646 INFO:tasks.workunit.client.0.smithi115.stdout:6/95: dread d8/db/f12 [0,4194304] 0 2024-09-13T17:05:42.646 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:42.643+0000 7f0ce7d6b640 1 -- 172.21.15.115:0/1949372324 shutdown_connections 2024-09-13T17:05:42.646 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:42.643+0000 7f0ce7d6b640 1 --2- 172.21.15.115:0/1949372324 >> [v2:172.21.15.195:6828/1660911692,v1:172.21.15.195:6829/1660911692] conn(0x7f0ccc06cde0 0x7f0ccc06f2a0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:42.646 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:42.643+0000 7f0ce7d6b640 1 --2- 172.21.15.115:0/1949372324 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0ce00ffc80 0x7f0ce0194a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:42.646 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:42.644+0000 7f0ce7d6b640 1 --2- 172.21.15.115:0/1949372324 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ce00fea80 0x7f0ce0194540 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:42.646 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:42.644+0000 7f0ce7d6b640 1 -- 172.21.15.115:0/1949372324 >> 172.21.15.115:0/1949372324 conn(0x7f0ce00fa210 msgr2=0x7f0ce0102eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:05:42.647 INFO:tasks.workunit.client.0.smithi115.stdout:4/178: truncate f3 503199 0 2024-09-13T17:05:42.648 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:42.645+0000 7f0ce7d6b640 1 -- 172.21.15.115:0/1949372324 shutdown_connections 2024-09-13T17:05:42.648 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:05:42.645+0000 7f0ce7d6b640 1 -- 172.21.15.115:0/1949372324 wait complete. 2024-09-13T17:05:42.648 INFO:tasks.workunit.client.1.smithi195.stdout:9/163: unlink d6/d19/f34 0 2024-09-13T17:05:42.649 INFO:tasks.workunit.client.0.smithi115.stdout:6/96: symlink d8/d9/de/l1a 0 2024-09-13T17:05:42.655 INFO:tasks.workunit.client.1.smithi195.stdout:1/130: mkdir db/df/d13/d2f 0 2024-09-13T17:05:42.655 INFO:tasks.workunit.client.1.smithi195.stdout:1/131: chown db/df/d13/f1e 2 1 2024-09-13T17:05:42.656 INFO:tasks.workunit.client.1.smithi195.stdout:1/132: stat db/df/f16 0 2024-09-13T17:05:42.656 INFO:tasks.workunit.client.1.smithi195.stdout:1/133: chown db/df/d13/f27 2416006 1 2024-09-13T17:05:42.657 INFO:tasks.workunit.client.0.smithi115.stdout:8/122: dwrite d0/f1d [0,4194304] 0 2024-09-13T17:05:42.661 INFO:tasks.workunit.client.0.smithi115.stdout:8/123: mkdir d0/d15/d1f 0 2024-09-13T17:05:42.661 INFO:tasks.workunit.client.0.smithi115.stdout:8/124: readlink d0/l3 0 2024-09-13T17:05:42.662 INFO:tasks.workunit.client.1.smithi195.stdout:2/157: dwrite d0/d3/fe [0,4194304] 0 2024-09-13T17:05:42.663 INFO:tasks.workunit.client.1.smithi195.stdout:2/158: readlink d0/d1a/d1c/d1e/l2b 0 2024-09-13T17:05:42.663 INFO:tasks.workunit.client.1.smithi195.stdout:2/159: write d0/d1a/d1c/d1e/f31 [425179,103665] 0 2024-09-13T17:05:42.663 INFO:tasks.workunit.client.1.smithi195.stdout:2/160: readlink d0/d3/l8 0 2024-09-13T17:05:42.663 INFO:tasks.workunit.client.0.smithi115.stdout:8/125: rmdir d0 39 2024-09-13T17:05:42.664 INFO:tasks.workunit.client.0.smithi115.stdout:8/126: getdents d0/d15/d1f 0 2024-09-13T17:05:42.665 INFO:tasks.workunit.client.1.smithi195.stdout:0/167: mknod d7/db/d11/c2b 0 2024-09-13T17:05:42.669 INFO:tasks.workunit.client.1.smithi195.stdout:4/204: creat d1a/d1f/d43/d24/d41/f47 x:0 0 0 2024-09-13T17:05:42.672 INFO:tasks.workunit.client.1.smithi195.stdout:8/174: mknod d0/d13/c38 0 2024-09-13T17:05:42.673 INFO:tasks.workunit.client.0.smithi115.stdout:6/97: dwrite d8/db/dd/f16 [4194304,4194304] 0 2024-09-13T17:05:42.673 INFO:tasks.workunit.client.0.smithi115.stdout:4/179: dwrite d7/dd/de/f10 [0,4194304] 0 2024-09-13T17:05:42.673 INFO:tasks.workunit.client.0.smithi115.stdout:4/180: truncate d7/dd/f2a 128661 0 2024-09-13T17:05:42.674 INFO:tasks.workunit.client.0.smithi115.stdout:4/181: creat d7/dd/f37 x:0 0 0 2024-09-13T17:05:42.675 INFO:tasks.workunit.client.1.smithi195.stdout:1/134: dwrite db/df/d13/f2e [0,4194304] 0 2024-09-13T17:05:42.675 INFO:tasks.workunit.client.1.smithi195.stdout:9/164: rename d6/d12/c31 to d6/d12/c3a 0 2024-09-13T17:05:42.675 INFO:tasks.workunit.client.1.smithi195.stdout:9/165: getdents d6/df/d37 0 2024-09-13T17:05:42.676 INFO:tasks.workunit.client.1.smithi195.stdout:0/168: write d7/d10/f12 [2654983,66564] 0 2024-09-13T17:05:42.676 INFO:tasks.workunit.client.1.smithi195.stdout:0/169: creat d7/d8/d16/f2c x:0 0 0 2024-09-13T17:05:42.677 INFO:tasks.workunit.client.0.smithi115.stdout:6/98: symlink d8/l1b 0 2024-09-13T17:05:42.678 INFO:tasks.workunit.client.1.smithi195.stdout:8/175: dread d0/d13/f16 [0,4194304] 0 2024-09-13T17:05:42.678 INFO:tasks.workunit.client.1.smithi195.stdout:2/161: symlink d0/d1a/l33 0 2024-09-13T17:05:42.678 INFO:tasks.workunit.client.1.smithi195.stdout:2/162: getdents d0/d1a/d1c/d2c 0 2024-09-13T17:05:42.679 INFO:tasks.workunit.client.0.smithi115.stdout:6/99: dread d8/d9/de/f18 [0,4194304] 0 2024-09-13T17:05:42.679 INFO:tasks.workunit.client.0.smithi115.stdout:6/100: write f5 [5012611,120962] 0 2024-09-13T17:05:42.679 INFO:tasks.workunit.client.0.smithi115.stdout:8/127: getdents d0/d15 0 2024-09-13T17:05:42.681 INFO:tasks.workunit.client.1.smithi195.stdout:4/205: creat d1a/d1f/d43/f48 x:0 0 0 2024-09-13T17:05:42.681 INFO:tasks.workunit.client.1.smithi195.stdout:4/206: truncate d1a/d1f/d21/d22/f28 1152227 0 2024-09-13T17:05:42.687 INFO:tasks.workunit.client.1.smithi195.stdout:5/184: link d2/l3c d2/d7/d32/l3d 0 2024-09-13T17:05:42.688 INFO:tasks.workunit.client.0.smithi115.stdout:4/182: rmdir d7/dd/de 39 2024-09-13T17:05:42.689 INFO:tasks.workunit.client.1.smithi195.stdout:3/145: sync 2024-09-13T17:05:42.690 INFO:tasks.workunit.client.0.smithi115.stdout:6/101: symlink d8/d9/d17/l1c 0 2024-09-13T17:05:42.692 INFO:tasks.workunit.client.0.smithi115.stdout:8/128: creat d0/d15/f20 x:0 0 0 2024-09-13T17:05:42.694 INFO:tasks.workunit.client.0.smithi115.stdout:4/183: rmdir d7/dd/de 39 2024-09-13T17:05:42.695 INFO:tasks.workunit.client.0.smithi115.stdout:4/184: chown d7/dd/de/f1c 19112188 1 2024-09-13T17:05:42.695 INFO:tasks.workunit.client.0.smithi115.stdout:4/185: write d7/dd/de/f17 [1954992,85745] 0 2024-09-13T17:05:42.701 INFO:tasks.workunit.client.1.smithi195.stdout:0/170: mknod d7/d10/c2d 0 2024-09-13T17:05:42.701 INFO:tasks.workunit.client.1.smithi195.stdout:0/171: truncate d7/d10/f12 4833373 0 2024-09-13T17:05:42.701 INFO:tasks.workunit.client.1.smithi195.stdout:0/172: write d7/d8/d16/f21 [552932,81302] 0 2024-09-13T17:05:42.701 INFO:tasks.workunit.client.1.smithi195.stdout:5/185: dread d2/d4/d10/f2f [0,4194304] 0 2024-09-13T17:05:42.702 INFO:tasks.workunit.client.0.smithi115.stdout:4/186: mknod d7/dd/c38 0 2024-09-13T17:05:42.703 INFO:tasks.workunit.client.1.smithi195.stdout:8/176: unlink d0/c33 0 2024-09-13T17:05:42.705 INFO:tasks.workunit.client.1.smithi195.stdout:2/163: creat d0/d1a/d1c/d2c/f34 x:0 0 0 2024-09-13T17:05:42.707 INFO:tasks.workunit.client.0.smithi115.stdout:8/129: rmdir d0/d15/d1f 0 2024-09-13T17:05:42.707 INFO:tasks.workunit.client.0.smithi115.stdout:8/130: stat d0/c2 0 2024-09-13T17:05:42.708 INFO:tasks.workunit.client.0.smithi115.stdout:4/187: symlink d7/dd/de/l39 0 2024-09-13T17:05:42.709 INFO:tasks.workunit.client.1.smithi195.stdout:4/207: dread f11 [0,4194304] 0 2024-09-13T17:05:42.709 INFO:tasks.workunit.client.1.smithi195.stdout:4/208: chown f7 1074737080 1 2024-09-13T17:05:42.710 INFO:tasks.workunit.client.1.smithi195.stdout:3/146: link d7/f14 d7/d19/f22 0 2024-09-13T17:05:42.711 INFO:tasks.workunit.client.0.smithi115.stdout:6/102: rename d8/d9/de to d8/db/d1d 0 2024-09-13T17:05:42.714 INFO:tasks.workunit.client.0.smithi115.stdout:4/188: creat d7/dd/de/f3a x:0 0 0 2024-09-13T17:05:42.714 INFO:tasks.workunit.client.0.smithi115.stdout:4/189: creat d7/dd/f3b x:0 0 0 2024-09-13T17:05:42.715 INFO:tasks.workunit.client.1.smithi195.stdout:8/177: creat d0/d4/f39 x:0 0 0 2024-09-13T17:05:42.715 INFO:tasks.workunit.client.1.smithi195.stdout:8/178: stat d0/fc 0 2024-09-13T17:05:42.721 INFO:tasks.workunit.client.1.smithi195.stdout:8/179: unlink d0/d4/l30 0 2024-09-13T17:05:42.723 INFO:tasks.workunit.client.1.smithi195.stdout:8/180: symlink d0/d17/d2f/d31/l3a 0 2024-09-13T17:05:42.724 INFO:tasks.workunit.client.1.smithi195.stdout:3/147: link d7/cc d7/c23 0 2024-09-13T17:05:42.727 INFO:tasks.workunit.client.1.smithi195.stdout:4/209: dwrite d1a/f1d [0,4194304] 0 2024-09-13T17:05:42.727 INFO:tasks.workunit.client.1.smithi195.stdout:3/148: symlink d7/l24 0 2024-09-13T17:05:42.727 INFO:tasks.workunit.client.1.smithi195.stdout:3/149: fdatasync d7/d19/f22 0 2024-09-13T17:05:42.727 INFO:tasks.workunit.client.1.smithi195.stdout:3/150: fsync d7/fa 0 2024-09-13T17:05:42.729 INFO:tasks.workunit.client.1.smithi195.stdout:4/210: symlink d1a/d1f/d43/d29/l49 0 2024-09-13T17:05:42.731 INFO:tasks.workunit.client.1.smithi195.stdout:3/151: symlink d7/d19/l25 0 2024-09-13T17:05:42.731 INFO:tasks.workunit.client.1.smithi195.stdout:4/211: getdents d1a/d1f 0 2024-09-13T17:05:42.731 INFO:tasks.workunit.client.1.smithi195.stdout:4/212: dread - d1a/d1f/d21/d22/f26 zero size 2024-09-13T17:05:42.740 INFO:tasks.workunit.client.1.smithi195.stdout:9/166: dwrite d6/f7 [0,4194304] 0 2024-09-13T17:05:42.740 INFO:tasks.workunit.client.1.smithi195.stdout:9/167: write d6/df/d16/f32 [761072,31570] 0 2024-09-13T17:05:42.743 INFO:tasks.workunit.client.1.smithi195.stdout:8/181: dwrite d0/d4/f39 [0,4194304] 0 2024-09-13T17:05:42.746 INFO:tasks.workunit.client.1.smithi195.stdout:8/182: link d0/c23 d0/d17/d2f/d31/c3b 0 2024-09-13T17:05:42.748 INFO:tasks.workunit.client.0.smithi115.stdout:8/131: dread d0/f13 [0,4194304] 0 2024-09-13T17:05:42.749 INFO:tasks.workunit.client.1.smithi195.stdout:8/183: rename d0/d17/d2f/d31/l3a to d0/d17/l3c 0 2024-09-13T17:05:42.749 INFO:tasks.workunit.client.1.smithi195.stdout:0/173: dwrite f6 [0,4194304] 0 2024-09-13T17:05:42.750 INFO:tasks.workunit.client.1.smithi195.stdout:5/186: rename d2/d7 to d2/d3e 0 2024-09-13T17:05:42.750 INFO:tasks.workunit.client.1.smithi195.stdout:6/134: sync 2024-09-13T17:05:42.750 INFO:tasks.workunit.client.1.smithi195.stdout:6/135: chown f17 434 1 2024-09-13T17:05:42.750 INFO:tasks.workunit.client.1.smithi195.stdout:6/136: readlink d1c/d24/l27 0 2024-09-13T17:05:42.751 INFO:tasks.workunit.client.0.smithi115.stdout:8/132: mkdir d0/d21 0 2024-09-13T17:05:42.752 INFO:tasks.workunit.client.1.smithi195.stdout:4/213: dwrite d1a/d1f/d21/f30 [0,4194304] 0 2024-09-13T17:05:42.752 INFO:tasks.workunit.client.1.smithi195.stdout:4/214: dread - d1a/d1f/d43/d24/d41/f47 zero size 2024-09-13T17:05:42.753 INFO:tasks.workunit.client.1.smithi195.stdout:4/215: write fd [1158950,71971] 0 2024-09-13T17:05:42.753 INFO:tasks.workunit.client.1.smithi195.stdout:8/184: symlink d0/d17/d2f/l3d 0 2024-09-13T17:05:42.755 INFO:tasks.workunit.client.0.smithi115.stdout:8/133: rmdir d0 39 2024-09-13T17:05:42.755 INFO:tasks.workunit.client.0.smithi115.stdout:6/103: dwrite f6 [0,4194304] 0 2024-09-13T17:05:42.756 INFO:tasks.workunit.client.0.smithi115.stdout:8/134: stat d0/c10 0 2024-09-13T17:05:42.757 INFO:tasks.workunit.client.1.smithi195.stdout:0/174: write f6 [2538247,86775] 0 2024-09-13T17:05:42.758 INFO:tasks.workunit.client.1.smithi195.stdout:5/187: mkdir d2/d12/d3f 0 2024-09-13T17:05:42.759 INFO:tasks.workunit.client.1.smithi195.stdout:6/137: rmdir d1c/d24 39 2024-09-13T17:05:42.762 INFO:tasks.workunit.client.1.smithi195.stdout:9/168: dwrite d6/f1e [0,4194304] 0 2024-09-13T17:05:42.763 INFO:tasks.workunit.client.1.smithi195.stdout:9/169: read - d6/d19/f36 zero size 2024-09-13T17:05:42.771 INFO:tasks.workunit.client.0.smithi115.stdout:6/104: link d8/db/dd/f16 d8/d9/f1e 0 2024-09-13T17:05:42.772 INFO:tasks.workunit.client.1.smithi195.stdout:9/170: dread d6/f1e [0,4194304] 0 2024-09-13T17:05:42.775 INFO:tasks.workunit.client.1.smithi195.stdout:0/175: rename d7/d10/f12 to d7/d8/df/f2e 0 2024-09-13T17:05:42.777 INFO:tasks.workunit.client.0.smithi115.stdout:8/135: write d0/d15/f1b [351616,18860] 0 2024-09-13T17:05:42.778 INFO:tasks.workunit.client.1.smithi195.stdout:5/188: dwrite d2/d4/d10/f28 [0,4194304] 0 2024-09-13T17:05:42.778 INFO:tasks.workunit.client.1.smithi195.stdout:5/189: write d2/d3e/f35 [347250,85380] 0 2024-09-13T17:05:42.780 INFO:tasks.workunit.client.0.smithi115.stdout:8/136: symlink d0/d18/l22 0 2024-09-13T17:05:42.781 INFO:tasks.workunit.client.0.smithi115.stdout:6/105: dread f5 [0,4194304] 0 2024-09-13T17:05:42.782 INFO:tasks.workunit.client.0.smithi115.stdout:6/106: write d8/db/f12 [4898628,120252] 0 2024-09-13T17:05:42.782 INFO:tasks.workunit.client.1.smithi195.stdout:0/176: mknod d7/d8/df/c2f 0 2024-09-13T17:05:42.782 INFO:tasks.workunit.client.1.smithi195.stdout:0/177: fsync d7/d8/d16/f21 0 2024-09-13T17:05:42.782 INFO:tasks.workunit.client.1.smithi195.stdout:0/178: creat d7/d8/d16/f30 x:0 0 0 2024-09-13T17:05:42.782 INFO:tasks.workunit.client.1.smithi195.stdout:6/138: mkdir d1c/d28 0 2024-09-13T17:05:42.783 INFO:tasks.workunit.client.1.smithi195.stdout:6/139: stat f2 0 2024-09-13T17:05:42.784 INFO:tasks.workunit.client.1.smithi195.stdout:0/179: dread d7/d8/d16/f21 [0,4194304] 0 2024-09-13T17:05:42.785 INFO:tasks.workunit.client.0.smithi115.stdout:6/107: rename f6 to d8/d9/f1f 0 2024-09-13T17:05:42.785 INFO:tasks.workunit.client.0.smithi115.stdout:6/108: readlink d8/d9/d17/l1c 0 2024-09-13T17:05:42.785 INFO:tasks.workunit.client.1.smithi195.stdout:4/216: dread fe [0,4194304] 0 2024-09-13T17:05:42.786 INFO:tasks.workunit.client.1.smithi195.stdout:4/217: chown d1a/c27 117 1 2024-09-13T17:05:42.788 INFO:tasks.workunit.client.0.smithi115.stdout:6/109: creat d8/db/d1d/f20 x:0 0 0 2024-09-13T17:05:42.788 INFO:tasks.workunit.client.0.smithi115.stdout:6/110: readlink l2 0 2024-09-13T17:05:42.789 INFO:tasks.workunit.client.1.smithi195.stdout:8/185: getdents d0/d17/d2f/d31 0 2024-09-13T17:05:42.790 INFO:tasks.workunit.client.1.smithi195.stdout:8/186: stat d0/d13/f16 0 2024-09-13T17:05:42.791 INFO:tasks.workunit.client.1.smithi195.stdout:8/187: dread d0/d17/f1b [0,4194304] 0 2024-09-13T17:05:42.791 INFO:tasks.workunit.client.1.smithi195.stdout:8/188: getdents d0/d17/d2f/d31 0 2024-09-13T17:05:42.792 INFO:tasks.workunit.client.1.smithi195.stdout:9/171: rmdir d6/df/d16 39 2024-09-13T17:05:42.793 INFO:tasks.workunit.client.0.smithi115.stdout:8/137: dread d0/f13 [0,4194304] 0 2024-09-13T17:05:42.793 INFO:tasks.workunit.client.0.smithi115.stdout:6/111: symlink d8/d13/d15/l21 0 2024-09-13T17:05:42.793 INFO:tasks.workunit.client.1.smithi195.stdout:4/218: dread fb [0,4194304] 0 2024-09-13T17:05:42.794 INFO:tasks.workunit.client.1.smithi195.stdout:4/219: stat d1a/d1f/d21/d22/l45 0 2024-09-13T17:05:42.795 INFO:tasks.workunit.client.1.smithi195.stdout:5/190: mknod d2/d4/d10/c40 0 2024-09-13T17:05:42.796 INFO:tasks.workunit.client.1.smithi195.stdout:7/227: sync 2024-09-13T17:05:42.797 INFO:tasks.workunit.client.0.smithi115.stdout:6/112: mknod d8/d9/c22 0 2024-09-13T17:05:42.799 INFO:tasks.workunit.client.1.smithi195.stdout:6/140: creat d1c/f29 x:0 0 0 2024-09-13T17:05:42.799 INFO:tasks.workunit.client.1.smithi195.stdout:6/141: fdatasync f19 0 2024-09-13T17:05:42.800 INFO:tasks.workunit.client.1.smithi195.stdout:8/189: mkdir d0/d17/d2f/d3e 0 2024-09-13T17:05:42.801 INFO:tasks.workunit.client.1.smithi195.stdout:9/172: mknod d6/df/d37/c3b 0 2024-09-13T17:05:42.804 INFO:tasks.workunit.client.1.smithi195.stdout:7/228: symlink d5/db/d19/d22/d3c/l45 0 2024-09-13T17:05:42.804 INFO:tasks.workunit.client.1.smithi195.stdout:7/229: stat d5/db/d19/d22/d3c/c43 0 2024-09-13T17:05:42.805 INFO:tasks.workunit.client.1.smithi195.stdout:6/142: getdents d1c/d24 0 2024-09-13T17:05:42.805 INFO:tasks.workunit.client.1.smithi195.stdout:6/143: fdatasync d1c/f1e 0 2024-09-13T17:05:42.805 INFO:tasks.workunit.client.1.smithi195.stdout:6/144: dread - d1c/f23 zero size 2024-09-13T17:05:42.807 INFO:tasks.workunit.client.1.smithi195.stdout:9/173: rename d6/d19/d21/f33 to d6/df/f3c 0 2024-09-13T17:05:42.810 INFO:tasks.workunit.client.1.smithi195.stdout:5/191: getdents d2/d4 0 2024-09-13T17:05:42.812 INFO:tasks.workunit.client.1.smithi195.stdout:4/220: dwrite d1a/d1f/d43/d29/f3f [0,4194304] 0 2024-09-13T17:05:42.812 INFO:tasks.workunit.client.1.smithi195.stdout:4/221: stat d1a/d1f/d43/d24/c2c 0 2024-09-13T17:05:42.812 INFO:tasks.workunit.client.1.smithi195.stdout:4/222: write d1a/d1f/d21/d22/f28 [579244,108218] 0 2024-09-13T17:05:42.813 INFO:tasks.workunit.client.1.smithi195.stdout:0/180: dwrite d7/d8/d23/f27 [0,4194304] 0 2024-09-13T17:05:42.815 INFO:tasks.workunit.client.1.smithi195.stdout:8/190: getdents d0 0 2024-09-13T17:05:42.815 INFO:tasks.workunit.client.0.smithi115.stdout:6/113: dread d8/db/f12 [0,4194304] 0 2024-09-13T17:05:42.816 INFO:tasks.workunit.client.1.smithi195.stdout:9/174: creat d6/d12/d39/f3d x:0 0 0 2024-09-13T17:05:42.816 INFO:tasks.workunit.client.1.smithi195.stdout:9/175: write d6/d19/f1f [1080676,58899] 0 2024-09-13T17:05:42.819 INFO:tasks.workunit.client.1.smithi195.stdout:6/145: symlink d1c/l2a 0 2024-09-13T17:05:42.819 INFO:tasks.workunit.client.1.smithi195.stdout:6/146: write d1c/f23 [294428,15476] 0 2024-09-13T17:05:42.823 INFO:tasks.workunit.client.0.smithi115.stdout:8/138: dwrite d0/d15/f20 [0,4194304] 0 2024-09-13T17:05:42.829 INFO:tasks.workunit.client.1.smithi195.stdout:4/223: rmdir d1a/d1f/d21 39 2024-09-13T17:05:42.829 INFO:tasks.workunit.client.1.smithi195.stdout:1/135: sync 2024-09-13T17:05:42.829 INFO:tasks.workunit.client.1.smithi195.stdout:4/224: creat d1a/f4a x:0 0 0 2024-09-13T17:05:42.831 INFO:tasks.workunit.client.0.smithi115.stdout:8/139: truncate d0/f1d 1126597 0 2024-09-13T17:05:42.840 INFO:tasks.workunit.client.1.smithi195.stdout:8/191: creat d0/d17/d2f/d31/f3f x:0 0 0 2024-09-13T17:05:42.840 INFO:tasks.workunit.client.1.smithi195.stdout:9/176: truncate d6/d19/d21/f2f 856526 0 2024-09-13T17:05:42.840 INFO:tasks.workunit.client.1.smithi195.stdout:9/177: stat d6/df/c15 0 2024-09-13T17:05:42.840 INFO:tasks.workunit.client.1.smithi195.stdout:9/178: creat d6/d12/d39/f3e x:0 0 0 2024-09-13T17:05:42.840 INFO:tasks.workunit.client.1.smithi195.stdout:9/179: readlink d6/df/d16/l20 0 2024-09-13T17:05:42.841 INFO:tasks.workunit.client.0.smithi115.stdout:2/203: sync 2024-09-13T17:05:42.841 INFO:tasks.workunit.client.0.smithi115.stdout:0/67: sync 2024-09-13T17:05:42.842 INFO:tasks.workunit.client.1.smithi195.stdout:9/180: creat d6/f3f x:0 0 0 2024-09-13T17:05:42.843 INFO:tasks.workunit.client.0.smithi115.stdout:2/204: rmdir d3/d5/de 39 2024-09-13T17:05:42.843 INFO:tasks.workunit.client.0.smithi115.stdout:2/205: fsync d3/d5/fa 0 2024-09-13T17:05:42.845 INFO:tasks.workunit.client.1.smithi195.stdout:3/152: sync 2024-09-13T17:05:42.845 INFO:tasks.workunit.client.1.smithi195.stdout:2/164: sync 2024-09-13T17:05:42.845 INFO:tasks.workunit.client.1.smithi195.stdout:2/165: creat d0/d3/df/f35 x:0 0 0 2024-09-13T17:05:42.845 INFO:tasks.workunit.client.0.smithi115.stdout:0/68: creat d9/f12 x:0 0 0 2024-09-13T17:05:42.845 INFO:tasks.workunit.client.0.smithi115.stdout:0/69: write f2 [1032675,104424] 0 2024-09-13T17:05:42.849 INFO:tasks.workunit.client.0.smithi115.stdout:0/70: unlink d9/fe 0 2024-09-13T17:05:42.849 INFO:tasks.workunit.client.0.smithi115.stdout:2/206: dread d3/d5/fa [0,4194304] 0 2024-09-13T17:05:42.853 INFO:tasks.workunit.client.1.smithi195.stdout:4/225: read d1a/f1d [3360220,96114] 0 2024-09-13T17:05:42.854 INFO:tasks.workunit.client.0.smithi115.stdout:2/207: getdents d3/d5/d13/d1c 0 2024-09-13T17:05:42.854 INFO:tasks.workunit.client.0.smithi115.stdout:6/114: dwrite d8/db/ff [4194304,4194304] 0 2024-09-13T17:05:42.855 INFO:tasks.workunit.client.1.smithi195.stdout:9/181: dread d6/f1e [0,4194304] 0 2024-09-13T17:05:42.856 INFO:tasks.workunit.client.0.smithi115.stdout:6/115: mknod d8/d9/c23 0 2024-09-13T17:05:42.856 INFO:tasks.workunit.client.0.smithi115.stdout:6/116: chown d8/db/f12 770 1 2024-09-13T17:05:42.856 INFO:tasks.workunit.client.0.smithi115.stdout:6/117: fsync d8/d9/f1e 0 2024-09-13T17:05:42.856 INFO:tasks.workunit.client.0.smithi115.stdout:6/118: write d8/db/d1d/f18 [1009861,83880] 0 2024-09-13T17:05:42.856 INFO:tasks.workunit.client.0.smithi115.stdout:6/119: chown d8/db/f12 210667 1 2024-09-13T17:05:42.857 INFO:tasks.workunit.client.1.smithi195.stdout:4/226: dread fb [0,4194304] 0 2024-09-13T17:05:42.859 INFO:tasks.workunit.client.1.smithi195.stdout:9/182: dread d6/d12/f2b [0,4194304] 0 2024-09-13T17:05:42.859 INFO:tasks.workunit.client.1.smithi195.stdout:9/183: readlink d6/df/d16/l20 0 2024-09-13T17:05:42.861 INFO:tasks.workunit.client.1.smithi195.stdout:4/227: rmdir d1a/d1f/d21/d36 39 2024-09-13T17:05:42.861 INFO:tasks.workunit.client.1.smithi195.stdout:4/228: creat d1a/d1f/d43/d24/d41/f4b x:0 0 0 2024-09-13T17:05:42.862 INFO:tasks.workunit.client.1.smithi195.stdout:4/229: chown d1a/l33 2 1 2024-09-13T17:05:42.866 INFO:tasks.workunit.client.1.smithi195.stdout:4/230: symlink d1a/l4c 0 2024-09-13T17:05:42.868 INFO:tasks.workunit.client.1.smithi195.stdout:9/184: rmdir d6/d12/d39 39 2024-09-13T17:05:42.869 INFO:tasks.workunit.client.1.smithi195.stdout:9/185: fdatasync d6/f18 0 2024-09-13T17:05:42.869 INFO:tasks.workunit.client.0.smithi115.stdout:6/120: truncate d8/db/ff 7001325 0 2024-09-13T17:05:42.870 INFO:tasks.workunit.client.1.smithi195.stdout:4/231: rmdir d1a/d1f/d21/d36 39 2024-09-13T17:05:42.870 INFO:tasks.workunit.client.1.smithi195.stdout:5/192: dwrite d2/d3e/f16 [4194304,4194304] 0 2024-09-13T17:05:42.872 INFO:tasks.workunit.client.1.smithi195.stdout:9/186: link d6/d12/l17 d6/df/l40 0 2024-09-13T17:05:42.872 INFO:tasks.workunit.client.1.smithi195.stdout:9/187: chown d6/f1e 36442018 1 2024-09-13T17:05:42.872 INFO:tasks.workunit.client.1.smithi195.stdout:9/188: stat d6/f25 0 2024-09-13T17:05:42.877 INFO:tasks.workunit.client.0.smithi115.stdout:6/121: rename d8/d9 to d8/d13/d15/d24 0 2024-09-13T17:05:42.877 INFO:tasks.workunit.client.0.smithi115.stdout:6/122: chown d8/db/dd 0 1 2024-09-13T17:05:42.878 INFO:tasks.workunit.client.1.smithi195.stdout:5/193: symlink d2/d12/l41 0 2024-09-13T17:05:42.879 INFO:tasks.workunit.client.1.smithi195.stdout:4/232: dread f0 [0,4194304] 0 2024-09-13T17:05:42.879 INFO:tasks.workunit.client.1.smithi195.stdout:4/233: chown d1a/d1f 1335685 1 2024-09-13T17:05:42.879 INFO:tasks.workunit.client.0.smithi115.stdout:6/123: creat d8/f25 x:0 0 0 2024-09-13T17:05:42.880 INFO:tasks.workunit.client.1.smithi195.stdout:9/189: mknod d6/df/c41 0 2024-09-13T17:05:42.882 INFO:tasks.workunit.client.0.smithi115.stdout:8/140: dread d0/f1d [0,4194304] 0 2024-09-13T17:05:42.882 INFO:tasks.workunit.client.0.smithi115.stdout:6/124: rename d8/db/f12 to d8/db/d1d/f26 0 2024-09-13T17:05:42.885 INFO:tasks.workunit.client.1.smithi195.stdout:4/234: unlink fb 0 2024-09-13T17:05:42.885 INFO:tasks.workunit.client.1.smithi195.stdout:4/235: creat d1a/d1f/d21/d22/f4d x:0 0 0 2024-09-13T17:05:42.889 INFO:tasks.workunit.client.1.smithi195.stdout:4/236: mkdir d1a/d1f/d43/d24/d4e 0 2024-09-13T17:05:42.889 INFO:tasks.workunit.client.1.smithi195.stdout:4/237: truncate d1a/f4a 799431 0 2024-09-13T17:05:42.890 INFO:tasks.workunit.client.1.smithi195.stdout:4/238: truncate d1a/f1d 2033899 0 2024-09-13T17:05:42.891 INFO:tasks.workunit.client.1.smithi195.stdout:6/147: dwrite d1c/f1e [0,4194304] 0 2024-09-13T17:05:42.891 INFO:tasks.workunit.client.1.smithi195.stdout:4/239: readlink l9 0 2024-09-13T17:05:42.891 INFO:tasks.workunit.client.1.smithi195.stdout:4/240: chown d1a/d1f/c2f 24 1 2024-09-13T17:05:42.892 INFO:tasks.workunit.client.1.smithi195.stdout:0/181: dwrite d7/d8/d23/f25 [0,4194304] 0 2024-09-13T17:05:42.892 INFO:tasks.workunit.client.1.smithi195.stdout:0/182: creat d7/d8/d16/f31 x:0 0 0 2024-09-13T17:05:42.892 INFO:tasks.workunit.client.1.smithi195.stdout:0/183: creat d7/d8/d23/f32 x:0 0 0 2024-09-13T17:05:42.893 INFO:tasks.workunit.client.1.smithi195.stdout:8/192: dwrite d0/f8 [4194304,4194304] 0 2024-09-13T17:05:42.896 INFO:tasks.workunit.client.0.smithi115.stdout:2/208: dwrite d3/d5/dd/df/d22/f2b [0,4194304] 0 2024-09-13T17:05:42.897 INFO:tasks.workunit.client.1.smithi195.stdout:3/153: dwrite d7/f14 [0,4194304] 0 2024-09-13T17:05:42.897 INFO:tasks.workunit.client.1.smithi195.stdout:3/154: write d7/f13 [5218219,3392] 0 2024-09-13T17:05:42.897 INFO:tasks.workunit.client.1.smithi195.stdout:3/155: chown d7/f14 21068 1 2024-09-13T17:05:42.898 INFO:tasks.workunit.client.1.smithi195.stdout:6/148: creat d1c/d28/f2b x:0 0 0 2024-09-13T17:05:42.900 INFO:tasks.workunit.client.1.smithi195.stdout:5/194: dwrite d2/d4/d11/f2d [0,4194304] 0 2024-09-13T17:05:42.900 INFO:tasks.workunit.client.1.smithi195.stdout:2/166: dwrite d0/d1a/d1c/d1e/f2a [0,4194304] 0 2024-09-13T17:05:42.900 INFO:tasks.workunit.client.1.smithi195.stdout:2/167: fdatasync d0/d3/f4 0 2024-09-13T17:05:42.901 INFO:tasks.workunit.client.1.smithi195.stdout:5/195: dread d2/d4/d10/f24 [0,4194304] 0 2024-09-13T17:05:42.901 INFO:tasks.workunit.client.1.smithi195.stdout:5/196: creat d2/df/f42 x:0 0 0 2024-09-13T17:05:42.901 INFO:tasks.workunit.client.0.smithi115.stdout:6/125: getdents d8/db 0 2024-09-13T17:05:42.907 INFO:tasks.workunit.client.0.smithi115.stdout:2/209: creat d3/d5/de/f43 x:0 0 0 2024-09-13T17:05:42.907 INFO:tasks.workunit.client.0.smithi115.stdout:2/210: write d3/d5/de/f2a [694643,45809] 0 2024-09-13T17:05:42.907 INFO:tasks.workunit.client.1.smithi195.stdout:3/156: write d7/f13 [3596477,110086] 0 2024-09-13T17:05:42.909 INFO:tasks.workunit.client.1.smithi195.stdout:3/157: dread d7/f15 [0,4194304] 0 2024-09-13T17:05:42.910 INFO:tasks.workunit.client.1.smithi195.stdout:6/149: write d1c/f1e [1187512,66391] 0 2024-09-13T17:05:42.910 INFO:tasks.workunit.client.1.smithi195.stdout:6/150: chown l5 67 1 2024-09-13T17:05:42.910 INFO:tasks.workunit.client.1.smithi195.stdout:6/151: dread - d1c/f29 zero size 2024-09-13T17:05:42.910 INFO:tasks.workunit.client.1.smithi195.stdout:6/152: chown l5 120252999 1 2024-09-13T17:05:42.910 INFO:tasks.workunit.client.0.smithi115.stdout:6/126: creat d8/d13/d15/d24/f27 x:0 0 0 2024-09-13T17:05:42.911 INFO:tasks.workunit.client.1.smithi195.stdout:0/184: symlink d7/db/d11/l33 0 2024-09-13T17:05:42.913 INFO:tasks.workunit.client.0.smithi115.stdout:0/71: dwrite f2 [0,4194304] 0 2024-09-13T17:05:42.913 INFO:tasks.workunit.client.1.smithi195.stdout:8/193: creat d0/d17/d2f/f40 x:0 0 0 2024-09-13T17:05:42.914 INFO:tasks.workunit.client.1.smithi195.stdout:9/190: dwrite d6/df/f3c [0,4194304] 0 2024-09-13T17:05:42.914 INFO:tasks.workunit.client.1.smithi195.stdout:9/191: stat d6/df/c41 0 2024-09-13T17:05:42.914 INFO:tasks.workunit.client.1.smithi195.stdout:9/192: chown d6/l8 11983 1 2024-09-13T17:05:42.914 INFO:tasks.workunit.client.1.smithi195.stdout:9/193: chown d6/d19/d21/f2f 117 1 2024-09-13T17:05:42.915 INFO:tasks.workunit.client.0.smithi115.stdout:8/141: dwrite d0/fb [0,4194304] 0 2024-09-13T17:05:42.919 INFO:tasks.workunit.client.0.smithi115.stdout:8/142: dread d0/f1d [0,4194304] 0 2024-09-13T17:05:42.920 INFO:tasks.workunit.client.1.smithi195.stdout:2/168: dwrite d0/d1a/d1c/d1e/f25 [8388608,4194304] 0 2024-09-13T17:05:42.923 INFO:tasks.workunit.client.1.smithi195.stdout:6/153: dread f2 [0,4194304] 0 2024-09-13T17:05:42.924 INFO:tasks.workunit.client.0.smithi115.stdout:8/143: rename d0/d18/d19/l1e to d0/l23 0 2024-09-13T17:05:42.924 INFO:tasks.workunit.client.0.smithi115.stdout:8/144: write d0/d15/f1b [762666,119108] 0 2024-09-13T17:05:42.926 INFO:tasks.workunit.client.1.smithi195.stdout:5/197: mkdir d2/df/d39/d43 0 2024-09-13T17:05:42.926 INFO:tasks.workunit.client.1.smithi195.stdout:5/198: readlink d2/d4/d11/l1e 0 2024-09-13T17:05:42.926 INFO:tasks.workunit.client.0.smithi115.stdout:0/72: mknod d9/c13 0 2024-09-13T17:05:42.930 INFO:tasks.workunit.client.1.smithi195.stdout:3/158: creat d7/d21/f26 x:0 0 0 2024-09-13T17:05:42.932 INFO:tasks.workunit.client.0.smithi115.stdout:8/145: rename d0/c10 to d0/d15/c24 0 2024-09-13T17:05:42.934 INFO:tasks.workunit.client.0.smithi115.stdout:0/73: mknod d9/c14 0 2024-09-13T17:05:42.937 INFO:tasks.workunit.client.0.smithi115.stdout:8/146: write d0/f13 [318726,124118] 0 2024-09-13T17:05:42.939 INFO:tasks.workunit.client.1.smithi195.stdout:0/185: creat d7/db/f34 x:0 0 0 2024-09-13T17:05:42.939 INFO:tasks.workunit.client.0.smithi115.stdout:0/74: truncate d9/ff 684902 0 2024-09-13T17:05:42.944 INFO:tasks.workunit.client.0.smithi115.stdout:6/127: dwrite d8/d13/d15/d24/f1f [4194304,4194304] 0 2024-09-13T17:05:42.945 INFO:tasks.workunit.client.1.smithi195.stdout:9/194: creat d6/d12/d39/f42 x:0 0 0 2024-09-13T17:05:42.946 INFO:tasks.workunit.client.1.smithi195.stdout:8/194: dwrite d0/d17/f1d [0,4194304] 0 2024-09-13T17:05:42.948 INFO:tasks.workunit.client.0.smithi115.stdout:2/211: dwrite d3/d5/de/f10 [0,4194304] 0 2024-09-13T17:05:42.949 INFO:tasks.workunit.client.1.smithi195.stdout:2/169: creat d0/d1a/f36 x:0 0 0 2024-09-13T17:05:42.949 INFO:tasks.workunit.client.1.smithi195.stdout:2/170: write d0/d3/f26 [993308,41132] 0 2024-09-13T17:05:42.952 INFO:tasks.workunit.client.1.smithi195.stdout:5/199: creat d2/df/d39/f44 x:0 0 0 2024-09-13T17:05:42.953 INFO:tasks.workunit.client.1.smithi195.stdout:3/159: chown d7/le 439626592 1 2024-09-13T17:05:42.954 INFO:tasks.workunit.client.1.smithi195.stdout:9/195: unlink d6/c23 0 2024-09-13T17:05:42.956 INFO:tasks.workunit.client.0.smithi115.stdout:8/147: dwrite d0/fc [0,4194304] 0 2024-09-13T17:05:42.956 INFO:tasks.workunit.client.0.smithi115.stdout:8/148: truncate d0/d18/f1c 358179 0 2024-09-13T17:05:42.957 INFO:tasks.workunit.client.0.smithi115.stdout:8/149: dread d0/d18/f1c [0,4194304] 0 2024-09-13T17:05:42.957 INFO:tasks.workunit.client.0.smithi115.stdout:8/150: readlink d0/l4 0 2024-09-13T17:05:42.957 INFO:tasks.workunit.client.1.smithi195.stdout:8/195: creat d0/d13/f41 x:0 0 0 2024-09-13T17:05:42.958 INFO:tasks.workunit.client.1.smithi195.stdout:2/171: mknod d0/d3/df/d11/c37 0 2024-09-13T17:05:42.962 INFO:tasks.workunit.client.1.smithi195.stdout:7/230: sync 2024-09-13T17:05:42.963 INFO:tasks.workunit.client.1.smithi195.stdout:0/186: dwrite d7/d8/d16/f1c [0,4194304] 0 2024-09-13T17:05:42.963 INFO:tasks.workunit.client.1.smithi195.stdout:0/187: creat d7/d8/d23/f35 x:0 0 0 2024-09-13T17:05:42.963 INFO:tasks.workunit.client.1.smithi195.stdout:6/154: rename d1c/l22 to d1c/l2c 0 2024-09-13T17:05:42.963 INFO:tasks.workunit.client.1.smithi195.stdout:6/155: chown fd 1062120533 1 2024-09-13T17:05:42.966 INFO:tasks.workunit.client.0.smithi115.stdout:0/75: link f2 d9/f15 0 2024-09-13T17:05:42.967 INFO:tasks.workunit.client.0.smithi115.stdout:0/76: write d9/f15 [5094528,2530] 0 2024-09-13T17:05:42.968 INFO:tasks.workunit.client.1.smithi195.stdout:5/200: mkdir d2/d4/d10/d45 0 2024-09-13T17:05:42.968 INFO:tasks.workunit.client.1.smithi195.stdout:5/201: stat d2/d3e 0 2024-09-13T17:05:42.969 INFO:tasks.workunit.client.1.smithi195.stdout:9/196: write d6/d12/f2a [110116,78615] 0 2024-09-13T17:05:42.969 INFO:tasks.workunit.client.0.smithi115.stdout:6/128: rmdir d8/d13 39 2024-09-13T17:05:42.972 INFO:tasks.workunit.client.1.smithi195.stdout:8/196: rmdir d0/d17/d2f/d3e 0 2024-09-13T17:05:42.973 INFO:tasks.workunit.client.0.smithi115.stdout:8/151: symlink d0/d21/l25 0 2024-09-13T17:05:42.973 INFO:tasks.workunit.client.1.smithi195.stdout:2/172: symlink d0/d3/df/d11/l38 0 2024-09-13T17:05:42.974 INFO:tasks.workunit.client.1.smithi195.stdout:7/231: creat d5/d35/d37/f46 x:0 0 0 2024-09-13T17:05:42.978 INFO:tasks.workunit.client.1.smithi195.stdout:0/188: symlink d7/d10/l36 0 2024-09-13T17:05:42.979 INFO:tasks.workunit.client.0.smithi115.stdout:7/50: sync 2024-09-13T17:05:42.979 INFO:tasks.workunit.client.0.smithi115.stdout:7/51: write d0/fa [969373,74928] 0 2024-09-13T17:05:42.980 INFO:tasks.workunit.client.1.smithi195.stdout:5/202: write d2/df/f1a [2709138,100754] 0 2024-09-13T17:05:42.980 INFO:tasks.workunit.client.1.smithi195.stdout:9/197: symlink d6/d19/d21/l43 0 2024-09-13T17:05:42.980 INFO:tasks.workunit.client.1.smithi195.stdout:8/197: dread d0/f3 [0,4194304] 0 2024-09-13T17:05:42.982 INFO:tasks.workunit.client.1.smithi195.stdout:6/156: mkdir d1c/d2d 0 2024-09-13T17:05:42.982 INFO:tasks.workunit.client.1.smithi195.stdout:0/189: mknod d7/d8/d23/c37 0 2024-09-13T17:05:42.982 INFO:tasks.workunit.client.1.smithi195.stdout:9/198: mkdir d6/df/d13/d44 0 2024-09-13T17:05:42.984 INFO:tasks.workunit.client.1.smithi195.stdout:2/173: link d0/c30 d0/c39 0 2024-09-13T17:05:42.984 INFO:tasks.workunit.client.1.smithi195.stdout:2/174: write d0/d3/df/d11/f32 [890823,53933] 0 2024-09-13T17:05:42.985 INFO:tasks.workunit.client.1.smithi195.stdout:2/175: creat d0/d1a/f3a x:0 0 0 2024-09-13T17:05:42.985 INFO:tasks.workunit.client.1.smithi195.stdout:2/176: chown d0/d3/df/f20 70502 1 2024-09-13T17:05:42.985 INFO:tasks.workunit.client.1.smithi195.stdout:2/177: fsync d0/d1a/d1c/d1e/f25 0 2024-09-13T17:05:42.991 INFO:tasks.workunit.client.0.smithi115.stdout:2/212: dwrite d3/f4 [0,4194304] 0 2024-09-13T17:05:42.991 INFO:tasks.workunit.client.0.smithi115.stdout:8/152: write d0/fc [1094683,41905] 0 2024-09-13T17:05:42.991 INFO:tasks.workunit.client.0.smithi115.stdout:2/213: write d3/d5/dd/df/f28 [4450485,80678] 0 2024-09-13T17:05:42.991 INFO:tasks.workunit.client.0.smithi115.stdout:2/214: write d3/f18 [645979,51077] 0 2024-09-13T17:05:42.993 INFO:tasks.workunit.client.1.smithi195.stdout:3/160: dwrite d7/f12 [0,4194304] 0 2024-09-13T17:05:42.995 INFO:tasks.workunit.client.0.smithi115.stdout:8/153: mkdir d0/d26 0 2024-09-13T17:05:42.998 INFO:tasks.workunit.client.1.smithi195.stdout:0/190: dread d7/d8/d16/f1b [0,4194304] 0 2024-09-13T17:05:43.001 INFO:tasks.workunit.client.1.smithi195.stdout:2/178: rmdir d0/d1a/d1c/d1e 39 2024-09-13T17:05:43.001 INFO:tasks.workunit.client.1.smithi195.stdout:2/179: write d0/d1a/d1c/d1e/f2a [5080484,91033] 0 2024-09-13T17:05:43.001 INFO:tasks.workunit.client.1.smithi195.stdout:2/180: fsync d0/d3/f4 0 2024-09-13T17:05:43.001 INFO:tasks.workunit.client.1.smithi195.stdout:1/136: sync 2024-09-13T17:05:43.001 INFO:tasks.workunit.client.1.smithi195.stdout:1/137: chown db/f2b 98 1 2024-09-13T17:05:43.001 INFO:tasks.workunit.client.0.smithi115.stdout:2/215: symlink d3/d5/dd/d1f/d2f/l44 0 2024-09-13T17:05:43.001 INFO:tasks.workunit.client.0.smithi115.stdout:2/216: chown d3/l36 14530 1 2024-09-13T17:05:43.001 INFO:tasks.workunit.client.0.smithi115.stdout:2/217: readlink d3/l3e 0 2024-09-13T17:05:43.002 INFO:tasks.workunit.client.0.smithi115.stdout:6/129: dwrite d8/db/ff [0,4194304] 0 2024-09-13T17:05:43.006 INFO:tasks.workunit.client.1.smithi195.stdout:2/181: stat d0/c7 0 2024-09-13T17:05:43.007 INFO:tasks.workunit.client.0.smithi115.stdout:7/52: dwrite d0/d2/f8 [0,4194304] 0 2024-09-13T17:05:43.007 INFO:tasks.workunit.client.1.smithi195.stdout:3/161: rmdir d7/d21 39 2024-09-13T17:05:43.007 INFO:tasks.workunit.client.1.smithi195.stdout:3/162: truncate d7/d21/f26 1030063 0 2024-09-13T17:05:43.010 INFO:tasks.workunit.client.1.smithi195.stdout:2/182: symlink d0/d3/df/d11/l3b 0 2024-09-13T17:05:43.010 INFO:tasks.workunit.client.1.smithi195.stdout:2/183: fsync d0/f24 0 2024-09-13T17:05:43.012 INFO:tasks.workunit.client.1.smithi195.stdout:3/163: creat d7/d21/f27 x:0 0 0 2024-09-13T17:05:43.013 INFO:tasks.workunit.client.1.smithi195.stdout:6/157: rmdir d1c 39 2024-09-13T17:05:43.013 INFO:tasks.workunit.client.1.smithi195.stdout:6/158: write d1c/f23 [923830,6312] 0 2024-09-13T17:05:43.013 INFO:tasks.workunit.client.1.smithi195.stdout:6/159: getdents d1c/d24 0 2024-09-13T17:05:43.013 INFO:tasks.workunit.client.1.smithi195.stdout:0/191: write d7/d8/d16/f1c [250139,57065] 0 2024-09-13T17:05:43.014 INFO:tasks.workunit.client.1.smithi195.stdout:3/164: mknod d7/d21/c28 0 2024-09-13T17:05:43.017 INFO:tasks.workunit.client.1.smithi195.stdout:9/199: truncate d6/d12/f2a 486519 0 2024-09-13T17:05:43.017 INFO:tasks.workunit.client.1.smithi195.stdout:9/200: dread - d6/f3f zero size 2024-09-13T17:05:43.018 INFO:tasks.workunit.client.1.smithi195.stdout:8/198: dwrite d0/d13/f41 [0,4194304] 0 2024-09-13T17:05:43.019 INFO:tasks.workunit.client.1.smithi195.stdout:3/165: rename d7/l10 to d7/d19/l29 0 2024-09-13T17:05:43.019 INFO:tasks.workunit.client.1.smithi195.stdout:3/166: chown d7/f14 82 1 2024-09-13T17:05:43.021 INFO:tasks.workunit.client.1.smithi195.stdout:2/184: dread d0/f24 [0,4194304] 0 2024-09-13T17:05:43.021 INFO:tasks.workunit.client.1.smithi195.stdout:2/185: readlink d0/d3/df/d11/l3b 0 2024-09-13T17:05:43.021 INFO:tasks.workunit.client.1.smithi195.stdout:7/232: dwrite d5/db/d19/f18 [0,4194304] 0 2024-09-13T17:05:43.021 INFO:tasks.workunit.client.1.smithi195.stdout:7/233: write d5/f6 [5304774,117424] 0 2024-09-13T17:05:43.022 INFO:tasks.workunit.client.1.smithi195.stdout:7/234: write d5/f6 [4159269,60914] 0 2024-09-13T17:05:43.022 INFO:tasks.workunit.client.1.smithi195.stdout:7/235: stat d5/d13/d24/f3f 0 2024-09-13T17:05:43.022 INFO:tasks.workunit.client.1.smithi195.stdout:5/203: dwrite d2/d4/f1d [0,4194304] 0 2024-09-13T17:05:43.022 INFO:tasks.workunit.client.0.smithi115.stdout:6/130: mkdir d8/db/d28 0 2024-09-13T17:05:43.022 INFO:tasks.workunit.client.0.smithi115.stdout:6/131: chown d8/db/d1d/f26 8227727 1 2024-09-13T17:05:43.023 INFO:tasks.workunit.client.1.smithi195.stdout:2/186: dread d0/d1a/d1c/f23 [0,4194304] 0 2024-09-13T17:05:43.024 INFO:tasks.workunit.client.0.smithi115.stdout:0/77: truncate d9/f15 4621003 0 2024-09-13T17:05:43.024 INFO:tasks.workunit.client.1.smithi195.stdout:9/201: mkdir d6/d19/d21/d45 0 2024-09-13T17:05:43.025 INFO:tasks.workunit.client.0.smithi115.stdout:8/154: getdents d0/d18 0 2024-09-13T17:05:43.026 INFO:tasks.workunit.client.1.smithi195.stdout:1/138: dwrite db/df/d13/f27 [0,4194304] 0 2024-09-13T17:05:43.030 INFO:tasks.workunit.client.0.smithi115.stdout:6/132: dread d8/db/d1d/f18 [0,4194304] 0 2024-09-13T17:05:43.030 INFO:tasks.workunit.client.0.smithi115.stdout:6/133: truncate d8/db/d1d/f20 285484 0 2024-09-13T17:05:43.032 INFO:tasks.workunit.client.1.smithi195.stdout:9/202: write d6/f1e [3172175,101578] 0 2024-09-13T17:05:43.034 INFO:tasks.workunit.client.1.smithi195.stdout:4/241: sync 2024-09-13T17:05:43.035 INFO:tasks.workunit.client.1.smithi195.stdout:8/199: link d0/d13/c32 d0/d17/d2f/d31/c42 0 2024-09-13T17:05:43.040 INFO:tasks.workunit.client.0.smithi115.stdout:7/53: symlink d0/dc/le 0 2024-09-13T17:05:43.040 INFO:tasks.workunit.client.0.smithi115.stdout:2/218: getdents d3/d5/dd/df/d22 0 2024-09-13T17:05:43.040 INFO:tasks.workunit.client.0.smithi115.stdout:7/54: write d0/fa [252463,96833] 0 2024-09-13T17:05:43.048 INFO:tasks.workunit.client.1.smithi195.stdout:5/204: rename d2/d4/d11 to d2/d4/d10/d46 0 2024-09-13T17:05:43.058 INFO:tasks.workunit.client.0.smithi115.stdout:2/219: rename d3/d5/fa to d3/d5/d13/f45 0 2024-09-13T17:05:43.061 INFO:tasks.workunit.client.1.smithi195.stdout:4/242: mknod d1a/c4f 0 2024-09-13T17:05:43.061 INFO:tasks.workunit.client.1.smithi195.stdout:4/243: chown d1a/d1f/d21/d22/f2b 789 1 2024-09-13T17:05:43.063 INFO:tasks.workunit.client.1.smithi195.stdout:8/200: mknod d0/d17/d2f/c43 0 2024-09-13T17:05:43.064 INFO:tasks.workunit.client.1.smithi195.stdout:8/201: read - d0/d17/d2f/d31/f3f zero size 2024-09-13T17:05:43.064 INFO:tasks.workunit.client.1.smithi195.stdout:8/202: readlink d0/d17/l1e 0 2024-09-13T17:05:43.065 INFO:tasks.workunit.client.0.smithi115.stdout:8/155: mknod d0/d15/c27 0 2024-09-13T17:05:43.065 INFO:tasks.workunit.client.0.smithi115.stdout:8/156: write d0/f1d [174542,75736] 0 2024-09-13T17:05:43.065 INFO:tasks.workunit.client.0.smithi115.stdout:8/157: stat d0/c1a 0 2024-09-13T17:05:43.067 INFO:tasks.workunit.client.0.smithi115.stdout:2/220: mkdir d3/d5/d13/d39/d46 0 2024-09-13T17:05:43.067 INFO:tasks.workunit.client.0.smithi115.stdout:2/221: chown d3/d5/dd/df/d22 30296446 1 2024-09-13T17:05:43.068 INFO:tasks.workunit.client.0.smithi115.stdout:7/55: unlink d0/fb 0 2024-09-13T17:05:43.070 INFO:tasks.workunit.client.0.smithi115.stdout:0/78: rename d9/f10 to d9/f16 0 2024-09-13T17:05:43.072 INFO:tasks.workunit.client.1.smithi195.stdout:5/205: rmdir d2/df/d39/d43 0 2024-09-13T17:05:43.073 INFO:tasks.workunit.client.0.smithi115.stdout:8/158: mkdir d0/d18/d19/d28 0 2024-09-13T17:05:43.074 INFO:tasks.workunit.client.0.smithi115.stdout:8/159: write d0/f13 [2624047,46707] 0 2024-09-13T17:05:43.077 INFO:tasks.workunit.client.1.smithi195.stdout:8/203: mknod d0/d17/d2f/d31/c44 0 2024-09-13T17:05:43.077 INFO:tasks.workunit.client.0.smithi115.stdout:2/222: mkdir d3/d5/de/d3a/d47 0 2024-09-13T17:05:43.078 INFO:tasks.workunit.client.0.smithi115.stdout:0/79: truncate d9/fa 810157 0 2024-09-13T17:05:43.079 INFO:tasks.workunit.client.0.smithi115.stdout:7/56: read d0/f1 [4073911,57337] 0 2024-09-13T17:05:43.080 INFO:tasks.workunit.client.0.smithi115.stdout:0/80: dread d9/fa [0,4194304] 0 2024-09-13T17:05:43.081 INFO:tasks.workunit.client.1.smithi195.stdout:8/204: unlink d0/f2b 0 2024-09-13T17:05:43.088 INFO:tasks.workunit.client.1.smithi195.stdout:8/205: dread d0/d4/f39 [0,4194304] 0 2024-09-13T17:05:43.088 INFO:tasks.workunit.client.1.smithi195.stdout:8/206: chown d0/c19 94 1 2024-09-13T17:05:43.095 INFO:tasks.workunit.client.1.smithi195.stdout:3/167: dwrite d7/f12 [0,4194304] 0 2024-09-13T17:05:43.096 INFO:tasks.workunit.client.1.smithi195.stdout:3/168: write d7/f15 [192167,75966] 0 2024-09-13T17:05:43.102 INFO:tasks.workunit.client.0.smithi115.stdout:2/223: dread f2 [0,4194304] 0 2024-09-13T17:05:43.105 INFO:tasks.workunit.client.1.smithi195.stdout:0/192: dwrite d7/d8/d23/f25 [0,4194304] 0 2024-09-13T17:05:43.106 INFO:tasks.workunit.client.0.smithi115.stdout:2/224: dread d3/d5/dd/df/f24 [0,4194304] 0 2024-09-13T17:05:43.106 INFO:tasks.workunit.client.0.smithi115.stdout:2/225: fdatasync d3/d5/dd/df/d22/f29 0 2024-09-13T17:05:43.109 INFO:tasks.workunit.client.1.smithi195.stdout:0/193: dread f6 [0,4194304] 0 2024-09-13T17:05:43.115 INFO:tasks.workunit.client.1.smithi195.stdout:0/194: dread d7/d8/d16/f1b [0,4194304] 0 2024-09-13T17:05:43.116 INFO:tasks.workunit.client.1.smithi195.stdout:0/195: mkdir d7/db/d38 0 2024-09-13T17:05:43.116 INFO:tasks.workunit.client.1.smithi195.stdout:0/196: truncate d7/d8/d16/f31 692060 0 2024-09-13T17:05:43.121 INFO:tasks.workunit.client.0.smithi115.stdout:5/132: sync 2024-09-13T17:05:43.121 INFO:tasks.workunit.client.0.smithi115.stdout:9/87: sync 2024-09-13T17:05:43.121 INFO:tasks.workunit.client.0.smithi115.stdout:1/83: sync 2024-09-13T17:05:43.121 INFO:tasks.workunit.client.0.smithi115.stdout:5/133: stat d19/d21/f2a 0 2024-09-13T17:05:43.122 INFO:tasks.workunit.client.0.smithi115.stdout:5/134: truncate d19/d1d/f20 541072 0 2024-09-13T17:05:43.122 INFO:tasks.workunit.client.0.smithi115.stdout:5/135: chown d19/c1f 260734 1 2024-09-13T17:05:43.122 INFO:tasks.workunit.client.0.smithi115.stdout:5/136: creat d19/d21/f30 x:0 0 0 2024-09-13T17:05:43.125 INFO:tasks.workunit.client.0.smithi115.stdout:5/137: link d19/d21/f2a d19/d21/f31 0 2024-09-13T17:05:43.126 INFO:tasks.workunit.client.0.smithi115.stdout:5/138: mkdir d19/d2b/d32 0 2024-09-13T17:05:43.128 INFO:tasks.workunit.client.0.smithi115.stdout:5/139: rename c13 to d19/c33 0 2024-09-13T17:05:43.131 INFO:tasks.workunit.client.0.smithi115.stdout:3/310: sync 2024-09-13T17:05:43.132 INFO:tasks.workunit.client.0.smithi115.stdout:4/190: sync 2024-09-13T17:05:43.133 INFO:tasks.workunit.client.0.smithi115.stdout:6/134: dwrite d8/f25 [0,4194304] 0 2024-09-13T17:05:43.136 INFO:tasks.workunit.client.0.smithi115.stdout:6/135: link d8/f25 d8/d13/d15/d24/f29 0 2024-09-13T17:05:43.137 INFO:tasks.workunit.client.0.smithi115.stdout:6/136: symlink d8/db/l2a 0 2024-09-13T17:05:43.137 INFO:tasks.workunit.client.0.smithi115.stdout:6/137: creat d8/db/d1d/f2b x:0 0 0 2024-09-13T17:05:43.140 INFO:tasks.workunit.client.1.smithi195.stdout:2/187: dwrite d0/d1a/f36 [0,4194304] 0 2024-09-13T17:05:43.143 INFO:tasks.workunit.client.1.smithi195.stdout:9/203: dwrite d6/d12/d39/f3d [0,4194304] 0 2024-09-13T17:05:43.143 INFO:tasks.workunit.client.1.smithi195.stdout:9/204: creat d6/d12/f46 x:0 0 0 2024-09-13T17:05:43.145 INFO:tasks.workunit.client.1.smithi195.stdout:1/139: dwrite db/f17 [0,4194304] 0 2024-09-13T17:05:43.148 INFO:tasks.workunit.client.1.smithi195.stdout:1/140: write db/f1c [414429,125102] 0 2024-09-13T17:05:43.148 INFO:tasks.workunit.client.1.smithi195.stdout:7/236: dwrite f4 [0,4194304] 0 2024-09-13T17:05:43.148 INFO:tasks.workunit.client.1.smithi195.stdout:4/244: dwrite d1a/d1f/d21/d22/f2b [0,4194304] 0 2024-09-13T17:05:43.148 INFO:tasks.workunit.client.1.smithi195.stdout:4/245: chown d1a/f4a 0 1 2024-09-13T17:05:43.148 INFO:tasks.workunit.client.1.smithi195.stdout:4/246: chown d1a/c27 30 1 2024-09-13T17:05:43.148 INFO:tasks.workunit.client.1.smithi195.stdout:2/188: rmdir d0/d1a/d1c 39 2024-09-13T17:05:43.149 INFO:tasks.workunit.client.0.smithi115.stdout:4/191: dread d7/dd/de/f10 [0,4194304] 0 2024-09-13T17:05:43.149 INFO:tasks.workunit.client.1.smithi195.stdout:7/237: mknod d5/d35/c47 0 2024-09-13T17:05:43.150 INFO:tasks.workunit.client.0.smithi115.stdout:6/138: fsync d8/d13/d15/d24/f29 0 2024-09-13T17:05:43.152 INFO:tasks.workunit.client.0.smithi115.stdout:4/192: mkdir d7/dd/d3c 0 2024-09-13T17:05:43.154 INFO:tasks.workunit.client.0.smithi115.stdout:6/139: mkdir d8/d2c 0 2024-09-13T17:05:43.154 INFO:tasks.workunit.client.0.smithi115.stdout:6/140: write d8/db/d1d/f18 [1154785,52391] 0 2024-09-13T17:05:43.154 INFO:tasks.workunit.client.0.smithi115.stdout:6/141: chown d8/db/l14 560 1 2024-09-13T17:05:43.154 INFO:tasks.workunit.client.1.smithi195.stdout:1/141: read db/df/d13/f27 [871131,126234] 0 2024-09-13T17:05:43.155 INFO:tasks.workunit.client.1.smithi195.stdout:4/247: rename fe to d1a/d1f/d43/f50 0 2024-09-13T17:05:43.156 INFO:tasks.workunit.client.0.smithi115.stdout:4/193: rmdir d7 39 2024-09-13T17:05:43.156 INFO:tasks.workunit.client.0.smithi115.stdout:4/194: write d7/dd/de/f1c [4963084,13206] 0 2024-09-13T17:05:43.156 INFO:tasks.workunit.client.0.smithi115.stdout:4/195: readlink d7/dd/de/l39 0 2024-09-13T17:05:43.156 INFO:tasks.workunit.client.1.smithi195.stdout:9/205: write d6/d12/d39/f3d [4664769,113556] 0 2024-09-13T17:05:43.158 INFO:tasks.workunit.client.1.smithi195.stdout:2/189: link d0/c30 d0/d1a/d1c/c3c 0 2024-09-13T17:05:43.159 INFO:tasks.workunit.client.0.smithi115.stdout:6/142: truncate d8/f25 955547 0 2024-09-13T17:05:43.160 INFO:tasks.workunit.client.0.smithi115.stdout:6/143: rename d8 to d8/db/d28/d2d 22 2024-09-13T17:05:43.160 INFO:tasks.workunit.client.1.smithi195.stdout:9/206: dread d6/df/d16/f32 [0,4194304] 0 2024-09-13T17:05:43.160 INFO:tasks.workunit.client.1.smithi195.stdout:9/207: read d6/df/f27 [666107,118211] 0 2024-09-13T17:05:43.160 INFO:tasks.workunit.client.1.smithi195.stdout:9/208: fdatasync d6/d12/d39/f42 0 2024-09-13T17:05:43.162 INFO:tasks.workunit.client.0.smithi115.stdout:4/196: dread d7/f12 [0,4194304] 0 2024-09-13T17:05:43.162 INFO:tasks.workunit.client.0.smithi115.stdout:6/144: getdents d8/d13 0 2024-09-13T17:05:43.162 INFO:tasks.workunit.client.0.smithi115.stdout:4/197: write d7/dd/de/f3a [770931,126517] 0 2024-09-13T17:05:43.162 INFO:tasks.workunit.client.0.smithi115.stdout:4/198: write d7/dd/de/f17 [2045830,109895] 0 2024-09-13T17:05:43.162 INFO:tasks.workunit.client.1.smithi195.stdout:1/142: dread db/df/f26 [0,4194304] 0 2024-09-13T17:05:43.165 INFO:tasks.workunit.client.1.smithi195.stdout:1/143: link c1 db/d19/c30 0 2024-09-13T17:05:43.166 INFO:tasks.workunit.client.0.smithi115.stdout:4/199: dread d7/f35 [0,4194304] 0 2024-09-13T17:05:43.167 INFO:tasks.workunit.client.1.smithi195.stdout:1/144: rmdir db/df/d13/d2f 0 2024-09-13T17:05:43.167 INFO:tasks.workunit.client.1.smithi195.stdout:1/145: dread - db/df/f1f zero size 2024-09-13T17:05:43.168 INFO:tasks.workunit.client.1.smithi195.stdout:1/146: dread db/f1b [0,4194304] 0 2024-09-13T17:05:43.170 INFO:tasks.workunit.client.1.smithi195.stdout:8/207: dwrite d0/f20 [0,4194304] 0 2024-09-13T17:05:43.171 INFO:tasks.workunit.client.0.smithi115.stdout:4/200: truncate d7/f19 4417735 0 2024-09-13T17:05:43.174 INFO:tasks.workunit.client.1.smithi195.stdout:1/147: unlink db/le 0 2024-09-13T17:05:43.175 INFO:tasks.workunit.client.1.smithi195.stdout:2/190: write d0/d1a/d1c/d1e/f2a [1430747,23832] 0 2024-09-13T17:05:43.176 INFO:tasks.workunit.client.0.smithi115.stdout:4/201: symlink d7/dd/l3d 0 2024-09-13T17:05:43.176 INFO:tasks.workunit.client.0.smithi115.stdout:4/202: chown d7/dd/f37 258366828 1 2024-09-13T17:05:43.178 INFO:tasks.workunit.client.1.smithi195.stdout:5/206: dwrite d2/d3e/f35 [0,4194304] 0 2024-09-13T17:05:43.178 INFO:tasks.workunit.client.1.smithi195.stdout:5/207: write d2/f26 [271135,7185] 0 2024-09-13T17:05:43.178 INFO:tasks.workunit.client.0.smithi115.stdout:2/226: dwrite f2 [0,4194304] 0 2024-09-13T17:05:43.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:42 smithi115 ceph-mon[27708]: from='client.14628 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:05:43.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:42 smithi115 ceph-mon[27708]: pgmap v10: 65 pgs: 65 active+clean; 349 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 14 MiB/s rd, 22 MiB/s wr, 512 op/s 2024-09-13T17:05:43.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:42 smithi115 ceph-mon[27708]: from='client.? 172.21.15.115:0/1959308402' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:05:43.179 INFO:tasks.workunit.client.0.smithi115.stdout:0/81: dwrite d9/fd [0,4194304] 0 2024-09-13T17:05:43.179 INFO:tasks.workunit.client.0.smithi115.stdout:7/57: fdatasync d0/fa 0 2024-09-13T17:05:43.181 INFO:tasks.workunit.client.1.smithi195.stdout:1/148: mknod db/c31 0 2024-09-13T17:05:43.184 INFO:tasks.workunit.client.0.smithi115.stdout:8/160: dwrite d0/d15/f1b [0,4194304] 0 2024-09-13T17:05:43.184 INFO:tasks.workunit.client.1.smithi195.stdout:7/238: dread d5/f6 [4194304,4194304] 0 2024-09-13T17:05:43.184 INFO:tasks.workunit.client.1.smithi195.stdout:7/239: chown d5/db/d19/d22 13546388 1 2024-09-13T17:05:43.187 INFO:tasks.workunit.client.0.smithi115.stdout:5/140: dwrite d19/d21/f31 [0,4194304] 0 2024-09-13T17:05:43.187 INFO:tasks.workunit.client.0.smithi115.stdout:5/141: chown d19/c33 246 1 2024-09-13T17:05:43.187 INFO:tasks.workunit.client.0.smithi115.stdout:9/88: dwrite d0/de/d10/d15/f20 [0,4194304] 0 2024-09-13T17:05:43.187 INFO:tasks.workunit.client.1.smithi195.stdout:0/197: dwrite d7/db/d11/f1f [0,4194304] 0 2024-09-13T17:05:43.188 INFO:tasks.workunit.client.0.smithi115.stdout:8/161: fdatasync d0/f1d 0 2024-09-13T17:05:43.188 INFO:tasks.workunit.client.0.smithi115.stdout:8/162: stat d0/d18/d19/d28 0 2024-09-13T17:05:43.188 INFO:tasks.workunit.client.0.smithi115.stdout:1/84: dwrite d5/fc [0,4194304] 0 2024-09-13T17:05:43.188 INFO:tasks.workunit.client.0.smithi115.stdout:1/85: chown d5/d7/f16 245512539 1 2024-09-13T17:05:43.188 INFO:tasks.workunit.client.0.smithi115.stdout:4/203: write d7/dd/de/f3a [352020,116965] 0 2024-09-13T17:05:43.189 INFO:tasks.workunit.client.0.smithi115.stdout:2/227: rename d3/c12 to d3/d5/dd/d1f/d2f/c48 0 2024-09-13T17:05:43.189 INFO:tasks.workunit.client.0.smithi115.stdout:2/228: chown d3 11 1 2024-09-13T17:05:43.189 INFO:tasks.workunit.client.1.smithi195.stdout:2/191: mkdir d0/d3/d3d 0 2024-09-13T17:05:43.189 INFO:tasks.workunit.client.1.smithi195.stdout:2/192: dread - d0/d3/df/f35 zero size 2024-09-13T17:05:43.191 INFO:tasks.workunit.client.0.smithi115.stdout:0/82: stat d9/fc 0 2024-09-13T17:05:43.192 INFO:tasks.workunit.client.1.smithi195.stdout:5/208: fdatasync d2/f26 0 2024-09-13T17:05:43.192 INFO:tasks.workunit.client.1.smithi195.stdout:5/209: chown d2/d4/d10/d45 51569 1 2024-09-13T17:05:43.192 INFO:tasks.workunit.client.1.smithi195.stdout:5/210: fsync d2/d4/d10/f15 0 2024-09-13T17:05:43.195 INFO:tasks.workunit.client.1.smithi195.stdout:4/248: dwrite f14 [0,4194304] 0 2024-09-13T17:05:43.195 INFO:tasks.workunit.client.0.smithi115.stdout:7/58: mkdir d0/d2/df 0 2024-09-13T17:05:43.198 INFO:tasks.workunit.client.1.smithi195.stdout:8/208: dwrite d0/d4/fb [0,4194304] 0 2024-09-13T17:05:43.200 INFO:tasks.workunit.client.1.smithi195.stdout:1/149: dwrite db/f2c [0,4194304] 0 2024-09-13T17:05:43.200 INFO:tasks.workunit.client.0.smithi115.stdout:4/204: dread d7/dd/f1e [0,4194304] 0 2024-09-13T17:05:43.207 INFO:tasks.workunit.client.1.smithi195.stdout:7/240: symlink d5/d35/d37/l48 0 2024-09-13T17:05:43.207 INFO:tasks.workunit.client.1.smithi195.stdout:7/241: stat d5/db/d19/d22 0 2024-09-13T17:05:43.207 INFO:tasks.workunit.client.1.smithi195.stdout:9/209: dwrite d6/df/f27 [0,4194304] 0 2024-09-13T17:05:43.207 INFO:tasks.workunit.client.1.smithi195.stdout:2/193: write d0/d1a/f36 [3283667,105331] 0 2024-09-13T17:05:43.208 INFO:tasks.workunit.client.0.smithi115.stdout:5/142: symlink d19/d21/l34 0 2024-09-13T17:05:43.210 INFO:tasks.workunit.client.1.smithi195.stdout:0/198: getdents d7/d10 0 2024-09-13T17:05:43.216 INFO:tasks.workunit.client.1.smithi195.stdout:4/249: mknod d1a/d1f/d43/c51 0 2024-09-13T17:05:43.216 INFO:tasks.workunit.client.1.smithi195.stdout:4/250: chown d1a/d1f/d43/c51 0 1 2024-09-13T17:05:43.216 INFO:tasks.workunit.client.0.smithi115.stdout:8/163: dwrite d0/d15/f1b [0,4194304] 0 2024-09-13T17:05:43.217 INFO:tasks.workunit.client.0.smithi115.stdout:5/143: write d19/f25 [556931,723] 0 2024-09-13T17:05:43.217 INFO:tasks.workunit.client.0.smithi115.stdout:5/144: chown lb 32080 1 2024-09-13T17:05:43.218 INFO:tasks.workunit.client.1.smithi195.stdout:5/211: dwrite d2/f26 [0,4194304] 0 2024-09-13T17:05:43.218 INFO:tasks.workunit.client.1.smithi195.stdout:5/212: chown d2/c14 302946253 1 2024-09-13T17:05:43.219 INFO:tasks.workunit.client.0.smithi115.stdout:5/145: dread f16 [0,4194304] 0 2024-09-13T17:05:43.219 INFO:tasks.workunit.client.0.smithi115.stdout:9/89: write d0/fb [985335,80669] 0 2024-09-13T17:05:43.219 INFO:tasks.workunit.client.0.smithi115.stdout:9/90: write d0/de/d10/f14 [1163191,50202] 0 2024-09-13T17:05:43.221 INFO:tasks.workunit.client.1.smithi195.stdout:8/209: rename d0/d13/c32 to d0/d17/d2f/c45 0 2024-09-13T17:05:43.223 INFO:tasks.workunit.client.1.smithi195.stdout:6/160: sync 2024-09-13T17:05:43.225 INFO:tasks.workunit.client.0.smithi115.stdout:2/229: creat d3/d5/de/d3a/d47/f49 x:0 0 0 2024-09-13T17:05:43.225 INFO:tasks.workunit.client.0.smithi115.stdout:2/230: write d3/f14 [4909547,44939] 0 2024-09-13T17:05:43.225 INFO:tasks.workunit.client.0.smithi115.stdout:2/231: fsync f2 0 2024-09-13T17:05:43.226 INFO:tasks.workunit.client.0.smithi115.stdout:8/164: dread d0/d15/f1b [0,4194304] 0 2024-09-13T17:05:43.226 INFO:tasks.workunit.client.0.smithi115.stdout:8/165: fsync d0/d15/f20 0 2024-09-13T17:05:43.227 INFO:tasks.workunit.client.1.smithi195.stdout:1/150: symlink db/l32 0 2024-09-13T17:05:43.227 INFO:tasks.workunit.client.1.smithi195.stdout:1/151: fdatasync db/f11 0 2024-09-13T17:05:43.228 INFO:tasks.workunit.client.1.smithi195.stdout:2/194: dread d0/d1a/f36 [0,4194304] 0 2024-09-13T17:05:43.231 INFO:tasks.workunit.client.1.smithi195.stdout:1/152: dread f5 [0,4194304] 0 2024-09-13T17:05:43.233 INFO:tasks.workunit.client.1.smithi195.stdout:0/199: unlink d7/d8/d23/c37 0 2024-09-13T17:05:43.233 INFO:tasks.workunit.client.0.smithi115.stdout:0/83: getdents d9 0 2024-09-13T17:05:43.233 INFO:tasks.workunit.client.0.smithi115.stdout:0/84: fdatasync d9/fd 0 2024-09-13T17:05:43.235 INFO:tasks.workunit.client.1.smithi195.stdout:5/213: read d2/f17 [3495297,21282] 0 2024-09-13T17:05:43.235 INFO:tasks.workunit.client.1.smithi195.stdout:5/214: chown d2/d4/f2b 1 1 2024-09-13T17:05:43.236 INFO:tasks.workunit.client.1.smithi195.stdout:0/200: dread d7/d8/d16/f21 [0,4194304] 0 2024-09-13T17:05:43.236 INFO:tasks.workunit.client.1.smithi195.stdout:4/251: creat d1a/d1f/d21/d36/f52 x:0 0 0 2024-09-13T17:05:43.236 INFO:tasks.workunit.client.1.smithi195.stdout:4/252: getdents d1a/d1f 0 2024-09-13T17:05:43.237 INFO:tasks.workunit.client.1.smithi195.stdout:4/253: stat d1a/d1f/d43/d29 0 2024-09-13T17:05:43.238 INFO:tasks.workunit.client.0.smithi115.stdout:4/205: link d7/dd/de/f10 d7/dd/d3c/f3e 0 2024-09-13T17:05:43.238 INFO:tasks.workunit.client.0.smithi115.stdout:4/206: rename d7 to d7/dd/de/d3f 22 2024-09-13T17:05:43.240 INFO:tasks.workunit.client.0.smithi115.stdout:5/146: symlink d19/d21/l35 0 2024-09-13T17:05:43.242 INFO:tasks.workunit.client.1.smithi195.stdout:5/215: read d2/df/fa [2076489,66266] 0 2024-09-13T17:05:43.242 INFO:tasks.workunit.client.1.smithi195.stdout:5/216: stat d2/d4/l1f 0 2024-09-13T17:05:43.243 INFO:tasks.workunit.client.0.smithi115.stdout:1/86: getdents d5/d7 0 2024-09-13T17:05:43.244 INFO:tasks.workunit.client.1.smithi195.stdout:6/161: creat d1c/d24/f2e x:0 0 0 2024-09-13T17:05:43.246 INFO:tasks.workunit.client.1.smithi195.stdout:2/195: creat d0/d1a/d1c/f3e x:0 0 0 2024-09-13T17:05:43.246 INFO:tasks.workunit.client.1.smithi195.stdout:2/196: write d0/d1a/d1c/d1e/f2a [3655503,41898] 0 2024-09-13T17:05:43.246 INFO:tasks.workunit.client.1.smithi195.stdout:2/197: read - d0/f21 zero size 2024-09-13T17:05:43.247 INFO:tasks.workunit.client.0.smithi115.stdout:2/232: symlink d3/d5/dd/df/d22/l4a 0 2024-09-13T17:05:43.248 INFO:tasks.workunit.client.1.smithi195.stdout:1/153: unlink db/f1b 0 2024-09-13T17:05:43.248 INFO:tasks.workunit.client.1.smithi195.stdout:1/154: truncate db/f10 3318282 0 2024-09-13T17:05:43.249 INFO:tasks.workunit.client.0.smithi115.stdout:0/85: link f0 d9/f17 0 2024-09-13T17:05:43.250 INFO:tasks.workunit.client.1.smithi195.stdout:0/201: unlink d7/d8/df/c2f 0 2024-09-13T17:05:43.251 INFO:tasks.workunit.client.0.smithi115.stdout:7/59: getdents d0 0 2024-09-13T17:05:43.252 INFO:tasks.workunit.client.0.smithi115.stdout:4/207: creat d7/dd/d3c/f40 x:0 0 0 2024-09-13T17:05:43.253 INFO:tasks.workunit.client.1.smithi195.stdout:2/198: creat d0/d1a/d1c/d1e/f3f x:0 0 0 2024-09-13T17:05:43.253 INFO:tasks.workunit.client.0.smithi115.stdout:5/147: mknod d19/d21/c36 0 2024-09-13T17:05:43.254 INFO:tasks.workunit.client.1.smithi195.stdout:0/202: mknod d7/db/d38/c39 0 2024-09-13T17:05:43.255 INFO:tasks.workunit.client.1.smithi195.stdout:6/162: mknod d1c/c2f 0 2024-09-13T17:05:43.255 INFO:tasks.workunit.client.1.smithi195.stdout:6/163: chown d1c/l2a 105075907 1 2024-09-13T17:05:43.255 INFO:tasks.workunit.client.1.smithi195.stdout:6/164: write d1c/d28/f2b [1016971,300] 0 2024-09-13T17:05:43.255 INFO:tasks.workunit.client.1.smithi195.stdout:6/165: fsync d1c/f1e 0 2024-09-13T17:05:43.255 INFO:tasks.workunit.client.1.smithi195.stdout:6/166: chown f1a 2575 1 2024-09-13T17:05:43.256 INFO:tasks.workunit.client.1.smithi195.stdout:6/167: write d1c/f23 [1619909,73813] 0 2024-09-13T17:05:43.256 INFO:tasks.workunit.client.0.smithi115.stdout:9/91: rmdir d0/de/d10 39 2024-09-13T17:05:43.256 INFO:tasks.workunit.client.1.smithi195.stdout:2/199: mknod d0/d3/c40 0 2024-09-13T17:05:43.260 INFO:tasks.workunit.client.0.smithi115.stdout:1/87: symlink d5/d7/l1e 0 2024-09-13T17:05:43.260 INFO:tasks.workunit.client.0.smithi115.stdout:2/233: write d3/d5/de/f10 [3178057,89324] 0 2024-09-13T17:05:43.263 INFO:tasks.workunit.client.1.smithi195.stdout:2/200: rename d0/c39 to d0/d1a/c41 0 2024-09-13T17:05:43.263 INFO:tasks.workunit.client.1.smithi195.stdout:6/168: mkdir d1c/d2d/d30 0 2024-09-13T17:05:43.265 INFO:tasks.workunit.client.0.smithi115.stdout:7/60: creat d0/d2/df/f10 x:0 0 0 2024-09-13T17:05:43.265 INFO:tasks.workunit.client.0.smithi115.stdout:7/61: dread - d0/d2/df/f10 zero size 2024-09-13T17:05:43.265 INFO:tasks.workunit.client.0.smithi115.stdout:4/208: mknod d7/c41 0 2024-09-13T17:05:43.265 INFO:tasks.workunit.client.0.smithi115.stdout:1/88: dread - d5/d7/f18 zero size 2024-09-13T17:05:43.265 INFO:tasks.workunit.client.1.smithi195.stdout:0/203: dread d7/d8/d16/f1b [0,4194304] 0 2024-09-13T17:05:43.266 INFO:tasks.workunit.client.1.smithi195.stdout:2/201: link d0/d1a/d1c/d1e/f31 d0/d3/df/d11/f42 0 2024-09-13T17:05:43.267 INFO:tasks.workunit.client.0.smithi115.stdout:7/62: stat d0/d2/f8 0 2024-09-13T17:05:43.267 INFO:tasks.workunit.client.0.smithi115.stdout:2/234: symlink d3/d5/dd/d1f/d2f/l4b 0 2024-09-13T17:05:43.267 INFO:tasks.workunit.client.0.smithi115.stdout:2/235: chown d3/d5/dd/df/d22/f42 52546731 1 2024-09-13T17:05:43.267 INFO:tasks.workunit.client.1.smithi195.stdout:0/204: dread d7/d8/d16/f21 [0,4194304] 0 2024-09-13T17:05:43.267 INFO:tasks.workunit.client.1.smithi195.stdout:0/205: chown d7/d8/d23 39 1 2024-09-13T17:05:43.267 INFO:tasks.workunit.client.1.smithi195.stdout:0/206: fdatasync d7/d8/d16/f2c 0 2024-09-13T17:05:43.267 INFO:tasks.workunit.client.0.smithi115.stdout:4/209: mknod d7/dd/d3c/c42 0 2024-09-13T17:05:43.268 INFO:tasks.workunit.client.0.smithi115.stdout:4/210: write d7/dd/de/f13 [5489501,6254] 0 2024-09-13T17:05:43.268 INFO:tasks.workunit.client.0.smithi115.stdout:9/92: mkdir d0/d21 0 2024-09-13T17:05:43.268 INFO:tasks.workunit.client.0.smithi115.stdout:9/93: fsync d0/f11 0 2024-09-13T17:05:43.269 INFO:tasks.workunit.client.1.smithi195.stdout:0/207: mknod d7/db/d38/c3a 0 2024-09-13T17:05:43.269 INFO:tasks.workunit.client.0.smithi115.stdout:7/63: truncate d0/fa 907462 0 2024-09-13T17:05:43.270 INFO:tasks.workunit.client.0.smithi115.stdout:2/236: creat d3/d5/de/d3a/f4c x:0 0 0 2024-09-13T17:05:43.270 INFO:tasks.workunit.client.0.smithi115.stdout:2/237: chown d3/d5/de/d3a/d47 5 1 2024-09-13T17:05:43.270 INFO:tasks.workunit.client.1.smithi195.stdout:6/169: dread f2 [0,4194304] 0 2024-09-13T17:05:43.271 INFO:tasks.workunit.client.1.smithi195.stdout:0/208: creat d7/db/d38/f3b x:0 0 0 2024-09-13T17:05:43.271 INFO:tasks.workunit.client.0.smithi115.stdout:9/94: unlink d0/de/l1c 0 2024-09-13T17:05:43.272 INFO:tasks.workunit.client.0.smithi115.stdout:4/211: dread d7/f35 [0,4194304] 0 2024-09-13T17:05:43.273 INFO:tasks.workunit.client.1.smithi195.stdout:6/170: link c9 d1c/d2d/c31 0 2024-09-13T17:05:43.273 INFO:tasks.workunit.client.1.smithi195.stdout:6/171: write d1c/f23 [2457969,107469] 0 2024-09-13T17:05:43.273 INFO:tasks.workunit.client.1.smithi195.stdout:6/172: write d1c/d24/f2e [497731,40654] 0 2024-09-13T17:05:43.274 INFO:tasks.workunit.client.0.smithi115.stdout:7/64: creat d0/dc/f11 x:0 0 0 2024-09-13T17:05:43.275 INFO:tasks.workunit.client.0.smithi115.stdout:5/148: dwrite f16 [0,4194304] 0 2024-09-13T17:05:43.276 INFO:tasks.workunit.client.0.smithi115.stdout:9/95: creat d0/d21/f22 x:0 0 0 2024-09-13T17:05:43.276 INFO:tasks.workunit.client.0.smithi115.stdout:5/149: write f5 [210885,58916] 0 2024-09-13T17:05:43.277 INFO:tasks.workunit.client.1.smithi195.stdout:6/173: creat d1c/d2d/f32 x:0 0 0 2024-09-13T17:05:43.279 INFO:tasks.workunit.client.0.smithi115.stdout:9/96: symlink d0/d21/l23 0 2024-09-13T17:05:43.280 INFO:tasks.workunit.client.1.smithi195.stdout:6/174: symlink d1c/l33 0 2024-09-13T17:05:43.280 INFO:tasks.workunit.client.1.smithi195.stdout:6/175: write f18 [412963,61787] 0 2024-09-13T17:05:43.281 INFO:tasks.workunit.client.0.smithi115.stdout:9/97: rename d0/de/f18 to d0/de/d10/d15/f24 0 2024-09-13T17:05:43.281 INFO:tasks.workunit.client.1.smithi195.stdout:8/210: dwrite d0/d4/fb [0,4194304] 0 2024-09-13T17:05:43.290 INFO:tasks.workunit.client.0.smithi115.stdout:8/166: dwrite d0/f1d [0,4194304] 0 2024-09-13T17:05:43.291 INFO:tasks.workunit.client.1.smithi195.stdout:0/209: dwrite d7/d8/d23/f35 [0,4194304] 0 2024-09-13T17:05:43.292 INFO:tasks.workunit.client.0.smithi115.stdout:4/212: dwrite d7/fc [0,4194304] 0 2024-09-13T17:05:43.295 INFO:tasks.workunit.client.0.smithi115.stdout:4/213: dread d7/f30 [0,4194304] 0 2024-09-13T17:05:43.308 INFO:tasks.workunit.client.0.smithi115.stdout:0/86: dwrite f0 [0,4194304] 0 2024-09-13T17:05:43.310 INFO:tasks.workunit.client.1.smithi195.stdout:1/155: dwrite db/df/d13/f1e [4194304,4194304] 0 2024-09-13T17:05:43.310 INFO:tasks.workunit.client.1.smithi195.stdout:1/156: creat db/f33 x:0 0 0 2024-09-13T17:05:43.311 INFO:tasks.workunit.client.1.smithi195.stdout:1/157: dread db/f11 [0,4194304] 0 2024-09-13T17:05:43.316 INFO:tasks.workunit.client.0.smithi115.stdout:8/167: dwrite d0/f13 [4194304,4194304] 0 2024-09-13T17:05:43.319 INFO:tasks.workunit.client.1.smithi195.stdout:6/176: dwrite d1c/d28/f2b [0,4194304] 0 2024-09-13T17:05:43.320 INFO:tasks.workunit.client.0.smithi115.stdout:1/89: dwrite d5/d7/f13 [0,4194304] 0 2024-09-13T17:05:43.320 INFO:tasks.workunit.client.0.smithi115.stdout:5/150: dwrite d19/d1d/f20 [0,4194304] 0 2024-09-13T17:05:43.320 INFO:tasks.workunit.client.0.smithi115.stdout:5/151: creat d19/f37 x:0 0 0 2024-09-13T17:05:43.325 INFO:tasks.workunit.client.1.smithi195.stdout:1/158: dwrite db/f11 [0,4194304] 0 2024-09-13T17:05:43.325 INFO:tasks.workunit.client.1.smithi195.stdout:1/159: dread - db/f2b zero size 2024-09-13T17:05:43.325 INFO:tasks.workunit.client.1.smithi195.stdout:1/160: write db/f10 [3023732,89210] 0 2024-09-13T17:05:43.326 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:42 smithi195 ceph-mon[34981]: from='client.14628 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:05:43.326 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:42 smithi195 ceph-mon[34981]: pgmap v10: 65 pgs: 65 active+clean; 349 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 14 MiB/s rd, 22 MiB/s wr, 512 op/s 2024-09-13T17:05:43.326 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:42 smithi195 ceph-mon[34981]: from='client.? 172.21.15.115:0/1959308402' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:05:43.330 INFO:tasks.workunit.client.0.smithi115.stdout:1/90: write d5/d7/f13 [3193421,10783] 0 2024-09-13T17:05:43.332 INFO:tasks.workunit.client.0.smithi115.stdout:5/152: dread d19/f25 [0,4194304] 0 2024-09-13T17:05:43.347 INFO:tasks.workunit.client.0.smithi115.stdout:1/91: dwrite d5/f14 [0,4194304] 0 2024-09-13T17:05:43.376 INFO:tasks.workunit.client.0.smithi115.stdout:9/98: symlink d0/de/d10/l25 0 2024-09-13T17:05:43.378 INFO:tasks.workunit.client.0.smithi115.stdout:9/99: dread d0/de/d10/f14 [0,4194304] 0 2024-09-13T17:05:43.379 INFO:tasks.workunit.client.0.smithi115.stdout:9/100: stat d0/de/d10/d15 0 2024-09-13T17:05:43.379 INFO:tasks.workunit.client.1.smithi195.stdout:8/211: symlink d0/d17/l46 0 2024-09-13T17:05:43.384 INFO:tasks.workunit.client.0.smithi115.stdout:4/214: unlink d7/dd/de/f10 0 2024-09-13T17:05:43.387 INFO:tasks.workunit.client.1.smithi195.stdout:5/217: write d2/f26 [4458595,119361] 0 2024-09-13T17:05:43.387 INFO:tasks.workunit.client.1.smithi195.stdout:5/218: stat d2/df/f1a 0 2024-09-13T17:05:43.387 INFO:tasks.workunit.client.1.smithi195.stdout:0/210: mknod d7/c3c 0 2024-09-13T17:05:43.389 INFO:tasks.workunit.client.1.smithi195.stdout:3/169: sync 2024-09-13T17:05:43.393 INFO:tasks.workunit.client.0.smithi115.stdout:0/87: getdents d9 0 2024-09-13T17:05:43.393 INFO:tasks.workunit.client.0.smithi115.stdout:0/88: fsync d9/fa 0 2024-09-13T17:05:43.396 INFO:tasks.workunit.client.1.smithi195.stdout:8/212: dwrite d0/f20 [0,4194304] 0 2024-09-13T17:05:43.397 INFO:tasks.workunit.client.0.smithi115.stdout:9/101: dwrite d0/de/d10/f14 [0,4194304] 0 2024-09-13T17:05:43.402 INFO:tasks.workunit.client.0.smithi115.stdout:0/89: dread f2 [0,4194304] 0 2024-09-13T17:05:43.402 INFO:tasks.workunit.client.0.smithi115.stdout:0/90: chown d9/c11 670072 1 2024-09-13T17:05:43.407 INFO:tasks.workunit.client.1.smithi195.stdout:0/211: dwrite d7/d8/d23/f25 [0,4194304] 0 2024-09-13T17:05:43.408 INFO:tasks.workunit.client.1.smithi195.stdout:0/212: chown d7/d8/df/f2e 316755 1 2024-09-13T17:05:43.409 INFO:tasks.workunit.client.1.smithi195.stdout:2/202: fsync d0/d3/df/d11/f42 0 2024-09-13T17:05:43.413 INFO:tasks.workunit.client.0.smithi115.stdout:7/65: truncate d0/fa 1594299 0 2024-09-13T17:05:43.416 INFO:tasks.workunit.client.0.smithi115.stdout:2/238: rename d3/d5 to d3/d4d 0 2024-09-13T17:05:43.418 INFO:tasks.workunit.client.0.smithi115.stdout:5/153: symlink d19/d2c/l38 0 2024-09-13T17:05:43.419 INFO:tasks.workunit.client.0.smithi115.stdout:5/154: chown f16 7008 1 2024-09-13T17:05:43.433 INFO:tasks.workunit.client.0.smithi115.stdout:2/239: dwrite d3/f40 [0,4194304] 0 2024-09-13T17:05:43.433 INFO:tasks.workunit.client.0.smithi115.stdout:2/240: rename d3 to d3/d4d/d13/d1c/d4e 22 2024-09-13T17:05:43.436 INFO:tasks.workunit.client.0.smithi115.stdout:2/241: dread d3/d4d/de/f2a [0,4194304] 0 2024-09-13T17:05:43.436 INFO:tasks.workunit.client.0.smithi115.stdout:2/242: fdatasync d3/d4d/de/f10 0 2024-09-13T17:05:43.438 INFO:tasks.workunit.client.0.smithi115.stdout:5/155: dwrite d19/d21/f2a [0,4194304] 0 2024-09-13T17:05:43.440 INFO:tasks.workunit.client.0.smithi115.stdout:1/92: creat d5/d7/f1f x:0 0 0 2024-09-13T17:05:43.443 INFO:tasks.workunit.client.0.smithi115.stdout:4/215: unlink d7/dd/c2f 0 2024-09-13T17:05:43.443 INFO:tasks.workunit.client.0.smithi115.stdout:4/216: stat d7/f36 0 2024-09-13T17:05:43.444 INFO:tasks.workunit.client.1.smithi195.stdout:3/170: truncate d7/fa 3697810 0 2024-09-13T17:05:43.446 INFO:tasks.workunit.client.0.smithi115.stdout:9/102: fdatasync d0/f1f 0 2024-09-13T17:05:43.448 INFO:tasks.workunit.client.0.smithi115.stdout:0/91: link f2 d9/f18 0 2024-09-13T17:05:43.449 INFO:tasks.workunit.client.1.smithi195.stdout:8/213: mkdir d0/d17/d2f/d47 0 2024-09-13T17:05:43.450 INFO:tasks.workunit.client.0.smithi115.stdout:7/66: symlink d0/l12 0 2024-09-13T17:05:43.451 INFO:tasks.workunit.client.1.smithi195.stdout:2/203: mkdir d0/d1a/d1c/d2c/d43 0 2024-09-13T17:05:43.453 INFO:tasks.workunit.client.1.smithi195.stdout:1/161: getdents db/df 0 2024-09-13T17:05:43.455 INFO:tasks.workunit.client.1.smithi195.stdout:5/219: symlink d2/d3e/d32/l47 0 2024-09-13T17:05:43.455 INFO:tasks.workunit.client.1.smithi195.stdout:5/220: readlink d2/df/l2a 0 2024-09-13T17:05:43.458 INFO:tasks.workunit.client.0.smithi115.stdout:4/217: dwrite d7/f19 [0,4194304] 0 2024-09-13T17:05:43.458 INFO:tasks.workunit.client.0.smithi115.stdout:4/218: fsync d7/dd/de/f1c 0 2024-09-13T17:05:43.459 INFO:tasks.workunit.client.1.smithi195.stdout:3/171: mkdir d7/d21/d2a 0 2024-09-13T17:05:43.460 INFO:tasks.workunit.client.1.smithi195.stdout:8/214: creat d0/d17/d2f/d47/f48 x:0 0 0 2024-09-13T17:05:43.461 INFO:tasks.workunit.client.1.smithi195.stdout:2/204: mknod d0/d3/c44 0 2024-09-13T17:05:43.463 INFO:tasks.workunit.client.1.smithi195.stdout:2/205: dread d0/d1a/d1c/f23 [0,4194304] 0 2024-09-13T17:05:43.463 INFO:tasks.workunit.client.1.smithi195.stdout:1/162: unlink db/f2c 0 2024-09-13T17:05:43.464 INFO:tasks.workunit.client.1.smithi195.stdout:2/206: fdatasync d0/f21 0 2024-09-13T17:05:43.465 INFO:tasks.workunit.client.1.smithi195.stdout:5/221: truncate d2/d4/d10/f28 753574 0 2024-09-13T17:05:43.465 INFO:tasks.workunit.client.1.smithi195.stdout:5/222: dread - d2/df/d39/f44 zero size 2024-09-13T17:05:43.465 INFO:tasks.workunit.client.1.smithi195.stdout:5/223: dread - d2/df/f42 zero size 2024-09-13T17:05:43.465 INFO:tasks.workunit.client.0.smithi115.stdout:2/243: symlink d3/d4d/dd/l4f 0 2024-09-13T17:05:43.466 INFO:tasks.workunit.client.1.smithi195.stdout:3/172: readlink d7/ld 0 2024-09-13T17:05:43.467 INFO:tasks.workunit.client.0.smithi115.stdout:5/156: link d19/d21/l35 d19/d2b/d32/l39 0 2024-09-13T17:05:43.469 INFO:tasks.workunit.client.1.smithi195.stdout:8/215: unlink d0/d17/d2f/d31/c42 0 2024-09-13T17:05:43.471 INFO:tasks.workunit.client.0.smithi115.stdout:1/93: creat d5/f20 x:0 0 0 2024-09-13T17:05:43.471 INFO:tasks.workunit.client.0.smithi115.stdout:1/94: readlink d5/l11 0 2024-09-13T17:05:43.473 INFO:tasks.workunit.client.1.smithi195.stdout:9/210: sync 2024-09-13T17:05:43.473 INFO:tasks.workunit.client.1.smithi195.stdout:7/242: sync 2024-09-13T17:05:43.473 INFO:tasks.workunit.client.1.smithi195.stdout:3/173: creat d7/d21/d2a/f2b x:0 0 0 2024-09-13T17:05:43.476 INFO:tasks.workunit.client.1.smithi195.stdout:8/216: unlink d0/f20 0 2024-09-13T17:05:43.479 INFO:tasks.workunit.client.1.smithi195.stdout:9/211: mkdir d6/df/d13/d44/d47 0 2024-09-13T17:05:43.483 INFO:tasks.workunit.client.1.smithi195.stdout:8/217: mkdir d0/d17/d49 0 2024-09-13T17:05:43.487 INFO:tasks.workunit.client.0.smithi115.stdout:2/244: symlink d3/d4d/dd/l50 0 2024-09-13T17:05:43.487 INFO:tasks.workunit.client.1.smithi195.stdout:5/224: read d2/f26 [2951701,19106] 0 2024-09-13T17:05:43.488 INFO:tasks.workunit.client.1.smithi195.stdout:8/218: symlink d0/d13/l4a 0 2024-09-13T17:05:43.490 INFO:tasks.workunit.client.1.smithi195.stdout:5/225: mkdir d2/df/d48 0 2024-09-13T17:05:43.491 INFO:tasks.workunit.client.0.smithi115.stdout:5/157: unlink f10 0 2024-09-13T17:05:43.492 INFO:tasks.workunit.client.1.smithi195.stdout:9/212: write d6/d19/d21/f2f [14381,125041] 0 2024-09-13T17:05:43.492 INFO:tasks.workunit.client.1.smithi195.stdout:9/213: dread - d6/d12/d39/f3e zero size 2024-09-13T17:05:43.492 INFO:tasks.workunit.client.1.smithi195.stdout:9/214: write d6/d19/f1f [605607,83026] 0 2024-09-13T17:05:43.493 INFO:tasks.workunit.client.1.smithi195.stdout:4/254: sync 2024-09-13T17:05:43.493 INFO:tasks.workunit.client.1.smithi195.stdout:8/219: unlink d0/c23 0 2024-09-13T17:05:43.494 INFO:tasks.workunit.client.0.smithi115.stdout:0/92: getdents d9 0 2024-09-13T17:05:43.495 INFO:tasks.workunit.client.0.smithi115.stdout:4/219: dwrite d7/f31 [0,4194304] 0 2024-09-13T17:05:43.497 INFO:tasks.workunit.client.0.smithi115.stdout:9/103: rmdir d0/d21 39 2024-09-13T17:05:43.497 INFO:tasks.workunit.client.0.smithi115.stdout:9/104: stat d0/de/f1e 0 2024-09-13T17:05:43.498 INFO:tasks.workunit.client.1.smithi195.stdout:2/207: dwrite d0/d1a/d1c/d1e/f2a [0,4194304] 0 2024-09-13T17:05:43.499 INFO:tasks.workunit.client.1.smithi195.stdout:9/215: mknod d6/d19/d21/d45/c48 0 2024-09-13T17:05:43.501 INFO:tasks.workunit.client.1.smithi195.stdout:1/163: dwrite db/f18 [0,4194304] 0 2024-09-13T17:05:43.501 INFO:tasks.workunit.client.1.smithi195.stdout:1/164: chown db/df/d13/l25 9674 1 2024-09-13T17:05:43.501 INFO:tasks.workunit.client.1.smithi195.stdout:1/165: chown db/f33 355161763 1 2024-09-13T17:05:43.502 INFO:tasks.workunit.client.1.smithi195.stdout:7/243: dwrite d5/db/d19/d22/f38 [0,4194304] 0 2024-09-13T17:05:43.503 INFO:tasks.workunit.client.0.smithi115.stdout:7/67: truncate d0/fa 46359 0 2024-09-13T17:05:43.507 INFO:tasks.workunit.client.0.smithi115.stdout:1/95: read d5/d7/f16 [11032,70786] 0 2024-09-13T17:05:43.507 INFO:tasks.workunit.client.0.smithi115.stdout:0/93: dread d9/f15 [0,4194304] 0 2024-09-13T17:05:43.508 INFO:tasks.workunit.client.0.smithi115.stdout:2/245: rename d3/d4d/de/d3a/f4c to d3/d4d/d13/f51 0 2024-09-13T17:05:43.508 INFO:tasks.workunit.client.0.smithi115.stdout:2/246: fsync d3/d4d/dd/df/f28 0 2024-09-13T17:05:43.509 INFO:tasks.workunit.client.0.smithi115.stdout:2/247: write d3/d4d/dd/df/d22/f29 [1632703,39494] 0 2024-09-13T17:05:43.510 INFO:tasks.workunit.client.1.smithi195.stdout:8/220: mkdir d0/d17/d2f/d47/d4b 0 2024-09-13T17:05:43.512 INFO:tasks.workunit.client.0.smithi115.stdout:2/248: dread d3/d4d/de/f15 [0,4194304] 0 2024-09-13T17:05:43.513 INFO:tasks.workunit.client.1.smithi195.stdout:2/208: creat d0/f45 x:0 0 0 2024-09-13T17:05:43.513 INFO:tasks.workunit.client.0.smithi115.stdout:5/158: mkdir d19/d21/d3a 0 2024-09-13T17:05:43.513 INFO:tasks.workunit.client.0.smithi115.stdout:5/159: stat d19/d21/f30 0 2024-09-13T17:05:43.514 INFO:tasks.workunit.client.1.smithi195.stdout:6/177: sync 2024-09-13T17:05:43.517 INFO:tasks.workunit.client.0.smithi115.stdout:9/105: symlink d0/d21/l26 0 2024-09-13T17:05:43.517 INFO:tasks.workunit.client.0.smithi115.stdout:9/106: write d0/f11 [5186659,64628] 0 2024-09-13T17:05:43.520 INFO:tasks.workunit.client.0.smithi115.stdout:7/68: creat d0/f13 x:0 0 0 2024-09-13T17:05:43.520 INFO:tasks.workunit.client.0.smithi115.stdout:7/69: write d0/dc/f11 [818811,45092] 0 2024-09-13T17:05:43.520 INFO:tasks.workunit.client.0.smithi115.stdout:7/70: creat d0/d2/f14 x:0 0 0 2024-09-13T17:05:43.520 INFO:tasks.workunit.client.0.smithi115.stdout:7/71: write d0/f1 [2958633,13672] 0 2024-09-13T17:05:43.520 INFO:tasks.workunit.client.0.smithi115.stdout:7/72: creat d0/d2/df/f15 x:0 0 0 2024-09-13T17:05:43.520 INFO:tasks.workunit.client.0.smithi115.stdout:7/73: creat d0/d2/df/f16 x:0 0 0 2024-09-13T17:05:43.522 INFO:tasks.workunit.client.1.smithi195.stdout:3/174: dwrite d7/fa [4194304,4194304] 0 2024-09-13T17:05:43.522 INFO:tasks.workunit.client.1.smithi195.stdout:3/175: chown d7/d21/f27 125 1 2024-09-13T17:05:43.523 INFO:tasks.workunit.client.1.smithi195.stdout:1/166: symlink db/d19/l34 0 2024-09-13T17:05:43.523 INFO:tasks.workunit.client.1.smithi195.stdout:1/167: write db/df/f28 [1322783,12898] 0 2024-09-13T17:05:43.523 INFO:tasks.workunit.client.1.smithi195.stdout:1/168: fsync f5 0 2024-09-13T17:05:43.525 INFO:tasks.workunit.client.1.smithi195.stdout:6/178: dread ff [0,4194304] 0 2024-09-13T17:05:43.525 INFO:tasks.workunit.client.0.smithi115.stdout:0/94: unlink d9/fa 0 2024-09-13T17:05:43.525 INFO:tasks.workunit.client.0.smithi115.stdout:0/95: write d9/ff [622548,55519] 0 2024-09-13T17:05:43.527 INFO:tasks.workunit.client.1.smithi195.stdout:4/255: rename c17 to d1a/d1f/d43/c53 0 2024-09-13T17:05:43.527 INFO:tasks.workunit.client.0.smithi115.stdout:5/160: write fd [3181998,6352] 0 2024-09-13T17:05:43.527 INFO:tasks.workunit.client.0.smithi115.stdout:5/161: fdatasync d19/d21/f30 0 2024-09-13T17:05:43.528 INFO:tasks.workunit.client.0.smithi115.stdout:5/162: fdatasync f5 0 2024-09-13T17:05:43.528 INFO:tasks.workunit.client.0.smithi115.stdout:1/96: dread d5/d7/f15 [0,4194304] 0 2024-09-13T17:05:43.529 INFO:tasks.workunit.client.0.smithi115.stdout:2/249: rename d3/d4d/l38 to d3/d4d/dd/l52 0 2024-09-13T17:05:43.529 INFO:tasks.workunit.client.0.smithi115.stdout:2/250: write d3/d4d/de/f10 [2691186,21184] 0 2024-09-13T17:05:43.530 INFO:tasks.workunit.client.1.smithi195.stdout:2/209: mknod d0/d1a/d1c/d2c/d43/c46 0 2024-09-13T17:05:43.530 INFO:tasks.workunit.client.1.smithi195.stdout:2/210: write d0/d3/df/f10 [12703652,46341] 0 2024-09-13T17:05:43.533 INFO:tasks.workunit.client.1.smithi195.stdout:5/226: dwrite d2/f17 [0,4194304] 0 2024-09-13T17:05:43.534 INFO:tasks.workunit.client.0.smithi115.stdout:4/220: dwrite f5 [0,4194304] 0 2024-09-13T17:05:43.537 INFO:tasks.workunit.client.1.smithi195.stdout:9/216: dwrite d6/d12/d39/f3e [0,4194304] 0 2024-09-13T17:05:43.539 INFO:tasks.workunit.client.1.smithi195.stdout:1/169: mknod db/df/d13/c35 0 2024-09-13T17:05:43.540 INFO:tasks.workunit.client.0.smithi115.stdout:7/74: mkdir d0/dc/d17 0 2024-09-13T17:05:43.541 INFO:tasks.workunit.client.1.smithi195.stdout:6/179: symlink d1c/d2d/l34 0 2024-09-13T17:05:43.541 INFO:tasks.workunit.client.1.smithi195.stdout:6/180: fdatasync f14 0 2024-09-13T17:05:43.542 INFO:tasks.workunit.client.0.smithi115.stdout:0/96: creat d9/f19 x:0 0 0 2024-09-13T17:05:43.545 INFO:tasks.workunit.client.1.smithi195.stdout:4/256: dread d1a/d1f/d43/f3d [0,4194304] 0 2024-09-13T17:05:43.547 INFO:tasks.workunit.client.0.smithi115.stdout:5/163: creat d19/d2b/d32/f3b x:0 0 0 2024-09-13T17:05:43.547 INFO:tasks.workunit.client.0.smithi115.stdout:5/164: fdatasync d19/d21/f2a 0 2024-09-13T17:05:43.550 INFO:tasks.workunit.client.1.smithi195.stdout:5/227: rename d2/d4/d10/f28 to d2/df/d39/f49 0 2024-09-13T17:05:43.550 INFO:tasks.workunit.client.1.smithi195.stdout:5/228: chown d2/d4/d10/c40 607327 1 2024-09-13T17:05:43.551 INFO:tasks.workunit.client.1.smithi195.stdout:3/176: dwrite d7/f12 [0,4194304] 0 2024-09-13T17:05:43.554 INFO:tasks.workunit.client.0.smithi115.stdout:2/251: symlink d3/d4d/dd/df/d22/l53 0 2024-09-13T17:05:43.557 INFO:tasks.workunit.client.1.smithi195.stdout:4/257: write d1a/d1f/d43/d29/f3f [233274,71193] 0 2024-09-13T17:05:43.559 INFO:tasks.workunit.client.0.smithi115.stdout:0/97: dread f0 [0,4194304] 0 2024-09-13T17:05:43.559 INFO:tasks.workunit.client.0.smithi115.stdout:4/221: dwrite d7/dd/f2b [0,4194304] 0 2024-09-13T17:05:43.560 INFO:tasks.workunit.client.1.smithi195.stdout:1/170: write db/df/d13/f1e [4586192,8122] 0 2024-09-13T17:05:43.560 INFO:tasks.workunit.client.1.smithi195.stdout:1/171: truncate db/df/f16 1378713 0 2024-09-13T17:05:43.561 INFO:tasks.workunit.client.0.smithi115.stdout:7/75: mkdir d0/d18 0 2024-09-13T17:05:43.564 INFO:tasks.workunit.client.1.smithi195.stdout:0/213: sync 2024-09-13T17:05:43.566 INFO:tasks.workunit.client.0.smithi115.stdout:5/165: write d19/f1a [7716214,52753] 0 2024-09-13T17:05:43.569 INFO:tasks.workunit.client.0.smithi115.stdout:1/97: rmdir d5 39 2024-09-13T17:05:43.569 INFO:tasks.workunit.client.0.smithi115.stdout:1/98: chown d5/fb 352703 1 2024-09-13T17:05:43.570 INFO:tasks.workunit.client.1.smithi195.stdout:2/211: rmdir d0/d1a/d1c/d1e 39 2024-09-13T17:05:43.570 INFO:tasks.workunit.client.1.smithi195.stdout:6/181: dwrite f17 [0,4194304] 0 2024-09-13T17:05:43.570 INFO:tasks.workunit.client.1.smithi195.stdout:6/182: chown d1c/f23 54 1 2024-09-13T17:05:43.572 INFO:tasks.workunit.client.1.smithi195.stdout:5/229: truncate d2/d4/d10/f15 2063657 0 2024-09-13T17:05:43.576 INFO:tasks.workunit.client.0.smithi115.stdout:0/98: link d9/c14 d9/c1a 0 2024-09-13T17:05:43.582 INFO:tasks.workunit.client.0.smithi115.stdout:7/76: rename d0/l12 to d0/l19 0 2024-09-13T17:05:43.582 INFO:tasks.workunit.client.0.smithi115.stdout:7/77: chown d0/f1 60 1 2024-09-13T17:05:43.585 INFO:tasks.workunit.client.1.smithi195.stdout:0/214: truncate f6 1040582 0 2024-09-13T17:05:43.587 INFO:tasks.workunit.client.0.smithi115.stdout:2/252: dwrite d3/f18 [0,4194304] 0 2024-09-13T17:05:43.587 INFO:tasks.workunit.client.0.smithi115.stdout:4/222: dwrite d7/dd/de/f23 [0,4194304] 0 2024-09-13T17:05:43.588 INFO:tasks.workunit.client.1.smithi195.stdout:9/217: getdents d6/d19 0 2024-09-13T17:05:43.588 INFO:tasks.workunit.client.1.smithi195.stdout:9/218: read d6/df/f27 [1549632,115759] 0 2024-09-13T17:05:43.588 INFO:tasks.workunit.client.1.smithi195.stdout:9/219: fdatasync d6/d12/f46 0 2024-09-13T17:05:43.588 INFO:tasks.workunit.client.1.smithi195.stdout:9/220: getdents d6/df/d13/d44/d47 0 2024-09-13T17:05:43.588 INFO:tasks.workunit.client.1.smithi195.stdout:3/177: dwrite d7/fa [4194304,4194304] 0 2024-09-13T17:05:43.588 INFO:tasks.workunit.client.1.smithi195.stdout:3/178: stat c6 0 2024-09-13T17:05:43.588 INFO:tasks.workunit.client.1.smithi195.stdout:3/179: chown d7/d21/d2a 732512 1 2024-09-13T17:05:43.589 INFO:tasks.workunit.client.1.smithi195.stdout:2/212: mkdir d0/d1a/d47 0 2024-09-13T17:05:43.589 INFO:tasks.workunit.client.0.smithi115.stdout:2/253: read d3/d4d/de/f2a [641554,110637] 0 2024-09-13T17:05:43.592 INFO:tasks.workunit.client.1.smithi195.stdout:6/183: mkdir d1c/d28/d35 0 2024-09-13T17:05:43.592 INFO:tasks.workunit.client.1.smithi195.stdout:6/184: write d1c/f1e [3083273,60385] 0 2024-09-13T17:05:43.596 INFO:tasks.workunit.client.0.smithi115.stdout:1/99: chown d5/d7/l1a 903936578 1 2024-09-13T17:05:43.596 INFO:tasks.workunit.client.0.smithi115.stdout:1/100: truncate d5/f20 260120 0 2024-09-13T17:05:43.597 INFO:tasks.workunit.client.0.smithi115.stdout:2/254: write d3/d4d/dd/df/f28 [296327,92265] 0 2024-09-13T17:05:43.597 INFO:tasks.workunit.client.1.smithi195.stdout:3/180: write d7/f12 [590148,58627] 0 2024-09-13T17:05:43.598 INFO:tasks.workunit.client.1.smithi195.stdout:3/181: write d7/d21/d2a/f2b [502023,50021] 0 2024-09-13T17:05:43.598 INFO:tasks.workunit.client.1.smithi195.stdout:5/230: link d2/d4/d10/d46/f2d d2/d4/d10/f4a 0 2024-09-13T17:05:43.598 INFO:tasks.workunit.client.0.smithi115.stdout:0/99: mkdir d9/d1b 0 2024-09-13T17:05:43.602 INFO:tasks.workunit.client.0.smithi115.stdout:7/78: link d0/d2/df/f10 d0/d2/f1a 0 2024-09-13T17:05:43.602 INFO:tasks.workunit.client.0.smithi115.stdout:7/79: creat d0/f1b x:0 0 0 2024-09-13T17:05:43.607 INFO:tasks.workunit.client.1.smithi195.stdout:4/258: truncate d1a/d1f/d43/d29/f3f 11118 0 2024-09-13T17:05:43.607 INFO:tasks.workunit.client.1.smithi195.stdout:4/259: chown d1a/c3a 34 1 2024-09-13T17:05:43.608 INFO:tasks.workunit.client.1.smithi195.stdout:5/231: read d2/d4/d10/f2f [2950888,56937] 0 2024-09-13T17:05:43.610 INFO:tasks.workunit.client.1.smithi195.stdout:9/221: creat d6/df/d13/d44/f49 x:0 0 0 2024-09-13T17:05:43.610 INFO:tasks.workunit.client.1.smithi195.stdout:9/222: truncate d6/d19/f36 24604 0 2024-09-13T17:05:43.611 INFO:tasks.workunit.client.0.smithi115.stdout:2/255: dwrite d3/d4d/dd/df/d22/f34 [0,4194304] 0 2024-09-13T17:05:43.611 INFO:tasks.workunit.client.0.smithi115.stdout:2/256: chown d3/d4d/de/f15 1877 1 2024-09-13T17:05:43.611 INFO:tasks.workunit.client.0.smithi115.stdout:4/223: truncate d7/dd/de/f3a 111412 0 2024-09-13T17:05:43.613 INFO:tasks.workunit.client.0.smithi115.stdout:1/101: creat d5/d7/f21 x:0 0 0 2024-09-13T17:05:43.615 INFO:tasks.workunit.client.1.smithi195.stdout:6/185: creat d1c/d28/d35/f36 x:0 0 0 2024-09-13T17:05:43.615 INFO:tasks.workunit.client.1.smithi195.stdout:6/186: write d1c/f29 [235808,97252] 0 2024-09-13T17:05:43.615 INFO:tasks.workunit.client.1.smithi195.stdout:6/187: creat d1c/d24/f37 x:0 0 0 2024-09-13T17:05:43.616 INFO:tasks.workunit.client.0.smithi115.stdout:0/100: unlink d9/f19 0 2024-09-13T17:05:43.620 INFO:tasks.workunit.client.1.smithi195.stdout:3/182: link d7/d19/c20 d7/d19/c2c 0 2024-09-13T17:05:43.620 INFO:tasks.workunit.client.0.smithi115.stdout:7/80: mknod d0/c1c 0 2024-09-13T17:05:43.621 INFO:tasks.workunit.client.0.smithi115.stdout:7/81: dread d0/fa [0,4194304] 0 2024-09-13T17:05:43.622 INFO:tasks.workunit.client.1.smithi195.stdout:0/215: rmdir d7/d8/d23 39 2024-09-13T17:05:43.622 INFO:tasks.workunit.client.1.smithi195.stdout:0/216: stat d7/d8/d23 0 2024-09-13T17:05:43.624 INFO:tasks.workunit.client.1.smithi195.stdout:4/260: symlink d1a/d1f/d43/d29/l54 0 2024-09-13T17:05:43.624 INFO:tasks.workunit.client.1.smithi195.stdout:4/261: creat d1a/d1f/d21/d36/f55 x:0 0 0 2024-09-13T17:05:43.625 INFO:tasks.workunit.client.0.smithi115.stdout:2/257: rename d3/l3f to d3/l54 0 2024-09-13T17:05:43.625 INFO:tasks.workunit.client.0.smithi115.stdout:2/258: readlink d3/d4d/dd/df/d22/l53 0 2024-09-13T17:05:43.625 INFO:tasks.workunit.client.0.smithi115.stdout:2/259: read - d3/d4d/dd/df/d22/f26 zero size 2024-09-13T17:05:43.626 INFO:tasks.workunit.client.1.smithi195.stdout:5/232: getdents d2/d3e/d32 0 2024-09-13T17:05:43.628 INFO:tasks.workunit.client.1.smithi195.stdout:2/213: link d0/d1a/f36 d0/f48 0 2024-09-13T17:05:43.628 INFO:tasks.workunit.client.1.smithi195.stdout:7/244: sync 2024-09-13T17:05:43.628 INFO:tasks.workunit.client.1.smithi195.stdout:8/221: sync 2024-09-13T17:05:43.628 INFO:tasks.workunit.client.1.smithi195.stdout:7/245: creat d5/d35/d37/f49 x:0 0 0 2024-09-13T17:05:43.629 INFO:tasks.workunit.client.0.smithi115.stdout:7/82: symlink d0/d18/l1d 0 2024-09-13T17:05:43.630 INFO:tasks.workunit.client.0.smithi115.stdout:7/83: write d0/f13 [824936,9404] 0 2024-09-13T17:05:43.630 INFO:tasks.workunit.client.0.smithi115.stdout:7/84: fsync d0/dc/f11 0 2024-09-13T17:05:43.630 INFO:tasks.workunit.client.1.smithi195.stdout:6/188: unlink d1c/d24/c25 0 2024-09-13T17:05:43.632 INFO:tasks.workunit.client.1.smithi195.stdout:4/262: write f2 [342421,23141] 0 2024-09-13T17:05:43.636 INFO:tasks.workunit.client.1.smithi195.stdout:0/217: creat d7/d10/f3d x:0 0 0 2024-09-13T17:05:43.637 INFO:tasks.workunit.client.0.smithi115.stdout:4/224: write d7/dd/d3c/f3e [980288,115525] 0 2024-09-13T17:05:43.637 INFO:tasks.workunit.client.0.smithi115.stdout:7/85: rename d0/dc to d0/d2/d1e 0 2024-09-13T17:05:43.640 INFO:tasks.workunit.client.1.smithi195.stdout:5/233: creat d2/d4/f4b x:0 0 0 2024-09-13T17:05:43.640 INFO:tasks.workunit.client.1.smithi195.stdout:5/234: readlink d2/d3e/l34 0 2024-09-13T17:05:43.640 INFO:tasks.workunit.client.1.smithi195.stdout:5/235: chown d2/d12/l13 910836 1 2024-09-13T17:05:43.641 INFO:tasks.workunit.client.1.smithi195.stdout:5/236: chown d2/df/d48 225 1 2024-09-13T17:05:43.642 INFO:tasks.workunit.client.1.smithi195.stdout:2/214: symlink d0/d3/d3d/l49 0 2024-09-13T17:05:43.642 INFO:tasks.workunit.client.1.smithi195.stdout:2/215: write d0/f22 [34375,17618] 0 2024-09-13T17:05:43.644 INFO:tasks.workunit.client.0.smithi115.stdout:7/86: link d0/d2/f8 d0/d18/f1f 0 2024-09-13T17:05:43.644 INFO:tasks.workunit.client.0.smithi115.stdout:7/87: fdatasync d0/d2/df/f16 0 2024-09-13T17:05:43.644 INFO:tasks.workunit.client.0.smithi115.stdout:7/88: rename d0/d2 to d0/d2/d20 22 2024-09-13T17:05:43.647 INFO:tasks.workunit.client.0.smithi115.stdout:4/225: dread d7/f2d [0,4194304] 0 2024-09-13T17:05:43.647 INFO:tasks.workunit.client.0.smithi115.stdout:4/226: write d7/dd/d3c/f3e [5092012,12634] 0 2024-09-13T17:05:43.647 INFO:tasks.workunit.client.0.smithi115.stdout:7/89: mkdir d0/d2/df/d21 0 2024-09-13T17:05:43.649 INFO:tasks.workunit.client.1.smithi195.stdout:4/263: mknod d1a/c56 0 2024-09-13T17:05:43.649 INFO:tasks.workunit.client.1.smithi195.stdout:4/264: read d1a/d1f/d43/d29/f3f [7269,17489] 0 2024-09-13T17:05:43.649 INFO:tasks.workunit.client.1.smithi195.stdout:4/265: chown f12 2932288 1 2024-09-13T17:05:43.649 INFO:tasks.workunit.client.1.smithi195.stdout:4/266: write d1a/d1f/d43/d29/f38 [414320,80840] 0 2024-09-13T17:05:43.650 INFO:tasks.workunit.client.0.smithi115.stdout:7/90: write d0/d2/d1e/f11 [602242,41452] 0 2024-09-13T17:05:43.650 INFO:tasks.workunit.client.1.smithi195.stdout:0/218: mknod d7/d8/d16/c3e 0 2024-09-13T17:05:43.650 INFO:tasks.workunit.client.1.smithi195.stdout:0/219: read f3 [98947,14919] 0 2024-09-13T17:05:43.657 INFO:tasks.workunit.client.1.smithi195.stdout:4/267: symlink d1a/d1f/d21/d36/l57 0 2024-09-13T17:05:43.658 INFO:tasks.workunit.client.1.smithi195.stdout:0/220: mknod d7/d8/c3f 0 2024-09-13T17:05:43.662 INFO:tasks.workunit.client.1.smithi195.stdout:4/268: mkdir d1a/d1f/d43/d29/d58 0 2024-09-13T17:05:43.662 INFO:tasks.workunit.client.1.smithi195.stdout:0/221: mknod d7/db/c40 0 2024-09-13T17:05:43.664 INFO:tasks.workunit.client.0.smithi115.stdout:7/91: rmdir d0 39 2024-09-13T17:05:43.665 INFO:tasks.workunit.client.1.smithi195.stdout:4/269: symlink d1a/l59 0 2024-09-13T17:05:43.665 INFO:tasks.workunit.client.1.smithi195.stdout:4/270: readlink d1a/d1f/d21/d22/l45 0 2024-09-13T17:05:43.666 INFO:tasks.workunit.client.1.smithi195.stdout:0/222: mknod d7/d10/c41 0 2024-09-13T17:05:43.668 INFO:tasks.workunit.client.1.smithi195.stdout:2/216: rename d0/d1a to d0/d4a 0 2024-09-13T17:05:43.668 INFO:tasks.workunit.client.1.smithi195.stdout:2/217: chown d0/d4a/d1c/d1e 10572 1 2024-09-13T17:05:43.668 INFO:tasks.workunit.client.1.smithi195.stdout:2/218: write d0/d4a/d1c/d1e/f31 [972823,113546] 0 2024-09-13T17:05:43.668 INFO:tasks.workunit.client.1.smithi195.stdout:2/219: write d0/d3/f26 [1593716,54928] 0 2024-09-13T17:05:43.668 INFO:tasks.workunit.client.1.smithi195.stdout:2/220: write d0/f45 [660323,52337] 0 2024-09-13T17:05:43.669 INFO:tasks.workunit.client.1.smithi195.stdout:4/271: mkdir d1a/d1f/d43/d5a 0 2024-09-13T17:05:43.669 INFO:tasks.workunit.client.1.smithi195.stdout:4/272: creat d1a/d1f/d21/d22/f5b x:0 0 0 2024-09-13T17:05:43.669 INFO:tasks.workunit.client.1.smithi195.stdout:4/273: dread - d1a/d1f/d43/f48 zero size 2024-09-13T17:05:43.670 INFO:tasks.workunit.client.0.smithi115.stdout:4/227: truncate d7/dd/d3c/f3e 2100018 0 2024-09-13T17:05:43.672 INFO:tasks.workunit.client.1.smithi195.stdout:2/221: mknod d0/d3/df/d11/c4b 0 2024-09-13T17:05:43.672 INFO:tasks.workunit.client.1.smithi195.stdout:0/223: read d7/d8/d16/f1b [2926844,66868] 0 2024-09-13T17:05:43.673 INFO:tasks.workunit.client.0.smithi115.stdout:4/228: unlink d7/dd/de/f17 0 2024-09-13T17:05:43.673 INFO:tasks.workunit.client.0.smithi115.stdout:4/229: dread - d7/dd/f2c zero size 2024-09-13T17:05:43.675 INFO:tasks.workunit.client.1.smithi195.stdout:4/274: rmdir d1a/d1f/d43/d24/d4e 0 2024-09-13T17:05:43.675 INFO:tasks.workunit.client.1.smithi195.stdout:4/275: fsync d1a/d1f/d21/d22/f4d 0 2024-09-13T17:05:43.677 INFO:tasks.workunit.client.1.smithi195.stdout:2/222: symlink d0/d3/d3d/l4c 0 2024-09-13T17:05:43.677 INFO:tasks.workunit.client.0.smithi115.stdout:3/311: sync 2024-09-13T17:05:43.679 INFO:tasks.workunit.client.1.smithi195.stdout:0/224: link d7/db/f34 d7/db/d38/f42 0 2024-09-13T17:05:43.679 INFO:tasks.workunit.client.1.smithi195.stdout:0/225: chown d7/d8/d23/f35 15 1 2024-09-13T17:05:43.680 INFO:tasks.workunit.client.1.smithi195.stdout:4/276: symlink d1a/d1f/l5c 0 2024-09-13T17:05:43.682 INFO:tasks.workunit.client.1.smithi195.stdout:2/223: symlink d0/d4a/d1c/d1e/l4d 0 2024-09-13T17:05:43.683 INFO:tasks.workunit.client.0.smithi115.stdout:7/92: dwrite d0/f13 [0,4194304] 0 2024-09-13T17:05:43.685 INFO:tasks.workunit.client.1.smithi195.stdout:4/277: rename f2 to d1a/d1f/d43/d24/d41/f5d 0 2024-09-13T17:05:43.687 INFO:tasks.workunit.client.0.smithi115.stdout:7/93: mkdir d0/d2/d1e/d22 0 2024-09-13T17:05:43.687 INFO:tasks.workunit.client.0.smithi115.stdout:7/94: dread - d0/d2/f14 zero size 2024-09-13T17:05:43.688 INFO:tasks.workunit.client.1.smithi195.stdout:0/226: rmdir d7/d10 39 2024-09-13T17:05:43.693 INFO:tasks.workunit.client.0.smithi115.stdout:4/230: dwrite d7/f12 [0,4194304] 0 2024-09-13T17:05:43.697 INFO:tasks.workunit.client.0.smithi115.stdout:7/95: dread d0/f13 [0,4194304] 0 2024-09-13T17:05:43.697 INFO:tasks.workunit.client.0.smithi115.stdout:7/96: dread - d0/d2/f1a zero size 2024-09-13T17:05:43.698 INFO:tasks.workunit.client.0.smithi115.stdout:7/97: mknod d0/d18/c23 0 2024-09-13T17:05:43.701 INFO:tasks.workunit.client.0.smithi115.stdout:6/145: sync 2024-09-13T17:05:43.703 INFO:tasks.workunit.client.0.smithi115.stdout:6/146: truncate d8/db/dd/f16 5712671 0 2024-09-13T17:05:43.704 INFO:tasks.workunit.client.0.smithi115.stdout:6/147: mknod d8/d13/d15/c2e 0 2024-09-13T17:05:43.709 INFO:tasks.workunit.client.0.smithi115.stdout:7/98: dread d0/f1 [0,4194304] 0 2024-09-13T17:05:43.709 INFO:tasks.workunit.client.0.smithi115.stdout:7/99: unlink d0/d2/f14 0 2024-09-13T17:05:43.711 INFO:tasks.workunit.client.0.smithi115.stdout:7/100: link d0/c1c d0/d18/c24 0 2024-09-13T17:05:43.716 INFO:tasks.workunit.client.0.smithi115.stdout:2/260: write f2 [59499,106524] 0 2024-09-13T17:05:43.724 INFO:tasks.workunit.client.1.smithi195.stdout:8/222: dwrite d0/d17/d2f/d31/f37 [0,4194304] 0 2024-09-13T17:05:43.724 INFO:tasks.workunit.client.1.smithi195.stdout:8/223: dread - d0/d17/d2f/d47/f48 zero size 2024-09-13T17:05:43.725 INFO:tasks.workunit.client.1.smithi195.stdout:7/246: dwrite d5/db/d19/f18 [0,4194304] 0 2024-09-13T17:05:43.725 INFO:tasks.workunit.client.1.smithi195.stdout:7/247: creat d5/d35/d37/f4a x:0 0 0 2024-09-13T17:05:43.725 INFO:tasks.workunit.client.1.smithi195.stdout:7/248: fsync d5/d13/d30/f34 0 2024-09-13T17:05:43.725 INFO:tasks.workunit.client.1.smithi195.stdout:7/249: fdatasync d5/d35/d37/f46 0 2024-09-13T17:05:43.725 INFO:tasks.workunit.client.1.smithi195.stdout:7/250: chown d5/d13/d24/l29 172 1 2024-09-13T17:05:43.726 INFO:tasks.workunit.client.1.smithi195.stdout:7/251: write d5/d13/f40 [722463,14642] 0 2024-09-13T17:05:43.726 INFO:tasks.workunit.client.1.smithi195.stdout:7/252: write d5/f6 [6050857,73493] 0 2024-09-13T17:05:43.727 INFO:tasks.workunit.client.0.smithi115.stdout:6/148: write d8/d13/d15/d24/f1e [879238,106256] 0 2024-09-13T17:05:43.729 INFO:tasks.workunit.client.0.smithi115.stdout:6/149: symlink d8/db/dd/l2f 0 2024-09-13T17:05:43.729 INFO:tasks.workunit.client.0.smithi115.stdout:6/150: chown d8/d13/d15/d24/d17 37392081 1 2024-09-13T17:05:43.730 INFO:tasks.workunit.client.1.smithi195.stdout:2/224: write d0/d3/f26 [925947,5420] 0 2024-09-13T17:05:43.731 INFO:tasks.workunit.client.0.smithi115.stdout:6/151: rmdir d8/db/d28 0 2024-09-13T17:05:43.731 INFO:tasks.workunit.client.0.smithi115.stdout:6/152: stat c4 0 2024-09-13T17:05:43.733 INFO:tasks.workunit.client.0.smithi115.stdout:6/153: truncate d8/f25 530565 0 2024-09-13T17:05:43.733 INFO:tasks.workunit.client.0.smithi115.stdout:6/154: write d8/db/d1d/f2b [753638,13687] 0 2024-09-13T17:05:43.733 INFO:tasks.workunit.client.0.smithi115.stdout:6/155: stat d8/d13/d15/d24/f29 0 2024-09-13T17:05:43.734 INFO:tasks.workunit.client.0.smithi115.stdout:6/156: readlink d8/d13/d15/d24/la 0 2024-09-13T17:05:43.734 INFO:tasks.workunit.client.1.smithi195.stdout:8/224: read d0/d4/fb [2956086,124073] 0 2024-09-13T17:05:43.734 INFO:tasks.workunit.client.1.smithi195.stdout:8/225: stat d0/d17/c18 0 2024-09-13T17:05:43.734 INFO:tasks.workunit.client.1.smithi195.stdout:8/226: write d0/f2e [397172,47610] 0 2024-09-13T17:05:43.734 INFO:tasks.workunit.client.0.smithi115.stdout:6/157: creat d8/d2c/f30 x:0 0 0 2024-09-13T17:05:43.734 INFO:tasks.workunit.client.0.smithi115.stdout:6/158: chown d8/d13/d15 398935438 1 2024-09-13T17:05:43.736 INFO:tasks.workunit.client.1.smithi195.stdout:8/227: mkdir d0/d17/d2f/d47/d4c 0 2024-09-13T17:05:43.736 INFO:tasks.workunit.client.1.smithi195.stdout:8/228: fsync d0/d13/f41 0 2024-09-13T17:05:43.736 INFO:tasks.workunit.client.1.smithi195.stdout:8/229: write d0/d17/d2f/f40 [162403,45708] 0 2024-09-13T17:05:43.737 INFO:tasks.workunit.client.1.smithi195.stdout:9/223: dwrite d6/df/f3c [0,4194304] 0 2024-09-13T17:05:43.738 INFO:tasks.workunit.client.0.smithi115.stdout:4/231: dwrite d7/f29 [0,4194304] 0 2024-09-13T17:05:43.738 INFO:tasks.workunit.client.0.smithi115.stdout:4/232: creat d7/dd/de/f43 x:0 0 0 2024-09-13T17:05:43.739 INFO:tasks.workunit.client.0.smithi115.stdout:4/233: readlink d7/l24 0 2024-09-13T17:05:43.739 INFO:tasks.workunit.client.0.smithi115.stdout:4/234: dread - d7/dd/f32 zero size 2024-09-13T17:05:43.739 INFO:tasks.workunit.client.0.smithi115.stdout:4/235: creat d7/dd/f44 x:0 0 0 2024-09-13T17:05:43.739 INFO:tasks.workunit.client.0.smithi115.stdout:4/236: chown d7/dd/c1f 711 1 2024-09-13T17:05:43.744 INFO:tasks.workunit.client.1.smithi195.stdout:7/253: write d5/db/f2c [139897,121268] 0 2024-09-13T17:05:43.744 INFO:tasks.workunit.client.1.smithi195.stdout:7/254: fdatasync d5/fa 0 2024-09-13T17:05:43.748 INFO:tasks.workunit.client.1.smithi195.stdout:8/230: dread d0/d13/f41 [0,4194304] 0 2024-09-13T17:05:43.750 INFO:tasks.workunit.client.1.smithi195.stdout:2/225: write d0/d4a/d1c/d1e/f2a [2429462,100455] 0 2024-09-13T17:05:43.751 INFO:tasks.workunit.client.1.smithi195.stdout:9/224: mknod d6/df/d13/c4a 0 2024-09-13T17:05:43.752 INFO:tasks.workunit.client.1.smithi195.stdout:2/226: rmdir d0/d4a/d1c 39 2024-09-13T17:05:43.752 INFO:tasks.workunit.client.1.smithi195.stdout:2/227: creat d0/d3/f4e x:0 0 0 2024-09-13T17:05:43.753 INFO:tasks.workunit.client.1.smithi195.stdout:9/225: mkdir d6/d12/d4b 0 2024-09-13T17:05:43.757 INFO:tasks.workunit.client.1.smithi195.stdout:8/231: truncate d0/f2e 243470 0 2024-09-13T17:05:43.758 INFO:tasks.workunit.client.1.smithi195.stdout:2/228: mknod d0/d4a/d1c/c4f 0 2024-09-13T17:05:43.758 INFO:tasks.workunit.client.1.smithi195.stdout:2/229: write d0/d3/df/f35 [626185,57373] 0 2024-09-13T17:05:43.760 INFO:tasks.workunit.client.1.smithi195.stdout:6/189: dwrite d1c/f1e [4194304,4194304] 0 2024-09-13T17:05:43.760 INFO:tasks.workunit.client.1.smithi195.stdout:9/226: rename d6/d19/d21/f2f to d6/d19/f4c 0 2024-09-13T17:05:43.760 INFO:tasks.workunit.client.1.smithi195.stdout:9/227: creat d6/d12/f4d x:0 0 0 2024-09-13T17:05:43.761 INFO:tasks.workunit.client.1.smithi195.stdout:0/227: dwrite f3 [0,4194304] 0 2024-09-13T17:05:43.761 INFO:tasks.workunit.client.0.smithi115.stdout:7/101: dwrite d0/d2/f8 [0,4194304] 0 2024-09-13T17:05:43.761 INFO:tasks.workunit.client.0.smithi115.stdout:2/261: dwrite d3/d4d/dd/df/d22/f26 [0,4194304] 0 2024-09-13T17:05:43.762 INFO:tasks.workunit.client.1.smithi195.stdout:6/190: unlink d1c/d2d/l34 0 2024-09-13T17:05:43.763 INFO:tasks.workunit.client.0.smithi115.stdout:7/102: mkdir d0/d2/df/d21/d25 0 2024-09-13T17:05:43.764 INFO:tasks.workunit.client.0.smithi115.stdout:3/312: dwrite d1/d4b/d1a/d30/f3c [0,4194304] 0 2024-09-13T17:05:43.766 INFO:tasks.workunit.client.1.smithi195.stdout:1/172: sync 2024-09-13T17:05:43.766 INFO:tasks.workunit.client.1.smithi195.stdout:1/173: rename db/df to db/df/d36 22 2024-09-13T17:05:43.767 INFO:tasks.workunit.client.0.smithi115.stdout:6/159: dread d8/d13/d15/d24/f1f [0,4194304] 0 2024-09-13T17:05:43.767 INFO:tasks.workunit.client.0.smithi115.stdout:6/160: fsync d8/db/ff 0 2024-09-13T17:05:43.767 INFO:tasks.workunit.client.0.smithi115.stdout:6/161: chown d8/db/dd/l2f 1322 1 2024-09-13T17:05:43.768 INFO:tasks.workunit.client.1.smithi195.stdout:2/230: write d0/d3/df/f10 [3478371,18345] 0 2024-09-13T17:05:43.768 INFO:tasks.workunit.client.1.smithi195.stdout:4/278: dwrite f7 [0,4194304] 0 2024-09-13T17:05:43.769 INFO:tasks.workunit.client.1.smithi195.stdout:0/228: symlink d7/l43 0 2024-09-13T17:05:43.770 INFO:tasks.workunit.client.0.smithi115.stdout:2/262: rmdir d3/d4d/dd 39 2024-09-13T17:05:43.771 INFO:tasks.workunit.client.0.smithi115.stdout:4/237: dwrite f3 [0,4194304] 0 2024-09-13T17:05:43.772 INFO:tasks.workunit.client.1.smithi195.stdout:1/174: mkdir db/d19/d37 0 2024-09-13T17:05:43.773 INFO:tasks.workunit.client.1.smithi195.stdout:9/228: dread d6/d12/f2b [0,4194304] 0 2024-09-13T17:05:43.773 INFO:tasks.workunit.client.1.smithi195.stdout:9/229: write d6/df/d13/d44/f49 [721050,128581] 0 2024-09-13T17:05:43.774 INFO:tasks.workunit.client.0.smithi115.stdout:7/103: mknod d0/c26 0 2024-09-13T17:05:43.775 INFO:tasks.workunit.client.1.smithi195.stdout:7/255: dwrite d5/db/fc [0,4194304] 0 2024-09-13T17:05:43.775 INFO:tasks.workunit.client.0.smithi115.stdout:2/263: rmdir d3/d4d/dd/df 39 2024-09-13T17:05:43.776 INFO:tasks.workunit.client.0.smithi115.stdout:2/264: read - d3/d4d/de/d3a/d47/f49 zero size 2024-09-13T17:05:43.776 INFO:tasks.workunit.client.0.smithi115.stdout:2/265: chown d3/f18 12 1 2024-09-13T17:05:43.776 INFO:tasks.workunit.client.0.smithi115.stdout:2/266: write d3/d4d/de/f37 [640100,5652] 0 2024-09-13T17:05:43.776 INFO:tasks.workunit.client.0.smithi115.stdout:2/267: write d3/d4d/dd/df/d22/f29 [1754276,128354] 0 2024-09-13T17:05:43.777 INFO:tasks.workunit.client.0.smithi115.stdout:2/268: dread d3/d4d/de/f2a [0,4194304] 0 2024-09-13T17:05:43.777 INFO:tasks.workunit.client.1.smithi195.stdout:8/232: dread d0/d17/d2f/d31/f37 [0,4194304] 0 2024-09-13T17:05:43.777 INFO:tasks.workunit.client.1.smithi195.stdout:8/233: write d0/d17/d2f/f40 [1076716,130244] 0 2024-09-13T17:05:43.779 INFO:tasks.workunit.client.0.smithi115.stdout:2/269: getdents d3/d4d/dd/df/d22 0 2024-09-13T17:05:43.781 INFO:tasks.workunit.client.0.smithi115.stdout:4/238: dread f5 [0,4194304] 0 2024-09-13T17:05:43.783 INFO:tasks.workunit.client.0.smithi115.stdout:3/313: dread d1/f10 [0,4194304] 0 2024-09-13T17:05:43.783 INFO:tasks.workunit.client.0.smithi115.stdout:3/314: write d1/f9 [815659,72432] 0 2024-09-13T17:05:43.784 INFO:tasks.workunit.client.0.smithi115.stdout:2/270: mkdir d3/d4d/d13/d39/d55 0 2024-09-13T17:05:43.784 INFO:tasks.workunit.client.0.smithi115.stdout:4/239: rmdir d7/dd/d3c 39 2024-09-13T17:05:43.787 INFO:tasks.workunit.client.0.smithi115.stdout:3/315: getdents d1 0 2024-09-13T17:05:43.789 INFO:tasks.workunit.client.0.smithi115.stdout:3/316: truncate d1/d4b/d1a/d30/f39 811864 0 2024-09-13T17:05:43.789 INFO:tasks.workunit.client.1.smithi195.stdout:4/279: symlink d1a/d1f/d21/l5e 0 2024-09-13T17:05:43.792 INFO:tasks.workunit.client.1.smithi195.stdout:0/229: unlink d7/d8/d16/c17 0 2024-09-13T17:05:43.792 INFO:tasks.workunit.client.0.smithi115.stdout:3/317: mknod d1/d12/d14/d54/c6d 0 2024-09-13T17:05:43.794 INFO:tasks.workunit.client.1.smithi195.stdout:9/230: symlink d6/d12/l4e 0 2024-09-13T17:05:43.794 INFO:tasks.workunit.client.1.smithi195.stdout:9/231: read - d6/d12/f4d zero size 2024-09-13T17:05:43.794 INFO:tasks.workunit.client.1.smithi195.stdout:9/232: fdatasync d6/f18 0 2024-09-13T17:05:43.801 INFO:tasks.workunit.client.1.smithi195.stdout:7/256: rename d5/l21 to d5/db/d19/d22/l4b 0 2024-09-13T17:05:43.802 INFO:tasks.workunit.client.0.smithi115.stdout:6/162: dwrite d8/db/d1d/f26 [0,4194304] 0 2024-09-13T17:05:43.802 INFO:tasks.workunit.client.0.smithi115.stdout:4/240: dread d7/fc [0,4194304] 0 2024-09-13T17:05:43.806 INFO:tasks.workunit.client.1.smithi195.stdout:1/175: getdents db/df/d13 0 2024-09-13T17:05:43.806 INFO:tasks.workunit.client.1.smithi195.stdout:1/176: creat db/f38 x:0 0 0 2024-09-13T17:05:43.806 INFO:tasks.workunit.client.0.smithi115.stdout:4/241: creat d7/dd/d3c/f45 x:0 0 0 2024-09-13T17:05:43.807 INFO:tasks.workunit.client.0.smithi115.stdout:4/242: chown l2 18 1 2024-09-13T17:05:43.807 INFO:tasks.workunit.client.1.smithi195.stdout:2/231: dwrite d0/d3/df/f20 [8388608,4194304] 0 2024-09-13T17:05:43.808 INFO:tasks.workunit.client.1.smithi195.stdout:4/280: dread d1a/d1f/d43/f3d [0,4194304] 0 2024-09-13T17:05:43.808 INFO:tasks.workunit.client.0.smithi115.stdout:7/104: truncate d0/f13 547850 0 2024-09-13T17:05:43.809 INFO:tasks.workunit.client.1.smithi195.stdout:1/177: read db/df/f28 [1240934,89816] 0 2024-09-13T17:05:43.809 INFO:tasks.workunit.client.1.smithi195.stdout:9/233: truncate d6/df/f27 4007741 0 2024-09-13T17:05:43.809 INFO:tasks.workunit.client.1.smithi195.stdout:9/234: readlink d6/l8 0 2024-09-13T17:05:43.810 INFO:tasks.workunit.client.1.smithi195.stdout:3/183: sync 2024-09-13T17:05:43.810 INFO:tasks.workunit.client.1.smithi195.stdout:5/237: sync 2024-09-13T17:05:43.812 INFO:tasks.workunit.client.0.smithi115.stdout:2/271: dwrite d3/d4d/de/f15 [0,4194304] 0 2024-09-13T17:05:43.813 INFO:tasks.workunit.client.1.smithi195.stdout:7/257: symlink d5/db/d19/l4c 0 2024-09-13T17:05:43.814 INFO:tasks.workunit.client.1.smithi195.stdout:7/258: write d5/d13/d30/f34 [3145390,124594] 0 2024-09-13T17:05:43.814 INFO:tasks.workunit.client.1.smithi195.stdout:7/259: fdatasync f4 0 2024-09-13T17:05:43.814 INFO:tasks.workunit.client.1.smithi195.stdout:7/260: chown d5/db/l44 18706 1 2024-09-13T17:05:43.815 INFO:tasks.workunit.client.0.smithi115.stdout:7/105: rename d0/d2/d1e/le to d0/l27 0 2024-09-13T17:05:43.816 INFO:tasks.workunit.client.0.smithi115.stdout:4/243: mknod d7/dd/d3c/c46 0 2024-09-13T17:05:43.817 INFO:tasks.workunit.client.0.smithi115.stdout:7/106: dread d0/d2/d1e/f11 [0,4194304] 0 2024-09-13T17:05:43.818 INFO:tasks.workunit.client.0.smithi115.stdout:2/272: truncate d3/f40 3227529 0 2024-09-13T17:05:43.818 INFO:tasks.workunit.client.0.smithi115.stdout:2/273: truncate d3/d4d/de/d3a/d47/f49 190251 0 2024-09-13T17:05:43.819 INFO:tasks.workunit.client.1.smithi195.stdout:4/281: getdents d1a/d1f/d21 0 2024-09-13T17:05:43.824 INFO:tasks.workunit.client.1.smithi195.stdout:9/235: unlink d6/d12/l14 0 2024-09-13T17:05:43.824 INFO:tasks.workunit.client.0.smithi115.stdout:3/318: dwrite d1/d4b/d1a/f20 [4194304,4194304] 0 2024-09-13T17:05:43.825 INFO:tasks.workunit.client.0.smithi115.stdout:3/319: readlink d1/d12/d23/l29 0 2024-09-13T17:05:43.825 INFO:tasks.workunit.client.0.smithi115.stdout:4/244: truncate d7/f35 241937 0 2024-09-13T17:05:43.825 INFO:tasks.workunit.client.1.smithi195.stdout:0/230: dwrite d7/db/d11/f1f [0,4194304] 0 2024-09-13T17:05:43.825 INFO:tasks.workunit.client.1.smithi195.stdout:0/231: write f6 [1161575,41083] 0 2024-09-13T17:05:43.825 INFO:tasks.workunit.client.1.smithi195.stdout:2/232: dwrite d0/f45 [0,4194304] 0 2024-09-13T17:05:43.825 INFO:tasks.workunit.client.1.smithi195.stdout:9/236: dread d6/df/d16/f32 [0,4194304] 0 2024-09-13T17:05:43.826 INFO:tasks.workunit.client.0.smithi115.stdout:2/274: rename d3/d4d/dd/df/d22 to d3/d4d/dd/d1f/d2f/d56 0 2024-09-13T17:05:43.827 INFO:tasks.workunit.client.0.smithi115.stdout:7/107: read d0/d18/f1f [1956506,68626] 0 2024-09-13T17:05:43.827 INFO:tasks.workunit.client.1.smithi195.stdout:3/184: truncate d7/f12 2367401 0 2024-09-13T17:05:43.828 INFO:tasks.workunit.client.1.smithi195.stdout:5/238: mknod d2/c4c 0 2024-09-13T17:05:43.832 INFO:tasks.workunit.client.1.smithi195.stdout:2/233: dread d0/f24 [0,4194304] 0 2024-09-13T17:05:43.832 INFO:tasks.workunit.client.1.smithi195.stdout:2/234: readlink d0/d3/df/d11/l15 0 2024-09-13T17:05:43.832 INFO:tasks.workunit.client.0.smithi115.stdout:3/320: mkdir d1/d4b/d1a/d6e 0 2024-09-13T17:05:43.832 INFO:tasks.workunit.client.0.smithi115.stdout:3/321: write d1/d4b/d69/f6a [45608,81463] 0 2024-09-13T17:05:43.835 INFO:tasks.workunit.client.0.smithi115.stdout:4/245: creat d7/f47 x:0 0 0 2024-09-13T17:05:43.836 INFO:tasks.workunit.client.1.smithi195.stdout:4/282: creat d1a/d1f/d43/d5a/f5f x:0 0 0 2024-09-13T17:05:43.839 INFO:tasks.workunit.client.0.smithi115.stdout:2/275: dread d3/d4d/dd/d1f/d2f/d56/f26 [0,4194304] 0 2024-09-13T17:05:43.839 INFO:tasks.workunit.client.0.smithi115.stdout:2/276: chown d3/d4d/dd/d1f/d2f/d56/l3c 2 1 2024-09-13T17:05:43.842 INFO:tasks.workunit.client.0.smithi115.stdout:7/108: rename d0/d2/d1e/d17 to d0/d2/d28 0 2024-09-13T17:05:43.842 INFO:tasks.workunit.client.0.smithi115.stdout:7/109: write d0/d18/f1f [680894,77574] 0 2024-09-13T17:05:43.843 INFO:tasks.workunit.client.1.smithi195.stdout:3/185: dread d7/d19/f22 [0,4194304] 0 2024-09-13T17:05:43.844 INFO:tasks.workunit.client.0.smithi115.stdout:4/246: rename d7/l24 to d7/l48 0 2024-09-13T17:05:43.844 INFO:tasks.workunit.client.0.smithi115.stdout:4/247: stat l2 0 2024-09-13T17:05:43.844 INFO:tasks.workunit.client.0.smithi115.stdout:4/248: chown d7/dd/c1f 1478540 1 2024-09-13T17:05:43.844 INFO:tasks.workunit.client.0.smithi115.stdout:4/249: chown d7/f31 17 1 2024-09-13T17:05:43.846 INFO:tasks.workunit.client.1.smithi195.stdout:8/234: rename d0/d17/d2f/d47 to d0/d13/d4d 0 2024-09-13T17:05:43.848 INFO:tasks.workunit.client.1.smithi195.stdout:5/239: creat d2/d12/d3f/f4d x:0 0 0 2024-09-13T17:05:43.849 INFO:tasks.workunit.client.0.smithi115.stdout:7/110: getdents d0/d2/df/d21 0 2024-09-13T17:05:43.852 INFO:tasks.workunit.client.0.smithi115.stdout:7/111: rename d0/d2/df/f15 to d0/d2/df/f29 0 2024-09-13T17:05:43.852 INFO:tasks.workunit.client.0.smithi115.stdout:4/250: write d7/fc [907279,75182] 0 2024-09-13T17:05:43.853 INFO:tasks.workunit.client.1.smithi195.stdout:2/235: creat d0/d3/d3d/f50 x:0 0 0 2024-09-13T17:05:43.855 INFO:tasks.workunit.client.1.smithi195.stdout:7/261: getdents d5/d13/d30 0 2024-09-13T17:05:43.857 INFO:tasks.workunit.client.0.smithi115.stdout:7/112: rename d0/c1c to d0/d2/df/d21/d25/c2a 0 2024-09-13T17:05:43.857 INFO:tasks.workunit.client.0.smithi115.stdout:7/113: write d0/d2/df/f16 [250650,40789] 0 2024-09-13T17:05:43.859 INFO:tasks.workunit.client.1.smithi195.stdout:3/186: creat d7/f2d x:0 0 0 2024-09-13T17:05:43.861 INFO:tasks.workunit.client.1.smithi195.stdout:7/262: dread d5/d13/f40 [0,4194304] 0 2024-09-13T17:05:43.861 INFO:tasks.workunit.client.1.smithi195.stdout:1/178: rename f5 to db/df/f39 0 2024-09-13T17:05:43.862 INFO:tasks.workunit.client.0.smithi115.stdout:4/251: symlink d7/dd/l49 0 2024-09-13T17:05:43.862 INFO:tasks.workunit.client.1.smithi195.stdout:4/283: dwrite d1a/d1f/d43/f48 [0,4194304] 0 2024-09-13T17:05:43.863 INFO:tasks.workunit.client.0.smithi115.stdout:3/322: dwrite d1/d4b/d1a/d30/f3c [0,4194304] 0 2024-09-13T17:05:43.863 INFO:tasks.workunit.client.0.smithi115.stdout:2/277: dwrite d3/d4d/de/f15 [0,4194304] 0 2024-09-13T17:05:43.863 INFO:tasks.workunit.client.0.smithi115.stdout:3/323: write d1/d12/d14/f55 [445279,87211] 0 2024-09-13T17:05:43.863 INFO:tasks.workunit.client.1.smithi195.stdout:8/235: unlink d0/d17/l1e 0 2024-09-13T17:05:43.866 INFO:tasks.workunit.client.1.smithi195.stdout:7/263: symlink d5/db/d19/d22/l4d 0 2024-09-13T17:05:43.868 INFO:tasks.workunit.client.1.smithi195.stdout:0/232: rename d7/c13 to d7/d8/d23/c44 0 2024-09-13T17:05:43.868 INFO:tasks.workunit.client.1.smithi195.stdout:0/233: chown d7/d8/d23/f27 157519632 1 2024-09-13T17:05:43.872 INFO:tasks.workunit.client.1.smithi195.stdout:2/236: dwrite d0/d3/f4 [4194304,4194304] 0 2024-09-13T17:05:43.872 INFO:tasks.workunit.client.1.smithi195.stdout:2/237: chown d0/d3/d3d/l4c 6 1 2024-09-13T17:05:43.873 INFO:tasks.workunit.client.1.smithi195.stdout:2/238: write d0/d4a/d1c/d2c/f34 [880213,1281] 0 2024-09-13T17:05:43.873 INFO:tasks.workunit.client.1.smithi195.stdout:1/179: link db/df/d13/f2e db/df/f3a 0 2024-09-13T17:05:43.877 INFO:tasks.workunit.client.0.smithi115.stdout:3/324: write d1/d4b/d1a/f27 [5539964,112126] 0 2024-09-13T17:05:43.879 INFO:tasks.workunit.client.1.smithi195.stdout:6/191: sync 2024-09-13T17:05:43.879 INFO:tasks.workunit.client.1.smithi195.stdout:6/192: creat d1c/d24/f38 x:0 0 0 2024-09-13T17:05:43.879 INFO:tasks.workunit.client.1.smithi195.stdout:6/193: chown d1c/c2f 265796 1 2024-09-13T17:05:43.879 INFO:tasks.workunit.client.1.smithi195.stdout:4/284: dwrite fa [0,4194304] 0 2024-09-13T17:05:43.880 INFO:tasks.workunit.client.1.smithi195.stdout:8/236: mkdir d0/d4/d4e 0 2024-09-13T17:05:43.884 INFO:tasks.workunit.client.1.smithi195.stdout:7/264: creat d5/db/d19/d22/f4e x:0 0 0 2024-09-13T17:05:43.885 INFO:tasks.workunit.client.1.smithi195.stdout:7/265: write d5/d13/f32 [706296,72848] 0 2024-09-13T17:05:43.885 INFO:tasks.workunit.client.1.smithi195.stdout:7/266: readlink d5/db/l44 0 2024-09-13T17:05:43.887 INFO:tasks.workunit.client.1.smithi195.stdout:9/237: rename d6/df/d16/l2d to d6/d19/d21/l4f 0 2024-09-13T17:05:43.891 INFO:tasks.workunit.client.0.smithi115.stdout:7/114: rename d0/l27 to d0/d2/d1e/d22/l2b 0 2024-09-13T17:05:43.892 INFO:tasks.workunit.client.1.smithi195.stdout:9/238: fsync d6/df/d13/d44/f49 0 2024-09-13T17:05:43.892 INFO:tasks.workunit.client.1.smithi195.stdout:0/234: dwrite d7/d8/fe [0,4194304] 0 2024-09-13T17:05:43.892 INFO:tasks.workunit.client.1.smithi195.stdout:0/235: dread - d7/d8/d23/f32 zero size 2024-09-13T17:05:43.892 INFO:tasks.workunit.client.1.smithi195.stdout:0/236: dread - d7/d8/d16/f30 zero size 2024-09-13T17:05:43.892 INFO:tasks.workunit.client.1.smithi195.stdout:0/237: truncate d7/db/d38/f3b 680040 0 2024-09-13T17:05:43.892 INFO:tasks.workunit.client.1.smithi195.stdout:0/238: fsync f1 0 2024-09-13T17:05:43.893 INFO:tasks.workunit.client.1.smithi195.stdout:9/239: dread d6/d19/f36 [0,4194304] 0 2024-09-13T17:05:43.893 INFO:tasks.workunit.client.1.smithi195.stdout:9/240: chown d6/df/f38 0 1 2024-09-13T17:05:43.894 INFO:tasks.workunit.client.0.smithi115.stdout:4/252: link d7/dd/f3b d7/dd/de/f4a 0 2024-09-13T17:05:43.896 INFO:tasks.workunit.client.1.smithi195.stdout:1/180: dwrite db/f10 [0,4194304] 0 2024-09-13T17:05:43.898 INFO:tasks.workunit.client.1.smithi195.stdout:1/181: read db/f1c [187780,121320] 0 2024-09-13T17:05:43.898 INFO:tasks.workunit.client.0.smithi115.stdout:7/115: dread d0/d18/f1f [0,4194304] 0 2024-09-13T17:05:43.901 INFO:tasks.workunit.client.1.smithi195.stdout:8/237: stat d0/d4/c1a 0 2024-09-13T17:05:43.901 INFO:tasks.workunit.client.1.smithi195.stdout:7/267: creat d5/db/d19/d22/d3c/f4f x:0 0 0 2024-09-13T17:05:43.904 INFO:tasks.workunit.client.0.smithi115.stdout:2/278: mkdir d3/d4d/dd/df/d57 0 2024-09-13T17:05:43.909 INFO:tasks.workunit.client.0.smithi115.stdout:3/325: unlink d1/d4b/d1a/d30/f39 0 2024-09-13T17:05:43.909 INFO:tasks.workunit.client.0.smithi115.stdout:3/326: chown d1/d12/c26 40 1 2024-09-13T17:05:43.909 INFO:tasks.workunit.client.1.smithi195.stdout:8/238: dread d0/f8 [0,4194304] 0 2024-09-13T17:05:43.912 INFO:tasks.workunit.client.1.smithi195.stdout:0/239: dwrite d7/d8/d16/f31 [0,4194304] 0 2024-09-13T17:05:43.914 INFO:tasks.workunit.client.0.smithi115.stdout:8/168: sync 2024-09-13T17:05:43.914 INFO:tasks.workunit.client.0.smithi115.stdout:9/107: sync 2024-09-13T17:05:43.915 INFO:tasks.workunit.client.1.smithi195.stdout:9/241: creat d6/df/d37/f50 x:0 0 0 2024-09-13T17:05:43.918 INFO:tasks.workunit.client.0.smithi115.stdout:4/253: mkdir d7/dd/de/d4b 0 2024-09-13T17:05:43.920 INFO:tasks.workunit.client.1.smithi195.stdout:1/182: rmdir db/df 39 2024-09-13T17:05:43.922 INFO:tasks.workunit.client.0.smithi115.stdout:7/116: creat d0/d2/df/d21/d25/f2c x:0 0 0 2024-09-13T17:05:43.923 INFO:tasks.workunit.client.1.smithi195.stdout:2/239: truncate d0/d3/df/f10 1951159 0 2024-09-13T17:05:43.923 INFO:tasks.workunit.client.1.smithi195.stdout:2/240: read - d0/d4a/d1c/d1e/f3f zero size 2024-09-13T17:05:43.923 INFO:tasks.workunit.client.0.smithi115.stdout:2/279: mkdir d3/d4d/dd/d1f/d2f/d56/d58 0 2024-09-13T17:05:43.927 INFO:tasks.workunit.client.0.smithi115.stdout:3/327: symlink d1/d12/d14/l6f 0 2024-09-13T17:05:43.927 INFO:tasks.workunit.client.0.smithi115.stdout:3/328: dread - d1/d12/d14/d54/f6c zero size 2024-09-13T17:05:43.931 INFO:tasks.workunit.client.0.smithi115.stdout:3/329: write d1/d12/d23/f59 [1474108,11563] 0 2024-09-13T17:05:43.931 INFO:tasks.workunit.client.0.smithi115.stdout:8/169: mkdir d0/d26/d29 0 2024-09-13T17:05:43.933 INFO:tasks.workunit.client.0.smithi115.stdout:4/254: mkdir d7/dd/d4c 0 2024-09-13T17:05:43.933 INFO:tasks.workunit.client.0.smithi115.stdout:4/255: truncate d7/dd/f37 803817 0 2024-09-13T17:05:43.934 INFO:tasks.workunit.client.0.smithi115.stdout:4/256: write d7/dd/f37 [683018,109633] 0 2024-09-13T17:05:43.935 INFO:tasks.workunit.client.1.smithi195.stdout:9/242: symlink d6/df/d16/l51 0 2024-09-13T17:05:43.935 INFO:tasks.workunit.client.1.smithi195.stdout:9/243: fsync d6/d19/f4c 0 2024-09-13T17:05:43.935 INFO:tasks.workunit.client.0.smithi115.stdout:3/330: mknod d1/d4b/d1a/d30/c70 0 2024-09-13T17:05:43.937 INFO:tasks.workunit.client.1.smithi195.stdout:1/183: getdents db/df 0 2024-09-13T17:05:43.937 INFO:tasks.workunit.client.1.smithi195.stdout:1/184: fdatasync db/df/d13/f21 0 2024-09-13T17:05:43.937 INFO:tasks.workunit.client.1.smithi195.stdout:1/185: chown db/f33 314645916 1 2024-09-13T17:05:43.937 INFO:tasks.workunit.client.1.smithi195.stdout:1/186: fsync db/df/f20 0 2024-09-13T17:05:43.937 INFO:tasks.workunit.client.1.smithi195.stdout:8/239: dwrite d0/d17/d2f/d31/f37 [0,4194304] 0 2024-09-13T17:05:43.938 INFO:tasks.workunit.client.0.smithi115.stdout:8/170: creat d0/d26/d29/f2a x:0 0 0 2024-09-13T17:05:43.938 INFO:tasks.workunit.client.0.smithi115.stdout:8/171: chown d0/d15 3344759 1 2024-09-13T17:05:43.939 INFO:tasks.workunit.client.1.smithi195.stdout:5/240: rename d2/d4 to d2/d12/d4e 0 2024-09-13T17:05:43.941 INFO:tasks.workunit.client.0.smithi115.stdout:4/257: rmdir d7/dd/d4c 0 2024-09-13T17:05:43.941 INFO:tasks.workunit.client.0.smithi115.stdout:4/258: creat d7/dd/f4d x:0 0 0 2024-09-13T17:05:43.941 INFO:tasks.workunit.client.1.smithi195.stdout:7/268: getdents d5/db/d19 0 2024-09-13T17:05:43.944 INFO:tasks.workunit.client.0.smithi115.stdout:3/331: rename d1/c32 to d1/d4b/d1a/d30/c71 0 2024-09-13T17:05:43.944 INFO:tasks.workunit.client.0.smithi115.stdout:3/332: dread - d1/d12/f5b zero size 2024-09-13T17:05:43.945 INFO:tasks.workunit.client.1.smithi195.stdout:1/187: truncate db/f17 2095169 0 2024-09-13T17:05:43.949 INFO:tasks.workunit.client.0.smithi115.stdout:8/172: mkdir d0/d18/d19/d2b 0 2024-09-13T17:05:43.949 INFO:tasks.workunit.client.1.smithi195.stdout:8/240: symlink d0/d13/l4f 0 2024-09-13T17:05:43.951 INFO:tasks.workunit.client.0.smithi115.stdout:9/108: dwrite d0/de/d10/d15/f20 [0,4194304] 0 2024-09-13T17:05:43.954 INFO:tasks.workunit.client.0.smithi115.stdout:4/259: mkdir d7/dd/de/d4e 0 2024-09-13T17:05:43.955 INFO:tasks.workunit.client.1.smithi195.stdout:5/241: truncate d2/df/f1c 2748678 0 2024-09-13T17:05:43.956 INFO:tasks.workunit.client.1.smithi195.stdout:7/269: dread f4 [0,4194304] 0 2024-09-13T17:05:43.956 INFO:tasks.workunit.client.1.smithi195.stdout:2/241: dwrite d0/d4a/f3a [0,4194304] 0 2024-09-13T17:05:43.957 INFO:tasks.workunit.client.0.smithi115.stdout:3/333: rename d1/d4b/d1a/d30/c68 to d1/d12/d23/c72 0 2024-09-13T17:05:43.957 INFO:tasks.workunit.client.0.smithi115.stdout:8/173: write d0/d15/f20 [593353,33434] 0 2024-09-13T17:05:43.958 INFO:tasks.workunit.client.1.smithi195.stdout:1/188: creat db/d19/d37/f3b x:0 0 0 2024-09-13T17:05:43.958 INFO:tasks.workunit.client.1.smithi195.stdout:2/242: dread d0/d4a/d1c/d2c/f34 [0,4194304] 0 2024-09-13T17:05:43.958 INFO:tasks.workunit.client.1.smithi195.stdout:2/243: write d0/d3/df/f10 [2664182,84481] 0 2024-09-13T17:05:43.960 INFO:tasks.workunit.client.0.smithi115.stdout:4/260: mkdir d7/dd/de/d4b/d4f 0 2024-09-13T17:05:43.961 INFO:tasks.workunit.client.0.smithi115.stdout:9/109: write d0/de/d10/f13 [3354163,57634] 0 2024-09-13T17:05:43.961 INFO:tasks.workunit.client.1.smithi195.stdout:8/241: creat d0/d17/d49/f50 x:0 0 0 2024-09-13T17:05:43.963 INFO:tasks.workunit.client.0.smithi115.stdout:3/334: mknod d1/c73 0 2024-09-13T17:05:43.967 INFO:tasks.workunit.client.0.smithi115.stdout:7/117: dwrite d0/d2/d1e/f11 [0,4194304] 0 2024-09-13T17:05:43.968 INFO:tasks.workunit.client.1.smithi195.stdout:3/187: rename d7/c8 to d7/d21/c2e 0 2024-09-13T17:05:43.968 INFO:tasks.workunit.client.1.smithi195.stdout:3/188: write d7/d21/f26 [1754051,2741] 0 2024-09-13T17:05:43.970 INFO:tasks.workunit.client.0.smithi115.stdout:3/335: dread d1/f10 [0,4194304] 0 2024-09-13T17:05:43.970 INFO:tasks.workunit.client.0.smithi115.stdout:3/336: chown d1/d4b/l24 1710085051 1 2024-09-13T17:05:43.970 INFO:tasks.workunit.client.0.smithi115.stdout:3/337: truncate d1/d4b/d69/f6a 581999 0 2024-09-13T17:05:43.973 INFO:tasks.workunit.client.0.smithi115.stdout:2/280: dwrite f2 [0,4194304] 0 2024-09-13T17:05:43.973 INFO:tasks.workunit.client.0.smithi115.stdout:8/174: link d0/d21/l25 d0/d18/d19/d2b/l2c 0 2024-09-13T17:05:43.974 INFO:tasks.workunit.client.1.smithi195.stdout:9/244: dwrite d6/d12/d39/f3e [0,4194304] 0 2024-09-13T17:05:43.975 INFO:tasks.workunit.client.1.smithi195.stdout:7/270: mkdir d5/db/d50 0 2024-09-13T17:05:43.975 INFO:tasks.workunit.client.1.smithi195.stdout:7/271: dread - d5/d35/d37/f49 zero size 2024-09-13T17:05:43.978 INFO:tasks.workunit.client.0.smithi115.stdout:9/110: mknod d0/d21/c27 0 2024-09-13T17:05:43.979 INFO:tasks.workunit.client.0.smithi115.stdout:9/111: creat d0/de/f28 x:0 0 0 2024-09-13T17:05:43.979 INFO:tasks.workunit.client.0.smithi115.stdout:9/112: dread - d0/d21/f22 zero size 2024-09-13T17:05:43.985 INFO:tasks.workunit.client.1.smithi195.stdout:6/194: rename d1c/f1e to d1c/d28/d35/f39 0 2024-09-13T17:05:43.986 INFO:tasks.workunit.client.0.smithi115.stdout:2/281: dread d3/f14 [0,4194304] 0 2024-09-13T17:05:43.986 INFO:tasks.workunit.client.0.smithi115.stdout:2/282: chown d3/d4d 85 1 2024-09-13T17:05:43.987 INFO:tasks.workunit.client.0.smithi115.stdout:7/118: unlink d0/d2/d1e/d22/l2b 0 2024-09-13T17:05:43.987 INFO:tasks.workunit.client.0.smithi115.stdout:7/119: write d0/d2/df/f29 [433730,93036] 0 2024-09-13T17:05:43.988 INFO:tasks.workunit.client.0.smithi115.stdout:4/261: dwrite d7/dd/f44 [0,4194304] 0 2024-09-13T17:05:43.989 INFO:tasks.workunit.client.1.smithi195.stdout:8/242: dwrite d0/fc [0,4194304] 0 2024-09-13T17:05:43.990 INFO:tasks.workunit.client.1.smithi195.stdout:5/242: rmdir d2/df 39 2024-09-13T17:05:43.992 INFO:tasks.workunit.client.0.smithi115.stdout:8/175: symlink d0/d18/l2d 0 2024-09-13T17:05:43.998 INFO:tasks.workunit.client.1.smithi195.stdout:9/245: mknod d6/d19/c52 0 2024-09-13T17:05:43.998 INFO:tasks.workunit.client.1.smithi195.stdout:9/246: dread - d6/d12/f46 zero size 2024-09-13T17:05:44.002 INFO:tasks.workunit.client.1.smithi195.stdout:7/272: link d5/d13/d24/f3f d5/d13/d24/f51 0 2024-09-13T17:05:44.004 INFO:tasks.workunit.client.0.smithi115.stdout:9/113: write d0/f1d [1019304,43822] 0 2024-09-13T17:05:44.004 INFO:tasks.workunit.client.1.smithi195.stdout:1/189: rmdir db/d19/d37 39 2024-09-13T17:05:44.006 INFO:tasks.workunit.client.1.smithi195.stdout:5/243: write d2/f17 [1012878,88404] 0 2024-09-13T17:05:44.007 INFO:tasks.workunit.client.1.smithi195.stdout:9/247: dread d6/df/f3c [0,4194304] 0 2024-09-13T17:05:44.013 INFO:tasks.workunit.client.1.smithi195.stdout:7/273: truncate d5/db/fc 844201 0 2024-09-13T17:05:44.013 INFO:tasks.workunit.client.1.smithi195.stdout:7/274: creat d5/d35/d37/f52 x:0 0 0 2024-09-13T17:05:44.014 INFO:tasks.workunit.client.1.smithi195.stdout:1/190: truncate db/df/d13/f1e 7295453 0 2024-09-13T17:05:44.014 INFO:tasks.workunit.client.1.smithi195.stdout:3/189: dwrite d7/d21/f26 [0,4194304] 0 2024-09-13T17:05:44.015 INFO:tasks.workunit.client.1.smithi195.stdout:5/244: creat d2/df/d39/f4f x:0 0 0 2024-09-13T17:05:44.015 INFO:tasks.workunit.client.1.smithi195.stdout:5/245: creat d2/d12/f50 x:0 0 0 2024-09-13T17:05:44.015 INFO:tasks.workunit.client.1.smithi195.stdout:8/243: dwrite d0/d17/d2f/d31/f37 [0,4194304] 0 2024-09-13T17:05:44.017 INFO:tasks.workunit.client.1.smithi195.stdout:9/248: creat d6/d12/d4b/f53 x:0 0 0 2024-09-13T17:05:44.018 INFO:tasks.workunit.client.1.smithi195.stdout:9/249: fdatasync d6/d12/d39/f42 0 2024-09-13T17:05:44.022 INFO:tasks.workunit.client.1.smithi195.stdout:8/244: dread d0/d4/f39 [0,4194304] 0 2024-09-13T17:05:44.022 INFO:tasks.workunit.client.1.smithi195.stdout:7/275: link d5/d35/l3b d5/db/l53 0 2024-09-13T17:05:44.024 INFO:tasks.workunit.client.1.smithi195.stdout:3/190: dread d7/f12 [0,4194304] 0 2024-09-13T17:05:44.024 INFO:tasks.workunit.client.1.smithi195.stdout:1/191: symlink db/l3c 0 2024-09-13T17:05:44.025 INFO:tasks.workunit.client.1.smithi195.stdout:1/192: readlink db/df/d13/l1d 0 2024-09-13T17:05:44.025 INFO:tasks.workunit.client.0.smithi115.stdout:3/338: rmdir d1/d12 39 2024-09-13T17:05:44.025 INFO:tasks.workunit.client.0.smithi115.stdout:3/339: fsync d1/d12/d14/f2e 0 2024-09-13T17:05:44.025 INFO:tasks.workunit.client.0.smithi115.stdout:3/340: fsync d1/d12/d14/f2a 0 2024-09-13T17:05:44.029 INFO:tasks.workunit.client.0.smithi115.stdout:8/176: creat d0/d18/f2e x:0 0 0 2024-09-13T17:05:44.030 INFO:tasks.workunit.client.1.smithi195.stdout:5/246: rmdir d2/d12/d4e 39 2024-09-13T17:05:44.030 INFO:tasks.workunit.client.0.smithi115.stdout:8/177: write d0/d18/f1c [22454,77197] 0 2024-09-13T17:05:44.032 INFO:tasks.workunit.client.0.smithi115.stdout:9/114: mknod d0/de/d10/c29 0 2024-09-13T17:05:44.033 INFO:tasks.workunit.client.1.smithi195.stdout:0/240: rename d7/d8/df to d7/d10/d45 0 2024-09-13T17:05:44.034 INFO:tasks.workunit.client.1.smithi195.stdout:8/245: write d0/d17/d2f/d31/f37 [3498608,92460] 0 2024-09-13T17:05:44.035 INFO:tasks.workunit.client.1.smithi195.stdout:7/276: mknod d5/db/d19/d22/d3c/c54 0 2024-09-13T17:05:44.036 INFO:tasks.workunit.client.0.smithi115.stdout:3/341: symlink d1/d12/d14/d54/l74 0 2024-09-13T17:05:44.036 INFO:tasks.workunit.client.1.smithi195.stdout:1/193: creat db/df/f3d x:0 0 0 2024-09-13T17:05:44.037 INFO:tasks.workunit.client.0.smithi115.stdout:9/115: symlink d0/de/l2a 0 2024-09-13T17:05:44.037 INFO:tasks.workunit.client.1.smithi195.stdout:5/247: creat d2/d12/d4e/d10/f51 x:0 0 0 2024-09-13T17:05:44.041 INFO:tasks.workunit.client.0.smithi115.stdout:3/342: creat d1/d4b/d1a/d6e/f75 x:0 0 0 2024-09-13T17:05:44.041 INFO:tasks.workunit.client.0.smithi115.stdout:3/343: truncate d1/d12/d14/f55 1212547 0 2024-09-13T17:05:44.041 INFO:tasks.workunit.client.0.smithi115.stdout:3/344: creat d1/d4b/f76 x:0 0 0 2024-09-13T17:05:44.043 INFO:tasks.workunit.client.0.smithi115.stdout:8/178: write d0/fc [3076777,61502] 0 2024-09-13T17:05:44.044 INFO:tasks.workunit.client.0.smithi115.stdout:9/116: link d0/de/d10/c29 d0/de/d10/d15/c2b 0 2024-09-13T17:05:44.045 INFO:tasks.workunit.client.0.smithi115.stdout:9/117: dread - d0/de/f28 zero size 2024-09-13T17:05:44.046 INFO:tasks.workunit.client.1.smithi195.stdout:9/250: dwrite d6/df/f27 [0,4194304] 0 2024-09-13T17:05:44.046 INFO:tasks.workunit.client.1.smithi195.stdout:8/246: stat d0/d17/l3c 0 2024-09-13T17:05:44.046 INFO:tasks.workunit.client.1.smithi195.stdout:8/247: readlink d0/d17/l25 0 2024-09-13T17:05:44.046 INFO:tasks.workunit.client.0.smithi115.stdout:7/120: rmdir d0/d2/d1e/d22 0 2024-09-13T17:05:44.047 INFO:tasks.workunit.client.1.smithi195.stdout:3/191: dwrite d7/d19/f22 [0,4194304] 0 2024-09-13T17:05:44.048 INFO:tasks.workunit.client.1.smithi195.stdout:7/277: link d5/db/d19/l2b d5/db/l55 0 2024-09-13T17:05:44.048 INFO:tasks.workunit.client.1.smithi195.stdout:8/248: write d0/d13/f41 [2596714,44752] 0 2024-09-13T17:05:44.051 INFO:tasks.workunit.client.1.smithi195.stdout:0/241: rename d7/d10/d45 to d7/d10/d46 0 2024-09-13T17:05:44.052 INFO:tasks.workunit.client.1.smithi195.stdout:4/285: sync 2024-09-13T17:05:44.052 INFO:tasks.workunit.client.1.smithi195.stdout:4/286: getdents d1a/d1f/d21 0 2024-09-13T17:05:44.057 INFO:tasks.workunit.client.1.smithi195.stdout:7/278: dread d5/d13/d30/f34 [0,4194304] 0 2024-09-13T17:05:44.058 INFO:tasks.workunit.client.1.smithi195.stdout:1/194: dwrite db/f17 [0,4194304] 0 2024-09-13T17:05:44.058 INFO:tasks.workunit.client.1.smithi195.stdout:1/195: write db/f38 [201332,8496] 0 2024-09-13T17:05:44.061 INFO:tasks.workunit.client.1.smithi195.stdout:8/249: dwrite d0/d17/f1b [0,4194304] 0 2024-09-13T17:05:44.070 INFO:tasks.workunit.client.1.smithi195.stdout:1/196: dwrite db/df/f29 [0,4194304] 0 2024-09-13T17:05:44.070 INFO:tasks.workunit.client.1.smithi195.stdout:1/197: write db/df/f20 [234140,48412] 0 2024-09-13T17:05:44.070 INFO:tasks.workunit.client.1.smithi195.stdout:1/198: chown db/df/f16 36229098 1 2024-09-13T17:05:44.071 INFO:tasks.workunit.client.1.smithi195.stdout:1/199: write db/f33 [637132,77622] 0 2024-09-13T17:05:44.173 INFO:tasks.workunit.client.1.smithi195.stdout:5/248: unlink d2/d12/d4e/d10/d46/f2d 0 2024-09-13T17:05:44.173 INFO:tasks.workunit.client.1.smithi195.stdout:5/249: fsync d2/d12/d4e/f4b 0 2024-09-13T17:05:44.173 INFO:tasks.workunit.client.1.smithi195.stdout:5/250: chown d2/d3e 2392172 1 2024-09-13T17:05:44.173 INFO:tasks.workunit.client.1.smithi195.stdout:5/251: chown d2/d12/d4e/l1f 0 1 2024-09-13T17:05:44.174 INFO:tasks.workunit.client.0.smithi115.stdout:3/345: rename d1/d12/d14/f2a to d1/d4b/d69/f77 0 2024-09-13T17:05:44.174 INFO:tasks.workunit.client.0.smithi115.stdout:3/346: fdatasync d1/d12/d23/f59 0 2024-09-13T17:05:44.175 INFO:tasks.workunit.client.0.smithi115.stdout:8/179: creat d0/d15/f2f x:0 0 0 2024-09-13T17:05:44.178 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:43 smithi115 ceph-mon[27708]: from='client.14636 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:05:44.178 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:43 smithi115 ceph-mon[27708]: from='mgr.24317 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:05:44.181 INFO:tasks.workunit.client.0.smithi115.stdout:7/121: mkdir d0/d2/df/d21/d2d 0 2024-09-13T17:05:44.183 INFO:tasks.workunit.client.1.smithi195.stdout:9/251: creat d6/d19/d21/d45/f54 x:0 0 0 2024-09-13T17:05:44.183 INFO:tasks.workunit.client.1.smithi195.stdout:9/252: read - d6/d12/f46 zero size 2024-09-13T17:05:44.185 INFO:tasks.workunit.client.1.smithi195.stdout:3/192: mknod d7/d19/d1e/c2f 0 2024-09-13T17:05:44.185 INFO:tasks.workunit.client.1.smithi195.stdout:3/193: write f5 [2187517,122281] 0 2024-09-13T17:05:44.189 INFO:tasks.workunit.client.0.smithi115.stdout:8/180: dwrite d0/f1d [4194304,4194304] 0 2024-09-13T17:05:44.189 INFO:tasks.workunit.client.1.smithi195.stdout:0/242: mknod d7/d8/c47 0 2024-09-13T17:05:44.190 INFO:tasks.workunit.client.1.smithi195.stdout:0/243: stat d7/d8/d16/f21 0 2024-09-13T17:05:44.193 INFO:tasks.workunit.client.1.smithi195.stdout:4/287: mkdir d1a/d1f/d43/d24/d41/d60 0 2024-09-13T17:05:44.193 INFO:tasks.workunit.client.1.smithi195.stdout:4/288: truncate d1a/d1f/d43/d24/f3e 934075 0 2024-09-13T17:05:44.193 INFO:tasks.workunit.client.1.smithi195.stdout:4/289: chown d1a/d1f/d21/d22/f26 280968 1 2024-09-13T17:05:44.194 INFO:tasks.workunit.client.0.smithi115.stdout:3/347: link d1/cb d1/d4b/d1a/d30/c78 0 2024-09-13T17:05:44.195 INFO:tasks.workunit.client.1.smithi195.stdout:7/279: symlink d5/db/d50/l56 0 2024-09-13T17:05:44.196 INFO:tasks.workunit.client.0.smithi115.stdout:9/118: write d0/f8 [836991,29610] 0 2024-09-13T17:05:44.198 INFO:tasks.workunit.client.0.smithi115.stdout:7/122: rename d0/d2/d1e/f11 to d0/f2e 0 2024-09-13T17:05:44.200 INFO:tasks.workunit.client.0.smithi115.stdout:8/181: creat d0/d18/d19/d28/f30 x:0 0 0 2024-09-13T17:05:44.202 INFO:tasks.workunit.client.0.smithi115.stdout:3/348: truncate d1/d4b/d1a/d30/f37 3931487 0 2024-09-13T17:05:44.204 INFO:tasks.workunit.client.0.smithi115.stdout:7/123: getdents d0/d18 0 2024-09-13T17:05:44.204 INFO:tasks.workunit.client.0.smithi115.stdout:7/124: truncate d0/d2/df/f10 906299 0 2024-09-13T17:05:44.206 INFO:tasks.workunit.client.0.smithi115.stdout:8/182: symlink d0/d18/d19/d28/l31 0 2024-09-13T17:05:44.207 INFO:tasks.workunit.client.0.smithi115.stdout:8/183: write d0/fc [4048598,1854] 0 2024-09-13T17:05:44.207 INFO:tasks.workunit.client.0.smithi115.stdout:1/102: sync 2024-09-13T17:05:44.207 INFO:tasks.workunit.client.1.smithi195.stdout:0/244: dwrite d7/db/d38/f42 [0,4194304] 0 2024-09-13T17:05:44.208 INFO:tasks.workunit.client.1.smithi195.stdout:3/194: dwrite d7/f12 [0,4194304] 0 2024-09-13T17:05:44.211 INFO:tasks.workunit.client.0.smithi115.stdout:3/349: creat d1/d12/d14/d61/f79 x:0 0 0 2024-09-13T17:05:44.211 INFO:tasks.workunit.client.0.smithi115.stdout:9/119: write d0/f11 [806054,39238] 0 2024-09-13T17:05:44.211 INFO:tasks.workunit.client.0.smithi115.stdout:3/350: write d1/f16 [2569937,47755] 0 2024-09-13T17:05:44.211 INFO:tasks.workunit.client.0.smithi115.stdout:3/351: truncate d1/d12/d14/f3e 5025670 0 2024-09-13T17:05:44.211 INFO:tasks.workunit.client.0.smithi115.stdout:3/352: fsync d1/d12/d23/f3a 0 2024-09-13T17:05:44.211 INFO:tasks.workunit.client.0.smithi115.stdout:3/353: chown d1/d4b/d1a/l53 2046 1 2024-09-13T17:05:44.212 INFO:tasks.workunit.client.1.smithi195.stdout:1/200: mkdir db/d19/d37/d3e 0 2024-09-13T17:05:44.219 INFO:tasks.workunit.client.1.smithi195.stdout:8/250: dwrite d0/d17/d2f/d31/f3f [0,4194304] 0 2024-09-13T17:05:44.285 INFO:tasks.workunit.client.0.smithi115.stdout:6/163: sync 2024-09-13T17:05:44.286 INFO:tasks.workunit.client.0.smithi115.stdout:5/166: sync 2024-09-13T17:05:44.286 INFO:tasks.workunit.client.0.smithi115.stdout:0/101: sync 2024-09-13T17:05:44.286 INFO:tasks.workunit.client.0.smithi115.stdout:0/102: fsync d9/f18 0 2024-09-13T17:05:44.286 INFO:tasks.workunit.client.0.smithi115.stdout:0/103: chown f2 6854 1 2024-09-13T17:05:44.286 INFO:tasks.workunit.client.0.smithi115.stdout:5/167: creat d19/f3c x:0 0 0 2024-09-13T17:05:44.297 INFO:tasks.workunit.client.0.smithi115.stdout:0/104: dwrite d9/ff [0,4194304] 0 2024-09-13T17:05:44.297 INFO:tasks.workunit.client.0.smithi115.stdout:0/105: write d9/f16 [337200,11189] 0 2024-09-13T17:05:44.301 INFO:tasks.workunit.client.0.smithi115.stdout:7/125: rename d0/d2/d28 to d0/d2/df/d21/d2f 0 2024-09-13T17:05:44.301 INFO:tasks.workunit.client.0.smithi115.stdout:7/126: readlink d0/l9 0 2024-09-13T17:05:44.301 INFO:tasks.workunit.client.0.smithi115.stdout:7/127: stat d0 0 2024-09-13T17:05:44.301 INFO:tasks.workunit.client.1.smithi195.stdout:2/244: rename d0/d3/df/d11 to d0/d4a/d1c/d2c/d51 0 2024-09-13T17:05:44.302 INFO:tasks.workunit.client.1.smithi195.stdout:6/195: rename d1c/d28 to d1c/d28/d3a 22 2024-09-13T17:05:44.303 INFO:tasks.workunit.client.1.smithi195.stdout:9/253: stat d6/c11 0 2024-09-13T17:05:44.304 INFO:tasks.workunit.client.0.smithi115.stdout:1/103: creat d5/f22 x:0 0 0 2024-09-13T17:05:44.306 INFO:tasks.workunit.client.1.smithi195.stdout:9/254: write d6/df/f3c [2073336,19904] 0 2024-09-13T17:05:44.308 INFO:tasks.workunit.client.1.smithi195.stdout:4/290: symlink d1a/d1f/d21/d36/l61 0 2024-09-13T17:05:44.311 INFO:tasks.workunit.client.0.smithi115.stdout:9/120: symlink d0/de/d10/d15/l2c 0 2024-09-13T17:05:44.311 INFO:tasks.workunit.client.0.smithi115.stdout:9/121: creat d0/de/f2d x:0 0 0 2024-09-13T17:05:44.311 INFO:tasks.workunit.client.1.smithi195.stdout:7/280: creat d5/d35/f57 x:0 0 0 2024-09-13T17:05:44.312 INFO:tasks.workunit.client.0.smithi115.stdout:3/354: symlink d1/d4b/l7a 0 2024-09-13T17:05:44.319 INFO:tasks.workunit.client.1.smithi195.stdout:3/195: rename d7/d21/c2e to d7/d21/c30 0 2024-09-13T17:05:44.319 INFO:tasks.workunit.client.1.smithi195.stdout:3/196: chown d7/d19/c20 0 1 2024-09-13T17:05:44.319 INFO:tasks.workunit.client.1.smithi195.stdout:9/255: dread d6/d19/f1f [0,4194304] 0 2024-09-13T17:05:44.320 INFO:tasks.workunit.client.1.smithi195.stdout:4/291: dread d1a/d1f/d43/d24/f3e [0,4194304] 0 2024-09-13T17:05:44.322 INFO:tasks.workunit.client.1.smithi195.stdout:1/201: symlink db/d19/l3f 0 2024-09-13T17:05:44.322 INFO:tasks.workunit.client.1.smithi195.stdout:6/196: dwrite d1c/d28/f2b [0,4194304] 0 2024-09-13T17:05:44.323 INFO:tasks.workunit.client.0.smithi115.stdout:6/164: mknod d8/d2c/c31 0 2024-09-13T17:05:44.325 INFO:tasks.workunit.client.1.smithi195.stdout:8/251: chown d0/d17/d2f/d31/c44 12645 1 2024-09-13T17:05:44.326 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:43 smithi195 ceph-mon[34981]: from='client.14636 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:05:44.326 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:43 smithi195 ceph-mon[34981]: from='mgr.24317 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:05:44.327 INFO:tasks.workunit.client.1.smithi195.stdout:2/245: creat d0/d4a/d1c/d1e/f52 x:0 0 0 2024-09-13T17:05:44.330 INFO:tasks.workunit.client.1.smithi195.stdout:7/281: symlink d5/d35/d37/l58 0 2024-09-13T17:05:44.330 INFO:tasks.workunit.client.1.smithi195.stdout:7/282: fdatasync d5/d35/d37/f4a 0 2024-09-13T17:05:44.330 INFO:tasks.workunit.client.1.smithi195.stdout:4/292: read fa [535454,5238] 0 2024-09-13T17:05:44.332 INFO:tasks.workunit.client.0.smithi115.stdout:0/106: mknod d9/c1c 0 2024-09-13T17:05:44.332 INFO:tasks.workunit.client.0.smithi115.stdout:0/107: getdents d9/d1b 0 2024-09-13T17:05:44.337 INFO:tasks.workunit.client.0.smithi115.stdout:7/128: unlink d0/c26 0 2024-09-13T17:05:44.337 INFO:tasks.workunit.client.1.smithi195.stdout:3/197: truncate d7/f13 2432360 0 2024-09-13T17:05:44.337 INFO:tasks.workunit.client.1.smithi195.stdout:3/198: fdatasync d7/f14 0 2024-09-13T17:05:44.339 INFO:tasks.workunit.client.1.smithi195.stdout:5/252: rename d2/d12/c38 to d2/d12/d4e/d10/c52 0 2024-09-13T17:05:44.339 INFO:tasks.workunit.client.1.smithi195.stdout:5/253: truncate d2/d12/d3f/f4d 229006 0 2024-09-13T17:05:44.339 INFO:tasks.workunit.client.1.smithi195.stdout:5/254: write d2/d12/f50 [921488,30446] 0 2024-09-13T17:05:44.339 INFO:tasks.workunit.client.0.smithi115.stdout:9/122: dwrite d0/de/d10/f1b [0,4194304] 0 2024-09-13T17:05:44.340 INFO:tasks.workunit.client.1.smithi195.stdout:8/252: unlink d0/d17/f1b 0 2024-09-13T17:05:44.342 INFO:tasks.workunit.client.1.smithi195.stdout:3/199: dread f5 [0,4194304] 0 2024-09-13T17:05:44.343 INFO:tasks.workunit.client.1.smithi195.stdout:2/246: unlink d0/d4a/d1c/d1e/l4d 0 2024-09-13T17:05:44.344 INFO:tasks.workunit.client.0.smithi115.stdout:3/355: unlink d1/d12/d14/d61/f79 0 2024-09-13T17:05:44.344 INFO:tasks.workunit.client.0.smithi115.stdout:3/356: chown d1/d12/d14 2632 1 2024-09-13T17:05:44.345 INFO:tasks.workunit.client.0.smithi115.stdout:6/165: creat d8/db/f32 x:0 0 0 2024-09-13T17:05:44.346 INFO:tasks.workunit.client.0.smithi115.stdout:6/166: chown d8/d13/d15/d24 2044 1 2024-09-13T17:05:44.347 INFO:tasks.workunit.client.0.smithi115.stdout:5/168: getdents d19/d21 0 2024-09-13T17:05:44.348 INFO:tasks.workunit.client.0.smithi115.stdout:5/169: fsync fd 0 2024-09-13T17:05:44.350 INFO:tasks.workunit.client.0.smithi115.stdout:7/129: unlink d0/d2/df/f29 0 2024-09-13T17:05:44.350 INFO:tasks.workunit.client.0.smithi115.stdout:7/130: fsync d0/d2/df/d21/d25/f2c 0 2024-09-13T17:05:44.351 INFO:tasks.workunit.client.1.smithi195.stdout:0/245: rename d7/d10/f3d to d7/d10/d46/f48 0 2024-09-13T17:05:44.353 INFO:tasks.workunit.client.0.smithi115.stdout:1/104: getdents d5 0 2024-09-13T17:05:44.353 INFO:tasks.workunit.client.0.smithi115.stdout:1/105: chown d5/l19 313645122 1 2024-09-13T17:05:44.355 INFO:tasks.workunit.client.1.smithi195.stdout:9/256: dwrite d6/df/f38 [0,4194304] 0 2024-09-13T17:05:44.355 INFO:tasks.workunit.client.0.smithi115.stdout:0/108: dwrite d9/f17 [4194304,4194304] 0 2024-09-13T17:05:44.356 INFO:tasks.workunit.client.1.smithi195.stdout:8/253: creat d0/d13/d4d/f51 x:0 0 0 2024-09-13T17:05:44.356 INFO:tasks.workunit.client.1.smithi195.stdout:6/197: dwrite d1c/d28/f2b [0,4194304] 0 2024-09-13T17:05:44.356 INFO:tasks.workunit.client.1.smithi195.stdout:6/198: dread - d1c/d24/f37 zero size 2024-09-13T17:05:44.356 INFO:tasks.workunit.client.1.smithi195.stdout:6/199: fsync d1c/f29 0 2024-09-13T17:05:44.357 INFO:tasks.workunit.client.1.smithi195.stdout:3/200: creat d7/f31 x:0 0 0 2024-09-13T17:05:44.358 INFO:tasks.workunit.client.1.smithi195.stdout:3/201: dread - d7/d21/f27 zero size 2024-09-13T17:05:44.358 INFO:tasks.workunit.client.1.smithi195.stdout:3/202: creat d7/d21/d2a/f32 x:0 0 0 2024-09-13T17:05:44.359 INFO:tasks.workunit.client.1.smithi195.stdout:2/247: truncate d0/d3/df/f20 1825027 0 2024-09-13T17:05:44.362 INFO:tasks.workunit.client.0.smithi115.stdout:3/357: unlink d1/d4b/d1a/d30/c31 0 2024-09-13T17:05:44.362 INFO:tasks.workunit.client.0.smithi115.stdout:3/358: truncate d1/d12/d14/d54/f6c 455357 0 2024-09-13T17:05:44.365 INFO:tasks.workunit.client.0.smithi115.stdout:6/167: dwrite d8/d13/d15/d24/f1f [0,4194304] 0 2024-09-13T17:05:44.365 INFO:tasks.workunit.client.1.smithi195.stdout:1/202: rename db/cd to db/d19/d37/c40 0 2024-09-13T17:05:44.365 INFO:tasks.workunit.client.0.smithi115.stdout:5/170: mkdir d19/d3d 0 2024-09-13T17:05:44.369 INFO:tasks.workunit.client.0.smithi115.stdout:7/131: creat d0/d18/f30 x:0 0 0 2024-09-13T17:05:44.371 INFO:tasks.workunit.client.1.smithi195.stdout:9/257: write d6/df/f38 [989754,58352] 0 2024-09-13T17:05:44.373 INFO:tasks.workunit.client.0.smithi115.stdout:0/109: mkdir d9/d1d 0 2024-09-13T17:05:44.376 INFO:tasks.workunit.client.0.smithi115.stdout:9/123: rmdir d0/de 39 2024-09-13T17:05:44.376 INFO:tasks.workunit.client.0.smithi115.stdout:9/124: chown d0/f8 58470418 1 2024-09-13T17:05:44.377 INFO:tasks.workunit.client.1.smithi195.stdout:8/254: truncate d0/f3 2621489 0 2024-09-13T17:05:44.378 INFO:tasks.workunit.client.0.smithi115.stdout:6/168: rmdir d8/d13 39 2024-09-13T17:05:44.378 INFO:tasks.workunit.client.0.smithi115.stdout:6/169: readlink d8/l1b 0 2024-09-13T17:05:44.380 INFO:tasks.workunit.client.0.smithi115.stdout:3/359: write d1/d4b/d69/f77 [1191236,56423] 0 2024-09-13T17:05:44.381 INFO:tasks.workunit.client.0.smithi115.stdout:3/360: fsync d1/d4b/d1a/f20 0 2024-09-13T17:05:44.381 INFO:tasks.workunit.client.0.smithi115.stdout:3/361: write d1/d12/f5b [917739,76323] 0 2024-09-13T17:05:44.385 INFO:tasks.workunit.client.0.smithi115.stdout:5/171: mknod d19/c3e 0 2024-09-13T17:05:44.385 INFO:tasks.workunit.client.1.smithi195.stdout:3/203: dwrite d7/d21/f26 [0,4194304] 0 2024-09-13T17:05:44.386 INFO:tasks.workunit.client.1.smithi195.stdout:1/203: dwrite db/f38 [0,4194304] 0 2024-09-13T17:05:44.387 INFO:tasks.workunit.client.0.smithi115.stdout:7/132: creat d0/f31 x:0 0 0 2024-09-13T17:05:44.387 INFO:tasks.workunit.client.0.smithi115.stdout:7/133: fsync d0/f13 0 2024-09-13T17:05:44.388 INFO:tasks.workunit.client.1.smithi195.stdout:6/200: mknod d1c/d28/d35/c3b 0 2024-09-13T17:05:44.389 INFO:tasks.workunit.client.0.smithi115.stdout:1/106: symlink d5/d7/l23 0 2024-09-13T17:05:44.392 INFO:tasks.workunit.client.0.smithi115.stdout:0/110: symlink d9/l1e 0 2024-09-13T17:05:44.394 INFO:tasks.workunit.client.1.smithi195.stdout:5/255: getdents d2/d12/d4e/d10/d46 0 2024-09-13T17:05:44.394 INFO:tasks.workunit.client.1.smithi195.stdout:5/256: write d2/f17 [1353664,85553] 0 2024-09-13T17:05:44.395 INFO:tasks.workunit.client.0.smithi115.stdout:6/170: unlink d8/d13/d15/d24/f27 0 2024-09-13T17:05:44.396 INFO:tasks.workunit.client.0.smithi115.stdout:3/362: dwrite d1/d12/d23/f48 [0,4194304] 0 2024-09-13T17:05:44.396 INFO:tasks.workunit.client.0.smithi115.stdout:3/363: chown d1/d4b/f21 46768181 1 2024-09-13T17:05:44.397 INFO:tasks.workunit.client.1.smithi195.stdout:4/293: rename d1a/l31 to d1a/d1f/d43/d29/d58/l62 0 2024-09-13T17:05:44.398 INFO:tasks.workunit.client.0.smithi115.stdout:5/172: rename c15 to d19/d2c/c3f 0 2024-09-13T17:05:44.398 INFO:tasks.workunit.client.0.smithi115.stdout:9/125: rename d0 to d0/de/d10/d15/d2e 22 2024-09-13T17:05:44.398 INFO:tasks.workunit.client.0.smithi115.stdout:9/126: readlink d0/d21/l26 0 2024-09-13T17:05:44.398 INFO:tasks.workunit.client.0.smithi115.stdout:5/173: read d19/f1e [972905,27718] 0 2024-09-13T17:05:44.398 INFO:tasks.workunit.client.0.smithi115.stdout:5/174: fsync d19/f25 0 2024-09-13T17:05:44.399 INFO:tasks.workunit.client.1.smithi195.stdout:9/258: mknod d6/df/d16/c55 0 2024-09-13T17:05:44.399 INFO:tasks.workunit.client.0.smithi115.stdout:1/107: mknod d5/c24 0 2024-09-13T17:05:44.400 INFO:tasks.workunit.client.0.smithi115.stdout:1/108: write d5/d7/f18 [820651,77480] 0 2024-09-13T17:05:44.401 INFO:tasks.workunit.client.0.smithi115.stdout:6/171: unlink d8/db/d1d/f20 0 2024-09-13T17:05:44.402 INFO:tasks.workunit.client.0.smithi115.stdout:0/111: dread d9/fd [0,4194304] 0 2024-09-13T17:05:44.405 INFO:tasks.workunit.client.0.smithi115.stdout:7/134: dwrite d0/d18/f30 [0,4194304] 0 2024-09-13T17:05:44.407 INFO:tasks.workunit.client.1.smithi195.stdout:1/204: creat db/d19/d37/f41 x:0 0 0 2024-09-13T17:05:44.407 INFO:tasks.workunit.client.0.smithi115.stdout:2/283: sync 2024-09-13T17:05:44.408 INFO:tasks.workunit.client.1.smithi195.stdout:2/248: getdents d0/d3 0 2024-09-13T17:05:44.410 INFO:tasks.workunit.client.0.smithi115.stdout:3/364: mkdir d1/d4b/d69/d7b 0 2024-09-13T17:05:44.410 INFO:tasks.workunit.client.0.smithi115.stdout:3/365: creat d1/d12/d14/d61/f7c x:0 0 0 2024-09-13T17:05:44.410 INFO:tasks.workunit.client.0.smithi115.stdout:3/366: chown d1/l11 64969839 1 2024-09-13T17:05:44.411 INFO:tasks.workunit.client.1.smithi195.stdout:5/257: rmdir d2/d12/d4e/d10/d46 39 2024-09-13T17:05:44.412 INFO:tasks.workunit.client.0.smithi115.stdout:3/367: dread d1/d4b/d1a/d30/f36 [0,4194304] 0 2024-09-13T17:05:44.413 INFO:tasks.workunit.client.1.smithi195.stdout:1/205: dread db/f11 [0,4194304] 0 2024-09-13T17:05:44.414 INFO:tasks.workunit.client.0.smithi115.stdout:5/175: mkdir d19/d2b/d40 0 2024-09-13T17:05:44.416 INFO:tasks.workunit.client.1.smithi195.stdout:0/246: rename d7/db/d38/f42 to d7/d10/d46/f49 0 2024-09-13T17:05:44.418 INFO:tasks.workunit.client.0.smithi115.stdout:4/262: sync 2024-09-13T17:05:44.419 INFO:tasks.workunit.client.0.smithi115.stdout:4/263: write d7/f36 [2716552,17636] 0 2024-09-13T17:05:44.419 INFO:tasks.workunit.client.1.smithi195.stdout:4/294: mkdir d1a/d1f/d43/d5a/d63 0 2024-09-13T17:05:44.419 INFO:tasks.workunit.client.1.smithi195.stdout:4/295: write d1a/d1f/d21/d22/f3b [981542,31635] 0 2024-09-13T17:05:44.419 INFO:tasks.workunit.client.0.smithi115.stdout:6/172: unlink d8/db/f32 0 2024-09-13T17:05:44.420 INFO:tasks.workunit.client.1.smithi195.stdout:9/259: symlink d6/d12/l56 0 2024-09-13T17:05:44.422 INFO:tasks.workunit.client.1.smithi195.stdout:3/204: mkdir d7/d33 0 2024-09-13T17:05:44.422 INFO:tasks.workunit.client.1.smithi195.stdout:3/205: creat d7/d21/f34 x:0 0 0 2024-09-13T17:05:44.423 INFO:tasks.workunit.client.1.smithi195.stdout:5/258: symlink d2/d3e/l53 0 2024-09-13T17:05:44.424 INFO:tasks.workunit.client.1.smithi195.stdout:1/206: symlink db/df/l42 0 2024-09-13T17:05:44.425 INFO:tasks.workunit.client.0.smithi115.stdout:2/284: creat d3/d4d/de/f59 x:0 0 0 2024-09-13T17:05:44.426 INFO:tasks.workunit.client.1.smithi195.stdout:4/296: symlink d1a/d1f/d43/d29/l64 0 2024-09-13T17:05:44.426 INFO:tasks.workunit.client.1.smithi195.stdout:4/297: creat d1a/d1f/d43/d5a/f65 x:0 0 0 2024-09-13T17:05:44.426 INFO:tasks.workunit.client.1.smithi195.stdout:4/298: dread - d1a/d1f/d43/d24/d41/f47 zero size 2024-09-13T17:05:44.430 INFO:tasks.workunit.client.0.smithi115.stdout:3/368: truncate d1/d4b/d1a/f6b 2680974 0 2024-09-13T17:05:44.432 INFO:tasks.workunit.client.1.smithi195.stdout:3/206: rename d7/d33 to d7/d21/d2a/d35 0 2024-09-13T17:05:44.433 INFO:tasks.workunit.client.0.smithi115.stdout:5/176: mkdir d19/d2b/d40/d41 0 2024-09-13T17:05:44.433 INFO:tasks.workunit.client.0.smithi115.stdout:5/177: write d19/f1e [690666,40646] 0 2024-09-13T17:05:44.434 INFO:tasks.workunit.client.1.smithi195.stdout:1/207: write db/df/f29 [225367,56377] 0 2024-09-13T17:05:44.434 INFO:tasks.workunit.client.1.smithi195.stdout:2/249: mknod d0/c53 0 2024-09-13T17:05:44.434 INFO:tasks.workunit.client.1.smithi195.stdout:2/250: chown d0/d4a/d1c/c3c 817 1 2024-09-13T17:05:44.435 INFO:tasks.workunit.client.0.smithi115.stdout:1/109: symlink d5/d7/l25 0 2024-09-13T17:05:44.435 INFO:tasks.workunit.client.1.smithi195.stdout:5/259: getdents d2/d12/d4e/d10 0 2024-09-13T17:05:44.436 INFO:tasks.workunit.client.1.smithi195.stdout:5/260: stat d2/d3e/l53 0 2024-09-13T17:05:44.438 INFO:tasks.workunit.client.1.smithi195.stdout:0/247: dwrite d7/d8/d23/f32 [0,4194304] 0 2024-09-13T17:05:44.439 INFO:tasks.workunit.client.1.smithi195.stdout:4/299: link d1a/d1f/f20 d1a/d1f/d43/f66 0 2024-09-13T17:05:44.440 INFO:tasks.workunit.client.0.smithi115.stdout:3/369: dread d1/d4b/d1a/d30/f37 [0,4194304] 0 2024-09-13T17:05:44.440 INFO:tasks.workunit.client.0.smithi115.stdout:3/370: fdatasync d1/d12/f45 0 2024-09-13T17:05:44.440 INFO:tasks.workunit.client.0.smithi115.stdout:3/371: chown d1/d12/d14/l52 7 1 2024-09-13T17:05:44.440 INFO:tasks.workunit.client.0.smithi115.stdout:3/372: dread - d1/d4b/f76 zero size 2024-09-13T17:05:44.440 INFO:tasks.workunit.client.0.smithi115.stdout:0/112: getdents d9 0 2024-09-13T17:05:44.440 INFO:tasks.workunit.client.0.smithi115.stdout:6/173: dwrite d8/db/d1d/f2b [0,4194304] 0 2024-09-13T17:05:44.442 INFO:tasks.workunit.client.1.smithi195.stdout:9/260: mknod d6/c57 0 2024-09-13T17:05:44.444 INFO:tasks.workunit.client.0.smithi115.stdout:7/135: getdents d0 0 2024-09-13T17:05:44.446 INFO:tasks.workunit.client.0.smithi115.stdout:2/285: creat d3/d4d/dd/d1f/d2f/d56/d58/f5a x:0 0 0 2024-09-13T17:05:44.447 INFO:tasks.workunit.client.1.smithi195.stdout:1/208: creat db/d19/d37/d3e/f43 x:0 0 0 2024-09-13T17:05:44.448 INFO:tasks.workunit.client.1.smithi195.stdout:3/207: dread d7/d19/f22 [0,4194304] 0 2024-09-13T17:05:44.448 INFO:tasks.workunit.client.0.smithi115.stdout:9/127: rename d0/ca to d0/c2f 0 2024-09-13T17:05:44.448 INFO:tasks.workunit.client.0.smithi115.stdout:9/128: read - d0/d21/f22 zero size 2024-09-13T17:05:44.449 INFO:tasks.workunit.client.0.smithi115.stdout:9/129: chown d0/lf 3 1 2024-09-13T17:05:44.449 INFO:tasks.workunit.client.1.smithi195.stdout:2/251: creat d0/f54 x:0 0 0 2024-09-13T17:05:44.449 INFO:tasks.workunit.client.0.smithi115.stdout:5/178: symlink d19/d2b/d40/l42 0 2024-09-13T17:05:44.450 INFO:tasks.workunit.client.1.smithi195.stdout:3/208: dread d7/d21/d2a/f2b [0,4194304] 0 2024-09-13T17:05:44.450 INFO:tasks.workunit.client.1.smithi195.stdout:3/209: chown d7/d19/l25 979602566 1 2024-09-13T17:05:44.451 INFO:tasks.workunit.client.1.smithi195.stdout:5/261: mkdir d2/df/d39/d54 0 2024-09-13T17:05:44.451 INFO:tasks.workunit.client.1.smithi195.stdout:5/262: write d2/f17 [3587054,77649] 0 2024-09-13T17:05:44.452 INFO:tasks.workunit.client.0.smithi115.stdout:1/110: mkdir d5/d26 0 2024-09-13T17:05:44.454 INFO:tasks.workunit.client.0.smithi115.stdout:4/264: truncate d7/f36 1167237 0 2024-09-13T17:05:44.454 INFO:tasks.workunit.client.0.smithi115.stdout:4/265: write d7/dd/de/f13 [1392258,130044] 0 2024-09-13T17:05:44.455 INFO:tasks.workunit.client.0.smithi115.stdout:0/113: unlink d9/f15 0 2024-09-13T17:05:44.457 INFO:tasks.workunit.client.0.smithi115.stdout:3/373: dwrite d1/d12/d14/f55 [0,4194304] 0 2024-09-13T17:05:44.457 INFO:tasks.workunit.client.1.smithi195.stdout:0/248: creat d7/d8/d23/f4a x:0 0 0 2024-09-13T17:05:44.459 INFO:tasks.workunit.client.1.smithi195.stdout:1/209: fsync db/d19/d37/d3e/f43 0 2024-09-13T17:05:44.460 INFO:tasks.workunit.client.0.smithi115.stdout:6/174: mkdir d8/d33 0 2024-09-13T17:05:44.460 INFO:tasks.workunit.client.0.smithi115.stdout:6/175: write d8/d13/f19 [155370,28952] 0 2024-09-13T17:05:44.461 INFO:tasks.workunit.client.0.smithi115.stdout:7/136: getdents d0/d2/d1e 0 2024-09-13T17:05:44.463 INFO:tasks.workunit.client.0.smithi115.stdout:2/286: mkdir d3/d4d/dd/df/d5b 0 2024-09-13T17:05:44.466 INFO:tasks.workunit.client.0.smithi115.stdout:3/374: dread d1/d12/d14/f55 [0,4194304] 0 2024-09-13T17:05:44.466 INFO:tasks.workunit.client.0.smithi115.stdout:5/179: truncate fd 2038338 0 2024-09-13T17:05:44.467 INFO:tasks.workunit.client.1.smithi195.stdout:9/261: mkdir d6/df/d16/d58 0 2024-09-13T17:05:44.467 INFO:tasks.workunit.client.0.smithi115.stdout:1/111: symlink d5/d26/l27 0 2024-09-13T17:05:44.469 INFO:tasks.workunit.client.0.smithi115.stdout:4/266: creat d7/dd/de/d4e/f50 x:0 0 0 2024-09-13T17:05:44.470 INFO:tasks.workunit.client.1.smithi195.stdout:2/252: mknod d0/d3/d3d/c55 0 2024-09-13T17:05:44.470 INFO:tasks.workunit.client.1.smithi195.stdout:3/210: symlink d7/d21/d2a/d35/l36 0 2024-09-13T17:05:44.473 INFO:tasks.workunit.client.1.smithi195.stdout:5/263: mknod d2/d12/d4e/d10/d46/c55 0 2024-09-13T17:05:44.475 INFO:tasks.workunit.client.0.smithi115.stdout:6/176: link d8/d2c/c31 d8/d33/c34 0 2024-09-13T17:05:44.475 INFO:tasks.workunit.client.0.smithi115.stdout:6/177: fdatasync f5 0 2024-09-13T17:05:44.476 INFO:tasks.workunit.client.1.smithi195.stdout:0/249: mkdir d7/d8/d23/d4b 0 2024-09-13T17:05:44.479 INFO:tasks.workunit.client.0.smithi115.stdout:7/137: rename d0/f1b to d0/d2/d1e/f32 0 2024-09-13T17:05:44.482 INFO:tasks.workunit.client.0.smithi115.stdout:0/114: dread d9/f17 [0,4194304] 0 2024-09-13T17:05:44.484 INFO:tasks.workunit.client.1.smithi195.stdout:4/300: rename l10 to d1a/d1f/d43/d5a/l67 0 2024-09-13T17:05:44.484 INFO:tasks.workunit.client.1.smithi195.stdout:4/301: fsync f16 0 2024-09-13T17:05:44.484 INFO:tasks.workunit.client.1.smithi195.stdout:4/302: chown d1a/d1f/d43/d29/d58/l62 2572 1 2024-09-13T17:05:44.485 INFO:tasks.workunit.client.0.smithi115.stdout:2/287: mkdir d3/d4d/dd/df/d5c 0 2024-09-13T17:05:44.485 INFO:tasks.workunit.client.1.smithi195.stdout:7/283: sync 2024-09-13T17:05:44.485 INFO:tasks.workunit.client.1.smithi195.stdout:7/284: dread - d5/db/d19/d22/f4e zero size 2024-09-13T17:05:44.486 INFO:tasks.workunit.client.1.smithi195.stdout:7/285: rename d5/d35 to d5/d35/d59 22 2024-09-13T17:05:44.486 INFO:tasks.workunit.client.1.smithi195.stdout:1/210: mknod db/c44 0 2024-09-13T17:05:44.487 INFO:tasks.workunit.client.0.smithi115.stdout:4/267: dread d7/f31 [0,4194304] 0 2024-09-13T17:05:44.487 INFO:tasks.workunit.client.1.smithi195.stdout:5/264: dread d2/df/f1c [0,4194304] 0 2024-09-13T17:05:44.490 INFO:tasks.workunit.client.0.smithi115.stdout:9/130: unlink d0/l4 0 2024-09-13T17:05:44.491 INFO:tasks.workunit.client.1.smithi195.stdout:9/262: symlink d6/df/l59 0 2024-09-13T17:05:44.492 INFO:tasks.workunit.client.0.smithi115.stdout:3/375: mknod d1/d12/d23/c7d 0 2024-09-13T17:05:44.494 INFO:tasks.workunit.client.1.smithi195.stdout:3/211: unlink d7/d21/f34 0 2024-09-13T17:05:44.494 INFO:tasks.workunit.client.1.smithi195.stdout:3/212: write d7/f15 [1019810,55274] 0 2024-09-13T17:05:44.494 INFO:tasks.workunit.client.0.smithi115.stdout:5/180: mknod d19/d21/c43 0 2024-09-13T17:05:44.553 INFO:tasks.workunit.client.0.smithi115.stdout:7/138: dwrite d0/d2/df/f10 [0,4194304] 0 2024-09-13T17:05:44.553 INFO:tasks.workunit.client.0.smithi115.stdout:6/178: dwrite d8/d13/d15/d24/f29 [0,4194304] 0 2024-09-13T17:05:44.554 INFO:tasks.workunit.client.1.smithi195.stdout:0/250: unlink d7/db/d38/c39 0 2024-09-13T17:05:44.554 INFO:tasks.workunit.client.1.smithi195.stdout:0/251: stat d7/d8/d23/d4b 0 2024-09-13T17:05:44.554 INFO:tasks.workunit.client.1.smithi195.stdout:2/253: dwrite d0/d3/d3d/f50 [0,4194304] 0 2024-09-13T17:05:44.554 INFO:tasks.workunit.client.1.smithi195.stdout:2/254: write d0/f22 [905911,117179] 0 2024-09-13T17:05:44.554 INFO:tasks.workunit.client.1.smithi195.stdout:2/255: fdatasync d0/d4a/f3a 0 2024-09-13T17:05:44.554 INFO:tasks.workunit.client.1.smithi195.stdout:2/256: dread - d0/d4a/d1c/d1e/f52 zero size 2024-09-13T17:05:44.554 INFO:tasks.workunit.client.1.smithi195.stdout:2/257: dread - d0/d4a/d1c/f3e zero size 2024-09-13T17:05:44.555 INFO:tasks.workunit.client.1.smithi195.stdout:4/303: mknod d1a/d1f/d43/d29/d58/c68 0 2024-09-13T17:05:44.555 INFO:tasks.workunit.client.0.smithi115.stdout:1/112: creat d5/d26/f28 x:0 0 0 2024-09-13T17:05:44.555 INFO:tasks.workunit.client.0.smithi115.stdout:1/113: creat d5/d26/f29 x:0 0 0 2024-09-13T17:05:44.558 INFO:tasks.workunit.client.1.smithi195.stdout:7/286: rename d5/d13/d30/l39 to d5/d13/d30/l5a 0 2024-09-13T17:05:44.558 INFO:tasks.workunit.client.1.smithi195.stdout:4/304: dread d1a/d1f/d43/d29/f3f [0,4194304] 0 2024-09-13T17:05:44.559 INFO:tasks.workunit.client.0.smithi115.stdout:2/288: creat d3/d4d/d13/d39/f5d x:0 0 0 2024-09-13T17:05:44.559 INFO:tasks.workunit.client.0.smithi115.stdout:2/289: dread - d3/d4d/dd/d1f/d2f/d56/d58/f5a zero size 2024-09-13T17:05:44.559 INFO:tasks.workunit.client.0.smithi115.stdout:9/131: dwrite d0/de/d10/f14 [0,4194304] 0 2024-09-13T17:05:44.559 INFO:tasks.workunit.client.0.smithi115.stdout:9/132: dread - d0/de/f28 zero size 2024-09-13T17:05:44.560 INFO:tasks.workunit.client.1.smithi195.stdout:1/211: mknod db/d19/c45 0 2024-09-13T17:05:44.561 INFO:tasks.workunit.client.0.smithi115.stdout:3/376: mknod d1/d4b/d1a/d30/c7e 0 2024-09-13T17:05:44.561 INFO:tasks.workunit.client.0.smithi115.stdout:3/377: write d1/d4b/d69/f77 [929904,19314] 0 2024-09-13T17:05:44.561 INFO:tasks.workunit.client.0.smithi115.stdout:3/378: dread - d1/d12/d23/f62 zero size 2024-09-13T17:05:44.562 INFO:tasks.workunit.client.1.smithi195.stdout:0/252: read d7/db/f34 [3621524,59109] 0 2024-09-13T17:05:44.562 INFO:tasks.workunit.client.1.smithi195.stdout:0/253: creat d7/d8/d16/f4c x:0 0 0 2024-09-13T17:05:44.564 INFO:tasks.workunit.client.0.smithi115.stdout:5/181: rename d19/d21/f31 to d19/d2b/f44 0 2024-09-13T17:05:44.564 INFO:tasks.workunit.client.0.smithi115.stdout:5/182: chown f16 1494402437 1 2024-09-13T17:05:44.564 INFO:tasks.workunit.client.0.smithi115.stdout:5/183: fdatasync d19/f37 0 2024-09-13T17:05:44.566 INFO:tasks.workunit.client.1.smithi195.stdout:9/263: truncate d6/df/f27 3199617 0 2024-09-13T17:05:44.567 INFO:tasks.workunit.client.1.smithi195.stdout:2/258: write d0/d3/fe [1908064,556] 0 2024-09-13T17:05:44.567 INFO:tasks.workunit.client.1.smithi195.stdout:9/264: dread - d6/d12/f4d zero size 2024-09-13T17:05:44.567 INFO:tasks.workunit.client.1.smithi195.stdout:9/265: write d6/d12/f46 [42801,118812] 0 2024-09-13T17:05:44.575 INFO:tasks.workunit.client.1.smithi195.stdout:5/265: write d2/d3e/d32/f33 [3690803,101707] 0 2024-09-13T17:05:44.575 INFO:tasks.workunit.client.1.smithi195.stdout:5/266: fsync d2/df/d39/f44 0 2024-09-13T17:05:44.576 INFO:tasks.workunit.client.0.smithi115.stdout:6/179: link d8/d13/d15/d24/la d8/db/l35 0 2024-09-13T17:05:44.583 INFO:tasks.workunit.client.1.smithi195.stdout:9/266: write d6/f7 [1347893,115756] 0 2024-09-13T17:05:44.583 INFO:tasks.workunit.client.1.smithi195.stdout:9/267: chown d6/df/f27 26 1 2024-09-13T17:05:44.583 INFO:tasks.workunit.client.1.smithi195.stdout:9/268: creat d6/d19/d21/d45/f5a x:0 0 0 2024-09-13T17:05:44.583 INFO:tasks.workunit.client.0.smithi115.stdout:0/115: dwrite d9/f18 [4194304,4194304] 0 2024-09-13T17:05:44.583 INFO:tasks.workunit.client.1.smithi195.stdout:4/305: dwrite d1a/d1f/d21/d22/f5b [0,4194304] 0 2024-09-13T17:05:44.586 INFO:tasks.workunit.client.0.smithi115.stdout:7/139: dwrite d0/d2/d1e/f32 [0,4194304] 0 2024-09-13T17:05:44.586 INFO:tasks.workunit.client.1.smithi195.stdout:7/287: rename d5/db/fc to d5/db/d19/d22/f5b 0 2024-09-13T17:05:44.586 INFO:tasks.workunit.client.1.smithi195.stdout:7/288: truncate d5/d35/d37/f4a 469897 0 2024-09-13T17:05:44.588 INFO:tasks.workunit.client.1.smithi195.stdout:1/212: mkdir db/d19/d37/d46 0 2024-09-13T17:05:44.591 INFO:tasks.workunit.client.0.smithi115.stdout:5/184: dwrite d19/f25 [0,4194304] 0 2024-09-13T17:05:44.591 INFO:tasks.workunit.client.0.smithi115.stdout:5/185: creat d19/d2b/d32/f45 x:0 0 0 2024-09-13T17:05:44.592 INFO:tasks.workunit.client.1.smithi195.stdout:4/306: dread d1a/f2d [0,4194304] 0 2024-09-13T17:05:44.593 INFO:tasks.workunit.client.1.smithi195.stdout:0/254: mkdir d7/d10/d4d 0 2024-09-13T17:05:44.594 INFO:tasks.workunit.client.0.smithi115.stdout:1/114: mknod d5/c2a 0 2024-09-13T17:05:44.596 INFO:tasks.workunit.client.0.smithi115.stdout:7/140: write d0/d2/f1a [2549330,87315] 0 2024-09-13T17:05:44.596 INFO:tasks.workunit.client.0.smithi115.stdout:7/141: write d0/d18/f1f [5053943,54250] 0 2024-09-13T17:05:44.597 INFO:tasks.workunit.client.0.smithi115.stdout:2/290: symlink d3/d4d/d13/l5e 0 2024-09-13T17:05:44.599 INFO:tasks.workunit.client.1.smithi195.stdout:2/259: symlink d0/d4a/d1c/d2c/d51/l56 0 2024-09-13T17:05:44.600 INFO:tasks.workunit.client.0.smithi115.stdout:9/133: unlink d0/de/d10/d15/f20 0 2024-09-13T17:05:44.601 INFO:tasks.workunit.client.1.smithi195.stdout:3/213: rmdir d7/d21/d2a 39 2024-09-13T17:05:44.601 INFO:tasks.workunit.client.1.smithi195.stdout:3/214: chown d7/f15 8063 1 2024-09-13T17:05:44.603 INFO:tasks.workunit.client.0.smithi115.stdout:3/379: rename d1/d4b/d1a/c64 to d1/d12/d23/c7f 0 2024-09-13T17:05:44.603 INFO:tasks.workunit.client.0.smithi115.stdout:9/134: rename d0/de/d10 to d0/de/d10/d15/d30 22 2024-09-13T17:05:44.603 INFO:tasks.workunit.client.0.smithi115.stdout:9/135: truncate d0/d21/f22 429312 0 2024-09-13T17:05:44.603 INFO:tasks.workunit.client.0.smithi115.stdout:9/136: fdatasync d0/de/d10/f14 0 2024-09-13T17:05:44.604 INFO:tasks.workunit.client.0.smithi115.stdout:0/116: truncate d9/f16 1054563 0 2024-09-13T17:05:44.605 INFO:tasks.workunit.client.1.smithi195.stdout:6/201: sync 2024-09-13T17:05:44.605 INFO:tasks.workunit.client.1.smithi195.stdout:8/255: sync 2024-09-13T17:05:44.605 INFO:tasks.workunit.client.1.smithi195.stdout:6/202: write d1c/d24/f38 [608521,101482] 0 2024-09-13T17:05:44.605 INFO:tasks.workunit.client.1.smithi195.stdout:6/203: chown f18 50411820 1 2024-09-13T17:05:44.608 INFO:tasks.workunit.client.0.smithi115.stdout:8/184: sync 2024-09-13T17:05:44.608 INFO:tasks.workunit.client.0.smithi115.stdout:8/185: readlink d0/l9 0 2024-09-13T17:05:44.608 INFO:tasks.workunit.client.0.smithi115.stdout:6/180: dwrite d8/db/d1d/f26 [0,4194304] 0 2024-09-13T17:05:44.609 INFO:tasks.workunit.client.1.smithi195.stdout:5/267: dwrite d2/d3e/d32/f33 [4194304,4194304] 0 2024-09-13T17:05:44.609 INFO:tasks.workunit.client.1.smithi195.stdout:2/260: fdatasync d0/d3/fe 0 2024-09-13T17:05:44.611 INFO:tasks.workunit.client.1.smithi195.stdout:7/289: rename d5/c3e to d5/db/d19/d22/c5c 0 2024-09-13T17:05:44.612 INFO:tasks.workunit.client.1.smithi195.stdout:5/268: dread d2/df/f1a [0,4194304] 0 2024-09-13T17:05:44.614 INFO:tasks.workunit.client.1.smithi195.stdout:1/213: unlink db/d19/c24 0 2024-09-13T17:05:44.614 INFO:tasks.workunit.client.1.smithi195.stdout:1/214: truncate db/df/f3d 471813 0 2024-09-13T17:05:44.615 INFO:tasks.workunit.client.1.smithi195.stdout:1/215: getdents db/d19/d37/d46 0 2024-09-13T17:05:44.615 INFO:tasks.workunit.client.1.smithi195.stdout:1/216: creat db/d19/f47 x:0 0 0 2024-09-13T17:05:44.624 INFO:tasks.workunit.client.1.smithi195.stdout:0/255: unlink d7/d10/c41 0 2024-09-13T17:05:44.624 INFO:tasks.workunit.client.1.smithi195.stdout:0/256: write d7/d8/d16/f30 [223722,52925] 0 2024-09-13T17:05:44.625 INFO:tasks.workunit.client.1.smithi195.stdout:8/256: mkdir d0/d13/d52 0 2024-09-13T17:05:44.626 INFO:tasks.workunit.client.0.smithi115.stdout:7/142: creat d0/d2/df/d21/f33 x:0 0 0 2024-09-13T17:05:44.626 INFO:tasks.workunit.client.0.smithi115.stdout:7/143: write d0/fa [284671,35878] 0 2024-09-13T17:05:44.627 INFO:tasks.workunit.client.1.smithi195.stdout:6/204: mknod d1c/d28/d35/c3c 0 2024-09-13T17:05:44.627 INFO:tasks.workunit.client.1.smithi195.stdout:6/205: truncate f14 120581 0 2024-09-13T17:05:44.627 INFO:tasks.workunit.client.1.smithi195.stdout:6/206: fsync d1c/d28/d35/f36 0 2024-09-13T17:05:44.628 INFO:tasks.workunit.client.0.smithi115.stdout:2/291: creat d3/f5f x:0 0 0 2024-09-13T17:05:44.628 INFO:tasks.workunit.client.0.smithi115.stdout:2/292: write d3/d4d/de/f2a [1441560,125695] 0 2024-09-13T17:05:44.628 INFO:tasks.workunit.client.0.smithi115.stdout:2/293: dread - d3/d4d/dd/d1f/d2f/d56/f42 zero size 2024-09-13T17:05:44.629 INFO:tasks.workunit.client.0.smithi115.stdout:3/380: unlink d1/d4b/d1a/d30/f36 0 2024-09-13T17:05:44.631 INFO:tasks.workunit.client.0.smithi115.stdout:9/137: creat d0/f31 x:0 0 0 2024-09-13T17:05:44.631 INFO:tasks.workunit.client.0.smithi115.stdout:9/138: chown d0/f1f 124930 1 2024-09-13T17:05:44.631 INFO:tasks.workunit.client.0.smithi115.stdout:9/139: chown d0/de/d10/f1b 645 1 2024-09-13T17:05:44.631 INFO:tasks.workunit.client.0.smithi115.stdout:0/117: creat d9/f1f x:0 0 0 2024-09-13T17:05:44.632 INFO:tasks.workunit.client.1.smithi195.stdout:9/269: rmdir d6/d12 39 2024-09-13T17:05:44.633 INFO:tasks.workunit.client.0.smithi115.stdout:6/181: symlink d8/d13/d15/d24/l36 0 2024-09-13T17:05:44.634 INFO:tasks.workunit.client.0.smithi115.stdout:7/144: dread d0/f1 [0,4194304] 0 2024-09-13T17:05:44.635 INFO:tasks.workunit.client.1.smithi195.stdout:7/290: link d5/db/d19/d22/f5b d5/db/d19/d22/f5d 0 2024-09-13T17:05:44.635 INFO:tasks.workunit.client.1.smithi195.stdout:7/291: stat d5/db/d19/d22/d3c/f4f 0 2024-09-13T17:05:44.637 INFO:tasks.workunit.client.0.smithi115.stdout:7/145: dread d0/d2/df/f16 [0,4194304] 0 2024-09-13T17:05:44.637 INFO:tasks.workunit.client.0.smithi115.stdout:8/186: dwrite d0/d18/d19/d28/f30 [0,4194304] 0 2024-09-13T17:05:44.637 INFO:tasks.workunit.client.1.smithi195.stdout:3/215: dwrite d7/f15 [0,4194304] 0 2024-09-13T17:05:44.639 INFO:tasks.workunit.client.1.smithi195.stdout:1/217: symlink db/d19/d37/d3e/l48 0 2024-09-13T17:05:44.639 INFO:tasks.workunit.client.1.smithi195.stdout:1/218: dread - db/df/f1f zero size 2024-09-13T17:05:44.639 INFO:tasks.workunit.client.1.smithi195.stdout:1/219: chown db/d19/d37/d3e/f43 650778 1 2024-09-13T17:05:44.639 INFO:tasks.workunit.client.1.smithi195.stdout:1/220: fsync db/df/d13/f27 0 2024-09-13T17:05:44.639 INFO:tasks.workunit.client.1.smithi195.stdout:1/221: dread - db/df/d13/f22 zero size 2024-09-13T17:05:44.640 INFO:tasks.workunit.client.1.smithi195.stdout:4/307: rmdir d1a/d1f/d43/d24/d41 39 2024-09-13T17:05:44.644 INFO:tasks.workunit.client.0.smithi115.stdout:1/115: symlink d5/d7/l2b 0 2024-09-13T17:05:44.644 INFO:tasks.workunit.client.0.smithi115.stdout:2/294: symlink d3/d4d/dd/df/d57/l60 0 2024-09-13T17:05:44.644 INFO:tasks.workunit.client.0.smithi115.stdout:2/295: write d3/d4d/de/f59 [28671,35120] 0 2024-09-13T17:05:44.645 INFO:tasks.workunit.client.1.smithi195.stdout:0/257: mkdir d7/d8/d23/d4b/d4e 0 2024-09-13T17:05:44.645 INFO:tasks.workunit.client.1.smithi195.stdout:0/258: dread - d7/d8/d23/f4a zero size 2024-09-13T17:05:44.646 INFO:tasks.workunit.client.0.smithi115.stdout:8/187: write d0/fb [256740,101218] 0 2024-09-13T17:05:44.646 INFO:tasks.workunit.client.1.smithi195.stdout:8/257: creat d0/d17/d2f/d31/f53 x:0 0 0 2024-09-13T17:05:44.646 INFO:tasks.workunit.client.1.smithi195.stdout:8/258: getdents d0/d13/d52 0 2024-09-13T17:05:44.647 INFO:tasks.workunit.client.0.smithi115.stdout:3/381: unlink d1/d4b/d1a/f20 0 2024-09-13T17:05:44.649 INFO:tasks.workunit.client.1.smithi195.stdout:6/207: unlink d1c/d24/f37 0 2024-09-13T17:05:44.653 INFO:tasks.workunit.client.1.smithi195.stdout:2/261: rename d0/d4a/d1c/d2c/d51/c4b to d0/c57 0 2024-09-13T17:05:44.653 INFO:tasks.workunit.client.1.smithi195.stdout:2/262: write d0/d4a/d1c/d1e/f52 [242119,67058] 0 2024-09-13T17:05:44.653 INFO:tasks.workunit.client.1.smithi195.stdout:2/263: fsync d0/d3/f4e 0 2024-09-13T17:05:44.654 INFO:tasks.workunit.client.0.smithi115.stdout:0/118: getdents d9/d1d 0 2024-09-13T17:05:44.655 INFO:tasks.workunit.client.1.smithi195.stdout:7/292: link d5/f6 d5/db/d19/f5e 0 2024-09-13T17:05:44.655 INFO:tasks.workunit.client.0.smithi115.stdout:8/188: read d0/fc [5933098,65491] 0 2024-09-13T17:05:44.656 INFO:tasks.workunit.client.0.smithi115.stdout:8/189: stat d0/d18/d19/d28/f30 0 2024-09-13T17:05:44.656 INFO:tasks.workunit.client.0.smithi115.stdout:6/182: mknod d8/d2c/c37 0 2024-09-13T17:05:44.658 INFO:tasks.workunit.client.0.smithi115.stdout:7/146: link d0/l4 d0/d2/l34 0 2024-09-13T17:05:44.658 INFO:tasks.workunit.client.0.smithi115.stdout:7/147: rename d0/d2/df to d0/d2/df/d21/d2d/d35 22 2024-09-13T17:05:44.661 INFO:tasks.workunit.client.1.smithi195.stdout:0/259: dread d7/d8/d23/f25 [0,4194304] 0 2024-09-13T17:05:44.662 INFO:tasks.workunit.client.0.smithi115.stdout:1/116: mkdir d5/d26/d2c 0 2024-09-13T17:05:44.665 INFO:tasks.workunit.client.0.smithi115.stdout:2/296: mknod d3/d4d/dd/d1f/d2f/c61 0 2024-09-13T17:05:44.667 INFO:tasks.workunit.client.1.smithi195.stdout:8/259: dwrite d0/f2e [0,4194304] 0 2024-09-13T17:05:44.667 INFO:tasks.workunit.client.0.smithi115.stdout:9/140: rmdir d0/de/d10/d15 39 2024-09-13T17:05:44.669 INFO:tasks.workunit.client.0.smithi115.stdout:0/119: chown d9/fb 48 1 2024-09-13T17:05:44.670 INFO:tasks.workunit.client.0.smithi115.stdout:6/183: write d8/d13/d15/d24/f1f [1234163,92967] 0 2024-09-13T17:05:44.672 INFO:tasks.workunit.client.0.smithi115.stdout:8/190: link d0/d26/d29/f2a d0/d21/f32 0 2024-09-13T17:05:44.673 INFO:tasks.workunit.client.0.smithi115.stdout:7/148: mknod d0/d2/df/d21/d25/c36 0 2024-09-13T17:05:44.675 INFO:tasks.workunit.client.0.smithi115.stdout:1/117: symlink d5/d26/l2d 0 2024-09-13T17:05:44.677 INFO:tasks.workunit.client.0.smithi115.stdout:8/191: dread d0/f1d [0,4194304] 0 2024-09-13T17:05:44.677 INFO:tasks.workunit.client.0.smithi115.stdout:3/382: dwrite d1/d4b/d1a/d6e/f75 [0,4194304] 0 2024-09-13T17:05:44.677 INFO:tasks.workunit.client.1.smithi195.stdout:3/216: creat d7/d21/d2a/d35/f37 x:0 0 0 2024-09-13T17:05:44.679 INFO:tasks.workunit.client.1.smithi195.stdout:1/222: symlink db/d19/d37/d3e/l49 0 2024-09-13T17:05:44.680 INFO:tasks.workunit.client.0.smithi115.stdout:2/297: mkdir d3/d4d/d13/d62 0 2024-09-13T17:05:44.680 INFO:tasks.workunit.client.1.smithi195.stdout:4/308: symlink d1a/d1f/d21/d22/l69 0 2024-09-13T17:05:44.682 INFO:tasks.workunit.client.1.smithi195.stdout:6/208: creat d1c/d2d/d30/f3d x:0 0 0 2024-09-13T17:05:44.682 INFO:tasks.workunit.client.0.smithi115.stdout:9/141: stat d0/f16 0 2024-09-13T17:05:44.686 INFO:tasks.workunit.client.1.smithi195.stdout:7/293: truncate d5/f6 4664225 0 2024-09-13T17:05:44.686 INFO:tasks.workunit.client.1.smithi195.stdout:2/264: dwrite d0/d4a/d1c/d1e/f52 [0,4194304] 0 2024-09-13T17:05:44.686 INFO:tasks.workunit.client.0.smithi115.stdout:0/120: creat d9/f20 x:0 0 0 2024-09-13T17:05:44.687 INFO:tasks.workunit.client.1.smithi195.stdout:0/260: mkdir d7/db/d38/d4f 0 2024-09-13T17:05:44.687 INFO:tasks.workunit.client.1.smithi195.stdout:0/261: stat d7/d8 0 2024-09-13T17:05:44.691 INFO:tasks.workunit.client.0.smithi115.stdout:6/184: creat d8/d13/d15/d24/d17/f38 x:0 0 0 2024-09-13T17:05:44.693 INFO:tasks.workunit.client.0.smithi115.stdout:7/149: symlink d0/d2/df/d21/d2d/l37 0 2024-09-13T17:05:44.694 INFO:tasks.workunit.client.1.smithi195.stdout:8/260: symlink d0/l54 0 2024-09-13T17:05:44.694 INFO:tasks.workunit.client.1.smithi195.stdout:8/261: chown d0/d17/d2f/d31 190 1 2024-09-13T17:05:44.695 INFO:tasks.workunit.client.0.smithi115.stdout:1/118: truncate d5/f14 2359815 0 2024-09-13T17:05:44.696 INFO:tasks.workunit.client.1.smithi195.stdout:0/262: write d7/d10/d46/f2e [3007288,76589] 0 2024-09-13T17:05:44.696 INFO:tasks.workunit.client.1.smithi195.stdout:0/263: dread - d7/d8/d16/f2c zero size 2024-09-13T17:05:44.696 INFO:tasks.workunit.client.1.smithi195.stdout:0/264: chown d7/d8 2320201 1 2024-09-13T17:05:44.696 INFO:tasks.workunit.client.1.smithi195.stdout:0/265: write d7/d8/d16/f2c [711247,61045] 0 2024-09-13T17:05:44.696 INFO:tasks.workunit.client.1.smithi195.stdout:0/266: chown d7/c1a 23570282 1 2024-09-13T17:05:44.697 INFO:tasks.workunit.client.1.smithi195.stdout:3/217: getdents d7/d21/d2a 0 2024-09-13T17:05:44.700 INFO:tasks.workunit.client.1.smithi195.stdout:4/309: creat d1a/d1f/d21/f6a x:0 0 0 2024-09-13T17:05:44.700 INFO:tasks.workunit.client.1.smithi195.stdout:4/310: read d1a/d1f/d43/d29/f3f [7317,96455] 0 2024-09-13T17:05:44.705 INFO:tasks.workunit.client.0.smithi115.stdout:3/383: rename d1/d4b/d1a/f4c to d1/d4b/d69/f80 0 2024-09-13T17:05:44.705 INFO:tasks.workunit.client.1.smithi195.stdout:6/209: dwrite d1c/d24/f2e [0,4194304] 0 2024-09-13T17:05:44.706 INFO:tasks.workunit.client.1.smithi195.stdout:2/265: mknod d0/d4a/d1c/d2c/d51/c58 0 2024-09-13T17:05:44.707 INFO:tasks.workunit.client.0.smithi115.stdout:2/298: mknod d3/d4d/d13/c63 0 2024-09-13T17:05:44.707 INFO:tasks.workunit.client.0.smithi115.stdout:2/299: fsync d3/d4d/de/f2a 0 2024-09-13T17:05:44.707 INFO:tasks.workunit.client.0.smithi115.stdout:2/300: truncate d3/d4d/de/f43 24761 0 2024-09-13T17:05:44.707 INFO:tasks.workunit.client.0.smithi115.stdout:2/301: dread - d3/d4d/d13/f51 zero size 2024-09-13T17:05:44.707 INFO:tasks.workunit.client.0.smithi115.stdout:2/302: fsync d3/d4d/de/d3a/d47/f49 0 2024-09-13T17:05:44.708 INFO:tasks.workunit.client.1.smithi195.stdout:6/210: dread f18 [0,4194304] 0 2024-09-13T17:05:44.708 INFO:tasks.workunit.client.1.smithi195.stdout:8/262: truncate d0/fc 3362783 0 2024-09-13T17:05:44.708 INFO:tasks.workunit.client.1.smithi195.stdout:6/211: write d1c/d28/f2b [4491942,118957] 0 2024-09-13T17:05:44.708 INFO:tasks.workunit.client.1.smithi195.stdout:7/294: dwrite d5/db/d19/d22/f38 [0,4194304] 0 2024-09-13T17:05:44.708 INFO:tasks.workunit.client.1.smithi195.stdout:7/295: chown d5/db/d19 7396 1 2024-09-13T17:05:44.709 INFO:tasks.workunit.client.1.smithi195.stdout:7/296: chown d5/fa 1631 1 2024-09-13T17:05:44.709 INFO:tasks.workunit.client.1.smithi195.stdout:9/270: rename d6/df/d37 to d6/d19/d21/d5b 0 2024-09-13T17:05:44.712 INFO:tasks.workunit.client.0.smithi115.stdout:6/185: symlink d8/d13/l39 0 2024-09-13T17:05:44.713 INFO:tasks.workunit.client.0.smithi115.stdout:7/150: dwrite d0/d2/df/f16 [0,4194304] 0 2024-09-13T17:05:44.713 INFO:tasks.workunit.client.0.smithi115.stdout:7/151: truncate d0/d2/df/d21/d25/f2c 400985 0 2024-09-13T17:05:44.714 INFO:tasks.workunit.client.0.smithi115.stdout:8/192: getdents d0/d15 0 2024-09-13T17:05:44.714 INFO:tasks.workunit.client.0.smithi115.stdout:7/152: dread d0/d2/df/d21/d25/f2c [0,4194304] 0 2024-09-13T17:05:44.714 INFO:tasks.workunit.client.1.smithi195.stdout:2/266: dread d0/f22 [0,4194304] 0 2024-09-13T17:05:44.714 INFO:tasks.workunit.client.1.smithi195.stdout:2/267: stat d0/d4a/c18 0 2024-09-13T17:05:44.714 INFO:tasks.workunit.client.1.smithi195.stdout:2/268: truncate d0/f21 577059 0 2024-09-13T17:05:44.714 INFO:tasks.workunit.client.1.smithi195.stdout:2/269: write d0/d3/fe [4471526,10543] 0 2024-09-13T17:05:44.718 INFO:tasks.workunit.client.0.smithi115.stdout:3/384: truncate d1/d4b/f1b 2857065 0 2024-09-13T17:05:44.720 INFO:tasks.workunit.client.0.smithi115.stdout:1/119: dwrite d5/d26/f28 [0,4194304] 0 2024-09-13T17:05:44.720 INFO:tasks.workunit.client.0.smithi115.stdout:1/120: chown d5/d26/d2c 3286 1 2024-09-13T17:05:44.720 INFO:tasks.workunit.client.0.smithi115.stdout:1/121: chown d5/d26/f28 15807788 1 2024-09-13T17:05:44.720 INFO:tasks.workunit.client.0.smithi115.stdout:1/122: chown d5/d7 249645 1 2024-09-13T17:05:44.720 INFO:tasks.workunit.client.0.smithi115.stdout:8/193: dread d0/f1d [0,4194304] 0 2024-09-13T17:05:44.720 INFO:tasks.workunit.client.0.smithi115.stdout:8/194: creat d0/d18/f33 x:0 0 0 2024-09-13T17:05:44.721 INFO:tasks.workunit.client.1.smithi195.stdout:2/270: dread d0/d3/f26 [0,4194304] 0 2024-09-13T17:05:44.721 INFO:tasks.workunit.client.1.smithi195.stdout:2/271: write d0/d3/df/f10 [2793754,29962] 0 2024-09-13T17:05:44.721 INFO:tasks.workunit.client.1.smithi195.stdout:1/223: rename db/d19/d37/f41 to db/d19/f4a 0 2024-09-13T17:05:44.722 INFO:tasks.workunit.client.0.smithi115.stdout:0/121: creat d9/d1b/f21 x:0 0 0 2024-09-13T17:05:44.723 INFO:tasks.workunit.client.0.smithi115.stdout:2/303: dread d3/d4d/d13/d39/f3b [0,4194304] 0 2024-09-13T17:05:44.724 INFO:tasks.workunit.client.1.smithi195.stdout:6/212: mkdir d1c/d3e 0 2024-09-13T17:05:44.725 INFO:tasks.workunit.client.0.smithi115.stdout:6/186: write d8/f25 [809176,12428] 0 2024-09-13T17:05:44.725 INFO:tasks.workunit.client.0.smithi115.stdout:8/195: dread d0/f1d [4194304,4194304] 0 2024-09-13T17:05:44.729 INFO:tasks.workunit.client.0.smithi115.stdout:3/385: rename d1/d12/d14/d54/f6c to d1/d4b/d1a/f81 0 2024-09-13T17:05:44.730 INFO:tasks.workunit.client.0.smithi115.stdout:3/386: dread d1/d12/d23/f3a [0,4194304] 0 2024-09-13T17:05:44.732 INFO:tasks.workunit.client.0.smithi115.stdout:1/123: unlink d5/d7/l25 0 2024-09-13T17:05:44.732 INFO:tasks.workunit.client.0.smithi115.stdout:1/124: dread - d5/d26/f29 zero size 2024-09-13T17:05:44.732 INFO:tasks.workunit.client.0.smithi115.stdout:1/125: stat d5/d7/l1a 0 2024-09-13T17:05:44.732 INFO:tasks.workunit.client.1.smithi195.stdout:8/263: read d0/fc [228200,84022] 0 2024-09-13T17:05:44.734 INFO:tasks.workunit.client.0.smithi115.stdout:7/153: dwrite d0/f2e [0,4194304] 0 2024-09-13T17:05:44.735 INFO:tasks.workunit.client.1.smithi195.stdout:2/272: dread d0/f48 [0,4194304] 0 2024-09-13T17:05:44.735 INFO:tasks.workunit.client.1.smithi195.stdout:2/273: chown d0/d4a/l29 7 1 2024-09-13T17:05:44.736 INFO:tasks.workunit.client.0.smithi115.stdout:0/122: symlink d9/d1d/l22 0 2024-09-13T17:05:44.738 INFO:tasks.workunit.client.0.smithi115.stdout:2/304: mknod d3/d4d/de/d3a/d47/c64 0 2024-09-13T17:05:44.740 INFO:tasks.workunit.client.0.smithi115.stdout:6/187: read d8/db/ff [1288265,39404] 0 2024-09-13T17:05:44.740 INFO:tasks.workunit.client.0.smithi115.stdout:6/188: write d8/f25 [1527306,45884] 0 2024-09-13T17:05:44.743 INFO:tasks.workunit.client.1.smithi195.stdout:1/224: unlink db/d19/c30 0 2024-09-13T17:05:44.745 INFO:tasks.workunit.client.0.smithi115.stdout:8/196: mkdir d0/d21/d34 0 2024-09-13T17:05:44.747 INFO:tasks.workunit.client.1.smithi195.stdout:6/213: truncate ff 5045201 0 2024-09-13T17:05:44.748 INFO:tasks.workunit.client.0.smithi115.stdout:3/387: truncate d1/d4b/f21 3516819 0 2024-09-13T17:05:44.751 INFO:tasks.workunit.client.1.smithi195.stdout:8/264: mkdir d0/d13/d52/d55 0 2024-09-13T17:05:44.751 INFO:tasks.workunit.client.0.smithi115.stdout:2/305: creat d3/d4d/dd/df/f65 x:0 0 0 2024-09-13T17:05:44.753 INFO:tasks.workunit.client.1.smithi195.stdout:2/274: symlink d0/d4a/l59 0 2024-09-13T17:05:44.753 INFO:tasks.workunit.client.1.smithi195.stdout:2/275: readlink d0/d4a/d1c/d2c/d51/l3b 0 2024-09-13T17:05:44.754 INFO:tasks.workunit.client.0.smithi115.stdout:6/189: creat d8/db/dd/f3a x:0 0 0 2024-09-13T17:05:44.758 INFO:tasks.workunit.client.0.smithi115.stdout:1/126: dwrite d5/f22 [0,4194304] 0 2024-09-13T17:05:44.759 INFO:tasks.workunit.client.0.smithi115.stdout:2/306: mkdir d3/d4d/d13/d62/d66 0 2024-09-13T17:05:44.761 INFO:tasks.workunit.client.1.smithi195.stdout:8/265: creat d0/d17/f56 x:0 0 0 2024-09-13T17:05:44.762 INFO:tasks.workunit.client.1.smithi195.stdout:8/266: write d0/fc [2824289,77684] 0 2024-09-13T17:05:44.762 INFO:tasks.workunit.client.1.smithi195.stdout:8/267: read d0/f3 [1447218,104790] 0 2024-09-13T17:05:44.762 INFO:tasks.workunit.client.1.smithi195.stdout:8/268: creat d0/d13/f57 x:0 0 0 2024-09-13T17:05:44.764 INFO:tasks.workunit.client.1.smithi195.stdout:0/267: rename d7/d8/d16 to d7/d50 0 2024-09-13T17:05:44.766 INFO:tasks.workunit.client.0.smithi115.stdout:1/127: link d5/c1d d5/c2e 0 2024-09-13T17:05:44.766 INFO:tasks.workunit.client.1.smithi195.stdout:5/269: sync 2024-09-13T17:05:44.767 INFO:tasks.workunit.client.1.smithi195.stdout:8/269: mknod d0/d13/d4d/d4c/c58 0 2024-09-13T17:05:44.768 INFO:tasks.workunit.client.0.smithi115.stdout:0/123: dwrite d9/f1f [0,4194304] 0 2024-09-13T17:05:44.768 INFO:tasks.workunit.client.0.smithi115.stdout:0/124: creat d9/d1b/f23 x:0 0 0 2024-09-13T17:05:44.771 INFO:tasks.workunit.client.0.smithi115.stdout:7/154: dwrite d0/d2/df/d21/f33 [0,4194304] 0 2024-09-13T17:05:44.771 INFO:tasks.workunit.client.0.smithi115.stdout:7/155: chown d0/l3 1084 1 2024-09-13T17:05:44.772 INFO:tasks.workunit.client.1.smithi195.stdout:2/276: write d0/d4a/d1c/d1e/f52 [3797728,23191] 0 2024-09-13T17:05:44.772 INFO:tasks.workunit.client.1.smithi195.stdout:1/225: dwrite db/df/d13/f27 [0,4194304] 0 2024-09-13T17:05:44.775 INFO:tasks.workunit.client.1.smithi195.stdout:6/214: dwrite d1c/f29 [0,4194304] 0 2024-09-13T17:05:44.776 INFO:tasks.workunit.client.0.smithi115.stdout:6/190: dwrite d8/d13/d15/d24/d17/f38 [0,4194304] 0 2024-09-13T17:05:44.776 INFO:tasks.workunit.client.0.smithi115.stdout:6/191: fsync d8/d13/d15/d24/d17/f38 0 2024-09-13T17:05:44.787 INFO:tasks.workunit.client.1.smithi195.stdout:0/268: dwrite d7/db/d11/f1f [0,4194304] 0 2024-09-13T17:05:44.790 INFO:tasks.workunit.client.1.smithi195.stdout:2/277: dwrite d0/d3/df/f20 [0,4194304] 0 2024-09-13T17:05:44.790 INFO:tasks.workunit.client.1.smithi195.stdout:2/278: dread - d0/d4a/d1c/f3e zero size 2024-09-13T17:05:44.790 INFO:tasks.workunit.client.1.smithi195.stdout:2/279: chown d0/d4a/d1c/d1e/f3f 47 1 2024-09-13T17:05:44.798 INFO:tasks.workunit.client.1.smithi195.stdout:0/269: write d7/d50/f31 [1651422,103099] 0 2024-09-13T17:05:44.802 INFO:tasks.workunit.client.1.smithi195.stdout:0/270: dread d7/d10/d46/f49 [0,4194304] 0 2024-09-13T17:05:44.802 INFO:tasks.workunit.client.1.smithi195.stdout:0/271: write d7/d50/f21 [1037440,79313] 0 2024-09-13T17:05:44.803 INFO:tasks.workunit.client.1.smithi195.stdout:2/280: dwrite d0/f45 [0,4194304] 0 2024-09-13T17:05:44.861 INFO:tasks.workunit.client.1.smithi195.stdout:3/218: rename d7/f31 to d7/d21/d2a/d35/f38 0 2024-09-13T17:05:44.862 INFO:tasks.workunit.client.0.smithi115.stdout:2/307: symlink d3/d4d/d13/d62/d66/l67 0 2024-09-13T17:05:44.863 INFO:tasks.workunit.client.1.smithi195.stdout:5/270: unlink d2/d12/d4e/d10/f15 0 2024-09-13T17:05:44.863 INFO:tasks.workunit.client.1.smithi195.stdout:5/271: chown d2/d12/d4e/d10/d45 4689 1 2024-09-13T17:05:44.863 INFO:tasks.workunit.client.1.smithi195.stdout:5/272: chown d2/d12 292036 1 2024-09-13T17:05:44.864 INFO:tasks.workunit.client.0.smithi115.stdout:1/128: mkdir d5/d26/d2c/d2f 0 2024-09-13T17:05:44.865 INFO:tasks.workunit.client.1.smithi195.stdout:8/270: link d0/d17/d2f/l3d d0/d17/d2f/l59 0 2024-09-13T17:05:44.867 INFO:tasks.workunit.client.1.smithi195.stdout:1/226: creat db/df/d13/f4b x:0 0 0 2024-09-13T17:05:44.871 INFO:tasks.workunit.client.1.smithi195.stdout:6/215: creat d1c/d28/f3f x:0 0 0 2024-09-13T17:05:44.874 INFO:tasks.workunit.client.1.smithi195.stdout:8/271: dread d0/d17/f1d [0,4194304] 0 2024-09-13T17:05:44.877 INFO:tasks.workunit.client.0.smithi115.stdout:7/156: truncate d0/f13 289427 0 2024-09-13T17:05:44.880 INFO:tasks.workunit.client.1.smithi195.stdout:6/216: read d1c/f29 [850362,107226] 0 2024-09-13T17:05:44.881 INFO:tasks.workunit.client.0.smithi115.stdout:6/192: creat d8/d13/d15/d24/f3b x:0 0 0 2024-09-13T17:05:44.883 INFO:tasks.workunit.client.1.smithi195.stdout:1/227: dwrite db/f38 [0,4194304] 0 2024-09-13T17:05:44.883 INFO:tasks.workunit.client.1.smithi195.stdout:1/228: creat db/d19/d37/d3e/f4c x:0 0 0 2024-09-13T17:05:44.885 INFO:tasks.workunit.client.1.smithi195.stdout:2/281: symlink d0/d4a/l5a 0 2024-09-13T17:05:44.887 INFO:tasks.workunit.client.1.smithi195.stdout:3/219: link d7/d19/l25 d7/d19/l39 0 2024-09-13T17:05:44.887 INFO:tasks.workunit.client.1.smithi195.stdout:3/220: write d7/fa [1908307,89419] 0 2024-09-13T17:05:44.888 INFO:tasks.workunit.client.0.smithi115.stdout:1/129: symlink d5/d26/d2c/l30 0 2024-09-13T17:05:44.890 INFO:tasks.workunit.client.1.smithi195.stdout:4/311: rename d1a/l59 to d1a/d1f/d43/l6b 0 2024-09-13T17:05:44.890 INFO:tasks.workunit.client.1.smithi195.stdout:7/297: rename d5 to d5/d35/d37/d5f 22 2024-09-13T17:05:44.890 INFO:tasks.workunit.client.1.smithi195.stdout:6/217: dread fd [4194304,4194304] 0 2024-09-13T17:05:44.892 INFO:tasks.workunit.client.1.smithi195.stdout:5/273: mkdir d2/d3e/d32/d56 0 2024-09-13T17:05:44.892 INFO:tasks.workunit.client.1.smithi195.stdout:5/274: truncate d2/d12/d4e/f3b 1048509 0 2024-09-13T17:05:44.892 INFO:tasks.workunit.client.0.smithi115.stdout:6/193: mknod d8/d13/c3c 0 2024-09-13T17:05:44.892 INFO:tasks.workunit.client.0.smithi115.stdout:6/194: dread - d8/d2c/f30 zero size 2024-09-13T17:05:44.893 INFO:tasks.workunit.client.0.smithi115.stdout:6/195: creat d8/db/d1d/f3d x:0 0 0 2024-09-13T17:05:44.893 INFO:tasks.workunit.client.0.smithi115.stdout:6/196: chown d8/db/d1d 312 1 2024-09-13T17:05:44.893 INFO:tasks.workunit.client.0.smithi115.stdout:6/197: chown d8/d13/l39 16600 1 2024-09-13T17:05:44.895 INFO:tasks.workunit.client.1.smithi195.stdout:8/272: link d0/d17/d2f/d31/f53 d0/d4/f5a 0 2024-09-13T17:05:44.895 INFO:tasks.workunit.client.1.smithi195.stdout:8/273: write d0/d17/d2f/d31/f53 [780189,79360] 0 2024-09-13T17:05:44.895 INFO:tasks.workunit.client.1.smithi195.stdout:8/274: chown d0/d17/c18 7652 1 2024-09-13T17:05:44.895 INFO:tasks.workunit.client.1.smithi195.stdout:8/275: fdatasync d0/d17/d2f/f40 0 2024-09-13T17:05:44.897 INFO:tasks.workunit.client.0.smithi115.stdout:1/130: link d5/d26/f29 d5/d26/f31 0 2024-09-13T17:05:44.900 INFO:tasks.workunit.client.0.smithi115.stdout:7/157: link d0/l9 d0/d2/d1e/l38 0 2024-09-13T17:05:44.902 INFO:tasks.workunit.client.1.smithi195.stdout:4/312: write d1a/d1f/d21/f30 [3147764,128645] 0 2024-09-13T17:05:44.905 INFO:tasks.workunit.client.1.smithi195.stdout:1/229: mkdir db/df/d4d 0 2024-09-13T17:05:44.906 INFO:tasks.workunit.client.0.smithi115.stdout:6/198: mknod d8/d13/d15/d24/c3e 0 2024-09-13T17:05:44.906 INFO:tasks.workunit.client.0.smithi115.stdout:6/199: write d8/db/ff [903755,108517] 0 2024-09-13T17:05:44.906 INFO:tasks.workunit.client.0.smithi115.stdout:6/200: fsync d8/db/dd/f3a 0 2024-09-13T17:05:44.906 INFO:tasks.workunit.client.0.smithi115.stdout:6/201: fdatasync d8/f25 0 2024-09-13T17:05:44.906 INFO:tasks.workunit.client.0.smithi115.stdout:6/202: chown d8/l1b 50254 1 2024-09-13T17:05:44.907 INFO:tasks.workunit.client.1.smithi195.stdout:9/271: sync 2024-09-13T17:05:44.907 INFO:tasks.workunit.client.1.smithi195.stdout:9/272: chown d6/d19/c52 124732030 1 2024-09-13T17:05:44.909 INFO:tasks.workunit.client.1.smithi195.stdout:3/221: mkdir d7/d21/d2a/d3a 0 2024-09-13T17:05:44.910 INFO:tasks.workunit.client.0.smithi115.stdout:4/268: sync 2024-09-13T17:05:44.911 INFO:tasks.workunit.client.0.smithi115.stdout:1/131: rename d5/d7/f13 to d5/d26/d2c/f32 0 2024-09-13T17:05:44.911 INFO:tasks.workunit.client.0.smithi115.stdout:1/132: stat d5/d7/f21 0 2024-09-13T17:05:44.911 INFO:tasks.workunit.client.0.smithi115.stdout:1/133: readlink d5/l11 0 2024-09-13T17:05:44.911 INFO:tasks.workunit.client.0.smithi115.stdout:1/134: dread - d5/d26/f29 zero size 2024-09-13T17:05:44.913 INFO:tasks.workunit.client.1.smithi195.stdout:0/272: rename d7/c1a to d7/d50/c51 0 2024-09-13T17:05:44.914 INFO:tasks.workunit.client.1.smithi195.stdout:0/273: readlink d7/d8/d23/l28 0 2024-09-13T17:05:44.914 INFO:tasks.workunit.client.1.smithi195.stdout:0/274: truncate d7/d10/d46/f2e 5784675 0 2024-09-13T17:05:44.915 INFO:tasks.workunit.client.1.smithi195.stdout:0/275: dread d7/db/d38/f3b [0,4194304] 0 2024-09-13T17:05:44.916 INFO:tasks.workunit.client.1.smithi195.stdout:5/275: mknod d2/df/d39/d54/c57 0 2024-09-13T17:05:44.916 INFO:tasks.workunit.client.1.smithi195.stdout:5/276: readlink d2/d3e/l34 0 2024-09-13T17:05:44.917 INFO:tasks.workunit.client.0.smithi115.stdout:6/203: mkdir d8/d33/d3f 0 2024-09-13T17:05:44.917 INFO:tasks.workunit.client.0.smithi115.stdout:6/204: stat d8/d13/d15/c2e 0 2024-09-13T17:05:44.919 INFO:tasks.workunit.client.0.smithi115.stdout:1/135: write d5/d7/ff [288829,120630] 0 2024-09-13T17:05:44.919 INFO:tasks.workunit.client.0.smithi115.stdout:1/136: write d5/d7/ff [958672,62563] 0 2024-09-13T17:05:44.922 INFO:tasks.workunit.client.1.smithi195.stdout:8/276: rename d0/d4/l12 to d0/d13/d52/d55/l5b 0 2024-09-13T17:05:44.922 INFO:tasks.workunit.client.1.smithi195.stdout:8/277: readlink d0/l54 0 2024-09-13T17:05:44.926 INFO:tasks.workunit.client.0.smithi115.stdout:7/158: link d0/d2/d1e/f32 d0/d2/d1e/f39 0 2024-09-13T17:05:44.926 INFO:tasks.workunit.client.0.smithi115.stdout:4/269: dread f3 [0,4194304] 0 2024-09-13T17:05:44.926 INFO:tasks.workunit.client.1.smithi195.stdout:2/282: dwrite d0/d3/f4e [0,4194304] 0 2024-09-13T17:05:44.927 INFO:tasks.workunit.client.1.smithi195.stdout:2/283: stat d0/d3/f4 0 2024-09-13T17:05:44.929 INFO:tasks.workunit.client.1.smithi195.stdout:1/230: rename db/df/f29 to db/d19/d37/f4e 0 2024-09-13T17:05:44.931 INFO:tasks.workunit.client.0.smithi115.stdout:7/159: creat d0/d2/f3a x:0 0 0 2024-09-13T17:05:44.935 INFO:tasks.workunit.client.1.smithi195.stdout:8/278: symlink d0/l5c 0 2024-09-13T17:05:44.935 INFO:tasks.workunit.client.1.smithi195.stdout:8/279: readlink d0/d4/l27 0 2024-09-13T17:05:44.935 INFO:tasks.workunit.client.1.smithi195.stdout:8/280: chown d0/d17/f56 18324 1 2024-09-13T17:05:44.935 INFO:tasks.workunit.client.1.smithi195.stdout:8/281: write d0/d4/f5a [1312779,90362] 0 2024-09-13T17:05:44.935 INFO:tasks.workunit.client.1.smithi195.stdout:8/282: creat d0/d13/f5d x:0 0 0 2024-09-13T17:05:44.935 INFO:tasks.workunit.client.1.smithi195.stdout:8/283: chown d0/d13/d4d/d4c 113667 1 2024-09-13T17:05:44.936 INFO:tasks.workunit.client.1.smithi195.stdout:8/284: chown d0/d13/c34 445622 1 2024-09-13T17:05:44.936 INFO:tasks.workunit.client.1.smithi195.stdout:8/285: creat d0/d4/f5e x:0 0 0 2024-09-13T17:05:44.937 INFO:tasks.workunit.client.1.smithi195.stdout:2/284: dread d0/d3/fe [0,4194304] 0 2024-09-13T17:05:44.938 INFO:tasks.workunit.client.0.smithi115.stdout:1/137: rename d5/d26/d2c/d2f to d5/d7/d33 0 2024-09-13T17:05:44.938 INFO:tasks.workunit.client.0.smithi115.stdout:1/138: write d5/d26/d2c/f32 [4707602,68306] 0 2024-09-13T17:05:44.943 INFO:tasks.workunit.client.1.smithi195.stdout:1/231: creat db/df/d4d/f4f x:0 0 0 2024-09-13T17:05:44.943 INFO:tasks.workunit.client.1.smithi195.stdout:1/232: dread - db/df/f1f zero size 2024-09-13T17:05:44.947 INFO:tasks.workunit.client.1.smithi195.stdout:8/286: symlink d0/l5f 0 2024-09-13T17:05:44.947 INFO:tasks.workunit.client.1.smithi195.stdout:8/287: fdatasync d0/d13/f41 0 2024-09-13T17:05:44.948 INFO:tasks.workunit.client.1.smithi195.stdout:2/285: truncate d0/d3/df/f35 165638 0 2024-09-13T17:05:44.953 INFO:tasks.workunit.client.1.smithi195.stdout:2/286: creat d0/d3/f5b x:0 0 0 2024-09-13T17:05:44.953 INFO:tasks.workunit.client.1.smithi195.stdout:2/287: write d0/d4a/d1c/d1e/f3f [920623,124142] 0 2024-09-13T17:05:44.953 INFO:tasks.workunit.client.1.smithi195.stdout:2/288: creat d0/d3/f5c x:0 0 0 2024-09-13T17:05:44.955 INFO:tasks.workunit.client.1.smithi195.stdout:1/233: getdents db/d19 0 2024-09-13T17:05:44.957 INFO:tasks.workunit.client.1.smithi195.stdout:8/288: link d0/d17/d2f/d31/c3b d0/d13/d4d/c60 0 2024-09-13T17:05:44.958 INFO:tasks.workunit.client.1.smithi195.stdout:1/234: symlink db/d19/d37/d3e/l50 0 2024-09-13T17:05:44.959 INFO:tasks.workunit.client.1.smithi195.stdout:8/289: creat d0/f61 x:0 0 0 2024-09-13T17:05:44.959 INFO:tasks.workunit.client.1.smithi195.stdout:8/290: write d0/d4/f5e [183804,12546] 0 2024-09-13T17:05:44.960 INFO:tasks.workunit.client.0.smithi115.stdout:0/125: dwrite d9/f1f [4194304,4194304] 0 2024-09-13T17:05:44.960 INFO:tasks.workunit.client.0.smithi115.stdout:0/126: fsync d9/fb 0 2024-09-13T17:05:44.961 INFO:tasks.workunit.client.1.smithi195.stdout:1/235: mkdir db/df/d51 0 2024-09-13T17:05:44.962 INFO:tasks.workunit.client.1.smithi195.stdout:4/313: dwrite f11 [0,4194304] 0 2024-09-13T17:05:44.962 INFO:tasks.workunit.client.1.smithi195.stdout:4/314: chown d1a/d1f/d43/d29/l64 561 1 2024-09-13T17:05:44.967 INFO:tasks.workunit.client.1.smithi195.stdout:1/236: rmdir db/df/d13 39 2024-09-13T17:05:44.967 INFO:tasks.workunit.client.1.smithi195.stdout:1/237: creat db/df/d4d/f52 x:0 0 0 2024-09-13T17:05:44.969 INFO:tasks.workunit.client.1.smithi195.stdout:1/238: creat db/df/d51/f53 x:0 0 0 2024-09-13T17:05:44.972 INFO:tasks.workunit.client.1.smithi195.stdout:1/239: link l8 db/d19/d37/d3e/l54 0 2024-09-13T17:05:44.972 INFO:tasks.workunit.client.1.smithi195.stdout:1/240: getdents db/d19 0 2024-09-13T17:05:44.973 INFO:tasks.workunit.client.1.smithi195.stdout:7/298: dwrite d5/d35/f57 [0,4194304] 0 2024-09-13T17:05:44.973 INFO:tasks.workunit.client.1.smithi195.stdout:7/299: chown d5/db/l1e 84771 1 2024-09-13T17:05:44.973 INFO:tasks.workunit.client.1.smithi195.stdout:7/300: creat d5/d35/f60 x:0 0 0 2024-09-13T17:05:44.973 INFO:tasks.workunit.client.1.smithi195.stdout:1/241: symlink db/l55 0 2024-09-13T17:05:44.977 INFO:tasks.workunit.client.1.smithi195.stdout:7/301: symlink d5/d35/l61 0 2024-09-13T17:05:44.977 INFO:tasks.workunit.client.1.smithi195.stdout:7/302: creat d5/db/d19/d22/f62 x:0 0 0 2024-09-13T17:05:44.978 INFO:tasks.workunit.client.1.smithi195.stdout:1/242: mknod db/d19/d37/c56 0 2024-09-13T17:05:44.979 INFO:tasks.workunit.client.1.smithi195.stdout:1/243: symlink db/df/d4d/l57 0 2024-09-13T17:05:44.982 INFO:tasks.workunit.client.1.smithi195.stdout:6/218: dwrite d1c/f29 [0,4194304] 0 2024-09-13T17:05:44.983 INFO:tasks.workunit.client.1.smithi195.stdout:9/273: dwrite d6/f3f [0,4194304] 0 2024-09-13T17:05:44.983 INFO:tasks.workunit.client.1.smithi195.stdout:3/222: dwrite d7/d21/d2a/d35/f37 [0,4194304] 0 2024-09-13T17:05:44.983 INFO:tasks.workunit.client.1.smithi195.stdout:9/274: write d6/d19/f1f [3114312,40531] 0 2024-09-13T17:05:44.985 INFO:tasks.workunit.client.1.smithi195.stdout:3/223: unlink d7/f12 0 2024-09-13T17:05:44.987 INFO:tasks.workunit.client.1.smithi195.stdout:3/224: creat d7/d21/d2a/f3b x:0 0 0 2024-09-13T17:05:44.987 INFO:tasks.workunit.client.1.smithi195.stdout:3/225: dread - d7/f2d zero size 2024-09-13T17:05:44.987 INFO:tasks.workunit.client.1.smithi195.stdout:3/226: chown d7/d21/f27 11124 1 2024-09-13T17:05:44.987 INFO:tasks.workunit.client.1.smithi195.stdout:6/219: dread d1c/f23 [0,4194304] 0 2024-09-13T17:05:44.988 INFO:tasks.workunit.client.1.smithi195.stdout:3/227: symlink d7/d21/l3c 0 2024-09-13T17:05:44.988 INFO:tasks.workunit.client.1.smithi195.stdout:3/228: getdents d7/d19/d1e 0 2024-09-13T17:05:44.992 INFO:tasks.workunit.client.1.smithi195.stdout:7/303: dread d5/d35/f57 [0,4194304] 0 2024-09-13T17:05:44.992 INFO:tasks.workunit.client.1.smithi195.stdout:0/276: dwrite d7/d10/d46/f49 [0,4194304] 0 2024-09-13T17:05:44.992 INFO:tasks.workunit.client.1.smithi195.stdout:7/304: dread - d5/d35/d37/f52 zero size 2024-09-13T17:05:44.992 INFO:tasks.workunit.client.1.smithi195.stdout:0/277: getdents d7/db/d38/d4f 0 2024-09-13T17:05:44.992 INFO:tasks.workunit.client.1.smithi195.stdout:5/277: dwrite d2/f26 [0,4194304] 0 2024-09-13T17:05:44.993 INFO:tasks.workunit.client.1.smithi195.stdout:5/278: readlink d2/d3e/l53 0 2024-09-13T17:05:44.993 INFO:tasks.workunit.client.1.smithi195.stdout:2/289: dwrite d0/d3/f4 [0,4194304] 0 2024-09-13T17:05:44.993 INFO:tasks.workunit.client.1.smithi195.stdout:9/275: write d6/df/d13/d44/f49 [265629,72153] 0 2024-09-13T17:05:44.993 INFO:tasks.workunit.client.1.smithi195.stdout:8/291: dwrite d0/f8 [4194304,4194304] 0 2024-09-13T17:05:44.993 INFO:tasks.workunit.client.1.smithi195.stdout:8/292: stat d0/d13/d4d/f48 0 2024-09-13T17:05:44.993 INFO:tasks.workunit.client.0.smithi115.stdout:7/160: dwrite d0/f13 [0,4194304] 0 2024-09-13T17:05:44.994 INFO:tasks.workunit.client.0.smithi115.stdout:0/127: dwrite d9/fc [4194304,4194304] 0 2024-09-13T17:05:44.994 INFO:tasks.workunit.client.0.smithi115.stdout:1/139: dwrite d5/d7/f18 [0,4194304] 0 2024-09-13T17:05:44.994 INFO:tasks.workunit.client.0.smithi115.stdout:1/140: chown d5/d26/d2c 377 1 2024-09-13T17:05:44.994 INFO:tasks.workunit.client.0.smithi115.stdout:0/128: chown d9/f1f 10310518 1 2024-09-13T17:05:44.994 INFO:tasks.workunit.client.0.smithi115.stdout:1/141: fdatasync d5/fa 0 2024-09-13T17:05:44.995 INFO:tasks.workunit.client.0.smithi115.stdout:1/142: chown d5/f22 5952 1 2024-09-13T17:05:44.995 INFO:tasks.workunit.client.0.smithi115.stdout:1/143: readlink d5/l11 0 2024-09-13T17:05:44.995 INFO:tasks.workunit.client.0.smithi115.stdout:1/144: truncate d5/fa 4295625 0 2024-09-13T17:05:44.995 INFO:tasks.workunit.client.0.smithi115.stdout:4/270: dwrite d7/dd/de/f4a [0,4194304] 0 2024-09-13T17:05:44.996 INFO:tasks.workunit.client.1.smithi195.stdout:2/290: symlink d0/d3/l5d 0 2024-09-13T17:05:44.996 INFO:tasks.workunit.client.1.smithi195.stdout:2/291: read d0/d3/f26 [872904,86154] 0 2024-09-13T17:05:44.998 INFO:tasks.workunit.client.1.smithi195.stdout:4/315: dwrite f5 [0,4194304] 0 2024-09-13T17:05:45.000 INFO:tasks.workunit.client.0.smithi115.stdout:7/161: truncate d0/d2/df/f10 2595198 0 2024-09-13T17:05:45.001 INFO:tasks.workunit.client.1.smithi195.stdout:3/229: dread d7/f14 [0,4194304] 0 2024-09-13T17:05:45.001 INFO:tasks.workunit.client.1.smithi195.stdout:9/276: mkdir d6/df/d16/d5c 0 2024-09-13T17:05:45.001 INFO:tasks.workunit.client.1.smithi195.stdout:9/277: write d6/d12/f46 [525480,49970] 0 2024-09-13T17:05:45.003 INFO:tasks.workunit.client.1.smithi195.stdout:7/305: rmdir d5/d35/d37 39 2024-09-13T17:05:45.011 INFO:tasks.workunit.client.0.smithi115.stdout:0/129: unlink l6 0 2024-09-13T17:05:45.011 INFO:tasks.workunit.client.0.smithi115.stdout:0/130: chown l4 73854 1 2024-09-13T17:05:45.011 INFO:tasks.workunit.client.0.smithi115.stdout:0/131: dread - d9/fb zero size 2024-09-13T17:05:45.011 INFO:tasks.workunit.client.1.smithi195.stdout:7/306: dread d5/fa [0,4194304] 0 2024-09-13T17:05:45.013 INFO:tasks.workunit.client.0.smithi115.stdout:1/145: rmdir d5/d26/d2c 39 2024-09-13T17:05:45.013 INFO:tasks.workunit.client.1.smithi195.stdout:6/220: dwrite d1c/d28/d35/f39 [0,4194304] 0 2024-09-13T17:05:45.013 INFO:tasks.workunit.client.1.smithi195.stdout:6/221: creat d1c/d2d/f40 x:0 0 0 2024-09-13T17:05:45.013 INFO:tasks.workunit.client.1.smithi195.stdout:6/222: creat d1c/d28/f41 x:0 0 0 2024-09-13T17:05:45.013 INFO:tasks.workunit.client.1.smithi195.stdout:6/223: chown ca 15 1 2024-09-13T17:05:45.014 INFO:tasks.workunit.client.1.smithi195.stdout:8/293: getdents d0/d17/d49 0 2024-09-13T17:05:45.017 INFO:tasks.workunit.client.1.smithi195.stdout:3/230: truncate d7/f14 4141915 0 2024-09-13T17:05:45.017 INFO:tasks.workunit.client.1.smithi195.stdout:3/231: chown d7/d21/c30 1350 1 2024-09-13T17:05:45.017 INFO:tasks.workunit.client.1.smithi195.stdout:3/232: write d7/d21/d2a/f3b [257851,35885] 0 2024-09-13T17:05:45.017 INFO:tasks.workunit.client.1.smithi195.stdout:7/307: dread d5/db/d19/d22/f5d [0,4194304] 0 2024-09-13T17:05:45.017 INFO:tasks.workunit.client.1.smithi195.stdout:7/308: readlink d5/db/d19/d22/l4d 0 2024-09-13T17:05:45.017 INFO:tasks.workunit.client.1.smithi195.stdout:7/309: creat d5/d13/d24/f63 x:0 0 0 2024-09-13T17:05:45.019 INFO:tasks.workunit.client.1.smithi195.stdout:9/278: rename d6/df/d16/f32 to d6/df/d13/d44/f5d 0 2024-09-13T17:05:45.020 INFO:tasks.workunit.client.1.smithi195.stdout:9/279: dread - d6/d19/d21/d5b/f50 zero size 2024-09-13T17:05:45.020 INFO:tasks.workunit.client.1.smithi195.stdout:9/280: fsync d6/d19/f4c 0 2024-09-13T17:05:45.020 INFO:tasks.workunit.client.1.smithi195.stdout:8/294: dread d0/f3 [0,4194304] 0 2024-09-13T17:05:45.021 INFO:tasks.workunit.client.0.smithi115.stdout:0/132: write d9/f18 [1235520,102931] 0 2024-09-13T17:05:45.021 INFO:tasks.workunit.client.0.smithi115.stdout:0/133: chown d9/f16 484446907 1 2024-09-13T17:05:45.021 INFO:tasks.workunit.client.1.smithi195.stdout:5/279: dwrite d2/d12/d4e/d10/f4a [4194304,4194304] 0 2024-09-13T17:05:45.023 INFO:tasks.workunit.client.1.smithi195.stdout:2/292: dwrite d0/d4a/d1c/d1e/f25 [4194304,4194304] 0 2024-09-13T17:05:45.024 INFO:tasks.workunit.client.1.smithi195.stdout:4/316: dwrite d1a/d1f/d43/f3d [4194304,4194304] 0 2024-09-13T17:05:45.024 INFO:tasks.workunit.client.1.smithi195.stdout:4/317: write d1a/d1f/d43/d24/d41/f5d [3069386,5947] 0 2024-09-13T17:05:45.026 INFO:tasks.workunit.client.0.smithi115.stdout:4/271: mknod d7/dd/de/d4e/c51 0 2024-09-13T17:05:45.028 INFO:tasks.workunit.client.0.smithi115.stdout:7/162: mkdir d0/d3b 0 2024-09-13T17:05:45.028 INFO:tasks.workunit.client.0.smithi115.stdout:7/163: fdatasync d0/d2/f1a 0 2024-09-13T17:05:45.029 INFO:tasks.workunit.client.1.smithi195.stdout:9/281: dread d6/d12/f2b [0,4194304] 0 2024-09-13T17:05:45.030 INFO:tasks.workunit.client.0.smithi115.stdout:1/146: mknod d5/d7/d33/c34 0 2024-09-13T17:05:45.033 INFO:tasks.workunit.client.0.smithi115.stdout:0/134: mkdir d9/d1d/d24 0 2024-09-13T17:05:45.034 INFO:tasks.workunit.client.1.smithi195.stdout:5/280: dread d2/d3e/f3a [0,4194304] 0 2024-09-13T17:05:45.034 INFO:tasks.workunit.client.0.smithi115.stdout:4/272: mknod d7/dd/c52 0 2024-09-13T17:05:45.038 INFO:tasks.workunit.client.1.smithi195.stdout:4/318: dwrite d1a/d1f/d43/d24/d41/f47 [0,4194304] 0 2024-09-13T17:05:45.039 INFO:tasks.workunit.client.1.smithi195.stdout:4/319: truncate d1a/d1f/d43/d5a/f5f 157267 0 2024-09-13T17:05:45.039 INFO:tasks.workunit.client.0.smithi115.stdout:0/135: creat d9/d1d/d24/f25 x:0 0 0 2024-09-13T17:05:45.039 INFO:tasks.workunit.client.0.smithi115.stdout:0/136: dread - d9/d1d/d24/f25 zero size 2024-09-13T17:05:45.039 INFO:tasks.workunit.client.0.smithi115.stdout:0/137: chown d9 42177 1 2024-09-13T17:05:45.041 INFO:tasks.workunit.client.1.smithi195.stdout:4/320: dread d1a/d1f/d21/d22/f28 [0,4194304] 0 2024-09-13T17:05:45.043 INFO:tasks.workunit.client.0.smithi115.stdout:4/273: mkdir d7/dd/de/d4b/d4f/d53 0 2024-09-13T17:05:45.052 INFO:tasks.workunit.client.1.smithi195.stdout:4/321: dread d1a/d1f/d21/d22/f5b [0,4194304] 0 2024-09-13T17:05:45.053 INFO:tasks.workunit.client.0.smithi115.stdout:0/138: read f0 [5928441,114099] 0 2024-09-13T17:05:45.053 INFO:tasks.workunit.client.0.smithi115.stdout:0/139: truncate d9/d1b/f23 805729 0 2024-09-13T17:05:45.053 INFO:tasks.workunit.client.0.smithi115.stdout:7/164: rename d0/c5 to d0/d2/d1e/c3c 0 2024-09-13T17:05:45.053 INFO:tasks.workunit.client.1.smithi195.stdout:3/233: rename d7/d21/d2a/d35/f38 to d7/d21/d2a/d35/f3d 0 2024-09-13T17:05:45.053 INFO:tasks.workunit.client.0.smithi115.stdout:0/140: chown d9/c11 136963497 1 2024-09-13T17:05:45.057 INFO:tasks.workunit.client.1.smithi195.stdout:4/322: dread d1a/d1f/d21/d36/f46 [0,4194304] 0 2024-09-13T17:05:45.057 INFO:tasks.workunit.client.1.smithi195.stdout:7/310: mknod d5/db/d19/d22/d3c/c64 0 2024-09-13T17:05:45.057 INFO:tasks.workunit.client.1.smithi195.stdout:7/311: truncate d5/d13/d24/f3f 779343 0 2024-09-13T17:05:45.057 INFO:tasks.workunit.client.1.smithi195.stdout:7/312: fsync d5/d13/f40 0 2024-09-13T17:05:45.057 INFO:tasks.workunit.client.1.smithi195.stdout:9/282: dwrite d6/df/d13/d44/f49 [0,4194304] 0 2024-09-13T17:05:45.058 INFO:tasks.workunit.client.1.smithi195.stdout:5/281: dwrite d2/df/f42 [0,4194304] 0 2024-09-13T17:05:45.059 INFO:tasks.workunit.client.1.smithi195.stdout:6/224: rename l5 to d1c/d3e/l42 0 2024-09-13T17:05:45.059 INFO:tasks.workunit.client.1.smithi195.stdout:6/225: write d1c/d24/f38 [700476,17078] 0 2024-09-13T17:05:45.059 INFO:tasks.workunit.client.1.smithi195.stdout:9/283: write d6/df/d13/d44/f5d [45738,127951] 0 2024-09-13T17:05:45.060 INFO:tasks.workunit.client.1.smithi195.stdout:9/284: dread - d6/d19/d21/d5b/f50 zero size 2024-09-13T17:05:45.061 INFO:tasks.workunit.client.0.smithi115.stdout:0/141: getdents d9 0 2024-09-13T17:05:45.061 INFO:tasks.workunit.client.0.smithi115.stdout:0/142: chown d9/f12 1759 1 2024-09-13T17:05:45.061 INFO:tasks.workunit.client.0.smithi115.stdout:0/143: readlink d9/l1e 0 2024-09-13T17:05:45.062 INFO:tasks.workunit.client.0.smithi115.stdout:0/144: dread d9/f16 [0,4194304] 0 2024-09-13T17:05:45.063 INFO:tasks.workunit.client.1.smithi195.stdout:2/293: creat d0/d4a/d1c/d2c/d43/f5e x:0 0 0 2024-09-13T17:05:45.063 INFO:tasks.workunit.client.1.smithi195.stdout:9/285: dread d6/f25 [0,4194304] 0 2024-09-13T17:05:45.065 INFO:tasks.workunit.client.0.smithi115.stdout:0/145: truncate d9/f16 192894 0 2024-09-13T17:05:45.065 INFO:tasks.workunit.client.0.smithi115.stdout:4/274: dwrite d7/dd/d3c/f3e [0,4194304] 0 2024-09-13T17:05:45.065 INFO:tasks.workunit.client.1.smithi195.stdout:5/282: write d2/df/d39/f49 [12838,17834] 0 2024-09-13T17:05:45.065 INFO:tasks.workunit.client.1.smithi195.stdout:5/283: write d2/d3e/d32/f33 [2949352,3514] 0 2024-09-13T17:05:45.066 INFO:tasks.workunit.client.0.smithi115.stdout:0/146: mkdir d9/d1d/d24/d26 0 2024-09-13T17:05:45.067 INFO:tasks.workunit.client.0.smithi115.stdout:0/147: fsync f0 0 2024-09-13T17:05:45.069 INFO:tasks.workunit.client.0.smithi115.stdout:5/186: sync 2024-09-13T17:05:45.069 INFO:tasks.workunit.client.1.smithi195.stdout:3/234: mknod d7/d19/d1e/c3e 0 2024-09-13T17:05:45.070 INFO:tasks.workunit.client.0.smithi115.stdout:7/165: getdents d0/d2/d1e 0 2024-09-13T17:05:45.072 INFO:tasks.workunit.client.1.smithi195.stdout:4/323: mknod d1a/d1f/d43/c6c 0 2024-09-13T17:05:45.074 INFO:tasks.workunit.client.1.smithi195.stdout:7/313: creat d5/d35/d37/f65 x:0 0 0 2024-09-13T17:05:45.074 INFO:tasks.workunit.client.1.smithi195.stdout:7/314: write d5/db/d19/d22/f62 [175164,126058] 0 2024-09-13T17:05:45.077 INFO:tasks.workunit.client.0.smithi115.stdout:4/275: rename l2 to d7/dd/de/d4b/d4f/d53/l54 0 2024-09-13T17:05:45.078 INFO:tasks.workunit.client.0.smithi115.stdout:0/148: mkdir d9/d27 0 2024-09-13T17:05:45.081 INFO:tasks.workunit.client.0.smithi115.stdout:5/187: symlink d19/l46 0 2024-09-13T17:05:45.081 INFO:tasks.workunit.client.0.smithi115.stdout:5/188: truncate f3 1170620 0 2024-09-13T17:05:45.082 INFO:tasks.workunit.client.0.smithi115.stdout:7/166: mkdir d0/d2/d1e/d3d 0 2024-09-13T17:05:45.084 INFO:tasks.workunit.client.0.smithi115.stdout:4/276: write f5 [3061890,77267] 0 2024-09-13T17:05:45.085 INFO:tasks.workunit.client.0.smithi115.stdout:5/189: symlink d19/d21/l47 0 2024-09-13T17:05:45.086 INFO:tasks.workunit.client.1.smithi195.stdout:2/294: link d0/d3/l8 d0/d4a/d1c/d2c/l5f 0 2024-09-13T17:05:45.087 INFO:tasks.workunit.client.0.smithi115.stdout:7/167: creat d0/f3e x:0 0 0 2024-09-13T17:05:45.088 INFO:tasks.workunit.client.0.smithi115.stdout:0/149: write d9/fd [3688531,128375] 0 2024-09-13T17:05:45.088 INFO:tasks.workunit.client.0.smithi115.stdout:0/150: truncate d9/d1b/f21 396806 0 2024-09-13T17:05:45.089 INFO:tasks.workunit.client.0.smithi115.stdout:5/190: link d19/l1b d19/d2b/d32/l48 0 2024-09-13T17:05:45.089 INFO:tasks.workunit.client.0.smithi115.stdout:5/191: truncate d19/f3c 333594 0 2024-09-13T17:05:45.090 INFO:tasks.workunit.client.0.smithi115.stdout:5/192: truncate fe 1005683 0 2024-09-13T17:05:45.090 INFO:tasks.workunit.client.0.smithi115.stdout:5/193: chown f8 11 1 2024-09-13T17:05:45.090 INFO:tasks.workunit.client.1.smithi195.stdout:4/324: dwrite f13 [0,4194304] 0 2024-09-13T17:05:45.090 INFO:tasks.workunit.client.0.smithi115.stdout:4/277: fdatasync f5 0 2024-09-13T17:05:45.092 INFO:tasks.workunit.client.0.smithi115.stdout:0/151: mknod d9/d1d/d24/d26/c28 0 2024-09-13T17:05:45.092 INFO:tasks.workunit.client.0.smithi115.stdout:0/152: write f0 [4848670,122993] 0 2024-09-13T17:05:45.094 INFO:tasks.workunit.client.0.smithi115.stdout:5/194: rename d19/f25 to d19/d2b/f49 0 2024-09-13T17:05:45.094 INFO:tasks.workunit.client.0.smithi115.stdout:5/195: chown f3 8823 1 2024-09-13T17:05:45.096 INFO:tasks.workunit.client.0.smithi115.stdout:4/278: getdents d7/dd/de/d4b/d4f/d53 0 2024-09-13T17:05:45.098 INFO:tasks.workunit.client.0.smithi115.stdout:7/168: truncate d0/d2/d1e/f32 361668 0 2024-09-13T17:05:45.099 INFO:tasks.workunit.client.0.smithi115.stdout:5/196: creat d19/d21/f4a x:0 0 0 2024-09-13T17:05:45.100 INFO:tasks.workunit.client.1.smithi195.stdout:5/284: mkdir d2/df/d39/d54/d58 0 2024-09-13T17:05:45.101 INFO:tasks.workunit.client.0.smithi115.stdout:4/279: truncate d7/fc 557199 0 2024-09-13T17:05:45.101 INFO:tasks.workunit.client.0.smithi115.stdout:4/280: stat d7/dd/c52 0 2024-09-13T17:05:45.102 INFO:tasks.workunit.client.1.smithi195.stdout:3/235: creat d7/d19/d1e/f3f x:0 0 0 2024-09-13T17:05:45.103 INFO:tasks.workunit.client.1.smithi195.stdout:3/236: fdatasync d7/d21/d2a/f32 0 2024-09-13T17:05:45.104 INFO:tasks.workunit.client.0.smithi115.stdout:7/169: symlink d0/d2/l3f 0 2024-09-13T17:05:45.105 INFO:tasks.workunit.client.1.smithi195.stdout:7/315: symlink d5/d13/d24/l66 0 2024-09-13T17:05:45.107 INFO:tasks.workunit.client.1.smithi195.stdout:6/226: getdents d1c/d2d/d30 0 2024-09-13T17:05:45.108 INFO:tasks.workunit.client.0.smithi115.stdout:7/170: unlink d0/d18/c24 0 2024-09-13T17:05:45.109 INFO:tasks.workunit.client.1.smithi195.stdout:2/295: mknod d0/d3/df/c60 0 2024-09-13T17:05:45.117 INFO:tasks.workunit.client.1.smithi195.stdout:4/325: truncate d1a/d1f/d21/d36/f46 806581 0 2024-09-13T17:05:45.118 INFO:tasks.workunit.client.1.smithi195.stdout:5/285: creat d2/df/d39/d54/d58/f59 x:0 0 0 2024-09-13T17:05:45.118 INFO:tasks.workunit.client.1.smithi195.stdout:7/316: mknod d5/d35/c67 0 2024-09-13T17:05:45.118 INFO:tasks.workunit.client.1.smithi195.stdout:7/317: stat d5/d35/d37 0 2024-09-13T17:05:45.119 INFO:tasks.workunit.client.1.smithi195.stdout:7/318: readlink d5/db/d19/d22/l4d 0 2024-09-13T17:05:45.119 INFO:tasks.workunit.client.1.smithi195.stdout:6/227: rmdir d1c 39 2024-09-13T17:05:45.119 INFO:tasks.workunit.client.1.smithi195.stdout:6/228: chown d1c/c20 0 1 2024-09-13T17:05:45.120 INFO:tasks.workunit.client.1.smithi195.stdout:6/229: fdatasync d1c/d24/f38 0 2024-09-13T17:05:45.120 INFO:tasks.workunit.client.1.smithi195.stdout:6/230: fdatasync f17 0 2024-09-13T17:05:45.120 INFO:tasks.workunit.client.1.smithi195.stdout:6/231: write d1c/d28/f3f [330487,83537] 0 2024-09-13T17:05:45.120 INFO:tasks.workunit.client.1.smithi195.stdout:4/326: rename d1a/d1f/d21/l5e to d1a/d1f/d43/d5a/d63/l6d 0 2024-09-13T17:05:45.121 INFO:tasks.workunit.client.1.smithi195.stdout:5/286: mkdir d2/df/d48/d5a 0 2024-09-13T17:05:45.122 INFO:tasks.workunit.client.0.smithi115.stdout:0/153: dwrite d9/fc [0,4194304] 0 2024-09-13T17:05:45.122 INFO:tasks.workunit.client.1.smithi195.stdout:6/232: unlink f18 0 2024-09-13T17:05:45.123 INFO:tasks.workunit.client.0.smithi115.stdout:7/171: dread d0/d2/f1a [0,4194304] 0 2024-09-13T17:05:45.126 INFO:tasks.workunit.client.1.smithi195.stdout:4/327: mkdir d1a/d1f/d43/d5a/d63/d6e 0 2024-09-13T17:05:45.126 INFO:tasks.workunit.client.0.smithi115.stdout:0/154: mknod d9/d1d/d24/c29 0 2024-09-13T17:05:45.127 INFO:tasks.workunit.client.0.smithi115.stdout:0/155: write d9/fb [524039,130367] 0 2024-09-13T17:05:45.127 INFO:tasks.workunit.client.1.smithi195.stdout:3/237: dwrite d7/d21/f26 [0,4194304] 0 2024-09-13T17:05:45.127 INFO:tasks.workunit.client.1.smithi195.stdout:3/238: fsync d7/d19/f22 0 2024-09-13T17:05:45.128 INFO:tasks.workunit.client.1.smithi195.stdout:5/287: getdents d2/df/d39/d54 0 2024-09-13T17:05:45.128 INFO:tasks.workunit.client.1.smithi195.stdout:5/288: chown d2/d3e/f3a 6213318 1 2024-09-13T17:05:45.132 INFO:tasks.workunit.client.1.smithi195.stdout:6/233: symlink d1c/d2d/l43 0 2024-09-13T17:05:45.133 INFO:tasks.workunit.client.0.smithi115.stdout:7/172: getdents d0/d2/d1e 0 2024-09-13T17:05:45.133 INFO:tasks.workunit.client.0.smithi115.stdout:7/173: chown d0/d3b 1 1 2024-09-13T17:05:45.135 INFO:tasks.workunit.client.1.smithi195.stdout:4/328: unlink c3 0 2024-09-13T17:05:45.136 INFO:tasks.workunit.client.1.smithi195.stdout:4/329: fdatasync d1a/d1f/d43/d24/d41/f4b 0 2024-09-13T17:05:45.136 INFO:tasks.workunit.client.1.smithi195.stdout:0/278: sync 2024-09-13T17:05:45.136 INFO:tasks.workunit.client.1.smithi195.stdout:1/244: sync 2024-09-13T17:05:45.137 INFO:tasks.workunit.client.1.smithi195.stdout:0/279: write d7/d8/d23/f4a [526623,14289] 0 2024-09-13T17:05:45.137 INFO:tasks.workunit.client.1.smithi195.stdout:4/330: dread d1a/f4a [0,4194304] 0 2024-09-13T17:05:45.138 INFO:tasks.workunit.client.1.smithi195.stdout:1/245: mkdir db/d58 0 2024-09-13T17:05:45.140 INFO:tasks.workunit.client.0.smithi115.stdout:0/156: write d9/fc [4375596,24532] 0 2024-09-13T17:05:45.140 INFO:tasks.workunit.client.0.smithi115.stdout:4/281: dwrite d7/f31 [0,4194304] 0 2024-09-13T17:05:45.140 INFO:tasks.workunit.client.0.smithi115.stdout:4/282: readlink d7/dd/de/l39 0 2024-09-13T17:05:45.140 INFO:tasks.workunit.client.0.smithi115.stdout:0/157: chown d9/d1d/d24/d26/c28 3036489 1 2024-09-13T17:05:45.140 INFO:tasks.workunit.client.0.smithi115.stdout:4/283: write d7/f36 [193830,95968] 0 2024-09-13T17:05:45.141 INFO:tasks.workunit.client.1.smithi195.stdout:0/280: truncate d7/d50/f1c 777370 0 2024-09-13T17:05:45.141 INFO:tasks.workunit.client.1.smithi195.stdout:6/234: mknod d1c/c44 0 2024-09-13T17:05:45.147 INFO:tasks.workunit.client.1.smithi195.stdout:1/246: symlink db/d19/d37/l59 0 2024-09-13T17:05:45.147 INFO:tasks.workunit.client.1.smithi195.stdout:4/331: mkdir d1a/d1f/d43/d24/d41/d60/d6f 0 2024-09-13T17:05:45.150 INFO:tasks.workunit.client.1.smithi195.stdout:0/281: creat d7/d50/f52 x:0 0 0 2024-09-13T17:05:45.151 INFO:tasks.workunit.client.1.smithi195.stdout:1/247: mkdir db/d19/d5a 0 2024-09-13T17:05:45.153 INFO:tasks.workunit.client.1.smithi195.stdout:0/282: creat d7/f53 x:0 0 0 2024-09-13T17:05:45.156 INFO:tasks.workunit.client.0.smithi115.stdout:5/197: dwrite d19/d2b/f49 [0,4194304] 0 2024-09-13T17:05:45.160 INFO:tasks.workunit.client.0.smithi115.stdout:5/198: rmdir d19/d3d 0 2024-09-13T17:05:45.160 INFO:tasks.workunit.client.0.smithi115.stdout:5/199: dread - d19/d21/f4a zero size 2024-09-13T17:05:45.178 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:44 smithi115 ceph-mon[27708]: pgmap v11: 65 pgs: 65 active+clean; 665 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 45 MiB/s rd, 68 MiB/s wr, 549 op/s 2024-09-13T17:05:45.180 INFO:tasks.workunit.client.1.smithi195.stdout:2/296: dwrite d0/d3/f5c [0,4194304] 0 2024-09-13T17:05:45.181 INFO:tasks.workunit.client.1.smithi195.stdout:2/297: mknod d0/d3/c61 0 2024-09-13T17:05:45.182 INFO:tasks.workunit.client.1.smithi195.stdout:2/298: mkdir d0/d4a/d1c/d62 0 2024-09-13T17:05:45.185 INFO:tasks.workunit.client.0.smithi115.stdout:8/197: sync 2024-09-13T17:05:45.185 INFO:tasks.workunit.client.0.smithi115.stdout:8/198: read d0/f1d [4806931,2095] 0 2024-09-13T17:05:45.185 INFO:tasks.workunit.client.1.smithi195.stdout:2/299: dread d0/d3/f26 [0,4194304] 0 2024-09-13T17:05:45.186 INFO:tasks.workunit.client.0.smithi115.stdout:8/199: creat d0/d26/f35 x:0 0 0 2024-09-13T17:05:45.186 INFO:tasks.workunit.client.1.smithi195.stdout:2/300: truncate d0/d4a/d1c/d1e/f2a 4913786 0 2024-09-13T17:05:45.188 INFO:tasks.workunit.client.0.smithi115.stdout:8/200: creat d0/d18/d19/d2b/f36 x:0 0 0 2024-09-13T17:05:45.189 INFO:tasks.workunit.client.1.smithi195.stdout:0/283: dread d7/d8/d23/f27 [0,4194304] 0 2024-09-13T17:05:45.191 INFO:tasks.workunit.client.1.smithi195.stdout:0/284: symlink d7/d8/d23/d4b/l54 0 2024-09-13T17:05:45.193 INFO:tasks.workunit.client.1.smithi195.stdout:0/285: mknod d7/d50/c55 0 2024-09-13T17:05:45.193 INFO:tasks.workunit.client.1.smithi195.stdout:0/286: fsync d7/d50/f1b 0 2024-09-13T17:05:45.193 INFO:tasks.workunit.client.1.smithi195.stdout:0/287: write d7/db/d38/f3b [1151020,120176] 0 2024-09-13T17:05:45.195 INFO:tasks.workunit.client.1.smithi195.stdout:2/301: dread d0/d3/f4 [0,4194304] 0 2024-09-13T17:05:45.195 INFO:tasks.workunit.client.1.smithi195.stdout:2/302: readlink d0/d4a/l5a 0 2024-09-13T17:05:45.196 INFO:tasks.workunit.client.1.smithi195.stdout:2/303: write d0/f48 [2200079,123173] 0 2024-09-13T17:05:45.196 INFO:tasks.workunit.client.1.smithi195.stdout:0/288: rename d7/d10 to d7/d8/d23/d4b/d56 0 2024-09-13T17:05:45.196 INFO:tasks.workunit.client.1.smithi195.stdout:0/289: creat d7/db/d38/f57 x:0 0 0 2024-09-13T17:05:45.198 INFO:tasks.workunit.client.1.smithi195.stdout:0/290: creat d7/d8/d23/d4b/d56/f58 x:0 0 0 2024-09-13T17:05:45.210 INFO:tasks.workunit.client.0.smithi115.stdout:9/142: sync 2024-09-13T17:05:45.211 INFO:tasks.workunit.client.0.smithi115.stdout:3/388: sync 2024-09-13T17:05:45.211 INFO:tasks.workunit.client.0.smithi115.stdout:3/389: chown d1/d12/l66 11102419 1 2024-09-13T17:05:45.211 INFO:tasks.workunit.client.0.smithi115.stdout:7/174: dwrite d0/d2/df/d21/f33 [4194304,4194304] 0 2024-09-13T17:05:45.212 INFO:tasks.workunit.client.0.smithi115.stdout:3/390: write d1/f9 [2067830,114224] 0 2024-09-13T17:05:45.213 INFO:tasks.workunit.client.1.smithi195.stdout:5/289: dwrite d2/d12/d4e/d10/f23 [0,4194304] 0 2024-09-13T17:05:45.214 INFO:tasks.workunit.client.1.smithi195.stdout:6/235: dwrite d1c/d2d/f32 [0,4194304] 0 2024-09-13T17:05:45.214 INFO:tasks.workunit.client.1.smithi195.stdout:6/236: creat d1c/d28/d35/f45 x:0 0 0 2024-09-13T17:05:45.214 INFO:tasks.workunit.client.0.smithi115.stdout:7/175: mknod d0/d2/df/d21/d2f/c40 0 2024-09-13T17:05:45.216 INFO:tasks.workunit.client.0.smithi115.stdout:3/391: creat d1/d4b/d1a/d30/f82 x:0 0 0 2024-09-13T17:05:45.217 INFO:tasks.workunit.client.1.smithi195.stdout:5/290: creat d2/d12/d4e/f5b x:0 0 0 2024-09-13T17:05:45.217 INFO:tasks.workunit.client.1.smithi195.stdout:5/291: dread - d2/df/d39/f4f zero size 2024-09-13T17:05:45.217 INFO:tasks.workunit.client.1.smithi195.stdout:5/292: fsync d2/df/fa 0 2024-09-13T17:05:45.219 INFO:tasks.workunit.client.0.smithi115.stdout:0/158: dwrite d9/d1d/d24/f25 [0,4194304] 0 2024-09-13T17:05:45.220 INFO:tasks.workunit.client.0.smithi115.stdout:8/201: dwrite d0/fb [4194304,4194304] 0 2024-09-13T17:05:45.220 INFO:tasks.workunit.client.0.smithi115.stdout:8/202: read - d0/d18/f2e zero size 2024-09-13T17:05:45.220 INFO:tasks.workunit.client.0.smithi115.stdout:8/203: chown d0/d18/d19/d28 392649500 1 2024-09-13T17:05:45.220 INFO:tasks.workunit.client.0.smithi115.stdout:8/204: chown d0/d26/d29/f2a 11 1 2024-09-13T17:05:45.220 INFO:tasks.workunit.client.0.smithi115.stdout:4/284: dwrite d7/f35 [0,4194304] 0 2024-09-13T17:05:45.220 INFO:tasks.workunit.client.0.smithi115.stdout:4/285: dread - d7/dd/de/f43 zero size 2024-09-13T17:05:45.221 INFO:tasks.workunit.client.0.smithi115.stdout:4/286: chown f3 7664775 1 2024-09-13T17:05:45.221 INFO:tasks.workunit.client.0.smithi115.stdout:4/287: write d7/dd/f37 [288680,58663] 0 2024-09-13T17:05:45.222 INFO:tasks.workunit.client.1.smithi195.stdout:0/291: dwrite f6 [0,4194304] 0 2024-09-13T17:05:45.222 INFO:tasks.workunit.client.1.smithi195.stdout:4/332: dwrite d1a/d1f/d43/f66 [0,4194304] 0 2024-09-13T17:05:45.222 INFO:tasks.workunit.client.1.smithi195.stdout:3/239: dwrite d7/f2d [0,4194304] 0 2024-09-13T17:05:45.223 INFO:tasks.workunit.client.1.smithi195.stdout:3/240: chown d7/f14 0 1 2024-09-13T17:05:45.223 INFO:tasks.workunit.client.1.smithi195.stdout:2/304: dwrite d0/d4a/d1c/f23 [0,4194304] 0 2024-09-13T17:05:45.223 INFO:tasks.workunit.client.1.smithi195.stdout:1/248: dwrite db/d19/d37/d3e/f43 [0,4194304] 0 2024-09-13T17:05:45.223 INFO:tasks.workunit.client.1.smithi195.stdout:1/249: chown l8 1504859 1 2024-09-13T17:05:45.223 INFO:tasks.workunit.client.1.smithi195.stdout:1/250: truncate db/df/d13/f22 1001539 0 2024-09-13T17:05:45.223 INFO:tasks.workunit.client.1.smithi195.stdout:0/292: write d7/db/d38/f3b [935719,103376] 0 2024-09-13T17:05:45.223 INFO:tasks.workunit.client.1.smithi195.stdout:0/293: write d7/d50/f30 [566346,18989] 0 2024-09-13T17:05:45.223 INFO:tasks.workunit.client.1.smithi195.stdout:0/294: read - d7/d50/f4c zero size 2024-09-13T17:05:45.223 INFO:tasks.workunit.client.1.smithi195.stdout:0/295: chown f6 115 1 2024-09-13T17:05:45.223 INFO:tasks.workunit.client.1.smithi195.stdout:0/296: readlink d7/d8/d23/d4b/l54 0 2024-09-13T17:05:45.223 INFO:tasks.workunit.client.1.smithi195.stdout:0/297: chown d7/ca 3307700 1 2024-09-13T17:05:45.225 INFO:tasks.workunit.client.1.smithi195.stdout:6/237: mkdir d1c/d28/d46 0 2024-09-13T17:05:45.226 INFO:tasks.workunit.client.0.smithi115.stdout:9/143: dread d0/f3 [0,4194304] 0 2024-09-13T17:05:45.226 INFO:tasks.workunit.client.0.smithi115.stdout:5/200: dwrite d19/f37 [0,4194304] 0 2024-09-13T17:05:45.228 INFO:tasks.workunit.client.1.smithi195.stdout:2/305: dread d0/d3/df/f20 [4194304,4194304] 0 2024-09-13T17:05:45.230 INFO:tasks.workunit.client.1.smithi195.stdout:4/333: creat d1a/d1f/d43/d24/d41/f70 x:0 0 0 2024-09-13T17:05:45.230 INFO:tasks.workunit.client.1.smithi195.stdout:4/334: write d1a/d1f/d21/d36/f46 [870561,99190] 0 2024-09-13T17:05:45.231 INFO:tasks.workunit.client.0.smithi115.stdout:7/176: rmdir d0 39 2024-09-13T17:05:45.232 INFO:tasks.workunit.client.1.smithi195.stdout:3/241: link d7/d19/l25 d7/d21/d2a/l40 0 2024-09-13T17:05:45.232 INFO:tasks.workunit.client.1.smithi195.stdout:3/242: chown d7/d19/d1e 45610809 1 2024-09-13T17:05:45.234 INFO:tasks.workunit.client.0.smithi115.stdout:3/392: dread d1/f1d [0,4194304] 0 2024-09-13T17:05:45.234 INFO:tasks.workunit.client.0.smithi115.stdout:3/393: dread - d1/d4b/d1a/d30/f82 zero size 2024-09-13T17:05:45.236 INFO:tasks.workunit.client.0.smithi115.stdout:0/159: mknod d9/d1d/d24/c2a 0 2024-09-13T17:05:45.240 INFO:tasks.workunit.client.0.smithi115.stdout:8/205: rename d0/d21/d34 to d0/d18/d19/d2b/d37 0 2024-09-13T17:05:45.240 INFO:tasks.workunit.client.0.smithi115.stdout:8/206: creat d0/d26/d29/f38 x:0 0 0 2024-09-13T17:05:45.240 INFO:tasks.workunit.client.0.smithi115.stdout:8/207: write d0/d15/f2f [342724,32977] 0 2024-09-13T17:05:45.242 INFO:tasks.workunit.client.0.smithi115.stdout:4/288: symlink d7/dd/de/d4b/d4f/l55 0 2024-09-13T17:05:45.248 INFO:tasks.workunit.client.1.smithi195.stdout:5/293: dwrite d2/df/d39/f4f [0,4194304] 0 2024-09-13T17:05:45.248 INFO:tasks.workunit.client.1.smithi195.stdout:1/251: creat db/df/d13/f5b x:0 0 0 2024-09-13T17:05:45.249 INFO:tasks.workunit.client.0.smithi115.stdout:3/394: dread d1/d4b/f4d [0,4194304] 0 2024-09-13T17:05:45.249 INFO:tasks.workunit.client.0.smithi115.stdout:3/395: chown d1/d12/c65 1927544 1 2024-09-13T17:05:45.255 INFO:tasks.workunit.client.1.smithi195.stdout:0/298: link d7/d8/fe d7/d8/f59 0 2024-09-13T17:05:45.257 INFO:tasks.workunit.client.1.smithi195.stdout:6/238: link f19 d1c/d3e/f47 0 2024-09-13T17:05:45.257 INFO:tasks.workunit.client.1.smithi195.stdout:6/239: fdatasync d1c/d28/d35/f36 0 2024-09-13T17:05:45.257 INFO:tasks.workunit.client.1.smithi195.stdout:6/240: chown fd 2 1 2024-09-13T17:05:45.258 INFO:tasks.workunit.client.1.smithi195.stdout:2/306: dwrite d0/d3/fe [0,4194304] 0 2024-09-13T17:05:45.258 INFO:tasks.workunit.client.1.smithi195.stdout:3/243: dwrite d7/d21/d2a/d35/f3d [0,4194304] 0 2024-09-13T17:05:45.258 INFO:tasks.workunit.client.1.smithi195.stdout:3/244: fsync d7/d19/f22 0 2024-09-13T17:05:45.258 INFO:tasks.workunit.client.1.smithi195.stdout:3/245: write d7/f15 [4992419,8090] 0 2024-09-13T17:05:45.259 INFO:tasks.workunit.client.1.smithi195.stdout:9/286: sync 2024-09-13T17:05:45.259 INFO:tasks.workunit.client.1.smithi195.stdout:8/295: sync 2024-09-13T17:05:45.259 INFO:tasks.workunit.client.1.smithi195.stdout:8/296: truncate d0/d13/f5d 517720 0 2024-09-13T17:05:45.261 INFO:tasks.workunit.client.1.smithi195.stdout:0/299: dread d7/d50/f21 [0,4194304] 0 2024-09-13T17:05:45.261 INFO:tasks.workunit.client.1.smithi195.stdout:4/335: stat d1a/d1f/d43/d29/d58/l62 0 2024-09-13T17:05:45.264 INFO:tasks.workunit.client.1.smithi195.stdout:5/294: write d2/d3e/f35 [2823726,40880] 0 2024-09-13T17:05:45.264 INFO:tasks.workunit.client.1.smithi195.stdout:1/252: symlink db/df/d13/l5c 0 2024-09-13T17:05:45.267 INFO:tasks.workunit.client.1.smithi195.stdout:6/241: mknod d1c/d2d/c48 0 2024-09-13T17:05:45.270 INFO:tasks.workunit.client.1.smithi195.stdout:2/307: mkdir d0/d4a/d1c/d2c/d43/d63 0 2024-09-13T17:05:45.270 INFO:tasks.workunit.client.1.smithi195.stdout:2/308: chown d0/d4a/d1c/d2c/d51/l56 188 1 2024-09-13T17:05:45.270 INFO:tasks.workunit.client.0.smithi115.stdout:5/201: mknod d19/d2b/d40/d41/c4b 0 2024-09-13T17:05:45.273 INFO:tasks.workunit.client.0.smithi115.stdout:9/144: mknod d0/d21/c32 0 2024-09-13T17:05:45.273 INFO:tasks.workunit.client.0.smithi115.stdout:9/145: chown d0/de/f1e 324234 1 2024-09-13T17:05:45.273 INFO:tasks.workunit.client.0.smithi115.stdout:9/146: fsync d0/de/d10/d15/f24 0 2024-09-13T17:05:45.274 INFO:tasks.workunit.client.1.smithi195.stdout:7/319: sync 2024-09-13T17:05:45.274 INFO:tasks.workunit.client.1.smithi195.stdout:3/246: write d7/d21/d2a/d35/f3d [3467838,55340] 0 2024-09-13T17:05:45.274 INFO:tasks.workunit.client.0.smithi115.stdout:7/177: creat d0/d2/df/f41 x:0 0 0 2024-09-13T17:05:45.275 INFO:tasks.workunit.client.1.smithi195.stdout:0/300: truncate d7/d8/d23/f4a 26411 0 2024-09-13T17:05:45.278 INFO:tasks.workunit.client.1.smithi195.stdout:9/287: dread d6/f3f [0,4194304] 0 2024-09-13T17:05:45.279 INFO:tasks.workunit.client.1.smithi195.stdout:1/253: symlink db/l5d 0 2024-09-13T17:05:45.285 INFO:tasks.workunit.client.1.smithi195.stdout:2/309: rename d0/d3/df/f20 to d0/d4a/d1c/d2c/d43/f64 0 2024-09-13T17:05:45.285 INFO:tasks.workunit.client.1.smithi195.stdout:2/310: chown d0/d4a/d1c/d1e 73255080 1 2024-09-13T17:05:45.285 INFO:tasks.workunit.client.1.smithi195.stdout:7/320: symlink d5/l68 0 2024-09-13T17:05:45.285 INFO:tasks.workunit.client.1.smithi195.stdout:7/321: truncate d5/db/d19/d22/f62 341795 0 2024-09-13T17:05:45.285 INFO:tasks.workunit.client.1.smithi195.stdout:7/322: write d5/db/f2c [4776530,75683] 0 2024-09-13T17:05:45.286 INFO:tasks.workunit.client.1.smithi195.stdout:0/301: mknod d7/db/d38/d4f/c5a 0 2024-09-13T17:05:45.287 INFO:tasks.workunit.client.0.smithi115.stdout:8/208: creat d0/f39 x:0 0 0 2024-09-13T17:05:45.287 INFO:tasks.workunit.client.0.smithi115.stdout:8/209: chown d0/d18/f33 36507 1 2024-09-13T17:05:45.287 INFO:tasks.workunit.client.0.smithi115.stdout:8/210: fdatasync d0/d15/f1b 0 2024-09-13T17:05:45.289 INFO:tasks.workunit.client.1.smithi195.stdout:9/288: mkdir d6/df/d13/d44/d5e 0 2024-09-13T17:05:45.289 INFO:tasks.workunit.client.1.smithi195.stdout:9/289: chown d6/d12/f2a 15817 1 2024-09-13T17:05:45.289 INFO:tasks.workunit.client.1.smithi195.stdout:9/290: chown d6/d12/f2a 3506169 1 2024-09-13T17:05:45.289 INFO:tasks.workunit.client.1.smithi195.stdout:9/291: write d6/df/f3c [196433,63048] 0 2024-09-13T17:05:45.289 INFO:tasks.workunit.client.1.smithi195.stdout:9/292: write d6/d19/d21/d45/f5a [51881,115174] 0 2024-09-13T17:05:45.290 INFO:tasks.workunit.client.0.smithi115.stdout:4/289: creat d7/dd/de/d4b/f56 x:0 0 0 2024-09-13T17:05:45.290 INFO:tasks.workunit.client.0.smithi115.stdout:4/290: fsync d7/dd/f2b 0 2024-09-13T17:05:45.290 INFO:tasks.workunit.client.1.smithi195.stdout:8/297: dwrite d0/d17/f56 [0,4194304] 0 2024-09-13T17:05:45.290 INFO:tasks.workunit.client.1.smithi195.stdout:8/298: fsync d0/d17/d2f/d31/f3f 0 2024-09-13T17:05:45.292 INFO:tasks.workunit.client.0.smithi115.stdout:3/396: mkdir d1/d83 0 2024-09-13T17:05:45.293 INFO:tasks.workunit.client.1.smithi195.stdout:0/302: creat d7/d8/d23/d4b/d4e/f5b x:0 0 0 2024-09-13T17:05:45.293 INFO:tasks.workunit.client.1.smithi195.stdout:0/303: creat d7/d50/f5c x:0 0 0 2024-09-13T17:05:45.295 INFO:tasks.workunit.client.1.smithi195.stdout:4/336: dwrite f7 [0,4194304] 0 2024-09-13T17:05:45.295 INFO:tasks.workunit.client.1.smithi195.stdout:9/293: unlink d6/cc 0 2024-09-13T17:05:45.296 INFO:tasks.workunit.client.1.smithi195.stdout:9/294: fsync d6/d12/d4b/f53 0 2024-09-13T17:05:45.296 INFO:tasks.workunit.client.1.smithi195.stdout:9/295: write d6/d12/f4d [230814,37216] 0 2024-09-13T17:05:45.298 INFO:tasks.workunit.client.1.smithi195.stdout:5/295: dwrite d2/df/d39/f44 [0,4194304] 0 2024-09-13T17:05:45.299 INFO:tasks.workunit.client.0.smithi115.stdout:9/147: mknod d0/de/d10/c33 0 2024-09-13T17:05:45.299 INFO:tasks.workunit.client.0.smithi115.stdout:9/148: chown d0/de/f2d 15654848 1 2024-09-13T17:05:45.301 INFO:tasks.workunit.client.1.smithi195.stdout:3/247: rename d7/d19/d1e/c2f to d7/c41 0 2024-09-13T17:05:45.301 INFO:tasks.workunit.client.1.smithi195.stdout:3/248: fsync d7/f14 0 2024-09-13T17:05:45.301 INFO:tasks.workunit.client.1.smithi195.stdout:3/249: truncate d7/d21/d2a/f32 1022242 0 2024-09-13T17:05:45.302 INFO:tasks.workunit.client.0.smithi115.stdout:0/160: getdents d9/d1b 0 2024-09-13T17:05:45.302 INFO:tasks.workunit.client.0.smithi115.stdout:0/161: chown d9/d27 197987946 1 2024-09-13T17:05:45.302 INFO:tasks.workunit.client.0.smithi115.stdout:0/162: fdatasync d9/d1b/f21 0 2024-09-13T17:05:45.302 INFO:tasks.workunit.client.0.smithi115.stdout:4/291: dread d7/f31 [0,4194304] 0 2024-09-13T17:05:45.302 INFO:tasks.workunit.client.0.smithi115.stdout:4/292: stat d7/dd/de/d4e 0 2024-09-13T17:05:45.305 INFO:tasks.workunit.client.0.smithi115.stdout:8/211: mkdir d0/d21/d3a 0 2024-09-13T17:05:45.305 INFO:tasks.workunit.client.0.smithi115.stdout:8/212: write d0/d26/d29/f2a [120446,75712] 0 2024-09-13T17:05:45.306 INFO:tasks.workunit.client.0.smithi115.stdout:7/178: dwrite d0/d18/f30 [0,4194304] 0 2024-09-13T17:05:45.306 INFO:tasks.workunit.client.0.smithi115.stdout:7/179: getdents d0/d3b 0 2024-09-13T17:05:45.306 INFO:tasks.workunit.client.1.smithi195.stdout:0/304: mkdir d7/db/d38/d5d 0 2024-09-13T17:05:45.307 INFO:tasks.workunit.client.0.smithi115.stdout:4/293: write d7/f2e [2792468,75473] 0 2024-09-13T17:05:45.307 INFO:tasks.workunit.client.0.smithi115.stdout:4/294: stat d7/dd/de/d4e/c51 0 2024-09-13T17:05:45.309 INFO:tasks.workunit.client.0.smithi115.stdout:2/308: sync 2024-09-13T17:05:45.309 INFO:tasks.workunit.client.0.smithi115.stdout:6/205: sync 2024-09-13T17:05:45.309 INFO:tasks.workunit.client.0.smithi115.stdout:6/206: chown d8/db/l14 13262656 1 2024-09-13T17:05:45.309 INFO:tasks.workunit.client.0.smithi115.stdout:5/202: truncate d19/f3c 231561 0 2024-09-13T17:05:45.309 INFO:tasks.workunit.client.0.smithi115.stdout:8/213: fsync d0/f39 0 2024-09-13T17:05:45.309 INFO:tasks.workunit.client.0.smithi115.stdout:8/214: stat d0/l3 0 2024-09-13T17:05:45.309 INFO:tasks.workunit.client.0.smithi115.stdout:8/215: getdents d0/d18/d19/d2b/d37 0 2024-09-13T17:05:45.310 INFO:tasks.workunit.client.1.smithi195.stdout:4/337: unlink d1a/d1f/d21/f30 0 2024-09-13T17:05:45.310 INFO:tasks.workunit.client.1.smithi195.stdout:4/338: dread - d1a/d1f/d43/d29/f2a zero size 2024-09-13T17:05:45.311 INFO:tasks.workunit.client.1.smithi195.stdout:6/242: dwrite d1c/d28/d35/f39 [4194304,4194304] 0 2024-09-13T17:05:45.312 INFO:tasks.workunit.client.1.smithi195.stdout:6/243: fdatasync d1c/d2d/f32 0 2024-09-13T17:05:45.312 INFO:tasks.workunit.client.1.smithi195.stdout:6/244: dread - f15 zero size 2024-09-13T17:05:45.313 INFO:tasks.workunit.client.1.smithi195.stdout:1/254: dwrite db/df/d13/f1e [0,4194304] 0 2024-09-13T17:05:45.313 INFO:tasks.workunit.client.1.smithi195.stdout:4/339: dread d1a/d1f/d43/d24/f3e [0,4194304] 0 2024-09-13T17:05:45.313 INFO:tasks.workunit.client.1.smithi195.stdout:4/340: write d1a/d1f/d21/d22/f42 [504711,56274] 0 2024-09-13T17:05:45.313 INFO:tasks.workunit.client.1.smithi195.stdout:4/341: chown d1a/d1f/d21/d22/f28 2565390 1 2024-09-13T17:05:45.314 INFO:tasks.workunit.client.0.smithi115.stdout:0/163: creat d9/f2b x:0 0 0 2024-09-13T17:05:45.315 INFO:tasks.workunit.client.0.smithi115.stdout:1/147: sync 2024-09-13T17:05:45.315 INFO:tasks.workunit.client.0.smithi115.stdout:1/148: creat d5/d26/f35 x:0 0 0 2024-09-13T17:05:45.315 INFO:tasks.workunit.client.0.smithi115.stdout:1/149: truncate d5/d7/f15 217530 0 2024-09-13T17:05:45.316 INFO:tasks.workunit.client.1.smithi195.stdout:6/245: read f2 [4190991,97750] 0 2024-09-13T17:05:45.317 INFO:tasks.workunit.client.1.smithi195.stdout:5/296: mkdir d2/d12/d4e/d10/d5c 0 2024-09-13T17:05:45.318 INFO:tasks.workunit.client.0.smithi115.stdout:7/180: truncate d0/d2/df/f10 510335 0 2024-09-13T17:05:45.320 INFO:tasks.workunit.client.1.smithi195.stdout:2/311: dwrite d0/d4a/d1c/d1e/f3f [0,4194304] 0 2024-09-13T17:05:45.320 INFO:tasks.workunit.client.1.smithi195.stdout:2/312: creat d0/d4a/d1c/d1e/f65 x:0 0 0 2024-09-13T17:05:45.322 INFO:tasks.workunit.client.0.smithi115.stdout:4/295: write d7/dd/de/f4a [872424,29163] 0 2024-09-13T17:05:45.322 INFO:tasks.workunit.client.0.smithi115.stdout:3/397: rmdir d1/d4b/d69 39 2024-09-13T17:05:45.323 INFO:tasks.workunit.client.1.smithi195.stdout:9/296: rename d6/df/d13/d44/f49 to d6/d19/d21/d5b/f5f 0 2024-09-13T17:05:45.326 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:44 smithi195 ceph-mon[34981]: pgmap v11: 65 pgs: 65 active+clean; 665 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 45 MiB/s rd, 68 MiB/s wr, 549 op/s 2024-09-13T17:05:45.328 INFO:tasks.workunit.client.0.smithi115.stdout:2/309: write d3/d4d/de/f15 [820959,101801] 0 2024-09-13T17:05:45.330 INFO:tasks.workunit.client.0.smithi115.stdout:6/207: truncate d8/db/d1d/f2b 1962287 0 2024-09-13T17:05:45.333 INFO:tasks.workunit.client.1.smithi195.stdout:9/297: dread d6/d12/f2b [0,4194304] 0 2024-09-13T17:05:45.335 INFO:tasks.workunit.client.0.smithi115.stdout:9/149: mkdir d0/d34 0 2024-09-13T17:05:45.337 INFO:tasks.workunit.client.0.smithi115.stdout:5/203: read d19/f3c [22285,43923] 0 2024-09-13T17:05:45.337 INFO:tasks.workunit.client.0.smithi115.stdout:4/296: write d7/f29 [3781373,83478] 0 2024-09-13T17:05:45.337 INFO:tasks.workunit.client.0.smithi115.stdout:4/297: dread - d7/dd/f33 zero size 2024-09-13T17:05:45.337 INFO:tasks.workunit.client.0.smithi115.stdout:4/298: write d7/f36 [195164,13684] 0 2024-09-13T17:05:45.338 INFO:tasks.workunit.client.1.smithi195.stdout:6/246: dread f19 [0,4194304] 0 2024-09-13T17:05:45.338 INFO:tasks.workunit.client.1.smithi195.stdout:6/247: stat d1c 0 2024-09-13T17:05:45.344 INFO:tasks.workunit.client.0.smithi115.stdout:0/164: write d9/f1f [4104282,91545] 0 2024-09-13T17:05:45.344 INFO:tasks.workunit.client.0.smithi115.stdout:0/165: stat d9/d27 0 2024-09-13T17:05:45.347 INFO:tasks.workunit.client.0.smithi115.stdout:3/398: unlink d1/d12/d14/l52 0 2024-09-13T17:05:45.347 INFO:tasks.workunit.client.0.smithi115.stdout:3/399: write d1/d4b/d69/f77 [508930,62511] 0 2024-09-13T17:05:45.347 INFO:tasks.workunit.client.0.smithi115.stdout:3/400: chown d1/d4b/l24 112792 1 2024-09-13T17:05:45.347 INFO:tasks.workunit.client.1.smithi195.stdout:0/305: dwrite d7/d8/d23/d4b/d4e/f5b [0,4194304] 0 2024-09-13T17:05:45.348 INFO:tasks.workunit.client.1.smithi195.stdout:4/342: mkdir d1a/d1f/d43/d24/d71 0 2024-09-13T17:05:45.348 INFO:tasks.workunit.client.1.smithi195.stdout:4/343: fsync d1a/d1f/d43/d5a/f5f 0 2024-09-13T17:05:45.351 INFO:tasks.workunit.client.0.smithi115.stdout:9/150: mknod d0/de/d10/c35 0 2024-09-13T17:05:45.355 INFO:tasks.workunit.client.0.smithi115.stdout:5/204: creat d19/d2b/d40/d41/f4c x:0 0 0 2024-09-13T17:05:45.357 INFO:tasks.workunit.client.0.smithi115.stdout:1/150: symlink d5/d7/l36 0 2024-09-13T17:05:45.358 INFO:tasks.workunit.client.0.smithi115.stdout:0/166: mkdir d9/d1d/d24/d26/d2c 0 2024-09-13T17:05:45.358 INFO:tasks.workunit.client.0.smithi115.stdout:0/167: chown d9/c14 6333 1 2024-09-13T17:05:45.358 INFO:tasks.workunit.client.0.smithi115.stdout:0/168: truncate d9/f16 363847 0 2024-09-13T17:05:45.360 INFO:tasks.workunit.client.0.smithi115.stdout:9/151: creat d0/d21/f36 x:0 0 0 2024-09-13T17:05:45.360 INFO:tasks.workunit.client.0.smithi115.stdout:9/152: readlink d0/d21/l26 0 2024-09-13T17:05:45.361 INFO:tasks.workunit.client.0.smithi115.stdout:5/205: mknod d19/d2b/c4d 0 2024-09-13T17:05:45.361 INFO:tasks.workunit.client.0.smithi115.stdout:5/206: creat d19/d2b/d32/f4e x:0 0 0 2024-09-13T17:05:45.362 INFO:tasks.workunit.client.0.smithi115.stdout:4/299: rmdir d7/dd/de/d4b 39 2024-09-13T17:05:45.362 INFO:tasks.workunit.client.0.smithi115.stdout:4/300: stat d7/dd/de/f13 0 2024-09-13T17:05:45.363 INFO:tasks.workunit.client.1.smithi195.stdout:5/297: creat d2/d12/d4e/d10/d45/f5d x:0 0 0 2024-09-13T17:05:45.363 INFO:tasks.workunit.client.1.smithi195.stdout:5/298: dread - d2/d12/d4e/f5b zero size 2024-09-13T17:05:45.365 INFO:tasks.workunit.client.0.smithi115.stdout:0/169: unlink f2 0 2024-09-13T17:05:45.366 INFO:tasks.workunit.client.0.smithi115.stdout:0/170: getdents d9/d27 0 2024-09-13T17:05:45.367 INFO:tasks.workunit.client.0.smithi115.stdout:9/153: mkdir d0/de/d37 0 2024-09-13T17:05:45.369 INFO:tasks.workunit.client.1.smithi195.stdout:2/313: truncate d0/d4a/d1c/f23 910639 0 2024-09-13T17:05:45.369 INFO:tasks.workunit.client.1.smithi195.stdout:2/314: fsync d0/d3/df/f10 0 2024-09-13T17:05:45.369 INFO:tasks.workunit.client.1.smithi195.stdout:2/315: write d0/d3/df/f10 [9030418,72072] 0 2024-09-13T17:05:45.370 INFO:tasks.workunit.client.1.smithi195.stdout:3/250: dwrite d7/f15 [0,4194304] 0 2024-09-13T17:05:45.371 INFO:tasks.workunit.client.0.smithi115.stdout:5/207: rename d19/d2c/l38 to d19/d21/d3a/l4f 0 2024-09-13T17:05:45.371 INFO:tasks.workunit.client.0.smithi115.stdout:5/208: chown d19/c1f 4 1 2024-09-13T17:05:45.372 INFO:tasks.workunit.client.1.smithi195.stdout:1/255: dwrite db/df/f28 [0,4194304] 0 2024-09-13T17:05:45.372 INFO:tasks.workunit.client.1.smithi195.stdout:1/256: chown db/df/d13 665 1 2024-09-13T17:05:45.372 INFO:tasks.workunit.client.1.smithi195.stdout:6/248: mkdir d1c/d24/d49 0 2024-09-13T17:05:45.373 INFO:tasks.workunit.client.0.smithi115.stdout:4/301: mkdir d7/dd/de/d57 0 2024-09-13T17:05:45.375 INFO:tasks.workunit.client.0.smithi115.stdout:1/151: symlink d5/d7/l37 0 2024-09-13T17:05:45.377 INFO:tasks.workunit.client.0.smithi115.stdout:0/171: getdents d9/d1d 0 2024-09-13T17:05:45.377 INFO:tasks.workunit.client.0.smithi115.stdout:6/208: dwrite d8/db/d1d/f18 [0,4194304] 0 2024-09-13T17:05:45.379 INFO:tasks.workunit.client.1.smithi195.stdout:0/306: mkdir d7/d8/d23/d4b/d56/d4d/d5e 0 2024-09-13T17:05:45.382 INFO:tasks.workunit.client.1.smithi195.stdout:4/344: creat d1a/d1f/d43/d24/d71/f72 x:0 0 0 2024-09-13T17:05:45.383 INFO:tasks.workunit.client.1.smithi195.stdout:5/299: dread d2/d12/d4e/d10/f23 [0,4194304] 0 2024-09-13T17:05:45.385 INFO:tasks.workunit.client.0.smithi115.stdout:9/154: rename d0/de/d10/d15/f19 to d0/de/d37/f38 0 2024-09-13T17:05:45.386 INFO:tasks.workunit.client.0.smithi115.stdout:4/302: dread d7/fb [0,4194304] 0 2024-09-13T17:05:45.386 INFO:tasks.workunit.client.0.smithi115.stdout:8/216: dwrite d0/d21/f32 [0,4194304] 0 2024-09-13T17:05:45.387 INFO:tasks.workunit.client.1.smithi195.stdout:5/300: write d2/d12/d4e/f3b [891877,22391] 0 2024-09-13T17:05:45.388 INFO:tasks.workunit.client.0.smithi115.stdout:7/181: dwrite d0/f3e [0,4194304] 0 2024-09-13T17:05:45.388 INFO:tasks.workunit.client.0.smithi115.stdout:3/401: dwrite d1/d4b/f2b [0,4194304] 0 2024-09-13T17:05:45.388 INFO:tasks.workunit.client.0.smithi115.stdout:7/182: chown d0/f3e 121173578 1 2024-09-13T17:05:45.388 INFO:tasks.workunit.client.0.smithi115.stdout:7/183: chown d0/d2/l3f 464593 1 2024-09-13T17:05:45.388 INFO:tasks.workunit.client.1.smithi195.stdout:9/298: dwrite d6/f1e [0,4194304] 0 2024-09-13T17:05:45.390 INFO:tasks.workunit.client.0.smithi115.stdout:5/209: creat d19/d2b/f50 x:0 0 0 2024-09-13T17:05:45.390 INFO:tasks.workunit.client.0.smithi115.stdout:2/310: dwrite d3/f4 [4194304,4194304] 0 2024-09-13T17:05:45.390 INFO:tasks.workunit.client.1.smithi195.stdout:3/251: link d7/d21/l3c d7/d19/l42 0 2024-09-13T17:05:45.393 INFO:tasks.workunit.client.0.smithi115.stdout:2/311: dread d3/d4d/d13/f45 [0,4194304] 0 2024-09-13T17:05:45.397 INFO:tasks.workunit.client.1.smithi195.stdout:6/249: mknod d1c/d2d/c4a 0 2024-09-13T17:05:45.397 INFO:tasks.workunit.client.0.smithi115.stdout:4/303: creat d7/dd/d3c/f58 x:0 0 0 2024-09-13T17:05:45.398 INFO:tasks.workunit.client.1.smithi195.stdout:4/345: truncate d1a/d1f/d43/d24/f25 109392 0 2024-09-13T17:05:45.401 INFO:tasks.workunit.client.1.smithi195.stdout:2/316: rename d0/d4a/d1c/d1e/f25 to d0/f66 0 2024-09-13T17:05:45.403 INFO:tasks.workunit.client.0.smithi115.stdout:8/217: mkdir d0/d18/d19/d2b/d3b 0 2024-09-13T17:05:45.403 INFO:tasks.workunit.client.0.smithi115.stdout:8/218: read - d0/f39 zero size 2024-09-13T17:05:45.403 INFO:tasks.workunit.client.0.smithi115.stdout:1/152: dwrite d5/d7/ff [0,4194304] 0 2024-09-13T17:05:45.404 INFO:tasks.workunit.client.1.smithi195.stdout:1/257: dwrite db/f11 [4194304,4194304] 0 2024-09-13T17:05:45.405 INFO:tasks.workunit.client.1.smithi195.stdout:6/250: dread d1c/d24/f38 [0,4194304] 0 2024-09-13T17:05:45.405 INFO:tasks.workunit.client.1.smithi195.stdout:6/251: readlink d1c/d3e/l42 0 2024-09-13T17:05:45.405 INFO:tasks.workunit.client.1.smithi195.stdout:3/252: truncate d7/d19/f22 1816584 0 2024-09-13T17:05:45.406 INFO:tasks.workunit.client.0.smithi115.stdout:9/155: dread d0/f16 [0,4194304] 0 2024-09-13T17:05:45.406 INFO:tasks.workunit.client.0.smithi115.stdout:3/402: read d1/d4b/d1a/d30/f37 [3450634,127126] 0 2024-09-13T17:05:45.408 INFO:tasks.workunit.client.1.smithi195.stdout:4/346: rmdir d1a/d1f/d43/d5a/d63/d6e 0 2024-09-13T17:05:45.410 INFO:tasks.workunit.client.0.smithi115.stdout:0/172: dwrite f0 [0,4194304] 0 2024-09-13T17:05:45.411 INFO:tasks.workunit.client.1.smithi195.stdout:4/347: read d1a/d1f/d21/d36/f46 [552143,96345] 0 2024-09-13T17:05:45.412 INFO:tasks.workunit.client.0.smithi115.stdout:5/210: symlink d19/d2b/d40/l51 0 2024-09-13T17:05:45.412 INFO:tasks.workunit.client.0.smithi115.stdout:6/209: dwrite d8/db/d1d/f2b [0,4194304] 0 2024-09-13T17:05:45.413 INFO:tasks.workunit.client.1.smithi195.stdout:2/317: symlink d0/d3/df/l67 0 2024-09-13T17:05:45.413 INFO:tasks.workunit.client.1.smithi195.stdout:2/318: creat d0/d3/f68 x:0 0 0 2024-09-13T17:05:45.414 INFO:tasks.workunit.client.1.smithi195.stdout:1/258: write db/f18 [798573,42572] 0 2024-09-13T17:05:45.414 INFO:tasks.workunit.client.1.smithi195.stdout:1/259: write db/df/f20 [129461,93240] 0 2024-09-13T17:05:45.415 INFO:tasks.workunit.client.1.smithi195.stdout:2/319: dread d0/d4a/d1c/d2c/f34 [0,4194304] 0 2024-09-13T17:05:45.417 INFO:tasks.workunit.client.1.smithi195.stdout:9/299: rename d6/d12/f2a to d6/d19/d21/f60 0 2024-09-13T17:05:45.418 INFO:tasks.workunit.client.0.smithi115.stdout:2/312: getdents d3/d4d/d13 0 2024-09-13T17:05:45.420 INFO:tasks.workunit.client.0.smithi115.stdout:4/304: rmdir d7/dd/de/d4b 39 2024-09-13T17:05:45.420 INFO:tasks.workunit.client.0.smithi115.stdout:4/305: creat d7/dd/de/f59 x:0 0 0 2024-09-13T17:05:45.420 INFO:tasks.workunit.client.0.smithi115.stdout:4/306: fsync d7/dd/f37 0 2024-09-13T17:05:45.420 INFO:tasks.workunit.client.0.smithi115.stdout:4/307: chown d7/dd/f44 221510 1 2024-09-13T17:05:45.420 INFO:tasks.workunit.client.0.smithi115.stdout:0/173: write f0 [348790,3779] 0 2024-09-13T17:05:45.422 INFO:tasks.workunit.client.0.smithi115.stdout:7/184: dwrite d0/d2/df/f10 [0,4194304] 0 2024-09-13T17:05:45.423 INFO:tasks.workunit.client.0.smithi115.stdout:8/219: unlink d0/f39 0 2024-09-13T17:05:45.423 INFO:tasks.workunit.client.0.smithi115.stdout:7/185: dread d0/d2/df/d21/d25/f2c [0,4194304] 0 2024-09-13T17:05:45.423 INFO:tasks.workunit.client.1.smithi195.stdout:2/320: dread d0/d3/fe [0,4194304] 0 2024-09-13T17:05:45.424 INFO:tasks.workunit.client.1.smithi195.stdout:2/321: readlink d0/d4a/d1c/d2c/d51/l38 0 2024-09-13T17:05:45.424 INFO:tasks.workunit.client.1.smithi195.stdout:2/322: chown d0/d4a/l29 15122022 1 2024-09-13T17:05:45.424 INFO:tasks.workunit.client.1.smithi195.stdout:4/348: dread d1a/d1f/d43/f3d [0,4194304] 0 2024-09-13T17:05:45.424 INFO:tasks.workunit.client.1.smithi195.stdout:4/349: chown d1a/d1f/d43/d24/d41/f4b 266514029 1 2024-09-13T17:05:45.425 INFO:tasks.workunit.client.1.smithi195.stdout:4/350: dread - d1a/d1f/d43/d29/f2a zero size 2024-09-13T17:05:45.425 INFO:tasks.workunit.client.1.smithi195.stdout:4/351: truncate d1a/d1f/d43/d24/d41/f4b 916244 0 2024-09-13T17:05:45.425 INFO:tasks.workunit.client.1.smithi195.stdout:4/352: chown d1a/d1f/d43/d29/d58/l62 13625278 1 2024-09-13T17:05:45.425 INFO:tasks.workunit.client.0.smithi115.stdout:6/210: dread d8/d13/d15/d24/f29 [0,4194304] 0 2024-09-13T17:05:45.427 INFO:tasks.workunit.client.1.smithi195.stdout:3/253: unlink d7/c41 0 2024-09-13T17:05:45.428 INFO:tasks.workunit.client.1.smithi195.stdout:3/254: write d7/d21/d2a/d35/f3d [1498746,119895] 0 2024-09-13T17:05:45.431 INFO:tasks.workunit.client.0.smithi115.stdout:3/403: rmdir d1 39 2024-09-13T17:05:45.433 INFO:tasks.workunit.client.1.smithi195.stdout:4/353: dread d1a/d1f/d21/d22/f5b [0,4194304] 0 2024-09-13T17:05:45.433 INFO:tasks.workunit.client.0.smithi115.stdout:8/220: read d0/d15/f1b [676140,81892] 0 2024-09-13T17:05:45.435 INFO:tasks.workunit.client.1.smithi195.stdout:1/260: unlink db/f10 0 2024-09-13T17:05:45.435 INFO:tasks.workunit.client.1.smithi195.stdout:1/261: truncate db/df/d4d/f4f 979841 0 2024-09-13T17:05:45.437 INFO:tasks.workunit.client.0.smithi115.stdout:5/211: rename d19/d21/c36 to d19/d21/d3a/c52 0 2024-09-13T17:05:45.437 INFO:tasks.workunit.client.0.smithi115.stdout:5/212: readlink d19/d2b/d32/l39 0 2024-09-13T17:05:45.437 INFO:tasks.workunit.client.0.smithi115.stdout:5/213: creat d19/f53 x:0 0 0 2024-09-13T17:05:45.439 INFO:tasks.workunit.client.1.smithi195.stdout:9/300: mkdir d6/df/d13/d44/d47/d61 0 2024-09-13T17:05:45.441 INFO:tasks.workunit.client.1.smithi195.stdout:9/301: dread d6/d12/f46 [0,4194304] 0 2024-09-13T17:05:45.441 INFO:tasks.workunit.client.1.smithi195.stdout:9/302: write d6/d12/f2b [3539233,92611] 0 2024-09-13T17:05:45.442 INFO:tasks.workunit.client.1.smithi195.stdout:9/303: dread d6/d19/d21/f60 [0,4194304] 0 2024-09-13T17:05:45.442 INFO:tasks.workunit.client.1.smithi195.stdout:9/304: fdatasync d6/df/f27 0 2024-09-13T17:05:45.442 INFO:tasks.workunit.client.1.smithi195.stdout:4/354: getdents d1a/d1f/d43/d5a/d63 0 2024-09-13T17:05:45.443 INFO:tasks.workunit.client.1.smithi195.stdout:4/355: chown f14 1565508281 1 2024-09-13T17:05:45.444 INFO:tasks.workunit.client.1.smithi195.stdout:4/356: dread d1a/d1f/d43/d24/f25 [0,4194304] 0 2024-09-13T17:05:45.444 INFO:tasks.workunit.client.1.smithi195.stdout:4/357: write f0 [4160627,101817] 0 2024-09-13T17:05:45.446 INFO:tasks.workunit.client.1.smithi195.stdout:1/262: unlink db/c23 0 2024-09-13T17:05:45.447 INFO:tasks.workunit.client.0.smithi115.stdout:2/313: mknod d3/d4d/dd/d1f/d2f/d56/c68 0 2024-09-13T17:05:45.450 INFO:tasks.workunit.client.1.smithi195.stdout:6/252: rename d1c/c1f to d1c/d24/c4b 0 2024-09-13T17:05:45.450 INFO:tasks.workunit.client.1.smithi195.stdout:6/253: truncate f1a 743310 0 2024-09-13T17:05:45.451 INFO:tasks.workunit.client.1.smithi195.stdout:4/358: rmdir d1a/d1f/d43/d24 39 2024-09-13T17:05:45.452 INFO:tasks.workunit.client.1.smithi195.stdout:7/323: sync 2024-09-13T17:05:45.452 INFO:tasks.workunit.client.1.smithi195.stdout:7/324: fdatasync d5/db/d19/d22/f4e 0 2024-09-13T17:05:45.456 INFO:tasks.workunit.client.1.smithi195.stdout:8/299: sync 2024-09-13T17:05:45.456 INFO:tasks.workunit.client.1.smithi195.stdout:8/300: dread - d0/d17/d49/f50 zero size 2024-09-13T17:05:45.456 INFO:tasks.workunit.client.1.smithi195.stdout:8/301: stat d0/d17/d2f/d31/f3f 0 2024-09-13T17:05:45.456 INFO:tasks.workunit.client.1.smithi195.stdout:8/302: write d0/f3 [1182797,16350] 0 2024-09-13T17:05:45.457 INFO:tasks.workunit.client.0.smithi115.stdout:7/186: mknod d0/d2/df/c42 0 2024-09-13T17:05:45.459 INFO:tasks.workunit.client.0.smithi115.stdout:6/211: truncate d8/d13/d15/d24/f29 2715369 0 2024-09-13T17:05:45.460 INFO:tasks.workunit.client.1.smithi195.stdout:6/254: dread d1c/d28/d35/f39 [4194304,4194304] 0 2024-09-13T17:05:45.461 INFO:tasks.workunit.client.0.smithi115.stdout:9/156: mknod d0/c39 0 2024-09-13T17:05:45.463 INFO:tasks.workunit.client.1.smithi195.stdout:1/263: rename db/d19/f47 to db/f5e 0 2024-09-13T17:05:45.463 INFO:tasks.workunit.client.1.smithi195.stdout:1/264: fdatasync db/df/d13/f2e 0 2024-09-13T17:05:45.463 INFO:tasks.workunit.client.1.smithi195.stdout:1/265: dread - db/df/d13/f21 zero size 2024-09-13T17:05:45.464 INFO:tasks.workunit.client.0.smithi115.stdout:3/404: mknod d1/c84 0 2024-09-13T17:05:45.464 INFO:tasks.workunit.client.1.smithi195.stdout:9/305: dwrite d6/d19/f4c [0,4194304] 0 2024-09-13T17:05:45.464 INFO:tasks.workunit.client.1.smithi195.stdout:9/306: fdatasync d6/df/d13/d44/f5d 0 2024-09-13T17:05:45.464 INFO:tasks.workunit.client.1.smithi195.stdout:9/307: write d6/df/f3c [1001524,113339] 0 2024-09-13T17:05:45.465 INFO:tasks.workunit.client.1.smithi195.stdout:7/325: mknod d5/db/c69 0 2024-09-13T17:05:45.466 INFO:tasks.workunit.client.0.smithi115.stdout:8/221: mknod d0/d26/d29/c3c 0 2024-09-13T17:05:45.468 INFO:tasks.workunit.client.0.smithi115.stdout:3/405: dread d1/f1d [0,4194304] 0 2024-09-13T17:05:45.469 INFO:tasks.workunit.client.1.smithi195.stdout:4/359: dwrite d1a/d1f/d43/d24/f25 [0,4194304] 0 2024-09-13T17:05:45.469 INFO:tasks.workunit.client.1.smithi195.stdout:4/360: dread d1a/d1f/d43/d29/f3f [0,4194304] 0 2024-09-13T17:05:45.469 INFO:tasks.workunit.client.0.smithi115.stdout:4/308: rename d7/dd/de/d4b to d7/dd/de/d4e/d5a 0 2024-09-13T17:05:45.471 INFO:tasks.workunit.client.1.smithi195.stdout:8/303: mkdir d0/d62 0 2024-09-13T17:05:45.479 INFO:tasks.workunit.client.1.smithi195.stdout:6/255: creat d1c/d24/d49/f4c x:0 0 0 2024-09-13T17:05:45.479 INFO:tasks.workunit.client.1.smithi195.stdout:6/256: creat d1c/d28/d35/f4d x:0 0 0 2024-09-13T17:05:45.479 INFO:tasks.workunit.client.1.smithi195.stdout:6/257: chown ca 26 1 2024-09-13T17:05:45.480 INFO:tasks.workunit.client.0.smithi115.stdout:5/214: unlink d19/f37 0 2024-09-13T17:05:45.481 INFO:tasks.workunit.client.1.smithi195.stdout:6/258: dread f14 [0,4194304] 0 2024-09-13T17:05:45.485 INFO:tasks.workunit.client.0.smithi115.stdout:0/174: mkdir d9/d1d/d24/d26/d2d 0 2024-09-13T17:05:45.485 INFO:tasks.workunit.client.0.smithi115.stdout:0/175: chown d9/d1d/d24/d26/d2d 8098 1 2024-09-13T17:05:45.486 INFO:tasks.workunit.client.1.smithi195.stdout:9/308: mknod d6/d19/c62 0 2024-09-13T17:05:45.486 INFO:tasks.workunit.client.1.smithi195.stdout:9/309: fdatasync d6/f1e 0 2024-09-13T17:05:45.489 INFO:tasks.workunit.client.1.smithi195.stdout:7/326: rename d5/d35/d37/f49 to d5/d13/f6a 0 2024-09-13T17:05:45.489 INFO:tasks.workunit.client.0.smithi115.stdout:4/309: dwrite d7/dd/f37 [0,4194304] 0 2024-09-13T17:05:45.490 INFO:tasks.workunit.client.1.smithi195.stdout:7/327: dread d5/d35/d37/f4a [0,4194304] 0 2024-09-13T17:05:45.491 INFO:tasks.workunit.client.0.smithi115.stdout:9/157: creat d0/de/d10/d15/f3a x:0 0 0 2024-09-13T17:05:45.491 INFO:tasks.workunit.client.0.smithi115.stdout:9/158: dread - d0/d21/f36 zero size 2024-09-13T17:05:45.491 INFO:tasks.workunit.client.0.smithi115.stdout:8/222: dwrite d0/d18/f2e [0,4194304] 0 2024-09-13T17:05:45.491 INFO:tasks.workunit.client.0.smithi115.stdout:8/223: write d0/d26/f35 [585323,111117] 0 2024-09-13T17:05:45.491 INFO:tasks.workunit.client.0.smithi115.stdout:8/224: creat d0/d18/d19/d2b/f3d x:0 0 0 2024-09-13T17:05:45.493 INFO:tasks.workunit.client.0.smithi115.stdout:4/310: dread d7/fc [0,4194304] 0 2024-09-13T17:05:45.494 INFO:tasks.workunit.client.1.smithi195.stdout:6/259: dread ff [0,4194304] 0 2024-09-13T17:05:45.495 INFO:tasks.workunit.client.0.smithi115.stdout:3/406: creat d1/d83/f85 x:0 0 0 2024-09-13T17:05:45.495 INFO:tasks.workunit.client.0.smithi115.stdout:3/407: write d1/d12/d14/f51 [4872872,120094] 0 2024-09-13T17:05:45.497 INFO:tasks.workunit.client.0.smithi115.stdout:2/314: rename d3/d4d/d13/d1c/c23 to d3/d4d/dd/d1f/d2f/d56/c69 0 2024-09-13T17:05:45.498 INFO:tasks.workunit.client.0.smithi115.stdout:3/408: dread d1/d4b/d1a/f81 [0,4194304] 0 2024-09-13T17:05:45.498 INFO:tasks.workunit.client.0.smithi115.stdout:3/409: creat d1/d4b/f86 x:0 0 0 2024-09-13T17:05:45.499 INFO:tasks.workunit.client.0.smithi115.stdout:5/215: dwrite d19/d21/f22 [0,4194304] 0 2024-09-13T17:05:45.508 INFO:tasks.workunit.client.1.smithi195.stdout:7/328: dwrite d5/db/d19/d22/d3c/f4f [0,4194304] 0 2024-09-13T17:05:45.510 INFO:tasks.workunit.client.0.smithi115.stdout:5/216: write d19/d1d/f20 [2290129,48551] 0 2024-09-13T17:05:45.510 INFO:tasks.workunit.client.0.smithi115.stdout:5/217: write d19/d2b/d32/f45 [104096,114800] 0 2024-09-13T17:05:45.511 INFO:tasks.workunit.client.0.smithi115.stdout:0/176: dread d9/ff [0,4194304] 0 2024-09-13T17:05:45.515 INFO:tasks.workunit.client.0.smithi115.stdout:4/311: dwrite d7/dd/f37 [0,4194304] 0 2024-09-13T17:05:45.515 INFO:tasks.workunit.client.0.smithi115.stdout:4/312: write d7/f47 [7341,112302] 0 2024-09-13T17:05:45.527 INFO:tasks.workunit.client.0.smithi115.stdout:5/218: dwrite d19/d21/f4a [0,4194304] 0 2024-09-13T17:05:45.533 INFO:tasks.workunit.client.0.smithi115.stdout:4/313: dwrite d7/f29 [0,4194304] 0 2024-09-13T17:05:45.536 INFO:tasks.workunit.client.0.smithi115.stdout:7/187: mkdir d0/d2/d1e/d43 0 2024-09-13T17:05:45.539 INFO:tasks.workunit.client.0.smithi115.stdout:5/219: dwrite d19/f3c [0,4194304] 0 2024-09-13T17:05:45.542 INFO:tasks.workunit.client.1.smithi195.stdout:1/266: getdents db/d19/d37/d3e 0 2024-09-13T17:05:45.545 INFO:tasks.workunit.client.1.smithi195.stdout:9/310: getdents d6/df/d16 0 2024-09-13T17:05:45.546 INFO:tasks.workunit.client.0.smithi115.stdout:9/159: getdents d0/de/d37 0 2024-09-13T17:05:45.548 INFO:tasks.workunit.client.1.smithi195.stdout:8/304: rename d0/d4/d4e to d0/d17/d49/d63 0 2024-09-13T17:05:45.551 INFO:tasks.workunit.client.1.smithi195.stdout:6/260: symlink d1c/d2d/d30/l4e 0 2024-09-13T17:05:45.551 INFO:tasks.workunit.client.1.smithi195.stdout:6/261: truncate f19 4423632 0 2024-09-13T17:05:45.551 INFO:tasks.workunit.client.1.smithi195.stdout:6/262: write d1c/f29 [4389699,78526] 0 2024-09-13T17:05:45.551 INFO:tasks.workunit.client.1.smithi195.stdout:6/263: chown d1c/d3e/l42 240947719 1 2024-09-13T17:05:45.552 INFO:tasks.workunit.client.0.smithi115.stdout:8/225: mkdir d0/d15/d3e 0 2024-09-13T17:05:45.553 INFO:tasks.workunit.client.1.smithi195.stdout:4/361: getdents d1a/d1f/d43/d24/d41 0 2024-09-13T17:05:45.554 INFO:tasks.workunit.client.0.smithi115.stdout:2/315: symlink d3/d4d/d13/d62/d66/l6a 0 2024-09-13T17:05:45.558 INFO:tasks.workunit.client.1.smithi195.stdout:8/305: dread d0/d17/f56 [0,4194304] 0 2024-09-13T17:05:45.558 INFO:tasks.workunit.client.1.smithi195.stdout:8/306: dread - d0/d13/d4d/f48 zero size 2024-09-13T17:05:45.558 INFO:tasks.workunit.client.1.smithi195.stdout:7/329: link d5/db/d19/d22/f62 d5/db/d19/d22/f6b 0 2024-09-13T17:05:45.559 INFO:tasks.workunit.client.0.smithi115.stdout:0/177: chown d9/f1f 1 1 2024-09-13T17:05:45.561 INFO:tasks.workunit.client.1.smithi195.stdout:1/267: dwrite db/f1c [0,4194304] 0 2024-09-13T17:05:45.564 INFO:tasks.workunit.client.0.smithi115.stdout:7/188: mkdir d0/d2/df/d21/d25/d44 0 2024-09-13T17:05:45.566 INFO:tasks.workunit.client.0.smithi115.stdout:7/189: dread d0/fa [0,4194304] 0 2024-09-13T17:05:45.567 INFO:tasks.workunit.client.0.smithi115.stdout:8/226: write d0/d18/d19/d28/f30 [1264077,42337] 0 2024-09-13T17:05:45.567 INFO:tasks.workunit.client.0.smithi115.stdout:8/227: chown d0/cf 0 1 2024-09-13T17:05:45.568 INFO:tasks.workunit.client.1.smithi195.stdout:6/264: rename l16 to d1c/d28/l4f 0 2024-09-13T17:05:45.570 INFO:tasks.workunit.client.1.smithi195.stdout:4/362: mknod d1a/d1f/d21/c73 0 2024-09-13T17:05:45.571 INFO:tasks.workunit.client.0.smithi115.stdout:5/220: rename d19/d21/l47 to d19/d2e/l54 0 2024-09-13T17:05:45.572 INFO:tasks.workunit.client.1.smithi195.stdout:8/307: mknod d0/c64 0 2024-09-13T17:05:45.572 INFO:tasks.workunit.client.1.smithi195.stdout:0/307: sync 2024-09-13T17:05:45.576 INFO:tasks.workunit.client.0.smithi115.stdout:5/221: dread d19/f1e [0,4194304] 0 2024-09-13T17:05:45.576 INFO:tasks.workunit.client.1.smithi195.stdout:9/311: getdents d6/d19/d21/d45 0 2024-09-13T17:05:45.576 INFO:tasks.workunit.client.1.smithi195.stdout:9/312: chown d6/df/l59 767802648 1 2024-09-13T17:05:45.576 INFO:tasks.workunit.client.1.smithi195.stdout:9/313: fsync d6/d19/d21/d45/f5a 0 2024-09-13T17:05:45.576 INFO:tasks.workunit.client.1.smithi195.stdout:9/314: chown d6/d19/f1f 14993 1 2024-09-13T17:05:45.577 INFO:tasks.workunit.client.1.smithi195.stdout:7/330: dwrite d5/d35/d37/f52 [0,4194304] 0 2024-09-13T17:05:45.578 INFO:tasks.workunit.client.1.smithi195.stdout:7/331: chown d5/d13/f1d 19222072 1 2024-09-13T17:05:45.578 INFO:tasks.workunit.client.1.smithi195.stdout:7/332: write d5/db/f2c [2262600,74269] 0 2024-09-13T17:05:45.578 INFO:tasks.workunit.client.1.smithi195.stdout:7/333: creat d5/db/d19/d22/f6c x:0 0 0 2024-09-13T17:05:45.578 INFO:tasks.workunit.client.1.smithi195.stdout:7/334: chown d5/db/d19/d22/d3c/c43 13979563 1 2024-09-13T17:05:45.578 INFO:tasks.workunit.client.1.smithi195.stdout:1/268: dread db/f1c [0,4194304] 0 2024-09-13T17:05:45.578 INFO:tasks.workunit.client.1.smithi195.stdout:1/269: fdatasync db/d19/d37/d3e/f4c 0 2024-09-13T17:05:45.578 INFO:tasks.workunit.client.1.smithi195.stdout:1/270: read db/f18 [3715304,43219] 0 2024-09-13T17:05:45.578 INFO:tasks.workunit.client.1.smithi195.stdout:6/265: rename f15 to d1c/d28/f50 0 2024-09-13T17:05:45.578 INFO:tasks.workunit.client.1.smithi195.stdout:6/266: creat d1c/d24/f51 x:0 0 0 2024-09-13T17:05:45.580 INFO:tasks.workunit.client.1.smithi195.stdout:9/315: unlink d6/df/l40 0 2024-09-13T17:05:45.587 INFO:tasks.workunit.client.1.smithi195.stdout:1/271: mknod db/d19/c5f 0 2024-09-13T17:05:45.588 INFO:tasks.workunit.client.1.smithi195.stdout:4/363: dwrite d1a/d1f/d43/d24/d71/f72 [0,4194304] 0 2024-09-13T17:05:45.590 INFO:tasks.workunit.client.1.smithi195.stdout:8/308: rename d0/d13/l4a to d0/d4/l65 0 2024-09-13T17:05:45.594 INFO:tasks.workunit.client.1.smithi195.stdout:9/316: symlink d6/d19/l63 0 2024-09-13T17:05:45.596 INFO:tasks.workunit.client.0.smithi115.stdout:2/316: mkdir d3/d4d/d13/d6b 0 2024-09-13T17:05:45.596 INFO:tasks.workunit.client.1.smithi195.stdout:6/267: dwrite f2 [4194304,4194304] 0 2024-09-13T17:05:45.597 INFO:tasks.workunit.client.0.smithi115.stdout:3/410: rmdir d1/d4b/d1a/d6e 39 2024-09-13T17:05:45.600 INFO:tasks.workunit.client.0.smithi115.stdout:0/178: symlink d9/d1d/l2e 0 2024-09-13T17:05:45.600 INFO:tasks.workunit.client.0.smithi115.stdout:0/179: chown d9/d1d/d24/c29 7387293 1 2024-09-13T17:05:45.601 INFO:tasks.workunit.client.1.smithi195.stdout:1/272: mkdir db/d60 0 2024-09-13T17:05:45.602 INFO:tasks.workunit.client.1.smithi195.stdout:8/309: read d0/d4/f39 [3932722,52889] 0 2024-09-13T17:05:45.602 INFO:tasks.workunit.client.0.smithi115.stdout:4/314: rmdir d7/dd/de/d4e 39 2024-09-13T17:05:45.604 INFO:tasks.workunit.client.1.smithi195.stdout:5/301: sync 2024-09-13T17:05:45.604 INFO:tasks.workunit.client.1.smithi195.stdout:3/255: sync 2024-09-13T17:05:45.605 INFO:tasks.workunit.client.1.smithi195.stdout:2/323: sync 2024-09-13T17:05:45.605 INFO:tasks.workunit.client.1.smithi195.stdout:2/324: readlink d0/d4a/l5a 0 2024-09-13T17:05:45.605 INFO:tasks.workunit.client.1.smithi195.stdout:2/325: stat d0/d4a/f3a 0 2024-09-13T17:05:45.605 INFO:tasks.workunit.client.1.smithi195.stdout:2/326: fsync d0/d4a/d1c/f23 0 2024-09-13T17:05:45.605 INFO:tasks.workunit.client.0.smithi115.stdout:7/190: mknod d0/d2/df/c45 0 2024-09-13T17:05:45.606 INFO:tasks.workunit.client.0.smithi115.stdout:7/191: truncate d0/d2/f3a 892437 0 2024-09-13T17:05:45.606 INFO:tasks.workunit.client.1.smithi195.stdout:4/364: dwrite d1a/d1f/d43/f48 [0,4194304] 0 2024-09-13T17:05:45.607 INFO:tasks.workunit.client.0.smithi115.stdout:7/192: dread d0/d2/d1e/f32 [0,4194304] 0 2024-09-13T17:05:45.609 INFO:tasks.workunit.client.1.smithi195.stdout:9/317: rename d6/d12/d4b to d6/d19/d21/d64 0 2024-09-13T17:05:45.609 INFO:tasks.workunit.client.0.smithi115.stdout:8/228: creat d0/d21/d3a/f3f x:0 0 0 2024-09-13T17:05:45.611 INFO:tasks.workunit.client.1.smithi195.stdout:6/268: mknod d1c/d24/c52 0 2024-09-13T17:05:45.611 INFO:tasks.workunit.client.1.smithi195.stdout:6/269: creat d1c/d28/d35/f53 x:0 0 0 2024-09-13T17:05:45.613 INFO:tasks.workunit.client.0.smithi115.stdout:3/411: getdents d1 0 2024-09-13T17:05:45.614 INFO:tasks.workunit.client.1.smithi195.stdout:1/273: creat db/d19/d5a/f61 x:0 0 0 2024-09-13T17:05:45.614 INFO:tasks.workunit.client.1.smithi195.stdout:2/327: dread d0/d4a/d1c/d1e/f52 [0,4194304] 0 2024-09-13T17:05:45.614 INFO:tasks.workunit.client.1.smithi195.stdout:8/310: getdents d0/d13/d52/d55 0 2024-09-13T17:05:45.617 INFO:tasks.workunit.client.1.smithi195.stdout:5/302: mknod d2/df/d48/d5a/c5e 0 2024-09-13T17:05:45.617 INFO:tasks.workunit.client.1.smithi195.stdout:5/303: stat d2/d12/d4e/d10/d46/l1e 0 2024-09-13T17:05:45.617 INFO:tasks.workunit.client.0.smithi115.stdout:2/317: dwrite d3/d4d/dd/d1f/d2f/d56/f2b [0,4194304] 0 2024-09-13T17:05:45.617 INFO:tasks.workunit.client.0.smithi115.stdout:2/318: dread - d3/d4d/d13/d39/f5d zero size 2024-09-13T17:05:45.617 INFO:tasks.workunit.client.0.smithi115.stdout:2/319: write d3/d4d/d13/f51 [555991,130101] 0 2024-09-13T17:05:45.618 INFO:tasks.workunit.client.0.smithi115.stdout:4/315: symlink d7/dd/l5b 0 2024-09-13T17:05:45.618 INFO:tasks.workunit.client.0.smithi115.stdout:0/180: write d9/f17 [4397990,90402] 0 2024-09-13T17:05:45.618 INFO:tasks.workunit.client.0.smithi115.stdout:4/316: creat d7/dd/de/f5c x:0 0 0 2024-09-13T17:05:45.621 INFO:tasks.workunit.client.0.smithi115.stdout:7/193: creat d0/d2/df/d21/d2d/f46 x:0 0 0 2024-09-13T17:05:45.621 INFO:tasks.workunit.client.0.smithi115.stdout:7/194: creat d0/d2/df/f47 x:0 0 0 2024-09-13T17:05:45.622 INFO:tasks.workunit.client.1.smithi195.stdout:3/256: dread d7/d21/d2a/d35/f37 [0,4194304] 0 2024-09-13T17:05:45.622 INFO:tasks.workunit.client.1.smithi195.stdout:3/257: fsync d7/f2d 0 2024-09-13T17:05:45.624 INFO:tasks.workunit.client.1.smithi195.stdout:4/365: mknod d1a/d1f/d21/c74 0 2024-09-13T17:05:45.624 INFO:tasks.workunit.client.1.smithi195.stdout:4/366: write d1a/d1f/d43/d29/f38 [1373537,97467] 0 2024-09-13T17:05:45.624 INFO:tasks.workunit.client.1.smithi195.stdout:4/367: chown d1a/d1f/d43/d29/d58/l62 62 1 2024-09-13T17:05:45.625 INFO:tasks.workunit.client.0.smithi115.stdout:8/229: mknod d0/d18/d19/d2b/d37/c40 0 2024-09-13T17:05:45.627 INFO:tasks.workunit.client.1.smithi195.stdout:6/270: symlink d1c/d28/d35/l54 0 2024-09-13T17:05:45.627 INFO:tasks.workunit.client.1.smithi195.stdout:6/271: creat d1c/d2d/f55 x:0 0 0 2024-09-13T17:05:45.629 INFO:tasks.workunit.client.0.smithi115.stdout:3/412: truncate d1/f10 983871 0 2024-09-13T17:05:45.629 INFO:tasks.workunit.client.0.smithi115.stdout:3/413: write d1/d12/d14/f19 [709933,80341] 0 2024-09-13T17:05:45.630 INFO:tasks.workunit.client.1.smithi195.stdout:1/274: mkdir db/df/d51/d62 0 2024-09-13T17:05:45.632 INFO:tasks.workunit.client.1.smithi195.stdout:2/328: symlink d0/d3/l69 0 2024-09-13T17:05:45.632 INFO:tasks.workunit.client.1.smithi195.stdout:2/329: write d0/d3/f26 [259213,112329] 0 2024-09-13T17:05:45.632 INFO:tasks.workunit.client.0.smithi115.stdout:2/320: mknod d3/d4d/c6c 0 2024-09-13T17:05:45.633 INFO:tasks.workunit.client.0.smithi115.stdout:2/321: stat d3/d4d/d13 0 2024-09-13T17:05:45.634 INFO:tasks.workunit.client.1.smithi195.stdout:8/311: link d0/d4/c1a d0/d17/c66 0 2024-09-13T17:05:45.634 INFO:tasks.workunit.client.1.smithi195.stdout:8/312: write d0/d17/d49/f50 [699461,99737] 0 2024-09-13T17:05:45.635 INFO:tasks.workunit.client.1.smithi195.stdout:5/304: rename d2/l2c to d2/d3e/d32/l5f 0 2024-09-13T17:05:45.635 INFO:tasks.workunit.client.1.smithi195.stdout:5/305: creat d2/df/d39/d54/d58/f60 x:0 0 0 2024-09-13T17:05:45.637 INFO:tasks.workunit.client.0.smithi115.stdout:4/317: mknod d7/dd/de/d4e/d5a/c5d 0 2024-09-13T17:05:45.637 INFO:tasks.workunit.client.1.smithi195.stdout:3/258: symlink d7/d19/d1e/l43 0 2024-09-13T17:05:45.638 INFO:tasks.workunit.client.1.smithi195.stdout:3/259: truncate d7/d21/d2a/f3b 787051 0 2024-09-13T17:05:45.638 INFO:tasks.workunit.client.1.smithi195.stdout:3/260: truncate d7/d19/f22 2537998 0 2024-09-13T17:05:45.638 INFO:tasks.workunit.client.1.smithi195.stdout:3/261: truncate d7/d21/d2a/f32 1260931 0 2024-09-13T17:05:45.638 INFO:tasks.workunit.client.1.smithi195.stdout:3/262: write d7/d19/d1e/f3f [378826,53631] 0 2024-09-13T17:05:45.640 INFO:tasks.workunit.client.1.smithi195.stdout:8/313: mkdir d0/d13/d4d/d4c/d67 0 2024-09-13T17:05:45.640 INFO:tasks.workunit.client.1.smithi195.stdout:4/368: dread f5 [0,4194304] 0 2024-09-13T17:05:45.640 INFO:tasks.workunit.client.1.smithi195.stdout:9/318: dwrite d6/df/f3c [0,4194304] 0 2024-09-13T17:05:45.640 INFO:tasks.workunit.client.1.smithi195.stdout:9/319: fdatasync d6/d12/d39/f3d 0 2024-09-13T17:05:45.640 INFO:tasks.workunit.client.0.smithi115.stdout:8/230: rmdir d0/d21 39 2024-09-13T17:05:45.641 INFO:tasks.workunit.client.1.smithi195.stdout:6/272: dread f2 [4194304,4194304] 0 2024-09-13T17:05:45.641 INFO:tasks.workunit.client.1.smithi195.stdout:2/330: dread d0/d3/f4e [0,4194304] 0 2024-09-13T17:05:45.643 INFO:tasks.workunit.client.0.smithi115.stdout:5/222: rename d19/d2b/d40/d41 to d19/d2b/d32/d55 0 2024-09-13T17:05:45.643 INFO:tasks.workunit.client.1.smithi195.stdout:6/273: read d1c/d24/f38 [73367,117619] 0 2024-09-13T17:05:45.643 INFO:tasks.workunit.client.1.smithi195.stdout:6/274: chown d1c/d2d/c31 114146369 1 2024-09-13T17:05:45.643 INFO:tasks.workunit.client.0.smithi115.stdout:0/181: write d9/fc [364772,102644] 0 2024-09-13T17:05:45.644 INFO:tasks.workunit.client.1.smithi195.stdout:5/306: symlink d2/d12/l61 0 2024-09-13T17:05:45.646 INFO:tasks.workunit.client.1.smithi195.stdout:1/275: dwrite db/df/d4d/f4f [0,4194304] 0 2024-09-13T17:05:45.647 INFO:tasks.workunit.client.0.smithi115.stdout:3/414: symlink d1/d4b/l87 0 2024-09-13T17:05:45.647 INFO:tasks.workunit.client.0.smithi115.stdout:3/415: read - d1/d4b/f76 zero size 2024-09-13T17:05:45.651 INFO:tasks.workunit.client.1.smithi195.stdout:4/369: mkdir d1a/d1f/d43/d24/d41/d60/d75 0 2024-09-13T17:05:45.652 INFO:tasks.workunit.client.0.smithi115.stdout:2/322: creat d3/d4d/de/d3a/f6d x:0 0 0 2024-09-13T17:05:45.652 INFO:tasks.workunit.client.0.smithi115.stdout:2/323: getdents d3/d4d/d13/d6b 0 2024-09-13T17:05:45.653 INFO:tasks.workunit.client.1.smithi195.stdout:9/320: mkdir d6/df/d16/d65 0 2024-09-13T17:05:45.653 INFO:tasks.workunit.client.1.smithi195.stdout:9/321: chown d6/d19/d21/l4f 5565229 1 2024-09-13T17:05:45.654 INFO:tasks.workunit.client.0.smithi115.stdout:8/231: creat d0/d15/d3e/f41 x:0 0 0 2024-09-13T17:05:45.654 INFO:tasks.workunit.client.0.smithi115.stdout:4/318: dread d7/f19 [0,4194304] 0 2024-09-13T17:05:45.655 INFO:tasks.workunit.client.0.smithi115.stdout:4/319: readlink d7/dd/l5b 0 2024-09-13T17:05:45.655 INFO:tasks.workunit.client.1.smithi195.stdout:2/331: symlink d0/d4a/d1c/l6a 0 2024-09-13T17:05:45.656 INFO:tasks.workunit.client.0.smithi115.stdout:8/232: dread d0/d15/f2f [0,4194304] 0 2024-09-13T17:05:45.659 INFO:tasks.workunit.client.0.smithi115.stdout:2/324: creat d3/d4d/d13/f6e x:0 0 0 2024-09-13T17:05:45.664 INFO:tasks.workunit.client.0.smithi115.stdout:8/233: mkdir d0/d42 0 2024-09-13T17:05:45.665 INFO:tasks.workunit.client.1.smithi195.stdout:2/332: write d0/d3/fe [2938084,78925] 0 2024-09-13T17:05:45.665 INFO:tasks.workunit.client.1.smithi195.stdout:2/333: chown d0/d3/df/l1f 58 1 2024-09-13T17:05:45.666 INFO:tasks.workunit.client.0.smithi115.stdout:2/325: mknod d3/d4d/de/c6f 0 2024-09-13T17:05:45.666 INFO:tasks.workunit.client.0.smithi115.stdout:2/326: truncate d3/d4d/de/f59 618435 0 2024-09-13T17:05:45.666 INFO:tasks.workunit.client.0.smithi115.stdout:2/327: chown d3/d4d/dd/d1f/d2f/d56/f29 1837418 1 2024-09-13T17:05:45.666 INFO:tasks.workunit.client.0.smithi115.stdout:2/328: truncate d3/d4d/dd/d1f/d2f/d56/f26 4705158 0 2024-09-13T17:05:45.669 INFO:tasks.workunit.client.0.smithi115.stdout:0/182: link d9/c13 d9/c2f 0 2024-09-13T17:05:45.669 INFO:tasks.workunit.client.0.smithi115.stdout:2/329: dread d3/d4d/de/f2a [0,4194304] 0 2024-09-13T17:05:45.670 INFO:tasks.workunit.client.1.smithi195.stdout:6/275: dwrite d1c/d28/f2b [4194304,4194304] 0 2024-09-13T17:05:45.671 INFO:tasks.workunit.client.1.smithi195.stdout:5/307: dread d2/d3e/f3a [0,4194304] 0 2024-09-13T17:05:45.672 INFO:tasks.workunit.client.0.smithi115.stdout:8/234: mkdir d0/d18/d43 0 2024-09-13T17:05:45.674 INFO:tasks.workunit.client.0.smithi115.stdout:0/183: mkdir d9/d1d/d24/d26/d2d/d30 0 2024-09-13T17:05:45.674 INFO:tasks.workunit.client.0.smithi115.stdout:5/223: dwrite fd [0,4194304] 0 2024-09-13T17:05:45.675 INFO:tasks.workunit.client.0.smithi115.stdout:2/330: mkdir d3/d4d/d13/d39/d46/d70 0 2024-09-13T17:05:45.676 INFO:tasks.workunit.client.1.smithi195.stdout:1/276: truncate db/f11 7936575 0 2024-09-13T17:05:45.679 INFO:tasks.workunit.client.1.smithi195.stdout:3/263: dwrite d7/d19/d1e/f3f [0,4194304] 0 2024-09-13T17:05:45.681 INFO:tasks.workunit.client.0.smithi115.stdout:4/320: dwrite d7/dd/de/f1c [4194304,4194304] 0 2024-09-13T17:05:45.681 INFO:tasks.workunit.client.0.smithi115.stdout:4/321: read d7/f36 [102464,108031] 0 2024-09-13T17:05:45.681 INFO:tasks.workunit.client.0.smithi115.stdout:4/322: creat d7/dd/de/f5e x:0 0 0 2024-09-13T17:05:45.681 INFO:tasks.workunit.client.0.smithi115.stdout:4/323: chown d7/dd/de/f59 118481 1 2024-09-13T17:05:45.691 INFO:tasks.workunit.client.0.smithi115.stdout:2/331: dwrite d3/d4d/de/f59 [0,4194304] 0 2024-09-13T17:05:45.754 INFO:tasks.workunit.client.1.smithi195.stdout:4/370: symlink d1a/d1f/d43/d24/d41/l76 0 2024-09-13T17:05:45.755 INFO:tasks.workunit.client.1.smithi195.stdout:4/371: creat d1a/d1f/d21/d22/f77 x:0 0 0 2024-09-13T17:05:45.757 INFO:tasks.workunit.client.1.smithi195.stdout:6/276: mknod d1c/d3e/c56 0 2024-09-13T17:05:45.757 INFO:tasks.workunit.client.0.smithi115.stdout:5/224: rmdir d19/d2c 39 2024-09-13T17:05:45.761 INFO:tasks.workunit.client.1.smithi195.stdout:1/277: link db/df/d13/f27 db/df/f63 0 2024-09-13T17:05:45.764 INFO:tasks.workunit.client.1.smithi195.stdout:3/264: unlink d7/d19/l29 0 2024-09-13T17:05:45.764 INFO:tasks.workunit.client.1.smithi195.stdout:3/265: read d7/d21/d2a/f3b [405709,84002] 0 2024-09-13T17:05:45.764 INFO:tasks.workunit.client.1.smithi195.stdout:3/266: creat d7/d21/d2a/f44 x:0 0 0 2024-09-13T17:05:45.768 INFO:tasks.workunit.client.0.smithi115.stdout:2/332: creat d3/d4d/dd/df/d5c/f71 x:0 0 0 2024-09-13T17:05:45.769 INFO:tasks.workunit.client.0.smithi115.stdout:2/333: fsync d3/d4d/de/f43 0 2024-09-13T17:05:45.769 INFO:tasks.workunit.client.1.smithi195.stdout:4/372: rmdir d1a/d1f/d43/d24/d41/d60/d75 0 2024-09-13T17:05:45.771 INFO:tasks.workunit.client.1.smithi195.stdout:8/314: rmdir d0/d13/d4d 39 2024-09-13T17:05:45.772 INFO:tasks.workunit.client.0.smithi115.stdout:5/225: truncate d19/d21/f22 990886 0 2024-09-13T17:05:45.777 INFO:tasks.workunit.client.0.smithi115.stdout:2/334: getdents d3 0 2024-09-13T17:05:45.779 INFO:tasks.workunit.client.1.smithi195.stdout:6/277: creat d1c/d2d/d30/f57 x:0 0 0 2024-09-13T17:05:45.779 INFO:tasks.workunit.client.1.smithi195.stdout:6/278: creat d1c/d28/f58 x:0 0 0 2024-09-13T17:05:45.781 INFO:tasks.workunit.client.1.smithi195.stdout:9/322: rmdir d6 39 2024-09-13T17:05:45.781 INFO:tasks.workunit.client.1.smithi195.stdout:9/323: truncate d6/d19/d21/d64/f53 981288 0 2024-09-13T17:05:45.782 INFO:tasks.workunit.client.1.smithi195.stdout:5/308: getdents d2/d12/d3f 0 2024-09-13T17:05:45.783 INFO:tasks.workunit.client.0.smithi115.stdout:2/335: rmdir d3/d4d/de/d3a 39 2024-09-13T17:05:45.785 INFO:tasks.workunit.client.0.smithi115.stdout:5/226: dread d19/d21/f2a [0,4194304] 0 2024-09-13T17:05:45.785 INFO:tasks.workunit.client.0.smithi115.stdout:5/227: fdatasync d19/d1d/f2f 0 2024-09-13T17:05:45.785 INFO:tasks.workunit.client.0.smithi115.stdout:5/228: fsync d19/d2b/f44 0 2024-09-13T17:05:45.785 INFO:tasks.workunit.client.1.smithi195.stdout:1/278: rename db/f17 to db/d19/f64 0 2024-09-13T17:05:45.785 INFO:tasks.workunit.client.1.smithi195.stdout:1/279: getdents db/df/d51/d62 0 2024-09-13T17:05:45.786 INFO:tasks.workunit.client.0.smithi115.stdout:2/336: mkdir d3/d4d/dd/d1f/d2f/d56/d58/d72 0 2024-09-13T17:05:45.788 INFO:tasks.workunit.client.1.smithi195.stdout:3/267: mknod d7/d19/d1e/c45 0 2024-09-13T17:05:45.789 INFO:tasks.workunit.client.0.smithi115.stdout:2/337: link d3/d4d/dd/l4f d3/d4d/dd/l73 0 2024-09-13T17:05:45.793 INFO:tasks.workunit.client.1.smithi195.stdout:4/373: dwrite d1a/d1f/d43/d29/f2a [0,4194304] 0 2024-09-13T17:05:45.797 INFO:tasks.workunit.client.0.smithi115.stdout:5/229: dread d19/d21/f4a [0,4194304] 0 2024-09-13T17:05:45.798 INFO:tasks.workunit.client.1.smithi195.stdout:9/324: dread d6/f1e [0,4194304] 0 2024-09-13T17:05:45.798 INFO:tasks.workunit.client.1.smithi195.stdout:8/315: dwrite d0/d17/d2f/d31/f53 [0,4194304] 0 2024-09-13T17:05:45.798 INFO:tasks.workunit.client.1.smithi195.stdout:8/316: read - d0/f61 zero size 2024-09-13T17:05:45.798 INFO:tasks.workunit.client.1.smithi195.stdout:8/317: creat d0/d17/f68 x:0 0 0 2024-09-13T17:05:45.798 INFO:tasks.workunit.client.1.smithi195.stdout:8/318: readlink d0/l54 0 2024-09-13T17:05:45.799 INFO:tasks.workunit.client.1.smithi195.stdout:6/279: dwrite d1c/d28/d35/f4d [0,4194304] 0 2024-09-13T17:05:45.799 INFO:tasks.workunit.client.1.smithi195.stdout:6/280: read - d1c/d28/d35/f45 zero size 2024-09-13T17:05:45.799 INFO:tasks.workunit.client.1.smithi195.stdout:6/281: truncate d1c/d28/d35/f36 693897 0 2024-09-13T17:05:45.806 INFO:tasks.workunit.client.0.smithi115.stdout:5/230: read d19/f3c [1633644,32198] 0 2024-09-13T17:05:45.810 INFO:tasks.workunit.client.0.smithi115.stdout:5/231: dread d19/d21/f4a [0,4194304] 0 2024-09-13T17:05:45.810 INFO:tasks.workunit.client.0.smithi115.stdout:5/232: chown cf 26681 1 2024-09-13T17:05:45.811 INFO:tasks.workunit.client.0.smithi115.stdout:2/338: dwrite d3/d4d/de/f15 [4194304,4194304] 0 2024-09-13T17:05:45.812 INFO:tasks.workunit.client.0.smithi115.stdout:2/339: dread d3/d4d/de/d3a/d47/f49 [0,4194304] 0 2024-09-13T17:05:45.812 INFO:tasks.workunit.client.0.smithi115.stdout:2/340: dread - d3/d4d/dd/df/f65 zero size 2024-09-13T17:05:45.814 INFO:tasks.workunit.client.0.smithi115.stdout:2/341: dread d3/d4d/d13/f51 [0,4194304] 0 2024-09-13T17:05:45.814 INFO:tasks.workunit.client.0.smithi115.stdout:2/342: truncate d3/d4d/de/d3a/f6d 764806 0 2024-09-13T17:05:45.828 INFO:tasks.workunit.client.1.smithi195.stdout:5/309: getdents d2/df/d48/d5a 0 2024-09-13T17:05:45.829 INFO:tasks.workunit.client.1.smithi195.stdout:1/280: mknod db/d19/d37/c65 0 2024-09-13T17:05:45.829 INFO:tasks.workunit.client.1.smithi195.stdout:1/281: dread - db/f2b zero size 2024-09-13T17:05:45.829 INFO:tasks.workunit.client.1.smithi195.stdout:1/282: stat db/df/d13/l25 0 2024-09-13T17:05:45.830 INFO:tasks.workunit.client.1.smithi195.stdout:3/268: unlink d7/d21/d2a/f44 0 2024-09-13T17:05:45.830 INFO:tasks.workunit.client.1.smithi195.stdout:3/269: fsync d7/d21/f26 0 2024-09-13T17:05:45.831 INFO:tasks.workunit.client.1.smithi195.stdout:3/270: chown d7/d19/c1f 26072708 1 2024-09-13T17:05:45.834 INFO:tasks.workunit.client.1.smithi195.stdout:4/374: creat d1a/d1f/d43/d24/f78 x:0 0 0 2024-09-13T17:05:45.835 INFO:tasks.workunit.client.0.smithi115.stdout:8/235: rmdir d0/d18 39 2024-09-13T17:05:45.835 INFO:tasks.workunit.client.0.smithi115.stdout:8/236: write d0/d18/d19/d28/f30 [4870993,97497] 0 2024-09-13T17:05:45.835 INFO:tasks.workunit.client.0.smithi115.stdout:8/237: write d0/d15/d3e/f41 [354010,37338] 0 2024-09-13T17:05:45.835 INFO:tasks.workunit.client.1.smithi195.stdout:9/325: mknod d6/d19/d21/d45/c66 0 2024-09-13T17:05:45.837 INFO:tasks.workunit.client.1.smithi195.stdout:0/308: sync 2024-09-13T17:05:45.837 INFO:tasks.workunit.client.1.smithi195.stdout:0/309: write d7/d50/f30 [739118,126629] 0 2024-09-13T17:05:45.837 INFO:tasks.workunit.client.1.smithi195.stdout:7/335: sync 2024-09-13T17:05:45.847 INFO:tasks.workunit.client.1.smithi195.stdout:9/326: write d6/df/f3c [1181713,96024] 0 2024-09-13T17:05:45.851 INFO:tasks.workunit.client.1.smithi195.stdout:9/327: read d6/d19/d21/d64/f53 [456453,29236] 0 2024-09-13T17:05:45.851 INFO:tasks.workunit.client.1.smithi195.stdout:8/319: truncate d0/d4/fb 1964111 0 2024-09-13T17:05:45.851 INFO:tasks.workunit.client.1.smithi195.stdout:8/320: read - d0/d13/f57 zero size 2024-09-13T17:05:45.854 INFO:tasks.workunit.client.1.smithi195.stdout:2/334: sync 2024-09-13T17:05:45.854 INFO:tasks.workunit.client.1.smithi195.stdout:2/335: chown d0/d4a/d1c/d2c/l5f 167789645 1 2024-09-13T17:05:45.854 INFO:tasks.workunit.client.0.smithi115.stdout:2/343: rmdir d3/d4d/d13 39 2024-09-13T17:05:45.854 INFO:tasks.workunit.client.0.smithi115.stdout:2/344: write d3/d4d/dd/d1f/d2f/d56/f42 [921274,109607] 0 2024-09-13T17:05:45.854 INFO:tasks.workunit.client.0.smithi115.stdout:2/345: readlink d3/d4d/dd/d1f/d2f/l41 0 2024-09-13T17:05:45.854 INFO:tasks.workunit.client.0.smithi115.stdout:2/346: creat d3/d4d/de/f74 x:0 0 0 2024-09-13T17:05:45.856 INFO:tasks.workunit.client.0.smithi115.stdout:8/238: mkdir d0/d15/d44 0 2024-09-13T17:05:45.857 INFO:tasks.workunit.client.1.smithi195.stdout:6/282: symlink d1c/d2d/l59 0 2024-09-13T17:05:45.857 INFO:tasks.workunit.client.1.smithi195.stdout:6/283: dread - d1c/d24/f51 zero size 2024-09-13T17:05:45.858 INFO:tasks.workunit.client.0.smithi115.stdout:4/324: truncate d7/dd/de/f13 8216615 0 2024-09-13T17:05:45.858 INFO:tasks.workunit.client.0.smithi115.stdout:4/325: write d7/dd/de/f5e [897210,64490] 0 2024-09-13T17:05:45.858 INFO:tasks.workunit.client.1.smithi195.stdout:0/310: dwrite d7/d50/f5c [0,4194304] 0 2024-09-13T17:05:45.865 INFO:tasks.workunit.client.1.smithi195.stdout:7/336: dwrite d5/db/d19/d22/f5d [0,4194304] 0 2024-09-13T17:05:45.866 INFO:tasks.workunit.client.1.smithi195.stdout:7/337: fsync d5/d35/d37/f65 0 2024-09-13T17:05:45.866 INFO:tasks.workunit.client.1.smithi195.stdout:7/338: fdatasync d5/d13/f6a 0 2024-09-13T17:05:45.866 INFO:tasks.workunit.client.1.smithi195.stdout:0/311: write d7/d8/d23/f27 [2772623,128148] 0 2024-09-13T17:05:45.866 INFO:tasks.workunit.client.1.smithi195.stdout:0/312: write d7/d8/d23/d4b/d56/d46/f48 [871996,45528] 0 2024-09-13T17:05:45.866 INFO:tasks.workunit.client.1.smithi195.stdout:0/313: creat d7/d8/d23/d4b/d4e/f5f x:0 0 0 2024-09-13T17:05:45.874 INFO:tasks.workunit.client.0.smithi115.stdout:8/239: mknod d0/d26/c45 0 2024-09-13T17:05:45.880 INFO:tasks.workunit.client.0.smithi115.stdout:4/326: mknod d7/dd/de/d4e/d5a/d4f/d53/c5f 0 2024-09-13T17:05:45.884 INFO:tasks.workunit.client.0.smithi115.stdout:8/240: truncate d0/d15/f1b 1398374 0 2024-09-13T17:05:45.884 INFO:tasks.workunit.client.0.smithi115.stdout:8/241: write d0/d26/d29/f38 [968007,23588] 0 2024-09-13T17:05:45.885 INFO:tasks.workunit.client.0.smithi115.stdout:4/327: symlink d7/dd/de/d57/l60 0 2024-09-13T17:05:45.886 INFO:tasks.workunit.client.0.smithi115.stdout:8/242: rename d0/l16 to d0/d15/d3e/l46 0 2024-09-13T17:05:45.888 INFO:tasks.workunit.client.0.smithi115.stdout:4/328: unlink d7/dd/de/f4a 0 2024-09-13T17:05:45.888 INFO:tasks.workunit.client.0.smithi115.stdout:4/329: write d7/dd/de/f3a [460182,80234] 0 2024-09-13T17:05:45.889 INFO:tasks.workunit.client.0.smithi115.stdout:4/330: creat d7/dd/de/f61 x:0 0 0 2024-09-13T17:05:45.889 INFO:tasks.workunit.client.0.smithi115.stdout:4/331: truncate d7/f2d 4451058 0 2024-09-13T17:05:45.890 INFO:tasks.workunit.client.1.smithi195.stdout:5/310: mkdir d2/df/d62 0 2024-09-13T17:05:45.892 INFO:tasks.workunit.client.1.smithi195.stdout:1/283: mkdir db/d19/d5a/d66 0 2024-09-13T17:05:45.893 INFO:tasks.workunit.client.0.smithi115.stdout:4/332: creat d7/dd/de/d4e/f62 x:0 0 0 2024-09-13T17:05:45.893 INFO:tasks.workunit.client.0.smithi115.stdout:4/333: chown d7/f36 11 1 2024-09-13T17:05:45.893 INFO:tasks.workunit.client.0.smithi115.stdout:4/334: readlink d7/dd/l5b 0 2024-09-13T17:05:45.893 INFO:tasks.workunit.client.0.smithi115.stdout:4/335: stat d7/dd/de/l39 0 2024-09-13T17:05:45.894 INFO:tasks.workunit.client.1.smithi195.stdout:4/375: symlink d1a/d1f/d21/d36/l79 0 2024-09-13T17:05:45.897 INFO:tasks.workunit.client.1.smithi195.stdout:8/321: mkdir d0/d13/d69 0 2024-09-13T17:05:45.898 INFO:tasks.workunit.client.1.smithi195.stdout:2/336: creat d0/d4a/d1c/d2c/d43/d63/f6b x:0 0 0 2024-09-13T17:05:45.898 INFO:tasks.workunit.client.1.smithi195.stdout:2/337: chown d0/f45 8946065 1 2024-09-13T17:05:45.898 INFO:tasks.workunit.client.1.smithi195.stdout:2/338: chown d0/f48 798493 1 2024-09-13T17:05:45.898 INFO:tasks.workunit.client.1.smithi195.stdout:6/284: symlink d1c/d28/d46/l5a 0 2024-09-13T17:05:45.900 INFO:tasks.workunit.client.1.smithi195.stdout:0/314: dwrite d7/d50/f1b [0,4194304] 0 2024-09-13T17:05:45.900 INFO:tasks.workunit.client.1.smithi195.stdout:0/315: fdatasync d7/d50/f1b 0 2024-09-13T17:05:45.901 INFO:tasks.workunit.client.1.smithi195.stdout:1/284: write db/df/f3a [2401982,50585] 0 2024-09-13T17:05:45.910 INFO:tasks.workunit.client.1.smithi195.stdout:1/285: write db/df/d4d/f4f [3802691,86429] 0 2024-09-13T17:05:45.910 INFO:tasks.workunit.client.1.smithi195.stdout:1/286: truncate db/df/f1f 454693 0 2024-09-13T17:05:45.925 INFO:tasks.workunit.client.0.smithi115.stdout:8/243: dwrite d0/d18/f1c [0,4194304] 0 2024-09-13T17:05:45.926 INFO:tasks.workunit.client.1.smithi195.stdout:5/311: dwrite d2/df/d39/f44 [4194304,4194304] 0 2024-09-13T17:05:45.926 INFO:tasks.workunit.client.1.smithi195.stdout:5/312: chown d2/df/d48/d5a/c5e 15251995 1 2024-09-13T17:05:45.926 INFO:tasks.workunit.client.1.smithi195.stdout:1/287: dwrite db/d19/f4a [0,4194304] 0 2024-09-13T17:05:45.999 INFO:tasks.workunit.client.1.smithi195.stdout:7/339: mknod d5/d13/d30/c6d 0 2024-09-13T17:05:46.003 INFO:tasks.workunit.client.1.smithi195.stdout:3/271: mkdir d7/d46 0 2024-09-13T17:05:46.003 INFO:tasks.workunit.client.1.smithi195.stdout:3/272: write d7/f14 [3311833,124315] 0 2024-09-13T17:05:46.003 INFO:tasks.workunit.client.1.smithi195.stdout:3/273: readlink d7/d19/l25 0 2024-09-13T17:05:46.004 INFO:tasks.workunit.client.0.smithi115.stdout:8/244: link d0/d21/f32 d0/d15/d3e/f47 0 2024-09-13T17:05:46.004 INFO:tasks.workunit.client.0.smithi115.stdout:8/245: chown d0/d15/f1b 19 1 2024-09-13T17:05:46.005 INFO:tasks.workunit.client.1.smithi195.stdout:4/376: mknod d1a/d1f/d43/c7a 0 2024-09-13T17:05:46.005 INFO:tasks.workunit.client.1.smithi195.stdout:4/377: chown d1a/d1f/d21/d36/l79 3 1 2024-09-13T17:05:46.006 INFO:tasks.workunit.client.0.smithi115.stdout:8/246: dread d0/d26/f35 [0,4194304] 0 2024-09-13T17:05:46.006 INFO:tasks.workunit.client.1.smithi195.stdout:6/285: stat l3 0 2024-09-13T17:05:46.009 INFO:tasks.workunit.client.0.smithi115.stdout:8/247: symlink d0/d15/d3e/l48 0 2024-09-13T17:05:46.009 INFO:tasks.workunit.client.0.smithi115.stdout:8/248: readlink d0/l9 0 2024-09-13T17:05:46.011 INFO:tasks.workunit.client.0.smithi115.stdout:8/249: creat d0/d15/d44/f49 x:0 0 0 2024-09-13T17:05:46.011 INFO:tasks.workunit.client.0.smithi115.stdout:8/250: write d0/d18/d19/d2b/f3d [944232,84419] 0 2024-09-13T17:05:46.013 INFO:tasks.workunit.client.1.smithi195.stdout:3/274: dread d7/f14 [0,4194304] 0 2024-09-13T17:05:46.014 INFO:tasks.workunit.client.0.smithi115.stdout:8/251: creat d0/d21/f4a x:0 0 0 2024-09-13T17:05:46.018 INFO:tasks.workunit.client.1.smithi195.stdout:5/313: link d2/df/d39/d54/c57 d2/d12/d4e/d10/c63 0 2024-09-13T17:05:46.020 INFO:tasks.workunit.client.0.smithi115.stdout:8/252: rmdir d0/d26/d29 39 2024-09-13T17:05:46.020 INFO:tasks.workunit.client.0.smithi115.stdout:8/253: chown d0/le 110614480 1 2024-09-13T17:05:46.021 INFO:tasks.workunit.client.0.smithi115.stdout:8/254: creat d0/d15/d3e/f4b x:0 0 0 2024-09-13T17:05:46.024 INFO:tasks.workunit.client.1.smithi195.stdout:1/288: mkdir db/df/d4d/d67 0 2024-09-13T17:05:46.024 INFO:tasks.workunit.client.0.smithi115.stdout:8/255: mknod d0/d18/c4c 0 2024-09-13T17:05:46.030 INFO:tasks.workunit.client.1.smithi195.stdout:7/340: mknod d5/d13/c6e 0 2024-09-13T17:05:46.037 INFO:tasks.workunit.client.1.smithi195.stdout:5/314: creat d2/d12/d4e/d10/d46/f64 x:0 0 0 2024-09-13T17:05:46.037 INFO:tasks.workunit.client.1.smithi195.stdout:5/315: chown d2/f17 17058 1 2024-09-13T17:05:46.037 INFO:tasks.workunit.client.1.smithi195.stdout:5/316: readlink d2/d12/d4e/l1f 0 2024-09-13T17:05:46.037 INFO:tasks.workunit.client.1.smithi195.stdout:5/317: stat d2/d3e/f3a 0 2024-09-13T17:05:46.037 INFO:tasks.workunit.client.1.smithi195.stdout:1/289: symlink db/d60/l68 0 2024-09-13T17:05:46.038 INFO:tasks.workunit.client.1.smithi195.stdout:7/341: mknod d5/d35/d37/c6f 0 2024-09-13T17:05:46.039 INFO:tasks.workunit.client.1.smithi195.stdout:4/378: rmdir d1a/d1f/d43/d5a 39 2024-09-13T17:05:46.039 INFO:tasks.workunit.client.1.smithi195.stdout:4/379: creat d1a/d1f/d21/d22/f7b x:0 0 0 2024-09-13T17:05:46.040 INFO:tasks.workunit.client.1.smithi195.stdout:6/286: getdents d1c/d2d/d30 0 2024-09-13T17:05:46.041 INFO:tasks.workunit.client.1.smithi195.stdout:6/287: dread f1a [0,4194304] 0 2024-09-13T17:05:46.043 INFO:tasks.workunit.client.1.smithi195.stdout:5/318: rename d2/df/d48/d5a/c5e to d2/df/d39/d54/d58/c65 0 2024-09-13T17:05:46.044 INFO:tasks.workunit.client.1.smithi195.stdout:1/290: mknod db/d19/d37/d46/c69 0 2024-09-13T17:05:46.044 INFO:tasks.workunit.client.1.smithi195.stdout:1/291: fdatasync db/df/d4d/f4f 0 2024-09-13T17:05:46.044 INFO:tasks.workunit.client.1.smithi195.stdout:1/292: dread - db/df/d51/f53 zero size 2024-09-13T17:05:46.046 INFO:tasks.workunit.client.1.smithi195.stdout:7/342: mkdir d5/d13/d24/d70 0 2024-09-13T17:05:46.049 INFO:tasks.workunit.client.1.smithi195.stdout:3/275: link d7/lf d7/l47 0 2024-09-13T17:05:46.050 INFO:tasks.workunit.client.1.smithi195.stdout:6/288: creat d1c/d2d/d30/f5b x:0 0 0 2024-09-13T17:05:46.051 INFO:tasks.workunit.client.1.smithi195.stdout:7/343: truncate d5/db/d19/d22/f38 749430 0 2024-09-13T17:05:46.051 INFO:tasks.workunit.client.1.smithi195.stdout:7/344: fdatasync d5/db/d19/d22/f5b 0 2024-09-13T17:05:46.051 INFO:tasks.workunit.client.1.smithi195.stdout:7/345: fsync d5/d13/f1d 0 2024-09-13T17:05:46.051 INFO:tasks.workunit.client.1.smithi195.stdout:3/276: creat d7/d19/f48 x:0 0 0 2024-09-13T17:05:46.052 INFO:tasks.workunit.client.1.smithi195.stdout:3/277: readlink d7/l47 0 2024-09-13T17:05:46.052 INFO:tasks.workunit.client.1.smithi195.stdout:3/278: chown d7/d19/f48 1 1 2024-09-13T17:05:46.052 INFO:tasks.workunit.client.1.smithi195.stdout:6/289: getdents d1c/d3e 0 2024-09-13T17:05:46.053 INFO:tasks.workunit.client.1.smithi195.stdout:7/346: truncate d5/f6 1030193 0 2024-09-13T17:05:46.054 INFO:tasks.workunit.client.0.smithi115.stdout:8/256: dwrite d0/d18/f1c [0,4194304] 0 2024-09-13T17:05:46.054 INFO:tasks.workunit.client.0.smithi115.stdout:8/257: chown d0/d15/l17 27 1 2024-09-13T17:05:46.055 INFO:tasks.workunit.client.1.smithi195.stdout:6/290: mknod d1c/d24/c5c 0 2024-09-13T17:05:46.055 INFO:tasks.workunit.client.1.smithi195.stdout:6/291: truncate d1c/d2d/f55 770299 0 2024-09-13T17:05:46.055 INFO:tasks.workunit.client.1.smithi195.stdout:7/347: symlink d5/d13/l71 0 2024-09-13T17:05:46.056 INFO:tasks.workunit.client.1.smithi195.stdout:7/348: read d5/d13/d24/f3f [658995,57635] 0 2024-09-13T17:05:46.056 INFO:tasks.workunit.client.1.smithi195.stdout:7/349: write d5/d13/d24/f63 [414718,75899] 0 2024-09-13T17:05:46.056 INFO:tasks.workunit.client.1.smithi195.stdout:7/350: readlink d5/db/d19/l2b 0 2024-09-13T17:05:46.060 INFO:tasks.workunit.client.1.smithi195.stdout:4/380: dwrite d1a/d1f/d21/d22/f4d [0,4194304] 0 2024-09-13T17:05:46.060 INFO:tasks.workunit.client.0.smithi115.stdout:8/258: rename d0/d18/f33 to d0/d15/f4d 0 2024-09-13T17:05:46.061 INFO:tasks.workunit.client.0.smithi115.stdout:8/259: symlink d0/l4e 0 2024-09-13T17:05:46.062 INFO:tasks.workunit.client.1.smithi195.stdout:1/293: dwrite db/f33 [0,4194304] 0 2024-09-13T17:05:46.062 INFO:tasks.workunit.client.1.smithi195.stdout:1/294: readlink db/d19/l34 0 2024-09-13T17:05:46.062 INFO:tasks.workunit.client.1.smithi195.stdout:1/295: creat db/d19/d37/f6a x:0 0 0 2024-09-13T17:05:46.063 INFO:tasks.workunit.client.0.smithi115.stdout:8/260: mkdir d0/d18/d19/d28/d4f 0 2024-09-13T17:05:46.064 INFO:tasks.workunit.client.1.smithi195.stdout:6/292: write d1c/d28/d35/f39 [5820523,117343] 0 2024-09-13T17:05:46.064 INFO:tasks.workunit.client.1.smithi195.stdout:6/293: chown ce 427 1 2024-09-13T17:05:46.064 INFO:tasks.workunit.client.1.smithi195.stdout:4/381: rename d1a/d1f/d21/d22/f7b to d1a/d1f/d21/d36/f7c 0 2024-09-13T17:05:46.066 INFO:tasks.workunit.client.0.smithi115.stdout:8/261: symlink d0/d21/d3a/l50 0 2024-09-13T17:05:46.066 INFO:tasks.workunit.client.0.smithi115.stdout:8/262: chown d0/d18/d19/d2b/d37 76 1 2024-09-13T17:05:46.066 INFO:tasks.workunit.client.1.smithi195.stdout:3/279: dwrite d7/d19/f48 [0,4194304] 0 2024-09-13T17:05:46.068 INFO:tasks.workunit.client.0.smithi115.stdout:8/263: mkdir d0/d18/d51 0 2024-09-13T17:05:46.070 INFO:tasks.workunit.client.0.smithi115.stdout:8/264: rename d0/d15/d3e/f4b to d0/d15/d44/f52 0 2024-09-13T17:05:46.070 INFO:tasks.workunit.client.0.smithi115.stdout:8/265: write d0/d15/d3e/f41 [279106,54013] 0 2024-09-13T17:05:46.076 INFO:tasks.workunit.client.0.smithi115.stdout:8/266: rename d0/d15/f20 to d0/f53 0 2024-09-13T17:05:46.076 INFO:tasks.workunit.client.0.smithi115.stdout:8/267: truncate d0/f13 8526872 0 2024-09-13T17:05:46.080 INFO:tasks.workunit.client.0.smithi115.stdout:8/268: rename d0/l4 to d0/d26/l54 0 2024-09-13T17:05:46.080 INFO:tasks.workunit.client.1.smithi195.stdout:3/280: getdents d7/d21/d2a/d35 0 2024-09-13T17:05:46.081 INFO:tasks.workunit.client.1.smithi195.stdout:6/294: mkdir d1c/d5d 0 2024-09-13T17:05:46.085 INFO:tasks.workunit.client.1.smithi195.stdout:3/281: truncate d7/d19/d1e/f3f 2762430 0 2024-09-13T17:05:46.086 INFO:tasks.workunit.client.1.smithi195.stdout:3/282: mknod d7/d21/d2a/c49 0 2024-09-13T17:05:46.086 INFO:tasks.workunit.client.1.smithi195.stdout:3/283: stat d7/lb 0 2024-09-13T17:05:46.092 INFO:tasks.workunit.client.0.smithi115.stdout:2/347: rmdir d3/d4d 39 2024-09-13T17:05:46.105 INFO:tasks.workunit.client.1.smithi195.stdout:2/339: creat d0/f6c x:0 0 0 2024-09-13T17:05:46.105 INFO:tasks.workunit.client.1.smithi195.stdout:2/340: readlink d0/d3/d3d/l4c 0 2024-09-13T17:05:46.105 INFO:tasks.workunit.client.1.smithi195.stdout:2/341: chown d0/d4a/d1c/d2c/d51/l3b 30394615 1 2024-09-13T17:05:46.107 INFO:tasks.workunit.client.1.smithi195.stdout:2/342: rename d0/d3/df/l67 to d0/d4a/d1c/d2c/d43/l6d 0 2024-09-13T17:05:46.107 INFO:tasks.workunit.client.1.smithi195.stdout:2/343: stat d0/d3/c40 0 2024-09-13T17:05:46.118 INFO:tasks.workunit.client.0.smithi115.stdout:6/212: sync 2024-09-13T17:05:46.118 INFO:tasks.workunit.client.0.smithi115.stdout:1/153: sync 2024-09-13T17:05:46.118 INFO:tasks.workunit.client.0.smithi115.stdout:9/160: sync 2024-09-13T17:05:46.124 INFO:tasks.workunit.client.0.smithi115.stdout:6/213: rename d8/d2c to d8/d33/d40 0 2024-09-13T17:05:46.129 INFO:tasks.workunit.client.1.smithi195.stdout:9/328: rmdir d6 39 2024-09-13T17:05:46.129 INFO:tasks.workunit.client.1.smithi195.stdout:9/329: chown d6/d19/f1f 235540267 1 2024-09-13T17:05:46.130 INFO:tasks.workunit.client.1.smithi195.stdout:9/330: link d6/d19/d21/d45/c66 d6/d19/d21/d64/c67 0 2024-09-13T17:05:46.131 INFO:tasks.workunit.client.1.smithi195.stdout:9/331: rmdir d6/d19/d21/d45 39 2024-09-13T17:05:46.131 INFO:tasks.workunit.client.1.smithi195.stdout:9/332: chown d6/df/d13/d44/d47/d61 0 1 2024-09-13T17:05:46.132 INFO:tasks.workunit.client.1.smithi195.stdout:9/333: mkdir d6/d19/d21/d64/d68 0 2024-09-13T17:05:46.133 INFO:tasks.workunit.client.1.smithi195.stdout:9/334: creat d6/f69 x:0 0 0 2024-09-13T17:05:46.133 INFO:tasks.workunit.client.1.smithi195.stdout:9/335: read d6/d19/d21/d45/f5a [165053,185] 0 2024-09-13T17:05:46.134 INFO:tasks.workunit.client.1.smithi195.stdout:9/336: chown d6/d19/f4c 1792142744 1 2024-09-13T17:05:46.134 INFO:tasks.workunit.client.1.smithi195.stdout:9/337: chown d6/df/d16/d5c 50 1 2024-09-13T17:05:46.143 INFO:tasks.workunit.client.1.smithi195.stdout:9/338: truncate d6/df/f3c 729451 0 2024-09-13T17:05:46.143 INFO:tasks.workunit.client.1.smithi195.stdout:9/339: write d6/df/f38 [731915,76549] 0 2024-09-13T17:05:46.143 INFO:tasks.workunit.client.1.smithi195.stdout:9/340: dread - d6/d19/d21/d5b/f50 zero size 2024-09-13T17:05:46.143 INFO:tasks.workunit.client.1.smithi195.stdout:9/341: symlink d6/d19/d21/d5b/l6a 0 2024-09-13T17:05:46.146 INFO:tasks.workunit.client.1.smithi195.stdout:0/316: truncate d7/d8/d23/f27 2188440 0 2024-09-13T17:05:46.159 INFO:tasks.workunit.client.1.smithi195.stdout:2/344: dread d0/d4a/d1c/d1e/f52 [0,4194304] 0 2024-09-13T17:05:46.160 INFO:tasks.workunit.client.0.smithi115.stdout:3/416: sync 2024-09-13T17:05:46.160 INFO:tasks.workunit.client.0.smithi115.stdout:7/195: sync 2024-09-13T17:05:46.160 INFO:tasks.workunit.client.0.smithi115.stdout:5/233: sync 2024-09-13T17:05:46.160 INFO:tasks.workunit.client.0.smithi115.stdout:7/196: fdatasync d0/d2/df/d21/d25/f2c 0 2024-09-13T17:05:46.160 INFO:tasks.workunit.client.0.smithi115.stdout:7/197: getdents d0/d2/df/d21/d25/d44 0 2024-09-13T17:05:46.160 INFO:tasks.workunit.client.0.smithi115.stdout:7/198: write d0/d2/f8 [2387155,105238] 0 2024-09-13T17:05:46.160 INFO:tasks.workunit.client.0.smithi115.stdout:0/184: sync 2024-09-13T17:05:46.161 INFO:tasks.workunit.client.0.smithi115.stdout:5/234: symlink d19/d1d/l56 0 2024-09-13T17:05:46.161 INFO:tasks.workunit.client.1.smithi195.stdout:6/295: dwrite d1c/d28/f50 [0,4194304] 0 2024-09-13T17:05:46.162 INFO:tasks.workunit.client.0.smithi115.stdout:3/417: symlink d1/d83/l88 0 2024-09-13T17:05:46.163 INFO:tasks.workunit.client.0.smithi115.stdout:2/348: dwrite d3/d4d/dd/d1f/d2f/d56/f29 [0,4194304] 0 2024-09-13T17:05:46.163 INFO:tasks.workunit.client.0.smithi115.stdout:1/154: write d5/f22 [4110050,109651] 0 2024-09-13T17:05:46.164 INFO:tasks.workunit.client.0.smithi115.stdout:9/161: dwrite d0/f31 [0,4194304] 0 2024-09-13T17:05:46.164 INFO:tasks.workunit.client.0.smithi115.stdout:9/162: chown d0/de/d10/l25 3097449 1 2024-09-13T17:05:46.166 INFO:tasks.workunit.client.0.smithi115.stdout:7/199: mknod d0/c48 0 2024-09-13T17:05:46.166 INFO:tasks.workunit.client.0.smithi115.stdout:7/200: readlink d0/d2/df/d21/d2d/l37 0 2024-09-13T17:05:46.166 INFO:tasks.workunit.client.0.smithi115.stdout:7/201: truncate d0/d2/df/d21/d25/f2c 565894 0 2024-09-13T17:05:46.168 INFO:tasks.workunit.client.0.smithi115.stdout:3/418: mknod d1/d4b/d1a/d6e/c89 0 2024-09-13T17:05:46.169 INFO:tasks.workunit.client.1.smithi195.stdout:2/345: read d0/d3/f4e [3950978,93411] 0 2024-09-13T17:05:46.170 INFO:tasks.workunit.client.1.smithi195.stdout:6/296: mkdir d1c/d2d/d5e 0 2024-09-13T17:05:46.172 INFO:tasks.workunit.client.0.smithi115.stdout:0/185: rename d9/f12 to d9/d1d/d24/f31 0 2024-09-13T17:05:46.173 INFO:tasks.workunit.client.0.smithi115.stdout:8/269: dwrite d0/fb [0,4194304] 0 2024-09-13T17:05:46.173 INFO:tasks.workunit.client.0.smithi115.stdout:8/270: creat d0/d21/f55 x:0 0 0 2024-09-13T17:05:46.174 INFO:tasks.workunit.client.0.smithi115.stdout:6/214: dwrite d8/db/d1d/f26 [0,4194304] 0 2024-09-13T17:05:46.175 INFO:tasks.workunit.client.1.smithi195.stdout:6/297: unlink d1c/c44 0 2024-09-13T17:05:46.179 INFO:tasks.workunit.client.1.smithi195.stdout:6/298: truncate ff 4573275 0 2024-09-13T17:05:46.182 INFO:tasks.workunit.client.0.smithi115.stdout:7/202: creat d0/d18/f49 x:0 0 0 2024-09-13T17:05:46.182 INFO:tasks.workunit.client.0.smithi115.stdout:7/203: dread - d0/d2/df/f41 zero size 2024-09-13T17:05:46.185 INFO:tasks.workunit.client.1.smithi195.stdout:6/299: unlink l1b 0 2024-09-13T17:05:46.185 INFO:tasks.workunit.client.1.smithi195.stdout:6/300: fdatasync d1c/d2d/d30/f57 0 2024-09-13T17:05:46.187 INFO:tasks.workunit.client.0.smithi115.stdout:3/419: rename d1/l3 to d1/d83/l8a 0 2024-09-13T17:05:46.188 INFO:tasks.workunit.client.0.smithi115.stdout:3/420: chown d1/c84 956197755 1 2024-09-13T17:05:46.191 INFO:tasks.workunit.client.0.smithi115.stdout:1/155: dread d5/d7/f18 [0,4194304] 0 2024-09-13T17:05:46.191 INFO:tasks.workunit.client.0.smithi115.stdout:1/156: truncate d5/fb 613019 0 2024-09-13T17:05:46.196 INFO:tasks.workunit.client.0.smithi115.stdout:8/271: creat d0/d18/f56 x:0 0 0 2024-09-13T17:05:46.197 INFO:tasks.workunit.client.0.smithi115.stdout:7/204: mkdir d0/d2/d4a 0 2024-09-13T17:05:46.198 INFO:tasks.workunit.client.0.smithi115.stdout:3/421: mkdir d1/d4b/d69/d7b/d8b 0 2024-09-13T17:05:46.198 INFO:tasks.workunit.client.0.smithi115.stdout:0/186: rmdir d9/d1b 39 2024-09-13T17:05:46.200 INFO:tasks.workunit.client.0.smithi115.stdout:1/157: symlink d5/l38 0 2024-09-13T17:05:46.200 INFO:tasks.workunit.client.0.smithi115.stdout:1/158: dread - d5/d26/f29 zero size 2024-09-13T17:05:46.200 INFO:tasks.workunit.client.0.smithi115.stdout:1/159: dread - d5/d7/f21 zero size 2024-09-13T17:05:46.200 INFO:tasks.workunit.client.0.smithi115.stdout:1/160: write d5/d7/f21 [255729,80757] 0 2024-09-13T17:05:46.200 INFO:tasks.workunit.client.0.smithi115.stdout:1/161: chown d5/d7/f21 149 1 2024-09-13T17:05:46.201 INFO:tasks.workunit.client.1.smithi195.stdout:6/301: write d1c/d24/f2e [1722343,48644] 0 2024-09-13T17:05:46.201 INFO:tasks.workunit.client.0.smithi115.stdout:8/272: mknod d0/d15/d44/c57 0 2024-09-13T17:05:46.202 INFO:tasks.workunit.client.0.smithi115.stdout:7/205: link d0/d2/df/d21/d25/c2a d0/d2/c4b 0 2024-09-13T17:05:46.202 INFO:tasks.workunit.client.0.smithi115.stdout:7/206: chown d0/d3b 1 1 2024-09-13T17:05:46.203 INFO:tasks.workunit.client.0.smithi115.stdout:7/207: creat d0/d18/f4c x:0 0 0 2024-09-13T17:05:46.204 INFO:tasks.workunit.client.0.smithi115.stdout:3/422: creat d1/d4b/d69/d7b/d8b/f8c x:0 0 0 2024-09-13T17:05:46.205 INFO:tasks.workunit.client.0.smithi115.stdout:0/187: mknod d9/d1b/c32 0 2024-09-13T17:05:46.207 INFO:tasks.workunit.client.0.smithi115.stdout:7/208: symlink d0/d3b/l4d 0 2024-09-13T17:05:46.208 INFO:tasks.workunit.client.0.smithi115.stdout:3/423: link d1/d4b/l7a d1/d12/d23/l8d 0 2024-09-13T17:05:46.209 INFO:tasks.workunit.client.0.smithi115.stdout:0/188: chown d9/c1a 2840 1 2024-09-13T17:05:46.210 INFO:tasks.workunit.client.0.smithi115.stdout:5/235: dwrite d19/d2b/d32/f4e [0,4194304] 0 2024-09-13T17:05:46.210 INFO:tasks.workunit.client.0.smithi115.stdout:5/236: chown d19/d2b/d32/f45 0 1 2024-09-13T17:05:46.210 INFO:tasks.workunit.client.1.smithi195.stdout:6/302: write f17 [211049,127236] 0 2024-09-13T17:05:46.210 INFO:tasks.workunit.client.1.smithi195.stdout:6/303: fsync d1c/f29 0 2024-09-13T17:05:46.210 INFO:tasks.workunit.client.1.smithi195.stdout:2/346: dwrite d0/d4a/f36 [0,4194304] 0 2024-09-13T17:05:46.211 INFO:tasks.workunit.client.1.smithi195.stdout:2/347: write d0/f21 [690326,110429] 0 2024-09-13T17:05:46.211 INFO:tasks.workunit.client.0.smithi115.stdout:2/349: dwrite d3/f5f [0,4194304] 0 2024-09-13T17:05:46.211 INFO:tasks.workunit.client.0.smithi115.stdout:6/215: dwrite d8/db/d1d/f26 [4194304,4194304] 0 2024-09-13T17:05:46.211 INFO:tasks.workunit.client.0.smithi115.stdout:1/162: unlink d5/d7/le 0 2024-09-13T17:05:46.213 INFO:tasks.workunit.client.0.smithi115.stdout:7/209: rename d0/d2/df/f41 to d0/d2/df/d21/d2f/f4e 0 2024-09-13T17:05:46.213 INFO:tasks.workunit.client.0.smithi115.stdout:7/210: chown d0/fa 11542441 1 2024-09-13T17:05:46.217 INFO:tasks.workunit.client.0.smithi115.stdout:3/424: creat d1/d12/d23/f8e x:0 0 0 2024-09-13T17:05:46.219 INFO:tasks.workunit.client.0.smithi115.stdout:0/189: link d9/c1a d9/d1b/c33 0 2024-09-13T17:05:46.223 INFO:tasks.workunit.client.1.smithi195.stdout:6/304: rename d1c/d28 to d1c/d24/d49/d5f 0 2024-09-13T17:05:46.224 INFO:tasks.workunit.client.0.smithi115.stdout:5/237: truncate f16 3715670 0 2024-09-13T17:05:46.224 INFO:tasks.workunit.client.0.smithi115.stdout:5/238: stat l11 0 2024-09-13T17:05:46.226 INFO:tasks.workunit.client.1.smithi195.stdout:6/305: truncate d1c/f29 71591 0 2024-09-13T17:05:46.226 INFO:tasks.workunit.client.1.smithi195.stdout:6/306: fsync d1c/d24/d49/d5f/d35/f36 0 2024-09-13T17:05:46.227 INFO:tasks.workunit.client.1.smithi195.stdout:0/317: dwrite d7/db/d38/f3b [0,4194304] 0 2024-09-13T17:05:46.227 INFO:tasks.workunit.client.1.smithi195.stdout:0/318: stat d7/d8/d23/d4b/d56/d46/l19 0 2024-09-13T17:05:46.228 INFO:tasks.workunit.client.0.smithi115.stdout:2/350: mknod d3/d4d/dd/d1f/d2f/d56/c75 0 2024-09-13T17:05:46.228 INFO:tasks.workunit.client.0.smithi115.stdout:8/273: dwrite d0/d21/f32 [0,4194304] 0 2024-09-13T17:05:46.228 INFO:tasks.workunit.client.0.smithi115.stdout:8/274: truncate d0/d15/f4d 763855 0 2024-09-13T17:05:46.228 INFO:tasks.workunit.client.0.smithi115.stdout:8/275: chown d0/c12 1 1 2024-09-13T17:05:46.229 INFO:tasks.workunit.client.0.smithi115.stdout:6/216: dwrite d8/db/d1d/f18 [0,4194304] 0 2024-09-13T17:05:46.229 INFO:tasks.workunit.client.0.smithi115.stdout:6/217: creat d8/d13/d15/d24/d17/f41 x:0 0 0 2024-09-13T17:05:46.229 INFO:tasks.workunit.client.1.smithi195.stdout:6/307: symlink d1c/d3e/l60 0 2024-09-13T17:05:46.230 INFO:tasks.workunit.client.0.smithi115.stdout:1/163: chown d5/d7/l17 247 1 2024-09-13T17:05:46.232 INFO:tasks.workunit.client.0.smithi115.stdout:7/211: creat d0/d2/df/d21/d25/d44/f4f x:0 0 0 2024-09-13T17:05:46.232 INFO:tasks.workunit.client.0.smithi115.stdout:7/212: readlink d0/d18/l1d 0 2024-09-13T17:05:46.233 INFO:tasks.workunit.client.0.smithi115.stdout:3/425: symlink d1/d4b/d1a/d30/l8f 0 2024-09-13T17:05:46.234 INFO:tasks.workunit.client.1.smithi195.stdout:7/351: creat d5/f72 x:0 0 0 2024-09-13T17:05:46.235 INFO:tasks.workunit.client.0.smithi115.stdout:0/190: getdents d9/d1d/d24/d26 0 2024-09-13T17:05:46.237 INFO:tasks.workunit.client.0.smithi115.stdout:5/239: creat d19/d2b/d32/d55/f57 x:0 0 0 2024-09-13T17:05:46.238 INFO:tasks.workunit.client.0.smithi115.stdout:8/276: truncate d0/f53 145379 0 2024-09-13T17:05:46.238 INFO:tasks.workunit.client.1.smithi195.stdout:3/284: write d7/d19/d1e/f3f [581184,79329] 0 2024-09-13T17:05:46.238 INFO:tasks.workunit.client.1.smithi195.stdout:3/285: chown d7/d19/l25 1474547552 1 2024-09-13T17:05:46.240 INFO:tasks.workunit.client.0.smithi115.stdout:2/351: dread d3/d4d/de/f59 [0,4194304] 0 2024-09-13T17:05:46.243 INFO:tasks.workunit.client.1.smithi195.stdout:0/319: mknod d7/db/c60 0 2024-09-13T17:05:46.245 INFO:tasks.workunit.client.1.smithi195.stdout:2/348: link d0/d4a/d1c/d2c/d43/l6d d0/d3/d3d/l6e 0 2024-09-13T17:05:46.246 INFO:tasks.workunit.client.0.smithi115.stdout:1/164: creat d5/d26/d2c/f39 x:0 0 0 2024-09-13T17:05:46.246 INFO:tasks.workunit.client.0.smithi115.stdout:1/165: chown d5/d26/f35 182772 1 2024-09-13T17:05:46.248 INFO:tasks.workunit.client.1.smithi195.stdout:6/308: link d1c/c20 d1c/d24/d49/d5f/d46/c61 0 2024-09-13T17:05:46.248 INFO:tasks.workunit.client.1.smithi195.stdout:6/309: chown d1c/d24/d49/d5f/d35/f36 250293770 1 2024-09-13T17:05:46.248 INFO:tasks.workunit.client.1.smithi195.stdout:6/310: write d1c/d2d/d30/f3d [309044,110170] 0 2024-09-13T17:05:46.249 INFO:tasks.workunit.client.1.smithi195.stdout:7/352: mknod d5/d13/c73 0 2024-09-13T17:05:46.250 INFO:tasks.workunit.client.0.smithi115.stdout:3/426: mkdir d1/d4b/d69/d7b/d8b/d90 0 2024-09-13T17:05:46.251 INFO:tasks.workunit.client.1.smithi195.stdout:3/286: unlink d7/le 0 2024-09-13T17:05:46.253 INFO:tasks.workunit.client.1.smithi195.stdout:0/320: creat d7/db/d11/f61 x:0 0 0 2024-09-13T17:05:46.254 INFO:tasks.workunit.client.1.smithi195.stdout:2/349: mknod d0/d4a/d1c/d1e/c6f 0 2024-09-13T17:05:46.254 INFO:tasks.workunit.client.1.smithi195.stdout:2/350: fdatasync d0/f45 0 2024-09-13T17:05:46.255 INFO:tasks.workunit.client.0.smithi115.stdout:5/240: link d19/d21/c43 d19/d2b/c58 0 2024-09-13T17:05:46.257 INFO:tasks.workunit.client.1.smithi195.stdout:6/311: mknod d1c/d3e/c62 0 2024-09-13T17:05:46.259 INFO:tasks.workunit.client.1.smithi195.stdout:7/353: symlink d5/db/d19/d22/l74 0 2024-09-13T17:05:46.259 INFO:tasks.workunit.client.1.smithi195.stdout:7/354: chown d5/d35/d37/f65 164736 1 2024-09-13T17:05:46.261 INFO:tasks.workunit.client.0.smithi115.stdout:3/427: dread d1/d4b/d1a/f27 [0,4194304] 0 2024-09-13T17:05:46.261 INFO:tasks.workunit.client.0.smithi115.stdout:3/428: creat d1/d83/f91 x:0 0 0 2024-09-13T17:05:46.264 INFO:tasks.workunit.client.0.smithi115.stdout:1/166: mkdir d5/d7/d33/d3a 0 2024-09-13T17:05:46.264 INFO:tasks.workunit.client.0.smithi115.stdout:1/167: read d5/f20 [141397,47223] 0 2024-09-13T17:05:46.266 INFO:tasks.workunit.client.1.smithi195.stdout:2/351: dread d0/f48 [0,4194304] 0 2024-09-13T17:05:46.269 INFO:tasks.workunit.client.1.smithi195.stdout:2/352: mknod d0/d4a/d1c/d1e/c70 0 2024-09-13T17:05:46.269 INFO:tasks.workunit.client.1.smithi195.stdout:2/353: truncate d0/d4a/d1c/d1e/f65 797477 0 2024-09-13T17:05:46.270 INFO:tasks.workunit.client.1.smithi195.stdout:3/287: dwrite d7/f15 [4194304,4194304] 0 2024-09-13T17:05:46.271 INFO:tasks.workunit.client.1.smithi195.stdout:2/354: dread d0/d3/df/f35 [0,4194304] 0 2024-09-13T17:05:46.271 INFO:tasks.workunit.client.1.smithi195.stdout:2/355: write d0/d4a/d1c/d2c/d43/d63/f6b [896330,112706] 0 2024-09-13T17:05:46.271 INFO:tasks.workunit.client.1.smithi195.stdout:2/356: chown d0/d3 251881374 1 2024-09-13T17:05:46.271 INFO:tasks.workunit.client.1.smithi195.stdout:1/296: creat db/f6b x:0 0 0 2024-09-13T17:05:46.272 INFO:tasks.workunit.client.0.smithi115.stdout:0/191: link d9/f18 d9/d1b/f34 0 2024-09-13T17:05:46.273 INFO:tasks.workunit.client.1.smithi195.stdout:9/342: write d6/df/f3c [1203571,54623] 0 2024-09-13T17:05:46.274 INFO:tasks.workunit.client.0.smithi115.stdout:5/241: link d19/d2b/d32/d55/c4b d19/d2e/c59 0 2024-09-13T17:05:46.275 INFO:tasks.workunit.client.1.smithi195.stdout:8/322: sync 2024-09-13T17:05:46.275 INFO:tasks.workunit.client.1.smithi195.stdout:3/288: dread d7/f14 [0,4194304] 0 2024-09-13T17:05:46.277 INFO:tasks.workunit.client.1.smithi195.stdout:9/343: mknod d6/df/d13/d44/d47/d61/c6b 0 2024-09-13T17:05:46.279 INFO:tasks.workunit.client.1.smithi195.stdout:8/323: mkdir d0/d17/d2f/d6a 0 2024-09-13T17:05:46.279 INFO:tasks.workunit.client.1.smithi195.stdout:8/324: write d0/d4/f39 [2118808,104815] 0 2024-09-13T17:05:46.279 INFO:tasks.workunit.client.1.smithi195.stdout:8/325: creat d0/d17/f6b x:0 0 0 2024-09-13T17:05:46.280 INFO:tasks.workunit.client.0.smithi115.stdout:3/429: mknod d1/d4b/d1a/d30/c92 0 2024-09-13T17:05:46.281 INFO:tasks.workunit.client.1.smithi195.stdout:0/321: link d7/d8/d23/f27 d7/d8/d23/f62 0 2024-09-13T17:05:46.283 INFO:tasks.workunit.client.1.smithi195.stdout:1/297: write db/d19/d37/d3e/f43 [3741234,69276] 0 2024-09-13T17:05:46.283 INFO:tasks.workunit.client.1.smithi195.stdout:3/289: truncate d7/d21/f26 1142590 0 2024-09-13T17:05:46.283 INFO:tasks.workunit.client.1.smithi195.stdout:3/290: chown d7/d21/c30 63 1 2024-09-13T17:05:46.283 INFO:tasks.workunit.client.1.smithi195.stdout:3/291: read d7/f13 [1382347,66623] 0 2024-09-13T17:05:46.285 INFO:tasks.workunit.client.1.smithi195.stdout:9/344: unlink d6/d19/l63 0 2024-09-13T17:05:46.288 INFO:tasks.workunit.client.0.smithi115.stdout:2/352: truncate d3/d4d/dd/d1f/d2f/d56/f29 587284 0 2024-09-13T17:05:46.290 INFO:tasks.workunit.client.1.smithi195.stdout:8/326: link d0/d13/c21 d0/d13/d69/c6c 0 2024-09-13T17:05:46.290 INFO:tasks.workunit.client.1.smithi195.stdout:2/357: dwrite d0/d4a/d1c/d2c/f34 [0,4194304] 0 2024-09-13T17:05:46.293 INFO:tasks.workunit.client.0.smithi115.stdout:1/168: dwrite d5/f10 [0,4194304] 0 2024-09-13T17:05:46.294 INFO:tasks.workunit.client.0.smithi115.stdout:1/169: fsync d5/d26/f29 0 2024-09-13T17:05:46.294 INFO:tasks.workunit.client.1.smithi195.stdout:2/358: write d0/d4a/d1c/f23 [393912,78591] 0 2024-09-13T17:05:46.294 INFO:tasks.workunit.client.1.smithi195.stdout:2/359: chown d0/f48 0 1 2024-09-13T17:05:46.294 INFO:tasks.workunit.client.0.smithi115.stdout:5/242: unlink fe 0 2024-09-13T17:05:46.295 INFO:tasks.workunit.client.0.smithi115.stdout:5/243: dread - d19/d21/f30 zero size 2024-09-13T17:05:46.299 INFO:tasks.workunit.client.0.smithi115.stdout:3/430: rmdir d1/d12/d14/d61 39 2024-09-13T17:05:46.301 INFO:tasks.workunit.client.0.smithi115.stdout:3/431: symlink d1/d4b/d1a/d30/l93 0 2024-09-13T17:05:46.301 INFO:tasks.workunit.client.0.smithi115.stdout:3/432: write d1/d12/d14/f3e [5007093,8827] 0 2024-09-13T17:05:46.302 INFO:tasks.workunit.client.0.smithi115.stdout:3/433: chown d1 41 1 2024-09-13T17:05:46.302 INFO:tasks.workunit.client.0.smithi115.stdout:3/434: fdatasync d1/d4b/f86 0 2024-09-13T17:05:46.302 INFO:tasks.workunit.client.0.smithi115.stdout:3/435: chown d1/d12/d14/f51 228934 1 2024-09-13T17:05:46.303 INFO:tasks.workunit.client.1.smithi195.stdout:1/298: rmdir db/d60 39 2024-09-13T17:05:46.304 INFO:tasks.workunit.client.1.smithi195.stdout:3/292: mkdir d7/d21/d2a/d4a 0 2024-09-13T17:05:46.306 INFO:tasks.workunit.client.1.smithi195.stdout:9/345: mknod d6/d19/d21/c6c 0 2024-09-13T17:05:46.311 INFO:tasks.workunit.client.0.smithi115.stdout:5/244: write d19/d2b/d32/f4e [3913805,32504] 0 2024-09-13T17:05:46.313 INFO:tasks.workunit.client.1.smithi195.stdout:0/322: getdents d7 0 2024-09-13T17:05:46.316 INFO:tasks.workunit.client.1.smithi195.stdout:3/293: stat d7/d21/c30 0 2024-09-13T17:05:46.317 INFO:tasks.workunit.client.1.smithi195.stdout:9/346: mkdir d6/d19/d21/d64/d68/d6d 0 2024-09-13T17:05:46.318 INFO:tasks.workunit.client.1.smithi195.stdout:9/347: creat d6/df/d16/d58/f6e x:0 0 0 2024-09-13T17:05:46.326 INFO:tasks.workunit.client.0.smithi115.stdout:4/336: sync 2024-09-13T17:05:46.326 INFO:tasks.workunit.client.0.smithi115.stdout:4/337: fsync d7/dd/de/f59 0 2024-09-13T17:05:46.326 INFO:tasks.workunit.client.0.smithi115.stdout:4/338: readlink d7/dd/de/l27 0 2024-09-13T17:05:46.326 INFO:tasks.workunit.client.0.smithi115.stdout:4/339: fdatasync d7/dd/f33 0 2024-09-13T17:05:46.326 INFO:tasks.workunit.client.0.smithi115.stdout:0/192: dwrite d9/f16 [0,4194304] 0 2024-09-13T17:05:46.328 INFO:tasks.workunit.client.0.smithi115.stdout:2/353: dwrite d3/d4d/de/f10 [0,4194304] 0 2024-09-13T17:05:46.329 INFO:tasks.workunit.client.0.smithi115.stdout:4/340: mkdir d7/dd/d63 0 2024-09-13T17:05:46.329 INFO:tasks.workunit.client.0.smithi115.stdout:3/436: dwrite d1/d4b/d1a/f27 [4194304,4194304] 0 2024-09-13T17:05:46.332 INFO:tasks.workunit.client.0.smithi115.stdout:7/213: rename d0/d2/df to d0/d3b/d50 0 2024-09-13T17:05:46.333 INFO:tasks.workunit.client.0.smithi115.stdout:0/193: dread d9/fc [0,4194304] 0 2024-09-13T17:05:46.333 INFO:tasks.workunit.client.0.smithi115.stdout:0/194: read f0 [3835277,59321] 0 2024-09-13T17:05:46.333 INFO:tasks.workunit.client.0.smithi115.stdout:0/195: write d9/f18 [1976277,45310] 0 2024-09-13T17:05:46.333 INFO:tasks.workunit.client.0.smithi115.stdout:0/196: chown d9/c2f 8658796 1 2024-09-13T17:05:46.333 INFO:tasks.workunit.client.0.smithi115.stdout:0/197: chown d9/d1d/d24 408508 1 2024-09-13T17:05:46.334 INFO:tasks.workunit.client.0.smithi115.stdout:2/354: unlink d3/d4d/de/f74 0 2024-09-13T17:05:46.336 INFO:tasks.workunit.client.0.smithi115.stdout:3/437: link d1/d12/d14/f51 d1/d4b/d69/d7b/f94 0 2024-09-13T17:05:46.336 INFO:tasks.workunit.client.0.smithi115.stdout:3/438: write d1/d12/d23/f62 [930300,19960] 0 2024-09-13T17:05:46.336 INFO:tasks.workunit.client.1.smithi195.stdout:6/312: dread d1c/f29 [0,4194304] 0 2024-09-13T17:05:46.336 INFO:tasks.workunit.client.1.smithi195.stdout:6/313: stat f1a 0 2024-09-13T17:05:46.337 INFO:tasks.workunit.client.0.smithi115.stdout:1/170: rename d5/l9 to d5/d7/d33/l3b 0 2024-09-13T17:05:46.341 INFO:tasks.workunit.client.1.smithi195.stdout:6/314: creat d1c/f63 x:0 0 0 2024-09-13T17:05:46.341 INFO:tasks.workunit.client.1.smithi195.stdout:6/315: fsync d1c/d24/f38 0 2024-09-13T17:05:46.341 INFO:tasks.workunit.client.0.smithi115.stdout:2/355: rmdir d3/d4d 39 2024-09-13T17:05:46.342 INFO:tasks.workunit.client.1.smithi195.stdout:3/294: dwrite d7/d21/f27 [0,4194304] 0 2024-09-13T17:05:46.342 INFO:tasks.workunit.client.1.smithi195.stdout:3/295: creat d7/d21/d2a/f4b x:0 0 0 2024-09-13T17:05:46.342 INFO:tasks.workunit.client.1.smithi195.stdout:3/296: creat d7/d19/d1e/f4c x:0 0 0 2024-09-13T17:05:46.345 INFO:tasks.workunit.client.0.smithi115.stdout:5/245: write f16 [1962361,102242] 0 2024-09-13T17:05:46.345 INFO:tasks.workunit.client.1.smithi195.stdout:0/323: dwrite d7/d8/d23/f32 [0,4194304] 0 2024-09-13T17:05:46.345 INFO:tasks.workunit.client.0.smithi115.stdout:3/439: fdatasync d1/d12/d14/f3e 0 2024-09-13T17:05:46.346 INFO:tasks.workunit.client.0.smithi115.stdout:1/171: rename d5/d7/l37 to d5/l3c 0 2024-09-13T17:05:46.346 INFO:tasks.workunit.client.0.smithi115.stdout:1/172: read d5/f20 [20577,17040] 0 2024-09-13T17:05:46.347 INFO:tasks.workunit.client.0.smithi115.stdout:2/356: dread d3/d4d/de/f2a [0,4194304] 0 2024-09-13T17:05:46.347 INFO:tasks.workunit.client.0.smithi115.stdout:2/357: fsync d3/f18 0 2024-09-13T17:05:46.348 INFO:tasks.workunit.client.0.smithi115.stdout:4/341: dwrite d7/f31 [4194304,4194304] 0 2024-09-13T17:05:46.348 INFO:tasks.workunit.client.0.smithi115.stdout:4/342: getdents d7/dd/d63 0 2024-09-13T17:05:46.348 INFO:tasks.workunit.client.0.smithi115.stdout:4/343: fsync d7/f30 0 2024-09-13T17:05:46.348 INFO:tasks.workunit.client.0.smithi115.stdout:4/344: fdatasync d7/dd/de/f3a 0 2024-09-13T17:05:46.351 INFO:tasks.workunit.client.0.smithi115.stdout:5/246: dread f3 [0,4194304] 0 2024-09-13T17:05:46.351 INFO:tasks.workunit.client.0.smithi115.stdout:5/247: readlink d19/d2b/d40/l42 0 2024-09-13T17:05:46.351 INFO:tasks.workunit.client.0.smithi115.stdout:5/248: truncate d19/d2b/d32/d55/f4c 669341 0 2024-09-13T17:05:46.351 INFO:tasks.workunit.client.0.smithi115.stdout:5/249: chown c4 126121420 1 2024-09-13T17:05:46.352 INFO:tasks.workunit.client.0.smithi115.stdout:5/250: write d19/d2b/d32/f3b [825804,81308] 0 2024-09-13T17:05:46.354 INFO:tasks.workunit.client.0.smithi115.stdout:3/440: link d1/d4b/d1a/d30/l3d d1/d4b/d69/l95 0 2024-09-13T17:05:46.356 INFO:tasks.workunit.client.0.smithi115.stdout:1/173: mkdir d5/d3d 0 2024-09-13T17:05:46.357 INFO:tasks.workunit.client.0.smithi115.stdout:5/251: dread d19/d2b/f44 [0,4194304] 0 2024-09-13T17:05:46.358 INFO:tasks.workunit.client.0.smithi115.stdout:2/358: symlink d3/d4d/d13/d1c/l76 0 2024-09-13T17:05:46.359 INFO:tasks.workunit.client.1.smithi195.stdout:0/324: rename d7/c26 to d7/db/c63 0 2024-09-13T17:05:46.360 INFO:tasks.workunit.client.1.smithi195.stdout:0/325: write d7/d8/d23/f27 [2614589,39924] 0 2024-09-13T17:05:46.362 INFO:tasks.workunit.client.1.smithi195.stdout:6/316: getdents d1c/d2d/d30 0 2024-09-13T17:05:46.363 INFO:tasks.workunit.client.0.smithi115.stdout:0/198: dwrite d9/fd [0,4194304] 0 2024-09-13T17:05:46.363 INFO:tasks.workunit.client.0.smithi115.stdout:0/199: write d9/f1f [4847208,125279] 0 2024-09-13T17:05:46.363 INFO:tasks.workunit.client.0.smithi115.stdout:0/200: getdents d9/d1d/d24/d26 0 2024-09-13T17:05:46.363 INFO:tasks.workunit.client.0.smithi115.stdout:0/201: chown d9/d1d/l22 118 1 2024-09-13T17:05:46.363 INFO:tasks.workunit.client.0.smithi115.stdout:0/202: chown d9/c13 2 1 2024-09-13T17:05:46.365 INFO:tasks.workunit.client.0.smithi115.stdout:1/174: mkdir d5/d3e 0 2024-09-13T17:05:46.365 INFO:tasks.workunit.client.0.smithi115.stdout:1/175: dread - d5/d26/d2c/f39 zero size 2024-09-13T17:05:46.366 INFO:tasks.workunit.client.1.smithi195.stdout:0/326: symlink d7/db/l64 0 2024-09-13T17:05:46.367 INFO:tasks.workunit.client.0.smithi115.stdout:2/359: stat d3/d4d/dd/l4f 0 2024-09-13T17:05:46.368 INFO:tasks.workunit.client.1.smithi195.stdout:6/317: symlink d1c/d2d/d5e/l64 0 2024-09-13T17:05:46.368 INFO:tasks.workunit.client.1.smithi195.stdout:6/318: write d1c/f63 [697843,44404] 0 2024-09-13T17:05:46.369 INFO:tasks.workunit.client.1.smithi195.stdout:4/382: sync 2024-09-13T17:05:46.369 INFO:tasks.workunit.client.1.smithi195.stdout:5/319: sync 2024-09-13T17:05:46.369 INFO:tasks.workunit.client.1.smithi195.stdout:5/320: chown d2/d3e/d32/c36 1754 1 2024-09-13T17:05:46.369 INFO:tasks.workunit.client.1.smithi195.stdout:5/321: chown d2/df/d62 25320711 1 2024-09-13T17:05:46.369 INFO:tasks.workunit.client.1.smithi195.stdout:4/383: write d1a/d1f/d21/d22/f42 [1514057,89070] 0 2024-09-13T17:05:46.369 INFO:tasks.workunit.client.1.smithi195.stdout:4/384: creat d1a/d1f/d43/d24/f7d x:0 0 0 2024-09-13T17:05:46.369 INFO:tasks.workunit.client.1.smithi195.stdout:4/385: write d1a/d1f/d43/d24/d41/f5d [3880387,39758] 0 2024-09-13T17:05:46.369 INFO:tasks.workunit.client.1.smithi195.stdout:4/386: readlink d1a/d1f/d21/d36/l57 0 2024-09-13T17:05:46.370 INFO:tasks.workunit.client.1.smithi195.stdout:4/387: fsync d1a/d1f/d43/f48 0 2024-09-13T17:05:46.370 INFO:tasks.workunit.client.0.smithi115.stdout:0/203: symlink d9/d1d/d24/d26/l35 0 2024-09-13T17:05:46.371 INFO:tasks.workunit.client.1.smithi195.stdout:5/322: write d2/d12/f50 [381127,56882] 0 2024-09-13T17:05:46.372 INFO:tasks.workunit.client.1.smithi195.stdout:0/327: rename d7/d8/d23/d4b/d4e/f5f to d7/d8/d23/d4b/d4e/f65 0 2024-09-13T17:05:46.372 INFO:tasks.workunit.client.1.smithi195.stdout:0/328: dread - d7/d8/d23/d4b/d56/f58 zero size 2024-09-13T17:05:46.372 INFO:tasks.workunit.client.1.smithi195.stdout:0/329: write d7/d50/f52 [162988,56686] 0 2024-09-13T17:05:46.374 INFO:tasks.workunit.client.1.smithi195.stdout:6/319: rename d1c/d24/d49/d5f/f3f to d1c/d24/d49/f65 0 2024-09-13T17:05:46.377 INFO:tasks.workunit.client.0.smithi115.stdout:3/441: dwrite d1/f9 [0,4194304] 0 2024-09-13T17:05:46.377 INFO:tasks.workunit.client.0.smithi115.stdout:3/442: creat d1/d4b/d1a/d30/f96 x:0 0 0 2024-09-13T17:05:46.378 INFO:tasks.workunit.client.1.smithi195.stdout:6/320: read d1c/d24/d49/f65 [241215,29357] 0 2024-09-13T17:05:46.378 INFO:tasks.workunit.client.1.smithi195.stdout:0/330: truncate d7/d8/d23/d4b/d4e/f5b 3803277 0 2024-09-13T17:05:46.378 INFO:tasks.workunit.client.1.smithi195.stdout:0/331: chown d7/db/d38 40507 1 2024-09-13T17:05:46.382 INFO:tasks.workunit.client.0.smithi115.stdout:5/252: dwrite d19/f1a [4194304,4194304] 0 2024-09-13T17:05:46.382 INFO:tasks.workunit.client.0.smithi115.stdout:5/253: creat d19/d2b/d32/d55/f5a x:0 0 0 2024-09-13T17:05:46.383 INFO:tasks.workunit.client.1.smithi195.stdout:6/321: mknod d1c/d2d/d30/c66 0 2024-09-13T17:05:46.383 INFO:tasks.workunit.client.1.smithi195.stdout:6/322: stat d1c/d3e/f47 0 2024-09-13T17:05:46.383 INFO:tasks.workunit.client.0.smithi115.stdout:2/360: dread d3/f18 [0,4194304] 0 2024-09-13T17:05:46.386 INFO:tasks.workunit.client.1.smithi195.stdout:6/323: creat d1c/f67 x:0 0 0 2024-09-13T17:05:46.386 INFO:tasks.workunit.client.1.smithi195.stdout:0/332: dread d7/d50/f31 [0,4194304] 0 2024-09-13T17:05:46.387 INFO:tasks.workunit.client.0.smithi115.stdout:1/176: dwrite d5/f20 [0,4194304] 0 2024-09-13T17:05:46.387 INFO:tasks.workunit.client.0.smithi115.stdout:1/177: truncate d5/d26/f31 467593 0 2024-09-13T17:05:46.389 INFO:tasks.workunit.client.1.smithi195.stdout:4/388: rename d1a/d1f/d43/d24/d71 to d1a/d1f/d21/d7e 0 2024-09-13T17:05:46.389 INFO:tasks.workunit.client.1.smithi195.stdout:4/389: stat d1a/d1f/d21/f6a 0 2024-09-13T17:05:46.392 INFO:tasks.workunit.client.0.smithi115.stdout:3/443: rename d1/l57 to d1/d12/l97 0 2024-09-13T17:05:46.398 INFO:tasks.workunit.client.1.smithi195.stdout:9/348: getdents d6/d19/d21 0 2024-09-13T17:05:46.398 INFO:tasks.workunit.client.1.smithi195.stdout:9/349: write d6/df/f38 [2387502,87529] 0 2024-09-13T17:05:46.398 INFO:tasks.workunit.client.1.smithi195.stdout:9/350: write d6/d12/f2b [633616,31873] 0 2024-09-13T17:05:46.398 INFO:tasks.workunit.client.0.smithi115.stdout:5/254: creat d19/d21/d3a/f5b x:0 0 0 2024-09-13T17:05:46.401 INFO:tasks.workunit.client.0.smithi115.stdout:2/361: mkdir d3/d4d/d13/d77 0 2024-09-13T17:05:46.403 INFO:tasks.workunit.client.1.smithi195.stdout:6/324: creat d1c/d24/d49/d5f/d35/f68 x:0 0 0 2024-09-13T17:05:46.406 INFO:tasks.workunit.client.1.smithi195.stdout:0/333: creat d7/d8/d23/d4b/d56/d4d/f66 x:0 0 0 2024-09-13T17:05:46.407 INFO:tasks.workunit.client.1.smithi195.stdout:0/334: creat d7/d50/f67 x:0 0 0 2024-09-13T17:05:46.409 INFO:tasks.workunit.client.1.smithi195.stdout:5/323: rename d2/d3e/d32/f33 to d2/d12/d4e/d10/f66 0 2024-09-13T17:05:46.410 INFO:tasks.workunit.client.0.smithi115.stdout:1/178: symlink d5/d7/d33/l3f 0 2024-09-13T17:05:46.410 INFO:tasks.workunit.client.0.smithi115.stdout:1/179: write d5/d26/f29 [857611,125128] 0 2024-09-13T17:05:46.410 INFO:tasks.workunit.client.0.smithi115.stdout:1/180: write d5/f22 [4768495,46147] 0 2024-09-13T17:05:46.411 INFO:tasks.workunit.client.1.smithi195.stdout:4/390: mknod d1a/d1f/d21/d22/c7f 0 2024-09-13T17:05:46.411 INFO:tasks.workunit.client.0.smithi115.stdout:4/345: rmdir d7/dd 39 2024-09-13T17:05:46.413 INFO:tasks.workunit.client.0.smithi115.stdout:3/444: symlink d1/d4b/d69/l98 0 2024-09-13T17:05:46.413 INFO:tasks.workunit.client.0.smithi115.stdout:3/445: truncate d1/d83/f91 696649 0 2024-09-13T17:05:46.415 INFO:tasks.workunit.client.1.smithi195.stdout:9/351: creat d6/d19/d21/d5b/f6f x:0 0 0 2024-09-13T17:05:46.415 INFO:tasks.workunit.client.1.smithi195.stdout:9/352: write d6/d19/d21/d64/f53 [350461,52895] 0 2024-09-13T17:05:46.415 INFO:tasks.workunit.client.1.smithi195.stdout:9/353: readlink d6/d19/d21/d5b/l6a 0 2024-09-13T17:05:46.417 INFO:tasks.workunit.client.0.smithi115.stdout:5/255: creat d19/d2e/f5c x:0 0 0 2024-09-13T17:05:46.417 INFO:tasks.workunit.client.0.smithi115.stdout:5/256: write f14 [1632937,72581] 0 2024-09-13T17:05:46.417 INFO:tasks.workunit.client.0.smithi115.stdout:5/257: write d19/d1d/f20 [1825532,128252] 0 2024-09-13T17:05:46.417 INFO:tasks.workunit.client.1.smithi195.stdout:9/354: dread d6/d19/d21/d45/f5a [0,4194304] 0 2024-09-13T17:05:46.418 INFO:tasks.workunit.client.1.smithi195.stdout:6/325: mknod d1c/d24/d49/d5f/c69 0 2024-09-13T17:05:46.423 INFO:tasks.workunit.client.0.smithi115.stdout:5/258: dread d19/d21/f4a [0,4194304] 0 2024-09-13T17:05:46.423 INFO:tasks.workunit.client.0.smithi115.stdout:1/181: mknod d5/d3e/c40 0 2024-09-13T17:05:46.423 INFO:tasks.workunit.client.0.smithi115.stdout:3/446: dread d1/d4b/f1b [0,4194304] 0 2024-09-13T17:05:46.424 INFO:tasks.workunit.client.0.smithi115.stdout:2/362: dwrite d3/d4d/de/f43 [0,4194304] 0 2024-09-13T17:05:46.424 INFO:tasks.workunit.client.0.smithi115.stdout:3/447: dread - d1/d4b/f76 zero size 2024-09-13T17:05:46.424 INFO:tasks.workunit.client.0.smithi115.stdout:2/363: write d3/d4d/dd/df/d5c/f71 [1027499,62411] 0 2024-09-13T17:05:46.424 INFO:tasks.workunit.client.1.smithi195.stdout:5/324: mknod d2/df/d39/c67 0 2024-09-13T17:05:46.428 INFO:tasks.workunit.client.0.smithi115.stdout:1/182: dread d5/d26/f31 [0,4194304] 0 2024-09-13T17:05:46.429 INFO:tasks.workunit.client.0.smithi115.stdout:3/448: dread d1/d12/f45 [0,4194304] 0 2024-09-13T17:05:46.429 INFO:tasks.workunit.client.0.smithi115.stdout:3/449: chown d1/d12/d14/d61 34561 1 2024-09-13T17:05:46.429 INFO:tasks.workunit.client.0.smithi115.stdout:3/450: write d1/d4b/d69/f6a [608402,86945] 0 2024-09-13T17:05:46.430 INFO:tasks.workunit.client.1.smithi195.stdout:9/355: symlink d6/df/d16/d58/l70 0 2024-09-13T17:05:46.430 INFO:tasks.workunit.client.1.smithi195.stdout:9/356: read d6/df/f38 [1798303,93062] 0 2024-09-13T17:05:46.430 INFO:tasks.workunit.client.1.smithi195.stdout:0/335: dwrite d7/d8/d23/d4b/d56/d46/f2e [4194304,4194304] 0 2024-09-13T17:05:46.430 INFO:tasks.workunit.client.1.smithi195.stdout:0/336: stat d7/db/c60 0 2024-09-13T17:05:46.431 INFO:tasks.workunit.client.0.smithi115.stdout:5/259: unlink d19/d1d/f28 0 2024-09-13T17:05:46.431 INFO:tasks.workunit.client.0.smithi115.stdout:5/260: write d19/f3c [1447403,46048] 0 2024-09-13T17:05:46.432 INFO:tasks.workunit.client.1.smithi195.stdout:6/326: creat d1c/d24/d49/d5f/f6a x:0 0 0 2024-09-13T17:05:46.437 INFO:tasks.workunit.client.1.smithi195.stdout:3/297: fsync d7/d19/d1e/f4c 0 2024-09-13T17:05:46.438 INFO:tasks.workunit.client.1.smithi195.stdout:0/337: mkdir d7/d8/d23/d4b/d4e/d68 0 2024-09-13T17:05:46.438 INFO:tasks.workunit.client.1.smithi195.stdout:0/338: chown d7/db/d38/d5d 1119 1 2024-09-13T17:05:46.439 INFO:tasks.workunit.client.0.smithi115.stdout:2/364: mknod d3/d4d/dd/c78 0 2024-09-13T17:05:46.439 INFO:tasks.workunit.client.0.smithi115.stdout:2/365: getdents d3/d4d/dd/d1f/d2f/d56/d58/d72 0 2024-09-13T17:05:46.439 INFO:tasks.workunit.client.0.smithi115.stdout:3/451: dread d1/d4b/f2b [0,4194304] 0 2024-09-13T17:05:46.440 INFO:tasks.workunit.client.0.smithi115.stdout:1/183: truncate d5/d7/f18 724088 0 2024-09-13T17:05:46.446 INFO:tasks.workunit.client.0.smithi115.stdout:5/261: mkdir d19/d21/d3a/d5d 0 2024-09-13T17:05:46.446 INFO:tasks.workunit.client.0.smithi115.stdout:3/452: dread d1/d4b/d69/f80 [0,4194304] 0 2024-09-13T17:05:46.447 INFO:tasks.workunit.client.0.smithi115.stdout:2/366: creat d3/d4d/dd/d1f/f79 x:0 0 0 2024-09-13T17:05:46.448 INFO:tasks.workunit.client.0.smithi115.stdout:2/367: readlink d3/d4d/dd/l50 0 2024-09-13T17:05:46.449 INFO:tasks.workunit.client.1.smithi195.stdout:0/339: rmdir d7/db/d38/d4f 39 2024-09-13T17:05:46.451 INFO:tasks.workunit.client.0.smithi115.stdout:5/262: truncate d19/d21/f2a 890739 0 2024-09-13T17:05:46.453 INFO:tasks.workunit.client.0.smithi115.stdout:2/368: creat d3/d4d/dd/df/d5b/f7a x:0 0 0 2024-09-13T17:05:46.455 INFO:tasks.workunit.client.0.smithi115.stdout:1/184: dwrite d5/fa [4194304,4194304] 0 2024-09-13T17:05:46.456 INFO:tasks.workunit.client.0.smithi115.stdout:1/185: readlink d5/l38 0 2024-09-13T17:05:46.456 INFO:tasks.workunit.client.0.smithi115.stdout:1/186: chown d5/d26/l27 1737230193 1 2024-09-13T17:05:46.456 INFO:tasks.workunit.client.0.smithi115.stdout:1/187: truncate d5/d26/d2c/f39 1048383 0 2024-09-13T17:05:46.456 INFO:tasks.workunit.client.0.smithi115.stdout:5/263: rename d19/d2b/d40 to d19/d2b/d32/d55/d5e 0 2024-09-13T17:05:46.456 INFO:tasks.workunit.client.1.smithi195.stdout:5/325: rename d2/d12/d4e/d10/d45 to d2/df/d39/d68 0 2024-09-13T17:05:46.457 INFO:tasks.workunit.client.1.smithi195.stdout:5/326: creat d2/df/d39/d54/d58/f69 x:0 0 0 2024-09-13T17:05:46.458 INFO:tasks.workunit.client.1.smithi195.stdout:3/298: mknod d7/c4d 0 2024-09-13T17:05:46.458 INFO:tasks.workunit.client.1.smithi195.stdout:3/299: chown d7/d19 5890 1 2024-09-13T17:05:46.460 INFO:tasks.workunit.client.1.smithi195.stdout:0/340: symlink d7/d8/d23/d4b/d4e/d68/l69 0 2024-09-13T17:05:46.462 INFO:tasks.workunit.client.0.smithi115.stdout:2/369: rmdir d3/d4d/d13/d39/d46 39 2024-09-13T17:05:46.463 INFO:tasks.workunit.client.1.smithi195.stdout:0/341: mknod d7/d8/d23/d4b/d56/d46/c6a 0 2024-09-13T17:05:46.463 INFO:tasks.workunit.client.1.smithi195.stdout:0/342: stat d7/d50/f31 0 2024-09-13T17:05:46.465 INFO:tasks.workunit.client.0.smithi115.stdout:1/188: creat d5/f41 x:0 0 0 2024-09-13T17:05:46.466 INFO:tasks.workunit.client.1.smithi195.stdout:0/343: symlink d7/db/d38/d5d/l6b 0 2024-09-13T17:05:46.467 INFO:tasks.workunit.client.0.smithi115.stdout:2/370: truncate d3/f4 3558987 0 2024-09-13T17:05:46.467 INFO:tasks.workunit.client.0.smithi115.stdout:2/371: creat d3/d4d/dd/d1f/d2f/d56/d58/f7b x:0 0 0 2024-09-13T17:05:46.468 INFO:tasks.workunit.client.1.smithi195.stdout:5/327: write d2/df/f42 [1278576,47522] 0 2024-09-13T17:05:46.468 INFO:tasks.workunit.client.1.smithi195.stdout:0/344: symlink d7/d50/l6c 0 2024-09-13T17:05:46.469 INFO:tasks.workunit.client.1.smithi195.stdout:7/355: sync 2024-09-13T17:05:46.469 INFO:tasks.workunit.client.1.smithi195.stdout:7/356: fsync f4 0 2024-09-13T17:05:46.470 INFO:tasks.workunit.client.1.smithi195.stdout:7/357: creat d5/d35/f75 x:0 0 0 2024-09-13T17:05:46.470 INFO:tasks.workunit.client.1.smithi195.stdout:7/358: chown d5/db/d50 1 1 2024-09-13T17:05:46.470 INFO:tasks.workunit.client.1.smithi195.stdout:7/359: write d5/db/d19/d22/f6b [711079,62949] 0 2024-09-13T17:05:46.472 INFO:tasks.workunit.client.1.smithi195.stdout:0/345: rename d7/l43 to d7/db/d38/l6d 0 2024-09-13T17:05:46.473 INFO:tasks.workunit.client.0.smithi115.stdout:2/372: write d3/f18 [3400690,112762] 0 2024-09-13T17:05:46.473 INFO:tasks.workunit.client.0.smithi115.stdout:2/373: write d3/d4d/dd/f2d [842027,15321] 0 2024-09-13T17:05:46.474 INFO:tasks.workunit.client.1.smithi195.stdout:7/360: mkdir d5/d76 0 2024-09-13T17:05:46.474 INFO:tasks.workunit.client.1.smithi195.stdout:7/361: chown d5/db/d19/d22/f5b 50397 1 2024-09-13T17:05:46.476 INFO:tasks.workunit.client.1.smithi195.stdout:3/300: dwrite f5 [0,4194304] 0 2024-09-13T17:05:46.476 INFO:tasks.workunit.client.1.smithi195.stdout:3/301: dread - d7/d21/d2a/f4b zero size 2024-09-13T17:05:46.477 INFO:tasks.workunit.client.1.smithi195.stdout:7/362: symlink d5/d13/d24/l77 0 2024-09-13T17:05:46.479 INFO:tasks.workunit.client.1.smithi195.stdout:3/302: symlink d7/d21/l4e 0 2024-09-13T17:05:46.483 INFO:tasks.workunit.client.1.smithi195.stdout:0/346: write d7/db/d38/f3b [15108,97477] 0 2024-09-13T17:05:46.484 INFO:tasks.workunit.client.1.smithi195.stdout:5/328: write d2/df/d39/f4f [1853689,34068] 0 2024-09-13T17:05:46.484 INFO:tasks.workunit.client.1.smithi195.stdout:5/329: truncate d2/df/f1c 3712383 0 2024-09-13T17:05:46.485 INFO:tasks.workunit.client.1.smithi195.stdout:5/330: fdatasync d2/df/f1a 0 2024-09-13T17:05:46.485 INFO:tasks.workunit.client.1.smithi195.stdout:5/331: write d2/df/d39/d68/f5d [333415,38327] 0 2024-09-13T17:05:46.485 INFO:tasks.workunit.client.1.smithi195.stdout:5/332: read d2/d12/d4e/f3b [79341,70052] 0 2024-09-13T17:05:46.485 INFO:tasks.workunit.client.1.smithi195.stdout:5/333: dread - d2/d12/d4e/d10/f51 zero size 2024-09-13T17:05:46.488 INFO:tasks.workunit.client.1.smithi195.stdout:0/347: creat d7/d8/d23/d4b/d56/d46/f6e x:0 0 0 2024-09-13T17:05:46.488 INFO:tasks.workunit.client.1.smithi195.stdout:5/334: rmdir d2/d3e/d32 39 2024-09-13T17:05:46.489 INFO:tasks.workunit.client.1.smithi195.stdout:0/348: symlink d7/d8/d23/d4b/d56/l6f 0 2024-09-13T17:05:46.490 INFO:tasks.workunit.client.1.smithi195.stdout:6/327: rmdir d1c/d24/d49/d5f 39 2024-09-13T17:05:46.493 INFO:tasks.workunit.client.1.smithi195.stdout:0/349: link f3 d7/d8/d23/d4b/d56/d4d/d5e/f70 0 2024-09-13T17:05:46.494 INFO:tasks.workunit.client.1.smithi195.stdout:6/328: mkdir d1c/d3e/d6b 0 2024-09-13T17:05:46.494 INFO:tasks.workunit.client.1.smithi195.stdout:6/329: truncate d1c/d24/d49/d5f/d35/f68 638100 0 2024-09-13T17:05:46.495 INFO:tasks.workunit.client.1.smithi195.stdout:6/330: write d1c/d24/f2e [5043364,94602] 0 2024-09-13T17:05:46.496 INFO:tasks.workunit.client.1.smithi195.stdout:0/350: unlink d7/d50/f1b 0 2024-09-13T17:05:46.499 INFO:tasks.workunit.client.1.smithi195.stdout:6/331: rename d1c/f29 to d1c/f6c 0 2024-09-13T17:05:46.499 INFO:tasks.workunit.client.1.smithi195.stdout:6/332: write d1c/d2d/f32 [4685518,46861] 0 2024-09-13T17:05:46.500 INFO:tasks.workunit.client.1.smithi195.stdout:6/333: mknod d1c/d24/d49/d5f/d46/c6d 0 2024-09-13T17:05:46.501 INFO:tasks.workunit.client.1.smithi195.stdout:6/334: symlink d1c/d24/d49/d5f/l6e 0 2024-09-13T17:05:46.503 INFO:tasks.workunit.client.0.smithi115.stdout:2/374: dwrite d3/d4d/de/f37 [0,4194304] 0 2024-09-13T17:05:46.503 INFO:tasks.workunit.client.0.smithi115.stdout:2/375: creat d3/d4d/dd/df/d5c/f7c x:0 0 0 2024-09-13T17:05:46.503 INFO:tasks.workunit.client.0.smithi115.stdout:2/376: write d3/d4d/dd/df/d5c/f7c [809003,63584] 0 2024-09-13T17:05:46.503 INFO:tasks.workunit.client.0.smithi115.stdout:2/377: write d3/d4d/dd/df/d5c/f7c [1268752,65501] 0 2024-09-13T17:05:46.507 INFO:tasks.workunit.client.1.smithi195.stdout:0/351: dread d7/db/f34 [0,4194304] 0 2024-09-13T17:05:46.508 INFO:tasks.workunit.client.1.smithi195.stdout:0/352: stat d7/c3c 0 2024-09-13T17:05:46.525 INFO:tasks.workunit.client.1.smithi195.stdout:0/353: dread f6 [0,4194304] 0 2024-09-13T17:05:46.525 INFO:tasks.workunit.client.1.smithi195.stdout:0/354: truncate d7/db/d11/f61 98362 0 2024-09-13T17:05:46.525 INFO:tasks.workunit.client.1.smithi195.stdout:0/355: fsync d7/d8/d23/d4b/d56/d46/f2e 0 2024-09-13T17:05:46.527 INFO:tasks.workunit.client.1.smithi195.stdout:7/363: dwrite d5/db/d19/f33 [0,4194304] 0 2024-09-13T17:05:46.530 INFO:tasks.workunit.client.1.smithi195.stdout:3/303: dwrite d7/d21/d2a/f2b [0,4194304] 0 2024-09-13T17:05:46.530 INFO:tasks.workunit.client.1.smithi195.stdout:3/304: creat d7/d21/f4f x:0 0 0 2024-09-13T17:05:46.533 INFO:tasks.workunit.client.0.smithi115.stdout:1/189: dread d5/d7/f18 [0,4194304] 0 2024-09-13T17:05:46.546 INFO:tasks.workunit.client.0.smithi115.stdout:1/190: creat d5/d7/d33/f42 x:0 0 0 2024-09-13T17:05:46.547 INFO:tasks.workunit.client.0.smithi115.stdout:1/191: creat d5/d7/d33/d3a/f43 x:0 0 0 2024-09-13T17:05:46.547 INFO:tasks.workunit.client.0.smithi115.stdout:1/192: chown d5/d7/d33/c34 13423723 1 2024-09-13T17:05:46.548 INFO:tasks.workunit.client.1.smithi195.stdout:6/335: dwrite d1c/d2d/d30/f5b [0,4194304] 0 2024-09-13T17:05:46.549 INFO:tasks.workunit.client.1.smithi195.stdout:5/335: dwrite d2/df/f42 [0,4194304] 0 2024-09-13T17:05:46.550 INFO:tasks.workunit.client.0.smithi115.stdout:5/264: dwrite d19/d2b/f44 [0,4194304] 0 2024-09-13T17:05:46.550 INFO:tasks.workunit.client.0.smithi115.stdout:5/265: chown f3 0 1 2024-09-13T17:05:46.550 INFO:tasks.workunit.client.0.smithi115.stdout:1/193: unlink d5/f20 0 2024-09-13T17:05:46.550 INFO:tasks.workunit.client.0.smithi115.stdout:1/194: truncate d5/d26/f31 1227493 0 2024-09-13T17:05:46.551 INFO:tasks.workunit.client.1.smithi195.stdout:7/364: symlink d5/d13/d30/l78 0 2024-09-13T17:05:46.551 INFO:tasks.workunit.client.1.smithi195.stdout:7/365: fdatasync d5/db/d19/d22/f5b 0 2024-09-13T17:05:46.551 INFO:tasks.workunit.client.1.smithi195.stdout:7/366: read - d5/f72 zero size 2024-09-13T17:05:46.551 INFO:tasks.workunit.client.1.smithi195.stdout:7/367: truncate d5/db/d19/d22/f4e 964644 0 2024-09-13T17:05:46.551 INFO:tasks.workunit.client.1.smithi195.stdout:7/368: readlink d5/l41 0 2024-09-13T17:05:46.551 INFO:tasks.workunit.client.1.smithi195.stdout:7/369: creat d5/db/d19/d22/f79 x:0 0 0 2024-09-13T17:05:46.552 INFO:tasks.workunit.client.0.smithi115.stdout:5/266: rename f0 to d19/d2b/d32/d55/f5f 0 2024-09-13T17:05:46.558 INFO:tasks.workunit.client.0.smithi115.stdout:1/195: dread d5/d26/d2c/f32 [0,4194304] 0 2024-09-13T17:05:46.558 INFO:tasks.workunit.client.0.smithi115.stdout:1/196: chown d5/f6 17337169 1 2024-09-13T17:05:46.558 INFO:tasks.workunit.client.0.smithi115.stdout:1/197: creat d5/d7/d33/d3a/f44 x:0 0 0 2024-09-13T17:05:46.558 INFO:tasks.workunit.client.0.smithi115.stdout:1/198: fsync d5/d7/f1f 0 2024-09-13T17:05:46.558 INFO:tasks.workunit.client.0.smithi115.stdout:1/199: dread - d5/d7/d33/d3a/f43 zero size 2024-09-13T17:05:46.559 INFO:tasks.workunit.client.1.smithi195.stdout:3/305: stat d7/d21/d2a/l40 0 2024-09-13T17:05:46.560 INFO:tasks.workunit.client.1.smithi195.stdout:0/356: getdents d7/db 0 2024-09-13T17:05:46.561 INFO:tasks.workunit.client.0.smithi115.stdout:1/200: rmdir d5/d3e 39 2024-09-13T17:05:46.563 INFO:tasks.workunit.client.0.smithi115.stdout:1/201: rmdir d5/d3d 0 2024-09-13T17:05:46.563 INFO:tasks.workunit.client.0.smithi115.stdout:1/202: write d5/d7/d33/d3a/f44 [754699,71536] 0 2024-09-13T17:05:46.565 INFO:tasks.workunit.client.1.smithi195.stdout:6/336: mkdir d1c/d2d/d30/d6f 0 2024-09-13T17:05:46.565 INFO:tasks.workunit.client.0.smithi115.stdout:1/203: mknod d5/c45 0 2024-09-13T17:05:46.566 INFO:tasks.workunit.client.0.smithi115.stdout:1/204: truncate d5/d7/f1f 2145 0 2024-09-13T17:05:46.567 INFO:tasks.workunit.client.1.smithi195.stdout:5/336: creat d2/f6a x:0 0 0 2024-09-13T17:05:46.569 INFO:tasks.workunit.client.1.smithi195.stdout:7/370: rmdir d5/d76 0 2024-09-13T17:05:46.569 INFO:tasks.workunit.client.1.smithi195.stdout:7/371: chown d5/d35/d37/c6f 130 1 2024-09-13T17:05:46.570 INFO:tasks.workunit.client.1.smithi195.stdout:7/372: creat d5/d13/d30/f7a x:0 0 0 2024-09-13T17:05:46.571 INFO:tasks.workunit.client.1.smithi195.stdout:6/337: symlink d1c/l70 0 2024-09-13T17:05:46.571 INFO:tasks.workunit.client.1.smithi195.stdout:6/338: write d1c/d24/d49/d5f/d35/f53 [602887,601] 0 2024-09-13T17:05:46.571 INFO:tasks.workunit.client.1.smithi195.stdout:6/339: readlink d1c/d2d/l59 0 2024-09-13T17:05:46.571 INFO:tasks.workunit.client.1.smithi195.stdout:7/373: rename d5/c23 to d5/db/d19/d22/c7b 0 2024-09-13T17:05:46.573 INFO:tasks.workunit.client.1.smithi195.stdout:7/374: rename d5/ce to d5/db/d50/c7c 0 2024-09-13T17:05:46.573 INFO:tasks.workunit.client.1.smithi195.stdout:7/375: write d5/fa [3701648,85770] 0 2024-09-13T17:05:46.574 INFO:tasks.workunit.client.1.smithi195.stdout:7/376: symlink d5/l7d 0 2024-09-13T17:05:46.575 INFO:tasks.workunit.client.0.smithi115.stdout:1/205: dread d5/d7/ff [0,4194304] 0 2024-09-13T17:05:46.575 INFO:tasks.workunit.client.0.smithi115.stdout:1/206: readlink d5/d7/l17 0 2024-09-13T17:05:46.575 INFO:tasks.workunit.client.0.smithi115.stdout:1/207: readlink l3 0 2024-09-13T17:05:46.575 INFO:tasks.workunit.client.0.smithi115.stdout:1/208: chown d5/l3c 455491987 1 2024-09-13T17:05:46.575 INFO:tasks.workunit.client.1.smithi195.stdout:7/377: symlink d5/d13/d24/l7e 0 2024-09-13T17:05:46.576 INFO:tasks.workunit.client.1.smithi195.stdout:7/378: dread - d5/db/d19/d22/f6c zero size 2024-09-13T17:05:46.576 INFO:tasks.workunit.client.1.smithi195.stdout:7/379: mkdir d5/db/d50/d7f 0 2024-09-13T17:05:46.577 INFO:tasks.workunit.client.1.smithi195.stdout:7/380: creat d5/db/d50/d7f/f80 x:0 0 0 2024-09-13T17:05:46.577 INFO:tasks.workunit.client.1.smithi195.stdout:7/381: chown d5/db/d19/f5e 7 1 2024-09-13T17:05:46.578 INFO:tasks.workunit.client.1.smithi195.stdout:7/382: creat d5/db/d50/f81 x:0 0 0 2024-09-13T17:05:46.579 INFO:tasks.workunit.client.1.smithi195.stdout:7/383: mkdir d5/db/d50/d7f/d82 0 2024-09-13T17:05:46.580 INFO:tasks.workunit.client.0.smithi115.stdout:2/378: dwrite d3/d4d/dd/d1f/d2f/d56/f2b [0,4194304] 0 2024-09-13T17:05:46.580 INFO:tasks.workunit.client.0.smithi115.stdout:2/379: fdatasync d3/d4d/de/d3a/f6d 0 2024-09-13T17:05:46.580 INFO:tasks.workunit.client.0.smithi115.stdout:2/380: chown d3/f40 2648919 1 2024-09-13T17:05:46.580 INFO:tasks.workunit.client.0.smithi115.stdout:2/381: write d3/d4d/dd/d1f/d2f/d56/f2b [4421233,78107] 0 2024-09-13T17:05:46.581 INFO:tasks.workunit.client.1.smithi195.stdout:7/384: dread d5/d13/f32 [0,4194304] 0 2024-09-13T17:05:46.581 INFO:tasks.workunit.client.1.smithi195.stdout:7/385: creat d5/d13/d30/f83 x:0 0 0 2024-09-13T17:05:46.584 INFO:tasks.workunit.client.1.smithi195.stdout:6/340: dwrite d1c/d2d/d30/f57 [0,4194304] 0 2024-09-13T17:05:46.587 INFO:tasks.workunit.client.1.smithi195.stdout:6/341: symlink d1c/d3e/l71 0 2024-09-13T17:05:46.589 INFO:tasks.workunit.client.0.smithi115.stdout:9/163: sync 2024-09-13T17:05:46.590 INFO:tasks.workunit.client.1.smithi195.stdout:6/342: symlink d1c/d2d/l72 0 2024-09-13T17:05:46.592 INFO:tasks.workunit.client.0.smithi115.stdout:2/382: dread d3/f5f [0,4194304] 0 2024-09-13T17:05:46.593 INFO:tasks.workunit.client.1.smithi195.stdout:8/327: sync 2024-09-13T17:05:46.593 INFO:tasks.workunit.client.1.smithi195.stdout:1/299: sync 2024-09-13T17:05:46.593 INFO:tasks.workunit.client.1.smithi195.stdout:2/360: sync 2024-09-13T17:05:46.593 INFO:tasks.workunit.client.1.smithi195.stdout:1/300: fdatasync db/d19/d37/d3e/f4c 0 2024-09-13T17:05:46.595 INFO:tasks.workunit.client.1.smithi195.stdout:2/361: dread d0/d4a/d1c/d2c/d51/f42 [0,4194304] 0 2024-09-13T17:05:46.596 INFO:tasks.workunit.client.1.smithi195.stdout:2/362: chown d0/c7 1 1 2024-09-13T17:05:46.596 INFO:tasks.workunit.client.1.smithi195.stdout:2/363: read - d0/d3/f68 zero size 2024-09-13T17:05:46.596 INFO:tasks.workunit.client.1.smithi195.stdout:2/364: write d0/d3/f68 [430960,3763] 0 2024-09-13T17:05:46.596 INFO:tasks.workunit.client.1.smithi195.stdout:2/365: readlink d0/d3/d3d/l4c 0 2024-09-13T17:05:46.597 INFO:tasks.workunit.client.0.smithi115.stdout:2/383: unlink d3/d4d/dd/d1f/d2f/d56/l4a 0 2024-09-13T17:05:46.598 INFO:tasks.workunit.client.1.smithi195.stdout:6/343: dread d1c/d2d/d30/f5b [0,4194304] 0 2024-09-13T17:05:46.599 INFO:tasks.workunit.client.1.smithi195.stdout:8/328: mknod d0/d17/c6d 0 2024-09-13T17:05:46.599 INFO:tasks.workunit.client.1.smithi195.stdout:6/344: dread f14 [0,4194304] 0 2024-09-13T17:05:46.600 INFO:tasks.workunit.client.1.smithi195.stdout:1/301: truncate db/df/d13/f27 2828120 0 2024-09-13T17:05:46.601 INFO:tasks.workunit.client.0.smithi115.stdout:2/384: mkdir d3/d4d/dd/d1f/d2f/d7d 0 2024-09-13T17:05:46.601 INFO:tasks.workunit.client.0.smithi115.stdout:2/385: dread - d3/d4d/dd/df/d5b/f7a zero size 2024-09-13T17:05:46.601 INFO:tasks.workunit.client.0.smithi115.stdout:2/386: chown d3/l3e 11395356 1 2024-09-13T17:05:46.603 INFO:tasks.workunit.client.1.smithi195.stdout:8/329: mknod d0/d13/d4d/c6e 0 2024-09-13T17:05:46.604 INFO:tasks.workunit.client.1.smithi195.stdout:6/345: dread d1c/d24/f38 [0,4194304] 0 2024-09-13T17:05:46.604 INFO:tasks.workunit.client.1.smithi195.stdout:6/346: fsync f19 0 2024-09-13T17:05:46.605 INFO:tasks.workunit.client.0.smithi115.stdout:2/387: truncate d3/d4d/dd/df/d5c/f71 600333 0 2024-09-13T17:05:46.605 INFO:tasks.workunit.client.0.smithi115.stdout:2/388: getdents d3/d4d/dd/d1f/d2f/d56/d58/d72 0 2024-09-13T17:05:46.605 INFO:tasks.workunit.client.0.smithi115.stdout:2/389: creat d3/d4d/dd/d1f/f7e x:0 0 0 2024-09-13T17:05:46.605 INFO:tasks.workunit.client.0.smithi115.stdout:2/390: fdatasync d3/d4d/de/f15 0 2024-09-13T17:05:46.605 INFO:tasks.workunit.client.1.smithi195.stdout:2/366: write d0/f24 [972559,66416] 0 2024-09-13T17:05:46.606 INFO:tasks.workunit.client.1.smithi195.stdout:1/302: creat db/d19/d37/d3e/f6c x:0 0 0 2024-09-13T17:05:46.606 INFO:tasks.workunit.client.1.smithi195.stdout:6/347: symlink d1c/d2d/l73 0 2024-09-13T17:05:46.607 INFO:tasks.workunit.client.1.smithi195.stdout:7/386: dread d5/db/d19/d22/f5b [0,4194304] 0 2024-09-13T17:05:46.609 INFO:tasks.workunit.client.1.smithi195.stdout:2/367: creat d0/d4a/d1c/d2c/f71 x:0 0 0 2024-09-13T17:05:46.609 INFO:tasks.workunit.client.1.smithi195.stdout:2/368: fdatasync d0/d4a/d1c/d2c/d51/f32 0 2024-09-13T17:05:46.610 INFO:tasks.workunit.client.1.smithi195.stdout:1/303: creat db/df/d51/d62/f6d x:0 0 0 2024-09-13T17:05:46.610 INFO:tasks.workunit.client.1.smithi195.stdout:1/304: truncate db/f2b 1004849 0 2024-09-13T17:05:46.610 INFO:tasks.workunit.client.0.smithi115.stdout:1/209: rmdir d5/d7/d33 39 2024-09-13T17:05:46.612 INFO:tasks.workunit.client.1.smithi195.stdout:6/348: creat d1c/d2d/d5e/f74 x:0 0 0 2024-09-13T17:05:46.613 INFO:tasks.workunit.client.0.smithi115.stdout:1/210: symlink d5/d3e/l46 0 2024-09-13T17:05:46.614 INFO:tasks.workunit.client.1.smithi195.stdout:7/387: truncate d5/db/d19/d22/f5b 2396079 0 2024-09-13T17:05:46.616 INFO:tasks.workunit.client.0.smithi115.stdout:1/211: creat d5/d3e/f47 x:0 0 0 2024-09-13T17:05:46.617 INFO:tasks.workunit.client.1.smithi195.stdout:6/349: symlink d1c/d3e/l75 0 2024-09-13T17:05:46.617 INFO:tasks.workunit.client.1.smithi195.stdout:2/369: mknod d0/c72 0 2024-09-13T17:05:46.618 INFO:tasks.workunit.client.0.smithi115.stdout:1/212: mkdir d5/d7/d33/d48 0 2024-09-13T17:05:46.618 INFO:tasks.workunit.client.0.smithi115.stdout:1/213: fdatasync d5/d26/f29 0 2024-09-13T17:05:46.619 INFO:tasks.workunit.client.1.smithi195.stdout:6/350: mknod d1c/d2d/d5e/c76 0 2024-09-13T17:05:46.619 INFO:tasks.workunit.client.1.smithi195.stdout:9/357: sync 2024-09-13T17:05:46.620 INFO:tasks.workunit.client.1.smithi195.stdout:4/391: sync 2024-09-13T17:05:46.620 INFO:tasks.workunit.client.0.smithi115.stdout:1/214: dread d5/d7/f1f [0,4194304] 0 2024-09-13T17:05:46.621 INFO:tasks.workunit.client.1.smithi195.stdout:6/351: read d1c/d2d/f55 [704576,46307] 0 2024-09-13T17:05:46.621 INFO:tasks.workunit.client.1.smithi195.stdout:6/352: write d1c/d2d/d5e/f74 [832011,11240] 0 2024-09-13T17:05:46.621 INFO:tasks.workunit.client.1.smithi195.stdout:2/370: mkdir d0/d4a/d47/d73 0 2024-09-13T17:05:46.621 INFO:tasks.workunit.client.1.smithi195.stdout:3/306: dwrite d7/d21/f27 [0,4194304] 0 2024-09-13T17:05:46.622 INFO:tasks.workunit.client.1.smithi195.stdout:9/358: rename d6/d19/d21/d45/c48 to d6/df/d16/d58/c71 0 2024-09-13T17:05:46.622 INFO:tasks.workunit.client.1.smithi195.stdout:9/359: write d6/d19/d21/d5b/f50 [257329,8086] 0 2024-09-13T17:05:46.627 INFO:tasks.workunit.client.1.smithi195.stdout:1/305: write db/df/d13/f2d [2769528,58938] 0 2024-09-13T17:05:46.627 INFO:tasks.workunit.client.1.smithi195.stdout:9/360: mkdir d6/df/d72 0 2024-09-13T17:05:46.628 INFO:tasks.workunit.client.0.smithi115.stdout:5/267: dwrite d19/d2b/d32/d55/f5f [0,4194304] 0 2024-09-13T17:05:46.628 INFO:tasks.workunit.client.0.smithi115.stdout:5/268: write d19/d2b/f50 [993545,35643] 0 2024-09-13T17:05:46.630 INFO:tasks.workunit.client.0.smithi115.stdout:1/215: dread d5/f14 [0,4194304] 0 2024-09-13T17:05:46.630 INFO:tasks.workunit.client.0.smithi115.stdout:1/216: fsync d5/fa 0 2024-09-13T17:05:46.631 INFO:tasks.workunit.client.1.smithi195.stdout:9/361: creat d6/df/d13/d44/d47/d61/f73 x:0 0 0 2024-09-13T17:05:46.632 INFO:tasks.workunit.client.0.smithi115.stdout:5/269: mknod d19/d2b/d32/d55/d5e/c60 0 2024-09-13T17:05:46.633 INFO:tasks.workunit.client.1.smithi195.stdout:2/371: dread d0/f45 [0,4194304] 0 2024-09-13T17:05:46.634 INFO:tasks.workunit.client.0.smithi115.stdout:1/217: rename d5/d26/f31 to d5/d7/f49 0 2024-09-13T17:05:46.634 INFO:tasks.workunit.client.0.smithi115.stdout:1/218: dread - d5/f41 zero size 2024-09-13T17:05:46.634 INFO:tasks.workunit.client.0.smithi115.stdout:1/219: chown d5/f10 386 1 2024-09-13T17:05:46.635 INFO:tasks.workunit.client.0.smithi115.stdout:1/220: write d5/d7/f1f [296195,47123] 0 2024-09-13T17:05:46.635 INFO:tasks.workunit.client.0.smithi115.stdout:1/221: chown d5/f6 16909 1 2024-09-13T17:05:46.635 INFO:tasks.workunit.client.1.smithi195.stdout:3/307: write d7/f15 [4447439,64674] 0 2024-09-13T17:05:46.635 INFO:tasks.workunit.client.1.smithi195.stdout:3/308: creat d7/d19/d1e/f50 x:0 0 0 2024-09-13T17:05:46.636 INFO:tasks.workunit.client.0.smithi115.stdout:9/164: dwrite d0/f11 [4194304,4194304] 0 2024-09-13T17:05:46.637 INFO:tasks.workunit.client.0.smithi115.stdout:2/391: dwrite d3/d4d/dd/d1f/d2f/d56/f26 [0,4194304] 0 2024-09-13T17:05:46.637 INFO:tasks.workunit.client.0.smithi115.stdout:2/392: stat d3/d4d/d13/d39/f5d 0 2024-09-13T17:05:46.637 INFO:tasks.workunit.client.0.smithi115.stdout:2/393: creat d3/d4d/dd/d1f/d2f/d56/d58/f7f x:0 0 0 2024-09-13T17:05:46.637 INFO:tasks.workunit.client.0.smithi115.stdout:9/165: creat d0/de/d10/d15/f3b x:0 0 0 2024-09-13T17:05:46.637 INFO:tasks.workunit.client.0.smithi115.stdout:1/222: rename d5/d7/ff to d5/d26/f4a 0 2024-09-13T17:05:46.638 INFO:tasks.workunit.client.1.smithi195.stdout:5/337: dwrite d2/f6a [0,4194304] 0 2024-09-13T17:05:46.641 INFO:tasks.workunit.client.1.smithi195.stdout:7/388: dwrite d5/d35/d37/f4a [0,4194304] 0 2024-09-13T17:05:46.642 INFO:tasks.workunit.client.1.smithi195.stdout:3/309: unlink d7/c4d 0 2024-09-13T17:05:46.645 INFO:tasks.workunit.client.1.smithi195.stdout:9/362: write d6/d19/d21/d5b/f5f [3839003,48115] 0 2024-09-13T17:05:46.645 INFO:tasks.workunit.client.1.smithi195.stdout:4/392: dwrite d1a/f4a [0,4194304] 0 2024-09-13T17:05:46.646 INFO:tasks.workunit.client.1.smithi195.stdout:8/330: dwrite d0/d17/d49/f50 [0,4194304] 0 2024-09-13T17:05:46.646 INFO:tasks.workunit.client.1.smithi195.stdout:8/331: chown d0/d17 27560029 1 2024-09-13T17:05:46.646 INFO:tasks.workunit.client.1.smithi195.stdout:9/363: write d6/df/f38 [1591879,48044] 0 2024-09-13T17:05:46.646 INFO:tasks.workunit.client.1.smithi195.stdout:0/357: dwrite d7/d8/d23/d4b/d4e/f5b [0,4194304] 0 2024-09-13T17:05:46.650 INFO:tasks.workunit.client.0.smithi115.stdout:1/223: symlink d5/d26/d2c/l4b 0 2024-09-13T17:05:46.650 INFO:tasks.workunit.client.0.smithi115.stdout:1/224: chown d5/d7/l36 9 1 2024-09-13T17:05:46.650 INFO:tasks.workunit.client.0.smithi115.stdout:1/225: write d5/d7/f21 [891622,23933] 0 2024-09-13T17:05:46.650 INFO:tasks.workunit.client.0.smithi115.stdout:2/394: dread f2 [0,4194304] 0 2024-09-13T17:05:46.650 INFO:tasks.workunit.client.0.smithi115.stdout:2/395: chown d3/d4d/dd 917773 1 2024-09-13T17:05:46.653 INFO:tasks.workunit.client.1.smithi195.stdout:4/393: dread d1a/d1f/d43/d29/f38 [0,4194304] 0 2024-09-13T17:05:46.653 INFO:tasks.workunit.client.1.smithi195.stdout:7/389: dread d5/d35/d37/f4a [0,4194304] 0 2024-09-13T17:05:46.653 INFO:tasks.workunit.client.1.smithi195.stdout:1/306: dwrite db/df/d13/f2e [0,4194304] 0 2024-09-13T17:05:46.665 INFO:tasks.workunit.client.0.smithi115.stdout:2/396: dread d3/f40 [0,4194304] 0 2024-09-13T17:05:46.665 INFO:tasks.workunit.client.1.smithi195.stdout:6/353: dwrite d1c/d24/d49/d5f/d35/f53 [0,4194304] 0 2024-09-13T17:05:46.666 INFO:tasks.workunit.client.1.smithi195.stdout:6/354: stat d1c/d3e/c56 0 2024-09-13T17:05:46.666 INFO:tasks.workunit.client.1.smithi195.stdout:6/355: creat d1c/d2d/d5e/f77 x:0 0 0 2024-09-13T17:05:46.666 INFO:tasks.workunit.client.1.smithi195.stdout:6/356: fsync f2 0 2024-09-13T17:05:46.669 INFO:tasks.workunit.client.0.smithi115.stdout:2/397: symlink d3/d4d/d13/d1c/l80 0 2024-09-13T17:05:46.671 INFO:tasks.workunit.client.1.smithi195.stdout:8/332: mkdir d0/d17/d2f/d6a/d6f 0 2024-09-13T17:05:46.671 INFO:tasks.workunit.client.1.smithi195.stdout:8/333: dread - d0/d13/f57 zero size 2024-09-13T17:05:46.672 INFO:tasks.workunit.client.1.smithi195.stdout:4/394: truncate f0 8904447 0 2024-09-13T17:05:46.672 INFO:tasks.workunit.client.1.smithi195.stdout:4/395: chown d1a/d1f 1 1 2024-09-13T17:05:46.675 INFO:tasks.workunit.client.1.smithi195.stdout:1/307: mknod db/d60/c6e 0 2024-09-13T17:05:46.676 INFO:tasks.workunit.client.1.smithi195.stdout:1/308: read db/df/f26 [112878,63635] 0 2024-09-13T17:05:46.676 INFO:tasks.workunit.client.1.smithi195.stdout:1/309: truncate db/df/d13/f21 592347 0 2024-09-13T17:05:46.676 INFO:tasks.workunit.client.1.smithi195.stdout:1/310: dread - db/d19/d37/f6a zero size 2024-09-13T17:05:46.676 INFO:tasks.workunit.client.1.smithi195.stdout:1/311: write db/d19/d37/d3e/f4c [580653,89834] 0 2024-09-13T17:05:46.677 INFO:tasks.workunit.client.1.smithi195.stdout:3/310: getdents d7/d19 0 2024-09-13T17:05:46.679 INFO:tasks.workunit.client.1.smithi195.stdout:6/357: mknod d1c/d3e/c78 0 2024-09-13T17:05:46.680 INFO:tasks.workunit.client.1.smithi195.stdout:6/358: readlink d1c/d2d/l59 0 2024-09-13T17:05:46.680 INFO:tasks.workunit.client.1.smithi195.stdout:6/359: write d1c/d24/d49/d5f/f41 [555836,93901] 0 2024-09-13T17:05:46.681 INFO:tasks.workunit.client.1.smithi195.stdout:8/334: rename d0/d13/c34 to d0/d17/c70 0 2024-09-13T17:05:46.681 INFO:tasks.workunit.client.1.smithi195.stdout:8/335: stat d0/d4/f39 0 2024-09-13T17:05:46.682 INFO:tasks.workunit.client.1.smithi195.stdout:1/312: mknod db/d19/d5a/c6f 0 2024-09-13T17:05:46.682 INFO:tasks.workunit.client.1.smithi195.stdout:1/313: truncate db/df/f20 1090223 0 2024-09-13T17:05:46.683 INFO:tasks.workunit.client.1.smithi195.stdout:3/311: mkdir d7/d21/d51 0 2024-09-13T17:05:46.683 INFO:tasks.workunit.client.1.smithi195.stdout:3/312: readlink d7/lf 0 2024-09-13T17:05:46.683 INFO:tasks.workunit.client.1.smithi195.stdout:3/313: write d7/d19/d1e/f50 [905857,103425] 0 2024-09-13T17:05:46.683 INFO:tasks.workunit.client.1.smithi195.stdout:6/360: mknod d1c/d3e/d6b/c79 0 2024-09-13T17:05:46.683 INFO:tasks.workunit.client.1.smithi195.stdout:6/361: write d1c/d24/f38 [902916,117402] 0 2024-09-13T17:05:46.684 INFO:tasks.workunit.client.1.smithi195.stdout:1/314: mkdir db/df/d51/d62/d70 0 2024-09-13T17:05:46.684 INFO:tasks.workunit.client.1.smithi195.stdout:1/315: truncate db/f6b 99068 0 2024-09-13T17:05:46.684 INFO:tasks.workunit.client.1.smithi195.stdout:1/316: rename db/d19/d37/d3e/f6c to db/df/d4d/f71 0 2024-09-13T17:05:46.686 INFO:tasks.workunit.client.1.smithi195.stdout:2/372: dwrite d0/d3/fe [0,4194304] 0 2024-09-13T17:05:46.686 INFO:tasks.workunit.client.1.smithi195.stdout:2/373: write d0/d4a/d1c/d1e/f2a [3109482,106979] 0 2024-09-13T17:05:46.688 INFO:tasks.workunit.client.1.smithi195.stdout:2/374: mknod d0/d4a/d1c/d2c/c74 0 2024-09-13T17:05:46.688 INFO:tasks.workunit.client.1.smithi195.stdout:2/375: write d0/f54 [196374,36726] 0 2024-09-13T17:05:46.688 INFO:tasks.workunit.client.1.smithi195.stdout:2/376: write d0/d4a/f36 [4954060,124347] 0 2024-09-13T17:05:46.688 INFO:tasks.workunit.client.1.smithi195.stdout:2/377: chown d0/d3/df/f35 237774 1 2024-09-13T17:05:46.694 INFO:tasks.workunit.client.1.smithi195.stdout:3/314: dread d7/d21/d2a/d35/f3d [0,4194304] 0 2024-09-13T17:05:46.694 INFO:tasks.workunit.client.1.smithi195.stdout:3/315: creat d7/d19/d1e/f52 x:0 0 0 2024-09-13T17:05:46.694 INFO:tasks.workunit.client.1.smithi195.stdout:3/316: chown d7/d19/c1f 825 1 2024-09-13T17:05:46.695 INFO:tasks.workunit.client.1.smithi195.stdout:8/336: dread d0/d17/d2f/f40 [0,4194304] 0 2024-09-13T17:05:46.696 INFO:tasks.workunit.client.1.smithi195.stdout:8/337: chown d0/l5c 28790 1 2024-09-13T17:05:46.696 INFO:tasks.workunit.client.1.smithi195.stdout:8/338: chown d0/d13/d4d/f48 311 1 2024-09-13T17:05:46.696 INFO:tasks.workunit.client.1.smithi195.stdout:3/317: truncate d7/d19/f48 2823195 0 2024-09-13T17:05:46.697 INFO:tasks.workunit.client.1.smithi195.stdout:1/317: dread db/df/d4d/f4f [0,4194304] 0 2024-09-13T17:05:46.697 INFO:tasks.workunit.client.1.smithi195.stdout:1/318: creat db/df/d51/f72 x:0 0 0 2024-09-13T17:05:46.697 INFO:tasks.workunit.client.1.smithi195.stdout:8/339: mkdir d0/d17/d49/d63/d71 0 2024-09-13T17:05:46.701 INFO:tasks.workunit.client.1.smithi195.stdout:3/318: dread d7/d21/d2a/d35/f3d [0,4194304] 0 2024-09-13T17:05:46.703 INFO:tasks.workunit.client.1.smithi195.stdout:3/319: rmdir d7/d46 0 2024-09-13T17:05:46.705 INFO:tasks.workunit.client.1.smithi195.stdout:3/320: creat d7/d21/d2a/d35/f53 x:0 0 0 2024-09-13T17:05:46.705 INFO:tasks.workunit.client.1.smithi195.stdout:3/321: write d7/d19/d1e/f52 [315663,30734] 0 2024-09-13T17:05:46.705 INFO:tasks.workunit.client.1.smithi195.stdout:3/322: creat d7/d21/d51/f54 x:0 0 0 2024-09-13T17:05:46.706 INFO:tasks.workunit.client.1.smithi195.stdout:3/323: mknod d7/c55 0 2024-09-13T17:05:46.707 INFO:tasks.workunit.client.1.smithi195.stdout:5/338: dwrite d2/d12/d4e/f1d [0,4194304] 0 2024-09-13T17:05:46.708 INFO:tasks.workunit.client.1.smithi195.stdout:5/339: write d2/d12/d3f/f4d [882629,59387] 0 2024-09-13T17:05:46.708 INFO:tasks.workunit.client.1.smithi195.stdout:3/324: unlink d7/lb 0 2024-09-13T17:05:46.710 INFO:tasks.workunit.client.1.smithi195.stdout:5/340: link d2/d12/d3f/f4d d2/df/d39/d54/d58/f6b 0 2024-09-13T17:05:46.710 INFO:tasks.workunit.client.1.smithi195.stdout:5/341: readlink d2/d12/l13 0 2024-09-13T17:05:46.710 INFO:tasks.workunit.client.1.smithi195.stdout:3/325: mknod d7/d21/d2a/c56 0 2024-09-13T17:05:46.710 INFO:tasks.workunit.client.1.smithi195.stdout:3/326: stat d7/d19/d1e/f50 0 2024-09-13T17:05:46.711 INFO:tasks.workunit.client.1.smithi195.stdout:3/327: write d7/d19/d1e/f52 [425247,36525] 0 2024-09-13T17:05:46.712 INFO:tasks.workunit.client.1.smithi195.stdout:9/364: dwrite d6/d12/d39/f3e [4194304,4194304] 0 2024-09-13T17:05:46.712 INFO:tasks.workunit.client.1.smithi195.stdout:3/328: symlink d7/l57 0 2024-09-13T17:05:46.712 INFO:tasks.workunit.client.0.smithi115.stdout:1/226: dwrite d5/d7/f49 [0,4194304] 0 2024-09-13T17:05:46.714 INFO:tasks.workunit.client.1.smithi195.stdout:9/365: truncate d6/f18 3965979 0 2024-09-13T17:05:46.714 INFO:tasks.workunit.client.1.smithi195.stdout:9/366: write d6/f69 [941550,105816] 0 2024-09-13T17:05:46.714 INFO:tasks.workunit.client.1.smithi195.stdout:9/367: stat d6/df/d16/d58/f6e 0 2024-09-13T17:05:46.718 INFO:tasks.workunit.client.1.smithi195.stdout:9/368: creat d6/df/d16/f74 x:0 0 0 2024-09-13T17:05:46.718 INFO:tasks.workunit.client.0.smithi115.stdout:1/227: mknod d5/c4c 0 2024-09-13T17:05:46.718 INFO:tasks.workunit.client.0.smithi115.stdout:1/228: dread - d5/d3e/f47 zero size 2024-09-13T17:05:46.719 INFO:tasks.workunit.client.1.smithi195.stdout:9/369: creat d6/df/d16/d65/f75 x:0 0 0 2024-09-13T17:05:46.720 INFO:tasks.workunit.client.0.smithi115.stdout:1/229: unlink d5/fa 0 2024-09-13T17:05:46.721 INFO:tasks.workunit.client.0.smithi115.stdout:1/230: creat d5/d26/f4d x:0 0 0 2024-09-13T17:05:46.721 INFO:tasks.workunit.client.1.smithi195.stdout:7/390: dwrite d5/db/d19/f18 [0,4194304] 0 2024-09-13T17:05:46.722 INFO:tasks.workunit.client.1.smithi195.stdout:4/396: dwrite d1a/d1f/d43/d29/f3f [0,4194304] 0 2024-09-13T17:05:46.722 INFO:tasks.workunit.client.1.smithi195.stdout:4/397: fdatasync d1a/d1f/d43/d29/f38 0 2024-09-13T17:05:46.722 INFO:tasks.workunit.client.1.smithi195.stdout:4/398: fsync d1a/d1f/d21/d22/f26 0 2024-09-13T17:05:46.722 INFO:tasks.workunit.client.1.smithi195.stdout:0/358: dwrite d7/d8/d23/d4b/d4e/f5b [4194304,4194304] 0 2024-09-13T17:05:46.723 INFO:tasks.workunit.client.1.smithi195.stdout:0/359: dread - d7/d8/d23/d4b/d4e/f65 zero size 2024-09-13T17:05:46.723 INFO:tasks.workunit.client.0.smithi115.stdout:1/231: mknod d5/d3e/c4e 0 2024-09-13T17:05:46.723 INFO:tasks.workunit.client.0.smithi115.stdout:2/398: dwrite d3/d4d/de/f2a [0,4194304] 0 2024-09-13T17:05:46.724 INFO:tasks.workunit.client.1.smithi195.stdout:7/391: symlink d5/db/d50/d7f/d82/l84 0 2024-09-13T17:05:46.724 INFO:tasks.workunit.client.0.smithi115.stdout:1/232: creat d5/d7/d33/d48/f4f x:0 0 0 2024-09-13T17:05:46.725 INFO:tasks.workunit.client.0.smithi115.stdout:1/233: write d5/fb [1529439,118207] 0 2024-09-13T17:05:46.725 INFO:tasks.workunit.client.1.smithi195.stdout:4/399: creat d1a/d1f/d43/d29/d58/f80 x:0 0 0 2024-09-13T17:05:46.727 INFO:tasks.workunit.client.1.smithi195.stdout:0/360: creat d7/d8/d23/d4b/d56/d4d/d5e/f71 x:0 0 0 2024-09-13T17:05:46.728 INFO:tasks.workunit.client.1.smithi195.stdout:4/400: creat d1a/d1f/d43/d5a/f81 x:0 0 0 2024-09-13T17:05:46.729 INFO:tasks.workunit.client.1.smithi195.stdout:6/362: dwrite d1c/d24/f51 [0,4194304] 0 2024-09-13T17:05:46.729 INFO:tasks.workunit.client.0.smithi115.stdout:2/399: symlink d3/d4d/d13/d1c/l81 0 2024-09-13T17:05:46.729 INFO:tasks.workunit.client.0.smithi115.stdout:2/400: readlink d3/d4d/dd/df/d57/l60 0 2024-09-13T17:05:46.729 INFO:tasks.workunit.client.0.smithi115.stdout:2/401: fsync d3/d4d/dd/df/f28 0 2024-09-13T17:05:46.730 INFO:tasks.workunit.client.1.smithi195.stdout:8/340: dwrite d0/d13/f16 [0,4194304] 0 2024-09-13T17:05:46.730 INFO:tasks.workunit.client.1.smithi195.stdout:8/341: getdents d0/d13/d52/d55 0 2024-09-13T17:05:46.732 INFO:tasks.workunit.client.1.smithi195.stdout:2/378: dwrite d0/d4a/d1c/d1e/f52 [0,4194304] 0 2024-09-13T17:05:46.732 INFO:tasks.workunit.client.1.smithi195.stdout:2/379: stat d0/d3/c44 0 2024-09-13T17:05:46.732 INFO:tasks.workunit.client.0.smithi115.stdout:1/234: rename l3 to d5/d7/d33/d48/l50 0 2024-09-13T17:05:46.733 INFO:tasks.workunit.client.1.smithi195.stdout:4/401: link d1a/d1f/d43/d29/l49 d1a/d1f/d43/d29/l82 0 2024-09-13T17:05:46.734 INFO:tasks.workunit.client.0.smithi115.stdout:2/402: creat d3/d4d/d13/d62/d66/f82 x:0 0 0 2024-09-13T17:05:46.734 INFO:tasks.workunit.client.0.smithi115.stdout:2/403: readlink d3/d4d/d13/d1c/l3d 0 2024-09-13T17:05:46.734 INFO:tasks.workunit.client.0.smithi115.stdout:2/404: creat d3/d4d/dd/df/d5b/f83 x:0 0 0 2024-09-13T17:05:46.734 INFO:tasks.workunit.client.0.smithi115.stdout:2/405: fsync f2 0 2024-09-13T17:05:46.734 INFO:tasks.workunit.client.1.smithi195.stdout:3/329: dread d7/f2d [0,4194304] 0 2024-09-13T17:05:46.734 INFO:tasks.workunit.client.1.smithi195.stdout:5/342: dwrite d2/df/d39/f49 [0,4194304] 0 2024-09-13T17:05:46.735 INFO:tasks.workunit.client.1.smithi195.stdout:3/330: chown c6 3493852 1 2024-09-13T17:05:46.735 INFO:tasks.workunit.client.1.smithi195.stdout:3/331: chown d7/d21/d2a/c49 130437 1 2024-09-13T17:05:46.735 INFO:tasks.workunit.client.0.smithi115.stdout:1/235: creat d5/d7/d33/d3a/f51 x:0 0 0 2024-09-13T17:05:46.736 INFO:tasks.workunit.client.0.smithi115.stdout:1/236: chown d5/l38 0 1 2024-09-13T17:05:46.739 INFO:tasks.workunit.client.1.smithi195.stdout:6/363: mknod d1c/d2d/d30/d6f/c7a 0 2024-09-13T17:05:46.739 INFO:tasks.workunit.client.1.smithi195.stdout:6/364: fdatasync d1c/f23 0 2024-09-13T17:05:46.740 INFO:tasks.workunit.client.0.smithi115.stdout:2/406: symlink d3/d4d/dd/l84 0 2024-09-13T17:05:46.742 INFO:tasks.workunit.client.1.smithi195.stdout:8/342: rename d0/d17/c2a to d0/d13/d4d/c72 0 2024-09-13T17:05:46.742 INFO:tasks.workunit.client.1.smithi195.stdout:4/402: write d1a/d1f/d43/d24/d41/f47 [383702,1600] 0 2024-09-13T17:05:46.742 INFO:tasks.workunit.client.1.smithi195.stdout:8/343: chown d0/d13/d52 3 1 2024-09-13T17:05:46.742 INFO:tasks.workunit.client.1.smithi195.stdout:4/403: dread - d1a/d1f/d43/d24/f78 zero size 2024-09-13T17:05:46.742 INFO:tasks.workunit.client.1.smithi195.stdout:8/344: stat d0/d13/l4f 0 2024-09-13T17:05:46.743 INFO:tasks.workunit.client.0.smithi115.stdout:1/237: mknod d5/d26/c52 0 2024-09-13T17:05:46.743 INFO:tasks.workunit.client.1.smithi195.stdout:2/380: mkdir d0/d4a/d47/d73/d75 0 2024-09-13T17:05:46.746 INFO:tasks.workunit.client.0.smithi115.stdout:2/407: rmdir d3/d4d/dd/df/d5c 39 2024-09-13T17:05:46.748 INFO:tasks.workunit.client.1.smithi195.stdout:9/370: dwrite d6/d19/d21/d5b/f6f [0,4194304] 0 2024-09-13T17:05:46.749 INFO:tasks.workunit.client.1.smithi195.stdout:3/332: link d7/d21/c28 d7/d19/c58 0 2024-09-13T17:05:46.749 INFO:tasks.workunit.client.1.smithi195.stdout:3/333: write d7/d21/d2a/f3b [1377702,32912] 0 2024-09-13T17:05:46.750 INFO:tasks.workunit.client.1.smithi195.stdout:5/343: mknod d2/df/d39/d54/d58/c6c 0 2024-09-13T17:05:46.752 INFO:tasks.workunit.client.1.smithi195.stdout:4/404: rename d1a/c3a to d1a/d1f/d43/d24/c83 0 2024-09-13T17:05:46.754 INFO:tasks.workunit.client.1.smithi195.stdout:8/345: mkdir d0/d4/d73 0 2024-09-13T17:05:46.755 INFO:tasks.workunit.client.1.smithi195.stdout:6/365: fdatasync d1c/d24/f38 0 2024-09-13T17:05:46.755 INFO:tasks.workunit.client.1.smithi195.stdout:7/392: dwrite d5/db/d50/f81 [0,4194304] 0 2024-09-13T17:05:46.755 INFO:tasks.workunit.client.1.smithi195.stdout:7/393: stat d5/d35/l61 0 2024-09-13T17:05:46.755 INFO:tasks.workunit.client.1.smithi195.stdout:7/394: chown d5/d35/d37 0 1 2024-09-13T17:05:46.755 INFO:tasks.workunit.client.1.smithi195.stdout:0/361: dwrite d7/d8/d23/d4b/d56/d46/f2e [8388608,4194304] 0 2024-09-13T17:05:46.757 INFO:tasks.workunit.client.1.smithi195.stdout:9/371: symlink d6/d19/d21/d64/l76 0 2024-09-13T17:05:46.758 INFO:tasks.workunit.client.0.smithi115.stdout:1/238: dread d5/f6 [0,4194304] 0 2024-09-13T17:05:46.759 INFO:tasks.workunit.client.0.smithi115.stdout:2/408: write d3/d4d/dd/d1f/d2f/d56/f34 [130804,91012] 0 2024-09-13T17:05:46.760 INFO:tasks.workunit.client.1.smithi195.stdout:5/344: mknod d2/d12/d4e/d10/d46/c6d 0 2024-09-13T17:05:46.760 INFO:tasks.workunit.client.1.smithi195.stdout:5/345: chown d2/f26 6332 1 2024-09-13T17:05:46.761 INFO:tasks.workunit.client.1.smithi195.stdout:2/381: dwrite d0/d4a/d1c/d2c/d51/f32 [0,4194304] 0 2024-09-13T17:05:46.761 INFO:tasks.workunit.client.1.smithi195.stdout:2/382: truncate d0/f6c 313174 0 2024-09-13T17:05:46.762 INFO:tasks.workunit.client.0.smithi115.stdout:1/239: creat d5/d7/d33/f53 x:0 0 0 2024-09-13T17:05:46.765 INFO:tasks.workunit.client.1.smithi195.stdout:4/405: unlink d1a/d1f/d43/d24/d41/f47 0 2024-09-13T17:05:46.765 INFO:tasks.workunit.client.1.smithi195.stdout:1/319: rmdir db/df/d51 39 2024-09-13T17:05:46.765 INFO:tasks.workunit.client.1.smithi195.stdout:1/320: chown db/df/d13/f27 2037613550 1 2024-09-13T17:05:46.768 INFO:tasks.workunit.client.1.smithi195.stdout:8/346: read d0/d17/f56 [857041,18976] 0 2024-09-13T17:05:46.768 INFO:tasks.workunit.client.1.smithi195.stdout:8/347: chown d0/d17/d49 1789919 1 2024-09-13T17:05:46.768 INFO:tasks.workunit.client.1.smithi195.stdout:8/348: chown d0/c29 11 1 2024-09-13T17:05:46.768 INFO:tasks.workunit.client.1.smithi195.stdout:8/349: chown d0/l2c 16 1 2024-09-13T17:05:46.772 INFO:tasks.workunit.client.0.smithi115.stdout:2/409: dread d3/d4d/de/f10 [0,4194304] 0 2024-09-13T17:05:46.773 INFO:tasks.workunit.client.1.smithi195.stdout:7/395: rename d5/db/d19/d22/l4b to d5/db/d19/d22/d3c/l85 0 2024-09-13T17:05:46.775 INFO:tasks.workunit.client.1.smithi195.stdout:0/362: creat d7/db/d38/d5d/f72 x:0 0 0 2024-09-13T17:05:46.775 INFO:tasks.workunit.client.1.smithi195.stdout:9/372: write d6/f3f [1087858,69706] 0 2024-09-13T17:05:46.776 INFO:tasks.workunit.client.1.smithi195.stdout:6/366: dwrite f14 [0,4194304] 0 2024-09-13T17:05:46.777 INFO:tasks.workunit.client.0.smithi115.stdout:2/410: symlink d3/d4d/d13/d1c/l85 0 2024-09-13T17:05:46.777 INFO:tasks.workunit.client.0.smithi115.stdout:2/411: stat d3/d4d/d13/f6e 0 2024-09-13T17:05:46.777 INFO:tasks.workunit.client.0.smithi115.stdout:2/412: fdatasync d3/d4d/d13/f45 0 2024-09-13T17:05:46.777 INFO:tasks.workunit.client.1.smithi195.stdout:3/334: rmdir d7/d21/d51 39 2024-09-13T17:05:46.780 INFO:tasks.workunit.client.1.smithi195.stdout:5/346: mknod d2/df/d39/d54/d58/c6e 0 2024-09-13T17:05:46.781 INFO:tasks.workunit.client.1.smithi195.stdout:2/383: dwrite d0/d3/f5b [0,4194304] 0 2024-09-13T17:05:46.783 INFO:tasks.workunit.client.1.smithi195.stdout:9/373: write d6/f1e [3068026,87297] 0 2024-09-13T17:05:46.783 INFO:tasks.workunit.client.0.smithi115.stdout:2/413: dread d3/f40 [0,4194304] 0 2024-09-13T17:05:46.783 INFO:tasks.workunit.client.0.smithi115.stdout:2/414: creat d3/d4d/dd/df/f86 x:0 0 0 2024-09-13T17:05:46.783 INFO:tasks.workunit.client.0.smithi115.stdout:2/415: chown d3/d4d/d13/d62/d66/l6a 880974753 1 2024-09-13T17:05:46.788 INFO:tasks.workunit.client.1.smithi195.stdout:4/406: mkdir d1a/d1f/d21/d84 0 2024-09-13T17:05:46.788 INFO:tasks.workunit.client.1.smithi195.stdout:4/407: chown l9 402 1 2024-09-13T17:05:46.788 INFO:tasks.workunit.client.1.smithi195.stdout:4/408: write fa [2339850,115447] 0 2024-09-13T17:05:46.788 INFO:tasks.workunit.client.1.smithi195.stdout:4/409: chown d1a/d1f/d21/d84 1674345 1 2024-09-13T17:05:46.788 INFO:tasks.workunit.client.1.smithi195.stdout:4/410: dread - d1a/d1f/d21/d22/f77 zero size 2024-09-13T17:05:46.788 INFO:tasks.workunit.client.1.smithi195.stdout:4/411: dread - d1a/d1f/d21/f6a zero size 2024-09-13T17:05:46.789 INFO:tasks.workunit.client.0.smithi115.stdout:1/240: truncate d5/d26/f29 1622084 0 2024-09-13T17:05:46.789 INFO:tasks.workunit.client.0.smithi115.stdout:2/416: mkdir d3/d4d/d13/d39/d87 0 2024-09-13T17:05:46.789 INFO:tasks.workunit.client.0.smithi115.stdout:2/417: write d3/f18 [240875,87940] 0 2024-09-13T17:05:46.789 INFO:tasks.workunit.client.0.smithi115.stdout:2/418: fsync d3/d4d/de/d3a/d47/f49 0 2024-09-13T17:05:46.826 INFO:tasks.workunit.client.1.smithi195.stdout:1/321: mkdir db/d60/d73 0 2024-09-13T17:05:46.826 INFO:tasks.workunit.client.1.smithi195.stdout:1/322: fsync db/df/d4d/f4f 0 2024-09-13T17:05:46.828 INFO:tasks.workunit.client.1.smithi195.stdout:8/350: symlink d0/d13/d52/d55/l74 0 2024-09-13T17:05:46.829 INFO:tasks.workunit.client.1.smithi195.stdout:8/351: fdatasync d0/d17/d2f/f40 0 2024-09-13T17:05:46.830 INFO:tasks.workunit.client.1.smithi195.stdout:7/396: mknod d5/d13/d24/d70/c86 0 2024-09-13T17:05:46.831 INFO:tasks.workunit.client.1.smithi195.stdout:7/397: chown d5/d13/d30/f36 0 1 2024-09-13T17:05:46.833 INFO:tasks.workunit.client.1.smithi195.stdout:0/363: rename d7/d50/f31 to d7/db/d11/f73 0 2024-09-13T17:05:46.833 INFO:tasks.workunit.client.1.smithi195.stdout:0/364: creat d7/d8/d23/d4b/d56/d46/f74 x:0 0 0 2024-09-13T17:05:46.834 INFO:tasks.workunit.client.1.smithi195.stdout:9/374: write d6/d19/d21/d5b/f6f [3307723,79550] 0 2024-09-13T17:05:46.839 INFO:tasks.workunit.client.0.smithi115.stdout:1/241: truncate d5/d26/d2c/f32 2048354 0 2024-09-13T17:05:46.844 INFO:tasks.workunit.client.1.smithi195.stdout:6/367: rmdir d1c/d5d 0 2024-09-13T17:05:46.844 INFO:tasks.workunit.client.1.smithi195.stdout:6/368: chown ce 3 1 2024-09-13T17:05:46.844 INFO:tasks.workunit.client.0.smithi115.stdout:2/419: symlink d3/d4d/d13/d77/l88 0 2024-09-13T17:05:46.846 INFO:tasks.workunit.client.1.smithi195.stdout:5/347: unlink d2/d12/d4e/d10/f51 0 2024-09-13T17:05:46.850 INFO:tasks.workunit.client.1.smithi195.stdout:2/384: creat d0/f76 x:0 0 0 2024-09-13T17:05:46.850 INFO:tasks.workunit.client.1.smithi195.stdout:2/385: stat d0/d4a/l33 0 2024-09-13T17:05:46.854 INFO:tasks.workunit.client.1.smithi195.stdout:4/412: mknod d1a/d1f/d43/d24/d41/c85 0 2024-09-13T17:05:46.858 INFO:tasks.workunit.client.1.smithi195.stdout:1/323: mkdir db/df/d4d/d74 0 2024-09-13T17:05:46.858 INFO:tasks.workunit.client.1.smithi195.stdout:1/324: write db/df/d51/f72 [893531,11089] 0 2024-09-13T17:05:46.859 INFO:tasks.workunit.client.0.smithi115.stdout:1/242: dwrite d5/d26/f4d [0,4194304] 0 2024-09-13T17:05:46.859 INFO:tasks.workunit.client.0.smithi115.stdout:1/243: creat d5/d7/d33/f54 x:0 0 0 2024-09-13T17:05:46.859 INFO:tasks.workunit.client.0.smithi115.stdout:1/244: fsync d5/d7/d33/d3a/f51 0 2024-09-13T17:05:46.859 INFO:tasks.workunit.client.0.smithi115.stdout:1/245: creat d5/d26/f55 x:0 0 0 2024-09-13T17:05:46.860 INFO:tasks.workunit.client.0.smithi115.stdout:2/420: dwrite d3/d4d/dd/d1f/d2f/d56/f2b [4194304,4194304] 0 2024-09-13T17:05:46.861 INFO:tasks.workunit.client.1.smithi195.stdout:8/352: unlink d0/d17/l25 0 2024-09-13T17:05:46.873 INFO:tasks.workunit.client.1.smithi195.stdout:7/398: unlink d5/db/d50/d7f/d82/l84 0 2024-09-13T17:05:46.873 INFO:tasks.workunit.client.1.smithi195.stdout:7/399: creat d5/db/d50/f87 x:0 0 0 2024-09-13T17:05:46.874 INFO:tasks.workunit.client.0.smithi115.stdout:2/421: dread d3/d4d/de/f37 [0,4194304] 0 2024-09-13T17:05:46.876 INFO:tasks.workunit.client.1.smithi195.stdout:8/353: dwrite d0/d17/d2f/d31/f53 [0,4194304] 0 2024-09-13T17:05:46.876 INFO:tasks.workunit.client.1.smithi195.stdout:8/354: chown d0/d13/c38 1520802600 1 2024-09-13T17:05:46.877 INFO:tasks.workunit.client.0.smithi115.stdout:1/246: link d5/d7/c8 d5/d26/d2c/c56 0 2024-09-13T17:05:46.877 INFO:tasks.workunit.client.0.smithi115.stdout:1/247: chown d5/d26/d2c/l30 1563133 1 2024-09-13T17:05:46.877 INFO:tasks.workunit.client.1.smithi195.stdout:1/325: dwrite db/d19/d37/f3b [0,4194304] 0 2024-09-13T17:05:46.878 INFO:tasks.workunit.client.1.smithi195.stdout:1/326: write db/d19/d37/f4e [3161857,24550] 0 2024-09-13T17:05:46.878 INFO:tasks.workunit.client.1.smithi195.stdout:0/365: link d7/db/c22 d7/d50/c75 0 2024-09-13T17:05:46.878 INFO:tasks.workunit.client.1.smithi195.stdout:0/366: readlink d7/d8/d23/d4b/d56/d46/l19 0 2024-09-13T17:05:46.879 INFO:tasks.workunit.client.0.smithi115.stdout:2/422: symlink d3/d4d/d13/d39/d46/d70/l89 0 2024-09-13T17:05:46.880 INFO:tasks.workunit.client.0.smithi115.stdout:1/248: rename d5/d7/d33/d3a/f44 to d5/d7/d33/d3a/f57 0 2024-09-13T17:05:46.882 INFO:tasks.workunit.client.0.smithi115.stdout:2/423: rename d3/f5f to d3/f8a 0 2024-09-13T17:05:46.882 INFO:tasks.workunit.client.0.smithi115.stdout:2/424: fsync d3/d4d/dd/d1f/d2f/d56/f26 0 2024-09-13T17:05:46.882 INFO:tasks.workunit.client.0.smithi115.stdout:2/425: truncate d3/d4d/d13/d39/f5d 735523 0 2024-09-13T17:05:46.883 INFO:tasks.workunit.client.0.smithi115.stdout:1/249: symlink d5/d7/d33/d48/l58 0 2024-09-13T17:05:46.883 INFO:tasks.workunit.client.0.smithi115.stdout:1/250: chown d5/d7/d33/c34 29700452 1 2024-09-13T17:05:46.884 INFO:tasks.workunit.client.1.smithi195.stdout:1/327: dread db/df/d13/f2e [0,4194304] 0 2024-09-13T17:05:46.885 INFO:tasks.workunit.client.0.smithi115.stdout:2/426: truncate d3/f8a 2045798 0 2024-09-13T17:05:46.885 INFO:tasks.workunit.client.0.smithi115.stdout:2/427: fdatasync d3/d4d/de/f59 0 2024-09-13T17:05:46.885 INFO:tasks.workunit.client.0.smithi115.stdout:2/428: dread - d3/d4d/dd/d1f/d2f/d56/d58/f7b zero size 2024-09-13T17:05:46.886 INFO:tasks.workunit.client.1.smithi195.stdout:1/328: dread db/df/f16 [0,4194304] 0 2024-09-13T17:05:46.888 INFO:tasks.workunit.client.0.smithi115.stdout:1/251: dread d5/f6 [0,4194304] 0 2024-09-13T17:05:46.889 INFO:tasks.workunit.client.0.smithi115.stdout:1/252: chown d5/d7/d33/d48 289 1 2024-09-13T17:05:46.889 INFO:tasks.workunit.client.0.smithi115.stdout:1/253: read d5/f22 [626264,402] 0 2024-09-13T17:05:46.889 INFO:tasks.workunit.client.0.smithi115.stdout:2/429: mkdir d3/d4d/dd/df/d57/d8b 0 2024-09-13T17:05:46.889 INFO:tasks.workunit.client.0.smithi115.stdout:2/430: chown d3/d4d/dd/df/d5c 54 1 2024-09-13T17:05:46.889 INFO:tasks.workunit.client.0.smithi115.stdout:2/431: write d3/d4d/dd/d1f/f7e [1027424,16237] 0 2024-09-13T17:05:46.891 INFO:tasks.workunit.client.0.smithi115.stdout:2/432: link d3/d4d/d13/c63 d3/d4d/d13/d1c/c8c 0 2024-09-13T17:05:46.894 INFO:tasks.workunit.client.0.smithi115.stdout:2/433: creat d3/d4d/de/d3a/d47/f8d x:0 0 0 2024-09-13T17:05:46.894 INFO:tasks.workunit.client.0.smithi115.stdout:2/434: chown d3/d4d/de/c27 6 1 2024-09-13T17:05:46.896 INFO:tasks.workunit.client.0.smithi115.stdout:1/254: dread d5/f22 [0,4194304] 0 2024-09-13T17:05:46.897 INFO:tasks.workunit.client.0.smithi115.stdout:2/435: unlink d3/d4d/dd/df/f28 0 2024-09-13T17:05:46.900 INFO:tasks.workunit.client.0.smithi115.stdout:1/255: mkdir d5/d3e/d59 0 2024-09-13T17:05:46.908 INFO:tasks.workunit.client.1.smithi195.stdout:9/375: symlink d6/df/d13/d44/d5e/l77 0 2024-09-13T17:05:46.908 INFO:tasks.workunit.client.1.smithi195.stdout:9/376: rename d6 to d6/d19/d21/d78 22 2024-09-13T17:05:46.908 INFO:tasks.workunit.client.1.smithi195.stdout:9/377: truncate d6/d19/d21/d45/f54 290196 0 2024-09-13T17:05:46.908 INFO:tasks.workunit.client.1.smithi195.stdout:9/378: write d6/df/d16/d65/f75 [375867,64666] 0 2024-09-13T17:05:46.908 INFO:tasks.workunit.client.1.smithi195.stdout:9/379: read d6/d12/f2b [3217710,91615] 0 2024-09-13T17:05:46.908 INFO:tasks.workunit.client.1.smithi195.stdout:9/380: chown d6/d12/d39/f42 108373 1 2024-09-13T17:05:46.909 INFO:tasks.workunit.client.1.smithi195.stdout:9/381: truncate d6/d12/f4d 746274 0 2024-09-13T17:05:46.909 INFO:tasks.workunit.client.1.smithi195.stdout:9/382: creat d6/d19/d21/d5b/f79 x:0 0 0 2024-09-13T17:05:46.909 INFO:tasks.workunit.client.1.smithi195.stdout:6/369: stat d1c/d2d/c31 0 2024-09-13T17:05:46.909 INFO:tasks.workunit.client.1.smithi195.stdout:6/370: creat d1c/d2d/f7b x:0 0 0 2024-09-13T17:05:46.909 INFO:tasks.workunit.client.1.smithi195.stdout:5/348: rmdir d2/d3e/d32/d56 0 2024-09-13T17:05:46.909 INFO:tasks.workunit.client.1.smithi195.stdout:5/349: chown d2/c21 1 1 2024-09-13T17:05:46.910 INFO:tasks.workunit.client.1.smithi195.stdout:2/386: stat d0/d3/d3d/l6e 0 2024-09-13T17:05:46.911 INFO:tasks.workunit.client.1.smithi195.stdout:4/413: mknod d1a/d1f/d21/d84/c86 0 2024-09-13T17:05:46.913 INFO:tasks.workunit.client.1.smithi195.stdout:7/400: truncate f4 6289764 0 2024-09-13T17:05:46.913 INFO:tasks.workunit.client.1.smithi195.stdout:7/401: fsync d5/d35/d37/f4a 0 2024-09-13T17:05:46.913 INFO:tasks.workunit.client.1.smithi195.stdout:7/402: write d5/db/d50/f87 [711653,85958] 0 2024-09-13T17:05:46.915 INFO:tasks.workunit.client.1.smithi195.stdout:8/355: mknod d0/d4/c75 0 2024-09-13T17:05:46.916 INFO:tasks.workunit.client.1.smithi195.stdout:6/371: dread d1c/d24/d49/d5f/d35/f4d [0,4194304] 0 2024-09-13T17:05:46.919 INFO:tasks.workunit.client.0.smithi115.stdout:2/436: dwrite d3/d4d/d13/d39/f3b [0,4194304] 0 2024-09-13T17:05:46.919 INFO:tasks.workunit.client.0.smithi115.stdout:2/437: stat d3/d4d/dd/l84 0 2024-09-13T17:05:46.920 INFO:tasks.workunit.client.0.smithi115.stdout:2/438: readlink d3/d4d/d13/d62/d66/l67 0 2024-09-13T17:05:46.920 INFO:tasks.workunit.client.0.smithi115.stdout:2/439: write d3/d4d/dd/df/d5b/f83 [720278,7536] 0 2024-09-13T17:05:46.920 INFO:tasks.workunit.client.0.smithi115.stdout:2/440: write d3/f18 [5083081,106808] 0 2024-09-13T17:05:46.920 INFO:tasks.workunit.client.0.smithi115.stdout:2/441: write d3/d4d/dd/d1f/f79 [784033,92676] 0 2024-09-13T17:05:46.920 INFO:tasks.workunit.client.0.smithi115.stdout:2/442: chown d3/c7 232183083 1 2024-09-13T17:05:46.920 INFO:tasks.workunit.client.0.smithi115.stdout:2/443: write d3/f40 [4060297,39434] 0 2024-09-13T17:05:46.920 INFO:tasks.workunit.client.0.smithi115.stdout:2/444: truncate d3/d4d/dd/d1f/d2f/d56/d58/f7b 229824 0 2024-09-13T17:05:46.921 INFO:tasks.workunit.client.1.smithi195.stdout:5/350: write d2/df/d39/f44 [4928518,3218] 0 2024-09-13T17:05:46.921 INFO:tasks.workunit.client.1.smithi195.stdout:6/372: dread d1c/d24/d49/d5f/f41 [0,4194304] 0 2024-09-13T17:05:46.922 INFO:tasks.workunit.client.1.smithi195.stdout:0/367: unlink d7/d8/d23/d4b/d56/d46/c6a 0 2024-09-13T17:05:46.923 INFO:tasks.workunit.client.0.smithi115.stdout:2/445: dread d3/d4d/de/f59 [0,4194304] 0 2024-09-13T17:05:46.924 INFO:tasks.workunit.client.0.smithi115.stdout:2/446: truncate d3/d4d/d13/f45 1033418 0 2024-09-13T17:05:46.924 INFO:tasks.workunit.client.0.smithi115.stdout:2/447: stat d3/d4d/d13/f51 0 2024-09-13T17:05:46.924 INFO:tasks.workunit.client.1.smithi195.stdout:1/329: unlink db/df/f3d 0 2024-09-13T17:05:46.924 INFO:tasks.workunit.client.1.smithi195.stdout:1/330: fsync db/f6b 0 2024-09-13T17:05:46.927 INFO:tasks.workunit.client.1.smithi195.stdout:5/351: write d2/df/fa [5110135,45052] 0 2024-09-13T17:05:46.931 INFO:tasks.workunit.client.1.smithi195.stdout:2/387: unlink d0/d4a/d1c/d1e/f52 0 2024-09-13T17:05:46.932 INFO:tasks.workunit.client.1.smithi195.stdout:8/356: symlink d0/d13/d69/l76 0 2024-09-13T17:05:46.932 INFO:tasks.workunit.client.1.smithi195.stdout:4/414: dwrite d1a/d1f/d43/d29/f3f [4194304,4194304] 0 2024-09-13T17:05:46.936 INFO:tasks.workunit.client.1.smithi195.stdout:6/373: getdents d1c/d2d/d30 0 2024-09-13T17:05:46.939 INFO:tasks.workunit.client.0.smithi115.stdout:2/448: dwrite d3/d4d/de/d3a/d47/f49 [0,4194304] 0 2024-09-13T17:05:46.940 INFO:tasks.workunit.client.1.smithi195.stdout:1/331: mknod db/d60/c75 0 2024-09-13T17:05:46.941 INFO:tasks.workunit.client.1.smithi195.stdout:6/374: write d1c/d3e/f47 [3295588,32381] 0 2024-09-13T17:05:46.941 INFO:tasks.workunit.client.1.smithi195.stdout:1/332: dread db/f2b [0,4194304] 0 2024-09-13T17:05:46.941 INFO:tasks.workunit.client.1.smithi195.stdout:6/375: fdatasync d1c/d24/d49/d5f/d35/f45 0 2024-09-13T17:05:46.941 INFO:tasks.workunit.client.1.smithi195.stdout:6/376: read - d1c/f67 zero size 2024-09-13T17:05:46.946 INFO:tasks.workunit.client.1.smithi195.stdout:5/352: link d2/d12/d4e/c6 d2/df/d39/c6f 0 2024-09-13T17:05:46.946 INFO:tasks.workunit.client.1.smithi195.stdout:5/353: chown d2/d3e/d32/c36 158 1 2024-09-13T17:05:46.948 INFO:tasks.workunit.client.1.smithi195.stdout:1/333: write db/df/f63 [2806585,73928] 0 2024-09-13T17:05:46.948 INFO:tasks.workunit.client.1.smithi195.stdout:1/334: getdents db/d60/d73 0 2024-09-13T17:05:46.949 INFO:tasks.workunit.client.1.smithi195.stdout:8/357: dwrite d0/d13/f41 [0,4194304] 0 2024-09-13T17:05:46.949 INFO:tasks.workunit.client.1.smithi195.stdout:8/358: write d0/d17/f56 [4750826,17046] 0 2024-09-13T17:05:46.952 INFO:tasks.workunit.client.1.smithi195.stdout:2/388: creat d0/d4a/d47/d73/d75/f77 x:0 0 0 2024-09-13T17:05:46.952 INFO:tasks.workunit.client.1.smithi195.stdout:2/389: chown d0/d4a/d1c/d2c/d51/l38 52681567 1 2024-09-13T17:05:46.955 INFO:tasks.workunit.client.1.smithi195.stdout:4/415: rename d1a/d1f/d43/d29/f38 to d1a/d1f/f87 0 2024-09-13T17:05:46.957 INFO:tasks.workunit.client.1.smithi195.stdout:1/335: creat db/df/d4d/d74/f76 x:0 0 0 2024-09-13T17:05:46.957 INFO:tasks.workunit.client.1.smithi195.stdout:1/336: chown db/f6b 880 1 2024-09-13T17:05:46.957 INFO:tasks.workunit.client.1.smithi195.stdout:1/337: getdents db/df/d4d/d67 0 2024-09-13T17:05:46.959 INFO:tasks.workunit.client.1.smithi195.stdout:2/390: write d0/d4a/f36 [1799561,3819] 0 2024-09-13T17:05:46.960 INFO:tasks.workunit.client.1.smithi195.stdout:4/416: creat d1a/d1f/d43/d24/d41/f88 x:0 0 0 2024-09-13T17:05:46.961 INFO:tasks.workunit.client.1.smithi195.stdout:5/354: write d2/f6a [2768306,3969] 0 2024-09-13T17:05:46.962 INFO:tasks.workunit.client.1.smithi195.stdout:5/355: readlink d2/d12/d4e/l1f 0 2024-09-13T17:05:46.962 INFO:tasks.workunit.client.1.smithi195.stdout:6/377: dwrite d1c/d2d/d30/f5b [0,4194304] 0 2024-09-13T17:05:46.962 INFO:tasks.workunit.client.1.smithi195.stdout:1/338: getdents db/df/d13 0 2024-09-13T17:05:46.962 INFO:tasks.workunit.client.1.smithi195.stdout:1/339: stat db/d19 0 2024-09-13T17:05:46.962 INFO:tasks.workunit.client.0.smithi115.stdout:6/218: sync 2024-09-13T17:05:46.964 INFO:tasks.workunit.client.1.smithi195.stdout:5/356: creat d2/d12/d3f/f70 x:0 0 0 2024-09-13T17:05:46.964 INFO:tasks.workunit.client.0.smithi115.stdout:6/219: symlink d8/d13/d15/l42 0 2024-09-13T17:05:46.966 INFO:tasks.workunit.client.1.smithi195.stdout:5/357: mknod d2/d3e/d32/c71 0 2024-09-13T17:05:46.966 INFO:tasks.workunit.client.1.smithi195.stdout:5/358: fsync d2/f26 0 2024-09-13T17:05:46.968 INFO:tasks.workunit.client.1.smithi195.stdout:6/378: link d1c/d2d/l72 d1c/l7c 0 2024-09-13T17:05:46.971 INFO:tasks.workunit.client.1.smithi195.stdout:5/359: mknod d2/df/d39/d54/c72 0 2024-09-13T17:05:46.971 INFO:tasks.workunit.client.1.smithi195.stdout:5/360: truncate d2/df/d39/d54/d58/f69 237623 0 2024-09-13T17:05:46.971 INFO:tasks.workunit.client.1.smithi195.stdout:5/361: write d2/f17 [4797691,72257] 0 2024-09-13T17:05:46.972 INFO:tasks.workunit.client.1.smithi195.stdout:3/335: sync 2024-09-13T17:05:46.974 INFO:tasks.workunit.client.1.smithi195.stdout:5/362: unlink d2/d3e/f35 0 2024-09-13T17:05:46.974 INFO:tasks.workunit.client.1.smithi195.stdout:5/363: chown d2/d3e/l53 213140162 1 2024-09-13T17:05:46.974 INFO:tasks.workunit.client.1.smithi195.stdout:5/364: dread - d2/df/d39/d54/d58/f59 zero size 2024-09-13T17:05:46.975 INFO:tasks.workunit.client.1.smithi195.stdout:5/365: chown d2/df/d62 209913 1 2024-09-13T17:05:46.976 INFO:tasks.workunit.client.1.smithi195.stdout:4/417: write d1a/d1f/f20 [1420915,46161] 0 2024-09-13T17:05:46.976 INFO:tasks.workunit.client.1.smithi195.stdout:4/418: fdatasync d1a/d1f/d21/d22/f3b 0 2024-09-13T17:05:46.980 INFO:tasks.workunit.client.1.smithi195.stdout:5/366: creat d2/df/d39/d54/f73 x:0 0 0 2024-09-13T17:05:46.982 INFO:tasks.workunit.client.1.smithi195.stdout:4/419: symlink d1a/d1f/d21/d22/l89 0 2024-09-13T17:05:46.984 INFO:tasks.workunit.client.1.smithi195.stdout:6/379: dwrite d1c/d24/d49/d5f/d35/f39 [0,4194304] 0 2024-09-13T17:05:46.985 INFO:tasks.workunit.client.1.smithi195.stdout:6/380: write d1c/d2d/f55 [626548,15002] 0 2024-09-13T17:05:46.985 INFO:tasks.workunit.client.1.smithi195.stdout:6/381: fsync f17 0 2024-09-13T17:05:46.985 INFO:tasks.workunit.client.1.smithi195.stdout:9/383: rmdir d6 39 2024-09-13T17:05:46.989 INFO:tasks.workunit.client.1.smithi195.stdout:9/384: creat d6/df/d16/d5c/f7a x:0 0 0 2024-09-13T17:05:46.990 INFO:tasks.workunit.client.1.smithi195.stdout:4/420: dread f5 [0,4194304] 0 2024-09-13T17:05:46.991 INFO:tasks.workunit.client.1.smithi195.stdout:6/382: rmdir d1c/d2d/d5e 39 2024-09-13T17:05:46.991 INFO:tasks.workunit.client.1.smithi195.stdout:3/336: dwrite d7/d21/d2a/f3b [0,4194304] 0 2024-09-13T17:05:46.992 INFO:tasks.workunit.client.1.smithi195.stdout:3/337: creat d7/d21/f59 x:0 0 0 2024-09-13T17:05:46.992 INFO:tasks.workunit.client.1.smithi195.stdout:6/383: truncate f17 4764269 0 2024-09-13T17:05:46.996 INFO:tasks.workunit.client.1.smithi195.stdout:9/385: dread d6/f3f [0,4194304] 0 2024-09-13T17:05:46.999 INFO:tasks.workunit.client.1.smithi195.stdout:3/338: rename d7/d21/d2a/d3a to d7/d21/d2a/d4a/d5a 0 2024-09-13T17:05:47.003 INFO:tasks.workunit.client.1.smithi195.stdout:3/339: fdatasync d7/f13 0 2024-09-13T17:05:47.004 INFO:tasks.workunit.client.1.smithi195.stdout:3/340: mknod d7/d19/d1e/c5b 0 2024-09-13T17:05:47.005 INFO:tasks.workunit.client.1.smithi195.stdout:3/341: symlink d7/d19/d1e/l5c 0 2024-09-13T17:05:47.008 INFO:tasks.workunit.client.1.smithi195.stdout:9/386: dwrite d6/df/d16/d58/f6e [0,4194304] 0 2024-09-13T17:05:47.011 INFO:tasks.workunit.client.1.smithi195.stdout:9/387: mkdir d6/df/d7b 0 2024-09-13T17:05:47.054 INFO:tasks.workunit.client.1.smithi195.stdout:8/359: dwrite d0/d4/fb [0,4194304] 0 2024-09-13T17:05:47.054 INFO:tasks.workunit.client.1.smithi195.stdout:8/360: dread - d0/d13/f57 zero size 2024-09-13T17:05:47.054 INFO:tasks.workunit.client.1.smithi195.stdout:8/361: creat d0/d4/f77 x:0 0 0 2024-09-13T17:05:47.054 INFO:tasks.workunit.client.1.smithi195.stdout:8/362: chown d0/d17/d2f/d31/f37 62877766 1 2024-09-13T17:05:47.056 INFO:tasks.workunit.client.0.smithi115.stdout:2/449: dwrite d3/f40 [0,4194304] 0 2024-09-13T17:05:47.057 INFO:tasks.workunit.client.1.smithi195.stdout:8/363: rmdir d0/d4/d73 0 2024-09-13T17:05:47.059 INFO:tasks.workunit.client.1.smithi195.stdout:8/364: symlink d0/d13/d52/d55/l78 0 2024-09-13T17:05:47.062 INFO:tasks.workunit.client.0.smithi115.stdout:2/450: write d3/d4d/de/f10 [2639956,39767] 0 2024-09-13T17:05:47.063 INFO:tasks.workunit.client.0.smithi115.stdout:2/451: symlink d3/d4d/d13/d62/l8e 0 2024-09-13T17:05:47.063 INFO:tasks.workunit.client.0.smithi115.stdout:2/452: stat d3/d4d/d13/f45 0 2024-09-13T17:05:47.065 INFO:tasks.workunit.client.1.smithi195.stdout:6/384: rmdir d1c 39 2024-09-13T17:05:47.067 INFO:tasks.workunit.client.1.smithi195.stdout:8/365: dread d0/d4/f39 [0,4194304] 0 2024-09-13T17:05:47.067 INFO:tasks.workunit.client.1.smithi195.stdout:8/366: getdents d0/d17/d2f/d6a/d6f 0 2024-09-13T17:05:47.067 INFO:tasks.workunit.client.1.smithi195.stdout:6/385: mkdir d1c/d7d 0 2024-09-13T17:05:47.068 INFO:tasks.workunit.client.1.smithi195.stdout:8/367: symlink d0/d13/d4d/d4c/d67/l79 0 2024-09-13T17:05:47.068 INFO:tasks.workunit.client.1.smithi195.stdout:8/368: chown d0/d4/c75 1 1 2024-09-13T17:05:47.068 INFO:tasks.workunit.client.1.smithi195.stdout:8/369: fdatasync d0/d4/fb 0 2024-09-13T17:05:47.071 INFO:tasks.workunit.client.1.smithi195.stdout:8/370: link d0/l1c d0/d17/d2f/d31/l7a 0 2024-09-13T17:05:47.071 INFO:tasks.workunit.client.1.smithi195.stdout:8/371: chown d0/d13/f5d 4 1 2024-09-13T17:05:47.071 INFO:tasks.workunit.client.1.smithi195.stdout:8/372: fdatasync d0/d17/d2f/d31/f53 0 2024-09-13T17:05:47.071 INFO:tasks.workunit.client.1.smithi195.stdout:8/373: truncate d0/d4/fb 4938806 0 2024-09-13T17:05:47.071 INFO:tasks.workunit.client.1.smithi195.stdout:1/340: dwrite db/df/d13/f21 [0,4194304] 0 2024-09-13T17:05:47.072 INFO:tasks.workunit.client.0.smithi115.stdout:6/220: dwrite d8/db/d1d/f3d [0,4194304] 0 2024-09-13T17:05:47.075 INFO:tasks.workunit.client.1.smithi195.stdout:3/342: dwrite d7/f14 [0,4194304] 0 2024-09-13T17:05:47.076 INFO:tasks.workunit.client.1.smithi195.stdout:4/421: dwrite d1a/f1d [0,4194304] 0 2024-09-13T17:05:47.078 INFO:tasks.workunit.client.1.smithi195.stdout:1/341: write db/d19/f64 [1487171,63683] 0 2024-09-13T17:05:47.079 INFO:tasks.workunit.client.0.smithi115.stdout:6/221: unlink d8/d33/c34 0 2024-09-13T17:05:47.083 INFO:tasks.workunit.client.0.smithi115.stdout:6/222: creat d8/d33/d3f/f43 x:0 0 0 2024-09-13T17:05:47.083 INFO:tasks.workunit.client.0.smithi115.stdout:6/223: write d8/d13/d15/d24/d17/f41 [793158,40078] 0 2024-09-13T17:05:47.083 INFO:tasks.workunit.client.0.smithi115.stdout:6/224: write d8/d33/d3f/f43 [545196,35837] 0 2024-09-13T17:05:47.086 INFO:tasks.workunit.client.1.smithi195.stdout:3/343: link d7/f14 d7/d21/d2a/d4a/d5a/f5d 0 2024-09-13T17:05:47.086 INFO:tasks.workunit.client.1.smithi195.stdout:3/344: fdatasync d7/d19/d1e/f50 0 2024-09-13T17:05:47.086 INFO:tasks.workunit.client.1.smithi195.stdout:3/345: chown d7/d19/c2c 696993139 1 2024-09-13T17:05:47.088 INFO:tasks.workunit.client.1.smithi195.stdout:6/386: dwrite d1c/d24/d49/d5f/f6a [0,4194304] 0 2024-09-13T17:05:47.089 INFO:tasks.workunit.client.1.smithi195.stdout:1/342: dread db/df/d4d/f4f [0,4194304] 0 2024-09-13T17:05:47.089 INFO:tasks.workunit.client.1.smithi195.stdout:1/343: chown db/f11 413916394 1 2024-09-13T17:05:47.089 INFO:tasks.workunit.client.1.smithi195.stdout:1/344: write db/df/d51/d62/f6d [230721,58868] 0 2024-09-13T17:05:47.089 INFO:tasks.workunit.client.1.smithi195.stdout:1/345: write db/d19/d37/d3e/f4c [1673462,110750] 0 2024-09-13T17:05:47.089 INFO:tasks.workunit.client.1.smithi195.stdout:4/422: creat d1a/d1f/d43/d24/d41/d60/f8a x:0 0 0 2024-09-13T17:05:47.089 INFO:tasks.workunit.client.1.smithi195.stdout:4/423: truncate d1a/d1f/d43/d5a/f81 82146 0 2024-09-13T17:05:47.091 INFO:tasks.workunit.client.1.smithi195.stdout:3/346: unlink d7/d21/d2a/d35/f53 0 2024-09-13T17:05:47.094 INFO:tasks.workunit.client.0.smithi115.stdout:6/225: write d8/db/d1d/f3d [1859145,26087] 0 2024-09-13T17:05:47.094 INFO:tasks.workunit.client.1.smithi195.stdout:6/387: link d1c/d24/d49/d5f/f41 d1c/d2d/d30/d6f/f7e 0 2024-09-13T17:05:47.095 INFO:tasks.workunit.client.1.smithi195.stdout:9/388: dwrite d6/df/d16/d58/f6e [4194304,4194304] 0 2024-09-13T17:05:47.096 INFO:tasks.workunit.client.1.smithi195.stdout:1/346: mknod db/df/d4d/d67/c77 0 2024-09-13T17:05:47.096 INFO:tasks.workunit.client.1.smithi195.stdout:1/347: stat db/d19/d37/f3b 0 2024-09-13T17:05:47.097 INFO:tasks.workunit.client.1.smithi195.stdout:9/389: dread d6/d19/d21/d5b/f50 [0,4194304] 0 2024-09-13T17:05:47.100 INFO:tasks.workunit.client.0.smithi115.stdout:6/226: dread d8/d33/d3f/f43 [0,4194304] 0 2024-09-13T17:05:47.101 INFO:tasks.workunit.client.1.smithi195.stdout:4/424: rename d1a/l4c to d1a/d1f/d21/d22/l8b 0 2024-09-13T17:05:47.101 INFO:tasks.workunit.client.1.smithi195.stdout:1/348: truncate db/f33 2118821 0 2024-09-13T17:05:47.101 INFO:tasks.workunit.client.1.smithi195.stdout:1/349: chown db/df/d51/d62 351733225 1 2024-09-13T17:05:47.102 INFO:tasks.workunit.client.1.smithi195.stdout:9/390: creat d6/d19/d21/f7c x:0 0 0 2024-09-13T17:05:47.104 INFO:tasks.workunit.client.0.smithi115.stdout:6/227: symlink d8/l44 0 2024-09-13T17:05:47.106 INFO:tasks.workunit.client.1.smithi195.stdout:3/347: rename d7/d21/d2a/l40 to d7/d21/l5e 0 2024-09-13T17:05:47.107 INFO:tasks.workunit.client.1.smithi195.stdout:4/425: symlink d1a/d1f/d43/d24/l8c 0 2024-09-13T17:05:47.111 INFO:tasks.workunit.client.1.smithi195.stdout:9/391: link d6/d19/d21/d45/c66 d6/df/d13/d44/d47/d61/c7d 0 2024-09-13T17:05:47.111 INFO:tasks.workunit.client.1.smithi195.stdout:4/426: fsync f19 0 2024-09-13T17:05:47.112 INFO:tasks.workunit.client.1.smithi195.stdout:3/348: mkdir d7/d5f 0 2024-09-13T17:05:47.114 INFO:tasks.workunit.client.1.smithi195.stdout:9/392: creat d6/d19/d21/d64/d68/d6d/f7e x:0 0 0 2024-09-13T17:05:47.116 INFO:tasks.workunit.client.1.smithi195.stdout:7/403: sync 2024-09-13T17:05:47.117 INFO:tasks.workunit.client.1.smithi195.stdout:7/404: readlink d5/l41 0 2024-09-13T17:05:47.118 INFO:tasks.workunit.client.1.smithi195.stdout:6/388: dwrite d1c/d24/f51 [0,4194304] 0 2024-09-13T17:05:47.120 INFO:tasks.workunit.client.1.smithi195.stdout:6/389: mkdir d1c/d24/d7f 0 2024-09-13T17:05:47.124 INFO:tasks.workunit.client.1.smithi195.stdout:7/405: dread d5/d13/f40 [0,4194304] 0 2024-09-13T17:05:47.124 INFO:tasks.workunit.client.1.smithi195.stdout:7/406: read - d5/db/d19/d22/f79 zero size 2024-09-13T17:05:47.124 INFO:tasks.workunit.client.1.smithi195.stdout:7/407: fsync d5/d13/f40 0 2024-09-13T17:05:47.127 INFO:tasks.workunit.client.1.smithi195.stdout:7/408: getdents d5/db/d50/d7f/d82 0 2024-09-13T17:05:47.140 INFO:tasks.workunit.client.1.smithi195.stdout:1/350: dwrite db/df/f20 [0,4194304] 0 2024-09-13T17:05:47.140 INFO:tasks.workunit.client.1.smithi195.stdout:7/409: dread d5/d13/d30/f34 [0,4194304] 0 2024-09-13T17:05:47.140 INFO:tasks.workunit.client.1.smithi195.stdout:1/351: fsync db/df/d13/f5b 0 2024-09-13T17:05:47.140 INFO:tasks.workunit.client.1.smithi195.stdout:1/352: chown db/df/f26 9 1 2024-09-13T17:05:47.140 INFO:tasks.workunit.client.1.smithi195.stdout:1/353: creat db/d19/d5a/f78 x:0 0 0 2024-09-13T17:05:47.142 INFO:tasks.workunit.client.1.smithi195.stdout:7/410: link d5/d13/d30/l5a d5/d13/d24/l88 0 2024-09-13T17:05:47.143 INFO:tasks.workunit.client.1.smithi195.stdout:1/354: creat db/d19/f79 x:0 0 0 2024-09-13T17:05:47.143 INFO:tasks.workunit.client.1.smithi195.stdout:1/355: chown db/l3c 4408 1 2024-09-13T17:05:47.143 INFO:tasks.workunit.client.1.smithi195.stdout:1/356: mkdir db/d19/d5a/d66/d7a 0 2024-09-13T17:05:47.146 INFO:tasks.workunit.client.1.smithi195.stdout:4/427: dwrite d1a/d1f/d21/d36/f7c [0,4194304] 0 2024-09-13T17:05:47.146 INFO:tasks.workunit.client.1.smithi195.stdout:4/428: write d1a/d1f/f20 [983431,102529] 0 2024-09-13T17:05:47.147 INFO:tasks.workunit.client.0.smithi115.stdout:6/228: dwrite d8/db/ff [0,4194304] 0 2024-09-13T17:05:47.147 INFO:tasks.workunit.client.1.smithi195.stdout:3/349: dwrite d7/d19/f22 [0,4194304] 0 2024-09-13T17:05:47.148 INFO:tasks.workunit.client.1.smithi195.stdout:9/393: dwrite d6/d19/d21/d5b/f5f [0,4194304] 0 2024-09-13T17:05:47.148 INFO:tasks.workunit.client.1.smithi195.stdout:9/394: fdatasync d6/f18 0 2024-09-13T17:05:47.148 INFO:tasks.workunit.client.1.smithi195.stdout:9/395: chown d6/d19/c2e 231800204 1 2024-09-13T17:05:47.148 INFO:tasks.workunit.client.1.smithi195.stdout:7/411: dread d5/db/d19/d22/d3c/f4f [0,4194304] 0 2024-09-13T17:05:47.148 INFO:tasks.workunit.client.1.smithi195.stdout:7/412: readlink d5/db/d19/d22/l74 0 2024-09-13T17:05:47.149 INFO:tasks.workunit.client.1.smithi195.stdout:1/357: write db/d19/d37/d3e/f4c [1370310,86179] 0 2024-09-13T17:05:47.150 INFO:tasks.workunit.client.1.smithi195.stdout:7/413: read d5/db/d19/d22/f38 [386984,98244] 0 2024-09-13T17:05:47.150 INFO:tasks.workunit.client.1.smithi195.stdout:4/429: link d1a/d1f/d43/d24/f7d d1a/d1f/d43/d24/d41/f8d 0 2024-09-13T17:05:47.150 INFO:tasks.workunit.client.1.smithi195.stdout:4/430: chown d1a/d1f/f20 5595 1 2024-09-13T17:05:47.150 INFO:tasks.workunit.client.1.smithi195.stdout:4/431: stat d1a/f4a 0 2024-09-13T17:05:47.150 INFO:tasks.workunit.client.1.smithi195.stdout:4/432: stat d1a/d1f/c2f 0 2024-09-13T17:05:47.157 INFO:tasks.workunit.client.1.smithi195.stdout:7/414: dread d5/d13/d30/f34 [0,4194304] 0 2024-09-13T17:05:47.157 INFO:tasks.workunit.client.1.smithi195.stdout:7/415: stat d5/d13/d30/f7a 0 2024-09-13T17:05:47.161 INFO:tasks.workunit.client.0.smithi115.stdout:6/229: dwrite d8/d33/d3f/f43 [0,4194304] 0 2024-09-13T17:05:47.161 INFO:tasks.workunit.client.0.smithi115.stdout:6/230: readlink d8/d13/l39 0 2024-09-13T17:05:47.166 INFO:tasks.workunit.client.1.smithi195.stdout:3/350: dread d7/fa [4194304,4194304] 0 2024-09-13T17:05:47.166 INFO:tasks.workunit.client.1.smithi195.stdout:9/396: mknod d6/d19/d21/c7f 0 2024-09-13T17:05:47.168 INFO:tasks.workunit.client.1.smithi195.stdout:1/358: mknod db/df/d13/c7b 0 2024-09-13T17:05:47.168 INFO:tasks.workunit.client.1.smithi195.stdout:1/359: chown db/df/d13/f4b 1 1 2024-09-13T17:05:47.169 INFO:tasks.workunit.client.1.smithi195.stdout:4/433: mkdir d1a/d1f/d43/d29/d8e 0 2024-09-13T17:05:47.174 INFO:tasks.workunit.client.0.smithi115.stdout:6/231: mknod d8/d13/c45 0 2024-09-13T17:05:47.177 INFO:tasks.workunit.client.0.smithi115.stdout:6/232: mkdir d8/d33/d46 0 2024-09-13T17:05:47.177 INFO:tasks.workunit.client.0.smithi115.stdout:6/233: chown d8/db/ff 580020562 1 2024-09-13T17:05:47.177 INFO:tasks.workunit.client.0.smithi115.stdout:6/234: stat d8/db/dd 0 2024-09-13T17:05:47.177 INFO:tasks.workunit.client.1.smithi195.stdout:3/351: readlink d7/l47 0 2024-09-13T17:05:47.178 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:46 smithi115 ceph-mon[27708]: pgmap v12: 65 pgs: 65 active+clean; 1.0 GiB data, 3.1 GiB used, 533 GiB / 536 GiB avail; 94 MiB/s rd, 132 MiB/s wr, 652 op/s 2024-09-13T17:05:47.179 INFO:tasks.workunit.client.1.smithi195.stdout:7/416: getdents d5 0 2024-09-13T17:05:47.179 INFO:tasks.workunit.client.1.smithi195.stdout:7/417: read - d5/d35/f60 zero size 2024-09-13T17:05:47.179 INFO:tasks.workunit.client.1.smithi195.stdout:7/418: chown d5/d13/d24/l7e 20 1 2024-09-13T17:05:47.179 INFO:tasks.workunit.client.1.smithi195.stdout:7/419: read d5/d13/d24/f51 [272072,25883] 0 2024-09-13T17:05:47.179 INFO:tasks.workunit.client.0.smithi115.stdout:6/235: mknod d8/db/d1d/c47 0 2024-09-13T17:05:47.181 INFO:tasks.workunit.client.1.smithi195.stdout:0/368: sync 2024-09-13T17:05:47.181 INFO:tasks.workunit.client.1.smithi195.stdout:2/391: sync 2024-09-13T17:05:47.181 INFO:tasks.workunit.client.1.smithi195.stdout:3/352: stat d7/d21/c28 0 2024-09-13T17:05:47.181 INFO:tasks.workunit.client.1.smithi195.stdout:5/367: sync 2024-09-13T17:05:47.183 INFO:tasks.workunit.client.1.smithi195.stdout:7/420: creat d5/d13/d24/d70/f89 x:0 0 0 2024-09-13T17:05:47.183 INFO:tasks.workunit.client.1.smithi195.stdout:7/421: stat d5/db/d50/d7f/f80 0 2024-09-13T17:05:47.185 INFO:tasks.workunit.client.1.smithi195.stdout:0/369: dread d7/d50/f21 [0,4194304] 0 2024-09-13T17:05:47.186 INFO:tasks.workunit.client.1.smithi195.stdout:2/392: creat d0/d4a/d1c/d2c/d51/f78 x:0 0 0 2024-09-13T17:05:47.186 INFO:tasks.workunit.client.1.smithi195.stdout:2/393: chown d0/d4a/d47/d73/d75/f77 131724014 1 2024-09-13T17:05:47.186 INFO:tasks.workunit.client.0.smithi115.stdout:4/346: sync 2024-09-13T17:05:47.186 INFO:tasks.workunit.client.0.smithi115.stdout:0/204: sync 2024-09-13T17:05:47.186 INFO:tasks.workunit.client.0.smithi115.stdout:8/277: sync 2024-09-13T17:05:47.186 INFO:tasks.workunit.client.0.smithi115.stdout:8/278: chown d0/l8 11008331 1 2024-09-13T17:05:47.186 INFO:tasks.workunit.client.0.smithi115.stdout:8/279: dread - d0/d18/d19/d2b/f36 zero size 2024-09-13T17:05:47.187 INFO:tasks.workunit.client.1.smithi195.stdout:3/353: write d7/d21/f26 [941093,97536] 0 2024-09-13T17:05:47.187 INFO:tasks.workunit.client.1.smithi195.stdout:5/368: mkdir d2/d12/d4e/d74 0 2024-09-13T17:05:47.188 INFO:tasks.workunit.client.1.smithi195.stdout:5/369: read d2/d12/d4e/d10/f24 [526816,97073] 0 2024-09-13T17:05:47.188 INFO:tasks.workunit.client.1.smithi195.stdout:5/370: chown d2/d12/d3f/f4d 7015 1 2024-09-13T17:05:47.189 INFO:tasks.workunit.client.0.smithi115.stdout:4/347: mknod d7/dd/de/d4e/d5a/d4f/c64 0 2024-09-13T17:05:47.190 INFO:tasks.workunit.client.1.smithi195.stdout:8/374: sync 2024-09-13T17:05:47.192 INFO:tasks.workunit.client.1.smithi195.stdout:0/370: rename f6 to d7/db/d38/f76 0 2024-09-13T17:05:47.193 INFO:tasks.workunit.client.0.smithi115.stdout:0/205: write d9/f20 [404703,45433] 0 2024-09-13T17:05:47.193 INFO:tasks.workunit.client.1.smithi195.stdout:8/375: mknod d0/d13/d52/c7b 0 2024-09-13T17:05:47.193 INFO:tasks.workunit.client.1.smithi195.stdout:8/376: fdatasync d0/fc 0 2024-09-13T17:05:47.194 INFO:tasks.workunit.client.0.smithi115.stdout:7/214: sync 2024-09-13T17:05:47.194 INFO:tasks.workunit.client.0.smithi115.stdout:4/348: rename d7/dd/de/d4e/c51 to d7/dd/d63/c65 0 2024-09-13T17:05:47.194 INFO:tasks.workunit.client.0.smithi115.stdout:4/349: fsync d7/f12 0 2024-09-13T17:05:47.194 INFO:tasks.workunit.client.0.smithi115.stdout:4/350: chown d7/dd/de/d57/l60 45 1 2024-09-13T17:05:47.197 INFO:tasks.workunit.client.1.smithi195.stdout:2/394: rename d0/d4a/d1c/d2c/d43/d63/f6b to d0/d4a/d1c/d2c/d51/f79 0 2024-09-13T17:05:47.197 INFO:tasks.workunit.client.1.smithi195.stdout:2/395: chown d0/d4a/d1c/d2c/d51/l56 1107645 1 2024-09-13T17:05:47.197 INFO:tasks.workunit.client.1.smithi195.stdout:2/396: creat d0/d3/f7a x:0 0 0 2024-09-13T17:05:47.198 INFO:tasks.workunit.client.1.smithi195.stdout:0/371: symlink d7/d8/d23/d4b/l77 0 2024-09-13T17:05:47.198 INFO:tasks.workunit.client.1.smithi195.stdout:0/372: fdatasync d7/d50/f67 0 2024-09-13T17:05:47.199 INFO:tasks.workunit.client.1.smithi195.stdout:9/397: dwrite d6/d19/d21/d5b/f79 [0,4194304] 0 2024-09-13T17:05:47.199 INFO:tasks.workunit.client.1.smithi195.stdout:9/398: creat d6/df/d16/d5c/f80 x:0 0 0 2024-09-13T17:05:47.199 INFO:tasks.workunit.client.1.smithi195.stdout:9/399: chown d6/df/d16/d58 22188820 1 2024-09-13T17:05:47.199 INFO:tasks.workunit.client.1.smithi195.stdout:9/400: fsync d6/d19/f1f 0 2024-09-13T17:05:47.199 INFO:tasks.workunit.client.1.smithi195.stdout:9/401: creat d6/df/d16/d5c/f81 x:0 0 0 2024-09-13T17:05:47.199 INFO:tasks.workunit.client.1.smithi195.stdout:9/402: truncate d6/df/d16/d5c/f80 744751 0 2024-09-13T17:05:47.199 INFO:tasks.workunit.client.1.smithi195.stdout:1/360: dwrite db/d19/f4a [0,4194304] 0 2024-09-13T17:05:47.199 INFO:tasks.workunit.client.1.smithi195.stdout:1/361: dread - db/d19/d5a/f78 zero size 2024-09-13T17:05:47.200 INFO:tasks.workunit.client.1.smithi195.stdout:1/362: dread - db/df/d13/f4b zero size 2024-09-13T17:05:47.200 INFO:tasks.workunit.client.1.smithi195.stdout:1/363: creat db/df/d4d/d74/f7c x:0 0 0 2024-09-13T17:05:47.200 INFO:tasks.workunit.client.1.smithi195.stdout:3/354: read d7/d21/d2a/f3b [1716439,1971] 0 2024-09-13T17:05:47.201 INFO:tasks.workunit.client.1.smithi195.stdout:8/377: unlink d0/f2e 0 2024-09-13T17:05:47.201 INFO:tasks.workunit.client.1.smithi195.stdout:5/371: dread d2/d12/d4e/d10/f23 [0,4194304] 0 2024-09-13T17:05:47.201 INFO:tasks.workunit.client.1.smithi195.stdout:5/372: chown d2/d12/d3f/f4d 8 1 2024-09-13T17:05:47.201 INFO:tasks.workunit.client.1.smithi195.stdout:5/373: creat d2/d12/f75 x:0 0 0 2024-09-13T17:05:47.202 INFO:tasks.workunit.client.1.smithi195.stdout:5/374: chown d2/d12 1 1 2024-09-13T17:05:47.202 INFO:tasks.workunit.client.0.smithi115.stdout:7/215: mkdir d0/d51 0 2024-09-13T17:05:47.202 INFO:tasks.workunit.client.0.smithi115.stdout:0/206: dread d9/fb [0,4194304] 0 2024-09-13T17:05:47.202 INFO:tasks.workunit.client.1.smithi195.stdout:8/378: dread d0/d13/f5d [0,4194304] 0 2024-09-13T17:05:47.203 INFO:tasks.workunit.client.1.smithi195.stdout:2/397: dread d0/f54 [0,4194304] 0 2024-09-13T17:05:47.203 INFO:tasks.workunit.client.1.smithi195.stdout:7/422: write d5/d35/d37/f4a [2288423,129129] 0 2024-09-13T17:05:47.204 INFO:tasks.workunit.client.1.smithi195.stdout:7/423: creat d5/d13/d30/f8a x:0 0 0 2024-09-13T17:05:47.204 INFO:tasks.workunit.client.1.smithi195.stdout:7/424: fdatasync d5/d35/f60 0 2024-09-13T17:05:47.204 INFO:tasks.workunit.client.1.smithi195.stdout:4/434: dwrite d1a/d1f/d21/d22/f42 [0,4194304] 0 2024-09-13T17:05:47.204 INFO:tasks.workunit.client.1.smithi195.stdout:4/435: fdatasync d1a/d1f/d43/d29/f3f 0 2024-09-13T17:05:47.204 INFO:tasks.workunit.client.1.smithi195.stdout:4/436: fsync d1a/d1f/d21/d22/f28 0 2024-09-13T17:05:47.204 INFO:tasks.workunit.client.0.smithi115.stdout:4/351: getdents d7/dd/de/d57 0 2024-09-13T17:05:47.206 INFO:tasks.workunit.client.1.smithi195.stdout:0/373: creat d7/d8/d23/d4b/d4e/d68/f78 x:0 0 0 2024-09-13T17:05:47.206 INFO:tasks.workunit.client.0.smithi115.stdout:6/236: dwrite d8/db/d1d/f2b [4194304,4194304] 0 2024-09-13T17:05:47.210 INFO:tasks.workunit.client.0.smithi115.stdout:6/237: mknod d8/d13/d15/d24/c48 0 2024-09-13T17:05:47.211 INFO:tasks.workunit.client.1.smithi195.stdout:9/403: getdents d6/df/d16/d58 0 2024-09-13T17:05:47.213 INFO:tasks.workunit.client.0.smithi115.stdout:6/238: getdents d8/d13/d15 0 2024-09-13T17:05:47.214 INFO:tasks.workunit.client.0.smithi115.stdout:0/207: write d9/d1d/d24/f25 [1358968,28720] 0 2024-09-13T17:05:47.214 INFO:tasks.workunit.client.0.smithi115.stdout:0/208: chown f0 121717 1 2024-09-13T17:05:47.215 INFO:tasks.workunit.client.0.smithi115.stdout:6/239: mkdir d8/db/d49 0 2024-09-13T17:05:47.215 INFO:tasks.workunit.client.0.smithi115.stdout:6/240: readlink d8/db/l2a 0 2024-09-13T17:05:47.216 INFO:tasks.workunit.client.0.smithi115.stdout:7/216: write d0/d3b/d50/f10 [1680665,90595] 0 2024-09-13T17:05:47.216 INFO:tasks.workunit.client.0.smithi115.stdout:7/217: readlink d0/l19 0 2024-09-13T17:05:47.216 INFO:tasks.workunit.client.0.smithi115.stdout:7/218: dread - d0/d3b/d50/d21/d25/d44/f4f zero size 2024-09-13T17:05:47.216 INFO:tasks.workunit.client.0.smithi115.stdout:8/280: dwrite d0/d21/f32 [0,4194304] 0 2024-09-13T17:05:47.217 INFO:tasks.workunit.client.0.smithi115.stdout:4/352: write d7/dd/d3c/f3e [500953,45933] 0 2024-09-13T17:05:47.219 INFO:tasks.workunit.client.0.smithi115.stdout:6/241: dread d8/d13/d15/d24/d17/f41 [0,4194304] 0 2024-09-13T17:05:47.220 INFO:tasks.workunit.client.0.smithi115.stdout:6/242: write d8/db/d1d/f3d [4345352,14290] 0 2024-09-13T17:05:47.220 INFO:tasks.workunit.client.0.smithi115.stdout:0/209: mkdir d9/d1d/d24/d26/d36 0 2024-09-13T17:05:47.222 INFO:tasks.workunit.client.1.smithi195.stdout:1/364: mknod db/df/d4d/d74/c7d 0 2024-09-13T17:05:47.222 INFO:tasks.workunit.client.1.smithi195.stdout:1/365: chown db/df/d13/f2e 774134202 1 2024-09-13T17:05:47.224 INFO:tasks.workunit.client.1.smithi195.stdout:3/355: mkdir d7/d21/d2a/d35/d60 0 2024-09-13T17:05:47.226 INFO:tasks.workunit.client.0.smithi115.stdout:7/219: rmdir d0/d2/d1e/d43 0 2024-09-13T17:05:47.226 INFO:tasks.workunit.client.0.smithi115.stdout:7/220: chown d0/d2/d1e/d3d 75972011 1 2024-09-13T17:05:47.226 INFO:tasks.workunit.client.0.smithi115.stdout:7/221: chown d0/d18/f4c 58380 1 2024-09-13T17:05:47.226 INFO:tasks.workunit.client.0.smithi115.stdout:7/222: truncate d0/d2/d1e/f32 1076540 0 2024-09-13T17:05:47.228 INFO:tasks.workunit.client.0.smithi115.stdout:8/281: link d0/le d0/d18/d19/l58 0 2024-09-13T17:05:47.231 INFO:tasks.workunit.client.1.smithi195.stdout:8/379: rename d0/d13/d4d to d0/d17/d2f/d7c 0 2024-09-13T17:05:47.233 INFO:tasks.workunit.client.0.smithi115.stdout:6/243: symlink d8/db/l4a 0 2024-09-13T17:05:47.235 INFO:tasks.workunit.client.0.smithi115.stdout:7/223: read d0/d3b/d50/f16 [2317382,75098] 0 2024-09-13T17:05:47.235 INFO:tasks.workunit.client.1.smithi195.stdout:2/398: creat d0/d4a/f7b x:0 0 0 2024-09-13T17:05:47.235 INFO:tasks.workunit.client.0.smithi115.stdout:0/210: getdents d9 0 2024-09-13T17:05:47.236 INFO:tasks.workunit.client.0.smithi115.stdout:6/244: symlink d8/d13/d15/l4b 0 2024-09-13T17:05:47.237 INFO:tasks.workunit.client.0.smithi115.stdout:4/353: dwrite d7/dd/f37 [0,4194304] 0 2024-09-13T17:05:47.237 INFO:tasks.workunit.client.1.smithi195.stdout:7/425: truncate f4 4234308 0 2024-09-13T17:05:47.239 INFO:tasks.workunit.client.0.smithi115.stdout:7/224: link d0/d2/d1e/l38 d0/d51/l52 0 2024-09-13T17:05:47.240 INFO:tasks.workunit.client.0.smithi115.stdout:0/211: mknod d9/d1d/d24/d26/d2d/d30/c37 0 2024-09-13T17:05:47.242 INFO:tasks.workunit.client.1.smithi195.stdout:2/399: dread d0/f66 [0,4194304] 0 2024-09-13T17:05:47.245 INFO:tasks.workunit.client.1.smithi195.stdout:0/374: rmdir d7 39 2024-09-13T17:05:47.245 INFO:tasks.workunit.client.1.smithi195.stdout:0/375: write d7/d50/f1c [503529,23658] 0 2024-09-13T17:05:47.245 INFO:tasks.workunit.client.1.smithi195.stdout:0/376: creat d7/d8/d23/d4b/d4e/d68/f79 x:0 0 0 2024-09-13T17:05:47.246 INFO:tasks.workunit.client.1.smithi195.stdout:0/377: chown c5 357339 1 2024-09-13T17:05:47.246 INFO:tasks.workunit.client.1.smithi195.stdout:0/378: fsync f3 0 2024-09-13T17:05:47.249 INFO:tasks.workunit.client.0.smithi115.stdout:8/282: dwrite d0/f13 [0,4194304] 0 2024-09-13T17:05:47.254 INFO:tasks.workunit.client.1.smithi195.stdout:9/404: symlink d6/d19/l82 0 2024-09-13T17:05:47.256 INFO:tasks.workunit.client.0.smithi115.stdout:6/245: dwrite d8/db/d1d/f26 [0,4194304] 0 2024-09-13T17:05:47.256 INFO:tasks.workunit.client.1.smithi195.stdout:1/366: mkdir db/d19/d37/d46/d7e 0 2024-09-13T17:05:47.256 INFO:tasks.workunit.client.1.smithi195.stdout:1/367: creat db/df/f7f x:0 0 0 2024-09-13T17:05:47.257 INFO:tasks.workunit.client.1.smithi195.stdout:3/356: stat d7/d19/l39 0 2024-09-13T17:05:47.261 INFO:tasks.workunit.client.1.smithi195.stdout:4/437: rename d1a/l33 to d1a/d1f/d43/d24/d41/l8f 0 2024-09-13T17:05:47.261 INFO:tasks.workunit.client.1.smithi195.stdout:4/438: creat d1a/d1f/d43/d5a/f90 x:0 0 0 2024-09-13T17:05:47.263 INFO:tasks.workunit.client.1.smithi195.stdout:8/380: symlink d0/d17/d2f/d7c/d4c/d67/l7d 0 2024-09-13T17:05:47.266 INFO:tasks.workunit.client.1.smithi195.stdout:7/426: creat d5/db/d50/d7f/d82/f8b x:0 0 0 2024-09-13T17:05:47.268 INFO:tasks.workunit.client.1.smithi195.stdout:2/400: creat d0/d4a/d47/d73/f7c x:0 0 0 2024-09-13T17:05:47.268 INFO:tasks.workunit.client.1.smithi195.stdout:2/401: dread - d0/d4a/d1c/d2c/d43/f5e zero size 2024-09-13T17:05:47.269 INFO:tasks.workunit.client.0.smithi115.stdout:4/354: rmdir d7/dd/de 39 2024-09-13T17:05:47.270 INFO:tasks.workunit.client.1.smithi195.stdout:1/368: dwrite db/d19/d5a/f78 [0,4194304] 0 2024-09-13T17:05:47.271 INFO:tasks.workunit.client.1.smithi195.stdout:1/369: readlink db/df/d4d/l57 0 2024-09-13T17:05:47.272 INFO:tasks.workunit.client.1.smithi195.stdout:8/381: dread d0/d17/f1d [0,4194304] 0 2024-09-13T17:05:47.272 INFO:tasks.workunit.client.1.smithi195.stdout:0/379: creat d7/db/f7a x:0 0 0 2024-09-13T17:05:47.272 INFO:tasks.workunit.client.1.smithi195.stdout:0/380: dread - d7/d8/d23/d4b/d4e/d68/f78 zero size 2024-09-13T17:05:47.272 INFO:tasks.workunit.client.1.smithi195.stdout:6/390: sync 2024-09-13T17:05:47.275 INFO:tasks.workunit.client.0.smithi115.stdout:7/225: getdents d0/d3b/d50/d21/d2f 0 2024-09-13T17:05:47.276 INFO:tasks.workunit.client.1.smithi195.stdout:3/357: creat d7/f61 x:0 0 0 2024-09-13T17:05:47.276 INFO:tasks.workunit.client.1.smithi195.stdout:3/358: write d7/d21/d2a/f4b [623498,117595] 0 2024-09-13T17:05:47.278 INFO:tasks.workunit.client.0.smithi115.stdout:0/212: creat d9/f38 x:0 0 0 2024-09-13T17:05:47.279 INFO:tasks.workunit.client.1.smithi195.stdout:9/405: rename d6/df/d13/d44/f5d to d6/d19/d21/d5b/f83 0 2024-09-13T17:05:47.280 INFO:tasks.workunit.client.0.smithi115.stdout:8/283: getdents d0/d18/d19 0 2024-09-13T17:05:47.283 INFO:tasks.workunit.client.0.smithi115.stdout:6/246: unlink d8/d13/d15/d24/c3e 0 2024-09-13T17:05:47.284 INFO:tasks.workunit.client.1.smithi195.stdout:4/439: mkdir d1a/d1f/d43/d29/d58/d91 0 2024-09-13T17:05:47.284 INFO:tasks.workunit.client.1.smithi195.stdout:4/440: write d1a/d1f/d43/d24/d41/f88 [192995,125961] 0 2024-09-13T17:05:47.285 INFO:tasks.workunit.client.0.smithi115.stdout:4/355: link d7/dd/f37 d7/dd/de/d4e/d5a/d4f/d53/f66 0 2024-09-13T17:05:47.286 INFO:tasks.workunit.client.0.smithi115.stdout:0/213: creat d9/d1d/f39 x:0 0 0 2024-09-13T17:05:47.287 INFO:tasks.workunit.client.1.smithi195.stdout:7/427: dwrite d5/d13/d30/f7a [0,4194304] 0 2024-09-13T17:05:47.287 INFO:tasks.workunit.client.1.smithi195.stdout:7/428: fdatasync d5/d13/d24/f3f 0 2024-09-13T17:05:47.287 INFO:tasks.workunit.client.0.smithi115.stdout:8/284: mkdir d0/d26/d29/d59 0 2024-09-13T17:05:47.288 INFO:tasks.workunit.client.1.smithi195.stdout:1/370: rmdir db/df/d51/d62 39 2024-09-13T17:05:47.288 INFO:tasks.workunit.client.1.smithi195.stdout:1/371: truncate db/d19/d37/f6a 250085 0 2024-09-13T17:05:47.288 INFO:tasks.workunit.client.1.smithi195.stdout:1/372: fdatasync db/df/d13/f21 0 2024-09-13T17:05:47.290 INFO:tasks.workunit.client.0.smithi115.stdout:6/247: rename d8/d33/d46 to d8/d33/d40/d4c 0 2024-09-13T17:05:47.290 INFO:tasks.workunit.client.0.smithi115.stdout:6/248: fsync d8/d13/d15/d24/f1f 0 2024-09-13T17:05:47.290 INFO:tasks.workunit.client.0.smithi115.stdout:6/249: chown d8/db/dd/l2f 101205799 1 2024-09-13T17:05:47.290 INFO:tasks.workunit.client.1.smithi195.stdout:8/382: stat d0/d17/c70 0 2024-09-13T17:05:47.291 INFO:tasks.workunit.client.0.smithi115.stdout:0/214: creat d9/d1b/f3a x:0 0 0 2024-09-13T17:05:47.291 INFO:tasks.workunit.client.0.smithi115.stdout:0/215: write d9/f38 [241977,113154] 0 2024-09-13T17:05:47.293 INFO:tasks.workunit.client.0.smithi115.stdout:7/226: dread d0/d3b/d50/f10 [0,4194304] 0 2024-09-13T17:05:47.294 INFO:tasks.workunit.client.0.smithi115.stdout:7/227: write d0/d3b/d50/d21/d25/f2c [684874,51080] 0 2024-09-13T17:05:47.294 INFO:tasks.workunit.client.1.smithi195.stdout:0/381: unlink d7/d50/f52 0 2024-09-13T17:05:47.294 INFO:tasks.workunit.client.1.smithi195.stdout:0/382: dread - d7/d8/d23/d4b/d4e/d68/f79 zero size 2024-09-13T17:05:47.294 INFO:tasks.workunit.client.1.smithi195.stdout:0/383: creat d7/db/f7b x:0 0 0 2024-09-13T17:05:47.294 INFO:tasks.workunit.client.1.smithi195.stdout:0/384: dread - d7/d8/d23/d4b/d4e/d68/f79 zero size 2024-09-13T17:05:47.295 INFO:tasks.workunit.client.1.smithi195.stdout:0/385: chown d7/d50/c51 0 1 2024-09-13T17:05:47.295 INFO:tasks.workunit.client.0.smithi115.stdout:8/285: mkdir d0/d18/d43/d5a 0 2024-09-13T17:05:47.296 INFO:tasks.workunit.client.1.smithi195.stdout:6/391: creat d1c/d2d/d30/f80 x:0 0 0 2024-09-13T17:05:47.298 INFO:tasks.workunit.client.0.smithi115.stdout:4/356: dread d7/dd/de/f13 [4194304,4194304] 0 2024-09-13T17:05:47.298 INFO:tasks.workunit.client.0.smithi115.stdout:4/357: truncate d7/dd/de/f43 770926 0 2024-09-13T17:05:47.299 INFO:tasks.workunit.client.0.smithi115.stdout:6/250: creat d8/db/d49/f4d x:0 0 0 2024-09-13T17:05:47.301 INFO:tasks.workunit.client.1.smithi195.stdout:2/402: rename d0/d4a/d1c/d1e/f31 to d0/d4a/d1c/d62/f7d 0 2024-09-13T17:05:47.302 INFO:tasks.workunit.client.0.smithi115.stdout:0/216: symlink d9/d1d/d24/l3b 0 2024-09-13T17:05:47.303 INFO:tasks.workunit.client.1.smithi195.stdout:4/441: link d1a/d1f/d43/d24/c83 d1a/d1f/d21/d22/c92 0 2024-09-13T17:05:47.303 INFO:tasks.workunit.client.1.smithi195.stdout:4/442: readlink d1a/d1f/l5c 0 2024-09-13T17:05:47.305 INFO:tasks.workunit.client.0.smithi115.stdout:7/228: creat d0/d2/d1e/f53 x:0 0 0 2024-09-13T17:05:47.305 INFO:tasks.workunit.client.1.smithi195.stdout:8/383: dwrite d0/d13/f5d [0,4194304] 0 2024-09-13T17:05:47.306 INFO:tasks.workunit.client.1.smithi195.stdout:8/384: write d0/d17/d2f/d31/f37 [5062684,17450] 0 2024-09-13T17:05:47.308 INFO:tasks.workunit.client.0.smithi115.stdout:8/286: symlink d0/d15/d3e/l5b 0 2024-09-13T17:05:47.308 INFO:tasks.workunit.client.0.smithi115.stdout:4/358: rename d7/dd/d3c/c46 to d7/dd/de/c67 0 2024-09-13T17:05:47.310 INFO:tasks.workunit.client.0.smithi115.stdout:6/251: creat d8/d13/f4e x:0 0 0 2024-09-13T17:05:47.313 INFO:tasks.workunit.client.0.smithi115.stdout:0/217: mknod d9/d1d/c3c 0 2024-09-13T17:05:47.314 INFO:tasks.workunit.client.0.smithi115.stdout:7/229: rmdir d0/d2 39 2024-09-13T17:05:47.316 INFO:tasks.workunit.client.1.smithi195.stdout:1/373: creat db/df/d13/f80 x:0 0 0 2024-09-13T17:05:47.317 INFO:tasks.workunit.client.0.smithi115.stdout:8/287: truncate d0/d26/d29/f38 780022 0 2024-09-13T17:05:47.317 INFO:tasks.workunit.client.0.smithi115.stdout:8/288: chown d0/d18/d19/d28/d4f 0 1 2024-09-13T17:05:47.319 INFO:tasks.workunit.client.0.smithi115.stdout:4/359: symlink d7/dd/de/d4e/d5a/d4f/d53/l68 0 2024-09-13T17:05:47.321 INFO:tasks.workunit.client.1.smithi195.stdout:0/386: mkdir d7/d8/d7c 0 2024-09-13T17:05:47.321 INFO:tasks.workunit.client.1.smithi195.stdout:0/387: dread - d7/d8/d23/d4b/d4e/d68/f78 zero size 2024-09-13T17:05:47.321 INFO:tasks.workunit.client.1.smithi195.stdout:8/385: dwrite d0/d17/d2f/d7c/f48 [0,4194304] 0 2024-09-13T17:05:47.321 INFO:tasks.workunit.client.1.smithi195.stdout:8/386: read d0/d17/f56 [3304060,128404] 0 2024-09-13T17:05:47.322 INFO:tasks.workunit.client.0.smithi115.stdout:7/230: mkdir d0/d3b/d54 0 2024-09-13T17:05:47.322 INFO:tasks.workunit.client.0.smithi115.stdout:4/360: dread d7/fc [0,4194304] 0 2024-09-13T17:05:47.323 INFO:tasks.workunit.client.0.smithi115.stdout:0/218: write d9/f18 [5894308,61662] 0 2024-09-13T17:05:47.323 INFO:tasks.workunit.client.0.smithi115.stdout:0/219: chown d9/d1d/l22 2 1 2024-09-13T17:05:47.323 INFO:tasks.workunit.client.1.smithi195.stdout:6/392: mknod d1c/d24/d49/d5f/c81 0 2024-09-13T17:05:47.324 INFO:tasks.workunit.client.1.smithi195.stdout:3/359: mkdir d7/d62 0 2024-09-13T17:05:47.324 INFO:tasks.workunit.client.1.smithi195.stdout:3/360: fsync d7/d21/f4f 0 2024-09-13T17:05:47.326 INFO:tasks.workunit.client.0.smithi115.stdout:7/231: creat d0/d3b/d54/f55 x:0 0 0 2024-09-13T17:05:47.326 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:46 smithi195 ceph-mon[34981]: pgmap v12: 65 pgs: 65 active+clean; 1.0 GiB data, 3.1 GiB used, 533 GiB / 536 GiB avail; 94 MiB/s rd, 132 MiB/s wr, 652 op/s 2024-09-13T17:05:47.328 INFO:tasks.workunit.client.0.smithi115.stdout:4/361: unlink d7/dd/f37 0 2024-09-13T17:05:47.329 INFO:tasks.workunit.client.0.smithi115.stdout:6/252: dread d8/d13/d15/d24/f1e [0,4194304] 0 2024-09-13T17:05:47.329 INFO:tasks.workunit.client.0.smithi115.stdout:6/253: dread - d8/db/d49/f4d zero size 2024-09-13T17:05:47.329 INFO:tasks.workunit.client.1.smithi195.stdout:9/406: rename d6/d19/d21/c6c to d6/df/d16/c84 0 2024-09-13T17:05:47.329 INFO:tasks.workunit.client.1.smithi195.stdout:9/407: creat d6/d19/d21/d64/d68/d6d/f85 x:0 0 0 2024-09-13T17:05:47.330 INFO:tasks.workunit.client.0.smithi115.stdout:8/289: write d0/d15/d3e/f47 [2636140,60027] 0 2024-09-13T17:05:47.330 INFO:tasks.workunit.client.0.smithi115.stdout:7/232: creat d0/f56 x:0 0 0 2024-09-13T17:05:47.331 INFO:tasks.workunit.client.1.smithi195.stdout:9/408: dread d6/d19/d21/d45/f5a [0,4194304] 0 2024-09-13T17:05:47.331 INFO:tasks.workunit.client.1.smithi195.stdout:9/409: read d6/f25 [730842,17527] 0 2024-09-13T17:05:47.332 INFO:tasks.workunit.client.1.smithi195.stdout:1/374: dwrite db/df/d13/f4b [0,4194304] 0 2024-09-13T17:05:47.332 INFO:tasks.workunit.client.1.smithi195.stdout:1/375: write db/df/d4d/f52 [324662,4038] 0 2024-09-13T17:05:47.332 INFO:tasks.workunit.client.1.smithi195.stdout:1/376: truncate db/d19/d5a/f61 47259 0 2024-09-13T17:05:47.332 INFO:tasks.workunit.client.1.smithi195.stdout:1/377: creat db/df/d4d/f81 x:0 0 0 2024-09-13T17:05:47.332 INFO:tasks.workunit.client.1.smithi195.stdout:5/375: sync 2024-09-13T17:05:47.333 INFO:tasks.workunit.client.0.smithi115.stdout:4/362: unlink d7/dd/de/d4e/d5a/c5d 0 2024-09-13T17:05:47.333 INFO:tasks.workunit.client.0.smithi115.stdout:4/363: write d7/dd/de/f59 [169402,85402] 0 2024-09-13T17:05:47.340 INFO:tasks.workunit.client.0.smithi115.stdout:7/233: dread d0/d3b/d50/f10 [0,4194304] 0 2024-09-13T17:05:47.340 INFO:tasks.workunit.client.0.smithi115.stdout:7/234: write d0/d3b/d50/d21/d25/d44/f4f [336623,123431] 0 2024-09-13T17:05:47.340 INFO:tasks.workunit.client.0.smithi115.stdout:7/235: dread - d0/d3b/d54/f55 zero size 2024-09-13T17:05:47.341 INFO:tasks.workunit.client.0.smithi115.stdout:8/290: rename d0/d18/d19/d2b/d37/c40 to d0/d18/d51/c5c 0 2024-09-13T17:05:47.342 INFO:tasks.workunit.client.1.smithi195.stdout:0/388: symlink d7/d8/d23/l7d 0 2024-09-13T17:05:47.343 INFO:tasks.workunit.client.0.smithi115.stdout:6/254: getdents d8/db/d1d 0 2024-09-13T17:05:47.343 INFO:tasks.workunit.client.0.smithi115.stdout:6/255: write f5 [1893492,51954] 0 2024-09-13T17:05:47.349 INFO:tasks.workunit.client.0.smithi115.stdout:8/291: rename d0/c6 to d0/d18/d51/c5d 0 2024-09-13T17:05:47.351 INFO:tasks.workunit.client.1.smithi195.stdout:8/387: link d0/d17/c66 d0/c7e 0 2024-09-13T17:05:47.351 INFO:tasks.workunit.client.1.smithi195.stdout:8/388: creat d0/d4/f7f x:0 0 0 2024-09-13T17:05:47.351 INFO:tasks.workunit.client.1.smithi195.stdout:8/389: write d0/d17/f6b [621608,36496] 0 2024-09-13T17:05:47.352 INFO:tasks.workunit.client.0.smithi115.stdout:4/364: dwrite d7/dd/f2a [0,4194304] 0 2024-09-13T17:05:47.352 INFO:tasks.workunit.client.1.smithi195.stdout:5/376: dwrite d2/d3e/f16 [0,4194304] 0 2024-09-13T17:05:47.352 INFO:tasks.workunit.client.1.smithi195.stdout:6/393: symlink d1c/d2d/d5e/l82 0 2024-09-13T17:05:47.355 INFO:tasks.workunit.client.0.smithi115.stdout:8/292: symlink d0/d18/d19/d2b/l5e 0 2024-09-13T17:05:47.355 INFO:tasks.workunit.client.0.smithi115.stdout:8/293: write d0/d15/f4d [959852,95185] 0 2024-09-13T17:05:47.355 INFO:tasks.workunit.client.0.smithi115.stdout:0/220: dwrite d9/f38 [0,4194304] 0 2024-09-13T17:05:47.358 INFO:tasks.workunit.client.1.smithi195.stdout:3/361: creat d7/d21/d2a/d4a/d5a/f63 x:0 0 0 2024-09-13T17:05:47.362 INFO:tasks.workunit.client.1.smithi195.stdout:7/429: rename d5/db/d19/d22/d3c/c54 to d5/db/d50/d7f/d82/c8c 0 2024-09-13T17:05:47.364 INFO:tasks.workunit.client.0.smithi115.stdout:4/365: rmdir d7/dd/de/d4e/d5a/d4f 39 2024-09-13T17:05:47.365 INFO:tasks.workunit.client.1.smithi195.stdout:9/410: mkdir d6/d12/d86 0 2024-09-13T17:05:47.367 INFO:tasks.workunit.client.0.smithi115.stdout:8/294: rename d0/d18/d19/d2b/f36 to d0/d18/d51/f5f 0 2024-09-13T17:05:47.369 INFO:tasks.workunit.client.1.smithi195.stdout:2/403: rmdir d0/d4a/d1c/d2c/d43 39 2024-09-13T17:05:47.369 INFO:tasks.workunit.client.1.smithi195.stdout:2/404: fdatasync d0/d3/fe 0 2024-09-13T17:05:47.371 INFO:tasks.workunit.client.0.smithi115.stdout:4/366: creat d7/dd/de/d4e/d5a/d4f/d53/f69 x:0 0 0 2024-09-13T17:05:47.371 INFO:tasks.workunit.client.0.smithi115.stdout:4/367: write d7/dd/de/d4e/d5a/d4f/d53/f69 [1007094,116533] 0 2024-09-13T17:05:47.372 INFO:tasks.workunit.client.1.smithi195.stdout:1/378: mknod db/df/d4d/c82 0 2024-09-13T17:05:47.372 INFO:tasks.workunit.client.0.smithi115.stdout:4/368: dread d7/f47 [0,4194304] 0 2024-09-13T17:05:47.373 INFO:tasks.workunit.client.0.smithi115.stdout:4/369: fdatasync d7/f29 0 2024-09-13T17:05:47.373 INFO:tasks.workunit.client.0.smithi115.stdout:8/295: truncate d0/f1d 3386792 0 2024-09-13T17:05:47.373 INFO:tasks.workunit.client.0.smithi115.stdout:8/296: dread - d0/d15/d44/f52 zero size 2024-09-13T17:05:47.375 INFO:tasks.workunit.client.0.smithi115.stdout:4/370: rename d7/f35 to d7/dd/d63/f6a 0 2024-09-13T17:05:47.376 INFO:tasks.workunit.client.1.smithi195.stdout:5/377: getdents d2/df 0 2024-09-13T17:05:47.376 INFO:tasks.workunit.client.1.smithi195.stdout:5/378: chown d2/df/d39 6997842 1 2024-09-13T17:05:47.378 INFO:tasks.workunit.client.1.smithi195.stdout:3/362: stat d7/lf 0 2024-09-13T17:05:47.379 INFO:tasks.workunit.client.1.smithi195.stdout:1/379: read db/df/f3a [3069968,44685] 0 2024-09-13T17:05:47.379 INFO:tasks.workunit.client.1.smithi195.stdout:1/380: chown db/l55 12 1 2024-09-13T17:05:47.381 INFO:tasks.workunit.client.1.smithi195.stdout:4/443: rename d1a/d1f/d21/d22/f2b to d1a/d1f/d21/f93 0 2024-09-13T17:05:47.381 INFO:tasks.workunit.client.1.smithi195.stdout:4/444: creat d1a/f94 x:0 0 0 2024-09-13T17:05:47.381 INFO:tasks.workunit.client.1.smithi195.stdout:4/445: write d1a/f94 [540336,90511] 0 2024-09-13T17:05:47.381 INFO:tasks.workunit.client.1.smithi195.stdout:4/446: chown d1a/d1f/d43/d29/l82 1 1 2024-09-13T17:05:47.381 INFO:tasks.workunit.client.1.smithi195.stdout:4/447: fdatasync f14 0 2024-09-13T17:05:47.382 INFO:tasks.workunit.client.1.smithi195.stdout:7/430: symlink d5/db/d50/l8d 0 2024-09-13T17:05:47.382 INFO:tasks.workunit.client.1.smithi195.stdout:7/431: creat d5/db/d19/d22/f8e x:0 0 0 2024-09-13T17:05:47.382 INFO:tasks.workunit.client.1.smithi195.stdout:9/411: symlink d6/df/d7b/l87 0 2024-09-13T17:05:47.382 INFO:tasks.workunit.client.1.smithi195.stdout:9/412: getdents d6/df/d72 0 2024-09-13T17:05:47.382 INFO:tasks.workunit.client.1.smithi195.stdout:2/405: truncate d0/d3/f5b 2292081 0 2024-09-13T17:05:47.383 INFO:tasks.workunit.client.1.smithi195.stdout:0/389: rename d7/d8/d23/f32 to d7/d8/f7e 0 2024-09-13T17:05:47.383 INFO:tasks.workunit.client.1.smithi195.stdout:4/448: chown cf 0 1 2024-09-13T17:05:47.385 INFO:tasks.workunit.client.1.smithi195.stdout:7/432: unlink d5/d13/d24/f63 0 2024-09-13T17:05:47.385 INFO:tasks.workunit.client.1.smithi195.stdout:9/413: rmdir d6/df/d13/d44/d5e 39 2024-09-13T17:05:47.385 INFO:tasks.workunit.client.1.smithi195.stdout:1/381: getdents db/d19/d5a 0 2024-09-13T17:05:47.387 INFO:tasks.workunit.client.0.smithi115.stdout:7/236: dwrite d0/d2/d1e/f53 [0,4194304] 0 2024-09-13T17:05:47.391 INFO:tasks.workunit.client.1.smithi195.stdout:8/390: rename d0/d17/d2f/d7c/f51 to d0/d17/d49/f80 0 2024-09-13T17:05:47.394 INFO:tasks.workunit.client.1.smithi195.stdout:4/449: symlink d1a/d1f/d21/d22/l95 0 2024-09-13T17:05:47.394 INFO:tasks.workunit.client.1.smithi195.stdout:4/450: getdents d1a/d1f/d43/d29/d8e 0 2024-09-13T17:05:47.395 INFO:tasks.workunit.client.1.smithi195.stdout:7/433: symlink d5/l8f 0 2024-09-13T17:05:47.397 INFO:tasks.workunit.client.1.smithi195.stdout:7/434: dread d5/db/d19/f5e [0,4194304] 0 2024-09-13T17:05:47.397 INFO:tasks.workunit.client.1.smithi195.stdout:7/435: write d5/db/d19/d22/f38 [33997,47730] 0 2024-09-13T17:05:47.397 INFO:tasks.workunit.client.1.smithi195.stdout:7/436: readlink d5/d13/d30/l5a 0 2024-09-13T17:05:47.399 INFO:tasks.workunit.client.1.smithi195.stdout:1/382: creat db/d19/d5a/f83 x:0 0 0 2024-09-13T17:05:47.399 INFO:tasks.workunit.client.1.smithi195.stdout:1/383: readlink db/d19/d37/d3e/l49 0 2024-09-13T17:05:47.399 INFO:tasks.workunit.client.1.smithi195.stdout:1/384: chown db/f6b 415822585 1 2024-09-13T17:05:47.399 INFO:tasks.workunit.client.1.smithi195.stdout:1/385: write db/df/d13/f21 [5002179,80162] 0 2024-09-13T17:05:47.399 INFO:tasks.workunit.client.1.smithi195.stdout:1/386: fsync db/d19/d37/d3e/f43 0 2024-09-13T17:05:47.400 INFO:tasks.workunit.client.1.smithi195.stdout:1/387: fsync db/f18 0 2024-09-13T17:05:47.400 INFO:tasks.workunit.client.1.smithi195.stdout:0/390: getdents d7/db/d11 0 2024-09-13T17:05:47.404 INFO:tasks.workunit.client.1.smithi195.stdout:8/391: symlink d0/d4/l81 0 2024-09-13T17:05:47.405 INFO:tasks.workunit.client.0.smithi115.stdout:7/237: mknod d0/d2/d1e/c57 0 2024-09-13T17:05:47.405 INFO:tasks.workunit.client.0.smithi115.stdout:7/238: write d0/f1 [3350466,89804] 0 2024-09-13T17:05:47.407 INFO:tasks.workunit.client.1.smithi195.stdout:4/451: link d1a/d1f/d21/d22/f77 d1a/d1f/d43/d29/d58/d91/f96 0 2024-09-13T17:05:47.409 INFO:tasks.workunit.client.1.smithi195.stdout:7/437: mkdir d5/db/d19/d22/d90 0 2024-09-13T17:05:47.412 INFO:tasks.workunit.client.1.smithi195.stdout:1/388: rename db/c44 to db/d19/d37/d46/c84 0 2024-09-13T17:05:47.415 INFO:tasks.workunit.client.1.smithi195.stdout:8/392: rename d0/d17/d2f/d7c/d4c/d67/l79 to d0/d17/d2f/d7c/d4c/l82 0 2024-09-13T17:05:47.415 INFO:tasks.workunit.client.0.smithi115.stdout:6/256: dwrite d8/d33/d40/f30 [0,4194304] 0 2024-09-13T17:05:47.423 INFO:tasks.workunit.client.0.smithi115.stdout:6/257: creat d8/d13/d15/f4f x:0 0 0 2024-09-13T17:05:47.424 INFO:tasks.workunit.client.0.smithi115.stdout:6/258: chown d8/db/d1d/f3d 0 1 2024-09-13T17:05:47.424 INFO:tasks.workunit.client.1.smithi195.stdout:4/452: rename d1a/d1f/d21/d22/l45 to d1a/d1f/d43/d24/l97 0 2024-09-13T17:05:47.424 INFO:tasks.workunit.client.1.smithi195.stdout:4/453: chown d1a/d1f/d43/d29/d58/c68 51 1 2024-09-13T17:05:47.424 INFO:tasks.workunit.client.1.smithi195.stdout:1/389: write db/df/d13/f21 [3646388,16519] 0 2024-09-13T17:05:47.426 INFO:tasks.workunit.client.0.smithi115.stdout:6/259: unlink d8/d13/l39 0 2024-09-13T17:05:47.428 INFO:tasks.workunit.client.1.smithi195.stdout:1/390: mkdir db/df/d4d/d85 0 2024-09-13T17:05:47.428 INFO:tasks.workunit.client.1.smithi195.stdout:1/391: creat db/df/d13/f86 x:0 0 0 2024-09-13T17:05:47.430 INFO:tasks.workunit.client.1.smithi195.stdout:1/392: link db/df/d13/l1d db/l87 0 2024-09-13T17:05:47.432 INFO:tasks.workunit.client.1.smithi195.stdout:1/393: link db/c31 db/d60/d73/c88 0 2024-09-13T17:05:47.434 INFO:tasks.workunit.client.1.smithi195.stdout:1/394: link db/d19/d37/c40 db/d19/d37/d46/c89 0 2024-09-13T17:05:47.437 INFO:tasks.workunit.client.1.smithi195.stdout:1/395: link db/f18 db/d19/d37/f8a 0 2024-09-13T17:05:47.438 INFO:tasks.workunit.client.1.smithi195.stdout:1/396: truncate db/d19/d5a/f83 738553 0 2024-09-13T17:05:47.438 INFO:tasks.workunit.client.1.smithi195.stdout:1/397: readlink db/l5d 0 2024-09-13T17:05:47.438 INFO:tasks.workunit.client.1.smithi195.stdout:4/454: read d1a/f2d [738510,18310] 0 2024-09-13T17:05:47.439 INFO:tasks.workunit.client.1.smithi195.stdout:3/363: dwrite d7/d21/d51/f54 [0,4194304] 0 2024-09-13T17:05:47.439 INFO:tasks.workunit.client.1.smithi195.stdout:1/398: link db/d19/f79 db/d19/f8b 0 2024-09-13T17:05:47.442 INFO:tasks.workunit.client.1.smithi195.stdout:3/364: mkdir d7/d21/d2a/d35/d60/d64 0 2024-09-13T17:05:47.443 INFO:tasks.workunit.client.1.smithi195.stdout:1/399: link l7 db/df/l8c 0 2024-09-13T17:05:47.443 INFO:tasks.workunit.client.1.smithi195.stdout:1/400: write db/df/d13/f86 [729695,71193] 0 2024-09-13T17:05:47.444 INFO:tasks.workunit.client.0.smithi115.stdout:8/297: dwrite d0/f13 [0,4194304] 0 2024-09-13T17:05:47.445 INFO:tasks.workunit.client.0.smithi115.stdout:4/371: mknod d7/dd/de/d4e/d5a/d4f/d53/c6b 0 2024-09-13T17:05:47.445 INFO:tasks.workunit.client.0.smithi115.stdout:4/372: stat d7/dd/f2b 0 2024-09-13T17:05:47.445 INFO:tasks.workunit.client.0.smithi115.stdout:4/373: write d7/f36 [1599985,34351] 0 2024-09-13T17:05:47.446 INFO:tasks.workunit.client.0.smithi115.stdout:6/260: read d8/db/d1d/f26 [7936262,124259] 0 2024-09-13T17:05:47.448 INFO:tasks.workunit.client.1.smithi195.stdout:1/401: truncate db/df/f3a 2667733 0 2024-09-13T17:05:47.448 INFO:tasks.workunit.client.1.smithi195.stdout:1/402: creat db/df/d13/f8d x:0 0 0 2024-09-13T17:05:47.448 INFO:tasks.workunit.client.1.smithi195.stdout:1/403: fdatasync db/d19/d37/d3e/f43 0 2024-09-13T17:05:47.451 INFO:tasks.workunit.client.0.smithi115.stdout:6/261: mknod d8/db/d49/c50 0 2024-09-13T17:05:47.453 INFO:tasks.workunit.client.1.smithi195.stdout:5/379: dwrite d2/d12/d4e/f3b [0,4194304] 0 2024-09-13T17:05:47.454 INFO:tasks.workunit.client.1.smithi195.stdout:9/414: dwrite d6/d19/d21/d64/d68/d6d/f85 [0,4194304] 0 2024-09-13T17:05:47.454 INFO:tasks.workunit.client.0.smithi115.stdout:6/262: unlink d8/d13/d15/d24/f1f 0 2024-09-13T17:05:47.455 INFO:tasks.workunit.client.1.smithi195.stdout:2/406: dwrite d0/f48 [0,4194304] 0 2024-09-13T17:05:47.455 INFO:tasks.workunit.client.1.smithi195.stdout:2/407: write d0/d4a/d1c/d2c/d51/f42 [1776339,47698] 0 2024-09-13T17:05:47.455 INFO:tasks.workunit.client.1.smithi195.stdout:2/408: readlink d0/d4a/d1c/l6a 0 2024-09-13T17:05:47.455 INFO:tasks.workunit.client.1.smithi195.stdout:2/409: readlink d0/d3/l69 0 2024-09-13T17:05:47.455 INFO:tasks.workunit.client.1.smithi195.stdout:2/410: dread - d0/d4a/d1c/d2c/d51/f78 zero size 2024-09-13T17:05:47.455 INFO:tasks.workunit.client.1.smithi195.stdout:0/391: dwrite d7/d50/f1c [0,4194304] 0 2024-09-13T17:05:47.456 INFO:tasks.workunit.client.1.smithi195.stdout:7/438: dwrite d5/db/d19/d22/d3c/f4f [0,4194304] 0 2024-09-13T17:05:47.456 INFO:tasks.workunit.client.0.smithi115.stdout:6/263: unlink d8/d13/d15/l4b 0 2024-09-13T17:05:47.457 INFO:tasks.workunit.client.1.smithi195.stdout:8/393: dwrite d0/d17/d2f/d31/f37 [0,4194304] 0 2024-09-13T17:05:47.458 INFO:tasks.workunit.client.0.smithi115.stdout:4/374: write d7/dd/f44 [3030884,78860] 0 2024-09-13T17:05:47.459 INFO:tasks.workunit.client.0.smithi115.stdout:7/239: dwrite d0/d3b/d50/d21/d2f/f4e [0,4194304] 0 2024-09-13T17:05:47.459 INFO:tasks.workunit.client.0.smithi115.stdout:7/240: stat d0/d3b/d54 0 2024-09-13T17:05:47.459 INFO:tasks.workunit.client.0.smithi115.stdout:7/241: dread - d0/d18/f49 zero size 2024-09-13T17:05:47.462 INFO:tasks.workunit.client.1.smithi195.stdout:5/380: dread d2/df/f1a [0,4194304] 0 2024-09-13T17:05:47.462 INFO:tasks.workunit.client.1.smithi195.stdout:5/381: write d2/d12/d4e/f5b [607554,121347] 0 2024-09-13T17:05:47.462 INFO:tasks.workunit.client.0.smithi115.stdout:8/298: write d0/d18/f2e [2027219,36455] 0 2024-09-13T17:05:47.464 INFO:tasks.workunit.client.1.smithi195.stdout:3/365: dwrite d7/f15 [8388608,4194304] 0 2024-09-13T17:05:47.465 INFO:tasks.workunit.client.0.smithi115.stdout:4/375: mkdir d7/dd/de/d4e/d6c 0 2024-09-13T17:05:47.466 INFO:tasks.workunit.client.1.smithi195.stdout:2/411: mkdir d0/d4a/d47/d73/d75/d7e 0 2024-09-13T17:05:47.466 INFO:tasks.workunit.client.1.smithi195.stdout:2/412: chown d0/d3/df/l1f 387 1 2024-09-13T17:05:47.466 INFO:tasks.workunit.client.1.smithi195.stdout:2/413: read - d0/d4a/d1c/d2c/d51/f78 zero size 2024-09-13T17:05:47.467 INFO:tasks.workunit.client.1.smithi195.stdout:4/455: getdents d1a 0 2024-09-13T17:05:47.469 INFO:tasks.workunit.client.1.smithi195.stdout:9/415: dwrite d6/d12/f46 [0,4194304] 0 2024-09-13T17:05:47.469 INFO:tasks.workunit.client.1.smithi195.stdout:9/416: chown d6/df/f27 30411000 1 2024-09-13T17:05:47.469 INFO:tasks.workunit.client.1.smithi195.stdout:9/417: write d6/f3f [1151519,40808] 0 2024-09-13T17:05:47.470 INFO:tasks.workunit.client.1.smithi195.stdout:0/392: rename d7/d8/d23/d4b/d56/d46/f2e to d7/db/d38/d5d/f7f 0 2024-09-13T17:05:47.470 INFO:tasks.workunit.client.1.smithi195.stdout:0/393: write d7/d8/d23/d4b/d56/d46/f6e [426034,36510] 0 2024-09-13T17:05:47.473 INFO:tasks.workunit.client.0.smithi115.stdout:7/242: creat d0/d3b/f58 x:0 0 0 2024-09-13T17:05:47.473 INFO:tasks.workunit.client.0.smithi115.stdout:7/243: fsync d0/d2/f3a 0 2024-09-13T17:05:47.473 INFO:tasks.workunit.client.0.smithi115.stdout:7/244: write d0/d3b/d50/f10 [63234,40200] 0 2024-09-13T17:05:47.474 INFO:tasks.workunit.client.1.smithi195.stdout:7/439: getdents d5/db/d19 0 2024-09-13T17:05:47.474 INFO:tasks.workunit.client.1.smithi195.stdout:7/440: getdents d5/db/d19/d22/d90 0 2024-09-13T17:05:47.478 INFO:tasks.workunit.client.0.smithi115.stdout:9/166: sync 2024-09-13T17:05:47.478 INFO:tasks.workunit.client.0.smithi115.stdout:5/270: sync 2024-09-13T17:05:47.478 INFO:tasks.workunit.client.0.smithi115.stdout:2/453: sync 2024-09-13T17:05:47.478 INFO:tasks.workunit.client.0.smithi115.stdout:1/256: sync 2024-09-13T17:05:47.479 INFO:tasks.workunit.client.0.smithi115.stdout:3/453: sync 2024-09-13T17:05:47.479 INFO:tasks.workunit.client.0.smithi115.stdout:3/454: creat d1/d4b/d1a/d30/f99 x:0 0 0 2024-09-13T17:05:47.488 INFO:tasks.workunit.client.1.smithi195.stdout:0/394: write d7/d50/f1c [514060,111281] 0 2024-09-13T17:05:47.489 INFO:tasks.workunit.client.0.smithi115.stdout:9/167: mknod d0/d34/c3c 0 2024-09-13T17:05:47.489 INFO:tasks.workunit.client.0.smithi115.stdout:9/168: write d0/f1d [1427453,33709] 0 2024-09-13T17:05:47.489 INFO:tasks.workunit.client.0.smithi115.stdout:2/454: dread d3/d4d/de/f10 [0,4194304] 0 2024-09-13T17:05:47.490 INFO:tasks.workunit.client.0.smithi115.stdout:1/257: symlink d5/d7/d33/d3a/l5a 0 2024-09-13T17:05:47.491 INFO:tasks.workunit.client.0.smithi115.stdout:2/455: dread d3/d4d/dd/d1f/d2f/d56/d58/f7b [0,4194304] 0 2024-09-13T17:05:47.493 INFO:tasks.workunit.client.1.smithi195.stdout:7/441: dwrite d5/f6 [0,4194304] 0 2024-09-13T17:05:47.495 INFO:tasks.workunit.client.0.smithi115.stdout:3/455: rename d1/d12/c26 to d1/d4b/d69/d7b/d8b/d90/c9a 0 2024-09-13T17:05:47.496 INFO:tasks.workunit.client.1.smithi195.stdout:0/395: dread f3 [0,4194304] 0 2024-09-13T17:05:47.496 INFO:tasks.workunit.client.1.smithi195.stdout:0/396: readlink d7/d8/d23/d4b/l77 0 2024-09-13T17:05:47.497 INFO:tasks.workunit.client.0.smithi115.stdout:5/271: dwrite f8 [0,4194304] 0 2024-09-13T17:05:47.497 INFO:tasks.workunit.client.0.smithi115.stdout:5/272: read - d19/f53 zero size 2024-09-13T17:05:47.498 INFO:tasks.workunit.client.1.smithi195.stdout:8/394: creat d0/d62/f83 x:0 0 0 2024-09-13T17:05:47.499 INFO:tasks.workunit.client.0.smithi115.stdout:2/456: link d3/d4d/d13/d62/d66/f82 d3/f8f 0 2024-09-13T17:05:47.500 INFO:tasks.workunit.client.1.smithi195.stdout:5/382: mkdir d2/df/d39/d76 0 2024-09-13T17:05:47.502 INFO:tasks.workunit.client.1.smithi195.stdout:3/366: mknod d7/d21/d51/c65 0 2024-09-13T17:05:47.504 INFO:tasks.workunit.client.0.smithi115.stdout:1/258: rename d5/d7/d33/d48/l58 to d5/d3e/l5b 0 2024-09-13T17:05:47.505 INFO:tasks.workunit.client.0.smithi115.stdout:2/457: dread d3/d4d/dd/df/f24 [0,4194304] 0 2024-09-13T17:05:47.507 INFO:tasks.workunit.client.0.smithi115.stdout:3/456: unlink d1/d4b/d1a/d30/c71 0 2024-09-13T17:05:47.509 INFO:tasks.workunit.client.0.smithi115.stdout:9/169: link d0/c7 d0/de/c3d 0 2024-09-13T17:05:47.510 INFO:tasks.workunit.client.0.smithi115.stdout:2/458: write d3/f4 [323614,116328] 0 2024-09-13T17:05:47.510 INFO:tasks.workunit.client.0.smithi115.stdout:2/459: readlink d3/d4d/dd/l30 0 2024-09-13T17:05:47.510 INFO:tasks.workunit.client.0.smithi115.stdout:2/460: chown d3/d4d/dd/d1f/d2f/d56 240615969 1 2024-09-13T17:05:47.512 INFO:tasks.workunit.client.1.smithi195.stdout:2/414: link d0/d4a/d1c/f23 d0/d4a/d1c/f7f 0 2024-09-13T17:05:47.512 INFO:tasks.workunit.client.1.smithi195.stdout:2/415: chown d0/d3/l5d 9032700 1 2024-09-13T17:05:47.514 INFO:tasks.workunit.client.1.smithi195.stdout:4/456: rmdir d1a/d1f/d43/d29/d58/d91 39 2024-09-13T17:05:47.518 INFO:tasks.workunit.client.0.smithi115.stdout:5/273: unlink d19/d2b/d32/l39 0 2024-09-13T17:05:47.519 INFO:tasks.workunit.client.0.smithi115.stdout:9/170: write d0/f3 [9563664,123607] 0 2024-09-13T17:05:47.521 INFO:tasks.workunit.client.0.smithi115.stdout:2/461: write d3/d4d/d13/d39/f3b [2576167,2309] 0 2024-09-13T17:05:47.522 INFO:tasks.workunit.client.0.smithi115.stdout:3/457: creat d1/d4b/d1a/f9b x:0 0 0 2024-09-13T17:05:47.524 INFO:tasks.workunit.client.1.smithi195.stdout:9/418: rename d6/df/d16/d5c/f80 to d6/df/d16/f88 0 2024-09-13T17:05:47.526 INFO:tasks.workunit.client.0.smithi115.stdout:9/171: creat d0/de/d10/f3e x:0 0 0 2024-09-13T17:05:47.527 INFO:tasks.workunit.client.1.smithi195.stdout:7/442: symlink d5/d13/l91 0 2024-09-13T17:05:47.528 INFO:tasks.workunit.client.0.smithi115.stdout:2/462: symlink d3/d4d/dd/df/d57/d8b/l90 0 2024-09-13T17:05:47.530 INFO:tasks.workunit.client.1.smithi195.stdout:0/397: mknod d7/db/d11/c80 0 2024-09-13T17:05:47.530 INFO:tasks.workunit.client.1.smithi195.stdout:0/398: chown d7/db/c60 0 1 2024-09-13T17:05:47.530 INFO:tasks.workunit.client.1.smithi195.stdout:0/399: readlink d7/d8/d23/d4b/d4e/d68/l69 0 2024-09-13T17:05:47.532 INFO:tasks.workunit.client.0.smithi115.stdout:3/458: read d1/d4b/d69/f80 [3762357,68267] 0 2024-09-13T17:05:47.533 INFO:tasks.workunit.client.1.smithi195.stdout:8/395: symlink d0/d17/d2f/l84 0 2024-09-13T17:05:47.535 INFO:tasks.workunit.client.0.smithi115.stdout:9/172: creat d0/f3f x:0 0 0 2024-09-13T17:05:47.537 INFO:tasks.workunit.client.1.smithi195.stdout:5/383: rmdir d2/df/d39/d68 39 2024-09-13T17:05:47.538 INFO:tasks.workunit.client.0.smithi115.stdout:5/274: dwrite d19/d21/f22 [0,4194304] 0 2024-09-13T17:05:47.539 INFO:tasks.workunit.client.1.smithi195.stdout:0/400: write d7/d8/f7e [2155900,60065] 0 2024-09-13T17:05:47.540 INFO:tasks.workunit.client.0.smithi115.stdout:2/463: mknod d3/d4d/dd/c91 0 2024-09-13T17:05:47.541 INFO:tasks.workunit.client.1.smithi195.stdout:3/367: mkdir d7/d21/d66 0 2024-09-13T17:05:47.541 INFO:tasks.workunit.client.1.smithi195.stdout:3/368: chown d7/d21/d2a/d35/l36 1193699794 1 2024-09-13T17:05:47.541 INFO:tasks.workunit.client.1.smithi195.stdout:3/369: fsync f5 0 2024-09-13T17:05:47.544 INFO:tasks.workunit.client.0.smithi115.stdout:3/459: link d1/d4b/d1a/d30/l93 d1/d12/d14/d54/l9c 0 2024-09-13T17:05:47.545 INFO:tasks.workunit.client.1.smithi195.stdout:2/416: getdents d0/d4a/d1c/d2c/d43/d63 0 2024-09-13T17:05:47.546 INFO:tasks.workunit.client.0.smithi115.stdout:2/464: mkdir d3/d4d/d13/d62/d92 0 2024-09-13T17:05:47.550 INFO:tasks.workunit.client.0.smithi115.stdout:2/465: symlink d3/d4d/dd/d1f/d2f/d56/d58/d72/l93 0 2024-09-13T17:05:47.550 INFO:tasks.workunit.client.0.smithi115.stdout:2/466: stat d3/d4d/de/f37 0 2024-09-13T17:05:47.554 INFO:tasks.workunit.client.0.smithi115.stdout:2/467: symlink d3/d4d/dd/df/d5b/l94 0 2024-09-13T17:05:47.554 INFO:tasks.workunit.client.0.smithi115.stdout:2/468: fsync d3/d4d/dd/f2d 0 2024-09-13T17:05:47.554 INFO:tasks.workunit.client.0.smithi115.stdout:2/469: dread - d3/d4d/dd/d1f/d2f/d56/d58/f7f zero size 2024-09-13T17:05:47.554 INFO:tasks.workunit.client.1.smithi195.stdout:2/417: dread d0/d3/fe [0,4194304] 0 2024-09-13T17:05:47.555 INFO:tasks.workunit.client.0.smithi115.stdout:2/470: read d3/d4d/de/d3a/f6d [245921,100752] 0 2024-09-13T17:05:47.556 INFO:tasks.workunit.client.1.smithi195.stdout:4/457: mkdir d1a/d1f/d21/d22/d98 0 2024-09-13T17:05:47.557 INFO:tasks.workunit.client.1.smithi195.stdout:9/419: creat d6/d12/d39/f89 x:0 0 0 2024-09-13T17:05:47.558 INFO:tasks.workunit.client.0.smithi115.stdout:9/173: dwrite d0/f11 [8388608,4194304] 0 2024-09-13T17:05:47.558 INFO:tasks.workunit.client.0.smithi115.stdout:9/174: dread - d0/de/d10/d15/f3a zero size 2024-09-13T17:05:47.560 INFO:tasks.workunit.client.0.smithi115.stdout:3/460: dread d1/fa [0,4194304] 0 2024-09-13T17:05:47.561 INFO:tasks.workunit.client.1.smithi195.stdout:7/443: rename d5/d13/l91 to d5/d35/d37/l92 0 2024-09-13T17:05:47.562 INFO:tasks.workunit.client.0.smithi115.stdout:2/471: unlink d3/d4d/d13/l1e 0 2024-09-13T17:05:47.563 INFO:tasks.workunit.client.1.smithi195.stdout:8/396: symlink d0/d13/d52/d55/l85 0 2024-09-13T17:05:47.564 INFO:tasks.workunit.client.0.smithi115.stdout:3/461: mkdir d1/d83/d9d 0 2024-09-13T17:05:47.565 INFO:tasks.workunit.client.0.smithi115.stdout:2/472: dread d3/d4d/dd/d1f/d2f/d56/f42 [0,4194304] 0 2024-09-13T17:05:47.565 INFO:tasks.workunit.client.0.smithi115.stdout:2/473: fsync d3/f8a 0 2024-09-13T17:05:47.565 INFO:tasks.workunit.client.0.smithi115.stdout:2/474: chown d3/d4d/dd/d1f/d2f/d56 86074605 1 2024-09-13T17:05:47.566 INFO:tasks.workunit.client.1.smithi195.stdout:6/394: sync 2024-09-13T17:05:47.566 INFO:tasks.workunit.client.1.smithi195.stdout:6/395: dread - d1c/d24/d49/d5f/d35/f45 zero size 2024-09-13T17:05:47.567 INFO:tasks.workunit.client.0.smithi115.stdout:2/475: write d3/d4d/dd/d1f/f79 [716618,24544] 0 2024-09-13T17:05:47.567 INFO:tasks.workunit.client.0.smithi115.stdout:2/476: stat d3/d4d/dd/d1f/d2f/d56/d58/f5a 0 2024-09-13T17:05:47.567 INFO:tasks.workunit.client.0.smithi115.stdout:2/477: write d3/f8f [451609,123737] 0 2024-09-13T17:05:47.568 INFO:tasks.workunit.client.1.smithi195.stdout:5/384: dwrite d2/df/d39/f49 [0,4194304] 0 2024-09-13T17:05:47.572 INFO:tasks.workunit.client.0.smithi115.stdout:9/175: write d0/f11 [8844687,122627] 0 2024-09-13T17:05:47.572 INFO:tasks.workunit.client.0.smithi115.stdout:5/275: dwrite d19/d2b/d32/d55/f5a [0,4194304] 0 2024-09-13T17:05:47.572 INFO:tasks.workunit.client.0.smithi115.stdout:5/276: chown d19/d2b/d32/d55/f5a 14929 1 2024-09-13T17:05:47.573 INFO:tasks.workunit.client.1.smithi195.stdout:0/401: dwrite d7/d8/d23/d4b/d4e/f65 [0,4194304] 0 2024-09-13T17:05:47.575 INFO:tasks.workunit.client.0.smithi115.stdout:2/478: write d3/d4d/de/f59 [2936005,38806] 0 2024-09-13T17:05:47.575 INFO:tasks.workunit.client.0.smithi115.stdout:2/479: chown d3/d4d/de 33 1 2024-09-13T17:05:47.575 INFO:tasks.workunit.client.0.smithi115.stdout:2/480: chown d3/d4d/dd/c78 46050 1 2024-09-13T17:05:47.575 INFO:tasks.workunit.client.0.smithi115.stdout:2/481: readlink d3/d4d/dd/d1f/d2f/d56/l53 0 2024-09-13T17:05:47.581 INFO:tasks.workunit.client.1.smithi195.stdout:6/396: dwrite d1c/d2d/d30/f57 [4194304,4194304] 0 2024-09-13T17:05:47.581 INFO:tasks.workunit.client.1.smithi195.stdout:5/385: dwrite d2/d12/d4e/f4b [0,4194304] 0 2024-09-13T17:05:47.671 INFO:tasks.workunit.client.0.smithi115.stdout:3/462: link d1/d4b/d1a/d30/f82 d1/d83/d9d/f9e 0 2024-09-13T17:05:47.672 INFO:tasks.workunit.client.1.smithi195.stdout:2/418: symlink d0/d4a/d1c/d2c/l80 0 2024-09-13T17:05:47.672 INFO:tasks.workunit.client.1.smithi195.stdout:2/419: creat d0/d4a/d1c/d2c/d51/f81 x:0 0 0 2024-09-13T17:05:47.675 INFO:tasks.workunit.client.1.smithi195.stdout:9/420: creat d6/d12/f8a x:0 0 0 2024-09-13T17:05:47.676 INFO:tasks.workunit.client.1.smithi195.stdout:4/458: rename d1a/d1f/d21/c74 to d1a/d1f/d43/c99 0 2024-09-13T17:05:47.676 INFO:tasks.workunit.client.1.smithi195.stdout:4/459: write d1a/d1f/d43/d24/f7d [1031800,55301] 0 2024-09-13T17:05:47.680 INFO:tasks.workunit.client.1.smithi195.stdout:8/397: link d0/d17/d2f/d7c/c72 d0/d13/d52/c86 0 2024-09-13T17:05:47.681 INFO:tasks.workunit.client.0.smithi115.stdout:5/277: mknod d19/c61 0 2024-09-13T17:05:47.682 INFO:tasks.workunit.client.0.smithi115.stdout:5/278: write d19/d21/f30 [693767,5380] 0 2024-09-13T17:05:47.683 INFO:tasks.workunit.client.1.smithi195.stdout:3/370: mkdir d7/d67 0 2024-09-13T17:05:47.687 INFO:tasks.workunit.client.0.smithi115.stdout:2/482: truncate d3/d4d/de/d3a/d47/f49 3532272 0 2024-09-13T17:05:47.687 INFO:tasks.workunit.client.0.smithi115.stdout:2/483: write d3/d4d/d13/d62/d66/f82 [1618835,70269] 0 2024-09-13T17:05:47.690 INFO:tasks.workunit.client.1.smithi195.stdout:4/460: dread d1a/d1f/d43/d29/f2a [0,4194304] 0 2024-09-13T17:05:47.690 INFO:tasks.workunit.client.1.smithi195.stdout:4/461: write d1a/d1f/d43/f66 [3110937,41135] 0 2024-09-13T17:05:47.690 INFO:tasks.workunit.client.1.smithi195.stdout:4/462: chown d1a/d1f/d21/d22/c92 6578061 1 2024-09-13T17:05:47.690 INFO:tasks.workunit.client.1.smithi195.stdout:4/463: write d1a/d1f/d43/d29/d58/d91/f96 [531436,62044] 0 2024-09-13T17:05:47.691 INFO:tasks.workunit.client.0.smithi115.stdout:3/463: creat d1/d4b/d69/d7b/f9f x:0 0 0 2024-09-13T17:05:47.691 INFO:tasks.workunit.client.0.smithi115.stdout:3/464: write d1/d4b/d69/d7b/f9f [609882,111656] 0 2024-09-13T17:05:47.693 INFO:tasks.workunit.client.1.smithi195.stdout:0/402: link d7/d8/d23/f25 d7/db/f81 0 2024-09-13T17:05:47.693 INFO:tasks.workunit.client.1.smithi195.stdout:0/403: fdatasync d7/d8/d23/f62 0 2024-09-13T17:05:47.693 INFO:tasks.workunit.client.1.smithi195.stdout:0/404: write d7/db/d38/f76 [4504988,17324] 0 2024-09-13T17:05:47.693 INFO:tasks.workunit.client.1.smithi195.stdout:0/405: creat d7/d50/f82 x:0 0 0 2024-09-13T17:05:47.693 INFO:tasks.workunit.client.1.smithi195.stdout:0/406: creat d7/d8/d23/d4b/d56/d46/f83 x:0 0 0 2024-09-13T17:05:47.698 INFO:tasks.workunit.client.0.smithi115.stdout:9/176: symlink d0/l40 0 2024-09-13T17:05:47.699 INFO:tasks.workunit.client.1.smithi195.stdout:6/397: getdents d1c/d24/d49 0 2024-09-13T17:05:47.705 INFO:tasks.workunit.client.1.smithi195.stdout:5/386: mknod d2/d12/d4e/d10/d46/c77 0 2024-09-13T17:05:47.707 INFO:tasks.workunit.client.1.smithi195.stdout:9/421: mknod d6/d19/d21/d64/d68/c8b 0 2024-09-13T17:05:47.709 INFO:tasks.workunit.client.1.smithi195.stdout:7/444: rename d5/db/d19/d22/d3c/l45 to d5/db/d19/d22/l93 0 2024-09-13T17:05:47.710 INFO:tasks.workunit.client.1.smithi195.stdout:8/398: creat d0/d17/d2f/d31/f87 x:0 0 0 2024-09-13T17:05:47.710 INFO:tasks.workunit.client.1.smithi195.stdout:8/399: write d0/d17/d49/f80 [591709,60502] 0 2024-09-13T17:05:47.710 INFO:tasks.workunit.client.1.smithi195.stdout:8/400: stat d0/d13/d52 0 2024-09-13T17:05:47.711 INFO:tasks.workunit.client.1.smithi195.stdout:8/401: creat d0/d13/f88 x:0 0 0 2024-09-13T17:05:47.712 INFO:tasks.workunit.client.0.smithi115.stdout:5/279: mkdir d19/d21/d62 0 2024-09-13T17:05:47.714 INFO:tasks.workunit.client.0.smithi115.stdout:9/177: creat d0/de/d37/f41 x:0 0 0 2024-09-13T17:05:47.714 INFO:tasks.workunit.client.0.smithi115.stdout:9/178: dread - d0/de/d10/d15/f3b zero size 2024-09-13T17:05:47.715 INFO:tasks.workunit.client.1.smithi195.stdout:3/371: write d7/f2d [4384970,46273] 0 2024-09-13T17:05:47.717 INFO:tasks.workunit.client.1.smithi195.stdout:4/464: unlink d1a/d1f/d21/d22/l89 0 2024-09-13T17:05:47.720 INFO:tasks.workunit.client.0.smithi115.stdout:5/280: mkdir d19/d21/d62/d63 0 2024-09-13T17:05:47.722 INFO:tasks.workunit.client.0.smithi115.stdout:9/179: mkdir d0/d21/d42 0 2024-09-13T17:05:47.722 INFO:tasks.workunit.client.0.smithi115.stdout:9/180: stat d0/lf 0 2024-09-13T17:05:47.723 INFO:tasks.workunit.client.1.smithi195.stdout:6/398: symlink d1c/d24/d49/d5f/d35/l83 0 2024-09-13T17:05:47.723 INFO:tasks.workunit.client.1.smithi195.stdout:6/399: fdatasync d1c/d2d/d30/d6f/f7e 0 2024-09-13T17:05:47.724 INFO:tasks.workunit.client.0.smithi115.stdout:5/281: link d19/d21/d3a/c52 d19/d1d/c64 0 2024-09-13T17:05:47.726 INFO:tasks.workunit.client.1.smithi195.stdout:5/387: truncate d2/d12/f50 35639 0 2024-09-13T17:05:47.726 INFO:tasks.workunit.client.1.smithi195.stdout:5/388: read d2/f6a [4082176,106667] 0 2024-09-13T17:05:47.726 INFO:tasks.workunit.client.0.smithi115.stdout:9/181: symlink d0/de/d37/l43 0 2024-09-13T17:05:47.726 INFO:tasks.workunit.client.0.smithi115.stdout:9/182: creat d0/de/d10/f44 x:0 0 0 2024-09-13T17:05:47.727 INFO:tasks.workunit.client.0.smithi115.stdout:9/183: truncate d0/de/d10/d15/f24 4630154 0 2024-09-13T17:05:47.727 INFO:tasks.workunit.client.0.smithi115.stdout:9/184: readlink d0/l40 0 2024-09-13T17:05:47.728 INFO:tasks.workunit.client.1.smithi195.stdout:9/422: unlink d6/d19/d21/d45/f54 0 2024-09-13T17:05:47.730 INFO:tasks.workunit.client.1.smithi195.stdout:7/445: rename d5/d13/c73 to d5/db/d19/c94 0 2024-09-13T17:05:47.733 INFO:tasks.workunit.client.1.smithi195.stdout:3/372: link d7/d21/d2a/f32 d7/d5f/f68 0 2024-09-13T17:05:47.734 INFO:tasks.workunit.client.1.smithi195.stdout:0/407: getdents d7/d8/d23/d4b/d56/d4d 0 2024-09-13T17:05:47.736 INFO:tasks.workunit.client.1.smithi195.stdout:9/423: dread d6/df/d16/d65/f75 [0,4194304] 0 2024-09-13T17:05:47.736 INFO:tasks.workunit.client.1.smithi195.stdout:3/373: symlink d7/d62/l69 0 2024-09-13T17:05:47.738 INFO:tasks.workunit.client.1.smithi195.stdout:7/446: getdents d5/d13/d24/d70 0 2024-09-13T17:05:47.740 INFO:tasks.workunit.client.1.smithi195.stdout:9/424: rename d6/d12/c3a to d6/d19/c8c 0 2024-09-13T17:05:47.742 INFO:tasks.workunit.client.1.smithi195.stdout:3/374: symlink d7/d21/d2a/d35/d60/l6a 0 2024-09-13T17:05:47.743 INFO:tasks.workunit.client.1.smithi195.stdout:5/389: dread d2/d3e/f16 [0,4194304] 0 2024-09-13T17:05:47.743 INFO:tasks.workunit.client.1.smithi195.stdout:5/390: chown d2/f6a 259 1 2024-09-13T17:05:47.743 INFO:tasks.workunit.client.1.smithi195.stdout:5/391: chown d2/d12/d4e/c22 17641 1 2024-09-13T17:05:47.743 INFO:tasks.workunit.client.1.smithi195.stdout:3/375: truncate d7/d19/f48 24575 0 2024-09-13T17:05:47.744 INFO:tasks.workunit.client.1.smithi195.stdout:1/404: sync 2024-09-13T17:05:47.746 INFO:tasks.workunit.client.1.smithi195.stdout:3/376: getdents d7/d21/d2a/d4a 0 2024-09-13T17:05:47.746 INFO:tasks.workunit.client.1.smithi195.stdout:3/377: chown d7/d19/d1e/c5b 0 1 2024-09-13T17:05:47.746 INFO:tasks.workunit.client.1.smithi195.stdout:3/378: fsync d7/d21/d2a/f4b 0 2024-09-13T17:05:47.746 INFO:tasks.workunit.client.1.smithi195.stdout:3/379: write d7/d21/d2a/f32 [688947,95292] 0 2024-09-13T17:05:47.746 INFO:tasks.workunit.client.1.smithi195.stdout:1/405: mkdir db/df/d51/d8e 0 2024-09-13T17:05:47.750 INFO:tasks.workunit.client.0.smithi115.stdout:2/484: dwrite d3/d4d/d13/d62/d66/f82 [0,4194304] 0 2024-09-13T17:05:47.750 INFO:tasks.workunit.client.0.smithi115.stdout:2/485: truncate d3/d4d/dd/d1f/d2f/d56/f29 1417914 0 2024-09-13T17:05:47.750 INFO:tasks.workunit.client.0.smithi115.stdout:2/486: write d3/d4d/dd/df/d5c/f71 [1081667,90902] 0 2024-09-13T17:05:47.750 INFO:tasks.workunit.client.1.smithi195.stdout:9/425: read d6/df/f27 [2785427,1686] 0 2024-09-13T17:05:47.756 INFO:tasks.workunit.client.1.smithi195.stdout:3/380: link d7/d19/l39 d7/d21/d2a/d35/d60/l6b 0 2024-09-13T17:05:47.756 INFO:tasks.workunit.client.0.smithi115.stdout:9/185: dwrite d0/de/d10/d15/f3b [0,4194304] 0 2024-09-13T17:05:47.757 INFO:tasks.workunit.client.0.smithi115.stdout:9/186: write d0/de/f2d [853842,91959] 0 2024-09-13T17:05:47.757 INFO:tasks.workunit.client.0.smithi115.stdout:9/187: dread - d0/f3f zero size 2024-09-13T17:05:47.757 INFO:tasks.workunit.client.0.smithi115.stdout:9/188: dread - d0/de/d37/f41 zero size 2024-09-13T17:05:47.760 INFO:tasks.workunit.client.1.smithi195.stdout:9/426: stat d6/d19/c8c 0 2024-09-13T17:05:47.761 INFO:tasks.workunit.client.0.smithi115.stdout:3/465: dwrite d1/d12/d14/f51 [0,4194304] 0 2024-09-13T17:05:47.762 INFO:tasks.workunit.client.1.smithi195.stdout:5/392: rename d2/df/d39 to d2/df/d78 0 2024-09-13T17:05:47.763 INFO:tasks.workunit.client.1.smithi195.stdout:5/393: write d2/df/d78/d54/f73 [649227,96510] 0 2024-09-13T17:05:47.763 INFO:tasks.workunit.client.1.smithi195.stdout:8/402: dwrite d0/d13/f88 [0,4194304] 0 2024-09-13T17:05:47.765 INFO:tasks.workunit.client.1.smithi195.stdout:3/381: link d7/d19/d1e/f52 d7/d67/f6c 0 2024-09-13T17:05:47.767 INFO:tasks.workunit.client.0.smithi115.stdout:9/189: symlink d0/de/d10/d15/l45 0 2024-09-13T17:05:47.768 INFO:tasks.workunit.client.1.smithi195.stdout:3/382: read d7/d19/d1e/f52 [262367,85612] 0 2024-09-13T17:05:47.773 INFO:tasks.workunit.client.0.smithi115.stdout:5/282: dwrite d19/d2b/d32/d55/f5a [0,4194304] 0 2024-09-13T17:05:47.774 INFO:tasks.workunit.client.0.smithi115.stdout:3/466: mkdir d1/d4b/d69/d7b/da0 0 2024-09-13T17:05:47.775 INFO:tasks.workunit.client.1.smithi195.stdout:5/394: getdents d2/df/d78/d54/d58 0 2024-09-13T17:05:47.775 INFO:tasks.workunit.client.1.smithi195.stdout:5/395: read d2/df/f1a [860579,59132] 0 2024-09-13T17:05:47.780 INFO:tasks.workunit.client.0.smithi115.stdout:3/467: mkdir d1/d4b/d69/da1 0 2024-09-13T17:05:47.780 INFO:tasks.workunit.client.0.smithi115.stdout:3/468: fsync d1/d4b/d69/f6a 0 2024-09-13T17:05:47.780 INFO:tasks.workunit.client.0.smithi115.stdout:3/469: stat d1/d83 0 2024-09-13T17:05:47.781 INFO:tasks.workunit.client.0.smithi115.stdout:3/470: creat d1/d4b/d1a/fa2 x:0 0 0 2024-09-13T17:05:47.782 INFO:tasks.workunit.client.1.smithi195.stdout:8/403: creat d0/f89 x:0 0 0 2024-09-13T17:05:47.782 INFO:tasks.workunit.client.0.smithi115.stdout:5/283: dread f14 [0,4194304] 0 2024-09-13T17:05:47.786 INFO:tasks.workunit.client.1.smithi195.stdout:6/400: dwrite d1c/f63 [0,4194304] 0 2024-09-13T17:05:47.786 INFO:tasks.workunit.client.1.smithi195.stdout:6/401: truncate d1c/d24/d49/f4c 374234 0 2024-09-13T17:05:47.787 INFO:tasks.workunit.client.1.smithi195.stdout:3/383: rename d7/d21/d51/c65 to d7/d21/d66/c6d 0 2024-09-13T17:05:47.789 INFO:tasks.workunit.client.1.smithi195.stdout:8/404: symlink d0/d17/d2f/d7c/l8a 0 2024-09-13T17:05:47.789 INFO:tasks.workunit.client.1.smithi195.stdout:8/405: chown d0/d17/l3c 2067455864 1 2024-09-13T17:05:47.791 INFO:tasks.workunit.client.1.smithi195.stdout:5/396: write d2/f26 [375070,3433] 0 2024-09-13T17:05:47.793 INFO:tasks.workunit.client.1.smithi195.stdout:5/397: mknod d2/d3e/c79 0 2024-09-13T17:05:47.794 INFO:tasks.workunit.client.0.smithi115.stdout:3/471: write d1/d12/d23/f48 [1136594,44584] 0 2024-09-13T17:05:47.794 INFO:tasks.workunit.client.1.smithi195.stdout:5/398: creat d2/d3e/f7a x:0 0 0 2024-09-13T17:05:47.796 INFO:tasks.workunit.client.0.smithi115.stdout:3/472: rename d1/d83/l88 to d1/d4b/d1a/la3 0 2024-09-13T17:05:47.797 INFO:tasks.workunit.client.1.smithi195.stdout:5/399: mkdir d2/d12/d3f/d7b 0 2024-09-13T17:05:47.798 INFO:tasks.workunit.client.1.smithi195.stdout:5/400: chown d2/d12/d4e/f2b 1 1 2024-09-13T17:05:47.798 INFO:tasks.workunit.client.1.smithi195.stdout:0/408: dwrite d7/db/d11/f73 [0,4194304] 0 2024-09-13T17:05:47.798 INFO:tasks.workunit.client.1.smithi195.stdout:5/401: write d2/d12/f75 [829695,43111] 0 2024-09-13T17:05:47.798 INFO:tasks.workunit.client.0.smithi115.stdout:2/487: dwrite d3/d4d/dd/df/f86 [0,4194304] 0 2024-09-13T17:05:47.799 INFO:tasks.workunit.client.1.smithi195.stdout:8/406: write d0/d17/d2f/d7c/f48 [4041861,94130] 0 2024-09-13T17:05:47.799 INFO:tasks.workunit.client.1.smithi195.stdout:1/406: dwrite db/df/d51/f72 [0,4194304] 0 2024-09-13T17:05:47.799 INFO:tasks.workunit.client.1.smithi195.stdout:9/427: dwrite d6/f69 [0,4194304] 0 2024-09-13T17:05:47.800 INFO:tasks.workunit.client.1.smithi195.stdout:4/465: dwrite f8 [0,4194304] 0 2024-09-13T17:05:47.800 INFO:tasks.workunit.client.1.smithi195.stdout:5/402: write d2/d12/d3f/f4d [766961,46822] 0 2024-09-13T17:05:47.800 INFO:tasks.workunit.client.0.smithi115.stdout:3/473: mkdir d1/da4 0 2024-09-13T17:05:47.804 INFO:tasks.workunit.client.1.smithi195.stdout:8/407: symlink d0/d17/d49/d63/l8b 0 2024-09-13T17:05:47.806 INFO:tasks.workunit.client.1.smithi195.stdout:3/384: dread d7/f15 [4194304,4194304] 0 2024-09-13T17:05:47.806 INFO:tasks.workunit.client.1.smithi195.stdout:0/409: dread d7/db/d38/f3b [0,4194304] 0 2024-09-13T17:05:47.808 INFO:tasks.workunit.client.1.smithi195.stdout:6/402: dwrite d1c/d24/d49/d5f/d35/f39 [0,4194304] 0 2024-09-13T17:05:47.808 INFO:tasks.workunit.client.0.smithi115.stdout:3/474: creat d1/d12/d14/fa5 x:0 0 0 2024-09-13T17:05:47.815 INFO:tasks.workunit.client.0.smithi115.stdout:3/475: truncate d1/d4b/d1a/f81 408375 0 2024-09-13T17:05:47.815 INFO:tasks.workunit.client.0.smithi115.stdout:3/476: fsync d1/d4b/d1a/f4e 0 2024-09-13T17:05:47.815 INFO:tasks.workunit.client.0.smithi115.stdout:9/190: rmdir d0/de/d37 39 2024-09-13T17:05:47.815 INFO:tasks.workunit.client.0.smithi115.stdout:9/191: chown d0/d21/f22 108 1 2024-09-13T17:05:47.815 INFO:tasks.workunit.client.0.smithi115.stdout:2/488: dread d3/f18 [0,4194304] 0 2024-09-13T17:05:47.816 INFO:tasks.workunit.client.1.smithi195.stdout:5/403: dread d2/d3e/f3a [0,4194304] 0 2024-09-13T17:05:47.825 INFO:tasks.workunit.client.1.smithi195.stdout:1/407: symlink db/l8f 0 2024-09-13T17:05:47.826 INFO:tasks.workunit.client.1.smithi195.stdout:1/408: write db/df/d13/f86 [1715801,45741] 0 2024-09-13T17:05:47.828 INFO:tasks.workunit.client.1.smithi195.stdout:8/408: dwrite d0/d13/f5d [4194304,4194304] 0 2024-09-13T17:05:47.828 INFO:tasks.workunit.client.1.smithi195.stdout:8/409: stat d0/d17/d2f/d31/f37 0 2024-09-13T17:05:47.828 INFO:tasks.workunit.client.1.smithi195.stdout:8/410: write d0/d4/f39 [1779537,109734] 0 2024-09-13T17:05:47.829 INFO:tasks.workunit.client.0.smithi115.stdout:3/477: mkdir d1/da6 0 2024-09-13T17:05:47.830 INFO:tasks.workunit.client.1.smithi195.stdout:8/411: write d0/d17/f6b [399433,11389] 0 2024-09-13T17:05:47.830 INFO:tasks.workunit.client.1.smithi195.stdout:3/385: creat d7/d21/d2a/d4a/f6e x:0 0 0 2024-09-13T17:05:47.833 INFO:tasks.workunit.client.1.smithi195.stdout:0/410: mknod d7/db/d38/d5d/c84 0 2024-09-13T17:05:47.834 INFO:tasks.workunit.client.0.smithi115.stdout:9/192: dwrite d0/de/d10/f14 [4194304,4194304] 0 2024-09-13T17:05:47.834 INFO:tasks.workunit.client.0.smithi115.stdout:9/193: creat d0/de/d10/f46 x:0 0 0 2024-09-13T17:05:47.834 INFO:tasks.workunit.client.0.smithi115.stdout:9/194: stat d0/f3f 0 2024-09-13T17:05:47.835 INFO:tasks.workunit.client.1.smithi195.stdout:4/466: dwrite d1a/d1f/d43/d5a/f65 [0,4194304] 0 2024-09-13T17:05:47.836 INFO:tasks.workunit.client.1.smithi195.stdout:5/404: dread d2/df/d78/f49 [0,4194304] 0 2024-09-13T17:05:47.837 INFO:tasks.workunit.client.1.smithi195.stdout:6/403: rename d1c/d24/d49/d5f/d46/c61 to d1c/d24/d49/c84 0 2024-09-13T17:05:47.837 INFO:tasks.workunit.client.1.smithi195.stdout:1/409: rename db/df to db/df/d4d/d67/d90 22 2024-09-13T17:05:47.838 INFO:tasks.workunit.client.0.smithi115.stdout:2/489: dread d3/d4d/de/f59 [0,4194304] 0 2024-09-13T17:05:47.844 INFO:tasks.workunit.client.1.smithi195.stdout:3/386: write f5 [702984,53698] 0 2024-09-13T17:05:47.845 INFO:tasks.workunit.client.0.smithi115.stdout:9/195: symlink d0/de/d37/l47 0 2024-09-13T17:05:47.857 INFO:tasks.workunit.client.0.smithi115.stdout:2/490: write d3/d4d/de/f43 [1604626,22419] 0 2024-09-13T17:05:47.857 INFO:tasks.workunit.client.0.smithi115.stdout:2/491: read - d3/d4d/dd/df/d5b/f7a zero size 2024-09-13T17:05:47.857 INFO:tasks.workunit.client.0.smithi115.stdout:2/492: chown d3/d4d/d13 31 1 2024-09-13T17:05:47.857 INFO:tasks.workunit.client.0.smithi115.stdout:2/493: readlink d3/d4d/d13/d62/d66/l6a 0 2024-09-13T17:05:47.857 INFO:tasks.workunit.client.1.smithi195.stdout:4/467: dwrite d1a/d1f/d43/d5a/f81 [0,4194304] 0 2024-09-13T17:05:47.869 INFO:tasks.workunit.client.0.smithi115.stdout:0/221: sync 2024-09-13T17:05:47.870 INFO:tasks.workunit.client.1.smithi195.stdout:1/410: dwrite db/d19/d37/d3e/f43 [0,4194304] 0 2024-09-13T17:05:47.870 INFO:tasks.workunit.client.1.smithi195.stdout:1/411: dread - db/df/d13/f5b zero size 2024-09-13T17:05:47.870 INFO:tasks.workunit.client.0.smithi115.stdout:2/494: dread d3/f8f [0,4194304] 0 2024-09-13T17:05:47.871 INFO:tasks.workunit.client.0.smithi115.stdout:3/478: dwrite d1/d4b/f4d [0,4194304] 0 2024-09-13T17:05:47.872 INFO:tasks.workunit.client.0.smithi115.stdout:2/495: rmdir d3/d4d/dd/d1f 39 2024-09-13T17:05:47.874 INFO:tasks.workunit.client.0.smithi115.stdout:2/496: symlink d3/l95 0 2024-09-13T17:05:47.880 INFO:tasks.workunit.client.1.smithi195.stdout:9/428: mkdir d6/d8d 0 2024-09-13T17:05:47.880 INFO:tasks.workunit.client.1.smithi195.stdout:8/412: symlink d0/d17/d2f/d7c/d4b/l8c 0 2024-09-13T17:05:47.881 INFO:tasks.workunit.client.1.smithi195.stdout:9/429: read d6/df/f27 [357010,4100] 0 2024-09-13T17:05:47.881 INFO:tasks.workunit.client.1.smithi195.stdout:5/405: link d2/df/d78/f44 d2/f7c 0 2024-09-13T17:05:47.882 INFO:tasks.workunit.client.0.smithi115.stdout:3/479: write d1/d12/d14/f55 [2875657,19677] 0 2024-09-13T17:05:47.882 INFO:tasks.workunit.client.0.smithi115.stdout:3/480: creat d1/d4b/d1a/d30/fa7 x:0 0 0 2024-09-13T17:05:47.884 INFO:tasks.workunit.client.1.smithi195.stdout:3/387: mkdir d7/d21/d2a/d35/d60/d6f 0 2024-09-13T17:05:47.884 INFO:tasks.workunit.client.1.smithi195.stdout:3/388: write d7/d67/f6c [52390,81873] 0 2024-09-13T17:05:47.884 INFO:tasks.workunit.client.1.smithi195.stdout:3/389: chown d7/d21/d2a/f32 36388 1 2024-09-13T17:05:47.884 INFO:tasks.workunit.client.1.smithi195.stdout:3/390: truncate d7/d21/d2a/d4a/f6e 940615 0 2024-09-13T17:05:47.884 INFO:tasks.workunit.client.1.smithi195.stdout:5/406: dread d2/d12/f50 [0,4194304] 0 2024-09-13T17:05:47.885 INFO:tasks.workunit.client.0.smithi115.stdout:3/481: symlink d1/d12/d14/d61/la8 0 2024-09-13T17:05:47.885 INFO:tasks.workunit.client.0.smithi115.stdout:3/482: readlink d1/d4b/d69/l95 0 2024-09-13T17:05:47.885 INFO:tasks.workunit.client.0.smithi115.stdout:3/483: fdatasync d1/d4b/d1a/f6b 0 2024-09-13T17:05:47.886 INFO:tasks.workunit.client.0.smithi115.stdout:3/484: creat d1/da6/fa9 x:0 0 0 2024-09-13T17:05:47.886 INFO:tasks.workunit.client.0.smithi115.stdout:3/485: dread - d1/da6/fa9 zero size 2024-09-13T17:05:47.886 INFO:tasks.workunit.client.0.smithi115.stdout:3/486: creat d1/d4b/d1a/d30/faa x:0 0 0 2024-09-13T17:05:47.886 INFO:tasks.workunit.client.0.smithi115.stdout:0/222: dwrite d9/d1d/f39 [0,4194304] 0 2024-09-13T17:05:47.886 INFO:tasks.workunit.client.0.smithi115.stdout:0/223: dread - d9/d1d/d24/f31 zero size 2024-09-13T17:05:47.887 INFO:tasks.workunit.client.0.smithi115.stdout:0/224: chown d9/d1d/d24/d26/d2d 28830 1 2024-09-13T17:05:47.889 INFO:tasks.workunit.client.1.smithi195.stdout:4/468: mknod d1a/d1f/d43/d24/c9a 0 2024-09-13T17:05:47.889 INFO:tasks.workunit.client.1.smithi195.stdout:4/469: stat d1a/d1f/d21/d36/l61 0 2024-09-13T17:05:47.889 INFO:tasks.workunit.client.1.smithi195.stdout:4/470: dread - d1a/d1f/d43/d24/f78 zero size 2024-09-13T17:05:47.890 INFO:tasks.workunit.client.0.smithi115.stdout:3/487: creat d1/fab x:0 0 0 2024-09-13T17:05:47.890 INFO:tasks.workunit.client.0.smithi115.stdout:3/488: creat d1/d4b/fac x:0 0 0 2024-09-13T17:05:47.895 INFO:tasks.workunit.client.1.smithi195.stdout:6/404: truncate d1c/d24/d49/d5f/d35/f39 623016 0 2024-09-13T17:05:47.895 INFO:tasks.workunit.client.1.smithi195.stdout:6/405: write f19 [799332,27793] 0 2024-09-13T17:05:47.897 INFO:tasks.workunit.client.1.smithi195.stdout:5/407: link d2/d3e/f16 d2/d12/d4e/d10/f7d 0 2024-09-13T17:05:47.897 INFO:tasks.workunit.client.1.smithi195.stdout:5/408: fsync d2/df/d78/f4f 0 2024-09-13T17:05:47.898 INFO:tasks.workunit.client.0.smithi115.stdout:0/225: creat d9/d1d/d24/d26/d36/f3d x:0 0 0 2024-09-13T17:05:47.898 INFO:tasks.workunit.client.0.smithi115.stdout:0/226: chown d9/d1d/d24/l3b 8 1 2024-09-13T17:05:47.898 INFO:tasks.workunit.client.1.smithi195.stdout:2/420: sync 2024-09-13T17:05:47.898 INFO:tasks.workunit.client.1.smithi195.stdout:2/421: creat d0/d3/f82 x:0 0 0 2024-09-13T17:05:47.899 INFO:tasks.workunit.client.1.smithi195.stdout:2/422: write d0/d4a/d1c/f23 [374303,76523] 0 2024-09-13T17:05:47.900 INFO:tasks.workunit.client.1.smithi195.stdout:1/412: unlink db/d19/d5a/c6f 0 2024-09-13T17:05:47.901 INFO:tasks.workunit.client.0.smithi115.stdout:2/497: dwrite d3/d4d/dd/f2d [0,4194304] 0 2024-09-13T17:05:47.903 INFO:tasks.workunit.client.1.smithi195.stdout:6/406: rename d1c/d24/d49/d5f/d46 to d1c/d24/d49/d5f/d85 0 2024-09-13T17:05:47.903 INFO:tasks.workunit.client.1.smithi195.stdout:6/407: chown d1c/d2d 0 1 2024-09-13T17:05:47.905 INFO:tasks.workunit.client.0.smithi115.stdout:3/489: link d1/d12/d23/f59 d1/d12/d14/fad 0 2024-09-13T17:05:47.910 INFO:tasks.workunit.client.1.smithi195.stdout:2/423: symlink d0/d4a/d1c/d2c/l83 0 2024-09-13T17:05:47.910 INFO:tasks.workunit.client.1.smithi195.stdout:2/424: write d0/f6c [23109,108146] 0 2024-09-13T17:05:47.911 INFO:tasks.workunit.client.0.smithi115.stdout:0/227: dread d9/f38 [0,4194304] 0 2024-09-13T17:05:47.912 INFO:tasks.workunit.client.0.smithi115.stdout:3/490: dread d1/d12/d14/f19 [0,4194304] 0 2024-09-13T17:05:47.912 INFO:tasks.workunit.client.1.smithi195.stdout:6/408: symlink d1c/d24/l86 0 2024-09-13T17:05:47.914 INFO:tasks.workunit.client.1.smithi195.stdout:2/425: mkdir d0/d4a/d1c/d2c/d43/d84 0 2024-09-13T17:05:47.914 INFO:tasks.workunit.client.0.smithi115.stdout:3/491: symlink d1/d4b/d69/d7b/lae 0 2024-09-13T17:05:47.920 INFO:tasks.workunit.client.1.smithi195.stdout:7/447: sync 2024-09-13T17:05:47.920 INFO:tasks.workunit.client.1.smithi195.stdout:7/448: creat d5/d13/d30/f95 x:0 0 0 2024-09-13T17:05:47.921 INFO:tasks.workunit.client.1.smithi195.stdout:7/449: rename d5/db/l44 to d5/db/l96 0 2024-09-13T17:05:47.921 INFO:tasks.workunit.client.0.smithi115.stdout:3/492: unlink d1/d4b/l44 0 2024-09-13T17:05:47.921 INFO:tasks.workunit.client.0.smithi115.stdout:3/493: truncate d1/d4b/f21 619211 0 2024-09-13T17:05:47.921 INFO:tasks.workunit.client.0.smithi115.stdout:3/494: write d1/d4b/fac [503331,1141] 0 2024-09-13T17:05:47.922 INFO:tasks.workunit.client.0.smithi115.stdout:0/228: write d9/f38 [183412,108714] 0 2024-09-13T17:05:47.922 INFO:tasks.workunit.client.0.smithi115.stdout:3/495: unlink d1/d4b/d1a/d30/c92 0 2024-09-13T17:05:47.922 INFO:tasks.workunit.client.0.smithi115.stdout:3/496: readlink d1/l67 0 2024-09-13T17:05:47.922 INFO:tasks.workunit.client.0.smithi115.stdout:3/497: write d1/d12/d23/f48 [1153484,71658] 0 2024-09-13T17:05:47.922 INFO:tasks.workunit.client.0.smithi115.stdout:3/498: truncate d1/da6/fa9 100251 0 2024-09-13T17:05:47.922 INFO:tasks.workunit.client.0.smithi115.stdout:3/499: creat d1/da6/faf x:0 0 0 2024-09-13T17:05:47.924 INFO:tasks.workunit.client.0.smithi115.stdout:0/229: mknod d9/d1d/d24/c3e 0 2024-09-13T17:05:47.924 INFO:tasks.workunit.client.0.smithi115.stdout:0/230: write d9/f38 [1236449,44165] 0 2024-09-13T17:05:47.924 INFO:tasks.workunit.client.0.smithi115.stdout:0/231: creat d9/d1d/f3f x:0 0 0 2024-09-13T17:05:47.927 INFO:tasks.workunit.client.0.smithi115.stdout:3/500: dread d1/d12/f5b [0,4194304] 0 2024-09-13T17:05:47.928 INFO:tasks.workunit.client.1.smithi195.stdout:8/413: dwrite d0/d17/d2f/d31/f37 [0,4194304] 0 2024-09-13T17:05:47.928 INFO:tasks.workunit.client.1.smithi195.stdout:9/430: dwrite d6/d19/d21/d5b/f6f [0,4194304] 0 2024-09-13T17:05:47.931 INFO:tasks.workunit.client.0.smithi115.stdout:3/501: rename d1/l40 to d1/d4b/d1a/d30/lb0 0 2024-09-13T17:05:47.931 INFO:tasks.workunit.client.0.smithi115.stdout:3/502: chown d1/d4b/c33 45 1 2024-09-13T17:05:47.931 INFO:tasks.workunit.client.0.smithi115.stdout:3/503: chown d1/d4b/d1a/d30/c70 17098 1 2024-09-13T17:05:47.932 INFO:tasks.workunit.client.1.smithi195.stdout:9/431: mkdir d6/df/d13/d8e 0 2024-09-13T17:05:47.935 INFO:tasks.workunit.client.0.smithi115.stdout:3/504: rename d1/l5 to d1/d4b/d69/d7b/lb1 0 2024-09-13T17:05:47.936 INFO:tasks.workunit.client.1.smithi195.stdout:8/414: symlink d0/d17/d2f/d31/l8d 0 2024-09-13T17:05:47.936 INFO:tasks.workunit.client.1.smithi195.stdout:8/415: dread - d0/d4/f7f zero size 2024-09-13T17:05:47.937 INFO:tasks.workunit.client.1.smithi195.stdout:8/416: mknod d0/d17/d49/d63/c8e 0 2024-09-13T17:05:47.938 INFO:tasks.workunit.client.1.smithi195.stdout:9/432: mknod d6/c8f 0 2024-09-13T17:05:47.939 INFO:tasks.workunit.client.1.smithi195.stdout:8/417: symlink d0/d17/d2f/d6a/d6f/l8f 0 2024-09-13T17:05:47.939 INFO:tasks.workunit.client.1.smithi195.stdout:9/433: mknod d6/df/d7b/c90 0 2024-09-13T17:05:47.940 INFO:tasks.workunit.client.1.smithi195.stdout:4/471: dwrite d1a/d1f/d43/d24/f78 [0,4194304] 0 2024-09-13T17:05:47.943 INFO:tasks.workunit.client.1.smithi195.stdout:4/472: creat d1a/d1f/d43/d29/f9b x:0 0 0 2024-09-13T17:05:47.946 INFO:tasks.workunit.client.1.smithi195.stdout:5/409: write d2/df/d78/f49 [834191,20949] 0 2024-09-13T17:05:47.947 INFO:tasks.workunit.client.0.smithi115.stdout:2/498: dwrite d3/d4d/dd/d1f/d2f/d56/f29 [0,4194304] 0 2024-09-13T17:05:47.949 INFO:tasks.workunit.client.0.smithi115.stdout:2/499: creat d3/d4d/dd/f96 x:0 0 0 2024-09-13T17:05:47.950 INFO:tasks.workunit.client.0.smithi115.stdout:2/500: symlink d3/d4d/d13/d39/d87/l97 0 2024-09-13T17:05:47.951 INFO:tasks.workunit.client.0.smithi115.stdout:2/501: mkdir d3/d4d/de/d98 0 2024-09-13T17:05:47.952 INFO:tasks.workunit.client.0.smithi115.stdout:2/502: mkdir d3/d4d/de/d99 0 2024-09-13T17:05:47.952 INFO:tasks.workunit.client.0.smithi115.stdout:2/503: chown d3/d4d/de/d3a/d47 11977 1 2024-09-13T17:05:47.953 INFO:tasks.workunit.client.0.smithi115.stdout:2/504: truncate d3/d4d/de/d3a/d47/f49 2470012 0 2024-09-13T17:05:47.956 INFO:tasks.workunit.client.0.smithi115.stdout:2/505: mkdir d3/d4d/de/d99/d9a 0 2024-09-13T17:05:47.958 INFO:tasks.workunit.client.0.smithi115.stdout:2/506: link d3/d4d/de/f43 d3/d4d/dd/d1f/d2f/d56/f9b 0 2024-09-13T17:05:47.959 INFO:tasks.workunit.client.1.smithi195.stdout:1/413: dwrite db/f2b [0,4194304] 0 2024-09-13T17:05:47.960 INFO:tasks.workunit.client.1.smithi195.stdout:2/426: dwrite d0/d4a/f7b [0,4194304] 0 2024-09-13T17:05:47.960 INFO:tasks.workunit.client.1.smithi195.stdout:2/427: fdatasync d0/f66 0 2024-09-13T17:05:47.964 INFO:tasks.workunit.client.1.smithi195.stdout:2/428: symlink d0/d4a/d1c/d2c/d43/d63/l85 0 2024-09-13T17:05:47.967 INFO:tasks.workunit.client.1.smithi195.stdout:2/429: truncate d0/d3/f5b 1591288 0 2024-09-13T17:05:47.969 INFO:tasks.workunit.client.1.smithi195.stdout:2/430: mknod d0/d4a/d47/d73/d75/d7e/c86 0 2024-09-13T17:05:47.970 INFO:tasks.workunit.client.1.smithi195.stdout:7/450: dwrite d5/db/d19/d22/d3c/f4f [0,4194304] 0 2024-09-13T17:05:47.970 INFO:tasks.workunit.client.1.smithi195.stdout:7/451: fsync d5/db/d19/d22/f6c 0 2024-09-13T17:05:47.970 INFO:tasks.workunit.client.1.smithi195.stdout:3/391: dwrite d7/f2d [0,4194304] 0 2024-09-13T17:05:47.971 INFO:tasks.workunit.client.1.smithi195.stdout:2/431: unlink d0/d3/d3d/l4c 0 2024-09-13T17:05:47.971 INFO:tasks.workunit.client.1.smithi195.stdout:2/432: chown d0/d4a/d1c/d2c/d51/f78 24740527 1 2024-09-13T17:05:47.973 INFO:tasks.workunit.client.1.smithi195.stdout:7/452: symlink d5/db/d19/d22/l97 0 2024-09-13T17:05:47.974 INFO:tasks.workunit.client.1.smithi195.stdout:7/453: dread d5/d13/d24/f51 [0,4194304] 0 2024-09-13T17:05:47.976 INFO:tasks.workunit.client.0.smithi115.stdout:2/507: write d3/f14 [2788888,23482] 0 2024-09-13T17:05:47.979 INFO:tasks.workunit.client.0.smithi115.stdout:2/508: symlink d3/d4d/d13/l9c 0 2024-09-13T17:05:47.981 INFO:tasks.workunit.client.1.smithi195.stdout:3/392: mkdir d7/d62/d70 0 2024-09-13T17:05:47.982 INFO:tasks.workunit.client.1.smithi195.stdout:2/433: creat d0/d4a/d1c/d2c/d43/d84/f87 x:0 0 0 2024-09-13T17:05:47.983 INFO:tasks.workunit.client.1.smithi195.stdout:7/454: mknod d5/d13/c98 0 2024-09-13T17:05:47.983 INFO:tasks.workunit.client.1.smithi195.stdout:7/455: truncate d5/d35/f60 1028309 0 2024-09-13T17:05:47.983 INFO:tasks.workunit.client.1.smithi195.stdout:7/456: creat d5/d35/f99 x:0 0 0 2024-09-13T17:05:47.984 INFO:tasks.workunit.client.1.smithi195.stdout:7/457: creat d5/d13/d24/f9a x:0 0 0 2024-09-13T17:05:47.986 INFO:tasks.workunit.client.1.smithi195.stdout:8/418: dwrite d0/d17/f6b [0,4194304] 0 2024-09-13T17:05:47.986 INFO:tasks.workunit.client.1.smithi195.stdout:3/393: mkdir d7/d21/d2a/d4a/d71 0 2024-09-13T17:05:47.986 INFO:tasks.workunit.client.0.smithi115.stdout:0/232: dwrite d9/d1d/d24/f25 [0,4194304] 0 2024-09-13T17:05:47.986 INFO:tasks.workunit.client.0.smithi115.stdout:0/233: write d9/d1b/f34 [8425330,27762] 0 2024-09-13T17:05:47.989 INFO:tasks.workunit.client.0.smithi115.stdout:0/234: truncate d9/fc 2552434 0 2024-09-13T17:05:47.992 INFO:tasks.workunit.client.1.smithi195.stdout:7/458: link d5/db/d19/c2f d5/db/d19/c9b 0 2024-09-13T17:05:47.992 INFO:tasks.workunit.client.1.smithi195.stdout:7/459: creat d5/d13/f9c x:0 0 0 2024-09-13T17:05:47.992 INFO:tasks.workunit.client.1.smithi195.stdout:7/460: chown d5/d35/d37/l48 196276327 1 2024-09-13T17:05:47.992 INFO:tasks.workunit.client.1.smithi195.stdout:7/461: chown d5/d13/f6a 1696031 1 2024-09-13T17:05:47.994 INFO:tasks.workunit.client.0.smithi115.stdout:0/235: link d9/d1d/d24/d26/d2d/d30/c37 d9/d1d/d24/d26/d2c/c40 0 2024-09-13T17:05:47.994 INFO:tasks.workunit.client.0.smithi115.stdout:0/236: creat d9/f41 x:0 0 0 2024-09-13T17:05:47.999 INFO:tasks.workunit.client.1.smithi195.stdout:8/419: symlink d0/d17/d49/l90 0 2024-09-13T17:05:47.999 INFO:tasks.workunit.client.1.smithi195.stdout:8/420: fsync d0/fc 0 2024-09-13T17:05:47.999 INFO:tasks.workunit.client.1.smithi195.stdout:8/421: chown d0/d17/d2f/d7c/c6e 897389143 1 2024-09-13T17:05:47.999 INFO:tasks.workunit.client.1.smithi195.stdout:8/422: fsync d0/d13/f5d 0 2024-09-13T17:05:47.999 INFO:tasks.workunit.client.1.smithi195.stdout:8/423: truncate d0/d4/f7f 102739 0 2024-09-13T17:05:48.001 INFO:tasks.workunit.client.0.smithi115.stdout:3/505: dwrite d1/d4b/d1a/f9b [0,4194304] 0 2024-09-13T17:05:48.002 INFO:tasks.workunit.client.1.smithi195.stdout:9/434: dwrite d6/d19/d21/d5b/f6f [0,4194304] 0 2024-09-13T17:05:48.007 INFO:tasks.workunit.client.1.smithi195.stdout:7/462: stat d5/d35/l3b 0 2024-09-13T17:05:48.007 INFO:tasks.workunit.client.1.smithi195.stdout:7/463: readlink d5/db/d19/d22/l97 0 2024-09-13T17:05:48.008 INFO:tasks.workunit.client.1.smithi195.stdout:8/424: mkdir d0/d17/d2f/d7c/d4b/d91 0 2024-09-13T17:05:48.018 INFO:tasks.workunit.client.1.smithi195.stdout:7/464: write d5/db/d19/f18 [3924512,9917] 0 2024-09-13T17:05:48.018 INFO:tasks.workunit.client.1.smithi195.stdout:7/465: read d5/d35/f60 [802237,99137] 0 2024-09-13T17:05:48.019 INFO:tasks.workunit.client.1.smithi195.stdout:7/466: link d5/db/d50/d7f/d82/c8c d5/d35/d37/c9d 0 2024-09-13T17:05:48.020 INFO:tasks.workunit.client.1.smithi195.stdout:7/467: creat d5/f9e x:0 0 0 2024-09-13T17:05:48.020 INFO:tasks.workunit.client.1.smithi195.stdout:7/468: write d5/f6 [5220691,8607] 0 2024-09-13T17:05:48.026 INFO:tasks.workunit.client.1.smithi195.stdout:4/473: dwrite f14 [0,4194304] 0 2024-09-13T17:05:48.027 INFO:tasks.workunit.client.0.smithi115.stdout:3/506: write d1/d4b/d1a/d6e/f75 [2513430,14226] 0 2024-09-13T17:05:48.028 INFO:tasks.workunit.client.1.smithi195.stdout:4/474: mkdir d1a/d1f/d9c 0 2024-09-13T17:05:48.034 INFO:tasks.workunit.client.1.smithi195.stdout:6/409: dwrite f19 [0,4194304] 0 2024-09-13T17:05:48.034 INFO:tasks.workunit.client.1.smithi195.stdout:6/410: fsync d1c/d2d/f32 0 2024-09-13T17:05:48.035 INFO:tasks.workunit.client.1.smithi195.stdout:5/410: dwrite d2/d3e/f3a [4194304,4194304] 0 2024-09-13T17:05:48.035 INFO:tasks.workunit.client.1.smithi195.stdout:5/411: chown d2/f26 516 1 2024-09-13T17:05:48.035 INFO:tasks.workunit.client.1.smithi195.stdout:5/412: chown d2/d3e/d32 6 1 2024-09-13T17:05:48.042 INFO:tasks.workunit.client.1.smithi195.stdout:1/414: dwrite db/df/d13/f8d [0,4194304] 0 2024-09-13T17:05:48.047 INFO:tasks.workunit.client.1.smithi195.stdout:1/415: getdents db/d19/d37/d3e 0 2024-09-13T17:05:48.048 INFO:tasks.workunit.client.0.smithi115.stdout:2/509: dwrite d3/f4 [0,4194304] 0 2024-09-13T17:05:48.048 INFO:tasks.workunit.client.1.smithi195.stdout:3/394: dwrite d7/d19/d1e/f50 [0,4194304] 0 2024-09-13T17:05:48.049 INFO:tasks.workunit.client.1.smithi195.stdout:1/416: mknod db/d19/c91 0 2024-09-13T17:05:48.049 INFO:tasks.workunit.client.0.smithi115.stdout:2/510: creat d3/d4d/dd/d1f/f9d x:0 0 0 2024-09-13T17:05:48.056 INFO:tasks.workunit.client.0.smithi115.stdout:2/511: rmdir d3/d4d 39 2024-09-13T17:05:48.057 INFO:tasks.workunit.client.0.smithi115.stdout:2/512: readlink d3/d4d/dd/d1f/d2f/d56/d58/d72/l93 0 2024-09-13T17:05:48.058 INFO:tasks.workunit.client.1.smithi195.stdout:0/411: sync 2024-09-13T17:05:48.058 INFO:tasks.workunit.client.1.smithi195.stdout:0/412: write d7/d8/d23/d4b/d4e/d68/f79 [351902,89872] 0 2024-09-13T17:05:48.061 INFO:tasks.workunit.client.1.smithi195.stdout:2/434: rename d0/d4a/d1c to d0/d4a/d47/d73/d75/d88 0 2024-09-13T17:05:48.063 INFO:tasks.workunit.client.1.smithi195.stdout:3/395: rmdir d7/d21 39 2024-09-13T17:05:48.064 INFO:tasks.workunit.client.1.smithi195.stdout:6/411: rename d1c/d2d/d5e/f77 to d1c/d3e/f87 0 2024-09-13T17:05:48.064 INFO:tasks.workunit.client.1.smithi195.stdout:3/396: readlink d7/l24 0 2024-09-13T17:05:48.066 INFO:tasks.workunit.client.1.smithi195.stdout:3/397: mknod d7/d21/d2a/d4a/d5a/c72 0 2024-09-13T17:05:48.067 INFO:tasks.workunit.client.1.smithi195.stdout:3/398: creat d7/d21/f73 x:0 0 0 2024-09-13T17:05:48.068 INFO:tasks.workunit.client.1.smithi195.stdout:7/469: dwrite d5/db/d50/d7f/f80 [0,4194304] 0 2024-09-13T17:05:48.068 INFO:tasks.workunit.client.1.smithi195.stdout:9/435: dwrite d6/df/d13/d44/d47/d61/f73 [0,4194304] 0 2024-09-13T17:05:48.069 INFO:tasks.workunit.client.0.smithi115.stdout:0/237: dwrite d9/fd [4194304,4194304] 0 2024-09-13T17:05:48.069 INFO:tasks.workunit.client.1.smithi195.stdout:3/399: mkdir d7/d21/d2a/d35/d60/d6f/d74 0 2024-09-13T17:05:48.069 INFO:tasks.workunit.client.1.smithi195.stdout:3/400: write d7/f61 [981791,13387] 0 2024-09-13T17:05:48.070 INFO:tasks.workunit.client.1.smithi195.stdout:8/425: dwrite d0/d17/f6b [0,4194304] 0 2024-09-13T17:05:48.072 INFO:tasks.workunit.client.1.smithi195.stdout:5/413: dwrite d2/d12/d4e/d10/f24 [0,4194304] 0 2024-09-13T17:05:48.072 INFO:tasks.workunit.client.1.smithi195.stdout:1/417: dwrite db/df/f16 [0,4194304] 0 2024-09-13T17:05:48.073 INFO:tasks.workunit.client.0.smithi115.stdout:2/513: write d3/f4 [780194,115847] 0 2024-09-13T17:05:48.074 INFO:tasks.workunit.client.0.smithi115.stdout:0/238: unlink d9/d1d/f3f 0 2024-09-13T17:05:48.074 INFO:tasks.workunit.client.0.smithi115.stdout:0/239: write d9/f2b [113164,40071] 0 2024-09-13T17:05:48.074 INFO:tasks.workunit.client.0.smithi115.stdout:0/240: fdatasync d9/f41 0 2024-09-13T17:05:48.074 INFO:tasks.workunit.client.0.smithi115.stdout:3/507: dwrite d1/d4b/fac [0,4194304] 0 2024-09-13T17:05:48.074 INFO:tasks.workunit.client.0.smithi115.stdout:3/508: chown d1/c73 38 1 2024-09-13T17:05:48.075 INFO:tasks.workunit.client.1.smithi195.stdout:6/412: dread f17 [0,4194304] 0 2024-09-13T17:05:48.075 INFO:tasks.workunit.client.1.smithi195.stdout:6/413: truncate d1c/d2d/f32 4884132 0 2024-09-13T17:05:48.075 INFO:tasks.workunit.client.1.smithi195.stdout:4/475: dwrite d1a/d1f/d43/d5a/f65 [0,4194304] 0 2024-09-13T17:05:48.076 INFO:tasks.workunit.client.0.smithi115.stdout:2/514: creat d3/d4d/dd/d1f/d2f/d56/f9e x:0 0 0 2024-09-13T17:05:48.077 INFO:tasks.workunit.client.1.smithi195.stdout:3/401: truncate d7/d21/d2a/f32 769040 0 2024-09-13T17:05:48.079 INFO:tasks.workunit.client.0.smithi115.stdout:0/241: rename d9/ff to d9/d1d/f42 0 2024-09-13T17:05:48.082 INFO:tasks.workunit.client.1.smithi195.stdout:8/426: mknod d0/d4/c92 0 2024-09-13T17:05:48.082 INFO:tasks.workunit.client.1.smithi195.stdout:7/470: write d5/db/d19/f33 [74911,129371] 0 2024-09-13T17:05:48.083 INFO:tasks.workunit.client.1.smithi195.stdout:2/435: dwrite d0/f24 [0,4194304] 0 2024-09-13T17:05:48.084 INFO:tasks.workunit.client.1.smithi195.stdout:9/436: dread d6/df/d16/d58/f6e [0,4194304] 0 2024-09-13T17:05:48.085 INFO:tasks.workunit.client.0.smithi115.stdout:2/515: creat d3/d4d/de/d98/f9f x:0 0 0 2024-09-13T17:05:48.087 INFO:tasks.workunit.client.0.smithi115.stdout:0/242: mknod d9/d1d/d24/d26/d2d/c43 0 2024-09-13T17:05:48.089 INFO:tasks.workunit.client.1.smithi195.stdout:5/414: creat d2/df/d78/d68/f7e x:0 0 0 2024-09-13T17:05:48.089 INFO:tasks.workunit.client.1.smithi195.stdout:5/415: creat d2/df/d78/d68/f7f x:0 0 0 2024-09-13T17:05:48.090 INFO:tasks.workunit.client.0.smithi115.stdout:2/516: mkdir d3/d4d/d13/d39/d46/da0 0 2024-09-13T17:05:48.094 INFO:tasks.workunit.client.1.smithi195.stdout:2/436: write d0/d3/f4 [8141297,62443] 0 2024-09-13T17:05:48.094 INFO:tasks.workunit.client.0.smithi115.stdout:2/517: symlink d3/d4d/dd/df/d5c/la1 0 2024-09-13T17:05:48.095 INFO:tasks.workunit.client.1.smithi195.stdout:8/427: write d0/d4/fb [1482701,100781] 0 2024-09-13T17:05:48.097 INFO:tasks.workunit.client.1.smithi195.stdout:1/418: rename db/l32 to db/d60/d73/l92 0 2024-09-13T17:05:48.098 INFO:tasks.workunit.client.1.smithi195.stdout:6/414: mkdir d1c/d24/d49/d5f/d35/d88 0 2024-09-13T17:05:48.099 INFO:tasks.workunit.client.0.smithi115.stdout:2/518: mkdir d3/d4d/d13/da2 0 2024-09-13T17:05:48.099 INFO:tasks.workunit.client.0.smithi115.stdout:2/519: chown d3/f4 6 1 2024-09-13T17:05:48.101 INFO:tasks.workunit.client.1.smithi195.stdout:7/471: unlink d5/db/l53 0 2024-09-13T17:05:48.103 INFO:tasks.workunit.client.1.smithi195.stdout:8/428: write d0/d17/f6b [1277666,12242] 0 2024-09-13T17:05:48.103 INFO:tasks.workunit.client.1.smithi195.stdout:8/429: fdatasync d0/d4/f39 0 2024-09-13T17:05:48.103 INFO:tasks.workunit.client.1.smithi195.stdout:8/430: creat d0/d17/d2f/f93 x:0 0 0 2024-09-13T17:05:48.104 INFO:tasks.workunit.client.0.smithi115.stdout:6/264: sync 2024-09-13T17:05:48.104 INFO:tasks.workunit.client.0.smithi115.stdout:8/299: sync 2024-09-13T17:05:48.107 INFO:tasks.workunit.client.0.smithi115.stdout:6/265: rename d8/d13/d15/d24/d17/f41 to d8/f51 0 2024-09-13T17:05:48.110 INFO:tasks.workunit.client.1.smithi195.stdout:9/437: link d6/d12/c22 d6/df/d16/c91 0 2024-09-13T17:05:48.111 INFO:tasks.workunit.client.0.smithi115.stdout:3/509: dwrite d1/d4b/d1a/f6b [0,4194304] 0 2024-09-13T17:05:48.111 INFO:tasks.workunit.client.0.smithi115.stdout:3/510: chown d1/d12/c4f 3791778 1 2024-09-13T17:05:48.111 INFO:tasks.workunit.client.0.smithi115.stdout:3/511: write d1/d4b/d69/f80 [4530357,77282] 0 2024-09-13T17:05:48.111 INFO:tasks.workunit.client.0.smithi115.stdout:3/512: readlink d1/d4b/l43 0 2024-09-13T17:05:48.112 INFO:tasks.workunit.client.1.smithi195.stdout:2/437: symlink d0/d3/df/l89 0 2024-09-13T17:05:48.114 INFO:tasks.workunit.client.0.smithi115.stdout:0/243: dwrite f0 [4194304,4194304] 0 2024-09-13T17:05:48.114 INFO:tasks.workunit.client.1.smithi195.stdout:3/402: dwrite d7/d21/d2a/d4a/f6e [0,4194304] 0 2024-09-13T17:05:48.114 INFO:tasks.workunit.client.1.smithi195.stdout:1/419: symlink db/d19/d37/d46/l93 0 2024-09-13T17:05:48.117 INFO:tasks.workunit.client.1.smithi195.stdout:9/438: write d6/df/d16/d58/f6e [7429658,70521] 0 2024-09-13T17:05:48.117 INFO:tasks.workunit.client.1.smithi195.stdout:9/439: write d6/df/d16/f74 [27757,124933] 0 2024-09-13T17:05:48.121 INFO:tasks.workunit.client.1.smithi195.stdout:8/431: symlink d0/d17/d2f/d6a/l94 0 2024-09-13T17:05:48.131 INFO:tasks.workunit.client.1.smithi195.stdout:3/403: symlink d7/d19/d1e/l75 0 2024-09-13T17:05:48.131 INFO:tasks.workunit.client.1.smithi195.stdout:3/404: chown d7/d21/d2a/f3b 76364 1 2024-09-13T17:05:48.131 INFO:tasks.workunit.client.0.smithi115.stdout:0/244: mknod d9/d27/c44 0 2024-09-13T17:05:48.133 INFO:tasks.workunit.client.1.smithi195.stdout:8/432: creat d0/d13/d52/d55/f95 x:0 0 0 2024-09-13T17:05:48.133 INFO:tasks.workunit.client.1.smithi195.stdout:8/433: read - d0/d17/f68 zero size 2024-09-13T17:05:48.133 INFO:tasks.workunit.client.1.smithi195.stdout:8/434: fdatasync d0/d13/f88 0 2024-09-13T17:05:48.133 INFO:tasks.workunit.client.1.smithi195.stdout:4/476: rename d1a/d1f/d43/d29 to d1a/d1f/d21/d84/d9d 0 2024-09-13T17:05:48.134 INFO:tasks.workunit.client.0.smithi115.stdout:0/245: creat d9/d1d/d24/d26/f45 x:0 0 0 2024-09-13T17:05:48.135 INFO:tasks.workunit.client.1.smithi195.stdout:4/477: dread d1a/d1f/d43/d24/d41/f4b [0,4194304] 0 2024-09-13T17:05:48.135 INFO:tasks.workunit.client.1.smithi195.stdout:4/478: dread - d1a/d1f/d21/f6a zero size 2024-09-13T17:05:48.136 INFO:tasks.workunit.client.1.smithi195.stdout:3/405: creat d7/d62/f76 x:0 0 0 2024-09-13T17:05:48.137 INFO:tasks.workunit.client.1.smithi195.stdout:8/435: symlink d0/d17/d2f/d7c/d4c/d67/l96 0 2024-09-13T17:05:48.137 INFO:tasks.workunit.client.1.smithi195.stdout:8/436: chown d0/d4/c10 121 1 2024-09-13T17:05:48.137 INFO:tasks.workunit.client.1.smithi195.stdout:8/437: readlink d0/d13/l26 0 2024-09-13T17:05:48.138 INFO:tasks.workunit.client.1.smithi195.stdout:5/416: rename d2/d12/l61 to d2/df/d78/l80 0 2024-09-13T17:05:48.139 INFO:tasks.workunit.client.1.smithi195.stdout:3/406: creat d7/f77 x:0 0 0 2024-09-13T17:05:48.139 INFO:tasks.workunit.client.1.smithi195.stdout:3/407: write d7/d19/d1e/f4c [422988,41392] 0 2024-09-13T17:05:48.140 INFO:tasks.workunit.client.1.smithi195.stdout:6/415: rename d1c/d2d/l43 to d1c/d2d/d5e/l89 0 2024-09-13T17:05:48.140 INFO:tasks.workunit.client.1.smithi195.stdout:6/416: fdatasync d1c/d2d/d30/d6f/f7e 0 2024-09-13T17:05:48.141 INFO:tasks.workunit.client.1.smithi195.stdout:3/408: creat d7/d21/d2a/d35/d60/d64/f78 x:0 0 0 2024-09-13T17:05:48.142 INFO:tasks.workunit.client.1.smithi195.stdout:1/420: rename db/d19/d37/c56 to db/df/d13/c94 0 2024-09-13T17:05:48.143 INFO:tasks.workunit.client.1.smithi195.stdout:6/417: mkdir d1c/d3e/d6b/d8a 0 2024-09-13T17:05:48.145 INFO:tasks.workunit.client.1.smithi195.stdout:3/409: symlink d7/d21/d66/l79 0 2024-09-13T17:05:48.145 INFO:tasks.workunit.client.1.smithi195.stdout:8/438: rename d0/d13/d69/l76 to d0/d17/d2f/d7c/d4c/l97 0 2024-09-13T17:05:48.146 INFO:tasks.workunit.client.1.smithi195.stdout:2/438: dwrite d0/d4a/d47/d73/d75/d88/d2c/d51/f79 [0,4194304] 0 2024-09-13T17:05:48.146 INFO:tasks.workunit.client.1.smithi195.stdout:1/421: mknod db/df/d4d/d85/c95 0 2024-09-13T17:05:48.148 INFO:tasks.workunit.client.1.smithi195.stdout:6/418: link d1c/d2d/f40 d1c/d24/d49/d5f/d85/f8b 0 2024-09-13T17:05:48.150 INFO:tasks.workunit.client.1.smithi195.stdout:8/439: unlink d0/d17/d2f/d7c/c60 0 2024-09-13T17:05:48.154 INFO:tasks.workunit.client.1.smithi195.stdout:3/410: dread d7/d21/d2a/d4a/f6e [0,4194304] 0 2024-09-13T17:05:48.154 INFO:tasks.workunit.client.1.smithi195.stdout:3/411: chown d7 14 1 2024-09-13T17:05:48.156 INFO:tasks.workunit.client.0.smithi115.stdout:3/513: dwrite d1/d4b/d69/d7b/d8b/f8c [0,4194304] 0 2024-09-13T17:05:48.156 INFO:tasks.workunit.client.0.smithi115.stdout:2/520: dwrite d3/f4 [0,4194304] 0 2024-09-13T17:05:48.157 INFO:tasks.workunit.client.1.smithi195.stdout:7/472: dwrite d5/f6 [4194304,4194304] 0 2024-09-13T17:05:48.157 INFO:tasks.workunit.client.1.smithi195.stdout:7/473: truncate d5/d13/d30/f83 843667 0 2024-09-13T17:05:48.157 INFO:tasks.workunit.client.1.smithi195.stdout:7/474: read d5/db/d19/d22/f38 [225314,66441] 0 2024-09-13T17:05:48.161 INFO:tasks.workunit.client.0.smithi115.stdout:3/514: symlink d1/d4b/d69/d7b/d8b/d90/lb2 0 2024-09-13T17:05:48.161 INFO:tasks.workunit.client.0.smithi115.stdout:3/515: write d1/d12/d14/d61/f7c [487074,29274] 0 2024-09-13T17:05:48.161 INFO:tasks.workunit.client.0.smithi115.stdout:3/516: fsync d1/d4b/f1b 0 2024-09-13T17:05:48.162 INFO:tasks.workunit.client.1.smithi195.stdout:1/422: dread db/d19/f64 [0,4194304] 0 2024-09-13T17:05:48.162 INFO:tasks.workunit.client.1.smithi195.stdout:1/423: fdatasync db/df/d13/f80 0 2024-09-13T17:05:48.163 INFO:tasks.workunit.client.1.smithi195.stdout:7/475: creat d5/d13/d24/d70/f9f x:0 0 0 2024-09-13T17:05:48.163 INFO:tasks.workunit.client.1.smithi195.stdout:7/476: chown d5/d35/d37/l92 27453 1 2024-09-13T17:05:48.166 INFO:tasks.workunit.client.1.smithi195.stdout:2/439: dread d0/f22 [0,4194304] 0 2024-09-13T17:05:48.166 INFO:tasks.workunit.client.0.smithi115.stdout:3/517: symlink d1/d4b/d69/d7b/lb3 0 2024-09-13T17:05:48.167 INFO:tasks.workunit.client.1.smithi195.stdout:7/477: symlink d5/d13/d24/la0 0 2024-09-13T17:05:48.168 INFO:tasks.workunit.client.1.smithi195.stdout:1/424: mkdir db/d19/d5a/d66/d96 0 2024-09-13T17:05:48.168 INFO:tasks.workunit.client.1.smithi195.stdout:1/425: creat db/f97 x:0 0 0 2024-09-13T17:05:48.168 INFO:tasks.workunit.client.1.smithi195.stdout:1/426: write db/df/f1f [1494939,96237] 0 2024-09-13T17:05:48.169 INFO:tasks.workunit.client.0.smithi115.stdout:3/518: mknod d1/da6/cb4 0 2024-09-13T17:05:48.171 INFO:tasks.workunit.client.1.smithi195.stdout:2/440: link d0/d4a/f7b d0/d3/d3d/f8a 0 2024-09-13T17:05:48.174 INFO:tasks.workunit.client.1.smithi195.stdout:9/440: dwrite d6/d19/d21/d64/d68/d6d/f7e [0,4194304] 0 2024-09-13T17:05:48.175 INFO:tasks.workunit.client.1.smithi195.stdout:7/478: mkdir d5/db/d50/d7f/d82/da1 0 2024-09-13T17:05:48.175 INFO:tasks.workunit.client.1.smithi195.stdout:7/479: chown d5/d35/d37/f65 48 1 2024-09-13T17:05:48.177 INFO:tasks.workunit.client.1.smithi195.stdout:1/427: mknod db/d19/d5a/d66/d7a/c98 0 2024-09-13T17:05:48.178 INFO:tasks.workunit.client.1.smithi195.stdout:2/441: mknod d0/d4a/d47/d73/d75/d88/d2c/d43/c8b 0 2024-09-13T17:05:48.179 INFO:tasks.workunit.client.1.smithi195.stdout:4/479: dwrite d1a/d1f/d21/d84/d9d/f2a [0,4194304] 0 2024-09-13T17:05:48.180 INFO:tasks.workunit.client.0.smithi115.stdout:0/246: dwrite d9/d1d/f39 [0,4194304] 0 2024-09-13T17:05:48.182 INFO:tasks.workunit.client.0.smithi115.stdout:0/247: mkdir d9/d1d/d24/d26/d2d/d30/d46 0 2024-09-13T17:05:48.185 INFO:tasks.workunit.client.1.smithi195.stdout:9/441: creat d6/df/d72/f92 x:0 0 0 2024-09-13T17:05:48.185 INFO:tasks.workunit.client.1.smithi195.stdout:7/480: mknod d5/d35/ca2 0 2024-09-13T17:05:48.186 INFO:tasks.workunit.client.1.smithi195.stdout:1/428: unlink db/df/d4d/f4f 0 2024-09-13T17:05:48.188 INFO:tasks.workunit.client.1.smithi195.stdout:2/442: creat d0/d4a/d47/d73/d75/d88/d2c/d43/d84/f8c x:0 0 0 2024-09-13T17:05:48.188 INFO:tasks.workunit.client.1.smithi195.stdout:5/417: dwrite d2/df/f1a [4194304,4194304] 0 2024-09-13T17:05:48.189 INFO:tasks.workunit.client.1.smithi195.stdout:8/440: dwrite d0/fc [0,4194304] 0 2024-09-13T17:05:48.189 INFO:tasks.workunit.client.1.smithi195.stdout:8/441: write d0/d17/d2f/d31/f87 [622012,7840] 0 2024-09-13T17:05:48.189 INFO:tasks.workunit.client.1.smithi195.stdout:8/442: creat d0/d62/f98 x:0 0 0 2024-09-13T17:05:48.190 INFO:tasks.workunit.client.1.smithi195.stdout:3/412: dwrite d7/d21/d2a/d4a/f6e [0,4194304] 0 2024-09-13T17:05:48.190 INFO:tasks.workunit.client.1.smithi195.stdout:4/480: symlink d1a/l9e 0 2024-09-13T17:05:48.190 INFO:tasks.workunit.client.0.smithi115.stdout:2/521: dwrite d3/d4d/d13/d39/f5d [0,4194304] 0 2024-09-13T17:05:48.190 INFO:tasks.workunit.client.0.smithi115.stdout:2/522: creat d3/d4d/dd/fa3 x:0 0 0 2024-09-13T17:05:48.190 INFO:tasks.workunit.client.0.smithi115.stdout:3/519: dwrite d1/d12/d23/f59 [0,4194304] 0 2024-09-13T17:05:48.191 INFO:tasks.workunit.client.1.smithi195.stdout:9/442: symlink d6/d12/d86/l93 0 2024-09-13T17:05:48.191 INFO:tasks.workunit.client.1.smithi195.stdout:4/481: dread d1a/d1f/d43/d24/f7d [0,4194304] 0 2024-09-13T17:05:48.192 INFO:tasks.workunit.client.1.smithi195.stdout:4/482: readlink d1a/d1f/d21/d22/l69 0 2024-09-13T17:05:48.192 INFO:tasks.workunit.client.1.smithi195.stdout:4/483: getdents d1a/d1f/d43/d5a/d63 0 2024-09-13T17:05:48.193 INFO:tasks.workunit.client.1.smithi195.stdout:2/443: creat d0/d4a/d47/d73/d75/d88/d2c/f8d x:0 0 0 2024-09-13T17:05:48.195 INFO:tasks.workunit.client.0.smithi115.stdout:0/248: dread d9/f1f [0,4194304] 0 2024-09-13T17:05:48.201 INFO:tasks.workunit.client.1.smithi195.stdout:9/443: dread d6/d19/d21/d64/d68/d6d/f7e [0,4194304] 0 2024-09-13T17:05:48.201 INFO:tasks.workunit.client.1.smithi195.stdout:9/444: write d6/df/d16/f88 [1025878,69396] 0 2024-09-13T17:05:48.203 INFO:tasks.workunit.client.0.smithi115.stdout:2/523: mkdir d3/d4d/de/d3a/d47/da4 0 2024-09-13T17:05:48.203 INFO:tasks.workunit.client.1.smithi195.stdout:3/413: creat d7/d21/d2a/d4a/f7a x:0 0 0 2024-09-13T17:05:48.203 INFO:tasks.workunit.client.1.smithi195.stdout:3/414: fsync d7/d21/d2a/f3b 0 2024-09-13T17:05:48.203 INFO:tasks.workunit.client.0.smithi115.stdout:3/520: dread d1/d12/f45 [0,4194304] 0 2024-09-13T17:05:48.204 INFO:tasks.workunit.client.1.smithi195.stdout:4/484: mkdir d1a/d1f/d21/d84/d9d/d8e/d9f 0 2024-09-13T17:05:48.205 INFO:tasks.workunit.client.1.smithi195.stdout:8/443: dread d0/d13/f88 [0,4194304] 0 2024-09-13T17:05:48.205 INFO:tasks.workunit.client.1.smithi195.stdout:8/444: truncate d0/f8 9129874 0 2024-09-13T17:05:48.205 INFO:tasks.workunit.client.0.smithi115.stdout:0/249: creat d9/d1d/d24/d26/d2d/d30/f47 x:0 0 0 2024-09-13T17:05:48.206 INFO:tasks.workunit.client.1.smithi195.stdout:2/444: mkdir d0/d4a/d47/d73/d75/d88/d8e 0 2024-09-13T17:05:48.207 INFO:tasks.workunit.client.0.smithi115.stdout:2/524: creat d3/fa5 x:0 0 0 2024-09-13T17:05:48.207 INFO:tasks.workunit.client.0.smithi115.stdout:2/525: truncate d3/d4d/d13/f51 1068511 0 2024-09-13T17:05:48.208 INFO:tasks.workunit.client.1.smithi195.stdout:7/481: dwrite d5/db/d19/d22/f5b [0,4194304] 0 2024-09-13T17:05:48.208 INFO:tasks.workunit.client.1.smithi195.stdout:9/445: symlink d6/d19/l94 0 2024-09-13T17:05:48.208 INFO:tasks.workunit.client.1.smithi195.stdout:9/446: fdatasync d6/df/d13/d44/d47/d61/f73 0 2024-09-13T17:05:48.210 INFO:tasks.workunit.client.0.smithi115.stdout:3/521: truncate d1/d4b/d1a/f9b 204675 0 2024-09-13T17:05:48.210 INFO:tasks.workunit.client.0.smithi115.stdout:3/522: getdents d1/d4b/d69/d7b/da0 0 2024-09-13T17:05:48.210 INFO:tasks.workunit.client.0.smithi115.stdout:3/523: chown d1/da4 9445 1 2024-09-13T17:05:48.212 INFO:tasks.workunit.client.0.smithi115.stdout:0/250: unlink d9/d1d/d24/f31 0 2024-09-13T17:05:48.215 INFO:tasks.workunit.client.1.smithi195.stdout:4/485: creat d1a/d1f/d21/d84/d9d/d58/d91/fa0 x:0 0 0 2024-09-13T17:05:48.215 INFO:tasks.workunit.client.1.smithi195.stdout:4/486: dread - d1a/d1f/d43/d5a/f90 zero size 2024-09-13T17:05:48.215 INFO:tasks.workunit.client.1.smithi195.stdout:4/487: creat d1a/d1f/d21/d84/d9d/d58/d91/fa1 x:0 0 0 2024-09-13T17:05:48.217 INFO:tasks.workunit.client.1.smithi195.stdout:8/445: symlink d0/d13/d52/l99 0 2024-09-13T17:05:48.217 INFO:tasks.workunit.client.1.smithi195.stdout:8/446: fsync d0/f89 0 2024-09-13T17:05:48.218 INFO:tasks.workunit.client.1.smithi195.stdout:2/445: rmdir d0/d4a/d47/d73/d75/d7e 39 2024-09-13T17:05:48.220 INFO:tasks.workunit.client.1.smithi195.stdout:7/482: mkdir d5/db/d19/da3 0 2024-09-13T17:05:48.222 INFO:tasks.workunit.client.1.smithi195.stdout:9/447: symlink d6/df/d13/d44/d5e/l95 0 2024-09-13T17:05:48.222 INFO:tasks.workunit.client.1.smithi195.stdout:9/448: write d6/d12/f2b [2281350,66496] 0 2024-09-13T17:05:48.224 INFO:tasks.workunit.client.1.smithi195.stdout:4/488: dread fa [0,4194304] 0 2024-09-13T17:05:48.225 INFO:tasks.workunit.client.1.smithi195.stdout:3/415: rename d7/l17 to d7/d21/d2a/d35/d60/l7b 0 2024-09-13T17:05:48.225 INFO:tasks.workunit.client.1.smithi195.stdout:3/416: read - d7/d21/f4f zero size 2024-09-13T17:05:48.225 INFO:tasks.workunit.client.0.smithi115.stdout:2/526: dwrite d3/d4d/dd/df/d5c/f71 [0,4194304] 0 2024-09-13T17:05:48.226 INFO:tasks.workunit.client.0.smithi115.stdout:0/251: getdents d9/d1d 0 2024-09-13T17:05:48.226 INFO:tasks.workunit.client.0.smithi115.stdout:0/252: fsync d9/f2b 0 2024-09-13T17:05:48.228 INFO:tasks.workunit.client.0.smithi115.stdout:4/376: sync 2024-09-13T17:05:48.229 INFO:tasks.workunit.client.1.smithi195.stdout:8/447: mkdir d0/d17/d2f/d7c/d4c/d9a 0 2024-09-13T17:05:48.229 INFO:tasks.workunit.client.1.smithi195.stdout:8/448: chown d0/d62 30034 1 2024-09-13T17:05:48.229 INFO:tasks.workunit.client.1.smithi195.stdout:8/449: dread - d0/f89 zero size 2024-09-13T17:05:48.230 INFO:tasks.workunit.client.0.smithi115.stdout:3/524: dwrite d1/d4b/d1a/d30/f37 [0,4194304] 0 2024-09-13T17:05:48.231 INFO:tasks.workunit.client.0.smithi115.stdout:3/525: chown d1/d12/l97 52680 1 2024-09-13T17:05:48.232 INFO:tasks.workunit.client.0.smithi115.stdout:2/527: mkdir d3/d4d/dd/d1f/d2f/da6 0 2024-09-13T17:05:48.241 INFO:tasks.workunit.client.1.smithi195.stdout:3/417: dwrite f5 [0,4194304] 0 2024-09-13T17:05:48.242 INFO:tasks.workunit.client.0.smithi115.stdout:3/526: symlink d1/d4b/d69/d7b/lb5 0 2024-09-13T17:05:48.242 INFO:tasks.workunit.client.0.smithi115.stdout:3/527: read - d1/d4b/d1a/d30/fa7 zero size 2024-09-13T17:05:48.243 INFO:tasks.workunit.client.1.smithi195.stdout:9/449: unlink d6/d12/d39/f42 0 2024-09-13T17:05:48.243 INFO:tasks.workunit.client.0.smithi115.stdout:2/528: getdents d3/d4d/d13/d39/d87 0 2024-09-13T17:05:48.243 INFO:tasks.workunit.client.0.smithi115.stdout:2/529: chown d3/d4d/de 12015 1 2024-09-13T17:05:48.244 INFO:tasks.workunit.client.0.smithi115.stdout:4/377: dread d7/dd/f3b [0,4194304] 0 2024-09-13T17:05:48.245 INFO:tasks.workunit.client.1.smithi195.stdout:4/489: creat d1a/d1f/d21/d84/d9d/d58/fa2 x:0 0 0 2024-09-13T17:05:48.246 INFO:tasks.workunit.client.0.smithi115.stdout:0/253: truncate d9/d1d/f39 1577284 0 2024-09-13T17:05:48.248 INFO:tasks.workunit.client.1.smithi195.stdout:8/450: mkdir d0/d17/d2f/d7c/d4c/d9b 0 2024-09-13T17:05:48.249 INFO:tasks.workunit.client.0.smithi115.stdout:3/528: mkdir d1/d4b/d69/db6 0 2024-09-13T17:05:48.250 INFO:tasks.workunit.client.0.smithi115.stdout:0/254: write d9/d1b/f21 [112490,58800] 0 2024-09-13T17:05:48.250 INFO:tasks.workunit.client.1.smithi195.stdout:2/446: getdents d0/d4a 0 2024-09-13T17:05:48.252 INFO:tasks.workunit.client.0.smithi115.stdout:2/530: symlink d3/d4d/d13/d39/d46/d70/la7 0 2024-09-13T17:05:48.256 INFO:tasks.workunit.client.0.smithi115.stdout:3/529: unlink d1/d4b/d69/f6a 0 2024-09-13T17:05:48.256 INFO:tasks.workunit.client.0.smithi115.stdout:3/530: dread - d1/d4b/d1a/d30/f82 zero size 2024-09-13T17:05:48.257 INFO:tasks.workunit.client.1.smithi195.stdout:0/413: sync 2024-09-13T17:05:48.257 INFO:tasks.workunit.client.1.smithi195.stdout:0/414: stat d7/d8/d23/l28 0 2024-09-13T17:05:48.257 INFO:tasks.workunit.client.1.smithi195.stdout:0/415: chown d7/d50/c55 974 1 2024-09-13T17:05:48.257 INFO:tasks.workunit.client.1.smithi195.stdout:0/416: creat d7/d8/d23/d4b/d56/d4d/d5e/f85 x:0 0 0 2024-09-13T17:05:48.257 INFO:tasks.workunit.client.1.smithi195.stdout:0/417: write d7/d8/d23/d4b/d56/d4d/d5e/f85 [709933,76167] 0 2024-09-13T17:05:48.258 INFO:tasks.workunit.client.0.smithi115.stdout:2/531: symlink d3/d4d/d13/d62/d92/la8 0 2024-09-13T17:05:48.259 INFO:tasks.workunit.client.1.smithi195.stdout:3/418: symlink d7/d62/d70/l7c 0 2024-09-13T17:05:48.260 INFO:tasks.workunit.client.1.smithi195.stdout:3/419: write d7/d21/f59 [374659,116396] 0 2024-09-13T17:05:48.260 INFO:tasks.workunit.client.1.smithi195.stdout:3/420: dread - d7/d21/f73 zero size 2024-09-13T17:05:48.260 INFO:tasks.workunit.client.1.smithi195.stdout:3/421: creat d7/d21/d2a/d35/d60/d64/f7d x:0 0 0 2024-09-13T17:05:48.260 INFO:tasks.workunit.client.0.smithi115.stdout:4/378: dwrite d7/dd/f4d [0,4194304] 0 2024-09-13T17:05:48.260 INFO:tasks.workunit.client.0.smithi115.stdout:4/379: read f5 [349975,115479] 0 2024-09-13T17:05:48.264 INFO:tasks.workunit.client.1.smithi195.stdout:9/450: creat d6/d12/d86/f96 x:0 0 0 2024-09-13T17:05:48.264 INFO:tasks.workunit.client.1.smithi195.stdout:9/451: chown d6/f1e 594252521 1 2024-09-13T17:05:48.267 INFO:tasks.workunit.client.1.smithi195.stdout:4/490: mkdir d1a/d1f/d21/d22/d98/da3 0 2024-09-13T17:05:48.268 INFO:tasks.workunit.client.1.smithi195.stdout:4/491: read d1a/d1f/d43/d24/f3e [160146,29863] 0 2024-09-13T17:05:48.270 INFO:tasks.workunit.client.1.smithi195.stdout:8/451: creat d0/d17/d49/d63/d71/f9c x:0 0 0 2024-09-13T17:05:48.270 INFO:tasks.workunit.client.1.smithi195.stdout:8/452: write d0/d4/f77 [400144,60064] 0 2024-09-13T17:05:48.270 INFO:tasks.workunit.client.1.smithi195.stdout:8/453: readlink d0/d17/l3c 0 2024-09-13T17:05:48.272 INFO:tasks.workunit.client.0.smithi115.stdout:4/380: symlink d7/dd/de/d57/l6d 0 2024-09-13T17:05:48.274 INFO:tasks.workunit.client.1.smithi195.stdout:0/418: mkdir d7/d8/d23/d4b/d4e/d86 0 2024-09-13T17:05:48.275 INFO:tasks.workunit.client.0.smithi115.stdout:2/532: getdents d3/d4d/dd/d1f/d2f/d56 0 2024-09-13T17:05:48.277 INFO:tasks.workunit.client.0.smithi115.stdout:4/381: creat d7/dd/d3c/f6e x:0 0 0 2024-09-13T17:05:48.278 INFO:tasks.workunit.client.1.smithi195.stdout:9/452: symlink d6/d19/d21/l97 0 2024-09-13T17:05:48.279 INFO:tasks.workunit.client.1.smithi195.stdout:4/492: unlink d1a/d1f/d21/d36/l61 0 2024-09-13T17:05:48.279 INFO:tasks.workunit.client.1.smithi195.stdout:4/493: read - d1a/d1f/d21/d36/f55 zero size 2024-09-13T17:05:48.279 INFO:tasks.workunit.client.1.smithi195.stdout:9/453: dread d6/d19/d21/d45/f5a [0,4194304] 0 2024-09-13T17:05:48.280 INFO:tasks.workunit.client.0.smithi115.stdout:4/382: unlink d7/dd/de/f23 0 2024-09-13T17:05:48.282 INFO:tasks.workunit.client.1.smithi195.stdout:8/454: mkdir d0/d17/d2f/d7c/d4c/d67/d9d 0 2024-09-13T17:05:48.282 INFO:tasks.workunit.client.0.smithi115.stdout:0/255: dwrite d9/d1d/d24/f25 [0,4194304] 0 2024-09-13T17:05:48.284 INFO:tasks.workunit.client.0.smithi115.stdout:4/383: link d7/dd/de/d4e/f62 d7/dd/de/d4e/f6f 0 2024-09-13T17:05:48.284 INFO:tasks.workunit.client.0.smithi115.stdout:3/531: dwrite d1/d4b/d69/f80 [0,4194304] 0 2024-09-13T17:05:48.285 INFO:tasks.workunit.client.1.smithi195.stdout:2/447: dwrite d0/f6c [0,4194304] 0 2024-09-13T17:05:48.285 INFO:tasks.workunit.client.1.smithi195.stdout:3/422: dwrite d7/f61 [0,4194304] 0 2024-09-13T17:05:48.287 INFO:tasks.workunit.client.1.smithi195.stdout:0/419: mkdir d7/d87 0 2024-09-13T17:05:48.288 INFO:tasks.workunit.client.0.smithi115.stdout:2/533: dread d3/d4d/de/f37 [0,4194304] 0 2024-09-13T17:05:48.288 INFO:tasks.workunit.client.0.smithi115.stdout:2/534: chown d3/d4d/de/d3a/d47/f49 0 1 2024-09-13T17:05:48.289 INFO:tasks.workunit.client.1.smithi195.stdout:2/448: read d0/d4a/d47/d73/d75/d88/d2c/d43/f64 [2400746,82704] 0 2024-09-13T17:05:48.289 INFO:tasks.workunit.client.0.smithi115.stdout:0/256: mkdir d9/d1d/d24/d26/d36/d48 0 2024-09-13T17:05:48.290 INFO:tasks.workunit.client.1.smithi195.stdout:9/454: mknod d6/d19/d21/c98 0 2024-09-13T17:05:48.291 INFO:tasks.workunit.client.0.smithi115.stdout:4/384: mkdir d7/dd/de/d4e/d5a/d4f/d70 0 2024-09-13T17:05:48.294 INFO:tasks.workunit.client.1.smithi195.stdout:8/455: unlink d0/d17/d2f/l59 0 2024-09-13T17:05:48.294 INFO:tasks.workunit.client.1.smithi195.stdout:8/456: creat d0/d17/f9e x:0 0 0 2024-09-13T17:05:48.294 INFO:tasks.workunit.client.1.smithi195.stdout:8/457: read - d0/f61 zero size 2024-09-13T17:05:48.294 INFO:tasks.workunit.client.1.smithi195.stdout:9/455: write d6/d12/d39/f3d [4433191,96564] 0 2024-09-13T17:05:48.303 INFO:tasks.workunit.client.1.smithi195.stdout:2/449: mknod d0/d4a/d47/d73/d75/d88/c8f 0 2024-09-13T17:05:48.303 INFO:tasks.workunit.client.1.smithi195.stdout:2/450: fsync d0/d4a/d47/d73/f7c 0 2024-09-13T17:05:48.304 INFO:tasks.workunit.client.0.smithi115.stdout:4/385: dread d7/dd/d63/f6a [0,4194304] 0 2024-09-13T17:05:48.304 INFO:tasks.workunit.client.0.smithi115.stdout:4/386: rename d7/dd/de to d7/dd/de/d4e/d71 22 2024-09-13T17:05:48.308 INFO:tasks.workunit.client.1.smithi195.stdout:4/494: dwrite f11 [4194304,4194304] 0 2024-09-13T17:05:48.309 INFO:tasks.workunit.client.0.smithi115.stdout:3/532: symlink d1/d83/lb7 0 2024-09-13T17:05:48.310 INFO:tasks.workunit.client.1.smithi195.stdout:6/419: sync 2024-09-13T17:05:48.311 INFO:tasks.workunit.client.1.smithi195.stdout:8/458: rename d0/c29 to d0/d17/d49/d63/d71/c9f 0 2024-09-13T17:05:48.312 INFO:tasks.workunit.client.0.smithi115.stdout:2/535: rmdir d3/d4d/d13/d1c 39 2024-09-13T17:05:48.312 INFO:tasks.workunit.client.0.smithi115.stdout:2/536: fdatasync d3/d4d/dd/d1f/f9d 0 2024-09-13T17:05:48.314 INFO:tasks.workunit.client.0.smithi115.stdout:2/537: dread d3/d4d/d13/f45 [0,4194304] 0 2024-09-13T17:05:48.316 INFO:tasks.workunit.client.0.smithi115.stdout:0/257: link d9/d1d/d24/f25 d9/d1d/d24/d26/d2d/d30/d46/f49 0 2024-09-13T17:05:48.316 INFO:tasks.workunit.client.1.smithi195.stdout:9/456: rmdir d6 39 2024-09-13T17:05:48.317 INFO:tasks.workunit.client.1.smithi195.stdout:2/451: getdents d0/d4a/d47/d73/d75/d88/d2c/d51 0 2024-09-13T17:05:48.318 INFO:tasks.workunit.client.1.smithi195.stdout:2/452: write d0/d3/df/f35 [1105490,113334] 0 2024-09-13T17:05:48.318 INFO:tasks.workunit.client.0.smithi115.stdout:3/533: mknod d1/d4b/d69/db6/cb8 0 2024-09-13T17:05:48.318 INFO:tasks.workunit.client.0.smithi115.stdout:3/534: truncate d1/d4b/f86 963341 0 2024-09-13T17:05:48.319 INFO:tasks.workunit.client.1.smithi195.stdout:2/453: write d0/d4a/d47/d73/d75/d88/d1e/f65 [489923,99376] 0 2024-09-13T17:05:48.323 INFO:tasks.workunit.client.0.smithi115.stdout:2/538: link d3/d4d/d13/d1c/l3d d3/d4d/d13/d62/la9 0 2024-09-13T17:05:48.323 INFO:tasks.workunit.client.0.smithi115.stdout:2/539: chown d3/d4d/de 379978760 1 2024-09-13T17:05:48.324 INFO:tasks.workunit.client.1.smithi195.stdout:0/420: dwrite d7/db/d11/f61 [0,4194304] 0 2024-09-13T17:05:48.324 INFO:tasks.workunit.client.1.smithi195.stdout:3/423: dwrite d7/d19/d1e/f50 [0,4194304] 0 2024-09-13T17:05:48.324 INFO:tasks.workunit.client.1.smithi195.stdout:3/424: readlink d7/d21/l4e 0 2024-09-13T17:05:48.330 INFO:tasks.workunit.client.1.smithi195.stdout:6/420: mkdir d1c/d2d/d8c 0 2024-09-13T17:05:48.331 INFO:tasks.workunit.client.1.smithi195.stdout:4/495: dwrite d1a/d1f/d43/d24/d41/f8d [0,4194304] 0 2024-09-13T17:05:48.331 INFO:tasks.workunit.client.0.smithi115.stdout:3/535: rmdir d1/d4b/d1a/d30 39 2024-09-13T17:05:48.332 INFO:tasks.workunit.client.0.smithi115.stdout:0/258: read d9/f16 [714392,66071] 0 2024-09-13T17:05:48.332 INFO:tasks.workunit.client.0.smithi115.stdout:4/387: dwrite d7/dd/de/f59 [0,4194304] 0 2024-09-13T17:05:48.333 INFO:tasks.workunit.client.1.smithi195.stdout:8/459: rename d0/d13/f57 to d0/d17/d2f/d7c/d4c/fa0 0 2024-09-13T17:05:48.338 INFO:tasks.workunit.client.0.smithi115.stdout:0/259: mknod d9/d27/c4a 0 2024-09-13T17:05:48.347 INFO:tasks.workunit.client.0.smithi115.stdout:2/540: dwrite d3/d4d/de/f43 [4194304,4194304] 0 2024-09-13T17:05:48.348 INFO:tasks.workunit.client.0.smithi115.stdout:4/388: mkdir d7/dd/d3c/d72 0 2024-09-13T17:05:48.351 INFO:tasks.workunit.client.0.smithi115.stdout:2/541: chown d3/f40 1459991 1 2024-09-13T17:05:48.352 INFO:tasks.workunit.client.0.smithi115.stdout:3/536: dwrite d1/d4b/f86 [0,4194304] 0 2024-09-13T17:05:48.352 INFO:tasks.workunit.client.0.smithi115.stdout:3/537: fsync d1/d4b/d1a/d30/f37 0 2024-09-13T17:05:48.354 INFO:tasks.workunit.client.1.smithi195.stdout:3/425: mkdir d7/d21/d66/d7e 0 2024-09-13T17:05:48.355 INFO:tasks.workunit.client.0.smithi115.stdout:2/542: getdents d3/d4d/d13/d77 0 2024-09-13T17:05:48.355 INFO:tasks.workunit.client.0.smithi115.stdout:2/543: readlink d3/d4d/d13/d62/l8e 0 2024-09-13T17:05:48.355 INFO:tasks.workunit.client.0.smithi115.stdout:2/544: fdatasync d3/d4d/dd/df/d5b/f83 0 2024-09-13T17:05:48.356 INFO:tasks.workunit.client.0.smithi115.stdout:2/545: readlink d3/d4d/d13/d1c/l76 0 2024-09-13T17:05:48.356 INFO:tasks.workunit.client.0.smithi115.stdout:2/546: chown d3/d4d/dd/d1f/d2f/d56/d58 2 1 2024-09-13T17:05:48.356 INFO:tasks.workunit.client.0.smithi115.stdout:2/547: chown d3/d4d/dd/d1f/d2f/d56/l53 130 1 2024-09-13T17:05:48.356 INFO:tasks.workunit.client.1.smithi195.stdout:6/421: truncate f14 40745 0 2024-09-13T17:05:48.362 INFO:tasks.workunit.client.0.smithi115.stdout:3/538: symlink d1/d4b/d1a/d30/lb9 0 2024-09-13T17:05:48.365 INFO:tasks.workunit.client.1.smithi195.stdout:9/457: dwrite d6/d12/d39/f3d [4194304,4194304] 0 2024-09-13T17:05:48.365 INFO:tasks.workunit.client.1.smithi195.stdout:9/458: truncate d6/df/d72/f92 993665 0 2024-09-13T17:05:48.365 INFO:tasks.workunit.client.1.smithi195.stdout:2/454: rename d0/d3/l5d to d0/d4a/d47/d73/d75/d88/d2c/d51/l90 0 2024-09-13T17:05:48.365 INFO:tasks.workunit.client.0.smithi115.stdout:0/260: dwrite f0 [4194304,4194304] 0 2024-09-13T17:05:48.366 INFO:tasks.workunit.client.1.smithi195.stdout:4/496: dwrite d1a/d1f/d43/d24/f25 [0,4194304] 0 2024-09-13T17:05:48.367 INFO:tasks.workunit.client.0.smithi115.stdout:4/389: mknod d7/dd/de/d4e/d5a/d4f/d53/c73 0 2024-09-13T17:05:48.367 INFO:tasks.workunit.client.1.smithi195.stdout:1/429: sync 2024-09-13T17:05:48.367 INFO:tasks.workunit.client.1.smithi195.stdout:1/430: chown db/d60/c75 38939719 1 2024-09-13T17:05:48.370 INFO:tasks.workunit.client.0.smithi115.stdout:2/548: creat d3/d4d/dd/d1f/d2f/d7d/faa x:0 0 0 2024-09-13T17:05:48.374 INFO:tasks.workunit.client.0.smithi115.stdout:3/539: mkdir d1/d83/d9d/dba 0 2024-09-13T17:05:48.376 INFO:tasks.workunit.client.1.smithi195.stdout:1/431: dread db/d19/d37/f8a [0,4194304] 0 2024-09-13T17:05:48.378 INFO:tasks.workunit.client.1.smithi195.stdout:6/422: dwrite d1c/d24/f38 [0,4194304] 0 2024-09-13T17:05:48.379 INFO:tasks.workunit.client.0.smithi115.stdout:3/540: unlink d1/d4b/l7a 0 2024-09-13T17:05:48.379 INFO:tasks.workunit.client.1.smithi195.stdout:6/423: read d1c/d2d/d30/d6f/f7e [294361,62814] 0 2024-09-13T17:05:48.380 INFO:tasks.workunit.client.1.smithi195.stdout:6/424: chown f1a 46 1 2024-09-13T17:05:48.382 INFO:tasks.workunit.client.0.smithi115.stdout:4/390: mkdir d7/dd/d3c/d74 0 2024-09-13T17:05:48.383 INFO:tasks.workunit.client.1.smithi195.stdout:5/418: sync 2024-09-13T17:05:48.383 INFO:tasks.workunit.client.1.smithi195.stdout:7/483: sync 2024-09-13T17:05:48.383 INFO:tasks.workunit.client.1.smithi195.stdout:5/419: fsync d2/df/d78/d54/f73 0 2024-09-13T17:05:48.383 INFO:tasks.workunit.client.1.smithi195.stdout:7/484: write d5/d13/d24/f51 [820739,82773] 0 2024-09-13T17:05:48.383 INFO:tasks.workunit.client.1.smithi195.stdout:7/485: dread - d5/d13/d24/f9a zero size 2024-09-13T17:05:48.384 INFO:tasks.workunit.client.0.smithi115.stdout:2/549: dread d3/d4d/de/f59 [0,4194304] 0 2024-09-13T17:05:48.384 INFO:tasks.workunit.client.1.smithi195.stdout:7/486: read d5/d13/d30/f83 [571366,69218] 0 2024-09-13T17:05:48.384 INFO:tasks.workunit.client.1.smithi195.stdout:1/432: dread db/df/d13/f2e [0,4194304] 0 2024-09-13T17:05:48.385 INFO:tasks.workunit.client.1.smithi195.stdout:1/433: fsync db/df/d51/f72 0 2024-09-13T17:05:48.385 INFO:tasks.workunit.client.1.smithi195.stdout:1/434: chown db/df/d13/f86 55644530 1 2024-09-13T17:05:48.385 INFO:tasks.workunit.client.1.smithi195.stdout:1/435: write db/f6b [870698,87650] 0 2024-09-13T17:05:48.387 INFO:tasks.workunit.client.1.smithi195.stdout:3/426: symlink d7/d21/d2a/d35/l7f 0 2024-09-13T17:05:48.388 INFO:tasks.workunit.client.1.smithi195.stdout:9/459: creat d6/d19/d21/d45/f99 x:0 0 0 2024-09-13T17:05:48.390 INFO:tasks.workunit.client.1.smithi195.stdout:4/497: dwrite d1a/f94 [0,4194304] 0 2024-09-13T17:05:48.390 INFO:tasks.workunit.client.1.smithi195.stdout:4/498: dread - d1a/d1f/d43/d5a/f90 zero size 2024-09-13T17:05:48.390 INFO:tasks.workunit.client.1.smithi195.stdout:4/499: readlink d1a/l44 0 2024-09-13T17:05:48.390 INFO:tasks.workunit.client.1.smithi195.stdout:4/500: chown d1a/d1f/d43/d24/c9a 23262309 1 2024-09-13T17:05:48.390 INFO:tasks.workunit.client.1.smithi195.stdout:4/501: read d1a/d1f/d21/d22/f3b [877996,20218] 0 2024-09-13T17:05:48.391 INFO:tasks.workunit.client.0.smithi115.stdout:7/245: sync 2024-09-13T17:05:48.391 INFO:tasks.workunit.client.0.smithi115.stdout:1/259: sync 2024-09-13T17:05:48.391 INFO:tasks.workunit.client.0.smithi115.stdout:9/196: sync 2024-09-13T17:05:48.392 INFO:tasks.workunit.client.0.smithi115.stdout:5/284: sync 2024-09-13T17:05:48.392 INFO:tasks.workunit.client.0.smithi115.stdout:9/197: readlink d0/d21/l23 0 2024-09-13T17:05:48.392 INFO:tasks.workunit.client.0.smithi115.stdout:6/266: sync 2024-09-13T17:05:48.392 INFO:tasks.workunit.client.0.smithi115.stdout:5/285: chown d19/f1a 141690 1 2024-09-13T17:05:48.392 INFO:tasks.workunit.client.0.smithi115.stdout:1/260: dread - d5/d7/d33/f42 zero size 2024-09-13T17:05:48.392 INFO:tasks.workunit.client.0.smithi115.stdout:6/267: creat d8/db/f52 x:0 0 0 2024-09-13T17:05:48.392 INFO:tasks.workunit.client.0.smithi115.stdout:6/268: stat d8/db/d1d/f18 0 2024-09-13T17:05:48.392 INFO:tasks.workunit.client.0.smithi115.stdout:8/300: sync 2024-09-13T17:05:48.392 INFO:tasks.workunit.client.0.smithi115.stdout:0/261: dwrite d9/d1b/f3a [0,4194304] 0 2024-09-13T17:05:48.393 INFO:tasks.workunit.client.1.smithi195.stdout:8/460: rename d0/d13/d52/d55/l78 to d0/d17/d2f/d7c/d4b/la1 0 2024-09-13T17:05:48.394 INFO:tasks.workunit.client.1.smithi195.stdout:8/461: stat d0/d17/d2f/d7c/c6e 0 2024-09-13T17:05:48.394 INFO:tasks.workunit.client.1.smithi195.stdout:8/462: chown d0/d17/d2f/d7c/c6e 9181949 1 2024-09-13T17:05:48.396 INFO:tasks.workunit.client.0.smithi115.stdout:7/246: mkdir d0/d59 0 2024-09-13T17:05:48.396 INFO:tasks.workunit.client.0.smithi115.stdout:7/247: chown d0/d3b/d54 5 1 2024-09-13T17:05:48.398 INFO:tasks.workunit.client.1.smithi195.stdout:3/427: write d7/d21/f27 [2421328,123251] 0 2024-09-13T17:05:48.400 INFO:tasks.workunit.client.0.smithi115.stdout:9/198: mknod d0/de/d10/c48 0 2024-09-13T17:05:48.402 INFO:tasks.workunit.client.0.smithi115.stdout:5/286: truncate d19/d21/f4a 2992582 0 2024-09-13T17:05:48.402 INFO:tasks.workunit.client.0.smithi115.stdout:5/287: rename d19 to d19/d2b/d32/d65 22 2024-09-13T17:05:48.402 INFO:tasks.workunit.client.0.smithi115.stdout:5/288: write d19/d2b/d32/d55/f4c [852581,124614] 0 2024-09-13T17:05:48.403 INFO:tasks.workunit.client.0.smithi115.stdout:5/289: write d19/d2b/f49 [4248363,56455] 0 2024-09-13T17:05:48.403 INFO:tasks.workunit.client.1.smithi195.stdout:6/425: creat d1c/d24/d7f/f8d x:0 0 0 2024-09-13T17:05:48.405 INFO:tasks.workunit.client.1.smithi195.stdout:5/420: rename d2/df/f1a to d2/df/f81 0 2024-09-13T17:05:48.407 INFO:tasks.workunit.client.1.smithi195.stdout:0/421: rename d7/d8 to d7/d88 0 2024-09-13T17:05:48.407 INFO:tasks.workunit.client.1.smithi195.stdout:0/422: write d7/d88/d23/d4b/d56/d4d/f66 [228709,107619] 0 2024-09-13T17:05:48.407 INFO:tasks.workunit.client.0.smithi115.stdout:3/541: dwrite d1/d12/d23/f62 [0,4194304] 0 2024-09-13T17:05:48.411 INFO:tasks.workunit.client.0.smithi115.stdout:8/301: mkdir d0/d21/d3a/d60 0 2024-09-13T17:05:48.413 INFO:tasks.workunit.client.0.smithi115.stdout:0/262: mknod d9/d1d/d24/d26/d36/c4b 0 2024-09-13T17:05:48.415 INFO:tasks.workunit.client.1.smithi195.stdout:4/502: link d1a/d1f/d43/c53 d1a/d1f/d21/d84/ca4 0 2024-09-13T17:05:48.415 INFO:tasks.workunit.client.0.smithi115.stdout:7/248: symlink d0/d3b/d50/l5a 0 2024-09-13T17:05:48.417 INFO:tasks.workunit.client.0.smithi115.stdout:1/261: mkdir d5/d7/d5c 0 2024-09-13T17:05:48.418 INFO:tasks.workunit.client.0.smithi115.stdout:9/199: creat d0/d34/f49 x:0 0 0 2024-09-13T17:05:48.421 INFO:tasks.workunit.client.1.smithi195.stdout:7/487: rename d5/l41 to d5/d13/d24/la4 0 2024-09-13T17:05:48.422 INFO:tasks.workunit.client.0.smithi115.stdout:5/290: unlink d19/d21/l27 0 2024-09-13T17:05:48.423 INFO:tasks.workunit.client.1.smithi195.stdout:8/463: symlink d0/d17/d2f/d7c/d4c/d67/d9d/la2 0 2024-09-13T17:05:48.423 INFO:tasks.workunit.client.1.smithi195.stdout:8/464: write d0/d17/d2f/d31/f3f [4980185,122422] 0 2024-09-13T17:05:48.424 INFO:tasks.workunit.client.1.smithi195.stdout:6/426: symlink d1c/d2d/l8e 0 2024-09-13T17:05:48.424 INFO:tasks.workunit.client.1.smithi195.stdout:6/427: chown f17 1 1 2024-09-13T17:05:48.426 INFO:tasks.workunit.client.1.smithi195.stdout:5/421: symlink d2/d12/d4e/l82 0 2024-09-13T17:05:48.426 INFO:tasks.workunit.client.0.smithi115.stdout:3/542: mkdir d1/d4b/d69/d7b/dbb 0 2024-09-13T17:05:48.427 INFO:tasks.workunit.client.1.smithi195.stdout:0/423: mknod d7/d88/d23/d4b/d56/d4d/d5e/c89 0 2024-09-13T17:05:48.428 INFO:tasks.workunit.client.0.smithi115.stdout:0/263: truncate d9/d1b/f23 482981 0 2024-09-13T17:05:48.428 INFO:tasks.workunit.client.1.smithi195.stdout:4/503: mknod d1a/d1f/d21/d36/ca5 0 2024-09-13T17:05:48.430 INFO:tasks.workunit.client.0.smithi115.stdout:7/249: creat d0/d3b/d50/d21/d2f/f5b x:0 0 0 2024-09-13T17:05:48.430 INFO:tasks.workunit.client.1.smithi195.stdout:4/504: dread f16 [0,4194304] 0 2024-09-13T17:05:48.430 INFO:tasks.workunit.client.1.smithi195.stdout:4/505: creat d1a/d1f/d43/d24/fa6 x:0 0 0 2024-09-13T17:05:48.430 INFO:tasks.workunit.client.1.smithi195.stdout:4/506: write d1a/d1f/f20 [1716331,61510] 0 2024-09-13T17:05:48.431 INFO:tasks.workunit.client.1.smithi195.stdout:4/507: chown d1a/d1f/d43/d5a/f90 6771365 1 2024-09-13T17:05:48.431 INFO:tasks.workunit.client.1.smithi195.stdout:3/428: rename d7/d19/l42 to d7/d21/d2a/d35/d60/d6f/l80 0 2024-09-13T17:05:48.433 INFO:tasks.workunit.client.0.smithi115.stdout:9/200: rmdir d0/de 39 2024-09-13T17:05:48.434 INFO:tasks.workunit.client.1.smithi195.stdout:8/465: link d0/d17/d2f/d31/f87 d0/d17/d2f/d7c/d4c/d67/fa3 0 2024-09-13T17:05:48.436 INFO:tasks.workunit.client.0.smithi115.stdout:5/291: link d19/c61 d19/d21/d3a/d5d/c66 0 2024-09-13T17:05:48.436 INFO:tasks.workunit.client.0.smithi115.stdout:6/269: dwrite d8/f25 [0,4194304] 0 2024-09-13T17:05:48.437 INFO:tasks.workunit.client.0.smithi115.stdout:8/302: dwrite d0/d26/d29/f38 [0,4194304] 0 2024-09-13T17:05:48.437 INFO:tasks.workunit.client.0.smithi115.stdout:8/303: stat d0/c12 0 2024-09-13T17:05:48.437 INFO:tasks.workunit.client.0.smithi115.stdout:8/304: creat d0/d15/d44/f61 x:0 0 0 2024-09-13T17:05:48.437 INFO:tasks.workunit.client.0.smithi115.stdout:8/305: chown d0/d15/c27 10 1 2024-09-13T17:05:48.438 INFO:tasks.workunit.client.1.smithi195.stdout:7/488: dread d5/db/d19/d22/f5d [0,4194304] 0 2024-09-13T17:05:48.438 INFO:tasks.workunit.client.1.smithi195.stdout:7/489: read - d5/d13/f9c zero size 2024-09-13T17:05:48.440 INFO:tasks.workunit.client.1.smithi195.stdout:9/460: dwrite d6/d19/f36 [0,4194304] 0 2024-09-13T17:05:48.440 INFO:tasks.workunit.client.1.smithi195.stdout:9/461: fsync d6/df/d16/d65/f75 0 2024-09-13T17:05:48.440 INFO:tasks.workunit.client.0.smithi115.stdout:2/550: dwrite d3/d4d/dd/d1f/d2f/d56/f9b [0,4194304] 0 2024-09-13T17:05:48.440 INFO:tasks.workunit.client.0.smithi115.stdout:0/264: rename f0 to d9/d1d/d24/d26/d36/d48/f4c 0 2024-09-13T17:05:48.441 INFO:tasks.workunit.client.1.smithi195.stdout:0/424: dread d7/db/d11/f1f [0,4194304] 0 2024-09-13T17:05:48.441 INFO:tasks.workunit.client.0.smithi115.stdout:4/391: dwrite d7/dd/d3c/f3e [0,4194304] 0 2024-09-13T17:05:48.442 INFO:tasks.workunit.client.0.smithi115.stdout:5/292: dread d19/f1e [0,4194304] 0 2024-09-13T17:05:48.442 INFO:tasks.workunit.client.0.smithi115.stdout:5/293: write d19/d1d/f26 [91055,78649] 0 2024-09-13T17:05:48.442 INFO:tasks.workunit.client.0.smithi115.stdout:5/294: chown d19/d2c 126 1 2024-09-13T17:05:48.442 INFO:tasks.workunit.client.1.smithi195.stdout:8/466: mknod d0/d17/d2f/d7c/d4c/d67/ca4 0 2024-09-13T17:05:48.443 INFO:tasks.workunit.client.0.smithi115.stdout:7/250: mknod d0/d2/c5c 0 2024-09-13T17:05:48.450 INFO:tasks.workunit.client.1.smithi195.stdout:0/425: dread d7/d88/d23/f35 [0,4194304] 0 2024-09-13T17:05:48.453 INFO:tasks.workunit.client.0.smithi115.stdout:3/543: dwrite d1/d4b/f86 [4194304,4194304] 0 2024-09-13T17:05:48.453 INFO:tasks.workunit.client.0.smithi115.stdout:3/544: fsync d1/d4b/d1a/f4e 0 2024-09-13T17:05:48.458 INFO:tasks.workunit.client.1.smithi195.stdout:9/462: creat d6/df/d13/d44/d47/f9a x:0 0 0 2024-09-13T17:05:48.460 INFO:tasks.workunit.client.1.smithi195.stdout:8/467: mkdir d0/d17/d2f/d7c/d4c/d9a/da5 0 2024-09-13T17:05:48.460 INFO:tasks.workunit.client.1.smithi195.stdout:8/468: write d0/d17/f56 [5152755,11068] 0 2024-09-13T17:05:48.461 INFO:tasks.workunit.client.1.smithi195.stdout:4/508: dwrite d1a/d1f/d21/f6a [0,4194304] 0 2024-09-13T17:05:48.461 INFO:tasks.workunit.client.1.smithi195.stdout:9/463: mknod d6/df/c9b 0 2024-09-13T17:05:48.461 INFO:tasks.workunit.client.1.smithi195.stdout:9/464: creat d6/df/d13/d44/d47/f9c x:0 0 0 2024-09-13T17:05:48.464 INFO:tasks.workunit.client.1.smithi195.stdout:0/426: write d7/db/d38/d5d/f7f [6710056,94939] 0 2024-09-13T17:05:48.465 INFO:tasks.workunit.client.1.smithi195.stdout:8/469: dread d0/d17/d49/f80 [0,4194304] 0 2024-09-13T17:05:48.467 INFO:tasks.workunit.client.0.smithi115.stdout:9/201: unlink d0/de/d10/f1b 0 2024-09-13T17:05:48.467 INFO:tasks.workunit.client.0.smithi115.stdout:9/202: chown d0/de/c3d 102390 1 2024-09-13T17:05:48.468 INFO:tasks.workunit.client.0.smithi115.stdout:9/203: dread d0/d21/f22 [0,4194304] 0 2024-09-13T17:05:48.468 INFO:tasks.workunit.client.0.smithi115.stdout:9/204: fdatasync d0/f3 0 2024-09-13T17:05:48.469 INFO:tasks.workunit.client.1.smithi195.stdout:4/509: rename f14 to d1a/d1f/d43/d24/d41/d60/d6f/fa7 0 2024-09-13T17:05:48.472 INFO:tasks.workunit.client.0.smithi115.stdout:6/270: mkdir d8/d13/d15/d24/d53 0 2024-09-13T17:05:48.478 INFO:tasks.workunit.client.1.smithi195.stdout:8/470: rename d0/d4/l81 to d0/d17/d2f/d7c/d4c/la6 0 2024-09-13T17:05:48.478 INFO:tasks.workunit.client.1.smithi195.stdout:8/471: readlink d0/d17/d2f/d31/l7a 0 2024-09-13T17:05:48.478 INFO:tasks.workunit.client.1.smithi195.stdout:7/490: dwrite d5/d13/d24/d70/f9f [0,4194304] 0 2024-09-13T17:05:48.478 INFO:tasks.workunit.client.0.smithi115.stdout:1/262: rmdir d5 39 2024-09-13T17:05:48.479 INFO:tasks.workunit.client.0.smithi115.stdout:5/295: dwrite d19/f1e [0,4194304] 0 2024-09-13T17:05:48.479 INFO:tasks.workunit.client.1.smithi195.stdout:9/465: dread d6/d19/f36 [0,4194304] 0 2024-09-13T17:05:48.479 INFO:tasks.workunit.client.1.smithi195.stdout:3/429: dwrite d7/d21/d2a/d35/f37 [0,4194304] 0 2024-09-13T17:05:48.482 INFO:tasks.workunit.client.1.smithi195.stdout:8/472: rmdir d0/d17/d2f/d7c/d4c/d67/d9d 39 2024-09-13T17:05:48.482 INFO:tasks.workunit.client.1.smithi195.stdout:8/473: fsync d0/d13/f5d 0 2024-09-13T17:05:48.482 INFO:tasks.workunit.client.1.smithi195.stdout:8/474: chown d0/d13/l26 14250689 1 2024-09-13T17:05:48.482 INFO:tasks.workunit.client.1.smithi195.stdout:0/427: write d7/d88/d23/f25 [2646221,955] 0 2024-09-13T17:05:48.483 INFO:tasks.workunit.client.0.smithi115.stdout:6/271: read d8/d33/d40/f30 [79497,10879] 0 2024-09-13T17:05:48.483 INFO:tasks.workunit.client.0.smithi115.stdout:6/272: write f5 [545138,113371] 0 2024-09-13T17:05:48.483 INFO:tasks.workunit.client.0.smithi115.stdout:8/306: symlink d0/d18/d19/d2b/l62 0 2024-09-13T17:05:48.483 INFO:tasks.workunit.client.0.smithi115.stdout:8/307: truncate d0/d15/d3e/f41 910224 0 2024-09-13T17:05:48.488 INFO:tasks.workunit.client.1.smithi195.stdout:4/510: dwrite f19 [0,4194304] 0 2024-09-13T17:05:48.488 INFO:tasks.workunit.client.1.smithi195.stdout:4/511: chown d1a/d1f/f20 0 1 2024-09-13T17:05:48.489 INFO:tasks.workunit.client.0.smithi115.stdout:2/551: rename d3/d4d/dd/d1f/c32 to d3/d4d/d13/d62/d66/cab 0 2024-09-13T17:05:48.489 INFO:tasks.workunit.client.0.smithi115.stdout:2/552: truncate d3/d4d/de/d3a/f6d 1120385 0 2024-09-13T17:05:48.489 INFO:tasks.workunit.client.0.smithi115.stdout:2/553: stat d3/d4d/d13/d39/d46/d70 0 2024-09-13T17:05:48.489 INFO:tasks.workunit.client.0.smithi115.stdout:2/554: chown d3/d4d 2128201 1 2024-09-13T17:05:48.489 INFO:tasks.workunit.client.0.smithi115.stdout:2/555: write d3/d4d/de/d3a/d47/f8d [949682,77935] 0 2024-09-13T17:05:48.489 INFO:tasks.workunit.client.0.smithi115.stdout:2/556: chown d3/d4d/d13/d39/d46/d70/la7 23 1 2024-09-13T17:05:48.489 INFO:tasks.workunit.client.0.smithi115.stdout:2/557: truncate d3/d4d/dd/df/f86 4416237 0 2024-09-13T17:05:48.490 INFO:tasks.workunit.client.1.smithi195.stdout:7/491: symlink d5/d13/d30/la5 0 2024-09-13T17:05:48.490 INFO:tasks.workunit.client.1.smithi195.stdout:7/492: readlink d5/d13/d24/la0 0 2024-09-13T17:05:48.491 INFO:tasks.workunit.client.1.smithi195.stdout:7/493: write d5/d13/f40 [547572,105321] 0 2024-09-13T17:05:48.491 INFO:tasks.workunit.client.1.smithi195.stdout:7/494: creat d5/db/d19/d22/d3c/fa6 x:0 0 0 2024-09-13T17:05:48.491 INFO:tasks.workunit.client.0.smithi115.stdout:0/265: creat d9/d1d/d24/d26/d36/d48/f4d x:0 0 0 2024-09-13T17:05:48.494 INFO:tasks.workunit.client.0.smithi115.stdout:1/263: dwrite d5/d26/f4d [0,4194304] 0 2024-09-13T17:05:48.495 INFO:tasks.workunit.client.0.smithi115.stdout:1/264: chown d5/f6 38 1 2024-09-13T17:05:48.495 INFO:tasks.workunit.client.0.smithi115.stdout:4/392: unlink d7/dd/de/d4e/d5a/d4f/l55 0 2024-09-13T17:05:48.500 INFO:tasks.workunit.client.1.smithi195.stdout:9/466: symlink d6/d19/l9d 0 2024-09-13T17:05:48.500 INFO:tasks.workunit.client.1.smithi195.stdout:9/467: creat d6/d19/d21/d64/d68/d6d/f9e x:0 0 0 2024-09-13T17:05:48.502 INFO:tasks.workunit.client.1.smithi195.stdout:3/430: creat d7/f81 x:0 0 0 2024-09-13T17:05:48.504 INFO:tasks.workunit.client.0.smithi115.stdout:2/558: dwrite d3/d4d/dd/df/f86 [0,4194304] 0 2024-09-13T17:05:48.504 INFO:tasks.workunit.client.0.smithi115.stdout:2/559: getdents d3/d4d/d13/d39/d46/da0 0 2024-09-13T17:05:48.506 INFO:tasks.workunit.client.1.smithi195.stdout:8/475: symlink d0/d17/d49/d63/la7 0 2024-09-13T17:05:48.508 INFO:tasks.workunit.client.1.smithi195.stdout:0/428: rename d7/d88/d23/d4b/d56/f58 to d7/d88/d23/d4b/d56/d46/f8a 0 2024-09-13T17:05:48.511 INFO:tasks.workunit.client.1.smithi195.stdout:8/476: dread d0/d4/f5e [0,4194304] 0 2024-09-13T17:05:48.511 INFO:tasks.workunit.client.1.smithi195.stdout:8/477: write d0/d17/d2f/d7c/f48 [157012,20157] 0 2024-09-13T17:05:48.515 INFO:tasks.workunit.client.0.smithi115.stdout:8/308: symlink d0/d15/l63 0 2024-09-13T17:05:48.518 INFO:tasks.workunit.client.0.smithi115.stdout:6/273: rename d8/db/f52 to d8/d13/d15/d24/d53/f54 0 2024-09-13T17:05:48.520 INFO:tasks.workunit.client.0.smithi115.stdout:0/266: truncate d9/d1d/f39 566100 0 2024-09-13T17:05:48.521 INFO:tasks.workunit.client.1.smithi195.stdout:7/495: mknod d5/d13/ca7 0 2024-09-13T17:05:48.525 INFO:tasks.workunit.client.0.smithi115.stdout:1/265: creat d5/d7/d5c/f5d x:0 0 0 2024-09-13T17:05:48.526 INFO:tasks.workunit.client.1.smithi195.stdout:9/468: creat d6/df/d13/d44/d47/d61/f9f x:0 0 0 2024-09-13T17:05:48.527 INFO:tasks.workunit.client.0.smithi115.stdout:4/393: symlink d7/dd/de/d4e/d6c/l75 0 2024-09-13T17:05:48.529 INFO:tasks.workunit.client.1.smithi195.stdout:3/431: truncate d7/f15 12185177 0 2024-09-13T17:05:48.532 INFO:tasks.workunit.client.0.smithi115.stdout:7/251: rmdir d0/d3b/d50/d21/d2f 39 2024-09-13T17:05:48.534 INFO:tasks.workunit.client.0.smithi115.stdout:3/545: rmdir d1/d4b/d69/d7b 39 2024-09-13T17:05:48.535 INFO:tasks.workunit.client.1.smithi195.stdout:8/478: dwrite d0/d13/f5d [8388608,4194304] 0 2024-09-13T17:05:48.535 INFO:tasks.workunit.client.1.smithi195.stdout:8/479: creat d0/fa8 x:0 0 0 2024-09-13T17:05:48.536 INFO:tasks.workunit.client.1.smithi195.stdout:0/429: creat d7/d88/d7c/f8b x:0 0 0 2024-09-13T17:05:48.539 INFO:tasks.workunit.client.0.smithi115.stdout:4/394: dread d7/f2e [4194304,4194304] 0 2024-09-13T17:05:48.541 INFO:tasks.workunit.client.1.smithi195.stdout:2/455: sync 2024-09-13T17:05:48.541 INFO:tasks.workunit.client.1.smithi195.stdout:2/456: creat d0/d4a/d47/d73/d75/d88/d2c/f91 x:0 0 0 2024-09-13T17:05:48.542 INFO:tasks.workunit.client.0.smithi115.stdout:2/560: mkdir d3/d4d/dd/d1f/d2f/d56/d58/dac 0 2024-09-13T17:05:48.543 INFO:tasks.workunit.client.0.smithi115.stdout:0/267: dwrite d9/d1d/d24/f25 [0,4194304] 0 2024-09-13T17:05:48.543 INFO:tasks.workunit.client.1.smithi195.stdout:4/512: rmdir d1a/d1f/d21/d84/d9d/d58 39 2024-09-13T17:05:48.543 INFO:tasks.workunit.client.1.smithi195.stdout:4/513: getdents d1a/d1f/d43/d5a/d63 0 2024-09-13T17:05:48.544 INFO:tasks.workunit.client.1.smithi195.stdout:4/514: chown d1a/d1f/d21/d22/f5b 53 1 2024-09-13T17:05:48.545 INFO:tasks.workunit.client.0.smithi115.stdout:8/309: creat d0/d18/d19/d2b/d37/f64 x:0 0 0 2024-09-13T17:05:48.545 INFO:tasks.workunit.client.0.smithi115.stdout:8/310: chown d0/fc 1 1 2024-09-13T17:05:48.550 INFO:tasks.workunit.client.1.smithi195.stdout:7/496: mkdir d5/d13/da8 0 2024-09-13T17:05:48.551 INFO:tasks.workunit.client.1.smithi195.stdout:7/497: dread - d5/db/d19/d22/f8e zero size 2024-09-13T17:05:48.551 INFO:tasks.workunit.client.1.smithi195.stdout:7/498: truncate d5/d35/f60 1651079 0 2024-09-13T17:05:48.551 INFO:tasks.workunit.client.1.smithi195.stdout:7/499: fdatasync d5/db/d50/f87 0 2024-09-13T17:05:48.552 INFO:tasks.workunit.client.1.smithi195.stdout:9/469: dwrite d6/d19/d21/d45/f5a [0,4194304] 0 2024-09-13T17:05:48.552 INFO:tasks.workunit.client.1.smithi195.stdout:9/470: fdatasync d6/df/d13/d44/d47/f9c 0 2024-09-13T17:05:48.552 INFO:tasks.workunit.client.1.smithi195.stdout:9/471: read d6/f7 [1727755,16619] 0 2024-09-13T17:05:48.554 INFO:tasks.workunit.client.0.smithi115.stdout:6/274: creat d8/d33/f55 x:0 0 0 2024-09-13T17:05:48.554 INFO:tasks.workunit.client.0.smithi115.stdout:6/275: chown d8/d33 2 1 2024-09-13T17:05:48.557 INFO:tasks.workunit.client.0.smithi115.stdout:1/266: unlink d5/d7/d33/f42 0 2024-09-13T17:05:48.558 INFO:tasks.workunit.client.1.smithi195.stdout:8/480: rmdir d0/d17/d2f/d7c/d4c/d9a 39 2024-09-13T17:05:48.558 INFO:tasks.workunit.client.0.smithi115.stdout:7/252: rmdir d0/d3b/d50/d21 39 2024-09-13T17:05:48.558 INFO:tasks.workunit.client.0.smithi115.stdout:7/253: chown d0/d3b/l4d 43615856 1 2024-09-13T17:05:48.559 INFO:tasks.workunit.client.0.smithi115.stdout:7/254: read d0/f1 [2535259,121233] 0 2024-09-13T17:05:48.559 INFO:tasks.workunit.client.1.smithi195.stdout:3/432: dwrite d7/d21/d2a/d4a/d5a/f63 [0,4194304] 0 2024-09-13T17:05:48.560 INFO:tasks.workunit.client.1.smithi195.stdout:0/430: unlink d7/db/d11/f1f 0 2024-09-13T17:05:48.560 INFO:tasks.workunit.client.1.smithi195.stdout:0/431: fsync d7/d88/d23/d4b/d56/d46/f8a 0 2024-09-13T17:05:48.561 INFO:tasks.workunit.client.0.smithi115.stdout:3/546: symlink d1/d4b/d69/d7b/da0/lbc 0 2024-09-13T17:05:48.561 INFO:tasks.workunit.client.0.smithi115.stdout:3/547: dread - d1/d4b/d1a/f4e zero size 2024-09-13T17:05:48.561 INFO:tasks.workunit.client.1.smithi195.stdout:1/436: sync 2024-09-13T17:05:48.564 INFO:tasks.workunit.client.0.smithi115.stdout:2/561: rename d3/d4d/dd/d1f/d2f/l4b to d3/d4d/d13/d62/lad 0 2024-09-13T17:05:48.567 INFO:tasks.workunit.client.0.smithi115.stdout:0/268: mknod d9/d1d/d24/d26/d2d/d30/d46/c4e 0 2024-09-13T17:05:48.568 INFO:tasks.workunit.client.1.smithi195.stdout:7/500: symlink d5/db/la9 0 2024-09-13T17:05:48.569 INFO:tasks.workunit.client.0.smithi115.stdout:6/276: getdents d8/d33/d40 0 2024-09-13T17:05:48.570 INFO:tasks.workunit.client.0.smithi115.stdout:1/267: dread d5/d26/f4a [0,4194304] 0 2024-09-13T17:05:48.570 INFO:tasks.workunit.client.0.smithi115.stdout:1/268: chown d5/fc 985 1 2024-09-13T17:05:48.572 INFO:tasks.workunit.client.0.smithi115.stdout:3/548: creat d1/d12/fbd x:0 0 0 2024-09-13T17:05:48.576 INFO:tasks.workunit.client.0.smithi115.stdout:8/311: dwrite d0/d21/f4a [0,4194304] 0 2024-09-13T17:05:48.577 INFO:tasks.workunit.client.0.smithi115.stdout:0/269: mknod d9/d1d/d24/d26/d2d/d30/d46/c4f 0 2024-09-13T17:05:48.577 INFO:tasks.workunit.client.0.smithi115.stdout:0/270: chown d9/d1d/d24/l3b 1790595 1 2024-09-13T17:05:48.577 INFO:tasks.workunit.client.1.smithi195.stdout:2/457: dwrite d0/d4a/d47/d73/d75/d88/d2c/d43/d84/f8c [0,4194304] 0 2024-09-13T17:05:48.578 INFO:tasks.workunit.client.1.smithi195.stdout:8/481: creat d0/d17/d2f/d6a/fa9 x:0 0 0 2024-09-13T17:05:48.579 INFO:tasks.workunit.client.0.smithi115.stdout:4/395: dwrite d7/dd/f25 [0,4194304] 0 2024-09-13T17:05:48.580 INFO:tasks.workunit.client.0.smithi115.stdout:1/269: creat d5/d7/d33/d48/f5e x:0 0 0 2024-09-13T17:05:48.581 INFO:tasks.workunit.client.0.smithi115.stdout:1/270: write d5/d7/f16 [444514,105752] 0 2024-09-13T17:05:48.586 INFO:tasks.workunit.client.0.smithi115.stdout:7/255: dwrite d0/d2/f8 [0,4194304] 0 2024-09-13T17:05:48.587 INFO:tasks.workunit.client.1.smithi195.stdout:3/433: creat d7/d5f/f82 x:0 0 0 2024-09-13T17:05:48.588 INFO:tasks.workunit.client.1.smithi195.stdout:6/428: sync 2024-09-13T17:05:48.589 INFO:tasks.workunit.client.1.smithi195.stdout:5/422: sync 2024-09-13T17:05:48.589 INFO:tasks.workunit.client.0.smithi115.stdout:8/312: rename d0/f1d to d0/d18/f65 0 2024-09-13T17:05:48.589 INFO:tasks.workunit.client.0.smithi115.stdout:8/313: readlink d0/d15/l63 0 2024-09-13T17:05:48.590 INFO:tasks.workunit.client.0.smithi115.stdout:1/271: dread d5/f22 [4194304,4194304] 0 2024-09-13T17:05:48.591 INFO:tasks.workunit.client.0.smithi115.stdout:0/271: dread d9/f17 [4194304,4194304] 0 2024-09-13T17:05:48.592 INFO:tasks.workunit.client.0.smithi115.stdout:0/272: truncate d9/d1d/d24/d26/d36/f3d 481348 0 2024-09-13T17:05:48.592 INFO:tasks.workunit.client.1.smithi195.stdout:0/432: getdents d7/d88/d23/d4b/d56 0 2024-09-13T17:05:48.592 INFO:tasks.workunit.client.0.smithi115.stdout:0/273: read d9/f2b [60419,71101] 0 2024-09-13T17:05:48.594 INFO:tasks.workunit.client.1.smithi195.stdout:4/515: getdents d1a/d1f/d21/d36 0 2024-09-13T17:05:48.596 INFO:tasks.workunit.client.0.smithi115.stdout:0/274: dread d9/d1b/f21 [0,4194304] 0 2024-09-13T17:05:48.597 INFO:tasks.workunit.client.1.smithi195.stdout:7/501: mkdir d5/db/d50/daa 0 2024-09-13T17:05:48.597 INFO:tasks.workunit.client.1.smithi195.stdout:7/502: creat d5/db/d50/d7f/d82/fab x:0 0 0 2024-09-13T17:05:48.597 INFO:tasks.workunit.client.1.smithi195.stdout:7/503: truncate d5/db/d19/d22/d3c/f4f 4906413 0 2024-09-13T17:05:48.606 INFO:tasks.workunit.client.1.smithi195.stdout:0/433: dread d7/d50/f5c [0,4194304] 0 2024-09-13T17:05:48.606 INFO:tasks.workunit.client.1.smithi195.stdout:0/434: fdatasync d7/db/d38/d5d/f72 0 2024-09-13T17:05:48.606 INFO:tasks.workunit.client.1.smithi195.stdout:0/435: chown d7/db/d38/d5d/l6b 5 1 2024-09-13T17:05:48.607 INFO:tasks.workunit.client.1.smithi195.stdout:0/436: creat d7/db/f8c x:0 0 0 2024-09-13T17:05:48.613 INFO:tasks.workunit.client.0.smithi115.stdout:3/549: dwrite d1/d12/d14/d61/f7c [0,4194304] 0 2024-09-13T17:05:48.613 INFO:tasks.workunit.client.0.smithi115.stdout:6/277: dwrite d8/db/d1d/f3d [0,4194304] 0 2024-09-13T17:05:48.614 INFO:tasks.workunit.client.1.smithi195.stdout:1/437: dwrite db/df/f63 [0,4194304] 0 2024-09-13T17:05:48.617 INFO:tasks.workunit.client.0.smithi115.stdout:2/562: dwrite d3/d4d/de/f43 [4194304,4194304] 0 2024-09-13T17:05:48.617 INFO:tasks.workunit.client.0.smithi115.stdout:4/396: dwrite d7/dd/f4d [0,4194304] 0 2024-09-13T17:05:48.618 INFO:tasks.workunit.client.1.smithi195.stdout:6/429: dwrite f1a [0,4194304] 0 2024-09-13T17:05:48.618 INFO:tasks.workunit.client.1.smithi195.stdout:6/430: stat d1c/d2d/l73 0 2024-09-13T17:05:48.618 INFO:tasks.workunit.client.1.smithi195.stdout:1/438: dread db/f18 [0,4194304] 0 2024-09-13T17:05:48.630 INFO:tasks.workunit.client.0.smithi115.stdout:2/563: read d3/d4d/de/f2a [255954,14336] 0 2024-09-13T17:05:48.630 INFO:tasks.workunit.client.0.smithi115.stdout:2/564: chown d3/d4d/dd/df/d5b/l94 8299191 1 2024-09-13T17:05:48.637 INFO:tasks.workunit.client.1.smithi195.stdout:6/431: dwrite d1c/d2d/d30/f5b [0,4194304] 0 2024-09-13T17:05:48.637 INFO:tasks.workunit.client.0.smithi115.stdout:3/550: dwrite d1/d4b/f76 [0,4194304] 0 2024-09-13T17:05:48.637 INFO:tasks.workunit.client.0.smithi115.stdout:4/397: dwrite d7/dd/de/d4e/f6f [0,4194304] 0 2024-09-13T17:05:48.645 INFO:tasks.workunit.client.0.smithi115.stdout:2/565: write d3/d4d/de/f15 [5172774,25684] 0 2024-09-13T17:05:48.645 INFO:tasks.workunit.client.0.smithi115.stdout:2/566: chown d3/d4d/dd/df/d5b/l94 304444519 1 2024-09-13T17:05:48.645 INFO:tasks.workunit.client.0.smithi115.stdout:2/567: write d3/d4d/d13/d39/f3b [927300,4669] 0 2024-09-13T17:05:48.651 INFO:tasks.workunit.client.1.smithi195.stdout:6/432: dwrite d1c/d3e/f87 [0,4194304] 0 2024-09-13T17:05:48.664 INFO:tasks.workunit.client.0.smithi115.stdout:4/398: dwrite d7/dd/f33 [0,4194304] 0 2024-09-13T17:05:48.664 INFO:tasks.workunit.client.0.smithi115.stdout:4/399: chown d7/dd/l5b 204474183 1 2024-09-13T17:05:48.664 INFO:tasks.workunit.client.0.smithi115.stdout:3/551: dwrite d1/d4b/d1a/d30/fa7 [0,4194304] 0 2024-09-13T17:05:48.664 INFO:tasks.workunit.client.0.smithi115.stdout:3/552: creat d1/d12/d14/fbe x:0 0 0 2024-09-13T17:05:48.745 INFO:tasks.workunit.client.0.smithi115.stdout:7/256: unlink d0/f1 0 2024-09-13T17:05:48.746 INFO:tasks.workunit.client.0.smithi115.stdout:8/314: symlink d0/d42/l66 0 2024-09-13T17:05:48.746 INFO:tasks.workunit.client.0.smithi115.stdout:8/315: truncate d0/d21/f55 687961 0 2024-09-13T17:05:48.762 INFO:tasks.workunit.client.0.smithi115.stdout:8/316: dread d0/d26/d29/f38 [0,4194304] 0 2024-09-13T17:05:48.764 INFO:tasks.workunit.client.0.smithi115.stdout:8/317: dread d0/d21/f55 [0,4194304] 0 2024-09-13T17:05:48.764 INFO:tasks.workunit.client.0.smithi115.stdout:8/318: read d0/d26/d29/f2a [1436426,41328] 0 2024-09-13T17:05:48.764 INFO:tasks.workunit.client.0.smithi115.stdout:7/257: dwrite d0/d2/f1a [0,4194304] 0 2024-09-13T17:05:48.764 INFO:tasks.workunit.client.0.smithi115.stdout:7/258: creat d0/d18/f5d x:0 0 0 2024-09-13T17:05:48.781 INFO:tasks.workunit.client.1.smithi195.stdout:2/458: rename d0/d4a/d47/d73/d75/d88/d2c/d43/d84/f8c to d0/d3/f92 0 2024-09-13T17:05:48.781 INFO:tasks.workunit.client.0.smithi115.stdout:1/272: symlink d5/d26/l5f 0 2024-09-13T17:05:48.781 INFO:tasks.workunit.client.0.smithi115.stdout:1/273: readlink d5/d7/l36 0 2024-09-13T17:05:48.782 INFO:tasks.workunit.client.1.smithi195.stdout:8/482: mknod d0/d17/d2f/d7c/d4c/d9b/caa 0 2024-09-13T17:05:48.786 INFO:tasks.workunit.client.0.smithi115.stdout:0/275: unlink d9/f2b 0 2024-09-13T17:05:48.788 INFO:tasks.workunit.client.1.smithi195.stdout:2/459: dread d0/f45 [0,4194304] 0 2024-09-13T17:05:48.788 INFO:tasks.workunit.client.1.smithi195.stdout:2/460: chown d0/d3/fe 132 1 2024-09-13T17:05:48.789 INFO:tasks.workunit.client.1.smithi195.stdout:3/434: truncate d7/d21/d2a/d35/f3d 3594842 0 2024-09-13T17:05:48.789 INFO:tasks.workunit.client.1.smithi195.stdout:3/435: fdatasync d7/d21/d51/f54 0 2024-09-13T17:05:48.789 INFO:tasks.workunit.client.1.smithi195.stdout:3/436: write d7/f81 [538180,99716] 0 2024-09-13T17:05:48.791 INFO:tasks.workunit.client.1.smithi195.stdout:5/423: symlink d2/df/d62/l83 0 2024-09-13T17:05:48.792 INFO:tasks.workunit.client.0.smithi115.stdout:6/278: mknod d8/db/d1d/c56 0 2024-09-13T17:05:48.792 INFO:tasks.workunit.client.0.smithi115.stdout:6/279: fsync d8/db/d1d/f26 0 2024-09-13T17:05:48.792 INFO:tasks.workunit.client.0.smithi115.stdout:6/280: creat d8/d33/f57 x:0 0 0 2024-09-13T17:05:48.793 INFO:tasks.workunit.client.1.smithi195.stdout:4/516: creat d1a/d1f/d21/d84/d9d/d8e/d9f/fa8 x:0 0 0 2024-09-13T17:05:48.797 INFO:tasks.workunit.client.1.smithi195.stdout:7/504: symlink d5/db/d50/daa/lac 0 2024-09-13T17:05:48.799 INFO:tasks.workunit.client.1.smithi195.stdout:0/437: symlink d7/d87/l8d 0 2024-09-13T17:05:48.805 INFO:tasks.workunit.client.0.smithi115.stdout:2/568: rename d3/d4d/d13/d1c/c2c to d3/d4d/d13/d39/cae 0 2024-09-13T17:05:48.805 INFO:tasks.workunit.client.0.smithi115.stdout:2/569: chown d3/d4d/de/c27 457120403 1 2024-09-13T17:05:48.805 INFO:tasks.workunit.client.0.smithi115.stdout:2/570: fdatasync d3/d4d/dd/d1f/d2f/d56/d58/f7f 0 2024-09-13T17:05:48.805 INFO:tasks.workunit.client.0.smithi115.stdout:2/571: dread - d3/d4d/dd/d1f/f9d zero size 2024-09-13T17:05:48.808 INFO:tasks.workunit.client.0.smithi115.stdout:0/276: dwrite d9/f20 [0,4194304] 0 2024-09-13T17:05:48.808 INFO:tasks.workunit.client.0.smithi115.stdout:0/277: chown l4 85 1 2024-09-13T17:05:48.810 INFO:tasks.workunit.client.1.smithi195.stdout:7/505: dwrite d5/d13/f1d [0,4194304] 0 2024-09-13T17:05:48.811 INFO:tasks.workunit.client.1.smithi195.stdout:7/506: chown d5/db/d19/d22/l74 10610851 1 2024-09-13T17:05:48.811 INFO:tasks.workunit.client.1.smithi195.stdout:7/507: write d5/d13/f6a [578056,62465] 0 2024-09-13T17:05:48.816 INFO:tasks.workunit.client.0.smithi115.stdout:3/553: chown d1/d12/d23/c72 31305017 1 2024-09-13T17:05:48.817 INFO:tasks.workunit.client.0.smithi115.stdout:3/554: fdatasync d1/d4b/d69/d7b/d8b/f8c 0 2024-09-13T17:05:48.817 INFO:tasks.workunit.client.1.smithi195.stdout:6/433: mkdir d1c/d24/d49/d5f/d85/d8f 0 2024-09-13T17:05:48.818 INFO:tasks.workunit.client.0.smithi115.stdout:8/319: symlink d0/d18/d19/d2b/d3b/l67 0 2024-09-13T17:05:48.821 INFO:tasks.workunit.client.0.smithi115.stdout:0/278: write d9/d1b/f3a [3333871,119595] 0 2024-09-13T17:05:48.824 INFO:tasks.workunit.client.0.smithi115.stdout:7/259: creat d0/d2/d1e/d3d/f5e x:0 0 0 2024-09-13T17:05:48.824 INFO:tasks.workunit.client.0.smithi115.stdout:7/260: dread - d0/d18/f5d zero size 2024-09-13T17:05:48.826 INFO:tasks.workunit.client.1.smithi195.stdout:3/437: creat d7/d21/d2a/d35/d60/d6f/f83 x:0 0 0 2024-09-13T17:05:48.829 INFO:tasks.workunit.client.1.smithi195.stdout:5/424: unlink d2/d12/d4e/f4b 0 2024-09-13T17:05:48.829 INFO:tasks.workunit.client.1.smithi195.stdout:5/425: chown d2/d3e/d32/l3d 114657 1 2024-09-13T17:05:48.831 INFO:tasks.workunit.client.0.smithi115.stdout:0/279: dread d9/d1d/d24/d26/d2d/d30/d46/f49 [0,4194304] 0 2024-09-13T17:05:48.831 INFO:tasks.workunit.client.0.smithi115.stdout:0/280: write d9/d1b/f3a [1778816,84225] 0 2024-09-13T17:05:48.831 INFO:tasks.workunit.client.1.smithi195.stdout:4/517: unlink d1a/d1f/d43/d24/d41/l76 0 2024-09-13T17:05:48.832 INFO:tasks.workunit.client.1.smithi195.stdout:4/518: chown d1a/d1f/d43 2618 1 2024-09-13T17:05:48.832 INFO:tasks.workunit.client.1.smithi195.stdout:4/519: readlink d1a/d1f/d21/d36/l79 0 2024-09-13T17:05:48.833 INFO:tasks.workunit.client.1.smithi195.stdout:0/438: truncate d7/d50/f21 203809 0 2024-09-13T17:05:48.836 INFO:tasks.workunit.client.0.smithi115.stdout:7/261: dread d0/d3b/d50/d21/d2f/f4e [0,4194304] 0 2024-09-13T17:05:48.838 INFO:tasks.workunit.client.0.smithi115.stdout:4/400: dwrite d7/dd/d3c/f40 [0,4194304] 0 2024-09-13T17:05:48.841 INFO:tasks.workunit.client.1.smithi195.stdout:9/472: sync 2024-09-13T17:05:48.841 INFO:tasks.workunit.client.1.smithi195.stdout:9/473: stat d6/df/d13/d44/d47/f9c 0 2024-09-13T17:05:48.841 INFO:tasks.workunit.client.1.smithi195.stdout:9/474: stat d6/d19 0 2024-09-13T17:05:48.842 INFO:tasks.workunit.client.1.smithi195.stdout:6/434: mknod d1c/d3e/c90 0 2024-09-13T17:05:48.844 INFO:tasks.workunit.client.1.smithi195.stdout:1/439: rename db/d19/d37/d46/l93 to db/d19/d5a/l99 0 2024-09-13T17:05:48.849 INFO:tasks.workunit.client.0.smithi115.stdout:4/401: read d7/dd/f2a [3965828,99135] 0 2024-09-13T17:05:48.849 INFO:tasks.workunit.client.0.smithi115.stdout:4/402: stat d7/dd/d3c/f58 0 2024-09-13T17:05:48.850 INFO:tasks.workunit.client.1.smithi195.stdout:8/483: rmdir d0/d17 39 2024-09-13T17:05:48.851 INFO:tasks.workunit.client.1.smithi195.stdout:2/461: link d0/d4a/d47/d73/d75/d88/d1e/c6f d0/c93 0 2024-09-13T17:05:48.851 INFO:tasks.workunit.client.1.smithi195.stdout:2/462: fsync d0/d4a/d47/d73/d75/d88/f23 0 2024-09-13T17:05:48.851 INFO:tasks.workunit.client.1.smithi195.stdout:2/463: chown d0/f76 24 1 2024-09-13T17:05:48.851 INFO:tasks.workunit.client.1.smithi195.stdout:2/464: stat d0/d4a/d47/d73/d75/d88/d2c/d51/c58 0 2024-09-13T17:05:48.853 INFO:tasks.workunit.client.1.smithi195.stdout:3/438: link d7/d67/f6c d7/d21/d2a/d35/d60/f84 0 2024-09-13T17:05:48.854 INFO:tasks.workunit.client.1.smithi195.stdout:5/426: creat d2/d3e/d32/f84 x:0 0 0 2024-09-13T17:05:48.854 INFO:tasks.workunit.client.1.smithi195.stdout:5/427: chown d2 5 1 2024-09-13T17:05:48.854 INFO:tasks.workunit.client.0.smithi115.stdout:6/281: creat d8/d13/d15/d24/d53/f58 x:0 0 0 2024-09-13T17:05:48.855 INFO:tasks.workunit.client.1.smithi195.stdout:6/435: write d1c/d24/d49/d5f/f6a [4167568,90632] 0 2024-09-13T17:05:48.856 INFO:tasks.workunit.client.1.smithi195.stdout:4/520: creat d1a/d1f/d43/d5a/d63/fa9 x:0 0 0 2024-09-13T17:05:48.857 INFO:tasks.workunit.client.0.smithi115.stdout:3/555: dwrite d1/d4b/f4d [0,4194304] 0 2024-09-13T17:05:48.857 INFO:tasks.workunit.client.0.smithi115.stdout:3/556: dread - d1/d12/d14/fbe zero size 2024-09-13T17:05:48.857 INFO:tasks.workunit.client.0.smithi115.stdout:0/281: dwrite d9/d1d/d24/d26/d36/d48/f4c [4194304,4194304] 0 2024-09-13T17:05:48.858 INFO:tasks.workunit.client.1.smithi195.stdout:0/439: dwrite d7/d88/d23/d4b/d56/d46/f6e [0,4194304] 0 2024-09-13T17:05:48.858 INFO:tasks.workunit.client.1.smithi195.stdout:0/440: write d7/d88/d23/d4b/d56/d46/f48 [870866,128131] 0 2024-09-13T17:05:48.858 INFO:tasks.workunit.client.1.smithi195.stdout:0/441: chown d7/d88/d23/d4b/d56/d46/f6e 92844 1 2024-09-13T17:05:48.859 INFO:tasks.workunit.client.1.smithi195.stdout:6/436: dread d1c/d2d/f55 [0,4194304] 0 2024-09-13T17:05:48.859 INFO:tasks.workunit.client.1.smithi195.stdout:6/437: chown d1c/d24/d49/d5f/d85 0 1 2024-09-13T17:05:48.863 INFO:tasks.workunit.client.0.smithi115.stdout:2/572: link d3/d4d/dd/d1f/f9d d3/d4d/dd/faf 0 2024-09-13T17:05:48.868 INFO:tasks.workunit.client.1.smithi195.stdout:0/442: dread d7/db/d38/f76 [0,4194304] 0 2024-09-13T17:05:48.868 INFO:tasks.workunit.client.0.smithi115.stdout:8/320: link d0/le d0/d15/d44/l68 0 2024-09-13T17:05:48.869 INFO:tasks.workunit.client.1.smithi195.stdout:7/508: rmdir d5/d13 39 2024-09-13T17:05:48.869 INFO:tasks.workunit.client.1.smithi195.stdout:7/509: truncate d5/db/d50/d7f/d82/fab 201135 0 2024-09-13T17:05:48.870 INFO:tasks.workunit.client.0.smithi115.stdout:7/262: creat d0/d2/d4a/f5f x:0 0 0 2024-09-13T17:05:48.872 INFO:tasks.workunit.client.1.smithi195.stdout:9/475: mkdir d6/df/d13/d44/d5e/da0 0 2024-09-13T17:05:48.872 INFO:tasks.workunit.client.1.smithi195.stdout:9/476: creat d6/d12/d39/fa1 x:0 0 0 2024-09-13T17:05:48.872 INFO:tasks.workunit.client.1.smithi195.stdout:9/477: truncate d6/d19/d21/f60 660780 0 2024-09-13T17:05:48.874 INFO:tasks.workunit.client.1.smithi195.stdout:1/440: mknod db/df/d51/c9a 0 2024-09-13T17:05:48.874 INFO:tasks.workunit.client.1.smithi195.stdout:1/441: creat db/df/d4d/f9b x:0 0 0 2024-09-13T17:05:48.874 INFO:tasks.workunit.client.1.smithi195.stdout:1/442: write db/f2b [4475715,75328] 0 2024-09-13T17:05:48.874 INFO:tasks.workunit.client.1.smithi195.stdout:1/443: fdatasync db/d19/f8b 0 2024-09-13T17:05:48.874 INFO:tasks.workunit.client.1.smithi195.stdout:1/444: fsync db/df/f1f 0 2024-09-13T17:05:48.874 INFO:tasks.workunit.client.1.smithi195.stdout:1/445: readlink db/d19/d37/d3e/l54 0 2024-09-13T17:05:48.875 INFO:tasks.workunit.client.1.smithi195.stdout:1/446: write db/df/d13/f2e [308779,94157] 0 2024-09-13T17:05:48.876 INFO:tasks.workunit.client.1.smithi195.stdout:8/484: link d0/l2c d0/d17/d49/d63/lab 0 2024-09-13T17:05:48.879 INFO:tasks.workunit.client.0.smithi115.stdout:4/403: creat d7/dd/de/d4e/d5a/d4f/f76 x:0 0 0 2024-09-13T17:05:48.879 INFO:tasks.workunit.client.0.smithi115.stdout:4/404: write d7/dd/de/f5c [348897,10833] 0 2024-09-13T17:05:48.881 INFO:tasks.workunit.client.1.smithi195.stdout:4/521: dwrite f19 [0,4194304] 0 2024-09-13T17:05:48.881 INFO:tasks.workunit.client.1.smithi195.stdout:4/522: truncate d1a/d1f/d21/d36/f55 238894 0 2024-09-13T17:05:48.881 INFO:tasks.workunit.client.1.smithi195.stdout:4/523: fsync f8 0 2024-09-13T17:05:48.881 INFO:tasks.workunit.client.1.smithi195.stdout:4/524: write fd [1653131,65455] 0 2024-09-13T17:05:48.881 INFO:tasks.workunit.client.1.smithi195.stdout:4/525: chown d1a/d1f/d21/d22/l69 1 1 2024-09-13T17:05:48.881 INFO:tasks.workunit.client.1.smithi195.stdout:2/465: mkdir d0/d4a/d47/d73/d94 0 2024-09-13T17:05:48.882 INFO:tasks.workunit.client.0.smithi115.stdout:6/282: dwrite d8/f51 [0,4194304] 0 2024-09-13T17:05:48.882 INFO:tasks.workunit.client.0.smithi115.stdout:6/283: write d8/d33/d40/f30 [1177204,39165] 0 2024-09-13T17:05:48.882 INFO:tasks.workunit.client.0.smithi115.stdout:6/284: fdatasync d8/d33/d3f/f43 0 2024-09-13T17:05:48.884 INFO:tasks.workunit.client.0.smithi115.stdout:8/321: read d0/d21/f4a [258052,46095] 0 2024-09-13T17:05:48.885 INFO:tasks.workunit.client.0.smithi115.stdout:2/573: creat d3/d4d/de/d99/d9a/fb0 x:0 0 0 2024-09-13T17:05:48.885 INFO:tasks.workunit.client.0.smithi115.stdout:2/574: chown d3/f8f 66664 1 2024-09-13T17:05:48.886 INFO:tasks.workunit.client.1.smithi195.stdout:8/485: dread d0/d13/f16 [0,4194304] 0 2024-09-13T17:05:48.886 INFO:tasks.workunit.client.1.smithi195.stdout:8/486: write d0/d17/f9e [183103,95516] 0 2024-09-13T17:05:48.886 INFO:tasks.workunit.client.1.smithi195.stdout:5/428: creat d2/df/d78/d54/d58/f85 x:0 0 0 2024-09-13T17:05:48.886 INFO:tasks.workunit.client.1.smithi195.stdout:5/429: fdatasync d2/df/d78/f49 0 2024-09-13T17:05:48.887 INFO:tasks.workunit.client.1.smithi195.stdout:5/430: read d2/df/d78/d54/f73 [495725,34247] 0 2024-09-13T17:05:48.887 INFO:tasks.workunit.client.1.smithi195.stdout:5/431: fdatasync d2/df/d78/d68/f7f 0 2024-09-13T17:05:48.892 INFO:tasks.workunit.client.0.smithi115.stdout:4/405: dread d7/f2d [0,4194304] 0 2024-09-13T17:05:48.893 INFO:tasks.workunit.client.1.smithi195.stdout:0/443: creat d7/db/d38/d4f/f8e x:0 0 0 2024-09-13T17:05:48.895 INFO:tasks.workunit.client.0.smithi115.stdout:1/274: rename d5/d7/d33/d48 to d5/d60 0 2024-09-13T17:05:48.896 INFO:tasks.workunit.client.1.smithi195.stdout:7/510: rename d5/db/d19/da3 to d5/db/d50/d7f/d82/dad 0 2024-09-13T17:05:48.898 INFO:tasks.workunit.client.1.smithi195.stdout:9/478: dwrite d6/d19/d21/d5b/f50 [0,4194304] 0 2024-09-13T17:05:48.898 INFO:tasks.workunit.client.1.smithi195.stdout:9/479: fdatasync d6/df/d13/d44/d47/f9c 0 2024-09-13T17:05:48.898 INFO:tasks.workunit.client.0.smithi115.stdout:7/263: dwrite d0/d2/f1a [0,4194304] 0 2024-09-13T17:05:48.901 INFO:tasks.workunit.client.1.smithi195.stdout:2/466: dwrite d0/d3/f5c [4194304,4194304] 0 2024-09-13T17:05:48.902 INFO:tasks.workunit.client.0.smithi115.stdout:4/406: fsync d7/dd/de/d4e/d5a/d4f/d53/f66 0 2024-09-13T17:05:48.904 INFO:tasks.workunit.client.0.smithi115.stdout:6/285: truncate d8/d13/d15/d24/f1e 1826388 0 2024-09-13T17:05:48.906 INFO:tasks.workunit.client.1.smithi195.stdout:1/447: symlink db/df/d4d/l9c 0 2024-09-13T17:05:48.906 INFO:tasks.workunit.client.1.smithi195.stdout:1/448: chown db/df/d51/c9a 374 1 2024-09-13T17:05:48.906 INFO:tasks.workunit.client.1.smithi195.stdout:1/449: creat db/d19/d37/f9d x:0 0 0 2024-09-13T17:05:48.907 INFO:tasks.workunit.client.0.smithi115.stdout:3/557: rename d1/d4b/d1a/c2f to d1/d12/cbf 0 2024-09-13T17:05:48.909 INFO:tasks.workunit.client.0.smithi115.stdout:1/275: mknod d5/d7/d33/d3a/c61 0 2024-09-13T17:05:48.910 INFO:tasks.workunit.client.0.smithi115.stdout:8/322: getdents d0/d21/d3a 0 2024-09-13T17:05:48.912 INFO:tasks.workunit.client.1.smithi195.stdout:4/526: creat d1a/d1f/d21/d84/d9d/d58/d91/faa x:0 0 0 2024-09-13T17:05:48.912 INFO:tasks.workunit.client.1.smithi195.stdout:4/527: getdents d1a/d1f/d21/d22/d98/da3 0 2024-09-13T17:05:48.912 INFO:tasks.workunit.client.1.smithi195.stdout:4/528: stat d1a/d1f/d21/d84/d9d/d58/d91/faa 0 2024-09-13T17:05:48.913 INFO:tasks.workunit.client.1.smithi195.stdout:4/529: creat d1a/d1f/d43/d24/d41/fab x:0 0 0 2024-09-13T17:05:48.913 INFO:tasks.workunit.client.0.smithi115.stdout:7/264: symlink d0/d3b/d50/d21/d25/d44/l60 0 2024-09-13T17:05:48.914 INFO:tasks.workunit.client.0.smithi115.stdout:2/575: rmdir d3/d4d/de/d98 39 2024-09-13T17:05:48.915 INFO:tasks.workunit.client.0.smithi115.stdout:2/576: chown d3/d4d/d13/d62/l8e 318755 1 2024-09-13T17:05:48.915 INFO:tasks.workunit.client.0.smithi115.stdout:2/577: write d3/d4d/de/d3a/d47/f8d [1420142,59265] 0 2024-09-13T17:05:48.915 INFO:tasks.workunit.client.0.smithi115.stdout:2/578: stat d3/d4d/de/f15 0 2024-09-13T17:05:48.915 INFO:tasks.workunit.client.0.smithi115.stdout:8/323: dread d0/d26/f35 [0,4194304] 0 2024-09-13T17:05:48.916 INFO:tasks.workunit.client.1.smithi195.stdout:9/480: dwrite d6/d19/f4c [0,4194304] 0 2024-09-13T17:05:48.916 INFO:tasks.workunit.client.1.smithi195.stdout:9/481: chown d6/df/d13/d44/d47/f9a 8779987 1 2024-09-13T17:05:48.917 INFO:tasks.workunit.client.0.smithi115.stdout:4/407: mkdir d7/dd/de/d4e/d6c/d77 0 2024-09-13T17:05:48.918 INFO:tasks.workunit.client.1.smithi195.stdout:3/439: symlink d7/l85 0 2024-09-13T17:05:48.919 INFO:tasks.workunit.client.0.smithi115.stdout:6/286: getdents d8/db/dd 0 2024-09-13T17:05:48.919 INFO:tasks.workunit.client.0.smithi115.stdout:6/287: fdatasync d8/db/ff 0 2024-09-13T17:05:48.922 INFO:tasks.workunit.client.0.smithi115.stdout:0/282: rename d9/d1d/d24/c2a to d9/d1d/d24/d26/d2d/d30/c50 0 2024-09-13T17:05:48.922 INFO:tasks.workunit.client.0.smithi115.stdout:0/283: chown d9/d1d/d24/d26/d2d/d30/f47 10837 1 2024-09-13T17:05:48.924 INFO:tasks.workunit.client.0.smithi115.stdout:3/558: creat d1/d4b/d69/db6/fc0 x:0 0 0 2024-09-13T17:05:48.929 INFO:tasks.workunit.client.0.smithi115.stdout:1/276: dwrite d5/d7/d33/f53 [0,4194304] 0 2024-09-13T17:05:48.929 INFO:tasks.workunit.client.0.smithi115.stdout:1/277: dread - d5/d26/f35 zero size 2024-09-13T17:05:48.929 INFO:tasks.workunit.client.0.smithi115.stdout:1/278: readlink d5/d7/l1e 0 2024-09-13T17:05:48.929 INFO:tasks.workunit.client.0.smithi115.stdout:1/279: chown d5/c24 618 1 2024-09-13T17:05:48.929 INFO:tasks.workunit.client.1.smithi195.stdout:9/482: write d6/df/d16/d58/f6e [1872595,113532] 0 2024-09-13T17:05:48.932 INFO:tasks.workunit.client.1.smithi195.stdout:8/487: rename d0/d17/d2f/d7c/d4b/d91 to d0/d13/d69/dac 0 2024-09-13T17:05:48.933 INFO:tasks.workunit.client.0.smithi115.stdout:4/408: dread d7/f12 [0,4194304] 0 2024-09-13T17:05:48.936 INFO:tasks.workunit.client.1.smithi195.stdout:7/511: mknod d5/db/d50/d7f/d82/cae 0 2024-09-13T17:05:48.936 INFO:tasks.workunit.client.1.smithi195.stdout:7/512: fsync d5/db/d19/d22/f62 0 2024-09-13T17:05:48.940 INFO:tasks.workunit.client.0.smithi115.stdout:3/559: write d1/d4b/f86 [7347817,25223] 0 2024-09-13T17:05:48.940 INFO:tasks.workunit.client.0.smithi115.stdout:7/265: creat d0/d3b/d50/d21/d2d/f61 x:0 0 0 2024-09-13T17:05:48.940 INFO:tasks.workunit.client.0.smithi115.stdout:3/560: dread d1/d4b/d1a/f9b [0,4194304] 0 2024-09-13T17:05:48.942 INFO:tasks.workunit.client.0.smithi115.stdout:8/324: truncate d0/f13 5849362 0 2024-09-13T17:05:48.942 INFO:tasks.workunit.client.0.smithi115.stdout:6/288: truncate d8/f25 2658546 0 2024-09-13T17:05:48.942 INFO:tasks.workunit.client.0.smithi115.stdout:6/289: chown d8/d13/d15/d24/d17 9643745 1 2024-09-13T17:05:48.942 INFO:tasks.workunit.client.0.smithi115.stdout:6/290: dread - d8/d13/d15/d24/f3b zero size 2024-09-13T17:05:48.942 INFO:tasks.workunit.client.0.smithi115.stdout:6/291: readlink d8/db/l14 0 2024-09-13T17:05:48.943 INFO:tasks.workunit.client.1.smithi195.stdout:3/440: dwrite d7/fa [4194304,4194304] 0 2024-09-13T17:05:48.943 INFO:tasks.workunit.client.1.smithi195.stdout:3/441: read d7/d67/f6c [288573,56022] 0 2024-09-13T17:05:48.943 INFO:tasks.workunit.client.1.smithi195.stdout:3/442: write d7/d5f/f82 [351107,87269] 0 2024-09-13T17:05:48.943 INFO:tasks.workunit.client.1.smithi195.stdout:3/443: write d7/d21/d2a/d35/d60/d64/f78 [229999,37268] 0 2024-09-13T17:05:48.943 INFO:tasks.workunit.client.1.smithi195.stdout:3/444: chown d7/l85 5910 1 2024-09-13T17:05:48.943 INFO:tasks.workunit.client.1.smithi195.stdout:2/467: mknod d0/d4a/d47/d73/d75/d88/d2c/d43/d63/c95 0 2024-09-13T17:05:48.943 INFO:tasks.workunit.client.1.smithi195.stdout:2/468: dread - d0/d4a/d47/d73/d75/d88/d2c/f8d zero size 2024-09-13T17:05:48.943 INFO:tasks.workunit.client.1.smithi195.stdout:2/469: read - d0/d3/f82 zero size 2024-09-13T17:05:48.943 INFO:tasks.workunit.client.1.smithi195.stdout:2/470: creat d0/d3/f96 x:0 0 0 2024-09-13T17:05:48.943 INFO:tasks.workunit.client.1.smithi195.stdout:2/471: dread - d0/d4a/d47/d73/d75/d88/f3e zero size 2024-09-13T17:05:48.944 INFO:tasks.workunit.client.1.smithi195.stdout:1/450: mknod db/df/d51/d8e/c9e 0 2024-09-13T17:05:48.946 INFO:tasks.workunit.client.1.smithi195.stdout:4/530: symlink d1a/d1f/d43/d24/d41/d60/d6f/lac 0 2024-09-13T17:05:48.948 INFO:tasks.workunit.client.0.smithi115.stdout:4/409: rename d7/dd/de/l21 to d7/dd/de/d4e/d6c/d77/l78 0 2024-09-13T17:05:48.949 INFO:tasks.workunit.client.0.smithi115.stdout:7/266: symlink d0/d18/l62 0 2024-09-13T17:05:48.949 INFO:tasks.workunit.client.0.smithi115.stdout:7/267: creat d0/d18/f63 x:0 0 0 2024-09-13T17:05:48.951 INFO:tasks.workunit.client.0.smithi115.stdout:3/561: dread d1/d4b/f2b [0,4194304] 0 2024-09-13T17:05:48.951 INFO:tasks.workunit.client.0.smithi115.stdout:6/292: unlink d8/l1b 0 2024-09-13T17:05:48.952 INFO:tasks.workunit.client.1.smithi195.stdout:3/445: dread d7/d19/d1e/f52 [0,4194304] 0 2024-09-13T17:05:48.954 INFO:tasks.workunit.client.0.smithi115.stdout:8/325: rename d0/d18/d19/d2b/f3d to d0/d15/d3e/f69 0 2024-09-13T17:05:48.954 INFO:tasks.workunit.client.1.smithi195.stdout:1/451: dread db/df/d51/f72 [0,4194304] 0 2024-09-13T17:05:48.954 INFO:tasks.workunit.client.1.smithi195.stdout:1/452: write db/d19/d37/f4e [724891,119431] 0 2024-09-13T17:05:48.955 INFO:tasks.workunit.client.0.smithi115.stdout:7/268: symlink d0/l64 0 2024-09-13T17:05:48.956 INFO:tasks.workunit.client.0.smithi115.stdout:3/562: fdatasync d1/d12/d23/f59 0 2024-09-13T17:05:48.958 INFO:tasks.workunit.client.1.smithi195.stdout:2/472: dwrite d0/d3/f4e [0,4194304] 0 2024-09-13T17:05:48.958 INFO:tasks.workunit.client.1.smithi195.stdout:2/473: read - d0/d4a/d47/d73/f7c zero size 2024-09-13T17:05:48.959 INFO:tasks.workunit.client.0.smithi115.stdout:6/293: mknod d8/d13/d15/c59 0 2024-09-13T17:05:48.959 INFO:tasks.workunit.client.0.smithi115.stdout:6/294: dread - d8/d33/f57 zero size 2024-09-13T17:05:48.959 INFO:tasks.workunit.client.0.smithi115.stdout:8/326: symlink d0/d26/d29/l6a 0 2024-09-13T17:05:48.959 INFO:tasks.workunit.client.0.smithi115.stdout:8/327: write d0/d15/d44/f52 [678535,44740] 0 2024-09-13T17:05:48.959 INFO:tasks.workunit.client.1.smithi195.stdout:3/446: stat d7/d21/d2a/d35/d60/l7b 0 2024-09-13T17:05:48.960 INFO:tasks.workunit.client.0.smithi115.stdout:7/269: unlink d0/f31 0 2024-09-13T17:05:48.960 INFO:tasks.workunit.client.0.smithi115.stdout:7/270: creat d0/d3b/d50/d21/d2d/f65 x:0 0 0 2024-09-13T17:05:48.960 INFO:tasks.workunit.client.0.smithi115.stdout:7/271: write d0/d3b/d50/d21/d25/f2c [812583,29079] 0 2024-09-13T17:05:48.961 INFO:tasks.workunit.client.0.smithi115.stdout:3/563: mknod d1/d12/cc1 0 2024-09-13T17:05:48.962 INFO:tasks.workunit.client.1.smithi195.stdout:9/483: rmdir d6/d19/d21/d45 39 2024-09-13T17:05:48.965 INFO:tasks.workunit.client.0.smithi115.stdout:8/328: creat d0/d18/d43/f6b x:0 0 0 2024-09-13T17:05:48.967 INFO:tasks.workunit.client.1.smithi195.stdout:1/453: mknod db/d19/d37/d3e/c9f 0 2024-09-13T17:05:48.968 INFO:tasks.workunit.client.0.smithi115.stdout:3/564: chown d1/d12/d23/c5d 2006624 1 2024-09-13T17:05:48.969 INFO:tasks.workunit.client.1.smithi195.stdout:8/488: rmdir d0/d13/d52/d55 39 2024-09-13T17:05:48.970 INFO:tasks.workunit.client.1.smithi195.stdout:9/484: read d6/d19/d21/d64/d68/d6d/f7e [2718506,37870] 0 2024-09-13T17:05:48.970 INFO:tasks.workunit.client.1.smithi195.stdout:9/485: creat d6/d19/d21/d64/d68/d6d/fa2 x:0 0 0 2024-09-13T17:05:48.970 INFO:tasks.workunit.client.1.smithi195.stdout:2/474: truncate d0/f66 5829275 0 2024-09-13T17:05:48.970 INFO:tasks.workunit.client.1.smithi195.stdout:2/475: creat d0/d4a/d47/d73/d75/d88/d2c/d43/d84/f97 x:0 0 0 2024-09-13T17:05:48.971 INFO:tasks.workunit.client.1.smithi195.stdout:5/432: rename d2/df/d78/d68 to d2/df/d86 0 2024-09-13T17:05:48.972 INFO:tasks.workunit.client.1.smithi195.stdout:8/489: mkdir d0/d17/d49/d63/dad 0 2024-09-13T17:05:48.975 INFO:tasks.workunit.client.1.smithi195.stdout:3/447: dwrite d7/d21/f4f [0,4194304] 0 2024-09-13T17:05:48.975 INFO:tasks.workunit.client.1.smithi195.stdout:9/486: rename d6/d19/f4c to d6/d19/d21/d5b/fa3 0 2024-09-13T17:05:48.976 INFO:tasks.workunit.client.1.smithi195.stdout:8/490: symlink d0/d17/d2f/d7c/d4c/d9a/da5/lae 0 2024-09-13T17:05:48.978 INFO:tasks.workunit.client.1.smithi195.stdout:2/476: rename d0/d4a/d47/d73/d75/d88/d2c/d51/c58 to d0/d4a/d47/d73/d75/d88/d1e/c98 0 2024-09-13T17:05:48.979 INFO:tasks.workunit.client.1.smithi195.stdout:8/491: creat d0/d17/faf x:0 0 0 2024-09-13T17:05:48.981 INFO:tasks.workunit.client.1.smithi195.stdout:9/487: rename d6/d19/c2e to d6/df/d13/d44/d5e/da0/ca4 0 2024-09-13T17:05:48.981 INFO:tasks.workunit.client.1.smithi195.stdout:9/488: chown d6/df/d13/d44/d5e/da0/ca4 0 1 2024-09-13T17:05:48.981 INFO:tasks.workunit.client.1.smithi195.stdout:9/489: truncate d6/df/d72/f92 1021274 0 2024-09-13T17:05:48.981 INFO:tasks.workunit.client.1.smithi195.stdout:9/490: dread - d6/d19/d21/d45/f99 zero size 2024-09-13T17:05:48.981 INFO:tasks.workunit.client.1.smithi195.stdout:9/491: truncate d6/df/d13/d44/d47/f9a 15591 0 2024-09-13T17:05:48.981 INFO:tasks.workunit.client.1.smithi195.stdout:3/448: dread d7/d21/d2a/d35/f3d [0,4194304] 0 2024-09-13T17:05:48.981 INFO:tasks.workunit.client.1.smithi195.stdout:3/449: truncate d7/d62/f76 342452 0 2024-09-13T17:05:48.982 INFO:tasks.workunit.client.0.smithi115.stdout:8/329: stat d0/d15/d44/l68 0 2024-09-13T17:05:48.983 INFO:tasks.workunit.client.1.smithi195.stdout:8/492: unlink d0/d17/d2f/f40 0 2024-09-13T17:05:48.983 INFO:tasks.workunit.client.1.smithi195.stdout:8/493: chown d0/d17/d2f/d7c 39 1 2024-09-13T17:05:48.983 INFO:tasks.workunit.client.1.smithi195.stdout:8/494: read - d0/d17/d49/d63/d71/f9c zero size 2024-09-13T17:05:48.983 INFO:tasks.workunit.client.1.smithi195.stdout:8/495: chown d0/d17/d2f/d7c/d4c/d9a/da5/lae 31091 1 2024-09-13T17:05:48.983 INFO:tasks.workunit.client.0.smithi115.stdout:3/565: mkdir d1/dc2 0 2024-09-13T17:05:48.983 INFO:tasks.workunit.client.0.smithi115.stdout:3/566: fsync d1/d4b/d1a/fa2 0 2024-09-13T17:05:48.984 INFO:tasks.workunit.client.1.smithi195.stdout:9/492: mknod d6/df/d16/ca5 0 2024-09-13T17:05:48.984 INFO:tasks.workunit.client.1.smithi195.stdout:9/493: write d6/d19/d21/d64/d68/d6d/f7e [38771,68465] 0 2024-09-13T17:05:48.984 INFO:tasks.workunit.client.0.smithi115.stdout:3/567: rename d1/d12/d14/f55 to d1/d12/d14/d61/fc3 0 2024-09-13T17:05:48.984 INFO:tasks.workunit.client.0.smithi115.stdout:3/568: truncate d1/d12/d14/f51 5675602 0 2024-09-13T17:05:48.986 INFO:tasks.workunit.client.1.smithi195.stdout:3/450: rename d7/c55 to d7/d19/d1e/c86 0 2024-09-13T17:05:48.986 INFO:tasks.workunit.client.1.smithi195.stdout:3/451: readlink d7/d21/l5e 0 2024-09-13T17:05:48.986 INFO:tasks.workunit.client.1.smithi195.stdout:3/452: fsync d7/d5f/f68 0 2024-09-13T17:05:48.986 INFO:tasks.workunit.client.1.smithi195.stdout:3/453: chown d7/d21/d2a/d35/l36 13805984 1 2024-09-13T17:05:48.986 INFO:tasks.workunit.client.0.smithi115.stdout:3/569: creat d1/d4b/d1a/d6e/fc4 x:0 0 0 2024-09-13T17:05:48.987 INFO:tasks.workunit.client.0.smithi115.stdout:3/570: fdatasync d1/d12/d14/fa5 0 2024-09-13T17:05:48.987 INFO:tasks.workunit.client.1.smithi195.stdout:3/454: rmdir d7/d62/d70 39 2024-09-13T17:05:48.988 INFO:tasks.workunit.client.1.smithi195.stdout:3/455: creat d7/d21/d2a/d4a/d71/f87 x:0 0 0 2024-09-13T17:05:49.001 INFO:tasks.workunit.client.1.smithi195.stdout:5/433: dread d2/d12/d4e/d10/f23 [0,4194304] 0 2024-09-13T17:05:49.005 INFO:tasks.workunit.client.1.smithi195.stdout:5/434: creat d2/d12/d4e/d10/d5c/f87 x:0 0 0 2024-09-13T17:05:49.005 INFO:tasks.workunit.client.1.smithi195.stdout:5/435: stat d2/df/d78/d54/c72 0 2024-09-13T17:05:49.006 INFO:tasks.workunit.client.0.smithi115.stdout:7/272: dread d0/f13 [0,4194304] 0 2024-09-13T17:05:49.006 INFO:tasks.workunit.client.0.smithi115.stdout:7/273: write d0/d18/f1f [5164200,52835] 0 2024-09-13T17:05:49.006 INFO:tasks.workunit.client.0.smithi115.stdout:7/274: chown d0/d18/c23 0 1 2024-09-13T17:05:49.006 INFO:tasks.workunit.client.0.smithi115.stdout:7/275: dread - d0/d3b/d54/f55 zero size 2024-09-13T17:05:49.006 INFO:tasks.workunit.client.0.smithi115.stdout:7/276: symlink d0/d2/l66 0 2024-09-13T17:05:49.009 INFO:tasks.workunit.client.1.smithi195.stdout:5/436: mkdir d2/d88 0 2024-09-13T17:05:49.009 INFO:tasks.workunit.client.0.smithi115.stdout:7/277: mkdir d0/d2/d67 0 2024-09-13T17:05:49.010 INFO:tasks.workunit.client.0.smithi115.stdout:0/284: rmdir d9/d1d/d24/d26/d2d/d30 39 2024-09-13T17:05:49.010 INFO:tasks.workunit.client.0.smithi115.stdout:0/285: readlink d9/d1d/l2e 0 2024-09-13T17:05:49.011 INFO:tasks.workunit.client.1.smithi195.stdout:2/477: write d0/d3/f5c [2516073,62597] 0 2024-09-13T17:05:49.011 INFO:tasks.workunit.client.1.smithi195.stdout:2/478: fdatasync d0/d4a/d47/d73/d75/d88/d2c/d43/f64 0 2024-09-13T17:05:49.012 INFO:tasks.workunit.client.0.smithi115.stdout:8/330: dread d0/d15/d44/f52 [0,4194304] 0 2024-09-13T17:05:49.012 INFO:tasks.workunit.client.0.smithi115.stdout:8/331: write d0/d21/f4a [3869060,64575] 0 2024-09-13T17:05:49.013 INFO:tasks.workunit.client.0.smithi115.stdout:7/278: mknod d0/d3b/d50/d21/d25/d44/c68 0 2024-09-13T17:05:49.013 INFO:tasks.workunit.client.0.smithi115.stdout:7/279: truncate d0/d2/d4a/f5f 737739 0 2024-09-13T17:05:49.013 INFO:tasks.workunit.client.0.smithi115.stdout:7/280: truncate d0/d3b/d54/f55 1019031 0 2024-09-13T17:05:49.014 INFO:tasks.workunit.client.1.smithi195.stdout:1/454: dread db/df/d13/f8d [0,4194304] 0 2024-09-13T17:05:49.017 INFO:tasks.workunit.client.0.smithi115.stdout:8/332: unlink d0/d18/d43/f6b 0 2024-09-13T17:05:49.019 INFO:tasks.workunit.client.0.smithi115.stdout:1/280: dwrite d5/f6 [0,4194304] 0 2024-09-13T17:05:49.021 INFO:tasks.workunit.client.0.smithi115.stdout:0/286: dread d9/fc [0,4194304] 0 2024-09-13T17:05:49.021 INFO:tasks.workunit.client.0.smithi115.stdout:0/287: rename d9/d1d to d9/d1d/d24/d26/d51 22 2024-09-13T17:05:49.023 INFO:tasks.workunit.client.1.smithi195.stdout:5/437: write d2/d12/d4e/d10/f66 [4479626,89410] 0 2024-09-13T17:05:49.024 INFO:tasks.workunit.client.1.smithi195.stdout:2/479: creat d0/d4a/d47/d73/d75/d88/d2c/d43/d63/f99 x:0 0 0 2024-09-13T17:05:49.024 INFO:tasks.workunit.client.0.smithi115.stdout:5/296: sync 2024-09-13T17:05:49.024 INFO:tasks.workunit.client.0.smithi115.stdout:9/205: sync 2024-09-13T17:05:49.024 INFO:tasks.workunit.client.0.smithi115.stdout:9/206: truncate d0/de/d10/f3e 282341 0 2024-09-13T17:05:49.024 INFO:tasks.workunit.client.0.smithi115.stdout:9/207: truncate d0/de/d37/f41 776563 0 2024-09-13T17:05:49.025 INFO:tasks.workunit.client.1.smithi195.stdout:8/496: dwrite d0/f61 [0,4194304] 0 2024-09-13T17:05:49.025 INFO:tasks.workunit.client.1.smithi195.stdout:8/497: read - d0/d17/f68 zero size 2024-09-13T17:05:49.025 INFO:tasks.workunit.client.1.smithi195.stdout:8/498: truncate d0/d17/faf 703295 0 2024-09-13T17:05:49.025 INFO:tasks.workunit.client.1.smithi195.stdout:3/456: dwrite d7/f2d [4194304,4194304] 0 2024-09-13T17:05:49.025 INFO:tasks.workunit.client.1.smithi195.stdout:3/457: stat d7/d21/d2a/d35/d60/d6f 0 2024-09-13T17:05:49.026 INFO:tasks.workunit.client.0.smithi115.stdout:4/410: dwrite d7/fb [0,4194304] 0 2024-09-13T17:05:49.026 INFO:tasks.workunit.client.0.smithi115.stdout:1/281: mkdir d5/d26/d2c/d62 0 2024-09-13T17:05:49.026 INFO:tasks.workunit.client.0.smithi115.stdout:1/282: chown d5/f41 262977 1 2024-09-13T17:05:49.026 INFO:tasks.workunit.client.0.smithi115.stdout:4/411: chown d7/dd/d63/f6a 1361200 1 2024-09-13T17:05:49.026 INFO:tasks.workunit.client.0.smithi115.stdout:4/412: truncate d7/dd/d3c/f58 359307 0 2024-09-13T17:05:49.026 INFO:tasks.workunit.client.0.smithi115.stdout:7/281: dread d0/d3b/d50/f10 [0,4194304] 0 2024-09-13T17:05:49.027 INFO:tasks.workunit.client.1.smithi195.stdout:9/494: dwrite d6/d12/f8a [0,4194304] 0 2024-09-13T17:05:49.027 INFO:tasks.workunit.client.1.smithi195.stdout:9/495: write d6/d19/d21/d64/d68/d6d/f85 [4610380,3396] 0 2024-09-13T17:05:49.027 INFO:tasks.workunit.client.1.smithi195.stdout:9/496: write d6/df/d16/d5c/f7a [202687,29198] 0 2024-09-13T17:05:49.027 INFO:tasks.workunit.client.1.smithi195.stdout:9/497: write d6/f7 [3676677,90612] 0 2024-09-13T17:05:49.027 INFO:tasks.workunit.client.1.smithi195.stdout:9/498: stat d6/c8f 0 2024-09-13T17:05:49.029 INFO:tasks.workunit.client.0.smithi115.stdout:9/208: link d0/f8 d0/de/d10/f4a 0 2024-09-13T17:05:49.029 INFO:tasks.workunit.client.0.smithi115.stdout:9/209: write d0/d21/f22 [468960,76118] 0 2024-09-13T17:05:49.030 INFO:tasks.workunit.client.1.smithi195.stdout:5/438: symlink d2/df/d78/d76/l89 0 2024-09-13T17:05:49.033 INFO:tasks.workunit.client.0.smithi115.stdout:7/282: rename d0/d3b/d50/d21/d2d/l37 to d0/d2/d1e/d3d/l69 0 2024-09-13T17:05:49.036 INFO:tasks.workunit.client.1.smithi195.stdout:9/499: dread d6/df/d16/f88 [0,4194304] 0 2024-09-13T17:05:49.036 INFO:tasks.workunit.client.1.smithi195.stdout:9/500: write d6/df/d16/d65/f75 [1107031,125745] 0 2024-09-13T17:05:49.042 INFO:tasks.workunit.client.0.smithi115.stdout:5/297: dread d19/d2b/d32/d55/f5a [0,4194304] 0 2024-09-13T17:05:49.043 INFO:tasks.workunit.client.0.smithi115.stdout:3/571: dwrite d1/d4b/d1a/d30/f3c [0,4194304] 0 2024-09-13T17:05:49.043 INFO:tasks.workunit.client.0.smithi115.stdout:3/572: write d1/d4b/f5f [755407,66409] 0 2024-09-13T17:05:49.045 INFO:tasks.workunit.client.0.smithi115.stdout:1/283: write d5/d7/d33/f53 [572115,71995] 0 2024-09-13T17:05:49.045 INFO:tasks.workunit.client.0.smithi115.stdout:7/283: link d0/fa d0/d3b/f6a 0 2024-09-13T17:05:49.045 INFO:tasks.workunit.client.0.smithi115.stdout:7/284: write d0/d2/d1e/f39 [1394965,40257] 0 2024-09-13T17:05:49.046 INFO:tasks.workunit.client.0.smithi115.stdout:9/210: write d0/f1f [790259,64030] 0 2024-09-13T17:05:49.046 INFO:tasks.workunit.client.0.smithi115.stdout:9/211: dread - d0/de/d10/d15/f3a zero size 2024-09-13T17:05:49.049 INFO:tasks.workunit.client.0.smithi115.stdout:5/298: creat d19/d2b/d32/d55/d5e/f67 x:0 0 0 2024-09-13T17:05:49.059 INFO:tasks.workunit.client.0.smithi115.stdout:9/212: write d0/de/d10/d15/f24 [2682237,20432] 0 2024-09-13T17:05:49.060 INFO:tasks.workunit.client.0.smithi115.stdout:1/284: creat d5/d26/f63 x:0 0 0 2024-09-13T17:05:49.061 INFO:tasks.workunit.client.0.smithi115.stdout:4/413: dwrite d7/dd/f44 [0,4194304] 0 2024-09-13T17:05:49.065 INFO:tasks.workunit.client.0.smithi115.stdout:6/295: rmdir d8 39 2024-09-13T17:05:49.065 INFO:tasks.workunit.client.0.smithi115.stdout:6/296: stat d8/d13/d15/d24/d17 0 2024-09-13T17:05:49.066 INFO:tasks.workunit.client.0.smithi115.stdout:1/285: creat d5/d3e/f64 x:0 0 0 2024-09-13T17:05:49.067 INFO:tasks.workunit.client.0.smithi115.stdout:1/286: write d5/d7/f21 [214030,32430] 0 2024-09-13T17:05:49.068 INFO:tasks.workunit.client.1.smithi195.stdout:2/480: dwrite d0/d4a/d47/d73/d75/d88/d2c/d51/f81 [0,4194304] 0 2024-09-13T17:05:49.070 INFO:tasks.workunit.client.1.smithi195.stdout:5/439: creat d2/df/d78/d54/f8a x:0 0 0 2024-09-13T17:05:49.074 INFO:tasks.workunit.client.1.smithi195.stdout:9/501: creat d6/d19/d21/d5b/fa6 x:0 0 0 2024-09-13T17:05:49.074 INFO:tasks.workunit.client.0.smithi115.stdout:4/414: truncate d7/dd/de/d4e/d5a/d4f/d53/f66 1530316 0 2024-09-13T17:05:49.075 INFO:tasks.workunit.client.1.smithi195.stdout:9/502: dread d6/d19/d21/f60 [0,4194304] 0 2024-09-13T17:05:49.075 INFO:tasks.workunit.client.1.smithi195.stdout:3/458: getdents d7/d21/d2a/d35/d60/d6f 0 2024-09-13T17:05:49.077 INFO:tasks.workunit.client.0.smithi115.stdout:7/285: dwrite d0/d3b/f6a [0,4194304] 0 2024-09-13T17:05:49.081 INFO:tasks.workunit.client.0.smithi115.stdout:3/573: dwrite d1/f9 [0,4194304] 0 2024-09-13T17:05:49.081 INFO:tasks.workunit.client.0.smithi115.stdout:3/574: truncate d1/d12/d14/f51 6338351 0 2024-09-13T17:05:49.081 INFO:tasks.workunit.client.0.smithi115.stdout:5/299: dwrite d19/f3c [0,4194304] 0 2024-09-13T17:05:49.081 INFO:tasks.workunit.client.1.smithi195.stdout:9/503: dread d6/df/d16/f74 [0,4194304] 0 2024-09-13T17:05:49.086 INFO:tasks.workunit.client.1.smithi195.stdout:2/481: truncate d0/f6c 2693990 0 2024-09-13T17:05:49.087 INFO:tasks.workunit.client.0.smithi115.stdout:9/213: dwrite d0/fb [0,4194304] 0 2024-09-13T17:05:49.088 INFO:tasks.workunit.client.1.smithi195.stdout:5/440: creat d2/df/d78/f8b x:0 0 0 2024-09-13T17:05:49.091 INFO:tasks.workunit.client.0.smithi115.stdout:4/415: dwrite f5 [0,4194304] 0 2024-09-13T17:05:49.091 INFO:tasks.workunit.client.0.smithi115.stdout:4/416: write d7/dd/de/d4e/d5a/d4f/f76 [946731,99643] 0 2024-09-13T17:05:49.093 INFO:tasks.workunit.client.1.smithi195.stdout:3/459: getdents d7/d21/d66 0 2024-09-13T17:05:49.093 INFO:tasks.workunit.client.1.smithi195.stdout:3/460: dread - d7/d21/d2a/d35/d60/d64/f7d zero size 2024-09-13T17:05:49.095 INFO:tasks.workunit.client.1.smithi195.stdout:9/504: mkdir d6/d12/d86/da7 0 2024-09-13T17:05:49.098 INFO:tasks.workunit.client.1.smithi195.stdout:5/441: creat d2/df/d48/d5a/f8c x:0 0 0 2024-09-13T17:05:49.098 INFO:tasks.workunit.client.1.smithi195.stdout:5/442: readlink d2/l9 0 2024-09-13T17:05:49.102 INFO:tasks.workunit.client.1.smithi195.stdout:3/461: creat d7/d21/d66/d7e/f88 x:0 0 0 2024-09-13T17:05:49.103 INFO:tasks.workunit.client.0.smithi115.stdout:6/297: creat d8/d33/d40/f5a x:0 0 0 2024-09-13T17:05:49.103 INFO:tasks.workunit.client.1.smithi195.stdout:3/462: write d7/d21/f59 [168535,129832] 0 2024-09-13T17:05:49.104 INFO:tasks.workunit.client.1.smithi195.stdout:9/505: creat d6/d19/fa8 x:0 0 0 2024-09-13T17:05:49.107 INFO:tasks.workunit.client.1.smithi195.stdout:2/482: mknod d0/c9a 0 2024-09-13T17:05:49.110 INFO:tasks.workunit.client.1.smithi195.stdout:9/506: getdents d6/df/d7b 0 2024-09-13T17:05:49.110 INFO:tasks.workunit.client.1.smithi195.stdout:9/507: readlink d6/d19/d21/l24 0 2024-09-13T17:05:49.110 INFO:tasks.workunit.client.1.smithi195.stdout:9/508: write d6/d19/d21/d5b/fa6 [191834,92112] 0 2024-09-13T17:05:49.112 INFO:tasks.workunit.client.1.smithi195.stdout:2/483: creat d0/d4a/d47/d73/d75/d88/d8e/f9b x:0 0 0 2024-09-13T17:05:49.114 INFO:tasks.workunit.client.1.smithi195.stdout:6/438: sync 2024-09-13T17:05:49.115 INFO:tasks.workunit.client.1.smithi195.stdout:9/509: link d6/df/d7b/l87 d6/d19/la9 0 2024-09-13T17:05:49.117 INFO:tasks.workunit.client.0.smithi115.stdout:7/286: unlink d0/d2/d1e/f53 0 2024-09-13T17:05:49.117 INFO:tasks.workunit.client.0.smithi115.stdout:7/287: chown d0/d3b/d50 6602578 1 2024-09-13T17:05:49.118 INFO:tasks.workunit.client.1.smithi195.stdout:5/443: dread d2/df/f42 [0,4194304] 0 2024-09-13T17:05:49.118 INFO:tasks.workunit.client.1.smithi195.stdout:5/444: chown d2/d12/d4e/d10/d46/l1e 541 1 2024-09-13T17:05:49.119 INFO:tasks.workunit.client.1.smithi195.stdout:2/484: dread d0/d3/df/f35 [0,4194304] 0 2024-09-13T17:05:49.119 INFO:tasks.workunit.client.1.smithi195.stdout:9/510: symlink d6/d19/d21/d64/laa 0 2024-09-13T17:05:49.120 INFO:tasks.workunit.client.1.smithi195.stdout:9/511: write d6/df/d16/d5c/f7a [183060,5321] 0 2024-09-13T17:05:49.121 INFO:tasks.workunit.client.0.smithi115.stdout:3/575: mkdir d1/d4b/d1a/d30/dc5 0 2024-09-13T17:05:49.121 INFO:tasks.workunit.client.0.smithi115.stdout:3/576: dread d1/d4b/d1a/f81 [0,4194304] 0 2024-09-13T17:05:49.123 INFO:tasks.workunit.client.0.smithi115.stdout:5/300: creat d19/d21/d62/f68 x:0 0 0 2024-09-13T17:05:49.127 INFO:tasks.workunit.client.1.smithi195.stdout:3/463: dwrite d7/d19/d1e/f3f [0,4194304] 0 2024-09-13T17:05:49.128 INFO:tasks.workunit.client.1.smithi195.stdout:5/445: creat d2/df/d78/d76/f8d x:0 0 0 2024-09-13T17:05:49.131 INFO:tasks.workunit.client.0.smithi115.stdout:3/577: dread d1/d4b/f4d [0,4194304] 0 2024-09-13T17:05:49.131 INFO:tasks.workunit.client.0.smithi115.stdout:3/578: fdatasync d1/d4b/d69/db6/fc0 0 2024-09-13T17:05:49.131 INFO:tasks.workunit.client.0.smithi115.stdout:9/214: mknod d0/de/d10/d15/c4b 0 2024-09-13T17:05:49.132 INFO:tasks.workunit.client.0.smithi115.stdout:3/579: dread d1/d83/f91 [0,4194304] 0 2024-09-13T17:05:49.134 INFO:tasks.workunit.client.0.smithi115.stdout:4/417: link d7/dd/de/d4e/d5a/d4f/c64 d7/dd/de/d4e/d6c/c79 0 2024-09-13T17:05:49.135 INFO:tasks.workunit.client.1.smithi195.stdout:9/512: mknod d6/df/d16/cab 0 2024-09-13T17:05:49.136 INFO:tasks.workunit.client.0.smithi115.stdout:6/298: creat d8/d33/d3f/f5b x:0 0 0 2024-09-13T17:05:49.139 INFO:tasks.workunit.client.0.smithi115.stdout:7/288: truncate d0/f2e 3279418 0 2024-09-13T17:05:49.140 INFO:tasks.workunit.client.1.smithi195.stdout:3/464: symlink d7/d21/d2a/d4a/d5a/l89 0 2024-09-13T17:05:49.141 INFO:tasks.workunit.client.0.smithi115.stdout:5/301: mkdir d19/d2b/d69 0 2024-09-13T17:05:49.142 INFO:tasks.workunit.client.0.smithi115.stdout:5/302: creat d19/d2b/f6a x:0 0 0 2024-09-13T17:05:49.142 INFO:tasks.workunit.client.0.smithi115.stdout:5/303: stat d19/f1a 0 2024-09-13T17:05:49.143 INFO:tasks.workunit.client.1.smithi195.stdout:9/513: unlink d6/df/l10 0 2024-09-13T17:05:49.143 INFO:tasks.workunit.client.1.smithi195.stdout:9/514: fdatasync d6/d19/d21/d5b/f5f 0 2024-09-13T17:05:49.143 INFO:tasks.workunit.client.0.smithi115.stdout:1/287: getdents d5/d3e 0 2024-09-13T17:05:49.144 INFO:tasks.workunit.client.1.smithi195.stdout:5/446: dread d2/d3e/f16 [4194304,4194304] 0 2024-09-13T17:05:49.146 INFO:tasks.workunit.client.1.smithi195.stdout:9/515: symlink d6/d12/d39/lac 0 2024-09-13T17:05:49.148 INFO:tasks.workunit.client.0.smithi115.stdout:4/418: creat d7/dd/de/d4e/d5a/d4f/d53/f7a x:0 0 0 2024-09-13T17:05:49.150 INFO:tasks.workunit.client.1.smithi195.stdout:5/447: dread d2/d12/d3f/f4d [0,4194304] 0 2024-09-13T17:05:49.154 INFO:tasks.workunit.client.0.smithi115.stdout:7/289: mknod d0/d2/d67/c6b 0 2024-09-13T17:05:49.161 INFO:tasks.workunit.client.1.smithi195.stdout:5/448: link d2/df/d78/d54/c72 d2/d12/d3f/c8e 0 2024-09-13T17:05:49.161 INFO:tasks.workunit.client.1.smithi195.stdout:0/444: sync 2024-09-13T17:05:49.162 INFO:tasks.workunit.client.0.smithi115.stdout:5/304: mkdir d19/d2e/d6b 0 2024-09-13T17:05:49.165 INFO:tasks.workunit.client.1.smithi195.stdout:9/516: rename d6/df/d13/d44 to d6/d19/d21/d45/dad 0 2024-09-13T17:05:49.165 INFO:tasks.workunit.client.1.smithi195.stdout:9/517: getdents d6/d12/d86/da7 0 2024-09-13T17:05:49.168 INFO:tasks.workunit.client.1.smithi195.stdout:0/445: write f1 [4406213,50760] 0 2024-09-13T17:05:49.168 INFO:tasks.workunit.client.1.smithi195.stdout:0/446: creat d7/db/d38/d5d/f8f x:0 0 0 2024-09-13T17:05:49.168 INFO:tasks.workunit.client.1.smithi195.stdout:0/447: chown d7/d88/d23/d4b/d56/d46 0 1 2024-09-13T17:05:49.168 INFO:tasks.workunit.client.1.smithi195.stdout:0/448: write d7/db/f81 [106936,34105] 0 2024-09-13T17:05:49.168 INFO:tasks.workunit.client.1.smithi195.stdout:0/449: chown d7/d50/c3e 671502 1 2024-09-13T17:05:49.168 INFO:tasks.workunit.client.1.smithi195.stdout:0/450: truncate d7/d88/d23/f35 4244320 0 2024-09-13T17:05:49.169 INFO:tasks.workunit.client.0.smithi115.stdout:5/305: creat d19/d1d/f6c x:0 0 0 2024-09-13T17:05:49.169 INFO:tasks.workunit.client.0.smithi115.stdout:5/306: creat d19/d21/d3a/f6d x:0 0 0 2024-09-13T17:05:49.174 INFO:tasks.workunit.client.1.smithi195.stdout:9/518: dread d6/d12/d39/f3d [4194304,4194304] 0 2024-09-13T17:05:49.174 INFO:tasks.workunit.client.1.smithi195.stdout:9/519: truncate d6/d19/d21/d45/dad/d47/f9c 69122 0 2024-09-13T17:05:49.175 INFO:tasks.workunit.client.0.smithi115.stdout:5/307: mknod d19/d1d/c6e 0 2024-09-13T17:05:49.177 INFO:tasks.workunit.client.0.smithi115.stdout:7/290: rename d0/d18 to d0/d2/d1e/d3d/d6c 0 2024-09-13T17:05:49.178 INFO:tasks.workunit.client.0.smithi115.stdout:7/291: chown d0/d2/f8 112432 1 2024-09-13T17:05:49.179 INFO:tasks.workunit.client.1.smithi195.stdout:4/531: sync 2024-09-13T17:05:49.179 INFO:tasks.workunit.client.1.smithi195.stdout:7/513: sync 2024-09-13T17:05:49.180 INFO:tasks.workunit.client.0.smithi115.stdout:5/308: link d19/d2b/d32/f3b d19/d21/d62/d63/f6f 0 2024-09-13T17:05:49.183 INFO:tasks.workunit.client.1.smithi195.stdout:5/449: rename d2/d3e/d32 to d2/d12/d4e/d10/d8f 0 2024-09-13T17:05:49.185 INFO:tasks.workunit.client.1.smithi195.stdout:4/532: symlink d1a/d1f/d43/d24/lad 0 2024-09-13T17:05:49.185 INFO:tasks.workunit.client.1.smithi195.stdout:4/533: read d1a/d1f/d21/d22/f3b [119495,60468] 0 2024-09-13T17:05:49.185 INFO:tasks.workunit.client.1.smithi195.stdout:4/534: write d1a/d1f/d21/d22/f28 [672236,63480] 0 2024-09-13T17:05:49.185 INFO:tasks.workunit.client.1.smithi195.stdout:4/535: fsync f7 0 2024-09-13T17:05:49.186 INFO:tasks.workunit.client.0.smithi115.stdout:3/580: dwrite d1/d4b/f4d [0,4194304] 0 2024-09-13T17:05:49.186 INFO:tasks.workunit.client.0.smithi115.stdout:3/581: readlink d1/d4b/l43 0 2024-09-13T17:05:49.186 INFO:tasks.workunit.client.0.smithi115.stdout:1/288: dwrite d5/d60/f5e [0,4194304] 0 2024-09-13T17:05:49.186 INFO:tasks.workunit.client.0.smithi115.stdout:1/289: readlink d5/d26/l27 0 2024-09-13T17:05:49.188 INFO:tasks.workunit.client.0.smithi115.stdout:5/309: rename d19/d21/d62/d63/f6f to d19/d21/d3a/d5d/f70 0 2024-09-13T17:05:49.188 INFO:tasks.workunit.client.0.smithi115.stdout:5/310: read - d19/d1d/f6c zero size 2024-09-13T17:05:49.190 INFO:tasks.workunit.client.1.smithi195.stdout:3/465: dwrite d7/d21/d51/f54 [4194304,4194304] 0 2024-09-13T17:05:49.190 INFO:tasks.workunit.client.0.smithi115.stdout:4/419: dwrite d7/dd/f4d [0,4194304] 0 2024-09-13T17:05:49.190 INFO:tasks.workunit.client.1.smithi195.stdout:9/520: rmdir d6/d19/d21/d5b 39 2024-09-13T17:05:49.194 INFO:tasks.workunit.client.1.smithi195.stdout:5/450: mkdir d2/df/d90 0 2024-09-13T17:05:49.194 INFO:tasks.workunit.client.1.smithi195.stdout:5/451: stat d2/l9 0 2024-09-13T17:05:49.195 INFO:tasks.workunit.client.1.smithi195.stdout:2/485: fsync d0/d4a/d47/d73/d75/d88/d8e/f9b 0 2024-09-13T17:05:49.196 INFO:tasks.workunit.client.0.smithi115.stdout:6/299: dwrite d8/db/d1d/f2b [4194304,4194304] 0 2024-09-13T17:05:49.196 INFO:tasks.workunit.client.0.smithi115.stdout:6/300: write d8/d13/d15/d24/d53/f58 [926055,79907] 0 2024-09-13T17:05:49.196 INFO:tasks.workunit.client.0.smithi115.stdout:6/301: creat d8/d33/d40/f5c x:0 0 0 2024-09-13T17:05:49.196 INFO:tasks.workunit.client.0.smithi115.stdout:6/302: write d8/db/dd/f3a [729893,107751] 0 2024-09-13T17:05:49.197 INFO:tasks.workunit.client.0.smithi115.stdout:5/311: read d19/d21/f22 [940257,93275] 0 2024-09-13T17:05:49.198 INFO:tasks.workunit.client.1.smithi195.stdout:4/536: mknod d1a/d1f/d21/d84/d9d/cae 0 2024-09-13T17:05:49.199 INFO:tasks.workunit.client.0.smithi115.stdout:1/290: dread d5/f6 [0,4194304] 0 2024-09-13T17:05:49.199 INFO:tasks.workunit.client.0.smithi115.stdout:3/582: creat d1/da4/fc6 x:0 0 0 2024-09-13T17:05:49.204 INFO:tasks.workunit.client.1.smithi195.stdout:0/451: dwrite d7/d88/d23/f35 [0,4194304] 0 2024-09-13T17:05:49.206 INFO:tasks.workunit.client.1.smithi195.stdout:5/452: mkdir d2/d12/d4e/d74/d91 0 2024-09-13T17:05:49.207 INFO:tasks.workunit.client.0.smithi115.stdout:6/303: creat d8/db/f5d x:0 0 0 2024-09-13T17:05:49.209 INFO:tasks.workunit.client.1.smithi195.stdout:4/537: mknod d1a/d1f/d43/d5a/caf 0 2024-09-13T17:05:49.210 INFO:tasks.workunit.client.0.smithi115.stdout:1/291: mknod d5/d26/c65 0 2024-09-13T17:05:49.211 INFO:tasks.workunit.client.1.smithi195.stdout:7/514: dwrite d5/d35/f57 [4194304,4194304] 0 2024-09-13T17:05:49.212 INFO:tasks.workunit.client.1.smithi195.stdout:2/486: write d0/d3/f92 [2149558,83422] 0 2024-09-13T17:05:49.212 INFO:tasks.workunit.client.1.smithi195.stdout:3/466: mknod d7/c8a 0 2024-09-13T17:05:49.212 INFO:tasks.workunit.client.1.smithi195.stdout:9/521: dread d6/df/f27 [0,4194304] 0 2024-09-13T17:05:49.212 INFO:tasks.workunit.client.1.smithi195.stdout:3/467: chown d7/d21/d2a/d4a/d5a 0 1 2024-09-13T17:05:49.212 INFO:tasks.workunit.client.1.smithi195.stdout:3/468: chown d7/d21/f59 6802053 1 2024-09-13T17:05:49.212 INFO:tasks.workunit.client.1.smithi195.stdout:3/469: truncate d7/d21/d2a/f32 1334388 0 2024-09-13T17:05:49.213 INFO:tasks.workunit.client.0.smithi115.stdout:4/420: rename d7/dd/de/d57 to d7/dd/d3c/d7b 0 2024-09-13T17:05:49.213 INFO:tasks.workunit.client.0.smithi115.stdout:4/421: truncate d7/dd/f26 27123 0 2024-09-13T17:05:49.214 INFO:tasks.workunit.client.0.smithi115.stdout:4/422: dread d7/dd/f26 [0,4194304] 0 2024-09-13T17:05:49.214 INFO:tasks.workunit.client.0.smithi115.stdout:4/423: fsync d7/dd/de/d4e/f6f 0 2024-09-13T17:05:49.215 INFO:tasks.workunit.client.0.smithi115.stdout:9/215: truncate d0/fb 3681471 0 2024-09-13T17:05:49.215 INFO:tasks.workunit.client.0.smithi115.stdout:9/216: readlink d0/de/d10/d15/l45 0 2024-09-13T17:05:49.215 INFO:tasks.workunit.client.0.smithi115.stdout:9/217: write d0/de/d10/f3e [415071,102603] 0 2024-09-13T17:05:49.215 INFO:tasks.workunit.client.0.smithi115.stdout:9/218: dread - d0/de/d10/d15/f3a zero size 2024-09-13T17:05:49.215 INFO:tasks.workunit.client.0.smithi115.stdout:9/219: creat d0/d34/f4c x:0 0 0 2024-09-13T17:05:49.215 INFO:tasks.workunit.client.0.smithi115.stdout:9/220: stat d0/c39 0 2024-09-13T17:05:49.219 INFO:tasks.workunit.client.1.smithi195.stdout:1/455: sync 2024-09-13T17:05:49.219 INFO:tasks.workunit.client.1.smithi195.stdout:8/499: sync 2024-09-13T17:05:49.220 INFO:tasks.workunit.client.0.smithi115.stdout:3/583: dwrite d1/d4b/d1a/fa2 [0,4194304] 0 2024-09-13T17:05:49.220 INFO:tasks.workunit.client.0.smithi115.stdout:3/584: fdatasync d1/d4b/d1a/d30/fa7 0 2024-09-13T17:05:49.220 INFO:tasks.workunit.client.0.smithi115.stdout:6/304: creat d8/db/d49/f5e x:0 0 0 2024-09-13T17:05:49.220 INFO:tasks.workunit.client.1.smithi195.stdout:0/452: read f1 [810788,37377] 0 2024-09-13T17:05:49.220 INFO:tasks.workunit.client.1.smithi195.stdout:0/453: readlink d7/db/l64 0 2024-09-13T17:05:49.226 INFO:tasks.workunit.client.0.smithi115.stdout:4/424: read d7/dd/f2b [2802225,126969] 0 2024-09-13T17:05:49.226 INFO:tasks.workunit.client.0.smithi115.stdout:4/425: write d7/dd/de/d4e/f50 [571935,46682] 0 2024-09-13T17:05:49.227 INFO:tasks.workunit.client.1.smithi195.stdout:5/453: mkdir d2/df/d48/d5a/d92 0 2024-09-13T17:05:49.227 INFO:tasks.workunit.client.1.smithi195.stdout:5/454: readlink d2/df/d62/l83 0 2024-09-13T17:05:49.229 INFO:tasks.workunit.client.1.smithi195.stdout:4/538: rmdir d1a 39 2024-09-13T17:05:49.233 INFO:tasks.workunit.client.1.smithi195.stdout:7/515: mknod d5/db/caf 0 2024-09-13T17:05:49.234 INFO:tasks.workunit.client.0.smithi115.stdout:7/292: dread d0/f2e [0,4194304] 0 2024-09-13T17:05:49.234 INFO:tasks.workunit.client.0.smithi115.stdout:7/293: creat d0/d2/d1e/d3d/f6d x:0 0 0 2024-09-13T17:05:49.234 INFO:tasks.workunit.client.0.smithi115.stdout:7/294: truncate d0/d2/d1e/d3d/f6d 994646 0 2024-09-13T17:05:49.237 INFO:tasks.workunit.client.1.smithi195.stdout:2/487: dwrite d0/d3/df/f10 [0,4194304] 0 2024-09-13T17:05:49.237 INFO:tasks.workunit.client.1.smithi195.stdout:2/488: chown d0/d4a/d47/d73/d75/d88/d1e/c98 2055984 1 2024-09-13T17:05:49.237 INFO:tasks.workunit.client.1.smithi195.stdout:9/522: dwrite d6/d19/fa8 [0,4194304] 0 2024-09-13T17:05:49.238 INFO:tasks.workunit.client.1.smithi195.stdout:3/470: symlink d7/d21/d2a/d4a/l8b 0 2024-09-13T17:05:49.242 INFO:tasks.workunit.client.0.smithi115.stdout:1/292: unlink d5/f10 0 2024-09-13T17:05:49.243 INFO:tasks.workunit.client.1.smithi195.stdout:8/500: mkdir d0/d17/db0 0 2024-09-13T17:05:49.243 INFO:tasks.workunit.client.1.smithi195.stdout:8/501: stat d0/d17/d2f/d7c/l8a 0 2024-09-13T17:05:49.247 INFO:tasks.workunit.client.1.smithi195.stdout:1/456: symlink db/df/d51/la0 0 2024-09-13T17:05:49.248 INFO:tasks.workunit.client.0.smithi115.stdout:9/221: mknod d0/de/c4d 0 2024-09-13T17:05:49.249 INFO:tasks.workunit.client.1.smithi195.stdout:5/455: write d2/d12/d4e/d10/f23 [59492,99899] 0 2024-09-13T17:05:49.249 INFO:tasks.workunit.client.1.smithi195.stdout:5/456: write d2/df/d78/f4f [129483,124530] 0 2024-09-13T17:05:49.249 INFO:tasks.workunit.client.1.smithi195.stdout:5/457: chown d2/d12/d4e/d10/d8f/c71 175281 1 2024-09-13T17:05:49.249 INFO:tasks.workunit.client.1.smithi195.stdout:5/458: fsync d2/d12/d4e/d10/d46/f64 0 2024-09-13T17:05:49.250 INFO:tasks.workunit.client.1.smithi195.stdout:0/454: symlink d7/d88/d23/d4b/d56/d46/l90 0 2024-09-13T17:05:49.250 INFO:tasks.workunit.client.1.smithi195.stdout:0/455: dread - d7/db/d38/d4f/f8e zero size 2024-09-13T17:05:49.251 INFO:tasks.workunit.client.1.smithi195.stdout:1/457: read db/df/d13/f22 [445045,84987] 0 2024-09-13T17:05:49.256 INFO:tasks.workunit.client.1.smithi195.stdout:7/516: mknod d5/d13/da8/cb0 0 2024-09-13T17:05:49.258 INFO:tasks.workunit.client.0.smithi115.stdout:7/295: dwrite d0/d2/d1e/d3d/d6c/f1f [0,4194304] 0 2024-09-13T17:05:49.261 INFO:tasks.workunit.client.1.smithi195.stdout:0/456: dread d7/d88/d23/d4b/d56/d46/f6e [0,4194304] 0 2024-09-13T17:05:49.263 INFO:tasks.workunit.client.1.smithi195.stdout:9/523: creat d6/d19/d21/d45/dad/d47/d61/fae x:0 0 0 2024-09-13T17:05:49.263 INFO:tasks.workunit.client.1.smithi195.stdout:9/524: chown d6/d19/d21/d64/d68/d6d/fa2 6 1 2024-09-13T17:05:49.266 INFO:tasks.workunit.client.1.smithi195.stdout:2/489: dwrite d0/f6c [0,4194304] 0 2024-09-13T17:05:49.267 INFO:tasks.workunit.client.0.smithi115.stdout:6/305: link d8/db/dd/f3a d8/d13/d15/d24/f5f 0 2024-09-13T17:05:49.268 INFO:tasks.workunit.client.1.smithi195.stdout:8/502: getdents d0/d17/d2f/d7c/d4c/d9b 0 2024-09-13T17:05:49.270 INFO:tasks.workunit.client.0.smithi115.stdout:4/426: rename d7/dd/f2a to d7/dd/de/d4e/d6c/f7c 0 2024-09-13T17:05:49.271 INFO:tasks.workunit.client.1.smithi195.stdout:5/459: truncate d2/df/d78/f44 1374936 0 2024-09-13T17:05:49.272 INFO:tasks.workunit.client.0.smithi115.stdout:3/585: dread d1/d12/d23/f48 [0,4194304] 0 2024-09-13T17:05:49.272 INFO:tasks.workunit.client.0.smithi115.stdout:3/586: chown d1/f10 500007 1 2024-09-13T17:05:49.274 INFO:tasks.workunit.client.1.smithi195.stdout:4/539: dwrite d1a/d1f/d43/d24/d41/fab [0,4194304] 0 2024-09-13T17:05:49.275 INFO:tasks.workunit.client.0.smithi115.stdout:1/293: link d5/c2e d5/d3e/c66 0 2024-09-13T17:05:49.275 INFO:tasks.workunit.client.0.smithi115.stdout:9/222: dwrite d0/de/d10/f44 [0,4194304] 0 2024-09-13T17:05:49.277 INFO:tasks.workunit.client.1.smithi195.stdout:7/517: rename d5/d13/d30/f83 to d5/d13/da8/fb1 0 2024-09-13T17:05:49.279 INFO:tasks.workunit.client.1.smithi195.stdout:0/457: link d7/d50/f5c d7/d88/d23/d4b/d56/d46/f91 0 2024-09-13T17:05:49.279 INFO:tasks.workunit.client.1.smithi195.stdout:0/458: write d7/db/f8c [180031,8296] 0 2024-09-13T17:05:49.281 INFO:tasks.workunit.client.0.smithi115.stdout:4/427: dread d7/dd/de/d4e/f6f [0,4194304] 0 2024-09-13T17:05:49.282 INFO:tasks.workunit.client.1.smithi195.stdout:4/540: write d1a/f4a [1389963,48469] 0 2024-09-13T17:05:49.282 INFO:tasks.workunit.client.1.smithi195.stdout:4/541: fdatasync d1a/d1f/d21/d36/f52 0 2024-09-13T17:05:49.283 INFO:tasks.workunit.client.0.smithi115.stdout:7/296: creat d0/d3b/d50/d21/d25/d44/f6e x:0 0 0 2024-09-13T17:05:49.284 INFO:tasks.workunit.client.1.smithi195.stdout:9/525: symlink d6/df/d16/laf 0 2024-09-13T17:05:49.285 INFO:tasks.workunit.client.0.smithi115.stdout:6/306: mknod d8/d13/d15/d24/d53/c60 0 2024-09-13T17:05:49.286 INFO:tasks.workunit.client.1.smithi195.stdout:3/471: truncate d7/d21/d51/f54 8018128 0 2024-09-13T17:05:49.288 INFO:tasks.workunit.client.1.smithi195.stdout:5/460: dread d2/df/d78/f4f [0,4194304] 0 2024-09-13T17:05:49.289 INFO:tasks.workunit.client.1.smithi195.stdout:2/490: creat d0/d4a/d47/d73/d75/d88/d1e/f9c x:0 0 0 2024-09-13T17:05:49.289 INFO:tasks.workunit.client.1.smithi195.stdout:2/491: write d0/f76 [221805,17426] 0 2024-09-13T17:05:49.290 INFO:tasks.workunit.client.1.smithi195.stdout:0/459: read d7/db/d11/f73 [677031,113112] 0 2024-09-13T17:05:49.291 INFO:tasks.workunit.client.1.smithi195.stdout:8/503: mknod d0/d17/d2f/cb1 0 2024-09-13T17:05:49.291 INFO:tasks.workunit.client.1.smithi195.stdout:6/439: sync 2024-09-13T17:05:49.294 INFO:tasks.workunit.client.0.smithi115.stdout:7/297: write d0/d2/d1e/d3d/d6c/f1f [4182806,8618] 0 2024-09-13T17:05:49.295 INFO:tasks.workunit.client.1.smithi195.stdout:1/458: getdents db/df/d4d 0 2024-09-13T17:05:49.298 INFO:tasks.workunit.client.0.smithi115.stdout:4/428: symlink d7/dd/de/d4e/d5a/l7d 0 2024-09-13T17:05:49.298 INFO:tasks.workunit.client.0.smithi115.stdout:4/429: creat d7/dd/de/d4e/d5a/d4f/f7e x:0 0 0 2024-09-13T17:05:49.298 INFO:tasks.workunit.client.1.smithi195.stdout:8/504: dread d0/d17/d49/f50 [0,4194304] 0 2024-09-13T17:05:49.299 INFO:tasks.workunit.client.1.smithi195.stdout:8/505: chown d0/d17/f56 87668049 1 2024-09-13T17:05:49.300 INFO:tasks.workunit.client.1.smithi195.stdout:8/506: write d0/d17/d2f/d31/f87 [314826,56829] 0 2024-09-13T17:05:49.301 INFO:tasks.workunit.client.0.smithi115.stdout:6/307: creat d8/d33/f61 x:0 0 0 2024-09-13T17:05:49.301 INFO:tasks.workunit.client.0.smithi115.stdout:6/308: truncate d8/d13/d15/d24/f5f 1404259 0 2024-09-13T17:05:49.304 INFO:tasks.workunit.client.0.smithi115.stdout:1/294: dwrite d5/d26/d2c/f32 [0,4194304] 0 2024-09-13T17:05:49.304 INFO:tasks.workunit.client.0.smithi115.stdout:9/223: write d0/f16 [1919030,122976] 0 2024-09-13T17:05:49.305 INFO:tasks.workunit.client.1.smithi195.stdout:4/542: unlink d1a/d1f/d21/d84/d9d/d8e/d9f/fa8 0 2024-09-13T17:05:49.306 INFO:tasks.workunit.client.0.smithi115.stdout:7/298: creat d0/d2/d1e/f6f x:0 0 0 2024-09-13T17:05:49.308 INFO:tasks.workunit.client.1.smithi195.stdout:9/526: creat d6/d8d/fb0 x:0 0 0 2024-09-13T17:05:49.308 INFO:tasks.workunit.client.1.smithi195.stdout:9/527: write d6/df/d16/d5c/f81 [287100,52235] 0 2024-09-13T17:05:49.308 INFO:tasks.workunit.client.1.smithi195.stdout:9/528: chown d6/cd 0 1 2024-09-13T17:05:49.310 INFO:tasks.workunit.client.1.smithi195.stdout:8/507: dread d0/d17/d2f/d7c/f48 [0,4194304] 0 2024-09-13T17:05:49.310 INFO:tasks.workunit.client.1.smithi195.stdout:8/508: dread - d0/d17/f68 zero size 2024-09-13T17:05:49.310 INFO:tasks.workunit.client.1.smithi195.stdout:3/472: rename d7/d21/d66/d7e/f88 to d7/d21/d66/d7e/f8c 0 2024-09-13T17:05:49.311 INFO:tasks.workunit.client.0.smithi115.stdout:6/309: creat d8/d33/d40/d4c/f62 x:0 0 0 2024-09-13T17:05:49.314 INFO:tasks.workunit.client.1.smithi195.stdout:5/461: rename d2/d12/d4e/d10/f7d to d2/d12/f93 0 2024-09-13T17:05:49.318 INFO:tasks.workunit.client.1.smithi195.stdout:0/460: mknod d7/d87/c92 0 2024-09-13T17:05:49.319 INFO:tasks.workunit.client.0.smithi115.stdout:7/299: read d0/d3b/d50/d21/f33 [2697182,56411] 0 2024-09-13T17:05:49.319 INFO:tasks.workunit.client.0.smithi115.stdout:1/295: stat d5/d7/l1c 0 2024-09-13T17:05:49.320 INFO:tasks.workunit.client.1.smithi195.stdout:1/459: truncate db/df/f28 398652 0 2024-09-13T17:05:49.322 INFO:tasks.workunit.client.0.smithi115.stdout:2/579: sync 2024-09-13T17:05:49.322 INFO:tasks.workunit.client.0.smithi115.stdout:2/580: chown d3/f18 235744 1 2024-09-13T17:05:49.322 INFO:tasks.workunit.client.0.smithi115.stdout:2/581: chown d3/d4d/d13/d1c/l80 3495324 1 2024-09-13T17:05:49.322 INFO:tasks.workunit.client.0.smithi115.stdout:6/310: creat d8/d13/d15/d24/f63 x:0 0 0 2024-09-13T17:05:49.325 INFO:tasks.workunit.client.0.smithi115.stdout:1/296: rename d5/f41 to d5/d26/f67 0 2024-09-13T17:05:49.327 INFO:tasks.workunit.client.0.smithi115.stdout:4/430: dwrite d7/dd/de/f59 [0,4194304] 0 2024-09-13T17:05:49.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:48 smithi195 ceph-mon[34981]: pgmap v13: 65 pgs: 65 active+clean; 1.0 GiB data, 3.1 GiB used, 533 GiB / 536 GiB avail; 85 MiB/s rd, 120 MiB/s wr, 598 op/s 2024-09-13T17:05:49.327 INFO:tasks.workunit.client.0.smithi115.stdout:6/311: truncate f5 1688637 0 2024-09-13T17:05:49.328 INFO:tasks.workunit.client.0.smithi115.stdout:1/297: creat d5/d26/d2c/d62/f68 x:0 0 0 2024-09-13T17:05:49.332 INFO:tasks.workunit.client.0.smithi115.stdout:4/431: rename d7/dd/d3c/f40 to d7/f7f 0 2024-09-13T17:05:49.332 INFO:tasks.workunit.client.0.smithi115.stdout:4/432: write d7/dd/de/d4e/d6c/f7c [1137586,84646] 0 2024-09-13T17:05:49.336 INFO:tasks.workunit.client.0.smithi115.stdout:2/582: dread d3/f18 [0,4194304] 0 2024-09-13T17:05:49.336 INFO:tasks.workunit.client.0.smithi115.stdout:6/312: symlink d8/d33/d3f/l64 0 2024-09-13T17:05:49.337 INFO:tasks.workunit.client.1.smithi195.stdout:4/543: dwrite d1a/f1d [0,4194304] 0 2024-09-13T17:05:49.337 INFO:tasks.workunit.client.0.smithi115.stdout:9/224: dwrite d0/d21/f22 [0,4194304] 0 2024-09-13T17:05:49.340 INFO:tasks.workunit.client.1.smithi195.stdout:8/509: dwrite d0/d4/fb [0,4194304] 0 2024-09-13T17:05:49.342 INFO:tasks.workunit.client.0.smithi115.stdout:7/300: dwrite d0/d3b/d50/d21/d2d/f46 [0,4194304] 0 2024-09-13T17:05:49.342 INFO:tasks.workunit.client.0.smithi115.stdout:7/301: stat d0/d2/d1e/f32 0 2024-09-13T17:05:49.342 INFO:tasks.workunit.client.0.smithi115.stdout:7/302: fsync d0/d2/d1e/d3d/d6c/f1f 0 2024-09-13T17:05:49.342 INFO:tasks.workunit.client.0.smithi115.stdout:4/433: link d7/dd/de/l27 d7/dd/de/d4e/d6c/d77/l80 0 2024-09-13T17:05:49.344 INFO:tasks.workunit.client.0.smithi115.stdout:2/583: unlink d3/d4d/dd/faf 0 2024-09-13T17:05:49.347 INFO:tasks.workunit.client.1.smithi195.stdout:8/510: dread d0/d4/fb [0,4194304] 0 2024-09-13T17:05:49.349 INFO:tasks.workunit.client.0.smithi115.stdout:9/225: symlink d0/de/d37/l4e 0 2024-09-13T17:05:49.353 INFO:tasks.workunit.client.0.smithi115.stdout:6/313: dwrite d8/d13/d15/d24/f5f [0,4194304] 0 2024-09-13T17:05:49.354 INFO:tasks.workunit.client.1.smithi195.stdout:8/511: dread d0/f8 [4194304,4194304] 0 2024-09-13T17:05:49.356 INFO:tasks.workunit.client.0.smithi115.stdout:7/303: mkdir d0/d2/d67/d70 0 2024-09-13T17:05:49.359 INFO:tasks.workunit.client.0.smithi115.stdout:4/434: truncate d7/f30 576551 0 2024-09-13T17:05:49.363 INFO:tasks.workunit.client.0.smithi115.stdout:6/314: write d8/d13/d15/d24/f29 [967513,57109] 0 2024-09-13T17:05:49.363 INFO:tasks.workunit.client.0.smithi115.stdout:6/315: fsync d8/d13/d15/d24/f1e 0 2024-09-13T17:05:49.365 INFO:tasks.workunit.client.1.smithi195.stdout:7/518: rmdir d5/db 39 2024-09-13T17:05:49.368 INFO:tasks.workunit.client.1.smithi195.stdout:3/473: link d7/d21/f26 d7/d62/f8d 0 2024-09-13T17:05:49.370 INFO:tasks.workunit.client.0.smithi115.stdout:9/226: dwrite d0/de/d37/f41 [0,4194304] 0 2024-09-13T17:05:49.370 INFO:tasks.workunit.client.0.smithi115.stdout:9/227: stat d0/d21/c32 0 2024-09-13T17:05:49.370 INFO:tasks.workunit.client.0.smithi115.stdout:9/228: fdatasync d0/de/d10/f3e 0 2024-09-13T17:05:49.373 INFO:tasks.workunit.client.1.smithi195.stdout:2/492: rename d0/d4a/d47/d73/d75/d88/d2c/l80 to d0/d3/d3d/l9d 0 2024-09-13T17:05:49.373 INFO:tasks.workunit.client.1.smithi195.stdout:9/529: rename d6/df/d16 to d6/df/d16/d5c/db1 22 2024-09-13T17:05:49.373 INFO:tasks.workunit.client.1.smithi195.stdout:2/493: chown d0/d4a/d47/d73/d75 8112 1 2024-09-13T17:05:49.373 INFO:tasks.workunit.client.1.smithi195.stdout:9/530: chown d6/df/d16/l20 33374 1 2024-09-13T17:05:49.373 INFO:tasks.workunit.client.1.smithi195.stdout:2/494: chown d0/d3 69103918 1 2024-09-13T17:05:49.373 INFO:tasks.workunit.client.1.smithi195.stdout:2/495: creat d0/d3/df/f9e x:0 0 0 2024-09-13T17:05:49.374 INFO:tasks.workunit.client.0.smithi115.stdout:6/316: unlink d8/d13/d15/d24/d17/f38 0 2024-09-13T17:05:49.376 INFO:tasks.workunit.client.1.smithi195.stdout:5/462: mknod d2/df/d48/d5a/d92/c94 0 2024-09-13T17:05:49.378 INFO:tasks.workunit.client.1.smithi195.stdout:0/461: mknod d7/d88/d23/d4b/d56/d46/c93 0 2024-09-13T17:05:49.378 INFO:tasks.workunit.client.1.smithi195.stdout:0/462: dread - d7/d50/f4c zero size 2024-09-13T17:05:49.382 INFO:tasks.workunit.client.1.smithi195.stdout:1/460: truncate db/df/d4d/f52 256274 0 2024-09-13T17:05:49.382 INFO:tasks.workunit.client.1.smithi195.stdout:1/461: dread - db/df/d13/f5b zero size 2024-09-13T17:05:49.382 INFO:tasks.workunit.client.1.smithi195.stdout:1/462: readlink db/l55 0 2024-09-13T17:05:49.383 INFO:tasks.workunit.client.0.smithi115.stdout:4/435: dwrite d7/fc [0,4194304] 0 2024-09-13T17:05:49.384 INFO:tasks.workunit.client.0.smithi115.stdout:2/584: dwrite d3/f8a [0,4194304] 0 2024-09-13T17:05:49.384 INFO:tasks.workunit.client.1.smithi195.stdout:4/544: mknod d1a/d1f/d43/d5a/d63/cb0 0 2024-09-13T17:05:49.385 INFO:tasks.workunit.client.0.smithi115.stdout:9/229: mkdir d0/d21/d4f 0 2024-09-13T17:05:49.389 INFO:tasks.workunit.client.0.smithi115.stdout:7/304: rename d0/d3b/d50/d21/d2d to d0/d2/d1e/d3d/d6c/d71 0 2024-09-13T17:05:49.393 INFO:tasks.workunit.client.0.smithi115.stdout:4/436: rename d7/dd/f33 to d7/dd/f81 0 2024-09-13T17:05:49.396 INFO:tasks.workunit.client.0.smithi115.stdout:7/305: getdents d0/d3b/d50/d21/d25 0 2024-09-13T17:05:49.396 INFO:tasks.workunit.client.0.smithi115.stdout:7/306: chown d0/d2/l3f 30232 1 2024-09-13T17:05:49.396 INFO:tasks.workunit.client.0.smithi115.stdout:2/585: dread d3/f8f [0,4194304] 0 2024-09-13T17:05:49.396 INFO:tasks.workunit.client.0.smithi115.stdout:2/586: read d3/d4d/de/f15 [1226294,33903] 0 2024-09-13T17:05:49.398 INFO:tasks.workunit.client.0.smithi115.stdout:4/437: symlink d7/dd/de/d4e/d5a/l82 0 2024-09-13T17:05:49.399 INFO:tasks.workunit.client.1.smithi195.stdout:7/519: truncate d5/d35/f60 183712 0 2024-09-13T17:05:49.399 INFO:tasks.workunit.client.1.smithi195.stdout:7/520: chown d5/db/d19/c9b 6359 1 2024-09-13T17:05:49.399 INFO:tasks.workunit.client.1.smithi195.stdout:7/521: chown d5/db/d50/d7f 111 1 2024-09-13T17:05:49.401 INFO:tasks.workunit.client.1.smithi195.stdout:3/474: creat d7/d21/d2a/d4a/d5a/f8e x:0 0 0 2024-09-13T17:05:49.402 INFO:tasks.workunit.client.0.smithi115.stdout:2/587: creat d3/d4d/de/d99/fb1 x:0 0 0 2024-09-13T17:05:49.404 INFO:tasks.workunit.client.0.smithi115.stdout:4/438: creat d7/dd/f83 x:0 0 0 2024-09-13T17:05:49.406 INFO:tasks.workunit.client.1.smithi195.stdout:9/531: mknod d6/d19/d21/d64/d68/d6d/cb2 0 2024-09-13T17:05:49.406 INFO:tasks.workunit.client.1.smithi195.stdout:9/532: write d6/d19/d21/d45/dad/d47/d61/fae [495839,105139] 0 2024-09-13T17:05:49.406 INFO:tasks.workunit.client.1.smithi195.stdout:9/533: chown d6/df 56373046 1 2024-09-13T17:05:49.406 INFO:tasks.workunit.client.0.smithi115.stdout:6/317: dwrite d8/d13/d15/d24/f5f [0,4194304] 0 2024-09-13T17:05:49.406 INFO:tasks.workunit.client.0.smithi115.stdout:7/307: symlink d0/d2/d1e/l72 0 2024-09-13T17:05:49.408 INFO:tasks.workunit.client.0.smithi115.stdout:9/230: dwrite d0/f11 [4194304,4194304] 0 2024-09-13T17:05:49.408 INFO:tasks.workunit.client.1.smithi195.stdout:1/463: dwrite db/df/f39 [0,4194304] 0 2024-09-13T17:05:49.409 INFO:tasks.workunit.client.1.smithi195.stdout:2/496: unlink d0/d4a/d47/d73/d75/d88/d2c/d51/l56 0 2024-09-13T17:05:49.409 INFO:tasks.workunit.client.1.smithi195.stdout:9/534: dread d6/d19/d21/d64/f53 [0,4194304] 0 2024-09-13T17:05:49.409 INFO:tasks.workunit.client.1.smithi195.stdout:9/535: fdatasync d6/d19/d21/d45/dad/d47/f9c 0 2024-09-13T17:05:49.410 INFO:tasks.workunit.client.0.smithi115.stdout:2/588: rename d3/d4d/de/c27 to d3/d4d/de/cb2 0 2024-09-13T17:05:49.412 INFO:tasks.workunit.client.0.smithi115.stdout:6/318: creat d8/d13/d15/f65 x:0 0 0 2024-09-13T17:05:49.413 INFO:tasks.workunit.client.1.smithi195.stdout:5/463: mknod d2/df/d62/c95 0 2024-09-13T17:05:49.413 INFO:tasks.workunit.client.1.smithi195.stdout:5/464: creat d2/d12/d4e/d10/d46/f96 x:0 0 0 2024-09-13T17:05:49.413 INFO:tasks.workunit.client.1.smithi195.stdout:5/465: chown d2/d12 48314834 1 2024-09-13T17:05:49.413 INFO:tasks.workunit.client.1.smithi195.stdout:5/466: write d2/df/d78/d54/d58/f60 [452941,6043] 0 2024-09-13T17:05:49.414 INFO:tasks.workunit.client.1.smithi195.stdout:0/463: unlink d7/d50/l6c 0 2024-09-13T17:05:49.417 INFO:tasks.workunit.client.1.smithi195.stdout:4/545: symlink d1a/d1f/d9c/lb1 0 2024-09-13T17:05:49.417 INFO:tasks.workunit.client.1.smithi195.stdout:4/546: fsync d1a/d1f/d21/d22/f26 0 2024-09-13T17:05:49.417 INFO:tasks.workunit.client.1.smithi195.stdout:4/547: fsync d1a/d1f/d21/d36/f7c 0 2024-09-13T17:05:49.418 INFO:tasks.workunit.client.1.smithi195.stdout:4/548: read - d1a/d1f/d43/d24/fa6 zero size 2024-09-13T17:05:49.418 INFO:tasks.workunit.client.1.smithi195.stdout:4/549: dread - d1a/d1f/d21/d36/f52 zero size 2024-09-13T17:05:49.418 INFO:tasks.workunit.client.1.smithi195.stdout:4/550: write d1a/d1f/d21/d84/d9d/d58/d91/faa [385426,86157] 0 2024-09-13T17:05:49.418 INFO:tasks.workunit.client.1.smithi195.stdout:1/464: dread db/df/d13/f4b [0,4194304] 0 2024-09-13T17:05:49.419 INFO:tasks.workunit.client.0.smithi115.stdout:9/231: link d0/f1f d0/d21/d42/f50 0 2024-09-13T17:05:49.419 INFO:tasks.workunit.client.0.smithi115.stdout:9/232: write d0/de/d10/f13 [2288427,28071] 0 2024-09-13T17:05:49.423 INFO:tasks.workunit.client.1.smithi195.stdout:7/522: rename d5/d35/d37/f52 to d5/db/d50/d7f/d82/dad/fb2 0 2024-09-13T17:05:49.427 INFO:tasks.workunit.client.1.smithi195.stdout:3/475: mkdir d7/d21/d2a/d35/d8f 0 2024-09-13T17:05:49.428 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:48 smithi115 ceph-mon[27708]: pgmap v13: 65 pgs: 65 active+clean; 1.0 GiB data, 3.1 GiB used, 533 GiB / 536 GiB avail; 85 MiB/s rd, 120 MiB/s wr, 598 op/s 2024-09-13T17:05:49.429 INFO:tasks.workunit.client.0.smithi115.stdout:6/319: getdents d8 0 2024-09-13T17:05:49.430 INFO:tasks.workunit.client.0.smithi115.stdout:6/320: dread - d8/d33/d3f/f5b zero size 2024-09-13T17:05:49.430 INFO:tasks.workunit.client.0.smithi115.stdout:6/321: chown d8/db/d1d/c47 64 1 2024-09-13T17:05:49.430 INFO:tasks.workunit.client.0.smithi115.stdout:6/322: read - d8/d13/f4e zero size 2024-09-13T17:05:49.430 INFO:tasks.workunit.client.0.smithi115.stdout:6/323: truncate d8/d33/d40/f5c 643506 0 2024-09-13T17:05:49.430 INFO:tasks.workunit.client.0.smithi115.stdout:6/324: chown d8/d13/d15/d24/d17 6 1 2024-09-13T17:05:49.431 INFO:tasks.workunit.client.1.smithi195.stdout:2/497: rmdir d0/d4a/d47/d73/d75/d7e 39 2024-09-13T17:05:49.432 INFO:tasks.workunit.client.0.smithi115.stdout:7/308: mkdir d0/d2/d1e/d73 0 2024-09-13T17:05:49.435 INFO:tasks.workunit.client.1.smithi195.stdout:4/551: mkdir d1a/d1f/d21/d84/d9d/d8e/d9f/db2 0 2024-09-13T17:05:49.436 INFO:tasks.workunit.client.1.smithi195.stdout:4/552: readlink d1a/d1f/d21/d36/l79 0 2024-09-13T17:05:49.436 INFO:tasks.workunit.client.1.smithi195.stdout:4/553: truncate d1a/d1f/d21/d84/d9d/d58/d91/f96 673029 0 2024-09-13T17:05:49.437 INFO:tasks.workunit.client.0.smithi115.stdout:4/439: dwrite d7/dd/d3c/f58 [0,4194304] 0 2024-09-13T17:05:49.438 INFO:tasks.workunit.client.1.smithi195.stdout:5/467: dwrite d2/df/d78/d54/f73 [0,4194304] 0 2024-09-13T17:05:49.438 INFO:tasks.workunit.client.1.smithi195.stdout:9/536: dwrite d6/d19/d21/d5b/f50 [0,4194304] 0 2024-09-13T17:05:49.438 INFO:tasks.workunit.client.1.smithi195.stdout:9/537: write d6/d19/d21/f7c [243683,94712] 0 2024-09-13T17:05:49.439 INFO:tasks.workunit.client.1.smithi195.stdout:1/465: link db/d60/c6e db/d19/d37/d3e/ca1 0 2024-09-13T17:05:49.441 INFO:tasks.workunit.client.0.smithi115.stdout:9/233: rename d0/d21/l23 to d0/de/l51 0 2024-09-13T17:05:49.441 INFO:tasks.workunit.client.1.smithi195.stdout:6/440: sync 2024-09-13T17:05:49.443 INFO:tasks.workunit.client.1.smithi195.stdout:0/464: rename d7/d88/d23/d4b/d56/c2d to d7/d50/c94 0 2024-09-13T17:05:49.443 INFO:tasks.workunit.client.1.smithi195.stdout:0/465: read - d7/d88/d23/d4b/d56/d46/f74 zero size 2024-09-13T17:05:49.444 INFO:tasks.workunit.client.0.smithi115.stdout:2/589: getdents d3 0 2024-09-13T17:05:49.445 INFO:tasks.workunit.client.1.smithi195.stdout:7/523: creat d5/db/d19/fb3 x:0 0 0 2024-09-13T17:05:49.445 INFO:tasks.workunit.client.1.smithi195.stdout:7/524: chown d5/d13/da8/fb1 452 1 2024-09-13T17:05:49.445 INFO:tasks.workunit.client.1.smithi195.stdout:7/525: creat d5/db/d19/fb4 x:0 0 0 2024-09-13T17:05:49.446 INFO:tasks.workunit.client.0.smithi115.stdout:6/325: mkdir d8/d33/d40/d4c/d66 0 2024-09-13T17:05:49.449 INFO:tasks.workunit.client.1.smithi195.stdout:3/476: unlink d7/d21/d2a/f3b 0 2024-09-13T17:05:49.449 INFO:tasks.workunit.client.1.smithi195.stdout:3/477: write d7/d21/d2a/d4a/f7a [256759,68960] 0 2024-09-13T17:05:49.449 INFO:tasks.workunit.client.1.smithi195.stdout:3/478: readlink d7/d21/l5e 0 2024-09-13T17:05:49.451 INFO:tasks.workunit.client.0.smithi115.stdout:7/309: symlink d0/d3b/d50/d21/d25/l74 0 2024-09-13T17:05:49.452 INFO:tasks.workunit.client.1.smithi195.stdout:2/498: mknod d0/d4a/d47/d73/d75/d88/c9f 0 2024-09-13T17:05:49.457 INFO:tasks.workunit.client.1.smithi195.stdout:4/554: unlink d1a/d1f/d43/d24/c2c 0 2024-09-13T17:05:49.459 INFO:tasks.workunit.client.1.smithi195.stdout:6/441: dwrite d1c/d24/d49/d5f/d35/f45 [0,4194304] 0 2024-09-13T17:05:49.467 INFO:tasks.workunit.client.1.smithi195.stdout:2/499: dwrite d0/d3/f96 [0,4194304] 0 2024-09-13T17:05:49.469 INFO:tasks.workunit.client.1.smithi195.stdout:6/442: write d1c/d24/d49/d5f/f50 [325113,18667] 0 2024-09-13T17:05:49.476 INFO:tasks.workunit.client.1.smithi195.stdout:6/443: dread f17 [0,4194304] 0 2024-09-13T17:05:49.476 INFO:tasks.workunit.client.1.smithi195.stdout:6/444: fsync d1c/d24/d49/d5f/f6a 0 2024-09-13T17:05:49.480 INFO:tasks.workunit.client.1.smithi195.stdout:5/468: rename d2/d3e/c18 to d2/d12/c97 0 2024-09-13T17:05:49.482 INFO:tasks.workunit.client.0.smithi115.stdout:9/234: creat d0/d21/d42/f52 x:0 0 0 2024-09-13T17:05:49.483 INFO:tasks.workunit.client.1.smithi195.stdout:0/466: creat d7/d88/d23/d4b/f95 x:0 0 0 2024-09-13T17:05:49.483 INFO:tasks.workunit.client.1.smithi195.stdout:0/467: write d7/d50/f1c [3021191,89096] 0 2024-09-13T17:05:49.485 INFO:tasks.workunit.client.0.smithi115.stdout:2/590: truncate d3/d4d/d13/d39/f5d 1410994 0 2024-09-13T17:05:49.487 INFO:tasks.workunit.client.0.smithi115.stdout:6/326: mkdir d8/d33/d40/d67 0 2024-09-13T17:05:49.488 INFO:tasks.workunit.client.1.smithi195.stdout:7/526: rmdir d5/d13/d24/d70 39 2024-09-13T17:05:49.489 INFO:tasks.workunit.client.0.smithi115.stdout:7/310: mknod d0/c75 0 2024-09-13T17:05:49.490 INFO:tasks.workunit.client.1.smithi195.stdout:3/479: unlink d7/d21/d2a/d35/d60/d64/f7d 0 2024-09-13T17:05:49.491 INFO:tasks.workunit.client.1.smithi195.stdout:3/480: chown d7/d21/d2a/d35/d60 2 1 2024-09-13T17:05:49.491 INFO:tasks.workunit.client.0.smithi115.stdout:9/235: unlink d0/d34/f49 0 2024-09-13T17:05:49.493 INFO:tasks.workunit.client.1.smithi195.stdout:4/555: symlink d1a/d1f/d21/d84/d9d/d8e/d9f/lb3 0 2024-09-13T17:05:49.494 INFO:tasks.workunit.client.0.smithi115.stdout:2/591: symlink d3/d4d/d13/d39/d55/lb3 0 2024-09-13T17:05:49.497 INFO:tasks.workunit.client.0.smithi115.stdout:6/327: link d8/d13/d15/d24/l36 d8/d33/d40/d4c/l68 0 2024-09-13T17:05:49.497 INFO:tasks.workunit.client.0.smithi115.stdout:6/328: fsync d8/d13/d15/d24/f63 0 2024-09-13T17:05:49.504 INFO:tasks.workunit.client.0.smithi115.stdout:9/236: link d0/d21/c27 d0/d21/d4f/c53 0 2024-09-13T17:05:49.504 INFO:tasks.workunit.client.0.smithi115.stdout:9/237: stat d0/f11 0 2024-09-13T17:05:49.504 INFO:tasks.workunit.client.0.smithi115.stdout:9/238: chown d0/l40 3948 1 2024-09-13T17:05:49.504 INFO:tasks.workunit.client.0.smithi115.stdout:9/239: chown d0/de/d10/f13 320294875 1 2024-09-13T17:05:49.504 INFO:tasks.workunit.client.0.smithi115.stdout:6/329: write d8/db/ff [6773573,105103] 0 2024-09-13T17:05:49.504 INFO:tasks.workunit.client.0.smithi115.stdout:6/330: dread - d8/d33/d3f/f5b zero size 2024-09-13T17:05:49.505 INFO:tasks.workunit.client.0.smithi115.stdout:2/592: rename d3/fa5 to d3/d4d/de/d99/d9a/fb4 0 2024-09-13T17:05:49.505 INFO:tasks.workunit.client.0.smithi115.stdout:2/593: dread - d3/d4d/dd/f96 zero size 2024-09-13T17:05:49.507 INFO:tasks.workunit.client.1.smithi195.stdout:2/500: link d0/c72 d0/d4a/ca0 0 2024-09-13T17:05:49.507 INFO:tasks.workunit.client.1.smithi195.stdout:2/501: creat d0/d4a/d47/d73/d75/fa1 x:0 0 0 2024-09-13T17:05:49.509 INFO:tasks.workunit.client.0.smithi115.stdout:7/311: link d0/d2/f8 d0/d2/d1e/f76 0 2024-09-13T17:05:49.512 INFO:tasks.workunit.client.1.smithi195.stdout:6/445: mkdir d1c/d2d/d5e/d91 0 2024-09-13T17:05:49.512 INFO:tasks.workunit.client.0.smithi115.stdout:0/288: sync 2024-09-13T17:05:49.512 INFO:tasks.workunit.client.0.smithi115.stdout:0/289: chown d9/d1d/f42 15441 1 2024-09-13T17:05:49.513 INFO:tasks.workunit.client.0.smithi115.stdout:8/333: sync 2024-09-13T17:05:49.513 INFO:tasks.workunit.client.0.smithi115.stdout:8/334: chown d0/d18/d19/d28/l31 4271575 1 2024-09-13T17:05:49.513 INFO:tasks.workunit.client.0.smithi115.stdout:8/335: creat d0/d18/d43/f6c x:0 0 0 2024-09-13T17:05:49.513 INFO:tasks.workunit.client.0.smithi115.stdout:8/336: creat d0/d15/d3e/f6d x:0 0 0 2024-09-13T17:05:49.513 INFO:tasks.workunit.client.1.smithi195.stdout:8/512: sync 2024-09-13T17:05:49.513 INFO:tasks.workunit.client.1.smithi195.stdout:8/513: write d0/f61 [5051448,108327] 0 2024-09-13T17:05:49.514 INFO:tasks.workunit.client.0.smithi115.stdout:6/331: symlink d8/db/l69 0 2024-09-13T17:05:49.515 INFO:tasks.workunit.client.1.smithi195.stdout:3/481: dwrite d7/d21/f59 [0,4194304] 0 2024-09-13T17:05:49.515 INFO:tasks.workunit.client.1.smithi195.stdout:4/556: dwrite d1a/d1f/d21/f6a [0,4194304] 0 2024-09-13T17:05:49.518 INFO:tasks.workunit.client.0.smithi115.stdout:9/240: read d0/de/d10/f14 [4376513,74563] 0 2024-09-13T17:05:49.518 INFO:tasks.workunit.client.0.smithi115.stdout:9/241: readlink d0/de/d10/d15/l45 0 2024-09-13T17:05:49.518 INFO:tasks.workunit.client.0.smithi115.stdout:9/242: chown d0/d21/d42 25 1 2024-09-13T17:05:49.519 INFO:tasks.workunit.client.1.smithi195.stdout:5/469: mknod d2/df/d90/c98 0 2024-09-13T17:05:49.520 INFO:tasks.workunit.client.1.smithi195.stdout:5/470: dread - d2/df/d86/f7f zero size 2024-09-13T17:05:49.520 INFO:tasks.workunit.client.1.smithi195.stdout:5/471: stat d2/df/f1c 0 2024-09-13T17:05:49.520 INFO:tasks.workunit.client.1.smithi195.stdout:5/472: chown d2/l3c 42248101 1 2024-09-13T17:05:49.523 INFO:tasks.workunit.client.0.smithi115.stdout:0/290: mknod d9/d1d/d24/d26/d2d/d30/c52 0 2024-09-13T17:05:49.528 INFO:tasks.workunit.client.1.smithi195.stdout:0/468: mkdir d7/d88/d23/d96 0 2024-09-13T17:05:49.531 INFO:tasks.workunit.client.1.smithi195.stdout:7/527: creat d5/db/d19/d22/fb5 x:0 0 0 2024-09-13T17:05:49.532 INFO:tasks.workunit.client.0.smithi115.stdout:8/337: mknod d0/d26/c6e 0 2024-09-13T17:05:49.535 INFO:tasks.workunit.client.0.smithi115.stdout:9/243: mknod d0/d21/d4f/c54 0 2024-09-13T17:05:49.536 INFO:tasks.workunit.client.1.smithi195.stdout:6/446: getdents d1c/d3e/d6b 0 2024-09-13T17:05:49.537 INFO:tasks.workunit.client.1.smithi195.stdout:4/557: dread d1a/d1f/d43/f50 [0,4194304] 0 2024-09-13T17:05:49.537 INFO:tasks.workunit.client.0.smithi115.stdout:7/312: rmdir d0/d3b/d50/d21/d25/d44 39 2024-09-13T17:05:49.538 INFO:tasks.workunit.client.0.smithi115.stdout:7/313: getdents d0/d2/d1e/d73 0 2024-09-13T17:05:49.538 INFO:tasks.workunit.client.0.smithi115.stdout:7/314: dread - d0/d3b/d50/f47 zero size 2024-09-13T17:05:49.538 INFO:tasks.workunit.client.0.smithi115.stdout:7/315: fdatasync d0/d3b/d50/f47 0 2024-09-13T17:05:49.542 INFO:tasks.workunit.client.0.smithi115.stdout:0/291: creat d9/d1d/d24/d26/d2d/d30/d46/f53 x:0 0 0 2024-09-13T17:05:49.543 INFO:tasks.workunit.client.0.smithi115.stdout:0/292: write d9/d1b/f23 [153142,70199] 0 2024-09-13T17:05:49.543 INFO:tasks.workunit.client.1.smithi195.stdout:2/502: dwrite d0/d3/f92 [0,4194304] 0 2024-09-13T17:05:49.543 INFO:tasks.workunit.client.1.smithi195.stdout:2/503: creat d0/d4a/d47/d73/d75/fa2 x:0 0 0 2024-09-13T17:05:49.545 INFO:tasks.workunit.client.1.smithi195.stdout:8/514: truncate d0/d17/d2f/d31/f3f 2884043 0 2024-09-13T17:05:49.545 INFO:tasks.workunit.client.0.smithi115.stdout:6/332: dwrite d8/db/d1d/f26 [0,4194304] 0 2024-09-13T17:05:49.547 INFO:tasks.workunit.client.1.smithi195.stdout:3/482: dwrite d7/d62/f8d [0,4194304] 0 2024-09-13T17:05:49.547 INFO:tasks.workunit.client.1.smithi195.stdout:3/483: write d7/d67/f6c [59631,13323] 0 2024-09-13T17:05:49.547 INFO:tasks.workunit.client.1.smithi195.stdout:3/484: write d7/d21/d2a/d35/d60/d6f/f83 [251905,50322] 0 2024-09-13T17:05:49.550 INFO:tasks.workunit.client.0.smithi115.stdout:7/316: creat d0/d2/d1e/f77 x:0 0 0 2024-09-13T17:05:49.550 INFO:tasks.workunit.client.0.smithi115.stdout:7/317: dread - d0/d2/d1e/d3d/d6c/f4c zero size 2024-09-13T17:05:49.551 INFO:tasks.workunit.client.0.smithi115.stdout:8/338: dread d0/fb [0,4194304] 0 2024-09-13T17:05:49.552 INFO:tasks.workunit.client.0.smithi115.stdout:0/293: symlink d9/d1d/d24/d26/d2d/l54 0 2024-09-13T17:05:49.558 INFO:tasks.workunit.client.0.smithi115.stdout:6/333: mkdir d8/d13/d15/d24/d53/d6a 0 2024-09-13T17:05:49.558 INFO:tasks.workunit.client.0.smithi115.stdout:6/334: fdatasync d8/db/d49/f5e 0 2024-09-13T17:05:49.558 INFO:tasks.workunit.client.1.smithi195.stdout:9/538: rename d6/d19/f36 to d6/fb3 0 2024-09-13T17:05:49.559 INFO:tasks.workunit.client.1.smithi195.stdout:9/539: write d6/d12/d39/f89 [482071,49214] 0 2024-09-13T17:05:49.559 INFO:tasks.workunit.client.1.smithi195.stdout:5/473: mkdir d2/df/d78/d99 0 2024-09-13T17:05:49.559 INFO:tasks.workunit.client.0.smithi115.stdout:7/318: mkdir d0/d2/d4a/d78 0 2024-09-13T17:05:49.559 INFO:tasks.workunit.client.1.smithi195.stdout:0/469: symlink d7/db/d11/l97 0 2024-09-13T17:05:49.560 INFO:tasks.workunit.client.0.smithi115.stdout:8/339: creat d0/d42/f6f x:0 0 0 2024-09-13T17:05:49.560 INFO:tasks.workunit.client.0.smithi115.stdout:8/340: truncate d0/d15/d3e/f6d 723079 0 2024-09-13T17:05:49.562 INFO:tasks.workunit.client.0.smithi115.stdout:7/319: dread d0/d3b/d50/d21/d25/f2c [0,4194304] 0 2024-09-13T17:05:49.562 INFO:tasks.workunit.client.1.smithi195.stdout:4/558: mkdir d1a/d1f/d21/d7e/db4 0 2024-09-13T17:05:49.562 INFO:tasks.workunit.client.1.smithi195.stdout:4/559: creat d1a/d1f/d21/d22/fb5 x:0 0 0 2024-09-13T17:05:49.562 INFO:tasks.workunit.client.1.smithi195.stdout:4/560: chown f0 121640013 1 2024-09-13T17:05:49.562 INFO:tasks.workunit.client.1.smithi195.stdout:4/561: truncate d1a/d1f/d43/d24/d41/f8d 4285925 0 2024-09-13T17:05:49.563 INFO:tasks.workunit.client.0.smithi115.stdout:6/335: unlink d8/d13/d15/d24/d53/f58 0 2024-09-13T17:05:49.564 INFO:tasks.workunit.client.0.smithi115.stdout:7/320: creat d0/d3b/d50/d21/d2f/f79 x:0 0 0 2024-09-13T17:05:49.565 INFO:tasks.workunit.client.1.smithi195.stdout:5/474: dread d2/d3e/f16 [0,4194304] 0 2024-09-13T17:05:49.565 INFO:tasks.workunit.client.1.smithi195.stdout:5/475: read d2/d12/d4e/d10/f2f [1346542,89765] 0 2024-09-13T17:05:49.565 INFO:tasks.workunit.client.1.smithi195.stdout:8/515: mknod d0/d13/d52/cb2 0 2024-09-13T17:05:49.567 INFO:tasks.workunit.client.0.smithi115.stdout:9/244: dwrite d0/d21/d42/f50 [0,4194304] 0 2024-09-13T17:05:49.567 INFO:tasks.workunit.client.0.smithi115.stdout:9/245: fsync d0/de/d10/f14 0 2024-09-13T17:05:49.567 INFO:tasks.workunit.client.0.smithi115.stdout:6/336: rename d8/d13/d15/d24/d53/c60 to d8/d13/c6b 0 2024-09-13T17:05:49.568 INFO:tasks.workunit.client.1.smithi195.stdout:2/504: dwrite d0/d4a/d47/d73/d75/d88/d2c/d51/f79 [0,4194304] 0 2024-09-13T17:05:49.568 INFO:tasks.workunit.client.1.smithi195.stdout:2/505: creat d0/d4a/d47/d73/d75/d88/d2c/d43/d84/fa3 x:0 0 0 2024-09-13T17:05:49.569 INFO:tasks.workunit.client.0.smithi115.stdout:2/594: dwrite d3/d4d/d13/d39/f5d [0,4194304] 0 2024-09-13T17:05:49.569 INFO:tasks.workunit.client.0.smithi115.stdout:7/321: symlink d0/d2/d1e/d3d/d6c/l7a 0 2024-09-13T17:05:49.569 INFO:tasks.workunit.client.0.smithi115.stdout:7/322: read - d0/d2/d1e/f6f zero size 2024-09-13T17:05:49.569 INFO:tasks.workunit.client.0.smithi115.stdout:7/323: fsync d0/d3b/f6a 0 2024-09-13T17:05:49.570 INFO:tasks.workunit.client.0.smithi115.stdout:7/324: write d0/d2/d1e/d3d/d6c/f4c [574795,105048] 0 2024-09-13T17:05:49.570 INFO:tasks.workunit.client.0.smithi115.stdout:7/325: chown d0/d2/d1e 1384 1 2024-09-13T17:05:49.571 INFO:tasks.workunit.client.0.smithi115.stdout:8/341: dread d0/d18/f2e [0,4194304] 0 2024-09-13T17:05:49.571 INFO:tasks.workunit.client.0.smithi115.stdout:8/342: dread - d0/d18/f56 zero size 2024-09-13T17:05:49.572 INFO:tasks.workunit.client.0.smithi115.stdout:9/246: link d0/de/d10/d15/c4b d0/d34/c55 0 2024-09-13T17:05:49.574 INFO:tasks.workunit.client.0.smithi115.stdout:6/337: unlink d8/d33/d40/f30 0 2024-09-13T17:05:49.581 INFO:tasks.workunit.client.1.smithi195.stdout:2/506: dwrite d0/d4a/d47/d73/d75/d88/d2c/f8d [0,4194304] 0 2024-09-13T17:05:49.582 INFO:tasks.workunit.client.0.smithi115.stdout:9/247: dread d0/f16 [0,4194304] 0 2024-09-13T17:05:49.582 INFO:tasks.workunit.client.0.smithi115.stdout:9/248: read - d0/d21/f36 zero size 2024-09-13T17:05:49.583 INFO:tasks.workunit.client.0.smithi115.stdout:7/326: write d0/d3b/f6a [1035761,46974] 0 2024-09-13T17:05:49.583 INFO:tasks.workunit.client.0.smithi115.stdout:7/327: dread - d0/d2/d1e/f6f zero size 2024-09-13T17:05:49.583 INFO:tasks.workunit.client.1.smithi195.stdout:7/528: rename d5/db/d19/d22/f38 to d5/d13/da8/fb6 0 2024-09-13T17:05:49.583 INFO:tasks.workunit.client.1.smithi195.stdout:4/562: rename d1a/d1f/d21 to d1a/d1f/d21/d84/d9d/db6 22 2024-09-13T17:05:49.585 INFO:tasks.workunit.client.1.smithi195.stdout:9/540: unlink d6/df/d16/c84 0 2024-09-13T17:05:49.587 INFO:tasks.workunit.client.1.smithi195.stdout:0/470: symlink d7/d88/d23/d4b/d56/d4d/l98 0 2024-09-13T17:05:49.587 INFO:tasks.workunit.client.1.smithi195.stdout:0/471: write d7/d88/d23/f4a [969714,121318] 0 2024-09-13T17:05:49.587 INFO:tasks.workunit.client.1.smithi195.stdout:0/472: write d7/d88/d23/f4a [581882,90176] 0 2024-09-13T17:05:49.588 INFO:tasks.workunit.client.0.smithi115.stdout:2/595: symlink d3/d4d/d13/d1c/lb5 0 2024-09-13T17:05:49.590 INFO:tasks.workunit.client.0.smithi115.stdout:8/343: link d0/d21/d3a/f3f d0/d15/d44/f70 0 2024-09-13T17:05:49.591 INFO:tasks.workunit.client.1.smithi195.stdout:5/476: mknod d2/df/d48/d5a/d92/c9a 0 2024-09-13T17:05:49.591 INFO:tasks.workunit.client.1.smithi195.stdout:5/477: fdatasync d2/d12/d4e/f3b 0 2024-09-13T17:05:49.592 INFO:tasks.workunit.client.0.smithi115.stdout:6/338: link d8/d13/d15/c2e d8/db/dd/c6c 0 2024-09-13T17:05:49.592 INFO:tasks.workunit.client.0.smithi115.stdout:6/339: write d8/f51 [5199103,73796] 0 2024-09-13T17:05:49.593 INFO:tasks.workunit.client.1.smithi195.stdout:4/563: dread d1a/d1f/d21/d84/d9d/f3f [0,4194304] 0 2024-09-13T17:05:49.595 INFO:tasks.workunit.client.0.smithi115.stdout:7/328: symlink d0/l7b 0 2024-09-13T17:05:49.598 INFO:tasks.workunit.client.1.smithi195.stdout:0/473: write d7/d88/d23/d4b/d56/d46/f49 [1421873,24937] 0 2024-09-13T17:05:49.600 INFO:tasks.workunit.client.0.smithi115.stdout:2/596: unlink d3/d4d/dd/d1f/d2f/d56/c69 0 2024-09-13T17:05:49.600 INFO:tasks.workunit.client.0.smithi115.stdout:2/597: creat d3/d4d/dd/d1f/fb6 x:0 0 0 2024-09-13T17:05:49.601 INFO:tasks.workunit.client.0.smithi115.stdout:8/344: mkdir d0/d18/d19/d28/d71 0 2024-09-13T17:05:49.601 INFO:tasks.workunit.client.0.smithi115.stdout:8/345: dread - d0/d21/d3a/f3f zero size 2024-09-13T17:05:49.602 INFO:tasks.workunit.client.0.smithi115.stdout:9/249: dwrite d0/de/d10/d15/f24 [0,4194304] 0 2024-09-13T17:05:49.603 INFO:tasks.workunit.client.0.smithi115.stdout:9/250: chown d0/c2f 1611833 1 2024-09-13T17:05:49.604 INFO:tasks.workunit.client.1.smithi195.stdout:1/466: sync 2024-09-13T17:05:49.604 INFO:tasks.workunit.client.1.smithi195.stdout:1/467: fsync db/df/f7f 0 2024-09-13T17:05:49.604 INFO:tasks.workunit.client.1.smithi195.stdout:1/468: fsync db/d19/d37/f4e 0 2024-09-13T17:05:49.605 INFO:tasks.workunit.client.0.smithi115.stdout:6/340: unlink c4 0 2024-09-13T17:05:49.606 INFO:tasks.workunit.client.1.smithi195.stdout:5/478: dwrite d2/d12/d4e/f5b [0,4194304] 0 2024-09-13T17:05:49.608 INFO:tasks.workunit.client.1.smithi195.stdout:8/516: rename d0/d17/d2f/d7c/d4c/d67/d9d to d0/d17/d49/d63/db3 0 2024-09-13T17:05:49.608 INFO:tasks.workunit.client.1.smithi195.stdout:8/517: write d0/d17/d2f/d7c/d4c/d67/fa3 [717231,60942] 0 2024-09-13T17:05:49.610 INFO:tasks.workunit.client.0.smithi115.stdout:7/329: mkdir d0/d2/d1e/d3d/d7c 0 2024-09-13T17:05:49.610 INFO:tasks.workunit.client.0.smithi115.stdout:7/330: dread - d0/f56 zero size 2024-09-13T17:05:49.610 INFO:tasks.workunit.client.1.smithi195.stdout:1/469: write db/df/f16 [846359,84316] 0 2024-09-13T17:05:49.610 INFO:tasks.workunit.client.1.smithi195.stdout:1/470: creat db/fa2 x:0 0 0 2024-09-13T17:05:49.611 INFO:tasks.workunit.client.1.smithi195.stdout:7/529: creat d5/db/d19/d22/d3c/fb7 x:0 0 0 2024-09-13T17:05:49.613 INFO:tasks.workunit.client.1.smithi195.stdout:9/541: truncate d6/d19/d21/d64/f53 837055 0 2024-09-13T17:05:49.613 INFO:tasks.workunit.client.1.smithi195.stdout:1/471: dread db/f6b [0,4194304] 0 2024-09-13T17:05:49.614 INFO:tasks.workunit.client.0.smithi115.stdout:2/598: truncate d3/d4d/de/f10 3198500 0 2024-09-13T17:05:49.615 INFO:tasks.workunit.client.1.smithi195.stdout:0/474: creat d7/d87/f99 x:0 0 0 2024-09-13T17:05:49.617 INFO:tasks.workunit.client.0.smithi115.stdout:8/346: mkdir d0/d26/d29/d59/d72 0 2024-09-13T17:05:49.619 INFO:tasks.workunit.client.0.smithi115.stdout:9/251: link d0/d21/c32 d0/de/d10/d15/c56 0 2024-09-13T17:05:49.621 INFO:tasks.workunit.client.0.smithi115.stdout:6/341: dwrite d8/d13/d15/d24/f63 [0,4194304] 0 2024-09-13T17:05:49.622 INFO:tasks.workunit.client.0.smithi115.stdout:6/342: dread - d8/d33/d40/f5a zero size 2024-09-13T17:05:49.622 INFO:tasks.workunit.client.0.smithi115.stdout:6/343: dread - d8/d13/d15/f4f zero size 2024-09-13T17:05:49.622 INFO:tasks.workunit.client.0.smithi115.stdout:6/344: chown d8/d13/d15/c2e 5110 1 2024-09-13T17:05:49.622 INFO:tasks.workunit.client.0.smithi115.stdout:6/345: chown d8/d13/d15/d24/c48 5226 1 2024-09-13T17:05:49.622 INFO:tasks.workunit.client.0.smithi115.stdout:6/346: readlink d8/db/l14 0 2024-09-13T17:05:49.622 INFO:tasks.workunit.client.1.smithi195.stdout:5/479: mknod d2/df/c9b 0 2024-09-13T17:05:49.623 INFO:tasks.workunit.client.0.smithi115.stdout:2/599: symlink d3/d4d/d13/d39/d46/d70/lb7 0 2024-09-13T17:05:49.625 INFO:tasks.workunit.client.1.smithi195.stdout:2/507: rename d0/d3/df/l89 to d0/d4a/d47/d73/d94/la4 0 2024-09-13T17:05:49.626 INFO:tasks.workunit.client.0.smithi115.stdout:8/347: symlink d0/d18/d51/l73 0 2024-09-13T17:05:49.632 INFO:tasks.workunit.client.0.smithi115.stdout:7/331: rename d0/c75 to d0/d2/d1e/c7d 0 2024-09-13T17:05:49.638 INFO:tasks.workunit.client.1.smithi195.stdout:7/530: rmdir d5/db/d50/d7f 39 2024-09-13T17:05:49.638 INFO:tasks.workunit.client.1.smithi195.stdout:7/531: fdatasync d5/db/d19/d22/fb5 0 2024-09-13T17:05:49.640 INFO:tasks.workunit.client.1.smithi195.stdout:9/542: link d6/d19/d21/d64/d68/c8b d6/d19/d21/d45/dad/d5e/cb4 0 2024-09-13T17:05:49.642 INFO:tasks.workunit.client.0.smithi115.stdout:9/252: symlink d0/l57 0 2024-09-13T17:05:49.642 INFO:tasks.workunit.client.0.smithi115.stdout:9/253: creat d0/d21/f58 x:0 0 0 2024-09-13T17:05:49.642 INFO:tasks.workunit.client.0.smithi115.stdout:9/254: fsync d0/de/d10/f46 0 2024-09-13T17:05:49.642 INFO:tasks.workunit.client.1.smithi195.stdout:1/472: getdents db/d60/d73 0 2024-09-13T17:05:49.643 INFO:tasks.workunit.client.0.smithi115.stdout:7/332: mkdir d0/d2/d67/d70/d7e 0 2024-09-13T17:05:49.645 INFO:tasks.workunit.client.0.smithi115.stdout:8/348: dwrite d0/d18/f2e [0,4194304] 0 2024-09-13T17:05:49.645 INFO:tasks.workunit.client.0.smithi115.stdout:8/349: getdents d0/d18/d43/d5a 0 2024-09-13T17:05:49.645 INFO:tasks.workunit.client.0.smithi115.stdout:8/350: dread - d0/d42/f6f zero size 2024-09-13T17:05:49.645 INFO:tasks.workunit.client.0.smithi115.stdout:6/347: dwrite d8/db/d1d/f2b [0,4194304] 0 2024-09-13T17:05:49.647 INFO:tasks.workunit.client.1.smithi195.stdout:0/475: mkdir d7/db/d9a 0 2024-09-13T17:05:49.647 INFO:tasks.workunit.client.1.smithi195.stdout:0/476: chown d7/d88/d23/d4b/d56/d4d/d5e/f70 219165 1 2024-09-13T17:05:49.647 INFO:tasks.workunit.client.1.smithi195.stdout:0/477: dread - d7/d87/f99 zero size 2024-09-13T17:05:49.647 INFO:tasks.workunit.client.1.smithi195.stdout:0/478: write d7/d88/d23/d4b/d4e/d68/f79 [649706,85647] 0 2024-09-13T17:05:49.647 INFO:tasks.workunit.client.1.smithi195.stdout:0/479: chown d7/d88/d23/d4b/d56/d4d/d5e 1884244 1 2024-09-13T17:05:49.653 INFO:tasks.workunit.client.1.smithi195.stdout:5/480: symlink d2/df/d62/l9c 0 2024-09-13T17:05:49.655 INFO:tasks.workunit.client.0.smithi115.stdout:9/255: rename d0/de/f28 to d0/d21/f59 0 2024-09-13T17:05:49.658 INFO:tasks.workunit.client.0.smithi115.stdout:7/333: mknod d0/d3b/c7f 0 2024-09-13T17:05:49.660 INFO:tasks.workunit.client.1.smithi195.stdout:4/564: rename d1a/d1f/d21/d84/d9d/d58/d91/faa to d1a/d1f/d21/d22/fb7 0 2024-09-13T17:05:49.663 INFO:tasks.workunit.client.1.smithi195.stdout:2/508: mknod d0/d3/d3d/ca5 0 2024-09-13T17:05:49.666 INFO:tasks.workunit.client.0.smithi115.stdout:6/348: link d8/d13/c3c d8/db/c6d 0 2024-09-13T17:05:49.666 INFO:tasks.workunit.client.0.smithi115.stdout:6/349: creat d8/d13/d15/f6e x:0 0 0 2024-09-13T17:05:49.666 INFO:tasks.workunit.client.0.smithi115.stdout:6/350: creat d8/db/f6f x:0 0 0 2024-09-13T17:05:49.667 INFO:tasks.workunit.client.1.smithi195.stdout:8/518: mkdir d0/d17/d2f/d31/db4 0 2024-09-13T17:05:49.670 INFO:tasks.workunit.client.1.smithi195.stdout:7/532: symlink d5/db/d19/d22/lb8 0 2024-09-13T17:05:49.676 INFO:tasks.workunit.client.1.smithi195.stdout:9/543: truncate d6/d19/d21/f60 226966 0 2024-09-13T17:05:49.676 INFO:tasks.workunit.client.0.smithi115.stdout:9/256: mkdir d0/de/d37/d5a 0 2024-09-13T17:05:49.678 INFO:tasks.workunit.client.1.smithi195.stdout:4/565: mkdir d1a/d1f/d43/d5a/d63/db8 0 2024-09-13T17:05:49.682 INFO:tasks.workunit.client.1.smithi195.stdout:7/533: symlink d5/db/d50/d7f/d82/da1/lb9 0 2024-09-13T17:05:49.685 INFO:tasks.workunit.client.0.smithi115.stdout:6/351: getdents d8/db/d49 0 2024-09-13T17:05:49.685 INFO:tasks.workunit.client.1.smithi195.stdout:4/566: mkdir d1a/d1f/d43/d5a/d63/db8/db9 0 2024-09-13T17:05:49.685 INFO:tasks.workunit.client.1.smithi195.stdout:4/567: stat d1a/d1f/d21/d22/f4d 0 2024-09-13T17:05:49.686 INFO:tasks.workunit.client.1.smithi195.stdout:2/509: rmdir d0/d4a/d47/d73/d75/d88/d8e 39 2024-09-13T17:05:49.686 INFO:tasks.workunit.client.1.smithi195.stdout:1/473: dwrite db/df/d4d/d74/f7c [0,4194304] 0 2024-09-13T17:05:49.686 INFO:tasks.workunit.client.1.smithi195.stdout:2/510: fsync d0/d3/f82 0 2024-09-13T17:05:49.686 INFO:tasks.workunit.client.1.smithi195.stdout:2/511: write d0/d4a/d47/d73/d75/d88/d2c/d43/f5e [175066,72081] 0 2024-09-13T17:05:49.688 INFO:tasks.workunit.client.1.smithi195.stdout:2/512: read d0/d4a/d47/d73/d75/d88/d2c/d43/f5e [45280,65372] 0 2024-09-13T17:05:49.688 INFO:tasks.workunit.client.1.smithi195.stdout:2/513: truncate d0/d3/f82 809664 0 2024-09-13T17:05:49.688 INFO:tasks.workunit.client.1.smithi195.stdout:7/534: creat d5/d13/d24/fba x:0 0 0 2024-09-13T17:05:49.688 INFO:tasks.workunit.client.1.smithi195.stdout:7/535: dread - d5/d13/d30/f8a zero size 2024-09-13T17:05:49.688 INFO:tasks.workunit.client.0.smithi115.stdout:5/312: sync 2024-09-13T17:05:49.688 INFO:tasks.workunit.client.0.smithi115.stdout:5/313: truncate d19/d2b/f6a 797392 0 2024-09-13T17:05:49.688 INFO:tasks.workunit.client.0.smithi115.stdout:5/314: write d19/d21/d3a/f6d [268561,98397] 0 2024-09-13T17:05:49.689 INFO:tasks.workunit.client.0.smithi115.stdout:6/352: getdents d8/d13/d15/d24/d17 0 2024-09-13T17:05:49.691 INFO:tasks.workunit.client.1.smithi195.stdout:0/480: rename d7/d88/d23/d4b to d7/d87/d9b 0 2024-09-13T17:05:49.693 INFO:tasks.workunit.client.0.smithi115.stdout:5/315: mknod d19/d21/c71 0 2024-09-13T17:05:49.696 INFO:tasks.workunit.client.0.smithi115.stdout:9/257: dwrite d0/de/f1e [0,4194304] 0 2024-09-13T17:05:49.696 INFO:tasks.workunit.client.1.smithi195.stdout:4/568: unlink d1a/d1f/d21/c73 0 2024-09-13T17:05:49.696 INFO:tasks.workunit.client.0.smithi115.stdout:5/316: symlink d19/d2b/d32/l72 0 2024-09-13T17:05:49.697 INFO:tasks.workunit.client.0.smithi115.stdout:5/317: chown d19/d2b/d32/l48 44 1 2024-09-13T17:05:49.697 INFO:tasks.workunit.client.1.smithi195.stdout:5/481: dwrite d2/df/d78/d54/d58/f69 [0,4194304] 0 2024-09-13T17:05:49.700 INFO:tasks.workunit.client.1.smithi195.stdout:1/474: dread db/d19/d5a/f83 [0,4194304] 0 2024-09-13T17:05:49.700 INFO:tasks.workunit.client.0.smithi115.stdout:8/351: dwrite d0/d18/d43/f6c [0,4194304] 0 2024-09-13T17:05:49.700 INFO:tasks.workunit.client.0.smithi115.stdout:8/352: chown d0/d18/d19/d2b/l5e 1 1 2024-09-13T17:05:49.703 INFO:tasks.workunit.client.1.smithi195.stdout:0/481: dread d7/d88/d23/f62 [0,4194304] 0 2024-09-13T17:05:49.706 INFO:tasks.workunit.client.0.smithi115.stdout:5/318: getdents d19/d2c 0 2024-09-13T17:05:49.707 INFO:tasks.workunit.client.0.smithi115.stdout:5/319: chown d19/d1d/f6c 476 1 2024-09-13T17:05:49.707 INFO:tasks.workunit.client.1.smithi195.stdout:2/514: write d0/d3/f92 [3140257,92708] 0 2024-09-13T17:05:49.714 INFO:tasks.workunit.client.0.smithi115.stdout:8/353: mknod d0/d15/d3e/c74 0 2024-09-13T17:05:49.715 INFO:tasks.workunit.client.0.smithi115.stdout:8/354: write d0/d15/d3e/f47 [791839,55634] 0 2024-09-13T17:05:49.715 INFO:tasks.workunit.client.0.smithi115.stdout:2/600: dwrite d3/d4d/de/f10 [0,4194304] 0 2024-09-13T17:05:49.716 INFO:tasks.workunit.client.1.smithi195.stdout:7/536: mknod d5/db/d19/cbb 0 2024-09-13T17:05:49.716 INFO:tasks.workunit.client.1.smithi195.stdout:7/537: chown d5/db/d19/d22/f6c 364090837 1 2024-09-13T17:05:49.716 INFO:tasks.workunit.client.1.smithi195.stdout:7/538: write d5/d35/d37/f4a [769769,114685] 0 2024-09-13T17:05:49.718 INFO:tasks.workunit.client.0.smithi115.stdout:5/320: dread d19/d1d/f20 [0,4194304] 0 2024-09-13T17:05:49.721 INFO:tasks.workunit.client.0.smithi115.stdout:5/321: dread d19/d1d/f26 [0,4194304] 0 2024-09-13T17:05:49.721 INFO:tasks.workunit.client.0.smithi115.stdout:5/322: chown l11 1216932086 1 2024-09-13T17:05:49.721 INFO:tasks.workunit.client.0.smithi115.stdout:5/323: chown d19/d2e/d6b 15978 1 2024-09-13T17:05:49.721 INFO:tasks.workunit.client.0.smithi115.stdout:5/324: truncate d19/d21/d3a/f6d 880051 0 2024-09-13T17:05:49.723 INFO:tasks.workunit.client.1.smithi195.stdout:0/482: link d7/db/d38/d5d/l6b d7/db/d11/l9c 0 2024-09-13T17:05:49.724 INFO:tasks.workunit.client.1.smithi195.stdout:8/519: dwrite d0/d17/d49/f50 [0,4194304] 0 2024-09-13T17:05:49.726 INFO:tasks.workunit.client.0.smithi115.stdout:5/325: mknod d19/d2c/c73 0 2024-09-13T17:05:49.727 INFO:tasks.workunit.client.0.smithi115.stdout:5/326: readlink d19/d2b/d32/d55/d5e/l42 0 2024-09-13T17:05:49.729 INFO:tasks.workunit.client.1.smithi195.stdout:2/515: rename d0/d4a/c27 to d0/d3/ca6 0 2024-09-13T17:05:49.730 INFO:tasks.workunit.client.1.smithi195.stdout:4/569: getdents d1a/d1f/d43/d24 0 2024-09-13T17:05:49.730 INFO:tasks.workunit.client.1.smithi195.stdout:4/570: creat d1a/d1f/d43/d24/d41/d60/fba x:0 0 0 2024-09-13T17:05:49.733 INFO:tasks.workunit.client.1.smithi195.stdout:7/539: mknod d5/d13/d30/cbc 0 2024-09-13T17:05:49.735 INFO:tasks.workunit.client.1.smithi195.stdout:7/540: link d5/db/d19/d22/d3c/l85 d5/d35/lbd 0 2024-09-13T17:05:49.736 INFO:tasks.workunit.client.1.smithi195.stdout:7/541: chown d5/d13/d24/l88 1512 1 2024-09-13T17:05:49.736 INFO:tasks.workunit.client.0.smithi115.stdout:7/334: dwrite d0/d2/d1e/f39 [0,4194304] 0 2024-09-13T17:05:49.739 INFO:tasks.workunit.client.1.smithi195.stdout:7/542: link d5/d13/d24/d70/c86 d5/d35/d37/cbe 0 2024-09-13T17:05:49.739 INFO:tasks.workunit.client.1.smithi195.stdout:4/571: dread f19 [0,4194304] 0 2024-09-13T17:05:49.742 INFO:tasks.workunit.client.1.smithi195.stdout:7/543: dread d5/db/d19/d22/f6b [0,4194304] 0 2024-09-13T17:05:49.754 INFO:tasks.workunit.client.0.smithi115.stdout:9/258: dwrite d0/d21/f36 [0,4194304] 0 2024-09-13T17:05:49.754 INFO:tasks.workunit.client.0.smithi115.stdout:9/259: chown d0/de/l51 4991935 1 2024-09-13T17:05:49.770 INFO:tasks.workunit.client.1.smithi195.stdout:2/516: dwrite d0/f21 [0,4194304] 0 2024-09-13T17:05:49.771 INFO:tasks.workunit.client.1.smithi195.stdout:9/544: dwrite d6/f7 [0,4194304] 0 2024-09-13T17:05:49.771 INFO:tasks.workunit.client.1.smithi195.stdout:9/545: creat d6/d19/d21/d64/d68/d6d/fb5 x:0 0 0 2024-09-13T17:05:49.771 INFO:tasks.workunit.client.1.smithi195.stdout:9/546: chown d6/d19/d21/d45/dad/d47 26696 1 2024-09-13T17:05:49.772 INFO:tasks.workunit.client.1.smithi195.stdout:2/517: unlink d0/d4a/d47/d73/d94/la4 0 2024-09-13T17:05:49.774 INFO:tasks.workunit.client.0.smithi115.stdout:6/353: dwrite d8/d33/f61 [0,4194304] 0 2024-09-13T17:05:49.774 INFO:tasks.workunit.client.0.smithi115.stdout:6/354: dread - d8/d33/d40/d4c/f62 zero size 2024-09-13T17:05:49.775 INFO:tasks.workunit.client.1.smithi195.stdout:9/547: rename d6/f1e to d6/d19/d21/d45/fb6 0 2024-09-13T17:05:49.776 INFO:tasks.workunit.client.0.smithi115.stdout:2/601: dwrite d3/f8f [4194304,4194304] 0 2024-09-13T17:05:49.776 INFO:tasks.workunit.client.0.smithi115.stdout:5/327: dwrite f16 [0,4194304] 0 2024-09-13T17:05:49.776 INFO:tasks.workunit.client.1.smithi195.stdout:5/482: dwrite d2/df/f81 [4194304,4194304] 0 2024-09-13T17:05:49.776 INFO:tasks.workunit.client.1.smithi195.stdout:0/483: dwrite d7/d87/d9b/d4e/f65 [0,4194304] 0 2024-09-13T17:05:49.776 INFO:tasks.workunit.client.1.smithi195.stdout:5/483: write d2/d12/d4e/d10/d8f/f84 [557617,1808] 0 2024-09-13T17:05:49.782 INFO:tasks.workunit.client.0.smithi115.stdout:9/260: dwrite d0/de/d10/f44 [0,4194304] 0 2024-09-13T17:05:49.784 INFO:tasks.workunit.client.1.smithi195.stdout:7/544: dread d5/d35/d37/f4a [0,4194304] 0 2024-09-13T17:05:49.784 INFO:tasks.workunit.client.1.smithi195.stdout:7/545: fsync d5/db/d50/f81 0 2024-09-13T17:05:49.785 INFO:tasks.workunit.client.1.smithi195.stdout:9/548: creat d6/d19/d21/d45/dad/d5e/da0/fb7 x:0 0 0 2024-09-13T17:05:49.789 INFO:tasks.workunit.client.0.smithi115.stdout:6/355: unlink d8/d13/d15/d24/c48 0 2024-09-13T17:05:49.790 INFO:tasks.workunit.client.0.smithi115.stdout:6/356: write d8/d33/f55 [809368,53605] 0 2024-09-13T17:05:49.790 INFO:tasks.workunit.client.1.smithi195.stdout:3/485: sync 2024-09-13T17:05:49.790 INFO:tasks.workunit.client.1.smithi195.stdout:6/447: sync 2024-09-13T17:05:49.791 INFO:tasks.workunit.client.1.smithi195.stdout:6/448: creat d1c/d2d/d30/f92 x:0 0 0 2024-09-13T17:05:49.793 INFO:tasks.workunit.client.0.smithi115.stdout:8/355: rmdir d0/d15/d3e 39 2024-09-13T17:05:49.793 INFO:tasks.workunit.client.0.smithi115.stdout:8/356: creat d0/d15/d44/f75 x:0 0 0 2024-09-13T17:05:49.793 INFO:tasks.workunit.client.0.smithi115.stdout:8/357: fsync d0/d15/d3e/f47 0 2024-09-13T17:05:49.794 INFO:tasks.workunit.client.0.smithi115.stdout:9/261: dread d0/d21/f36 [0,4194304] 0 2024-09-13T17:05:49.802 INFO:tasks.workunit.client.1.smithi195.stdout:5/484: link d2/l3c d2/df/l9d 0 2024-09-13T17:05:49.802 INFO:tasks.workunit.client.1.smithi195.stdout:5/485: dread - d2/df/d48/d5a/f8c zero size 2024-09-13T17:05:49.805 INFO:tasks.workunit.client.1.smithi195.stdout:9/549: mknod d6/d12/cb8 0 2024-09-13T17:05:49.805 INFO:tasks.workunit.client.1.smithi195.stdout:9/550: creat d6/df/d72/fb9 x:0 0 0 2024-09-13T17:05:49.808 INFO:tasks.workunit.client.1.smithi195.stdout:5/486: dread d2/df/fa [0,4194304] 0 2024-09-13T17:05:49.808 INFO:tasks.workunit.client.1.smithi195.stdout:2/518: dwrite d0/d4a/d47/d73/d75/d88/f23 [0,4194304] 0 2024-09-13T17:05:49.808 INFO:tasks.workunit.client.1.smithi195.stdout:2/519: creat d0/d3/fa7 x:0 0 0 2024-09-13T17:05:49.813 INFO:tasks.workunit.client.1.smithi195.stdout:3/486: write d7/d21/d2a/d4a/d5a/f63 [452457,125708] 0 2024-09-13T17:05:49.813 INFO:tasks.workunit.client.1.smithi195.stdout:3/487: chown d7/d21/l4e 185 1 2024-09-13T17:05:49.815 INFO:tasks.workunit.client.1.smithi195.stdout:9/551: link d6/df/d16/cab d6/df/d16/d65/cba 0 2024-09-13T17:05:49.817 INFO:tasks.workunit.client.1.smithi195.stdout:5/487: symlink d2/df/d78/l9e 0 2024-09-13T17:05:49.820 INFO:tasks.workunit.client.1.smithi195.stdout:3/488: truncate d7/d21/d2a/f4b 528347 0 2024-09-13T17:05:49.821 INFO:tasks.workunit.client.1.smithi195.stdout:9/552: mknod d6/df/d16/cbb 0 2024-09-13T17:05:49.822 INFO:tasks.workunit.client.1.smithi195.stdout:3/489: truncate d7/d21/f4f 2396743 0 2024-09-13T17:05:49.824 INFO:tasks.workunit.client.0.smithi115.stdout:8/358: mkdir d0/d21/d76 0 2024-09-13T17:05:49.825 INFO:tasks.workunit.client.0.smithi115.stdout:8/359: link d0/l3 d0/l77 0 2024-09-13T17:05:49.826 INFO:tasks.workunit.client.0.smithi115.stdout:8/360: readlink d0/d26/d29/l6a 0 2024-09-13T17:05:49.828 INFO:tasks.workunit.client.1.smithi195.stdout:9/553: write d6/d12/f8a [2423092,109310] 0 2024-09-13T17:05:49.839 INFO:tasks.workunit.client.1.smithi195.stdout:5/488: dread d2/f26 [0,4194304] 0 2024-09-13T17:05:49.840 INFO:tasks.workunit.client.1.smithi195.stdout:5/489: mknod d2/df/d48/d5a/d92/c9f 0 2024-09-13T17:05:49.847 INFO:tasks.workunit.client.0.smithi115.stdout:2/602: dwrite d3/d4d/dd/d1f/d2f/d56/f9e [0,4194304] 0 2024-09-13T17:05:49.850 INFO:tasks.workunit.client.0.smithi115.stdout:2/603: unlink d3/c11 0 2024-09-13T17:05:49.851 INFO:tasks.workunit.client.0.smithi115.stdout:2/604: unlink d3/d4d/dd/df/d5b/f7a 0 2024-09-13T17:05:49.852 INFO:tasks.workunit.client.0.smithi115.stdout:2/605: truncate d3/d4d/dd/d1f/d2f/d56/f9b 4726371 0 2024-09-13T17:05:49.853 INFO:tasks.workunit.client.1.smithi195.stdout:5/490: dread d2/d12/d4e/f3b [0,4194304] 0 2024-09-13T17:05:49.855 INFO:tasks.workunit.client.1.smithi195.stdout:5/491: creat d2/d12/d4e/d10/d8f/fa0 x:0 0 0 2024-09-13T17:05:49.855 INFO:tasks.workunit.client.1.smithi195.stdout:6/449: dwrite d1c/d24/d49/d5f/d35/f36 [0,4194304] 0 2024-09-13T17:05:49.855 INFO:tasks.workunit.client.1.smithi195.stdout:0/484: dwrite d7/db/d11/f73 [4194304,4194304] 0 2024-09-13T17:05:49.855 INFO:tasks.workunit.client.1.smithi195.stdout:0/485: fsync d7/d88/f59 0 2024-09-13T17:05:49.855 INFO:tasks.workunit.client.1.smithi195.stdout:0/486: truncate d7/db/d38/d5d/f72 71843 0 2024-09-13T17:05:49.856 INFO:tasks.workunit.client.1.smithi195.stdout:7/546: dwrite d5/d35/d37/f46 [0,4194304] 0 2024-09-13T17:05:49.856 INFO:tasks.workunit.client.0.smithi115.stdout:5/328: dwrite d19/d2b/d32/d55/f57 [0,4194304] 0 2024-09-13T17:05:49.857 INFO:tasks.workunit.client.0.smithi115.stdout:6/357: dwrite d8/db/d49/f4d [0,4194304] 0 2024-09-13T17:05:49.857 INFO:tasks.workunit.client.0.smithi115.stdout:6/358: creat d8/db/f70 x:0 0 0 2024-09-13T17:05:49.857 INFO:tasks.workunit.client.0.smithi115.stdout:9/262: dwrite d0/f8 [0,4194304] 0 2024-09-13T17:05:49.857 INFO:tasks.workunit.client.0.smithi115.stdout:9/263: fdatasync d0/de/d37/f41 0 2024-09-13T17:05:49.858 INFO:tasks.workunit.client.0.smithi115.stdout:8/361: dwrite d0/fb [4194304,4194304] 0 2024-09-13T17:05:49.858 INFO:tasks.workunit.client.0.smithi115.stdout:8/362: chown d0/d18/d51/c5d 99 1 2024-09-13T17:05:49.859 INFO:tasks.workunit.client.1.smithi195.stdout:5/492: mkdir d2/d12/d4e/d10/d5c/da1 0 2024-09-13T17:05:49.859 INFO:tasks.workunit.client.1.smithi195.stdout:5/493: readlink d2/d12/d4e/d10/d46/l1e 0 2024-09-13T17:05:49.859 INFO:tasks.workunit.client.1.smithi195.stdout:2/520: dwrite d0/d4a/d47/d73/d75/d88/d1e/f2a [4194304,4194304] 0 2024-09-13T17:05:49.859 INFO:tasks.workunit.client.1.smithi195.stdout:2/521: stat d0/d4a/d47/d73/d75/d7e 0 2024-09-13T17:05:49.859 INFO:tasks.workunit.client.1.smithi195.stdout:2/522: chown d0/d4a/d47/d73/d75/d88/d62/f7d 5633 1 2024-09-13T17:05:49.861 INFO:tasks.workunit.client.0.smithi115.stdout:2/606: dread d3/d4d/de/f37 [0,4194304] 0 2024-09-13T17:05:49.862 INFO:tasks.workunit.client.1.smithi195.stdout:6/450: truncate f1a 1985416 0 2024-09-13T17:05:49.862 INFO:tasks.workunit.client.1.smithi195.stdout:6/451: fsync ff 0 2024-09-13T17:05:49.862 INFO:tasks.workunit.client.1.smithi195.stdout:6/452: readlink d1c/l2c 0 2024-09-13T17:05:49.862 INFO:tasks.workunit.client.1.smithi195.stdout:6/453: stat d1c/d3e/d6b/d8a 0 2024-09-13T17:05:49.863 INFO:tasks.workunit.client.1.smithi195.stdout:6/454: stat c9 0 2024-09-13T17:05:49.866 INFO:tasks.workunit.client.0.smithi115.stdout:5/329: read d19/d2b/d32/d55/f5a [346339,38028] 0 2024-09-13T17:05:49.867 INFO:tasks.workunit.client.1.smithi195.stdout:0/487: mkdir d7/d87/d9b/d56/d4d/d9d 0 2024-09-13T17:05:49.867 INFO:tasks.workunit.client.1.smithi195.stdout:2/523: dread d0/d4a/d47/d73/d75/d88/d2c/d51/f81 [0,4194304] 0 2024-09-13T17:05:49.871 INFO:tasks.workunit.client.1.smithi195.stdout:7/547: dread d5/db/d19/d22/f5d [0,4194304] 0 2024-09-13T17:05:49.872 INFO:tasks.workunit.client.1.smithi195.stdout:7/548: write d5/db/d19/d22/f62 [1363099,53826] 0 2024-09-13T17:05:49.872 INFO:tasks.workunit.client.0.smithi115.stdout:6/359: rename f5 to d8/d33/d40/d4c/f71 0 2024-09-13T17:05:49.875 INFO:tasks.workunit.client.0.smithi115.stdout:8/363: creat d0/d21/d3a/d60/f78 x:0 0 0 2024-09-13T17:05:49.876 INFO:tasks.workunit.client.1.smithi195.stdout:2/524: write d0/d3/f96 [826196,58985] 0 2024-09-13T17:05:49.876 INFO:tasks.workunit.client.1.smithi195.stdout:2/525: creat d0/d3/fa8 x:0 0 0 2024-09-13T17:05:49.877 INFO:tasks.workunit.client.1.smithi195.stdout:2/526: readlink d0/d4a/d47/d73/d75/d88/d2c/d43/l6d 0 2024-09-13T17:05:49.877 INFO:tasks.workunit.client.1.smithi195.stdout:2/527: dread - d0/d4a/d47/d73/d75/d88/d2c/d43/d84/f87 zero size 2024-09-13T17:05:49.878 INFO:tasks.workunit.client.0.smithi115.stdout:9/264: dwrite d0/f16 [0,4194304] 0 2024-09-13T17:05:49.878 INFO:tasks.workunit.client.0.smithi115.stdout:2/607: mknod d3/d4d/dd/df/d5b/cb8 0 2024-09-13T17:05:49.879 INFO:tasks.workunit.client.0.smithi115.stdout:5/330: mknod d19/d21/d62/c74 0 2024-09-13T17:05:49.882 INFO:tasks.workunit.client.1.smithi195.stdout:5/494: unlink d2/d12/d4e/c37 0 2024-09-13T17:05:49.884 INFO:tasks.workunit.client.0.smithi115.stdout:6/360: symlink d8/db/d1d/l72 0 2024-09-13T17:05:49.886 INFO:tasks.workunit.client.0.smithi115.stdout:8/364: truncate d0/d15/d3e/f69 1022104 0 2024-09-13T17:05:49.886 INFO:tasks.workunit.client.0.smithi115.stdout:8/365: fsync d0/d15/d44/f75 0 2024-09-13T17:05:49.889 INFO:tasks.workunit.client.0.smithi115.stdout:9/265: symlink d0/d34/l5b 0 2024-09-13T17:05:49.892 INFO:tasks.workunit.client.0.smithi115.stdout:2/608: getdents d3/d4d/dd/df/d57 0 2024-09-13T17:05:49.893 INFO:tasks.workunit.client.1.smithi195.stdout:0/488: rmdir d7 39 2024-09-13T17:05:49.893 INFO:tasks.workunit.client.0.smithi115.stdout:8/366: symlink d0/d18/l79 0 2024-09-13T17:05:49.893 INFO:tasks.workunit.client.0.smithi115.stdout:8/367: read d0/fc [1335842,97058] 0 2024-09-13T17:05:49.894 INFO:tasks.workunit.client.0.smithi115.stdout:6/361: write d8/d13/d15/d24/f63 [148146,63534] 0 2024-09-13T17:05:49.894 INFO:tasks.workunit.client.0.smithi115.stdout:6/362: dread - d8/db/f5d zero size 2024-09-13T17:05:49.895 INFO:tasks.workunit.client.1.smithi195.stdout:7/549: truncate d5/db/d19/f18 863404 0 2024-09-13T17:05:49.897 INFO:tasks.workunit.client.0.smithi115.stdout:2/609: creat d3/d4d/d13/d6b/fb9 x:0 0 0 2024-09-13T17:05:49.899 INFO:tasks.workunit.client.0.smithi115.stdout:8/368: truncate d0/d18/f1c 203827 0 2024-09-13T17:05:49.899 INFO:tasks.workunit.client.0.smithi115.stdout:8/369: creat d0/d21/d3a/d60/f7a x:0 0 0 2024-09-13T17:05:49.899 INFO:tasks.workunit.client.1.smithi195.stdout:2/528: dwrite d0/d4a/d47/d73/d75/d88/d8e/f9b [0,4194304] 0 2024-09-13T17:05:49.899 INFO:tasks.workunit.client.0.smithi115.stdout:9/266: write d0/de/d10/f44 [3089900,86514] 0 2024-09-13T17:05:49.902 INFO:tasks.workunit.client.0.smithi115.stdout:5/331: dwrite d19/d2b/f50 [0,4194304] 0 2024-09-13T17:05:49.902 INFO:tasks.workunit.client.1.smithi195.stdout:5/495: link d2/d12/f75 d2/d3e/fa2 0 2024-09-13T17:05:49.903 INFO:tasks.workunit.client.0.smithi115.stdout:6/363: symlink d8/d33/d40/l73 0 2024-09-13T17:05:49.904 INFO:tasks.workunit.client.1.smithi195.stdout:0/489: creat d7/d87/d9b/d56/d46/f9e x:0 0 0 2024-09-13T17:05:49.904 INFO:tasks.workunit.client.1.smithi195.stdout:0/490: chown d7/d87/d9b/d56/l36 42114 1 2024-09-13T17:05:49.906 INFO:tasks.workunit.client.0.smithi115.stdout:2/610: unlink d3/d4d/dd/d1f/d2f/d56/d58/f7f 0 2024-09-13T17:05:49.907 INFO:tasks.workunit.client.1.smithi195.stdout:7/550: symlink d5/d13/d30/lbf 0 2024-09-13T17:05:49.908 INFO:tasks.workunit.client.0.smithi115.stdout:8/370: dread d0/d18/f65 [0,4194304] 0 2024-09-13T17:05:49.908 INFO:tasks.workunit.client.0.smithi115.stdout:8/371: creat d0/d18/d43/f7b x:0 0 0 2024-09-13T17:05:49.908 INFO:tasks.workunit.client.0.smithi115.stdout:8/372: write d0/d18/f65 [2218973,124358] 0 2024-09-13T17:05:49.908 INFO:tasks.workunit.client.0.smithi115.stdout:8/373: chown d0/d18/d19/d2b/l5e 194340843 1 2024-09-13T17:05:49.913 INFO:tasks.workunit.client.0.smithi115.stdout:9/267: rename d0/de/d10/f13 to d0/de/f5c 0 2024-09-13T17:05:49.914 INFO:tasks.workunit.client.1.smithi195.stdout:6/455: dread f1a [0,4194304] 0 2024-09-13T17:05:49.914 INFO:tasks.workunit.client.1.smithi195.stdout:2/529: creat d0/d4a/fa9 x:0 0 0 2024-09-13T17:05:49.917 INFO:tasks.workunit.client.1.smithi195.stdout:7/551: getdents d5/db/d50/d7f/d82/dad 0 2024-09-13T17:05:49.918 INFO:tasks.workunit.client.0.smithi115.stdout:5/332: mkdir d19/d75 0 2024-09-13T17:05:49.919 INFO:tasks.workunit.client.1.smithi195.stdout:6/456: mknod d1c/d2d/d5e/d91/c93 0 2024-09-13T17:05:49.920 INFO:tasks.workunit.client.1.smithi195.stdout:6/457: dread - d1c/d24/d49/d5f/f58 zero size 2024-09-13T17:05:49.920 INFO:tasks.workunit.client.0.smithi115.stdout:6/364: rmdir d8/d13 39 2024-09-13T17:05:49.920 INFO:tasks.workunit.client.0.smithi115.stdout:6/365: fsync d8/d13/d15/d24/d53/f54 0 2024-09-13T17:05:49.920 INFO:tasks.workunit.client.0.smithi115.stdout:6/366: dread - d8/d13/f4e zero size 2024-09-13T17:05:49.922 INFO:tasks.workunit.client.0.smithi115.stdout:2/611: mkdir d3/d4d/d13/da2/dba 0 2024-09-13T17:05:49.922 INFO:tasks.workunit.client.1.smithi195.stdout:5/496: getdents d2/df/d78/d76 0 2024-09-13T17:05:49.925 INFO:tasks.workunit.client.1.smithi195.stdout:7/552: rename d5/d13/f1d to d5/d35/d37/fc0 0 2024-09-13T17:05:49.927 INFO:tasks.workunit.client.1.smithi195.stdout:2/530: getdents d0/d4a/d47/d73/d75/d88/d2c/d43/d63 0 2024-09-13T17:05:49.928 INFO:tasks.workunit.client.1.smithi195.stdout:0/491: dwrite d7/db/f8c [0,4194304] 0 2024-09-13T17:05:49.929 INFO:tasks.workunit.client.0.smithi115.stdout:8/374: mknod d0/d18/c7c 0 2024-09-13T17:05:49.929 INFO:tasks.workunit.client.0.smithi115.stdout:8/375: write d0/d15/d44/f61 [154617,124397] 0 2024-09-13T17:05:49.929 INFO:tasks.workunit.client.0.smithi115.stdout:6/367: write d8/db/d1d/f2b [8001340,14989] 0 2024-09-13T17:05:49.930 INFO:tasks.workunit.client.1.smithi195.stdout:8/520: sync 2024-09-13T17:05:49.930 INFO:tasks.workunit.client.1.smithi195.stdout:4/572: sync 2024-09-13T17:05:49.930 INFO:tasks.workunit.client.1.smithi195.stdout:8/521: fdatasync d0/d17/d2f/d31/f53 0 2024-09-13T17:05:49.930 INFO:tasks.workunit.client.1.smithi195.stdout:1/475: sync 2024-09-13T17:05:49.932 INFO:tasks.workunit.client.0.smithi115.stdout:9/268: creat d0/de/d37/f5d x:0 0 0 2024-09-13T17:05:49.935 INFO:tasks.workunit.client.0.smithi115.stdout:1/298: sync 2024-09-13T17:05:49.935 INFO:tasks.workunit.client.0.smithi115.stdout:4/440: sync 2024-09-13T17:05:49.935 INFO:tasks.workunit.client.0.smithi115.stdout:3/587: sync 2024-09-13T17:05:49.935 INFO:tasks.workunit.client.0.smithi115.stdout:0/294: sync 2024-09-13T17:05:49.936 INFO:tasks.workunit.client.1.smithi195.stdout:6/458: rename d1c/d3e/c62 to d1c/d24/d7f/c94 0 2024-09-13T17:05:49.937 INFO:tasks.workunit.client.0.smithi115.stdout:5/333: creat d19/d2c/f76 x:0 0 0 2024-09-13T17:05:49.938 INFO:tasks.workunit.client.0.smithi115.stdout:5/334: dread d19/d2b/f6a [0,4194304] 0 2024-09-13T17:05:49.938 INFO:tasks.workunit.client.1.smithi195.stdout:7/553: creat d5/db/d50/daa/fc1 x:0 0 0 2024-09-13T17:05:49.940 INFO:tasks.workunit.client.0.smithi115.stdout:2/612: rename d3/d4d/dd/df/d5c/f71 to d3/d4d/d13/d39/d46/fbb 0 2024-09-13T17:05:49.943 INFO:tasks.workunit.client.0.smithi115.stdout:6/368: symlink d8/db/l74 0 2024-09-13T17:05:49.943 INFO:tasks.workunit.client.1.smithi195.stdout:1/476: read db/df/d4d/d74/f7c [1989179,65467] 0 2024-09-13T17:05:49.946 INFO:tasks.workunit.client.0.smithi115.stdout:4/441: mknod d7/dd/de/d4e/d5a/d4f/c84 0 2024-09-13T17:05:49.947 INFO:tasks.workunit.client.1.smithi195.stdout:2/531: dwrite d0/d4a/d47/d73/d75/d88/f23 [0,4194304] 0 2024-09-13T17:05:49.947 INFO:tasks.workunit.client.1.smithi195.stdout:2/532: read d0/d3/f96 [519033,99854] 0 2024-09-13T17:05:49.949 INFO:tasks.workunit.client.0.smithi115.stdout:3/588: link d1/d4b/fac d1/d4b/d69/db6/fc7 0 2024-09-13T17:05:49.951 INFO:tasks.workunit.client.0.smithi115.stdout:9/269: dwrite d0/de/f1e [0,4194304] 0 2024-09-13T17:05:49.952 INFO:tasks.workunit.client.0.smithi115.stdout:0/295: truncate d9/d1d/d24/d26/d36/d48/f4c 8206943 0 2024-09-13T17:05:49.955 INFO:tasks.workunit.client.0.smithi115.stdout:1/299: rename d5/d7/l23 to d5/d7/d5c/l69 0 2024-09-13T17:05:49.955 INFO:tasks.workunit.client.0.smithi115.stdout:1/300: chown d5/d7/d33/d3a/f57 4581521 1 2024-09-13T17:05:49.955 INFO:tasks.workunit.client.0.smithi115.stdout:1/301: chown d5/d7/d33/d3a/f57 5 1 2024-09-13T17:05:49.956 INFO:tasks.workunit.client.1.smithi195.stdout:5/497: rmdir d2/d12/d4e/d10/d5c 39 2024-09-13T17:05:49.960 INFO:tasks.workunit.client.1.smithi195.stdout:4/573: symlink d1a/d1f/d21/d84/d9d/d8e/d9f/lbb 0 2024-09-13T17:05:49.960 INFO:tasks.workunit.client.1.smithi195.stdout:4/574: readlink d1a/d1f/d21/d22/l69 0 2024-09-13T17:05:49.960 INFO:tasks.workunit.client.1.smithi195.stdout:4/575: write d1a/d1f/d43/d5a/f90 [206312,60947] 0 2024-09-13T17:05:49.961 INFO:tasks.workunit.client.0.smithi115.stdout:6/369: mknod d8/d33/d40/c75 0 2024-09-13T17:05:49.965 INFO:tasks.workunit.client.0.smithi115.stdout:3/589: rmdir d1/d83/d9d 39 2024-09-13T17:05:49.965 INFO:tasks.workunit.client.1.smithi195.stdout:8/522: getdents d0/d17/d49/d63/d71 0 2024-09-13T17:05:49.965 INFO:tasks.workunit.client.1.smithi195.stdout:6/459: mkdir d1c/d3e/d6b/d8a/d95 0 2024-09-13T17:05:49.965 INFO:tasks.workunit.client.1.smithi195.stdout:6/460: dread d1c/d24/d49/f4c [0,4194304] 0 2024-09-13T17:05:49.965 INFO:tasks.workunit.client.1.smithi195.stdout:6/461: readlink d1c/l33 0 2024-09-13T17:05:49.966 INFO:tasks.workunit.client.1.smithi195.stdout:7/554: mknod d5/db/d19/d22/d90/cc2 0 2024-09-13T17:05:49.966 INFO:tasks.workunit.client.1.smithi195.stdout:7/555: chown d5/d35/f57 31613 1 2024-09-13T17:05:49.966 INFO:tasks.workunit.client.1.smithi195.stdout:7/556: creat d5/db/d19/d22/fc3 x:0 0 0 2024-09-13T17:05:49.967 INFO:tasks.workunit.client.0.smithi115.stdout:0/296: unlink d9/f38 0 2024-09-13T17:05:49.969 INFO:tasks.workunit.client.0.smithi115.stdout:4/442: rename d7/dd/de/d4e/d5a/d4f/d53/c73 to d7/dd/de/d4e/d6c/c85 0 2024-09-13T17:05:49.969 INFO:tasks.workunit.client.0.smithi115.stdout:4/443: fdatasync d7/f31 0 2024-09-13T17:05:49.970 INFO:tasks.workunit.client.1.smithi195.stdout:0/492: rmdir d7/db/d38/d4f 39 2024-09-13T17:05:49.973 INFO:tasks.workunit.client.1.smithi195.stdout:7/557: write d5/f6 [7813707,60646] 0 2024-09-13T17:05:49.973 INFO:tasks.workunit.client.1.smithi195.stdout:5/498: rmdir d2/d12/d4e/d74 39 2024-09-13T17:05:49.973 INFO:tasks.workunit.client.1.smithi195.stdout:5/499: fsync d2/df/d78/d54/d58/f60 0 2024-09-13T17:05:49.977 INFO:tasks.workunit.client.0.smithi115.stdout:5/335: dwrite d19/d2b/f44 [0,4194304] 0 2024-09-13T17:05:49.977 INFO:tasks.workunit.client.1.smithi195.stdout:1/477: read db/d19/d5a/f78 [3401085,128309] 0 2024-09-13T17:05:49.977 INFO:tasks.workunit.client.1.smithi195.stdout:1/478: creat db/fa3 x:0 0 0 2024-09-13T17:05:49.977 INFO:tasks.workunit.client.1.smithi195.stdout:4/576: rename d1a/d1f/d21/d22/f3b to d1a/d1f/d21/d7e/db4/fbc 0 2024-09-13T17:05:49.977 INFO:tasks.workunit.client.0.smithi115.stdout:6/370: write d8/d33/f61 [1871882,46587] 0 2024-09-13T17:05:49.980 INFO:tasks.workunit.client.1.smithi195.stdout:8/523: getdents d0/d17/d2f/d7c/d4c 0 2024-09-13T17:05:49.980 INFO:tasks.workunit.client.1.smithi195.stdout:8/524: write d0/d17/d2f/d7c/f48 [2496548,18094] 0 2024-09-13T17:05:49.981 INFO:tasks.workunit.client.1.smithi195.stdout:2/533: dwrite d0/d4a/f7b [0,4194304] 0 2024-09-13T17:05:49.982 INFO:tasks.workunit.client.1.smithi195.stdout:6/462: mknod d1c/d2d/c96 0 2024-09-13T17:05:49.985 INFO:tasks.workunit.client.1.smithi195.stdout:3/490: sync 2024-09-13T17:05:49.986 INFO:tasks.workunit.client.1.smithi195.stdout:3/491: write d7/f81 [394902,27180] 0 2024-09-13T17:05:49.986 INFO:tasks.workunit.client.1.smithi195.stdout:3/492: write d7/d21/d66/d7e/f8c [61116,89386] 0 2024-09-13T17:05:49.987 INFO:tasks.workunit.client.1.smithi195.stdout:7/558: mkdir d5/db/d19/dc4 0 2024-09-13T17:05:49.987 INFO:tasks.workunit.client.1.smithi195.stdout:7/559: fdatasync d5/db/d19/d22/d3c/f4f 0 2024-09-13T17:05:49.988 INFO:tasks.workunit.client.0.smithi115.stdout:4/444: dwrite d7/f30 [0,4194304] 0 2024-09-13T17:05:49.988 INFO:tasks.workunit.client.0.smithi115.stdout:4/445: chown d7/dd/de/l1b 415171 1 2024-09-13T17:05:49.989 INFO:tasks.workunit.client.1.smithi195.stdout:8/525: write d0/f8 [7811389,74577] 0 2024-09-13T17:05:49.989 INFO:tasks.workunit.client.1.smithi195.stdout:9/554: sync 2024-09-13T17:05:49.990 INFO:tasks.workunit.client.0.smithi115.stdout:2/613: rmdir d3/d4d/dd 39 2024-09-13T17:05:49.991 INFO:tasks.workunit.client.1.smithi195.stdout:0/493: dwrite d7/db/f7a [0,4194304] 0 2024-09-13T17:05:49.994 INFO:tasks.workunit.client.1.smithi195.stdout:1/479: link db/df/d13/c94 db/df/d51/d62/d70/ca4 0 2024-09-13T17:05:49.997 INFO:tasks.workunit.client.0.smithi115.stdout:3/590: unlink d1/d4b/d69/f80 0 2024-09-13T17:05:49.997 INFO:tasks.workunit.client.0.smithi115.stdout:3/591: write d1/da4/fc6 [179819,94614] 0 2024-09-13T17:05:50.000 INFO:tasks.workunit.client.1.smithi195.stdout:5/500: rename d2/df/d62/c95 to d2/df/d78/ca3 0 2024-09-13T17:05:50.001 INFO:tasks.workunit.client.0.smithi115.stdout:1/302: rename d5/c1d to d5/d26/d2c/d62/c6a 0 2024-09-13T17:05:50.001 INFO:tasks.workunit.client.0.smithi115.stdout:1/303: truncate d5/d60/f4f 194673 0 2024-09-13T17:05:50.003 INFO:tasks.workunit.client.1.smithi195.stdout:1/480: dread db/df/d13/f21 [0,4194304] 0 2024-09-13T17:05:50.003 INFO:tasks.workunit.client.1.smithi195.stdout:1/481: read - db/df/d4d/d74/f76 zero size 2024-09-13T17:05:50.003 INFO:tasks.workunit.client.1.smithi195.stdout:4/577: creat d1a/d1f/d21/d7e/db4/fbd x:0 0 0 2024-09-13T17:05:50.003 INFO:tasks.workunit.client.1.smithi195.stdout:4/578: stat d1a/d1f 0 2024-09-13T17:05:50.003 INFO:tasks.workunit.client.0.smithi115.stdout:5/336: truncate d19/d2b/d32/d55/f57 1702914 0 2024-09-13T17:05:50.004 INFO:tasks.workunit.client.0.smithi115.stdout:5/337: fdatasync d19/f3c 0 2024-09-13T17:05:50.004 INFO:tasks.workunit.client.0.smithi115.stdout:5/338: fsync d19/d1d/f20 0 2024-09-13T17:05:50.007 INFO:tasks.workunit.client.1.smithi195.stdout:6/463: getdents d1c 0 2024-09-13T17:05:50.010 INFO:tasks.workunit.client.1.smithi195.stdout:8/526: creat d0/d17/d49/d63/fb5 x:0 0 0 2024-09-13T17:05:50.010 INFO:tasks.workunit.client.0.smithi115.stdout:4/446: getdents d7/dd/d3c/d7b 0 2024-09-13T17:05:50.012 INFO:tasks.workunit.client.0.smithi115.stdout:3/592: symlink d1/d12/d14/d61/lc8 0 2024-09-13T17:05:50.012 INFO:tasks.workunit.client.0.smithi115.stdout:3/593: write d1/d4b/d1a/d6e/fc4 [525283,83424] 0 2024-09-13T17:05:50.013 INFO:tasks.workunit.client.0.smithi115.stdout:2/614: dwrite d3/d4d/dd/d1f/fb6 [0,4194304] 0 2024-09-13T17:05:50.014 INFO:tasks.workunit.client.0.smithi115.stdout:0/297: rename d9/fd to d9/d1d/d24/d26/f55 0 2024-09-13T17:05:50.014 INFO:tasks.workunit.client.0.smithi115.stdout:0/298: fsync d9/d1b/f23 0 2024-09-13T17:05:50.014 INFO:tasks.workunit.client.1.smithi195.stdout:0/494: creat d7/d87/d9b/d4e/d68/f9f x:0 0 0 2024-09-13T17:05:50.016 INFO:tasks.workunit.client.0.smithi115.stdout:1/304: creat d5/f6b x:0 0 0 2024-09-13T17:05:50.016 INFO:tasks.workunit.client.0.smithi115.stdout:1/305: chown d5/d7/l1c 87 1 2024-09-13T17:05:50.016 INFO:tasks.workunit.client.1.smithi195.stdout:7/560: dwrite d5/db/d50/d7f/d82/dad/fb2 [4194304,4194304] 0 2024-09-13T17:05:50.016 INFO:tasks.workunit.client.1.smithi195.stdout:9/555: dwrite d6/d19/d21/d45/dad/d5e/da0/fb7 [0,4194304] 0 2024-09-13T17:05:50.017 INFO:tasks.workunit.client.0.smithi115.stdout:4/447: truncate d7/fc 2172070 0 2024-09-13T17:05:50.017 INFO:tasks.workunit.client.0.smithi115.stdout:4/448: chown d7/c16 70185 1 2024-09-13T17:05:50.017 INFO:tasks.workunit.client.0.smithi115.stdout:4/449: chown d7/l48 36768 1 2024-09-13T17:05:50.017 INFO:tasks.workunit.client.0.smithi115.stdout:4/450: stat d7/dd/de/f1c 0 2024-09-13T17:05:50.018 INFO:tasks.workunit.client.0.smithi115.stdout:5/339: write f16 [2094170,75231] 0 2024-09-13T17:05:50.018 INFO:tasks.workunit.client.1.smithi195.stdout:2/534: rename d0/d4a/d47/d73/d75/d88/d2c/c74 to d0/d4a/d47/d73/d75/d88/caa 0 2024-09-13T17:05:50.022 INFO:tasks.workunit.client.1.smithi195.stdout:1/482: getdents db/df/d4d/d67 0 2024-09-13T17:05:50.024 INFO:tasks.workunit.client.1.smithi195.stdout:3/493: rmdir d7/d21/d2a/d4a/d71 39 2024-09-13T17:05:50.026 INFO:tasks.workunit.client.0.smithi115.stdout:2/615: creat d3/d4d/d13/d39/d46/da0/fbc x:0 0 0 2024-09-13T17:05:50.026 INFO:tasks.workunit.client.0.smithi115.stdout:2/616: chown d3/d4d/dd/l52 357 1 2024-09-13T17:05:50.027 INFO:tasks.workunit.client.0.smithi115.stdout:5/340: dread f5 [0,4194304] 0 2024-09-13T17:05:50.027 INFO:tasks.workunit.client.1.smithi195.stdout:8/527: creat d0/d13/d52/d55/fb6 x:0 0 0 2024-09-13T17:05:50.028 INFO:tasks.workunit.client.0.smithi115.stdout:3/594: dread d1/d12/f45 [0,4194304] 0 2024-09-13T17:05:50.028 INFO:tasks.workunit.client.0.smithi115.stdout:3/595: creat d1/d4b/d1a/d6e/fc9 x:0 0 0 2024-09-13T17:05:50.030 INFO:tasks.workunit.client.0.smithi115.stdout:0/299: symlink d9/d1d/d24/d26/l56 0 2024-09-13T17:05:50.030 INFO:tasks.workunit.client.0.smithi115.stdout:0/300: creat d9/d1b/f57 x:0 0 0 2024-09-13T17:05:50.034 INFO:tasks.workunit.client.0.smithi115.stdout:1/306: rename d5/d26/d2c/d62/f68 to d5/d3e/d59/f6c 0 2024-09-13T17:05:50.037 INFO:tasks.workunit.client.0.smithi115.stdout:3/596: dread d1/d4b/d1a/d30/f37 [0,4194304] 0 2024-09-13T17:05:50.038 INFO:tasks.workunit.client.0.smithi115.stdout:4/451: unlink d7/dd/de/d4e/f50 0 2024-09-13T17:05:50.038 INFO:tasks.workunit.client.0.smithi115.stdout:4/452: fsync d7/dd/de/d4e/d5a/d4f/d53/f69 0 2024-09-13T17:05:50.042 INFO:tasks.workunit.client.1.smithi195.stdout:2/535: dwrite d0/d4a/f7b [4194304,4194304] 0 2024-09-13T17:05:50.044 INFO:tasks.workunit.client.1.smithi195.stdout:9/556: unlink d6/d19/d21/d45/dad/d5e/da0/ca4 0 2024-09-13T17:05:50.046 INFO:tasks.workunit.client.1.smithi195.stdout:8/528: dwrite d0/d4/f5e [0,4194304] 0 2024-09-13T17:05:50.046 INFO:tasks.workunit.client.0.smithi115.stdout:0/301: rmdir d9/d1d/d24/d26/d2d/d30 39 2024-09-13T17:05:50.052 INFO:tasks.workunit.client.0.smithi115.stdout:1/307: mkdir d5/d6d 0 2024-09-13T17:05:50.052 INFO:tasks.workunit.client.0.smithi115.stdout:1/308: creat d5/d26/f6e x:0 0 0 2024-09-13T17:05:50.056 INFO:tasks.workunit.client.0.smithi115.stdout:3/597: creat d1/d4b/d69/fca x:0 0 0 2024-09-13T17:05:50.058 INFO:tasks.workunit.client.1.smithi195.stdout:5/501: rename d2/df/l9d to d2/la4 0 2024-09-13T17:05:50.059 INFO:tasks.workunit.client.0.smithi115.stdout:4/453: mkdir d7/d86 0 2024-09-13T17:05:50.060 INFO:tasks.workunit.client.1.smithi195.stdout:7/561: rmdir d5/d13/d24 39 2024-09-13T17:05:50.061 INFO:tasks.workunit.client.1.smithi195.stdout:8/529: dwrite d0/d17/f6b [0,4194304] 0 2024-09-13T17:05:50.061 INFO:tasks.workunit.client.0.smithi115.stdout:5/341: getdents d19/d2b 0 2024-09-13T17:05:50.061 INFO:tasks.workunit.client.0.smithi115.stdout:5/342: readlink d19/d21/d3a/l4f 0 2024-09-13T17:05:50.063 INFO:tasks.workunit.client.1.smithi195.stdout:2/536: creat d0/fab x:0 0 0 2024-09-13T17:05:50.072 INFO:tasks.workunit.client.1.smithi195.stdout:9/557: mkdir d6/d12/dbc 0 2024-09-13T17:05:50.074 INFO:tasks.workunit.client.0.smithi115.stdout:3/598: unlink d1/d4b/c33 0 2024-09-13T17:05:50.074 INFO:tasks.workunit.client.0.smithi115.stdout:1/309: dwrite d5/d7/d33/d3a/f43 [0,4194304] 0 2024-09-13T17:05:50.076 INFO:tasks.workunit.client.0.smithi115.stdout:4/454: creat d7/dd/d63/f87 x:0 0 0 2024-09-13T17:05:50.076 INFO:tasks.workunit.client.0.smithi115.stdout:4/455: truncate d7/dd/f32 525949 0 2024-09-13T17:05:50.078 INFO:tasks.workunit.client.0.smithi115.stdout:5/343: dwrite d19/d21/d62/f68 [0,4194304] 0 2024-09-13T17:05:50.078 INFO:tasks.workunit.client.0.smithi115.stdout:5/344: truncate d19/d2b/d32/d55/f4c 1876950 0 2024-09-13T17:05:50.079 INFO:tasks.workunit.client.0.smithi115.stdout:5/345: dread - d19/f53 zero size 2024-09-13T17:05:50.079 INFO:tasks.workunit.client.1.smithi195.stdout:6/464: rename d1c/d2d/d30/f3d to d1c/d7d/f97 0 2024-09-13T17:05:50.080 INFO:tasks.workunit.client.1.smithi195.stdout:5/502: symlink d2/df/d78/d54/d58/la5 0 2024-09-13T17:05:50.080 INFO:tasks.workunit.client.1.smithi195.stdout:5/503: chown d2/d12/d4e/d10/d8f/c71 812808771 1 2024-09-13T17:05:50.080 INFO:tasks.workunit.client.1.smithi195.stdout:9/558: dread d6/d19/d21/d64/d68/d6d/f7e [0,4194304] 0 2024-09-13T17:05:50.081 INFO:tasks.workunit.client.1.smithi195.stdout:9/559: write d6/df/d16/d5c/f81 [756871,68522] 0 2024-09-13T17:05:50.081 INFO:tasks.workunit.client.1.smithi195.stdout:9/560: fsync d6/f69 0 2024-09-13T17:05:50.082 INFO:tasks.workunit.client.1.smithi195.stdout:7/562: mknod d5/db/d50/d7f/d82/da1/cc5 0 2024-09-13T17:05:50.083 INFO:tasks.workunit.client.0.smithi115.stdout:3/599: write d1/d4b/d1a/f6b [17732,59303] 0 2024-09-13T17:05:50.083 INFO:tasks.workunit.client.0.smithi115.stdout:3/600: write d1/d4b/d1a/f2c [593843,33371] 0 2024-09-13T17:05:50.084 INFO:tasks.workunit.client.1.smithi195.stdout:8/530: getdents d0/d17/d49/d63/db3 0 2024-09-13T17:05:50.085 INFO:tasks.workunit.client.1.smithi195.stdout:2/537: truncate d0/f6c 3101277 0 2024-09-13T17:05:50.087 INFO:tasks.workunit.client.0.smithi115.stdout:1/310: rename d5/d3e/c40 to d5/d7/d5c/c6f 0 2024-09-13T17:05:50.088 INFO:tasks.workunit.client.0.smithi115.stdout:4/456: mkdir d7/d86/d88 0 2024-09-13T17:05:50.089 INFO:tasks.workunit.client.0.smithi115.stdout:4/457: write d7/dd/de/d4e/f6f [4628526,57139] 0 2024-09-13T17:05:50.093 INFO:tasks.workunit.client.0.smithi115.stdout:5/346: mkdir d19/d2b/d77 0 2024-09-13T17:05:50.095 INFO:tasks.workunit.client.1.smithi195.stdout:0/495: rename d7/db/c63 to d7/db/d9a/ca0 0 2024-09-13T17:05:50.096 INFO:tasks.workunit.client.0.smithi115.stdout:3/601: mkdir d1/d4b/d69/d7b/dbb/dcb 0 2024-09-13T17:05:50.096 INFO:tasks.workunit.client.0.smithi115.stdout:3/602: readlink d1/d4b/d1a/d30/l8f 0 2024-09-13T17:05:50.097 INFO:tasks.workunit.client.1.smithi195.stdout:6/465: link d1c/d2d/d5e/l89 d1c/d24/d49/d5f/d35/d88/l98 0 2024-09-13T17:05:50.097 INFO:tasks.workunit.client.1.smithi195.stdout:0/496: dread d7/d50/f30 [0,4194304] 0 2024-09-13T17:05:50.098 INFO:tasks.workunit.client.1.smithi195.stdout:5/504: symlink d2/d12/d4e/d10/d5c/la6 0 2024-09-13T17:05:50.098 INFO:tasks.workunit.client.1.smithi195.stdout:5/505: creat d2/df/d78/d54/fa7 x:0 0 0 2024-09-13T17:05:50.099 INFO:tasks.workunit.client.0.smithi115.stdout:4/458: mknod d7/dd/de/d4e/d5a/d4f/c89 0 2024-09-13T17:05:50.100 INFO:tasks.workunit.client.1.smithi195.stdout:0/497: dread d7/d88/d23/f4a [0,4194304] 0 2024-09-13T17:05:50.100 INFO:tasks.workunit.client.1.smithi195.stdout:0/498: write d7/d50/f1c [3554926,22681] 0 2024-09-13T17:05:50.102 INFO:tasks.workunit.client.0.smithi115.stdout:1/311: read d5/f14 [805990,32263] 0 2024-09-13T17:05:50.102 INFO:tasks.workunit.client.0.smithi115.stdout:3/603: rename d1/d12/d14/d54 to d1/d4b/d69/db6/dcc 0 2024-09-13T17:05:50.103 INFO:tasks.workunit.client.0.smithi115.stdout:5/347: dread f5 [0,4194304] 0 2024-09-13T17:05:50.105 INFO:tasks.workunit.client.1.smithi195.stdout:9/561: creat d6/d19/d21/d64/d68/fbd x:0 0 0 2024-09-13T17:05:50.105 INFO:tasks.workunit.client.1.smithi195.stdout:9/562: creat d6/d19/d21/d45/dad/d47/d61/fbe x:0 0 0 2024-09-13T17:05:50.106 INFO:tasks.workunit.client.0.smithi115.stdout:4/459: truncate d7/f29 4050208 0 2024-09-13T17:05:50.106 INFO:tasks.workunit.client.0.smithi115.stdout:4/460: dread - d7/dd/f2c zero size 2024-09-13T17:05:50.107 INFO:tasks.workunit.client.1.smithi195.stdout:7/563: symlink d5/d13/d24/lc6 0 2024-09-13T17:05:50.108 INFO:tasks.workunit.client.1.smithi195.stdout:7/564: write d5/d13/f40 [26517,100574] 0 2024-09-13T17:05:50.110 INFO:tasks.workunit.client.1.smithi195.stdout:8/531: rmdir d0/d17/d2f/d31 39 2024-09-13T17:05:50.110 INFO:tasks.workunit.client.1.smithi195.stdout:8/532: chown d0/c2d 48288 1 2024-09-13T17:05:50.112 INFO:tasks.workunit.client.0.smithi115.stdout:5/348: unlink d19/d2b/d32/f3b 0 2024-09-13T17:05:50.113 INFO:tasks.workunit.client.1.smithi195.stdout:0/499: dwrite d7/d87/d9b/d56/d46/f9e [0,4194304] 0 2024-09-13T17:05:50.113 INFO:tasks.workunit.client.1.smithi195.stdout:2/538: mkdir d0/d4a/d47/d73/d75/d88/d2c/d43/d84/dac 0 2024-09-13T17:05:50.115 INFO:tasks.workunit.client.0.smithi115.stdout:4/461: link d7/f36 d7/dd/de/d4e/d6c/f8a 0 2024-09-13T17:05:50.115 INFO:tasks.workunit.client.1.smithi195.stdout:0/500: dread d7/d50/f30 [0,4194304] 0 2024-09-13T17:05:50.115 INFO:tasks.workunit.client.1.smithi195.stdout:4/579: sync 2024-09-13T17:05:50.118 INFO:tasks.workunit.client.1.smithi195.stdout:1/483: rename db/df/f63 to db/df/d51/d62/d70/fa5 0 2024-09-13T17:05:50.118 INFO:tasks.workunit.client.1.smithi195.stdout:1/484: chown db/df/d13/f5b 3120112 1 2024-09-13T17:05:50.121 INFO:tasks.workunit.client.0.smithi115.stdout:4/462: write d7/dd/de/d4e/d6c/f8a [1757634,67638] 0 2024-09-13T17:05:50.121 INFO:tasks.workunit.client.0.smithi115.stdout:1/312: symlink d5/d7/l70 0 2024-09-13T17:05:50.121 INFO:tasks.workunit.client.0.smithi115.stdout:1/313: chown d5/d26/d2c/c56 220 1 2024-09-13T17:05:50.124 INFO:tasks.workunit.client.0.smithi115.stdout:4/463: write d7/dd/de/d4e/f62 [1658938,78963] 0 2024-09-13T17:05:50.125 INFO:tasks.workunit.client.0.smithi115.stdout:5/349: rename d19/d21/f30 to d19/d2e/d6b/f78 0 2024-09-13T17:05:50.125 INFO:tasks.workunit.client.0.smithi115.stdout:5/350: truncate d19/f53 440977 0 2024-09-13T17:05:50.126 INFO:tasks.workunit.client.1.smithi195.stdout:5/506: creat d2/d88/fa8 x:0 0 0 2024-09-13T17:05:50.128 INFO:tasks.workunit.client.0.smithi115.stdout:1/314: rmdir d5/d6d 0 2024-09-13T17:05:50.134 INFO:tasks.workunit.client.1.smithi195.stdout:9/563: creat d6/d19/d21/d64/fbf x:0 0 0 2024-09-13T17:05:50.135 INFO:tasks.workunit.client.0.smithi115.stdout:5/351: getdents d19 0 2024-09-13T17:05:50.136 INFO:tasks.workunit.client.0.smithi115.stdout:1/315: creat d5/d7/d33/d3a/f71 x:0 0 0 2024-09-13T17:05:50.138 INFO:tasks.workunit.client.0.smithi115.stdout:4/464: dwrite d7/dd/f44 [0,4194304] 0 2024-09-13T17:05:50.138 INFO:tasks.workunit.client.1.smithi195.stdout:8/533: unlink d0/d17/d2f/d7c/d4c/l82 0 2024-09-13T17:05:50.140 INFO:tasks.workunit.client.0.smithi115.stdout:5/352: creat d19/d2b/d77/f79 x:0 0 0 2024-09-13T17:05:50.141 INFO:tasks.workunit.client.0.smithi115.stdout:5/353: readlink d19/d2b/d32/d55/d5e/l42 0 2024-09-13T17:05:50.141 INFO:tasks.workunit.client.0.smithi115.stdout:5/354: chown d19/d2e/c59 58 1 2024-09-13T17:05:50.141 INFO:tasks.workunit.client.0.smithi115.stdout:5/355: fsync d19/d2b/d32/d55/f5f 0 2024-09-13T17:05:50.141 INFO:tasks.workunit.client.0.smithi115.stdout:5/356: chown d19/c33 4241 1 2024-09-13T17:05:50.142 INFO:tasks.workunit.client.0.smithi115.stdout:5/357: truncate d19/d1d/f26 438134 0 2024-09-13T17:05:50.143 INFO:tasks.workunit.client.0.smithi115.stdout:1/316: rename d5/d7/l2b to d5/d26/l72 0 2024-09-13T17:05:50.147 INFO:tasks.workunit.client.0.smithi115.stdout:4/465: mkdir d7/dd/d3c/d74/d8b 0 2024-09-13T17:05:50.149 INFO:tasks.workunit.client.0.smithi115.stdout:5/358: dread d19/f1a [4194304,4194304] 0 2024-09-13T17:05:50.149 INFO:tasks.workunit.client.0.smithi115.stdout:5/359: chown f14 220359035 1 2024-09-13T17:05:50.149 INFO:tasks.workunit.client.0.smithi115.stdout:5/360: dread - d19/d2b/d32/d55/d5e/f67 zero size 2024-09-13T17:05:50.149 INFO:tasks.workunit.client.0.smithi115.stdout:1/317: unlink d5/d26/l27 0 2024-09-13T17:05:50.150 INFO:tasks.workunit.client.1.smithi195.stdout:0/501: mkdir d7/d50/da1 0 2024-09-13T17:05:50.151 INFO:tasks.workunit.client.1.smithi195.stdout:0/502: dread - d7/d87/d9b/d56/d46/f83 zero size 2024-09-13T17:05:50.154 INFO:tasks.workunit.client.1.smithi195.stdout:4/580: unlink d1a/d1f/d21/d7e/db4/fbd 0 2024-09-13T17:05:50.155 INFO:tasks.workunit.client.0.smithi115.stdout:4/466: mknod d7/d86/d88/c8c 0 2024-09-13T17:05:50.155 INFO:tasks.workunit.client.0.smithi115.stdout:4/467: creat d7/dd/de/d4e/d5a/d4f/f8d x:0 0 0 2024-09-13T17:05:50.158 INFO:tasks.workunit.client.1.smithi195.stdout:3/494: rename d7/d62/f8d to d7/d62/d70/f90 0 2024-09-13T17:05:50.159 INFO:tasks.workunit.client.0.smithi115.stdout:5/361: link d19/d2c/c73 d19/d21/d3a/c7a 0 2024-09-13T17:05:50.160 INFO:tasks.workunit.client.1.smithi195.stdout:1/485: getdents db/d19/d5a/d66 0 2024-09-13T17:05:50.162 INFO:tasks.workunit.client.0.smithi115.stdout:1/318: mkdir d5/d7/d5c/d73 0 2024-09-13T17:05:50.162 INFO:tasks.workunit.client.0.smithi115.stdout:1/319: write d5/d26/f6e [920032,30015] 0 2024-09-13T17:05:50.164 INFO:tasks.workunit.client.0.smithi115.stdout:1/320: write d5/fb [543255,63765] 0 2024-09-13T17:05:50.165 INFO:tasks.workunit.client.1.smithi195.stdout:5/507: link d2/d12/d4e/d10/d46/l1e d2/df/d78/la9 0 2024-09-13T17:05:50.165 INFO:tasks.workunit.client.1.smithi195.stdout:5/508: write d2/df/d78/d54/f73 [4631459,86359] 0 2024-09-13T17:05:50.165 INFO:tasks.workunit.client.1.smithi195.stdout:3/495: dread d7/f61 [0,4194304] 0 2024-09-13T17:05:50.166 INFO:tasks.workunit.client.0.smithi115.stdout:1/321: readlink d5/l19 0 2024-09-13T17:05:50.166 INFO:tasks.workunit.client.0.smithi115.stdout:1/322: write d5/d26/d2c/f39 [584489,72412] 0 2024-09-13T17:05:50.168 INFO:tasks.workunit.client.1.smithi195.stdout:8/534: symlink d0/d17/d49/lb7 0 2024-09-13T17:05:50.169 INFO:tasks.workunit.client.1.smithi195.stdout:2/539: getdents d0/d4a/d47/d73/d75/d88/d2c/d43/d84 0 2024-09-13T17:05:50.171 INFO:tasks.workunit.client.1.smithi195.stdout:0/503: truncate d7/d87/d9b/d4e/d68/f79 691796 0 2024-09-13T17:05:50.174 INFO:tasks.workunit.client.1.smithi195.stdout:6/466: rename d1c/d24/d49/d5f/f6a to d1c/d2d/d8c/f99 0 2024-09-13T17:05:50.177 INFO:tasks.workunit.client.0.smithi115.stdout:1/323: write d5/d26/f28 [688200,5011] 0 2024-09-13T17:05:50.177 INFO:tasks.workunit.client.0.smithi115.stdout:1/324: chown d5/c4c 490829865 1 2024-09-13T17:05:50.178 INFO:tasks.workunit.client.0.smithi115.stdout:1/325: readlink d5/d26/d2c/l30 0 2024-09-13T17:05:50.178 INFO:tasks.workunit.client.0.smithi115.stdout:4/468: dwrite d7/dd/de/d4e/d5a/d4f/d53/f7a [0,4194304] 0 2024-09-13T17:05:50.178 INFO:tasks.workunit.client.1.smithi195.stdout:3/496: mknod d7/d21/d2a/d35/d8f/c91 0 2024-09-13T17:05:50.178 INFO:tasks.workunit.client.1.smithi195.stdout:3/497: write d7/d21/f73 [1025939,9290] 0 2024-09-13T17:05:50.179 INFO:tasks.workunit.client.1.smithi195.stdout:8/535: creat d0/d17/db0/fb8 x:0 0 0 2024-09-13T17:05:50.180 INFO:tasks.workunit.client.1.smithi195.stdout:0/504: mkdir d7/d50/da2 0 2024-09-13T17:05:50.181 INFO:tasks.workunit.client.0.smithi115.stdout:5/362: dwrite f8 [0,4194304] 0 2024-09-13T17:05:50.181 INFO:tasks.workunit.client.0.smithi115.stdout:5/363: write d19/f53 [1147722,121406] 0 2024-09-13T17:05:50.183 INFO:tasks.workunit.client.0.smithi115.stdout:1/326: unlink d5/d7/f1f 0 2024-09-13T17:05:50.184 INFO:tasks.workunit.client.1.smithi195.stdout:9/564: rename d6/d19/d21/d5b/c3b to d6/df/d16/d58/cc0 0 2024-09-13T17:05:50.186 INFO:tasks.workunit.client.1.smithi195.stdout:9/565: write d6/df/d16/d5c/f81 [74728,76208] 0 2024-09-13T17:05:50.186 INFO:tasks.workunit.client.1.smithi195.stdout:9/566: fsync d6/d19/d21/d5b/f50 0 2024-09-13T17:05:50.187 INFO:tasks.workunit.client.1.smithi195.stdout:2/540: dwrite d0/f48 [4194304,4194304] 0 2024-09-13T17:05:50.188 INFO:tasks.workunit.client.1.smithi195.stdout:6/467: creat d1c/d2d/f9a x:0 0 0 2024-09-13T17:05:50.188 INFO:tasks.workunit.client.1.smithi195.stdout:6/468: fsync d1c/d24/d49/f65 0 2024-09-13T17:05:50.190 INFO:tasks.workunit.client.1.smithi195.stdout:6/469: dread d1c/d7d/f97 [0,4194304] 0 2024-09-13T17:05:50.192 INFO:tasks.workunit.client.1.smithi195.stdout:8/536: mkdir d0/d13/db9 0 2024-09-13T17:05:50.192 INFO:tasks.workunit.client.1.smithi195.stdout:8/537: chown d0/d17/d49/d63/db3 2382 1 2024-09-13T17:05:50.193 INFO:tasks.workunit.client.0.smithi115.stdout:4/469: link d7/f2d d7/dd/d63/f8e 0 2024-09-13T17:05:50.218 INFO:tasks.workunit.client.1.smithi195.stdout:3/498: dwrite d7/d21/d2a/d4a/f7a [0,4194304] 0 2024-09-13T17:05:50.220 INFO:tasks.workunit.client.1.smithi195.stdout:1/486: rename db/d19/d5a/l99 to db/d19/d37/d46/d7e/la6 0 2024-09-13T17:05:50.221 INFO:tasks.workunit.client.1.smithi195.stdout:1/487: write db/df/d51/d62/d70/fa5 [5126534,24508] 0 2024-09-13T17:05:50.221 INFO:tasks.workunit.client.1.smithi195.stdout:1/488: dread - db/df/d4d/f81 zero size 2024-09-13T17:05:50.221 INFO:tasks.workunit.client.1.smithi195.stdout:0/505: dwrite d7/d87/f99 [0,4194304] 0 2024-09-13T17:05:50.221 INFO:tasks.workunit.client.1.smithi195.stdout:0/506: truncate d7/db/d11/f73 8995309 0 2024-09-13T17:05:50.221 INFO:tasks.workunit.client.1.smithi195.stdout:0/507: getdents d7/d87/d9b/d56/d4d/d9d 0 2024-09-13T17:05:50.224 INFO:tasks.workunit.client.0.smithi115.stdout:5/364: creat d19/d75/f7b x:0 0 0 2024-09-13T17:05:50.225 INFO:tasks.workunit.client.0.smithi115.stdout:4/470: dread d7/f30 [0,4194304] 0 2024-09-13T17:05:50.225 INFO:tasks.workunit.client.0.smithi115.stdout:4/471: creat d7/dd/de/d4e/d5a/d4f/f8f x:0 0 0 2024-09-13T17:05:50.226 INFO:tasks.workunit.client.1.smithi195.stdout:9/567: unlink d6/d19/d21/d45/dad/d47/f9a 0 2024-09-13T17:05:50.228 INFO:tasks.workunit.client.0.smithi115.stdout:1/327: rename d5/d3e/d59/f6c to d5/d26/d2c/f74 0 2024-09-13T17:05:50.228 INFO:tasks.workunit.client.0.smithi115.stdout:1/328: write d5/d26/f6e [1939393,103733] 0 2024-09-13T17:05:50.228 INFO:tasks.workunit.client.1.smithi195.stdout:6/470: dwrite d1c/d2d/d30/f92 [0,4194304] 0 2024-09-13T17:05:50.230 INFO:tasks.workunit.client.1.smithi195.stdout:2/541: unlink d0/d4a/d47/d73/d75/d88/d2c/d51/f32 0 2024-09-13T17:05:50.230 INFO:tasks.workunit.client.1.smithi195.stdout:8/538: dwrite d0/d4/f5a [0,4194304] 0 2024-09-13T17:05:50.230 INFO:tasks.workunit.client.1.smithi195.stdout:8/539: fsync d0/d17/d2f/f93 0 2024-09-13T17:05:50.237 INFO:tasks.workunit.client.1.smithi195.stdout:3/499: mknod d7/d21/d2a/d4a/c92 0 2024-09-13T17:05:50.240 INFO:tasks.workunit.client.1.smithi195.stdout:5/509: rename d2/d12/d4e/d10/d8f/f84 to d2/df/d78/faa 0 2024-09-13T17:05:50.240 INFO:tasks.workunit.client.1.smithi195.stdout:5/510: chown d2/d12/d4e/d10/d8f 5569184 1 2024-09-13T17:05:50.240 INFO:tasks.workunit.client.1.smithi195.stdout:5/511: truncate d2/df/d48/d5a/f8c 984817 0 2024-09-13T17:05:50.240 INFO:tasks.workunit.client.1.smithi195.stdout:5/512: dread - d2/df/d86/f7e zero size 2024-09-13T17:05:50.240 INFO:tasks.workunit.client.1.smithi195.stdout:8/540: dread d0/d13/f16 [0,4194304] 0 2024-09-13T17:05:50.241 INFO:tasks.workunit.client.1.smithi195.stdout:1/489: mkdir db/df/d13/da7 0 2024-09-13T17:05:50.241 INFO:tasks.workunit.client.1.smithi195.stdout:1/490: fsync db/df/d51/f53 0 2024-09-13T17:05:50.244 INFO:tasks.workunit.client.1.smithi195.stdout:6/471: dread d1c/d24/d49/d5f/f2b [0,4194304] 0 2024-09-13T17:05:50.244 INFO:tasks.workunit.client.1.smithi195.stdout:9/568: getdents d6/d19/d21/d45 0 2024-09-13T17:05:50.244 INFO:tasks.workunit.client.1.smithi195.stdout:9/569: truncate d6/d19/d21/d45/dad/d47/d61/fae 1294813 0 2024-09-13T17:05:50.244 INFO:tasks.workunit.client.1.smithi195.stdout:9/570: creat d6/df/d72/fc1 x:0 0 0 2024-09-13T17:05:50.244 INFO:tasks.workunit.client.1.smithi195.stdout:9/571: truncate d6/d12/f46 4709630 0 2024-09-13T17:05:50.245 INFO:tasks.workunit.client.0.smithi115.stdout:5/365: symlink d19/d2c/l7c 0 2024-09-13T17:05:50.247 INFO:tasks.workunit.client.0.smithi115.stdout:1/329: dwrite d5/d26/f55 [0,4194304] 0 2024-09-13T17:05:50.248 INFO:tasks.workunit.client.1.smithi195.stdout:2/542: dwrite d0/d3/f68 [0,4194304] 0 2024-09-13T17:05:50.248 INFO:tasks.workunit.client.1.smithi195.stdout:2/543: stat d0/d4a/d47/d73/d75 0 2024-09-13T17:05:50.248 INFO:tasks.workunit.client.1.smithi195.stdout:2/544: read d0/d3/f26 [800642,61615] 0 2024-09-13T17:05:50.249 INFO:tasks.workunit.client.0.smithi115.stdout:4/472: rename d7/dd/l49 to d7/dd/de/d4e/l90 0 2024-09-13T17:05:50.249 INFO:tasks.workunit.client.0.smithi115.stdout:4/473: getdents d7/dd/de/d4e/d5a/d4f/d70 0 2024-09-13T17:05:50.249 INFO:tasks.workunit.client.0.smithi115.stdout:4/474: stat d7/f2d 0 2024-09-13T17:05:50.249 INFO:tasks.workunit.client.0.smithi115.stdout:4/475: chown d7/dd/de/f5c 3 1 2024-09-13T17:05:50.251 INFO:tasks.workunit.client.0.smithi115.stdout:5/366: mknod d19/d2b/d77/c7d 0 2024-09-13T17:05:50.258 INFO:tasks.workunit.client.0.smithi115.stdout:1/330: rename d5/d26/f55 to d5/d3e/d59/f75 0 2024-09-13T17:05:50.262 INFO:tasks.workunit.client.1.smithi195.stdout:3/500: dwrite d7/f14 [0,4194304] 0 2024-09-13T17:05:50.262 INFO:tasks.workunit.client.1.smithi195.stdout:3/501: chown d7/d21/d51/f54 83018127 1 2024-09-13T17:05:50.262 INFO:tasks.workunit.client.0.smithi115.stdout:1/331: rename d5/f22 to d5/d3e/d59/f76 0 2024-09-13T17:05:50.262 INFO:tasks.workunit.client.0.smithi115.stdout:1/332: readlink d5/d7/d5c/l69 0 2024-09-13T17:05:50.263 INFO:tasks.workunit.client.0.smithi115.stdout:1/333: read - d5/d26/d2c/f74 zero size 2024-09-13T17:05:50.263 INFO:tasks.workunit.client.0.smithi115.stdout:1/334: chown d5/d7/d33/d3a/l5a 0 1 2024-09-13T17:05:50.264 INFO:tasks.workunit.client.0.smithi115.stdout:4/476: dread d7/f36 [0,4194304] 0 2024-09-13T17:05:50.264 INFO:tasks.workunit.client.0.smithi115.stdout:4/477: readlink d7/dd/d3c/d7b/l60 0 2024-09-13T17:05:50.264 INFO:tasks.workunit.client.0.smithi115.stdout:4/478: fdatasync d7/dd/de/d4e/d5a/d4f/d53/f7a 0 2024-09-13T17:05:50.264 INFO:tasks.workunit.client.0.smithi115.stdout:4/479: write d7/dd/f83 [358177,50079] 0 2024-09-13T17:05:50.265 INFO:tasks.workunit.client.1.smithi195.stdout:8/541: dwrite d0/d17/db0/fb8 [0,4194304] 0 2024-09-13T17:05:50.265 INFO:tasks.workunit.client.1.smithi195.stdout:8/542: write d0/d17/f68 [104595,120864] 0 2024-09-13T17:05:50.265 INFO:tasks.workunit.client.1.smithi195.stdout:8/543: write d0/d17/d2f/d7c/d4c/fa0 [747423,64113] 0 2024-09-13T17:05:50.265 INFO:tasks.workunit.client.1.smithi195.stdout:8/544: creat d0/d62/fba x:0 0 0 2024-09-13T17:05:50.265 INFO:tasks.workunit.client.1.smithi195.stdout:0/508: rename d7/db/c22 to d7/d87/d9b/d4e/d68/ca3 0 2024-09-13T17:05:50.266 INFO:tasks.workunit.client.1.smithi195.stdout:0/509: chown d7/db/d38/d4f/c5a 62415 1 2024-09-13T17:05:50.266 INFO:tasks.workunit.client.0.smithi115.stdout:1/335: creat d5/d7/f77 x:0 0 0 2024-09-13T17:05:50.267 INFO:tasks.workunit.client.1.smithi195.stdout:1/491: mkdir db/df/d4d/d74/da8 0 2024-09-13T17:05:50.268 INFO:tasks.workunit.client.0.smithi115.stdout:4/480: creat d7/dd/de/d4e/f91 x:0 0 0 2024-09-13T17:05:50.269 INFO:tasks.workunit.client.1.smithi195.stdout:6/472: symlink d1c/d7d/l9b 0 2024-09-13T17:05:50.269 INFO:tasks.workunit.client.1.smithi195.stdout:6/473: fsync d1c/f23 0 2024-09-13T17:05:50.273 INFO:tasks.workunit.client.0.smithi115.stdout:1/336: unlink d5/d26/f28 0 2024-09-13T17:05:50.274 INFO:tasks.workunit.client.1.smithi195.stdout:9/572: symlink d6/df/d72/lc2 0 2024-09-13T17:05:50.276 INFO:tasks.workunit.client.0.smithi115.stdout:4/481: link d7/dd/de/f43 d7/dd/de/d4e/f92 0 2024-09-13T17:05:50.280 INFO:tasks.workunit.client.1.smithi195.stdout:2/545: mknod d0/d4a/d47/d73/d75/d88/d2c/d43/cad 0 2024-09-13T17:05:50.281 INFO:tasks.workunit.client.1.smithi195.stdout:3/502: symlink d7/d21/d2a/d35/d60/l93 0 2024-09-13T17:05:50.281 INFO:tasks.workunit.client.1.smithi195.stdout:3/503: write d7/d21/d2a/d35/d60/d6f/f83 [680417,108017] 0 2024-09-13T17:05:50.286 INFO:tasks.workunit.client.1.smithi195.stdout:8/545: rmdir d0/d17/d49/d63/dad 0 2024-09-13T17:05:50.286 INFO:tasks.workunit.client.0.smithi115.stdout:4/482: dread d7/dd/de/d4e/d6c/f7c [0,4194304] 0 2024-09-13T17:05:50.287 INFO:tasks.workunit.client.1.smithi195.stdout:5/513: rename d2/d12/d4e/c6 to d2/d12/d4e/d74/cab 0 2024-09-13T17:05:50.288 INFO:tasks.workunit.client.1.smithi195.stdout:2/546: dread d0/f45 [0,4194304] 0 2024-09-13T17:05:50.289 INFO:tasks.workunit.client.1.smithi195.stdout:0/510: mkdir d7/d87/d9b/d56/d46/da4 0 2024-09-13T17:05:50.290 INFO:tasks.workunit.client.1.smithi195.stdout:5/514: dread d2/d12/f75 [0,4194304] 0 2024-09-13T17:05:50.290 INFO:tasks.workunit.client.0.smithi115.stdout:1/337: dwrite d5/d3e/f64 [0,4194304] 0 2024-09-13T17:05:50.293 INFO:tasks.workunit.client.1.smithi195.stdout:1/492: link db/df/d4d/d74/c7d db/df/d51/d8e/ca9 0 2024-09-13T17:05:50.294 INFO:tasks.workunit.client.1.smithi195.stdout:6/474: mkdir d1c/d7d/d9c 0 2024-09-13T17:05:50.299 INFO:tasks.workunit.client.1.smithi195.stdout:1/493: dread db/d19/d5a/f78 [0,4194304] 0 2024-09-13T17:05:50.299 INFO:tasks.workunit.client.1.smithi195.stdout:1/494: truncate db/d19/f79 982479 0 2024-09-13T17:05:50.301 INFO:tasks.workunit.client.1.smithi195.stdout:3/504: unlink d7/d21/d2a/d35/f3d 0 2024-09-13T17:05:50.301 INFO:tasks.workunit.client.1.smithi195.stdout:4/581: sync 2024-09-13T17:05:50.301 INFO:tasks.workunit.client.1.smithi195.stdout:7/565: sync 2024-09-13T17:05:50.301 INFO:tasks.workunit.client.1.smithi195.stdout:8/546: symlink d0/d13/lbb 0 2024-09-13T17:05:50.302 INFO:tasks.workunit.client.0.smithi115.stdout:1/338: symlink d5/d7/d5c/d73/l78 0 2024-09-13T17:05:50.302 INFO:tasks.workunit.client.0.smithi115.stdout:1/339: creat d5/d7/d5c/f79 x:0 0 0 2024-09-13T17:05:50.302 INFO:tasks.workunit.client.0.smithi115.stdout:1/340: readlink d5/d3e/l5b 0 2024-09-13T17:05:50.302 INFO:tasks.workunit.client.0.smithi115.stdout:1/341: creat d5/d7/d33/d3a/f7a x:0 0 0 2024-09-13T17:05:50.302 INFO:tasks.workunit.client.0.smithi115.stdout:1/342: creat d5/d7/d5c/f7b x:0 0 0 2024-09-13T17:05:50.302 INFO:tasks.workunit.client.0.smithi115.stdout:1/343: readlink d5/l19 0 2024-09-13T17:05:50.303 INFO:tasks.workunit.client.0.smithi115.stdout:1/344: stat d5/d7/d33 0 2024-09-13T17:05:50.304 INFO:tasks.workunit.client.1.smithi195.stdout:9/573: rename d6/f25 to d6/df/d13/fc3 0 2024-09-13T17:05:50.306 INFO:tasks.workunit.client.0.smithi115.stdout:7/335: sync 2024-09-13T17:05:50.306 INFO:tasks.workunit.client.1.smithi195.stdout:5/515: mknod d2/d3e/cac 0 2024-09-13T17:05:50.309 INFO:tasks.workunit.client.0.smithi115.stdout:4/483: dwrite d7/dd/de/f5c [0,4194304] 0 2024-09-13T17:05:50.311 INFO:tasks.workunit.client.1.smithi195.stdout:4/582: read d1a/d1f/d21/f6a [2061281,77250] 0 2024-09-13T17:05:50.311 INFO:tasks.workunit.client.1.smithi195.stdout:4/583: truncate d1a/d1f/d21/d84/d9d/f9b 398888 0 2024-09-13T17:05:50.311 INFO:tasks.workunit.client.1.smithi195.stdout:8/547: rename d0/d13/lbb to d0/d13/d69/dac/lbc 0 2024-09-13T17:05:50.313 INFO:tasks.workunit.client.0.smithi115.stdout:1/345: symlink d5/l7c 0 2024-09-13T17:05:50.315 INFO:tasks.workunit.client.0.smithi115.stdout:7/336: creat d0/d2/d67/f80 x:0 0 0 2024-09-13T17:05:50.316 INFO:tasks.workunit.client.1.smithi195.stdout:4/584: dread d1a/d1f/d21/d7e/db4/fbc [0,4194304] 0 2024-09-13T17:05:50.317 INFO:tasks.workunit.client.1.smithi195.stdout:5/516: rename d2/df/c25 to d2/cad 0 2024-09-13T17:05:50.318 INFO:tasks.workunit.client.1.smithi195.stdout:3/505: dread d7/d67/f6c [0,4194304] 0 2024-09-13T17:05:50.318 INFO:tasks.workunit.client.1.smithi195.stdout:7/566: dread d5/db/d19/d22/f5b [0,4194304] 0 2024-09-13T17:05:50.319 INFO:tasks.workunit.client.1.smithi195.stdout:9/574: read d6/f69 [265001,25867] 0 2024-09-13T17:05:50.319 INFO:tasks.workunit.client.1.smithi195.stdout:8/548: creat d0/d17/d49/d63/db3/fbd x:0 0 0 2024-09-13T17:05:50.323 INFO:tasks.workunit.client.0.smithi115.stdout:4/484: dread d7/f19 [0,4194304] 0 2024-09-13T17:05:50.323 INFO:tasks.workunit.client.0.smithi115.stdout:4/485: fsync d7/f47 0 2024-09-13T17:05:50.323 INFO:tasks.workunit.client.1.smithi195.stdout:2/547: dwrite d0/d4a/d47/d73/d75/d88/d2c/d51/f79 [0,4194304] 0 2024-09-13T17:05:50.323 INFO:tasks.workunit.client.1.smithi195.stdout:1/495: dwrite db/d19/d37/f9d [0,4194304] 0 2024-09-13T17:05:50.323 INFO:tasks.workunit.client.1.smithi195.stdout:1/496: dread - db/df/d4d/f71 zero size 2024-09-13T17:05:50.324 INFO:tasks.workunit.client.1.smithi195.stdout:3/506: dread d7/f61 [0,4194304] 0 2024-09-13T17:05:50.324 INFO:tasks.workunit.client.1.smithi195.stdout:3/507: truncate d7/d62/f76 894881 0 2024-09-13T17:05:50.327 INFO:tasks.workunit.client.0.smithi115.stdout:1/346: mkdir d5/d60/d7d 0 2024-09-13T17:05:50.327 INFO:tasks.workunit.client.0.smithi115.stdout:1/347: write d5/d26/d2c/f39 [159884,25601] 0 2024-09-13T17:05:50.330 INFO:tasks.workunit.client.1.smithi195.stdout:0/511: dwrite d7/d50/f1c [0,4194304] 0 2024-09-13T17:05:50.331 INFO:tasks.workunit.client.0.smithi115.stdout:7/337: rename d0/d2/f3a to d0/d2/d4a/f81 0 2024-09-13T17:05:50.331 INFO:tasks.workunit.client.0.smithi115.stdout:7/338: fsync d0/d2/f8 0 2024-09-13T17:05:50.332 INFO:tasks.workunit.client.0.smithi115.stdout:4/486: creat d7/d86/d88/f93 x:0 0 0 2024-09-13T17:05:50.334 INFO:tasks.workunit.client.1.smithi195.stdout:3/508: read d7/d19/f22 [128390,23670] 0 2024-09-13T17:05:50.334 INFO:tasks.workunit.client.0.smithi115.stdout:1/348: symlink d5/d7/d5c/l7e 0 2024-09-13T17:05:50.336 INFO:tasks.workunit.client.1.smithi195.stdout:4/585: mknod d1a/cbe 0 2024-09-13T17:05:50.336 INFO:tasks.workunit.client.0.smithi115.stdout:1/349: read d5/d7/d33/d3a/f57 [26211,123857] 0 2024-09-13T17:05:50.336 INFO:tasks.workunit.client.0.smithi115.stdout:1/350: creat d5/d26/d2c/d62/f7f x:0 0 0 2024-09-13T17:05:50.339 INFO:tasks.workunit.client.0.smithi115.stdout:7/339: rename d0/d3b/d50/d21/d25 to d0/d2/d1e/d3d/d82 0 2024-09-13T17:05:50.339 INFO:tasks.workunit.client.1.smithi195.stdout:5/517: mknod d2/d12/d4e/d10/d5c/da1/cae 0 2024-09-13T17:05:50.341 INFO:tasks.workunit.client.0.smithi115.stdout:4/487: link d7/dd/de/d4e/d5a/l82 d7/l94 0 2024-09-13T17:05:50.341 INFO:tasks.workunit.client.0.smithi115.stdout:4/488: chown d7/dd/c38 247 1 2024-09-13T17:05:50.342 INFO:tasks.workunit.client.1.smithi195.stdout:7/567: mknod d5/d13/d24/cc7 0 2024-09-13T17:05:50.343 INFO:tasks.workunit.client.0.smithi115.stdout:4/489: write d7/dd/de/d4e/d5a/d4f/d53/f69 [618983,3580] 0 2024-09-13T17:05:50.345 INFO:tasks.workunit.client.1.smithi195.stdout:9/575: mknod d6/d12/d86/da7/cc4 0 2024-09-13T17:05:50.345 INFO:tasks.workunit.client.0.smithi115.stdout:1/351: dread d5/d60/f5e [0,4194304] 0 2024-09-13T17:05:50.345 INFO:tasks.workunit.client.0.smithi115.stdout:1/352: rename d5/d7/d33/d3a to d5/d7/d33/d3a/d80 22 2024-09-13T17:05:50.347 INFO:tasks.workunit.client.0.smithi115.stdout:7/340: creat d0/d51/f83 x:0 0 0 2024-09-13T17:05:50.347 INFO:tasks.workunit.client.0.smithi115.stdout:7/341: write d0/d2/d1e/d3d/d6c/f1f [1328938,123191] 0 2024-09-13T17:05:50.349 INFO:tasks.workunit.client.1.smithi195.stdout:8/549: truncate d0/d17/d2f/d7c/f48 3225475 0 2024-09-13T17:05:50.349 INFO:tasks.workunit.client.1.smithi195.stdout:8/550: chown d0/d13/d52/d55/l85 64872146 1 2024-09-13T17:05:50.349 INFO:tasks.workunit.client.1.smithi195.stdout:8/551: creat d0/d13/fbe x:0 0 0 2024-09-13T17:05:50.350 INFO:tasks.workunit.client.0.smithi115.stdout:1/353: creat d5/d7/d5c/d73/f81 x:0 0 0 2024-09-13T17:05:50.352 INFO:tasks.workunit.client.1.smithi195.stdout:2/548: rename d0/d4a/c2d to d0/d4a/d47/d73/d75/d88/cae 0 2024-09-13T17:05:50.355 INFO:tasks.workunit.client.0.smithi115.stdout:1/354: symlink d5/d7/d5c/d73/l82 0 2024-09-13T17:05:50.356 INFO:tasks.workunit.client.0.smithi115.stdout:7/342: dread d0/d2/d1e/f39 [0,4194304] 0 2024-09-13T17:05:50.358 INFO:tasks.workunit.client.0.smithi115.stdout:4/490: dwrite d7/dd/f2c [0,4194304] 0 2024-09-13T17:05:50.359 INFO:tasks.workunit.client.1.smithi195.stdout:1/497: mknod db/d58/caa 0 2024-09-13T17:05:50.359 INFO:tasks.workunit.client.1.smithi195.stdout:1/498: creat db/d19/d37/fab x:0 0 0 2024-09-13T17:05:50.361 INFO:tasks.workunit.client.1.smithi195.stdout:0/512: link d7/db/d11/l9c d7/d87/d9b/la5 0 2024-09-13T17:05:50.364 INFO:tasks.workunit.client.1.smithi195.stdout:3/509: creat d7/d21/d66/f94 x:0 0 0 2024-09-13T17:05:50.364 INFO:tasks.workunit.client.1.smithi195.stdout:3/510: chown d7/d21/d66/d7e 37 1 2024-09-13T17:05:50.368 INFO:tasks.workunit.client.1.smithi195.stdout:4/586: creat d1a/d1f/d43/d5a/d63/db8/db9/fbf x:0 0 0 2024-09-13T17:05:50.373 INFO:tasks.workunit.client.1.smithi195.stdout:5/518: mknod d2/caf 0 2024-09-13T17:05:50.373 INFO:tasks.workunit.client.1.smithi195.stdout:7/568: symlink d5/db/d50/d7f/d82/dad/lc8 0 2024-09-13T17:05:50.373 INFO:tasks.workunit.client.0.smithi115.stdout:4/491: creat d7/dd/d3c/d72/f95 x:0 0 0 2024-09-13T17:05:50.374 INFO:tasks.workunit.client.1.smithi195.stdout:8/552: stat d0/d13/c35 0 2024-09-13T17:05:50.374 INFO:tasks.workunit.client.0.smithi115.stdout:7/343: dwrite d0/d3b/d50/f47 [0,4194304] 0 2024-09-13T17:05:50.376 INFO:tasks.workunit.client.1.smithi195.stdout:9/576: rename d6/d19/f1f to d6/d12/d39/fc5 0 2024-09-13T17:05:50.381 INFO:tasks.workunit.client.1.smithi195.stdout:1/499: mknod db/d19/d37/d46/d7e/cac 0 2024-09-13T17:05:50.383 INFO:tasks.workunit.client.1.smithi195.stdout:0/513: mkdir d7/d87/d9b/d56/da6 0 2024-09-13T17:05:50.387 INFO:tasks.workunit.client.1.smithi195.stdout:0/514: read d7/d50/f21 [147384,21412] 0 2024-09-13T17:05:50.387 INFO:tasks.workunit.client.1.smithi195.stdout:3/511: unlink d7/d62/f76 0 2024-09-13T17:05:50.387 INFO:tasks.workunit.client.1.smithi195.stdout:4/587: dwrite d1a/d1f/d43/d24/d41/f4b [0,4194304] 0 2024-09-13T17:05:50.387 INFO:tasks.workunit.client.1.smithi195.stdout:4/588: chown d1a/d1f/d21/d84/d9d/d58/f80 9406 1 2024-09-13T17:05:50.388 INFO:tasks.workunit.client.1.smithi195.stdout:4/589: write d1a/d1f/d43/d24/d41/f70 [208683,117042] 0 2024-09-13T17:05:50.388 INFO:tasks.workunit.client.1.smithi195.stdout:4/590: creat d1a/d1f/d43/fc0 x:0 0 0 2024-09-13T17:05:50.388 INFO:tasks.workunit.client.1.smithi195.stdout:4/591: creat d1a/d1f/d43/d5a/fc1 x:0 0 0 2024-09-13T17:05:50.388 INFO:tasks.workunit.client.1.smithi195.stdout:4/592: chown d1a/c56 3717461 1 2024-09-13T17:05:50.388 INFO:tasks.workunit.client.1.smithi195.stdout:4/593: dread - d1a/d1f/d43/d24/fa6 zero size 2024-09-13T17:05:50.388 INFO:tasks.workunit.client.1.smithi195.stdout:5/519: symlink d2/d12/d3f/lb0 0 2024-09-13T17:05:50.389 INFO:tasks.workunit.client.1.smithi195.stdout:7/569: unlink d5/db/d19/d22/f6b 0 2024-09-13T17:05:50.390 INFO:tasks.workunit.client.1.smithi195.stdout:7/570: creat d5/db/d19/fc9 x:0 0 0 2024-09-13T17:05:50.391 INFO:tasks.workunit.client.1.smithi195.stdout:8/553: truncate d0/f61 127648 0 2024-09-13T17:05:50.391 INFO:tasks.workunit.client.1.smithi195.stdout:8/554: chown d0/d4 825441678 1 2024-09-13T17:05:50.391 INFO:tasks.workunit.client.1.smithi195.stdout:8/555: chown d0/d17/d2f/d6a 1647 1 2024-09-13T17:05:50.391 INFO:tasks.workunit.client.1.smithi195.stdout:8/556: fsync d0/f8 0 2024-09-13T17:05:50.392 INFO:tasks.workunit.client.1.smithi195.stdout:8/557: dread - d0/d17/d49/d63/d71/f9c zero size 2024-09-13T17:05:50.392 INFO:tasks.workunit.client.1.smithi195.stdout:8/558: creat d0/d13/d52/d55/fbf x:0 0 0 2024-09-13T17:05:50.392 INFO:tasks.workunit.client.1.smithi195.stdout:8/559: chown d0/d17/d2f/d6a 557 1 2024-09-13T17:05:50.392 INFO:tasks.workunit.client.0.smithi115.stdout:4/492: dread d7/dd/de/f59 [0,4194304] 0 2024-09-13T17:05:50.393 INFO:tasks.workunit.client.1.smithi195.stdout:2/549: rename d0/f22 to d0/faf 0 2024-09-13T17:05:50.393 INFO:tasks.workunit.client.1.smithi195.stdout:2/550: write d0/d4a/d47/d73/d75/d88/d62/f7d [1159698,68205] 0 2024-09-13T17:05:50.394 INFO:tasks.workunit.client.1.smithi195.stdout:1/500: creat db/df/d51/d8e/fad x:0 0 0 2024-09-13T17:05:50.396 INFO:tasks.workunit.client.0.smithi115.stdout:4/493: unlink d7/d86/d88/c8c 0 2024-09-13T17:05:50.398 INFO:tasks.workunit.client.1.smithi195.stdout:3/512: symlink d7/d21/d66/d7e/l95 0 2024-09-13T17:05:50.398 INFO:tasks.workunit.client.1.smithi195.stdout:3/513: fsync d7/d19/d1e/f52 0 2024-09-13T17:05:50.398 INFO:tasks.workunit.client.1.smithi195.stdout:1/501: dread db/f18 [0,4194304] 0 2024-09-13T17:05:50.399 INFO:tasks.workunit.client.1.smithi195.stdout:0/515: write d7/d50/f1c [216919,31953] 0 2024-09-13T17:05:50.402 INFO:tasks.workunit.client.0.smithi115.stdout:4/494: dread d7/f30 [0,4194304] 0 2024-09-13T17:05:50.402 INFO:tasks.workunit.client.0.smithi115.stdout:4/495: write d7/dd/de/d4e/d5a/d4f/d53/f69 [2048750,112886] 0 2024-09-13T17:05:50.402 INFO:tasks.workunit.client.0.smithi115.stdout:7/344: dwrite d0/d2/d1e/d3d/d6c/d71/f65 [0,4194304] 0 2024-09-13T17:05:50.402 INFO:tasks.workunit.client.0.smithi115.stdout:7/345: chown d0/d2/c5c 62071625 1 2024-09-13T17:05:50.402 INFO:tasks.workunit.client.0.smithi115.stdout:7/346: creat d0/d2/d67/f84 x:0 0 0 2024-09-13T17:05:50.403 INFO:tasks.workunit.client.1.smithi195.stdout:9/577: dwrite d6/d19/d21/d5b/f5f [0,4194304] 0 2024-09-13T17:05:50.403 INFO:tasks.workunit.client.1.smithi195.stdout:9/578: write d6/d12/d86/f96 [935807,115269] 0 2024-09-13T17:05:50.403 INFO:tasks.workunit.client.1.smithi195.stdout:9/579: readlink d6/d12/d39/lac 0 2024-09-13T17:05:50.403 INFO:tasks.workunit.client.1.smithi195.stdout:4/594: dread d1a/d1f/d43/d5a/f65 [0,4194304] 0 2024-09-13T17:05:50.404 INFO:tasks.workunit.client.1.smithi195.stdout:4/595: chown d1a/c1b 31623559 1 2024-09-13T17:05:50.404 INFO:tasks.workunit.client.1.smithi195.stdout:5/520: rename d2/df/d78/d54/d58/f59 to d2/d12/d4e/d74/d91/fb1 0 2024-09-13T17:05:50.404 INFO:tasks.workunit.client.1.smithi195.stdout:5/521: write d2/d12/d4e/d10/d46/f96 [767865,126587] 0 2024-09-13T17:05:50.404 INFO:tasks.workunit.client.1.smithi195.stdout:5/522: write d2/d12/f50 [939362,110827] 0 2024-09-13T17:05:50.404 INFO:tasks.workunit.client.0.smithi115.stdout:4/496: truncate f3 1244335 0 2024-09-13T17:05:50.404 INFO:tasks.workunit.client.0.smithi115.stdout:4/497: readlink d7/l48 0 2024-09-13T17:05:50.407 INFO:tasks.workunit.client.1.smithi195.stdout:7/571: creat d5/d13/fca x:0 0 0 2024-09-13T17:05:50.407 INFO:tasks.workunit.client.1.smithi195.stdout:7/572: write d5/d13/d30/f8a [323796,58725] 0 2024-09-13T17:05:50.408 INFO:tasks.workunit.client.0.smithi115.stdout:8/376: sync 2024-09-13T17:05:50.413 INFO:tasks.workunit.client.1.smithi195.stdout:8/560: symlink d0/d13/d52/lc0 0 2024-09-13T17:05:50.413 INFO:tasks.workunit.client.1.smithi195.stdout:8/561: dread - d0/d13/fbe zero size 2024-09-13T17:05:50.414 INFO:tasks.workunit.client.0.smithi115.stdout:7/347: symlink d0/d2/d1e/d3d/d7c/l85 0 2024-09-13T17:05:50.417 INFO:tasks.workunit.client.1.smithi195.stdout:2/551: link d0/d3/df/f35 d0/d4a/d47/d73/d94/fb0 0 2024-09-13T17:05:50.421 INFO:tasks.workunit.client.1.smithi195.stdout:3/514: unlink d7/d21/d2a/d35/l36 0 2024-09-13T17:05:50.422 INFO:tasks.workunit.client.1.smithi195.stdout:7/573: dwrite d5/f6 [0,4194304] 0 2024-09-13T17:05:50.425 INFO:tasks.workunit.client.0.smithi115.stdout:7/348: write d0/f13 [3143514,125997] 0 2024-09-13T17:05:50.425 INFO:tasks.workunit.client.1.smithi195.stdout:1/502: mkdir db/d58/dae 0 2024-09-13T17:05:50.426 INFO:tasks.workunit.client.0.smithi115.stdout:8/377: mknod d0/d15/c7d 0 2024-09-13T17:05:50.428 INFO:tasks.workunit.client.1.smithi195.stdout:0/516: symlink d7/d87/d9b/d56/d4d/d5e/la7 0 2024-09-13T17:05:50.430 INFO:tasks.workunit.client.0.smithi115.stdout:4/498: rmdir d7/dd/de/d4e/d5a/d4f/d53 39 2024-09-13T17:05:50.430 INFO:tasks.workunit.client.0.smithi115.stdout:4/499: stat d7/dd/de/d4e/d5a/d4f/f76 0 2024-09-13T17:05:50.431 INFO:tasks.workunit.client.1.smithi195.stdout:3/515: dread f5 [0,4194304] 0 2024-09-13T17:05:50.433 INFO:tasks.workunit.client.0.smithi115.stdout:7/349: mkdir d0/d2/d67/d86 0 2024-09-13T17:05:50.433 INFO:tasks.workunit.client.0.smithi115.stdout:7/350: chown d0/d51 507074 1 2024-09-13T17:05:50.435 INFO:tasks.workunit.client.0.smithi115.stdout:8/378: mkdir d0/d26/d29/d59/d7e 0 2024-09-13T17:05:50.437 INFO:tasks.workunit.client.0.smithi115.stdout:7/351: unlink d0/d3b/f58 0 2024-09-13T17:05:50.440 INFO:tasks.workunit.client.1.smithi195.stdout:7/574: dwrite d5/db/d50/d7f/f80 [0,4194304] 0 2024-09-13T17:05:50.440 INFO:tasks.workunit.client.1.smithi195.stdout:7/575: dread - d5/d35/d37/f65 zero size 2024-09-13T17:05:50.440 INFO:tasks.workunit.client.1.smithi195.stdout:7/576: write d5/db/d19/d22/d3c/fa6 [77663,10105] 0 2024-09-13T17:05:50.440 INFO:tasks.workunit.client.1.smithi195.stdout:7/577: read d5/db/d50/d7f/d82/fab [30380,45174] 0 2024-09-13T17:05:50.446 INFO:tasks.workunit.client.0.smithi115.stdout:4/500: dwrite d7/dd/f2b [0,4194304] 0 2024-09-13T17:05:50.453 INFO:tasks.workunit.client.0.smithi115.stdout:8/379: dwrite d0/fb [0,4194304] 0 2024-09-13T17:05:50.539 INFO:tasks.workunit.client.0.smithi115.stdout:7/352: unlink d0/d51/l52 0 2024-09-13T17:05:50.539 INFO:tasks.workunit.client.0.smithi115.stdout:7/353: fdatasync d0/d2/f8 0 2024-09-13T17:05:50.541 INFO:tasks.workunit.client.1.smithi195.stdout:9/580: mknod d6/d12/dbc/cc6 0 2024-09-13T17:05:50.541 INFO:tasks.workunit.client.1.smithi195.stdout:9/581: read d6/d19/d21/d5b/f83 [227819,128438] 0 2024-09-13T17:05:50.541 INFO:tasks.workunit.client.1.smithi195.stdout:9/582: stat d6/df/d16/f74 0 2024-09-13T17:05:50.541 INFO:tasks.workunit.client.1.smithi195.stdout:9/583: chown d6/cd 416 1 2024-09-13T17:05:50.541 INFO:tasks.workunit.client.1.smithi195.stdout:9/584: creat d6/d19/d21/fc7 x:0 0 0 2024-09-13T17:05:50.561 INFO:tasks.workunit.client.0.smithi115.stdout:4/501: truncate d7/dd/d63/f6a 959697 0 2024-09-13T17:05:50.563 INFO:tasks.workunit.client.0.smithi115.stdout:8/380: creat d0/d21/d76/f7f x:0 0 0 2024-09-13T17:05:50.566 INFO:tasks.workunit.client.1.smithi195.stdout:5/523: mkdir d2/df/d90/db2 0 2024-09-13T17:05:50.577 INFO:tasks.workunit.client.0.smithi115.stdout:7/354: rename d0/d2/d1e/d3d/d6c/f1f to d0/f87 0 2024-09-13T17:05:50.577 INFO:tasks.workunit.client.1.smithi195.stdout:5/524: dread d2/df/f81 [4194304,4194304] 0 2024-09-13T17:05:50.577 INFO:tasks.workunit.client.1.smithi195.stdout:5/525: fdatasync d2/d12/d4e/d10/d5c/f87 0 2024-09-13T17:05:50.578 INFO:tasks.workunit.client.0.smithi115.stdout:4/502: mknod d7/dd/c96 0 2024-09-13T17:05:50.579 INFO:tasks.workunit.client.1.smithi195.stdout:2/552: creat d0/d4a/d47/d73/d75/d88/d62/fb1 x:0 0 0 2024-09-13T17:05:50.580 INFO:tasks.workunit.client.0.smithi115.stdout:8/381: mkdir d0/d42/d80 0 2024-09-13T17:05:50.583 INFO:tasks.workunit.client.0.smithi115.stdout:7/355: rmdir d0/d2/d4a/d78 0 2024-09-13T17:05:50.586 INFO:tasks.workunit.client.0.smithi115.stdout:4/503: mkdir d7/dd/d3c/d7b/d97 0 2024-09-13T17:05:50.586 INFO:tasks.workunit.client.0.smithi115.stdout:4/504: fsync d7/dd/de/d4e/d5a/d4f/d53/f7a 0 2024-09-13T17:05:50.587 INFO:tasks.workunit.client.1.smithi195.stdout:6/475: sync 2024-09-13T17:05:50.588 INFO:tasks.workunit.client.1.smithi195.stdout:0/517: unlink d7/db/d38/d4f/f8e 0 2024-09-13T17:05:50.589 INFO:tasks.workunit.client.0.smithi115.stdout:8/382: rmdir d0/d15/d3e 39 2024-09-13T17:05:50.590 INFO:tasks.workunit.client.0.smithi115.stdout:8/383: chown d0/d26/c45 84964682 1 2024-09-13T17:05:50.590 INFO:tasks.workunit.client.1.smithi195.stdout:3/516: mkdir d7/d62/d70/d96 0 2024-09-13T17:05:50.591 INFO:tasks.workunit.client.0.smithi115.stdout:8/384: dread d0/d15/f2f [0,4194304] 0 2024-09-13T17:05:50.591 INFO:tasks.workunit.client.0.smithi115.stdout:4/505: rmdir d7/dd/de/d4e/d5a/d4f/d53 39 2024-09-13T17:05:50.592 INFO:tasks.workunit.client.1.smithi195.stdout:7/578: symlink d5/d35/d37/lcb 0 2024-09-13T17:05:50.594 INFO:tasks.workunit.client.1.smithi195.stdout:6/476: dread d1c/d2d/d30/f5b [0,4194304] 0 2024-09-13T17:05:50.594 INFO:tasks.workunit.client.1.smithi195.stdout:6/477: chown f19 38 1 2024-09-13T17:05:50.594 INFO:tasks.workunit.client.1.smithi195.stdout:6/478: chown d1c/d24/d49/d5f/d85/l5a 5055 1 2024-09-13T17:05:50.594 INFO:tasks.workunit.client.0.smithi115.stdout:8/385: rename d0/d15/d44/f49 to d0/d26/f81 0 2024-09-13T17:05:50.597 INFO:tasks.workunit.client.0.smithi115.stdout:8/386: rename d0/d21/l25 to d0/l82 0 2024-09-13T17:05:50.600 INFO:tasks.workunit.client.0.smithi115.stdout:4/506: write d7/f12 [1026127,76493] 0 2024-09-13T17:05:50.601 INFO:tasks.workunit.client.0.smithi115.stdout:4/507: readlink d7/l22 0 2024-09-13T17:05:50.602 INFO:tasks.workunit.client.1.smithi195.stdout:9/585: creat d6/d19/d21/d45/fc8 x:0 0 0 2024-09-13T17:05:50.605 INFO:tasks.workunit.client.1.smithi195.stdout:5/526: symlink d2/df/d78/d99/lb3 0 2024-09-13T17:05:50.606 INFO:tasks.workunit.client.1.smithi195.stdout:2/553: mkdir d0/d4a/d47/d73/d75/d88/d2c/d43/d63/db2 0 2024-09-13T17:05:50.608 INFO:tasks.workunit.client.1.smithi195.stdout:1/503: rmdir db/df/d13 39 2024-09-13T17:05:50.609 INFO:tasks.workunit.client.0.smithi115.stdout:8/387: rename d0/d18/d43 to d0/d21/d76/d83 0 2024-09-13T17:05:50.610 INFO:tasks.workunit.client.1.smithi195.stdout:0/518: truncate d7/d50/f5c 3835886 0 2024-09-13T17:05:50.614 INFO:tasks.workunit.client.0.smithi115.stdout:4/508: link d7/dd/d3c/f58 d7/dd/de/d4e/d5a/d4f/d53/f98 0 2024-09-13T17:05:50.614 INFO:tasks.workunit.client.0.smithi115.stdout:4/509: creat d7/dd/d63/f99 x:0 0 0 2024-09-13T17:05:50.616 INFO:tasks.workunit.client.1.smithi195.stdout:3/517: mknod d7/d21/d2a/c97 0 2024-09-13T17:05:50.616 INFO:tasks.workunit.client.1.smithi195.stdout:3/518: chown d7/d21/d2a/d35/d60/d6f/d74 26159506 1 2024-09-13T17:05:50.617 INFO:tasks.workunit.client.1.smithi195.stdout:7/579: mkdir d5/db/d50/d7f/d82/dcc 0 2024-09-13T17:05:50.619 INFO:tasks.workunit.client.0.smithi115.stdout:8/388: dread d0/d21/f4a [0,4194304] 0 2024-09-13T17:05:50.620 INFO:tasks.workunit.client.1.smithi195.stdout:6/479: unlink cc 0 2024-09-13T17:05:50.621 INFO:tasks.workunit.client.0.smithi115.stdout:8/389: symlink d0/d18/d19/l84 0 2024-09-13T17:05:50.623 INFO:tasks.workunit.client.1.smithi195.stdout:9/586: rename d6/d19/d21/d45/dad/d47/d61/f73 to d6/d19/d21/d45/fc9 0 2024-09-13T17:05:50.623 INFO:tasks.workunit.client.1.smithi195.stdout:8/562: sync 2024-09-13T17:05:50.624 INFO:tasks.workunit.client.1.smithi195.stdout:4/596: sync 2024-09-13T17:05:50.624 INFO:tasks.workunit.client.1.smithi195.stdout:4/597: chown d1a/d1f/d43/d24/d41 204638296 1 2024-09-13T17:05:50.624 INFO:tasks.workunit.client.1.smithi195.stdout:5/527: symlink d2/d12/d4e/d10/d5c/lb4 0 2024-09-13T17:05:50.625 INFO:tasks.workunit.client.0.smithi115.stdout:8/390: mkdir d0/d18/d19/d2b/d3b/d85 0 2024-09-13T17:05:50.625 INFO:tasks.workunit.client.0.smithi115.stdout:8/391: readlink d0/l23 0 2024-09-13T17:05:50.626 INFO:tasks.workunit.client.1.smithi195.stdout:3/519: dread d7/f61 [0,4194304] 0 2024-09-13T17:05:50.628 INFO:tasks.workunit.client.1.smithi195.stdout:2/554: unlink d0/d4a/d47/d73/d75/d88/f23 0 2024-09-13T17:05:50.630 INFO:tasks.workunit.client.1.smithi195.stdout:7/580: creat d5/db/d50/d7f/fcd x:0 0 0 2024-09-13T17:05:50.630 INFO:tasks.workunit.client.1.smithi195.stdout:6/480: mknod d1c/d2d/d30/c9d 0 2024-09-13T17:05:50.631 INFO:tasks.workunit.client.1.smithi195.stdout:7/581: dread d5/db/d19/d22/f4e [0,4194304] 0 2024-09-13T17:05:50.635 INFO:tasks.workunit.client.1.smithi195.stdout:9/587: unlink d6/d19/d21/d5b/f50 0 2024-09-13T17:05:50.635 INFO:tasks.workunit.client.1.smithi195.stdout:9/588: dread - d6/d19/d21/d64/d68/d6d/fa2 zero size 2024-09-13T17:05:50.635 INFO:tasks.workunit.client.1.smithi195.stdout:9/589: write d6/d19/d21/d64/d68/d6d/fa2 [792875,89423] 0 2024-09-13T17:05:50.636 INFO:tasks.workunit.client.1.smithi195.stdout:0/519: dwrite d7/d87/d9b/d56/d46/f74 [0,4194304] 0 2024-09-13T17:05:50.636 INFO:tasks.workunit.client.1.smithi195.stdout:0/520: write d7/db/d38/f76 [5426727,118163] 0 2024-09-13T17:05:50.636 INFO:tasks.workunit.client.1.smithi195.stdout:0/521: chown d7/d87/d9b/d56/d4d/d5e/f70 7355879 1 2024-09-13T17:05:50.637 INFO:tasks.workunit.client.1.smithi195.stdout:8/563: unlink d0/d4/c10 0 2024-09-13T17:05:50.639 INFO:tasks.workunit.client.1.smithi195.stdout:4/598: unlink d1a/d1f/d21/d7e/f72 0 2024-09-13T17:05:50.639 INFO:tasks.workunit.client.1.smithi195.stdout:4/599: readlink d1a/d1f/d43/d24/d41/d60/d6f/lac 0 2024-09-13T17:05:50.640 INFO:tasks.workunit.client.0.smithi115.stdout:4/510: dwrite d7/dd/d63/f99 [0,4194304] 0 2024-09-13T17:05:50.640 INFO:tasks.workunit.client.1.smithi195.stdout:3/520: mknod d7/d21/d51/c98 0 2024-09-13T17:05:50.644 INFO:tasks.workunit.client.1.smithi195.stdout:2/555: mkdir d0/d4a/d47/d73/d75/d88/d2c/d43/d63/db2/db3 0 2024-09-13T17:05:50.645 INFO:tasks.workunit.client.0.smithi115.stdout:4/511: creat d7/dd/d3c/d7b/f9a x:0 0 0 2024-09-13T17:05:50.645 INFO:tasks.workunit.client.0.smithi115.stdout:4/512: dread - d7/dd/d63/f87 zero size 2024-09-13T17:05:50.646 INFO:tasks.workunit.client.1.smithi195.stdout:6/481: creat d1c/d24/d49/d5f/d85/f9e x:0 0 0 2024-09-13T17:05:50.646 INFO:tasks.workunit.client.1.smithi195.stdout:6/482: fdatasync d1c/d24/d49/d5f/f50 0 2024-09-13T17:05:50.647 INFO:tasks.workunit.client.1.smithi195.stdout:9/590: mkdir d6/d19/d21/d45/dad/dca 0 2024-09-13T17:05:50.649 INFO:tasks.workunit.client.1.smithi195.stdout:0/522: mknod d7/db/d9a/ca8 0 2024-09-13T17:05:50.650 INFO:tasks.workunit.client.1.smithi195.stdout:5/528: dwrite d2/df/d78/d54/d58/f69 [0,4194304] 0 2024-09-13T17:05:50.651 INFO:tasks.workunit.client.0.smithi115.stdout:8/392: dwrite d0/d26/f35 [0,4194304] 0 2024-09-13T17:05:50.651 INFO:tasks.workunit.client.1.smithi195.stdout:8/564: mknod d0/d4/cc1 0 2024-09-13T17:05:50.651 INFO:tasks.workunit.client.1.smithi195.stdout:8/565: creat d0/d17/fc2 x:0 0 0 2024-09-13T17:05:50.651 INFO:tasks.workunit.client.1.smithi195.stdout:8/566: read - d0/d13/d52/d55/f95 zero size 2024-09-13T17:05:50.652 INFO:tasks.workunit.client.1.smithi195.stdout:8/567: write d0/d17/f9e [439451,105528] 0 2024-09-13T17:05:50.652 INFO:tasks.workunit.client.1.smithi195.stdout:4/600: mkdir d1a/d1f/d9c/dc2 0 2024-09-13T17:05:50.653 INFO:tasks.workunit.client.1.smithi195.stdout:3/521: symlink d7/d5f/l99 0 2024-09-13T17:05:50.653 INFO:tasks.workunit.client.1.smithi195.stdout:4/601: write d1a/d1f/d21/d84/d9d/f9b [336357,92184] 0 2024-09-13T17:05:50.653 INFO:tasks.workunit.client.1.smithi195.stdout:4/602: read - d1a/d1f/d43/d5a/d63/fa9 zero size 2024-09-13T17:05:50.656 INFO:tasks.workunit.client.1.smithi195.stdout:2/556: unlink d0/d4a/f7b 0 2024-09-13T17:05:50.657 INFO:tasks.workunit.client.0.smithi115.stdout:4/513: dread d7/dd/de/f1c [0,4194304] 0 2024-09-13T17:05:50.657 INFO:tasks.workunit.client.0.smithi115.stdout:4/514: chown d7/dd/de/d4e/f91 6 1 2024-09-13T17:05:50.657 INFO:tasks.workunit.client.0.smithi115.stdout:4/515: fsync d7/dd/de/d4e/d6c/f7c 0 2024-09-13T17:05:50.659 INFO:tasks.workunit.client.1.smithi195.stdout:6/483: unlink d1c/d24/d49/c84 0 2024-09-13T17:05:50.660 INFO:tasks.workunit.client.0.smithi115.stdout:8/393: creat d0/d26/d29/f86 x:0 0 0 2024-09-13T17:05:50.665 INFO:tasks.workunit.client.1.smithi195.stdout:7/582: dwrite d5/db/d19/d22/f62 [0,4194304] 0 2024-09-13T17:05:50.665 INFO:tasks.workunit.client.1.smithi195.stdout:7/583: stat d5/d13/l71 0 2024-09-13T17:05:50.670 INFO:tasks.workunit.client.1.smithi195.stdout:2/557: dread d0/d3/f92 [0,4194304] 0 2024-09-13T17:05:50.672 INFO:tasks.workunit.client.1.smithi195.stdout:6/484: dread d1c/d2d/d30/f57 [0,4194304] 0 2024-09-13T17:05:50.672 INFO:tasks.workunit.client.1.smithi195.stdout:6/485: readlink d1c/d2d/l73 0 2024-09-13T17:05:50.673 INFO:tasks.workunit.client.1.smithi195.stdout:0/523: mknod d7/d88/d23/d96/ca9 0 2024-09-13T17:05:50.673 INFO:tasks.workunit.client.1.smithi195.stdout:0/524: dread - d7/d87/d9b/f95 zero size 2024-09-13T17:05:50.673 INFO:tasks.workunit.client.1.smithi195.stdout:0/525: write d7/db/d38/d5d/f72 [665829,56307] 0 2024-09-13T17:05:50.673 INFO:tasks.workunit.client.1.smithi195.stdout:0/526: read - d7/f53 zero size 2024-09-13T17:05:50.673 INFO:tasks.workunit.client.1.smithi195.stdout:8/568: dwrite d0/d13/f16 [0,4194304] 0 2024-09-13T17:05:50.673 INFO:tasks.workunit.client.0.smithi115.stdout:4/516: rename d7/dd/de/d4e/d5a/d4f/c64 to d7/dd/de/d4e/d5a/c9b 0 2024-09-13T17:05:50.677 INFO:tasks.workunit.client.1.smithi195.stdout:5/529: symlink d2/df/d86/lb5 0 2024-09-13T17:05:50.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:50 smithi115 ceph-mon[27708]: from='mgr.24317 ' entity='mgr.smithi195.hjjifz' 2024-09-13T17:05:50.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:50 smithi115 ceph-mon[27708]: from='mgr.24317 ' entity='mgr.smithi195.hjjifz' 2024-09-13T17:05:50.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:50 smithi115 ceph-mon[27708]: pgmap v14: 65 pgs: 65 active+clean; 1.9 GiB data, 5.6 GiB used, 531 GiB / 536 GiB avail; 200 MiB/s rd, 268 MiB/s wr, 807 op/s 2024-09-13T17:05:50.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:50 smithi115 ceph-mon[27708]: from='mgr.24317 ' entity='mgr.smithi195.hjjifz' 2024-09-13T17:05:50.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:50 smithi115 ceph-mon[27708]: from='mgr.24317 ' entity='mgr.smithi195.hjjifz' 2024-09-13T17:05:50.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:50 smithi115 ceph-mon[27708]: from='mgr.24317 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:05:50.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:50 smithi115 ceph-mon[27708]: from='mgr.24317 ' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:05:50.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:50 smithi115 ceph-mon[27708]: from='mgr.24317 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:05:50.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:50 smithi115 ceph-mon[27708]: from='mgr.24317 ' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:05:50.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:50 smithi115 ceph-mon[27708]: from='mgr.24317 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:05:50.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:50 smithi115 ceph-mon[27708]: from='mgr.24317 ' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:05:50.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:50 smithi115 ceph-mon[27708]: from='mgr.24317 ' entity='mgr.smithi195.hjjifz' 2024-09-13T17:05:50.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:50 smithi115 ceph-mon[27708]: from='mgr.24317 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:05:50.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:50 smithi115 ceph-mon[27708]: from='mgr.24317 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:05:50.681 INFO:tasks.workunit.client.0.smithi115.stdout:8/394: dwrite d0/d21/d3a/d60/f78 [0,4194304] 0 2024-09-13T17:05:50.682 INFO:tasks.workunit.client.1.smithi195.stdout:7/584: read d5/d13/d24/d70/f9f [324348,92472] 0 2024-09-13T17:05:50.685 INFO:tasks.workunit.client.1.smithi195.stdout:5/530: dread d2/f26 [0,4194304] 0 2024-09-13T17:05:50.685 INFO:tasks.workunit.client.1.smithi195.stdout:2/558: dwrite d0/d3/fa8 [0,4194304] 0 2024-09-13T17:05:50.687 INFO:tasks.workunit.client.1.smithi195.stdout:5/531: dread d2/d3e/fa2 [0,4194304] 0 2024-09-13T17:05:50.694 INFO:tasks.workunit.client.1.smithi195.stdout:5/532: dread d2/df/f81 [4194304,4194304] 0 2024-09-13T17:05:50.701 INFO:tasks.workunit.client.1.smithi195.stdout:5/533: dread d2/df/d78/f4f [0,4194304] 0 2024-09-13T17:05:50.761 INFO:tasks.workunit.client.0.smithi115.stdout:4/517: mkdir d7/dd/de/d4e/d5a/d4f/d9c 0 2024-09-13T17:05:50.761 INFO:tasks.workunit.client.0.smithi115.stdout:4/518: chown d7/l22 3075 1 2024-09-13T17:05:50.767 INFO:tasks.workunit.client.0.smithi115.stdout:8/395: mknod d0/d18/d19/d2b/d37/c87 0 2024-09-13T17:05:50.769 INFO:tasks.workunit.client.1.smithi195.stdout:4/603: mkdir d1a/d1f/d21/d7e/dc3 0 2024-09-13T17:05:50.769 INFO:tasks.workunit.client.1.smithi195.stdout:4/604: write d1a/d1f/f87 [2471907,47430] 0 2024-09-13T17:05:50.773 INFO:tasks.workunit.client.0.smithi115.stdout:4/519: mknod d7/dd/de/d4e/d5a/c9d 0 2024-09-13T17:05:50.775 INFO:tasks.workunit.client.1.smithi195.stdout:6/486: link d1c/d24/d49/d5f/d85/l5a d1c/d24/d49/d5f/l9f 0 2024-09-13T17:05:50.776 INFO:tasks.workunit.client.0.smithi115.stdout:8/396: creat d0/d21/d76/d83/f88 x:0 0 0 2024-09-13T17:05:50.780 INFO:tasks.workunit.client.0.smithi115.stdout:4/520: rename d7/dd/d3c/d7b/l6d to d7/dd/d3c/d7b/d97/l9e 0 2024-09-13T17:05:50.781 INFO:tasks.workunit.client.0.smithi115.stdout:4/521: truncate d7/dd/f26 218370 0 2024-09-13T17:05:50.781 INFO:tasks.workunit.client.0.smithi115.stdout:4/522: dread - d7/dd/d3c/f6e zero size 2024-09-13T17:05:50.781 INFO:tasks.workunit.client.1.smithi195.stdout:8/569: mknod d0/d13/d52/d55/cc3 0 2024-09-13T17:05:50.782 INFO:tasks.workunit.client.1.smithi195.stdout:8/570: write d0/d17/d49/d63/fb5 [250885,95171] 0 2024-09-13T17:05:50.782 INFO:tasks.workunit.client.1.smithi195.stdout:7/585: rename d5/d35/d37/l58 to d5/d35/lce 0 2024-09-13T17:05:50.784 INFO:tasks.workunit.client.0.smithi115.stdout:4/523: mkdir d7/dd/de/d4e/d9f 0 2024-09-13T17:05:50.787 INFO:tasks.workunit.client.1.smithi195.stdout:0/527: dread d7/db/d38/d5d/f7f [4194304,4194304] 0 2024-09-13T17:05:50.788 INFO:tasks.workunit.client.1.smithi195.stdout:0/528: stat d7/d88/d23/l28 0 2024-09-13T17:05:50.788 INFO:tasks.workunit.client.0.smithi115.stdout:4/524: truncate d7/dd/de/f43 78509 0 2024-09-13T17:05:50.791 INFO:tasks.workunit.client.0.smithi115.stdout:4/525: mkdir d7/dd/da0 0 2024-09-13T17:05:50.791 INFO:tasks.workunit.client.0.smithi115.stdout:4/526: chown d7/dd/f4d 22373 1 2024-09-13T17:05:50.820 INFO:tasks.workunit.client.0.smithi115.stdout:4/527: truncate d7/dd/f25 209543 0 2024-09-13T17:05:50.820 INFO:tasks.workunit.client.0.smithi115.stdout:4/528: dread - d7/dd/d3c/d7b/f9a zero size 2024-09-13T17:05:50.820 INFO:tasks.workunit.client.0.smithi115.stdout:4/529: fdatasync d7/f7f 0 2024-09-13T17:05:50.820 INFO:tasks.workunit.client.0.smithi115.stdout:4/530: read d7/dd/f26 [128640,76762] 0 2024-09-13T17:05:50.820 INFO:tasks.workunit.client.0.smithi115.stdout:4/531: stat d7/dd/f26 0 2024-09-13T17:05:50.821 INFO:tasks.workunit.client.1.smithi195.stdout:5/534: link d2/f6a d2/df/d62/fb6 0 2024-09-13T17:05:50.826 INFO:tasks.workunit.client.0.smithi115.stdout:4/532: dread d7/f19 [0,4194304] 0 2024-09-13T17:05:50.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:50 smithi195 ceph-mon[34981]: from='mgr.24317 ' entity='mgr.smithi195.hjjifz' 2024-09-13T17:05:50.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:50 smithi195 ceph-mon[34981]: from='mgr.24317 ' entity='mgr.smithi195.hjjifz' 2024-09-13T17:05:50.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:50 smithi195 ceph-mon[34981]: pgmap v14: 65 pgs: 65 active+clean; 1.9 GiB data, 5.6 GiB used, 531 GiB / 536 GiB avail; 200 MiB/s rd, 268 MiB/s wr, 807 op/s 2024-09-13T17:05:50.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:50 smithi195 ceph-mon[34981]: from='mgr.24317 ' entity='mgr.smithi195.hjjifz' 2024-09-13T17:05:50.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:50 smithi195 ceph-mon[34981]: from='mgr.24317 ' entity='mgr.smithi195.hjjifz' 2024-09-13T17:05:50.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:50 smithi195 ceph-mon[34981]: from='mgr.24317 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:05:50.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:50 smithi195 ceph-mon[34981]: from='mgr.24317 ' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:05:50.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:50 smithi195 ceph-mon[34981]: from='mgr.24317 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:05:50.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:50 smithi195 ceph-mon[34981]: from='mgr.24317 ' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:05:50.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:50 smithi195 ceph-mon[34981]: from='mgr.24317 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:05:50.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:50 smithi195 ceph-mon[34981]: from='mgr.24317 ' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:05:50.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:50 smithi195 ceph-mon[34981]: from='mgr.24317 ' entity='mgr.smithi195.hjjifz' 2024-09-13T17:05:50.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:50 smithi195 ceph-mon[34981]: from='mgr.24317 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:05:50.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:50 smithi195 ceph-mon[34981]: from='mgr.24317 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:05:50.831 INFO:tasks.workunit.client.1.smithi195.stdout:3/522: rmdir d7/d21/d66/d7e 39 2024-09-13T17:05:50.839 INFO:tasks.workunit.client.1.smithi195.stdout:6/487: creat d1c/d2d/d5e/fa0 x:0 0 0 2024-09-13T17:05:50.841 INFO:tasks.workunit.client.1.smithi195.stdout:8/571: link d0/c64 d0/d4/cc4 0 2024-09-13T17:05:50.841 INFO:tasks.workunit.client.1.smithi195.stdout:8/572: readlink d0/d17/d2f/d7c/d4c/la6 0 2024-09-13T17:05:50.844 INFO:tasks.workunit.client.1.smithi195.stdout:7/586: stat d5/d35/d37/cbe 0 2024-09-13T17:05:50.846 INFO:tasks.workunit.client.1.smithi195.stdout:3/523: dwrite d7/d21/d2a/f4b [0,4194304] 0 2024-09-13T17:05:50.847 INFO:tasks.workunit.client.0.smithi115.stdout:2/617: sync 2024-09-13T17:05:50.847 INFO:tasks.workunit.client.0.smithi115.stdout:6/371: sync 2024-09-13T17:05:50.847 INFO:tasks.workunit.client.0.smithi115.stdout:9/270: sync 2024-09-13T17:05:50.847 INFO:tasks.workunit.client.0.smithi115.stdout:9/271: stat d0/f3 0 2024-09-13T17:05:50.847 INFO:tasks.workunit.client.0.smithi115.stdout:6/372: fdatasync d8/d13/d15/f6e 0 2024-09-13T17:05:50.848 INFO:tasks.workunit.client.0.smithi115.stdout:2/618: fsync d3/d4d/de/d3a/f6d 0 2024-09-13T17:05:50.848 INFO:tasks.workunit.client.0.smithi115.stdout:2/619: chown d3/d4d/dd/d1f/d2f/d56/f2b 15943817 1 2024-09-13T17:05:50.852 INFO:tasks.workunit.client.1.smithi195.stdout:2/559: symlink d0/lb4 0 2024-09-13T17:05:50.864 INFO:tasks.workunit.client.0.smithi115.stdout:9/272: dwrite d0/f3 [8388608,4194304] 0 2024-09-13T17:05:50.897 INFO:tasks.workunit.client.1.smithi195.stdout:9/591: sync 2024-09-13T17:05:50.897 INFO:tasks.workunit.client.1.smithi195.stdout:1/504: sync 2024-09-13T17:05:50.949 INFO:tasks.workunit.client.0.smithi115.stdout:4/533: rename d7/dd/de/d4e/d6c/d77/l80 to d7/dd/de/d4e/d5a/d4f/d9c/la1 0 2024-09-13T17:05:50.953 INFO:tasks.workunit.client.0.smithi115.stdout:6/373: getdents d8/d13 0 2024-09-13T17:05:50.953 INFO:tasks.workunit.client.0.smithi115.stdout:6/374: readlink d8/db/l35 0 2024-09-13T17:05:50.953 INFO:tasks.workunit.client.0.smithi115.stdout:6/375: readlink d8/db/l69 0 2024-09-13T17:05:50.953 INFO:tasks.workunit.client.0.smithi115.stdout:6/376: readlink d8/d33/d3f/l64 0 2024-09-13T17:05:50.956 INFO:tasks.workunit.client.1.smithi195.stdout:0/529: rename d7/d87/d9b/l54 to d7/d87/d9b/d4e/laa 0 2024-09-13T17:05:50.959 INFO:tasks.workunit.client.0.smithi115.stdout:9/273: creat d0/d21/d4f/f5e x:0 0 0 2024-09-13T17:05:50.960 INFO:tasks.workunit.client.1.smithi195.stdout:4/605: rmdir d1a/d1f/d21/d84/d9d/d8e 39 2024-09-13T17:05:50.968 INFO:tasks.workunit.client.1.smithi195.stdout:5/535: symlink d2/d12/d4e/d10/d46/lb7 0 2024-09-13T17:05:50.968 INFO:tasks.workunit.client.1.smithi195.stdout:5/536: fdatasync d2/df/f81 0 2024-09-13T17:05:50.968 INFO:tasks.workunit.client.0.smithi115.stdout:9/274: dread d0/d21/f22 [0,4194304] 0 2024-09-13T17:05:50.969 INFO:tasks.workunit.client.0.smithi115.stdout:6/377: creat d8/f76 x:0 0 0 2024-09-13T17:05:50.969 INFO:tasks.workunit.client.0.smithi115.stdout:6/378: stat d8/d13/d15/d24/f3b 0 2024-09-13T17:05:50.971 INFO:tasks.workunit.client.1.smithi195.stdout:6/488: creat d1c/fa1 x:0 0 0 2024-09-13T17:05:50.971 INFO:tasks.workunit.client.1.smithi195.stdout:6/489: chown f2 14 1 2024-09-13T17:05:50.974 INFO:tasks.workunit.client.1.smithi195.stdout:8/573: link d0/d17/db0/fb8 d0/d17/d49/fc5 0 2024-09-13T17:05:50.974 INFO:tasks.workunit.client.1.smithi195.stdout:8/574: chown d0/d17/d49/d63/db3 8512062 1 2024-09-13T17:05:50.975 INFO:tasks.workunit.client.1.smithi195.stdout:5/537: dread d2/df/f1c [0,4194304] 0 2024-09-13T17:05:50.975 INFO:tasks.workunit.client.1.smithi195.stdout:5/538: write d2/df/d78/f8b [406296,31681] 0 2024-09-13T17:05:50.975 INFO:tasks.workunit.client.0.smithi115.stdout:9/275: chown d0/lc 246 1 2024-09-13T17:05:50.977 INFO:tasks.workunit.client.1.smithi195.stdout:7/587: getdents d5/db/d19 0 2024-09-13T17:05:50.978 INFO:tasks.workunit.client.1.smithi195.stdout:7/588: fdatasync d5/db/f2c 0 2024-09-13T17:05:50.980 INFO:tasks.workunit.client.0.smithi115.stdout:6/379: write d8/d33/d3f/f43 [2141767,42480] 0 2024-09-13T17:05:50.981 INFO:tasks.workunit.client.1.smithi195.stdout:3/524: truncate d7/d21/f4f 2101188 0 2024-09-13T17:05:50.981 INFO:tasks.workunit.client.1.smithi195.stdout:2/560: fsync d0/d4a/d47/d73/d75/d88/d2c/f34 0 2024-09-13T17:05:50.983 INFO:tasks.workunit.client.1.smithi195.stdout:9/592: rmdir d6/d12 39 2024-09-13T17:05:50.985 INFO:tasks.workunit.client.0.smithi115.stdout:6/380: creat d8/d33/d40/d4c/d66/f77 x:0 0 0 2024-09-13T17:05:50.988 INFO:tasks.workunit.client.1.smithi195.stdout:1/505: symlink db/d58/dae/laf 0 2024-09-13T17:05:50.988 INFO:tasks.workunit.client.1.smithi195.stdout:1/506: dread - db/df/d4d/d74/f76 zero size 2024-09-13T17:05:50.989 INFO:tasks.workunit.client.1.smithi195.stdout:1/507: write db/df/d4d/d74/f76 [798689,114791] 0 2024-09-13T17:05:50.989 INFO:tasks.workunit.client.1.smithi195.stdout:9/593: dread d6/d19/d21/d5b/fa6 [0,4194304] 0 2024-09-13T17:05:50.989 INFO:tasks.workunit.client.0.smithi115.stdout:6/381: rmdir d8/d13 39 2024-09-13T17:05:50.989 INFO:tasks.workunit.client.1.smithi195.stdout:6/490: dread d1c/d24/f38 [0,4194304] 0 2024-09-13T17:05:50.989 INFO:tasks.workunit.client.1.smithi195.stdout:6/491: creat d1c/fa2 x:0 0 0 2024-09-13T17:05:50.990 INFO:tasks.workunit.client.1.smithi195.stdout:0/530: rename d7/ca to d7/d87/d9b/d56/da6/cab 0 2024-09-13T17:05:50.991 INFO:tasks.workunit.client.1.smithi195.stdout:4/606: creat d1a/d1f/d9c/dc2/fc4 x:0 0 0 2024-09-13T17:05:50.991 INFO:tasks.workunit.client.1.smithi195.stdout:4/607: creat d1a/d1f/d43/d24/d41/d60/fc5 x:0 0 0 2024-09-13T17:05:50.992 INFO:tasks.workunit.client.1.smithi195.stdout:4/608: truncate d1a/d1f/d21/d7e/db4/fbc 1534803 0 2024-09-13T17:05:50.992 INFO:tasks.workunit.client.1.smithi195.stdout:4/609: dread - d1a/d1f/d43/d5a/fc1 zero size 2024-09-13T17:05:50.992 INFO:tasks.workunit.client.1.smithi195.stdout:4/610: creat d1a/d1f/d9c/dc2/fc6 x:0 0 0 2024-09-13T17:05:50.992 INFO:tasks.workunit.client.0.smithi115.stdout:6/382: creat d8/db/d49/f78 x:0 0 0 2024-09-13T17:05:50.992 INFO:tasks.workunit.client.1.smithi195.stdout:5/539: symlink d2/df/d90/db2/lb8 0 2024-09-13T17:05:50.993 INFO:tasks.workunit.client.1.smithi195.stdout:7/589: mknod d5/db/d19/d22/d90/ccf 0 2024-09-13T17:05:50.993 INFO:tasks.workunit.client.1.smithi195.stdout:7/590: dread - d5/d35/d37/f65 zero size 2024-09-13T17:05:50.995 INFO:tasks.workunit.client.1.smithi195.stdout:3/525: read d7/d19/d1e/f50 [766585,123710] 0 2024-09-13T17:05:50.996 INFO:tasks.workunit.client.1.smithi195.stdout:2/561: creat d0/d4a/d47/d73/d75/d88/d2c/d43/d84/fb5 x:0 0 0 2024-09-13T17:05:50.996 INFO:tasks.workunit.client.0.smithi115.stdout:9/276: dwrite d0/de/d37/f41 [4194304,4194304] 0 2024-09-13T17:05:50.998 INFO:tasks.workunit.client.1.smithi195.stdout:9/594: mkdir d6/d12/d86/da7/dcb 0 2024-09-13T17:05:50.998 INFO:tasks.workunit.client.1.smithi195.stdout:9/595: write d6/d19/d21/d64/d68/d6d/fb5 [787011,3182] 0 2024-09-13T17:05:51.001 INFO:tasks.workunit.client.1.smithi195.stdout:6/492: creat d1c/d3e/fa3 x:0 0 0 2024-09-13T17:05:51.004 INFO:tasks.workunit.client.1.smithi195.stdout:0/531: creat d7/d87/d9b/d56/d46/da4/fac x:0 0 0 2024-09-13T17:05:51.004 INFO:tasks.workunit.client.1.smithi195.stdout:0/532: readlink d7/d87/d9b/d4e/laa 0 2024-09-13T17:05:51.006 INFO:tasks.workunit.client.1.smithi195.stdout:8/575: dwrite d0/d17/d49/f80 [0,4194304] 0 2024-09-13T17:05:51.009 INFO:tasks.workunit.client.1.smithi195.stdout:5/540: symlink d2/lb9 0 2024-09-13T17:05:51.010 INFO:tasks.workunit.client.1.smithi195.stdout:7/591: rmdir d5/d13/d30 39 2024-09-13T17:05:51.013 INFO:tasks.workunit.client.1.smithi195.stdout:9/596: link d6/d19/l94 d6/df/d16/d5c/lcc 0 2024-09-13T17:05:51.015 INFO:tasks.workunit.client.1.smithi195.stdout:0/533: truncate d7/d88/d23/f62 823494 0 2024-09-13T17:05:51.015 INFO:tasks.workunit.client.1.smithi195.stdout:0/534: fdatasync f1 0 2024-09-13T17:05:51.015 INFO:tasks.workunit.client.1.smithi195.stdout:0/535: chown d7/d87/d9b/d56/l6f 23629 1 2024-09-13T17:05:51.017 INFO:tasks.workunit.client.1.smithi195.stdout:1/508: rename db/df/d4d/d85 to db/d19/d5a/db0 0 2024-09-13T17:05:51.017 INFO:tasks.workunit.client.0.smithi115.stdout:2/620: mknod d3/d4d/dd/cbd 0 2024-09-13T17:05:51.018 INFO:tasks.workunit.client.0.smithi115.stdout:2/621: rename d3/d4d/dd/df/d57 to d3/d4d/dd/df/d57/dbe 22 2024-09-13T17:05:51.020 INFO:tasks.workunit.client.0.smithi115.stdout:2/622: truncate d3/d4d/d13/d39/d46/fbb 3693291 0 2024-09-13T17:05:51.022 INFO:tasks.workunit.client.1.smithi195.stdout:5/541: creat d2/df/d90/db2/fba x:0 0 0 2024-09-13T17:05:51.023 INFO:tasks.workunit.client.0.smithi115.stdout:2/623: mknod d3/d4d/dd/d1f/cbf 0 2024-09-13T17:05:51.024 INFO:tasks.workunit.client.0.smithi115.stdout:9/277: dwrite d0/d21/d4f/f5e [0,4194304] 0 2024-09-13T17:05:51.026 INFO:tasks.workunit.client.1.smithi195.stdout:7/592: unlink d5/d35/f99 0 2024-09-13T17:05:51.026 INFO:tasks.workunit.client.1.smithi195.stdout:7/593: chown d5/l2e 227839213 1 2024-09-13T17:05:51.026 INFO:tasks.workunit.client.1.smithi195.stdout:4/611: dwrite d1a/d1f/d21/d22/f28 [0,4194304] 0 2024-09-13T17:05:51.026 INFO:tasks.workunit.client.1.smithi195.stdout:1/509: write db/df/d51/d62/d70/fa5 [1257359,27658] 0 2024-09-13T17:05:51.026 INFO:tasks.workunit.client.1.smithi195.stdout:3/526: dwrite d7/d62/d70/f90 [0,4194304] 0 2024-09-13T17:05:51.027 INFO:tasks.workunit.client.1.smithi195.stdout:3/527: write d7/d21/d2a/f32 [912556,53295] 0 2024-09-13T17:05:51.027 INFO:tasks.workunit.client.1.smithi195.stdout:3/528: write d7/d19/f48 [734603,105788] 0 2024-09-13T17:05:51.027 INFO:tasks.workunit.client.1.smithi195.stdout:9/597: dwrite d6/d19/d21/d64/d68/fbd [0,4194304] 0 2024-09-13T17:05:51.027 INFO:tasks.workunit.client.1.smithi195.stdout:9/598: fdatasync d6/d19/d21/d5b/f6f 0 2024-09-13T17:05:51.028 INFO:tasks.workunit.client.1.smithi195.stdout:2/562: mknod d0/d4a/d47/d73/d75/d88/d8e/cb6 0 2024-09-13T17:05:51.028 INFO:tasks.workunit.client.1.smithi195.stdout:2/563: fsync d0/d4a/d47/d73/d75/d88/d2c/d51/f42 0 2024-09-13T17:05:51.029 INFO:tasks.workunit.client.1.smithi195.stdout:8/576: creat d0/d13/fc6 x:0 0 0 2024-09-13T17:05:51.029 INFO:tasks.workunit.client.0.smithi115.stdout:2/624: mknod d3/d4d/de/cc0 0 2024-09-13T17:05:51.035 INFO:tasks.workunit.client.1.smithi195.stdout:3/529: dread d7/fa [0,4194304] 0 2024-09-13T17:05:51.036 INFO:tasks.workunit.client.0.smithi115.stdout:9/278: link d0/de/f5c d0/d21/d42/f5f 0 2024-09-13T17:05:51.036 INFO:tasks.workunit.client.0.smithi115.stdout:9/279: write d0/d21/f36 [4545134,122532] 0 2024-09-13T17:05:51.037 INFO:tasks.workunit.client.1.smithi195.stdout:7/594: rmdir d5/db/d19/d22/d90 39 2024-09-13T17:05:51.038 INFO:tasks.workunit.client.1.smithi195.stdout:7/595: truncate d5/d35/f75 170824 0 2024-09-13T17:05:51.038 INFO:tasks.workunit.client.0.smithi115.stdout:9/280: write d0/f1d [682770,97312] 0 2024-09-13T17:05:51.038 INFO:tasks.workunit.client.0.smithi115.stdout:9/281: creat d0/de/d10/f60 x:0 0 0 2024-09-13T17:05:51.039 INFO:tasks.workunit.client.1.smithi195.stdout:7/596: dread d5/db/d50/d7f/d82/fab [0,4194304] 0 2024-09-13T17:05:51.040 INFO:tasks.workunit.client.1.smithi195.stdout:1/510: symlink db/d19/d37/d3e/lb1 0 2024-09-13T17:05:51.040 INFO:tasks.workunit.client.0.smithi115.stdout:2/625: truncate d3/d4d/de/d3a/f6d 274681 0 2024-09-13T17:05:51.043 INFO:tasks.workunit.client.1.smithi195.stdout:4/612: dwrite d1a/d1f/d43/d24/d41/d60/d6f/fa7 [0,4194304] 0 2024-09-13T17:05:51.043 INFO:tasks.workunit.client.1.smithi195.stdout:4/613: stat d1a/d1f/d43/d24/l8c 0 2024-09-13T17:05:51.049 INFO:tasks.workunit.client.0.smithi115.stdout:2/626: read d3/d4d/d13/d62/d66/f82 [347067,88638] 0 2024-09-13T17:05:51.049 INFO:tasks.workunit.client.0.smithi115.stdout:9/282: chown d0/c5 322 1 2024-09-13T17:05:51.051 INFO:tasks.workunit.client.1.smithi195.stdout:9/599: symlink d6/df/d16/d58/lcd 0 2024-09-13T17:05:51.051 INFO:tasks.workunit.client.1.smithi195.stdout:9/600: write d6/d19/d21/d64/d68/d6d/f9e [837591,115720] 0 2024-09-13T17:05:51.051 INFO:tasks.workunit.client.1.smithi195.stdout:9/601: chown d6/df/d13 18391 1 2024-09-13T17:05:51.052 INFO:tasks.workunit.client.0.smithi115.stdout:2/627: creat d3/d4d/fc1 x:0 0 0 2024-09-13T17:05:51.054 INFO:tasks.workunit.client.1.smithi195.stdout:4/614: dread d1a/d1f/d43/d5a/f81 [0,4194304] 0 2024-09-13T17:05:51.055 INFO:tasks.workunit.client.0.smithi115.stdout:9/283: symlink d0/d21/d4f/l61 0 2024-09-13T17:05:51.058 INFO:tasks.workunit.client.1.smithi195.stdout:7/597: dwrite d5/f72 [0,4194304] 0 2024-09-13T17:05:51.058 INFO:tasks.workunit.client.1.smithi195.stdout:4/615: dread d1a/d1f/d21/d22/fb7 [0,4194304] 0 2024-09-13T17:05:51.058 INFO:tasks.workunit.client.1.smithi195.stdout:4/616: readlink d1a/d1f/d43/d5a/l67 0 2024-09-13T17:05:51.058 INFO:tasks.workunit.client.1.smithi195.stdout:4/617: fsync d1a/d1f/d21/d84/d9d/f3f 0 2024-09-13T17:05:51.058 INFO:tasks.workunit.client.1.smithi195.stdout:8/577: unlink d0/d17/d49/lb7 0 2024-09-13T17:05:51.059 INFO:tasks.workunit.client.0.smithi115.stdout:2/628: dread d3/d4d/de/f59 [0,4194304] 0 2024-09-13T17:05:51.059 INFO:tasks.workunit.client.0.smithi115.stdout:2/629: fdatasync d3/f14 0 2024-09-13T17:05:51.059 INFO:tasks.workunit.client.0.smithi115.stdout:2/630: chown d3/d4d/dd/d1f/d2f/d56/f26 104302 1 2024-09-13T17:05:51.059 INFO:tasks.workunit.client.0.smithi115.stdout:4/534: unlink d7/dd/de/f1c 0 2024-09-13T17:05:51.062 INFO:tasks.workunit.client.1.smithi195.stdout:6/493: rename ce to d1c/d24/d49/d5f/d85/ca4 0 2024-09-13T17:05:51.063 INFO:tasks.workunit.client.0.smithi115.stdout:4/535: creat d7/dd/d3c/d74/fa2 x:0 0 0 2024-09-13T17:05:51.065 INFO:tasks.workunit.client.0.smithi115.stdout:9/284: read d0/f3 [9886021,7165] 0 2024-09-13T17:05:51.068 INFO:tasks.workunit.client.0.smithi115.stdout:4/536: unlink d7/dd/de/d4e/d5a/d4f/d53/f69 0 2024-09-13T17:05:51.069 INFO:tasks.workunit.client.1.smithi195.stdout:3/530: unlink c6 0 2024-09-13T17:05:51.070 INFO:tasks.workunit.client.1.smithi195.stdout:3/531: write d7/fa [2110209,56296] 0 2024-09-13T17:05:51.070 INFO:tasks.workunit.client.0.smithi115.stdout:9/285: truncate d0/de/f2d 783045 0 2024-09-13T17:05:51.072 INFO:tasks.workunit.client.1.smithi195.stdout:7/598: read f4 [2881401,125157] 0 2024-09-13T17:05:51.072 INFO:tasks.workunit.client.1.smithi195.stdout:1/511: creat db/df/d4d/d74/da8/fb2 x:0 0 0 2024-09-13T17:05:51.072 INFO:tasks.workunit.client.1.smithi195.stdout:4/618: dwrite d1a/d1f/d43/fc0 [0,4194304] 0 2024-09-13T17:05:51.072 INFO:tasks.workunit.client.1.smithi195.stdout:4/619: dread - d1a/d1f/d43/d5a/fc1 zero size 2024-09-13T17:05:51.073 INFO:tasks.workunit.client.1.smithi195.stdout:4/620: creat d1a/d1f/d21/d84/d9d/d8e/d9f/fc7 x:0 0 0 2024-09-13T17:05:51.073 INFO:tasks.workunit.client.0.smithi115.stdout:4/537: symlink d7/dd/d3c/d74/la3 0 2024-09-13T17:05:51.075 INFO:tasks.workunit.client.0.smithi115.stdout:9/286: symlink d0/d21/l62 0 2024-09-13T17:05:51.075 INFO:tasks.workunit.client.0.smithi115.stdout:9/287: fdatasync d0/de/d37/f5d 0 2024-09-13T17:05:51.075 INFO:tasks.workunit.client.0.smithi115.stdout:9/288: chown d0/d21/d4f/f5e 3 1 2024-09-13T17:05:51.076 INFO:tasks.workunit.client.0.smithi115.stdout:4/538: dread d7/dd/de/d4e/d5a/d4f/f76 [0,4194304] 0 2024-09-13T17:05:51.077 INFO:tasks.workunit.client.1.smithi195.stdout:9/602: link d6/df/d16/d58/c71 d6/d19/d21/d64/d68/cce 0 2024-09-13T17:05:51.077 INFO:tasks.workunit.client.1.smithi195.stdout:9/603: read - d6/df/d72/fb9 zero size 2024-09-13T17:05:51.078 INFO:tasks.workunit.client.0.smithi115.stdout:2/631: dwrite d3/d4d/dd/f2d [0,4194304] 0 2024-09-13T17:05:51.080 INFO:tasks.workunit.client.0.smithi115.stdout:9/289: symlink d0/de/d37/l63 0 2024-09-13T17:05:51.082 INFO:tasks.workunit.client.1.smithi195.stdout:8/578: chown d0/d17/d2f/d31/c36 2436 1 2024-09-13T17:05:51.084 INFO:tasks.workunit.client.0.smithi115.stdout:2/632: mkdir d3/d4d/dd/d1f/d2f/d7d/dc2 0 2024-09-13T17:05:51.085 INFO:tasks.workunit.client.1.smithi195.stdout:6/494: mkdir d1c/d24/d49/d5f/d85/da5 0 2024-09-13T17:05:51.085 INFO:tasks.workunit.client.1.smithi195.stdout:6/495: readlink d1c/d24/d49/d5f/l4f 0 2024-09-13T17:05:51.086 INFO:tasks.workunit.client.0.smithi115.stdout:9/290: symlink d0/de/d10/d15/l64 0 2024-09-13T17:05:51.087 INFO:tasks.workunit.client.1.smithi195.stdout:0/536: rename d7/d87/d9b/la5 to d7/d87/d9b/d4e/d68/lad 0 2024-09-13T17:05:51.087 INFO:tasks.workunit.client.1.smithi195.stdout:0/537: write d7/d50/f67 [365616,100049] 0 2024-09-13T17:05:51.088 INFO:tasks.workunit.client.0.smithi115.stdout:2/633: symlink d3/d4d/dd/df/lc3 0 2024-09-13T17:05:51.088 INFO:tasks.workunit.client.0.smithi115.stdout:2/634: dread - d3/d4d/dd/df/f65 zero size 2024-09-13T17:05:51.088 INFO:tasks.workunit.client.0.smithi115.stdout:2/635: chown d3/d4d/dd/df/d57/l60 629321 1 2024-09-13T17:05:51.089 INFO:tasks.workunit.client.1.smithi195.stdout:3/532: creat d7/d21/d2a/d35/d60/f9a x:0 0 0 2024-09-13T17:05:51.090 INFO:tasks.workunit.client.0.smithi115.stdout:9/291: mkdir d0/d21/d65 0 2024-09-13T17:05:51.090 INFO:tasks.workunit.client.0.smithi115.stdout:9/292: chown d0/de/d37/f41 57415 1 2024-09-13T17:05:51.091 INFO:tasks.workunit.client.0.smithi115.stdout:4/539: dwrite d7/dd/de/d4e/d6c/f7c [0,4194304] 0 2024-09-13T17:05:51.092 INFO:tasks.workunit.client.1.smithi195.stdout:7/599: creat d5/d13/d30/fd0 x:0 0 0 2024-09-13T17:05:51.093 INFO:tasks.workunit.client.0.smithi115.stdout:2/636: link d3/d4d/d13/d62/d66/cab d3/d4d/dd/d1f/d2f/d56/d58/dac/cc4 0 2024-09-13T17:05:51.095 INFO:tasks.workunit.client.0.smithi115.stdout:4/540: mknod d7/dd/de/d4e/d6c/ca4 0 2024-09-13T17:05:51.095 INFO:tasks.workunit.client.1.smithi195.stdout:1/512: creat db/df/d4d/fb3 x:0 0 0 2024-09-13T17:05:51.096 INFO:tasks.workunit.client.0.smithi115.stdout:4/541: read d7/dd/de/d4e/d5a/d4f/f76 [310025,105043] 0 2024-09-13T17:05:51.101 INFO:tasks.workunit.client.0.smithi115.stdout:2/637: unlink d3/l54 0 2024-09-13T17:05:51.102 INFO:tasks.workunit.client.1.smithi195.stdout:4/621: mkdir d1a/d1f/d43/d5a/d63/db8/dc8 0 2024-09-13T17:05:51.105 INFO:tasks.workunit.client.0.smithi115.stdout:4/542: mknod d7/dd/d3c/d74/ca5 0 2024-09-13T17:05:51.105 INFO:tasks.workunit.client.0.smithi115.stdout:4/543: creat d7/dd/d3c/d74/fa6 x:0 0 0 2024-09-13T17:05:51.106 INFO:tasks.workunit.client.1.smithi195.stdout:9/604: mkdir d6/df/d16/d5c/dcf 0 2024-09-13T17:05:51.106 INFO:tasks.workunit.client.1.smithi195.stdout:9/605: chown d6/d19/l1c 608473 1 2024-09-13T17:05:51.106 INFO:tasks.workunit.client.1.smithi195.stdout:9/606: fsync d6/d19/d21/d45/dad/d5e/da0/fb7 0 2024-09-13T17:05:51.106 INFO:tasks.workunit.client.1.smithi195.stdout:9/607: write d6/d12/d39/f89 [1232147,127080] 0 2024-09-13T17:05:51.106 INFO:tasks.workunit.client.1.smithi195.stdout:9/608: fsync d6/d19/d21/d64/d68/d6d/f85 0 2024-09-13T17:05:51.107 INFO:tasks.workunit.client.1.smithi195.stdout:9/609: read d6/d12/f8a [1651339,106705] 0 2024-09-13T17:05:51.107 INFO:tasks.workunit.client.1.smithi195.stdout:9/610: dread - d6/d8d/fb0 zero size 2024-09-13T17:05:51.107 INFO:tasks.workunit.client.0.smithi115.stdout:4/544: dread d7/dd/de/f3a [0,4194304] 0 2024-09-13T17:05:51.107 INFO:tasks.workunit.client.0.smithi115.stdout:4/545: truncate d7/dd/d3c/d74/fa2 167143 0 2024-09-13T17:05:51.108 INFO:tasks.workunit.client.0.smithi115.stdout:2/638: mkdir d3/d4d/dd/df/d5b/dc5 0 2024-09-13T17:05:51.108 INFO:tasks.workunit.client.0.smithi115.stdout:2/639: read d3/d4d/d13/d39/f3b [385486,19886] 0 2024-09-13T17:05:51.108 INFO:tasks.workunit.client.0.smithi115.stdout:2/640: readlink d3/d4d/dd/d1f/d2f/d56/d58/d72/l93 0 2024-09-13T17:05:51.108 INFO:tasks.workunit.client.0.smithi115.stdout:0/302: sync 2024-09-13T17:05:51.109 INFO:tasks.workunit.client.1.smithi195.stdout:8/579: mknod d0/d17/cc7 0 2024-09-13T17:05:51.111 INFO:tasks.workunit.client.1.smithi195.stdout:6/496: symlink d1c/d24/la6 0 2024-09-13T17:05:51.115 INFO:tasks.workunit.client.1.smithi195.stdout:7/600: dwrite d5/d35/f60 [0,4194304] 0 2024-09-13T17:05:51.116 INFO:tasks.workunit.client.0.smithi115.stdout:0/303: symlink d9/d1d/d24/d26/d2c/l58 0 2024-09-13T17:05:51.118 INFO:tasks.workunit.client.0.smithi115.stdout:2/641: getdents d3/d4d/dd/d1f 0 2024-09-13T17:05:51.120 INFO:tasks.workunit.client.1.smithi195.stdout:3/533: symlink d7/d21/d2a/d35/d60/d6f/l9b 0 2024-09-13T17:05:51.128 INFO:tasks.workunit.client.1.smithi195.stdout:1/513: mkdir db/d19/d5a/d66/d96/db4 0 2024-09-13T17:05:51.131 INFO:tasks.workunit.client.0.smithi115.stdout:0/304: dread d9/d1d/d24/d26/d2d/d30/d46/f49 [0,4194304] 0 2024-09-13T17:05:51.131 INFO:tasks.workunit.client.0.smithi115.stdout:0/305: write d9/d1b/f57 [175510,58215] 0 2024-09-13T17:05:51.131 INFO:tasks.workunit.client.1.smithi195.stdout:2/564: rename d0/d3/d3d/c55 to d0/d4a/d47/d73/d75/d88/d2c/cb7 0 2024-09-13T17:05:51.136 INFO:tasks.workunit.client.1.smithi195.stdout:4/622: getdents d1a/d1f/d21/d7e/db4 0 2024-09-13T17:05:51.136 INFO:tasks.workunit.client.0.smithi115.stdout:2/642: dwrite d3/d4d/fc1 [0,4194304] 0 2024-09-13T17:05:51.140 INFO:tasks.workunit.client.1.smithi195.stdout:7/601: getdents d5/d35/d37 0 2024-09-13T17:05:51.141 INFO:tasks.workunit.client.1.smithi195.stdout:2/565: write d0/d4a/d47/d73/d75/d88/d2c/f8d [3261239,72319] 0 2024-09-13T17:05:51.143 INFO:tasks.workunit.client.1.smithi195.stdout:4/623: creat d1a/d1f/d21/d36/fc9 x:0 0 0 2024-09-13T17:05:51.148 INFO:tasks.workunit.client.1.smithi195.stdout:7/602: dread d5/d13/d30/f36 [0,4194304] 0 2024-09-13T17:05:51.148 INFO:tasks.workunit.client.1.smithi195.stdout:7/603: chown d5/d13/d30/f95 184268 1 2024-09-13T17:05:51.153 INFO:tasks.workunit.client.1.smithi195.stdout:7/604: dread f4 [0,4194304] 0 2024-09-13T17:05:51.157 INFO:tasks.workunit.client.1.smithi195.stdout:8/580: dwrite d0/d17/f68 [0,4194304] 0 2024-09-13T17:05:51.157 INFO:tasks.workunit.client.1.smithi195.stdout:2/566: link d0/d3/f68 d0/d4a/d47/d73/d75/d88/d2c/d43/d63/db2/fb8 0 2024-09-13T17:05:51.157 INFO:tasks.workunit.client.1.smithi195.stdout:2/567: creat d0/d4a/d47/d73/d75/fb9 x:0 0 0 2024-09-13T17:05:51.158 INFO:tasks.workunit.client.1.smithi195.stdout:4/624: unlink d1a/d1f/d43/d24/lad 0 2024-09-13T17:05:51.158 INFO:tasks.workunit.client.1.smithi195.stdout:4/625: chown d1a/d1f/d43/f50 66 1 2024-09-13T17:05:51.158 INFO:tasks.workunit.client.1.smithi195.stdout:4/626: dread - d1a/d1f/d43/d24/d41/d60/fba zero size 2024-09-13T17:05:51.159 INFO:tasks.workunit.client.1.smithi195.stdout:4/627: read d1a/d1f/f87 [507011,102843] 0 2024-09-13T17:05:51.159 INFO:tasks.workunit.client.1.smithi195.stdout:4/628: dread - d1a/d1f/d43/d24/fa6 zero size 2024-09-13T17:05:51.159 INFO:tasks.workunit.client.1.smithi195.stdout:9/611: rename d6/d19/d21/d45/dad/d47 to d6/d19/d21/d45/dad/d5e/dd0 0 2024-09-13T17:05:51.160 INFO:tasks.workunit.client.1.smithi195.stdout:7/605: link d5/d13/d24/lc6 d5/db/ld1 0 2024-09-13T17:05:51.160 INFO:tasks.workunit.client.1.smithi195.stdout:7/606: chown d5/d13/d24/l66 9508 1 2024-09-13T17:05:51.164 INFO:tasks.workunit.client.1.smithi195.stdout:8/581: unlink d0/d17/d49/d63/c8e 0 2024-09-13T17:05:51.164 INFO:tasks.workunit.client.1.smithi195.stdout:8/582: readlink d0/d13/d52/d55/l5b 0 2024-09-13T17:05:51.166 INFO:tasks.workunit.client.1.smithi195.stdout:2/568: mkdir d0/d4a/d47/dba 0 2024-09-13T17:05:51.166 INFO:tasks.workunit.client.1.smithi195.stdout:2/569: write d0/f54 [619087,65991] 0 2024-09-13T17:05:51.166 INFO:tasks.workunit.client.1.smithi195.stdout:2/570: getdents d0/d4a/d47/dba 0 2024-09-13T17:05:51.166 INFO:tasks.workunit.client.1.smithi195.stdout:9/612: write d6/d19/d21/d45/fc9 [184225,98775] 0 2024-09-13T17:05:51.166 INFO:tasks.workunit.client.1.smithi195.stdout:4/629: symlink d1a/d1f/d21/d84/d9d/d8e/d9f/db2/lca 0 2024-09-13T17:05:51.167 INFO:tasks.workunit.client.1.smithi195.stdout:4/630: write d1a/d1f/d21/d36/f55 [865359,115000] 0 2024-09-13T17:05:51.168 INFO:tasks.workunit.client.1.smithi195.stdout:6/497: rename d1c/d2d/d5e/d91 to d1c/d2d/d8c/da7 0 2024-09-13T17:05:51.169 INFO:tasks.workunit.client.0.smithi115.stdout:4/546: dwrite d7/f12 [4194304,4194304] 0 2024-09-13T17:05:51.170 INFO:tasks.workunit.client.0.smithi115.stdout:0/306: dwrite d9/d1d/d24/f25 [0,4194304] 0 2024-09-13T17:05:51.170 INFO:tasks.workunit.client.0.smithi115.stdout:0/307: read d9/fc [338291,18296] 0 2024-09-13T17:05:51.171 INFO:tasks.workunit.client.1.smithi195.stdout:3/534: dwrite d7/d67/f6c [0,4194304] 0 2024-09-13T17:05:51.171 INFO:tasks.workunit.client.1.smithi195.stdout:1/514: dwrite db/d19/f64 [0,4194304] 0 2024-09-13T17:05:51.171 INFO:tasks.workunit.client.1.smithi195.stdout:1/515: fdatasync db/df/d4d/d74/f76 0 2024-09-13T17:05:51.171 INFO:tasks.workunit.client.1.smithi195.stdout:1/516: read - db/f5e zero size 2024-09-13T17:05:51.171 INFO:tasks.workunit.client.1.smithi195.stdout:1/517: dread - db/f5e zero size 2024-09-13T17:05:51.171 INFO:tasks.workunit.client.1.smithi195.stdout:1/518: fdatasync db/df/f20 0 2024-09-13T17:05:51.171 INFO:tasks.workunit.client.1.smithi195.stdout:8/583: dread d0/f3 [0,4194304] 0 2024-09-13T17:05:51.171 INFO:tasks.workunit.client.1.smithi195.stdout:2/571: unlink d0/d4a/d47/d73/d75/d88/d2c/d51/l3b 0 2024-09-13T17:05:51.172 INFO:tasks.workunit.client.1.smithi195.stdout:9/613: mkdir d6/d19/d21/d45/dd1 0 2024-09-13T17:05:51.175 INFO:tasks.workunit.client.1.smithi195.stdout:7/607: dread d5/db/d50/d7f/d82/dad/fb2 [0,4194304] 0 2024-09-13T17:05:51.176 INFO:tasks.workunit.client.1.smithi195.stdout:4/631: truncate d1a/d1f/d21/f6a 1199277 0 2024-09-13T17:05:51.178 INFO:tasks.workunit.client.1.smithi195.stdout:1/519: dread db/df/f26 [0,4194304] 0 2024-09-13T17:05:51.180 INFO:tasks.workunit.client.1.smithi195.stdout:6/498: creat d1c/d24/fa8 x:0 0 0 2024-09-13T17:05:51.186 INFO:tasks.workunit.client.1.smithi195.stdout:3/535: mkdir d7/d21/d2a/d35/d9c 0 2024-09-13T17:05:51.188 INFO:tasks.workunit.client.0.smithi115.stdout:0/308: creat d9/d1d/d24/d26/d2c/f59 x:0 0 0 2024-09-13T17:05:51.188 INFO:tasks.workunit.client.0.smithi115.stdout:0/309: readlink d9/d1d/d24/d26/l56 0 2024-09-13T17:05:51.193 INFO:tasks.workunit.client.1.smithi195.stdout:9/614: dwrite d6/d19/d21/f7c [0,4194304] 0 2024-09-13T17:05:51.193 INFO:tasks.workunit.client.1.smithi195.stdout:9/615: fdatasync d6/d19/d21/d5b/f79 0 2024-09-13T17:05:51.193 INFO:tasks.workunit.client.1.smithi195.stdout:9/616: readlink d6/df/d16/l1a 0 2024-09-13T17:05:51.193 INFO:tasks.workunit.client.1.smithi195.stdout:9/617: write d6/d19/d21/d45/fb6 [1992783,102583] 0 2024-09-13T17:05:51.193 INFO:tasks.workunit.client.1.smithi195.stdout:9/618: read d6/f3f [1524888,21414] 0 2024-09-13T17:05:51.194 INFO:tasks.workunit.client.1.smithi195.stdout:9/619: readlink d6/d19/la9 0 2024-09-13T17:05:51.194 INFO:tasks.workunit.client.1.smithi195.stdout:8/584: creat d0/d17/d2f/d7c/d4c/d9b/fc8 x:0 0 0 2024-09-13T17:05:51.196 INFO:tasks.workunit.client.1.smithi195.stdout:9/620: dread d6/df/f27 [0,4194304] 0 2024-09-13T17:05:51.196 INFO:tasks.workunit.client.1.smithi195.stdout:9/621: readlink d6/df/d16/d58/lcd 0 2024-09-13T17:05:51.196 INFO:tasks.workunit.client.1.smithi195.stdout:2/572: symlink d0/d4a/d47/d73/lbb 0 2024-09-13T17:05:51.196 INFO:tasks.workunit.client.1.smithi195.stdout:2/573: chown d0/f24 8694540 1 2024-09-13T17:05:51.196 INFO:tasks.workunit.client.1.smithi195.stdout:7/608: rmdir d5/db/d50/d7f/d82/da1 39 2024-09-13T17:05:51.198 INFO:tasks.workunit.client.1.smithi195.stdout:4/632: mknod d1a/d1f/d9c/dc2/ccb 0 2024-09-13T17:05:51.198 INFO:tasks.workunit.client.1.smithi195.stdout:4/633: dread - d1a/d1f/d43/d5a/fc1 zero size 2024-09-13T17:05:51.198 INFO:tasks.workunit.client.1.smithi195.stdout:4/634: chown d1a/d1f/d43/d24/d41/f5d 360818 1 2024-09-13T17:05:51.199 INFO:tasks.workunit.client.1.smithi195.stdout:1/520: truncate db/df/d13/f27 1999211 0 2024-09-13T17:05:51.200 INFO:tasks.workunit.client.1.smithi195.stdout:6/499: mkdir d1c/d7d/d9c/da9 0 2024-09-13T17:05:51.202 INFO:tasks.workunit.client.1.smithi195.stdout:8/585: read d0/d17/d49/f50 [1380618,83015] 0 2024-09-13T17:05:51.202 INFO:tasks.workunit.client.1.smithi195.stdout:3/536: mknod d7/d19/c9d 0 2024-09-13T17:05:51.204 INFO:tasks.workunit.client.1.smithi195.stdout:9/622: read d6/d19/d21/d5b/f79 [3332696,72143] 0 2024-09-13T17:05:51.205 INFO:tasks.workunit.client.1.smithi195.stdout:7/609: mkdir d5/d35/dd2 0 2024-09-13T17:05:51.205 INFO:tasks.workunit.client.1.smithi195.stdout:7/610: readlink d5/d13/d24/l88 0 2024-09-13T17:05:51.205 INFO:tasks.workunit.client.1.smithi195.stdout:7/611: stat d5/db/d50/f87 0 2024-09-13T17:05:51.206 INFO:tasks.workunit.client.1.smithi195.stdout:1/521: dread db/d19/d37/d3e/f4c [0,4194304] 0 2024-09-13T17:05:51.206 INFO:tasks.workunit.client.1.smithi195.stdout:4/635: mkdir d1a/d1f/d21/d84/dcc 0 2024-09-13T17:05:51.206 INFO:tasks.workunit.client.1.smithi195.stdout:3/537: dread d7/f81 [0,4194304] 0 2024-09-13T17:05:51.208 INFO:tasks.workunit.client.1.smithi195.stdout:6/500: symlink d1c/d2d/d8c/laa 0 2024-09-13T17:05:51.208 INFO:tasks.workunit.client.1.smithi195.stdout:6/501: dread - d1c/d24/d7f/f8d zero size 2024-09-13T17:05:51.210 INFO:tasks.workunit.client.1.smithi195.stdout:2/574: rename d0/d4a/c18 to d0/d3/d3d/cbc 0 2024-09-13T17:05:51.211 INFO:tasks.workunit.client.1.smithi195.stdout:9/623: mkdir d6/d12/d86/dd2 0 2024-09-13T17:05:51.214 INFO:tasks.workunit.client.1.smithi195.stdout:7/612: mknod d5/db/d50/d7f/cd3 0 2024-09-13T17:05:51.214 INFO:tasks.workunit.client.1.smithi195.stdout:7/613: chown d5/d35/l3b 66150 1 2024-09-13T17:05:51.214 INFO:tasks.workunit.client.1.smithi195.stdout:4/636: symlink d1a/lcd 0 2024-09-13T17:05:51.215 INFO:tasks.workunit.client.1.smithi195.stdout:3/538: symlink d7/d21/d2a/d4a/l9e 0 2024-09-13T17:05:51.217 INFO:tasks.workunit.client.1.smithi195.stdout:8/586: getdents d0/d13/d52/d55 0 2024-09-13T17:05:51.219 INFO:tasks.workunit.client.1.smithi195.stdout:2/575: mknod d0/d4a/d47/d73/d75/d88/d2c/d51/cbd 0 2024-09-13T17:05:51.220 INFO:tasks.workunit.client.1.smithi195.stdout:2/576: write d0/d4a/d47/d73/d75/d88/d2c/d51/f78 [402052,112814] 0 2024-09-13T17:05:51.220 INFO:tasks.workunit.client.1.smithi195.stdout:2/577: dread - d0/d3/fa7 zero size 2024-09-13T17:05:51.220 INFO:tasks.workunit.client.1.smithi195.stdout:9/624: mknod d6/d19/d21/d45/dad/d5e/da0/cd3 0 2024-09-13T17:05:51.220 INFO:tasks.workunit.client.1.smithi195.stdout:9/625: dread - d6/df/d72/fc1 zero size 2024-09-13T17:05:51.222 INFO:tasks.workunit.client.1.smithi195.stdout:7/614: mkdir d5/db/d19/d22/d90/dd4 0 2024-09-13T17:05:51.222 INFO:tasks.workunit.client.1.smithi195.stdout:4/637: creat d1a/d1f/d43/fce x:0 0 0 2024-09-13T17:05:51.224 INFO:tasks.workunit.client.1.smithi195.stdout:3/539: mkdir d7/d21/d2a/d35/d8f/d9f 0 2024-09-13T17:05:51.224 INFO:tasks.workunit.client.1.smithi195.stdout:8/587: mkdir d0/d17/d49/d63/db3/dc9 0 2024-09-13T17:05:51.226 INFO:tasks.workunit.client.1.smithi195.stdout:3/540: dread d7/d21/d2a/f32 [0,4194304] 0 2024-09-13T17:05:51.226 INFO:tasks.workunit.client.1.smithi195.stdout:9/626: unlink d6/df/d16/cab 0 2024-09-13T17:05:51.227 INFO:tasks.workunit.client.1.smithi195.stdout:4/638: creat d1a/d1f/d21/d84/fcf x:0 0 0 2024-09-13T17:05:51.228 INFO:tasks.workunit.client.1.smithi195.stdout:4/639: dread - d1a/d1f/d21/d84/d9d/d8e/d9f/fc7 zero size 2024-09-13T17:05:51.228 INFO:tasks.workunit.client.1.smithi195.stdout:1/522: dwrite db/df/d51/f53 [0,4194304] 0 2024-09-13T17:05:51.229 INFO:tasks.workunit.client.1.smithi195.stdout:8/588: creat d0/d17/d2f/d7c/fca x:0 0 0 2024-09-13T17:05:51.229 INFO:tasks.workunit.client.1.smithi195.stdout:2/578: rmdir d0/d4a/d47/d73/d94 39 2024-09-13T17:05:51.231 INFO:tasks.workunit.client.1.smithi195.stdout:3/541: symlink d7/d21/d66/d7e/la0 0 2024-09-13T17:05:51.231 INFO:tasks.workunit.client.1.smithi195.stdout:5/542: sync 2024-09-13T17:05:51.234 INFO:tasks.workunit.client.1.smithi195.stdout:9/627: rmdir d6/d12 39 2024-09-13T17:05:51.234 INFO:tasks.workunit.client.1.smithi195.stdout:4/640: unlink d1a/d1f/d9c/dc2/fc4 0 2024-09-13T17:05:51.234 INFO:tasks.workunit.client.1.smithi195.stdout:7/615: dread d5/db/d19/d22/f5b [0,4194304] 0 2024-09-13T17:05:51.234 INFO:tasks.workunit.client.1.smithi195.stdout:7/616: readlink d5/db/la9 0 2024-09-13T17:05:51.235 INFO:tasks.workunit.client.1.smithi195.stdout:9/628: dread d6/d19/d21/d45/dad/d5e/dd0/f9c [0,4194304] 0 2024-09-13T17:05:51.235 INFO:tasks.workunit.client.1.smithi195.stdout:6/502: dwrite d1c/d24/d49/d5f/d35/f53 [0,4194304] 0 2024-09-13T17:05:51.235 INFO:tasks.workunit.client.1.smithi195.stdout:8/589: mknod d0/d17/d49/d63/db3/dc9/ccb 0 2024-09-13T17:05:51.235 INFO:tasks.workunit.client.1.smithi195.stdout:6/503: write d1c/d3e/fa3 [56900,111470] 0 2024-09-13T17:05:51.237 INFO:tasks.workunit.client.1.smithi195.stdout:2/579: unlink d0/d4a/d47/d73/d75/fa1 0 2024-09-13T17:05:51.239 INFO:tasks.workunit.client.1.smithi195.stdout:5/543: mkdir d2/df/d90/dbb 0 2024-09-13T17:05:51.239 INFO:tasks.workunit.client.1.smithi195.stdout:5/544: stat d2/d12 0 2024-09-13T17:05:51.239 INFO:tasks.workunit.client.1.smithi195.stdout:5/545: truncate d2/d12/d4e/d10/d5c/f87 856479 0 2024-09-13T17:05:51.240 INFO:tasks.workunit.client.1.smithi195.stdout:4/641: stat c4 0 2024-09-13T17:05:51.241 INFO:tasks.workunit.client.1.smithi195.stdout:7/617: mkdir d5/d13/d24/d70/dd5 0 2024-09-13T17:05:51.242 INFO:tasks.workunit.client.1.smithi195.stdout:8/590: rename d0/l1c to d0/d17/d2f/d7c/lcc 0 2024-09-13T17:05:51.244 INFO:tasks.workunit.client.1.smithi195.stdout:6/504: mknod d1c/d2d/d30/d6f/cab 0 2024-09-13T17:05:51.244 INFO:tasks.workunit.client.1.smithi195.stdout:6/505: fdatasync d1c/f23 0 2024-09-13T17:05:51.244 INFO:tasks.workunit.client.1.smithi195.stdout:6/506: rename d1c/d24/d49/d5f to d1c/d24/d49/d5f/d85/d8f/dac 22 2024-09-13T17:05:51.244 INFO:tasks.workunit.client.1.smithi195.stdout:6/507: chown d1c/d2d/f40 101043 1 2024-09-13T17:05:51.244 INFO:tasks.workunit.client.1.smithi195.stdout:9/629: mkdir d6/df/d16/d5c/dcf/dd4 0 2024-09-13T17:05:51.245 INFO:tasks.workunit.client.1.smithi195.stdout:2/580: dread - d0/d4a/d47/d73/d75/d88/d62/fb1 zero size 2024-09-13T17:05:51.245 INFO:tasks.workunit.client.1.smithi195.stdout:2/581: chown d0/d4a/d47/d73/d75/d88/d2c/d51/f78 24264 1 2024-09-13T17:05:51.246 INFO:tasks.workunit.client.1.smithi195.stdout:4/642: link d1a/d1f/d43/d5a/f81 d1a/d1f/d9c/fd0 0 2024-09-13T17:05:51.247 INFO:tasks.workunit.client.1.smithi195.stdout:1/523: dwrite db/df/d51/d8e/fad [0,4194304] 0 2024-09-13T17:05:51.247 INFO:tasks.workunit.client.1.smithi195.stdout:1/524: write db/df/f3a [2975975,15335] 0 2024-09-13T17:05:51.248 INFO:tasks.workunit.client.1.smithi195.stdout:8/591: mkdir d0/d17/d2f/d7c/d4c/d9a/dcd 0 2024-09-13T17:05:51.248 INFO:tasks.workunit.client.1.smithi195.stdout:3/542: dwrite d7/d21/d66/d7e/f8c [0,4194304] 0 2024-09-13T17:05:51.249 INFO:tasks.workunit.client.1.smithi195.stdout:2/582: mkdir d0/d3/df/dbe 0 2024-09-13T17:05:51.253 INFO:tasks.workunit.client.1.smithi195.stdout:9/630: dread d6/d19/d21/d64/f53 [0,4194304] 0 2024-09-13T17:05:51.254 INFO:tasks.workunit.client.1.smithi195.stdout:1/525: truncate db/df/d13/f21 4141471 0 2024-09-13T17:05:51.256 INFO:tasks.workunit.client.1.smithi195.stdout:6/508: read d1c/d24/d49/d5f/d35/f4d [1223224,82749] 0 2024-09-13T17:05:51.257 INFO:tasks.workunit.client.1.smithi195.stdout:8/592: link d0/d13/c35 d0/d17/d49/d63/db3/cce 0 2024-09-13T17:05:51.257 INFO:tasks.workunit.client.1.smithi195.stdout:8/593: write d0/d4/f77 [1348779,53943] 0 2024-09-13T17:05:51.258 INFO:tasks.workunit.client.1.smithi195.stdout:5/546: write d2/df/d78/d54/f73 [152934,128292] 0 2024-09-13T17:05:51.262 INFO:tasks.workunit.client.1.smithi195.stdout:3/543: symlink d7/d21/d2a/d35/d60/d6f/d74/la1 0 2024-09-13T17:05:51.263 INFO:tasks.workunit.client.1.smithi195.stdout:1/526: link db/d19/d37/d3e/l48 db/d19/lb5 0 2024-09-13T17:05:51.263 INFO:tasks.workunit.client.1.smithi195.stdout:1/527: chown db/d19/f4a 1205101 1 2024-09-13T17:05:51.266 INFO:tasks.workunit.client.1.smithi195.stdout:6/509: mkdir d1c/d24/d7f/dad 0 2024-09-13T17:05:51.266 INFO:tasks.workunit.client.1.smithi195.stdout:6/510: getdents d1c/d24/d7f/dad 0 2024-09-13T17:05:51.271 INFO:tasks.workunit.client.1.smithi195.stdout:8/594: rmdir d0/d17/d2f 39 2024-09-13T17:05:51.271 INFO:tasks.workunit.client.1.smithi195.stdout:8/595: readlink d0/l5f 0 2024-09-13T17:05:51.271 INFO:tasks.workunit.client.1.smithi195.stdout:7/618: dwrite d5/db/d19/d22/f79 [0,4194304] 0 2024-09-13T17:05:51.271 INFO:tasks.workunit.client.1.smithi195.stdout:1/528: getdents db/d19/d5a/d66/d7a 0 2024-09-13T17:05:51.271 INFO:tasks.workunit.client.1.smithi195.stdout:4/643: write d1a/d1f/d21/d84/d9d/f2a [737301,69384] 0 2024-09-13T17:05:51.271 INFO:tasks.workunit.client.0.smithi115.stdout:3/604: sync 2024-09-13T17:05:51.275 INFO:tasks.workunit.client.1.smithi195.stdout:8/596: rename d0/d4/f77 to d0/d17/d2f/d31/db4/fcf 0 2024-09-13T17:05:51.275 INFO:tasks.workunit.client.1.smithi195.stdout:8/597: write d0/d17/d49/d63/d71/f9c [842706,127989] 0 2024-09-13T17:05:51.277 INFO:tasks.workunit.client.1.smithi195.stdout:1/529: mknod db/df/d51/d62/d70/cb6 0 2024-09-13T17:05:51.277 INFO:tasks.workunit.client.1.smithi195.stdout:1/530: readlink db/d19/lb5 0 2024-09-13T17:05:51.279 INFO:tasks.workunit.client.1.smithi195.stdout:4/644: truncate d1a/d1f/d43/d24/f78 827839 0 2024-09-13T17:05:51.279 INFO:tasks.workunit.client.1.smithi195.stdout:0/538: sync 2024-09-13T17:05:51.286 INFO:tasks.workunit.client.1.smithi195.stdout:8/598: creat d0/d17/d2f/d6a/fd0 x:0 0 0 2024-09-13T17:05:51.287 INFO:tasks.workunit.client.0.smithi115.stdout:3/605: dread d1/d4b/f86 [0,4194304] 0 2024-09-13T17:05:51.287 INFO:tasks.workunit.client.0.smithi115.stdout:3/606: readlink d1/d12/l66 0 2024-09-13T17:05:51.288 INFO:tasks.workunit.client.0.smithi115.stdout:3/607: truncate d1/f1d 4495749 0 2024-09-13T17:05:51.288 INFO:tasks.workunit.client.0.smithi115.stdout:3/608: chown d1/d12/d14/d61/la8 47150 1 2024-09-13T17:05:51.288 INFO:tasks.workunit.client.1.smithi195.stdout:0/539: getdents d7/d88/d23/d96 0 2024-09-13T17:05:51.288 INFO:tasks.workunit.client.0.smithi115.stdout:3/609: fsync d1/d12/d23/f62 0 2024-09-13T17:05:51.291 INFO:tasks.workunit.client.1.smithi195.stdout:0/540: creat d7/db/d11/fae x:0 0 0 2024-09-13T17:05:51.291 INFO:tasks.workunit.client.1.smithi195.stdout:0/541: truncate d7/d50/f67 1426709 0 2024-09-13T17:05:51.293 INFO:tasks.workunit.client.0.smithi115.stdout:3/610: creat d1/d12/d14/fcd x:0 0 0 2024-09-13T17:05:51.294 INFO:tasks.workunit.client.1.smithi195.stdout:4/645: rename d1a/d1f/d21/d7e to d1a/d1f/d43/d5a/d63/dd1 0 2024-09-13T17:05:51.296 INFO:tasks.workunit.client.0.smithi115.stdout:3/611: rename d1/d4b/f86 to d1/d12/d14/fce 0 2024-09-13T17:05:51.297 INFO:tasks.workunit.client.1.smithi195.stdout:9/631: dwrite d6/d19/d21/d45/dad/d5e/dd0/d61/fae [0,4194304] 0 2024-09-13T17:05:51.297 INFO:tasks.workunit.client.1.smithi195.stdout:9/632: fdatasync d6/d12/f2b 0 2024-09-13T17:05:51.300 INFO:tasks.workunit.client.1.smithi195.stdout:0/542: rename d7/d87/d9b/d56/d46/f83 to d7/d50/da1/faf 0 2024-09-13T17:05:51.301 INFO:tasks.workunit.client.1.smithi195.stdout:4/646: truncate d1a/d1f/d43/d24/d41/d60/d6f/fa7 399544 0 2024-09-13T17:05:51.301 INFO:tasks.workunit.client.1.smithi195.stdout:4/647: creat d1a/d1f/d9c/dc2/fd2 x:0 0 0 2024-09-13T17:05:51.307 INFO:tasks.workunit.client.1.smithi195.stdout:0/543: mkdir d7/d87/d9b/d56/db0 0 2024-09-13T17:05:51.309 INFO:tasks.workunit.client.1.smithi195.stdout:6/511: dwrite d1c/d24/d49/d5f/d35/f39 [0,4194304] 0 2024-09-13T17:05:51.309 INFO:tasks.workunit.client.1.smithi195.stdout:6/512: fsync d1c/f63 0 2024-09-13T17:05:51.310 INFO:tasks.workunit.client.1.smithi195.stdout:6/513: write d1c/d24/d49/d5f/f58 [931000,5301] 0 2024-09-13T17:05:51.310 INFO:tasks.workunit.client.0.smithi115.stdout:3/612: dread d1/d4b/d1a/f27 [4194304,4194304] 0 2024-09-13T17:05:51.311 INFO:tasks.workunit.client.1.smithi195.stdout:4/648: getdents d1a 0 2024-09-13T17:05:51.311 INFO:tasks.workunit.client.1.smithi195.stdout:4/649: dread - d1a/d1f/d43/d24/fa6 zero size 2024-09-13T17:05:51.311 INFO:tasks.workunit.client.1.smithi195.stdout:5/547: dwrite d2/d12/d4e/d10/d46/f64 [0,4194304] 0 2024-09-13T17:05:51.311 INFO:tasks.workunit.client.1.smithi195.stdout:0/544: rmdir d7/d50/da1 39 2024-09-13T17:05:51.312 INFO:tasks.workunit.client.0.smithi115.stdout:3/613: write d1/da4/fc6 [18196,93719] 0 2024-09-13T17:05:51.313 INFO:tasks.workunit.client.1.smithi195.stdout:6/514: unlink d1c/d2d/f7b 0 2024-09-13T17:05:51.313 INFO:tasks.workunit.client.1.smithi195.stdout:6/515: chown d1c/d3e/d6b 3737 1 2024-09-13T17:05:51.313 INFO:tasks.workunit.client.1.smithi195.stdout:6/516: write d1c/f6c [152880,116249] 0 2024-09-13T17:05:51.313 INFO:tasks.workunit.client.1.smithi195.stdout:6/517: chown d1c/f67 81 1 2024-09-13T17:05:51.314 INFO:tasks.workunit.client.1.smithi195.stdout:3/544: dwrite d7/fa [4194304,4194304] 0 2024-09-13T17:05:51.316 INFO:tasks.workunit.client.0.smithi115.stdout:3/614: dread d1/d4b/d69/d7b/f9f [0,4194304] 0 2024-09-13T17:05:51.316 INFO:tasks.workunit.client.0.smithi115.stdout:3/615: chown d1/d4b/d69/d7b/dbb 1017639 1 2024-09-13T17:05:51.317 INFO:tasks.workunit.client.1.smithi195.stdout:5/548: dread d2/df/d78/f8b [0,4194304] 0 2024-09-13T17:05:51.317 INFO:tasks.workunit.client.1.smithi195.stdout:5/549: creat d2/d12/d4e/d10/d8f/fbc x:0 0 0 2024-09-13T17:05:51.317 INFO:tasks.workunit.client.1.smithi195.stdout:8/599: dwrite d0/f8 [8388608,4194304] 0 2024-09-13T17:05:51.318 INFO:tasks.workunit.client.1.smithi195.stdout:1/531: dwrite db/d19/f8b [0,4194304] 0 2024-09-13T17:05:51.321 INFO:tasks.workunit.client.1.smithi195.stdout:9/633: dwrite d6/f7 [0,4194304] 0 2024-09-13T17:05:51.322 INFO:tasks.workunit.client.0.smithi115.stdout:3/616: readlink d1/d12/d23/l29 0 2024-09-13T17:05:51.323 INFO:tasks.workunit.client.1.smithi195.stdout:6/518: symlink d1c/d3e/lae 0 2024-09-13T17:05:51.325 INFO:tasks.workunit.client.1.smithi195.stdout:3/545: creat d7/d19/fa2 x:0 0 0 2024-09-13T17:05:51.328 INFO:tasks.workunit.client.1.smithi195.stdout:8/600: link d0/d13/l4f d0/d17/ld1 0 2024-09-13T17:05:51.329 INFO:tasks.workunit.client.1.smithi195.stdout:8/601: write d0/d62/fba [274823,87260] 0 2024-09-13T17:05:51.334 INFO:tasks.workunit.client.1.smithi195.stdout:6/519: dread d1c/d24/d49/d5f/f2b [4194304,4194304] 0 2024-09-13T17:05:51.336 INFO:tasks.workunit.client.1.smithi195.stdout:9/634: mknod d6/df/d7b/cd5 0 2024-09-13T17:05:51.338 INFO:tasks.workunit.client.1.smithi195.stdout:5/550: dread d2/d12/d4e/f3b [0,4194304] 0 2024-09-13T17:05:51.338 INFO:tasks.workunit.client.1.smithi195.stdout:3/546: link f5 d7/d21/d2a/d35/fa3 0 2024-09-13T17:05:51.338 INFO:tasks.workunit.client.1.smithi195.stdout:5/551: creat d2/d12/d3f/fbd x:0 0 0 2024-09-13T17:05:51.340 INFO:tasks.workunit.client.1.smithi195.stdout:0/545: dwrite d7/d87/d9b/d4e/d68/f9f [0,4194304] 0 2024-09-13T17:05:51.340 INFO:tasks.workunit.client.1.smithi195.stdout:4/650: dwrite d1a/d1f/d21/d84/d9d/d58/f80 [0,4194304] 0 2024-09-13T17:05:51.340 INFO:tasks.workunit.client.1.smithi195.stdout:6/520: symlink d1c/d3e/d6b/d8a/d95/laf 0 2024-09-13T17:05:51.342 INFO:tasks.workunit.client.0.smithi115.stdout:3/617: dread d1/d4b/d69/f77 [0,4194304] 0 2024-09-13T17:05:51.342 INFO:tasks.workunit.client.0.smithi115.stdout:3/618: creat d1/d12/d14/fcf x:0 0 0 2024-09-13T17:05:51.382 INFO:tasks.workunit.client.1.smithi195.stdout:1/532: dwrite db/d19/d37/f3b [0,4194304] 0 2024-09-13T17:05:51.383 INFO:tasks.workunit.client.1.smithi195.stdout:1/533: write db/d19/d37/f4e [5075709,1821] 0 2024-09-13T17:05:51.385 INFO:tasks.workunit.client.1.smithi195.stdout:8/602: getdents d0/d13 0 2024-09-13T17:05:51.385 INFO:tasks.workunit.client.1.smithi195.stdout:8/603: write d0/d62/f83 [588536,69147] 0 2024-09-13T17:05:51.389 INFO:tasks.workunit.client.1.smithi195.stdout:5/552: getdents d2/d12/d4e/d74 0 2024-09-13T17:05:51.389 INFO:tasks.workunit.client.1.smithi195.stdout:5/553: chown d2/d12/d4e/l1f 10582330 1 2024-09-13T17:05:51.389 INFO:tasks.workunit.client.1.smithi195.stdout:3/547: write d7/f2d [1781218,40137] 0 2024-09-13T17:05:51.391 INFO:tasks.workunit.client.1.smithi195.stdout:9/635: dwrite d6/d19/d21/d64/d68/d6d/fb5 [0,4194304] 0 2024-09-13T17:05:51.391 INFO:tasks.workunit.client.1.smithi195.stdout:9/636: chown d6/d19/d21/d64/d68/d6d/f9e 0 1 2024-09-13T17:05:51.396 INFO:tasks.workunit.client.1.smithi195.stdout:0/546: creat d7/db/d38/d4f/fb1 x:0 0 0 2024-09-13T17:05:51.396 INFO:tasks.workunit.client.1.smithi195.stdout:5/554: dread d2/d12/d4e/f1d [0,4194304] 0 2024-09-13T17:05:51.396 INFO:tasks.workunit.client.0.smithi115.stdout:3/619: dwrite d1/d4b/d1a/d6e/fc4 [0,4194304] 0 2024-09-13T17:05:51.399 INFO:tasks.workunit.client.1.smithi195.stdout:4/651: rename d1a/d1f/d43/d24/d41/f5d to d1a/d1f/d43/d24/d41/fd3 0 2024-09-13T17:05:51.399 INFO:tasks.workunit.client.1.smithi195.stdout:4/652: creat d1a/d1f/d43/d5a/d63/db8/db9/fd4 x:0 0 0 2024-09-13T17:05:51.401 INFO:tasks.workunit.client.1.smithi195.stdout:6/521: link d1c/d2d/d5e/l64 d1c/d2d/d30/lb0 0 2024-09-13T17:05:51.401 INFO:tasks.workunit.client.1.smithi195.stdout:6/522: stat d1c/d3e/f87 0 2024-09-13T17:05:51.403 INFO:tasks.workunit.client.1.smithi195.stdout:5/555: write d2/d12/d4e/f5b [1059347,129332] 0 2024-09-13T17:05:51.403 INFO:tasks.workunit.client.1.smithi195.stdout:5/556: dread - d2/df/d86/f7e zero size 2024-09-13T17:05:51.405 INFO:tasks.workunit.client.1.smithi195.stdout:1/534: creat db/df/d13/da7/fb7 x:0 0 0 2024-09-13T17:05:51.406 INFO:tasks.workunit.client.1.smithi195.stdout:8/604: dwrite d0/d17/d2f/d6a/fa9 [0,4194304] 0 2024-09-13T17:05:51.407 INFO:tasks.workunit.client.1.smithi195.stdout:1/535: fsync db/d19/d37/f4e 0 2024-09-13T17:05:51.407 INFO:tasks.workunit.client.1.smithi195.stdout:3/548: unlink d7/f81 0 2024-09-13T17:05:51.408 INFO:tasks.workunit.client.1.smithi195.stdout:4/653: read f5 [671019,125141] 0 2024-09-13T17:05:51.408 INFO:tasks.workunit.client.1.smithi195.stdout:4/654: fdatasync d1a/d1f/d43/d24/d41/f88 0 2024-09-13T17:05:51.411 INFO:tasks.workunit.client.0.smithi115.stdout:3/620: dread d1/d4b/d1a/d30/fa7 [0,4194304] 0 2024-09-13T17:05:51.420 INFO:tasks.workunit.client.0.smithi115.stdout:3/621: write d1/d12/d23/f62 [1122193,116619] 0 2024-09-13T17:05:51.420 INFO:tasks.workunit.client.0.smithi115.stdout:3/622: stat d1/d4b/d1a/d6e/f75 0 2024-09-13T17:05:51.421 INFO:tasks.workunit.client.1.smithi195.stdout:9/637: rename d6/df/d16/c55 to d6/d19/cd6 0 2024-09-13T17:05:51.422 INFO:tasks.workunit.client.1.smithi195.stdout:0/547: symlink d7/d87/d9b/d4e/d68/lb2 0 2024-09-13T17:05:51.426 INFO:tasks.workunit.client.1.smithi195.stdout:5/557: truncate d2/d12/d4e/d10/f4a 246795 0 2024-09-13T17:05:51.429 INFO:tasks.workunit.client.0.smithi115.stdout:3/623: mknod d1/d12/d23/cd0 0 2024-09-13T17:05:51.431 INFO:tasks.workunit.client.1.smithi195.stdout:4/655: dwrite d1a/d1f/f87 [0,4194304] 0 2024-09-13T17:05:51.431 INFO:tasks.workunit.client.1.smithi195.stdout:4/656: creat d1a/d1f/d21/d84/d9d/d8e/d9f/fd5 x:0 0 0 2024-09-13T17:05:51.431 INFO:tasks.workunit.client.1.smithi195.stdout:4/657: write d1a/d1f/d43/f66 [4802567,38503] 0 2024-09-13T17:05:51.432 INFO:tasks.workunit.client.1.smithi195.stdout:4/658: readlink d1a/d1f/d9c/lb1 0 2024-09-13T17:05:51.432 INFO:tasks.workunit.client.1.smithi195.stdout:4/659: chown d1a/d1f/c39 3 1 2024-09-13T17:05:51.433 INFO:tasks.workunit.client.1.smithi195.stdout:8/605: symlink d0/ld2 0 2024-09-13T17:05:51.433 INFO:tasks.workunit.client.1.smithi195.stdout:8/606: write d0/d17/d2f/d7c/fca [562264,112461] 0 2024-09-13T17:05:51.434 INFO:tasks.workunit.client.1.smithi195.stdout:1/536: mknod db/df/d13/cb8 0 2024-09-13T17:05:51.435 INFO:tasks.workunit.client.1.smithi195.stdout:3/549: mkdir d7/d21/d2a/d35/d60/d6f/da4 0 2024-09-13T17:05:51.438 INFO:tasks.workunit.client.1.smithi195.stdout:5/558: stat d2/df/d78/l80 0 2024-09-13T17:05:51.441 INFO:tasks.workunit.client.1.smithi195.stdout:4/660: link c4 d1a/d1f/d43/d5a/d63/db8/dc8/cd6 0 2024-09-13T17:05:51.441 INFO:tasks.workunit.client.1.smithi195.stdout:4/661: stat cf 0 2024-09-13T17:05:51.442 INFO:tasks.workunit.client.1.smithi195.stdout:3/550: creat d7/d21/d2a/d4a/d5a/fa5 x:0 0 0 2024-09-13T17:05:51.443 INFO:tasks.workunit.client.1.smithi195.stdout:8/607: dread d0/d13/f16 [0,4194304] 0 2024-09-13T17:05:51.443 INFO:tasks.workunit.client.1.smithi195.stdout:8/608: chown d0/d13/l4f 200 1 2024-09-13T17:05:51.443 INFO:tasks.workunit.client.1.smithi195.stdout:3/551: getdents d7/d21 0 2024-09-13T17:05:51.444 INFO:tasks.workunit.client.1.smithi195.stdout:8/609: mknod d0/d4/cd3 0 2024-09-13T17:05:51.455 INFO:tasks.workunit.client.1.smithi195.stdout:4/662: write d1a/d1f/d21/f93 [3234096,110879] 0 2024-09-13T17:05:51.455 INFO:tasks.workunit.client.1.smithi195.stdout:4/663: chown d1a/d1f/d21/d84/d9d/f2a 18388591 1 2024-09-13T17:05:51.458 INFO:tasks.workunit.client.1.smithi195.stdout:0/548: dwrite d7/db/d38/f76 [0,4194304] 0 2024-09-13T17:05:51.462 INFO:tasks.workunit.client.0.smithi115.stdout:3/624: dwrite d1/d4b/d1a/d30/fa7 [0,4194304] 0 2024-09-13T17:05:51.463 INFO:tasks.workunit.client.1.smithi195.stdout:3/552: dwrite d7/d21/f73 [0,4194304] 0 2024-09-13T17:05:51.463 INFO:tasks.workunit.client.1.smithi195.stdout:1/537: dwrite db/df/f16 [4194304,4194304] 0 2024-09-13T17:05:51.469 INFO:tasks.workunit.client.1.smithi195.stdout:3/553: dread d7/d19/d1e/f50 [0,4194304] 0 2024-09-13T17:05:51.475 INFO:tasks.workunit.client.0.smithi115.stdout:3/625: dwrite d1/d12/d14/fcf [0,4194304] 0 2024-09-13T17:05:51.475 INFO:tasks.workunit.client.0.smithi115.stdout:3/626: chown d1/d12/d14/fcd 59431340 1 2024-09-13T17:05:51.478 INFO:tasks.workunit.client.1.smithi195.stdout:8/610: creat d0/d13/d52/fd4 x:0 0 0 2024-09-13T17:05:51.480 INFO:tasks.workunit.client.1.smithi195.stdout:4/664: truncate f0 6715205 0 2024-09-13T17:05:51.482 INFO:tasks.workunit.client.1.smithi195.stdout:6/523: rename d1c/d3e/d6b/d8a to d1c/d24/d49/d5f/db1 0 2024-09-13T17:05:51.486 INFO:tasks.workunit.client.0.smithi115.stdout:1/355: sync 2024-09-13T17:05:51.486 INFO:tasks.workunit.client.0.smithi115.stdout:1/356: dread - d5/d26/f35 zero size 2024-09-13T17:05:51.486 INFO:tasks.workunit.client.0.smithi115.stdout:1/357: read - d5/d7/d5c/d73/f81 zero size 2024-09-13T17:05:51.486 INFO:tasks.workunit.client.0.smithi115.stdout:1/358: chown d5/f6b 163065 1 2024-09-13T17:05:51.486 INFO:tasks.workunit.client.0.smithi115.stdout:5/367: sync 2024-09-13T17:05:51.486 INFO:tasks.workunit.client.0.smithi115.stdout:5/368: write d19/d2c/f76 [608177,94210] 0 2024-09-13T17:05:51.486 INFO:tasks.workunit.client.0.smithi115.stdout:5/369: write d19/d2e/d6b/f78 [1360610,106012] 0 2024-09-13T17:05:51.487 INFO:tasks.workunit.client.0.smithi115.stdout:5/370: write d19/d2b/d32/d55/f5a [5155169,20067] 0 2024-09-13T17:05:51.487 INFO:tasks.workunit.client.0.smithi115.stdout:5/371: getdents d19/d2b/d69 0 2024-09-13T17:05:51.489 INFO:tasks.workunit.client.1.smithi195.stdout:1/538: mknod db/df/d4d/d74/cb9 0 2024-09-13T17:05:51.495 INFO:tasks.workunit.client.1.smithi195.stdout:4/665: mkdir d1a/d1f/d43/d5a/d63/db8/dc8/dd7 0 2024-09-13T17:05:51.496 INFO:tasks.workunit.client.0.smithi115.stdout:1/359: rename d5/d26/l5f to d5/d7/l83 0 2024-09-13T17:05:51.501 INFO:tasks.workunit.client.1.smithi195.stdout:9/638: rename d6/d19/d21/d64/d68/d6d/f85 to d6/df/d13/fd7 0 2024-09-13T17:05:51.501 INFO:tasks.workunit.client.1.smithi195.stdout:9/639: write d6/df/d16/d58/f6e [6682871,24644] 0 2024-09-13T17:05:51.501 INFO:tasks.workunit.client.1.smithi195.stdout:1/539: getdents db/d19/d37/d46/d7e 0 2024-09-13T17:05:51.501 INFO:tasks.workunit.client.0.smithi115.stdout:1/360: unlink d5/d60/f4f 0 2024-09-13T17:05:51.502 INFO:tasks.workunit.client.0.smithi115.stdout:1/361: readlink d5/d26/d2c/l30 0 2024-09-13T17:05:51.504 INFO:tasks.workunit.client.1.smithi195.stdout:4/666: creat d1a/d1f/d43/d5a/d63/db8/fd8 x:0 0 0 2024-09-13T17:05:51.504 INFO:tasks.workunit.client.1.smithi195.stdout:4/667: chown d1a/d1f/d43/d24/d41/f70 643943388 1 2024-09-13T17:05:51.504 INFO:tasks.workunit.client.1.smithi195.stdout:5/559: rename d2/caf to d2/df/d48/d5a/cbe 0 2024-09-13T17:05:51.505 INFO:tasks.workunit.client.0.smithi115.stdout:1/362: creat d5/d3e/f84 x:0 0 0 2024-09-13T17:05:51.507 INFO:tasks.workunit.client.1.smithi195.stdout:1/540: mknod db/d19/d5a/d66/d96/db4/cba 0 2024-09-13T17:05:51.507 INFO:tasks.workunit.client.1.smithi195.stdout:1/541: write db/df/d4d/fb3 [1047407,63513] 0 2024-09-13T17:05:51.507 INFO:tasks.workunit.client.1.smithi195.stdout:4/668: truncate d1a/d1f/d21/d36/f7c 2208715 0 2024-09-13T17:05:51.508 INFO:tasks.workunit.client.1.smithi195.stdout:4/669: write d1a/d1f/d21/d22/fb7 [752767,128575] 0 2024-09-13T17:05:51.513 INFO:tasks.workunit.client.1.smithi195.stdout:5/560: link d2/d12/d4e/d10/f23 d2/df/d78/d99/fbf 0 2024-09-13T17:05:51.514 INFO:tasks.workunit.client.1.smithi195.stdout:8/611: dwrite d0/d13/f88 [0,4194304] 0 2024-09-13T17:05:51.515 INFO:tasks.workunit.client.0.smithi115.stdout:1/363: mkdir d5/d7/d85 0 2024-09-13T17:05:51.515 INFO:tasks.workunit.client.0.smithi115.stdout:1/364: write d5/d26/d2c/d62/f7f [107121,128397] 0 2024-09-13T17:05:51.516 INFO:tasks.workunit.client.1.smithi195.stdout:0/549: rename d7/d50/c94 to d7/db/d9a/cb3 0 2024-09-13T17:05:51.517 INFO:tasks.workunit.client.1.smithi195.stdout:1/542: symlink db/df/d4d/d74/lbb 0 2024-09-13T17:05:51.517 INFO:tasks.workunit.client.1.smithi195.stdout:1/543: fsync db/d19/d37/f4e 0 2024-09-13T17:05:51.519 INFO:tasks.workunit.client.0.smithi115.stdout:5/372: dwrite d19/d2b/d32/d55/f4c [0,4194304] 0 2024-09-13T17:05:51.519 INFO:tasks.workunit.client.0.smithi115.stdout:5/373: stat d19/c1c 0 2024-09-13T17:05:51.520 INFO:tasks.workunit.client.0.smithi115.stdout:1/365: mkdir d5/d7/d86 0 2024-09-13T17:05:51.521 INFO:tasks.workunit.client.1.smithi195.stdout:7/619: sync 2024-09-13T17:05:51.521 INFO:tasks.workunit.client.1.smithi195.stdout:2/583: sync 2024-09-13T17:05:51.523 INFO:tasks.workunit.client.1.smithi195.stdout:5/561: mkdir d2/d12/d4e/d74/d91/dc0 0 2024-09-13T17:05:51.523 INFO:tasks.workunit.client.1.smithi195.stdout:5/562: creat d2/d88/fc1 x:0 0 0 2024-09-13T17:05:51.528 INFO:tasks.workunit.client.1.smithi195.stdout:8/612: rename d0/d17/d49/l90 to d0/d17/d49/ld5 0 2024-09-13T17:05:51.530 INFO:tasks.workunit.client.1.smithi195.stdout:9/640: dwrite d6/d19/d21/d45/dad/d5e/dd0/d61/f9f [0,4194304] 0 2024-09-13T17:05:51.530 INFO:tasks.workunit.client.1.smithi195.stdout:3/554: rename d7/d19/l39 to d7/d21/d2a/d35/d60/la6 0 2024-09-13T17:05:51.531 INFO:tasks.workunit.client.1.smithi195.stdout:0/550: symlink d7/d87/d9b/d56/d46/da4/lb4 0 2024-09-13T17:05:51.533 INFO:tasks.workunit.client.1.smithi195.stdout:1/544: truncate db/d19/f79 2546134 0 2024-09-13T17:05:51.536 INFO:tasks.workunit.client.1.smithi195.stdout:4/670: rmdir d1a/d1f/d43/d24/d41/d60 39 2024-09-13T17:05:51.538 INFO:tasks.workunit.client.1.smithi195.stdout:2/584: read d0/d4a/d47/d73/d75/d88/d2c/d51/f79 [3582834,25905] 0 2024-09-13T17:05:51.539 INFO:tasks.workunit.client.0.smithi115.stdout:1/366: dread d5/d3e/f64 [0,4194304] 0 2024-09-13T17:05:51.539 INFO:tasks.workunit.client.0.smithi115.stdout:1/367: chown d5/d7/l83 3165926 1 2024-09-13T17:05:51.539 INFO:tasks.workunit.client.0.smithi115.stdout:1/368: stat d5/d3e/d59 0 2024-09-13T17:05:51.540 INFO:tasks.workunit.client.1.smithi195.stdout:7/620: link d5/l7d d5/db/d50/daa/ld6 0 2024-09-13T17:05:51.540 INFO:tasks.workunit.client.0.smithi115.stdout:3/627: dwrite d1/d12/d23/f8e [0,4194304] 0 2024-09-13T17:05:51.540 INFO:tasks.workunit.client.0.smithi115.stdout:3/628: write d1/d4b/d1a/f4e [880322,69370] 0 2024-09-13T17:05:51.540 INFO:tasks.workunit.client.0.smithi115.stdout:3/629: readlink d1/l8 0 2024-09-13T17:05:51.544 INFO:tasks.workunit.client.0.smithi115.stdout:5/374: dwrite f5 [0,4194304] 0 2024-09-13T17:05:51.546 INFO:tasks.workunit.client.0.smithi115.stdout:1/369: mkdir d5/d60/d7d/d87 0 2024-09-13T17:05:51.547 INFO:tasks.workunit.client.0.smithi115.stdout:1/370: readlink d5/d7/l1e 0 2024-09-13T17:05:51.547 INFO:tasks.workunit.client.0.smithi115.stdout:1/371: stat d5/d7/f49 0 2024-09-13T17:05:51.551 INFO:tasks.workunit.client.0.smithi115.stdout:7/356: sync 2024-09-13T17:05:51.552 INFO:tasks.workunit.client.0.smithi115.stdout:7/357: read d0/d3b/d54/f55 [799411,122048] 0 2024-09-13T17:05:51.552 INFO:tasks.workunit.client.0.smithi115.stdout:3/630: readlink d1/d12/d23/l8d 0 2024-09-13T17:05:51.553 INFO:tasks.workunit.client.1.smithi195.stdout:8/613: dwrite d0/d17/d49/d63/d71/f9c [0,4194304] 0 2024-09-13T17:05:51.554 INFO:tasks.workunit.client.1.smithi195.stdout:9/641: creat d6/d12/d86/da7/dcb/fd8 x:0 0 0 2024-09-13T17:05:51.554 INFO:tasks.workunit.client.1.smithi195.stdout:9/642: readlink d6/d12/d86/l93 0 2024-09-13T17:05:51.556 INFO:tasks.workunit.client.1.smithi195.stdout:6/524: rename d1c/d24/d49/d5f/d35/f4d to d1c/d24/d49/d5f/d35/d88/fb2 0 2024-09-13T17:05:51.556 INFO:tasks.workunit.client.1.smithi195.stdout:6/525: readlink d1c/d2d/l8e 0 2024-09-13T17:05:51.557 INFO:tasks.workunit.client.1.smithi195.stdout:3/555: symlink d7/d67/la7 0 2024-09-13T17:05:51.558 INFO:tasks.workunit.client.1.smithi195.stdout:3/556: readlink d7/d21/d2a/d4a/d5a/l89 0 2024-09-13T17:05:51.559 INFO:tasks.workunit.client.1.smithi195.stdout:0/551: truncate d7/d88/d23/f35 1988373 0 2024-09-13T17:05:51.560 INFO:tasks.workunit.client.0.smithi115.stdout:1/372: rmdir d5/d60/d7d 39 2024-09-13T17:05:51.560 INFO:tasks.workunit.client.0.smithi115.stdout:1/373: dread - d5/d7/d5c/f5d zero size 2024-09-13T17:05:51.563 INFO:tasks.workunit.client.1.smithi195.stdout:4/671: mknod d1a/d1f/d9c/dc2/cd9 0 2024-09-13T17:05:51.564 INFO:tasks.workunit.client.0.smithi115.stdout:7/358: truncate d0/d3b/d50/d21/f33 3811155 0 2024-09-13T17:05:51.567 INFO:tasks.workunit.client.1.smithi195.stdout:3/557: write d7/d21/d2a/d4a/f6e [3919107,97504] 0 2024-09-13T17:05:51.568 INFO:tasks.workunit.client.0.smithi115.stdout:3/631: mkdir d1/da6/dd1 0 2024-09-13T17:05:51.572 INFO:tasks.workunit.client.1.smithi195.stdout:6/526: dwrite d1c/d24/d49/d5f/f50 [4194304,4194304] 0 2024-09-13T17:05:51.572 INFO:tasks.workunit.client.0.smithi115.stdout:1/374: write d5/d26/d2c/f32 [1461522,25491] 0 2024-09-13T17:05:51.574 INFO:tasks.workunit.client.1.smithi195.stdout:4/672: dread d1a/d1f/d21/d22/f5b [0,4194304] 0 2024-09-13T17:05:51.581 INFO:tasks.workunit.client.0.smithi115.stdout:3/632: mkdir d1/d4b/d69/db6/dd2 0 2024-09-13T17:05:51.581 INFO:tasks.workunit.client.0.smithi115.stdout:3/633: getdents d1/d4b/d69/d7b/dbb/dcb 0 2024-09-13T17:05:51.585 INFO:tasks.workunit.client.0.smithi115.stdout:1/375: read d5/d26/f4a [762479,32137] 0 2024-09-13T17:05:51.587 INFO:tasks.workunit.client.0.smithi115.stdout:7/359: write d0/d2/d1e/f32 [3957511,32925] 0 2024-09-13T17:05:51.587 INFO:tasks.workunit.client.0.smithi115.stdout:7/360: write d0/d2/d1e/f6f [148943,72777] 0 2024-09-13T17:05:51.587 INFO:tasks.workunit.client.0.smithi115.stdout:7/361: write d0/d3b/d50/d21/d2f/f79 [800490,58895] 0 2024-09-13T17:05:51.587 INFO:tasks.workunit.client.0.smithi115.stdout:3/634: creat d1/d83/d9d/dba/fd3 x:0 0 0 2024-09-13T17:05:51.588 INFO:tasks.workunit.client.0.smithi115.stdout:3/635: write d1/d12/d14/f2e [557170,68209] 0 2024-09-13T17:05:51.588 INFO:tasks.workunit.client.1.smithi195.stdout:3/558: dwrite d7/d21/d2a/f32 [0,4194304] 0 2024-09-13T17:05:51.588 INFO:tasks.workunit.client.1.smithi195.stdout:0/552: dwrite d7/d88/d23/f62 [0,4194304] 0 2024-09-13T17:05:51.588 INFO:tasks.workunit.client.1.smithi195.stdout:0/553: fsync d7/db/f7b 0 2024-09-13T17:05:51.595 INFO:tasks.workunit.client.0.smithi115.stdout:1/376: mknod d5/c88 0 2024-09-13T17:05:51.595 INFO:tasks.workunit.client.0.smithi115.stdout:1/377: write d5/fb [1867910,113638] 0 2024-09-13T17:05:51.596 INFO:tasks.workunit.client.0.smithi115.stdout:7/362: dread d0/f87 [0,4194304] 0 2024-09-13T17:05:51.596 INFO:tasks.workunit.client.0.smithi115.stdout:7/363: truncate d0/d3b/d50/d21/d2f/f5b 630808 0 2024-09-13T17:05:51.599 INFO:tasks.workunit.client.1.smithi195.stdout:3/559: write d7/d21/f26 [2043276,105711] 0 2024-09-13T17:05:51.600 INFO:tasks.workunit.client.1.smithi195.stdout:6/527: dwrite f17 [0,4194304] 0 2024-09-13T17:05:51.601 INFO:tasks.workunit.client.0.smithi115.stdout:3/636: symlink d1/dc2/ld4 0 2024-09-13T17:05:51.604 INFO:tasks.workunit.client.1.smithi195.stdout:8/614: symlink d0/d62/ld6 0 2024-09-13T17:05:51.604 INFO:tasks.workunit.client.1.smithi195.stdout:8/615: fsync d0/d17/d2f/f93 0 2024-09-13T17:05:51.606 INFO:tasks.workunit.client.1.smithi195.stdout:9/643: mkdir d6/d19/d21/dd9 0 2024-09-13T17:05:51.606 INFO:tasks.workunit.client.1.smithi195.stdout:9/644: chown d6/d19/d21/l24 710107 1 2024-09-13T17:05:51.609 INFO:tasks.workunit.client.0.smithi115.stdout:3/637: write d1/d4b/d1a/d6e/fc4 [1476855,22613] 0 2024-09-13T17:05:51.610 INFO:tasks.workunit.client.0.smithi115.stdout:3/638: chown d1/d4b/d69/d7b/f9f 745525358 1 2024-09-13T17:05:51.610 INFO:tasks.workunit.client.1.smithi195.stdout:5/563: rename d2/d12/d4e/cc to d2/d12/d4e/d74/d91/cc2 0 2024-09-13T17:05:51.610 INFO:tasks.workunit.client.1.smithi195.stdout:5/564: readlink d2/df/d78/d54/d58/la5 0 2024-09-13T17:05:51.617 INFO:tasks.workunit.client.0.smithi115.stdout:1/378: mkdir d5/d26/d2c/d89 0 2024-09-13T17:05:51.620 INFO:tasks.workunit.client.0.smithi115.stdout:7/364: creat d0/d3b/d50/f88 x:0 0 0 2024-09-13T17:05:51.620 INFO:tasks.workunit.client.0.smithi115.stdout:7/365: fdatasync d0/d2/d1e/d3d/d6c/f30 0 2024-09-13T17:05:51.627 INFO:tasks.workunit.client.0.smithi115.stdout:3/639: dwrite d1/d4b/d69/d7b/f94 [4194304,4194304] 0 2024-09-13T17:05:51.629 INFO:tasks.workunit.client.1.smithi195.stdout:0/554: getdents d7/d88/d23 0 2024-09-13T17:05:51.632 INFO:tasks.workunit.client.0.smithi115.stdout:1/379: getdents d5/d26/d2c/d62 0 2024-09-13T17:05:51.633 INFO:tasks.workunit.client.1.smithi195.stdout:3/560: rename d7/d21/d2a/c49 to d7/d21/d2a/ca8 0 2024-09-13T17:05:51.633 INFO:tasks.workunit.client.0.smithi115.stdout:5/375: write f3 [1287268,73278] 0 2024-09-13T17:05:51.633 INFO:tasks.workunit.client.0.smithi115.stdout:5/376: truncate d19/d1d/f2f 995945 0 2024-09-13T17:05:51.634 INFO:tasks.workunit.client.0.smithi115.stdout:5/377: readlink l18 0 2024-09-13T17:05:51.635 INFO:tasks.workunit.client.1.smithi195.stdout:6/528: symlink d1c/d2d/d30/d6f/lb3 0 2024-09-13T17:05:51.640 INFO:tasks.workunit.client.1.smithi195.stdout:9/645: symlink d6/d19/d21/d45/dad/dca/lda 0 2024-09-13T17:05:51.640 INFO:tasks.workunit.client.0.smithi115.stdout:7/366: dwrite d0/d3b/d50/d21/d2f/f4e [4194304,4194304] 0 2024-09-13T17:05:51.642 INFO:tasks.workunit.client.1.smithi195.stdout:5/565: truncate d2/f6a 2743823 0 2024-09-13T17:05:51.642 INFO:tasks.workunit.client.1.smithi195.stdout:5/566: truncate d2/df/d78/d99/fbf 4990763 0 2024-09-13T17:05:51.648 INFO:tasks.workunit.client.1.smithi195.stdout:6/529: read f1a [1797385,92593] 0 2024-09-13T17:05:51.654 INFO:tasks.workunit.client.1.smithi195.stdout:4/673: rmdir d1a/d1f/d21/d84/d9d/d8e/d9f 39 2024-09-13T17:05:51.659 INFO:tasks.workunit.client.0.smithi115.stdout:3/640: creat d1/d12/d23/fd5 x:0 0 0 2024-09-13T17:05:51.660 INFO:tasks.workunit.client.0.smithi115.stdout:3/641: write d1/d4b/d1a/d30/f3c [4409591,67553] 0 2024-09-13T17:05:51.663 INFO:tasks.workunit.client.0.smithi115.stdout:1/380: mknod d5/d60/d7d/d87/c8a 0 2024-09-13T17:05:51.663 INFO:tasks.workunit.client.0.smithi115.stdout:1/381: truncate d5/f6b 826393 0 2024-09-13T17:05:51.663 INFO:tasks.workunit.client.0.smithi115.stdout:1/382: dread - d5/d7/d33/d3a/f71 zero size 2024-09-13T17:05:51.663 INFO:tasks.workunit.client.0.smithi115.stdout:1/383: chown d5/d7/d5c/l69 3 1 2024-09-13T17:05:51.666 INFO:tasks.workunit.client.0.smithi115.stdout:5/378: rename d19/d21/d3a/f5b to d19/d2c/f7e 0 2024-09-13T17:05:51.668 INFO:tasks.workunit.client.0.smithi115.stdout:7/367: dwrite d0/d2/f8 [4194304,4194304] 0 2024-09-13T17:05:51.668 INFO:tasks.workunit.client.0.smithi115.stdout:7/368: creat d0/d3b/d50/d21/d2f/f89 x:0 0 0 2024-09-13T17:05:51.671 INFO:tasks.workunit.client.1.smithi195.stdout:0/555: mkdir d7/db/d11/db5 0 2024-09-13T17:05:51.671 INFO:tasks.workunit.client.1.smithi195.stdout:0/556: dread - d7/d50/da1/faf zero size 2024-09-13T17:05:51.671 INFO:tasks.workunit.client.0.smithi115.stdout:1/384: write d5/d26/f29 [573656,126889] 0 2024-09-13T17:05:51.671 INFO:tasks.workunit.client.0.smithi115.stdout:1/385: write d5/d26/d2c/f32 [1457750,50364] 0 2024-09-13T17:05:51.675 INFO:tasks.workunit.client.1.smithi195.stdout:3/561: unlink d7/d19/d1e/f3f 0 2024-09-13T17:05:51.675 INFO:tasks.workunit.client.1.smithi195.stdout:3/562: chown d7/d5f/l99 130497841 1 2024-09-13T17:05:51.676 INFO:tasks.workunit.client.0.smithi115.stdout:5/379: truncate d19/f1a 2345909 0 2024-09-13T17:05:51.676 INFO:tasks.workunit.client.0.smithi115.stdout:5/380: read - d19/d2e/f5c zero size 2024-09-13T17:05:51.678 INFO:tasks.workunit.client.1.smithi195.stdout:8/616: getdents d0/d17/d49 0 2024-09-13T17:05:51.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:51 smithi115 ceph-mon[27708]: Adjusting osd_memory_target on smithi115 to 1216M 2024-09-13T17:05:51.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:51 smithi115 ceph-mon[27708]: Updating smithi115:/etc/ceph/ceph.conf 2024-09-13T17:05:51.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:51 smithi115 ceph-mon[27708]: Updating smithi195:/etc/ceph/ceph.conf 2024-09-13T17:05:51.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:51 smithi115 ceph-mon[27708]: Updating smithi195:/var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T17:05:51.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:51 smithi115 ceph-mon[27708]: Updating smithi115:/var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T17:05:51.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:51 smithi115 ceph-mon[27708]: Updating smithi195:/etc/ceph/ceph.client.admin.keyring 2024-09-13T17:05:51.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:51 smithi115 ceph-mon[27708]: Updating smithi115:/etc/ceph/ceph.client.admin.keyring 2024-09-13T17:05:51.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:51 smithi115 ceph-mon[27708]: Updating smithi195:/var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T17:05:51.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:51 smithi115 ceph-mon[27708]: from='mgr.24317 ' entity='mgr.smithi195.hjjifz' 2024-09-13T17:05:51.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:51 smithi115 ceph-mon[27708]: from='mgr.24317 ' entity='mgr.smithi195.hjjifz' 2024-09-13T17:05:51.685 INFO:tasks.workunit.client.0.smithi115.stdout:7/369: write d0/d2/d1e/f76 [8128115,13273] 0 2024-09-13T17:05:51.688 INFO:tasks.workunit.client.1.smithi195.stdout:3/563: dread d7/d19/d1e/f50 [0,4194304] 0 2024-09-13T17:05:51.689 INFO:tasks.workunit.client.0.smithi115.stdout:3/642: dwrite d1/d83/f91 [0,4194304] 0 2024-09-13T17:05:51.690 INFO:tasks.workunit.client.1.smithi195.stdout:9/646: link d6/d12/d86/f96 d6/d12/dbc/fdb 0 2024-09-13T17:05:51.691 INFO:tasks.workunit.client.1.smithi195.stdout:9/647: fdatasync d6/f18 0 2024-09-13T17:05:51.691 INFO:tasks.workunit.client.1.smithi195.stdout:9/648: creat d6/d19/d21/d45/fdc x:0 0 0 2024-09-13T17:05:51.693 INFO:tasks.workunit.client.1.smithi195.stdout:5/567: creat d2/d12/d4e/d74/fc3 x:0 0 0 2024-09-13T17:05:51.693 INFO:tasks.workunit.client.1.smithi195.stdout:5/568: read - d2/df/d78/d76/f8d zero size 2024-09-13T17:05:51.699 INFO:tasks.workunit.client.0.smithi115.stdout:8/397: sync 2024-09-13T17:05:51.700 INFO:tasks.workunit.client.1.smithi195.stdout:6/530: rename d1c/d24/d49/d5f/c69 to d1c/d7d/d9c/cb4 0 2024-09-13T17:05:51.700 INFO:tasks.workunit.client.0.smithi115.stdout:7/370: rmdir d0/d2/d1e/d3d/d82 39 2024-09-13T17:05:51.702 INFO:tasks.workunit.client.1.smithi195.stdout:4/674: symlink d1a/d1f/d21/d84/d9d/d8e/d9f/db2/lda 0 2024-09-13T17:05:51.703 INFO:tasks.workunit.client.0.smithi115.stdout:1/386: dwrite d5/d7/f16 [0,4194304] 0 2024-09-13T17:05:51.704 INFO:tasks.workunit.client.0.smithi115.stdout:8/398: mknod d0/d18/d19/d2b/d3b/c89 0 2024-09-13T17:05:51.706 INFO:tasks.workunit.client.0.smithi115.stdout:5/381: dwrite f5 [0,4194304] 0 2024-09-13T17:05:51.706 INFO:tasks.workunit.client.1.smithi195.stdout:0/557: getdents d7/d87/d9b/d56/da6 0 2024-09-13T17:05:51.711 INFO:tasks.workunit.client.0.smithi115.stdout:7/371: rmdir d0/d2/d67/d70/d7e 0 2024-09-13T17:05:51.711 INFO:tasks.workunit.client.0.smithi115.stdout:7/372: dread - d0/d2/d1e/d3d/d6c/d71/f61 zero size 2024-09-13T17:05:51.713 INFO:tasks.workunit.client.0.smithi115.stdout:7/373: dread d0/d2/d4a/f81 [0,4194304] 0 2024-09-13T17:05:51.716 INFO:tasks.workunit.client.1.smithi195.stdout:8/617: rmdir d0/d13/d69 39 2024-09-13T17:05:51.717 INFO:tasks.workunit.client.1.smithi195.stdout:4/675: write d1a/d1f/d43/d5a/f65 [710851,39924] 0 2024-09-13T17:05:51.717 INFO:tasks.workunit.client.1.smithi195.stdout:3/564: mkdir d7/d21/d2a/d35/d9c/da9 0 2024-09-13T17:05:51.718 INFO:tasks.workunit.client.0.smithi115.stdout:9/293: sync 2024-09-13T17:05:51.718 INFO:tasks.workunit.client.0.smithi115.stdout:4/547: sync 2024-09-13T17:05:51.718 INFO:tasks.workunit.client.0.smithi115.stdout:0/310: sync 2024-09-13T17:05:51.718 INFO:tasks.workunit.client.0.smithi115.stdout:0/311: dread - d9/d1d/d24/d26/d2d/d30/f47 zero size 2024-09-13T17:05:51.718 INFO:tasks.workunit.client.0.smithi115.stdout:0/312: truncate d9/f16 4588822 0 2024-09-13T17:05:51.718 INFO:tasks.workunit.client.0.smithi115.stdout:0/313: stat d9/d1d/l2e 0 2024-09-13T17:05:51.718 INFO:tasks.workunit.client.0.smithi115.stdout:9/294: write d0/de/d10/d15/f3a [149085,47770] 0 2024-09-13T17:05:51.718 INFO:tasks.workunit.client.0.smithi115.stdout:9/295: getdents d0/de/d37/d5a 0 2024-09-13T17:05:51.719 INFO:tasks.workunit.client.0.smithi115.stdout:1/387: unlink d5/d7/d5c/c6f 0 2024-09-13T17:05:51.722 INFO:tasks.workunit.client.0.smithi115.stdout:8/399: mknod d0/d15/d44/c8a 0 2024-09-13T17:05:51.722 INFO:tasks.workunit.client.0.smithi115.stdout:8/400: chown d0/d15/d44/f70 1 1 2024-09-13T17:05:51.723 INFO:tasks.workunit.client.1.smithi195.stdout:0/558: mknod d7/d87/d9b/d56/d46/cb6 0 2024-09-13T17:05:51.727 INFO:tasks.workunit.client.1.smithi195.stdout:4/676: symlink d1a/d1f/d43/ldb 0 2024-09-13T17:05:51.729 INFO:tasks.workunit.client.0.smithi115.stdout:2/643: sync 2024-09-13T17:05:51.729 INFO:tasks.workunit.client.0.smithi115.stdout:6/383: sync 2024-09-13T17:05:51.730 INFO:tasks.workunit.client.1.smithi195.stdout:6/531: dwrite f2 [4194304,4194304] 0 2024-09-13T17:05:51.730 INFO:tasks.workunit.client.1.smithi195.stdout:6/532: readlink d1c/d2d/d8c/laa 0 2024-09-13T17:05:51.731 INFO:tasks.workunit.client.0.smithi115.stdout:4/548: mknod d7/dd/d3c/d72/ca7 0 2024-09-13T17:05:51.731 INFO:tasks.workunit.client.0.smithi115.stdout:4/549: fsync d7/dd/de/f43 0 2024-09-13T17:05:51.732 INFO:tasks.workunit.client.0.smithi115.stdout:4/550: chown d7/dd/d3c/d7b/f9a 5944 1 2024-09-13T17:05:51.732 INFO:tasks.workunit.client.0.smithi115.stdout:4/551: chown d7/dd/de/d4e/d5a/d4f/d70 418918849 1 2024-09-13T17:05:51.732 INFO:tasks.workunit.client.1.smithi195.stdout:9/649: dwrite d6/df/d72/f92 [0,4194304] 0 2024-09-13T17:05:51.732 INFO:tasks.workunit.client.1.smithi195.stdout:9/650: chown d6/d12/d86/da7/dcb/fd8 28 1 2024-09-13T17:05:51.732 INFO:tasks.workunit.client.1.smithi195.stdout:9/651: chown d6/d19/d21/d45/dad/d5e/dd0/d61/fbe 6949176 1 2024-09-13T17:05:51.732 INFO:tasks.workunit.client.1.smithi195.stdout:7/621: sync 2024-09-13T17:05:51.732 INFO:tasks.workunit.client.1.smithi195.stdout:2/585: sync 2024-09-13T17:05:51.733 INFO:tasks.workunit.client.0.smithi115.stdout:3/643: dwrite d1/d4b/d1a/d30/faa [0,4194304] 0 2024-09-13T17:05:51.734 INFO:tasks.workunit.client.0.smithi115.stdout:3/644: dread - d1/d12/d14/fcd zero size 2024-09-13T17:05:51.734 INFO:tasks.workunit.client.0.smithi115.stdout:3/645: truncate d1/d12/f5b 1848288 0 2024-09-13T17:05:51.734 INFO:tasks.workunit.client.0.smithi115.stdout:3/646: write d1/da6/fa9 [459629,47640] 0 2024-09-13T17:05:51.734 INFO:tasks.workunit.client.1.smithi195.stdout:3/565: symlink d7/d21/d2a/d4a/d71/laa 0 2024-09-13T17:05:51.734 INFO:tasks.workunit.client.1.smithi195.stdout:3/566: read d7/d19/d1e/f50 [2857152,126765] 0 2024-09-13T17:05:51.734 INFO:tasks.workunit.client.1.smithi195.stdout:3/567: creat d7/d21/d2a/d4a/fab x:0 0 0 2024-09-13T17:05:51.735 INFO:tasks.workunit.client.0.smithi115.stdout:9/296: dread d0/f11 [0,4194304] 0 2024-09-13T17:05:51.735 INFO:tasks.workunit.client.0.smithi115.stdout:9/297: chown d0/de/d10/f3e 12842 1 2024-09-13T17:05:51.736 INFO:tasks.workunit.client.0.smithi115.stdout:0/314: rename d9/d1b/f23 to d9/d1d/d24/d26/d2d/d30/f5a 0 2024-09-13T17:05:51.736 INFO:tasks.workunit.client.1.smithi195.stdout:2/586: dread d0/f54 [0,4194304] 0 2024-09-13T17:05:51.736 INFO:tasks.workunit.client.1.smithi195.stdout:2/587: write d0/d4a/d47/d73/d75/d88/d2c/d43/f64 [6808536,6068] 0 2024-09-13T17:05:51.738 INFO:tasks.workunit.client.0.smithi115.stdout:1/388: creat d5/d3e/d59/f8b x:0 0 0 2024-09-13T17:05:51.738 INFO:tasks.workunit.client.0.smithi115.stdout:1/389: fdatasync d5/d7/d33/f53 0 2024-09-13T17:05:51.741 INFO:tasks.workunit.client.0.smithi115.stdout:8/401: mknod d0/d26/d29/c8b 0 2024-09-13T17:05:51.744 INFO:tasks.workunit.client.0.smithi115.stdout:5/382: rmdir d19/d75 39 2024-09-13T17:05:51.744 INFO:tasks.workunit.client.0.smithi115.stdout:5/383: chown d19/d2e/f5c 243372 1 2024-09-13T17:05:51.746 INFO:tasks.workunit.client.1.smithi195.stdout:8/618: dwrite d0/d17/d2f/f93 [0,4194304] 0 2024-09-13T17:05:51.746 INFO:tasks.workunit.client.1.smithi195.stdout:8/619: fsync d0/d13/d52/d55/fbf 0 2024-09-13T17:05:51.746 INFO:tasks.workunit.client.1.smithi195.stdout:8/620: write d0/d62/f98 [528125,39519] 0 2024-09-13T17:05:51.747 INFO:tasks.workunit.client.1.smithi195.stdout:8/621: fdatasync d0/fc 0 2024-09-13T17:05:51.747 INFO:tasks.workunit.client.1.smithi195.stdout:9/652: creat d6/df/d16/fdd x:0 0 0 2024-09-13T17:05:51.748 INFO:tasks.workunit.client.1.smithi195.stdout:0/559: dwrite d7/d88/d23/f35 [0,4194304] 0 2024-09-13T17:05:51.748 INFO:tasks.workunit.client.1.smithi195.stdout:8/622: dread d0/d17/d49/d63/fb5 [0,4194304] 0 2024-09-13T17:05:51.748 INFO:tasks.workunit.client.0.smithi115.stdout:7/374: dwrite d0/d2/d1e/d3d/d6c/f5d [0,4194304] 0 2024-09-13T17:05:51.748 INFO:tasks.workunit.client.0.smithi115.stdout:7/375: read d0/d2/f8 [5281386,18100] 0 2024-09-13T17:05:51.748 INFO:tasks.workunit.client.0.smithi115.stdout:7/376: chown d0/d2 336 1 2024-09-13T17:05:51.748 INFO:tasks.workunit.client.0.smithi115.stdout:7/377: stat d0/d2/d1e/d73 0 2024-09-13T17:05:51.749 INFO:tasks.workunit.client.0.smithi115.stdout:7/378: write d0/d3b/d50/d21/d2f/f79 [1154161,102799] 0 2024-09-13T17:05:51.749 INFO:tasks.workunit.client.0.smithi115.stdout:2/644: write d3/d4d/dd/d1f/f9d [966918,123964] 0 2024-09-13T17:05:51.749 INFO:tasks.workunit.client.1.smithi195.stdout:4/677: dwrite f13 [4194304,4194304] 0 2024-09-13T17:05:51.750 INFO:tasks.workunit.client.1.smithi195.stdout:7/622: link d5/db/d19/d22/f5d d5/d13/d24/fd7 0 2024-09-13T17:05:51.751 INFO:tasks.workunit.client.1.smithi195.stdout:1/545: sync 2024-09-13T17:05:51.755 INFO:tasks.workunit.client.1.smithi195.stdout:3/568: creat d7/d62/d70/fac x:0 0 0 2024-09-13T17:05:51.755 INFO:tasks.workunit.client.1.smithi195.stdout:3/569: stat d7/d62/d70/fac 0 2024-09-13T17:05:51.756 INFO:tasks.workunit.client.0.smithi115.stdout:6/384: dwrite d8/db/dd/f16 [0,4194304] 0 2024-09-13T17:05:51.756 INFO:tasks.workunit.client.0.smithi115.stdout:6/385: fsync d8/d33/f55 0 2024-09-13T17:05:51.756 INFO:tasks.workunit.client.1.smithi195.stdout:2/588: truncate d0/d4a/d47/d73/d75/d88/f3e 501336 0 2024-09-13T17:05:51.758 INFO:tasks.workunit.client.0.smithi115.stdout:3/647: creat d1/d4b/d69/d7b/dbb/fd6 x:0 0 0 2024-09-13T17:05:51.761 INFO:tasks.workunit.client.0.smithi115.stdout:9/298: creat d0/f66 x:0 0 0 2024-09-13T17:05:51.761 INFO:tasks.workunit.client.0.smithi115.stdout:9/299: creat d0/d21/f67 x:0 0 0 2024-09-13T17:05:51.762 INFO:tasks.workunit.client.0.smithi115.stdout:9/300: write d0/de/f2d [612851,130238] 0 2024-09-13T17:05:51.763 INFO:tasks.workunit.client.0.smithi115.stdout:0/315: truncate d9/f17 1158819 0 2024-09-13T17:05:51.764 INFO:tasks.workunit.client.1.smithi195.stdout:9/653: symlink d6/d12/d86/da7/dcb/lde 0 2024-09-13T17:05:51.766 INFO:tasks.workunit.client.0.smithi115.stdout:4/552: rename d7/dd/d63/c65 to d7/dd/d3c/d7b/ca8 0 2024-09-13T17:05:51.767 INFO:tasks.workunit.client.1.smithi195.stdout:8/623: unlink d0/d17/d49/fc5 0 2024-09-13T17:05:51.769 INFO:tasks.workunit.client.1.smithi195.stdout:3/570: dwrite d7/d19/f48 [0,4194304] 0 2024-09-13T17:05:51.770 INFO:tasks.workunit.client.0.smithi115.stdout:5/384: link l11 d19/d2b/d69/l7f 0 2024-09-13T17:05:51.770 INFO:tasks.workunit.client.0.smithi115.stdout:5/385: read - d19/d75/f7b zero size 2024-09-13T17:05:51.770 INFO:tasks.workunit.client.0.smithi115.stdout:5/386: dread - d19/d2e/f5c zero size 2024-09-13T17:05:51.770 INFO:tasks.workunit.client.1.smithi195.stdout:0/560: symlink d7/d87/d9b/d56/lb7 0 2024-09-13T17:05:51.775 INFO:tasks.workunit.client.1.smithi195.stdout:4/678: link f11 d1a/d1f/d21/d22/d98/fdc 0 2024-09-13T17:05:51.775 INFO:tasks.workunit.client.1.smithi195.stdout:4/679: fsync d1a/d1f/d43/fce 0 2024-09-13T17:05:51.778 INFO:tasks.workunit.client.1.smithi195.stdout:7/623: link d5/d35/l3b d5/db/d50/d7f/d82/da1/ld8 0 2024-09-13T17:05:51.779 INFO:tasks.workunit.client.1.smithi195.stdout:3/571: dread d7/d5f/f68 [0,4194304] 0 2024-09-13T17:05:51.779 INFO:tasks.workunit.client.0.smithi115.stdout:7/379: mknod d0/d2/d67/c8a 0 2024-09-13T17:05:51.779 INFO:tasks.workunit.client.0.smithi115.stdout:7/380: chown d0/l19 247154007 1 2024-09-13T17:05:51.781 INFO:tasks.workunit.client.0.smithi115.stdout:2/645: creat d3/d4d/d13/d77/fc6 x:0 0 0 2024-09-13T17:05:51.784 INFO:tasks.workunit.client.0.smithi115.stdout:0/316: dwrite d9/fc [0,4194304] 0 2024-09-13T17:05:51.784 INFO:tasks.workunit.client.0.smithi115.stdout:0/317: write d9/d1b/f21 [326903,86739] 0 2024-09-13T17:05:51.784 INFO:tasks.workunit.client.1.smithi195.stdout:2/589: symlink d0/d4a/d47/d73/d75/d88/d62/lbf 0 2024-09-13T17:05:51.784 INFO:tasks.workunit.client.1.smithi195.stdout:2/590: fdatasync d0/d3/f5b 0 2024-09-13T17:05:51.786 INFO:tasks.workunit.client.1.smithi195.stdout:9/654: link d6/d19/d21/d45/fc8 d6/df/d16/d5c/fdf 0 2024-09-13T17:05:51.786 INFO:tasks.workunit.client.1.smithi195.stdout:9/655: write d6/d19/d21/d64/d68/d6d/fa2 [1767305,54633] 0 2024-09-13T17:05:51.786 INFO:tasks.workunit.client.1.smithi195.stdout:9/656: write d6/d19/d21/d64/d68/d6d/fa2 [827555,30242] 0 2024-09-13T17:05:51.787 INFO:tasks.workunit.client.1.smithi195.stdout:3/572: write d7/d19/f48 [3814196,71402] 0 2024-09-13T17:05:51.792 INFO:tasks.workunit.client.1.smithi195.stdout:0/561: link d7/db/l64 d7/db/d38/d5d/lb8 0 2024-09-13T17:05:51.794 INFO:tasks.workunit.client.1.smithi195.stdout:4/680: mkdir d1a/d1f/d21/ddd 0 2024-09-13T17:05:51.795 INFO:tasks.workunit.client.0.smithi115.stdout:6/386: creat d8/d13/d15/d24/f79 x:0 0 0 2024-09-13T17:05:51.796 INFO:tasks.workunit.client.0.smithi115.stdout:6/387: readlink d8/l44 0 2024-09-13T17:05:51.796 INFO:tasks.workunit.client.0.smithi115.stdout:6/388: fsync d8/d13/d15/d24/f3b 0 2024-09-13T17:05:51.796 INFO:tasks.workunit.client.0.smithi115.stdout:6/389: dread - d8/d33/d40/f5a zero size 2024-09-13T17:05:51.796 INFO:tasks.workunit.client.0.smithi115.stdout:6/390: write d8/d33/d40/d4c/d66/f77 [317595,36127] 0 2024-09-13T17:05:51.796 INFO:tasks.workunit.client.1.smithi195.stdout:7/624: rename f4 to d5/db/d50/daa/fd9 0 2024-09-13T17:05:51.797 INFO:tasks.workunit.client.0.smithi115.stdout:6/391: dread d8/d33/d40/f5c [0,4194304] 0 2024-09-13T17:05:51.798 INFO:tasks.workunit.client.0.smithi115.stdout:3/648: creat d1/dc2/fd7 x:0 0 0 2024-09-13T17:05:51.798 INFO:tasks.workunit.client.0.smithi115.stdout:3/649: fdatasync d1/d4b/d1a/d30/f82 0 2024-09-13T17:05:51.799 INFO:tasks.workunit.client.1.smithi195.stdout:2/591: creat d0/d4a/d47/dba/fc0 x:0 0 0 2024-09-13T17:05:51.801 INFO:tasks.workunit.client.1.smithi195.stdout:9/657: creat d6/d12/d86/dd2/fe0 x:0 0 0 2024-09-13T17:05:51.802 INFO:tasks.workunit.client.0.smithi115.stdout:1/390: rename d5/d3e/f47 to d5/d7/d5c/f8c 0 2024-09-13T17:05:51.803 INFO:tasks.workunit.client.1.smithi195.stdout:3/573: mknod d7/d62/d70/cad 0 2024-09-13T17:05:51.806 INFO:tasks.workunit.client.0.smithi115.stdout:4/553: unlink f5 0 2024-09-13T17:05:51.806 INFO:tasks.workunit.client.0.smithi115.stdout:6/392: dread d8/db/d1d/f26 [0,4194304] 0 2024-09-13T17:05:51.806 INFO:tasks.workunit.client.1.smithi195.stdout:8/624: getdents d0/d17/d2f/d7c 0 2024-09-13T17:05:51.808 INFO:tasks.workunit.client.1.smithi195.stdout:8/625: write d0/d62/f98 [58148,5773] 0 2024-09-13T17:05:51.808 INFO:tasks.workunit.client.1.smithi195.stdout:4/681: creat d1a/d1f/d21/d84/d9d/d58/fde x:0 0 0 2024-09-13T17:05:51.809 INFO:tasks.workunit.client.1.smithi195.stdout:8/626: dread d0/d17/d49/d63/fb5 [0,4194304] 0 2024-09-13T17:05:51.810 INFO:tasks.workunit.client.0.smithi115.stdout:7/381: mknod d0/d2/d1e/d3d/d6c/d71/c8b 0 2024-09-13T17:05:51.810 INFO:tasks.workunit.client.0.smithi115.stdout:7/382: chown d0/d2/d1e/c7d 935435 1 2024-09-13T17:05:51.810 INFO:tasks.workunit.client.1.smithi195.stdout:4/682: dread d1a/d1f/d21/d36/f55 [0,4194304] 0 2024-09-13T17:05:51.811 INFO:tasks.workunit.client.1.smithi195.stdout:0/562: rename d7/db/d11/c2b to d7/d88/cb9 0 2024-09-13T17:05:51.812 INFO:tasks.workunit.client.1.smithi195.stdout:3/574: dread d7/d21/d2a/f2b [0,4194304] 0 2024-09-13T17:05:51.812 INFO:tasks.workunit.client.0.smithi115.stdout:5/387: dread d19/d21/d3a/d5d/f70 [0,4194304] 0 2024-09-13T17:05:51.812 INFO:tasks.workunit.client.0.smithi115.stdout:0/318: creat d9/d1d/d24/f5b x:0 0 0 2024-09-13T17:05:51.813 INFO:tasks.workunit.client.1.smithi195.stdout:8/627: dread d0/d17/f9e [0,4194304] 0 2024-09-13T17:05:51.813 INFO:tasks.workunit.client.1.smithi195.stdout:7/625: rename d5/db/l1f to d5/db/lda 0 2024-09-13T17:05:51.816 INFO:tasks.workunit.client.0.smithi115.stdout:3/650: getdents d1 0 2024-09-13T17:05:51.816 INFO:tasks.workunit.client.0.smithi115.stdout:3/651: dread - d1/d12/f56 zero size 2024-09-13T17:05:51.816 INFO:tasks.workunit.client.0.smithi115.stdout:3/652: write d1/d4b/d1a/d6e/fc4 [4011566,89685] 0 2024-09-13T17:05:51.816 INFO:tasks.workunit.client.0.smithi115.stdout:3/653: fsync d1/d12/fbd 0 2024-09-13T17:05:51.816 INFO:tasks.workunit.client.1.smithi195.stdout:2/592: truncate d0/d3/f68 1887241 0 2024-09-13T17:05:51.817 INFO:tasks.workunit.client.1.smithi195.stdout:7/626: dread d5/d13/d30/f34 [4194304,4194304] 0 2024-09-13T17:05:51.817 INFO:tasks.workunit.client.1.smithi195.stdout:7/627: chown d5/d35/l42 4 1 2024-09-13T17:05:51.820 INFO:tasks.workunit.client.1.smithi195.stdout:9/658: unlink d6/d19/d21/f7c 0 2024-09-13T17:05:51.820 INFO:tasks.workunit.client.1.smithi195.stdout:9/659: dread - d6/d19/d21/d64/fbf zero size 2024-09-13T17:05:51.821 INFO:tasks.workunit.client.0.smithi115.stdout:9/301: rename d0/d34/c55 to d0/d21/c68 0 2024-09-13T17:05:51.821 INFO:tasks.workunit.client.1.smithi195.stdout:8/628: dread d0/d17/d2f/d31/f3f [0,4194304] 0 2024-09-13T17:05:51.822 INFO:tasks.workunit.client.0.smithi115.stdout:7/383: dread d0/d2/d1e/d3d/d6c/d71/f46 [0,4194304] 0 2024-09-13T17:05:51.822 INFO:tasks.workunit.client.0.smithi115.stdout:7/384: chown d0/d3b/d50/d21/f33 200 1 2024-09-13T17:05:51.823 INFO:tasks.workunit.client.1.smithi195.stdout:4/683: rmdir d1a/d1f/d43/d5a/d63/db8/dc8 39 2024-09-13T17:05:51.824 INFO:tasks.workunit.client.0.smithi115.stdout:1/391: symlink d5/d7/d86/l8d 0 2024-09-13T17:05:51.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:51 smithi195 ceph-mon[34981]: Adjusting osd_memory_target on smithi115 to 1216M 2024-09-13T17:05:51.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:51 smithi195 ceph-mon[34981]: Updating smithi115:/etc/ceph/ceph.conf 2024-09-13T17:05:51.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:51 smithi195 ceph-mon[34981]: Updating smithi195:/etc/ceph/ceph.conf 2024-09-13T17:05:51.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:51 smithi195 ceph-mon[34981]: Updating smithi195:/var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T17:05:51.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:51 smithi195 ceph-mon[34981]: Updating smithi115:/var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T17:05:51.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:51 smithi195 ceph-mon[34981]: Updating smithi195:/etc/ceph/ceph.client.admin.keyring 2024-09-13T17:05:51.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:51 smithi195 ceph-mon[34981]: Updating smithi115:/etc/ceph/ceph.client.admin.keyring 2024-09-13T17:05:51.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:51 smithi195 ceph-mon[34981]: Updating smithi195:/var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T17:05:51.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:51 smithi195 ceph-mon[34981]: from='mgr.24317 ' entity='mgr.smithi195.hjjifz' 2024-09-13T17:05:51.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:51 smithi195 ceph-mon[34981]: from='mgr.24317 ' entity='mgr.smithi195.hjjifz' 2024-09-13T17:05:51.829 INFO:tasks.workunit.client.1.smithi195.stdout:0/563: rename d7/d87/d9b/d4e/d68/l69 to d7/d88/d7c/lba 0 2024-09-13T17:05:51.829 INFO:tasks.workunit.client.1.smithi195.stdout:0/564: fdatasync d7/d50/f30 0 2024-09-13T17:05:51.829 INFO:tasks.workunit.client.1.smithi195.stdout:0/565: read d7/d87/d9b/d56/d4d/d5e/f85 [741728,30172] 0 2024-09-13T17:05:51.829 INFO:tasks.workunit.client.1.smithi195.stdout:0/566: chown d7/d87/d9b/d4e/f5b 180998 1 2024-09-13T17:05:51.830 INFO:tasks.workunit.client.0.smithi115.stdout:4/554: rmdir d7 39 2024-09-13T17:05:51.831 INFO:tasks.workunit.client.0.smithi115.stdout:6/393: mknod d8/db/c7a 0 2024-09-13T17:05:51.832 INFO:tasks.workunit.client.0.smithi115.stdout:6/394: readlink d8/d13/d15/d24/l36 0 2024-09-13T17:05:51.832 INFO:tasks.workunit.client.0.smithi115.stdout:6/395: write d8/d13/d15/f65 [553914,32230] 0 2024-09-13T17:05:51.832 INFO:tasks.workunit.client.1.smithi195.stdout:3/575: rmdir d7/d62/d70/d96 0 2024-09-13T17:05:51.834 INFO:tasks.workunit.client.1.smithi195.stdout:2/593: creat d0/d4a/d47/d73/d94/fc1 x:0 0 0 2024-09-13T17:05:51.834 INFO:tasks.workunit.client.1.smithi195.stdout:8/629: dread d0/d17/d2f/d31/f37 [0,4194304] 0 2024-09-13T17:05:51.836 INFO:tasks.workunit.client.0.smithi115.stdout:5/388: creat d19/d21/f80 x:0 0 0 2024-09-13T17:05:51.836 INFO:tasks.workunit.client.0.smithi115.stdout:5/389: chown d19/d21/d3a 1 1 2024-09-13T17:05:51.836 INFO:tasks.workunit.client.0.smithi115.stdout:5/390: dread - d19/d2e/f5c zero size 2024-09-13T17:05:51.837 INFO:tasks.workunit.client.0.smithi115.stdout:0/319: dwrite d9/d1b/f57 [0,4194304] 0 2024-09-13T17:05:51.837 INFO:tasks.workunit.client.0.smithi115.stdout:0/320: chown d9/d1d/d24/d26/d2d/d30 11 1 2024-09-13T17:05:51.837 INFO:tasks.workunit.client.0.smithi115.stdout:0/321: readlink d9/d1d/d24/d26/d2c/l58 0 2024-09-13T17:05:51.838 INFO:tasks.workunit.client.1.smithi195.stdout:7/628: creat d5/d13/d24/d70/dd5/fdb x:0 0 0 2024-09-13T17:05:51.838 INFO:tasks.workunit.client.1.smithi195.stdout:7/629: creat d5/d13/d30/fdc x:0 0 0 2024-09-13T17:05:51.838 INFO:tasks.workunit.client.1.smithi195.stdout:7/630: creat d5/db/d50/daa/fdd x:0 0 0 2024-09-13T17:05:51.838 INFO:tasks.workunit.client.1.smithi195.stdout:7/631: chown d5/db/d19/d22/d3c/fb7 54 1 2024-09-13T17:05:51.842 INFO:tasks.workunit.client.0.smithi115.stdout:2/646: rename d3/d4d/dd/d1f/d2f/d56/d58/f5a to d3/d4d/d13/d39/d46/d70/fc7 0 2024-09-13T17:05:51.844 INFO:tasks.workunit.client.1.smithi195.stdout:4/684: unlink f19 0 2024-09-13T17:05:51.849 INFO:tasks.workunit.client.0.smithi115.stdout:9/302: symlink d0/d34/l69 0 2024-09-13T17:05:51.852 INFO:tasks.workunit.client.0.smithi115.stdout:1/392: mkdir d5/d60/d8e 0 2024-09-13T17:05:51.852 INFO:tasks.workunit.client.0.smithi115.stdout:6/396: dread d8/db/d1d/f2b [4194304,4194304] 0 2024-09-13T17:05:51.852 INFO:tasks.workunit.client.0.smithi115.stdout:1/393: dread - d5/d3e/d59/f8b zero size 2024-09-13T17:05:51.853 INFO:tasks.workunit.client.0.smithi115.stdout:3/654: dwrite d1/d4b/d1a/d6e/f75 [4194304,4194304] 0 2024-09-13T17:05:51.854 INFO:tasks.workunit.client.1.smithi195.stdout:2/594: link d0/d4a/l29 d0/d4a/d47/lc2 0 2024-09-13T17:05:51.854 INFO:tasks.workunit.client.1.smithi195.stdout:2/595: stat d0/d4a/d47/dba/fc0 0 2024-09-13T17:05:51.856 INFO:tasks.workunit.client.1.smithi195.stdout:8/630: write d0/d17/d2f/d6a/fa9 [302537,125891] 0 2024-09-13T17:05:51.859 INFO:tasks.workunit.client.1.smithi195.stdout:9/660: dwrite d6/d12/d39/f89 [0,4194304] 0 2024-09-13T17:05:51.860 INFO:tasks.workunit.client.1.smithi195.stdout:0/567: dwrite d7/f53 [0,4194304] 0 2024-09-13T17:05:51.860 INFO:tasks.workunit.client.1.smithi195.stdout:7/632: dwrite d5/d13/d24/d70/f89 [0,4194304] 0 2024-09-13T17:05:51.860 INFO:tasks.workunit.client.1.smithi195.stdout:7/633: truncate d5/d13/d30/fdc 7691 0 2024-09-13T17:05:51.861 INFO:tasks.workunit.client.0.smithi115.stdout:4/555: creat d7/dd/de/d4e/d5a/d4f/d70/fa9 x:0 0 0 2024-09-13T17:05:51.861 INFO:tasks.workunit.client.0.smithi115.stdout:4/556: stat d7/dd/f26 0 2024-09-13T17:05:51.861 INFO:tasks.workunit.client.0.smithi115.stdout:4/557: fsync d7/dd/de/d4e/d6c/f7c 0 2024-09-13T17:05:51.862 INFO:tasks.workunit.client.1.smithi195.stdout:4/685: symlink d1a/d1f/d43/d24/ldf 0 2024-09-13T17:05:51.866 INFO:tasks.workunit.client.1.smithi195.stdout:3/576: rmdir d7/d21/d2a/d35/d60/d64 39 2024-09-13T17:05:51.866 INFO:tasks.workunit.client.1.smithi195.stdout:3/577: chown d7/d21/d2a/d4a/f6e 2419 1 2024-09-13T17:05:51.866 INFO:tasks.workunit.client.1.smithi195.stdout:3/578: readlink d7/d67/la7 0 2024-09-13T17:05:51.869 INFO:tasks.workunit.client.1.smithi195.stdout:2/596: truncate d0/d3/fa8 3492765 0 2024-09-13T17:05:51.869 INFO:tasks.workunit.client.1.smithi195.stdout:2/597: dread - d0/d4a/d47/d73/d75/d88/d2c/d43/d63/f99 zero size 2024-09-13T17:05:51.870 INFO:tasks.workunit.client.0.smithi115.stdout:5/391: dwrite d19/d2b/f50 [0,4194304] 0 2024-09-13T17:05:51.872 INFO:tasks.workunit.client.0.smithi115.stdout:2/647: dwrite d3/d4d/de/d3a/d47/f49 [0,4194304] 0 2024-09-13T17:05:51.872 INFO:tasks.workunit.client.1.smithi195.stdout:8/631: mknod d0/d17/d2f/d6a/d6f/cd7 0 2024-09-13T17:05:51.872 INFO:tasks.workunit.client.1.smithi195.stdout:8/632: readlink d0/d17/d49/d63/la7 0 2024-09-13T17:05:51.873 INFO:tasks.workunit.client.1.smithi195.stdout:4/686: write f11 [6779052,78442] 0 2024-09-13T17:05:51.876 INFO:tasks.workunit.client.1.smithi195.stdout:9/661: dwrite d6/d12/d39/fa1 [0,4194304] 0 2024-09-13T17:05:51.877 INFO:tasks.workunit.client.0.smithi115.stdout:0/322: mkdir d9/d1d/d24/d26/d2d/d30/d5c 0 2024-09-13T17:05:51.881 INFO:tasks.workunit.client.0.smithi115.stdout:4/558: dwrite d7/fb [0,4194304] 0 2024-09-13T17:05:51.882 INFO:tasks.workunit.client.0.smithi115.stdout:9/303: rename d0/c2f to d0/de/d37/c6a 0 2024-09-13T17:05:51.882 INFO:tasks.workunit.client.0.smithi115.stdout:4/559: dread d7/dd/de/f3a [0,4194304] 0 2024-09-13T17:05:51.883 INFO:tasks.workunit.client.1.smithi195.stdout:0/568: mkdir d7/d87/d9b/d56/d4d/d5e/dbb 0 2024-09-13T17:05:51.883 INFO:tasks.workunit.client.1.smithi195.stdout:0/569: chown d7/d50/f21 6 1 2024-09-13T17:05:51.886 INFO:tasks.workunit.client.0.smithi115.stdout:1/394: unlink d5/d60/d7d/d87/c8a 0 2024-09-13T17:05:51.886 INFO:tasks.workunit.client.0.smithi115.stdout:1/395: chown d5/d7/d33/d3a/f57 59 1 2024-09-13T17:05:51.886 INFO:tasks.workunit.client.0.smithi115.stdout:1/396: readlink d5/d7/d5c/l69 0 2024-09-13T17:05:51.886 INFO:tasks.workunit.client.0.smithi115.stdout:1/397: truncate d5/d7/d33/d3a/f7a 782476 0 2024-09-13T17:05:51.887 INFO:tasks.workunit.client.0.smithi115.stdout:1/398: fsync d5/d7/d5c/d73/f81 0 2024-09-13T17:05:51.887 INFO:tasks.workunit.client.0.smithi115.stdout:6/397: mkdir d8/d13/d7b 0 2024-09-13T17:05:51.888 INFO:tasks.workunit.client.1.smithi195.stdout:8/633: dwrite d0/d4/f5a [0,4194304] 0 2024-09-13T17:05:51.888 INFO:tasks.workunit.client.1.smithi195.stdout:8/634: fsync d0/d17/f9e 0 2024-09-13T17:05:51.888 INFO:tasks.workunit.client.1.smithi195.stdout:8/635: stat d0/d17/d2f/d7c/f48 0 2024-09-13T17:05:51.890 INFO:tasks.workunit.client.0.smithi115.stdout:5/392: symlink d19/d2b/d32/l81 0 2024-09-13T17:05:51.892 INFO:tasks.workunit.client.0.smithi115.stdout:2/648: rmdir d3/d4d/dd/df/d5b/dc5 0 2024-09-13T17:05:51.895 INFO:tasks.workunit.client.0.smithi115.stdout:0/323: mkdir d9/d1d/d24/d26/d5d 0 2024-09-13T17:05:51.896 INFO:tasks.workunit.client.0.smithi115.stdout:2/649: dread d3/d4d/dd/df/d5c/f7c [0,4194304] 0 2024-09-13T17:05:51.898 INFO:tasks.workunit.client.0.smithi115.stdout:3/655: rename d1/d4b/d1a/f81 to d1/d4b/d1a/d30/fd8 0 2024-09-13T17:05:51.901 INFO:tasks.workunit.client.0.smithi115.stdout:4/560: mknod d7/dd/d3c/d74/d8b/caa 0 2024-09-13T17:05:51.901 INFO:tasks.workunit.client.0.smithi115.stdout:4/561: write d7/dd/f25 [1041372,15516] 0 2024-09-13T17:05:51.904 INFO:tasks.workunit.client.0.smithi115.stdout:1/399: symlink d5/d3e/l8f 0 2024-09-13T17:05:51.906 INFO:tasks.workunit.client.0.smithi115.stdout:2/650: write d3/d4d/de/f37 [640387,96256] 0 2024-09-13T17:05:51.906 INFO:tasks.workunit.client.1.smithi195.stdout:7/634: mknod d5/d13/d30/cde 0 2024-09-13T17:05:51.906 INFO:tasks.workunit.client.1.smithi195.stdout:7/635: fsync d5/db/d50/daa/fdd 0 2024-09-13T17:05:51.907 INFO:tasks.workunit.client.0.smithi115.stdout:6/398: truncate d8/db/d1d/f26 3173523 0 2024-09-13T17:05:51.907 INFO:tasks.workunit.client.0.smithi115.stdout:6/399: dread - d8/f76 zero size 2024-09-13T17:05:51.907 INFO:tasks.workunit.client.0.smithi115.stdout:6/400: creat d8/d33/f7c x:0 0 0 2024-09-13T17:05:51.909 INFO:tasks.workunit.client.1.smithi195.stdout:3/579: truncate d7/d21/d2a/d35/f37 216319 0 2024-09-13T17:05:51.910 INFO:tasks.workunit.client.0.smithi115.stdout:9/304: getdents d0/d21/d4f 0 2024-09-13T17:05:51.910 INFO:tasks.workunit.client.0.smithi115.stdout:9/305: chown d0/l57 11153941 1 2024-09-13T17:05:51.910 INFO:tasks.workunit.client.0.smithi115.stdout:9/306: truncate d0/de/d10/d15/f3a 480349 0 2024-09-13T17:05:51.912 INFO:tasks.workunit.client.1.smithi195.stdout:2/598: mknod d0/d4a/d47/d73/d75/d7e/cc3 0 2024-09-13T17:05:51.914 INFO:tasks.workunit.client.0.smithi115.stdout:3/656: dread d1/d4b/f2b [0,4194304] 0 2024-09-13T17:05:51.914 INFO:tasks.workunit.client.0.smithi115.stdout:3/657: chown d1/d12/fbd 3376436 1 2024-09-13T17:05:51.916 INFO:tasks.workunit.client.0.smithi115.stdout:1/400: write d5/f6 [1646329,55514] 0 2024-09-13T17:05:51.919 INFO:tasks.workunit.client.1.smithi195.stdout:4/687: mknod d1a/d1f/d21/d84/ce0 0 2024-09-13T17:05:51.920 INFO:tasks.workunit.client.0.smithi115.stdout:4/562: write d7/dd/de/f5c [2112765,30602] 0 2024-09-13T17:05:51.921 INFO:tasks.workunit.client.0.smithi115.stdout:4/563: write d7/f31 [3344146,118413] 0 2024-09-13T17:05:51.921 INFO:tasks.workunit.client.1.smithi195.stdout:4/688: dread fd [0,4194304] 0 2024-09-13T17:05:51.921 INFO:tasks.workunit.client.0.smithi115.stdout:5/393: dwrite d19/d2e/f5c [0,4194304] 0 2024-09-13T17:05:51.922 INFO:tasks.workunit.client.0.smithi115.stdout:3/658: dread d1/d4b/d1a/d6e/fc4 [0,4194304] 0 2024-09-13T17:05:51.925 INFO:tasks.workunit.client.0.smithi115.stdout:2/651: mkdir d3/d4d/d13/d1c/dc8 0 2024-09-13T17:05:51.925 INFO:tasks.workunit.client.0.smithi115.stdout:6/401: unlink d8/d13/d15/d24/d53/f54 0 2024-09-13T17:05:51.926 INFO:tasks.workunit.client.1.smithi195.stdout:9/662: mkdir d6/d12/d86/dd2/de1 0 2024-09-13T17:05:51.931 INFO:tasks.workunit.client.0.smithi115.stdout:4/564: unlink d7/dd/f32 0 2024-09-13T17:05:51.932 INFO:tasks.workunit.client.1.smithi195.stdout:0/570: getdents d7/d50/da1 0 2024-09-13T17:05:51.935 INFO:tasks.workunit.client.1.smithi195.stdout:8/636: creat d0/d17/d2f/d7c/d4c/d9a/da5/fd8 x:0 0 0 2024-09-13T17:05:51.935 INFO:tasks.workunit.client.1.smithi195.stdout:8/637: truncate d0/d62/f98 653419 0 2024-09-13T17:05:51.935 INFO:tasks.workunit.client.1.smithi195.stdout:5/569: sync 2024-09-13T17:05:51.935 INFO:tasks.workunit.client.1.smithi195.stdout:5/570: creat d2/fc4 x:0 0 0 2024-09-13T17:05:51.937 INFO:tasks.workunit.client.0.smithi115.stdout:3/659: unlink d1/d4b/f1b 0 2024-09-13T17:05:51.940 INFO:tasks.workunit.client.0.smithi115.stdout:2/652: creat d3/d4d/dd/d1f/fc9 x:0 0 0 2024-09-13T17:05:51.942 INFO:tasks.workunit.client.0.smithi115.stdout:6/402: unlink d8/db/d49/f78 0 2024-09-13T17:05:51.942 INFO:tasks.workunit.client.0.smithi115.stdout:6/403: stat d8/d13/d15/d24/c23 0 2024-09-13T17:05:51.942 INFO:tasks.workunit.client.0.smithi115.stdout:6/404: rename d8/d13 to d8/d13/d7d 22 2024-09-13T17:05:51.943 INFO:tasks.workunit.client.1.smithi195.stdout:7/636: rename d5/db/d19/d22/d90/ccf to d5/db/d50/d7f/d82/da1/cdf 0 2024-09-13T17:05:51.944 INFO:tasks.workunit.client.0.smithi115.stdout:4/565: mknod d7/dd/de/d4e/d5a/d4f/d70/cab 0 2024-09-13T17:05:51.945 INFO:tasks.workunit.client.1.smithi195.stdout:2/599: mknod d0/d4a/d47/d73/d75/d88/d2c/d43/d63/db2/cc4 0 2024-09-13T17:05:51.945 INFO:tasks.workunit.client.1.smithi195.stdout:2/600: write d0/d4a/d47/d73/d75/d88/d2c/d51/f42 [2036173,116100] 0 2024-09-13T17:05:51.946 INFO:tasks.workunit.client.0.smithi115.stdout:2/653: truncate d3/d4d/d13/f51 60163 0 2024-09-13T17:05:51.947 INFO:tasks.workunit.client.1.smithi195.stdout:4/689: symlink d1a/d1f/d43/d5a/d63/db8/db9/le1 0 2024-09-13T17:05:51.947 INFO:tasks.workunit.client.1.smithi195.stdout:4/690: write d1a/d1f/d21/d36/fc9 [576996,17599] 0 2024-09-13T17:05:51.947 INFO:tasks.workunit.client.1.smithi195.stdout:4/691: fdatasync d1a/d1f/f87 0 2024-09-13T17:05:51.947 INFO:tasks.workunit.client.0.smithi115.stdout:4/566: rmdir d7/d86 39 2024-09-13T17:05:51.948 INFO:tasks.workunit.client.1.smithi195.stdout:9/663: unlink d6/d19/d21/d5b/f6f 0 2024-09-13T17:05:51.949 INFO:tasks.workunit.client.1.smithi195.stdout:9/664: write d6/d12/d86/f96 [1488707,39073] 0 2024-09-13T17:05:51.950 INFO:tasks.workunit.client.0.smithi115.stdout:2/654: creat d3/d4d/dd/fca x:0 0 0 2024-09-13T17:05:51.950 INFO:tasks.workunit.client.0.smithi115.stdout:2/655: chown d3/d4d/de/d99/fb1 1514965 1 2024-09-13T17:05:51.950 INFO:tasks.workunit.client.0.smithi115.stdout:2/656: stat d3/d4d/de/d99/fb1 0 2024-09-13T17:05:51.951 INFO:tasks.workunit.client.1.smithi195.stdout:0/571: rename d7/d87/d9b/d56/c2a to d7/d50/da1/cbc 0 2024-09-13T17:05:51.952 INFO:tasks.workunit.client.0.smithi115.stdout:6/405: write d8/d13/d15/d24/f1e [3160327,34471] 0 2024-09-13T17:05:51.952 INFO:tasks.workunit.client.0.smithi115.stdout:6/406: chown d8/d33/d3f/l64 9687 1 2024-09-13T17:05:51.952 INFO:tasks.workunit.client.0.smithi115.stdout:6/407: write d8/d33/d40/f5c [908490,106703] 0 2024-09-13T17:05:51.953 INFO:tasks.workunit.client.1.smithi195.stdout:7/637: getdents d5/db/d50/d7f/d82/dad 0 2024-09-13T17:05:51.953 INFO:tasks.workunit.client.1.smithi195.stdout:7/638: write d5/db/d19/d22/fb5 [720940,11785] 0 2024-09-13T17:05:51.953 INFO:tasks.workunit.client.0.smithi115.stdout:2/657: rename d3/d4d/de/d3a/f6d to d3/d4d/de/d99/fcb 0 2024-09-13T17:05:51.955 INFO:tasks.workunit.client.1.smithi195.stdout:2/601: unlink d0/d4a/l5a 0 2024-09-13T17:05:51.956 INFO:tasks.workunit.client.0.smithi115.stdout:6/408: getdents d8/db/d1d 0 2024-09-13T17:05:51.957 INFO:tasks.workunit.client.1.smithi195.stdout:4/692: creat d1a/d1f/fe2 x:0 0 0 2024-09-13T17:05:51.958 INFO:tasks.workunit.client.1.smithi195.stdout:9/665: dread d6/d19/d21/d5b/f5f [0,4194304] 0 2024-09-13T17:05:51.958 INFO:tasks.workunit.client.1.smithi195.stdout:4/693: readlink d1a/l3c 0 2024-09-13T17:05:51.958 INFO:tasks.workunit.client.1.smithi195.stdout:4/694: chown d1a/d1f/d21/d84/d9d/d58 3886 1 2024-09-13T17:05:51.958 INFO:tasks.workunit.client.1.smithi195.stdout:5/571: getdents d2/d12/d3f 0 2024-09-13T17:05:51.958 INFO:tasks.workunit.client.1.smithi195.stdout:5/572: fsync d2/df/fa 0 2024-09-13T17:05:51.958 INFO:tasks.workunit.client.1.smithi195.stdout:5/573: dread - d2/df/d78/d54/d58/f85 zero size 2024-09-13T17:05:51.958 INFO:tasks.workunit.client.1.smithi195.stdout:8/638: rename d0/d13/c21 to d0/d13/d52/d55/cd9 0 2024-09-13T17:05:51.959 INFO:tasks.workunit.client.0.smithi115.stdout:6/409: creat d8/db/f7e x:0 0 0 2024-09-13T17:05:51.961 INFO:tasks.workunit.client.1.smithi195.stdout:0/572: truncate d7/db/f7a 3643966 0 2024-09-13T17:05:51.961 INFO:tasks.workunit.client.1.smithi195.stdout:0/573: readlink d7/db/d11/l97 0 2024-09-13T17:05:51.961 INFO:tasks.workunit.client.1.smithi195.stdout:0/574: chown d7/db/d38/d5d/lb8 8165959 1 2024-09-13T17:05:51.962 INFO:tasks.workunit.client.1.smithi195.stdout:9/666: dread d6/df/d16/d5c/f7a [0,4194304] 0 2024-09-13T17:05:51.962 INFO:tasks.workunit.client.0.smithi115.stdout:6/410: mkdir d8/d33/d7f 0 2024-09-13T17:05:51.962 INFO:tasks.workunit.client.0.smithi115.stdout:6/411: stat d8/db/d1d/f3d 0 2024-09-13T17:05:51.962 INFO:tasks.workunit.client.0.smithi115.stdout:6/412: dread - d8/d13/f4e zero size 2024-09-13T17:05:51.963 INFO:tasks.workunit.client.0.smithi115.stdout:1/401: dwrite d5/d26/f4d [0,4194304] 0 2024-09-13T17:05:51.964 INFO:tasks.workunit.client.1.smithi195.stdout:7/639: creat d5/d13/fe0 x:0 0 0 2024-09-13T17:05:51.964 INFO:tasks.workunit.client.1.smithi195.stdout:5/574: truncate d2/d12/d4e/d10/d5c/f87 42160 0 2024-09-13T17:05:51.964 INFO:tasks.workunit.client.1.smithi195.stdout:3/580: dwrite d7/f2d [0,4194304] 0 2024-09-13T17:05:51.964 INFO:tasks.workunit.client.0.smithi115.stdout:6/413: mkdir d8/d33/d3f/d80 0 2024-09-13T17:05:51.964 INFO:tasks.workunit.client.0.smithi115.stdout:9/307: dwrite d0/d21/d42/f52 [0,4194304] 0 2024-09-13T17:05:51.965 INFO:tasks.workunit.client.0.smithi115.stdout:5/394: dwrite d19/d2b/d32/d55/f57 [0,4194304] 0 2024-09-13T17:05:51.966 INFO:tasks.workunit.client.1.smithi195.stdout:0/575: truncate d7/d87/d9b/d56/d4d/d5e/f70 3169259 0 2024-09-13T17:05:51.966 INFO:tasks.workunit.client.1.smithi195.stdout:0/576: readlink d7/d87/d9b/d56/d46/l19 0 2024-09-13T17:05:51.966 INFO:tasks.workunit.client.1.smithi195.stdout:0/577: chown d7/d50/da1/cbc 1661 1 2024-09-13T17:05:51.968 INFO:tasks.workunit.client.1.smithi195.stdout:9/667: mkdir d6/d19/d21/d64/d68/de2 0 2024-09-13T17:05:51.969 INFO:tasks.workunit.client.1.smithi195.stdout:9/668: chown d6/f18 520819312 1 2024-09-13T17:05:51.969 INFO:tasks.workunit.client.1.smithi195.stdout:2/602: write d0/d3/f4 [1812198,124984] 0 2024-09-13T17:05:51.970 INFO:tasks.workunit.client.1.smithi195.stdout:4/695: dread d1a/d1f/d43/d24/f7d [0,4194304] 0 2024-09-13T17:05:51.972 INFO:tasks.workunit.client.1.smithi195.stdout:7/640: creat d5/db/d19/d22/d90/fe1 x:0 0 0 2024-09-13T17:05:51.973 INFO:tasks.workunit.client.1.smithi195.stdout:7/641: dread - d5/db/d19/fc9 zero size 2024-09-13T17:05:51.974 INFO:tasks.workunit.client.0.smithi115.stdout:2/658: dwrite d3/d4d/dd/d1f/fc9 [0,4194304] 0 2024-09-13T17:05:51.976 INFO:tasks.workunit.client.0.smithi115.stdout:6/414: rename d8/db/ff to d8/d13/d15/d24/f81 0 2024-09-13T17:05:51.978 INFO:tasks.workunit.client.0.smithi115.stdout:4/567: dwrite d7/dd/de/f43 [0,4194304] 0 2024-09-13T17:05:51.980 INFO:tasks.workunit.client.0.smithi115.stdout:9/308: unlink d0/f66 0 2024-09-13T17:05:51.981 INFO:tasks.workunit.client.0.smithi115.stdout:9/309: fsync d0/de/f1e 0 2024-09-13T17:05:51.981 INFO:tasks.workunit.client.0.smithi115.stdout:9/310: dread - d0/f3f zero size 2024-09-13T17:05:51.981 INFO:tasks.workunit.client.1.smithi195.stdout:0/578: mkdir d7/d50/da2/dbd 0 2024-09-13T17:05:51.984 INFO:tasks.workunit.client.1.smithi195.stdout:2/603: mkdir d0/d4a/d47/d73/d75/d88/d62/dc5 0 2024-09-13T17:05:51.984 INFO:tasks.workunit.client.0.smithi115.stdout:1/402: symlink d5/d7/l90 0 2024-09-13T17:05:51.987 INFO:tasks.workunit.client.1.smithi195.stdout:5/575: dread d2/d12/d4e/d10/f66 [4194304,4194304] 0 2024-09-13T17:05:51.987 INFO:tasks.workunit.client.1.smithi195.stdout:5/576: chown d2/d12/d4e/d10/c63 1798 1 2024-09-13T17:05:51.988 INFO:tasks.workunit.client.1.smithi195.stdout:4/696: rename d1a/d1f/d43/c7a to d1a/d1f/d21/d84/d9d/d8e/d9f/db2/ce3 0 2024-09-13T17:05:51.988 INFO:tasks.workunit.client.1.smithi195.stdout:6/533: sync 2024-09-13T17:05:51.988 INFO:tasks.workunit.client.1.smithi195.stdout:1/546: sync 2024-09-13T17:05:51.988 INFO:tasks.workunit.client.1.smithi195.stdout:1/547: creat db/df/d4d/d74/da8/fbc x:0 0 0 2024-09-13T17:05:51.988 INFO:tasks.workunit.client.1.smithi195.stdout:1/548: fdatasync db/df/d51/f53 0 2024-09-13T17:05:51.990 INFO:tasks.workunit.client.0.smithi115.stdout:9/311: write d0/de/d10/d15/f3b [193477,8867] 0 2024-09-13T17:05:51.990 INFO:tasks.workunit.client.0.smithi115.stdout:9/312: creat d0/de/d37/f6b x:0 0 0 2024-09-13T17:05:51.990 INFO:tasks.workunit.client.0.smithi115.stdout:9/313: chown d0/l57 44 1 2024-09-13T17:05:51.995 INFO:tasks.workunit.client.1.smithi195.stdout:3/581: symlink d7/lae 0 2024-09-13T17:05:51.999 INFO:tasks.workunit.client.0.smithi115.stdout:5/395: dwrite d19/d1d/f26 [0,4194304] 0 2024-09-13T17:05:52.002 INFO:tasks.workunit.client.0.smithi115.stdout:2/659: dwrite d3/d4d/dd/f96 [0,4194304] 0 2024-09-13T17:05:52.002 INFO:tasks.workunit.client.0.smithi115.stdout:4/568: link d7/dd/f81 d7/dd/de/fac 0 2024-09-13T17:05:52.008 INFO:tasks.workunit.client.1.smithi195.stdout:6/534: dwrite d1c/f67 [0,4194304] 0 2024-09-13T17:05:52.008 INFO:tasks.workunit.client.1.smithi195.stdout:6/535: truncate d1c/d24/d49/d5f/d85/f9e 1000507 0 2024-09-13T17:05:52.008 INFO:tasks.workunit.client.1.smithi195.stdout:9/669: dwrite d6/df/d16/d5c/fdf [0,4194304] 0 2024-09-13T17:05:52.008 INFO:tasks.workunit.client.1.smithi195.stdout:0/579: mknod d7/d88/d23/cbe 0 2024-09-13T17:05:52.009 INFO:tasks.workunit.client.1.smithi195.stdout:0/580: readlink d7/db/d11/l33 0 2024-09-13T17:05:52.009 INFO:tasks.workunit.client.0.smithi115.stdout:1/403: getdents d5/d60/d7d 0 2024-09-13T17:05:52.009 INFO:tasks.workunit.client.0.smithi115.stdout:1/404: truncate d5/d26/f63 113355 0 2024-09-13T17:05:52.009 INFO:tasks.workunit.client.0.smithi115.stdout:1/405: truncate d5/d26/d2c/f39 1416651 0 2024-09-13T17:05:52.009 INFO:tasks.workunit.client.1.smithi195.stdout:5/577: truncate d2/d12/d4e/d10/f23 660484 0 2024-09-13T17:05:52.010 INFO:tasks.workunit.client.0.smithi115.stdout:9/314: mknod d0/d21/c6c 0 2024-09-13T17:05:52.011 INFO:tasks.workunit.client.1.smithi195.stdout:4/697: unlink d1a/d1f/d21/d84/d9d/d8e/d9f/db2/lca 0 2024-09-13T17:05:52.012 INFO:tasks.workunit.client.1.smithi195.stdout:4/698: creat d1a/d1f/fe4 x:0 0 0 2024-09-13T17:05:52.014 INFO:tasks.workunit.client.1.smithi195.stdout:6/536: write d1c/f63 [2138546,3603] 0 2024-09-13T17:05:52.014 INFO:tasks.workunit.client.1.smithi195.stdout:6/537: creat d1c/d2d/d5e/fb5 x:0 0 0 2024-09-13T17:05:52.014 INFO:tasks.workunit.client.1.smithi195.stdout:6/538: write d1c/f6c [1034423,68452] 0 2024-09-13T17:05:52.016 INFO:tasks.workunit.client.1.smithi195.stdout:1/549: link db/df/d4d/fb3 db/df/d4d/d74/fbd 0 2024-09-13T17:05:52.016 INFO:tasks.workunit.client.1.smithi195.stdout:1/550: chown db/df/d13/da7/fb7 137747 1 2024-09-13T17:05:52.017 INFO:tasks.workunit.client.0.smithi115.stdout:5/396: dwrite f14 [4194304,4194304] 0 2024-09-13T17:05:52.017 INFO:tasks.workunit.client.0.smithi115.stdout:5/397: readlink d19/d2b/d32/d55/d5e/l51 0 2024-09-13T17:05:52.017 INFO:tasks.workunit.client.0.smithi115.stdout:5/398: write d19/f1e [4824601,129793] 0 2024-09-13T17:05:52.017 INFO:tasks.workunit.client.0.smithi115.stdout:5/399: creat d19/d21/d3a/f82 x:0 0 0 2024-09-13T17:05:52.018 INFO:tasks.workunit.client.1.smithi195.stdout:3/582: symlink d7/d19/d1e/laf 0 2024-09-13T17:05:52.019 INFO:tasks.workunit.client.1.smithi195.stdout:3/583: truncate d7/f77 385550 0 2024-09-13T17:05:52.028 INFO:tasks.workunit.client.1.smithi195.stdout:1/551: read db/df/f20 [1758549,89591] 0 2024-09-13T17:05:52.029 INFO:tasks.workunit.client.0.smithi115.stdout:4/569: symlink d7/d86/lad 0 2024-09-13T17:05:52.029 INFO:tasks.workunit.client.0.smithi115.stdout:4/570: dread - d7/dd/de/d4e/d5a/f56 zero size 2024-09-13T17:05:52.030 INFO:tasks.workunit.client.1.smithi195.stdout:4/699: dwrite d1a/d1f/d21/d84/d9d/d8e/d9f/fd5 [0,4194304] 0 2024-09-13T17:05:52.032 INFO:tasks.workunit.client.1.smithi195.stdout:2/604: mkdir d0/d3/d3d/dc6 0 2024-09-13T17:05:52.035 INFO:tasks.workunit.client.1.smithi195.stdout:5/578: mkdir d2/df/d48/d5a/dc5 0 2024-09-13T17:05:52.035 INFO:tasks.workunit.client.1.smithi195.stdout:5/579: write d2/df/fa [3501092,71196] 0 2024-09-13T17:05:52.035 INFO:tasks.workunit.client.1.smithi195.stdout:5/580: write d2/f26 [2509491,41618] 0 2024-09-13T17:05:52.035 INFO:tasks.workunit.client.1.smithi195.stdout:5/581: truncate d2/d12/d3f/fbd 8452 0 2024-09-13T17:05:52.040 INFO:tasks.workunit.client.1.smithi195.stdout:4/700: read d1a/d1f/d9c/fd0 [603213,68368] 0 2024-09-13T17:05:52.041 INFO:tasks.workunit.client.1.smithi195.stdout:1/552: rmdir db/d19/d37/d46/d7e 39 2024-09-13T17:05:52.053 INFO:tasks.workunit.client.0.smithi115.stdout:1/406: symlink d5/d60/d7d/d87/l91 0 2024-09-13T17:05:52.053 INFO:tasks.workunit.client.0.smithi115.stdout:1/407: write d5/d7/d33/d3a/f7a [778418,31012] 0 2024-09-13T17:05:52.054 INFO:tasks.workunit.client.0.smithi115.stdout:1/408: dread - d5/d3e/d59/f8b zero size 2024-09-13T17:05:52.054 INFO:tasks.workunit.client.0.smithi115.stdout:1/409: read d5/d26/d2c/d62/f7f [189638,65110] 0 2024-09-13T17:05:52.055 INFO:tasks.workunit.client.0.smithi115.stdout:9/315: mknod d0/d21/d42/c6d 0 2024-09-13T17:05:52.056 INFO:tasks.workunit.client.1.smithi195.stdout:2/605: creat d0/d4a/d47/d73/d75/d88/d2c/d43/d84/dac/fc7 x:0 0 0 2024-09-13T17:05:52.057 INFO:tasks.workunit.client.0.smithi115.stdout:1/410: dread d5/d26/f29 [0,4194304] 0 2024-09-13T17:05:52.062 INFO:tasks.workunit.client.1.smithi195.stdout:5/582: unlink d2/cad 0 2024-09-13T17:05:52.062 INFO:tasks.workunit.client.1.smithi195.stdout:5/583: write d2/d12/d4e/d10/f23 [941470,75302] 0 2024-09-13T17:05:52.064 INFO:tasks.workunit.client.1.smithi195.stdout:4/701: mknod d1a/d1f/d21/d22/d98/da3/ce5 0 2024-09-13T17:05:52.064 INFO:tasks.workunit.client.1.smithi195.stdout:2/606: dread d0/d3/df/f35 [0,4194304] 0 2024-09-13T17:05:52.065 INFO:tasks.workunit.client.0.smithi115.stdout:5/400: mkdir d19/d2b/d83 0 2024-09-13T17:05:52.066 INFO:tasks.workunit.client.1.smithi195.stdout:1/553: symlink db/d58/dae/lbe 0 2024-09-13T17:05:52.067 INFO:tasks.workunit.client.0.smithi115.stdout:6/415: rename d8/d33/d3f to d8/d33/d82 0 2024-09-13T17:05:52.069 INFO:tasks.workunit.client.1.smithi195.stdout:9/670: rename d6/d19/d21/d64 to d6/df/d16/de3 0 2024-09-13T17:05:52.071 INFO:tasks.workunit.client.0.smithi115.stdout:2/660: rmdir d3/d4d/de/d99 39 2024-09-13T17:05:52.073 INFO:tasks.workunit.client.0.smithi115.stdout:4/571: mkdir d7/dd/de/d4e/dae 0 2024-09-13T17:05:52.073 INFO:tasks.workunit.client.1.smithi195.stdout:1/554: write db/df/d13/f1e [1388704,31355] 0 2024-09-13T17:05:52.074 INFO:tasks.workunit.client.1.smithi195.stdout:9/671: dread d6/df/f3c [0,4194304] 0 2024-09-13T17:05:52.074 INFO:tasks.workunit.client.0.smithi115.stdout:9/316: dwrite d0/de/d37/f5d [0,4194304] 0 2024-09-13T17:05:52.079 INFO:tasks.workunit.client.1.smithi195.stdout:5/584: unlink d2/df/d86/f7f 0 2024-09-13T17:05:52.080 INFO:tasks.workunit.client.1.smithi195.stdout:4/702: symlink d1a/d1f/d21/d84/d9d/d8e/d9f/le6 0 2024-09-13T17:05:52.081 INFO:tasks.workunit.client.1.smithi195.stdout:4/703: truncate d1a/d1f/fe2 985412 0 2024-09-13T17:05:52.081 INFO:tasks.workunit.client.0.smithi115.stdout:5/401: truncate d19/d2b/f44 2378955 0 2024-09-13T17:05:52.081 INFO:tasks.workunit.client.0.smithi115.stdout:5/402: chown d19/d75/f7b 118632091 1 2024-09-13T17:05:52.082 INFO:tasks.workunit.client.1.smithi195.stdout:2/607: mknod d0/d4a/d47/cc8 0 2024-09-13T17:05:52.082 INFO:tasks.workunit.client.1.smithi195.stdout:2/608: fdatasync d0/d3/f5c 0 2024-09-13T17:05:52.083 INFO:tasks.workunit.client.1.smithi195.stdout:2/609: chown d0/d4a/d47/d73/d75/d88/d62/dc5 858932 1 2024-09-13T17:05:52.083 INFO:tasks.workunit.client.0.smithi115.stdout:9/317: dread d0/f16 [0,4194304] 0 2024-09-13T17:05:52.083 INFO:tasks.workunit.client.0.smithi115.stdout:6/416: symlink d8/d33/d82/l83 0 2024-09-13T17:05:52.083 INFO:tasks.workunit.client.0.smithi115.stdout:6/417: fdatasync d8/db/d1d/f2b 0 2024-09-13T17:05:52.083 INFO:tasks.workunit.client.0.smithi115.stdout:6/418: dread - d8/db/f6f zero size 2024-09-13T17:05:52.086 INFO:tasks.workunit.client.1.smithi195.stdout:0/581: rename d7/db/d38/d5d/lb8 to d7/d87/d9b/d56/lbf 0 2024-09-13T17:05:52.086 INFO:tasks.workunit.client.1.smithi195.stdout:0/582: dread - d7/d50/f4c zero size 2024-09-13T17:05:52.086 INFO:tasks.workunit.client.0.smithi115.stdout:4/572: write d7/f30 [436171,116051] 0 2024-09-13T17:05:52.087 INFO:tasks.workunit.client.0.smithi115.stdout:2/661: creat d3/d4d/dd/df/d57/d8b/fcc x:0 0 0 2024-09-13T17:05:52.087 INFO:tasks.workunit.client.1.smithi195.stdout:4/704: dread d1a/d1f/d43/d24/d41/f8d [0,4194304] 0 2024-09-13T17:05:52.093 INFO:tasks.workunit.client.0.smithi115.stdout:5/403: link d19/d1d/f2f d19/d2e/f84 0 2024-09-13T17:05:52.094 INFO:tasks.workunit.client.0.smithi115.stdout:5/404: write d19/d21/f80 [998101,126528] 0 2024-09-13T17:05:52.094 INFO:tasks.workunit.client.0.smithi115.stdout:5/405: chown d19/d1d/f20 118450 1 2024-09-13T17:05:52.098 INFO:tasks.workunit.client.1.smithi195.stdout:5/585: creat d2/df/d48/d5a/dc5/fc6 x:0 0 0 2024-09-13T17:05:52.099 INFO:tasks.workunit.client.0.smithi115.stdout:6/419: link d8/d13/d15/c2e d8/d13/d7b/c84 0 2024-09-13T17:05:52.102 INFO:tasks.workunit.client.1.smithi195.stdout:6/539: rename d1c/l7c to d1c/d24/d49/d5f/db1/d95/lb6 0 2024-09-13T17:05:52.103 INFO:tasks.workunit.client.0.smithi115.stdout:4/573: symlink d7/dd/d3c/d7b/d97/laf 0 2024-09-13T17:05:52.104 INFO:tasks.workunit.client.1.smithi195.stdout:4/705: creat d1a/d1f/d21/ddd/fe7 x:0 0 0 2024-09-13T17:05:52.104 INFO:tasks.workunit.client.1.smithi195.stdout:4/706: stat d1a/d1f/d21/d36/f7c 0 2024-09-13T17:05:52.104 INFO:tasks.workunit.client.1.smithi195.stdout:4/707: readlink d1a/d1f/d43/l6b 0 2024-09-13T17:05:52.105 INFO:tasks.workunit.client.1.smithi195.stdout:4/708: stat d1a/d1f/c39 0 2024-09-13T17:05:52.105 INFO:tasks.workunit.client.0.smithi115.stdout:5/406: getdents d19/d21/d62/d63 0 2024-09-13T17:05:52.105 INFO:tasks.workunit.client.0.smithi115.stdout:5/407: fsync d19/d2b/f49 0 2024-09-13T17:05:52.105 INFO:tasks.workunit.client.1.smithi195.stdout:9/672: getdents d6/d12/d86/dd2 0 2024-09-13T17:05:52.106 INFO:tasks.workunit.client.0.smithi115.stdout:9/318: symlink d0/l6e 0 2024-09-13T17:05:52.107 INFO:tasks.workunit.client.1.smithi195.stdout:2/610: getdents d0/d4a/d47/d73/d75/d88/d62 0 2024-09-13T17:05:52.107 INFO:tasks.workunit.client.1.smithi195.stdout:2/611: chown d0/d3/ca6 0 1 2024-09-13T17:05:52.107 INFO:tasks.workunit.client.1.smithi195.stdout:2/612: write d0/d4a/d47/d73/d75/d88/d62/fb1 [316855,83818] 0 2024-09-13T17:05:52.109 INFO:tasks.workunit.client.1.smithi195.stdout:5/586: rename d2/df/d90/db2/lb8 to d2/df/lc7 0 2024-09-13T17:05:52.110 INFO:tasks.workunit.client.0.smithi115.stdout:6/420: creat d8/d13/d15/d24/d17/f85 x:0 0 0 2024-09-13T17:05:52.110 INFO:tasks.workunit.client.0.smithi115.stdout:6/421: dread - d8/d33/f7c zero size 2024-09-13T17:05:52.112 INFO:tasks.workunit.client.1.smithi195.stdout:4/709: creat d1a/d1f/d43/d24/d41/fe8 x:0 0 0 2024-09-13T17:05:52.112 INFO:tasks.workunit.client.1.smithi195.stdout:4/710: creat d1a/d1f/d21/ddd/fe9 x:0 0 0 2024-09-13T17:05:52.114 INFO:tasks.workunit.client.0.smithi115.stdout:4/574: mkdir d7/dd/de/d4e/d6c/db0 0 2024-09-13T17:05:52.117 INFO:tasks.workunit.client.1.smithi195.stdout:0/583: dwrite d7/f53 [0,4194304] 0 2024-09-13T17:05:52.117 INFO:tasks.workunit.client.1.smithi195.stdout:0/584: chown d7/db/d38/c3a 0 1 2024-09-13T17:05:52.118 INFO:tasks.workunit.client.1.smithi195.stdout:9/673: creat d6/df/d7b/fe4 x:0 0 0 2024-09-13T17:05:52.118 INFO:tasks.workunit.client.1.smithi195.stdout:9/674: fdatasync d6/d12/d86/da7/dcb/fd8 0 2024-09-13T17:05:52.118 INFO:tasks.workunit.client.0.smithi115.stdout:5/408: read f14 [6726894,32148] 0 2024-09-13T17:05:52.118 INFO:tasks.workunit.client.0.smithi115.stdout:2/662: dwrite d3/d4d/dd/d1f/d2f/d56/f9e [0,4194304] 0 2024-09-13T17:05:52.120 INFO:tasks.workunit.client.0.smithi115.stdout:9/319: mkdir d0/d21/d65/d6f 0 2024-09-13T17:05:52.120 INFO:tasks.workunit.client.0.smithi115.stdout:9/320: stat d0/de/d10/d15/f3b 0 2024-09-13T17:05:52.121 INFO:tasks.workunit.client.0.smithi115.stdout:6/422: dread d8/d13/d15/d24/f1e [0,4194304] 0 2024-09-13T17:05:52.121 INFO:tasks.workunit.client.1.smithi195.stdout:6/540: rename d1c/d2d/d8c/da7/c93 to d1c/d7d/d9c/da9/cb7 0 2024-09-13T17:05:52.121 INFO:tasks.workunit.client.1.smithi195.stdout:8/639: sync 2024-09-13T17:05:52.123 INFO:tasks.workunit.client.1.smithi195.stdout:2/613: write d0/d3/f5c [7261214,69305] 0 2024-09-13T17:05:52.123 INFO:tasks.workunit.client.1.smithi195.stdout:2/614: chown d0/d4a/d47/d73/d75/d88/d2c/d51/c37 291 1 2024-09-13T17:05:52.126 INFO:tasks.workunit.client.1.smithi195.stdout:4/711: truncate d1a/d1f/d21/d84/d9d/d58/f80 491456 0 2024-09-13T17:05:52.126 INFO:tasks.workunit.client.1.smithi195.stdout:9/675: dread d6/d12/d39/fa1 [0,4194304] 0 2024-09-13T17:05:52.126 INFO:tasks.workunit.client.1.smithi195.stdout:4/712: fsync d1a/d1f/fe4 0 2024-09-13T17:05:52.126 INFO:tasks.workunit.client.1.smithi195.stdout:9/676: fdatasync d6/d19/d21/d45/fb6 0 2024-09-13T17:05:52.126 INFO:tasks.workunit.client.1.smithi195.stdout:9/677: fsync d6/d19/d21/f60 0 2024-09-13T17:05:52.126 INFO:tasks.workunit.client.1.smithi195.stdout:9/678: fsync d6/f3f 0 2024-09-13T17:05:52.128 INFO:tasks.workunit.client.0.smithi115.stdout:5/409: mknod d19/d2b/d69/c85 0 2024-09-13T17:05:52.129 INFO:tasks.workunit.client.1.smithi195.stdout:6/541: write d1c/d24/d49/d5f/d35/f39 [3077880,56128] 0 2024-09-13T17:05:52.132 INFO:tasks.workunit.client.1.smithi195.stdout:3/584: sync 2024-09-13T17:05:52.133 INFO:tasks.workunit.client.1.smithi195.stdout:7/642: sync 2024-09-13T17:05:52.133 INFO:tasks.workunit.client.1.smithi195.stdout:7/643: chown d5/db/d19/d22/fb5 21 1 2024-09-13T17:05:52.134 INFO:tasks.workunit.client.1.smithi195.stdout:2/615: chown d0/d4a/d47/d73/d75/d88/d1e/f65 4163611 1 2024-09-13T17:05:52.134 INFO:tasks.workunit.client.1.smithi195.stdout:5/587: dwrite d2/f6a [0,4194304] 0 2024-09-13T17:05:52.136 INFO:tasks.workunit.client.0.smithi115.stdout:6/423: read d8/db/dd/f3a [531599,29870] 0 2024-09-13T17:05:52.136 INFO:tasks.workunit.client.0.smithi115.stdout:6/424: creat d8/d13/d15/d24/f86 x:0 0 0 2024-09-13T17:05:52.136 INFO:tasks.workunit.client.0.smithi115.stdout:6/425: dread - d8/d13/d15/d24/f79 zero size 2024-09-13T17:05:52.136 INFO:tasks.workunit.client.0.smithi115.stdout:6/426: dread - d8/d33/f57 zero size 2024-09-13T17:05:52.136 INFO:tasks.workunit.client.0.smithi115.stdout:6/427: write d8/d13/f4e [611485,60008] 0 2024-09-13T17:05:52.138 INFO:tasks.workunit.client.1.smithi195.stdout:4/713: creat d1a/d1f/d43/d5a/d63/dd1/fea x:0 0 0 2024-09-13T17:05:52.138 INFO:tasks.workunit.client.1.smithi195.stdout:4/714: fsync d1a/d1f/d43/d24/d41/f8d 0 2024-09-13T17:05:52.139 INFO:tasks.workunit.client.0.smithi115.stdout:2/663: mknod d3/d4d/dd/d1f/d2f/da6/ccd 0 2024-09-13T17:05:52.141 INFO:tasks.workunit.client.1.smithi195.stdout:9/679: creat d6/d12/d86/da7/fe5 x:0 0 0 2024-09-13T17:05:52.144 INFO:tasks.workunit.client.0.smithi115.stdout:4/575: rmdir d7/dd/de/d4e/d5a/d4f/d53 39 2024-09-13T17:05:52.146 INFO:tasks.workunit.client.1.smithi195.stdout:3/585: mkdir d7/d21/d2a/d35/d60/db0 0 2024-09-13T17:05:52.146 INFO:tasks.workunit.client.1.smithi195.stdout:0/585: dwrite d7/d87/d9b/d56/d46/f91 [0,4194304] 0 2024-09-13T17:05:52.146 INFO:tasks.workunit.client.1.smithi195.stdout:0/586: truncate d7/db/d38/f57 556280 0 2024-09-13T17:05:52.146 INFO:tasks.workunit.client.1.smithi195.stdout:0/587: getdents d7/d87/d9b/d4e/d86 0 2024-09-13T17:05:52.147 INFO:tasks.workunit.client.1.smithi195.stdout:7/644: creat d5/d35/fe2 x:0 0 0 2024-09-13T17:05:52.148 INFO:tasks.workunit.client.0.smithi115.stdout:9/321: symlink d0/l70 0 2024-09-13T17:05:52.149 INFO:tasks.workunit.client.0.smithi115.stdout:9/322: creat d0/de/d10/f71 x:0 0 0 2024-09-13T17:05:52.149 INFO:tasks.workunit.client.1.smithi195.stdout:2/616: truncate d0/d3/fa8 344976 0 2024-09-13T17:05:52.150 INFO:tasks.workunit.client.1.smithi195.stdout:7/645: dread d5/db/d19/f18 [0,4194304] 0 2024-09-13T17:05:52.150 INFO:tasks.workunit.client.1.smithi195.stdout:7/646: stat d5/d35/dd2 0 2024-09-13T17:05:52.150 INFO:tasks.workunit.client.0.smithi115.stdout:4/576: creat d7/dd/de/d4e/d9f/fb1 x:0 0 0 2024-09-13T17:05:52.152 INFO:tasks.workunit.client.1.smithi195.stdout:5/588: mkdir d2/d12/d3f/d7b/dc8 0 2024-09-13T17:05:52.152 INFO:tasks.workunit.client.0.smithi115.stdout:5/410: dwrite f16 [0,4194304] 0 2024-09-13T17:05:52.153 INFO:tasks.workunit.client.0.smithi115.stdout:5/411: readlink d19/d2c/l7c 0 2024-09-13T17:05:52.153 INFO:tasks.workunit.client.0.smithi115.stdout:5/412: write f3 [1473602,78452] 0 2024-09-13T17:05:52.153 INFO:tasks.workunit.client.0.smithi115.stdout:5/413: write d19/d2b/f6a [1337656,2931] 0 2024-09-13T17:05:52.153 INFO:tasks.workunit.client.0.smithi115.stdout:6/428: dwrite d8/d13/d15/d24/f5f [0,4194304] 0 2024-09-13T17:05:52.153 INFO:tasks.workunit.client.0.smithi115.stdout:6/429: chown d8/db/l2a 41 1 2024-09-13T17:05:52.154 INFO:tasks.workunit.client.1.smithi195.stdout:4/715: link d1a/d1f/d43/d5a/f81 d1a/d1f/d21/d84/d9d/d8e/d9f/db2/feb 0 2024-09-13T17:05:52.154 INFO:tasks.workunit.client.1.smithi195.stdout:4/716: creat d1a/d1f/d43/d5a/d63/fec x:0 0 0 2024-09-13T17:05:52.156 INFO:tasks.workunit.client.0.smithi115.stdout:4/577: mknod d7/dd/d3c/d74/d8b/cb2 0 2024-09-13T17:05:52.156 INFO:tasks.workunit.client.0.smithi115.stdout:4/578: stat d7/f12 0 2024-09-13T17:05:52.156 INFO:tasks.workunit.client.1.smithi195.stdout:9/680: creat d6/df/d16/d5c/dcf/dd4/fe6 x:0 0 0 2024-09-13T17:05:52.160 INFO:tasks.workunit.client.1.smithi195.stdout:8/640: rename d0/d17/d2f/d6a to d0/dda 0 2024-09-13T17:05:52.163 INFO:tasks.workunit.client.0.smithi115.stdout:6/430: unlink d8/db/l69 0 2024-09-13T17:05:52.163 INFO:tasks.workunit.client.0.smithi115.stdout:6/431: write d8/db/f7e [117147,15862] 0 2024-09-13T17:05:52.165 INFO:tasks.workunit.client.0.smithi115.stdout:4/579: write d7/dd/de/f59 [1848297,18464] 0 2024-09-13T17:05:52.174 INFO:tasks.workunit.client.0.smithi115.stdout:4/580: dread d7/dd/d63/f99 [0,4194304] 0 2024-09-13T17:05:52.174 INFO:tasks.workunit.client.0.smithi115.stdout:5/414: dwrite f5 [0,4194304] 0 2024-09-13T17:05:52.175 INFO:tasks.workunit.client.1.smithi195.stdout:2/617: symlink d0/d4a/d47/d73/d75/d88/d2c/lc9 0 2024-09-13T17:05:52.176 INFO:tasks.workunit.client.1.smithi195.stdout:7/647: creat d5/db/d19/d22/fe3 x:0 0 0 2024-09-13T17:05:52.176 INFO:tasks.workunit.client.1.smithi195.stdout:7/648: chown d5/db/l1e 782 1 2024-09-13T17:05:52.176 INFO:tasks.workunit.client.0.smithi115.stdout:5/415: dread d19/d2b/d32/f45 [0,4194304] 0 2024-09-13T17:05:52.176 INFO:tasks.workunit.client.0.smithi115.stdout:5/416: fdatasync d19/d2b/f49 0 2024-09-13T17:05:52.176 INFO:tasks.workunit.client.0.smithi115.stdout:5/417: write d19/d2b/d32/d55/f5a [6060490,26730] 0 2024-09-13T17:05:52.177 INFO:tasks.workunit.client.1.smithi195.stdout:5/589: mkdir d2/d12/d4e/d10/d8f/dc9 0 2024-09-13T17:05:52.178 INFO:tasks.workunit.client.0.smithi115.stdout:4/581: mkdir d7/dd/d3c/d72/db3 0 2024-09-13T17:05:52.182 INFO:tasks.workunit.client.1.smithi195.stdout:9/681: mkdir d6/d19/d21/d45/dad/d5e/de7 0 2024-09-13T17:05:52.182 INFO:tasks.workunit.client.1.smithi195.stdout:2/618: dread d0/d3/f26 [0,4194304] 0 2024-09-13T17:05:52.182 INFO:tasks.workunit.client.1.smithi195.stdout:2/619: fdatasync d0/faf 0 2024-09-13T17:05:52.183 INFO:tasks.workunit.client.0.smithi115.stdout:5/418: dread d19/d2e/d6b/f78 [0,4194304] 0 2024-09-13T17:05:52.183 INFO:tasks.workunit.client.0.smithi115.stdout:5/419: fsync f8 0 2024-09-13T17:05:52.183 INFO:tasks.workunit.client.0.smithi115.stdout:5/420: chown d19/l1b 1781 1 2024-09-13T17:05:52.183 INFO:tasks.workunit.client.0.smithi115.stdout:6/432: dwrite d8/db/d1d/f18 [0,4194304] 0 2024-09-13T17:05:52.183 INFO:tasks.workunit.client.0.smithi115.stdout:4/582: symlink d7/dd/de/d4e/d5a/d4f/lb4 0 2024-09-13T17:05:52.183 INFO:tasks.workunit.client.0.smithi115.stdout:4/583: read d7/f30 [1556670,85924] 0 2024-09-13T17:05:52.185 INFO:tasks.workunit.client.1.smithi195.stdout:6/542: rename d1c/l2c to d1c/d7d/d9c/lb8 0 2024-09-13T17:05:52.191 INFO:tasks.workunit.client.1.smithi195.stdout:8/641: link d0/d4/l27 d0/d17/d2f/d7c/d4c/d9b/ldb 0 2024-09-13T17:05:52.194 INFO:tasks.workunit.client.1.smithi195.stdout:7/649: dwrite d5/db/d19/d22/fe3 [0,4194304] 0 2024-09-13T17:05:52.194 INFO:tasks.workunit.client.1.smithi195.stdout:2/620: dread d0/f21 [0,4194304] 0 2024-09-13T17:05:52.194 INFO:tasks.workunit.client.1.smithi195.stdout:7/650: chown d5/d13/d24/fba 87 1 2024-09-13T17:05:52.194 INFO:tasks.workunit.client.1.smithi195.stdout:2/621: fdatasync d0/f54 0 2024-09-13T17:05:52.195 INFO:tasks.workunit.client.1.smithi195.stdout:3/586: rmdir d7/d19/d1e 39 2024-09-13T17:05:52.195 INFO:tasks.workunit.client.1.smithi195.stdout:3/587: chown d7/d21/d2a/d35/fa3 13 1 2024-09-13T17:05:52.197 INFO:tasks.workunit.client.1.smithi195.stdout:5/590: symlink d2/d12/d4e/d10/d5c/lca 0 2024-09-13T17:05:52.199 INFO:tasks.workunit.client.1.smithi195.stdout:4/717: rmdir d1a/d1f/d21/d22 39 2024-09-13T17:05:52.199 INFO:tasks.workunit.client.1.smithi195.stdout:4/718: fsync fd 0 2024-09-13T17:05:52.200 INFO:tasks.workunit.client.1.smithi195.stdout:5/591: dread d2/d12/d4e/f1d [0,4194304] 0 2024-09-13T17:05:52.201 INFO:tasks.workunit.client.1.smithi195.stdout:9/682: creat d6/d12/d86/dd2/fe8 x:0 0 0 2024-09-13T17:05:52.203 INFO:tasks.workunit.client.1.smithi195.stdout:1/555: sync 2024-09-13T17:05:52.203 INFO:tasks.workunit.client.1.smithi195.stdout:1/556: creat db/fbf x:0 0 0 2024-09-13T17:05:52.203 INFO:tasks.workunit.client.1.smithi195.stdout:1/557: write db/df/d4d/d74/da8/fb2 [604476,119717] 0 2024-09-13T17:05:52.204 INFO:tasks.workunit.client.1.smithi195.stdout:7/651: write d5/fa [2109328,115740] 0 2024-09-13T17:05:52.204 INFO:tasks.workunit.client.0.smithi115.stdout:6/433: creat d8/d13/d15/d24/d53/d6a/f87 x:0 0 0 2024-09-13T17:05:52.206 INFO:tasks.workunit.client.1.smithi195.stdout:0/588: rename d7/db/l64 to d7/d87/d9b/lc0 0 2024-09-13T17:05:52.206 INFO:tasks.workunit.client.1.smithi195.stdout:0/589: creat d7/d50/fc1 x:0 0 0 2024-09-13T17:05:52.206 INFO:tasks.workunit.client.1.smithi195.stdout:8/642: rmdir d0/dda 39 2024-09-13T17:05:52.210 INFO:tasks.workunit.client.0.smithi115.stdout:5/421: dwrite d19/d21/f80 [0,4194304] 0 2024-09-13T17:05:52.211 INFO:tasks.workunit.client.0.smithi115.stdout:5/422: chown d19/c61 39618375 1 2024-09-13T17:05:52.213 INFO:tasks.workunit.client.0.smithi115.stdout:4/584: dwrite d7/dd/de/d4e/f6f [0,4194304] 0 2024-09-13T17:05:52.213 INFO:tasks.workunit.client.0.smithi115.stdout:4/585: dread - d7/dd/de/f61 zero size 2024-09-13T17:05:52.213 INFO:tasks.workunit.client.0.smithi115.stdout:4/586: chown d7/dd/de/d4e/d5a 65908184 1 2024-09-13T17:05:52.213 INFO:tasks.workunit.client.0.smithi115.stdout:4/587: creat d7/dd/de/d4e/d5a/d4f/d70/fb5 x:0 0 0 2024-09-13T17:05:52.216 INFO:tasks.workunit.client.1.smithi195.stdout:8/643: dread d0/d17/d49/f50 [0,4194304] 0 2024-09-13T17:05:52.216 INFO:tasks.workunit.client.1.smithi195.stdout:4/719: dread f11 [4194304,4194304] 0 2024-09-13T17:05:52.216 INFO:tasks.workunit.client.1.smithi195.stdout:8/644: read d0/d62/fba [222141,84739] 0 2024-09-13T17:05:52.216 INFO:tasks.workunit.client.1.smithi195.stdout:8/645: truncate d0/d17/d49/d63/fb5 703941 0 2024-09-13T17:05:52.217 INFO:tasks.workunit.client.0.smithi115.stdout:6/434: write d8/db/d1d/f3d [2191454,55172] 0 2024-09-13T17:05:52.309 INFO:tasks.workunit.client.1.smithi195.stdout:3/588: mknod d7/d19/d1e/cb1 0 2024-09-13T17:05:52.309 INFO:tasks.workunit.client.1.smithi195.stdout:3/589: creat d7/d19/fb2 x:0 0 0 2024-09-13T17:05:52.309 INFO:tasks.workunit.client.1.smithi195.stdout:5/592: truncate d2/df/d78/d54/d58/f69 2056159 0 2024-09-13T17:05:52.309 INFO:tasks.workunit.client.1.smithi195.stdout:5/593: write d2/df/d78/d54/d58/f85 [84325,50813] 0 2024-09-13T17:05:52.309 INFO:tasks.workunit.client.1.smithi195.stdout:5/594: write d2/d12/d4e/d10/d46/f96 [1838466,129278] 0 2024-09-13T17:05:52.311 INFO:tasks.workunit.client.1.smithi195.stdout:9/683: truncate d6/df/d16/f74 117333 0 2024-09-13T17:05:52.315 INFO:tasks.workunit.client.0.smithi115.stdout:5/423: mkdir d19/d2b/d83/d86 0 2024-09-13T17:05:52.316 INFO:tasks.workunit.client.1.smithi195.stdout:5/595: dread d2/d3e/f16 [0,4194304] 0 2024-09-13T17:05:52.316 INFO:tasks.workunit.client.1.smithi195.stdout:5/596: truncate d2/df/d48/d5a/dc5/fc6 997416 0 2024-09-13T17:05:52.321 INFO:tasks.workunit.client.0.smithi115.stdout:4/588: unlink d7/dd/de/d4e/d5a/d4f/d9c/la1 0 2024-09-13T17:05:52.321 INFO:tasks.workunit.client.1.smithi195.stdout:9/684: dread d6/df/d13/fd7 [0,4194304] 0 2024-09-13T17:05:52.321 INFO:tasks.workunit.client.1.smithi195.stdout:9/685: read d6/df/d16/d5c/f7a [195476,114595] 0 2024-09-13T17:05:52.322 INFO:tasks.workunit.client.1.smithi195.stdout:9/686: truncate d6/df/d16/de3/d68/fbd 4221265 0 2024-09-13T17:05:52.328 INFO:tasks.workunit.client.1.smithi195.stdout:4/720: symlink d1a/d1f/d43/d5a/d63/led 0 2024-09-13T17:05:52.328 INFO:tasks.workunit.client.1.smithi195.stdout:4/721: readlink d1a/d1f/d43/d24/ldf 0 2024-09-13T17:05:52.329 INFO:tasks.workunit.client.1.smithi195.stdout:8/646: symlink d0/d17/d49/d63/ldc 0 2024-09-13T17:05:52.332 INFO:tasks.workunit.client.0.smithi115.stdout:6/435: getdents d8/d33 0 2024-09-13T17:05:52.333 INFO:tasks.workunit.client.1.smithi195.stdout:5/597: dwrite d2/df/d78/d54/d58/f60 [0,4194304] 0 2024-09-13T17:05:52.336 INFO:tasks.workunit.client.0.smithi115.stdout:6/436: dread d8/d33/d40/f5c [0,4194304] 0 2024-09-13T17:05:52.336 INFO:tasks.workunit.client.0.smithi115.stdout:6/437: chown d8/d13/d15/d24/la 111 1 2024-09-13T17:05:52.338 INFO:tasks.workunit.client.1.smithi195.stdout:3/590: mkdir d7/d21/d2a/d35/d60/d64/db3 0 2024-09-13T17:05:52.342 INFO:tasks.workunit.client.1.smithi195.stdout:9/687: creat d6/d19/d21/d45/dad/d5e/de7/fe9 x:0 0 0 2024-09-13T17:05:52.342 INFO:tasks.workunit.client.1.smithi195.stdout:9/688: chown d6/df/d16/de3/d68/d6d/fa2 0 1 2024-09-13T17:05:52.342 INFO:tasks.workunit.client.1.smithi195.stdout:9/689: write d6/df/d16/de3/d68/d6d/f9e [1361905,119841] 0 2024-09-13T17:05:52.343 INFO:tasks.workunit.client.1.smithi195.stdout:4/722: mkdir d1a/d1f/d9c/dee 0 2024-09-13T17:05:52.344 INFO:tasks.workunit.client.1.smithi195.stdout:8/647: creat d0/d17/d2f/d7c/d4c/d67/fdd x:0 0 0 2024-09-13T17:05:52.347 INFO:tasks.workunit.client.1.smithi195.stdout:5/598: creat d2/df/d90/fcb x:0 0 0 2024-09-13T17:05:52.348 INFO:tasks.workunit.client.0.smithi115.stdout:4/589: dwrite d7/dd/de/f13 [0,4194304] 0 2024-09-13T17:05:52.349 INFO:tasks.workunit.client.1.smithi195.stdout:3/591: symlink d7/d21/lb4 0 2024-09-13T17:05:52.349 INFO:tasks.workunit.client.0.smithi115.stdout:6/438: dread d8/db/d1d/f18 [0,4194304] 0 2024-09-13T17:05:52.350 INFO:tasks.workunit.client.1.smithi195.stdout:6/543: rename d1c/d2d to d1c/d24/d7f/dad/db9 0 2024-09-13T17:05:52.351 INFO:tasks.workunit.client.0.smithi115.stdout:4/590: truncate d7/dd/de/fac 163794 0 2024-09-13T17:05:52.351 INFO:tasks.workunit.client.0.smithi115.stdout:4/591: chown d7/dd/f1e 29 1 2024-09-13T17:05:52.351 INFO:tasks.workunit.client.0.smithi115.stdout:4/592: fsync d7/dd/f25 0 2024-09-13T17:05:52.352 INFO:tasks.workunit.client.0.smithi115.stdout:4/593: chown d7/dd/de/d4e/d6c/l75 0 1 2024-09-13T17:05:52.353 INFO:tasks.workunit.client.1.smithi195.stdout:4/723: link f13 d1a/d1f/d43/d5a/d63/db8/dc8/fef 0 2024-09-13T17:05:52.354 INFO:tasks.workunit.client.0.smithi115.stdout:4/594: mkdir d7/dd/de/d4e/d5a/d4f/d70/db6 0 2024-09-13T17:05:52.355 INFO:tasks.workunit.client.1.smithi195.stdout:5/599: rmdir d2/df/d62 39 2024-09-13T17:05:52.356 INFO:tasks.workunit.client.0.smithi115.stdout:6/439: dread d8/d13/d15/d24/f29 [0,4194304] 0 2024-09-13T17:05:52.356 INFO:tasks.workunit.client.0.smithi115.stdout:6/440: dread - d8/db/f70 zero size 2024-09-13T17:05:52.356 INFO:tasks.workunit.client.0.smithi115.stdout:6/441: chown d8/d33/d40/d4c/f71 21600 1 2024-09-13T17:05:52.356 INFO:tasks.workunit.client.0.smithi115.stdout:6/442: fsync d8/d13/d15/d24/f63 0 2024-09-13T17:05:52.359 INFO:tasks.workunit.client.0.smithi115.stdout:6/443: mknod d8/db/c88 0 2024-09-13T17:05:52.360 INFO:tasks.workunit.client.0.smithi115.stdout:6/444: read d8/f25 [889735,99663] 0 2024-09-13T17:05:52.360 INFO:tasks.workunit.client.0.smithi115.stdout:6/445: stat d8/d13/d15/d24/f3b 0 2024-09-13T17:05:52.360 INFO:tasks.workunit.client.0.smithi115.stdout:6/446: read - d8/d33/d40/f5a zero size 2024-09-13T17:05:52.360 INFO:tasks.workunit.client.0.smithi115.stdout:6/447: write d8/d33/d40/d4c/f71 [1436082,97058] 0 2024-09-13T17:05:52.364 INFO:tasks.workunit.client.1.smithi195.stdout:2/622: rename d0/d4a/l59 to d0/d4a/d47/d73/lca 0 2024-09-13T17:05:52.365 INFO:tasks.workunit.client.1.smithi195.stdout:2/623: dread d0/d3/f82 [0,4194304] 0 2024-09-13T17:05:52.366 INFO:tasks.workunit.client.1.smithi195.stdout:6/544: symlink d1c/d24/d7f/dad/db9/d30/d6f/lba 0 2024-09-13T17:05:52.366 INFO:tasks.workunit.client.1.smithi195.stdout:1/558: sync 2024-09-13T17:05:52.366 INFO:tasks.workunit.client.1.smithi195.stdout:0/590: sync 2024-09-13T17:05:52.366 INFO:tasks.workunit.client.1.smithi195.stdout:0/591: creat d7/d87/d9b/d56/d46/fc2 x:0 0 0 2024-09-13T17:05:52.366 INFO:tasks.workunit.client.1.smithi195.stdout:0/592: stat d7/d87/d9b/d56/d4d/d5e/c89 0 2024-09-13T17:05:52.367 INFO:tasks.workunit.client.1.smithi195.stdout:4/724: creat d1a/d1f/d21/ff0 x:0 0 0 2024-09-13T17:05:52.367 INFO:tasks.workunit.client.1.smithi195.stdout:5/600: write d2/df/f1c [1232048,106873] 0 2024-09-13T17:05:52.367 INFO:tasks.workunit.client.1.smithi195.stdout:4/725: write d1a/d1f/d43/d24/d41/f70 [1184520,76968] 0 2024-09-13T17:05:52.369 INFO:tasks.workunit.client.1.smithi195.stdout:8/648: symlink d0/d17/d2f/d31/lde 0 2024-09-13T17:05:52.370 INFO:tasks.workunit.client.0.smithi115.stdout:6/448: dread d8/db/dd/f16 [0,4194304] 0 2024-09-13T17:05:52.371 INFO:tasks.workunit.client.1.smithi195.stdout:7/652: rename d5/d13/d24/l31 to d5/db/d19/d22/d90/dd4/le4 0 2024-09-13T17:05:52.373 INFO:tasks.workunit.client.0.smithi115.stdout:8/402: sync 2024-09-13T17:05:52.373 INFO:tasks.workunit.client.1.smithi195.stdout:2/624: unlink d0/d4a/d47/d73/d75/d88/d2c/d43/f5e 0 2024-09-13T17:05:52.374 INFO:tasks.workunit.client.0.smithi115.stdout:6/449: symlink d8/d13/d15/d24/d53/d6a/l89 0 2024-09-13T17:05:52.375 INFO:tasks.workunit.client.0.smithi115.stdout:4/595: dwrite d7/f30 [0,4194304] 0 2024-09-13T17:05:52.376 INFO:tasks.workunit.client.1.smithi195.stdout:6/545: mknod d1c/d3e/cbb 0 2024-09-13T17:05:52.377 INFO:tasks.workunit.client.1.smithi195.stdout:0/593: read d7/d87/d9b/d56/d46/f91 [3500207,127474] 0 2024-09-13T17:05:52.377 INFO:tasks.workunit.client.1.smithi195.stdout:0/594: fdatasync d7/d87/d9b/d4e/f5b 0 2024-09-13T17:05:52.377 INFO:tasks.workunit.client.0.smithi115.stdout:8/403: truncate d0/d21/f32 3311848 0 2024-09-13T17:05:52.378 INFO:tasks.workunit.client.0.smithi115.stdout:8/404: getdents d0/d26/d29/d59/d72 0 2024-09-13T17:05:52.378 INFO:tasks.workunit.client.0.smithi115.stdout:8/405: write d0/d15/d44/f70 [471521,67303] 0 2024-09-13T17:05:52.379 INFO:tasks.workunit.client.1.smithi195.stdout:1/559: creat db/d19/d5a/fc0 x:0 0 0 2024-09-13T17:05:52.381 INFO:tasks.workunit.client.0.smithi115.stdout:6/450: mknod d8/d13/d15/d24/d17/c8a 0 2024-09-13T17:05:52.381 INFO:tasks.workunit.client.0.smithi115.stdout:6/451: creat d8/d13/d15/d24/f8b x:0 0 0 2024-09-13T17:05:52.381 INFO:tasks.workunit.client.0.smithi115.stdout:6/452: chown d8/d13/d7b/c84 0 1 2024-09-13T17:05:52.382 INFO:tasks.workunit.client.1.smithi195.stdout:2/625: dread d0/d3/f96 [0,4194304] 0 2024-09-13T17:05:52.382 INFO:tasks.workunit.client.1.smithi195.stdout:2/626: write d0/d3/f68 [2758670,125975] 0 2024-09-13T17:05:52.385 INFO:tasks.workunit.client.1.smithi195.stdout:4/726: truncate d1a/d1f/d21/d84/d9d/d8e/d9f/db2/feb 2231812 0 2024-09-13T17:05:52.385 INFO:tasks.workunit.client.1.smithi195.stdout:4/727: dread - d1a/d1f/d9c/dc2/fd2 zero size 2024-09-13T17:05:52.387 INFO:tasks.workunit.client.1.smithi195.stdout:3/592: rename d7/l85 to d7/d21/d2a/d4a/d71/lb5 0 2024-09-13T17:05:52.387 INFO:tasks.workunit.client.1.smithi195.stdout:3/593: truncate d7/d19/fa2 427715 0 2024-09-13T17:05:52.387 INFO:tasks.workunit.client.1.smithi195.stdout:3/594: dread - d7/d21/d66/f94 zero size 2024-09-13T17:05:52.387 INFO:tasks.workunit.client.1.smithi195.stdout:3/595: fsync d7/d21/d2a/f2b 0 2024-09-13T17:05:52.388 INFO:tasks.workunit.client.1.smithi195.stdout:3/596: write d7/d21/d2a/d4a/d5a/f8e [30891,128857] 0 2024-09-13T17:05:52.389 INFO:tasks.workunit.client.1.smithi195.stdout:6/546: link d1c/f67 d1c/d24/d49/d5f/d85/da5/fbc 0 2024-09-13T17:05:52.389 INFO:tasks.workunit.client.0.smithi115.stdout:8/406: symlink d0/d21/d76/d83/l8c 0 2024-09-13T17:05:52.389 INFO:tasks.workunit.client.0.smithi115.stdout:8/407: write d0/d21/d76/f7f [902314,80546] 0 2024-09-13T17:05:52.390 INFO:tasks.workunit.client.1.smithi195.stdout:0/595: mknod d7/d87/d9b/d56/db0/cc3 0 2024-09-13T17:05:52.391 INFO:tasks.workunit.client.1.smithi195.stdout:1/560: symlink db/d60/d73/lc1 0 2024-09-13T17:05:52.391 INFO:tasks.workunit.client.1.smithi195.stdout:1/561: fdatasync db/d19/f4a 0 2024-09-13T17:05:52.392 INFO:tasks.workunit.client.0.smithi115.stdout:6/453: link d8/d13/d15/d24/c23 d8/d33/d40/d4c/c8c 0 2024-09-13T17:05:52.393 INFO:tasks.workunit.client.0.smithi115.stdout:8/408: creat d0/d18/d19/d28/f8d x:0 0 0 2024-09-13T17:05:52.393 INFO:tasks.workunit.client.0.smithi115.stdout:8/409: chown d0/d15/f1b 37205431 1 2024-09-13T17:05:52.395 INFO:tasks.workunit.client.1.smithi195.stdout:4/728: creat d1a/d1f/d9c/dee/ff1 x:0 0 0 2024-09-13T17:05:52.398 INFO:tasks.workunit.client.0.smithi115.stdout:6/454: unlink d8/db/d1d/l1a 0 2024-09-13T17:05:52.398 INFO:tasks.workunit.client.0.smithi115.stdout:6/455: chown d8/f25 14 1 2024-09-13T17:05:52.398 INFO:tasks.workunit.client.1.smithi195.stdout:7/653: dwrite d5/d35/d37/f65 [0,4194304] 0 2024-09-13T17:05:52.398 INFO:tasks.workunit.client.1.smithi195.stdout:7/654: chown d5/db/d19/d22/f62 676 1 2024-09-13T17:05:52.400 INFO:tasks.workunit.client.1.smithi195.stdout:5/601: rename d2/d3e/l34 to d2/d12/d4e/d10/d8f/lcc 0 2024-09-13T17:05:52.401 INFO:tasks.workunit.client.0.smithi115.stdout:4/596: dwrite d7/dd/de/d4e/f6f [4194304,4194304] 0 2024-09-13T17:05:52.401 INFO:tasks.workunit.client.1.smithi195.stdout:2/627: dread d0/d3/f68 [0,4194304] 0 2024-09-13T17:05:52.402 INFO:tasks.workunit.client.1.smithi195.stdout:6/547: symlink d1c/d24/d49/d5f/d35/lbd 0 2024-09-13T17:05:52.404 INFO:tasks.workunit.client.1.smithi195.stdout:3/597: dwrite d7/d21/d2a/d4a/f7a [0,4194304] 0 2024-09-13T17:05:52.405 INFO:tasks.workunit.client.1.smithi195.stdout:0/596: creat d7/d87/d9b/d56/d4d/fc4 x:0 0 0 2024-09-13T17:05:52.406 INFO:tasks.workunit.client.1.smithi195.stdout:1/562: dread db/df/d4d/d74/f7c [0,4194304] 0 2024-09-13T17:05:52.406 INFO:tasks.workunit.client.1.smithi195.stdout:1/563: readlink db/df/d13/l5c 0 2024-09-13T17:05:52.407 INFO:tasks.workunit.client.1.smithi195.stdout:4/729: unlink d1a/c1b 0 2024-09-13T17:05:52.409 INFO:tasks.workunit.client.0.smithi115.stdout:4/597: mknod d7/dd/cb7 0 2024-09-13T17:05:52.414 INFO:tasks.workunit.client.1.smithi195.stdout:2/628: unlink d0/d4a/d47/d73/d75/d88/d1e/f3f 0 2024-09-13T17:05:52.414 INFO:tasks.workunit.client.1.smithi195.stdout:2/629: write d0/d4a/d47/d73/d75/d88/d8e/f9b [4953675,9040] 0 2024-09-13T17:05:52.414 INFO:tasks.workunit.client.1.smithi195.stdout:2/630: chown d0/d4a/d47/dba/fc0 116074488 1 2024-09-13T17:05:52.415 INFO:tasks.workunit.client.1.smithi195.stdout:5/602: read d2/df/d78/d54/d58/f60 [2538601,82361] 0 2024-09-13T17:05:52.416 INFO:tasks.workunit.client.0.smithi115.stdout:8/410: dwrite d0/f13 [0,4194304] 0 2024-09-13T17:05:52.416 INFO:tasks.workunit.client.0.smithi115.stdout:8/411: stat d0/d18/l22 0 2024-09-13T17:05:52.416 INFO:tasks.workunit.client.0.smithi115.stdout:8/412: fdatasync d0/d18/d19/d28/f30 0 2024-09-13T17:05:52.417 INFO:tasks.workunit.client.0.smithi115.stdout:4/598: dread d7/dd/de/d4e/d5a/d4f/d53/f66 [0,4194304] 0 2024-09-13T17:05:52.417 INFO:tasks.workunit.client.0.smithi115.stdout:4/599: fdatasync d7/dd/de/d4e/d5a/d4f/d53/f98 0 2024-09-13T17:05:52.417 INFO:tasks.workunit.client.1.smithi195.stdout:6/548: mknod d1c/d24/d49/d5f/d35/d88/cbe 0 2024-09-13T17:05:52.417 INFO:tasks.workunit.client.1.smithi195.stdout:6/549: stat d1c/d24/d7f 0 2024-09-13T17:05:52.418 INFO:tasks.workunit.client.1.smithi195.stdout:6/550: chown d1c/f63 23792 1 2024-09-13T17:05:52.418 INFO:tasks.workunit.client.1.smithi195.stdout:6/551: stat d1c/d3e 0 2024-09-13T17:05:52.418 INFO:tasks.workunit.client.1.smithi195.stdout:3/598: dread d7/d21/d2a/d35/fa3 [0,4194304] 0 2024-09-13T17:05:52.418 INFO:tasks.workunit.client.1.smithi195.stdout:7/655: write d5/db/d19/d22/fe3 [3743713,13791] 0 2024-09-13T17:05:52.420 INFO:tasks.workunit.client.0.smithi115.stdout:7/385: sync 2024-09-13T17:05:52.424 INFO:tasks.workunit.client.0.smithi115.stdout:8/413: mknod d0/d18/d19/c8e 0 2024-09-13T17:05:52.424 INFO:tasks.workunit.client.0.smithi115.stdout:8/414: write d0/d21/d3a/f3f [198247,127560] 0 2024-09-13T17:05:52.424 INFO:tasks.workunit.client.0.smithi115.stdout:8/415: readlink d0/d15/d44/l68 0 2024-09-13T17:05:52.427 INFO:tasks.workunit.client.0.smithi115.stdout:4/600: creat d7/dd/d3c/d72/db3/fb8 x:0 0 0 2024-09-13T17:05:52.427 INFO:tasks.workunit.client.0.smithi115.stdout:6/456: dwrite d8/d13/d15/d24/d53/d6a/f87 [0,4194304] 0 2024-09-13T17:05:52.428 INFO:tasks.workunit.client.1.smithi195.stdout:5/603: dread d2/df/d78/d54/f73 [0,4194304] 0 2024-09-13T17:05:52.428 INFO:tasks.workunit.client.1.smithi195.stdout:5/604: dread - d2/df/d86/f7e zero size 2024-09-13T17:05:52.428 INFO:tasks.workunit.client.1.smithi195.stdout:5/605: write d2/f17 [4834581,68171] 0 2024-09-13T17:05:52.429 INFO:tasks.workunit.client.1.smithi195.stdout:6/552: write d1c/d24/f38 [599569,73420] 0 2024-09-13T17:05:52.429 INFO:tasks.workunit.client.1.smithi195.stdout:6/553: chown d1c/d3e/cbb 611997 1 2024-09-13T17:05:52.430 INFO:tasks.workunit.client.1.smithi195.stdout:0/597: rmdir d7/d87/d9b/d4e 39 2024-09-13T17:05:52.430 INFO:tasks.workunit.client.0.smithi115.stdout:7/386: stat d0/d2/d1e/c7d 0 2024-09-13T17:05:52.430 INFO:tasks.workunit.client.0.smithi115.stdout:7/387: write d0/d2/d1e/d3d/d82/d44/f6e [2553,82940] 0 2024-09-13T17:05:52.431 INFO:tasks.workunit.client.1.smithi195.stdout:1/564: creat db/df/d13/fc2 x:0 0 0 2024-09-13T17:05:52.434 INFO:tasks.workunit.client.1.smithi195.stdout:4/730: link f16 d1a/d1f/d43/d5a/d63/db8/dc8/ff2 0 2024-09-13T17:05:52.434 INFO:tasks.workunit.client.1.smithi195.stdout:4/731: write d1a/d1f/d21/d22/f26 [151898,58922] 0 2024-09-13T17:05:52.435 INFO:tasks.workunit.client.1.smithi195.stdout:4/732: write d1a/d1f/d43/d5a/f5f [1105701,88497] 0 2024-09-13T17:05:52.435 INFO:tasks.workunit.client.1.smithi195.stdout:4/733: fsync d1a/d1f/d21/d84/d9d/d8e/d9f/db2/feb 0 2024-09-13T17:05:52.435 INFO:tasks.workunit.client.1.smithi195.stdout:4/734: read - d1a/d1f/d9c/dc2/fd2 zero size 2024-09-13T17:05:52.435 INFO:tasks.workunit.client.1.smithi195.stdout:4/735: write d1a/d1f/d21/d22/f26 [942305,43175] 0 2024-09-13T17:05:52.435 INFO:tasks.workunit.client.1.smithi195.stdout:2/631: dwrite d0/d3/fa7 [0,4194304] 0 2024-09-13T17:05:52.435 INFO:tasks.workunit.client.0.smithi115.stdout:8/416: creat d0/d18/d19/d28/d71/f8f x:0 0 0 2024-09-13T17:05:52.440 INFO:tasks.workunit.client.0.smithi115.stdout:4/601: write d7/dd/de/d4e/f6f [411135,68848] 0 2024-09-13T17:05:52.443 INFO:tasks.workunit.client.0.smithi115.stdout:7/388: symlink d0/d2/d4a/l8c 0 2024-09-13T17:05:52.443 INFO:tasks.workunit.client.0.smithi115.stdout:7/389: truncate d0/d2/d4a/f81 1183655 0 2024-09-13T17:05:52.443 INFO:tasks.workunit.client.1.smithi195.stdout:5/606: mknod d2/ccd 0 2024-09-13T17:05:52.445 INFO:tasks.workunit.client.0.smithi115.stdout:8/417: creat d0/d21/d76/d83/d5a/f90 x:0 0 0 2024-09-13T17:05:52.449 INFO:tasks.workunit.client.0.smithi115.stdout:4/602: getdents d7/dd/d3c/d74/d8b 0 2024-09-13T17:05:52.450 INFO:tasks.workunit.client.1.smithi195.stdout:6/554: dwrite d1c/f63 [4194304,4194304] 0 2024-09-13T17:05:52.452 INFO:tasks.workunit.client.0.smithi115.stdout:6/457: dwrite d8/db/dd/f3a [4194304,4194304] 0 2024-09-13T17:05:52.452 INFO:tasks.workunit.client.0.smithi115.stdout:6/458: write d8/db/d49/f5e [358892,130938] 0 2024-09-13T17:05:52.452 INFO:tasks.workunit.client.0.smithi115.stdout:8/418: mknod d0/d18/d51/c91 0 2024-09-13T17:05:52.457 INFO:tasks.workunit.client.1.smithi195.stdout:0/598: dwrite d7/d87/d9b/d4e/d68/f9f [0,4194304] 0 2024-09-13T17:05:52.457 INFO:tasks.workunit.client.1.smithi195.stdout:0/599: chown d7/d88/d23/c24 50 1 2024-09-13T17:05:52.457 INFO:tasks.workunit.client.1.smithi195.stdout:1/565: mknod db/d19/d5a/d66/d7a/cc3 0 2024-09-13T17:05:52.459 INFO:tasks.workunit.client.0.smithi115.stdout:6/459: mkdir d8/db/d49/d8d 0 2024-09-13T17:05:52.459 INFO:tasks.workunit.client.1.smithi195.stdout:0/600: dread d7/d87/d9b/d56/d4d/d5e/f85 [0,4194304] 0 2024-09-13T17:05:52.459 INFO:tasks.workunit.client.1.smithi195.stdout:0/601: write d7/d50/f21 [1237201,51276] 0 2024-09-13T17:05:52.460 INFO:tasks.workunit.client.1.smithi195.stdout:4/736: mkdir d1a/d1f/d43/d5a/d63/dd1/db4/df3 0 2024-09-13T17:05:52.462 INFO:tasks.workunit.client.0.smithi115.stdout:4/603: rmdir d7/dd/de/d4e/d5a/d4f/d70 39 2024-09-13T17:05:52.462 INFO:tasks.workunit.client.0.smithi115.stdout:7/390: dwrite d0/f3e [0,4194304] 0 2024-09-13T17:05:52.464 INFO:tasks.workunit.client.0.smithi115.stdout:7/391: dread d0/d2/d4a/f81 [0,4194304] 0 2024-09-13T17:05:52.470 INFO:tasks.workunit.client.1.smithi195.stdout:8/649: rename d0/d17/db0 to d0/d17/d2f/d7c/d4c/d9b/ddf 0 2024-09-13T17:05:52.471 INFO:tasks.workunit.client.1.smithi195.stdout:5/607: truncate d2/d12/d4e/f1d 2792248 0 2024-09-13T17:05:52.472 INFO:tasks.workunit.client.0.smithi115.stdout:4/604: creat d7/dd/d3c/d74/d8b/fb9 x:0 0 0 2024-09-13T17:05:52.474 INFO:tasks.workunit.client.0.smithi115.stdout:6/460: dwrite d8/d13/d15/d24/f3b [0,4194304] 0 2024-09-13T17:05:52.479 INFO:tasks.workunit.client.1.smithi195.stdout:6/555: unlink d1c/d3e/l71 0 2024-09-13T17:05:52.484 INFO:tasks.workunit.client.1.smithi195.stdout:1/566: mknod db/d19/d5a/db0/cc4 0 2024-09-13T17:05:52.484 INFO:tasks.workunit.client.1.smithi195.stdout:1/567: chown db/df/d4d/d74 1743639 1 2024-09-13T17:05:52.486 INFO:tasks.workunit.client.1.smithi195.stdout:0/602: creat d7/d87/d9b/d56/fc5 x:0 0 0 2024-09-13T17:05:52.486 INFO:tasks.workunit.client.1.smithi195.stdout:0/603: chown d7 86247 1 2024-09-13T17:05:52.487 INFO:tasks.workunit.client.1.smithi195.stdout:0/604: chown d7/d87/d9b/d56/db0/cc3 377258 1 2024-09-13T17:05:52.488 INFO:tasks.workunit.client.0.smithi115.stdout:6/461: unlink d8/d13/c3c 0 2024-09-13T17:05:52.488 INFO:tasks.workunit.client.0.smithi115.stdout:6/462: truncate d8/d33/d40/f5a 931748 0 2024-09-13T17:05:52.492 INFO:tasks.workunit.client.1.smithi195.stdout:2/632: link d0/d3/d3d/l6e d0/d4a/d47/d73/d75/d88/d2c/d43/d63/db2/db3/lcb 0 2024-09-13T17:05:52.492 INFO:tasks.workunit.client.1.smithi195.stdout:2/633: chown d0/d4a/d47/d73/d75/d88/d2c/d43/d84/f97 121055785 1 2024-09-13T17:05:52.492 INFO:tasks.workunit.client.0.smithi115.stdout:6/463: symlink d8/l8e 0 2024-09-13T17:05:52.494 INFO:tasks.workunit.client.0.smithi115.stdout:4/605: dwrite d7/dd/d63/f87 [0,4194304] 0 2024-09-13T17:05:52.494 INFO:tasks.workunit.client.0.smithi115.stdout:7/392: dwrite d0/d2/d1e/d3d/d6c/f5d [4194304,4194304] 0 2024-09-13T17:05:52.495 INFO:tasks.workunit.client.1.smithi195.stdout:0/605: dread d7/d87/d9b/d4e/f5b [0,4194304] 0 2024-09-13T17:05:52.495 INFO:tasks.workunit.client.1.smithi195.stdout:8/650: symlink d0/d17/d2f/d7c/d4b/le0 0 2024-09-13T17:05:52.495 INFO:tasks.workunit.client.1.smithi195.stdout:5/608: dwrite d2/d12/d3f/f4d [0,4194304] 0 2024-09-13T17:05:52.495 INFO:tasks.workunit.client.0.smithi115.stdout:6/464: creat d8/d13/d7b/f8f x:0 0 0 2024-09-13T17:05:52.496 INFO:tasks.workunit.client.0.smithi115.stdout:6/465: chown d8/d33/d82/l83 110047329 1 2024-09-13T17:05:52.498 INFO:tasks.workunit.client.1.smithi195.stdout:4/737: mknod d1a/d1f/d43/d24/d41/cf4 0 2024-09-13T17:05:52.498 INFO:tasks.workunit.client.1.smithi195.stdout:4/738: stat d1a/d1f/d43/d5a/d63/db8/db9 0 2024-09-13T17:05:52.498 INFO:tasks.workunit.client.1.smithi195.stdout:4/739: truncate d1a/d1f/d43/d24/f3e 1307084 0 2024-09-13T17:05:52.499 INFO:tasks.workunit.client.1.smithi195.stdout:4/740: stat d1a/d1f/d21/d84/d9d/l64 0 2024-09-13T17:05:52.499 INFO:tasks.workunit.client.1.smithi195.stdout:4/741: write d1a/d1f/d43/d24/d41/fd3 [657929,28686] 0 2024-09-13T17:05:52.499 INFO:tasks.workunit.client.1.smithi195.stdout:4/742: readlink d1a/d1f/d43/l6b 0 2024-09-13T17:05:52.499 INFO:tasks.workunit.client.1.smithi195.stdout:9/690: sync 2024-09-13T17:05:52.500 INFO:tasks.workunit.client.0.smithi115.stdout:4/606: mkdir d7/d86/d88/dba 0 2024-09-13T17:05:52.500 INFO:tasks.workunit.client.0.smithi115.stdout:4/607: fdatasync d7/dd/de/f43 0 2024-09-13T17:05:52.500 INFO:tasks.workunit.client.1.smithi195.stdout:2/634: dread d0/d4a/f3a [0,4194304] 0 2024-09-13T17:05:52.502 INFO:tasks.workunit.client.1.smithi195.stdout:3/599: rename d7/ld to d7/d21/d2a/d35/d60/db0/lb6 0 2024-09-13T17:05:52.503 INFO:tasks.workunit.client.1.smithi195.stdout:1/568: dwrite db/df/d13/f2d [0,4194304] 0 2024-09-13T17:05:52.503 INFO:tasks.workunit.client.1.smithi195.stdout:1/569: write db/df/f7f [109373,105109] 0 2024-09-13T17:05:52.505 INFO:tasks.workunit.client.1.smithi195.stdout:0/606: symlink d7/d87/d9b/d4e/d68/lc6 0 2024-09-13T17:05:52.507 INFO:tasks.workunit.client.0.smithi115.stdout:7/393: rename d0/d2/d1e/d3d/d6c/l1d to d0/d51/l8d 0 2024-09-13T17:05:52.507 INFO:tasks.workunit.client.0.smithi115.stdout:7/394: write d0/d2/d1e/f32 [3303936,8366] 0 2024-09-13T17:05:52.507 INFO:tasks.workunit.client.0.smithi115.stdout:7/395: fsync d0/fa 0 2024-09-13T17:05:52.509 INFO:tasks.workunit.client.0.smithi115.stdout:4/608: write d7/dd/de/f43 [2138029,97662] 0 2024-09-13T17:05:52.509 INFO:tasks.workunit.client.0.smithi115.stdout:6/466: symlink d8/d13/d15/l90 0 2024-09-13T17:05:52.513 INFO:tasks.workunit.client.0.smithi115.stdout:4/609: mknod d7/dd/de/d4e/d6c/d77/cbb 0 2024-09-13T17:05:52.514 INFO:tasks.workunit.client.0.smithi115.stdout:4/610: write d7/dd/de/d4e/d9f/fb1 [743396,36856] 0 2024-09-13T17:05:52.515 INFO:tasks.workunit.client.1.smithi195.stdout:5/609: symlink d2/d12/lce 0 2024-09-13T17:05:52.517 INFO:tasks.workunit.client.0.smithi115.stdout:6/467: creat d8/d33/d40/d4c/f91 x:0 0 0 2024-09-13T17:05:52.517 INFO:tasks.workunit.client.0.smithi115.stdout:7/396: dread d0/d3b/d50/d21/d2f/f4e [0,4194304] 0 2024-09-13T17:05:52.519 INFO:tasks.workunit.client.0.smithi115.stdout:4/611: creat d7/dd/da0/fbc x:0 0 0 2024-09-13T17:05:52.520 INFO:tasks.workunit.client.1.smithi195.stdout:4/743: mknod d1a/d1f/d9c/cf5 0 2024-09-13T17:05:52.521 INFO:tasks.workunit.client.1.smithi195.stdout:4/744: readlink d1a/d1f/d43/l6b 0 2024-09-13T17:05:52.524 INFO:tasks.workunit.client.0.smithi115.stdout:4/612: dread d7/dd/de/fac [0,4194304] 0 2024-09-13T17:05:52.524 INFO:tasks.workunit.client.0.smithi115.stdout:4/613: getdents d7/d86/d88/dba 0 2024-09-13T17:05:52.525 INFO:tasks.workunit.client.1.smithi195.stdout:9/691: mknod d6/df/d16/de3/d68/de2/cea 0 2024-09-13T17:05:52.525 INFO:tasks.workunit.client.1.smithi195.stdout:9/692: readlink d6/df/d7b/l87 0 2024-09-13T17:05:52.526 INFO:tasks.workunit.client.0.smithi115.stdout:6/468: rename l2 to d8/d33/d7f/l92 0 2024-09-13T17:05:52.528 INFO:tasks.workunit.client.0.smithi115.stdout:7/397: dread d0/d2/d1e/d3d/d6c/f30 [0,4194304] 0 2024-09-13T17:05:52.529 INFO:tasks.workunit.client.1.smithi195.stdout:8/651: dwrite d0/d17/d2f/d7c/d4c/d9b/ddf/fb8 [0,4194304] 0 2024-09-13T17:05:52.529 INFO:tasks.workunit.client.1.smithi195.stdout:5/610: dwrite d2/d88/fc1 [0,4194304] 0 2024-09-13T17:05:52.529 INFO:tasks.workunit.client.1.smithi195.stdout:5/611: readlink d2/d12/d4e/d10/d5c/lb4 0 2024-09-13T17:05:52.529 INFO:tasks.workunit.client.1.smithi195.stdout:5/612: write d2/fc4 [370742,75686] 0 2024-09-13T17:05:52.530 INFO:tasks.workunit.client.0.smithi115.stdout:7/398: read d0/d2/d1e/d3d/d6c/f4c [530188,17614] 0 2024-09-13T17:05:52.530 INFO:tasks.workunit.client.0.smithi115.stdout:7/399: chown d0/l64 12105538 1 2024-09-13T17:05:52.530 INFO:tasks.workunit.client.0.smithi115.stdout:7/400: write d0/d2/d67/f80 [748279,98481] 0 2024-09-13T17:05:52.530 INFO:tasks.workunit.client.0.smithi115.stdout:4/614: mknod d7/dd/de/d4e/d5a/d4f/d70/db6/cbd 0 2024-09-13T17:05:52.531 INFO:tasks.workunit.client.1.smithi195.stdout:3/600: mkdir d7/d21/d2a/d35/db7 0 2024-09-13T17:05:52.532 INFO:tasks.workunit.client.1.smithi195.stdout:6/556: rename d1c/d24/d7f/dad/db9/d30/l4e to d1c/d24/d49/d5f/db1/lbf 0 2024-09-13T17:05:52.532 INFO:tasks.workunit.client.1.smithi195.stdout:6/557: chown d1c/f6c 6554 1 2024-09-13T17:05:52.532 INFO:tasks.workunit.client.1.smithi195.stdout:6/558: chown d1c/d24/la6 270136 1 2024-09-13T17:05:52.533 INFO:tasks.workunit.client.0.smithi115.stdout:6/469: unlink d8/d33/d40/d4c/d66/f77 0 2024-09-13T17:05:52.533 INFO:tasks.workunit.client.0.smithi115.stdout:6/470: fdatasync d8/d33/d40/d4c/f91 0 2024-09-13T17:05:52.534 INFO:tasks.workunit.client.0.smithi115.stdout:6/471: stat d8/d13/d15 0 2024-09-13T17:05:52.534 INFO:tasks.workunit.client.0.smithi115.stdout:6/472: write d8/d33/f7c [986584,105606] 0 2024-09-13T17:05:52.535 INFO:tasks.workunit.client.0.smithi115.stdout:7/401: creat d0/d2/d67/d70/f8e x:0 0 0 2024-09-13T17:05:52.536 INFO:tasks.workunit.client.0.smithi115.stdout:4/615: readlink d7/dd/de/d4e/d5a/d4f/d53/l54 0 2024-09-13T17:05:52.537 INFO:tasks.workunit.client.0.smithi115.stdout:6/473: mknod d8/d33/d82/d80/c93 0 2024-09-13T17:05:52.542 INFO:tasks.workunit.client.0.smithi115.stdout:7/402: getdents d0/d3b/d50 0 2024-09-13T17:05:52.542 INFO:tasks.workunit.client.0.smithi115.stdout:7/403: write d0/d3b/d50/d21/f33 [3583770,15652] 0 2024-09-13T17:05:52.543 INFO:tasks.workunit.client.1.smithi195.stdout:1/570: stat db/d19/d5a/f61 0 2024-09-13T17:05:52.544 INFO:tasks.workunit.client.1.smithi195.stdout:0/607: mknod d7/d87/d9b/d56/d46/cc7 0 2024-09-13T17:05:52.544 INFO:tasks.workunit.client.0.smithi115.stdout:4/616: write d7/dd/d63/f8e [4133593,39125] 0 2024-09-13T17:05:52.546 INFO:tasks.workunit.client.0.smithi115.stdout:6/474: dread d8/db/d1d/f18 [0,4194304] 0 2024-09-13T17:05:52.549 INFO:tasks.workunit.client.0.smithi115.stdout:7/404: rename d0/d2/d1e/d3d/d6c/d71/f65 to d0/d2/d1e/d3d/d82/d44/f8f 0 2024-09-13T17:05:52.549 INFO:tasks.workunit.client.0.smithi115.stdout:7/405: readlink d0/d3b/d50/l5a 0 2024-09-13T17:05:52.553 INFO:tasks.workunit.client.0.smithi115.stdout:6/475: write d8/db/dd/f16 [1547664,36849] 0 2024-09-13T17:05:52.553 INFO:tasks.workunit.client.0.smithi115.stdout:6/476: creat d8/f94 x:0 0 0 2024-09-13T17:05:52.554 INFO:tasks.workunit.client.1.smithi195.stdout:4/745: mkdir d1a/d1f/d21/d84/d9d/df6 0 2024-09-13T17:05:52.555 INFO:tasks.workunit.client.0.smithi115.stdout:7/406: link d0/d2/d1e/d3d/d82/c2a d0/d2/d4a/c90 0 2024-09-13T17:05:52.556 INFO:tasks.workunit.client.1.smithi195.stdout:9/693: creat d6/df/d16/de3/feb x:0 0 0 2024-09-13T17:05:52.561 INFO:tasks.workunit.client.1.smithi195.stdout:7/656: sync 2024-09-13T17:05:52.561 INFO:tasks.workunit.client.1.smithi195.stdout:7/657: write d5/db/d19/fb4 [468458,74646] 0 2024-09-13T17:05:52.562 INFO:tasks.workunit.client.0.smithi115.stdout:6/477: symlink d8/d13/d15/d24/l95 0 2024-09-13T17:05:52.564 INFO:tasks.workunit.client.1.smithi195.stdout:5/613: creat d2/d12/d4e/d10/d5c/fcf x:0 0 0 2024-09-13T17:05:52.565 INFO:tasks.workunit.client.0.smithi115.stdout:7/407: symlink d0/d59/l91 0 2024-09-13T17:05:52.566 INFO:tasks.workunit.client.0.smithi115.stdout:7/408: write d0/d2/d1e/d3d/d82/f2c [272108,95746] 0 2024-09-13T17:05:52.567 INFO:tasks.workunit.client.0.smithi115.stdout:7/409: dread - d0/d3b/d50/f88 zero size 2024-09-13T17:05:52.567 INFO:tasks.workunit.client.1.smithi195.stdout:3/601: creat d7/d21/d2a/d35/d60/d6f/da4/fb8 x:0 0 0 2024-09-13T17:05:52.569 INFO:tasks.workunit.client.0.smithi115.stdout:6/478: link d8/d33/d40/f5a d8/d13/d15/d24/f96 0 2024-09-13T17:05:52.570 INFO:tasks.workunit.client.1.smithi195.stdout:6/559: mkdir d1c/d24/d49/d5f/d85/d8f/dc0 0 2024-09-13T17:05:52.571 INFO:tasks.workunit.client.0.smithi115.stdout:6/479: chown d8/db/d49/f4d 13367680 1 2024-09-13T17:05:52.573 INFO:tasks.workunit.client.1.smithi195.stdout:1/571: rename db/d58/dae/laf to db/lc5 0 2024-09-13T17:05:52.574 INFO:tasks.workunit.client.0.smithi115.stdout:6/480: write d8/db/f70 [170274,726] 0 2024-09-13T17:05:52.575 INFO:tasks.workunit.client.1.smithi195.stdout:4/746: creat d1a/d1f/d43/d5a/d63/db8/dc8/dd7/ff7 x:0 0 0 2024-09-13T17:05:52.578 INFO:tasks.workunit.client.1.smithi195.stdout:0/608: rename d7/db/c40 to d7/db/d11/db5/cc8 0 2024-09-13T17:05:52.579 INFO:tasks.workunit.client.0.smithi115.stdout:6/481: getdents d8/d13/d15/d24/d53 0 2024-09-13T17:05:52.580 INFO:tasks.workunit.client.0.smithi115.stdout:4/617: truncate d7/f2d 1350085 0 2024-09-13T17:05:52.581 INFO:tasks.workunit.client.1.smithi195.stdout:9/694: getdents d6/d12/d86/dd2 0 2024-09-13T17:05:52.581 INFO:tasks.workunit.client.1.smithi195.stdout:9/695: stat d6/d19/d21/d5b/f83 0 2024-09-13T17:05:52.582 INFO:tasks.workunit.client.1.smithi195.stdout:7/658: dwrite d5/d35/f75 [0,4194304] 0 2024-09-13T17:05:52.585 INFO:tasks.workunit.client.1.smithi195.stdout:1/572: dread db/df/f26 [0,4194304] 0 2024-09-13T17:05:52.585 INFO:tasks.workunit.client.1.smithi195.stdout:5/614: dwrite d2/df/d86/f5d [0,4194304] 0 2024-09-13T17:05:52.587 INFO:tasks.workunit.client.1.smithi195.stdout:3/602: rename d7/d21/d2a/d4a/d71/f87 to d7/d62/d70/fb9 0 2024-09-13T17:05:52.589 INFO:tasks.workunit.client.1.smithi195.stdout:4/747: write d1a/d1f/d21/d22/f42 [644553,98499] 0 2024-09-13T17:05:52.589 INFO:tasks.workunit.client.1.smithi195.stdout:4/748: chown d1a/d1f/d21/d84/d9d/d8e/d9f/lb3 100 1 2024-09-13T17:05:52.589 INFO:tasks.workunit.client.1.smithi195.stdout:4/749: read - d1a/d1f/d43/d24/d41/d60/f8a zero size 2024-09-13T17:05:52.596 INFO:tasks.workunit.client.1.smithi195.stdout:7/659: mknod d5/db/d50/ce5 0 2024-09-13T17:05:52.596 INFO:tasks.workunit.client.1.smithi195.stdout:7/660: readlink d5/db/d50/d7f/d82/da1/ld8 0 2024-09-13T17:05:52.597 INFO:tasks.workunit.client.1.smithi195.stdout:7/661: write d5/f9e [629274,23006] 0 2024-09-13T17:05:52.601 INFO:tasks.workunit.client.1.smithi195.stdout:3/603: write d7/d21/f59 [4180435,5628] 0 2024-09-13T17:05:52.601 INFO:tasks.workunit.client.1.smithi195.stdout:0/609: dwrite d7/f53 [0,4194304] 0 2024-09-13T17:05:52.605 INFO:tasks.workunit.client.0.smithi115.stdout:4/618: dread d7/dd/f2b [0,4194304] 0 2024-09-13T17:05:52.606 INFO:tasks.workunit.client.1.smithi195.stdout:5/615: truncate d2/d3e/f3a 1184324 0 2024-09-13T17:05:52.610 INFO:tasks.workunit.client.1.smithi195.stdout:1/573: mkdir db/df/d4d/d67/dc6 0 2024-09-13T17:05:52.614 INFO:tasks.workunit.client.0.smithi115.stdout:4/619: dread d7/fb [0,4194304] 0 2024-09-13T17:05:52.614 INFO:tasks.workunit.client.1.smithi195.stdout:6/560: rename d1c/d24/d49/d5f/d35/f45 to d1c/d24/d49/d5f/d85/d8f/dc0/fc1 0 2024-09-13T17:05:52.616 INFO:tasks.workunit.client.1.smithi195.stdout:6/561: write d1c/f6c [504654,106289] 0 2024-09-13T17:05:52.616 INFO:tasks.workunit.client.1.smithi195.stdout:6/562: stat d1c/d24/d49/d5f/d35/d88 0 2024-09-13T17:05:52.618 INFO:tasks.workunit.client.1.smithi195.stdout:7/662: mkdir d5/db/d50/d7f/d82/de6 0 2024-09-13T17:05:52.621 INFO:tasks.workunit.client.1.smithi195.stdout:5/616: dread d2/d12/d3f/f4d [0,4194304] 0 2024-09-13T17:05:52.621 INFO:tasks.workunit.client.1.smithi195.stdout:5/617: truncate d2/f6a 4972994 0 2024-09-13T17:05:52.622 INFO:tasks.workunit.client.1.smithi195.stdout:3/604: creat d7/d21/d2a/d4a/d71/fba x:0 0 0 2024-09-13T17:05:52.622 INFO:tasks.workunit.client.1.smithi195.stdout:3/605: truncate d7/f77 457301 0 2024-09-13T17:05:52.628 INFO:tasks.workunit.client.1.smithi195.stdout:1/574: unlink db/df/d4d/c82 0 2024-09-13T17:05:52.628 INFO:tasks.workunit.client.1.smithi195.stdout:9/696: dwrite d6/df/d16/d5c/dcf/dd4/fe6 [0,4194304] 0 2024-09-13T17:05:52.628 INFO:tasks.workunit.client.1.smithi195.stdout:4/750: dwrite d1a/d1f/d21/d84/d9d/f2a [0,4194304] 0 2024-09-13T17:05:52.628 INFO:tasks.workunit.client.1.smithi195.stdout:4/751: read - d1a/d1f/d43/fce zero size 2024-09-13T17:05:52.629 INFO:tasks.workunit.client.1.smithi195.stdout:1/575: write db/df/d4d/f52 [176520,19728] 0 2024-09-13T17:05:52.629 INFO:tasks.workunit.client.1.smithi195.stdout:1/576: fsync db/d19/d5a/f78 0 2024-09-13T17:05:52.629 INFO:tasks.workunit.client.0.smithi115.stdout:7/410: dwrite d0/d2/d1e/d3d/d82/f2c [0,4194304] 0 2024-09-13T17:05:52.629 INFO:tasks.workunit.client.1.smithi195.stdout:7/663: unlink d5/d13/d24/la4 0 2024-09-13T17:05:52.630 INFO:tasks.workunit.client.1.smithi195.stdout:0/610: getdents d7/d87 0 2024-09-13T17:05:52.635 INFO:tasks.workunit.client.0.smithi115.stdout:7/411: symlink d0/d2/l92 0 2024-09-13T17:05:52.635 INFO:tasks.workunit.client.1.smithi195.stdout:6/563: dwrite d1c/d24/d7f/dad/db9/d8c/f99 [4194304,4194304] 0 2024-09-13T17:05:52.635 INFO:tasks.workunit.client.1.smithi195.stdout:5/618: rename d2/d12/f75 to d2/d3e/fd0 0 2024-09-13T17:05:52.636 INFO:tasks.workunit.client.1.smithi195.stdout:0/611: dread d7/d50/f21 [0,4194304] 0 2024-09-13T17:05:52.636 INFO:tasks.workunit.client.1.smithi195.stdout:3/606: symlink d7/d21/d2a/d35/lbb 0 2024-09-13T17:05:52.636 INFO:tasks.workunit.client.1.smithi195.stdout:3/607: stat d7/d62/d70 0 2024-09-13T17:05:52.638 INFO:tasks.workunit.client.0.smithi115.stdout:4/620: rename d7/dd/d63 to d7/dbe 0 2024-09-13T17:05:52.639 INFO:tasks.workunit.client.1.smithi195.stdout:1/577: write db/d19/f4a [577594,92947] 0 2024-09-13T17:05:52.640 INFO:tasks.workunit.client.1.smithi195.stdout:9/697: write d6/df/d16/de3/d68/fbd [3359788,128562] 0 2024-09-13T17:05:52.641 INFO:tasks.workunit.client.0.smithi115.stdout:7/412: symlink d0/d2/d1e/d3d/d82/d44/l93 0 2024-09-13T17:05:52.644 INFO:tasks.workunit.client.0.smithi115.stdout:4/621: link d7/dd/d3c/f45 d7/dd/de/d4e/d6c/d77/fbf 0 2024-09-13T17:05:52.645 INFO:tasks.workunit.client.0.smithi115.stdout:4/622: write d7/dd/d3c/d7b/f9a [701719,85264] 0 2024-09-13T17:05:52.652 INFO:tasks.workunit.client.0.smithi115.stdout:4/623: creat d7/dd/de/fc0 x:0 0 0 2024-09-13T17:05:52.652 INFO:tasks.workunit.client.0.smithi115.stdout:4/624: fdatasync d7/dd/de/d4e/d5a/d4f/d70/fa9 0 2024-09-13T17:05:52.652 INFO:tasks.workunit.client.0.smithi115.stdout:4/625: chown d7/dd/de/d4e/f91 253 1 2024-09-13T17:05:52.652 INFO:tasks.workunit.client.0.smithi115.stdout:4/626: chown d7/l48 586506921 1 2024-09-13T17:05:52.654 INFO:tasks.workunit.client.1.smithi195.stdout:0/612: dwrite d7/db/f34 [4194304,4194304] 0 2024-09-13T17:05:52.655 INFO:tasks.workunit.client.0.smithi115.stdout:7/413: rmdir d0/d2/d67 39 2024-09-13T17:05:52.657 INFO:tasks.workunit.client.0.smithi115.stdout:4/627: truncate d7/dd/de/f59 3854380 0 2024-09-13T17:05:52.659 INFO:tasks.workunit.client.0.smithi115.stdout:7/414: truncate d0/d2/d1e/d3d/f6d 697723 0 2024-09-13T17:05:52.660 INFO:tasks.workunit.client.1.smithi195.stdout:4/752: symlink d1a/d1f/d21/d22/lf8 0 2024-09-13T17:05:52.660 INFO:tasks.workunit.client.1.smithi195.stdout:4/753: creat d1a/d1f/d43/d24/d41/ff9 x:0 0 0 2024-09-13T17:05:52.661 INFO:tasks.workunit.client.0.smithi115.stdout:4/628: mknod d7/dd/d3c/d74/d8b/cc1 0 2024-09-13T17:05:52.663 INFO:tasks.workunit.client.1.smithi195.stdout:7/664: getdents d5/d13/da8 0 2024-09-13T17:05:52.664 INFO:tasks.workunit.client.0.smithi115.stdout:4/629: dread d7/dd/de/d4e/d9f/fb1 [0,4194304] 0 2024-09-13T17:05:52.664 INFO:tasks.workunit.client.0.smithi115.stdout:4/630: fdatasync d7/dd/de/f5c 0 2024-09-13T17:05:52.665 INFO:tasks.workunit.client.0.smithi115.stdout:7/415: mkdir d0/d2/d67/d86/d94 0 2024-09-13T17:05:52.667 INFO:tasks.workunit.client.0.smithi115.stdout:7/416: creat d0/d2/d67/d86/d94/f95 x:0 0 0 2024-09-13T17:05:52.668 INFO:tasks.workunit.client.0.smithi115.stdout:7/417: fsync d0/d2/d4a/f5f 0 2024-09-13T17:05:52.669 INFO:tasks.workunit.client.1.smithi195.stdout:6/564: creat d1c/d24/d7f/dad/db9/d30/d6f/fc2 x:0 0 0 2024-09-13T17:05:52.669 INFO:tasks.workunit.client.1.smithi195.stdout:6/565: write d1c/d7d/f97 [1463402,107094] 0 2024-09-13T17:05:52.669 INFO:tasks.workunit.client.1.smithi195.stdout:6/566: truncate d1c/d24/d7f/dad/db9/d30/d6f/fc2 691026 0 2024-09-13T17:05:52.669 INFO:tasks.workunit.client.1.smithi195.stdout:5/619: creat d2/d3e/fd1 x:0 0 0 2024-09-13T17:05:52.670 INFO:tasks.workunit.client.0.smithi115.stdout:7/418: mknod d0/c96 0 2024-09-13T17:05:52.671 INFO:tasks.workunit.client.1.smithi195.stdout:6/567: dread d1c/d24/d49/f65 [0,4194304] 0 2024-09-13T17:05:52.672 INFO:tasks.workunit.client.1.smithi195.stdout:3/608: mkdir d7/d21/d2a/d35/d60/d64/dbc 0 2024-09-13T17:05:52.673 INFO:tasks.workunit.client.1.smithi195.stdout:0/613: dwrite d7/d87/d9b/d4e/d68/f79 [0,4194304] 0 2024-09-13T17:05:52.673 INFO:tasks.workunit.client.1.smithi195.stdout:0/614: write d7/d88/d23/f35 [4976378,15061] 0 2024-09-13T17:05:52.674 INFO:tasks.workunit.client.0.smithi115.stdout:6/482: truncate d8/db/dd/f3a 1261411 0 2024-09-13T17:05:52.675 INFO:tasks.workunit.client.0.smithi115.stdout:7/419: mkdir d0/d97 0 2024-09-13T17:05:52.676 INFO:tasks.workunit.client.1.smithi195.stdout:1/578: unlink db/d19/c91 0 2024-09-13T17:05:52.676 INFO:tasks.workunit.client.1.smithi195.stdout:1/579: creat db/df/d4d/fc7 x:0 0 0 2024-09-13T17:05:52.676 INFO:tasks.workunit.client.1.smithi195.stdout:1/580: creat db/df/d13/da7/fc8 x:0 0 0 2024-09-13T17:05:52.676 INFO:tasks.workunit.client.1.smithi195.stdout:1/581: fsync db/df/f7f 0 2024-09-13T17:05:52.677 INFO:tasks.workunit.client.0.smithi115.stdout:6/483: symlink d8/d33/d40/d4c/d66/l97 0 2024-09-13T17:05:52.677 INFO:tasks.workunit.client.0.smithi115.stdout:6/484: fdatasync d8/d33/f61 0 2024-09-13T17:05:52.677 INFO:tasks.workunit.client.1.smithi195.stdout:9/698: creat d6/d19/d21/d45/dd1/fec x:0 0 0 2024-09-13T17:05:52.680 INFO:tasks.workunit.client.1.smithi195.stdout:4/754: symlink d1a/lfa 0 2024-09-13T17:05:52.682 INFO:tasks.workunit.client.0.smithi115.stdout:4/631: dwrite d7/dd/f83 [0,4194304] 0 2024-09-13T17:05:52.683 INFO:tasks.workunit.client.1.smithi195.stdout:7/665: symlink d5/db/d50/d7f/d82/de6/le7 0 2024-09-13T17:05:52.684 INFO:tasks.workunit.client.1.smithi195.stdout:7/666: creat d5/d13/fe8 x:0 0 0 2024-09-13T17:05:52.685 INFO:tasks.workunit.client.1.smithi195.stdout:5/620: link d2/df/c9b d2/d12/d4e/d74/cd2 0 2024-09-13T17:05:52.685 INFO:tasks.workunit.client.1.smithi195.stdout:5/621: readlink d2/d12/d4e/d10/d5c/la6 0 2024-09-13T17:05:52.686 INFO:tasks.workunit.client.1.smithi195.stdout:6/568: write d1c/d3e/f47 [4055879,35111] 0 2024-09-13T17:05:52.689 INFO:tasks.workunit.client.1.smithi195.stdout:3/609: link d7/d21/d2a/d35/d60/l6b d7/d21/d2a/d4a/lbd 0 2024-09-13T17:05:52.689 INFO:tasks.workunit.client.1.smithi195.stdout:3/610: creat d7/d21/d2a/d4a/fbe x:0 0 0 2024-09-13T17:05:52.695 INFO:tasks.workunit.client.1.smithi195.stdout:0/615: symlink d7/d87/d9b/d56/d4d/d9d/lc9 0 2024-09-13T17:05:52.699 INFO:tasks.workunit.client.1.smithi195.stdout:1/582: rename db/df/d4d/f71 to db/d19/d37/d3e/fc9 0 2024-09-13T17:05:52.700 INFO:tasks.workunit.client.1.smithi195.stdout:1/583: fdatasync db/f11 0 2024-09-13T17:05:52.701 INFO:tasks.workunit.client.1.smithi195.stdout:9/699: creat d6/df/d13/d8e/fed x:0 0 0 2024-09-13T17:05:52.701 INFO:tasks.workunit.client.1.smithi195.stdout:9/700: chown d6/d19/d21/d45/dad/dca 364535346 1 2024-09-13T17:05:52.704 INFO:tasks.workunit.client.0.smithi115.stdout:7/420: dwrite d0/f2e [0,4194304] 0 2024-09-13T17:05:52.704 INFO:tasks.workunit.client.0.smithi115.stdout:7/421: chown d0/d2/d67/f84 52 1 2024-09-13T17:05:52.704 INFO:tasks.workunit.client.0.smithi115.stdout:7/422: chown d0/f56 1065552 1 2024-09-13T17:05:52.704 INFO:tasks.workunit.client.0.smithi115.stdout:7/423: readlink d0/d2/d1e/l72 0 2024-09-13T17:05:52.704 INFO:tasks.workunit.client.0.smithi115.stdout:7/424: write d0/d2/d1e/d3d/d6c/f49 [751047,7065] 0 2024-09-13T17:05:52.705 INFO:tasks.workunit.client.0.smithi115.stdout:6/485: dwrite d8/d13/d15/d24/f29 [0,4194304] 0 2024-09-13T17:05:52.705 INFO:tasks.workunit.client.0.smithi115.stdout:6/486: write d8/d33/d40/f5c [1966409,66429] 0 2024-09-13T17:05:52.706 INFO:tasks.workunit.client.1.smithi195.stdout:7/667: mknod d5/db/d50/d7f/d82/dcc/ce9 0 2024-09-13T17:05:52.706 INFO:tasks.workunit.client.1.smithi195.stdout:7/668: write d5/d13/f32 [1070303,61070] 0 2024-09-13T17:05:52.707 INFO:tasks.workunit.client.1.smithi195.stdout:5/622: symlink d2/d12/d4e/d10/d5c/da1/ld3 0 2024-09-13T17:05:52.707 INFO:tasks.workunit.client.1.smithi195.stdout:5/623: chown d2/d12/d4e/d74/cab 191 1 2024-09-13T17:05:52.708 INFO:tasks.workunit.client.0.smithi115.stdout:7/425: rename d0/d2/d1e/d3d/d6c/f63 to d0/d97/f98 0 2024-09-13T17:05:52.709 INFO:tasks.workunit.client.1.smithi195.stdout:6/569: symlink d1c/d24/d49/d5f/lc3 0 2024-09-13T17:05:52.713 INFO:tasks.workunit.client.1.smithi195.stdout:0/616: mkdir d7/d87/d9b/d56/d46/dca 0 2024-09-13T17:05:52.713 INFO:tasks.workunit.client.1.smithi195.stdout:0/617: dread - d7/d50/da1/faf zero size 2024-09-13T17:05:52.713 INFO:tasks.workunit.client.1.smithi195.stdout:0/618: chown d7/d88/d23/f4a 8086112 1 2024-09-13T17:05:52.713 INFO:tasks.workunit.client.1.smithi195.stdout:0/619: stat d7/d88/d23/f25 0 2024-09-13T17:05:52.713 INFO:tasks.workunit.client.1.smithi195.stdout:0/620: fsync d7/d87/d9b/d56/fc5 0 2024-09-13T17:05:52.714 INFO:tasks.workunit.client.0.smithi115.stdout:7/426: mkdir d0/d3b/d50/d21/d99 0 2024-09-13T17:05:52.714 INFO:tasks.workunit.client.1.smithi195.stdout:2/635: sync 2024-09-13T17:05:52.714 INFO:tasks.workunit.client.1.smithi195.stdout:2/636: dread - d0/d4a/d47/d73/d75/fa2 zero size 2024-09-13T17:05:52.716 INFO:tasks.workunit.client.1.smithi195.stdout:9/701: mknod d6/d19/d21/d45/dad/cee 0 2024-09-13T17:05:52.718 INFO:tasks.workunit.client.1.smithi195.stdout:4/755: getdents d1a/d1f/d21/d36 0 2024-09-13T17:05:52.719 INFO:tasks.workunit.client.1.smithi195.stdout:7/669: dread d5/db/d50/d7f/f80 [0,4194304] 0 2024-09-13T17:05:52.719 INFO:tasks.workunit.client.1.smithi195.stdout:7/670: fdatasync d5/db/d50/daa/fd9 0 2024-09-13T17:05:52.719 INFO:tasks.workunit.client.1.smithi195.stdout:5/624: mknod d2/df/d78/d54/cd4 0 2024-09-13T17:05:52.719 INFO:tasks.workunit.client.1.smithi195.stdout:5/625: dread - d2/df/d86/f7e zero size 2024-09-13T17:05:52.720 INFO:tasks.workunit.client.1.smithi195.stdout:0/621: truncate f3 757662 0 2024-09-13T17:05:52.720 INFO:tasks.workunit.client.1.smithi195.stdout:8/652: sync 2024-09-13T17:05:52.720 INFO:tasks.workunit.client.1.smithi195.stdout:2/637: chown d0/d4a/d47/d73/d75/d88/c4f 97886 1 2024-09-13T17:05:52.721 INFO:tasks.workunit.client.1.smithi195.stdout:9/702: mknod d6/df/d16/d5c/dcf/cef 0 2024-09-13T17:05:52.723 INFO:tasks.workunit.client.1.smithi195.stdout:6/570: dread d1c/d24/d7f/dad/db9/d30/f57 [0,4194304] 0 2024-09-13T17:05:52.724 INFO:tasks.workunit.client.0.smithi115.stdout:4/632: dwrite d7/dd/de/d4e/d5a/d4f/d53/f66 [0,4194304] 0 2024-09-13T17:05:52.724 INFO:tasks.workunit.client.0.smithi115.stdout:4/633: fdatasync d7/dd/f1e 0 2024-09-13T17:05:52.724 INFO:tasks.workunit.client.1.smithi195.stdout:7/671: truncate d5/d13/da8/fb6 575554 0 2024-09-13T17:05:52.725 INFO:tasks.workunit.client.1.smithi195.stdout:5/626: rename d2/df/d86/lb5 to d2/df/d48/d5a/d92/ld5 0 2024-09-13T17:05:52.726 INFO:tasks.workunit.client.1.smithi195.stdout:3/611: dwrite d7/f15 [12582912,4194304] 0 2024-09-13T17:05:52.728 INFO:tasks.workunit.client.1.smithi195.stdout:1/584: dwrite db/df/f1f [0,4194304] 0 2024-09-13T17:05:52.730 INFO:tasks.workunit.client.1.smithi195.stdout:0/622: getdents d7/d87/d9b/d56/db0 0 2024-09-13T17:05:52.730 INFO:tasks.workunit.client.1.smithi195.stdout:0/623: fdatasync d7/d87/d9b/d56/d4d/d5e/f85 0 2024-09-13T17:05:52.732 INFO:tasks.workunit.client.1.smithi195.stdout:6/571: mknod d1c/d24/d7f/dad/db9/d8c/cc4 0 2024-09-13T17:05:52.736 INFO:tasks.workunit.client.1.smithi195.stdout:5/627: symlink d2/df/d90/dbb/ld6 0 2024-09-13T17:05:52.736 INFO:tasks.workunit.client.1.smithi195.stdout:3/612: truncate d7/d21/f4f 2059593 0 2024-09-13T17:05:52.736 INFO:tasks.workunit.client.1.smithi195.stdout:1/585: write db/df/f39 [877356,104483] 0 2024-09-13T17:05:52.737 INFO:tasks.workunit.client.1.smithi195.stdout:4/756: dwrite d1a/d1f/d43/d24/d41/f8d [0,4194304] 0 2024-09-13T17:05:52.737 INFO:tasks.workunit.client.1.smithi195.stdout:4/757: fdatasync d1a/d1f/d9c/dc2/fc6 0 2024-09-13T17:05:52.738 INFO:tasks.workunit.client.0.smithi115.stdout:6/487: dwrite d8/d33/f7c [0,4194304] 0 2024-09-13T17:05:52.738 INFO:tasks.workunit.client.0.smithi115.stdout:4/634: dread d7/dd/de/d4e/f92 [0,4194304] 0 2024-09-13T17:05:52.738 INFO:tasks.workunit.client.0.smithi115.stdout:6/488: write d8/d13/d15/d24/d17/f85 [357312,117635] 0 2024-09-13T17:05:52.804 INFO:tasks.workunit.client.1.smithi195.stdout:0/624: creat d7/d88/d23/fcb x:0 0 0 2024-09-13T17:05:52.804 INFO:tasks.workunit.client.1.smithi195.stdout:0/625: fdatasync d7/db/d11/f73 0 2024-09-13T17:05:52.805 INFO:tasks.workunit.client.1.smithi195.stdout:5/628: read d2/df/f81 [4642074,90521] 0 2024-09-13T17:05:52.808 INFO:tasks.workunit.client.0.smithi115.stdout:4/635: creat d7/dd/de/d4e/d6c/d77/fc2 x:0 0 0 2024-09-13T17:05:52.810 INFO:tasks.workunit.client.1.smithi195.stdout:3/613: mkdir d7/d21/d2a/d35/d60/d6f/dbf 0 2024-09-13T17:05:52.810 INFO:tasks.workunit.client.1.smithi195.stdout:3/614: fdatasync d7/d19/d1e/f50 0 2024-09-13T17:05:52.810 INFO:tasks.workunit.client.1.smithi195.stdout:3/615: truncate d7/d62/d70/fb9 353905 0 2024-09-13T17:05:52.811 INFO:tasks.workunit.client.1.smithi195.stdout:3/616: write d7/d21/f27 [5187899,110401] 0 2024-09-13T17:05:52.811 INFO:tasks.workunit.client.1.smithi195.stdout:8/653: dwrite d0/d17/d49/f50 [0,4194304] 0 2024-09-13T17:05:52.812 INFO:tasks.workunit.client.0.smithi115.stdout:6/489: unlink d8/d13/d15/d24/d53/d6a/f87 0 2024-09-13T17:05:52.814 INFO:tasks.workunit.client.1.smithi195.stdout:1/586: creat db/df/d51/d62/d70/fca x:0 0 0 2024-09-13T17:05:52.814 INFO:tasks.workunit.client.1.smithi195.stdout:1/587: fdatasync db/df/d13/f80 0 2024-09-13T17:05:52.816 INFO:tasks.workunit.client.0.smithi115.stdout:4/636: creat d7/fc3 x:0 0 0 2024-09-13T17:05:52.817 INFO:tasks.workunit.client.1.smithi195.stdout:4/758: rename d1a/d1f/d43/d24/c83 to d1a/d1f/d21/d84/dcc/cfb 0 2024-09-13T17:05:52.817 INFO:tasks.workunit.client.1.smithi195.stdout:4/759: creat d1a/d1f/d21/ffc x:0 0 0 2024-09-13T17:05:52.819 INFO:tasks.workunit.client.1.smithi195.stdout:5/629: link d2/df/d48/d5a/f8c d2/df/d78/fd7 0 2024-09-13T17:05:52.820 INFO:tasks.workunit.client.0.smithi115.stdout:6/490: rmdir d8/db/d1d 39 2024-09-13T17:05:52.823 INFO:tasks.workunit.client.0.smithi115.stdout:6/491: rename d8/d13/d15/d24/c23 to d8/d33/d40/d4c/c98 0 2024-09-13T17:05:52.823 INFO:tasks.workunit.client.1.smithi195.stdout:9/703: dwrite d6/df/d16/d5c/fdf [0,4194304] 0 2024-09-13T17:05:52.825 INFO:tasks.workunit.client.1.smithi195.stdout:2/638: dwrite d0/d3/f5b [0,4194304] 0 2024-09-13T17:05:52.825 INFO:tasks.workunit.client.1.smithi195.stdout:2/639: write d0/d4a/d47/dba/fc0 [819747,58890] 0 2024-09-13T17:05:52.826 INFO:tasks.workunit.client.1.smithi195.stdout:3/617: symlink d7/d21/d51/lc0 0 2024-09-13T17:05:52.826 INFO:tasks.workunit.client.1.smithi195.stdout:3/618: stat d7/d21/d2a/d35/d60/d6f/l9b 0 2024-09-13T17:05:52.829 INFO:tasks.workunit.client.1.smithi195.stdout:8/654: link d0/d17/c6d d0/d17/d49/ce1 0 2024-09-13T17:05:52.832 INFO:tasks.workunit.client.1.smithi195.stdout:1/588: mknod db/d19/d37/d3e/ccb 0 2024-09-13T17:05:52.832 INFO:tasks.workunit.client.1.smithi195.stdout:6/572: dwrite d1c/d24/d49/d5f/f50 [4194304,4194304] 0 2024-09-13T17:05:52.832 INFO:tasks.workunit.client.1.smithi195.stdout:3/619: dread d7/d21/d2a/d4a/d5a/f8e [0,4194304] 0 2024-09-13T17:05:52.833 INFO:tasks.workunit.client.1.smithi195.stdout:7/672: dwrite d5/d13/d30/f7a [0,4194304] 0 2024-09-13T17:05:52.833 INFO:tasks.workunit.client.1.smithi195.stdout:7/673: dread - d5/db/d50/daa/fc1 zero size 2024-09-13T17:05:52.837 INFO:tasks.workunit.client.1.smithi195.stdout:5/630: creat d2/d12/d4e/d10/fd8 x:0 0 0 2024-09-13T17:05:52.839 INFO:tasks.workunit.client.1.smithi195.stdout:9/704: rmdir d6/d19/d21/d45/dad/d5e 39 2024-09-13T17:05:52.840 INFO:tasks.workunit.client.1.smithi195.stdout:9/705: chown d6/d19/d21/d5b/fa3 725827298 1 2024-09-13T17:05:52.840 INFO:tasks.workunit.client.1.smithi195.stdout:9/706: chown d6/cd 20151188 1 2024-09-13T17:05:52.843 INFO:tasks.workunit.client.0.smithi115.stdout:6/492: dwrite d8/d33/d40/d4c/f91 [0,4194304] 0 2024-09-13T17:05:52.843 INFO:tasks.workunit.client.1.smithi195.stdout:2/640: creat d0/d4a/d47/d73/d75/d88/d62/dc5/fcc x:0 0 0 2024-09-13T17:05:52.843 INFO:tasks.workunit.client.1.smithi195.stdout:2/641: fdatasync d0/d4a/d47/d73/d75/d88/d2c/d43/d84/fb5 0 2024-09-13T17:05:52.843 INFO:tasks.workunit.client.1.smithi195.stdout:2/642: chown d0/d4a/d47/d73/d75/d88/d1e/l2b 7011046 1 2024-09-13T17:05:52.844 INFO:tasks.workunit.client.1.smithi195.stdout:8/655: mknod d0/ce2 0 2024-09-13T17:05:52.844 INFO:tasks.workunit.client.1.smithi195.stdout:8/656: dread - d0/f89 zero size 2024-09-13T17:05:52.846 INFO:tasks.workunit.client.1.smithi195.stdout:1/589: symlink db/d58/dae/lcc 0 2024-09-13T17:05:52.851 INFO:tasks.workunit.client.0.smithi115.stdout:6/493: mkdir d8/d33/d7f/d99 0 2024-09-13T17:05:52.854 INFO:tasks.workunit.client.1.smithi195.stdout:3/620: symlink d7/d19/lc1 0 2024-09-13T17:05:52.854 INFO:tasks.workunit.client.1.smithi195.stdout:3/621: dread - d7/d62/d70/fac zero size 2024-09-13T17:05:52.855 INFO:tasks.workunit.client.1.smithi195.stdout:3/622: chown d7/d21/d2a/ca8 188660 1 2024-09-13T17:05:52.855 INFO:tasks.workunit.client.1.smithi195.stdout:3/623: chown d7/d21/d2a/d35/d60/d64/f78 422 1 2024-09-13T17:05:52.855 INFO:tasks.workunit.client.1.smithi195.stdout:8/657: write d0/f8 [9847362,5536] 0 2024-09-13T17:05:52.858 INFO:tasks.workunit.client.1.smithi195.stdout:7/674: creat d5/db/fea x:0 0 0 2024-09-13T17:05:52.863 INFO:tasks.workunit.client.1.smithi195.stdout:8/658: dread d0/d4/fb [0,4194304] 0 2024-09-13T17:05:52.870 INFO:tasks.workunit.client.1.smithi195.stdout:5/631: unlink d2/d12/d4e/d10/f2f 0 2024-09-13T17:05:52.870 INFO:tasks.workunit.client.1.smithi195.stdout:5/632: chown d2/la4 3 1 2024-09-13T17:05:52.870 INFO:tasks.workunit.client.1.smithi195.stdout:1/590: dwrite db/f6b [0,4194304] 0 2024-09-13T17:05:52.871 INFO:tasks.workunit.client.0.smithi115.stdout:6/494: dwrite d8/d13/d15/f65 [0,4194304] 0 2024-09-13T17:05:52.871 INFO:tasks.workunit.client.1.smithi195.stdout:9/707: creat d6/df/d16/de3/d68/d6d/ff0 x:0 0 0 2024-09-13T17:05:52.879 INFO:tasks.workunit.client.1.smithi195.stdout:3/624: mkdir d7/d21/d2a/d35/db7/dc2 0 2024-09-13T17:05:52.879 INFO:tasks.workunit.client.1.smithi195.stdout:3/625: creat d7/d21/d2a/d4a/fc3 x:0 0 0 2024-09-13T17:05:52.879 INFO:tasks.workunit.client.1.smithi195.stdout:3/626: write d7/d21/d2a/d4a/fab [1016560,84195] 0 2024-09-13T17:05:52.879 INFO:tasks.workunit.client.1.smithi195.stdout:3/627: truncate d7/d21/d2a/d35/f37 1047332 0 2024-09-13T17:05:52.880 INFO:tasks.workunit.client.0.smithi115.stdout:6/495: truncate d8/db/d1d/f26 57338 0 2024-09-13T17:05:52.880 INFO:tasks.workunit.client.0.smithi115.stdout:6/496: creat d8/d13/d15/d24/d53/d6a/f9a x:0 0 0 2024-09-13T17:05:52.881 INFO:tasks.workunit.client.1.smithi195.stdout:8/659: link d0/d4/c75 d0/d17/d49/ce3 0 2024-09-13T17:05:52.883 INFO:tasks.workunit.client.1.smithi195.stdout:4/760: rename d1a/d1f/d21/d84/d9d/d58/d91 to d1a/d1f/d21/d84/d9d/d8e/d9f/db2/dfd 0 2024-09-13T17:05:52.884 INFO:tasks.workunit.client.1.smithi195.stdout:5/633: dwrite d2/df/d78/d54/f73 [4194304,4194304] 0 2024-09-13T17:05:52.884 INFO:tasks.workunit.client.1.smithi195.stdout:5/634: chown d2/df/d48/d5a/d92 972733 1 2024-09-13T17:05:52.884 INFO:tasks.workunit.client.1.smithi195.stdout:5/635: readlink d2/d12/l41 0 2024-09-13T17:05:52.884 INFO:tasks.workunit.client.1.smithi195.stdout:5/636: creat d2/df/d90/db2/fd9 x:0 0 0 2024-09-13T17:05:52.884 INFO:tasks.workunit.client.1.smithi195.stdout:5/637: truncate d2/d12/d4e/d74/fc3 11670 0 2024-09-13T17:05:52.887 INFO:tasks.workunit.client.0.smithi115.stdout:6/497: readlink d8/db/l14 0 2024-09-13T17:05:52.889 INFO:tasks.workunit.client.1.smithi195.stdout:9/708: mknod d6/d19/d21/d45/dad/d5e/dd0/d61/cf1 0 2024-09-13T17:05:52.891 INFO:tasks.workunit.client.0.smithi115.stdout:6/498: write d8/db/d1d/f18 [717761,32634] 0 2024-09-13T17:05:52.891 INFO:tasks.workunit.client.1.smithi195.stdout:8/660: creat d0/dda/d6f/fe4 x:0 0 0 2024-09-13T17:05:52.891 INFO:tasks.workunit.client.1.smithi195.stdout:8/661: write d0/f89 [636692,72814] 0 2024-09-13T17:05:52.892 INFO:tasks.workunit.client.1.smithi195.stdout:8/662: stat d0/d17/d2f/d7c 0 2024-09-13T17:05:52.893 INFO:tasks.workunit.client.1.smithi195.stdout:7/675: rename d5/db/d19/cbb to d5/db/d19/d22/d3c/ceb 0 2024-09-13T17:05:52.893 INFO:tasks.workunit.client.1.smithi195.stdout:3/628: dwrite d7/d21/d2a/d4a/fc3 [0,4194304] 0 2024-09-13T17:05:52.894 INFO:tasks.workunit.client.1.smithi195.stdout:4/761: write d1a/d1f/d43/d24/d41/f4b [1957216,82785] 0 2024-09-13T17:05:52.894 INFO:tasks.workunit.client.1.smithi195.stdout:2/643: dwrite d0/d4a/d47/d73/d75/d88/f7f [0,4194304] 0 2024-09-13T17:05:52.894 INFO:tasks.workunit.client.1.smithi195.stdout:4/762: write d1a/f1d [4409751,50523] 0 2024-09-13T17:05:52.894 INFO:tasks.workunit.client.1.smithi195.stdout:2/644: dread - d0/d4a/d47/d73/d75/d88/d2c/d43/d84/fa3 zero size 2024-09-13T17:05:52.894 INFO:tasks.workunit.client.1.smithi195.stdout:4/763: write d1a/d1f/d21/d22/f42 [613803,49820] 0 2024-09-13T17:05:52.898 INFO:tasks.workunit.client.0.smithi115.stdout:6/499: mkdir d8/d13/d15/d24/d17/d9b 0 2024-09-13T17:05:52.900 INFO:tasks.workunit.client.1.smithi195.stdout:5/638: unlink d2/df/d48/d5a/cbe 0 2024-09-13T17:05:52.902 INFO:tasks.workunit.client.1.smithi195.stdout:9/709: mknod d6/df/d16/d5c/dcf/cf2 0 2024-09-13T17:05:52.903 INFO:tasks.workunit.client.1.smithi195.stdout:9/710: read d6/d12/dbc/fdb [42471,125043] 0 2024-09-13T17:05:52.904 INFO:tasks.workunit.client.0.smithi115.stdout:6/500: rename d8/f94 to d8/d13/d15/d24/d53/f9c 0 2024-09-13T17:05:52.905 INFO:tasks.workunit.client.1.smithi195.stdout:1/591: rename db/df/l8c to db/df/d13/da7/lcd 0 2024-09-13T17:05:52.906 INFO:tasks.workunit.client.1.smithi195.stdout:1/592: read db/df/f7f [68271,48370] 0 2024-09-13T17:05:52.906 INFO:tasks.workunit.client.1.smithi195.stdout:1/593: readlink db/d19/d37/d3e/l49 0 2024-09-13T17:05:52.907 INFO:tasks.workunit.client.0.smithi115.stdout:6/501: unlink d8/d13/d15/d24/la 0 2024-09-13T17:05:52.909 INFO:tasks.workunit.client.1.smithi195.stdout:3/629: mkdir d7/d21/d2a/d35/d60/d64/db3/dc4 0 2024-09-13T17:05:52.910 INFO:tasks.workunit.client.0.smithi115.stdout:6/502: readlink d8/db/l4a 0 2024-09-13T17:05:52.910 INFO:tasks.workunit.client.0.smithi115.stdout:6/503: write d8/d13/d7b/f8f [793884,68329] 0 2024-09-13T17:05:52.910 INFO:tasks.workunit.client.0.smithi115.stdout:6/504: write d8/db/d1d/f18 [1279009,125873] 0 2024-09-13T17:05:52.910 INFO:tasks.workunit.client.0.smithi115.stdout:6/505: fdatasync d8/d13/d15/d24/f86 0 2024-09-13T17:05:52.911 INFO:tasks.workunit.client.1.smithi195.stdout:8/663: dwrite d0/d62/f98 [0,4194304] 0 2024-09-13T17:05:52.912 INFO:tasks.workunit.client.0.smithi115.stdout:6/506: creat d8/d13/f9d x:0 0 0 2024-09-13T17:05:52.914 INFO:tasks.workunit.client.0.smithi115.stdout:2/664: sync 2024-09-13T17:05:52.914 INFO:tasks.workunit.client.0.smithi115.stdout:3/660: sync 2024-09-13T17:05:52.914 INFO:tasks.workunit.client.0.smithi115.stdout:1/411: sync 2024-09-13T17:05:52.914 INFO:tasks.workunit.client.0.smithi115.stdout:5/424: sync 2024-09-13T17:05:52.914 INFO:tasks.workunit.client.0.smithi115.stdout:1/412: creat d5/d3e/f92 x:0 0 0 2024-09-13T17:05:52.914 INFO:tasks.workunit.client.0.smithi115.stdout:9/323: sync 2024-09-13T17:05:52.914 INFO:tasks.workunit.client.0.smithi115.stdout:1/413: chown d5/f14 0 1 2024-09-13T17:05:52.914 INFO:tasks.workunit.client.0.smithi115.stdout:8/419: sync 2024-09-13T17:05:52.915 INFO:tasks.workunit.client.0.smithi115.stdout:1/414: write d5/d7/d5c/f5d [234042,44956] 0 2024-09-13T17:05:52.915 INFO:tasks.workunit.client.0.smithi115.stdout:8/420: write d0/d21/d76/d83/f88 [105202,15125] 0 2024-09-13T17:05:52.915 INFO:tasks.workunit.client.0.smithi115.stdout:1/415: chown d5/d3e/l46 850145158 1 2024-09-13T17:05:52.915 INFO:tasks.workunit.client.0.smithi115.stdout:0/324: sync 2024-09-13T17:05:52.915 INFO:tasks.workunit.client.0.smithi115.stdout:6/507: mknod d8/d13/d15/d24/d17/c9e 0 2024-09-13T17:05:52.915 INFO:tasks.workunit.client.0.smithi115.stdout:6/508: write d8/d33/f61 [3378260,47745] 0 2024-09-13T17:05:52.915 INFO:tasks.workunit.client.0.smithi115.stdout:3/661: write d1/d4b/d1a/f2c [23540,41039] 0 2024-09-13T17:05:52.919 INFO:tasks.workunit.client.0.smithi115.stdout:2/665: mknod d3/d4d/d13/da2/cce 0 2024-09-13T17:05:52.921 INFO:tasks.workunit.client.0.smithi115.stdout:5/425: rename d19/d2b/d83 to d19/d2b/d32/d55/d5e/d87 0 2024-09-13T17:05:52.922 INFO:tasks.workunit.client.1.smithi195.stdout:2/645: creat d0/d4a/d47/d73/d75/d88/d2c/d43/fcd x:0 0 0 2024-09-13T17:05:52.922 INFO:tasks.workunit.client.1.smithi195.stdout:2/646: fdatasync d0/d4a/d47/d73/d75/d88/d2c/d43/f64 0 2024-09-13T17:05:52.924 INFO:tasks.workunit.client.1.smithi195.stdout:4/764: link d1a/d1f/d43/f3d d1a/d1f/d43/d5a/d63/dd1/ffe 0 2024-09-13T17:05:52.927 INFO:tasks.workunit.client.0.smithi115.stdout:5/426: dread d19/d2b/f44 [0,4194304] 0 2024-09-13T17:05:52.927 INFO:tasks.workunit.client.0.smithi115.stdout:8/421: symlink d0/d18/d19/d2b/l92 0 2024-09-13T17:05:52.928 INFO:tasks.workunit.client.0.smithi115.stdout:8/422: stat d0/d15/d44/f70 0 2024-09-13T17:05:52.928 INFO:tasks.workunit.client.0.smithi115.stdout:8/423: truncate d0/d15/d44/f70 818640 0 2024-09-13T17:05:52.928 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:52 smithi115 ceph-mon[27708]: Updating smithi115:/var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T17:05:52.928 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:52 smithi115 ceph-mon[27708]: pgmap v15: 65 pgs: 65 active+clean; 1.9 GiB data, 5.6 GiB used, 531 GiB / 536 GiB avail; 198 MiB/s rd, 262 MiB/s wr, 361 op/s 2024-09-13T17:05:52.928 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:52 smithi115 ceph-mon[27708]: from='mgr.24317 ' entity='mgr.smithi195.hjjifz' 2024-09-13T17:05:52.928 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:52 smithi115 ceph-mon[27708]: from='mgr.24317 ' entity='mgr.smithi195.hjjifz' 2024-09-13T17:05:52.928 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:52 smithi115 ceph-mon[27708]: from='mgr.24317 ' entity='mgr.smithi195.hjjifz' 2024-09-13T17:05:52.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:52 smithi115 ceph-mon[27708]: Reconfiguring prometheus.smithi115 (dependencies changed)... 2024-09-13T17:05:52.930 INFO:tasks.workunit.client.1.smithi195.stdout:1/594: link db/df/d51/d8e/fad db/d19/d5a/d66/d7a/fce 0 2024-09-13T17:05:52.933 INFO:tasks.workunit.client.1.smithi195.stdout:3/630: symlink d7/d21/d2a/d35/d60/d6f/da4/lc5 0 2024-09-13T17:05:52.934 INFO:tasks.workunit.client.0.smithi115.stdout:6/509: mknod d8/d13/d15/d24/d53/c9f 0 2024-09-13T17:05:52.935 INFO:tasks.workunit.client.1.smithi195.stdout:4/765: dread d1a/f94 [0,4194304] 0 2024-09-13T17:05:52.938 INFO:tasks.workunit.client.1.smithi195.stdout:8/664: mkdir d0/d17/d2f/d31/db4/de5 0 2024-09-13T17:05:52.941 INFO:tasks.workunit.client.1.smithi195.stdout:2/647: getdents d0/d4a/d47/d73/d75/d88/d8e 0 2024-09-13T17:05:52.941 INFO:tasks.workunit.client.1.smithi195.stdout:2/648: write d0/d4a/d47/d73/f7c [76883,27955] 0 2024-09-13T17:05:52.944 INFO:tasks.workunit.client.1.smithi195.stdout:3/631: mknod d7/d62/d70/cc6 0 2024-09-13T17:05:52.946 INFO:tasks.workunit.client.0.smithi115.stdout:2/666: creat d3/d4d/d13/d39/d46/d70/fcf x:0 0 0 2024-09-13T17:05:52.946 INFO:tasks.workunit.client.0.smithi115.stdout:2/667: readlink d3/d4d/d13/d1c/l3d 0 2024-09-13T17:05:52.946 INFO:tasks.workunit.client.0.smithi115.stdout:2/668: write d3/d4d/d13/d39/f5d [5129164,25933] 0 2024-09-13T17:05:52.949 INFO:tasks.workunit.client.1.smithi195.stdout:8/665: unlink d0/d13/f41 0 2024-09-13T17:05:52.950 INFO:tasks.workunit.client.0.smithi115.stdout:9/324: getdents d0 0 2024-09-13T17:05:52.950 INFO:tasks.workunit.client.0.smithi115.stdout:9/325: chown d0/de/d10/d15/f24 129544544 1 2024-09-13T17:05:52.951 INFO:tasks.workunit.client.0.smithi115.stdout:9/326: stat d0/d34/l5b 0 2024-09-13T17:05:52.953 INFO:tasks.workunit.client.1.smithi195.stdout:2/649: creat d0/d4a/d47/d73/d75/d88/d2c/d43/d63/fce x:0 0 0 2024-09-13T17:05:52.953 INFO:tasks.workunit.client.1.smithi195.stdout:2/650: write d0/d3/f7a [89284,82104] 0 2024-09-13T17:05:52.955 INFO:tasks.workunit.client.1.smithi195.stdout:8/666: truncate d0/d17/d2f/d31/f3f 2647403 0 2024-09-13T17:05:52.955 INFO:tasks.workunit.client.1.smithi195.stdout:8/667: creat d0/d17/d49/d63/db3/fe6 x:0 0 0 2024-09-13T17:05:52.956 INFO:tasks.workunit.client.1.smithi195.stdout:3/632: write d7/d21/f4f [477549,43505] 0 2024-09-13T17:05:52.957 INFO:tasks.workunit.client.1.smithi195.stdout:2/651: mkdir d0/d4a/d47/d73/d75/d88/d8e/dcf 0 2024-09-13T17:05:52.959 INFO:tasks.workunit.client.0.smithi115.stdout:1/416: rmdir d5/d7/d5c 39 2024-09-13T17:05:52.961 INFO:tasks.workunit.client.0.smithi115.stdout:5/427: mknod d19/d2b/d32/d55/d5e/c88 0 2024-09-13T17:05:52.961 INFO:tasks.workunit.client.1.smithi195.stdout:1/595: dwrite db/df/f16 [4194304,4194304] 0 2024-09-13T17:05:52.962 INFO:tasks.workunit.client.0.smithi115.stdout:6/510: dread d8/d13/d15/f65 [0,4194304] 0 2024-09-13T17:05:52.962 INFO:tasks.workunit.client.1.smithi195.stdout:8/668: dread d0/f3 [0,4194304] 0 2024-09-13T17:05:52.962 INFO:tasks.workunit.client.1.smithi195.stdout:8/669: chown d0/d4/c1a 1674903 1 2024-09-13T17:05:52.963 INFO:tasks.workunit.client.0.smithi115.stdout:8/424: symlink d0/d18/l93 0 2024-09-13T17:05:52.963 INFO:tasks.workunit.client.0.smithi115.stdout:8/425: dread - d0/d21/d3a/d60/f7a zero size 2024-09-13T17:05:52.967 INFO:tasks.workunit.client.1.smithi195.stdout:3/633: rename d7/d21/d2a/c97 to d7/d21/d2a/d35/d8f/d9f/cc7 0 2024-09-13T17:05:52.967 INFO:tasks.workunit.client.1.smithi195.stdout:0/626: sync 2024-09-13T17:05:52.968 INFO:tasks.workunit.client.0.smithi115.stdout:8/426: dread d0/d21/d3a/f3f [0,4194304] 0 2024-09-13T17:05:52.969 INFO:tasks.workunit.client.0.smithi115.stdout:1/417: mknod d5/d3e/c93 0 2024-09-13T17:05:52.970 INFO:tasks.workunit.client.0.smithi115.stdout:1/418: read d5/d7/f15 [57964,47133] 0 2024-09-13T17:05:52.970 INFO:tasks.workunit.client.0.smithi115.stdout:1/419: chown d5/d3e/d59/f8b 514 1 2024-09-13T17:05:52.972 INFO:tasks.workunit.client.0.smithi115.stdout:8/427: dread d0/d15/d44/f70 [0,4194304] 0 2024-09-13T17:05:52.972 INFO:tasks.workunit.client.1.smithi195.stdout:4/766: dwrite d1a/d1f/f20 [0,4194304] 0 2024-09-13T17:05:52.972 INFO:tasks.workunit.client.1.smithi195.stdout:4/767: read - d1a/d1f/d9c/dc2/fd2 zero size 2024-09-13T17:05:52.978 INFO:tasks.workunit.client.1.smithi195.stdout:8/670: stat d0/l2c 0 2024-09-13T17:05:52.981 INFO:tasks.workunit.client.0.smithi115.stdout:1/420: dread d5/d26/f4a [0,4194304] 0 2024-09-13T17:05:52.981 INFO:tasks.workunit.client.0.smithi115.stdout:1/421: chown d5/fc 10 1 2024-09-13T17:05:52.982 INFO:tasks.workunit.client.1.smithi195.stdout:3/634: truncate d7/f77 378368 0 2024-09-13T17:05:52.983 INFO:tasks.workunit.client.1.smithi195.stdout:0/627: dread d7/f53 [0,4194304] 0 2024-09-13T17:05:52.983 INFO:tasks.workunit.client.1.smithi195.stdout:0/628: chown d7/d50/f21 1 1 2024-09-13T17:05:52.983 INFO:tasks.workunit.client.0.smithi115.stdout:5/428: write d19/f1e [1993734,35652] 0 2024-09-13T17:05:52.985 INFO:tasks.workunit.client.0.smithi115.stdout:1/422: mknod d5/d3e/c94 0 2024-09-13T17:05:52.987 INFO:tasks.workunit.client.1.smithi195.stdout:4/768: mknod d1a/d1f/d43/d24/d41/cff 0 2024-09-13T17:05:52.988 INFO:tasks.workunit.client.0.smithi115.stdout:1/423: unlink d5/l3c 0 2024-09-13T17:05:52.988 INFO:tasks.workunit.client.0.smithi115.stdout:1/424: readlink d5/d7/l1e 0 2024-09-13T17:05:52.989 INFO:tasks.workunit.client.1.smithi195.stdout:8/671: symlink d0/d17/d2f/d7c/d4c/d9b/ddf/le7 0 2024-09-13T17:05:52.989 INFO:tasks.workunit.client.1.smithi195.stdout:3/635: dread d7/f61 [0,4194304] 0 2024-09-13T17:05:52.990 INFO:tasks.workunit.client.1.smithi195.stdout:0/629: mknod d7/db/d9a/ccc 0 2024-09-13T17:05:52.990 INFO:tasks.workunit.client.1.smithi195.stdout:0/630: readlink d7/d87/d9b/d4e/d68/lad 0 2024-09-13T17:05:52.991 INFO:tasks.workunit.client.1.smithi195.stdout:4/769: symlink d1a/d1f/d21/d84/l100 0 2024-09-13T17:05:52.992 INFO:tasks.workunit.client.1.smithi195.stdout:2/652: dwrite d0/d4a/d47/d73/d94/fb0 [0,4194304] 0 2024-09-13T17:05:52.993 INFO:tasks.workunit.client.1.smithi195.stdout:8/672: mkdir d0/d17/d49/d63/d71/de8 0 2024-09-13T17:05:52.994 INFO:tasks.workunit.client.1.smithi195.stdout:3/636: creat d7/d21/d2a/fc8 x:0 0 0 2024-09-13T17:05:52.994 INFO:tasks.workunit.client.1.smithi195.stdout:0/631: rmdir d7/db 39 2024-09-13T17:05:52.995 INFO:tasks.workunit.client.1.smithi195.stdout:0/632: readlink d7/d88/d7c/lba 0 2024-09-13T17:05:52.995 INFO:tasks.workunit.client.1.smithi195.stdout:0/633: chown d7/d88 2541 1 2024-09-13T17:05:52.995 INFO:tasks.workunit.client.0.smithi115.stdout:2/669: dwrite d3/d4d/de/d99/d9a/fb4 [0,4194304] 0 2024-09-13T17:05:52.996 INFO:tasks.workunit.client.1.smithi195.stdout:4/770: creat d1a/d1f/d9c/f101 x:0 0 0 2024-09-13T17:05:52.997 INFO:tasks.workunit.client.0.smithi115.stdout:5/429: dread d19/d21/f22 [0,4194304] 0 2024-09-13T17:05:53.000 INFO:tasks.workunit.client.0.smithi115.stdout:9/327: dwrite d0/de/d10/d15/f24 [0,4194304] 0 2024-09-13T17:05:53.000 INFO:tasks.workunit.client.0.smithi115.stdout:8/428: dwrite d0/d15/d44/f52 [0,4194304] 0 2024-09-13T17:05:53.000 INFO:tasks.workunit.client.0.smithi115.stdout:8/429: truncate d0/d15/d3e/f41 1132792 0 2024-09-13T17:05:53.000 INFO:tasks.workunit.client.0.smithi115.stdout:8/430: write d0/d18/d19/d28/f30 [5658640,3620] 0 2024-09-13T17:05:53.000 INFO:tasks.workunit.client.0.smithi115.stdout:8/431: write d0/f53 [920136,494] 0 2024-09-13T17:05:53.001 INFO:tasks.workunit.client.1.smithi195.stdout:2/653: dread d0/d4a/f3a [0,4194304] 0 2024-09-13T17:05:53.003 INFO:tasks.workunit.client.1.smithi195.stdout:3/637: creat d7/d21/d2a/d35/db7/fc9 x:0 0 0 2024-09-13T17:05:53.004 INFO:tasks.workunit.client.0.smithi115.stdout:2/670: creat d3/d4d/de/d98/fd0 x:0 0 0 2024-09-13T17:05:53.005 INFO:tasks.workunit.client.1.smithi195.stdout:0/634: mknod d7/db/ccd 0 2024-09-13T17:05:53.005 INFO:tasks.workunit.client.1.smithi195.stdout:0/635: dread - d7/d87/d9b/d56/d46/f8a zero size 2024-09-13T17:05:53.005 INFO:tasks.workunit.client.1.smithi195.stdout:0/636: fdatasync d7/d87/d9b/d56/d46/f74 0 2024-09-13T17:05:53.006 INFO:tasks.workunit.client.1.smithi195.stdout:4/771: mknod d1a/d1f/d9c/dc2/c102 0 2024-09-13T17:05:53.007 INFO:tasks.workunit.client.1.smithi195.stdout:4/772: chown d1a/d1f/d43/d24/l97 39 1 2024-09-13T17:05:53.007 INFO:tasks.workunit.client.1.smithi195.stdout:4/773: dread - d1a/d1f/d43/d5a/d63/fa9 zero size 2024-09-13T17:05:53.007 INFO:tasks.workunit.client.1.smithi195.stdout:4/774: truncate f16 1084127 0 2024-09-13T17:05:53.007 INFO:tasks.workunit.client.1.smithi195.stdout:4/775: read d1a/d1f/d21/d36/f46 [57937,50090] 0 2024-09-13T17:05:53.007 INFO:tasks.workunit.client.0.smithi115.stdout:5/430: mknod d19/d2b/d77/c89 0 2024-09-13T17:05:53.008 INFO:tasks.workunit.client.1.smithi195.stdout:8/673: dwrite d0/d4/f5a [0,4194304] 0 2024-09-13T17:05:53.009 INFO:tasks.workunit.client.0.smithi115.stdout:6/511: unlink d8/db/c6d 0 2024-09-13T17:05:53.010 INFO:tasks.workunit.client.1.smithi195.stdout:2/654: getdents d0/d3 0 2024-09-13T17:05:53.010 INFO:tasks.workunit.client.0.smithi115.stdout:9/328: rmdir d0/de 39 2024-09-13T17:05:53.013 INFO:tasks.workunit.client.1.smithi195.stdout:3/638: rename d7/d21/l4e to d7/d67/lca 0 2024-09-13T17:05:53.016 INFO:tasks.workunit.client.1.smithi195.stdout:4/776: mknod d1a/d1f/d21/d84/d9d/d8e/d9f/db2/c103 0 2024-09-13T17:05:53.019 INFO:tasks.workunit.client.1.smithi195.stdout:6/573: sync 2024-09-13T17:05:53.019 INFO:tasks.workunit.client.1.smithi195.stdout:6/574: readlink d1c/d24/d49/d5f/d35/lbd 0 2024-09-13T17:05:53.021 INFO:tasks.workunit.client.1.smithi195.stdout:2/655: mkdir d0/d4a/d47/d73/d75/d88/d1e/dd0 0 2024-09-13T17:05:53.022 INFO:tasks.workunit.client.1.smithi195.stdout:3/639: truncate d7/d21/d2a/d4a/f6e 1870166 0 2024-09-13T17:05:53.023 INFO:tasks.workunit.client.1.smithi195.stdout:4/777: dread d1a/d1f/d43/f3d [4194304,4194304] 0 2024-09-13T17:05:53.023 INFO:tasks.workunit.client.1.smithi195.stdout:4/778: dread - d1a/d1f/d43/d5a/d63/dd1/fea zero size 2024-09-13T17:05:53.024 INFO:tasks.workunit.client.1.smithi195.stdout:4/779: creat d1a/d1f/d21/f104 x:0 0 0 2024-09-13T17:05:53.024 INFO:tasks.workunit.client.0.smithi115.stdout:2/671: truncate d3/d4d/d13/f45 757895 0 2024-09-13T17:05:53.025 INFO:tasks.workunit.client.1.smithi195.stdout:6/575: creat d1c/d24/d49/d5f/db1/d95/fc5 x:0 0 0 2024-09-13T17:05:53.029 INFO:tasks.workunit.client.1.smithi195.stdout:2/656: mknod d0/d4a/d47/d73/d75/d88/d1e/cd1 0 2024-09-13T17:05:53.029 INFO:tasks.workunit.client.1.smithi195.stdout:2/657: write d0/d4a/d47/d73/d94/fc1 [871959,117819] 0 2024-09-13T17:05:53.029 INFO:tasks.workunit.client.1.smithi195.stdout:0/637: dwrite d7/d87/d9b/d56/d46/f6e [0,4194304] 0 2024-09-13T17:05:53.029 INFO:tasks.workunit.client.1.smithi195.stdout:0/638: write d7/d87/d9b/d56/d46/fc2 [139664,104485] 0 2024-09-13T17:05:53.029 INFO:tasks.workunit.client.1.smithi195.stdout:8/674: dwrite d0/d17/d2f/d31/f87 [0,4194304] 0 2024-09-13T17:05:53.029 INFO:tasks.workunit.client.1.smithi195.stdout:8/675: fsync d0/d4/f5e 0 2024-09-13T17:05:53.030 INFO:tasks.workunit.client.1.smithi195.stdout:0/639: read d7/d87/d9b/d56/d4d/d5e/f85 [72813,11054] 0 2024-09-13T17:05:53.030 INFO:tasks.workunit.client.1.smithi195.stdout:0/640: dread - d7/d87/d9b/d4e/d68/f78 zero size 2024-09-13T17:05:53.031 INFO:tasks.workunit.client.0.smithi115.stdout:9/329: creat d0/d21/d4f/f72 x:0 0 0 2024-09-13T17:05:53.032 INFO:tasks.workunit.client.1.smithi195.stdout:4/780: creat d1a/d1f/d43/d24/d41/d60/f105 x:0 0 0 2024-09-13T17:05:53.032 INFO:tasks.workunit.client.1.smithi195.stdout:4/781: dread - d1a/d1f/d21/d22/fb5 zero size 2024-09-13T17:05:53.032 INFO:tasks.workunit.client.0.smithi115.stdout:8/432: getdents d0/d18/d19/d28/d71 0 2024-09-13T17:05:53.032 INFO:tasks.workunit.client.0.smithi115.stdout:8/433: stat d0/d21/d3a/d60 0 2024-09-13T17:05:53.036 INFO:tasks.workunit.client.1.smithi195.stdout:8/676: dread d0/d17/d2f/d7c/f48 [0,4194304] 0 2024-09-13T17:05:53.060 INFO:tasks.workunit.client.1.smithi195.stdout:6/576: mkdir d1c/d24/d7f/dad/db9/d8c/da7/dc6 0 2024-09-13T17:05:53.061 INFO:tasks.workunit.client.1.smithi195.stdout:2/658: truncate d0/d4a/f3a 2199722 0 2024-09-13T17:05:53.074 INFO:tasks.workunit.client.1.smithi195.stdout:2/659: dwrite d0/d3/df/f10 [0,4194304] 0 2024-09-13T17:05:53.076 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:52 smithi195 ceph-mon[34981]: Updating smithi115:/var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T17:05:53.076 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:52 smithi195 ceph-mon[34981]: pgmap v15: 65 pgs: 65 active+clean; 1.9 GiB data, 5.6 GiB used, 531 GiB / 536 GiB avail; 198 MiB/s rd, 262 MiB/s wr, 361 op/s 2024-09-13T17:05:53.076 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:52 smithi195 ceph-mon[34981]: from='mgr.24317 ' entity='mgr.smithi195.hjjifz' 2024-09-13T17:05:53.076 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:52 smithi195 ceph-mon[34981]: from='mgr.24317 ' entity='mgr.smithi195.hjjifz' 2024-09-13T17:05:53.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:52 smithi195 ceph-mon[34981]: from='mgr.24317 ' entity='mgr.smithi195.hjjifz' 2024-09-13T17:05:53.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:52 smithi195 ceph-mon[34981]: Reconfiguring prometheus.smithi115 (dependencies changed)... 2024-09-13T17:05:53.084 INFO:tasks.workunit.client.1.smithi195.stdout:3/640: dwrite d7/f13 [0,4194304] 0 2024-09-13T17:05:53.085 INFO:tasks.workunit.client.1.smithi195.stdout:3/641: write d7/d62/d70/f90 [2556206,36200] 0 2024-09-13T17:05:53.096 INFO:tasks.workunit.client.0.smithi115.stdout:8/434: dwrite d0/d15/d3e/f41 [0,4194304] 0 2024-09-13T17:05:53.096 INFO:tasks.workunit.client.0.smithi115.stdout:8/435: fsync d0/fc 0 2024-09-13T17:05:53.098 INFO:tasks.workunit.client.1.smithi195.stdout:0/641: mknod d7/db/d38/d5d/cce 0 2024-09-13T17:05:53.099 INFO:tasks.workunit.client.1.smithi195.stdout:4/782: creat d1a/f106 x:0 0 0 2024-09-13T17:05:53.100 INFO:tasks.workunit.client.1.smithi195.stdout:8/677: mknod d0/d17/d49/d63/db3/ce9 0 2024-09-13T17:05:53.102 INFO:tasks.workunit.client.1.smithi195.stdout:6/577: mkdir d1c/d7d/dc7 0 2024-09-13T17:05:53.102 INFO:tasks.workunit.client.1.smithi195.stdout:6/578: chown d1c/d24/d7f/dad/db9/d30/f5b 0 1 2024-09-13T17:05:53.102 INFO:tasks.workunit.client.1.smithi195.stdout:6/579: chown d1c/d24/d49/d5f/d35/d88/fb2 113005 1 2024-09-13T17:05:53.105 INFO:tasks.workunit.client.1.smithi195.stdout:9/711: sync 2024-09-13T17:05:53.105 INFO:tasks.workunit.client.1.smithi195.stdout:7/676: sync 2024-09-13T17:05:53.105 INFO:tasks.workunit.client.1.smithi195.stdout:5/639: sync 2024-09-13T17:05:53.105 INFO:tasks.workunit.client.1.smithi195.stdout:5/640: dread - d2/d12/d3f/f70 zero size 2024-09-13T17:05:53.105 INFO:tasks.workunit.client.1.smithi195.stdout:2/660: creat d0/d4a/d47/d73/d75/d88/d8e/dcf/fd2 x:0 0 0 2024-09-13T17:05:53.106 INFO:tasks.workunit.client.0.smithi115.stdout:6/512: rmdir d8 39 2024-09-13T17:05:53.107 INFO:tasks.workunit.client.1.smithi195.stdout:1/596: sync 2024-09-13T17:05:53.108 INFO:tasks.workunit.client.0.smithi115.stdout:9/330: creat d0/f73 x:0 0 0 2024-09-13T17:05:53.110 INFO:tasks.workunit.client.1.smithi195.stdout:3/642: symlink d7/d21/d2a/lcb 0 2024-09-13T17:05:53.110 INFO:tasks.workunit.client.1.smithi195.stdout:3/643: chown d7/d21/d2a/d4a/fbe 70652 1 2024-09-13T17:05:53.110 INFO:tasks.workunit.client.0.smithi115.stdout:2/672: getdents d3/d4d/dd/df/d57/d8b 0 2024-09-13T17:05:53.111 INFO:tasks.workunit.client.1.smithi195.stdout:5/641: dread d2/d12/f50 [0,4194304] 0 2024-09-13T17:05:53.111 INFO:tasks.workunit.client.1.smithi195.stdout:4/783: dread d1a/d1f/d21/d84/d9d/f2a [0,4194304] 0 2024-09-13T17:05:53.111 INFO:tasks.workunit.client.1.smithi195.stdout:0/642: rmdir d7/db/d9a 39 2024-09-13T17:05:53.111 INFO:tasks.workunit.client.1.smithi195.stdout:0/643: stat d7/d88/d23/fcb 0 2024-09-13T17:05:53.114 INFO:tasks.workunit.client.1.smithi195.stdout:6/580: truncate d1c/d24/d49/d5f/d35/f36 3111933 0 2024-09-13T17:05:53.114 INFO:tasks.workunit.client.1.smithi195.stdout:6/581: chown d1c/d24/d7f/dad/db9/d30/f5b 261 1 2024-09-13T17:05:53.115 INFO:tasks.workunit.client.0.smithi115.stdout:8/436: mkdir d0/d42/d80/d94 0 2024-09-13T17:05:53.115 INFO:tasks.workunit.client.0.smithi115.stdout:8/437: readlink d0/d15/l17 0 2024-09-13T17:05:53.119 INFO:tasks.workunit.client.0.smithi115.stdout:6/513: creat d8/d33/d40/d4c/fa0 x:0 0 0 2024-09-13T17:05:53.119 INFO:tasks.workunit.client.0.smithi115.stdout:6/514: fsync d8/d13/f19 0 2024-09-13T17:05:53.120 INFO:tasks.workunit.client.1.smithi195.stdout:7/677: rename d5/db/d50/d7f/d82/de6/le7 to d5/d13/d30/lec 0 2024-09-13T17:05:53.120 INFO:tasks.workunit.client.1.smithi195.stdout:0/644: dread d7/db/f7a [0,4194304] 0 2024-09-13T17:05:53.121 INFO:tasks.workunit.client.0.smithi115.stdout:9/331: link d0/f1f d0/de/d10/f74 0 2024-09-13T17:05:53.122 INFO:tasks.workunit.client.1.smithi195.stdout:2/661: mknod d0/d4a/d47/d73/d94/cd3 0 2024-09-13T17:05:53.125 INFO:tasks.workunit.client.0.smithi115.stdout:2/673: creat d3/d4d/dd/df/d57/fd1 x:0 0 0 2024-09-13T17:05:53.126 INFO:tasks.workunit.client.1.smithi195.stdout:1/597: mknod db/ccf 0 2024-09-13T17:05:53.126 INFO:tasks.workunit.client.1.smithi195.stdout:1/598: chown db/f97 452713 1 2024-09-13T17:05:53.129 INFO:tasks.workunit.client.0.smithi115.stdout:8/438: rename d0/d18/d19/d2b/d3b/d85 to d0/d95 0 2024-09-13T17:05:53.130 INFO:tasks.workunit.client.0.smithi115.stdout:6/515: write d8/db/d1d/f26 [192799,2822] 0 2024-09-13T17:05:53.131 INFO:tasks.workunit.client.0.smithi115.stdout:6/516: fsync d8/db/d1d/f18 0 2024-09-13T17:05:53.132 INFO:tasks.workunit.client.1.smithi195.stdout:8/678: mkdir d0/d17/d2f/d31/dea 0 2024-09-13T17:05:53.133 INFO:tasks.workunit.client.0.smithi115.stdout:9/332: dread d0/f31 [0,4194304] 0 2024-09-13T17:05:53.133 INFO:tasks.workunit.client.0.smithi115.stdout:2/674: symlink d3/ld2 0 2024-09-13T17:05:53.133 INFO:tasks.workunit.client.0.smithi115.stdout:2/675: dread - d3/d4d/dd/df/d57/d8b/fcc zero size 2024-09-13T17:05:53.133 INFO:tasks.workunit.client.0.smithi115.stdout:2/676: fsync d3/d4d/d13/d39/d46/da0/fbc 0 2024-09-13T17:05:53.133 INFO:tasks.workunit.client.0.smithi115.stdout:2/677: truncate d3/d4d/dd/df/d57/fd1 447646 0 2024-09-13T17:05:53.133 INFO:tasks.workunit.client.1.smithi195.stdout:6/582: truncate d1c/d3e/f47 3536652 0 2024-09-13T17:05:53.134 INFO:tasks.workunit.client.1.smithi195.stdout:6/583: write d1c/d24/d7f/dad/db9/d30/d6f/fc2 [1606274,121327] 0 2024-09-13T17:05:53.136 INFO:tasks.workunit.client.0.smithi115.stdout:8/439: link d0/d15/f1b d0/d21/f96 0 2024-09-13T17:05:53.136 INFO:tasks.workunit.client.0.smithi115.stdout:8/440: fdatasync d0/d18/d19/d2b/d37/f64 0 2024-09-13T17:05:53.136 INFO:tasks.workunit.client.0.smithi115.stdout:6/517: dread d8/d13/d15/f65 [0,4194304] 0 2024-09-13T17:05:53.138 INFO:tasks.workunit.client.1.smithi195.stdout:6/584: dread d1c/d24/d7f/dad/db9/d5e/f74 [0,4194304] 0 2024-09-13T17:05:53.138 INFO:tasks.workunit.client.1.smithi195.stdout:6/585: chown d1c/d24/d49/d5f/d35/d88/fb2 9 1 2024-09-13T17:05:53.138 INFO:tasks.workunit.client.0.smithi115.stdout:6/518: write d8/d33/d40/f5c [757518,100066] 0 2024-09-13T17:05:53.139 INFO:tasks.workunit.client.1.smithi195.stdout:6/586: dread d1c/d24/d49/f4c [0,4194304] 0 2024-09-13T17:05:53.139 INFO:tasks.workunit.client.1.smithi195.stdout:6/587: chown d1c/d24/d7f/dad/db9/d30/d6f/cab 1833 1 2024-09-13T17:05:53.139 INFO:tasks.workunit.client.1.smithi195.stdout:4/784: dwrite f16 [0,4194304] 0 2024-09-13T17:05:53.139 INFO:tasks.workunit.client.0.smithi115.stdout:2/678: creat d3/d4d/dd/df/d5b/fd3 x:0 0 0 2024-09-13T17:05:53.141 INFO:tasks.workunit.client.1.smithi195.stdout:9/712: rmdir d6/d19/d21/d45 39 2024-09-13T17:05:53.141 INFO:tasks.workunit.client.1.smithi195.stdout:9/713: write d6/f69 [3322052,66182] 0 2024-09-13T17:05:53.141 INFO:tasks.workunit.client.1.smithi195.stdout:9/714: chown d6/df/d16/d5c/dcf/cef 5673473 1 2024-09-13T17:05:53.141 INFO:tasks.workunit.client.1.smithi195.stdout:9/715: stat d6/d12/dbc/cc6 0 2024-09-13T17:05:53.143 INFO:tasks.workunit.client.1.smithi195.stdout:3/644: rename d7/d21/d2a/d35/d60/l93 to d7/d21/d2a/d4a/d5a/lcc 0 2024-09-13T17:05:53.145 INFO:tasks.workunit.client.1.smithi195.stdout:7/678: creat d5/db/d19/fed x:0 0 0 2024-09-13T17:05:53.146 INFO:tasks.workunit.client.0.smithi115.stdout:8/441: dread d0/f13 [0,4194304] 0 2024-09-13T17:05:53.147 INFO:tasks.workunit.client.1.smithi195.stdout:8/679: read d0/d17/f68 [1441379,70786] 0 2024-09-13T17:05:53.148 INFO:tasks.workunit.client.1.smithi195.stdout:5/642: dwrite d2/df/d78/d76/f8d [0,4194304] 0 2024-09-13T17:05:53.149 INFO:tasks.workunit.client.1.smithi195.stdout:0/645: dwrite d7/d87/d9b/d56/d4d/d5e/f71 [0,4194304] 0 2024-09-13T17:05:53.149 INFO:tasks.workunit.client.1.smithi195.stdout:1/599: dwrite db/df/f39 [0,4194304] 0 2024-09-13T17:05:53.149 INFO:tasks.workunit.client.1.smithi195.stdout:6/588: unlink d1c/d24/d7f/dad/db9/d5e/f74 0 2024-09-13T17:05:53.154 INFO:tasks.workunit.client.1.smithi195.stdout:0/646: dread d7/db/d38/d5d/f72 [0,4194304] 0 2024-09-13T17:05:53.155 INFO:tasks.workunit.client.1.smithi195.stdout:0/647: stat d7/d88/fe 0 2024-09-13T17:05:53.159 INFO:tasks.workunit.client.0.smithi115.stdout:9/333: rmdir d0 39 2024-09-13T17:05:53.160 INFO:tasks.workunit.client.1.smithi195.stdout:2/662: rmdir d0/d4a/d47/d73/d75/d88/d2c/d51 39 2024-09-13T17:05:53.160 INFO:tasks.workunit.client.1.smithi195.stdout:2/663: chown d0/d4a/d47/d73/d75/d88/d2c/cb7 2886060 1 2024-09-13T17:05:53.160 INFO:tasks.workunit.client.1.smithi195.stdout:2/664: fdatasync d0/d4a/d47/d73/d75/d88/d2c/d51/f81 0 2024-09-13T17:05:53.163 INFO:tasks.workunit.client.0.smithi115.stdout:6/519: creat d8/db/d1d/fa1 x:0 0 0 2024-09-13T17:05:53.165 INFO:tasks.workunit.client.0.smithi115.stdout:2/679: creat d3/fd4 x:0 0 0 2024-09-13T17:05:53.167 INFO:tasks.workunit.client.1.smithi195.stdout:8/680: dwrite d0/dda/fd0 [0,4194304] 0 2024-09-13T17:05:53.167 INFO:tasks.workunit.client.1.smithi195.stdout:8/681: write d0/d17/d2f/d7c/f48 [1383185,38362] 0 2024-09-13T17:05:53.167 INFO:tasks.workunit.client.1.smithi195.stdout:5/643: unlink d2/df/d78/f4f 0 2024-09-13T17:05:53.168 INFO:tasks.workunit.client.0.smithi115.stdout:8/442: symlink d0/d21/l97 0 2024-09-13T17:05:53.170 INFO:tasks.workunit.client.0.smithi115.stdout:9/334: rename d0/de/d10/f4a to d0/de/d37/d5a/f75 0 2024-09-13T17:05:53.173 INFO:tasks.workunit.client.1.smithi195.stdout:0/648: dwrite d7/db/f7a [4194304,4194304] 0 2024-09-13T17:05:53.173 INFO:tasks.workunit.client.1.smithi195.stdout:0/649: chown d7/db/d38/l6d 482 1 2024-09-13T17:05:53.173 INFO:tasks.workunit.client.1.smithi195.stdout:0/650: write d7/d87/d9b/d56/d46/f91 [1167298,44369] 0 2024-09-13T17:05:53.173 INFO:tasks.workunit.client.0.smithi115.stdout:2/680: creat d3/d4d/dd/d1f/d2f/fd5 x:0 0 0 2024-09-13T17:05:53.175 INFO:tasks.workunit.client.1.smithi195.stdout:1/600: mkdir db/d19/d5a/d66/d96/dd0 0 2024-09-13T17:05:53.175 INFO:tasks.workunit.client.1.smithi195.stdout:1/601: truncate db/df/d4d/d74/f76 1664159 0 2024-09-13T17:05:53.175 INFO:tasks.workunit.client.1.smithi195.stdout:1/602: creat db/df/d51/d8e/fd1 x:0 0 0 2024-09-13T17:05:53.177 INFO:tasks.workunit.client.1.smithi195.stdout:6/589: symlink d1c/d24/d49/d5f/d85/da5/lc8 0 2024-09-13T17:05:53.177 INFO:tasks.workunit.client.1.smithi195.stdout:6/590: chown d1c/f63 620007 1 2024-09-13T17:05:53.179 INFO:tasks.workunit.client.0.smithi115.stdout:8/443: write d0/d21/d3a/d60/f78 [1961099,5756] 0 2024-09-13T17:05:53.179 INFO:tasks.workunit.client.0.smithi115.stdout:9/335: mknod d0/d21/d42/c76 0 2024-09-13T17:05:53.179 INFO:tasks.workunit.client.0.smithi115.stdout:9/336: readlink d0/de/d37/l63 0 2024-09-13T17:05:53.180 INFO:tasks.workunit.client.0.smithi115.stdout:6/520: mkdir d8/db/dd/da2 0 2024-09-13T17:05:53.180 INFO:tasks.workunit.client.0.smithi115.stdout:6/521: chown d8/d13/d15/d24/d53/c9f 714595480 1 2024-09-13T17:05:53.181 INFO:tasks.workunit.client.0.smithi115.stdout:6/522: fsync d8/db/d1d/f18 0 2024-09-13T17:05:53.181 INFO:tasks.workunit.client.1.smithi195.stdout:5/644: dwrite d2/df/d78/d54/d58/f85 [0,4194304] 0 2024-09-13T17:05:53.181 INFO:tasks.workunit.client.1.smithi195.stdout:5/645: chown d2/df/d78/d99/lb3 2631 1 2024-09-13T17:05:53.181 INFO:tasks.workunit.client.1.smithi195.stdout:5/646: truncate d2/df/d78/d54/d58/f85 4430441 0 2024-09-13T17:05:53.181 INFO:tasks.workunit.client.1.smithi195.stdout:5/647: fdatasync d2/d12/d4e/d10/f66 0 2024-09-13T17:05:53.182 INFO:tasks.workunit.client.0.smithi115.stdout:2/681: symlink d3/d4d/dd/d1f/d2f/ld6 0 2024-09-13T17:05:53.185 INFO:tasks.workunit.client.1.smithi195.stdout:4/785: getdents d1a/d1f/d43 0 2024-09-13T17:05:53.186 INFO:tasks.workunit.client.0.smithi115.stdout:8/444: mkdir d0/d26/d29/d98 0 2024-09-13T17:05:53.187 INFO:tasks.workunit.client.1.smithi195.stdout:2/665: mknod d0/d4a/d47/d73/d75/d88/d2c/d43/d63/cd4 0 2024-09-13T17:05:53.187 INFO:tasks.workunit.client.0.smithi115.stdout:9/337: truncate d0/f8 2144421 0 2024-09-13T17:05:53.188 INFO:tasks.workunit.client.0.smithi115.stdout:6/523: getdents d8/d33/d82/d80 0 2024-09-13T17:05:53.191 INFO:tasks.workunit.client.1.smithi195.stdout:1/603: dwrite db/df/d4d/d74/da8/fb2 [0,4194304] 0 2024-09-13T17:05:53.191 INFO:tasks.workunit.client.1.smithi195.stdout:1/604: fdatasync db/df/d13/f2e 0 2024-09-13T17:05:53.191 INFO:tasks.workunit.client.0.smithi115.stdout:8/445: rename d0/d18/d19/d28/l31 to d0/d18/d19/d28/d4f/l99 0 2024-09-13T17:05:53.193 INFO:tasks.workunit.client.0.smithi115.stdout:2/682: write d3/d4d/dd/d1f/d2f/d56/f26 [2438357,87867] 0 2024-09-13T17:05:53.194 INFO:tasks.workunit.client.1.smithi195.stdout:2/666: dread d0/d3/f4 [0,4194304] 0 2024-09-13T17:05:53.194 INFO:tasks.workunit.client.1.smithi195.stdout:2/667: creat d0/d4a/d47/d73/d94/fd5 x:0 0 0 2024-09-13T17:05:53.196 INFO:tasks.workunit.client.0.smithi115.stdout:8/446: creat d0/d18/f9a x:0 0 0 2024-09-13T17:05:53.196 INFO:tasks.workunit.client.0.smithi115.stdout:8/447: readlink d0/d18/d19/d2b/l2c 0 2024-09-13T17:05:53.197 INFO:tasks.workunit.client.1.smithi195.stdout:0/651: unlink d7/d87/d9b/d56/d4d/d9d/lc9 0 2024-09-13T17:05:53.198 INFO:tasks.workunit.client.1.smithi195.stdout:0/652: chown d7/d87/d9b/d56/d46/cc7 203243377 1 2024-09-13T17:05:53.200 INFO:tasks.workunit.client.0.smithi115.stdout:9/338: rename d0/l6e to d0/d21/d65/l77 0 2024-09-13T17:05:53.200 INFO:tasks.workunit.client.0.smithi115.stdout:9/339: fsync d0/de/d10/f14 0 2024-09-13T17:05:53.201 INFO:tasks.workunit.client.0.smithi115.stdout:8/448: creat d0/d26/f9b x:0 0 0 2024-09-13T17:05:53.202 INFO:tasks.workunit.client.0.smithi115.stdout:6/524: dwrite d8/f76 [0,4194304] 0 2024-09-13T17:05:53.202 INFO:tasks.workunit.client.0.smithi115.stdout:6/525: chown d8/d13/d15/f65 1062 1 2024-09-13T17:05:53.203 INFO:tasks.workunit.client.0.smithi115.stdout:6/526: chown d8 1 1 2024-09-13T17:05:53.203 INFO:tasks.workunit.client.1.smithi195.stdout:6/591: symlink d1c/d24/d49/d5f/d85/da5/lc9 0 2024-09-13T17:05:53.203 INFO:tasks.workunit.client.1.smithi195.stdout:6/592: read - d1c/d24/d7f/f8d zero size 2024-09-13T17:05:53.207 INFO:tasks.workunit.client.0.smithi115.stdout:6/527: dread d8/db/dd/f3a [0,4194304] 0 2024-09-13T17:05:53.207 INFO:tasks.workunit.client.0.smithi115.stdout:9/340: getdents d0/d21/d4f 0 2024-09-13T17:05:53.211 INFO:tasks.workunit.client.1.smithi195.stdout:5/648: truncate d2/d3e/f16 7124378 0 2024-09-13T17:05:53.211 INFO:tasks.workunit.client.1.smithi195.stdout:5/649: fdatasync d2/df/d78/d99/fbf 0 2024-09-13T17:05:53.212 INFO:tasks.workunit.client.1.smithi195.stdout:5/650: read - d2/d3e/fd1 zero size 2024-09-13T17:05:53.213 INFO:tasks.workunit.client.1.smithi195.stdout:5/651: dread d2/df/d48/d5a/f8c [0,4194304] 0 2024-09-13T17:05:53.234 INFO:tasks.workunit.client.1.smithi195.stdout:5/652: fsync d2/d3e/f3a 0 2024-09-13T17:05:53.235 INFO:tasks.workunit.client.1.smithi195.stdout:5/653: write d2/df/d78/d54/fa7 [345738,44005] 0 2024-09-13T17:05:53.235 INFO:tasks.workunit.client.1.smithi195.stdout:5/654: fsync d2/d12/d4e/d10/d8f/fbc 0 2024-09-13T17:05:53.236 INFO:tasks.workunit.client.1.smithi195.stdout:4/786: mkdir d1a/d1f/d21/d22/d107 0 2024-09-13T17:05:53.236 INFO:tasks.workunit.client.1.smithi195.stdout:1/605: creat db/df/d51/fd2 x:0 0 0 2024-09-13T17:05:53.236 INFO:tasks.workunit.client.1.smithi195.stdout:2/668: rmdir d0/d3/d3d 39 2024-09-13T17:05:53.236 INFO:tasks.workunit.client.0.smithi115.stdout:6/528: chown d8/db/f5d 0 1 2024-09-13T17:05:53.236 INFO:tasks.workunit.client.0.smithi115.stdout:6/529: chown d8/d13/d15/d24/f1e 132639627 1 2024-09-13T17:05:53.237 INFO:tasks.workunit.client.0.smithi115.stdout:9/341: dread d0/de/d37/f41 [0,4194304] 0 2024-09-13T17:05:53.237 INFO:tasks.workunit.client.0.smithi115.stdout:8/449: dwrite d0/d18/d19/d2b/d37/f64 [0,4194304] 0 2024-09-13T17:05:53.237 INFO:tasks.workunit.client.0.smithi115.stdout:8/450: readlink d0/l77 0 2024-09-13T17:05:53.237 INFO:tasks.workunit.client.0.smithi115.stdout:2/683: rename d3/d4d/dd/d1f/d2f to d3/d4d/d13/d62/d92/dd7 0 2024-09-13T17:05:53.237 INFO:tasks.workunit.client.0.smithi115.stdout:2/684: write d3/d4d/dd/df/f24 [2106000,60904] 0 2024-09-13T17:05:53.237 INFO:tasks.workunit.client.0.smithi115.stdout:2/685: chown d3/d4d/d13/da2/cce 1756 1 2024-09-13T17:05:53.237 INFO:tasks.workunit.client.0.smithi115.stdout:8/451: write d0/f13 [4151332,47702] 0 2024-09-13T17:05:53.237 INFO:tasks.workunit.client.0.smithi115.stdout:6/530: truncate d8/db/d49/f4d 3247031 0 2024-09-13T17:05:53.237 INFO:tasks.workunit.client.1.smithi195.stdout:6/593: truncate d1c/d24/d7f/dad/db9/d30/f5b 3598447 0 2024-09-13T17:05:53.242 INFO:tasks.workunit.client.1.smithi195.stdout:0/653: rmdir d7/d50 39 2024-09-13T17:05:53.242 INFO:tasks.workunit.client.1.smithi195.stdout:2/669: dread d0/f24 [0,4194304] 0 2024-09-13T17:05:53.245 INFO:tasks.workunit.client.1.smithi195.stdout:1/606: rename db/df/d13/f86 to db/d19/d5a/fd3 0 2024-09-13T17:05:53.246 INFO:tasks.workunit.client.1.smithi195.stdout:6/594: getdents d1c/d24/d7f/dad/db9/d5e 0 2024-09-13T17:05:53.246 INFO:tasks.workunit.client.1.smithi195.stdout:2/670: symlink d0/d4a/d47/d73/d75/d88/d1e/dd0/ld6 0 2024-09-13T17:05:53.247 INFO:tasks.workunit.client.1.smithi195.stdout:6/595: symlink d1c/d24/d49/d5f/d35/lca 0 2024-09-13T17:05:53.248 INFO:tasks.workunit.client.1.smithi195.stdout:2/671: truncate d0/d3/f4e 2884226 0 2024-09-13T17:05:53.250 INFO:tasks.workunit.client.1.smithi195.stdout:6/596: rename d1c/d7d/d9c/cb4 to d1c/d24/d7f/dad/db9/d30/d6f/ccb 0 2024-09-13T17:05:53.250 INFO:tasks.workunit.client.1.smithi195.stdout:6/597: fsync d1c/d24/d7f/dad/db9/f55 0 2024-09-13T17:05:53.252 INFO:tasks.workunit.client.1.smithi195.stdout:6/598: rename d1c/d24/d7f/c94 to d1c/d24/d7f/dad/db9/d30/d6f/ccc 0 2024-09-13T17:05:53.257 INFO:tasks.workunit.client.1.smithi195.stdout:1/607: dread db/f6b [0,4194304] 0 2024-09-13T17:05:53.263 INFO:tasks.workunit.client.1.smithi195.stdout:1/608: dread db/df/d4d/d74/fbd [0,4194304] 0 2024-09-13T17:05:53.264 INFO:tasks.workunit.client.1.smithi195.stdout:1/609: stat db/l87 0 2024-09-13T17:05:53.264 INFO:tasks.workunit.client.1.smithi195.stdout:1/610: creat db/d19/d5a/fd4 x:0 0 0 2024-09-13T17:05:53.270 INFO:tasks.workunit.client.0.smithi115.stdout:6/531: read d8/f76 [4030782,14904] 0 2024-09-13T17:05:53.271 INFO:tasks.workunit.client.1.smithi195.stdout:1/611: dread db/df/d13/f4b [0,4194304] 0 2024-09-13T17:05:53.271 INFO:tasks.workunit.client.1.smithi195.stdout:1/612: write db/d19/d37/f6a [514755,40827] 0 2024-09-13T17:05:53.272 INFO:tasks.workunit.client.1.smithi195.stdout:1/613: unlink l7 0 2024-09-13T17:05:53.273 INFO:tasks.workunit.client.1.smithi195.stdout:1/614: mknod db/d60/cd5 0 2024-09-13T17:05:53.273 INFO:tasks.workunit.client.1.smithi195.stdout:1/615: stat db/df/d13/da7/lcd 0 2024-09-13T17:05:53.274 INFO:tasks.workunit.client.1.smithi195.stdout:1/616: link db/df/d13/f8d db/d58/fd6 0 2024-09-13T17:05:53.277 INFO:tasks.workunit.client.0.smithi115.stdout:9/342: dwrite d0/de/d10/f74 [0,4194304] 0 2024-09-13T17:05:53.286 INFO:tasks.workunit.client.1.smithi195.stdout:5/655: dwrite d2/df/d78/f8b [0,4194304] 0 2024-09-13T17:05:53.292 INFO:tasks.workunit.client.0.smithi115.stdout:9/343: write d0/de/d10/f74 [4144655,15795] 0 2024-09-13T17:05:53.292 INFO:tasks.workunit.client.0.smithi115.stdout:9/344: write d0/de/d10/f60 [520614,33003] 0 2024-09-13T17:05:53.292 INFO:tasks.workunit.client.0.smithi115.stdout:9/345: chown d0/d21/l26 129 1 2024-09-13T17:05:53.292 INFO:tasks.workunit.client.0.smithi115.stdout:9/346: chown d0/fb 2 1 2024-09-13T17:05:53.292 INFO:tasks.workunit.client.0.smithi115.stdout:9/347: chown d0/d21/d42/f5f 41043530 1 2024-09-13T17:05:53.294 INFO:tasks.workunit.client.0.smithi115.stdout:2/686: dwrite d3/d4d/d13/d62/d92/dd7/d56/f9e [0,4194304] 0 2024-09-13T17:05:53.295 INFO:tasks.workunit.client.1.smithi195.stdout:4/787: dwrite d1a/d1f/d43/d24/f3e [0,4194304] 0 2024-09-13T17:05:53.295 INFO:tasks.workunit.client.1.smithi195.stdout:4/788: chown d1a/d1f/d9c/lb1 102558465 1 2024-09-13T17:05:53.295 INFO:tasks.workunit.client.1.smithi195.stdout:6/599: dwrite d1c/fa2 [0,4194304] 0 2024-09-13T17:05:53.296 INFO:tasks.workunit.client.1.smithi195.stdout:0/654: dwrite d7/d88/f7e [0,4194304] 0 2024-09-13T17:05:53.296 INFO:tasks.workunit.client.1.smithi195.stdout:0/655: readlink d7/db/d38/d5d/l6b 0 2024-09-13T17:05:53.296 INFO:tasks.workunit.client.0.smithi115.stdout:8/452: dwrite d0/d21/d3a/d60/f7a [0,4194304] 0 2024-09-13T17:05:53.296 INFO:tasks.workunit.client.0.smithi115.stdout:8/453: chown d0/d18/d51/c5d 465245118 1 2024-09-13T17:05:53.298 INFO:tasks.workunit.client.1.smithi195.stdout:2/672: dwrite d0/f45 [0,4194304] 0 2024-09-13T17:05:53.298 INFO:tasks.workunit.client.1.smithi195.stdout:2/673: write d0/d4a/d47/d73/d75/d88/d2c/d43/d84/fa3 [118659,20461] 0 2024-09-13T17:05:53.298 INFO:tasks.workunit.client.1.smithi195.stdout:2/674: chown d0/d4a/d47/d73/d75/d88/d2c/d43/d63/db2/cc4 99 1 2024-09-13T17:05:53.299 INFO:tasks.workunit.client.1.smithi195.stdout:7/679: sync 2024-09-13T17:05:53.300 INFO:tasks.workunit.client.1.smithi195.stdout:3/645: sync 2024-09-13T17:05:53.300 INFO:tasks.workunit.client.1.smithi195.stdout:9/716: sync 2024-09-13T17:05:53.300 INFO:tasks.workunit.client.1.smithi195.stdout:5/656: dread d2/d12/d4e/d10/d46/f64 [0,4194304] 0 2024-09-13T17:05:53.301 INFO:tasks.workunit.client.1.smithi195.stdout:4/789: mkdir d1a/d1f/d108 0 2024-09-13T17:05:53.305 INFO:tasks.workunit.client.1.smithi195.stdout:5/657: dread d2/d12/d4e/d10/d46/f64 [0,4194304] 0 2024-09-13T17:05:53.308 INFO:tasks.workunit.client.1.smithi195.stdout:6/600: rename d1c/d7d/d9c to d1c/d24/d49/d5f/db1/dcd 0 2024-09-13T17:05:53.311 INFO:tasks.workunit.client.0.smithi115.stdout:8/454: creat d0/d18/d51/f9c x:0 0 0 2024-09-13T17:05:53.312 INFO:tasks.workunit.client.1.smithi195.stdout:0/656: mknod d7/d50/da2/ccf 0 2024-09-13T17:05:53.312 INFO:tasks.workunit.client.1.smithi195.stdout:0/657: write d7/d87/d9b/d56/d46/f48 [1555407,84951] 0 2024-09-13T17:05:53.313 INFO:tasks.workunit.client.0.smithi115.stdout:2/687: rmdir d3/d4d/dd/df/d57 39 2024-09-13T17:05:53.315 INFO:tasks.workunit.client.1.smithi195.stdout:2/675: mkdir d0/d4a/d47/d73/d75/d88/d2c/dd7 0 2024-09-13T17:05:53.316 INFO:tasks.workunit.client.0.smithi115.stdout:8/455: truncate d0/d15/d44/f52 1410514 0 2024-09-13T17:05:53.316 INFO:tasks.workunit.client.0.smithi115.stdout:8/456: write d0/d21/d3a/f3f [59006,29543] 0 2024-09-13T17:05:53.318 INFO:tasks.workunit.client.1.smithi195.stdout:8/682: sync 2024-09-13T17:05:53.318 INFO:tasks.workunit.client.1.smithi195.stdout:3/646: creat d7/d21/d2a/d35/d8f/fcd x:0 0 0 2024-09-13T17:05:53.318 INFO:tasks.workunit.client.1.smithi195.stdout:3/647: stat d7/d19/d1e/cb1 0 2024-09-13T17:05:53.318 INFO:tasks.workunit.client.1.smithi195.stdout:3/648: fdatasync d7/d21/f59 0 2024-09-13T17:05:53.318 INFO:tasks.workunit.client.1.smithi195.stdout:3/649: write d7/d19/d1e/f50 [2281838,5613] 0 2024-09-13T17:05:53.318 INFO:tasks.workunit.client.1.smithi195.stdout:3/650: chown d7/d21/d2a/d35/d60/d64/f78 630 1 2024-09-13T17:05:53.318 INFO:tasks.workunit.client.0.smithi115.stdout:2/688: creat d3/d4d/d13/da2/fd8 x:0 0 0 2024-09-13T17:05:53.319 INFO:tasks.workunit.client.0.smithi115.stdout:2/689: dread - d3/d4d/d13/d39/d46/da0/fbc zero size 2024-09-13T17:05:53.320 INFO:tasks.workunit.client.1.smithi195.stdout:7/680: symlink d5/db/d19/d22/d3c/lee 0 2024-09-13T17:05:53.322 INFO:tasks.workunit.client.1.smithi195.stdout:0/658: dread d7/db/d11/f61 [0,4194304] 0 2024-09-13T17:05:53.322 INFO:tasks.workunit.client.1.smithi195.stdout:0/659: fdatasync d7/d87/d9b/d56/d46/f49 0 2024-09-13T17:05:53.322 INFO:tasks.workunit.client.1.smithi195.stdout:9/717: mknod d6/d12/d86/cf3 0 2024-09-13T17:05:53.323 INFO:tasks.workunit.client.0.smithi115.stdout:8/457: rename d0/d15/d3e/f69 to d0/d18/d19/d28/f9d 0 2024-09-13T17:05:53.325 INFO:tasks.workunit.client.1.smithi195.stdout:9/718: dread d6/df/d16/d5c/f7a [0,4194304] 0 2024-09-13T17:05:53.325 INFO:tasks.workunit.client.1.smithi195.stdout:4/790: rmdir d1a/d1f/d43/d5a/d63/dd1/db4/df3 0 2024-09-13T17:05:53.327 INFO:tasks.workunit.client.1.smithi195.stdout:6/601: dwrite d1c/d24/d7f/dad/db9/d8c/f99 [8388608,4194304] 0 2024-09-13T17:05:53.327 INFO:tasks.workunit.client.1.smithi195.stdout:6/602: chown d1c/c2f 29 1 2024-09-13T17:05:53.327 INFO:tasks.workunit.client.1.smithi195.stdout:6/603: chown d1c/d24/d49/d5f/d85/da5 6690850 1 2024-09-13T17:05:53.327 INFO:tasks.workunit.client.1.smithi195.stdout:5/658: creat d2/d12/d3f/d7b/fda x:0 0 0 2024-09-13T17:05:53.328 INFO:tasks.workunit.client.1.smithi195.stdout:2/676: unlink d0/c7 0 2024-09-13T17:05:53.329 INFO:tasks.workunit.client.1.smithi195.stdout:8/683: rename d0/d17/d2f/d7c/d4b to d0/d17/d49/d63/db3/deb 0 2024-09-13T17:05:53.330 INFO:tasks.workunit.client.1.smithi195.stdout:8/684: chown d0/d17/d2f/d31/c3b 13824 1 2024-09-13T17:05:53.330 INFO:tasks.workunit.client.1.smithi195.stdout:8/685: chown d0/l5c 2146802 1 2024-09-13T17:05:53.331 INFO:tasks.workunit.client.0.smithi115.stdout:2/690: write d3/f8a [471709,52010] 0 2024-09-13T17:05:53.333 INFO:tasks.workunit.client.1.smithi195.stdout:3/651: mknod d7/d21/d2a/d4a/d71/cce 0 2024-09-13T17:05:53.337 INFO:tasks.workunit.client.1.smithi195.stdout:0/660: symlink d7/db/ld0 0 2024-09-13T17:05:53.337 INFO:tasks.workunit.client.1.smithi195.stdout:0/661: fdatasync d7/d87/d9b/d56/d46/f6e 0 2024-09-13T17:05:53.337 INFO:tasks.workunit.client.1.smithi195.stdout:0/662: fdatasync d7/d87/d9b/d4e/d68/f79 0 2024-09-13T17:05:53.337 INFO:tasks.workunit.client.1.smithi195.stdout:2/677: rename d0/d3/f92 to d0/d3/fd8 0 2024-09-13T17:05:53.338 INFO:tasks.workunit.client.1.smithi195.stdout:5/659: read d2/d12/d4e/f1d [1243136,22699] 0 2024-09-13T17:05:53.339 INFO:tasks.workunit.client.1.smithi195.stdout:4/791: rename d1a/d1f/d21/d36/l57 to d1a/d1f/d9c/dee/l109 0 2024-09-13T17:05:53.341 INFO:tasks.workunit.client.1.smithi195.stdout:0/663: symlink d7/db/ld1 0 2024-09-13T17:05:53.341 INFO:tasks.workunit.client.1.smithi195.stdout:7/681: dwrite d5/db/d19/f33 [0,4194304] 0 2024-09-13T17:05:53.342 INFO:tasks.workunit.client.1.smithi195.stdout:7/682: creat d5/db/d19/d22/fef x:0 0 0 2024-09-13T17:05:53.342 INFO:tasks.workunit.client.1.smithi195.stdout:7/683: chown d5/f72 8874382 1 2024-09-13T17:05:53.342 INFO:tasks.workunit.client.1.smithi195.stdout:7/684: stat d5/d13/c98 0 2024-09-13T17:05:53.344 INFO:tasks.workunit.client.1.smithi195.stdout:8/686: dread d0/d62/f98 [0,4194304] 0 2024-09-13T17:05:53.345 INFO:tasks.workunit.client.1.smithi195.stdout:5/660: truncate d2/d12/d4e/d10/f66 8054713 0 2024-09-13T17:05:53.345 INFO:tasks.workunit.client.1.smithi195.stdout:4/792: mknod d1a/d1f/d21/d84/dcc/c10a 0 2024-09-13T17:05:53.345 INFO:tasks.workunit.client.1.smithi195.stdout:4/793: write d1a/d1f/d43/f50 [4891094,5106] 0 2024-09-13T17:05:53.346 INFO:tasks.workunit.client.1.smithi195.stdout:0/664: creat d7/d87/d9b/fd2 x:0 0 0 2024-09-13T17:05:53.346 INFO:tasks.workunit.client.1.smithi195.stdout:0/665: dread - d7/d50/da1/faf zero size 2024-09-13T17:05:53.346 INFO:tasks.workunit.client.1.smithi195.stdout:0/666: truncate d7/d50/f1c 4853843 0 2024-09-13T17:05:53.346 INFO:tasks.workunit.client.1.smithi195.stdout:6/604: write f17 [2807398,39510] 0 2024-09-13T17:05:53.351 INFO:tasks.workunit.client.1.smithi195.stdout:4/794: mkdir d1a/d1f/d108/d10b 0 2024-09-13T17:05:53.354 INFO:tasks.workunit.client.1.smithi195.stdout:4/795: creat d1a/d1f/d21/d84/dcc/f10c x:0 0 0 2024-09-13T17:05:53.356 INFO:tasks.workunit.client.1.smithi195.stdout:4/796: truncate d1a/d1f/d21/d22/f5b 3209843 0 2024-09-13T17:05:53.359 INFO:tasks.workunit.client.1.smithi195.stdout:4/797: unlink d1a/d1f/d43/d24/d41/f88 0 2024-09-13T17:05:53.360 INFO:tasks.workunit.client.1.smithi195.stdout:4/798: truncate f13 4441890 0 2024-09-13T17:05:53.362 INFO:tasks.workunit.client.1.smithi195.stdout:4/799: symlink d1a/d1f/d21/d84/d9d/d8e/d9f/db2/dfd/l10d 0 2024-09-13T17:05:53.364 INFO:tasks.workunit.client.1.smithi195.stdout:4/800: write d1a/d1f/d43/d5a/f5f [704821,47817] 0 2024-09-13T17:05:53.364 INFO:tasks.workunit.client.1.smithi195.stdout:4/801: dread - d1a/d1f/d21/d36/f52 zero size 2024-09-13T17:05:53.365 INFO:tasks.workunit.client.1.smithi195.stdout:8/687: dread d0/dda/fa9 [0,4194304] 0 2024-09-13T17:05:53.366 INFO:tasks.workunit.client.1.smithi195.stdout:5/661: dread d2/df/d62/fb6 [0,4194304] 0 2024-09-13T17:05:53.366 INFO:tasks.workunit.client.1.smithi195.stdout:5/662: write d2/df/f81 [8743588,47087] 0 2024-09-13T17:05:53.366 INFO:tasks.workunit.client.1.smithi195.stdout:5/663: readlink d2/d12/lce 0 2024-09-13T17:05:53.368 INFO:tasks.workunit.client.1.smithi195.stdout:4/802: dread d1a/d1f/d21/d22/f26 [0,4194304] 0 2024-09-13T17:05:53.368 INFO:tasks.workunit.client.1.smithi195.stdout:4/803: fsync d1a/d1f/d21/ddd/fe9 0 2024-09-13T17:05:53.368 INFO:tasks.workunit.client.1.smithi195.stdout:5/664: creat d2/d12/d4e/d10/d5c/da1/fdb x:0 0 0 2024-09-13T17:05:53.368 INFO:tasks.workunit.client.1.smithi195.stdout:5/665: fdatasync d2/f17 0 2024-09-13T17:05:53.369 INFO:tasks.workunit.client.1.smithi195.stdout:5/666: fdatasync d2/d12/d3f/f70 0 2024-09-13T17:05:53.369 INFO:tasks.workunit.client.1.smithi195.stdout:0/667: write d7/d87/d9b/d56/d4d/d5e/f71 [1167370,85175] 0 2024-09-13T17:05:53.369 INFO:tasks.workunit.client.1.smithi195.stdout:0/668: creat d7/d87/d9b/d56/fd3 x:0 0 0 2024-09-13T17:05:53.369 INFO:tasks.workunit.client.1.smithi195.stdout:0/669: readlink d7/db/ld1 0 2024-09-13T17:05:53.369 INFO:tasks.workunit.client.1.smithi195.stdout:0/670: readlink d7/d87/l8d 0 2024-09-13T17:05:53.369 INFO:tasks.workunit.client.1.smithi195.stdout:4/804: creat d1a/d1f/d21/d22/d98/da3/f10e x:0 0 0 2024-09-13T17:05:53.372 INFO:tasks.workunit.client.0.smithi115.stdout:8/458: dwrite d0/f53 [0,4194304] 0 2024-09-13T17:05:53.373 INFO:tasks.workunit.client.0.smithi115.stdout:8/459: write d0/d21/d3a/d60/f78 [3000786,33160] 0 2024-09-13T17:05:53.373 INFO:tasks.workunit.client.1.smithi195.stdout:0/671: symlink d7/d87/d9b/d56/d4d/d9d/ld4 0 2024-09-13T17:05:53.373 INFO:tasks.workunit.client.1.smithi195.stdout:9/719: dwrite d6/df/d16/de3/d68/d6d/fa2 [0,4194304] 0 2024-09-13T17:05:53.373 INFO:tasks.workunit.client.1.smithi195.stdout:9/720: fdatasync d6/d19/fa8 0 2024-09-13T17:05:53.375 INFO:tasks.workunit.client.1.smithi195.stdout:6/605: dwrite d1c/d24/d7f/f8d [0,4194304] 0 2024-09-13T17:05:53.375 INFO:tasks.workunit.client.1.smithi195.stdout:3/652: dwrite f5 [0,4194304] 0 2024-09-13T17:05:53.375 INFO:tasks.workunit.client.1.smithi195.stdout:7/685: dwrite d5/db/d50/d7f/fcd [0,4194304] 0 2024-09-13T17:05:53.376 INFO:tasks.workunit.client.1.smithi195.stdout:0/672: mkdir d7/d88/d23/dd5 0 2024-09-13T17:05:53.387 INFO:tasks.workunit.client.1.smithi195.stdout:0/673: dread d7/db/d38/f76 [0,4194304] 0 2024-09-13T17:05:53.387 INFO:tasks.workunit.client.1.smithi195.stdout:0/674: stat d7/db/d38/d5d/f7f 0 2024-09-13T17:05:53.388 INFO:tasks.workunit.client.1.smithi195.stdout:9/721: mknod d6/d19/d21/d45/cf4 0 2024-09-13T17:05:53.392 INFO:tasks.workunit.client.1.smithi195.stdout:6/606: creat d1c/d24/d7f/dad/fce x:0 0 0 2024-09-13T17:05:53.392 INFO:tasks.workunit.client.1.smithi195.stdout:6/607: read - d1c/d24/d7f/dad/db9/d5e/fa0 zero size 2024-09-13T17:05:53.394 INFO:tasks.workunit.client.1.smithi195.stdout:8/688: dwrite d0/d62/f98 [4194304,4194304] 0 2024-09-13T17:05:53.394 INFO:tasks.workunit.client.1.smithi195.stdout:8/689: creat d0/d17/d2f/d7c/d4c/d9b/fec x:0 0 0 2024-09-13T17:05:53.394 INFO:tasks.workunit.client.1.smithi195.stdout:8/690: readlink d0/d17/d49/d63/db3/deb/le0 0 2024-09-13T17:05:53.394 INFO:tasks.workunit.client.1.smithi195.stdout:7/686: dread d5/d13/d30/f7a [0,4194304] 0 2024-09-13T17:05:53.394 INFO:tasks.workunit.client.1.smithi195.stdout:7/687: read - d5/db/d19/d22/fef zero size 2024-09-13T17:05:53.396 INFO:tasks.workunit.client.1.smithi195.stdout:6/608: dread d1c/d7d/f97 [0,4194304] 0 2024-09-13T17:05:53.397 INFO:tasks.workunit.client.1.smithi195.stdout:0/675: mkdir d7/db/d9a/dd6 0 2024-09-13T17:05:53.397 INFO:tasks.workunit.client.1.smithi195.stdout:0/676: readlink d7/d87/d9b/d56/d4d/d5e/la7 0 2024-09-13T17:05:53.398 INFO:tasks.workunit.client.1.smithi195.stdout:9/722: symlink d6/d19/lf5 0 2024-09-13T17:05:53.401 INFO:tasks.workunit.client.1.smithi195.stdout:8/691: symlink d0/d13/led 0 2024-09-13T17:05:53.401 INFO:tasks.workunit.client.1.smithi195.stdout:8/692: chown d0/d17/d2f/d31/db4/de5 52 1 2024-09-13T17:05:53.401 INFO:tasks.workunit.client.1.smithi195.stdout:8/693: chown d0/d4/cc1 373 1 2024-09-13T17:05:53.403 INFO:tasks.workunit.client.1.smithi195.stdout:7/688: mkdir d5/db/d50/d7f/d82/dad/df0 0 2024-09-13T17:05:53.403 INFO:tasks.workunit.client.1.smithi195.stdout:6/609: dread d1c/f67 [0,4194304] 0 2024-09-13T17:05:53.403 INFO:tasks.workunit.client.1.smithi195.stdout:6/610: chown d1c/d24/d7f/dad/db9/d30/d6f/ccc 10916065 1 2024-09-13T17:05:53.403 INFO:tasks.workunit.client.1.smithi195.stdout:6/611: chown d1c/d24/d49/d5f/d85/da5/lc8 38765008 1 2024-09-13T17:05:53.404 INFO:tasks.workunit.client.1.smithi195.stdout:5/667: dwrite d2/d12/d4e/d10/d5c/f87 [0,4194304] 0 2024-09-13T17:05:53.407 INFO:tasks.workunit.client.1.smithi195.stdout:9/723: mkdir d6/df/d7b/df6 0 2024-09-13T17:05:53.407 INFO:tasks.workunit.client.1.smithi195.stdout:8/694: unlink d0/ld2 0 2024-09-13T17:05:53.407 INFO:tasks.workunit.client.1.smithi195.stdout:6/612: write d1c/f67 [631868,68359] 0 2024-09-13T17:05:53.407 INFO:tasks.workunit.client.1.smithi195.stdout:9/724: write d6/f3f [4862692,38519] 0 2024-09-13T17:05:53.407 INFO:tasks.workunit.client.1.smithi195.stdout:9/725: write d6/d12/f8a [2925255,42105] 0 2024-09-13T17:05:53.407 INFO:tasks.workunit.client.1.smithi195.stdout:7/689: mkdir d5/db/d19/d22/d3c/df1 0 2024-09-13T17:05:53.407 INFO:tasks.workunit.client.1.smithi195.stdout:7/690: write d5/d13/f6a [1244877,38312] 0 2024-09-13T17:05:53.407 INFO:tasks.workunit.client.1.smithi195.stdout:7/691: truncate d5/db/d19/d22/fe3 5091207 0 2024-09-13T17:05:53.413 INFO:tasks.workunit.client.1.smithi195.stdout:8/695: mkdir d0/d17/d2f/d7c/d4c/d67/dee 0 2024-09-13T17:05:53.414 INFO:tasks.workunit.client.1.smithi195.stdout:3/653: dwrite d7/d21/d2a/d4a/f6e [0,4194304] 0 2024-09-13T17:05:53.414 INFO:tasks.workunit.client.1.smithi195.stdout:4/805: dwrite d1a/d1f/d43/f66 [0,4194304] 0 2024-09-13T17:05:53.414 INFO:tasks.workunit.client.1.smithi195.stdout:4/806: fsync d1a/f94 0 2024-09-13T17:05:53.414 INFO:tasks.workunit.client.1.smithi195.stdout:4/807: fsync d1a/d1f/d43/d24/d41/fd3 0 2024-09-13T17:05:53.414 INFO:tasks.workunit.client.1.smithi195.stdout:4/808: write d1a/d1f/d21/d36/fc9 [1472205,98614] 0 2024-09-13T17:05:53.415 INFO:tasks.workunit.client.0.smithi115.stdout:8/460: dwrite d0/d26/d29/f38 [0,4194304] 0 2024-09-13T17:05:53.415 INFO:tasks.workunit.client.0.smithi115.stdout:8/461: stat d0/d21/f96 0 2024-09-13T17:05:53.416 INFO:tasks.workunit.client.1.smithi195.stdout:6/613: symlink d1c/d24/d49/lcf 0 2024-09-13T17:05:53.416 INFO:tasks.workunit.client.1.smithi195.stdout:6/614: stat d1c/d24/d49/d5f/d85/d8f/dc0/fc1 0 2024-09-13T17:05:53.420 INFO:tasks.workunit.client.1.smithi195.stdout:8/696: unlink d0/c19 0 2024-09-13T17:05:53.421 INFO:tasks.workunit.client.1.smithi195.stdout:0/677: dwrite d7/d87/d9b/d56/d46/f49 [8388608,4194304] 0 2024-09-13T17:05:53.422 INFO:tasks.workunit.client.1.smithi195.stdout:3/654: mkdir d7/d21/d2a/d35/d9c/dcf 0 2024-09-13T17:05:53.422 INFO:tasks.workunit.client.1.smithi195.stdout:3/655: truncate d7/d21/d2a/d35/d8f/fcd 108879 0 2024-09-13T17:05:53.423 INFO:tasks.workunit.client.0.smithi115.stdout:8/462: creat d0/d18/d19/d2b/f9e x:0 0 0 2024-09-13T17:05:53.431 INFO:tasks.workunit.client.1.smithi195.stdout:5/668: dwrite d2/df/d78/faa [0,4194304] 0 2024-09-13T17:05:53.431 INFO:tasks.workunit.client.1.smithi195.stdout:7/692: dwrite d5/d13/d30/fdc [0,4194304] 0 2024-09-13T17:05:53.431 INFO:tasks.workunit.client.1.smithi195.stdout:7/693: stat d5/d13/d24/fd7 0 2024-09-13T17:05:53.433 INFO:tasks.workunit.client.1.smithi195.stdout:4/809: chown c18 1008810231 1 2024-09-13T17:05:53.433 INFO:tasks.workunit.client.1.smithi195.stdout:4/810: dread - d1a/d1f/d21/d84/fcf zero size 2024-09-13T17:05:53.434 INFO:tasks.workunit.client.1.smithi195.stdout:6/615: creat d1c/d24/d49/d5f/d85/d8f/fd0 x:0 0 0 2024-09-13T17:05:53.436 INFO:tasks.workunit.client.1.smithi195.stdout:8/697: link d0/d17/fc2 d0/d17/d2f/d7c/d4c/d67/fef 0 2024-09-13T17:05:53.436 INFO:tasks.workunit.client.1.smithi195.stdout:8/698: fdatasync d0/dda/fd0 0 2024-09-13T17:05:53.436 INFO:tasks.workunit.client.1.smithi195.stdout:8/699: chown d0/d13/l26 0 1 2024-09-13T17:05:53.439 INFO:tasks.workunit.client.1.smithi195.stdout:3/656: symlink d7/d21/d2a/d4a/ld0 0 2024-09-13T17:05:53.442 INFO:tasks.workunit.client.1.smithi195.stdout:5/669: creat d2/df/d90/dbb/fdc x:0 0 0 2024-09-13T17:05:53.443 INFO:tasks.workunit.client.1.smithi195.stdout:0/678: dwrite d7/d50/fc1 [0,4194304] 0 2024-09-13T17:05:53.445 INFO:tasks.workunit.client.1.smithi195.stdout:7/694: symlink d5/db/d50/daa/lf2 0 2024-09-13T17:05:53.447 INFO:tasks.workunit.client.1.smithi195.stdout:4/811: truncate d1a/d1f/d43/d5a/f81 2113908 0 2024-09-13T17:05:53.447 INFO:tasks.workunit.client.1.smithi195.stdout:4/812: getdents d1a/d1f/d21/d84/d9d/df6 0 2024-09-13T17:05:53.447 INFO:tasks.workunit.client.1.smithi195.stdout:4/813: truncate d1a/d1f/d43/d5a/d63/db8/fd8 599040 0 2024-09-13T17:05:53.447 INFO:tasks.workunit.client.1.smithi195.stdout:4/814: creat d1a/d1f/d21/d84/d9d/d58/f10f x:0 0 0 2024-09-13T17:05:53.449 INFO:tasks.workunit.client.1.smithi195.stdout:6/616: mkdir d1c/d24/d7f/dad/db9/d8c/dd1 0 2024-09-13T17:05:53.449 INFO:tasks.workunit.client.1.smithi195.stdout:6/617: chown d1c/d24/d49/f4c 437942 1 2024-09-13T17:05:53.449 INFO:tasks.workunit.client.1.smithi195.stdout:6/618: fsync d1c/d24/d49/d5f/d85/d8f/dc0/fc1 0 2024-09-13T17:05:53.449 INFO:tasks.workunit.client.1.smithi195.stdout:6/619: write d1c/f67 [5087241,17048] 0 2024-09-13T17:05:53.450 INFO:tasks.workunit.client.1.smithi195.stdout:8/700: unlink d0/d13/l26 0 2024-09-13T17:05:53.452 INFO:tasks.workunit.client.1.smithi195.stdout:3/657: creat d7/d21/d2a/d35/d9c/da9/fd1 x:0 0 0 2024-09-13T17:05:53.452 INFO:tasks.workunit.client.1.smithi195.stdout:3/658: dread - d7/d21/d2a/d35/d60/f9a zero size 2024-09-13T17:05:53.456 INFO:tasks.workunit.client.1.smithi195.stdout:0/679: truncate d7/db/d38/d5d/f7f 10171369 0 2024-09-13T17:05:53.456 INFO:tasks.workunit.client.1.smithi195.stdout:7/695: symlink d5/d35/lf3 0 2024-09-13T17:05:53.459 INFO:tasks.workunit.client.1.smithi195.stdout:4/815: rename d1a/d1f/d43/d24/d41/d60/d6f/lac to d1a/d1f/d108/l110 0 2024-09-13T17:05:53.459 INFO:tasks.workunit.client.1.smithi195.stdout:4/816: write d1a/d1f/d21/d22/d98/da3/f10e [958150,72201] 0 2024-09-13T17:05:53.459 INFO:tasks.workunit.client.1.smithi195.stdout:4/817: write d1a/d1f/d21/d22/d98/da3/f10e [461497,119480] 0 2024-09-13T17:05:53.461 INFO:tasks.workunit.client.1.smithi195.stdout:3/659: truncate d7/f13 2944426 0 2024-09-13T17:05:53.461 INFO:tasks.workunit.client.1.smithi195.stdout:3/660: fdatasync d7/d21/d2a/fc8 0 2024-09-13T17:05:53.463 INFO:tasks.workunit.client.1.smithi195.stdout:0/680: truncate d7/db/d38/f3b 4004238 0 2024-09-13T17:05:53.463 INFO:tasks.workunit.client.1.smithi195.stdout:5/670: dwrite d2/d12/d4e/d10/d8f/fbc [0,4194304] 0 2024-09-13T17:05:53.464 INFO:tasks.workunit.client.1.smithi195.stdout:7/696: creat d5/d13/da8/ff4 x:0 0 0 2024-09-13T17:05:53.465 INFO:tasks.workunit.client.1.smithi195.stdout:4/818: mkdir d1a/d1f/d21/d84/d9d/d8e/d9f/d111 0 2024-09-13T17:05:53.466 INFO:tasks.workunit.client.0.smithi115.stdout:8/463: rmdir d0/d18 39 2024-09-13T17:05:53.468 INFO:tasks.workunit.client.1.smithi195.stdout:1/617: sync 2024-09-13T17:05:53.468 INFO:tasks.workunit.client.1.smithi195.stdout:1/618: chown db/d19/d37/d46/c84 3382542 1 2024-09-13T17:05:53.468 INFO:tasks.workunit.client.1.smithi195.stdout:1/619: write db/f18 [3472520,63668] 0 2024-09-13T17:05:53.469 INFO:tasks.workunit.client.1.smithi195.stdout:5/671: creat d2/d12/d4e/fdd x:0 0 0 2024-09-13T17:05:53.469 INFO:tasks.workunit.client.1.smithi195.stdout:5/672: fsync d2/d3e/f7a 0 2024-09-13T17:05:53.469 INFO:tasks.workunit.client.1.smithi195.stdout:7/697: creat d5/db/d50/d7f/d82/ff5 x:0 0 0 2024-09-13T17:05:53.470 INFO:tasks.workunit.client.1.smithi195.stdout:7/698: dread d5/d13/da8/fb1 [0,4194304] 0 2024-09-13T17:05:53.471 INFO:tasks.workunit.client.1.smithi195.stdout:4/819: unlink d1a/d1f/d43/c53 0 2024-09-13T17:05:53.472 INFO:tasks.workunit.client.1.smithi195.stdout:6/620: dwrite d1c/d24/d49/d5f/db1/d95/fc5 [0,4194304] 0 2024-09-13T17:05:53.472 INFO:tasks.workunit.client.1.smithi195.stdout:8/701: dwrite d0/d13/f5d [0,4194304] 0 2024-09-13T17:05:53.473 INFO:tasks.workunit.client.1.smithi195.stdout:3/661: rename d7/d21/d2a/d4a/d5a/f5d to d7/fd2 0 2024-09-13T17:05:53.473 INFO:tasks.workunit.client.1.smithi195.stdout:3/662: chown d7/l47 46095 1 2024-09-13T17:05:53.473 INFO:tasks.workunit.client.1.smithi195.stdout:7/699: dread d5/db/d19/d22/d3c/fa6 [0,4194304] 0 2024-09-13T17:05:53.473 INFO:tasks.workunit.client.1.smithi195.stdout:2/678: sync 2024-09-13T17:05:53.475 INFO:tasks.workunit.client.1.smithi195.stdout:1/620: creat db/d19/d5a/d66/d96/dd0/fd7 x:0 0 0 2024-09-13T17:05:53.476 INFO:tasks.workunit.client.1.smithi195.stdout:1/621: readlink db/d19/d37/d3e/l48 0 2024-09-13T17:05:53.478 INFO:tasks.workunit.client.0.smithi115.stdout:8/464: read d0/fb [5008188,37151] 0 2024-09-13T17:05:53.478 INFO:tasks.workunit.client.0.smithi115.stdout:8/465: chown d0/d42/d80/d94 52367 1 2024-09-13T17:05:53.478 INFO:tasks.workunit.client.0.smithi115.stdout:8/466: fdatasync d0/d18/f2e 0 2024-09-13T17:05:53.478 INFO:tasks.workunit.client.0.smithi115.stdout:8/467: chown d0/d18/d19/d2b 547 1 2024-09-13T17:05:53.478 INFO:tasks.workunit.client.0.smithi115.stdout:8/468: truncate d0/d21/d3a/d60/f7a 4470699 0 2024-09-13T17:05:53.478 INFO:tasks.workunit.client.0.smithi115.stdout:8/469: truncate d0/d21/d3a/f3f 1543138 0 2024-09-13T17:05:53.480 INFO:tasks.workunit.client.1.smithi195.stdout:6/621: unlink d1c/d24/d49/d5f/d35/f68 0 2024-09-13T17:05:53.480 INFO:tasks.workunit.client.1.smithi195.stdout:6/622: chown f14 0 1 2024-09-13T17:05:53.480 INFO:tasks.workunit.client.1.smithi195.stdout:6/623: chown d1c/d24/d7f/dad/db9/d8c 245 1 2024-09-13T17:05:53.480 INFO:tasks.workunit.client.1.smithi195.stdout:6/624: dread - d1c/d24/d7f/dad/db9/f9a zero size 2024-09-13T17:05:53.482 INFO:tasks.workunit.client.1.smithi195.stdout:8/702: rmdir d0/d17/d2f/d7c/d4c/d67/dee 0 2024-09-13T17:05:53.491 INFO:tasks.workunit.client.1.smithi195.stdout:5/673: rename d2/d12/d4e/d10/d5c/da1/cae to d2/df/d62/cde 0 2024-09-13T17:05:53.493 INFO:tasks.workunit.client.1.smithi195.stdout:6/625: mkdir d1c/d3e/d6b/dd2 0 2024-09-13T17:05:53.494 INFO:tasks.workunit.client.1.smithi195.stdout:6/626: getdents d1c/d24/d7f/dad/db9/d8c/dd1 0 2024-09-13T17:05:53.495 INFO:tasks.workunit.client.1.smithi195.stdout:8/703: mknod d0/d17/cf0 0 2024-09-13T17:05:53.495 INFO:tasks.workunit.client.1.smithi195.stdout:8/704: dread - d0/d13/fbe zero size 2024-09-13T17:05:53.495 INFO:tasks.workunit.client.1.smithi195.stdout:8/705: fsync d0/dda/d6f/fe4 0 2024-09-13T17:05:53.497 INFO:tasks.workunit.client.1.smithi195.stdout:3/663: getdents d7/d19 0 2024-09-13T17:05:53.498 INFO:tasks.workunit.client.1.smithi195.stdout:6/627: rmdir d1c/d24/d7f/dad/db9/d8c 39 2024-09-13T17:05:53.501 INFO:tasks.workunit.client.1.smithi195.stdout:8/706: rename d0/d17/d2f/d31/dea to d0/dda/d6f/df1 0 2024-09-13T17:05:53.501 INFO:tasks.workunit.client.1.smithi195.stdout:8/707: write d0/d17/d2f/d7c/d4c/d9a/da5/fd8 [168668,35776] 0 2024-09-13T17:05:53.503 INFO:tasks.workunit.client.1.smithi195.stdout:8/708: rename d0/d17/d49/d63/db3/deb to d0/d17/d49/d63/db3/df2 0 2024-09-13T17:05:53.505 INFO:tasks.workunit.client.1.smithi195.stdout:8/709: creat d0/d17/d2f/d31/db4/ff3 x:0 0 0 2024-09-13T17:05:53.505 INFO:tasks.workunit.client.1.smithi195.stdout:8/710: chown d0/d13/d69/c6c 3865467 1 2024-09-13T17:05:53.506 INFO:tasks.workunit.client.1.smithi195.stdout:3/664: write d7/d21/d2a/d4a/fc3 [1143008,43861] 0 2024-09-13T17:05:53.508 INFO:tasks.workunit.client.1.smithi195.stdout:8/711: symlink d0/dda/d6f/lf4 0 2024-09-13T17:05:53.509 INFO:tasks.workunit.client.1.smithi195.stdout:3/665: mknod d7/d21/d2a/d4a/d71/cd3 0 2024-09-13T17:05:53.511 INFO:tasks.workunit.client.1.smithi195.stdout:3/666: rename d7/d21/d51/lc0 to d7/d21/d2a/d35/d60/d6f/dbf/ld4 0 2024-09-13T17:05:53.515 INFO:tasks.workunit.client.1.smithi195.stdout:8/712: dread d0/d62/f98 [4194304,4194304] 0 2024-09-13T17:05:53.515 INFO:tasks.workunit.client.1.smithi195.stdout:8/713: write d0/d62/fba [202928,17202] 0 2024-09-13T17:05:53.517 INFO:tasks.workunit.client.1.smithi195.stdout:8/714: creat d0/dda/d6f/df1/ff5 x:0 0 0 2024-09-13T17:05:53.518 INFO:tasks.workunit.client.1.smithi195.stdout:3/667: read d7/d21/d2a/f32 [2371405,73049] 0 2024-09-13T17:05:53.519 INFO:tasks.workunit.client.1.smithi195.stdout:3/668: symlink d7/d21/d2a/ld5 0 2024-09-13T17:05:53.521 INFO:tasks.workunit.client.1.smithi195.stdout:3/669: dread d7/d21/d2a/d35/d60/d6f/f83 [0,4194304] 0 2024-09-13T17:05:53.522 INFO:tasks.workunit.client.1.smithi195.stdout:3/670: symlink d7/d21/d2a/d35/d60/d6f/da4/ld6 0 2024-09-13T17:05:53.522 INFO:tasks.workunit.client.1.smithi195.stdout:3/671: write d7/d21/d2a/d35/db7/fc9 [262996,23415] 0 2024-09-13T17:05:53.535 INFO:tasks.workunit.client.1.smithi195.stdout:3/672: dread d7/d21/d51/f54 [0,4194304] 0 2024-09-13T17:05:53.537 INFO:tasks.workunit.client.1.smithi195.stdout:3/673: unlink d7/d21/d2a/d4a/d71/laa 0 2024-09-13T17:05:53.537 INFO:tasks.workunit.client.1.smithi195.stdout:3/674: fsync d7/d21/d2a/d35/d60/d64/f78 0 2024-09-13T17:05:53.537 INFO:tasks.workunit.client.1.smithi195.stdout:3/675: write d7/d19/f48 [2363920,32758] 0 2024-09-13T17:05:53.538 INFO:tasks.workunit.client.1.smithi195.stdout:7/700: dwrite d5/d35/f57 [0,4194304] 0 2024-09-13T17:05:53.538 INFO:tasks.workunit.client.1.smithi195.stdout:1/622: dwrite db/df/d13/f2e [0,4194304] 0 2024-09-13T17:05:53.540 INFO:tasks.workunit.client.1.smithi195.stdout:4/820: dwrite d1a/d1f/d43/d5a/d63/dd1/db4/fbc [0,4194304] 0 2024-09-13T17:05:53.541 INFO:tasks.workunit.client.1.smithi195.stdout:5/674: dwrite d2/d12/d4e/f1d [0,4194304] 0 2024-09-13T17:05:53.541 INFO:tasks.workunit.client.1.smithi195.stdout:5/675: dread - d2/d12/d4e/fdd zero size 2024-09-13T17:05:53.541 INFO:tasks.workunit.client.1.smithi195.stdout:2/679: dwrite d0/d4a/d47/d73/d75/fa2 [0,4194304] 0 2024-09-13T17:05:53.541 INFO:tasks.workunit.client.1.smithi195.stdout:1/623: mkdir db/df/d4d/d67/dd8 0 2024-09-13T17:05:53.541 INFO:tasks.workunit.client.1.smithi195.stdout:1/624: chown c1 148 1 2024-09-13T17:05:53.542 INFO:tasks.workunit.client.0.smithi115.stdout:8/470: dwrite d0/d21/d76/d83/f6c [4194304,4194304] 0 2024-09-13T17:05:53.542 INFO:tasks.workunit.client.0.smithi115.stdout:8/471: truncate d0/d21/d76/f7f 1164743 0 2024-09-13T17:05:53.542 INFO:tasks.workunit.client.1.smithi195.stdout:6/628: dwrite f17 [0,4194304] 0 2024-09-13T17:05:53.542 INFO:tasks.workunit.client.1.smithi195.stdout:1/625: dread db/d19/d5a/f83 [0,4194304] 0 2024-09-13T17:05:53.547 INFO:tasks.workunit.client.0.smithi115.stdout:8/472: rename d0/d18/f1c to d0/d26/d29/d98/f9f 0 2024-09-13T17:05:53.548 INFO:tasks.workunit.client.1.smithi195.stdout:4/821: dread d1a/d1f/d43/d24/d41/fd3 [0,4194304] 0 2024-09-13T17:05:53.548 INFO:tasks.workunit.client.1.smithi195.stdout:9/726: sync 2024-09-13T17:05:53.550 INFO:tasks.workunit.client.1.smithi195.stdout:1/626: read db/df/d13/f2e [460842,305] 0 2024-09-13T17:05:53.550 INFO:tasks.workunit.client.1.smithi195.stdout:1/627: readlink db/d19/l34 0 2024-09-13T17:05:53.551 INFO:tasks.workunit.client.1.smithi195.stdout:5/676: truncate d2/df/d78/d54/d58/f85 3012858 0 2024-09-13T17:05:53.552 INFO:tasks.workunit.client.0.smithi115.stdout:8/473: truncate d0/d26/d29/f38 3692063 0 2024-09-13T17:05:53.554 INFO:tasks.workunit.client.1.smithi195.stdout:4/822: dread d1a/d1f/d43/d5a/d63/db8/dc8/ff2 [0,4194304] 0 2024-09-13T17:05:53.556 INFO:tasks.workunit.client.0.smithi115.stdout:8/474: symlink d0/d26/la0 0 2024-09-13T17:05:53.557 INFO:tasks.workunit.client.0.smithi115.stdout:8/475: mkdir d0/d26/d29/d59/d7e/da1 0 2024-09-13T17:05:53.560 INFO:tasks.workunit.client.0.smithi115.stdout:8/476: truncate d0/d26/f35 1306146 0 2024-09-13T17:05:53.562 INFO:tasks.workunit.client.1.smithi195.stdout:2/680: creat d0/d4a/d47/d73/d75/d88/d62/fd9 x:0 0 0 2024-09-13T17:05:53.562 INFO:tasks.workunit.client.1.smithi195.stdout:2/681: stat d0/f76 0 2024-09-13T17:05:53.563 INFO:tasks.workunit.client.1.smithi195.stdout:2/682: fdatasync d0/d4a/d47/d73/d75/d88/d2c/f8d 0 2024-09-13T17:05:53.563 INFO:tasks.workunit.client.1.smithi195.stdout:2/683: chown d0/d4a/d47/d73/lbb 78701 1 2024-09-13T17:05:53.563 INFO:tasks.workunit.client.1.smithi195.stdout:6/629: mknod d1c/d24/cd3 0 2024-09-13T17:05:53.563 INFO:tasks.workunit.client.1.smithi195.stdout:2/684: dread d0/d3/f82 [0,4194304] 0 2024-09-13T17:05:53.564 INFO:tasks.workunit.client.0.smithi115.stdout:8/477: dread d0/d21/f96 [0,4194304] 0 2024-09-13T17:05:53.564 INFO:tasks.workunit.client.0.smithi115.stdout:8/478: fdatasync d0/d21/d76/d83/f88 0 2024-09-13T17:05:53.564 INFO:tasks.workunit.client.0.smithi115.stdout:8/479: creat d0/d21/d3a/d60/fa2 x:0 0 0 2024-09-13T17:05:53.566 INFO:tasks.workunit.client.1.smithi195.stdout:1/628: creat db/d19/d5a/db0/fd9 x:0 0 0 2024-09-13T17:05:53.566 INFO:tasks.workunit.client.1.smithi195.stdout:1/629: creat db/df/d51/d62/d70/fda x:0 0 0 2024-09-13T17:05:53.566 INFO:tasks.workunit.client.1.smithi195.stdout:3/676: getdents d7/d21/d2a/d4a/d71 0 2024-09-13T17:05:53.567 INFO:tasks.workunit.client.1.smithi195.stdout:5/677: symlink d2/df/d48/d5a/d92/ldf 0 2024-09-13T17:05:53.568 INFO:tasks.workunit.client.0.smithi115.stdout:8/480: mkdir d0/d21/d3a/da3 0 2024-09-13T17:05:53.570 INFO:tasks.workunit.client.1.smithi195.stdout:2/685: dread d0/d3/fa7 [0,4194304] 0 2024-09-13T17:05:53.570 INFO:tasks.workunit.client.1.smithi195.stdout:8/715: rename d0/dda/d6f to d0/d17/d49/d63/d71/de8/df6 0 2024-09-13T17:05:53.570 INFO:tasks.workunit.client.1.smithi195.stdout:8/716: write d0/d62/fba [1226423,122080] 0 2024-09-13T17:05:53.571 INFO:tasks.workunit.client.0.smithi115.stdout:8/481: rename d0/d18/d19/d28/f9d to d0/d21/d76/fa4 0 2024-09-13T17:05:53.573 INFO:tasks.workunit.client.1.smithi195.stdout:6/630: unlink d1c/d24/d7f/dad/db9/d30/d6f/fc2 0 2024-09-13T17:05:53.575 INFO:tasks.workunit.client.0.smithi115.stdout:8/482: mknod d0/d18/ca5 0 2024-09-13T17:05:53.575 INFO:tasks.workunit.client.1.smithi195.stdout:9/727: rmdir d6/d19/d21 39 2024-09-13T17:05:53.575 INFO:tasks.workunit.client.1.smithi195.stdout:9/728: fsync d6/d12/d39/f3d 0 2024-09-13T17:05:53.575 INFO:tasks.workunit.client.1.smithi195.stdout:9/729: stat d6/df/d13 0 2024-09-13T17:05:53.577 INFO:tasks.workunit.client.0.smithi115.stdout:8/483: mknod d0/d26/d29/ca6 0 2024-09-13T17:05:53.578 INFO:tasks.workunit.client.1.smithi195.stdout:5/678: dread d2/d12/d4e/d10/d8f/fbc [0,4194304] 0 2024-09-13T17:05:53.578 INFO:tasks.workunit.client.1.smithi195.stdout:5/679: getdents d2/d12/d4e/d10/d8f/dc9 0 2024-09-13T17:05:53.578 INFO:tasks.workunit.client.1.smithi195.stdout:5/680: truncate d2/df/d48/d5a/dc5/fc6 1186637 0 2024-09-13T17:05:53.578 INFO:tasks.workunit.client.1.smithi195.stdout:5/681: write d2/d12/d3f/fbd [372440,107610] 0 2024-09-13T17:05:53.578 INFO:tasks.workunit.client.1.smithi195.stdout:5/682: chown d2/df/f1c 1463519 1 2024-09-13T17:05:53.578 INFO:tasks.workunit.client.1.smithi195.stdout:5/683: creat d2/d12/d4e/fe0 x:0 0 0 2024-09-13T17:05:53.578 INFO:tasks.workunit.client.1.smithi195.stdout:5/684: creat d2/d12/d4e/d10/d5c/fe1 x:0 0 0 2024-09-13T17:05:53.579 INFO:tasks.workunit.client.1.smithi195.stdout:3/677: creat d7/d21/d2a/d35/d9c/dcf/fd7 x:0 0 0 2024-09-13T17:05:53.579 INFO:tasks.workunit.client.1.smithi195.stdout:3/678: stat d7/d21/d2a 0 2024-09-13T17:05:53.580 INFO:tasks.workunit.client.1.smithi195.stdout:4/823: mkdir d1a/d1f/d21/d84/d9d/d8e/d112 0 2024-09-13T17:05:53.580 INFO:tasks.workunit.client.1.smithi195.stdout:4/824: chown d1a/d1f/d43/d5a/d63/dd1/dc3 66245884 1 2024-09-13T17:05:53.582 INFO:tasks.workunit.client.1.smithi195.stdout:2/686: mknod d0/d4a/d47/dba/cda 0 2024-09-13T17:05:53.585 INFO:tasks.workunit.client.1.smithi195.stdout:8/717: dwrite d0/d17/d49/f50 [0,4194304] 0 2024-09-13T17:05:53.585 INFO:tasks.workunit.client.1.smithi195.stdout:8/718: readlink d0/d17/d2f/d7c/l8a 0 2024-09-13T17:05:53.585 INFO:tasks.workunit.client.1.smithi195.stdout:1/630: rename db/d19/d37/d46/c84 to db/df/d4d/d67/dc6/cdb 0 2024-09-13T17:05:53.586 INFO:tasks.workunit.client.1.smithi195.stdout:2/687: dread d0/d4a/d47/d73/d94/fc1 [0,4194304] 0 2024-09-13T17:05:53.587 INFO:tasks.workunit.client.1.smithi195.stdout:2/688: readlink d0/d4a/d47/d73/d75/d88/d2c/l5f 0 2024-09-13T17:05:53.587 INFO:tasks.workunit.client.1.smithi195.stdout:6/631: unlink d1c/l2a 0 2024-09-13T17:05:53.587 INFO:tasks.workunit.client.1.smithi195.stdout:6/632: write ff [2075628,12536] 0 2024-09-13T17:05:53.587 INFO:tasks.workunit.client.1.smithi195.stdout:6/633: write f1a [1009961,94378] 0 2024-09-13T17:05:53.590 INFO:tasks.workunit.client.1.smithi195.stdout:3/679: creat d7/d21/d2a/d35/d9c/fd8 x:0 0 0 2024-09-13T17:05:53.591 INFO:tasks.workunit.client.1.smithi195.stdout:4/825: symlink d1a/d1f/d43/d5a/d63/dd1/dc3/l113 0 2024-09-13T17:05:53.593 INFO:tasks.workunit.client.1.smithi195.stdout:8/719: unlink d0/d13/d52/c7b 0 2024-09-13T17:05:53.595 INFO:tasks.workunit.client.1.smithi195.stdout:2/689: dread d0/d4a/d47/d73/d75/d88/d2c/d51/f81 [0,4194304] 0 2024-09-13T17:05:53.595 INFO:tasks.workunit.client.1.smithi195.stdout:2/690: readlink d0/d4a/d47/d73/d75/d88/d2c/d43/d63/l85 0 2024-09-13T17:05:53.595 INFO:tasks.workunit.client.1.smithi195.stdout:2/691: dread - d0/d4a/d47/d73/d75/d88/d2c/d43/d63/f99 zero size 2024-09-13T17:05:53.595 INFO:tasks.workunit.client.1.smithi195.stdout:9/730: dwrite d6/df/d16/de3/d68/d6d/fb5 [0,4194304] 0 2024-09-13T17:05:53.595 INFO:tasks.workunit.client.1.smithi195.stdout:9/731: chown d6/d12/d86/da7/dcb/fd8 13 1 2024-09-13T17:05:53.595 INFO:tasks.workunit.client.1.smithi195.stdout:6/634: rename d1c/d3e/d6b/dd2 to d1c/d3e/d6b/dd2/dd4 22 2024-09-13T17:05:53.595 INFO:tasks.workunit.client.1.smithi195.stdout:5/685: rename d2/df/d90/db2/fba to d2/df/d48/fe2 0 2024-09-13T17:05:53.598 INFO:tasks.workunit.client.1.smithi195.stdout:1/631: link db/d19/d37/l59 db/d19/d37/d46/d7e/ldc 0 2024-09-13T17:05:53.598 INFO:tasks.workunit.client.1.smithi195.stdout:5/686: dread d2/fc4 [0,4194304] 0 2024-09-13T17:05:53.601 INFO:tasks.workunit.client.1.smithi195.stdout:3/680: link d7/d21/d2a/d35/d60/l7b d7/d62/ld9 0 2024-09-13T17:05:53.603 INFO:tasks.workunit.client.1.smithi195.stdout:8/720: symlink d0/d17/d2f/d7c/d4c/d9a/dcd/lf7 0 2024-09-13T17:05:53.603 INFO:tasks.workunit.client.1.smithi195.stdout:8/721: truncate d0/d17/faf 1665782 0 2024-09-13T17:05:53.603 INFO:tasks.workunit.client.1.smithi195.stdout:8/722: write d0/d17/d2f/d7c/f48 [353427,11720] 0 2024-09-13T17:05:53.604 INFO:tasks.workunit.client.1.smithi195.stdout:0/681: sync 2024-09-13T17:05:53.604 INFO:tasks.workunit.client.1.smithi195.stdout:0/682: truncate d7/d87/d9b/d56/d46/f6e 4964031 0 2024-09-13T17:05:53.604 INFO:tasks.workunit.client.1.smithi195.stdout:5/687: dread d2/df/d78/d54/d58/f6b [0,4194304] 0 2024-09-13T17:05:53.605 INFO:tasks.workunit.client.1.smithi195.stdout:2/692: creat d0/d3/df/fdb x:0 0 0 2024-09-13T17:05:53.605 INFO:tasks.workunit.client.1.smithi195.stdout:2/693: fsync d0/d3/f7a 0 2024-09-13T17:05:53.606 INFO:tasks.workunit.client.1.smithi195.stdout:1/632: dread db/d19/f4a [0,4194304] 0 2024-09-13T17:05:53.607 INFO:tasks.workunit.client.0.smithi115.stdout:8/484: rename d0/d18/d19 to d0/d26/d29/d59/d7e/da7 0 2024-09-13T17:05:53.607 INFO:tasks.workunit.client.0.smithi115.stdout:8/485: chown d0/d18/d51/c5d 111320516 1 2024-09-13T17:05:53.607 INFO:tasks.workunit.client.0.smithi115.stdout:8/486: fsync d0/d18/f65 0 2024-09-13T17:05:53.608 INFO:tasks.workunit.client.1.smithi195.stdout:3/681: stat d7/d19/c2c 0 2024-09-13T17:05:53.609 INFO:tasks.workunit.client.0.smithi115.stdout:8/487: link d0/d26/l54 d0/d26/d29/d59/d7e/da7/d28/la8 0 2024-09-13T17:05:53.609 INFO:tasks.workunit.client.0.smithi115.stdout:8/488: write d0/d21/d3a/d60/f78 [1733449,101612] 0 2024-09-13T17:05:53.610 INFO:tasks.workunit.client.1.smithi195.stdout:8/723: dread d0/dda/fa9 [0,4194304] 0 2024-09-13T17:05:53.612 INFO:tasks.workunit.client.0.smithi115.stdout:8/489: symlink d0/d42/la9 0 2024-09-13T17:05:53.616 INFO:tasks.workunit.client.1.smithi195.stdout:5/688: dread d2/d12/d4e/d10/d5c/f87 [0,4194304] 0 2024-09-13T17:05:53.616 INFO:tasks.workunit.client.1.smithi195.stdout:5/689: fsync d2/df/d86/f7e 0 2024-09-13T17:05:53.617 INFO:tasks.workunit.client.1.smithi195.stdout:9/732: dwrite d6/d19/d21/d45/fc9 [0,4194304] 0 2024-09-13T17:05:53.618 INFO:tasks.workunit.client.1.smithi195.stdout:4/826: dwrite d1a/d1f/d21/d36/f46 [0,4194304] 0 2024-09-13T17:05:53.618 INFO:tasks.workunit.client.0.smithi115.stdout:8/490: unlink d0/l3 0 2024-09-13T17:05:53.623 INFO:tasks.workunit.client.0.smithi115.stdout:8/491: unlink d0/c2 0 2024-09-13T17:05:53.623 INFO:tasks.workunit.client.0.smithi115.stdout:8/492: chown d0/d26/d29/d98/f9f 52369387 1 2024-09-13T17:05:53.625 INFO:tasks.workunit.client.1.smithi195.stdout:0/683: creat d7/d87/d9b/d56/db0/fd7 x:0 0 0 2024-09-13T17:05:53.626 INFO:tasks.workunit.client.1.smithi195.stdout:2/694: truncate d0/d4a/d47/d73/d75/d88/d2c/d51/f81 3325893 0 2024-09-13T17:05:53.626 INFO:tasks.workunit.client.1.smithi195.stdout:2/695: write d0/d3/f68 [3656615,32466] 0 2024-09-13T17:05:53.626 INFO:tasks.workunit.client.1.smithi195.stdout:2/696: write d0/d4a/d47/dba/fc0 [1274894,114842] 0 2024-09-13T17:05:53.628 INFO:tasks.workunit.client.0.smithi115.stdout:8/493: mknod d0/d26/d29/d59/d7e/da7/d2b/caa 0 2024-09-13T17:05:53.629 INFO:tasks.workunit.client.1.smithi195.stdout:1/633: unlink db/df/d4d/d74/cb9 0 2024-09-13T17:05:53.631 INFO:tasks.workunit.client.1.smithi195.stdout:5/690: mkdir d2/d12/d4e/d10/d5c/de3 0 2024-09-13T17:05:53.631 INFO:tasks.workunit.client.0.smithi115.stdout:8/494: dread d0/d15/f1b [0,4194304] 0 2024-09-13T17:05:53.635 INFO:tasks.workunit.client.1.smithi195.stdout:4/827: rename d1a/d1f/d21/d84/d9d/d58/l62 to d1a/d1f/d43/d5a/d63/dd1/db4/l114 0 2024-09-13T17:05:53.635 INFO:tasks.workunit.client.1.smithi195.stdout:4/828: write d1a/d1f/d43/d24/d41/d60/f8a [20411,76846] 0 2024-09-13T17:05:53.635 INFO:tasks.workunit.client.1.smithi195.stdout:4/829: write d1a/d1f/d21/ddd/fe9 [295631,2964] 0 2024-09-13T17:05:53.635 INFO:tasks.workunit.client.1.smithi195.stdout:0/684: dread d7/db/d38/f57 [0,4194304] 0 2024-09-13T17:05:53.637 INFO:tasks.workunit.client.1.smithi195.stdout:5/691: creat d2/d12/d4e/d10/d8f/dc9/fe4 x:0 0 0 2024-09-13T17:05:53.638 INFO:tasks.workunit.client.1.smithi195.stdout:2/697: getdents d0/d4a/d47/d73 0 2024-09-13T17:05:53.641 INFO:tasks.workunit.client.1.smithi195.stdout:5/692: dread d2/d12/d4e/d10/f4a [0,4194304] 0 2024-09-13T17:05:53.641 INFO:tasks.workunit.client.1.smithi195.stdout:4/830: link d1a/d1f/d21/d84/dcc/f10c d1a/d1f/d21/d22/f115 0 2024-09-13T17:05:53.641 INFO:tasks.workunit.client.1.smithi195.stdout:5/693: write d2/df/d78/fd7 [419032,116735] 0 2024-09-13T17:05:53.643 INFO:tasks.workunit.client.1.smithi195.stdout:4/831: dread d1a/d1f/d21/d36/f55 [0,4194304] 0 2024-09-13T17:05:53.645 INFO:tasks.workunit.client.1.smithi195.stdout:5/694: mkdir d2/df/d78/d54/de5 0 2024-09-13T17:05:53.645 INFO:tasks.workunit.client.1.smithi195.stdout:8/724: dwrite d0/d62/f98 [4194304,4194304] 0 2024-09-13T17:05:53.645 INFO:tasks.workunit.client.1.smithi195.stdout:1/634: write db/f1c [2843612,45719] 0 2024-09-13T17:05:53.646 INFO:tasks.workunit.client.1.smithi195.stdout:3/682: dwrite d7/d21/d2a/d35/d8f/fcd [0,4194304] 0 2024-09-13T17:05:53.646 INFO:tasks.workunit.client.1.smithi195.stdout:3/683: write d7/d21/d2a/d35/d9c/fd8 [891152,62862] 0 2024-09-13T17:05:53.646 INFO:tasks.workunit.client.1.smithi195.stdout:4/832: unlink d1a/d1f/d21/d84/d9d/d8e/d9f/lbb 0 2024-09-13T17:05:53.646 INFO:tasks.workunit.client.1.smithi195.stdout:9/733: dwrite d6/df/d16/fdd [0,4194304] 0 2024-09-13T17:05:53.647 INFO:tasks.workunit.client.1.smithi195.stdout:5/695: truncate d2/df/f81 2562204 0 2024-09-13T17:05:53.648 INFO:tasks.workunit.client.1.smithi195.stdout:5/696: chown d2/df/d48/d5a/d92/c94 2406841 1 2024-09-13T17:05:53.652 INFO:tasks.workunit.client.1.smithi195.stdout:5/697: link d2/d12/d4e/d10/d8f/lcc d2/d12/d3f/d7b/le6 0 2024-09-13T17:05:53.655 INFO:tasks.workunit.client.1.smithi195.stdout:1/635: write db/d19/d37/d3e/f43 [3183903,102947] 0 2024-09-13T17:05:53.655 INFO:tasks.workunit.client.1.smithi195.stdout:1/636: write db/d19/d5a/f61 [234133,120584] 0 2024-09-13T17:05:53.655 INFO:tasks.workunit.client.1.smithi195.stdout:1/637: chown db/d19/d37/d3e/f4c 114 1 2024-09-13T17:05:53.655 INFO:tasks.workunit.client.1.smithi195.stdout:8/725: dread d0/d17/f6b [0,4194304] 0 2024-09-13T17:05:53.658 INFO:tasks.workunit.client.1.smithi195.stdout:4/833: rename d1a/d1f/d43/d5a/d63/db8/db9 to d1a/d1f/d21/d84/d9d/d8e/d9f/db2/d116 0 2024-09-13T17:05:53.658 INFO:tasks.workunit.client.1.smithi195.stdout:4/834: write d1a/d1f/d43/d5a/f90 [1009564,28019] 0 2024-09-13T17:05:53.658 INFO:tasks.workunit.client.1.smithi195.stdout:4/835: chown d1a/d1f/d21/ffc 29 1 2024-09-13T17:05:53.660 INFO:tasks.workunit.client.1.smithi195.stdout:8/726: symlink d0/d13/lf8 0 2024-09-13T17:05:53.662 INFO:tasks.workunit.client.1.smithi195.stdout:1/638: mknod db/d19/d5a/d66/d7a/cdd 0 2024-09-13T17:05:53.663 INFO:tasks.workunit.client.1.smithi195.stdout:5/698: write d2/df/d78/faa [3621262,69879] 0 2024-09-13T17:05:53.663 INFO:tasks.workunit.client.1.smithi195.stdout:5/699: stat d2/df/d78/d99/fbf 0 2024-09-13T17:05:53.663 INFO:tasks.workunit.client.1.smithi195.stdout:5/700: chown d2/df/d78/d54/d58/f60 0 1 2024-09-13T17:05:53.663 INFO:tasks.workunit.client.1.smithi195.stdout:5/701: chown d2/df/d78/d54/d58/f60 972 1 2024-09-13T17:05:53.663 INFO:tasks.workunit.client.1.smithi195.stdout:5/702: fdatasync d2/d12/d4e/d10/f24 0 2024-09-13T17:05:53.664 INFO:tasks.workunit.client.1.smithi195.stdout:5/703: dread - d2/d12/d4e/fe0 zero size 2024-09-13T17:05:53.664 INFO:tasks.workunit.client.1.smithi195.stdout:4/836: mkdir d1a/d1f/d43/d5a/d63/dd1/db4/d117 0 2024-09-13T17:05:53.664 INFO:tasks.workunit.client.1.smithi195.stdout:4/837: write d1a/d1f/d43/d24/d41/fe8 [901263,95089] 0 2024-09-13T17:05:53.665 INFO:tasks.workunit.client.1.smithi195.stdout:4/838: chown d1a/d1f/d43/c6c 2649 1 2024-09-13T17:05:53.665 INFO:tasks.workunit.client.1.smithi195.stdout:4/839: write d1a/d1f/d21/d84/d9d/d8e/d9f/db2/dfd/fa0 [421833,28332] 0 2024-09-13T17:05:53.665 INFO:tasks.workunit.client.1.smithi195.stdout:4/840: creat d1a/d1f/d21/ddd/f118 x:0 0 0 2024-09-13T17:05:53.665 INFO:tasks.workunit.client.1.smithi195.stdout:8/727: truncate d0/d17/f6b 816282 0 2024-09-13T17:05:53.665 INFO:tasks.workunit.client.1.smithi195.stdout:8/728: readlink d0/d13/d52/d55/l5b 0 2024-09-13T17:05:53.666 INFO:tasks.workunit.client.1.smithi195.stdout:8/729: dread - d0/fa8 zero size 2024-09-13T17:05:53.667 INFO:tasks.workunit.client.1.smithi195.stdout:1/639: mknod db/cde 0 2024-09-13T17:05:53.667 INFO:tasks.workunit.client.1.smithi195.stdout:1/640: write db/d19/d5a/d66/d96/dd0/fd7 [55964,931] 0 2024-09-13T17:05:53.669 INFO:tasks.workunit.client.1.smithi195.stdout:5/704: link d2/df/d78/d54/d58/la5 d2/df/d78/le7 0 2024-09-13T17:05:53.669 INFO:tasks.workunit.client.1.smithi195.stdout:5/705: truncate d2/d12/d4e/d10/d8f/fa0 684784 0 2024-09-13T17:05:53.671 INFO:tasks.workunit.client.1.smithi195.stdout:4/841: creat d1a/d1f/d21/d84/d9d/d8e/d9f/db2/d116/f119 x:0 0 0 2024-09-13T17:05:53.672 INFO:tasks.workunit.client.1.smithi195.stdout:4/842: chown d1a/d1f/d43/d24/d41/fd3 28349228 1 2024-09-13T17:05:53.672 INFO:tasks.workunit.client.1.smithi195.stdout:4/843: stat d1a/d1f/d21/d36/f55 0 2024-09-13T17:05:53.672 INFO:tasks.workunit.client.1.smithi195.stdout:8/730: mknod d0/d17/d49/d63/cf9 0 2024-09-13T17:05:53.673 INFO:tasks.workunit.client.1.smithi195.stdout:8/731: getdents d0/d13/d69 0 2024-09-13T17:05:53.675 INFO:tasks.workunit.client.1.smithi195.stdout:5/706: dread d2/d12/f50 [0,4194304] 0 2024-09-13T17:05:53.678 INFO:tasks.workunit.client.1.smithi195.stdout:5/707: dread d2/d12/f50 [0,4194304] 0 2024-09-13T17:05:53.685 INFO:tasks.workunit.client.1.smithi195.stdout:0/685: dwrite d7/d50/f5c [0,4194304] 0 2024-09-13T17:05:53.692 INFO:tasks.workunit.client.1.smithi195.stdout:9/734: dwrite d6/d19/d21/d45/dad/d5e/de7/fe9 [0,4194304] 0 2024-09-13T17:05:53.692 INFO:tasks.workunit.client.1.smithi195.stdout:3/684: dwrite d7/fd2 [0,4194304] 0 2024-09-13T17:05:53.692 INFO:tasks.workunit.client.1.smithi195.stdout:1/641: dwrite db/df/d13/f2e [0,4194304] 0 2024-09-13T17:05:53.692 INFO:tasks.workunit.client.1.smithi195.stdout:1/642: creat db/df/d4d/fdf x:0 0 0 2024-09-13T17:05:53.692 INFO:tasks.workunit.client.0.smithi115.stdout:8/495: dwrite d0/d21/d3a/d60/f78 [4194304,4194304] 0 2024-09-13T17:05:53.693 INFO:tasks.workunit.client.1.smithi195.stdout:4/844: dwrite f8 [0,4194304] 0 2024-09-13T17:05:53.694 INFO:tasks.workunit.client.1.smithi195.stdout:4/845: chown d1a/d1f/f87 386063 1 2024-09-13T17:05:53.694 INFO:tasks.workunit.client.1.smithi195.stdout:4/846: fdatasync d1a/d1f/d43/d24/d41/f8d 0 2024-09-13T17:05:53.694 INFO:tasks.workunit.client.1.smithi195.stdout:4/847: truncate d1a/d1f/d43/d5a/d63/db8/fd8 620578 0 2024-09-13T17:05:53.694 INFO:tasks.workunit.client.1.smithi195.stdout:4/848: creat d1a/f11a x:0 0 0 2024-09-13T17:05:53.699 INFO:tasks.workunit.client.1.smithi195.stdout:0/686: dread d7/d87/d9b/d4e/d68/f79 [0,4194304] 0 2024-09-13T17:05:53.699 INFO:tasks.workunit.client.1.smithi195.stdout:0/687: fsync d7/d50/f1c 0 2024-09-13T17:05:53.711 INFO:tasks.workunit.client.1.smithi195.stdout:3/685: dwrite d7/d21/d2a/d4a/d5a/f8e [0,4194304] 0 2024-09-13T17:05:53.711 INFO:tasks.workunit.client.1.smithi195.stdout:3/686: readlink d7/d21/d2a/d35/d60/d6f/dbf/ld4 0 2024-09-13T17:05:53.711 INFO:tasks.workunit.client.1.smithi195.stdout:3/687: write d7/d19/f48 [606505,25306] 0 2024-09-13T17:05:53.715 INFO:tasks.workunit.client.1.smithi195.stdout:0/688: write d7/d87/d9b/d56/d46/f91 [2177393,77591] 0 2024-09-13T17:05:53.720 INFO:tasks.workunit.client.1.smithi195.stdout:4/849: dwrite d1a/d1f/d21/d84/d9d/d8e/d9f/db2/dfd/fa0 [0,4194304] 0 2024-09-13T17:05:53.727 INFO:tasks.workunit.client.1.smithi195.stdout:8/732: mkdir d0/d17/d2f/d7c/d4c/d9b/ddf/dfa 0 2024-09-13T17:05:53.727 INFO:tasks.workunit.client.1.smithi195.stdout:8/733: dread - d0/d17/d2f/d7c/d4c/d67/fef zero size 2024-09-13T17:05:53.731 INFO:tasks.workunit.client.1.smithi195.stdout:5/708: link d2/d12/d4e/d10/d5c/fe1 d2/df/d90/db2/fe8 0 2024-09-13T17:05:53.731 INFO:tasks.workunit.client.1.smithi195.stdout:5/709: fsync d2/d12/d4e/fdd 0 2024-09-13T17:05:53.731 INFO:tasks.workunit.client.1.smithi195.stdout:5/710: creat d2/d12/d4e/d10/d8f/fe9 x:0 0 0 2024-09-13T17:05:53.732 INFO:tasks.workunit.client.1.smithi195.stdout:2/698: fsync d0/d4a/d47/d73/d75/d88/d2c/d51/f81 0 2024-09-13T17:05:53.732 INFO:tasks.workunit.client.1.smithi195.stdout:2/699: chown d0/d3/l69 978 1 2024-09-13T17:05:53.740 INFO:tasks.workunit.client.1.smithi195.stdout:7/701: sync 2024-09-13T17:05:53.747 INFO:tasks.workunit.client.1.smithi195.stdout:2/700: dwrite d0/fab [0,4194304] 0 2024-09-13T17:05:53.762 INFO:tasks.workunit.client.1.smithi195.stdout:9/735: mkdir d6/d19/df7 0 2024-09-13T17:05:53.762 INFO:tasks.workunit.client.1.smithi195.stdout:9/736: dread - d6/df/d13/d8e/fed zero size 2024-09-13T17:05:53.762 INFO:tasks.workunit.client.1.smithi195.stdout:9/737: chown d6/d19/d21/d45/dad/d5e/da0/cd3 634972 1 2024-09-13T17:05:53.765 INFO:tasks.workunit.client.1.smithi195.stdout:1/643: mkdir db/d19/d37/d46/d7e/de0 0 2024-09-13T17:05:53.765 INFO:tasks.workunit.client.1.smithi195.stdout:1/644: chown db/df/d4d/d67/c77 124 1 2024-09-13T17:05:53.765 INFO:tasks.workunit.client.1.smithi195.stdout:1/645: chown db/df/l42 8919 1 2024-09-13T17:05:53.765 INFO:tasks.workunit.client.1.smithi195.stdout:1/646: creat db/df/d4d/d74/fe1 x:0 0 0 2024-09-13T17:05:53.769 INFO:tasks.workunit.client.1.smithi195.stdout:3/688: creat d7/d67/fda x:0 0 0 2024-09-13T17:05:53.770 INFO:tasks.workunit.client.1.smithi195.stdout:0/689: mkdir d7/d88/d23/d96/dd8 0 2024-09-13T17:05:53.771 INFO:tasks.workunit.client.1.smithi195.stdout:4/850: symlink d1a/d1f/d9c/dee/l11b 0 2024-09-13T17:05:53.772 INFO:tasks.workunit.client.1.smithi195.stdout:1/647: dread db/df/d51/d8e/fad [0,4194304] 0 2024-09-13T17:05:53.773 INFO:tasks.workunit.client.1.smithi195.stdout:8/734: creat d0/d17/d2f/d7c/ffb x:0 0 0 2024-09-13T17:05:53.775 INFO:tasks.workunit.client.1.smithi195.stdout:5/711: mknod d2/df/d78/d99/cea 0 2024-09-13T17:05:53.776 INFO:tasks.workunit.client.1.smithi195.stdout:7/702: mknod d5/db/cf6 0 2024-09-13T17:05:53.776 INFO:tasks.workunit.client.1.smithi195.stdout:7/703: write d5/db/d19/d22/d3c/fa6 [561151,11248] 0 2024-09-13T17:05:53.776 INFO:tasks.workunit.client.1.smithi195.stdout:9/738: dwrite d6/d19/d21/d45/dad/d5e/da0/fb7 [0,4194304] 0 2024-09-13T17:05:53.776 INFO:tasks.workunit.client.1.smithi195.stdout:9/739: dread - d6/df/d16/de3/feb zero size 2024-09-13T17:05:53.779 INFO:tasks.workunit.client.1.smithi195.stdout:2/701: getdents d0/d4a/d47/d73/d75/d88/d2c 0 2024-09-13T17:05:53.779 INFO:tasks.workunit.client.1.smithi195.stdout:2/702: stat d0/d3/df/f9e 0 2024-09-13T17:05:53.779 INFO:tasks.workunit.client.1.smithi195.stdout:2/703: write d0/d3/df/fdb [96646,48328] 0 2024-09-13T17:05:53.779 INFO:tasks.workunit.client.1.smithi195.stdout:2/704: read d0/f66 [5607055,124941] 0 2024-09-13T17:05:53.780 INFO:tasks.workunit.client.1.smithi195.stdout:3/689: mkdir d7/d21/d2a/d35/d9c/dcf/ddb 0 2024-09-13T17:05:53.781 INFO:tasks.workunit.client.1.smithi195.stdout:0/690: mkdir d7/db/dd9 0 2024-09-13T17:05:53.783 INFO:tasks.workunit.client.1.smithi195.stdout:4/851: symlink d1a/d1f/d21/ddd/l11c 0 2024-09-13T17:05:53.784 INFO:tasks.workunit.client.1.smithi195.stdout:1/648: symlink db/df/d4d/d67/le2 0 2024-09-13T17:05:53.786 INFO:tasks.workunit.client.1.smithi195.stdout:8/735: truncate d0/dda/fa9 1465321 0 2024-09-13T17:05:53.788 INFO:tasks.workunit.client.1.smithi195.stdout:7/704: write d5/d35/f57 [5175657,36638] 0 2024-09-13T17:05:53.789 INFO:tasks.workunit.client.1.smithi195.stdout:9/740: getdents d6/df/d16/d58 0 2024-09-13T17:05:53.791 INFO:tasks.workunit.client.1.smithi195.stdout:4/852: mkdir d1a/d11d 0 2024-09-13T17:05:53.791 INFO:tasks.workunit.client.1.smithi195.stdout:4/853: creat d1a/d1f/d9c/f11e x:0 0 0 2024-09-13T17:05:53.791 INFO:tasks.workunit.client.1.smithi195.stdout:5/712: rmdir d2/df/d86 39 2024-09-13T17:05:53.795 INFO:tasks.workunit.client.1.smithi195.stdout:7/705: getdents d5/db/d50 0 2024-09-13T17:05:53.795 INFO:tasks.workunit.client.1.smithi195.stdout:0/691: dread d7/d88/d23/f62 [0,4194304] 0 2024-09-13T17:05:53.795 INFO:tasks.workunit.client.1.smithi195.stdout:0/692: chown d7/db/d11 98874 1 2024-09-13T17:05:53.795 INFO:tasks.workunit.client.1.smithi195.stdout:0/693: fsync d7/d87/d9b/d56/d4d/fc4 0 2024-09-13T17:05:53.795 INFO:tasks.workunit.client.1.smithi195.stdout:9/741: link d6/d12/d86/dd2/fe8 d6/df/d7b/df6/ff8 0 2024-09-13T17:05:53.797 INFO:tasks.workunit.client.1.smithi195.stdout:3/690: dwrite d7/d19/d1e/f4c [0,4194304] 0 2024-09-13T17:05:53.797 INFO:tasks.workunit.client.1.smithi195.stdout:3/691: dread - d7/d21/d2a/d35/d60/d6f/da4/fb8 zero size 2024-09-13T17:05:53.803 INFO:tasks.workunit.client.1.smithi195.stdout:4/854: symlink d1a/d1f/d21/d84/d9d/d58/l11f 0 2024-09-13T17:05:53.803 INFO:tasks.workunit.client.1.smithi195.stdout:7/706: mknod d5/d13/d24/d70/cf7 0 2024-09-13T17:05:53.803 INFO:tasks.workunit.client.1.smithi195.stdout:4/855: chown d1a/d1f/d21/d22/d98/da3/ce5 86 1 2024-09-13T17:05:53.803 INFO:tasks.workunit.client.1.smithi195.stdout:7/707: fsync d5/d35/fe2 0 2024-09-13T17:05:53.803 INFO:tasks.workunit.client.1.smithi195.stdout:4/856: fdatasync d1a/d1f/fe2 0 2024-09-13T17:05:53.805 INFO:tasks.workunit.client.1.smithi195.stdout:6/635: sync 2024-09-13T17:05:53.805 INFO:tasks.workunit.client.1.smithi195.stdout:6/636: creat d1c/d24/fd5 x:0 0 0 2024-09-13T17:05:53.805 INFO:tasks.workunit.client.1.smithi195.stdout:6/637: write d1c/fa1 [1037564,126375] 0 2024-09-13T17:05:53.805 INFO:tasks.workunit.client.1.smithi195.stdout:6/638: write d1c/d24/d49/d5f/d85/d8f/fd0 [175173,30853] 0 2024-09-13T17:05:53.810 INFO:tasks.workunit.client.1.smithi195.stdout:6/639: unlink d1c/d24/d49/d5f/db1/lbf 0 2024-09-13T17:05:53.810 INFO:tasks.workunit.client.1.smithi195.stdout:6/640: fsync f2 0 2024-09-13T17:05:53.816 INFO:tasks.workunit.client.1.smithi195.stdout:1/649: dwrite db/df/d51/d62/d70/fa5 [0,4194304] 0 2024-09-13T17:05:53.829 INFO:tasks.workunit.client.1.smithi195.stdout:4/857: fdatasync d1a/d1f/d43/d24/d41/fe8 0 2024-09-13T17:05:53.829 INFO:tasks.workunit.client.1.smithi195.stdout:4/858: write d1a/d1f/d21/d84/d9d/f9b [852023,128085] 0 2024-09-13T17:05:53.832 INFO:tasks.workunit.client.1.smithi195.stdout:8/736: dwrite d0/d17/d2f/f93 [0,4194304] 0 2024-09-13T17:05:53.832 INFO:tasks.workunit.client.1.smithi195.stdout:8/737: chown d0/d17/c18 20 1 2024-09-13T17:05:53.833 INFO:tasks.workunit.client.1.smithi195.stdout:4/859: rename d1a/d1f/d21/d36/f7c to d1a/d1f/d21/d84/d9d/d8e/d9f/db2/d116/f120 0 2024-09-13T17:05:53.833 INFO:tasks.workunit.client.1.smithi195.stdout:3/692: getdents d7/d21/d2a/d35/d9c/dcf 0 2024-09-13T17:05:53.833 INFO:tasks.workunit.client.1.smithi195.stdout:3/693: truncate d7/d21/d2a/d4a/d5a/fa5 1004369 0 2024-09-13T17:05:53.840 INFO:tasks.workunit.client.1.smithi195.stdout:8/738: mkdir d0/d17/d2f/d31/db4/dfc 0 2024-09-13T17:05:53.843 INFO:tasks.workunit.client.1.smithi195.stdout:4/860: mkdir d1a/d1f/d43/d5a/d63/dd1/d121 0 2024-09-13T17:05:53.845 INFO:tasks.workunit.client.1.smithi195.stdout:3/694: symlink d7/ldc 0 2024-09-13T17:05:53.846 INFO:tasks.workunit.client.1.smithi195.stdout:4/861: mknod d1a/d1f/d43/d24/d41/c122 0 2024-09-13T17:05:53.847 INFO:tasks.workunit.client.1.smithi195.stdout:3/695: mkdir d7/d21/d2a/d4a/d5a/ddd 0 2024-09-13T17:05:53.849 INFO:tasks.workunit.client.1.smithi195.stdout:4/862: mkdir d1a/d1f/d21/d22/d98/da3/d123 0 2024-09-13T17:05:53.849 INFO:tasks.workunit.client.1.smithi195.stdout:4/863: fdatasync d1a/d1f/d21/ddd/fe7 0 2024-09-13T17:05:53.851 INFO:tasks.workunit.client.1.smithi195.stdout:4/864: mkdir d1a/d1f/d43/d24/d41/d60/d6f/d124 0 2024-09-13T17:05:53.851 INFO:tasks.workunit.client.1.smithi195.stdout:4/865: mknod d1a/d1f/d43/d24/d41/c125 0 2024-09-13T17:05:53.856 INFO:tasks.workunit.client.1.smithi195.stdout:3/696: dread f5 [0,4194304] 0 2024-09-13T17:05:53.856 INFO:tasks.workunit.client.1.smithi195.stdout:3/697: creat d7/fde x:0 0 0 2024-09-13T17:05:53.860 INFO:tasks.workunit.client.1.smithi195.stdout:7/708: dwrite d5/db/d19/d22/d3c/f4f [0,4194304] 0 2024-09-13T17:05:53.860 INFO:tasks.workunit.client.1.smithi195.stdout:7/709: chown d5/db/d19/d22/l74 5 1 2024-09-13T17:05:53.860 INFO:tasks.workunit.client.1.smithi195.stdout:7/710: fdatasync d5/db/d19/d22/f4e 0 2024-09-13T17:05:53.860 INFO:tasks.workunit.client.1.smithi195.stdout:0/694: dwrite f1 [0,4194304] 0 2024-09-13T17:05:53.860 INFO:tasks.workunit.client.1.smithi195.stdout:7/711: dread - d5/d13/d24/d70/dd5/fdb zero size 2024-09-13T17:05:53.860 INFO:tasks.workunit.client.1.smithi195.stdout:7/712: chown d5/db/d19/d22/l97 10651 1 2024-09-13T17:05:53.860 INFO:tasks.workunit.client.1.smithi195.stdout:2/705: dwrite d0/d3/d3d/f50 [0,4194304] 0 2024-09-13T17:05:53.860 INFO:tasks.workunit.client.1.smithi195.stdout:2/706: fsync d0/d3/f26 0 2024-09-13T17:05:53.860 INFO:tasks.workunit.client.1.smithi195.stdout:2/707: chown d0/d4a/d47/d73/d75/d88/d2c/d43/d84/dac/fc7 5816664 1 2024-09-13T17:05:53.863 INFO:tasks.workunit.client.1.smithi195.stdout:3/698: write d7/d21/f73 [3346654,17966] 0 2024-09-13T17:05:53.865 INFO:tasks.workunit.client.1.smithi195.stdout:4/866: write d1a/d1f/d43/d24/d41/fab [334246,20252] 0 2024-09-13T17:05:53.865 INFO:tasks.workunit.client.1.smithi195.stdout:5/713: dwrite d2/d12/d4e/d10/f23 [0,4194304] 0 2024-09-13T17:05:53.866 INFO:tasks.workunit.client.1.smithi195.stdout:9/742: dwrite d6/d12/f8a [4194304,4194304] 0 2024-09-13T17:05:53.868 INFO:tasks.workunit.client.1.smithi195.stdout:7/713: rmdir d5/db 39 2024-09-13T17:05:53.868 INFO:tasks.workunit.client.1.smithi195.stdout:7/714: stat d5/db/d19/d22/fe3 0 2024-09-13T17:05:53.868 INFO:tasks.workunit.client.1.smithi195.stdout:7/715: readlink d5/db/d19/d22/l93 0 2024-09-13T17:05:53.869 INFO:tasks.workunit.client.1.smithi195.stdout:7/716: chown d5/db/ld1 461 1 2024-09-13T17:05:53.869 INFO:tasks.workunit.client.1.smithi195.stdout:1/650: dwrite db/df/d4d/d74/f76 [0,4194304] 0 2024-09-13T17:05:53.871 INFO:tasks.workunit.client.1.smithi195.stdout:2/708: write d0/d4a/f36 [3696882,126706] 0 2024-09-13T17:05:53.872 INFO:tasks.workunit.client.1.smithi195.stdout:4/867: link d1a/d1f/d43/d5a/d63/dd1/fea d1a/d1f/d43/d24/d41/d60/d6f/d124/f126 0 2024-09-13T17:05:53.873 INFO:tasks.workunit.client.1.smithi195.stdout:5/714: dread d2/df/d86/f5d [0,4194304] 0 2024-09-13T17:05:53.873 INFO:tasks.workunit.client.0.smithi115.stdout:7/427: sync 2024-09-13T17:05:53.877 INFO:tasks.workunit.client.1.smithi195.stdout:4/868: dread d1a/d1f/d21/f6a [0,4194304] 0 2024-09-13T17:05:53.877 INFO:tasks.workunit.client.1.smithi195.stdout:9/743: truncate d6/df/f38 3573114 0 2024-09-13T17:05:53.879 INFO:tasks.workunit.client.1.smithi195.stdout:3/699: dread d7/d62/d70/f90 [0,4194304] 0 2024-09-13T17:05:53.879 INFO:tasks.workunit.client.1.smithi195.stdout:3/700: write d7/d21/f73 [2156231,21538] 0 2024-09-13T17:05:53.881 INFO:tasks.workunit.client.1.smithi195.stdout:2/709: dread d0/d4a/d47/d73/d75/d88/d1e/f2a [4194304,4194304] 0 2024-09-13T17:05:53.881 INFO:tasks.workunit.client.1.smithi195.stdout:1/651: truncate db/df/d51/d8e/fad 495539 0 2024-09-13T17:05:53.884 INFO:tasks.workunit.client.1.smithi195.stdout:0/695: truncate f1 3095907 0 2024-09-13T17:05:53.884 INFO:tasks.workunit.client.1.smithi195.stdout:0/696: dread - d7/d88/d23/fcb zero size 2024-09-13T17:05:53.884 INFO:tasks.workunit.client.1.smithi195.stdout:7/717: write d5/d13/d24/fd7 [1690700,86819] 0 2024-09-13T17:05:53.889 INFO:tasks.workunit.client.1.smithi195.stdout:1/652: dread db/df/d51/f53 [0,4194304] 0 2024-09-13T17:05:53.889 INFO:tasks.workunit.client.1.smithi195.stdout:1/653: truncate db/df/d4d/f81 27743 0 2024-09-13T17:05:53.889 INFO:tasks.workunit.client.1.smithi195.stdout:1/654: write db/f18 [3278291,62633] 0 2024-09-13T17:05:53.890 INFO:tasks.workunit.client.1.smithi195.stdout:1/655: chown db/df/d51/d62/d70/fa5 3 1 2024-09-13T17:05:53.890 INFO:tasks.workunit.client.1.smithi195.stdout:1/656: chown db/d19/d37/d46/d7e/cac 60472 1 2024-09-13T17:05:53.890 INFO:tasks.workunit.client.1.smithi195.stdout:1/657: stat db/d58/fd6 0 2024-09-13T17:05:53.890 INFO:tasks.workunit.client.1.smithi195.stdout:1/658: write db/fa3 [869846,121753] 0 2024-09-13T17:05:53.890 INFO:tasks.workunit.client.1.smithi195.stdout:1/659: chown db/df/l42 56 1 2024-09-13T17:05:53.892 INFO:tasks.workunit.client.1.smithi195.stdout:9/744: creat d6/ff9 x:0 0 0 2024-09-13T17:05:53.894 INFO:tasks.workunit.client.1.smithi195.stdout:3/701: unlink d7/d19/lc1 0 2024-09-13T17:05:53.894 INFO:tasks.workunit.client.1.smithi195.stdout:3/702: write d7/d21/d2a/fc8 [30841,15739] 0 2024-09-13T17:05:53.894 INFO:tasks.workunit.client.1.smithi195.stdout:3/703: read d7/d21/d2a/fc8 [10230,112090] 0 2024-09-13T17:05:53.895 INFO:tasks.workunit.client.0.smithi115.stdout:7/428: dwrite d0/d2/d4a/f5f [0,4194304] 0 2024-09-13T17:05:53.895 INFO:tasks.workunit.client.1.smithi195.stdout:2/710: truncate d0/d3/fd8 390435 0 2024-09-13T17:05:53.897 INFO:tasks.workunit.client.1.smithi195.stdout:0/697: unlink d7/d87/d9b/d56/d4d/fc4 0 2024-09-13T17:05:53.899 INFO:tasks.workunit.client.1.smithi195.stdout:1/660: link db/df/d4d/d74/c7d db/d19/d37/ce3 0 2024-09-13T17:05:53.899 INFO:tasks.workunit.client.1.smithi195.stdout:1/661: chown db/df/d4d/d67/dc6/cdb 3209326 1 2024-09-13T17:05:53.904 INFO:tasks.workunit.client.0.smithi115.stdout:7/429: dread d0/d3b/d50/d21/f33 [0,4194304] 0 2024-09-13T17:05:53.907 INFO:tasks.workunit.client.0.smithi115.stdout:7/430: symlink d0/d2/d1e/d3d/d7c/l9a 0 2024-09-13T17:05:53.909 INFO:tasks.workunit.client.1.smithi195.stdout:5/715: rename d2/d12 to d2/df/d78/deb 0 2024-09-13T17:05:53.912 INFO:tasks.workunit.client.0.smithi115.stdout:7/431: mkdir d0/d2/d67/d86/d94/d9b 0 2024-09-13T17:05:53.913 INFO:tasks.workunit.client.1.smithi195.stdout:4/869: getdents d1a/d1f/d21/d84/d9d/d58 0 2024-09-13T17:05:53.922 INFO:tasks.workunit.client.1.smithi195.stdout:4/870: write d1a/d1f/d21/d84/d9d/f3f [1315110,64821] 0 2024-09-13T17:05:53.922 INFO:tasks.workunit.client.1.smithi195.stdout:9/745: truncate d6/d12/d39/fc5 2054695 0 2024-09-13T17:05:53.922 INFO:tasks.workunit.client.0.smithi115.stdout:7/432: write d0/d3b/d50/f47 [2248111,108373] 0 2024-09-13T17:05:53.924 INFO:tasks.workunit.client.1.smithi195.stdout:3/704: creat d7/d21/d2a/d35/d60/d64/fdf x:0 0 0 2024-09-13T17:05:53.924 INFO:tasks.workunit.client.1.smithi195.stdout:3/705: creat d7/d21/d2a/d35/d60/d64/fe0 x:0 0 0 2024-09-13T17:05:53.924 INFO:tasks.workunit.client.1.smithi195.stdout:3/706: creat d7/d62/d70/fe1 x:0 0 0 2024-09-13T17:05:53.924 INFO:tasks.workunit.client.1.smithi195.stdout:3/707: chown d7/d21/d2a/d4a/fbe 30196 1 2024-09-13T17:05:53.924 INFO:tasks.workunit.client.1.smithi195.stdout:3/708: fdatasync d7/d67/f6c 0 2024-09-13T17:05:53.924 INFO:tasks.workunit.client.1.smithi195.stdout:2/711: unlink d0/d4a/d47/d73/d75/d88/d1e/cd1 0 2024-09-13T17:05:53.927 INFO:tasks.workunit.client.1.smithi195.stdout:0/698: mkdir d7/d87/d9b/d4e/d68/dda 0 2024-09-13T17:05:53.928 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:53 smithi115 ceph-mon[27708]: Reconfiguring daemon prometheus.smithi115 on smithi115 2024-09-13T17:05:53.929 INFO:tasks.workunit.client.1.smithi195.stdout:2/712: dread d0/d3/f68 [0,4194304] 0 2024-09-13T17:05:53.929 INFO:tasks.workunit.client.0.smithi115.stdout:7/433: rename d0/d2/d1e/f39 to d0/d2/d1e/d3d/d6c/f9c 0 2024-09-13T17:05:53.930 INFO:tasks.workunit.client.0.smithi115.stdout:7/434: fdatasync d0/d2/d67/d86/d94/f95 0 2024-09-13T17:05:53.930 INFO:tasks.workunit.client.0.smithi115.stdout:7/435: write d0/f13 [1394782,22745] 0 2024-09-13T17:05:53.931 INFO:tasks.workunit.client.1.smithi195.stdout:1/662: creat db/d58/fe4 x:0 0 0 2024-09-13T17:05:53.931 INFO:tasks.workunit.client.1.smithi195.stdout:1/663: write db/df/d4d/d74/fbd [1269563,65867] 0 2024-09-13T17:05:53.933 INFO:tasks.workunit.client.1.smithi195.stdout:2/713: dread d0/f24 [0,4194304] 0 2024-09-13T17:05:53.933 INFO:tasks.workunit.client.1.smithi195.stdout:2/714: dread - d0/d4a/d47/d73/d75/d88/d1e/f9c zero size 2024-09-13T17:05:53.933 INFO:tasks.workunit.client.1.smithi195.stdout:7/718: rename d5/db/l55 to d5/db/d50/d7f/d82/dad/df0/lf8 0 2024-09-13T17:05:53.934 INFO:tasks.workunit.client.0.smithi115.stdout:7/436: creat d0/d2/d1e/f9d x:0 0 0 2024-09-13T17:05:53.934 INFO:tasks.workunit.client.0.smithi115.stdout:7/437: write d0/d2/d1e/d3d/f6d [1389802,106114] 0 2024-09-13T17:05:53.935 INFO:tasks.workunit.client.1.smithi195.stdout:6/641: sync 2024-09-13T17:05:53.935 INFO:tasks.workunit.client.1.smithi195.stdout:8/739: sync 2024-09-13T17:05:53.935 INFO:tasks.workunit.client.1.smithi195.stdout:8/740: truncate d0/d17/d49/d63/fb5 1236309 0 2024-09-13T17:05:53.938 INFO:tasks.workunit.client.1.smithi195.stdout:5/716: mkdir d2/df/d90/dbb/dec 0 2024-09-13T17:05:53.938 INFO:tasks.workunit.client.1.smithi195.stdout:5/717: read - d2/df/d78/deb/d4e/d10/fd8 zero size 2024-09-13T17:05:53.938 INFO:tasks.workunit.client.1.smithi195.stdout:5/718: write d2/df/d86/f7e [387566,49417] 0 2024-09-13T17:05:53.940 INFO:tasks.workunit.client.0.smithi115.stdout:7/438: unlink d0/d2/d1e/d3d/d6c/f5d 0 2024-09-13T17:05:53.940 INFO:tasks.workunit.client.0.smithi115.stdout:7/439: stat d0/d51 0 2024-09-13T17:05:53.942 INFO:tasks.workunit.client.1.smithi195.stdout:2/715: dread d0/d4a/d47/d73/d75/d88/d2c/f8d [0,4194304] 0 2024-09-13T17:05:53.942 INFO:tasks.workunit.client.1.smithi195.stdout:2/716: chown d0/f21 656240454 1 2024-09-13T17:05:53.942 INFO:tasks.workunit.client.1.smithi195.stdout:2/717: chown d0/d4a/d47/d73/d75/d88/d1e/f65 7 1 2024-09-13T17:05:53.942 INFO:tasks.workunit.client.1.smithi195.stdout:2/718: chown d0/d4a/c41 1 1 2024-09-13T17:05:53.943 INFO:tasks.workunit.client.0.smithi115.stdout:7/440: mkdir d0/d3b/d50/d21/d2f/d9e 0 2024-09-13T17:05:53.943 INFO:tasks.workunit.client.1.smithi195.stdout:4/871: dwrite d1a/d1f/d21/d84/d9d/f9b [0,4194304] 0 2024-09-13T17:05:53.943 INFO:tasks.workunit.client.1.smithi195.stdout:4/872: truncate d1a/d1f/d21/ff0 786235 0 2024-09-13T17:05:53.946 INFO:tasks.workunit.client.1.smithi195.stdout:3/709: link d7/d19/c9d d7/d5f/ce2 0 2024-09-13T17:05:53.946 INFO:tasks.workunit.client.1.smithi195.stdout:3/710: write d7/d19/f48 [3278245,87008] 0 2024-09-13T17:05:53.947 INFO:tasks.workunit.client.1.smithi195.stdout:0/699: mknod d7/d50/da2/cdb 0 2024-09-13T17:05:53.949 INFO:tasks.workunit.client.1.smithi195.stdout:1/664: unlink l6 0 2024-09-13T17:05:53.949 INFO:tasks.workunit.client.1.smithi195.stdout:1/665: truncate db/d19/d5a/fc0 911471 0 2024-09-13T17:05:53.950 INFO:tasks.workunit.client.1.smithi195.stdout:7/719: getdents d5/db/d50/daa 0 2024-09-13T17:05:53.950 INFO:tasks.workunit.client.1.smithi195.stdout:9/746: dwrite d6/d8d/fb0 [0,4194304] 0 2024-09-13T17:05:53.952 INFO:tasks.workunit.client.0.smithi115.stdout:7/441: write d0/d3b/d50/f10 [3887155,37411] 0 2024-09-13T17:05:53.953 INFO:tasks.workunit.client.1.smithi195.stdout:5/719: rmdir d2/df/d78/deb/d3f/d7b/dc8 0 2024-09-13T17:05:53.954 INFO:tasks.workunit.client.1.smithi195.stdout:2/719: dread d0/d4a/d47/d73/d94/fb0 [0,4194304] 0 2024-09-13T17:05:53.956 INFO:tasks.workunit.client.0.smithi115.stdout:7/442: rename d0/d3b/d50/c42 to d0/d2/d1e/d73/c9f 0 2024-09-13T17:05:53.956 INFO:tasks.workunit.client.0.smithi115.stdout:7/443: chown d0/d3b/d54 0 1 2024-09-13T17:05:53.957 INFO:tasks.workunit.client.1.smithi195.stdout:4/873: mknod d1a/d1f/d43/d5a/c127 0 2024-09-13T17:05:53.958 INFO:tasks.workunit.client.1.smithi195.stdout:3/711: creat d7/d21/d2a/d4a/d5a/fe3 x:0 0 0 2024-09-13T17:05:53.960 INFO:tasks.workunit.client.1.smithi195.stdout:6/642: dwrite d1c/d24/fd5 [0,4194304] 0 2024-09-13T17:05:53.960 INFO:tasks.workunit.client.0.smithi115.stdout:7/444: mknod d0/d2/d1e/d3d/d6c/ca0 0 2024-09-13T17:05:53.960 INFO:tasks.workunit.client.0.smithi115.stdout:7/445: dread - d0/d2/d67/d86/d94/f95 zero size 2024-09-13T17:05:53.961 INFO:tasks.workunit.client.1.smithi195.stdout:0/700: mknod d7/d50/da1/cdc 0 2024-09-13T17:05:53.961 INFO:tasks.workunit.client.1.smithi195.stdout:0/701: chown d7/d88/d23/l7d 1 1 2024-09-13T17:05:53.961 INFO:tasks.workunit.client.1.smithi195.stdout:7/720: mkdir d5/d13/da8/df9 0 2024-09-13T17:05:53.961 INFO:tasks.workunit.client.1.smithi195.stdout:7/721: truncate d5/db/d19/d22/fe3 5360213 0 2024-09-13T17:05:53.962 INFO:tasks.workunit.client.0.smithi115.stdout:7/446: symlink d0/d3b/d50/d21/d2f/la1 0 2024-09-13T17:05:53.963 INFO:tasks.workunit.client.1.smithi195.stdout:7/722: dread d5/db/d19/fb4 [0,4194304] 0 2024-09-13T17:05:53.963 INFO:tasks.workunit.client.1.smithi195.stdout:7/723: chown d5/d13/da8/ff4 3226461 1 2024-09-13T17:05:53.965 INFO:tasks.workunit.client.0.smithi115.stdout:4/637: sync 2024-09-13T17:05:53.965 INFO:tasks.workunit.client.0.smithi115.stdout:0/325: sync 2024-09-13T17:05:53.965 INFO:tasks.workunit.client.1.smithi195.stdout:9/747: rmdir d6/d19/d21/d45/dad/d5e 39 2024-09-13T17:05:53.967 INFO:tasks.workunit.client.1.smithi195.stdout:5/720: symlink d2/df/d90/db2/led 0 2024-09-13T17:05:53.968 INFO:tasks.workunit.client.0.smithi115.stdout:0/326: write d9/d1d/d24/d26/d36/f3d [284496,78363] 0 2024-09-13T17:05:53.968 INFO:tasks.workunit.client.1.smithi195.stdout:6/643: read d1c/d24/d49/d5f/f2b [7332006,86531] 0 2024-09-13T17:05:53.968 INFO:tasks.workunit.client.1.smithi195.stdout:6/644: creat d1c/d24/fd6 x:0 0 0 2024-09-13T17:05:53.968 INFO:tasks.workunit.client.1.smithi195.stdout:6/645: dread - d1c/d24/d7f/dad/db9/d5e/fa0 zero size 2024-09-13T17:05:53.968 INFO:tasks.workunit.client.1.smithi195.stdout:6/646: stat d1c/d3e/l60 0 2024-09-13T17:05:53.969 INFO:tasks.workunit.client.1.smithi195.stdout:2/720: unlink d0/d4a/d47/d73/d75/d88/d2c/d43/d63/l85 0 2024-09-13T17:05:53.972 INFO:tasks.workunit.client.1.smithi195.stdout:4/874: unlink d1a/d1f/d43/d5a/d63/db8/fd8 0 2024-09-13T17:05:53.972 INFO:tasks.workunit.client.1.smithi195.stdout:4/875: creat d1a/d1f/d43/d5a/d63/dd1/f128 x:0 0 0 2024-09-13T17:05:53.976 INFO:tasks.workunit.client.0.smithi115.stdout:7/447: dread d0/d2/d1e/d3d/d6c/f30 [0,4194304] 0 2024-09-13T17:05:53.976 INFO:tasks.workunit.client.0.smithi115.stdout:7/448: creat d0/d2/d4a/fa2 x:0 0 0 2024-09-13T17:05:53.977 INFO:tasks.workunit.client.1.smithi195.stdout:8/741: dwrite d0/d17/d49/d63/d71/de8/df6/fe4 [0,4194304] 0 2024-09-13T17:05:53.977 INFO:tasks.workunit.client.1.smithi195.stdout:8/742: chown d0/d62/f83 29 1 2024-09-13T17:05:53.977 INFO:tasks.workunit.client.1.smithi195.stdout:1/666: dwrite db/df/d13/f1e [4194304,4194304] 0 2024-09-13T17:05:53.978 INFO:tasks.workunit.client.0.smithi115.stdout:0/327: dread d9/d1b/f57 [0,4194304] 0 2024-09-13T17:05:53.978 INFO:tasks.workunit.client.1.smithi195.stdout:0/702: symlink d7/d87/d9b/d4e/d68/ldd 0 2024-09-13T17:05:53.978 INFO:tasks.workunit.client.1.smithi195.stdout:0/703: fsync d7/d88/f59 0 2024-09-13T17:05:53.981 INFO:tasks.workunit.client.1.smithi195.stdout:7/724: mknod d5/db/d50/d7f/d82/de6/cfa 0 2024-09-13T17:05:53.983 INFO:tasks.workunit.client.1.smithi195.stdout:9/748: getdents d6/d19/d21/d45/dd1 0 2024-09-13T17:05:53.983 INFO:tasks.workunit.client.1.smithi195.stdout:5/721: dwrite d2/df/d78/faa [0,4194304] 0 2024-09-13T17:05:53.984 INFO:tasks.workunit.client.0.smithi115.stdout:7/449: mknod d0/d2/d67/d70/ca3 0 2024-09-13T17:05:53.989 INFO:tasks.workunit.client.1.smithi195.stdout:0/704: write d7/d87/d9b/d4e/f5b [3019408,121204] 0 2024-09-13T17:05:53.989 INFO:tasks.workunit.client.1.smithi195.stdout:6/647: creat d1c/d24/d7f/dad/db9/d30/fd7 x:0 0 0 2024-09-13T17:05:53.991 INFO:tasks.workunit.client.1.smithi195.stdout:2/721: symlink d0/d4a/d47/d73/d75/ldc 0 2024-09-13T17:05:53.992 INFO:tasks.workunit.client.0.smithi115.stdout:7/450: mknod d0/d59/ca4 0 2024-09-13T17:05:53.994 INFO:tasks.workunit.client.1.smithi195.stdout:4/876: symlink d1a/d1f/d43/d5a/d63/dd1/l129 0 2024-09-13T17:05:53.995 INFO:tasks.workunit.client.1.smithi195.stdout:3/712: getdents d7/d21/d2a/d35/d60/d64 0 2024-09-13T17:05:53.998 INFO:tasks.workunit.client.1.smithi195.stdout:8/743: link d0/c64 d0/d13/d69/dac/cfd 0 2024-09-13T17:05:54.000 INFO:tasks.workunit.client.1.smithi195.stdout:5/722: symlink d2/df/lee 0 2024-09-13T17:05:54.005 INFO:tasks.workunit.client.1.smithi195.stdout:0/705: mkdir d7/db/d9a/dde 0 2024-09-13T17:05:54.007 INFO:tasks.workunit.client.1.smithi195.stdout:6/648: creat d1c/d24/d49/d5f/d85/d8f/dc0/fd8 x:0 0 0 2024-09-13T17:05:54.007 INFO:tasks.workunit.client.1.smithi195.stdout:6/649: fdatasync d1c/d24/d7f/f8d 0 2024-09-13T17:05:54.009 INFO:tasks.workunit.client.1.smithi195.stdout:4/877: rename d1a/d1f/d43/d24/d41/cf4 to d1a/d1f/d21/d84/d9d/d8e/d9f/d111/c12a 0 2024-09-13T17:05:54.010 INFO:tasks.workunit.client.1.smithi195.stdout:3/713: creat d7/d21/fe4 x:0 0 0 2024-09-13T17:05:54.010 INFO:tasks.workunit.client.1.smithi195.stdout:3/714: chown d7/d21/d2a/d4a/d5a/l89 8137200 1 2024-09-13T17:05:54.011 INFO:tasks.workunit.client.0.smithi115.stdout:0/328: dwrite d9/d1d/f39 [0,4194304] 0 2024-09-13T17:05:54.011 INFO:tasks.workunit.client.0.smithi115.stdout:0/329: chown d9/d1d/d24/d26/d2d/l54 497878375 1 2024-09-13T17:05:54.011 INFO:tasks.workunit.client.0.smithi115.stdout:0/330: truncate d9/d1d/d24/d26/d2d/d30/d46/f53 825483 0 2024-09-13T17:05:54.011 INFO:tasks.workunit.client.0.smithi115.stdout:0/331: write d9/fb [1469018,2279] 0 2024-09-13T17:05:54.011 INFO:tasks.workunit.client.1.smithi195.stdout:8/744: mknod d0/d17/d49/d63/db3/dc9/cfe 0 2024-09-13T17:05:54.012 INFO:tasks.workunit.client.1.smithi195.stdout:6/650: getdents d1c/d24/d49/d5f/db1/dcd 0 2024-09-13T17:05:54.012 INFO:tasks.workunit.client.1.smithi195.stdout:5/723: write d2/df/d78/d76/f8d [2260575,71744] 0 2024-09-13T17:05:54.015 INFO:tasks.workunit.client.1.smithi195.stdout:4/878: truncate d1a/d1f/d43/d24/d41/fd3 1291980 0 2024-09-13T17:05:54.016 INFO:tasks.workunit.client.1.smithi195.stdout:4/879: fsync d1a/d1f/d43/f3d 0 2024-09-13T17:05:54.016 INFO:tasks.workunit.client.1.smithi195.stdout:4/880: truncate d1a/d1f/d43/d24/fa6 771541 0 2024-09-13T17:05:54.016 INFO:tasks.workunit.client.1.smithi195.stdout:4/881: truncate d1a/d1f/d43/d5a/d63/dd1/f128 170222 0 2024-09-13T17:05:54.018 INFO:tasks.workunit.client.1.smithi195.stdout:6/651: mkdir d1c/d24/d7f/dad/db9/d5e/dd9 0 2024-09-13T17:05:54.018 INFO:tasks.workunit.client.1.smithi195.stdout:1/667: dwrite db/df/f28 [0,4194304] 0 2024-09-13T17:05:54.019 INFO:tasks.workunit.client.1.smithi195.stdout:5/724: creat d2/df/d48/fef x:0 0 0 2024-09-13T17:05:54.021 INFO:tasks.workunit.client.1.smithi195.stdout:4/882: link d1a/d1f/d21/d84/dcc/f10c d1a/d1f/d21/d84/d9d/df6/f12b 0 2024-09-13T17:05:54.021 INFO:tasks.workunit.client.1.smithi195.stdout:4/883: write d1a/d1f/d43/d24/d41/d60/d6f/d124/f126 [901570,54955] 0 2024-09-13T17:05:54.024 INFO:tasks.workunit.client.0.smithi115.stdout:0/332: write d9/f20 [2977215,42703] 0 2024-09-13T17:05:54.026 INFO:tasks.workunit.client.0.smithi115.stdout:0/333: getdents d9/d27 0 2024-09-13T17:05:54.026 INFO:tasks.workunit.client.0.smithi115.stdout:0/334: write d9/f20 [4903588,106540] 0 2024-09-13T17:05:54.026 INFO:tasks.workunit.client.0.smithi115.stdout:0/335: creat d9/d1d/d24/d26/d2d/d30/d46/f5e x:0 0 0 2024-09-13T17:05:54.026 INFO:tasks.workunit.client.0.smithi115.stdout:0/336: fdatasync d9/d1d/d24/d26/d2d/d30/d46/f53 0 2024-09-13T17:05:54.026 INFO:tasks.workunit.client.1.smithi195.stdout:3/715: rmdir d7/d21/d2a 39 2024-09-13T17:05:54.026 INFO:tasks.workunit.client.1.smithi195.stdout:8/745: write d0/d17/d2f/d31/f37 [773397,75315] 0 2024-09-13T17:05:54.028 INFO:tasks.workunit.client.1.smithi195.stdout:6/652: mkdir d1c/d24/d49/d5f/db1/d95/dda 0 2024-09-13T17:05:54.029 INFO:tasks.workunit.client.1.smithi195.stdout:4/884: write d1a/d1f/d43/d24/d41/f8d [3709026,112106] 0 2024-09-13T17:05:54.030 INFO:tasks.workunit.client.0.smithi115.stdout:7/451: dwrite d0/d3b/d50/f47 [0,4194304] 0 2024-09-13T17:05:54.030 INFO:tasks.workunit.client.1.smithi195.stdout:7/725: dwrite d5/fa [0,4194304] 0 2024-09-13T17:05:54.031 INFO:tasks.workunit.client.1.smithi195.stdout:2/722: dwrite d0/f66 [4194304,4194304] 0 2024-09-13T17:05:54.031 INFO:tasks.workunit.client.1.smithi195.stdout:5/725: mknod d2/df/d78/deb/d4e/d10/d8f/dc9/cf0 0 2024-09-13T17:05:54.033 INFO:tasks.workunit.client.1.smithi195.stdout:8/746: mkdir d0/d17/d2f/d7c/d4c/d9b/ddf/dff 0 2024-09-13T17:05:54.036 INFO:tasks.workunit.client.1.smithi195.stdout:4/885: truncate d1a/d1f/d21/d84/d9d/f2a 2199310 0 2024-09-13T17:05:54.041 INFO:tasks.workunit.client.0.smithi115.stdout:7/452: write d0/f3e [3254867,102994] 0 2024-09-13T17:05:54.041 INFO:tasks.workunit.client.0.smithi115.stdout:7/453: chown d0/f3e 1348186673 1 2024-09-13T17:05:54.042 INFO:tasks.workunit.client.0.smithi115.stdout:7/454: chown d0/d3b 10722858 1 2024-09-13T17:05:54.044 INFO:tasks.workunit.client.0.smithi115.stdout:7/455: mknod d0/d2/d1e/d3d/d82/ca5 0 2024-09-13T17:05:54.044 INFO:tasks.workunit.client.0.smithi115.stdout:7/456: chown d0/fa 14 1 2024-09-13T17:05:54.046 INFO:tasks.workunit.client.1.smithi195.stdout:7/726: link d5/db/d19/d22/l74 d5/d35/lfb 0 2024-09-13T17:05:54.047 INFO:tasks.workunit.client.1.smithi195.stdout:2/723: unlink d0/d4a/fa9 0 2024-09-13T17:05:54.047 INFO:tasks.workunit.client.1.smithi195.stdout:2/724: dread - d0/d4a/d47/d73/d75/d88/d2c/d43/d84/fb5 zero size 2024-09-13T17:05:54.048 INFO:tasks.workunit.client.0.smithi115.stdout:7/457: mknod d0/ca6 0 2024-09-13T17:05:54.048 INFO:tasks.workunit.client.0.smithi115.stdout:7/458: fsync d0/d3b/d50/d21/f33 0 2024-09-13T17:05:54.050 INFO:tasks.workunit.client.1.smithi195.stdout:9/749: write d6/df/f38 [4471312,35309] 0 2024-09-13T17:05:54.050 INFO:tasks.workunit.client.1.smithi195.stdout:9/750: dread - d6/d12/d86/dd2/fe0 zero size 2024-09-13T17:05:54.050 INFO:tasks.workunit.client.1.smithi195.stdout:9/751: dread - d6/df/d16/de3/feb zero size 2024-09-13T17:05:54.051 INFO:tasks.workunit.client.0.smithi115.stdout:7/459: mkdir d0/d2/d1e/d3d/d82/d44/da7 0 2024-09-13T17:05:54.052 INFO:tasks.workunit.client.1.smithi195.stdout:1/668: mknod db/df/d13/da7/ce5 0 2024-09-13T17:05:54.055 INFO:tasks.workunit.client.0.smithi115.stdout:7/460: unlink d0/d2/l34 0 2024-09-13T17:05:54.062 INFO:tasks.workunit.client.0.smithi115.stdout:8/496: sync 2024-09-13T17:05:54.063 INFO:tasks.workunit.client.0.smithi115.stdout:5/431: sync 2024-09-13T17:05:54.063 INFO:tasks.workunit.client.0.smithi115.stdout:9/348: sync 2024-09-13T17:05:54.063 INFO:tasks.workunit.client.0.smithi115.stdout:9/349: chown d0/d21/d4f/f5e 1949673 1 2024-09-13T17:05:54.063 INFO:tasks.workunit.client.0.smithi115.stdout:9/350: fsync d0/de/d37/d5a/f75 0 2024-09-13T17:05:54.064 INFO:tasks.workunit.client.0.smithi115.stdout:6/532: sync 2024-09-13T17:05:54.064 INFO:tasks.workunit.client.0.smithi115.stdout:3/662: sync 2024-09-13T17:05:54.064 INFO:tasks.workunit.client.0.smithi115.stdout:3/663: chown d1/l6 121147 1 2024-09-13T17:05:54.064 INFO:tasks.workunit.client.0.smithi115.stdout:1/425: sync 2024-09-13T17:05:54.064 INFO:tasks.workunit.client.0.smithi115.stdout:2/691: sync 2024-09-13T17:05:54.064 INFO:tasks.workunit.client.0.smithi115.stdout:2/692: write d3/d4d/dd/df/d57/d8b/fcc [175935,42553] 0 2024-09-13T17:05:54.065 INFO:tasks.workunit.client.1.smithi195.stdout:3/716: dwrite d7/d21/d2a/d4a/d5a/f63 [0,4194304] 0 2024-09-13T17:05:54.065 INFO:tasks.workunit.client.1.smithi195.stdout:4/886: dwrite d1a/d1f/d43/d5a/d63/db8/dc8/ff2 [0,4194304] 0 2024-09-13T17:05:54.065 INFO:tasks.workunit.client.1.smithi195.stdout:4/887: chown d1a/d1f/d21/d36/f52 14120 1 2024-09-13T17:05:54.065 INFO:tasks.workunit.client.1.smithi195.stdout:4/888: chown d1a/d1f/d43/d5a/c127 3 1 2024-09-13T17:05:54.065 INFO:tasks.workunit.client.1.smithi195.stdout:5/726: dwrite d2/df/d78/f49 [0,4194304] 0 2024-09-13T17:05:54.065 INFO:tasks.workunit.client.1.smithi195.stdout:5/727: write d2/df/d78/deb/d4e/d10/d46/f64 [4546450,49306] 0 2024-09-13T17:05:54.066 INFO:tasks.workunit.client.0.smithi115.stdout:5/432: dread d19/d21/d3a/f6d [0,4194304] 0 2024-09-13T17:05:54.067 INFO:tasks.workunit.client.0.smithi115.stdout:8/497: chown d0/d42 4015 1 2024-09-13T17:05:54.067 INFO:tasks.workunit.client.1.smithi195.stdout:8/747: symlink d0/d17/d49/d63/d71/de8/df6/l100 0 2024-09-13T17:05:54.070 INFO:tasks.workunit.client.0.smithi115.stdout:9/351: mknod d0/d21/c78 0 2024-09-13T17:05:54.070 INFO:tasks.workunit.client.0.smithi115.stdout:9/352: readlink d0/l70 0 2024-09-13T17:05:54.070 INFO:tasks.workunit.client.0.smithi115.stdout:7/461: dread d0/d2/d1e/f76 [0,4194304] 0 2024-09-13T17:05:54.070 INFO:tasks.workunit.client.0.smithi115.stdout:7/462: write d0/d2/d67/d86/d94/f95 [558297,44577] 0 2024-09-13T17:05:54.070 INFO:tasks.workunit.client.0.smithi115.stdout:7/463: creat d0/d51/fa8 x:0 0 0 2024-09-13T17:05:54.071 INFO:tasks.workunit.client.1.smithi195.stdout:6/653: rmdir d1c/d24/d49/d5f/d85/d8f 39 2024-09-13T17:05:54.073 INFO:tasks.workunit.client.0.smithi115.stdout:6/533: write d8/db/f6f [796331,42498] 0 2024-09-13T17:05:54.076 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:53 smithi195 ceph-mon[34981]: Reconfiguring daemon prometheus.smithi115 on smithi115 2024-09-13T17:05:54.077 INFO:tasks.workunit.client.1.smithi195.stdout:7/727: mkdir d5/db/d50/daa/dfc 0 2024-09-13T17:05:54.077 INFO:tasks.workunit.client.1.smithi195.stdout:7/728: write d5/d13/fe8 [993801,109166] 0 2024-09-13T17:05:54.077 INFO:tasks.workunit.client.1.smithi195.stdout:7/729: readlink d5/d13/d24/l29 0 2024-09-13T17:05:54.080 INFO:tasks.workunit.client.1.smithi195.stdout:2/725: symlink d0/d4a/d47/d73/d75/d88/d1e/dd0/ldd 0 2024-09-13T17:05:54.082 INFO:tasks.workunit.client.0.smithi115.stdout:5/433: creat d19/d2e/d6b/f8a x:0 0 0 2024-09-13T17:05:54.083 INFO:tasks.workunit.client.1.smithi195.stdout:9/752: creat d6/ffa x:0 0 0 2024-09-13T17:05:54.084 INFO:tasks.workunit.client.1.smithi195.stdout:9/753: chown d6/d8d 1643677 1 2024-09-13T17:05:54.084 INFO:tasks.workunit.client.1.smithi195.stdout:9/754: chown d6/d12/l17 106 1 2024-09-13T17:05:54.084 INFO:tasks.workunit.client.1.smithi195.stdout:9/755: getdents d6/d19/d21/d45/dd1 0 2024-09-13T17:05:54.085 INFO:tasks.workunit.client.1.smithi195.stdout:1/669: read - db/df/d13/da7/fb7 zero size 2024-09-13T17:05:54.085 INFO:tasks.workunit.client.1.smithi195.stdout:1/670: write db/df/d4d/fb3 [1922346,6221] 0 2024-09-13T17:05:54.086 INFO:tasks.workunit.client.1.smithi195.stdout:7/730: dread d5/db/d50/d7f/fcd [0,4194304] 0 2024-09-13T17:05:54.088 INFO:tasks.workunit.client.0.smithi115.stdout:7/464: creat d0/d59/fa9 x:0 0 0 2024-09-13T17:05:54.088 INFO:tasks.workunit.client.0.smithi115.stdout:7/465: fdatasync d0/f56 0 2024-09-13T17:05:54.088 INFO:tasks.workunit.client.0.smithi115.stdout:7/466: chown d0/d2/f1a 0 1 2024-09-13T17:05:54.091 INFO:tasks.workunit.client.0.smithi115.stdout:5/434: truncate d19/d2b/d32/d55/f5f 1376984 0 2024-09-13T17:05:54.091 INFO:tasks.workunit.client.0.smithi115.stdout:5/435: fdatasync f3 0 2024-09-13T17:05:54.092 INFO:tasks.workunit.client.0.smithi115.stdout:5/436: creat d19/d2b/d32/f8b x:0 0 0 2024-09-13T17:05:54.094 INFO:tasks.workunit.client.0.smithi115.stdout:8/498: unlink d0/d26/d29/d59/d7e/da7/d28/f30 0 2024-09-13T17:05:54.095 INFO:tasks.workunit.client.0.smithi115.stdout:7/467: rmdir d0/d2/d67/d70 39 2024-09-13T17:05:54.096 INFO:tasks.workunit.client.1.smithi195.stdout:5/728: link d2/df/d86/f5d d2/df/d48/ff1 0 2024-09-13T17:05:54.098 INFO:tasks.workunit.client.0.smithi115.stdout:3/664: rename d1/d12/d23 to d1/d4b/d1a/d6e/dd9 0 2024-09-13T17:05:54.098 INFO:tasks.workunit.client.0.smithi115.stdout:3/665: creat d1/d4b/d69/d7b/dbb/fda x:0 0 0 2024-09-13T17:05:54.100 INFO:tasks.workunit.client.1.smithi195.stdout:8/748: rmdir d0/d17/d2f/d31/db4/de5 0 2024-09-13T17:05:54.102 INFO:tasks.workunit.client.1.smithi195.stdout:6/654: link d1c/d24/d49/d5f/d35/l83 d1c/d3e/ldb 0 2024-09-13T17:05:54.102 INFO:tasks.workunit.client.1.smithi195.stdout:4/889: dwrite d1a/d1f/d43/fc0 [4194304,4194304] 0 2024-09-13T17:05:54.103 INFO:tasks.workunit.client.0.smithi115.stdout:1/426: dwrite d5/f6b [0,4194304] 0 2024-09-13T17:05:54.103 INFO:tasks.workunit.client.0.smithi115.stdout:1/427: stat d5/d26/d2c/f74 0 2024-09-13T17:05:54.104 INFO:tasks.workunit.client.0.smithi115.stdout:5/437: creat d19/d2b/d32/d55/d5e/d87/d86/f8c x:0 0 0 2024-09-13T17:05:54.104 INFO:tasks.workunit.client.0.smithi115.stdout:5/438: write d19/d21/d3a/d5d/f70 [1852394,130012] 0 2024-09-13T17:05:54.104 INFO:tasks.workunit.client.0.smithi115.stdout:5/439: write d19/d2b/d32/d55/d5e/d87/d86/f8c [607774,35123] 0 2024-09-13T17:05:54.104 INFO:tasks.workunit.client.0.smithi115.stdout:5/440: dread - d19/d2b/d32/d55/d5e/f67 zero size 2024-09-13T17:05:54.105 INFO:tasks.workunit.client.0.smithi115.stdout:8/499: read d0/d21/d76/d83/f88 [114906,44411] 0 2024-09-13T17:05:54.105 INFO:tasks.workunit.client.0.smithi115.stdout:6/534: dwrite d8/d13/d15/d24/d53/f9c [0,4194304] 0 2024-09-13T17:05:54.106 INFO:tasks.workunit.client.0.smithi115.stdout:7/468: symlink d0/d2/laa 0 2024-09-13T17:05:54.109 INFO:tasks.workunit.client.1.smithi195.stdout:2/726: link d0/d4a/d47/d73/d75/d88/d2c/d43/d84/fa3 d0/d4a/d47/d73/d75/fde 0 2024-09-13T17:05:54.109 INFO:tasks.workunit.client.1.smithi195.stdout:2/727: chown d0/d4a/d47/d73/d75/d88/d2c 31 1 2024-09-13T17:05:54.111 INFO:tasks.workunit.client.0.smithi115.stdout:2/693: rename d3/d4d/d13/d62/d66/l6a to d3/d4d/de/d3a/d47/da4/ld9 0 2024-09-13T17:05:54.112 INFO:tasks.workunit.client.1.smithi195.stdout:9/756: chown d6/df/d16/d65/cba 94513 1 2024-09-13T17:05:54.112 INFO:tasks.workunit.client.1.smithi195.stdout:9/757: write d6/df/d16/de3/d68/d6d/fb5 [4833053,92129] 0 2024-09-13T17:05:54.114 INFO:tasks.workunit.client.1.smithi195.stdout:9/758: dread d6/d19/d21/d45/dad/d5e/dd0/f9c [0,4194304] 0 2024-09-13T17:05:54.114 INFO:tasks.workunit.client.1.smithi195.stdout:1/671: truncate db/f6b 2725502 0 2024-09-13T17:05:54.116 INFO:tasks.workunit.client.0.smithi115.stdout:3/666: symlink d1/d4b/d69/d7b/da0/ldb 0 2024-09-13T17:05:54.117 INFO:tasks.workunit.client.1.smithi195.stdout:7/731: symlink d5/db/d50/d7f/d82/dcc/lfd 0 2024-09-13T17:05:54.118 INFO:tasks.workunit.client.0.smithi115.stdout:9/353: dwrite d0/f3f [0,4194304] 0 2024-09-13T17:05:54.118 INFO:tasks.workunit.client.0.smithi115.stdout:7/469: dread d0/d2/d1e/d3d/d6c/d71/f46 [0,4194304] 0 2024-09-13T17:05:54.122 INFO:tasks.workunit.client.1.smithi195.stdout:5/729: unlink d2/df/d78/deb/d4e/fe0 0 2024-09-13T17:05:54.122 INFO:tasks.workunit.client.1.smithi195.stdout:2/728: dread d0/d3/f5c [4194304,4194304] 0 2024-09-13T17:05:54.124 INFO:tasks.workunit.client.1.smithi195.stdout:8/749: rmdir d0/d17/d49/d63/d71 39 2024-09-13T17:05:54.126 INFO:tasks.workunit.client.0.smithi115.stdout:1/428: link d5/d3e/d59/f8b d5/f95 0 2024-09-13T17:05:54.127 INFO:tasks.workunit.client.1.smithi195.stdout:9/759: dread d6/df/d13/fd7 [0,4194304] 0 2024-09-13T17:05:54.127 INFO:tasks.workunit.client.1.smithi195.stdout:9/760: dread - d6/df/d72/fc1 zero size 2024-09-13T17:05:54.127 INFO:tasks.workunit.client.0.smithi115.stdout:3/667: dread d1/d4b/d69/db6/fc7 [0,4194304] 0 2024-09-13T17:05:54.127 INFO:tasks.workunit.client.0.smithi115.stdout:3/668: chown d1/d4b/d1a/d6e/dd9/fd5 409 1 2024-09-13T17:05:54.128 INFO:tasks.workunit.client.0.smithi115.stdout:8/500: dwrite d0/d21/d76/fa4 [0,4194304] 0 2024-09-13T17:05:54.129 INFO:tasks.workunit.client.0.smithi115.stdout:5/441: creat d19/f8d x:0 0 0 2024-09-13T17:05:54.130 INFO:tasks.workunit.client.1.smithi195.stdout:0/706: sync 2024-09-13T17:05:54.131 INFO:tasks.workunit.client.1.smithi195.stdout:0/707: chown d7/d87/d9b/d4e/d68/ldd 6594 1 2024-09-13T17:05:54.131 INFO:tasks.workunit.client.1.smithi195.stdout:6/655: creat d1c/d24/d49/d5f/d85/d8f/fdc x:0 0 0 2024-09-13T17:05:54.132 INFO:tasks.workunit.client.1.smithi195.stdout:6/656: write d1c/d24/d7f/dad/db9/d5e/fb5 [676834,82823] 0 2024-09-13T17:05:54.132 INFO:tasks.workunit.client.1.smithi195.stdout:6/657: readlink d1c/d24/d49/d5f/d35/lca 0 2024-09-13T17:05:54.133 INFO:tasks.workunit.client.1.smithi195.stdout:9/761: dread d6/f18 [0,4194304] 0 2024-09-13T17:05:54.133 INFO:tasks.workunit.client.1.smithi195.stdout:4/890: unlink d1a/d1f/d21/d22/lf8 0 2024-09-13T17:05:54.133 INFO:tasks.workunit.client.1.smithi195.stdout:4/891: dread - d1a/d1f/d43/d24/d41/d60/fba zero size 2024-09-13T17:05:54.136 INFO:tasks.workunit.client.1.smithi195.stdout:4/892: dread d1a/d1f/d43/d24/d41/fe8 [0,4194304] 0 2024-09-13T17:05:54.136 INFO:tasks.workunit.client.1.smithi195.stdout:1/672: mknod db/d19/d5a/d66/d96/db4/ce6 0 2024-09-13T17:05:54.141 INFO:tasks.workunit.client.0.smithi115.stdout:2/694: stat d3/d4d/d13/d62/lad 0 2024-09-13T17:05:54.142 INFO:tasks.workunit.client.0.smithi115.stdout:2/695: truncate d3/d4d/d13/da2/fd8 457887 0 2024-09-13T17:05:54.142 INFO:tasks.workunit.client.1.smithi195.stdout:2/729: truncate d0/d3/f4 3192429 0 2024-09-13T17:05:54.144 INFO:tasks.workunit.client.1.smithi195.stdout:6/658: dread d1c/d3e/f47 [0,4194304] 0 2024-09-13T17:05:54.144 INFO:tasks.workunit.client.1.smithi195.stdout:5/730: dwrite d2/df/d78/d54/d58/f6b [0,4194304] 0 2024-09-13T17:05:54.144 INFO:tasks.workunit.client.1.smithi195.stdout:5/731: write d2/df/d78/deb/d4e/d74/fc3 [585802,121957] 0 2024-09-13T17:05:54.144 INFO:tasks.workunit.client.1.smithi195.stdout:5/732: write d2/df/d78/deb/d4e/d10/d5c/fcf [798314,37033] 0 2024-09-13T17:05:54.148 INFO:tasks.workunit.client.1.smithi195.stdout:0/708: unlink d7/d50/f5c 0 2024-09-13T17:05:54.149 INFO:tasks.workunit.client.0.smithi115.stdout:9/354: truncate d0/de/d10/f60 316279 0 2024-09-13T17:05:54.150 INFO:tasks.workunit.client.1.smithi195.stdout:9/762: mkdir d6/d12/d86/da7/dfb 0 2024-09-13T17:05:54.150 INFO:tasks.workunit.client.1.smithi195.stdout:9/763: creat d6/df/d16/ffc x:0 0 0 2024-09-13T17:05:54.150 INFO:tasks.workunit.client.1.smithi195.stdout:9/764: fsync d6/df/f38 0 2024-09-13T17:05:54.150 INFO:tasks.workunit.client.0.smithi115.stdout:7/470: mknod d0/d51/cab 0 2024-09-13T17:05:54.152 INFO:tasks.workunit.client.1.smithi195.stdout:4/893: creat d1a/d1f/d108/f12c x:0 0 0 2024-09-13T17:05:54.153 INFO:tasks.workunit.client.0.smithi115.stdout:1/429: mkdir d5/d3e/d59/d96 0 2024-09-13T17:05:54.154 INFO:tasks.workunit.client.1.smithi195.stdout:0/709: dread d7/d87/d9b/d56/d46/f6e [0,4194304] 0 2024-09-13T17:05:54.156 INFO:tasks.workunit.client.1.smithi195.stdout:1/673: mknod db/d19/d5a/d66/d7a/ce7 0 2024-09-13T17:05:54.157 INFO:tasks.workunit.client.0.smithi115.stdout:3/669: symlink d1/d4b/d69/d7b/d8b/ldc 0 2024-09-13T17:05:54.157 INFO:tasks.workunit.client.0.smithi115.stdout:3/670: fsync d1/d12/d14/fcf 0 2024-09-13T17:05:54.157 INFO:tasks.workunit.client.0.smithi115.stdout:3/671: creat d1/d4b/d1a/d6e/fdd x:0 0 0 2024-09-13T17:05:54.157 INFO:tasks.workunit.client.0.smithi115.stdout:3/672: chown d1/d4b/d1a/d6e/c89 44558 1 2024-09-13T17:05:54.163 INFO:tasks.workunit.client.1.smithi195.stdout:1/674: dread db/df/f16 [0,4194304] 0 2024-09-13T17:05:54.167 INFO:tasks.workunit.client.1.smithi195.stdout:2/730: link d0/d4a/d47/d73/d75/d88/d2c/d51/f79 d0/d4a/d47/d73/d75/d88/d8e/fdf 0 2024-09-13T17:05:54.168 INFO:tasks.workunit.client.0.smithi115.stdout:8/501: fsync d0/f53 0 2024-09-13T17:05:54.169 INFO:tasks.workunit.client.1.smithi195.stdout:6/659: mknod d1c/d24/d7f/dad/db9/d8c/cdd 0 2024-09-13T17:05:54.169 INFO:tasks.workunit.client.1.smithi195.stdout:6/660: read - d1c/d24/fd6 zero size 2024-09-13T17:05:54.169 INFO:tasks.workunit.client.1.smithi195.stdout:6/661: stat d1c/d24/d7f/f8d 0 2024-09-13T17:05:54.169 INFO:tasks.workunit.client.1.smithi195.stdout:6/662: fsync d1c/d24/d49/f65 0 2024-09-13T17:05:54.170 INFO:tasks.workunit.client.0.smithi115.stdout:5/442: mknod d19/d21/d62/d63/c8e 0 2024-09-13T17:05:54.170 INFO:tasks.workunit.client.1.smithi195.stdout:1/675: write db/df/d4d/d74/da8/fb2 [2173809,12433] 0 2024-09-13T17:05:54.174 INFO:tasks.workunit.client.1.smithi195.stdout:5/733: creat d2/df/d78/ff2 x:0 0 0 2024-09-13T17:05:54.174 INFO:tasks.workunit.client.0.smithi115.stdout:6/535: link d8/db/l4a d8/d33/d40/la3 0 2024-09-13T17:05:54.175 INFO:tasks.workunit.client.0.smithi115.stdout:2/696: creat d3/d4d/d13/d62/d92/dd7/d7d/fda x:0 0 0 2024-09-13T17:05:54.178 INFO:tasks.workunit.client.0.smithi115.stdout:9/355: mkdir d0/d21/d65/d79 0 2024-09-13T17:05:54.178 INFO:tasks.workunit.client.0.smithi115.stdout:9/356: write d0/de/d10/f74 [1667957,28438] 0 2024-09-13T17:05:54.181 INFO:tasks.workunit.client.1.smithi195.stdout:9/765: link d6/d12/f46 d6/d12/d86/dd2/de1/ffd 0 2024-09-13T17:05:54.182 INFO:tasks.workunit.client.0.smithi115.stdout:3/673: link d1/f9 d1/da6/dd1/fde 0 2024-09-13T17:05:54.183 INFO:tasks.workunit.client.1.smithi195.stdout:2/731: symlink d0/d4a/d47/d73/d75/d88/d8e/dcf/le0 0 2024-09-13T17:05:54.183 INFO:tasks.workunit.client.1.smithi195.stdout:2/732: write d0/f66 [3378466,2114] 0 2024-09-13T17:05:54.184 INFO:tasks.workunit.client.0.smithi115.stdout:5/443: truncate d19/d21/f22 2988504 0 2024-09-13T17:05:54.184 INFO:tasks.workunit.client.0.smithi115.stdout:5/444: chown d19/d21/d3a/c7a 1478 1 2024-09-13T17:05:54.184 INFO:tasks.workunit.client.0.smithi115.stdout:6/536: rmdir d8/d13/d15/d24/d17 39 2024-09-13T17:05:54.184 INFO:tasks.workunit.client.0.smithi115.stdout:6/537: write d8/d13/d15/d24/f79 [789853,52289] 0 2024-09-13T17:05:54.185 INFO:tasks.workunit.client.1.smithi195.stdout:2/733: read d0/d4a/d47/d73/d75/d88/d2c/d51/f78 [117612,34882] 0 2024-09-13T17:05:54.185 INFO:tasks.workunit.client.1.smithi195.stdout:2/734: chown d0/d3/fa8 530 1 2024-09-13T17:05:54.186 INFO:tasks.workunit.client.1.smithi195.stdout:5/734: truncate d2/df/d78/deb/d4e/d10/d46/f64 4536703 0 2024-09-13T17:05:54.188 INFO:tasks.workunit.client.0.smithi115.stdout:2/697: symlink d3/d4d/dd/d1f/ldb 0 2024-09-13T17:05:54.188 INFO:tasks.workunit.client.0.smithi115.stdout:2/698: creat d3/d4d/d13/d6b/fdc x:0 0 0 2024-09-13T17:05:54.188 INFO:tasks.workunit.client.0.smithi115.stdout:2/699: fsync d3/d4d/dd/d1f/f9d 0 2024-09-13T17:05:54.189 INFO:tasks.workunit.client.1.smithi195.stdout:8/750: rename d0/d17/d49 to d0/d17/d2f/d31/d101 0 2024-09-13T17:05:54.190 INFO:tasks.workunit.client.0.smithi115.stdout:9/357: link d0/de/d10/f3e d0/d21/d65/d79/f7a 0 2024-09-13T17:05:54.190 INFO:tasks.workunit.client.0.smithi115.stdout:9/358: write d0/de/d10/d15/f3b [805005,22325] 0 2024-09-13T17:05:54.194 INFO:tasks.workunit.client.0.smithi115.stdout:3/674: unlink d1/d4b/d69/d7b/d8b/d90/lb2 0 2024-09-13T17:05:54.194 INFO:tasks.workunit.client.0.smithi115.stdout:3/675: write d1/d4b/d69/d7b/f9f [1519295,39585] 0 2024-09-13T17:05:54.195 INFO:tasks.workunit.client.0.smithi115.stdout:8/502: rename d0/fc to d0/d21/d76/d83/fab 0 2024-09-13T17:05:54.196 INFO:tasks.workunit.client.0.smithi115.stdout:5/445: mkdir d19/d2b/d69/d8f 0 2024-09-13T17:05:54.197 INFO:tasks.workunit.client.1.smithi195.stdout:2/735: rmdir d0/d3/d3d/dc6 0 2024-09-13T17:05:54.197 INFO:tasks.workunit.client.0.smithi115.stdout:6/538: creat d8/d13/d15/d24/d53/d6a/fa4 x:0 0 0 2024-09-13T17:05:54.198 INFO:tasks.workunit.client.1.smithi195.stdout:5/735: mkdir d2/df/d78/deb/d4e/d10/d46/df3 0 2024-09-13T17:05:54.198 INFO:tasks.workunit.client.1.smithi195.stdout:5/736: readlink d2/df/d78/d54/d58/la5 0 2024-09-13T17:05:54.199 INFO:tasks.workunit.client.1.smithi195.stdout:8/751: stat d0/d13/d69/dac/lbc 0 2024-09-13T17:05:54.200 INFO:tasks.workunit.client.0.smithi115.stdout:2/700: mkdir d3/d4d/d13/d62/d92/dd7/d7d/ddd 0 2024-09-13T17:05:54.200 INFO:tasks.workunit.client.0.smithi115.stdout:2/701: creat d3/d4d/d13/d39/d46/da0/fde x:0 0 0 2024-09-13T17:05:54.202 INFO:tasks.workunit.client.1.smithi195.stdout:9/766: getdents d6/d8d 0 2024-09-13T17:05:54.203 INFO:tasks.workunit.client.1.smithi195.stdout:9/767: write d6/df/f3c [2077348,97339] 0 2024-09-13T17:05:54.205 INFO:tasks.workunit.client.0.smithi115.stdout:9/359: creat d0/d21/d42/f7b x:0 0 0 2024-09-13T17:05:54.205 INFO:tasks.workunit.client.1.smithi195.stdout:2/736: rmdir d0/d3 39 2024-09-13T17:05:54.205 INFO:tasks.workunit.client.1.smithi195.stdout:8/752: rmdir d0/d13/d52/d55 39 2024-09-13T17:05:54.206 INFO:tasks.workunit.client.0.smithi115.stdout:3/676: creat d1/d4b/d69/d7b/fdf x:0 0 0 2024-09-13T17:05:54.206 INFO:tasks.workunit.client.0.smithi115.stdout:3/677: stat d1/d12/d14/fad 0 2024-09-13T17:05:54.206 INFO:tasks.workunit.client.0.smithi115.stdout:3/678: truncate d1/d4b/d69/d7b/f9f 1823566 0 2024-09-13T17:05:54.207 INFO:tasks.workunit.client.0.smithi115.stdout:3/679: chown d1/d12/d14/l5c 11528676 1 2024-09-13T17:05:54.207 INFO:tasks.workunit.client.0.smithi115.stdout:7/471: dwrite d0/d2/d1e/f32 [0,4194304] 0 2024-09-13T17:05:54.207 INFO:tasks.workunit.client.0.smithi115.stdout:7/472: readlink d0/l7b 0 2024-09-13T17:05:54.207 INFO:tasks.workunit.client.1.smithi195.stdout:4/894: dwrite f7 [4194304,4194304] 0 2024-09-13T17:05:54.207 INFO:tasks.workunit.client.1.smithi195.stdout:4/895: read d1a/f4a [3468105,8530] 0 2024-09-13T17:05:54.208 INFO:tasks.workunit.client.0.smithi115.stdout:8/503: truncate d0/d15/f1b 2026271 0 2024-09-13T17:05:54.209 INFO:tasks.workunit.client.0.smithi115.stdout:5/446: symlink d19/d2b/d32/d55/d5e/l90 0 2024-09-13T17:05:54.210 INFO:tasks.workunit.client.0.smithi115.stdout:6/539: dread d8/d13/d15/d24/f29 [0,4194304] 0 2024-09-13T17:05:54.210 INFO:tasks.workunit.client.0.smithi115.stdout:6/540: truncate d8/d13/d15/f6e 98407 0 2024-09-13T17:05:54.211 INFO:tasks.workunit.client.0.smithi115.stdout:1/430: dwrite d5/f6 [0,4194304] 0 2024-09-13T17:05:54.211 INFO:tasks.workunit.client.0.smithi115.stdout:1/431: fdatasync d5/d3e/d59/f8b 0 2024-09-13T17:05:54.212 INFO:tasks.workunit.client.0.smithi115.stdout:1/432: readlink d5/d7/d33/d3a/l5a 0 2024-09-13T17:05:54.213 INFO:tasks.workunit.client.1.smithi195.stdout:5/737: dread d2/df/d78/deb/d4e/f1d [0,4194304] 0 2024-09-13T17:05:54.213 INFO:tasks.workunit.client.1.smithi195.stdout:1/676: dwrite db/d19/d37/f3b [4194304,4194304] 0 2024-09-13T17:05:54.213 INFO:tasks.workunit.client.1.smithi195.stdout:0/710: dwrite d7/d88/f7e [4194304,4194304] 0 2024-09-13T17:05:54.214 INFO:tasks.workunit.client.1.smithi195.stdout:2/737: dread d0/d4a/d47/d73/d75/d88/f7f [0,4194304] 0 2024-09-13T17:05:54.217 INFO:tasks.workunit.client.0.smithi115.stdout:2/702: unlink d3/d4d/dd/f2d 0 2024-09-13T17:05:54.217 INFO:tasks.workunit.client.0.smithi115.stdout:2/703: chown d3/d4d/d13/d62/d92/dd7/d56/d58/dac/cc4 6309 1 2024-09-13T17:05:54.217 INFO:tasks.workunit.client.0.smithi115.stdout:2/704: truncate d3/d4d/d13/d6b/fb9 27413 0 2024-09-13T17:05:54.217 INFO:tasks.workunit.client.0.smithi115.stdout:2/705: fsync d3/d4d/d13/d77/fc6 0 2024-09-13T17:05:54.221 INFO:tasks.workunit.client.0.smithi115.stdout:9/360: creat d0/de/d10/f7c x:0 0 0 2024-09-13T17:05:54.225 INFO:tasks.workunit.client.0.smithi115.stdout:7/473: mkdir d0/d2/d1e/d3d/d82/d44/dac 0 2024-09-13T17:05:54.226 INFO:tasks.workunit.client.0.smithi115.stdout:8/504: truncate d0/d18/d51/f9c 909673 0 2024-09-13T17:05:54.227 INFO:tasks.workunit.client.0.smithi115.stdout:8/505: truncate d0/d26/d29/f38 4408532 0 2024-09-13T17:05:54.227 INFO:tasks.workunit.client.0.smithi115.stdout:8/506: fdatasync d0/d21/d76/d83/d5a/f90 0 2024-09-13T17:05:54.228 INFO:tasks.workunit.client.0.smithi115.stdout:5/447: mknod d19/d21/d3a/c91 0 2024-09-13T17:05:54.230 INFO:tasks.workunit.client.1.smithi195.stdout:2/738: dread d0/f48 [0,4194304] 0 2024-09-13T17:05:54.230 INFO:tasks.workunit.client.0.smithi115.stdout:6/541: link d8/d13/d15/d24/f3b d8/d33/d82/d80/fa5 0 2024-09-13T17:05:54.230 INFO:tasks.workunit.client.0.smithi115.stdout:6/542: truncate d8/d33/d40/d4c/fa0 945445 0 2024-09-13T17:05:54.231 INFO:tasks.workunit.client.0.smithi115.stdout:6/543: fdatasync d8/d13/d15/d24/f81 0 2024-09-13T17:05:54.231 INFO:tasks.workunit.client.0.smithi115.stdout:6/544: write d8/db/d1d/f3d [2425160,24343] 0 2024-09-13T17:05:54.232 INFO:tasks.workunit.client.0.smithi115.stdout:8/507: dread d0/d15/d44/f52 [0,4194304] 0 2024-09-13T17:05:54.232 INFO:tasks.workunit.client.0.smithi115.stdout:1/433: unlink d5/d26/l2d 0 2024-09-13T17:05:54.234 INFO:tasks.workunit.client.1.smithi195.stdout:1/677: symlink db/d58/dae/le8 0 2024-09-13T17:05:54.236 INFO:tasks.workunit.client.0.smithi115.stdout:2/706: rename d3/d4d/d13/d62/d92/dd7/c61 to d3/d4d/de/cdf 0 2024-09-13T17:05:54.236 INFO:tasks.workunit.client.0.smithi115.stdout:2/707: write d3/d4d/dd/df/d5b/f83 [876441,70542] 0 2024-09-13T17:05:54.236 INFO:tasks.workunit.client.0.smithi115.stdout:1/434: dread d5/d7/f21 [0,4194304] 0 2024-09-13T17:05:54.238 INFO:tasks.workunit.client.1.smithi195.stdout:0/711: creat d7/db/fdf x:0 0 0 2024-09-13T17:05:54.238 INFO:tasks.workunit.client.1.smithi195.stdout:0/712: chown d7/d87/d9b/d4e/d68/f79 6891903 1 2024-09-13T17:05:54.238 INFO:tasks.workunit.client.0.smithi115.stdout:9/361: mknod d0/d21/c7d 0 2024-09-13T17:05:54.239 INFO:tasks.workunit.client.0.smithi115.stdout:9/362: write d0/d21/d42/f7b [303166,34249] 0 2024-09-13T17:05:54.239 INFO:tasks.workunit.client.1.smithi195.stdout:5/738: getdents d2/df/d90/dbb 0 2024-09-13T17:05:54.240 INFO:tasks.workunit.client.0.smithi115.stdout:5/448: write fd [2833692,80663] 0 2024-09-13T17:05:54.241 INFO:tasks.workunit.client.1.smithi195.stdout:8/753: dwrite d0/d17/f6b [0,4194304] 0 2024-09-13T17:05:54.242 INFO:tasks.workunit.client.0.smithi115.stdout:3/680: dwrite d1/d4b/d69/db6/fc7 [0,4194304] 0 2024-09-13T17:05:54.242 INFO:tasks.workunit.client.0.smithi115.stdout:3/681: stat d1/d4b/d1a/d6e/dd9/cd0 0 2024-09-13T17:05:54.245 INFO:tasks.workunit.client.1.smithi195.stdout:0/713: dread d7/d87/d9b/d4e/d68/f9f [0,4194304] 0 2024-09-13T17:05:54.245 INFO:tasks.workunit.client.1.smithi195.stdout:9/768: dwrite d6/d12/f2b [4194304,4194304] 0 2024-09-13T17:05:54.245 INFO:tasks.workunit.client.1.smithi195.stdout:9/769: creat d6/df/d7b/ffe x:0 0 0 2024-09-13T17:05:54.246 INFO:tasks.workunit.client.1.smithi195.stdout:9/770: write d6/d19/d21/d5b/f83 [214906,11666] 0 2024-09-13T17:05:54.247 INFO:tasks.workunit.client.0.smithi115.stdout:8/508: symlink d0/d42/lac 0 2024-09-13T17:05:54.248 INFO:tasks.workunit.client.1.smithi195.stdout:2/739: fsync d0/d4a/d47/d73/d75/d88/d2c/d43/f64 0 2024-09-13T17:05:54.248 INFO:tasks.workunit.client.1.smithi195.stdout:4/896: dwrite d1a/d1f/d43/d5a/f5f [0,4194304] 0 2024-09-13T17:05:54.250 INFO:tasks.workunit.client.1.smithi195.stdout:5/739: rename d2/df/d78/deb/l41 to d2/df/d86/lf4 0 2024-09-13T17:05:54.253 INFO:tasks.workunit.client.0.smithi115.stdout:7/474: rename d0/fa to d0/d3b/fad 0 2024-09-13T17:05:54.253 INFO:tasks.workunit.client.0.smithi115.stdout:7/475: truncate d0/d51/fa8 946789 0 2024-09-13T17:05:54.253 INFO:tasks.workunit.client.0.smithi115.stdout:7/476: write d0/d3b/d50/f88 [312668,29792] 0 2024-09-13T17:05:54.256 INFO:tasks.workunit.client.1.smithi195.stdout:2/740: write d0/d3/f5b [2403566,75443] 0 2024-09-13T17:05:54.256 INFO:tasks.workunit.client.1.smithi195.stdout:2/741: write d0/d4a/d47/d73/d75/d88/d2c/f71 [478191,48626] 0 2024-09-13T17:05:54.257 INFO:tasks.workunit.client.0.smithi115.stdout:2/708: unlink d3/d4d/dd/df/f86 0 2024-09-13T17:05:54.257 INFO:tasks.workunit.client.0.smithi115.stdout:2/709: write d3/d4d/d13/da2/fd8 [1045432,81833] 0 2024-09-13T17:05:54.257 INFO:tasks.workunit.client.0.smithi115.stdout:2/710: chown d3/d4d/de/d99 193 1 2024-09-13T17:05:54.258 INFO:tasks.workunit.client.1.smithi195.stdout:8/754: read d0/d17/d2f/d31/f87 [3801043,26675] 0 2024-09-13T17:05:54.260 INFO:tasks.workunit.client.0.smithi115.stdout:1/435: symlink d5/d3e/d59/l97 0 2024-09-13T17:05:54.263 INFO:tasks.workunit.client.0.smithi115.stdout:9/363: rmdir d0/de 39 2024-09-13T17:05:54.268 INFO:tasks.workunit.client.0.smithi115.stdout:6/545: unlink d8/db/l14 0 2024-09-13T17:05:54.274 INFO:tasks.workunit.client.1.smithi195.stdout:9/771: symlink d6/df/d7b/lff 0 2024-09-13T17:05:54.274 INFO:tasks.workunit.client.1.smithi195.stdout:9/772: write d6/d12/f4d [1285137,54960] 0 2024-09-13T17:05:54.274 INFO:tasks.workunit.client.0.smithi115.stdout:3/682: creat d1/d4b/fe0 x:0 0 0 2024-09-13T17:05:54.274 INFO:tasks.workunit.client.0.smithi115.stdout:3/683: write d1/d4b/d69/f77 [2245374,94012] 0 2024-09-13T17:05:54.274 INFO:tasks.workunit.client.0.smithi115.stdout:3/684: readlink d1/d4b/d1a/d6e/dd9/l29 0 2024-09-13T17:05:54.275 INFO:tasks.workunit.client.0.smithi115.stdout:7/477: symlink d0/d2/d67/d86/d94/d9b/lae 0 2024-09-13T17:05:54.275 INFO:tasks.workunit.client.0.smithi115.stdout:7/478: write d0/d2/d1e/d3d/d82/d44/f6e [992040,20877] 0 2024-09-13T17:05:54.277 INFO:tasks.workunit.client.0.smithi115.stdout:1/436: symlink d5/d7/d85/l98 0 2024-09-13T17:05:54.277 INFO:tasks.workunit.client.0.smithi115.stdout:5/449: dwrite d19/d2b/f6a [0,4194304] 0 2024-09-13T17:05:54.282 INFO:tasks.workunit.client.0.smithi115.stdout:3/685: symlink d1/d4b/d69/d7b/le1 0 2024-09-13T17:05:54.285 INFO:tasks.workunit.client.0.smithi115.stdout:9/364: dwrite d0/d21/d65/d79/f7a [0,4194304] 0 2024-09-13T17:05:54.285 INFO:tasks.workunit.client.0.smithi115.stdout:9/365: truncate d0/d21/d4f/f72 810399 0 2024-09-13T17:05:54.285 INFO:tasks.workunit.client.1.smithi195.stdout:4/897: mknod d1a/d1f/d21/d84/d9d/d8e/d9f/c12d 0 2024-09-13T17:05:54.287 INFO:tasks.workunit.client.1.smithi195.stdout:4/898: read d1a/d1f/d21/d22/fb7 [315787,47548] 0 2024-09-13T17:05:54.287 INFO:tasks.workunit.client.1.smithi195.stdout:4/899: fdatasync d1a/d1f/fe4 0 2024-09-13T17:05:54.288 INFO:tasks.workunit.client.1.smithi195.stdout:5/740: creat d2/df/d62/ff5 x:0 0 0 2024-09-13T17:05:54.288 INFO:tasks.workunit.client.1.smithi195.stdout:3/717: sync 2024-09-13T17:05:54.289 INFO:tasks.workunit.client.0.smithi115.stdout:5/450: dread d19/d2b/f6a [0,4194304] 0 2024-09-13T17:05:54.289 INFO:tasks.workunit.client.0.smithi115.stdout:6/546: link d8/db/l2a d8/d13/d15/la6 0 2024-09-13T17:05:54.291 INFO:tasks.workunit.client.0.smithi115.stdout:3/686: truncate d1/d4b/d1a/f27 5862577 0 2024-09-13T17:05:54.293 INFO:tasks.workunit.client.1.smithi195.stdout:2/742: creat d0/d3/df/dbe/fe1 x:0 0 0 2024-09-13T17:05:54.293 INFO:tasks.workunit.client.1.smithi195.stdout:2/743: truncate d0/d3/df/f9e 706576 0 2024-09-13T17:05:54.295 INFO:tasks.workunit.client.1.smithi195.stdout:2/744: dread d0/d3/df/f9e [0,4194304] 0 2024-09-13T17:05:54.295 INFO:tasks.workunit.client.1.smithi195.stdout:2/745: dread - d0/d4a/d47/d73/d75/d88/d8e/dcf/fd2 zero size 2024-09-13T17:05:54.295 INFO:tasks.workunit.client.1.smithi195.stdout:9/773: rename d6/c26 to d6/d8d/c100 0 2024-09-13T17:05:54.295 INFO:tasks.workunit.client.1.smithi195.stdout:9/774: chown d6/d19/d21 5 1 2024-09-13T17:05:54.297 INFO:tasks.workunit.client.1.smithi195.stdout:4/900: link d1a/d1f/d21/d84/d9d/d8e/d9f/c12d d1a/d1f/d43/d5a/d63/dd1/dc3/c12e 0 2024-09-13T17:05:54.298 INFO:tasks.workunit.client.0.smithi115.stdout:9/366: truncate d0/f3 2433508 0 2024-09-13T17:05:54.298 INFO:tasks.workunit.client.1.smithi195.stdout:5/741: symlink d2/df/d78/deb/d4e/d10/d5c/lf6 0 2024-09-13T17:05:54.299 INFO:tasks.workunit.client.1.smithi195.stdout:1/678: dwrite db/df/d51/fd2 [0,4194304] 0 2024-09-13T17:05:54.300 INFO:tasks.workunit.client.1.smithi195.stdout:2/746: unlink d0/d3/l8 0 2024-09-13T17:05:54.303 INFO:tasks.workunit.client.1.smithi195.stdout:3/718: rename d7/d19/f22 to d7/d62/d70/fe5 0 2024-09-13T17:05:54.303 INFO:tasks.workunit.client.1.smithi195.stdout:0/714: dwrite d7/d88/d23/f25 [0,4194304] 0 2024-09-13T17:05:54.303 INFO:tasks.workunit.client.0.smithi115.stdout:8/509: dwrite d0/d15/d44/f52 [0,4194304] 0 2024-09-13T17:05:54.303 INFO:tasks.workunit.client.0.smithi115.stdout:8/510: stat d0/d21/f55 0 2024-09-13T17:05:54.304 INFO:tasks.workunit.client.0.smithi115.stdout:3/687: creat d1/d4b/d69/db6/dd2/fe2 x:0 0 0 2024-09-13T17:05:54.305 INFO:tasks.workunit.client.1.smithi195.stdout:8/755: dwrite d0/d17/d2f/d7c/d4c/d9b/fec [0,4194304] 0 2024-09-13T17:05:54.305 INFO:tasks.workunit.client.1.smithi195.stdout:8/756: readlink d0/d17/d2f/d7c/d4c/l97 0 2024-09-13T17:05:54.307 INFO:tasks.workunit.client.0.smithi115.stdout:1/437: dwrite d5/d26/d2c/d62/f7f [0,4194304] 0 2024-09-13T17:05:54.307 INFO:tasks.workunit.client.0.smithi115.stdout:1/438: truncate d5/d7/d5c/f5d 659200 0 2024-09-13T17:05:54.307 INFO:tasks.workunit.client.0.smithi115.stdout:1/439: fdatasync d5/d60/f5e 0 2024-09-13T17:05:54.307 INFO:tasks.workunit.client.1.smithi195.stdout:8/757: read d0/f89 [486829,123650] 0 2024-09-13T17:05:54.309 INFO:tasks.workunit.client.0.smithi115.stdout:6/547: dwrite d8/d33/d82/f43 [4194304,4194304] 0 2024-09-13T17:05:54.310 INFO:tasks.workunit.client.1.smithi195.stdout:9/775: mkdir d6/d12/d86/d101 0 2024-09-13T17:05:54.311 INFO:tasks.workunit.client.0.smithi115.stdout:5/451: getdents d19/d21/d3a 0 2024-09-13T17:05:54.311 INFO:tasks.workunit.client.0.smithi115.stdout:5/452: creat d19/d2c/f92 x:0 0 0 2024-09-13T17:05:54.313 INFO:tasks.workunit.client.1.smithi195.stdout:4/901: mknod d1a/d1f/d43/d24/d41/d60/d6f/d124/c12f 0 2024-09-13T17:05:54.314 INFO:tasks.workunit.client.0.smithi115.stdout:9/367: read d0/de/f1e [2161555,67039] 0 2024-09-13T17:05:54.315 INFO:tasks.workunit.client.0.smithi115.stdout:2/711: dwrite d3/d4d/de/f43 [0,4194304] 0 2024-09-13T17:05:54.315 INFO:tasks.workunit.client.0.smithi115.stdout:9/368: creat d0/d21/d42/f7e x:0 0 0 2024-09-13T17:05:54.315 INFO:tasks.workunit.client.0.smithi115.stdout:9/369: write d0/de/d37/f6b [921076,109322] 0 2024-09-13T17:05:54.315 INFO:tasks.workunit.client.0.smithi115.stdout:9/370: chown d0/de/d10/f46 19271 1 2024-09-13T17:05:54.315 INFO:tasks.workunit.client.0.smithi115.stdout:7/479: dwrite d0/f2e [0,4194304] 0 2024-09-13T17:05:54.315 INFO:tasks.workunit.client.0.smithi115.stdout:7/480: fsync d0/d2/d1e/d3d/d6c/d71/f46 0 2024-09-13T17:05:54.318 INFO:tasks.workunit.client.1.smithi195.stdout:5/742: mknod d2/d88/cf7 0 2024-09-13T17:05:54.319 INFO:tasks.workunit.client.1.smithi195.stdout:9/776: read d6/d12/d39/f89 [416791,102817] 0 2024-09-13T17:05:54.319 INFO:tasks.workunit.client.1.smithi195.stdout:9/777: getdents d6/df/d16/d58 0 2024-09-13T17:05:54.322 INFO:tasks.workunit.client.0.smithi115.stdout:5/453: write d19/d21/f4a [2850281,87351] 0 2024-09-13T17:05:54.325 INFO:tasks.workunit.client.0.smithi115.stdout:2/712: dread d3/d4d/d13/d62/d66/f82 [0,4194304] 0 2024-09-13T17:05:54.326 INFO:tasks.workunit.client.1.smithi195.stdout:1/679: rename db/f18 to db/d19/d37/fe9 0 2024-09-13T17:05:54.327 INFO:tasks.workunit.client.0.smithi115.stdout:6/548: symlink d8/d13/d15/d24/d53/d6a/la7 0 2024-09-13T17:05:54.329 INFO:tasks.workunit.client.1.smithi195.stdout:0/715: link d7/d88/d23/cbe d7/d88/d23/d96/dd8/ce0 0 2024-09-13T17:05:54.332 INFO:tasks.workunit.client.1.smithi195.stdout:7/732: sync 2024-09-13T17:05:54.333 INFO:tasks.workunit.client.1.smithi195.stdout:7/733: stat d5/db/d19/d22/d3c/f4f 0 2024-09-13T17:05:54.339 INFO:tasks.workunit.client.0.smithi115.stdout:9/371: mkdir d0/de/d10/d15/d7f 0 2024-09-13T17:05:54.343 INFO:tasks.workunit.client.0.smithi115.stdout:5/454: symlink d19/d2b/d32/d55/d5e/d87/l93 0 2024-09-13T17:05:54.343 INFO:tasks.workunit.client.0.smithi115.stdout:5/455: creat d19/d2b/d32/d55/f94 x:0 0 0 2024-09-13T17:05:54.343 INFO:tasks.workunit.client.0.smithi115.stdout:5/456: creat d19/d2b/d32/f95 x:0 0 0 2024-09-13T17:05:54.343 INFO:tasks.workunit.client.0.smithi115.stdout:8/511: dwrite d0/d15/d44/f52 [0,4194304] 0 2024-09-13T17:05:54.344 INFO:tasks.workunit.client.0.smithi115.stdout:2/713: rmdir d3/d4d/d13/d39/d46 39 2024-09-13T17:05:54.344 INFO:tasks.workunit.client.0.smithi115.stdout:2/714: creat d3/d4d/d13/da2/fe0 x:0 0 0 2024-09-13T17:05:54.345 INFO:tasks.workunit.client.0.smithi115.stdout:2/715: truncate d3/f4 4543476 0 2024-09-13T17:05:54.345 INFO:tasks.workunit.client.1.smithi195.stdout:6/663: sync 2024-09-13T17:05:54.345 INFO:tasks.workunit.client.1.smithi195.stdout:3/719: dwrite d7/d62/d70/fac [0,4194304] 0 2024-09-13T17:05:54.345 INFO:tasks.workunit.client.1.smithi195.stdout:3/720: chown d7/d21/d2a/f2b 152 1 2024-09-13T17:05:54.346 INFO:tasks.workunit.client.1.smithi195.stdout:4/902: symlink d1a/l130 0 2024-09-13T17:05:54.346 INFO:tasks.workunit.client.1.smithi195.stdout:4/903: dread - d1a/d1f/d21/d84/d9d/d8e/d9f/db2/d116/fbf zero size 2024-09-13T17:05:54.347 INFO:tasks.workunit.client.1.smithi195.stdout:9/778: dwrite d6/d19/d21/d5b/fa6 [0,4194304] 0 2024-09-13T17:05:54.347 INFO:tasks.workunit.client.1.smithi195.stdout:9/779: fdatasync d6/d12/d86/f96 0 2024-09-13T17:05:54.347 INFO:tasks.workunit.client.1.smithi195.stdout:9/780: dread - d6/df/d7b/ffe zero size 2024-09-13T17:05:54.352 INFO:tasks.workunit.client.0.smithi115.stdout:6/549: rename d8/d33/d40/d4c/c98 to d8/d33/d40/d4c/d66/ca8 0 2024-09-13T17:05:54.353 INFO:tasks.workunit.client.0.smithi115.stdout:3/688: dwrite d1/d4b/d1a/d6e/dd9/fd5 [0,4194304] 0 2024-09-13T17:05:54.353 INFO:tasks.workunit.client.0.smithi115.stdout:3/689: readlink d1/l41 0 2024-09-13T17:05:54.355 INFO:tasks.workunit.client.1.smithi195.stdout:8/758: rename d0/l2c to d0/d62/l102 0 2024-09-13T17:05:54.359 INFO:tasks.workunit.client.1.smithi195.stdout:7/734: link d5/d13/d30/f8a d5/db/d50/daa/ffe 0 2024-09-13T17:05:54.359 INFO:tasks.workunit.client.1.smithi195.stdout:7/735: fsync d5/db/d50/d7f/d82/ff5 0 2024-09-13T17:05:54.360 INFO:tasks.workunit.client.0.smithi115.stdout:5/457: stat l11 0 2024-09-13T17:05:54.361 INFO:tasks.workunit.client.0.smithi115.stdout:5/458: read - d19/d1d/f6c zero size 2024-09-13T17:05:54.361 INFO:tasks.workunit.client.0.smithi115.stdout:5/459: fdatasync d19/d1d/f6c 0 2024-09-13T17:05:54.365 INFO:tasks.workunit.client.1.smithi195.stdout:3/721: unlink d7/d67/lca 0 2024-09-13T17:05:54.366 INFO:tasks.workunit.client.1.smithi195.stdout:3/722: readlink d7/d21/d2a/d35/d60/d6f/da4/lc5 0 2024-09-13T17:05:54.366 INFO:tasks.workunit.client.1.smithi195.stdout:3/723: chown d7/d21/d2a/d35/lbb 202277745 1 2024-09-13T17:05:54.366 INFO:tasks.workunit.client.1.smithi195.stdout:3/724: dread - d7/d21/fe4 zero size 2024-09-13T17:05:54.366 INFO:tasks.workunit.client.1.smithi195.stdout:7/736: dread d5/f6 [4194304,4194304] 0 2024-09-13T17:05:54.370 INFO:tasks.workunit.client.1.smithi195.stdout:1/680: dwrite db/fbf [0,4194304] 0 2024-09-13T17:05:54.370 INFO:tasks.workunit.client.1.smithi195.stdout:1/681: dread - db/d19/d37/d3e/fc9 zero size 2024-09-13T17:05:54.371 INFO:tasks.workunit.client.0.smithi115.stdout:1/440: dwrite d5/d7/d5c/d73/f81 [0,4194304] 0 2024-09-13T17:05:54.371 INFO:tasks.workunit.client.1.smithi195.stdout:1/682: dread db/df/d51/d62/f6d [0,4194304] 0 2024-09-13T17:05:54.376 INFO:tasks.workunit.client.1.smithi195.stdout:5/743: getdents d2/df/d78/deb/d4e 0 2024-09-13T17:05:54.376 INFO:tasks.workunit.client.1.smithi195.stdout:5/744: read - d2/df/d90/db2/fe8 zero size 2024-09-13T17:05:54.377 INFO:tasks.workunit.client.1.smithi195.stdout:5/745: chown d2/df/d78/deb/d4e/d10/d5c/fcf 344 1 2024-09-13T17:05:54.377 INFO:tasks.workunit.client.1.smithi195.stdout:5/746: chown d2/df 120211293 1 2024-09-13T17:05:54.377 INFO:tasks.workunit.client.1.smithi195.stdout:5/747: write d2/df/d78/deb/d4e/f5b [666914,127731] 0 2024-09-13T17:05:54.377 INFO:tasks.workunit.client.0.smithi115.stdout:2/716: mkdir d3/d4d/d13/d62/d92/dd7/d56/d58/de1 0 2024-09-13T17:05:54.377 INFO:tasks.workunit.client.1.smithi195.stdout:5/748: dread d2/df/d48/d5a/dc5/fc6 [0,4194304] 0 2024-09-13T17:05:54.378 INFO:tasks.workunit.client.1.smithi195.stdout:4/904: rename f13 to d1a/d1f/d21/d22/d98/da3/d123/f131 0 2024-09-13T17:05:54.379 INFO:tasks.workunit.client.1.smithi195.stdout:4/905: read d1a/d1f/d21/d22/d98/da3/f10e [931852,65968] 0 2024-09-13T17:05:54.379 INFO:tasks.workunit.client.0.smithi115.stdout:7/481: dwrite d0/d2/d1e/f32 [0,4194304] 0 2024-09-13T17:05:54.379 INFO:tasks.workunit.client.0.smithi115.stdout:7/482: chown d0/d3b/d50/f88 10 1 2024-09-13T17:05:54.380 INFO:tasks.workunit.client.1.smithi195.stdout:8/759: symlink d0/d17/d2f/d7c/d4c/d9b/ddf/dfa/l103 0 2024-09-13T17:05:54.381 INFO:tasks.workunit.client.1.smithi195.stdout:8/760: chown d0/l9 690253438 1 2024-09-13T17:05:54.381 INFO:tasks.workunit.client.1.smithi195.stdout:8/761: chown d0/d17/d2f/d7c/lcc 31 1 2024-09-13T17:05:54.381 INFO:tasks.workunit.client.0.smithi115.stdout:7/483: dread d0/d2/d1e/d3d/d6c/f49 [0,4194304] 0 2024-09-13T17:05:54.381 INFO:tasks.workunit.client.0.smithi115.stdout:7/484: write d0/d2/d4a/f81 [1297511,129449] 0 2024-09-13T17:05:54.382 INFO:tasks.workunit.client.1.smithi195.stdout:3/725: creat d7/fe6 x:0 0 0 2024-09-13T17:05:54.384 INFO:tasks.workunit.client.1.smithi195.stdout:7/737: symlink d5/db/d50/lff 0 2024-09-13T17:05:54.386 INFO:tasks.workunit.client.0.smithi115.stdout:6/550: creat d8/d13/d7b/fa9 x:0 0 0 2024-09-13T17:05:54.386 INFO:tasks.workunit.client.1.smithi195.stdout:1/683: stat db/df/d13/da7/lcd 0 2024-09-13T17:05:54.388 INFO:tasks.workunit.client.1.smithi195.stdout:9/781: getdents d6/d12/d86/da7 0 2024-09-13T17:05:54.390 INFO:tasks.workunit.client.1.smithi195.stdout:6/664: dwrite d1c/d24/d49/d5f/db1/d95/fc5 [0,4194304] 0 2024-09-13T17:05:54.390 INFO:tasks.workunit.client.1.smithi195.stdout:6/665: write d1c/f63 [482989,2653] 0 2024-09-13T17:05:54.392 INFO:tasks.workunit.client.0.smithi115.stdout:3/690: dwrite d1/d12/d14/fcd [0,4194304] 0 2024-09-13T17:05:54.392 INFO:tasks.workunit.client.0.smithi115.stdout:3/691: write d1/d4b/d69/d7b/dbb/fda [945479,76845] 0 2024-09-13T17:05:54.392 INFO:tasks.workunit.client.0.smithi115.stdout:3/692: chown d1/d4b/c3f 202414951 1 2024-09-13T17:05:54.393 INFO:tasks.workunit.client.1.smithi195.stdout:1/684: dread db/f38 [0,4194304] 0 2024-09-13T17:05:54.394 INFO:tasks.workunit.client.1.smithi195.stdout:0/716: dwrite d7/d87/f99 [4194304,4194304] 0 2024-09-13T17:05:54.395 INFO:tasks.workunit.client.0.smithi115.stdout:7/485: dread d0/d3b/d50/d21/f33 [0,4194304] 0 2024-09-13T17:05:54.396 INFO:tasks.workunit.client.1.smithi195.stdout:5/749: creat d2/df/d78/deb/d4e/d10/d46/ff8 x:0 0 0 2024-09-13T17:05:54.397 INFO:tasks.workunit.client.1.smithi195.stdout:6/666: write d1c/d24/d7f/dad/db9/d8c/f99 [7999913,4632] 0 2024-09-13T17:05:54.398 INFO:tasks.workunit.client.0.smithi115.stdout:5/460: mknod d19/c96 0 2024-09-13T17:05:54.399 INFO:tasks.workunit.client.1.smithi195.stdout:4/906: mkdir d1a/d1f/d43/d24/d41/d60/d6f/d132 0 2024-09-13T17:05:54.401 INFO:tasks.workunit.client.1.smithi195.stdout:8/762: mknod d0/d17/d2f/d31/d101/d63/d71/de8/df6/df1/c104 0 2024-09-13T17:05:54.401 INFO:tasks.workunit.client.1.smithi195.stdout:8/763: chown d0/d17/d2f/d7c/d4c/d67/l7d 2838 1 2024-09-13T17:05:54.402 INFO:tasks.workunit.client.0.smithi115.stdout:6/551: dwrite d8/d13/d15/d24/d53/d6a/f9a [0,4194304] 0 2024-09-13T17:05:54.403 INFO:tasks.workunit.client.1.smithi195.stdout:3/726: symlink d7/d21/d2a/d35/d60/d64/dbc/le7 0 2024-09-13T17:05:54.403 INFO:tasks.workunit.client.1.smithi195.stdout:3/727: write d7/d21/f26 [1320631,107931] 0 2024-09-13T17:05:54.403 INFO:tasks.workunit.client.1.smithi195.stdout:3/728: chown d7/d21/d2a/d4a/f7a 6608 1 2024-09-13T17:05:54.404 INFO:tasks.workunit.client.1.smithi195.stdout:5/750: read d2/df/d78/faa [2285320,67492] 0 2024-09-13T17:05:54.404 INFO:tasks.workunit.client.1.smithi195.stdout:5/751: fdatasync d2/df/d78/deb/d4e/d10/d8f/fe9 0 2024-09-13T17:05:54.404 INFO:tasks.workunit.client.1.smithi195.stdout:7/738: mknod d5/db/d50/d7f/d82/de6/c100 0 2024-09-13T17:05:54.406 INFO:tasks.workunit.client.1.smithi195.stdout:9/782: rmdir d6/df/d13 39 2024-09-13T17:05:54.406 INFO:tasks.workunit.client.1.smithi195.stdout:9/783: write d6/d19/d21/d5b/f79 [2723969,81000] 0 2024-09-13T17:05:54.406 INFO:tasks.workunit.client.1.smithi195.stdout:9/784: readlink d6/d12/d86/l93 0 2024-09-13T17:05:54.411 INFO:tasks.workunit.client.1.smithi195.stdout:1/685: mkdir db/d19/d37/d3e/dea 0 2024-09-13T17:05:54.412 INFO:tasks.workunit.client.0.smithi115.stdout:1/441: mknod d5/d60/d7d/d87/c99 0 2024-09-13T17:05:54.412 INFO:tasks.workunit.client.0.smithi115.stdout:1/442: truncate d5/f14 2568165 0 2024-09-13T17:05:54.416 INFO:tasks.workunit.client.1.smithi195.stdout:6/667: symlink d1c/d24/d7f/dad/db9/d8c/lde 0 2024-09-13T17:05:54.416 INFO:tasks.workunit.client.1.smithi195.stdout:6/668: dread - d1c/d24/d7f/dad/fce zero size 2024-09-13T17:05:54.417 INFO:tasks.workunit.client.0.smithi115.stdout:2/717: mkdir d3/d4d/d13/d62/de2 0 2024-09-13T17:05:54.418 INFO:tasks.workunit.client.1.smithi195.stdout:4/907: mknod d1a/d1f/d21/d22/c133 0 2024-09-13T17:05:54.418 INFO:tasks.workunit.client.1.smithi195.stdout:7/739: dwrite d5/d13/d24/d70/f89 [0,4194304] 0 2024-09-13T17:05:54.418 INFO:tasks.workunit.client.1.smithi195.stdout:7/740: write d5/db/d19/d22/f6c [694085,59563] 0 2024-09-13T17:05:54.420 INFO:tasks.workunit.client.1.smithi195.stdout:8/764: link d0/d17/d2f/d7c/lcc d0/d13/d69/dac/l105 0 2024-09-13T17:05:54.420 INFO:tasks.workunit.client.0.smithi115.stdout:2/718: dread d3/d4d/de/d3a/d47/f8d [0,4194304] 0 2024-09-13T17:05:54.420 INFO:tasks.workunit.client.0.smithi115.stdout:2/719: fdatasync d3/f4 0 2024-09-13T17:05:54.420 INFO:tasks.workunit.client.0.smithi115.stdout:2/720: creat d3/d4d/d13/da2/fe3 x:0 0 0 2024-09-13T17:05:54.421 INFO:tasks.workunit.client.1.smithi195.stdout:3/729: mknod d7/d21/d66/d7e/ce8 0 2024-09-13T17:05:54.424 INFO:tasks.workunit.client.1.smithi195.stdout:5/752: rename d2/df/d78/deb/d4e/d10/d46/c77 to d2/df/d78/deb/d4e/d10/d46/cf9 0 2024-09-13T17:05:54.429 INFO:tasks.workunit.client.1.smithi195.stdout:9/785: creat d6/d12/dbc/f102 x:0 0 0 2024-09-13T17:05:54.431 INFO:tasks.workunit.client.1.smithi195.stdout:1/686: creat db/d19/d5a/feb x:0 0 0 2024-09-13T17:05:54.431 INFO:tasks.workunit.client.1.smithi195.stdout:1/687: write db/d19/d37/f8a [4355651,66015] 0 2024-09-13T17:05:54.432 INFO:tasks.workunit.client.1.smithi195.stdout:7/741: write d5/d35/d37/f65 [2131500,1054] 0 2024-09-13T17:05:54.433 INFO:tasks.workunit.client.1.smithi195.stdout:0/717: link d7/d87/d9b/d56/d4d/d5e/c89 d7/d87/d9b/d56/d46/dca/ce1 0 2024-09-13T17:05:54.433 INFO:tasks.workunit.client.1.smithi195.stdout:0/718: write d7/d88/d7c/f8b [937131,17614] 0 2024-09-13T17:05:54.436 INFO:tasks.workunit.client.1.smithi195.stdout:6/669: unlink d1c/d24/d49/d5f/d35/lca 0 2024-09-13T17:05:54.436 INFO:tasks.workunit.client.1.smithi195.stdout:6/670: creat d1c/d24/d7f/dad/db9/d30/d6f/fdf x:0 0 0 2024-09-13T17:05:54.438 INFO:tasks.workunit.client.1.smithi195.stdout:4/908: creat d1a/d11d/f134 x:0 0 0 2024-09-13T17:05:54.438 INFO:tasks.workunit.client.1.smithi195.stdout:4/909: creat d1a/d1f/d21/f135 x:0 0 0 2024-09-13T17:05:54.441 INFO:tasks.workunit.client.1.smithi195.stdout:8/765: dwrite d0/dda/fa9 [0,4194304] 0 2024-09-13T17:05:54.441 INFO:tasks.workunit.client.1.smithi195.stdout:8/766: chown d0/d17/d2f/d31/d101/d63/db3/fbd 377408 1 2024-09-13T17:05:54.442 INFO:tasks.workunit.client.1.smithi195.stdout:8/767: stat d0/d17/d2f/d7c/d4c/d9b/ddf/dfa/l103 0 2024-09-13T17:05:54.447 INFO:tasks.workunit.client.0.smithi115.stdout:8/512: truncate d0/d15/f1b 51330 0 2024-09-13T17:05:54.447 INFO:tasks.workunit.client.0.smithi115.stdout:8/513: truncate d0/d21/f55 1173839 0 2024-09-13T17:05:54.451 INFO:tasks.workunit.client.1.smithi195.stdout:3/730: truncate d7/d21/d2a/f2b 3037209 0 2024-09-13T17:05:54.453 INFO:tasks.workunit.client.1.smithi195.stdout:1/688: dwrite db/df/f26 [0,4194304] 0 2024-09-13T17:05:54.453 INFO:tasks.workunit.client.1.smithi195.stdout:9/786: dwrite d6/d19/d21/d5b/fa6 [0,4194304] 0 2024-09-13T17:05:54.453 INFO:tasks.workunit.client.1.smithi195.stdout:5/753: mkdir d2/df/d78/deb/d3f/dfa 0 2024-09-13T17:05:54.456 INFO:tasks.workunit.client.1.smithi195.stdout:7/742: mknod d5/db/d19/d22/d90/dd4/c101 0 2024-09-13T17:05:54.458 INFO:tasks.workunit.client.0.smithi115.stdout:3/693: dread d1/d4b/f21 [0,4194304] 0 2024-09-13T17:05:54.458 INFO:tasks.workunit.client.0.smithi115.stdout:3/694: read d1/d4b/d1a/f6b [3811536,126396] 0 2024-09-13T17:05:54.459 INFO:tasks.workunit.client.0.smithi115.stdout:7/486: creat d0/faf x:0 0 0 2024-09-13T17:05:54.461 INFO:tasks.workunit.client.1.smithi195.stdout:9/787: write d6/d19/d21/d45/dad/d5e/dd0/d61/fae [902613,46305] 0 2024-09-13T17:05:54.461 INFO:tasks.workunit.client.1.smithi195.stdout:0/719: readlink d7/d87/d9b/d56/d46/da4/lb4 0 2024-09-13T17:05:54.464 INFO:tasks.workunit.client.0.smithi115.stdout:5/461: rmdir d19/d2b 39 2024-09-13T17:05:54.466 INFO:tasks.workunit.client.1.smithi195.stdout:1/689: dread db/f1c [0,4194304] 0 2024-09-13T17:05:54.466 INFO:tasks.workunit.client.1.smithi195.stdout:1/690: fdatasync db/d19/d5a/fd3 0 2024-09-13T17:05:54.466 INFO:tasks.workunit.client.1.smithi195.stdout:1/691: fsync db/d19/f79 0 2024-09-13T17:05:54.468 INFO:tasks.workunit.client.1.smithi195.stdout:6/671: mkdir d1c/d24/d7f/dad/db9/d8c/dd1/de0 0 2024-09-13T17:05:54.472 INFO:tasks.workunit.client.0.smithi115.stdout:6/552: rename d8/d13/d15/d24/f96 to d8/d33/d7f/faa 0 2024-09-13T17:05:54.472 INFO:tasks.workunit.client.1.smithi195.stdout:4/910: mkdir d1a/d1f/d43/d5a/d63/dd1/d121/d136 0 2024-09-13T17:05:54.473 INFO:tasks.workunit.client.1.smithi195.stdout:1/692: write db/df/d51/f72 [2561837,12829] 0 2024-09-13T17:05:54.473 INFO:tasks.workunit.client.1.smithi195.stdout:1/693: dread - db/fa2 zero size 2024-09-13T17:05:54.473 INFO:tasks.workunit.client.1.smithi195.stdout:1/694: chown db/df/f26 9497880 1 2024-09-13T17:05:54.474 INFO:tasks.workunit.client.0.smithi115.stdout:1/443: mknod d5/d7/d5c/c9a 0 2024-09-13T17:05:54.474 INFO:tasks.workunit.client.0.smithi115.stdout:1/444: creat d5/d7/d33/d3a/f9b x:0 0 0 2024-09-13T17:05:54.474 INFO:tasks.workunit.client.0.smithi115.stdout:1/445: write d5/d7/d33/d3a/f57 [904133,70827] 0 2024-09-13T17:05:54.474 INFO:tasks.workunit.client.0.smithi115.stdout:1/446: chown d5/d7/d5c/f7b 59478 1 2024-09-13T17:05:54.474 INFO:tasks.workunit.client.0.smithi115.stdout:3/695: dwrite d1/d4b/d69/d7b/f94 [8388608,4194304] 0 2024-09-13T17:05:54.474 INFO:tasks.workunit.client.0.smithi115.stdout:3/696: truncate d1/d4b/d69/d7b/d8b/f8c 4447860 0 2024-09-13T17:05:54.475 INFO:tasks.workunit.client.1.smithi195.stdout:8/768: creat d0/d17/d2f/d31/d101/d63/d71/de8/f106 x:0 0 0 2024-09-13T17:05:54.478 INFO:tasks.workunit.client.1.smithi195.stdout:3/731: mkdir d7/d21/d2a/de9 0 2024-09-13T17:05:54.480 INFO:tasks.workunit.client.0.smithi115.stdout:2/721: stat d3/d4d/d13/c63 0 2024-09-13T17:05:54.480 INFO:tasks.workunit.client.0.smithi115.stdout:2/722: stat d3/d4d/dd/df/d57/fd1 0 2024-09-13T17:05:54.482 INFO:tasks.workunit.client.0.smithi115.stdout:8/514: creat d0/d15/d3e/fad x:0 0 0 2024-09-13T17:05:54.483 INFO:tasks.workunit.client.1.smithi195.stdout:5/754: symlink d2/df/d78/deb/d4e/d10/d46/df3/lfb 0 2024-09-13T17:05:54.486 INFO:tasks.workunit.client.0.smithi115.stdout:7/487: mknod d0/d2/d67/d86/d94/d9b/cb0 0 2024-09-13T17:05:54.489 INFO:tasks.workunit.client.1.smithi195.stdout:9/788: mkdir d6/df/d16/d103 0 2024-09-13T17:05:54.489 INFO:tasks.workunit.client.1.smithi195.stdout:9/789: truncate d6/d19/d21/d45/dad/d5e/dd0/f9c 967157 0 2024-09-13T17:05:54.489 INFO:tasks.workunit.client.0.smithi115.stdout:5/462: mknod d19/d21/d3a/c97 0 2024-09-13T17:05:54.489 INFO:tasks.workunit.client.0.smithi115.stdout:5/463: fdatasync d19/d2e/d6b/f8a 0 2024-09-13T17:05:54.489 INFO:tasks.workunit.client.0.smithi115.stdout:5/464: fdatasync d19/d2b/d32/d55/f4c 0 2024-09-13T17:05:54.490 INFO:tasks.workunit.client.1.smithi195.stdout:9/790: write d6/df/f3c [1918971,58335] 0 2024-09-13T17:05:54.491 INFO:tasks.workunit.client.1.smithi195.stdout:8/769: write d0/d4/f5e [490911,19380] 0 2024-09-13T17:05:54.491 INFO:tasks.workunit.client.1.smithi195.stdout:8/770: truncate d0/d17/d2f/d7c/d4c/d9b/ddf/fb8 4637785 0 2024-09-13T17:05:54.492 INFO:tasks.workunit.client.1.smithi195.stdout:8/771: dread d0/d17/d2f/d7c/d4c/d9a/da5/fd8 [0,4194304] 0 2024-09-13T17:05:54.493 INFO:tasks.workunit.client.1.smithi195.stdout:0/720: read d7/d87/d9b/d56/d46/fc2 [114061,11788] 0 2024-09-13T17:05:54.493 INFO:tasks.workunit.client.0.smithi115.stdout:1/447: rename d5/d26/l72 to d5/d60/d8e/l9c 0 2024-09-13T17:05:54.494 INFO:tasks.workunit.client.0.smithi115.stdout:1/448: chown d5/d26/c52 1000 0 2024-09-13T17:05:54.495 INFO:tasks.workunit.client.0.smithi115.stdout:3/697: mknod d1/d4b/d69/d7b/ce3 0 2024-09-13T17:05:54.497 INFO:tasks.workunit.client.0.smithi115.stdout:2/723: unlink d3/d4d/de/d3a/d47/da4/ld9 0 2024-09-13T17:05:54.498 INFO:tasks.workunit.client.1.smithi195.stdout:2/747: sync 2024-09-13T17:05:54.499 INFO:tasks.workunit.client.0.smithi115.stdout:7/488: link d0/faf d0/d2/d67/d86/fb1 0 2024-09-13T17:05:54.501 INFO:tasks.workunit.client.0.smithi115.stdout:2/724: truncate d3/d4d/d13/d62/d66/f82 2990964 0 2024-09-13T17:05:54.503 INFO:tasks.workunit.client.1.smithi195.stdout:6/672: mkdir d1c/d24/d49/d5f/de1 0 2024-09-13T17:05:54.504 INFO:tasks.workunit.client.1.smithi195.stdout:6/673: fsync d1c/d24/d7f/dad/fce 0 2024-09-13T17:05:54.505 INFO:tasks.workunit.client.0.smithi115.stdout:5/465: write f8 [2795231,75400] 0 2024-09-13T17:05:54.505 INFO:tasks.workunit.client.0.smithi115.stdout:5/466: fdatasync d19/d21/d3a/f82 0 2024-09-13T17:05:54.505 INFO:tasks.workunit.client.0.smithi115.stdout:7/489: symlink d0/d3b/d50/d21/d2f/lb2 0 2024-09-13T17:05:54.505 INFO:tasks.workunit.client.0.smithi115.stdout:7/490: write d0/d2/d1e/d3d/d6c/f49 [954056,79902] 0 2024-09-13T17:05:54.506 INFO:tasks.workunit.client.1.smithi195.stdout:4/911: creat d1a/d1f/d21/d22/d98/f137 x:0 0 0 2024-09-13T17:05:54.507 INFO:tasks.workunit.client.0.smithi115.stdout:2/725: mknod d3/d4d/d13/d62/d92/dd7/da6/ce4 0 2024-09-13T17:05:54.507 INFO:tasks.workunit.client.0.smithi115.stdout:2/726: creat d3/d4d/d13/d39/d46/da0/fe5 x:0 0 0 2024-09-13T17:05:54.507 INFO:tasks.workunit.client.0.smithi115.stdout:2/727: read d3/d4d/de/d99/fcb [256245,75287] 0 2024-09-13T17:05:54.507 INFO:tasks.workunit.client.0.smithi115.stdout:2/728: write d3/d4d/d13/d62/d92/dd7/d7d/fda [439287,26340] 0 2024-09-13T17:05:54.507 INFO:tasks.workunit.client.0.smithi115.stdout:2/729: truncate d3/d4d/dd/fa3 826021 0 2024-09-13T17:05:54.508 INFO:tasks.workunit.client.0.smithi115.stdout:2/730: write d3/d4d/d13/d39/d46/d70/fc7 [234413,18327] 0 2024-09-13T17:05:54.508 INFO:tasks.workunit.client.0.smithi115.stdout:2/731: chown d3/d4d/d13/d1c/l76 12391 1 2024-09-13T17:05:54.508 INFO:tasks.workunit.client.0.smithi115.stdout:1/449: write d5/d7/d33/d3a/f43 [1107355,28447] 0 2024-09-13T17:05:54.508 INFO:tasks.workunit.client.0.smithi115.stdout:1/450: dread - d5/d3e/f84 zero size 2024-09-13T17:05:54.510 INFO:tasks.workunit.client.1.smithi195.stdout:1/695: dwrite db/df/d4d/f52 [0,4194304] 0 2024-09-13T17:05:54.511 INFO:tasks.workunit.client.1.smithi195.stdout:1/696: write db/df/d4d/f9b [74953,120661] 0 2024-09-13T17:05:54.511 INFO:tasks.workunit.client.1.smithi195.stdout:3/732: creat d7/d21/d2a/d35/d60/fea x:0 0 0 2024-09-13T17:05:54.512 INFO:tasks.workunit.client.0.smithi115.stdout:6/553: dwrite d8/db/d1d/fa1 [0,4194304] 0 2024-09-13T17:05:54.513 INFO:tasks.workunit.client.0.smithi115.stdout:8/515: dwrite d0/d18/d51/f9c [0,4194304] 0 2024-09-13T17:05:54.514 INFO:tasks.workunit.client.0.smithi115.stdout:6/554: dread d8/d13/d15/d24/d17/f85 [0,4194304] 0 2024-09-13T17:05:54.514 INFO:tasks.workunit.client.0.smithi115.stdout:5/467: unlink d19/l46 0 2024-09-13T17:05:54.515 INFO:tasks.workunit.client.0.smithi115.stdout:5/468: chown d19/d2b/d69/l7f 69 1 2024-09-13T17:05:54.515 INFO:tasks.workunit.client.0.smithi115.stdout:6/555: write d8/db/d49/f5e [278675,83279] 0 2024-09-13T17:05:54.515 INFO:tasks.workunit.client.1.smithi195.stdout:5/755: symlink d2/df/d78/deb/d4e/d10/d5c/da1/lfc 0 2024-09-13T17:05:54.516 INFO:tasks.workunit.client.0.smithi115.stdout:6/556: read d8/d33/d40/f5a [726340,36360] 0 2024-09-13T17:05:54.516 INFO:tasks.workunit.client.0.smithi115.stdout:7/491: mkdir d0/d3b/d50/d21/d99/db3 0 2024-09-13T17:05:54.517 INFO:tasks.workunit.client.1.smithi195.stdout:9/791: getdents d6/d19/d21/d45/dad/d5e/de7 0 2024-09-13T17:05:54.518 INFO:tasks.workunit.client.1.smithi195.stdout:5/756: read d2/f7c [94830,54793] 0 2024-09-13T17:05:54.520 INFO:tasks.workunit.client.1.smithi195.stdout:8/772: rename d0/d13/l4f to d0/d17/d2f/l107 0 2024-09-13T17:05:54.521 INFO:tasks.workunit.client.1.smithi195.stdout:8/773: write d0/d17/d2f/d7c/ffb [1008457,42738] 0 2024-09-13T17:05:54.523 INFO:tasks.workunit.client.0.smithi115.stdout:3/698: dwrite d1/d4b/d1a/d30/faa [0,4194304] 0 2024-09-13T17:05:54.524 INFO:tasks.workunit.client.1.smithi195.stdout:0/721: creat d7/d88/fe2 x:0 0 0 2024-09-13T17:05:54.524 INFO:tasks.workunit.client.1.smithi195.stdout:0/722: truncate d7/db/f7a 8658966 0 2024-09-13T17:05:54.527 INFO:tasks.workunit.client.1.smithi195.stdout:2/748: link d0/d4a/d47/d73/d75/d88/d62/lbf d0/d4a/d47/d73/d75/le2 0 2024-09-13T17:05:54.527 INFO:tasks.workunit.client.0.smithi115.stdout:6/557: write d8/d33/d40/d4c/f91 [3397648,50545] 0 2024-09-13T17:05:54.529 INFO:tasks.workunit.client.0.smithi115.stdout:8/516: write d0/d21/d3a/d60/f7a [821611,13145] 0 2024-09-13T17:05:54.529 INFO:tasks.workunit.client.0.smithi115.stdout:8/517: write d0/d26/f9b [276991,82840] 0 2024-09-13T17:05:54.530 INFO:tasks.workunit.client.0.smithi115.stdout:5/469: read d19/d2b/f50 [3405441,3001] 0 2024-09-13T17:05:54.531 INFO:tasks.workunit.client.0.smithi115.stdout:3/699: write d1/d4b/f4d [2670410,56215] 0 2024-09-13T17:05:54.531 INFO:tasks.workunit.client.0.smithi115.stdout:3/700: creat d1/da4/fe4 x:0 0 0 2024-09-13T17:05:54.533 INFO:tasks.workunit.client.0.smithi115.stdout:2/732: dwrite d3/d4d/de/f10 [0,4194304] 0 2024-09-13T17:05:54.534 INFO:tasks.workunit.client.1.smithi195.stdout:1/697: creat db/d19/fec x:0 0 0 2024-09-13T17:05:54.534 INFO:tasks.workunit.client.0.smithi115.stdout:2/733: write d3/d4d/dd/d1f/f9d [541625,35375] 0 2024-09-13T17:05:54.535 INFO:tasks.workunit.client.0.smithi115.stdout:2/734: write d3/d4d/dd/d1f/f79 [383959,92181] 0 2024-09-13T17:05:54.536 INFO:tasks.workunit.client.1.smithi195.stdout:3/733: mkdir d7/d21/d2a/deb 0 2024-09-13T17:05:54.538 INFO:tasks.workunit.client.1.smithi195.stdout:9/792: mknod d6/d12/d86/dd2/c104 0 2024-09-13T17:05:54.539 INFO:tasks.workunit.client.0.smithi115.stdout:7/492: mknod d0/d3b/d50/d21/d99/db3/cb4 0 2024-09-13T17:05:54.541 INFO:tasks.workunit.client.1.smithi195.stdout:4/912: rename d1a/d1f/d21/d84/d9d/f3f to d1a/d1f/d43/d24/d41/d60/d6f/d124/f138 0 2024-09-13T17:05:54.542 INFO:tasks.workunit.client.1.smithi195.stdout:1/698: write db/df/f1f [713079,16963] 0 2024-09-13T17:05:54.543 INFO:tasks.workunit.client.1.smithi195.stdout:8/774: link d0/d17/d2f/d31/d101/d63/d71/de8/df6/df1/c104 d0/d17/d2f/d7c/d4c/d9b/ddf/c108 0 2024-09-13T17:05:54.548 INFO:tasks.workunit.client.1.smithi195.stdout:1/699: dread db/f6b [0,4194304] 0 2024-09-13T17:05:54.549 INFO:tasks.workunit.client.1.smithi195.stdout:0/723: mkdir d7/d88/d23/d96/dd8/de3 0 2024-09-13T17:05:54.549 INFO:tasks.workunit.client.0.smithi115.stdout:7/493: dread d0/f2e [0,4194304] 0 2024-09-13T17:05:54.549 INFO:tasks.workunit.client.0.smithi115.stdout:7/494: fsync d0/d97/f98 0 2024-09-13T17:05:54.551 INFO:tasks.workunit.client.1.smithi195.stdout:8/775: dread d0/d17/d2f/d31/d101/f50 [0,4194304] 0 2024-09-13T17:05:54.551 INFO:tasks.workunit.client.1.smithi195.stdout:8/776: chown d0/d62/fba 11152957 1 2024-09-13T17:05:54.553 INFO:tasks.workunit.client.0.smithi115.stdout:6/558: dread d8/db/f70 [0,4194304] 0 2024-09-13T17:05:54.554 INFO:tasks.workunit.client.1.smithi195.stdout:4/913: dread d1a/d1f/d43/d24/f3e [0,4194304] 0 2024-09-13T17:05:54.554 INFO:tasks.workunit.client.0.smithi115.stdout:8/518: link d0/d18/l93 d0/d26/d29/d59/d7e/da7/d2b/lae 0 2024-09-13T17:05:54.556 INFO:tasks.workunit.client.0.smithi115.stdout:5/470: symlink d19/d2b/d32/d55/l98 0 2024-09-13T17:05:54.556 INFO:tasks.workunit.client.0.smithi115.stdout:5/471: chown d19/d2b/d77 0 1 2024-09-13T17:05:54.562 INFO:tasks.workunit.client.0.smithi115.stdout:3/701: rmdir d1/d12 39 2024-09-13T17:05:54.562 INFO:tasks.workunit.client.0.smithi115.stdout:3/702: creat d1/d4b/d69/d7b/fe5 x:0 0 0 2024-09-13T17:05:54.563 INFO:tasks.workunit.client.1.smithi195.stdout:3/734: creat d7/d21/d66/d7e/fec x:0 0 0 2024-09-13T17:05:54.566 INFO:tasks.workunit.client.1.smithi195.stdout:2/749: rename d0/d3/df/f35 to d0/d4a/d47/d73/fe3 0 2024-09-13T17:05:54.569 INFO:tasks.workunit.client.1.smithi195.stdout:9/793: dwrite d6/d19/d21/d5b/f79 [0,4194304] 0 2024-09-13T17:05:54.569 INFO:tasks.workunit.client.1.smithi195.stdout:9/794: fsync d6/df/d16/f88 0 2024-09-13T17:05:54.569 INFO:tasks.workunit.client.1.smithi195.stdout:9/795: chown d6/d12/d39/f89 276 1 2024-09-13T17:05:54.570 INFO:tasks.workunit.client.1.smithi195.stdout:0/724: mknod d7/d88/d23/d96/dd8/ce4 0 2024-09-13T17:05:54.572 INFO:tasks.workunit.client.1.smithi195.stdout:8/777: mkdir d0/d17/d2f/d7c/d4c/d9a/d109 0 2024-09-13T17:05:54.572 INFO:tasks.workunit.client.0.smithi115.stdout:2/735: dwrite d3/d4d/d13/d62/d66/f82 [0,4194304] 0 2024-09-13T17:05:54.573 INFO:tasks.workunit.client.1.smithi195.stdout:4/914: mkdir d1a/d1f/d43/d24/d41/d60/d6f/d132/d139 0 2024-09-13T17:05:54.573 INFO:tasks.workunit.client.1.smithi195.stdout:4/915: dread - d1a/d1f/fe4 zero size 2024-09-13T17:05:54.573 INFO:tasks.workunit.client.1.smithi195.stdout:4/916: chown d1a/d1f/d43/d24/d41/f70 6430 1 2024-09-13T17:05:54.575 INFO:tasks.workunit.client.0.smithi115.stdout:8/519: dwrite d0/d42/f6f [0,4194304] 0 2024-09-13T17:05:54.575 INFO:tasks.workunit.client.1.smithi195.stdout:3/735: readlink d7/l1a 0 2024-09-13T17:05:54.576 INFO:tasks.workunit.client.1.smithi195.stdout:3/736: chown d7/d5f/f82 674722 1 2024-09-13T17:05:54.577 INFO:tasks.workunit.client.0.smithi115.stdout:8/520: dread d0/d15/d44/f61 [0,4194304] 0 2024-09-13T17:05:54.578 INFO:tasks.workunit.client.1.smithi195.stdout:1/700: rename db/f2b to db/d19/d5a/d66/d96/fed 0 2024-09-13T17:05:54.578 INFO:tasks.workunit.client.1.smithi195.stdout:8/778: rename d0 to d0/d62/d10a 22 2024-09-13T17:05:54.578 INFO:tasks.workunit.client.1.smithi195.stdout:1/701: readlink db/l5d 0 2024-09-13T17:05:54.585 INFO:tasks.workunit.client.1.smithi195.stdout:0/725: chown d7/d87/d9b/d56/d46/l19 409 1 2024-09-13T17:05:54.587 INFO:tasks.workunit.client.1.smithi195.stdout:4/917: mkdir d1a/d1f/d43/d24/d13a 0 2024-09-13T17:05:54.588 INFO:tasks.workunit.client.0.smithi115.stdout:7/495: getdents d0/d2 0 2024-09-13T17:05:54.588 INFO:tasks.workunit.client.0.smithi115.stdout:7/496: dread - d0/f56 zero size 2024-09-13T17:05:54.588 INFO:tasks.workunit.client.0.smithi115.stdout:7/497: chown d0/d97 304 1 2024-09-13T17:05:54.588 INFO:tasks.workunit.client.1.smithi195.stdout:4/918: dread d1a/d1f/d21/d84/d9d/d58/f80 [0,4194304] 0 2024-09-13T17:05:54.589 INFO:tasks.workunit.client.1.smithi195.stdout:3/737: unlink d7/d21/d2a/d4a/d71/cce 0 2024-09-13T17:05:54.591 INFO:tasks.workunit.client.0.smithi115.stdout:5/472: symlink d19/d2b/l99 0 2024-09-13T17:05:54.594 INFO:tasks.workunit.client.1.smithi195.stdout:8/779: link d0/d17/d2f/d7c/d4c/c58 d0/d17/d2f/d31/d101/d63/d71/de8/c10b 0 2024-09-13T17:05:54.594 INFO:tasks.workunit.client.1.smithi195.stdout:8/780: chown d0/d17/d2f/d31/l7a 494405 1 2024-09-13T17:05:54.595 INFO:tasks.workunit.client.1.smithi195.stdout:1/702: mkdir db/df/d4d/d74/dee 0 2024-09-13T17:05:54.596 INFO:tasks.workunit.client.0.smithi115.stdout:3/703: mknod d1/d4b/d1a/d30/ce6 0 2024-09-13T17:05:54.597 INFO:tasks.workunit.client.0.smithi115.stdout:3/704: chown d1/d12/d14/fce 279 1 2024-09-13T17:05:54.597 INFO:tasks.workunit.client.0.smithi115.stdout:3/705: stat d1/d4b/d69/d7b/dbb/fd6 0 2024-09-13T17:05:54.597 INFO:tasks.workunit.client.1.smithi195.stdout:8/781: write d0/d17/d2f/d31/d101/f50 [3730612,124628] 0 2024-09-13T17:05:54.597 INFO:tasks.workunit.client.1.smithi195.stdout:8/782: fdatasync d0/d17/d2f/d7c/fca 0 2024-09-13T17:05:54.600 INFO:tasks.workunit.client.1.smithi195.stdout:9/796: rmdir d6/df/d13/d8e 39 2024-09-13T17:05:54.602 INFO:tasks.workunit.client.0.smithi115.stdout:2/736: symlink d3/d4d/d13/d62/d92/dd7/d56/d58/de1/le6 0 2024-09-13T17:05:54.602 INFO:tasks.workunit.client.0.smithi115.stdout:2/737: truncate d3/d4d/dd/df/d5b/f83 1712115 0 2024-09-13T17:05:54.603 INFO:tasks.workunit.client.0.smithi115.stdout:2/738: dread d3/d4d/d13/d62/d92/dd7/d56/d58/f7b [0,4194304] 0 2024-09-13T17:05:54.603 INFO:tasks.workunit.client.1.smithi195.stdout:0/726: symlink d7/d87/d9b/d56/d4d/le5 0 2024-09-13T17:05:54.605 INFO:tasks.workunit.client.1.smithi195.stdout:4/919: rename d1a/f11a to d1a/d1f/d43/d5a/d63/dd1/db4/f13b 0 2024-09-13T17:05:54.607 INFO:tasks.workunit.client.1.smithi195.stdout:3/738: getdents d7/d21/d2a/d35/d9c/da9 0 2024-09-13T17:05:54.610 INFO:tasks.workunit.client.0.smithi115.stdout:7/498: creat d0/d2/d1e/d3d/d82/fb5 x:0 0 0 2024-09-13T17:05:54.611 INFO:tasks.workunit.client.0.smithi115.stdout:7/499: write d0/d51/fa8 [84282,13136] 0 2024-09-13T17:05:54.611 INFO:tasks.workunit.client.0.smithi115.stdout:7/500: dread - d0/d2/d1e/f77 zero size 2024-09-13T17:05:54.612 INFO:tasks.workunit.client.1.smithi195.stdout:2/750: link d0/d4a/d47/d73/d75/d88/d2c/f91 d0/d4a/d47/d73/d75/d88/d2c/fe4 0 2024-09-13T17:05:54.612 INFO:tasks.workunit.client.1.smithi195.stdout:2/751: fdatasync d0/d4a/d47/d73/d75/d88/f7f 0 2024-09-13T17:05:54.614 INFO:tasks.workunit.client.0.smithi115.stdout:6/559: rename d8/d13/d15/f6e to d8/db/fab 0 2024-09-13T17:05:54.614 INFO:tasks.workunit.client.1.smithi195.stdout:7/743: sync 2024-09-13T17:05:54.615 INFO:tasks.workunit.client.1.smithi195.stdout:8/783: mknod d0/d17/d2f/d7c/d4c/d9b/ddf/dff/c10c 0 2024-09-13T17:05:54.615 INFO:tasks.workunit.client.1.smithi195.stdout:1/703: dwrite db/d19/d5a/d66/d96/fed [0,4194304] 0 2024-09-13T17:05:54.616 INFO:tasks.workunit.client.0.smithi115.stdout:3/706: dwrite d1/d12/d14/fa5 [0,4194304] 0 2024-09-13T17:05:54.616 INFO:tasks.workunit.client.0.smithi115.stdout:6/560: write d8/f51 [5132414,94644] 0 2024-09-13T17:05:54.616 INFO:tasks.workunit.client.0.smithi115.stdout:6/561: getdents d8/d33/d40/d67 0 2024-09-13T17:05:54.616 INFO:tasks.workunit.client.0.smithi115.stdout:5/473: link d19/d2c/f7e d19/d1d/f9a 0 2024-09-13T17:05:54.617 INFO:tasks.workunit.client.1.smithi195.stdout:9/797: getdents d6/df/d7b/df6 0 2024-09-13T17:05:54.617 INFO:tasks.workunit.client.0.smithi115.stdout:2/739: mknod d3/d4d/dd/df/ce7 0 2024-09-13T17:05:54.619 INFO:tasks.workunit.client.1.smithi195.stdout:0/727: link d7/d88/d23/c44 d7/d50/da2/dbd/ce6 0 2024-09-13T17:05:54.619 INFO:tasks.workunit.client.1.smithi195.stdout:0/728: stat d7/d87/d9b/d4e/d68/lc6 0 2024-09-13T17:05:54.621 INFO:tasks.workunit.client.1.smithi195.stdout:4/920: mkdir d1a/d1f/d43/d5a/d63/db8/dc8/dd7/d13c 0 2024-09-13T17:05:54.621 INFO:tasks.workunit.client.1.smithi195.stdout:4/921: truncate d1a/d1f/d9c/f11e 213813 0 2024-09-13T17:05:54.621 INFO:tasks.workunit.client.1.smithi195.stdout:4/922: write d1a/d1f/d9c/f11e [396118,727] 0 2024-09-13T17:05:54.622 INFO:tasks.workunit.client.0.smithi115.stdout:8/521: rmdir d0/d21/d76/d83 39 2024-09-13T17:05:54.622 INFO:tasks.workunit.client.0.smithi115.stdout:8/522: readlink d0/d18/l93 0 2024-09-13T17:05:54.622 INFO:tasks.workunit.client.0.smithi115.stdout:8/523: chown d0/d21/d3a/d60/f78 736048 1 2024-09-13T17:05:54.622 INFO:tasks.workunit.client.0.smithi115.stdout:8/524: readlink d0/d26/d29/d59/d7e/da7/d2b/l92 0 2024-09-13T17:05:54.622 INFO:tasks.workunit.client.1.smithi195.stdout:3/739: getdents d7/d21/d2a/d35/d60/d64/db3 0 2024-09-13T17:05:54.624 INFO:tasks.workunit.client.0.smithi115.stdout:2/740: read d3/f4 [3277821,34872] 0 2024-09-13T17:05:54.625 INFO:tasks.workunit.client.1.smithi195.stdout:2/752: readlink d0/d4a/d47/d73/d75/d88/d2c/l5f 0 2024-09-13T17:05:54.627 INFO:tasks.workunit.client.0.smithi115.stdout:3/707: rmdir d1/d4b/d69/da1 0 2024-09-13T17:05:54.628 INFO:tasks.workunit.client.1.smithi195.stdout:7/744: link d5/d13/da8/cb0 d5/db/d50/d7f/c102 0 2024-09-13T17:05:54.630 INFO:tasks.workunit.client.1.smithi195.stdout:2/753: dread d0/faf [0,4194304] 0 2024-09-13T17:05:54.630 INFO:tasks.workunit.client.1.smithi195.stdout:8/784: rename d0/d62/fba to d0/d17/d2f/d7c/d4c/d9a/f10d 0 2024-09-13T17:05:54.630 INFO:tasks.workunit.client.1.smithi195.stdout:8/785: write d0/f3 [554451,96587] 0 2024-09-13T17:05:54.630 INFO:tasks.workunit.client.1.smithi195.stdout:8/786: fdatasync d0/d4/f5a 0 2024-09-13T17:05:54.630 INFO:tasks.workunit.client.1.smithi195.stdout:8/787: fdatasync d0/d17/d2f/d31/f87 0 2024-09-13T17:05:54.630 INFO:tasks.workunit.client.1.smithi195.stdout:2/754: read d0/faf [77865,7109] 0 2024-09-13T17:05:54.631 INFO:tasks.workunit.client.1.smithi195.stdout:6/674: sync 2024-09-13T17:05:54.632 INFO:tasks.workunit.client.0.smithi115.stdout:6/562: mknod d8/db/dd/cac 0 2024-09-13T17:05:54.632 INFO:tasks.workunit.client.0.smithi115.stdout:6/563: read - d8/d13/d15/d24/f8b zero size 2024-09-13T17:05:54.632 INFO:tasks.workunit.client.0.smithi115.stdout:6/564: chown d8/d13/d15/d24/d53/d6a 38849 1 2024-09-13T17:05:54.634 INFO:tasks.workunit.client.1.smithi195.stdout:9/798: symlink d6/d12/d86/l105 0 2024-09-13T17:05:54.635 INFO:tasks.workunit.client.0.smithi115.stdout:8/525: symlink d0/d26/d29/d59/d7e/da7/d28/d4f/laf 0 2024-09-13T17:05:54.635 INFO:tasks.workunit.client.0.smithi115.stdout:8/526: fdatasync d0/d18/f9a 0 2024-09-13T17:05:54.638 INFO:tasks.workunit.client.0.smithi115.stdout:3/708: symlink d1/d4b/d69/le7 0 2024-09-13T17:05:54.638 INFO:tasks.workunit.client.0.smithi115.stdout:3/709: creat d1/d4b/d69/db6/dd2/fe8 x:0 0 0 2024-09-13T17:05:54.639 INFO:tasks.workunit.client.0.smithi115.stdout:3/710: creat d1/d83/fe9 x:0 0 0 2024-09-13T17:05:54.639 INFO:tasks.workunit.client.0.smithi115.stdout:3/711: chown d1/d12/d14/d61/la8 0 1 2024-09-13T17:05:54.639 INFO:tasks.workunit.client.1.smithi195.stdout:4/923: mknod d1a/d1f/d43/d24/d41/d60/d6f/d132/d139/c13d 0 2024-09-13T17:05:54.640 INFO:tasks.workunit.client.0.smithi115.stdout:6/565: symlink d8/d33/lad 0 2024-09-13T17:05:54.641 INFO:tasks.workunit.client.1.smithi195.stdout:3/740: symlink d7/d21/d2a/de9/led 0 2024-09-13T17:05:54.642 INFO:tasks.workunit.client.0.smithi115.stdout:5/474: getdents d19/d2c 0 2024-09-13T17:05:54.643 INFO:tasks.workunit.client.1.smithi195.stdout:7/745: symlink d5/db/d50/daa/l103 0 2024-09-13T17:05:54.644 INFO:tasks.workunit.client.0.smithi115.stdout:2/741: getdents d3/d4d/d13/d77 0 2024-09-13T17:05:54.644 INFO:tasks.workunit.client.0.smithi115.stdout:2/742: dread - d3/d4d/de/d98/fd0 zero size 2024-09-13T17:05:54.645 INFO:tasks.workunit.client.0.smithi115.stdout:8/527: write d0/d26/d29/f38 [3997693,96385] 0 2024-09-13T17:05:54.645 INFO:tasks.workunit.client.0.smithi115.stdout:8/528: chown d0/d26/d29/d59/d7e/da7 11093 1 2024-09-13T17:05:54.646 INFO:tasks.workunit.client.1.smithi195.stdout:8/788: mknod d0/d13/d69/c10e 0 2024-09-13T17:05:54.647 INFO:tasks.workunit.client.1.smithi195.stdout:2/755: write d0/d4a/d47/d73/d75/d88/d2c/d43/d84/dac/fc7 [110406,25131] 0 2024-09-13T17:05:54.650 INFO:tasks.workunit.client.1.smithi195.stdout:6/675: link d1c/d24/d7f/dad/db9/f55 d1c/d24/d49/d5f/db1/dcd/fe2 0 2024-09-13T17:05:54.651 INFO:tasks.workunit.client.0.smithi115.stdout:5/475: symlink d19/d2b/l9b 0 2024-09-13T17:05:54.651 INFO:tasks.workunit.client.0.smithi115.stdout:5/476: creat d19/f9c x:0 0 0 2024-09-13T17:05:54.652 INFO:tasks.workunit.client.0.smithi115.stdout:5/477: truncate d19/d2c/f92 295710 0 2024-09-13T17:05:54.652 INFO:tasks.workunit.client.0.smithi115.stdout:5/478: chown d19/d2b/d77 86 1 2024-09-13T17:05:54.652 INFO:tasks.workunit.client.0.smithi115.stdout:5/479: truncate d19/d75/f7b 245478 0 2024-09-13T17:05:54.652 INFO:tasks.workunit.client.1.smithi195.stdout:0/729: getdents d7/d88/d7c 0 2024-09-13T17:05:54.653 INFO:tasks.workunit.client.0.smithi115.stdout:2/743: mknod d3/d4d/d13/d1c/dc8/ce8 0 2024-09-13T17:05:54.653 INFO:tasks.workunit.client.1.smithi195.stdout:4/924: dread d1a/f1d [0,4194304] 0 2024-09-13T17:05:54.654 INFO:tasks.workunit.client.1.smithi195.stdout:3/741: creat d7/d21/d2a/d4a/d71/fee x:0 0 0 2024-09-13T17:05:54.656 INFO:tasks.workunit.client.1.smithi195.stdout:7/746: rename d5/db/d19/d22/d3c/fb7 to d5/db/d50/daa/f104 0 2024-09-13T17:05:54.657 INFO:tasks.workunit.client.0.smithi115.stdout:6/566: getdents d8/d13/d7b 0 2024-09-13T17:05:54.657 INFO:tasks.workunit.client.0.smithi115.stdout:6/567: stat d8/db/dd 0 2024-09-13T17:05:54.657 INFO:tasks.workunit.client.0.smithi115.stdout:6/568: fdatasync d8/d13/d15/d24/f79 0 2024-09-13T17:05:54.657 INFO:tasks.workunit.client.0.smithi115.stdout:6/569: chown d8/d33/d40/c31 3575 1 2024-09-13T17:05:54.659 INFO:tasks.workunit.client.1.smithi195.stdout:1/704: dwrite db/df/d51/d62/f6d [0,4194304] 0 2024-09-13T17:05:54.659 INFO:tasks.workunit.client.0.smithi115.stdout:6/570: write d8/d33/f55 [393265,40392] 0 2024-09-13T17:05:54.659 INFO:tasks.workunit.client.1.smithi195.stdout:2/756: mknod d0/d3/df/ce5 0 2024-09-13T17:05:54.661 INFO:tasks.workunit.client.0.smithi115.stdout:3/712: dwrite d1/d4b/d1a/fa2 [4194304,4194304] 0 2024-09-13T17:05:54.661 INFO:tasks.workunit.client.0.smithi115.stdout:3/713: fdatasync d1/d4b/fac 0 2024-09-13T17:05:54.662 INFO:tasks.workunit.client.1.smithi195.stdout:0/730: stat d7/db/d38/l6d 0 2024-09-13T17:05:54.663 INFO:tasks.workunit.client.1.smithi195.stdout:0/731: fsync d7/d87/d9b/d56/d4d/d5e/f71 0 2024-09-13T17:05:54.664 INFO:tasks.workunit.client.0.smithi115.stdout:5/480: mknod d19/d2b/d32/d55/d5e/c9d 0 2024-09-13T17:05:54.664 INFO:tasks.workunit.client.0.smithi115.stdout:5/481: chown d19/d2b/f49 0 1 2024-09-13T17:05:54.665 INFO:tasks.workunit.client.1.smithi195.stdout:4/925: mkdir d1a/d1f/d21/d22/d98/d13e 0 2024-09-13T17:05:54.666 INFO:tasks.workunit.client.1.smithi195.stdout:4/926: creat d1a/d1f/d43/d5a/d63/f13f x:0 0 0 2024-09-13T17:05:54.666 INFO:tasks.workunit.client.1.smithi195.stdout:4/927: stat d1a/d1f/d9c/dc2/ccb 0 2024-09-13T17:05:54.669 INFO:tasks.workunit.client.0.smithi115.stdout:8/529: rename d0/le to d0/d26/d29/d59/d7e/lb0 0 2024-09-13T17:05:54.673 INFO:tasks.workunit.client.1.smithi195.stdout:3/742: mknod d7/d21/d66/d7e/cef 0 2024-09-13T17:05:54.676 INFO:tasks.workunit.client.1.smithi195.stdout:9/799: dwrite d6/d12/f8a [8388608,4194304] 0 2024-09-13T17:05:54.676 INFO:tasks.workunit.client.1.smithi195.stdout:9/800: write d6/df/d16/de3/d68/d6d/fa2 [5079641,84991] 0 2024-09-13T17:05:54.677 INFO:tasks.workunit.client.1.smithi195.stdout:5/757: sync 2024-09-13T17:05:54.677 INFO:tasks.workunit.client.1.smithi195.stdout:5/758: write d2/df/d62/fb6 [5510097,27957] 0 2024-09-13T17:05:54.678 INFO:tasks.workunit.client.1.smithi195.stdout:8/789: rename d0/d17/d2f/d31/d101/d63/l8b to d0/d17/d2f/d31/d101/d63/d71/de8/l10f 0 2024-09-13T17:05:54.678 INFO:tasks.workunit.client.1.smithi195.stdout:8/790: read - d0/d13/d52/d55/fbf zero size 2024-09-13T17:05:54.679 INFO:tasks.workunit.client.0.smithi115.stdout:8/530: mkdir d0/d26/d29/d59/d7e/da7/d2b/db1 0 2024-09-13T17:05:54.679 INFO:tasks.workunit.client.0.smithi115.stdout:8/531: dread - d0/d21/d76/d83/d5a/f90 zero size 2024-09-13T17:05:54.681 INFO:tasks.workunit.client.1.smithi195.stdout:7/747: mknod d5/d13/da8/df9/c105 0 2024-09-13T17:05:54.681 INFO:tasks.workunit.client.1.smithi195.stdout:7/748: truncate d5/db/d19/fc9 964938 0 2024-09-13T17:05:54.686 INFO:tasks.workunit.client.1.smithi195.stdout:0/732: creat d7/d87/d9b/d4e/d86/fe7 x:0 0 0 2024-09-13T17:05:54.688 INFO:tasks.workunit.client.1.smithi195.stdout:4/928: mkdir d1a/d1f/d43/d5a/d63/d140 0 2024-09-13T17:05:54.689 INFO:tasks.workunit.client.1.smithi195.stdout:9/801: creat d6/d12/d86/da7/f106 x:0 0 0 2024-09-13T17:05:54.690 INFO:tasks.workunit.client.1.smithi195.stdout:5/759: mknod d2/df/d78/deb/d4e/d10/d8f/dc9/cfd 0 2024-09-13T17:05:54.691 INFO:tasks.workunit.client.1.smithi195.stdout:3/743: rename d7/d21/d2a/d35/d9c/da9/fd1 to d7/d21/d2a/d35/d60/d64/db3/dc4/ff0 0 2024-09-13T17:05:54.694 INFO:tasks.workunit.client.1.smithi195.stdout:7/749: unlink d5/db/d50/daa/lf2 0 2024-09-13T17:05:54.695 INFO:tasks.workunit.client.1.smithi195.stdout:1/705: getdents db/d58 0 2024-09-13T17:05:54.695 INFO:tasks.workunit.client.1.smithi195.stdout:0/733: mkdir d7/d50/da2/de8 0 2024-09-13T17:05:54.695 INFO:tasks.workunit.client.1.smithi195.stdout:0/734: readlink d7/d87/d9b/d4e/d68/lc6 0 2024-09-13T17:05:54.696 INFO:tasks.workunit.client.1.smithi195.stdout:4/929: unlink d1a/d1f/d43/d5a/d63/db8/dc8/cd6 0 2024-09-13T17:05:54.696 INFO:tasks.workunit.client.1.smithi195.stdout:4/930: dread - d1a/d1f/d43/d5a/d63/fec zero size 2024-09-13T17:05:54.697 INFO:tasks.workunit.client.1.smithi195.stdout:9/802: symlink d6/d19/d21/d45/dad/d5e/dd0/d61/l107 0 2024-09-13T17:05:54.697 INFO:tasks.workunit.client.1.smithi195.stdout:9/803: dread - d6/df/d72/fb9 zero size 2024-09-13T17:05:54.705 INFO:tasks.workunit.client.1.smithi195.stdout:1/706: dread db/df/d4d/fb3 [0,4194304] 0 2024-09-13T17:05:54.705 INFO:tasks.workunit.client.1.smithi195.stdout:2/757: dwrite d0/d4a/d47/d73/d75/d88/f3e [0,4194304] 0 2024-09-13T17:05:54.705 INFO:tasks.workunit.client.1.smithi195.stdout:2/758: write d0/f48 [1118706,49149] 0 2024-09-13T17:05:54.709 INFO:tasks.workunit.client.1.smithi195.stdout:1/707: dread db/d19/f79 [0,4194304] 0 2024-09-13T17:05:54.709 INFO:tasks.workunit.client.1.smithi195.stdout:1/708: chown db/f6b 4526 1 2024-09-13T17:05:54.710 INFO:tasks.workunit.client.0.smithi115.stdout:5/482: dwrite d19/f3c [0,4194304] 0 2024-09-13T17:05:54.710 INFO:tasks.workunit.client.0.smithi115.stdout:6/571: dwrite d8/f51 [4194304,4194304] 0 2024-09-13T17:05:54.711 INFO:tasks.workunit.client.0.smithi115.stdout:3/714: dwrite d1/d4b/fe0 [0,4194304] 0 2024-09-13T17:05:54.711 INFO:tasks.workunit.client.0.smithi115.stdout:3/715: fdatasync d1/d4b/d69/d7b/dbb/fda 0 2024-09-13T17:05:54.711 INFO:tasks.workunit.client.0.smithi115.stdout:8/532: dwrite d0/d18/f65 [0,4194304] 0 2024-09-13T17:05:54.715 INFO:tasks.workunit.client.1.smithi195.stdout:1/709: write db/f11 [3817346,89637] 0 2024-09-13T17:05:54.717 INFO:tasks.workunit.client.1.smithi195.stdout:1/710: dread db/d19/d5a/d66/d96/dd0/fd7 [0,4194304] 0 2024-09-13T17:05:54.717 INFO:tasks.workunit.client.1.smithi195.stdout:7/750: dwrite d5/d13/d30/f34 [0,4194304] 0 2024-09-13T17:05:54.727 INFO:tasks.workunit.client.1.smithi195.stdout:1/711: dread db/f1c [0,4194304] 0 2024-09-13T17:05:54.734 INFO:tasks.workunit.client.0.smithi115.stdout:6/572: dwrite d8/f25 [0,4194304] 0 2024-09-13T17:05:54.734 INFO:tasks.workunit.client.0.smithi115.stdout:6/573: readlink d8/d33/d82/l83 0 2024-09-13T17:05:54.798 INFO:tasks.workunit.client.1.smithi195.stdout:8/791: rename d0/ce2 to d0/d13/d52/d55/c110 0 2024-09-13T17:05:54.799 INFO:tasks.workunit.client.1.smithi195.stdout:3/744: mknod d7/d21/d2a/d35/cf1 0 2024-09-13T17:05:54.801 INFO:tasks.workunit.client.1.smithi195.stdout:4/931: mknod d1a/d1f/d43/d5a/d63/dd1/db4/c141 0 2024-09-13T17:05:54.803 INFO:tasks.workunit.client.0.smithi115.stdout:5/483: creat d19/d21/d3a/d5d/f9e x:0 0 0 2024-09-13T17:05:54.809 INFO:tasks.workunit.client.1.smithi195.stdout:4/932: write d1a/d1f/d43/d5a/d63/db8/dc8/ff2 [263935,96240] 0 2024-09-13T17:05:54.814 INFO:tasks.workunit.client.0.smithi115.stdout:5/484: write d19/d21/f80 [435349,128656] 0 2024-09-13T17:05:54.814 INFO:tasks.workunit.client.0.smithi115.stdout:3/716: rename d1/d4b/d69/db6/fc0 to d1/d4b/d69/d7b/d8b/fea 0 2024-09-13T17:05:54.815 INFO:tasks.workunit.client.0.smithi115.stdout:3/717: chown d1/d4b/d69/db6/dd2 173183693 1 2024-09-13T17:05:54.817 INFO:tasks.workunit.client.1.smithi195.stdout:2/759: symlink d0/d4a/d47/d73/d94/le6 0 2024-09-13T17:05:54.819 INFO:tasks.workunit.client.0.smithi115.stdout:8/533: mkdir d0/d42/d80/d94/db2 0 2024-09-13T17:05:54.819 INFO:tasks.workunit.client.0.smithi115.stdout:8/534: creat d0/d15/d3e/fb3 x:0 0 0 2024-09-13T17:05:54.820 INFO:tasks.workunit.client.0.smithi115.stdout:6/574: symlink d8/db/dd/lae 0 2024-09-13T17:05:54.822 INFO:tasks.workunit.client.1.smithi195.stdout:7/751: link d5/d13/da8/df9/c105 d5/db/d19/d22/c106 0 2024-09-13T17:05:54.822 INFO:tasks.workunit.client.1.smithi195.stdout:7/752: chown d5/db/d50/d7f/f80 4 1 2024-09-13T17:05:54.824 INFO:tasks.workunit.client.1.smithi195.stdout:1/712: creat db/d19/d37/d3e/dea/fef x:0 0 0 2024-09-13T17:05:54.826 INFO:tasks.workunit.client.1.smithi195.stdout:5/760: rename d2/df/d78/deb/d4e/l82 to d2/df/lfe 0 2024-09-13T17:05:54.828 INFO:tasks.workunit.client.1.smithi195.stdout:9/804: symlink d6/l108 0 2024-09-13T17:05:54.828 INFO:tasks.workunit.client.1.smithi195.stdout:2/760: dread d0/d3/f5b [0,4194304] 0 2024-09-13T17:05:54.828 INFO:tasks.workunit.client.1.smithi195.stdout:2/761: creat d0/d4a/d47/d73/d75/d88/d1e/fe7 x:0 0 0 2024-09-13T17:05:54.831 INFO:tasks.workunit.client.1.smithi195.stdout:4/933: chown d1a/d1f/d21/d84/ce0 6028 1 2024-09-13T17:05:54.834 INFO:tasks.workunit.client.1.smithi195.stdout:7/753: mknod d5/db/d50/c107 0 2024-09-13T17:05:54.835 INFO:tasks.workunit.client.1.smithi195.stdout:2/762: dread d0/faf [0,4194304] 0 2024-09-13T17:05:54.836 INFO:tasks.workunit.client.1.smithi195.stdout:1/713: mkdir db/d60/d73/df0 0 2024-09-13T17:05:54.840 INFO:tasks.workunit.client.1.smithi195.stdout:0/735: rename d7/db/d11/fae to d7/d88/d23/fe9 0 2024-09-13T17:05:54.845 INFO:tasks.workunit.client.1.smithi195.stdout:1/714: unlink db/d19/d37/fe9 0 2024-09-13T17:05:54.847 INFO:tasks.workunit.client.1.smithi195.stdout:6/676: sync 2024-09-13T17:05:54.848 INFO:tasks.workunit.client.0.smithi115.stdout:5/485: creat d19/d2b/d32/d55/d5e/f9f x:0 0 0 2024-09-13T17:05:54.850 INFO:tasks.workunit.client.1.smithi195.stdout:5/761: rename d2/df/d78/deb/f50 to d2/df/d86/fff 0 2024-09-13T17:05:54.850 INFO:tasks.workunit.client.1.smithi195.stdout:5/762: chown d2/df/d78/deb/d4e/d10/d8f/c71 1579107 1 2024-09-13T17:05:54.850 INFO:tasks.workunit.client.1.smithi195.stdout:3/745: dwrite d7/f14 [0,4194304] 0 2024-09-13T17:05:54.853 INFO:tasks.workunit.client.1.smithi195.stdout:0/736: unlink d7/d87/d9b/d4e/d68/ca3 0 2024-09-13T17:05:54.853 INFO:tasks.workunit.client.1.smithi195.stdout:0/737: stat d7/l1d 0 2024-09-13T17:05:54.853 INFO:tasks.workunit.client.1.smithi195.stdout:0/738: write d7/d50/f4c [591847,2941] 0 2024-09-13T17:05:54.853 INFO:tasks.workunit.client.1.smithi195.stdout:0/739: fdatasync d7/db/d38/f3b 0 2024-09-13T17:05:54.853 INFO:tasks.workunit.client.1.smithi195.stdout:0/740: chown d7/db/d38/d5d/f7f 5696 1 2024-09-13T17:05:54.854 INFO:tasks.workunit.client.0.smithi115.stdout:8/535: unlink d0/d18/d51/c91 0 2024-09-13T17:05:54.854 INFO:tasks.workunit.client.0.smithi115.stdout:8/536: fdatasync d0/d21/d76/d83/d5a/f90 0 2024-09-13T17:05:54.854 INFO:tasks.workunit.client.0.smithi115.stdout:8/537: write d0/d21/f4a [560152,28000] 0 2024-09-13T17:05:54.855 INFO:tasks.workunit.client.1.smithi195.stdout:1/715: rename db/l8f to db/d19/d5a/d66/lf1 0 2024-09-13T17:05:54.856 INFO:tasks.workunit.client.0.smithi115.stdout:5/486: creat d19/d2b/d32/d55/d5e/d87/fa0 x:0 0 0 2024-09-13T17:05:54.857 INFO:tasks.workunit.client.1.smithi195.stdout:5/763: creat d2/df/d78/deb/d3f/dfa/f100 x:0 0 0 2024-09-13T17:05:54.858 INFO:tasks.workunit.client.1.smithi195.stdout:3/746: symlink d7/d21/d2a/d35/d60/db0/lf2 0 2024-09-13T17:05:54.859 INFO:tasks.workunit.client.0.smithi115.stdout:8/538: link d0/d15/d3e/f47 d0/d26/d29/d59/d7e/da7/d2b/d3b/fb4 0 2024-09-13T17:05:54.859 INFO:tasks.workunit.client.0.smithi115.stdout:8/539: write d0/d21/f4a [4084375,54593] 0 2024-09-13T17:05:54.860 INFO:tasks.workunit.client.0.smithi115.stdout:5/487: truncate d19/d2b/f49 411144 0 2024-09-13T17:05:54.862 INFO:tasks.workunit.client.1.smithi195.stdout:0/741: link d7/db/d9a/cb3 d7/d87/d9b/d4e/cea 0 2024-09-13T17:05:54.863 INFO:tasks.workunit.client.1.smithi195.stdout:5/764: rename d2/df/d78/d54/d58/f69 to d2/df/d78/d54/de5/f101 0 2024-09-13T17:05:54.863 INFO:tasks.workunit.client.1.smithi195.stdout:0/742: dread d7/d50/f67 [0,4194304] 0 2024-09-13T17:05:54.864 INFO:tasks.workunit.client.0.smithi115.stdout:8/540: getdents d0/d95 0 2024-09-13T17:05:54.864 INFO:tasks.workunit.client.1.smithi195.stdout:3/747: mknod d7/d21/d2a/d35/d9c/cf3 0 2024-09-13T17:05:54.865 INFO:tasks.workunit.client.1.smithi195.stdout:8/792: dwrite d0/d17/d2f/d7c/ffb [0,4194304] 0 2024-09-13T17:05:54.865 INFO:tasks.workunit.client.0.smithi115.stdout:5/488: unlink d19/d21/l35 0 2024-09-13T17:05:54.867 INFO:tasks.workunit.client.1.smithi195.stdout:0/743: rename d7/d88/fe to d7/d88/d7c/feb 0 2024-09-13T17:05:54.869 INFO:tasks.workunit.client.1.smithi195.stdout:5/765: creat d2/df/d78/deb/d4e/d10/d5c/da1/f102 x:0 0 0 2024-09-13T17:05:54.869 INFO:tasks.workunit.client.1.smithi195.stdout:5/766: fdatasync d2/d88/fa8 0 2024-09-13T17:05:54.869 INFO:tasks.workunit.client.1.smithi195.stdout:5/767: creat d2/df/d78/deb/d4e/d10/d46/f103 x:0 0 0 2024-09-13T17:05:54.869 INFO:tasks.workunit.client.1.smithi195.stdout:5/768: dread - d2/df/d78/ff2 zero size 2024-09-13T17:05:54.870 INFO:tasks.workunit.client.0.smithi115.stdout:5/489: mknod d19/d2b/ca1 0 2024-09-13T17:05:54.870 INFO:tasks.workunit.client.0.smithi115.stdout:5/490: write d19/d2e/f5c [4327966,89614] 0 2024-09-13T17:05:54.870 INFO:tasks.workunit.client.0.smithi115.stdout:5/491: write d19/d2b/d32/f45 [1012858,117175] 0 2024-09-13T17:05:54.870 INFO:tasks.workunit.client.0.smithi115.stdout:5/492: creat d19/fa2 x:0 0 0 2024-09-13T17:05:54.870 INFO:tasks.workunit.client.0.smithi115.stdout:5/493: creat d19/d2b/d32/d55/d5e/d87/fa3 x:0 0 0 2024-09-13T17:05:54.872 INFO:tasks.workunit.client.1.smithi195.stdout:8/793: getdents d0/d17/d2f 0 2024-09-13T17:05:54.876 INFO:tasks.workunit.client.0.smithi115.stdout:5/494: truncate d19/f53 616004 0 2024-09-13T17:05:54.877 INFO:tasks.workunit.client.0.smithi115.stdout:3/718: dwrite d1/d4b/fac [4194304,4194304] 0 2024-09-13T17:05:54.877 INFO:tasks.workunit.client.1.smithi195.stdout:5/769: unlink d2/df/d78/d54/c57 0 2024-09-13T17:05:54.877 INFO:tasks.workunit.client.1.smithi195.stdout:5/770: dread - d2/df/d48/fe2 zero size 2024-09-13T17:05:54.879 INFO:tasks.workunit.client.1.smithi195.stdout:8/794: creat d0/d17/d2f/d31/d101/d63/db3/dc9/f111 x:0 0 0 2024-09-13T17:05:54.879 INFO:tasks.workunit.client.0.smithi115.stdout:5/495: truncate d19/d21/d62/f68 1620732 0 2024-09-13T17:05:54.881 INFO:tasks.workunit.client.1.smithi195.stdout:0/744: write d7/d87/d9b/d56/d46/f6e [1001298,106189] 0 2024-09-13T17:05:54.884 INFO:tasks.workunit.client.0.smithi115.stdout:3/719: mkdir d1/d4b/d69/d7b/d8b/d90/deb 0 2024-09-13T17:05:54.884 INFO:tasks.workunit.client.0.smithi115.stdout:3/720: creat d1/d4b/fec x:0 0 0 2024-09-13T17:05:54.885 INFO:tasks.workunit.client.0.smithi115.stdout:5/496: mkdir d19/d2b/d32/d55/d5e/d87/da4 0 2024-09-13T17:05:54.885 INFO:tasks.workunit.client.0.smithi115.stdout:5/497: read d19/d21/f4a [1182211,84611] 0 2024-09-13T17:05:54.886 INFO:tasks.workunit.client.1.smithi195.stdout:0/745: rename d7/db/c60 to d7/db/d9a/dd6/cec 0 2024-09-13T17:05:54.887 INFO:tasks.workunit.client.1.smithi195.stdout:0/746: getdents d7/d88/d23/dd5 0 2024-09-13T17:05:54.887 INFO:tasks.workunit.client.1.smithi195.stdout:0/747: write d7/d50/f67 [189386,69880] 0 2024-09-13T17:05:54.893 INFO:tasks.workunit.client.1.smithi195.stdout:0/748: mkdir d7/d88/d23/d96/ded 0 2024-09-13T17:05:54.895 INFO:tasks.workunit.client.1.smithi195.stdout:0/749: write d7/d88/d23/f35 [4382240,98731] 0 2024-09-13T17:05:54.895 INFO:tasks.workunit.client.0.smithi115.stdout:5/498: mkdir d19/d21/d3a/d5d/da5 0 2024-09-13T17:05:54.895 INFO:tasks.workunit.client.0.smithi115.stdout:5/499: chown d19/d21/d62/d63 1 1 2024-09-13T17:05:54.896 INFO:tasks.workunit.client.1.smithi195.stdout:0/750: rmdir d7 39 2024-09-13T17:05:54.898 INFO:tasks.workunit.client.1.smithi195.stdout:0/751: symlink d7/d87/d9b/d56/d46/da4/lee 0 2024-09-13T17:05:54.898 INFO:tasks.workunit.client.1.smithi195.stdout:0/752: write d7/d87/d9b/fd2 [1043138,101004] 0 2024-09-13T17:05:54.906 INFO:tasks.workunit.client.0.smithi115.stdout:0/337: sync 2024-09-13T17:05:54.906 INFO:tasks.workunit.client.0.smithi115.stdout:4/638: sync 2024-09-13T17:05:54.906 INFO:tasks.workunit.client.0.smithi115.stdout:4/639: stat d7/dd/d3c/d72/db3/fb8 0 2024-09-13T17:05:54.906 INFO:tasks.workunit.client.0.smithi115.stdout:0/338: write d9/d1d/d24/d26/f55 [9175791,59420] 0 2024-09-13T17:05:54.907 INFO:tasks.workunit.client.0.smithi115.stdout:6/575: dwrite d8/d33/d40/d4c/f91 [0,4194304] 0 2024-09-13T17:05:54.907 INFO:tasks.workunit.client.0.smithi115.stdout:4/640: creat d7/dd/de/d4e/d5a/d4f/d53/fc4 x:0 0 0 2024-09-13T17:05:54.909 INFO:tasks.workunit.client.0.smithi115.stdout:0/339: dread d9/f17 [0,4194304] 0 2024-09-13T17:05:54.909 INFO:tasks.workunit.client.0.smithi115.stdout:4/641: creat d7/dd/de/d4e/dae/fc5 x:0 0 0 2024-09-13T17:05:54.910 INFO:tasks.workunit.client.0.smithi115.stdout:6/576: link d8/db/d1d/fa1 d8/db/faf 0 2024-09-13T17:05:54.911 INFO:tasks.workunit.client.0.smithi115.stdout:0/340: truncate d9/d1b/f34 6919492 0 2024-09-13T17:05:54.913 INFO:tasks.workunit.client.0.smithi115.stdout:4/642: creat d7/dd/de/d4e/d5a/d4f/d70/db6/fc6 x:0 0 0 2024-09-13T17:05:54.914 INFO:tasks.workunit.client.0.smithi115.stdout:6/577: mkdir d8/d33/d82/db0 0 2024-09-13T17:05:54.915 INFO:tasks.workunit.client.0.smithi115.stdout:4/643: link d7/dbe/f6a d7/dd/de/d4e/d6c/fc7 0 2024-09-13T17:05:54.916 INFO:tasks.workunit.client.0.smithi115.stdout:6/578: unlink d8/d33/d40/d4c/d66/ca8 0 2024-09-13T17:05:54.917 INFO:tasks.workunit.client.0.smithi115.stdout:4/644: mkdir d7/dd/de/d4e/d9f/dc8 0 2024-09-13T17:05:54.918 INFO:tasks.workunit.client.1.smithi195.stdout:4/934: dwrite d1a/d1f/d21/f135 [0,4194304] 0 2024-09-13T17:05:54.918 INFO:tasks.workunit.client.0.smithi115.stdout:6/579: rename d8/d13/d15/la6 to d8/d13/d15/d24/d17/lb1 0 2024-09-13T17:05:54.919 INFO:tasks.workunit.client.0.smithi115.stdout:4/645: truncate d7/dd/d3c/f3e 2654256 0 2024-09-13T17:05:54.920 INFO:tasks.workunit.client.0.smithi115.stdout:4/646: fdatasync d7/dd/de/f61 0 2024-09-13T17:05:54.920 INFO:tasks.workunit.client.0.smithi115.stdout:4/647: fdatasync d7/dd/de/f61 0 2024-09-13T17:05:54.920 INFO:tasks.workunit.client.0.smithi115.stdout:4/648: fdatasync d7/dd/de/f5c 0 2024-09-13T17:05:54.920 INFO:tasks.workunit.client.0.smithi115.stdout:4/649: write d7/dd/da0/fbc [546504,28659] 0 2024-09-13T17:05:54.921 INFO:tasks.workunit.client.0.smithi115.stdout:6/580: unlink d8/d33/f55 0 2024-09-13T17:05:54.923 INFO:tasks.workunit.client.0.smithi115.stdout:6/581: creat d8/d13/d15/d24/d17/d9b/fb2 x:0 0 0 2024-09-13T17:05:54.923 INFO:tasks.workunit.client.0.smithi115.stdout:6/582: read - d8/db/f5d zero size 2024-09-13T17:05:54.924 INFO:tasks.workunit.client.0.smithi115.stdout:6/583: unlink d8/d13/f19 0 2024-09-13T17:05:54.927 INFO:tasks.workunit.client.0.smithi115.stdout:0/341: dwrite d9/d1d/d24/d26/d36/d48/f4c [0,4194304] 0 2024-09-13T17:05:54.928 INFO:tasks.workunit.client.0.smithi115.stdout:6/584: dread d8/d33/d40/f5c [0,4194304] 0 2024-09-13T17:05:54.929 INFO:tasks.workunit.client.0.smithi115.stdout:0/342: creat d9/f5f x:0 0 0 2024-09-13T17:05:54.933 INFO:tasks.workunit.client.1.smithi195.stdout:4/935: write d1a/d1f/d43/f3d [1615566,4655] 0 2024-09-13T17:05:54.933 INFO:tasks.workunit.client.1.smithi195.stdout:4/936: chown d1a/d1f/d9c/dc2/c102 0 1 2024-09-13T17:05:54.933 INFO:tasks.workunit.client.1.smithi195.stdout:4/937: stat f16 0 2024-09-13T17:05:54.938 INFO:tasks.workunit.client.1.smithi195.stdout:6/677: dwrite fd [4194304,4194304] 0 2024-09-13T17:05:54.938 INFO:tasks.workunit.client.1.smithi195.stdout:3/748: dwrite d7/d21/d2a/d4a/f6e [4194304,4194304] 0 2024-09-13T17:05:54.939 INFO:tasks.workunit.client.1.smithi195.stdout:3/749: fsync d7/d67/f6c 0 2024-09-13T17:05:54.939 INFO:tasks.workunit.client.1.smithi195.stdout:3/750: read d7/d21/d2a/d4a/fc3 [2648220,36151] 0 2024-09-13T17:05:54.940 INFO:tasks.workunit.client.0.smithi115.stdout:8/541: dwrite d0/d21/d76/d83/fab [0,4194304] 0 2024-09-13T17:05:54.940 INFO:tasks.workunit.client.1.smithi195.stdout:2/763: dwrite d0/d3/fe [0,4194304] 0 2024-09-13T17:05:54.940 INFO:tasks.workunit.client.1.smithi195.stdout:7/754: dwrite d5/db/d50/d7f/d82/dad/fb2 [0,4194304] 0 2024-09-13T17:05:54.942 INFO:tasks.workunit.client.1.smithi195.stdout:7/755: readlink d5/d35/l3b 0 2024-09-13T17:05:54.942 INFO:tasks.workunit.client.1.smithi195.stdout:8/795: dwrite d0/d17/d2f/d7c/ffb [0,4194304] 0 2024-09-13T17:05:54.942 INFO:tasks.workunit.client.1.smithi195.stdout:8/796: chown d0/d13/d52/d55 13420656 1 2024-09-13T17:05:54.942 INFO:tasks.workunit.client.1.smithi195.stdout:8/797: readlink d0/d17/d2f/d7c/l8a 0 2024-09-13T17:05:54.942 INFO:tasks.workunit.client.1.smithi195.stdout:8/798: truncate d0/d17/d2f/d7c/f48 4251637 0 2024-09-13T17:05:54.942 INFO:tasks.workunit.client.1.smithi195.stdout:5/771: dwrite d2/df/d78/deb/d4e/d74/fc3 [0,4194304] 0 2024-09-13T17:05:54.942 INFO:tasks.workunit.client.1.smithi195.stdout:6/678: mknod d1c/d24/d7f/dad/db9/d8c/dd1/ce3 0 2024-09-13T17:05:54.942 INFO:tasks.workunit.client.1.smithi195.stdout:5/772: creat d2/df/d78/deb/d4e/d10/d46/f104 x:0 0 0 2024-09-13T17:05:54.942 INFO:tasks.workunit.client.1.smithi195.stdout:6/679: write d1c/d24/d7f/dad/db9/d30/d6f/fdf [726796,86496] 0 2024-09-13T17:05:54.942 INFO:tasks.workunit.client.1.smithi195.stdout:6/680: chown d1c/d24/d49/d5f/db1/dcd 221964 1 2024-09-13T17:05:54.945 INFO:tasks.workunit.client.1.smithi195.stdout:3/751: rename d7/d21/d2a/d35/fa3 to d7/d21/d2a/d35/d60/d6f/dbf/ff4 0 2024-09-13T17:05:54.945 INFO:tasks.workunit.client.0.smithi115.stdout:6/585: write d8/d33/d82/f43 [5009057,111448] 0 2024-09-13T17:05:54.947 INFO:tasks.workunit.client.0.smithi115.stdout:0/343: dread d9/d1d/f39 [0,4194304] 0 2024-09-13T17:05:54.949 INFO:tasks.workunit.client.1.smithi195.stdout:7/756: mknod d5/db/d50/d7f/d82/dcc/c108 0 2024-09-13T17:05:54.950 INFO:tasks.workunit.client.0.smithi115.stdout:8/542: creat d0/d26/d29/d59/d7e/da7/d28/d71/fb5 x:0 0 0 2024-09-13T17:05:54.953 INFO:tasks.workunit.client.1.smithi195.stdout:8/799: write d0/d17/d2f/d31/f3f [1375944,8635] 0 2024-09-13T17:05:54.965 INFO:tasks.workunit.client.0.smithi115.stdout:6/586: mkdir d8/db/dd/da2/db3 0 2024-09-13T17:05:54.969 INFO:tasks.workunit.client.0.smithi115.stdout:8/543: dread d0/d15/d3e/f41 [0,4194304] 0 2024-09-13T17:05:54.971 INFO:tasks.workunit.client.0.smithi115.stdout:0/344: rename d9/c14 to d9/d1d/d24/d26/d2d/d30/d46/c60 0 2024-09-13T17:05:54.973 INFO:tasks.workunit.client.0.smithi115.stdout:8/544: mkdir d0/d95/db6 0 2024-09-13T17:05:54.977 INFO:tasks.workunit.client.0.smithi115.stdout:0/345: link d9/d1d/d24/d26/f45 d9/d1b/f61 0 2024-09-13T17:05:54.978 INFO:tasks.workunit.client.1.smithi195.stdout:5/773: symlink d2/df/d78/deb/d3f/l105 0 2024-09-13T17:05:54.982 INFO:tasks.workunit.client.1.smithi195.stdout:7/757: symlink d5/db/d19/d22/d3c/l109 0 2024-09-13T17:05:54.986 INFO:tasks.workunit.client.0.smithi115.stdout:5/500: rmdir d19/d21/d62 39 2024-09-13T17:05:54.986 INFO:tasks.workunit.client.0.smithi115.stdout:5/501: fdatasync d19/d2b/f44 0 2024-09-13T17:05:54.993 INFO:tasks.workunit.client.0.smithi115.stdout:5/502: mkdir d19/d2b/d32/d55/d5e/d87/da4/da6 0 2024-09-13T17:05:54.996 INFO:tasks.workunit.client.1.smithi195.stdout:0/753: rmdir d7/d87/d9b/d56 39 2024-09-13T17:05:54.996 INFO:tasks.workunit.client.1.smithi195.stdout:0/754: write d7/d87/d9b/d56/d4d/d5e/f85 [1267813,8516] 0 2024-09-13T17:05:54.998 INFO:tasks.workunit.client.1.smithi195.stdout:0/755: rename d7/d88/cb9 to d7/d88/d23/d96/cef 0 2024-09-13T17:05:54.999 INFO:tasks.workunit.client.0.smithi115.stdout:0/346: dread d9/d1d/d24/d26/f55 [4194304,4194304] 0 2024-09-13T17:05:54.999 INFO:tasks.workunit.client.0.smithi115.stdout:0/347: creat d9/d1d/d24/d26/d36/f62 x:0 0 0 2024-09-13T17:05:55.001 INFO:tasks.workunit.client.0.smithi115.stdout:0/348: symlink d9/d1d/d24/d26/d5d/l63 0 2024-09-13T17:05:55.002 INFO:tasks.workunit.client.0.smithi115.stdout:5/503: write d19/d2b/d32/d55/f4c [2089848,68294] 0 2024-09-13T17:05:55.003 INFO:tasks.workunit.client.0.smithi115.stdout:0/349: creat d9/d1d/d24/d26/f64 x:0 0 0 2024-09-13T17:05:55.005 INFO:tasks.workunit.client.0.smithi115.stdout:0/350: dread d9/d1d/d24/d26/d2d/d30/d46/f53 [0,4194304] 0 2024-09-13T17:05:55.006 INFO:tasks.workunit.client.0.smithi115.stdout:5/504: mkdir d19/d2c/da7 0 2024-09-13T17:05:55.009 INFO:tasks.workunit.client.0.smithi115.stdout:0/351: link d9/d1d/d24/d26/d2d/c43 d9/d1d/d24/d26/d2d/d30/d5c/c65 0 2024-09-13T17:05:55.010 INFO:tasks.workunit.client.0.smithi115.stdout:5/505: creat d19/d2b/fa8 x:0 0 0 2024-09-13T17:05:55.013 INFO:tasks.workunit.client.0.smithi115.stdout:0/352: getdents d9/d1d/d24/d26/d36/d48 0 2024-09-13T17:05:55.016 INFO:tasks.workunit.client.0.smithi115.stdout:0/353: mkdir d9/d1d/d24/d26/d5d/d66 0 2024-09-13T17:05:55.018 INFO:tasks.workunit.client.0.smithi115.stdout:5/506: dread fd [0,4194304] 0 2024-09-13T17:05:55.022 INFO:tasks.workunit.client.0.smithi115.stdout:5/507: creat d19/d2b/d32/d55/d5e/d87/da4/fa9 x:0 0 0 2024-09-13T17:05:55.022 INFO:tasks.workunit.client.0.smithi115.stdout:5/508: truncate d19/d2b/d32/d55/f94 1022197 0 2024-09-13T17:05:55.023 INFO:tasks.workunit.client.0.smithi115.stdout:6/587: rename d8/d13/d15 to d8/d33/d40/d67/db4 0 2024-09-13T17:05:55.061 INFO:tasks.workunit.client.1.smithi195.stdout:4/938: dwrite d1a/d1f/d43/fce [0,4194304] 0 2024-09-13T17:05:55.062 INFO:tasks.workunit.client.1.smithi195.stdout:6/681: dwrite d1c/d24/d49/f65 [0,4194304] 0 2024-09-13T17:05:55.062 INFO:tasks.workunit.client.1.smithi195.stdout:2/764: dwrite d0/d4a/d47/d73/d75/d88/d8e/fdf [0,4194304] 0 2024-09-13T17:05:55.062 INFO:tasks.workunit.client.1.smithi195.stdout:3/752: dwrite d7/d21/d2a/d4a/fbe [0,4194304] 0 2024-09-13T17:05:55.062 INFO:tasks.workunit.client.1.smithi195.stdout:3/753: fdatasync d7/d21/d2a/d35/d60/d64/f78 0 2024-09-13T17:05:55.063 INFO:tasks.workunit.client.1.smithi195.stdout:7/758: dwrite d5/db/d19/d22/d3c/fa6 [0,4194304] 0 2024-09-13T17:05:55.063 INFO:tasks.workunit.client.0.smithi115.stdout:3/721: dwrite d1/d4b/f21 [0,4194304] 0 2024-09-13T17:05:55.063 INFO:tasks.workunit.client.0.smithi115.stdout:8/545: dwrite d0/d15/d3e/fad [0,4194304] 0 2024-09-13T17:05:55.065 INFO:tasks.workunit.client.1.smithi195.stdout:3/754: dread d7/d5f/f82 [0,4194304] 0 2024-09-13T17:05:55.065 INFO:tasks.workunit.client.1.smithi195.stdout:3/755: creat d7/d62/ff5 x:0 0 0 2024-09-13T17:05:55.066 INFO:tasks.workunit.client.1.smithi195.stdout:4/939: creat d1a/d1f/d43/d24/d13a/f142 x:0 0 0 2024-09-13T17:05:55.067 INFO:tasks.workunit.client.1.smithi195.stdout:4/940: write d1a/d1f/fe2 [120252,34355] 0 2024-09-13T17:05:55.069 INFO:tasks.workunit.client.1.smithi195.stdout:8/800: dwrite d0/d17/d2f/d31/d101/d63/d71/de8/df6/df1/ff5 [0,4194304] 0 2024-09-13T17:05:55.069 INFO:tasks.workunit.client.0.smithi115.stdout:6/588: dwrite d8/db/d1d/f26 [0,4194304] 0 2024-09-13T17:05:55.070 INFO:tasks.workunit.client.0.smithi115.stdout:6/589: write d8/d33/d40/f5c [2000040,103040] 0 2024-09-13T17:05:55.070 INFO:tasks.workunit.client.0.smithi115.stdout:5/509: dwrite f16 [0,4194304] 0 2024-09-13T17:05:55.070 INFO:tasks.workunit.client.1.smithi195.stdout:8/801: dread d0/d4/f7f [0,4194304] 0 2024-09-13T17:05:55.072 INFO:tasks.workunit.client.0.smithi115.stdout:3/722: write d1/d4b/f76 [1583050,91542] 0 2024-09-13T17:05:55.074 INFO:tasks.workunit.client.0.smithi115.stdout:8/546: link d0/d26/d29/d59/d7e/da7/d2b/l62 d0/d21/d3a/da3/lb7 0 2024-09-13T17:05:55.074 INFO:tasks.workunit.client.0.smithi115.stdout:8/547: truncate d0/d21/f96 352717 0 2024-09-13T17:05:55.076 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:54 smithi195 ceph-mon[34981]: pgmap v16: 65 pgs: 65 active+clean; 2.0 GiB data, 5.9 GiB used, 531 GiB / 536 GiB avail; 216 MiB/s rd, 278 MiB/s wr, 409 op/s 2024-09-13T17:05:55.078 INFO:tasks.workunit.client.0.smithi115.stdout:6/590: creat d8/db/dd/da2/db3/fb5 x:0 0 0 2024-09-13T17:05:55.078 INFO:tasks.workunit.client.0.smithi115.stdout:6/591: fdatasync d8/d33/d82/f43 0 2024-09-13T17:05:55.080 INFO:tasks.workunit.client.0.smithi115.stdout:5/510: mknod d19/d2b/d32/caa 0 2024-09-13T17:05:55.080 INFO:tasks.workunit.client.0.smithi115.stdout:5/511: write d19/d2b/d32/d55/d5e/f9f [389961,58833] 0 2024-09-13T17:05:55.080 INFO:tasks.workunit.client.1.smithi195.stdout:9/805: sync 2024-09-13T17:05:55.082 INFO:tasks.workunit.client.1.smithi195.stdout:6/682: dwrite d1c/d24/d7f/dad/db9/d5e/fb5 [0,4194304] 0 2024-09-13T17:05:55.082 INFO:tasks.workunit.client.1.smithi195.stdout:6/683: write f17 [4726149,100250] 0 2024-09-13T17:05:55.082 INFO:tasks.workunit.client.1.smithi195.stdout:6/684: fdatasync d1c/fa1 0 2024-09-13T17:05:55.082 INFO:tasks.workunit.client.1.smithi195.stdout:6/685: dread - d1c/d24/d7f/dad/fce zero size 2024-09-13T17:05:55.083 INFO:tasks.workunit.client.1.smithi195.stdout:7/759: mkdir d5/db/d50/d7f/d10a 0 2024-09-13T17:05:55.084 INFO:tasks.workunit.client.0.smithi115.stdout:3/723: mknod d1/d4b/d69/d7b/d8b/ced 0 2024-09-13T17:05:55.088 INFO:tasks.workunit.client.0.smithi115.stdout:6/592: chown d8/d33/d40/d4c/l68 1 1 2024-09-13T17:05:55.090 INFO:tasks.workunit.client.1.smithi195.stdout:3/756: rename d7/d21/d2a/deb to d7/d21/d2a/d35/d9c/df6 0 2024-09-13T17:05:55.090 INFO:tasks.workunit.client.0.smithi115.stdout:5/512: symlink d19/d2b/d32/d55/d5e/d87/da4/lab 0 2024-09-13T17:05:55.092 INFO:tasks.workunit.client.1.smithi195.stdout:0/756: unlink d7/d50/f21 0 2024-09-13T17:05:55.092 INFO:tasks.workunit.client.1.smithi195.stdout:0/757: write d7/d87/d9b/d56/fc5 [1043838,65896] 0 2024-09-13T17:05:55.092 INFO:tasks.workunit.client.1.smithi195.stdout:0/758: truncate d7/d87/d9b/d56/d4d/f66 1059155 0 2024-09-13T17:05:55.092 INFO:tasks.workunit.client.1.smithi195.stdout:0/759: read - d7/db/fdf zero size 2024-09-13T17:05:55.092 INFO:tasks.workunit.client.1.smithi195.stdout:0/760: stat d7/d88/c47 0 2024-09-13T17:05:55.093 INFO:tasks.workunit.client.1.smithi195.stdout:0/761: chown d7/d87/d9b/d56/d46/da4/fac 29276792 1 2024-09-13T17:05:55.093 INFO:tasks.workunit.client.1.smithi195.stdout:4/941: mknod d1a/d1f/d43/d24/d41/c143 0 2024-09-13T17:05:55.095 INFO:tasks.workunit.client.0.smithi115.stdout:3/724: symlink d1/d83/lee 0 2024-09-13T17:05:55.095 INFO:tasks.workunit.client.0.smithi115.stdout:3/725: fsync d1/f1d 0 2024-09-13T17:05:55.099 INFO:tasks.workunit.client.0.smithi115.stdout:8/548: getdents d0/d21/d76 0 2024-09-13T17:05:55.099 INFO:tasks.workunit.client.0.smithi115.stdout:8/549: stat d0/d18/f65 0 2024-09-13T17:05:55.100 INFO:tasks.workunit.client.0.smithi115.stdout:6/593: symlink d8/d33/d40/d67/db4/d24/lb6 0 2024-09-13T17:05:55.101 INFO:tasks.workunit.client.0.smithi115.stdout:3/726: dread d1/d4b/d69/d7b/f9f [0,4194304] 0 2024-09-13T17:05:55.101 INFO:tasks.workunit.client.0.smithi115.stdout:3/727: creat d1/d83/fef x:0 0 0 2024-09-13T17:05:55.103 INFO:tasks.workunit.client.0.smithi115.stdout:8/550: mknod d0/d26/d29/d59/d7e/da7/d28/d71/cb8 0 2024-09-13T17:05:55.103 INFO:tasks.workunit.client.0.smithi115.stdout:8/551: dread - d0/d21/d3a/d60/fa2 zero size 2024-09-13T17:05:55.103 INFO:tasks.workunit.client.0.smithi115.stdout:0/354: rmdir d9 39 2024-09-13T17:05:55.105 INFO:tasks.workunit.client.0.smithi115.stdout:6/594: symlink d8/d33/d40/d67/db4/d24/d53/d6a/lb7 0 2024-09-13T17:05:55.106 INFO:tasks.workunit.client.1.smithi195.stdout:8/802: symlink d0/d17/d2f/d31/d101/d63/l112 0 2024-09-13T17:05:55.108 INFO:tasks.workunit.client.1.smithi195.stdout:9/806: mkdir d6/df/d16/de3/d68/d109 0 2024-09-13T17:05:55.110 INFO:tasks.workunit.client.0.smithi115.stdout:1/451: sync 2024-09-13T17:05:55.110 INFO:tasks.workunit.client.0.smithi115.stdout:9/372: sync 2024-09-13T17:05:55.111 INFO:tasks.workunit.client.0.smithi115.stdout:5/513: dwrite d19/d2b/d77/f79 [0,4194304] 0 2024-09-13T17:05:55.111 INFO:tasks.workunit.client.0.smithi115.stdout:3/728: creat d1/d12/d14/d61/ff0 x:0 0 0 2024-09-13T17:05:55.111 INFO:tasks.workunit.client.0.smithi115.stdout:3/729: truncate d1/d4b/d1a/d6e/fc9 786131 0 2024-09-13T17:05:55.113 INFO:tasks.workunit.client.0.smithi115.stdout:8/552: creat d0/d18/fb9 x:0 0 0 2024-09-13T17:05:55.114 INFO:tasks.workunit.client.0.smithi115.stdout:6/595: symlink d8/d33/d40/d67/db4/d24/lb8 0 2024-09-13T17:05:55.120 INFO:tasks.workunit.client.0.smithi115.stdout:1/452: creat d5/d7/d33/f9d x:0 0 0 2024-09-13T17:05:55.125 INFO:tasks.workunit.client.1.smithi195.stdout:3/757: rename d7/d5f/l99 to d7/d21/d2a/d4a/lf7 0 2024-09-13T17:05:55.126 INFO:tasks.workunit.client.0.smithi115.stdout:5/514: dread d19/d2b/d32/d55/f4c [0,4194304] 0 2024-09-13T17:05:55.127 INFO:tasks.workunit.client.1.smithi195.stdout:0/762: mkdir d7/db/d11/db5/df0 0 2024-09-13T17:05:55.129 INFO:tasks.workunit.client.0.smithi115.stdout:1/453: write d5/d7/d5c/d73/f81 [488596,31840] 0 2024-09-13T17:05:55.130 INFO:tasks.workunit.client.0.smithi115.stdout:8/553: creat d0/d42/d80/d94/fba x:0 0 0 2024-09-13T17:05:55.131 INFO:tasks.workunit.client.1.smithi195.stdout:4/942: symlink d1a/d1f/d108/d10b/l144 0 2024-09-13T17:05:55.131 INFO:tasks.workunit.client.1.smithi195.stdout:4/943: fsync d1a/f2d 0 2024-09-13T17:05:55.131 INFO:tasks.workunit.client.1.smithi195.stdout:4/944: write d1a/d1f/fe4 [306612,62094] 0 2024-09-13T17:05:55.133 INFO:tasks.workunit.client.1.smithi195.stdout:8/803: mkdir d0/d13/db9/d113 0 2024-09-13T17:05:55.134 INFO:tasks.workunit.client.1.smithi195.stdout:9/807: symlink d6/df/d16/de3/l10a 0 2024-09-13T17:05:55.141 INFO:tasks.workunit.client.1.smithi195.stdout:6/686: rmdir d1c/d24/d49/d5f/d85/d8f 39 2024-09-13T17:05:55.141 INFO:tasks.workunit.client.1.smithi195.stdout:8/804: dread d0/d17/d2f/d31/f53 [0,4194304] 0 2024-09-13T17:05:55.141 INFO:tasks.workunit.client.1.smithi195.stdout:8/805: creat d0/d4/f114 x:0 0 0 2024-09-13T17:05:55.144 INFO:tasks.workunit.client.0.smithi115.stdout:3/730: rmdir d1/d4b/d69 39 2024-09-13T17:05:55.144 INFO:tasks.workunit.client.0.smithi115.stdout:3/731: write d1/d83/d9d/dba/fd3 [806324,22] 0 2024-09-13T17:05:55.144 INFO:tasks.workunit.client.0.smithi115.stdout:3/732: fdatasync d1/d4b/d1a/f27 0 2024-09-13T17:05:55.144 INFO:tasks.workunit.client.0.smithi115.stdout:3/733: fsync d1/d4b/d69/d7b/fdf 0 2024-09-13T17:05:55.144 INFO:tasks.workunit.client.1.smithi195.stdout:1/716: sync 2024-09-13T17:05:55.145 INFO:tasks.workunit.client.1.smithi195.stdout:7/760: truncate d5/db/d19/d22/d3c/fa6 3736757 0 2024-09-13T17:05:55.146 INFO:tasks.workunit.client.1.smithi195.stdout:0/763: dread d7/d88/d23/f25 [0,4194304] 0 2024-09-13T17:05:55.146 INFO:tasks.workunit.client.1.smithi195.stdout:0/764: write d7/d87/d9b/d4e/d68/f9f [4767016,80361] 0 2024-09-13T17:05:55.146 INFO:tasks.workunit.client.0.smithi115.stdout:1/454: link d5/d3e/d59/f76 d5/d60/d7d/d87/f9e 0 2024-09-13T17:05:55.149 INFO:tasks.workunit.client.1.smithi195.stdout:4/945: link d1a/d1f/d43/d5a/f81 d1a/d1f/d21/d84/d9d/d8e/d9f/db2/dfd/f145 0 2024-09-13T17:05:55.149 INFO:tasks.workunit.client.1.smithi195.stdout:4/946: dread - d1a/d1f/d43/d24/d41/d60/fba zero size 2024-09-13T17:05:55.149 INFO:tasks.workunit.client.1.smithi195.stdout:4/947: chown d1a/d1f/c39 0 1 2024-09-13T17:05:55.149 INFO:tasks.workunit.client.1.smithi195.stdout:4/948: write d1a/d1f/d43/d24/d41/ff9 [469693,42730] 0 2024-09-13T17:05:55.151 INFO:tasks.workunit.client.1.smithi195.stdout:9/808: rename d6/d19/df7 to d6/d12/d86/dd2/de1/d10b 0 2024-09-13T17:05:55.152 INFO:tasks.workunit.client.0.smithi115.stdout:6/596: link d8/d33/f61 d8/d33/d40/d4c/d66/fb9 0 2024-09-13T17:05:55.154 INFO:tasks.workunit.client.1.smithi195.stdout:6/687: mknod d1c/d3e/d6b/ce4 0 2024-09-13T17:05:55.156 INFO:tasks.workunit.client.0.smithi115.stdout:9/373: dwrite d0/d21/f36 [4194304,4194304] 0 2024-09-13T17:05:55.156 INFO:tasks.workunit.client.0.smithi115.stdout:0/355: dwrite d9/d1d/d24/d26/d36/d48/f4d [0,4194304] 0 2024-09-13T17:05:55.158 INFO:tasks.workunit.client.0.smithi115.stdout:3/734: creat d1/d4b/d1a/d6e/dd9/ff1 x:0 0 0 2024-09-13T17:05:55.160 INFO:tasks.workunit.client.1.smithi195.stdout:8/806: write d0/d17/d2f/d31/d101/f80 [370398,105494] 0 2024-09-13T17:05:55.160 INFO:tasks.workunit.client.1.smithi195.stdout:4/949: dread d1a/d1f/d21/d84/d9d/d8e/d9f/db2/feb [0,4194304] 0 2024-09-13T17:05:55.161 INFO:tasks.workunit.client.1.smithi195.stdout:0/765: creat d7/db/d9a/dd6/ff1 x:0 0 0 2024-09-13T17:05:55.164 INFO:tasks.workunit.client.0.smithi115.stdout:8/554: getdents d0/d26 0 2024-09-13T17:05:55.164 INFO:tasks.workunit.client.0.smithi115.stdout:8/555: write d0/d21/f4a [464923,59844] 0 2024-09-13T17:05:55.167 INFO:tasks.workunit.client.0.smithi115.stdout:6/597: truncate d8/db/faf 3037771 0 2024-09-13T17:05:55.167 INFO:tasks.workunit.client.0.smithi115.stdout:6/598: truncate d8/db/dd/f3a 1577698 0 2024-09-13T17:05:55.167 INFO:tasks.workunit.client.1.smithi195.stdout:7/761: rename d5/db/d19/d22/d3c/c43 to d5/db/d50/d7f/d10a/c10b 0 2024-09-13T17:05:55.167 INFO:tasks.workunit.client.1.smithi195.stdout:7/762: fsync d5/f72 0 2024-09-13T17:05:55.170 INFO:tasks.workunit.client.0.smithi115.stdout:1/455: dwrite d5/d3e/f64 [0,4194304] 0 2024-09-13T17:05:55.170 INFO:tasks.workunit.client.0.smithi115.stdout:1/456: chown d5/d3e/c94 23897 1 2024-09-13T17:05:55.171 INFO:tasks.workunit.client.0.smithi115.stdout:1/457: write d5/d7/d33/f54 [541199,96047] 0 2024-09-13T17:05:55.171 INFO:tasks.workunit.client.1.smithi195.stdout:9/809: mknod d6/d19/d21/d45/dad/d5e/dd0/d61/c10c 0 2024-09-13T17:05:55.173 INFO:tasks.workunit.client.1.smithi195.stdout:6/688: truncate d1c/d24/d49/d5f/db1/dcd/fe2 443897 0 2024-09-13T17:05:55.173 INFO:tasks.workunit.client.1.smithi195.stdout:6/689: fsync d1c/d24/d7f/dad/db9/f32 0 2024-09-13T17:05:55.174 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:54 smithi115 ceph-mon[27708]: pgmap v16: 65 pgs: 65 active+clean; 2.0 GiB data, 5.9 GiB used, 531 GiB / 536 GiB avail; 216 MiB/s rd, 278 MiB/s wr, 409 op/s 2024-09-13T17:05:55.179 INFO:tasks.workunit.client.1.smithi195.stdout:5/774: sync 2024-09-13T17:05:55.179 INFO:tasks.workunit.client.1.smithi195.stdout:2/765: sync 2024-09-13T17:05:55.179 INFO:tasks.workunit.client.1.smithi195.stdout:5/775: fdatasync d2/df/d78/d54/f8a 0 2024-09-13T17:05:55.186 INFO:tasks.workunit.client.1.smithi195.stdout:5/776: dread d2/df/d48/ff1 [0,4194304] 0 2024-09-13T17:05:55.188 INFO:tasks.workunit.client.1.smithi195.stdout:1/717: rmdir db/d19 39 2024-09-13T17:05:55.189 INFO:tasks.workunit.client.1.smithi195.stdout:4/950: mkdir d1a/d1f/d21/d36/d146 0 2024-09-13T17:05:55.190 INFO:tasks.workunit.client.1.smithi195.stdout:4/951: chown d1a/d1f/d21/d84/d9d 83981 1 2024-09-13T17:05:55.190 INFO:tasks.workunit.client.0.smithi115.stdout:0/356: mkdir d9/d1d/d24/d26/d5d/d67 0 2024-09-13T17:05:55.190 INFO:tasks.workunit.client.0.smithi115.stdout:0/357: dread - d9/d1d/d24/d26/d2c/f59 zero size 2024-09-13T17:05:55.190 INFO:tasks.workunit.client.1.smithi195.stdout:0/766: mknod d7/d87/d9b/d4e/d86/cf2 0 2024-09-13T17:05:55.191 INFO:tasks.workunit.client.0.smithi115.stdout:9/374: symlink d0/l80 0 2024-09-13T17:05:55.192 INFO:tasks.workunit.client.0.smithi115.stdout:9/375: creat d0/d21/d42/f81 x:0 0 0 2024-09-13T17:05:55.192 INFO:tasks.workunit.client.0.smithi115.stdout:3/735: mkdir d1/d4b/d69/db6/dd2/df2 0 2024-09-13T17:05:55.193 INFO:tasks.workunit.client.1.smithi195.stdout:7/763: unlink d5/d35/d37/f65 0 2024-09-13T17:05:55.196 INFO:tasks.workunit.client.1.smithi195.stdout:8/807: dwrite d0/d13/f16 [0,4194304] 0 2024-09-13T17:05:55.196 INFO:tasks.workunit.client.1.smithi195.stdout:8/808: write d0/d4/f7f [253619,390] 0 2024-09-13T17:05:55.197 INFO:tasks.workunit.client.0.smithi115.stdout:5/515: dwrite d19/d2b/d77/f79 [4194304,4194304] 0 2024-09-13T17:05:55.209 INFO:tasks.workunit.client.0.smithi115.stdout:8/556: unlink d0/d15/l17 0 2024-09-13T17:05:55.209 INFO:tasks.workunit.client.0.smithi115.stdout:8/557: readlink d0/d18/l2d 0 2024-09-13T17:05:55.213 INFO:tasks.workunit.client.1.smithi195.stdout:2/766: getdents d0/d4a/d47/d73/d75/d88/d1e/dd0 0 2024-09-13T17:05:55.213 INFO:tasks.workunit.client.0.smithi115.stdout:1/458: rmdir d5/d7/d86 39 2024-09-13T17:05:55.214 INFO:tasks.workunit.client.1.smithi195.stdout:2/767: read d0/f54 [52350,30459] 0 2024-09-13T17:05:55.216 INFO:tasks.workunit.client.1.smithi195.stdout:5/777: mkdir d2/df/d78/d54/d106 0 2024-09-13T17:05:55.219 INFO:tasks.workunit.client.1.smithi195.stdout:6/690: dread d1c/d24/d7f/dad/db9/f55 [0,4194304] 0 2024-09-13T17:05:55.219 INFO:tasks.workunit.client.1.smithi195.stdout:6/691: fsync d1c/d24/f2e 0 2024-09-13T17:05:55.219 INFO:tasks.workunit.client.1.smithi195.stdout:1/718: fsync db/d19/d37/d3e/fc9 0 2024-09-13T17:05:55.219 INFO:tasks.workunit.client.1.smithi195.stdout:1/719: readlink db/d58/dae/lbe 0 2024-09-13T17:05:55.219 INFO:tasks.workunit.client.1.smithi195.stdout:1/720: fdatasync db/d19/d5a/f83 0 2024-09-13T17:05:55.219 INFO:tasks.workunit.client.1.smithi195.stdout:1/721: dread - db/d58/fe4 zero size 2024-09-13T17:05:55.220 INFO:tasks.workunit.client.0.smithi115.stdout:9/376: mknod d0/d21/d42/c82 0 2024-09-13T17:05:55.221 INFO:tasks.workunit.client.1.smithi195.stdout:4/952: symlink d1a/d1f/d43/d24/d41/d60/d6f/l147 0 2024-09-13T17:05:55.222 INFO:tasks.workunit.client.0.smithi115.stdout:3/736: link d1/d4b/d1a/d30/l8f d1/d4b/d69/lf3 0 2024-09-13T17:05:55.223 INFO:tasks.workunit.client.1.smithi195.stdout:0/767: rename d7/d87/d9b/l77 to d7/d87/d9b/d4e/d68/dda/lf3 0 2024-09-13T17:05:55.225 INFO:tasks.workunit.client.1.smithi195.stdout:7/764: unlink d5/d35/f57 0 2024-09-13T17:05:55.226 INFO:tasks.workunit.client.0.smithi115.stdout:5/516: mkdir d19/dac 0 2024-09-13T17:05:55.226 INFO:tasks.workunit.client.0.smithi115.stdout:5/517: write d19/d2b/d32/d55/f5f [2078310,18288] 0 2024-09-13T17:05:55.227 INFO:tasks.workunit.client.0.smithi115.stdout:5/518: dread - d19/d21/d3a/d5d/f9e zero size 2024-09-13T17:05:55.227 INFO:tasks.workunit.client.0.smithi115.stdout:4/650: sync 2024-09-13T17:05:55.227 INFO:tasks.workunit.client.0.smithi115.stdout:7/501: sync 2024-09-13T17:05:55.228 INFO:tasks.workunit.client.1.smithi195.stdout:8/809: mknod d0/d17/d2f/d31/db4/dfc/c115 0 2024-09-13T17:05:55.228 INFO:tasks.workunit.client.0.smithi115.stdout:2/744: sync 2024-09-13T17:05:55.230 INFO:tasks.workunit.client.0.smithi115.stdout:9/377: dread d0/de/d10/d15/f3b [0,4194304] 0 2024-09-13T17:05:55.230 INFO:tasks.workunit.client.0.smithi115.stdout:9/378: chown d0/d21/d4f/c54 1941 1 2024-09-13T17:05:55.232 INFO:tasks.workunit.client.1.smithi195.stdout:0/768: dread d7/d88/d23/f35 [0,4194304] 0 2024-09-13T17:05:55.232 INFO:tasks.workunit.client.1.smithi195.stdout:9/810: dwrite d6/df/d16/d65/f75 [0,4194304] 0 2024-09-13T17:05:55.232 INFO:tasks.workunit.client.1.smithi195.stdout:9/811: chown d6/d19/l1c 3 1 2024-09-13T17:05:55.233 INFO:tasks.workunit.client.0.smithi115.stdout:8/558: unlink d0/d15/d3e/f41 0 2024-09-13T17:05:55.235 INFO:tasks.workunit.client.0.smithi115.stdout:6/599: truncate d8/d33/d40/d4c/f91 2486144 0 2024-09-13T17:05:55.236 INFO:tasks.workunit.client.1.smithi195.stdout:4/953: read d1a/d1f/f87 [2990275,118350] 0 2024-09-13T17:05:55.237 INFO:tasks.workunit.client.0.smithi115.stdout:1/459: truncate d5/d26/f4a 1454947 0 2024-09-13T17:05:55.239 INFO:tasks.workunit.client.1.smithi195.stdout:6/692: mkdir d1c/d24/d7f/dad/db9/d8c/de5 0 2024-09-13T17:05:55.239 INFO:tasks.workunit.client.1.smithi195.stdout:6/693: truncate d1c/d24/d7f/dad/db9/d5e/fa0 343661 0 2024-09-13T17:05:55.240 INFO:tasks.workunit.client.1.smithi195.stdout:8/810: dread d0/d17/d2f/d31/f87 [0,4194304] 0 2024-09-13T17:05:55.240 INFO:tasks.workunit.client.1.smithi195.stdout:8/811: readlink d0/d17/d2f/d31/d101/d63/ldc 0 2024-09-13T17:05:55.241 INFO:tasks.workunit.client.0.smithi115.stdout:3/737: getdents d1/d4b/d69/db6/dd2 0 2024-09-13T17:05:55.241 INFO:tasks.workunit.client.0.smithi115.stdout:1/460: dread d5/d7/f18 [0,4194304] 0 2024-09-13T17:05:55.241 INFO:tasks.workunit.client.0.smithi115.stdout:5/519: mknod d19/d2b/d32/d55/cad 0 2024-09-13T17:05:55.242 INFO:tasks.workunit.client.0.smithi115.stdout:4/651: link d7/dd/de/d4e/d9f/fb1 d7/dd/de/d4e/d9f/dc8/fc9 0 2024-09-13T17:05:55.242 INFO:tasks.workunit.client.0.smithi115.stdout:4/652: readlink d7/dd/de/d4e/d6c/l75 0 2024-09-13T17:05:55.244 INFO:tasks.workunit.client.1.smithi195.stdout:7/765: unlink l0 0 2024-09-13T17:05:55.245 INFO:tasks.workunit.client.0.smithi115.stdout:2/745: mkdir d3/d4d/d13/d39/d87/de9 0 2024-09-13T17:05:55.245 INFO:tasks.workunit.client.0.smithi115.stdout:2/746: fsync d3/d4d/d13/d39/d46/da0/fde 0 2024-09-13T17:05:55.245 INFO:tasks.workunit.client.0.smithi115.stdout:2/747: creat d3/d4d/d13/d62/d66/fea x:0 0 0 2024-09-13T17:05:55.245 INFO:tasks.workunit.client.0.smithi115.stdout:2/748: creat d3/d4d/d13/da2/feb x:0 0 0 2024-09-13T17:05:55.246 INFO:tasks.workunit.client.1.smithi195.stdout:0/769: truncate d7/db/d11/f61 3416433 0 2024-09-13T17:05:55.247 INFO:tasks.workunit.client.0.smithi115.stdout:7/502: dread d0/d3b/f6a [0,4194304] 0 2024-09-13T17:05:55.247 INFO:tasks.workunit.client.0.smithi115.stdout:8/559: unlink d0/d26/d29/d59/d7e/da7/d28/d71/cb8 0 2024-09-13T17:05:55.247 INFO:tasks.workunit.client.0.smithi115.stdout:8/560: readlink d0/d26/d29/d59/d7e/da7/d2b/l5e 0 2024-09-13T17:05:55.247 INFO:tasks.workunit.client.0.smithi115.stdout:8/561: write d0/d26/d29/d59/d7e/da7/d28/d71/fb5 [912108,62582] 0 2024-09-13T17:05:55.248 INFO:tasks.workunit.client.1.smithi195.stdout:1/722: dwrite db/df/d4d/fdf [0,4194304] 0 2024-09-13T17:05:55.249 INFO:tasks.workunit.client.0.smithi115.stdout:6/600: creat d8/db/dd/fba x:0 0 0 2024-09-13T17:05:55.253 INFO:tasks.workunit.client.1.smithi195.stdout:9/812: truncate d6/f69 3690444 0 2024-09-13T17:05:55.253 INFO:tasks.workunit.client.1.smithi195.stdout:9/813: chown d6/d19/d21/d45/dad/d5e/dd0/d61/c6b 824 1 2024-09-13T17:05:55.253 INFO:tasks.workunit.client.1.smithi195.stdout:9/814: fsync d6/d12/d86/da7/fe5 0 2024-09-13T17:05:55.253 INFO:tasks.workunit.client.1.smithi195.stdout:9/815: readlink d6/df/d7b/l87 0 2024-09-13T17:05:55.254 INFO:tasks.workunit.client.0.smithi115.stdout:3/738: mknod d1/d4b/d69/db6/dd2/cf4 0 2024-09-13T17:05:55.254 INFO:tasks.workunit.client.1.smithi195.stdout:6/694: dread d1c/d24/d49/d5f/f2b [0,4194304] 0 2024-09-13T17:05:55.254 INFO:tasks.workunit.client.1.smithi195.stdout:6/695: creat d1c/d24/d49/d5f/db1/d95/fe6 x:0 0 0 2024-09-13T17:05:55.255 INFO:tasks.workunit.client.1.smithi195.stdout:5/778: mknod d2/df/d78/deb/d4e/d10/c107 0 2024-09-13T17:05:55.259 INFO:tasks.workunit.client.0.smithi115.stdout:1/461: creat d5/d7/f9f x:0 0 0 2024-09-13T17:05:55.259 INFO:tasks.workunit.client.1.smithi195.stdout:4/954: symlink d1a/d1f/d9c/dc2/l148 0 2024-09-13T17:05:55.260 INFO:tasks.workunit.client.0.smithi115.stdout:8/562: dread d0/d26/d29/f38 [0,4194304] 0 2024-09-13T17:05:55.260 INFO:tasks.workunit.client.0.smithi115.stdout:8/563: dread - d0/d26/d29/d59/d7e/da7/d28/f8d zero size 2024-09-13T17:05:55.261 INFO:tasks.workunit.client.1.smithi195.stdout:0/770: dread f1 [0,4194304] 0 2024-09-13T17:05:55.261 INFO:tasks.workunit.client.1.smithi195.stdout:8/812: unlink d0/dda/fd0 0 2024-09-13T17:05:55.261 INFO:tasks.workunit.client.1.smithi195.stdout:8/813: write d0/d17/d2f/d31/f87 [5106419,121488] 0 2024-09-13T17:05:55.264 INFO:tasks.workunit.client.0.smithi115.stdout:4/653: unlink d7/dd/d3c/d74/d8b/cb2 0 2024-09-13T17:05:55.267 INFO:tasks.workunit.client.1.smithi195.stdout:3/758: sync 2024-09-13T17:05:55.267 INFO:tasks.workunit.client.0.smithi115.stdout:2/749: symlink d3/d4d/d13/d39/d87/de9/lec 0 2024-09-13T17:05:55.269 INFO:tasks.workunit.client.1.smithi195.stdout:1/723: mkdir db/d19/d5a/d66/df2 0 2024-09-13T17:05:55.271 INFO:tasks.workunit.client.0.smithi115.stdout:7/503: mknod d0/d3b/d50/d21/d99/cb6 0 2024-09-13T17:05:55.272 INFO:tasks.workunit.client.0.smithi115.stdout:5/520: dwrite d19/d2b/d32/d55/d5e/f9f [0,4194304] 0 2024-09-13T17:05:55.272 INFO:tasks.workunit.client.0.smithi115.stdout:5/521: getdents d19/d2b/d69/d8f 0 2024-09-13T17:05:55.273 INFO:tasks.workunit.client.1.smithi195.stdout:9/816: truncate d6/df/d13/fd7 4148624 0 2024-09-13T17:05:55.274 INFO:tasks.workunit.client.1.smithi195.stdout:9/817: getdents d6/df/d7b/df6 0 2024-09-13T17:05:55.274 INFO:tasks.workunit.client.1.smithi195.stdout:7/766: dwrite d5/db/d50/d7f/f80 [0,4194304] 0 2024-09-13T17:05:55.276 INFO:tasks.workunit.client.1.smithi195.stdout:0/771: dread f1 [0,4194304] 0 2024-09-13T17:05:55.276 INFO:tasks.workunit.client.1.smithi195.stdout:0/772: write d7/d87/d9b/fd2 [1541557,85477] 0 2024-09-13T17:05:55.278 INFO:tasks.workunit.client.1.smithi195.stdout:3/759: dread d7/d21/d2a/d4a/f7a [0,4194304] 0 2024-09-13T17:05:55.278 INFO:tasks.workunit.client.0.smithi115.stdout:6/601: truncate d8/db/d1d/f2b 1786821 0 2024-09-13T17:05:55.279 INFO:tasks.workunit.client.0.smithi115.stdout:6/602: readlink d8/d33/d40/la3 0 2024-09-13T17:05:55.279 INFO:tasks.workunit.client.0.smithi115.stdout:6/603: chown d8/d33/d40/la3 65910 1 2024-09-13T17:05:55.281 INFO:tasks.workunit.client.1.smithi195.stdout:6/696: creat d1c/d24/d7f/dad/db9/d8c/dd1/de0/fe7 x:0 0 0 2024-09-13T17:05:55.281 INFO:tasks.workunit.client.1.smithi195.stdout:6/697: chown d1c/d24/d7f/dad/db9/d8c/laa 484109 1 2024-09-13T17:05:55.281 INFO:tasks.workunit.client.1.smithi195.stdout:6/698: creat d1c/d24/d49/d5f/d85/fe8 x:0 0 0 2024-09-13T17:05:55.282 INFO:tasks.workunit.client.0.smithi115.stdout:3/739: dwrite d1/d12/f5b [0,4194304] 0 2024-09-13T17:05:55.284 INFO:tasks.workunit.client.1.smithi195.stdout:5/779: truncate d2/df/d78/deb/d4e/d10/d5c/da1/fdb 805686 0 2024-09-13T17:05:55.285 INFO:tasks.workunit.client.0.smithi115.stdout:1/462: dwrite d5/f14 [0,4194304] 0 2024-09-13T17:05:55.287 INFO:tasks.workunit.client.1.smithi195.stdout:5/780: dread d2/df/d78/deb/d4e/d10/d5c/fcf [0,4194304] 0 2024-09-13T17:05:55.288 INFO:tasks.workunit.client.1.smithi195.stdout:5/781: creat d2/df/d90/db2/f108 x:0 0 0 2024-09-13T17:05:55.288 INFO:tasks.workunit.client.1.smithi195.stdout:8/814: truncate d0/fc 928336 0 2024-09-13T17:05:55.288 INFO:tasks.workunit.client.1.smithi195.stdout:8/815: chown d0/d17/d2f/d31/d101/d63/db3/cce 110597391 1 2024-09-13T17:05:55.289 INFO:tasks.workunit.client.0.smithi115.stdout:8/564: creat d0/d21/d76/d83/d5a/fbb x:0 0 0 2024-09-13T17:05:55.293 INFO:tasks.workunit.client.0.smithi115.stdout:3/740: dread d1/d12/f5b [0,4194304] 0 2024-09-13T17:05:55.293 INFO:tasks.workunit.client.0.smithi115.stdout:3/741: chown d1 0 1 2024-09-13T17:05:55.304 INFO:tasks.workunit.client.1.smithi195.stdout:5/782: dread d2/f26 [0,4194304] 0 2024-09-13T17:05:55.310 INFO:tasks.workunit.client.1.smithi195.stdout:1/724: rename db/d58/dae/lbe to db/df/d51/d62/lf3 0 2024-09-13T17:05:55.311 INFO:tasks.workunit.client.0.smithi115.stdout:4/654: mkdir d7/dd/de/d4e/d6c/d77/dca 0 2024-09-13T17:05:55.311 INFO:tasks.workunit.client.0.smithi115.stdout:4/655: truncate d7/dd/d3c/d72/db3/fb8 374666 0 2024-09-13T17:05:55.311 INFO:tasks.workunit.client.0.smithi115.stdout:4/656: readlink d7/dd/l3d 0 2024-09-13T17:05:55.312 INFO:tasks.workunit.client.0.smithi115.stdout:4/657: chown d7/dd/d3c/d7b/l60 123 1 2024-09-13T17:05:55.313 INFO:tasks.workunit.client.1.smithi195.stdout:9/818: link d6/d12/d86/da7/fe5 d6/df/d7b/f10d 0 2024-09-13T17:05:55.315 INFO:tasks.workunit.client.0.smithi115.stdout:2/750: rename d3/d4d/d13/d62/d92/dd7/d56/f9b to d3/d4d/dd/df/fed 0 2024-09-13T17:05:55.317 INFO:tasks.workunit.client.1.smithi195.stdout:7/767: creat d5/db/d19/d22/d90/dd4/f10c x:0 0 0 2024-09-13T17:05:55.325 INFO:tasks.workunit.client.0.smithi115.stdout:6/604: dwrite d8/d33/d40/d67/db4/d24/d53/d6a/f9a [0,4194304] 0 2024-09-13T17:05:55.325 INFO:tasks.workunit.client.0.smithi115.stdout:7/504: dwrite d0/d2/d1e/d3d/d6c/d71/f46 [0,4194304] 0 2024-09-13T17:05:55.326 INFO:tasks.workunit.client.0.smithi115.stdout:1/463: mknod d5/d3e/ca0 0 2024-09-13T17:05:55.327 INFO:tasks.workunit.client.1.smithi195.stdout:6/699: stat d1c/d24/d49/d5f/db1/d95/lb6 0 2024-09-13T17:05:55.329 INFO:tasks.workunit.client.0.smithi115.stdout:8/565: creat d0/d26/d29/d59/d7e/da7/d2b/db1/fbc x:0 0 0 2024-09-13T17:05:55.331 INFO:tasks.workunit.client.0.smithi115.stdout:4/658: symlink d7/dd/de/d4e/lcb 0 2024-09-13T17:05:55.332 INFO:tasks.workunit.client.1.smithi195.stdout:0/773: dread d7/d87/d9b/d56/d46/f9e [0,4194304] 0 2024-09-13T17:05:55.332 INFO:tasks.workunit.client.0.smithi115.stdout:2/751: dwrite d3/d4d/d13/d62/d92/dd7/fd5 [0,4194304] 0 2024-09-13T17:05:55.332 INFO:tasks.workunit.client.0.smithi115.stdout:2/752: readlink d3/d4d/d13/d62/d92/dd7/d56/l53 0 2024-09-13T17:05:55.332 INFO:tasks.workunit.client.0.smithi115.stdout:2/753: chown d3/d4d/dd/d1f/f7e 0 1 2024-09-13T17:05:55.333 INFO:tasks.workunit.client.0.smithi115.stdout:3/742: rename d1/d4b/d69/le7 to d1/d83/d9d/dba/lf5 0 2024-09-13T17:05:55.337 INFO:tasks.workunit.client.0.smithi115.stdout:6/605: mknod d8/d33/d7f/cbb 0 2024-09-13T17:05:55.338 INFO:tasks.workunit.client.0.smithi115.stdout:6/606: chown d8/db/l4a 921439 1 2024-09-13T17:05:55.340 INFO:tasks.workunit.client.0.smithi115.stdout:7/505: link d0/d2/d1e/d3d/d6c/ca0 d0/d3b/d50/d21/cb7 0 2024-09-13T17:05:55.342 INFO:tasks.workunit.client.1.smithi195.stdout:8/816: mknod d0/d17/d2f/d7c/c116 0 2024-09-13T17:05:55.342 INFO:tasks.workunit.client.0.smithi115.stdout:1/464: mkdir d5/d3e/da1 0 2024-09-13T17:05:55.345 INFO:tasks.workunit.client.0.smithi115.stdout:8/566: mkdir d0/d26/d29/d59/d7e/da1/dbd 0 2024-09-13T17:05:55.345 INFO:tasks.workunit.client.0.smithi115.stdout:8/567: read - d0/d42/d80/d94/fba zero size 2024-09-13T17:05:55.345 INFO:tasks.workunit.client.0.smithi115.stdout:8/568: read - d0/d26/d29/d59/d7e/da7/d2b/f9e zero size 2024-09-13T17:05:55.346 INFO:tasks.workunit.client.0.smithi115.stdout:4/659: creat d7/dd/de/d4e/d6c/db0/fcc x:0 0 0 2024-09-13T17:05:55.347 INFO:tasks.workunit.client.0.smithi115.stdout:3/743: dread d1/d4b/d69/d7b/f94 [8388608,4194304] 0 2024-09-13T17:05:55.348 INFO:tasks.workunit.client.1.smithi195.stdout:9/819: truncate d6/d19/d21/d45/dad/d5e/dd0/d61/fae 2303120 0 2024-09-13T17:05:55.352 INFO:tasks.workunit.client.1.smithi195.stdout:3/760: getdents d7/d62 0 2024-09-13T17:05:55.352 INFO:tasks.workunit.client.1.smithi195.stdout:3/761: dread - d7/d21/d2a/d35/d60/d64/fdf zero size 2024-09-13T17:05:55.353 INFO:tasks.workunit.client.0.smithi115.stdout:2/754: symlink d3/d4d/d13/d39/d55/lee 0 2024-09-13T17:05:55.354 INFO:tasks.workunit.client.1.smithi195.stdout:6/700: symlink d1c/d24/d7f/le9 0 2024-09-13T17:05:55.355 INFO:tasks.workunit.client.0.smithi115.stdout:6/607: symlink d8/d33/d40/d67/db4/d24/d53/lbc 0 2024-09-13T17:05:55.355 INFO:tasks.workunit.client.0.smithi115.stdout:6/608: chown d8/l8e 6065167 1 2024-09-13T17:05:55.355 INFO:tasks.workunit.client.0.smithi115.stdout:6/609: write d8/d33/d40/d67/db4/d24/f1e [3425250,56873] 0 2024-09-13T17:05:55.356 INFO:tasks.workunit.client.1.smithi195.stdout:6/701: dread f14 [0,4194304] 0 2024-09-13T17:05:55.356 INFO:tasks.workunit.client.0.smithi115.stdout:1/465: mkdir d5/d7/d33/da2 0 2024-09-13T17:05:55.358 INFO:tasks.workunit.client.1.smithi195.stdout:8/817: getdents d0/d17/d2f/d7c/d4c/d9a/dcd 0 2024-09-13T17:05:55.360 INFO:tasks.workunit.client.0.smithi115.stdout:8/569: unlink d0/d26/f81 0 2024-09-13T17:05:55.363 INFO:tasks.workunit.client.1.smithi195.stdout:5/783: link d2/df/d78/ca3 d2/df/d78/deb/d4e/d10/d8f/c109 0 2024-09-13T17:05:55.366 INFO:tasks.workunit.client.0.smithi115.stdout:3/744: creat d1/d4b/d1a/d30/dc5/ff6 x:0 0 0 2024-09-13T17:05:55.366 INFO:tasks.workunit.client.0.smithi115.stdout:3/745: write d1/da4/fc6 [756888,12841] 0 2024-09-13T17:05:55.368 INFO:tasks.workunit.client.0.smithi115.stdout:1/466: dread d5/d26/d2c/d62/f7f [0,4194304] 0 2024-09-13T17:05:55.368 INFO:tasks.workunit.client.0.smithi115.stdout:1/467: dread - d5/d26/f67 zero size 2024-09-13T17:05:55.368 INFO:tasks.workunit.client.0.smithi115.stdout:1/468: chown d5/d3e/c93 215086 1 2024-09-13T17:05:55.368 INFO:tasks.workunit.client.0.smithi115.stdout:1/469: dread - d5/d3e/d59/f8b zero size 2024-09-13T17:05:55.369 INFO:tasks.workunit.client.1.smithi195.stdout:9/820: creat d6/df/d16/d103/f10e x:0 0 0 2024-09-13T17:05:55.369 INFO:tasks.workunit.client.1.smithi195.stdout:9/821: chown d6/d12/d39/f3e 1966101 1 2024-09-13T17:05:55.369 INFO:tasks.workunit.client.1.smithi195.stdout:9/822: write d6/d19/d21/d45/dad/d5e/dd0/d61/fbe [466508,60560] 0 2024-09-13T17:05:55.370 INFO:tasks.workunit.client.0.smithi115.stdout:6/610: truncate d8/db/d1d/f3d 1660191 0 2024-09-13T17:05:55.370 INFO:tasks.workunit.client.0.smithi115.stdout:6/611: chown d8/d33/d40/d67/db4/d24/d17/f85 665979 1 2024-09-13T17:05:55.370 INFO:tasks.workunit.client.0.smithi115.stdout:6/612: fsync d8/d33/d40/d67/db4/d24/d53/f9c 0 2024-09-13T17:05:55.371 INFO:tasks.workunit.client.1.smithi195.stdout:7/768: mkdir d5/db/d19/d22/d90/dd4/d10d 0 2024-09-13T17:05:55.371 INFO:tasks.workunit.client.1.smithi195.stdout:7/769: readlink d5/d35/l61 0 2024-09-13T17:05:55.371 INFO:tasks.workunit.client.1.smithi195.stdout:7/770: chown d5/db/d19/d22/f6c 7509066 1 2024-09-13T17:05:55.372 INFO:tasks.workunit.client.0.smithi115.stdout:2/755: dread d3/d4d/de/d3a/d47/f49 [0,4194304] 0 2024-09-13T17:05:55.374 INFO:tasks.workunit.client.0.smithi115.stdout:6/613: dread d8/d13/d7b/f8f [0,4194304] 0 2024-09-13T17:05:55.374 INFO:tasks.workunit.client.1.smithi195.stdout:3/762: rename d7/d21/d2a/d35/d60/l6a to d7/d21/d2a/d35/d9c/df6/lf8 0 2024-09-13T17:05:55.375 INFO:tasks.workunit.client.0.smithi115.stdout:1/470: truncate d5/d3e/f64 1932422 0 2024-09-13T17:05:55.375 INFO:tasks.workunit.client.0.smithi115.stdout:1/471: write d5/d7/f77 [659974,114002] 0 2024-09-13T17:05:55.376 INFO:tasks.workunit.client.1.smithi195.stdout:5/784: read d2/df/d78/d54/f73 [6465866,9872] 0 2024-09-13T17:05:55.377 INFO:tasks.workunit.client.0.smithi115.stdout:2/756: symlink d3/d4d/d13/d62/de2/lef 0 2024-09-13T17:05:55.377 INFO:tasks.workunit.client.0.smithi115.stdout:2/757: fdatasync d3/d4d/d13/d62/d92/dd7/d56/f29 0 2024-09-13T17:05:55.378 INFO:tasks.workunit.client.1.smithi195.stdout:2/768: sync 2024-09-13T17:05:55.379 INFO:tasks.workunit.client.1.smithi195.stdout:9/823: symlink d6/d19/d21/d45/dad/dca/l10f 0 2024-09-13T17:05:55.379 INFO:tasks.workunit.client.1.smithi195.stdout:9/824: write d6/df/d16/de3/feb [49540,118171] 0 2024-09-13T17:05:55.379 INFO:tasks.workunit.client.0.smithi115.stdout:3/746: dread d1/d12/d14/fad [0,4194304] 0 2024-09-13T17:05:55.381 INFO:tasks.workunit.client.0.smithi115.stdout:1/472: rename d5/d7/d33/d3a/f51 to d5/d26/d2c/d89/fa3 0 2024-09-13T17:05:55.381 INFO:tasks.workunit.client.0.smithi115.stdout:6/614: write d8/d33/d40/d4c/f91 [822786,76990] 0 2024-09-13T17:05:55.382 INFO:tasks.workunit.client.1.smithi195.stdout:7/771: symlink d5/d13/da8/l10e 0 2024-09-13T17:05:55.385 INFO:tasks.workunit.client.1.smithi195.stdout:3/763: unlink d7/d62/ff5 0 2024-09-13T17:05:55.385 INFO:tasks.workunit.client.0.smithi115.stdout:4/660: dwrite d7/fb [0,4194304] 0 2024-09-13T17:05:55.387 INFO:tasks.workunit.client.1.smithi195.stdout:5/785: stat d2/df/d78/deb/d4e/d10/f66 0 2024-09-13T17:05:55.389 INFO:tasks.workunit.client.0.smithi115.stdout:2/758: rename d3/d4d/d13/d62/d92/dd7/da6/ccd to d3/d4d/dd/df/cf0 0 2024-09-13T17:05:55.390 INFO:tasks.workunit.client.0.smithi115.stdout:1/473: dread d5/d60/d7d/d87/f9e [0,4194304] 0 2024-09-13T17:05:55.390 INFO:tasks.workunit.client.0.smithi115.stdout:1/474: dread - d5/d7/d33/f9d zero size 2024-09-13T17:05:55.390 INFO:tasks.workunit.client.0.smithi115.stdout:2/759: read d3/d4d/d13/d6b/fb9 [8552,82617] 0 2024-09-13T17:05:55.390 INFO:tasks.workunit.client.0.smithi115.stdout:2/760: chown f2 126 1 2024-09-13T17:05:55.391 INFO:tasks.workunit.client.1.smithi195.stdout:9/825: creat d6/d19/d21/d45/dad/d5e/dd0/d61/f110 x:0 0 0 2024-09-13T17:05:55.391 INFO:tasks.workunit.client.0.smithi115.stdout:2/761: dread d3/d4d/dd/df/d57/d8b/fcc [0,4194304] 0 2024-09-13T17:05:55.392 INFO:tasks.workunit.client.1.smithi195.stdout:7/772: mkdir d5/d13/d24/d10f 0 2024-09-13T17:05:55.393 INFO:tasks.workunit.client.0.smithi115.stdout:6/615: creat d8/d33/d7f/fbd x:0 0 0 2024-09-13T17:05:55.393 INFO:tasks.workunit.client.0.smithi115.stdout:6/616: creat d8/db/d1d/fbe x:0 0 0 2024-09-13T17:05:55.393 INFO:tasks.workunit.client.0.smithi115.stdout:6/617: chown d8/d33/d40/d67/db4/l21 53589 1 2024-09-13T17:05:55.393 INFO:tasks.workunit.client.0.smithi115.stdout:6/618: fdatasync d8/d33/d40/d67/db4/f65 0 2024-09-13T17:05:55.394 INFO:tasks.workunit.client.1.smithi195.stdout:3/764: mknod d7/d21/d2a/d4a/d71/cf9 0 2024-09-13T17:05:55.394 INFO:tasks.workunit.client.1.smithi195.stdout:3/765: chown d7/d21/l5e 19 1 2024-09-13T17:05:55.395 INFO:tasks.workunit.client.0.smithi115.stdout:3/747: rmdir d1/d4b/d69/db6/dd2/df2 0 2024-09-13T17:05:55.399 INFO:tasks.workunit.client.1.smithi195.stdout:0/774: dwrite d7/d87/d9b/d56/d46/f74 [0,4194304] 0 2024-09-13T17:05:55.399 INFO:tasks.workunit.client.0.smithi115.stdout:4/661: mknod d7/dd/de/d4e/d6c/d77/ccd 0 2024-09-13T17:05:55.399 INFO:tasks.workunit.client.0.smithi115.stdout:4/662: creat d7/dd/de/d4e/d6c/d77/fce x:0 0 0 2024-09-13T17:05:55.399 INFO:tasks.workunit.client.0.smithi115.stdout:4/663: fdatasync d7/dd/d3c/f3e 0 2024-09-13T17:05:55.399 INFO:tasks.workunit.client.0.smithi115.stdout:8/570: dwrite d0/d21/d3a/d60/f78 [4194304,4194304] 0 2024-09-13T17:05:55.400 INFO:tasks.workunit.client.0.smithi115.stdout:1/475: dread d5/d7/d5c/d73/f81 [0,4194304] 0 2024-09-13T17:05:55.401 INFO:tasks.workunit.client.1.smithi195.stdout:2/769: mkdir d0/de8 0 2024-09-13T17:05:55.402 INFO:tasks.workunit.client.0.smithi115.stdout:2/762: mkdir d3/d4d/de/d99/d9a/df1 0 2024-09-13T17:05:55.403 INFO:tasks.workunit.client.1.smithi195.stdout:7/773: rename d5/d13/d24/f9a to d5/d35/dd2/f110 0 2024-09-13T17:05:55.404 INFO:tasks.workunit.client.1.smithi195.stdout:6/702: dwrite d1c/d7d/f97 [0,4194304] 0 2024-09-13T17:05:55.404 INFO:tasks.workunit.client.1.smithi195.stdout:6/703: chown d1c/d24/d49 36 1 2024-09-13T17:05:55.405 INFO:tasks.workunit.client.1.smithi195.stdout:3/766: rmdir d7/d21/d2a/d35 39 2024-09-13T17:05:55.405 INFO:tasks.workunit.client.1.smithi195.stdout:3/767: fdatasync d7/d21/d2a/d4a/d71/fee 0 2024-09-13T17:05:55.406 INFO:tasks.workunit.client.0.smithi115.stdout:6/619: mkdir d8/d33/d40/d67/db4/dbf 0 2024-09-13T17:05:55.410 INFO:tasks.workunit.client.0.smithi115.stdout:3/748: unlink d1/d4b/d1a/d6e/fdd 0 2024-09-13T17:05:55.411 INFO:tasks.workunit.client.1.smithi195.stdout:4/955: sync 2024-09-13T17:05:55.412 INFO:tasks.workunit.client.1.smithi195.stdout:9/826: dwrite d6/df/d16/de3/f53 [0,4194304] 0 2024-09-13T17:05:55.412 INFO:tasks.workunit.client.1.smithi195.stdout:9/827: write d6/df/d16/d58/f6e [8155509,11095] 0 2024-09-13T17:05:55.417 INFO:tasks.workunit.client.0.smithi115.stdout:4/664: creat d7/dd/de/d4e/d5a/d4f/d53/fcf x:0 0 0 2024-09-13T17:05:55.417 INFO:tasks.workunit.client.0.smithi115.stdout:4/665: truncate d7/dd/d3c/d74/d8b/fb9 811322 0 2024-09-13T17:05:55.417 INFO:tasks.workunit.client.0.smithi115.stdout:4/666: getdents d7/dd/de/d4e/d6c/d77/dca 0 2024-09-13T17:05:55.420 INFO:tasks.workunit.client.0.smithi115.stdout:8/571: rename d0/d21/d76/f7f to d0/d21/fbe 0 2024-09-13T17:05:55.420 INFO:tasks.workunit.client.0.smithi115.stdout:8/572: fdatasync d0/d18/f65 0 2024-09-13T17:05:55.421 INFO:tasks.workunit.client.1.smithi195.stdout:9/828: write d6/d19/d21/d5b/fa3 [2381829,4342] 0 2024-09-13T17:05:55.421 INFO:tasks.workunit.client.1.smithi195.stdout:9/829: read - d6/df/d16/de3/fbf zero size 2024-09-13T17:05:55.421 INFO:tasks.workunit.client.1.smithi195.stdout:2/770: creat d0/fe9 x:0 0 0 2024-09-13T17:05:55.430 INFO:tasks.workunit.client.1.smithi195.stdout:6/704: symlink d1c/d24/d7f/dad/db9/d30/lea 0 2024-09-13T17:05:55.431 INFO:tasks.workunit.client.1.smithi195.stdout:6/705: creat d1c/d24/d7f/dad/feb x:0 0 0 2024-09-13T17:05:55.431 INFO:tasks.workunit.client.1.smithi195.stdout:6/706: getdents d1c/d3e/d6b/dd2 0 2024-09-13T17:05:55.431 INFO:tasks.workunit.client.1.smithi195.stdout:6/707: read d1c/d24/d49/d5f/d85/f9e [927017,9297] 0 2024-09-13T17:05:55.431 INFO:tasks.workunit.client.1.smithi195.stdout:6/708: write d1c/d24/d7f/dad/db9/f55 [293761,64021] 0 2024-09-13T17:05:55.431 INFO:tasks.workunit.client.1.smithi195.stdout:6/709: fsync d1c/d24/d49/d5f/d85/d8f/fdc 0 2024-09-13T17:05:55.432 INFO:tasks.workunit.client.1.smithi195.stdout:6/710: readlink d1c/d3e/l60 0 2024-09-13T17:05:55.432 INFO:tasks.workunit.client.1.smithi195.stdout:3/768: creat d7/d21/d2a/d35/d60/d6f/d74/ffa x:0 0 0 2024-09-13T17:05:55.434 INFO:tasks.workunit.client.1.smithi195.stdout:5/786: rmdir d2/df/d78/deb/d4e/d10/d46 39 2024-09-13T17:05:55.434 INFO:tasks.workunit.client.1.smithi195.stdout:5/787: chown d2/df/d78/deb/d4e/d10/f66 52 1 2024-09-13T17:05:55.434 INFO:tasks.workunit.client.1.smithi195.stdout:5/788: read - d2/df/d48/fe2 zero size 2024-09-13T17:05:55.434 INFO:tasks.workunit.client.1.smithi195.stdout:5/789: chown d2/fc4 550785899 1 2024-09-13T17:05:55.434 INFO:tasks.workunit.client.1.smithi195.stdout:5/790: write d2/df/d78/d54/fa7 [771678,14786] 0 2024-09-13T17:05:55.434 INFO:tasks.workunit.client.1.smithi195.stdout:5/791: fdatasync d2/df/d78/deb/d4e/d10/d46/ff8 0 2024-09-13T17:05:55.437 INFO:tasks.workunit.client.0.smithi115.stdout:2/763: getdents d3/d4d/d13/d62/d92/dd7 0 2024-09-13T17:05:55.437 INFO:tasks.workunit.client.0.smithi115.stdout:8/573: dwrite d0/d15/d3e/f47 [0,4194304] 0 2024-09-13T17:05:55.439 INFO:tasks.workunit.client.0.smithi115.stdout:6/620: symlink d8/d33/d40/d67/db4/d24/d53/d6a/lc0 0 2024-09-13T17:05:55.441 INFO:tasks.workunit.client.0.smithi115.stdout:3/749: unlink d1/da6/cb4 0 2024-09-13T17:05:55.441 INFO:tasks.workunit.client.0.smithi115.stdout:3/750: chown d1/d4b/d1a/d30/l93 28 1 2024-09-13T17:05:55.441 INFO:tasks.workunit.client.0.smithi115.stdout:3/751: chown d1/d4b/d69/d7b/da0/lbc 10795748 1 2024-09-13T17:05:55.441 INFO:tasks.workunit.client.0.smithi115.stdout:3/752: fdatasync d1/d12/d14/f2e 0 2024-09-13T17:05:55.442 INFO:tasks.workunit.client.1.smithi195.stdout:1/725: sync 2024-09-13T17:05:55.442 INFO:tasks.workunit.client.1.smithi195.stdout:0/775: getdents d7/db/d9a/dd6 0 2024-09-13T17:05:55.442 INFO:tasks.workunit.client.0.smithi115.stdout:4/667: symlink d7/dd/d3c/d7b/ld0 0 2024-09-13T17:05:55.444 INFO:tasks.workunit.client.0.smithi115.stdout:1/476: rename d5/d7/d86/l8d to d5/d60/la4 0 2024-09-13T17:05:55.445 INFO:tasks.workunit.client.1.smithi195.stdout:2/771: unlink d0/d4a/d47/d73/d75/d88/d8e/dcf/le0 0 2024-09-13T17:05:55.447 INFO:tasks.workunit.client.0.smithi115.stdout:2/764: mknod d3/d4d/d13/d39/cf2 0 2024-09-13T17:05:55.449 INFO:tasks.workunit.client.0.smithi115.stdout:2/765: dread d3/d4d/d13/f45 [0,4194304] 0 2024-09-13T17:05:55.450 INFO:tasks.workunit.client.0.smithi115.stdout:3/753: creat d1/da6/dd1/ff7 x:0 0 0 2024-09-13T17:05:55.451 INFO:tasks.workunit.client.1.smithi195.stdout:6/711: truncate d1c/d24/d7f/dad/db9/d30/d6f/fdf 273250 0 2024-09-13T17:05:55.451 INFO:tasks.workunit.client.1.smithi195.stdout:6/712: fdatasync d1c/d24/d49/d5f/f58 0 2024-09-13T17:05:55.451 INFO:tasks.workunit.client.1.smithi195.stdout:6/713: stat d1c/d24/d49/d5f/d35/f53 0 2024-09-13T17:05:55.453 INFO:tasks.workunit.client.0.smithi115.stdout:4/668: mkdir d7/dd/de/d4e/dd1 0 2024-09-13T17:05:55.453 INFO:tasks.workunit.client.0.smithi115.stdout:4/669: readlink d7/d86/lad 0 2024-09-13T17:05:55.454 INFO:tasks.workunit.client.1.smithi195.stdout:3/769: getdents d7/d21/d2a 0 2024-09-13T17:05:55.454 INFO:tasks.workunit.client.1.smithi195.stdout:3/770: truncate d7/d67/fda 182458 0 2024-09-13T17:05:55.457 INFO:tasks.workunit.client.1.smithi195.stdout:5/792: rename d2/df/d78/d99 to d2/df/d90/dbb/dec/d10a 0 2024-09-13T17:05:55.458 INFO:tasks.workunit.client.0.smithi115.stdout:2/766: link d3/d4d/d13/d62/d92/dd7/d56/d58/dac/cc4 d3/d4d/d13/d62/d92/dd7/d56/d58/dac/cf3 0 2024-09-13T17:05:55.459 INFO:tasks.workunit.client.1.smithi195.stdout:4/956: mknod d1a/d1f/d21/d84/c149 0 2024-09-13T17:05:55.460 INFO:tasks.workunit.client.0.smithi115.stdout:3/754: getdents d1/d4b/d69/d7b 0 2024-09-13T17:05:55.461 INFO:tasks.workunit.client.1.smithi195.stdout:1/726: creat db/df/ff4 x:0 0 0 2024-09-13T17:05:55.463 INFO:tasks.workunit.client.1.smithi195.stdout:0/776: symlink d7/d88/d23/d96/lf4 0 2024-09-13T17:05:55.466 INFO:tasks.workunit.client.1.smithi195.stdout:2/772: mknod d0/d4a/d47/d73/d75/d88/d2c/d43/d84/cea 0 2024-09-13T17:05:55.468 INFO:tasks.workunit.client.0.smithi115.stdout:1/477: rmdir d5/d7 39 2024-09-13T17:05:55.471 INFO:tasks.workunit.client.0.smithi115.stdout:2/767: creat d3/d4d/de/ff4 x:0 0 0 2024-09-13T17:05:55.471 INFO:tasks.workunit.client.0.smithi115.stdout:2/768: chown d3/d4d/de/f37 12145045 1 2024-09-13T17:05:55.473 INFO:tasks.workunit.client.1.smithi195.stdout:3/771: creat d7/d21/d2a/d35/d60/d64/ffb x:0 0 0 2024-09-13T17:05:55.474 INFO:tasks.workunit.client.0.smithi115.stdout:3/755: rename d1/d4b/d1a/d6e/c89 to d1/d12/d14/cf8 0 2024-09-13T17:05:55.475 INFO:tasks.workunit.client.0.smithi115.stdout:1/478: creat d5/d7/d5c/fa5 x:0 0 0 2024-09-13T17:05:55.476 INFO:tasks.workunit.client.1.smithi195.stdout:4/957: dwrite d1a/d1f/d43/d24/f7d [0,4194304] 0 2024-09-13T17:05:55.476 INFO:tasks.workunit.client.1.smithi195.stdout:4/958: fdatasync d1a/d1f/d21/ff0 0 2024-09-13T17:05:55.476 INFO:tasks.workunit.client.1.smithi195.stdout:4/959: fsync d1a/d1f/d21/f93 0 2024-09-13T17:05:55.476 INFO:tasks.workunit.client.1.smithi195.stdout:4/960: write d1a/d1f/d21/d36/f55 [907542,98052] 0 2024-09-13T17:05:55.477 INFO:tasks.workunit.client.1.smithi195.stdout:5/793: creat d2/df/d78/deb/d4e/d10/d5c/f10b x:0 0 0 2024-09-13T17:05:55.477 INFO:tasks.workunit.client.1.smithi195.stdout:5/794: chown d2/d3e/f3a 0 1 2024-09-13T17:05:55.478 INFO:tasks.workunit.client.1.smithi195.stdout:5/795: dread d2/df/d48/d5a/dc5/fc6 [0,4194304] 0 2024-09-13T17:05:55.478 INFO:tasks.workunit.client.1.smithi195.stdout:5/796: chown d2/df/d78/deb/d4e/d10 651219 1 2024-09-13T17:05:55.478 INFO:tasks.workunit.client.1.smithi195.stdout:5/797: write d2/df/d78/deb/d4e/fdd [76540,18540] 0 2024-09-13T17:05:55.478 INFO:tasks.workunit.client.1.smithi195.stdout:5/798: readlink d2/df/d90/db2/led 0 2024-09-13T17:05:55.478 INFO:tasks.workunit.client.1.smithi195.stdout:5/799: truncate d2/df/d78/d54/d58/f6b 4296605 0 2024-09-13T17:05:55.479 INFO:tasks.workunit.client.1.smithi195.stdout:0/777: dwrite d7/d87/d9b/fd2 [0,4194304] 0 2024-09-13T17:05:55.480 INFO:tasks.workunit.client.0.smithi115.stdout:1/479: getdents d5/d7/d86 0 2024-09-13T17:05:55.480 INFO:tasks.workunit.client.0.smithi115.stdout:1/480: dread - d5/d26/d2c/d89/fa3 zero size 2024-09-13T17:05:55.480 INFO:tasks.workunit.client.0.smithi115.stdout:1/481: readlink d5/d7/l83 0 2024-09-13T17:05:55.480 INFO:tasks.workunit.client.0.smithi115.stdout:1/482: truncate d5/d26/d2c/d89/fa3 298773 0 2024-09-13T17:05:55.483 INFO:tasks.workunit.client.0.smithi115.stdout:2/769: rmdir d3/d4d/d13/da2 39 2024-09-13T17:05:55.483 INFO:tasks.workunit.client.0.smithi115.stdout:3/756: dread d1/d4b/d1a/d30/f37 [0,4194304] 0 2024-09-13T17:05:55.484 INFO:tasks.workunit.client.0.smithi115.stdout:1/483: dread d5/d26/f6e [0,4194304] 0 2024-09-13T17:05:55.484 INFO:tasks.workunit.client.0.smithi115.stdout:1/484: fdatasync d5/d7/f16 0 2024-09-13T17:05:55.485 INFO:tasks.workunit.client.0.smithi115.stdout:1/485: creat d5/d7/d5c/fa6 x:0 0 0 2024-09-13T17:05:55.485 INFO:tasks.workunit.client.1.smithi195.stdout:2/773: mknod d0/d4a/d47/d73/d94/ceb 0 2024-09-13T17:05:55.486 INFO:tasks.workunit.client.1.smithi195.stdout:3/772: mkdir d7/d21/d2a/d35/d8f/d9f/dfc 0 2024-09-13T17:05:55.486 INFO:tasks.workunit.client.1.smithi195.stdout:3/773: chown d7/d67/la7 16869 1 2024-09-13T17:05:55.486 INFO:tasks.workunit.client.0.smithi115.stdout:3/757: mknod d1/da6/dd1/cf9 0 2024-09-13T17:05:55.486 INFO:tasks.workunit.client.0.smithi115.stdout:3/758: read - d1/d4b/d1a/d30/dc5/ff6 zero size 2024-09-13T17:05:55.491 INFO:tasks.workunit.client.0.smithi115.stdout:2/770: write d3/d4d/de/f10 [1769631,58408] 0 2024-09-13T17:05:55.491 INFO:tasks.workunit.client.0.smithi115.stdout:1/486: rename d5/fb to d5/d7/d5c/fa7 0 2024-09-13T17:05:55.491 INFO:tasks.workunit.client.0.smithi115.stdout:1/487: write d5/d60/d7d/d87/f9e [1741239,42972] 0 2024-09-13T17:05:55.492 INFO:tasks.workunit.client.1.smithi195.stdout:4/961: symlink d1a/d1f/d9c/dee/l14a 0 2024-09-13T17:05:55.496 INFO:tasks.workunit.client.0.smithi115.stdout:3/759: symlink d1/dc2/lfa 0 2024-09-13T17:05:55.496 INFO:tasks.workunit.client.0.smithi115.stdout:1/488: dread d5/d7/d33/d3a/f7a [0,4194304] 0 2024-09-13T17:05:55.496 INFO:tasks.workunit.client.0.smithi115.stdout:1/489: read - d5/d7/d5c/fa5 zero size 2024-09-13T17:05:55.496 INFO:tasks.workunit.client.0.smithi115.stdout:1/490: fsync d5/d3e/d59/f8b 0 2024-09-13T17:05:55.496 INFO:tasks.workunit.client.0.smithi115.stdout:1/491: write d5/d3e/d59/f8b [959671,122781] 0 2024-09-13T17:05:55.497 INFO:tasks.workunit.client.1.smithi195.stdout:5/800: creat d2/df/d78/deb/d3f/d7b/f10c x:0 0 0 2024-09-13T17:05:55.497 INFO:tasks.workunit.client.1.smithi195.stdout:5/801: chown d2/df/d78/deb/d3f/lb0 164298778 1 2024-09-13T17:05:55.497 INFO:tasks.workunit.client.1.smithi195.stdout:1/727: symlink db/d19/d37/d46/d7e/lf5 0 2024-09-13T17:05:55.498 INFO:tasks.workunit.client.0.smithi115.stdout:2/771: truncate d3/d4d/dd/fa3 617682 0 2024-09-13T17:05:55.498 INFO:tasks.workunit.client.0.smithi115.stdout:2/772: fsync d3/d4d/d13/d6b/fdc 0 2024-09-13T17:05:55.498 INFO:tasks.workunit.client.0.smithi115.stdout:2/773: creat d3/d4d/d13/d39/d46/da0/ff5 x:0 0 0 2024-09-13T17:05:55.503 INFO:tasks.workunit.client.1.smithi195.stdout:0/778: symlink d7/d87/d9b/d56/db0/lf5 0 2024-09-13T17:05:55.504 INFO:tasks.workunit.client.0.smithi115.stdout:2/774: getdents d3/d4d/d13/d39/d46 0 2024-09-13T17:05:55.506 INFO:tasks.workunit.client.1.smithi195.stdout:2/774: truncate d0/d3/f4 2213742 0 2024-09-13T17:05:55.506 INFO:tasks.workunit.client.1.smithi195.stdout:2/775: chown d0/d4a/d47/d73/d75/d88/d2c/d43/d84/fb5 29564020 1 2024-09-13T17:05:55.506 INFO:tasks.workunit.client.1.smithi195.stdout:2/776: write d0/d4a/d47/d73/d75/d88/d2c/d43/d84/fa3 [376697,19069] 0 2024-09-13T17:05:55.506 INFO:tasks.workunit.client.1.smithi195.stdout:2/777: chown d0/d4a/d47/d73/fe3 125706642 1 2024-09-13T17:05:55.507 INFO:tasks.workunit.client.0.smithi115.stdout:1/492: dread d5/d3e/d59/f76 [0,4194304] 0 2024-09-13T17:05:55.507 INFO:tasks.workunit.client.1.smithi195.stdout:3/774: mkdir d7/d21/d2a/d35/d60/d64/db3/dc4/dfd 0 2024-09-13T17:05:55.509 INFO:tasks.workunit.client.1.smithi195.stdout:4/962: creat d1a/d1f/d21/d84/f14b x:0 0 0 2024-09-13T17:05:55.510 INFO:tasks.workunit.client.0.smithi115.stdout:2/775: unlink d3/d4d/dd/fa3 0 2024-09-13T17:05:55.512 INFO:tasks.workunit.client.0.smithi115.stdout:1/493: unlink d5/d26/f67 0 2024-09-13T17:05:55.513 INFO:tasks.workunit.client.0.smithi115.stdout:2/776: mkdir d3/d4d/d13/d1c/dc8/df6 0 2024-09-13T17:05:55.514 INFO:tasks.workunit.client.0.smithi115.stdout:3/760: dwrite d1/da6/faf [0,4194304] 0 2024-09-13T17:05:55.515 INFO:tasks.workunit.client.0.smithi115.stdout:1/494: creat d5/d7/d5c/d73/fa8 x:0 0 0 2024-09-13T17:05:55.528 INFO:tasks.workunit.client.0.smithi115.stdout:2/777: link d3/d4d/de/c1d d3/d4d/d13/d1c/dc8/df6/cf7 0 2024-09-13T17:05:55.528 INFO:tasks.workunit.client.0.smithi115.stdout:2/778: dread - d3/d4d/d13/d39/d46/d70/fcf zero size 2024-09-13T17:05:55.528 INFO:tasks.workunit.client.0.smithi115.stdout:2/779: truncate d3/d4d/de/d99/fb1 913422 0 2024-09-13T17:05:55.529 INFO:tasks.workunit.client.1.smithi195.stdout:1/728: mkdir db/df/d13/df6 0 2024-09-13T17:05:55.530 INFO:tasks.workunit.client.1.smithi195.stdout:3/775: dwrite d7/d21/d2a/d4a/d5a/f8e [4194304,4194304] 0 2024-09-13T17:05:55.531 INFO:tasks.workunit.client.1.smithi195.stdout:0/779: symlink d7/d88/d23/d96/lf6 0 2024-09-13T17:05:55.532 INFO:tasks.workunit.client.0.smithi115.stdout:1/495: link d5/d26/f4a d5/d26/d2c/d89/fa9 0 2024-09-13T17:05:55.532 INFO:tasks.workunit.client.0.smithi115.stdout:1/496: creat d5/d7/d5c/faa x:0 0 0 2024-09-13T17:05:55.566 INFO:tasks.workunit.client.1.smithi195.stdout:2/778: link d0/d4a/d47/d73/d75/d88/d2c/d43/d84/f87 d0/d4a/d47/fec 0 2024-09-13T17:05:55.568 INFO:tasks.workunit.client.1.smithi195.stdout:4/963: symlink d1a/d1f/d43/d24/d41/l14c 0 2024-09-13T17:05:55.569 INFO:tasks.workunit.client.0.smithi115.stdout:2/780: mkdir d3/d4d/d13/da2/df8 0 2024-09-13T17:05:55.569 INFO:tasks.workunit.client.1.smithi195.stdout:5/802: getdents d2/d88 0 2024-09-13T17:05:55.570 INFO:tasks.workunit.client.0.smithi115.stdout:3/761: symlink d1/d4b/d1a/d6e/dd9/lfb 0 2024-09-13T17:05:55.570 INFO:tasks.workunit.client.0.smithi115.stdout:3/762: dread - d1/d12/d14/d61/ff0 zero size 2024-09-13T17:05:55.571 INFO:tasks.workunit.client.1.smithi195.stdout:1/729: rmdir db/d19/d5a/d66 39 2024-09-13T17:05:55.572 INFO:tasks.workunit.client.1.smithi195.stdout:7/774: sync 2024-09-13T17:05:55.572 INFO:tasks.workunit.client.1.smithi195.stdout:8/818: sync 2024-09-13T17:05:55.572 INFO:tasks.workunit.client.1.smithi195.stdout:7/775: dread - d5/db/d19/d22/fc3 zero size 2024-09-13T17:05:55.578 INFO:tasks.workunit.client.0.smithi115.stdout:1/497: rename d5/d7/d85 to d5/d7/d5c/dab 0 2024-09-13T17:05:55.578 INFO:tasks.workunit.client.0.smithi115.stdout:1/498: readlink d5/d3e/l46 0 2024-09-13T17:05:55.579 INFO:tasks.workunit.client.0.smithi115.stdout:2/781: truncate d3/d4d/dd/df/f24 1949512 0 2024-09-13T17:05:55.579 INFO:tasks.workunit.client.0.smithi115.stdout:2/782: chown d3/d4d/dd/df/d57/d8b/fcc 6677224 1 2024-09-13T17:05:55.582 INFO:tasks.workunit.client.0.smithi115.stdout:3/763: dread - d1/d4b/d69/db6/dd2/fe2 zero size 2024-09-13T17:05:55.584 INFO:tasks.workunit.client.0.smithi115.stdout:1/499: rename d5/d3e/d59/f76 to d5/d7/d33/d3a/fac 0 2024-09-13T17:05:55.584 INFO:tasks.workunit.client.0.smithi115.stdout:1/500: dread - d5/d7/d5c/f8c zero size 2024-09-13T17:05:55.584 INFO:tasks.workunit.client.0.smithi115.stdout:1/501: creat d5/d3e/d59/fad x:0 0 0 2024-09-13T17:05:55.585 INFO:tasks.workunit.client.1.smithi195.stdout:3/776: rmdir d7/d21/d2a/d35/d8f 39 2024-09-13T17:05:55.586 INFO:tasks.workunit.client.0.smithi115.stdout:3/764: mknod d1/d12/d14/cfc 0 2024-09-13T17:05:55.586 INFO:tasks.workunit.client.1.smithi195.stdout:9/830: sync 2024-09-13T17:05:55.586 INFO:tasks.workunit.client.1.smithi195.stdout:6/714: sync 2024-09-13T17:05:55.586 INFO:tasks.workunit.client.1.smithi195.stdout:6/715: dread - d1c/d24/d7f/dad/fce zero size 2024-09-13T17:05:55.586 INFO:tasks.workunit.client.1.smithi195.stdout:0/780: fsync d7/d50/fc1 0 2024-09-13T17:05:55.587 INFO:tasks.workunit.client.1.smithi195.stdout:0/781: creat d7/db/d38/d5d/ff7 x:0 0 0 2024-09-13T17:05:55.590 INFO:tasks.workunit.client.0.smithi115.stdout:1/502: unlink d5/d3e/f84 0 2024-09-13T17:05:55.590 INFO:tasks.workunit.client.0.smithi115.stdout:1/503: dread - d5/d7/d5c/fa6 zero size 2024-09-13T17:05:55.591 INFO:tasks.workunit.client.1.smithi195.stdout:5/803: link d2/df/d78/deb/d3f/c8e d2/df/d78/c10d 0 2024-09-13T17:05:55.592 INFO:tasks.workunit.client.1.smithi195.stdout:8/819: symlink d0/d13/l117 0 2024-09-13T17:05:55.592 INFO:tasks.workunit.client.1.smithi195.stdout:8/820: write d0/d17/d2f/d7c/fca [690328,5700] 0 2024-09-13T17:05:55.593 INFO:tasks.workunit.client.1.smithi195.stdout:8/821: write d0/d13/d52/fd4 [14975,74689] 0 2024-09-13T17:05:55.593 INFO:tasks.workunit.client.0.smithi115.stdout:1/504: unlink d5/d7/d5c/c9a 0 2024-09-13T17:05:55.594 INFO:tasks.workunit.client.1.smithi195.stdout:2/779: dwrite d0/d3/f5c [4194304,4194304] 0 2024-09-13T17:05:55.595 INFO:tasks.workunit.client.1.smithi195.stdout:7/776: rename d5/l2e to d5/db/d50/daa/dfc/l111 0 2024-09-13T17:05:55.596 INFO:tasks.workunit.client.1.smithi195.stdout:1/730: dwrite db/d19/d5a/fd3 [0,4194304] 0 2024-09-13T17:05:55.598 INFO:tasks.workunit.client.1.smithi195.stdout:7/777: dread d5/d13/f32 [0,4194304] 0 2024-09-13T17:05:55.598 INFO:tasks.workunit.client.1.smithi195.stdout:2/780: truncate d0/d3/df/f9e 386604 0 2024-09-13T17:05:55.598 INFO:tasks.workunit.client.1.smithi195.stdout:2/781: creat d0/d3/df/dbe/fed x:0 0 0 2024-09-13T17:05:55.600 INFO:tasks.workunit.client.1.smithi195.stdout:4/964: dread f5 [0,4194304] 0 2024-09-13T17:05:55.600 INFO:tasks.workunit.client.1.smithi195.stdout:4/965: dread - d1a/d1f/d21/d84/d9d/d8e/d9f/db2/d116/fbf zero size 2024-09-13T17:05:55.602 INFO:tasks.workunit.client.0.smithi115.stdout:3/765: dread d1/d12/d14/d61/fc3 [0,4194304] 0 2024-09-13T17:05:55.602 INFO:tasks.workunit.client.0.smithi115.stdout:3/766: fdatasync d1/d4b/d1a/d6e/f75 0 2024-09-13T17:05:55.602 INFO:tasks.workunit.client.1.smithi195.stdout:6/716: rename d1c/d24/fd5 to d1c/d24/d7f/dad/db9/d30/fec 0 2024-09-13T17:05:55.603 INFO:tasks.workunit.client.1.smithi195.stdout:9/831: getdents d6/d12/d86 0 2024-09-13T17:05:55.605 INFO:tasks.workunit.client.0.smithi115.stdout:3/767: getdents d1/dc2 0 2024-09-13T17:05:55.606 INFO:tasks.workunit.client.1.smithi195.stdout:1/731: fdatasync db/df/d13/da7/fc8 0 2024-09-13T17:05:55.606 INFO:tasks.workunit.client.1.smithi195.stdout:1/732: chown db/df/d13/f4b 1 1 2024-09-13T17:05:55.606 INFO:tasks.workunit.client.1.smithi195.stdout:7/778: symlink d5/db/d50/d7f/d82/dcc/l112 0 2024-09-13T17:05:55.607 INFO:tasks.workunit.client.1.smithi195.stdout:8/822: write d0/d17/d2f/d31/d101/d63/d71/de8/df6/df1/ff5 [206417,77427] 0 2024-09-13T17:05:55.607 INFO:tasks.workunit.client.1.smithi195.stdout:2/782: creat d0/d4a/d47/d73/d75/d88/d2c/fee x:0 0 0 2024-09-13T17:05:55.609 INFO:tasks.workunit.client.1.smithi195.stdout:5/804: rename d2/df/d78/d54/d106 to d2/d10e 0 2024-09-13T17:05:55.610 INFO:tasks.workunit.client.1.smithi195.stdout:5/805: write d2/f17 [4109068,4543] 0 2024-09-13T17:05:55.610 INFO:tasks.workunit.client.1.smithi195.stdout:5/806: stat d2/c4c 0 2024-09-13T17:05:55.611 INFO:tasks.workunit.client.1.smithi195.stdout:6/717: truncate d1c/d7d/f97 1974225 0 2024-09-13T17:05:55.611 INFO:tasks.workunit.client.1.smithi195.stdout:9/832: symlink d6/d19/l111 0 2024-09-13T17:05:55.611 INFO:tasks.workunit.client.1.smithi195.stdout:9/833: fsync d6/df/d13/fd7 0 2024-09-13T17:05:55.611 INFO:tasks.workunit.client.1.smithi195.stdout:9/834: chown d6/df/d16/d65/cba 17 1 2024-09-13T17:05:55.611 INFO:tasks.workunit.client.1.smithi195.stdout:9/835: fsync d6/f18 0 2024-09-13T17:05:55.611 INFO:tasks.workunit.client.1.smithi195.stdout:9/836: fsync d6/d19/d21/d5b/f83 0 2024-09-13T17:05:55.611 INFO:tasks.workunit.client.1.smithi195.stdout:1/733: creat db/d19/d5a/d66/d7a/ff7 x:0 0 0 2024-09-13T17:05:55.615 INFO:tasks.workunit.client.1.smithi195.stdout:4/966: link cf d1a/d1f/d21/d84/d9d/d8e/d9f/db2/d116/c14d 0 2024-09-13T17:05:55.617 INFO:tasks.workunit.client.1.smithi195.stdout:6/718: creat d1c/d24/d7f/dad/db9/d5e/fed x:0 0 0 2024-09-13T17:05:55.617 INFO:tasks.workunit.client.0.smithi115.stdout:1/505: dwrite d5/d26/f35 [0,4194304] 0 2024-09-13T17:05:55.617 INFO:tasks.workunit.client.0.smithi115.stdout:1/506: truncate d5/d7/f18 1596879 0 2024-09-13T17:05:55.617 INFO:tasks.workunit.client.0.smithi115.stdout:1/507: truncate d5/d3e/d59/f8b 1252900 0 2024-09-13T17:05:55.618 INFO:tasks.workunit.client.0.smithi115.stdout:1/508: write d5/d7/d5c/fa7 [1849829,57700] 0 2024-09-13T17:05:55.618 INFO:tasks.workunit.client.1.smithi195.stdout:3/777: dwrite d7/d19/d1e/f50 [0,4194304] 0 2024-09-13T17:05:55.618 INFO:tasks.workunit.client.1.smithi195.stdout:3/778: chown d7/d19/d1e/l5c 0 1 2024-09-13T17:05:55.619 INFO:tasks.workunit.client.1.smithi195.stdout:1/734: mknod db/cf8 0 2024-09-13T17:05:55.619 INFO:tasks.workunit.client.1.smithi195.stdout:5/807: dread d2/f7c [0,4194304] 0 2024-09-13T17:05:55.619 INFO:tasks.workunit.client.1.smithi195.stdout:5/808: chown d2/df/d78/deb/d4e/d10/d5c/fcf 26942630 1 2024-09-13T17:05:55.624 INFO:tasks.workunit.client.0.smithi115.stdout:1/509: mknod d5/d3e/cae 0 2024-09-13T17:05:55.625 INFO:tasks.workunit.client.1.smithi195.stdout:8/823: rmdir d0/d17/d2f/d7c/d4c 39 2024-09-13T17:05:55.627 INFO:tasks.workunit.client.1.smithi195.stdout:4/967: mkdir d1a/d1f/d21/d14e 0 2024-09-13T17:05:55.627 INFO:tasks.workunit.client.1.smithi195.stdout:4/968: fdatasync d1a/d1f/d21/d84/d9d/d58/f80 0 2024-09-13T17:05:55.627 INFO:tasks.workunit.client.0.smithi115.stdout:1/510: dread d5/d3e/d59/f8b [0,4194304] 0 2024-09-13T17:05:55.628 INFO:tasks.workunit.client.1.smithi195.stdout:2/783: rename d0/d4a/d47/d73/d75/d88/d1e/c70 to d0/d3/d3d/cef 0 2024-09-13T17:05:55.630 INFO:tasks.workunit.client.1.smithi195.stdout:6/719: creat d1c/d24/d7f/dad/db9/d8c/fee x:0 0 0 2024-09-13T17:05:55.630 INFO:tasks.workunit.client.1.smithi195.stdout:6/720: chown d1c/d24 40392725 1 2024-09-13T17:05:55.630 INFO:tasks.workunit.client.1.smithi195.stdout:6/721: creat d1c/d24/d7f/dad/db9/d30/fef x:0 0 0 2024-09-13T17:05:55.630 INFO:tasks.workunit.client.1.smithi195.stdout:0/782: getdents d7/db/d38/d5d 0 2024-09-13T17:05:55.630 INFO:tasks.workunit.client.1.smithi195.stdout:0/783: creat d7/d87/d9b/d4e/d68/ff8 x:0 0 0 2024-09-13T17:05:55.631 INFO:tasks.workunit.client.0.smithi115.stdout:1/511: rename d5/d7/l83 to d5/laf 0 2024-09-13T17:05:55.634 INFO:tasks.workunit.client.1.smithi195.stdout:8/824: write d0/d4/f5a [3730898,120506] 0 2024-09-13T17:05:55.634 INFO:tasks.workunit.client.1.smithi195.stdout:8/825: chown d0/d13/f88 65091567 1 2024-09-13T17:05:55.635 INFO:tasks.workunit.client.1.smithi195.stdout:1/735: read db/d19/d37/f6a [214415,16127] 0 2024-09-13T17:05:55.635 INFO:tasks.workunit.client.0.smithi115.stdout:1/512: rename d5/l38 to d5/d7/d5c/dab/lb0 0 2024-09-13T17:05:55.635 INFO:tasks.workunit.client.0.smithi115.stdout:1/513: write d5/d7/d33/d3a/f57 [1333291,4400] 0 2024-09-13T17:05:55.636 INFO:tasks.workunit.client.1.smithi195.stdout:5/809: symlink d2/l10f 0 2024-09-13T17:05:55.638 INFO:tasks.workunit.client.0.smithi115.stdout:1/514: mknod d5/d60/d7d/d87/cb1 0 2024-09-13T17:05:55.639 INFO:tasks.workunit.client.1.smithi195.stdout:7/779: dwrite d5/d35/fe2 [0,4194304] 0 2024-09-13T17:05:55.639 INFO:tasks.workunit.client.0.smithi115.stdout:3/768: dwrite d1/d4b/d69/d7b/fdf [0,4194304] 0 2024-09-13T17:05:55.641 INFO:tasks.workunit.client.1.smithi195.stdout:1/736: dread db/df/d4d/d74/fbd [0,4194304] 0 2024-09-13T17:05:55.642 INFO:tasks.workunit.client.0.smithi115.stdout:1/515: mkdir d5/d7/d33/d3a/db2 0 2024-09-13T17:05:55.643 INFO:tasks.workunit.client.1.smithi195.stdout:1/737: dread db/d19/d5a/f83 [0,4194304] 0 2024-09-13T17:05:55.643 INFO:tasks.workunit.client.1.smithi195.stdout:2/784: dwrite d0/d4a/d47/d73/d75/d88/d2c/d43/d63/f99 [0,4194304] 0 2024-09-13T17:05:55.644 INFO:tasks.workunit.client.1.smithi195.stdout:4/969: mkdir d1a/d1f/d21/d14e/d14f 0 2024-09-13T17:05:55.644 INFO:tasks.workunit.client.1.smithi195.stdout:4/970: write d1a/d1f/d21/d84/d9d/d8e/d9f/db2/d116/f120 [2640084,6266] 0 2024-09-13T17:05:55.646 INFO:tasks.workunit.client.1.smithi195.stdout:0/784: dread d7/d87/d9b/d4e/d68/f79 [0,4194304] 0 2024-09-13T17:05:55.646 INFO:tasks.workunit.client.1.smithi195.stdout:0/785: readlink d7/d87/d9b/d56/lb7 0 2024-09-13T17:05:55.648 INFO:tasks.workunit.client.0.smithi115.stdout:3/769: creat d1/d4b/d69/d7b/dbb/dcb/ffd x:0 0 0 2024-09-13T17:05:55.650 INFO:tasks.workunit.client.0.smithi115.stdout:1/516: creat d5/d26/d2c/fb3 x:0 0 0 2024-09-13T17:05:55.650 INFO:tasks.workunit.client.1.smithi195.stdout:1/738: write db/df/f39 [2837441,80085] 0 2024-09-13T17:05:55.650 INFO:tasks.workunit.client.1.smithi195.stdout:1/739: creat db/df/d4d/d74/ff9 x:0 0 0 2024-09-13T17:05:55.651 INFO:tasks.workunit.client.1.smithi195.stdout:1/740: fsync db/d19/d37/d3e/f4c 0 2024-09-13T17:05:55.652 INFO:tasks.workunit.client.1.smithi195.stdout:8/826: creat d0/d17/d2f/f118 x:0 0 0 2024-09-13T17:05:55.652 INFO:tasks.workunit.client.1.smithi195.stdout:8/827: write d0/d17/d2f/d31/d101/d63/d71/de8/f106 [129486,126564] 0 2024-09-13T17:05:55.654 INFO:tasks.workunit.client.1.smithi195.stdout:5/810: mkdir d2/df/d86/d110 0 2024-09-13T17:05:55.654 INFO:tasks.workunit.client.1.smithi195.stdout:5/811: chown d2/d88 37986835 1 2024-09-13T17:05:55.655 INFO:tasks.workunit.client.0.smithi115.stdout:1/517: link d5/d26/f4a d5/d3e/d59/d96/fb4 0 2024-09-13T17:05:55.665 INFO:tasks.workunit.client.1.smithi195.stdout:4/971: creat d1a/d1f/d43/d24/d41/d60/d6f/d124/f150 x:0 0 0 2024-09-13T17:05:55.667 INFO:tasks.workunit.client.1.smithi195.stdout:6/722: getdents d1c/d24/d49/d5f/db1 0 2024-09-13T17:05:55.671 INFO:tasks.workunit.client.0.smithi115.stdout:1/518: dwrite d5/d7/d33/d3a/f7a [0,4194304] 0 2024-09-13T17:05:55.671 INFO:tasks.workunit.client.0.smithi115.stdout:3/770: dwrite d1/d83/fef [0,4194304] 0 2024-09-13T17:05:55.671 INFO:tasks.workunit.client.1.smithi195.stdout:1/741: rmdir db/d19/d5a/d66/d96/dd0 39 2024-09-13T17:05:55.672 INFO:tasks.workunit.client.1.smithi195.stdout:1/742: fdatasync db/df/d4d/f52 0 2024-09-13T17:05:55.672 INFO:tasks.workunit.client.1.smithi195.stdout:1/743: dread - db/d19/d5a/d66/d7a/ff7 zero size 2024-09-13T17:05:55.672 INFO:tasks.workunit.client.1.smithi195.stdout:1/744: readlink db/df/d13/l5c 0 2024-09-13T17:05:55.672 INFO:tasks.workunit.client.1.smithi195.stdout:6/723: read d1c/d24/d49/d5f/d35/f36 [2516520,81591] 0 2024-09-13T17:05:55.673 INFO:tasks.workunit.client.1.smithi195.stdout:8/828: unlink d0/d17/d2f/d7c/d4c/c58 0 2024-09-13T17:05:55.675 INFO:tasks.workunit.client.1.smithi195.stdout:4/972: symlink d1a/d1f/d9c/dc2/l151 0 2024-09-13T17:05:55.675 INFO:tasks.workunit.client.1.smithi195.stdout:4/973: write d1a/d1f/d43/d24/d41/d60/fc5 [477061,41004] 0 2024-09-13T17:05:55.678 INFO:tasks.workunit.client.0.smithi115.stdout:1/519: rename d5/d26/f4a to d5/d26/d2c/fb5 0 2024-09-13T17:05:55.683 INFO:tasks.workunit.client.1.smithi195.stdout:8/829: mkdir d0/d17/d2f/d7c/d4c/d119 0 2024-09-13T17:05:55.683 INFO:tasks.workunit.client.1.smithi195.stdout:1/745: dread db/df/d4d/d74/f76 [0,4194304] 0 2024-09-13T17:05:55.683 INFO:tasks.workunit.client.1.smithi195.stdout:1/746: truncate db/df/d51/d62/d70/fca 867751 0 2024-09-13T17:05:55.684 INFO:tasks.workunit.client.0.smithi115.stdout:3/771: creat d1/d4b/d69/db6/ffe x:0 0 0 2024-09-13T17:05:55.688 INFO:tasks.workunit.client.1.smithi195.stdout:2/785: dwrite d0/d4a/d47/d73/d75/d88/d2c/d51/f79 [0,4194304] 0 2024-09-13T17:05:55.688 INFO:tasks.workunit.client.1.smithi195.stdout:2/786: dread - d0/d4a/d47/fec zero size 2024-09-13T17:05:55.688 INFO:tasks.workunit.client.1.smithi195.stdout:2/787: chown d0/d4a/d47/d73/d75/d88/d62/lbf 66450 1 2024-09-13T17:05:55.688 INFO:tasks.workunit.client.1.smithi195.stdout:4/974: dread d1a/d1f/d21/d84/d9d/f9b [0,4194304] 0 2024-09-13T17:05:55.689 INFO:tasks.workunit.client.0.smithi115.stdout:3/772: getdents d1/da4 0 2024-09-13T17:05:55.691 INFO:tasks.workunit.client.1.smithi195.stdout:4/975: dread d1a/d1f/d21/d22/f77 [0,4194304] 0 2024-09-13T17:05:55.693 INFO:tasks.workunit.client.1.smithi195.stdout:8/830: unlink d0/d17/d2f/d7c/d4c/d9b/ddf/fb8 0 2024-09-13T17:05:55.693 INFO:tasks.workunit.client.1.smithi195.stdout:8/831: fsync d0/d17/f1d 0 2024-09-13T17:05:55.694 INFO:tasks.workunit.client.1.smithi195.stdout:8/832: write d0/d17/d2f/d31/f37 [2741118,14198] 0 2024-09-13T17:05:55.694 INFO:tasks.workunit.client.1.smithi195.stdout:8/833: chown d0/d13/d52/c86 29986871 1 2024-09-13T17:05:55.694 INFO:tasks.workunit.client.1.smithi195.stdout:8/834: write d0/d17/d2f/d7c/fca [1069802,125639] 0 2024-09-13T17:05:55.694 INFO:tasks.workunit.client.1.smithi195.stdout:8/835: fsync d0/f61 0 2024-09-13T17:05:55.696 INFO:tasks.workunit.client.1.smithi195.stdout:2/788: symlink d0/d4a/d47/d73/d75/d88/d62/lf0 0 2024-09-13T17:05:55.697 INFO:tasks.workunit.client.1.smithi195.stdout:1/747: dwrite db/df/f7f [0,4194304] 0 2024-09-13T17:05:55.700 INFO:tasks.workunit.client.1.smithi195.stdout:1/748: chown db/d19/d5a/fd3 10058 1 2024-09-13T17:05:55.701 INFO:tasks.workunit.client.0.smithi115.stdout:1/520: link d5/d26/d2c/fb5 d5/d60/d7d/fb6 0 2024-09-13T17:05:55.701 INFO:tasks.workunit.client.0.smithi115.stdout:1/521: truncate d5/d26/d2c/fb3 969780 0 2024-09-13T17:05:55.701 INFO:tasks.workunit.client.0.smithi115.stdout:1/522: write d5/d7/d33/f54 [641829,40862] 0 2024-09-13T17:05:55.701 INFO:tasks.workunit.client.1.smithi195.stdout:4/976: creat d1a/d1f/d43/d5a/d63/dd1/d121/f152 x:0 0 0 2024-09-13T17:05:55.701 INFO:tasks.workunit.client.1.smithi195.stdout:4/977: read - d1a/d1f/d21/d84/f14b zero size 2024-09-13T17:05:55.701 INFO:tasks.workunit.client.1.smithi195.stdout:4/978: read d1a/d1f/d43/d5a/d63/dd1/ffe [1925918,49459] 0 2024-09-13T17:05:55.702 INFO:tasks.workunit.client.1.smithi195.stdout:6/724: rename d1c/d24/d7f/dad to d1c/df0 0 2024-09-13T17:05:55.707 INFO:tasks.workunit.client.1.smithi195.stdout:6/725: dread d1c/fa1 [0,4194304] 0 2024-09-13T17:05:55.710 INFO:tasks.workunit.client.1.smithi195.stdout:1/749: rmdir db/d19/d37 39 2024-09-13T17:05:55.710 INFO:tasks.workunit.client.1.smithi195.stdout:1/750: fdatasync db/d19/d37/d3e/fc9 0 2024-09-13T17:05:55.710 INFO:tasks.workunit.client.1.smithi195.stdout:1/751: write db/df/d4d/fc7 [360013,68288] 0 2024-09-13T17:05:55.712 INFO:tasks.workunit.client.1.smithi195.stdout:8/836: rename d0/d62/ld6 to d0/d17/d2f/d31/d101/d63/d71/de8/df6/l11a 0 2024-09-13T17:05:55.713 INFO:tasks.workunit.client.1.smithi195.stdout:2/789: mkdir d0/df1 0 2024-09-13T17:05:55.715 INFO:tasks.workunit.client.1.smithi195.stdout:8/837: mknod d0/d17/d2f/d7c/d4c/d9a/dcd/c11b 0 2024-09-13T17:05:55.716 INFO:tasks.workunit.client.1.smithi195.stdout:2/790: unlink d0/d4a/d47/d73/d75/d88/d2c/d43/d63/db2/fb8 0 2024-09-13T17:05:55.717 INFO:tasks.workunit.client.1.smithi195.stdout:2/791: chown d0/d4a/d47/d73/d75/d88/d2c/d43/d63/db2/db3 5 1 2024-09-13T17:05:55.717 INFO:tasks.workunit.client.1.smithi195.stdout:8/838: creat d0/d17/d2f/d7c/d4c/d9a/da5/f11c x:0 0 0 2024-09-13T17:05:55.718 INFO:tasks.workunit.client.1.smithi195.stdout:8/839: chown d0/fc 660 1 2024-09-13T17:05:55.719 INFO:tasks.workunit.client.1.smithi195.stdout:8/840: link d0/d17/c18 d0/d17/d2f/d7c/d4c/d9a/d109/c11d 0 2024-09-13T17:05:55.721 INFO:tasks.workunit.client.0.smithi115.stdout:1/523: dwrite d5/d7/d5c/fa6 [0,4194304] 0 2024-09-13T17:05:55.721 INFO:tasks.workunit.client.0.smithi115.stdout:1/524: creat d5/d3e/d59/fb7 x:0 0 0 2024-09-13T17:05:55.721 INFO:tasks.workunit.client.0.smithi115.stdout:1/525: fdatasync d5/d60/f5e 0 2024-09-13T17:05:55.722 INFO:tasks.workunit.client.0.smithi115.stdout:1/526: stat d5/d26/d2c/d89/fa3 0 2024-09-13T17:05:55.722 INFO:tasks.workunit.client.0.smithi115.stdout:3/773: dwrite d1/da6/dd1/fde [0,4194304] 0 2024-09-13T17:05:55.723 INFO:tasks.workunit.client.0.smithi115.stdout:3/774: fsync d1/d4b/d1a/f4e 0 2024-09-13T17:05:55.723 INFO:tasks.workunit.client.0.smithi115.stdout:3/775: fdatasync d1/d4b/d69/d7b/dbb/fda 0 2024-09-13T17:05:55.725 INFO:tasks.workunit.client.1.smithi195.stdout:1/752: dread db/d19/d37/f4e [0,4194304] 0 2024-09-13T17:05:55.726 INFO:tasks.workunit.client.0.smithi115.stdout:1/527: rmdir d5/d7/d33/da2 0 2024-09-13T17:05:55.727 INFO:tasks.workunit.client.1.smithi195.stdout:1/753: creat db/d19/d37/d46/d7e/ffa x:0 0 0 2024-09-13T17:05:55.728 INFO:tasks.workunit.client.1.smithi195.stdout:4/979: dwrite f8 [0,4194304] 0 2024-09-13T17:05:55.729 INFO:tasks.workunit.client.1.smithi195.stdout:4/980: write d1a/f106 [517881,125895] 0 2024-09-13T17:05:55.729 INFO:tasks.workunit.client.1.smithi195.stdout:4/981: chown d1a/f4a 16007839 1 2024-09-13T17:05:55.729 INFO:tasks.workunit.client.1.smithi195.stdout:4/982: write d1a/d1f/d108/f12c [314698,61212] 0 2024-09-13T17:05:55.729 INFO:tasks.workunit.client.1.smithi195.stdout:2/792: write d0/f21 [4042360,43183] 0 2024-09-13T17:05:55.729 INFO:tasks.workunit.client.1.smithi195.stdout:6/726: dwrite f17 [4194304,4194304] 0 2024-09-13T17:05:55.729 INFO:tasks.workunit.client.1.smithi195.stdout:6/727: stat d1c/df0/db9/d30/c9d 0 2024-09-13T17:05:55.729 INFO:tasks.workunit.client.0.smithi115.stdout:3/776: mknod d1/d4b/d69/d7b/d8b/d90/deb/cff 0 2024-09-13T17:05:55.731 INFO:tasks.workunit.client.1.smithi195.stdout:4/983: symlink d1a/d1f/d21/d36/d146/l153 0 2024-09-13T17:05:55.734 INFO:tasks.workunit.client.1.smithi195.stdout:8/841: dread d0/d17/d2f/d31/d101/d63/d71/de8/df6/df1/ff5 [0,4194304] 0 2024-09-13T17:05:55.734 INFO:tasks.workunit.client.1.smithi195.stdout:9/837: sync 2024-09-13T17:05:55.736 INFO:tasks.workunit.client.0.smithi115.stdout:3/777: rename d1/d12/cc1 to d1/d83/d9d/c100 0 2024-09-13T17:05:55.736 INFO:tasks.workunit.client.0.smithi115.stdout:3/778: write d1/da6/dd1/ff7 [966759,51866] 0 2024-09-13T17:05:55.736 INFO:tasks.workunit.client.0.smithi115.stdout:3/779: chown d1/f1d 8940 1 2024-09-13T17:05:55.736 INFO:tasks.workunit.client.0.smithi115.stdout:3/780: write d1/d4b/f76 [3268110,17135] 0 2024-09-13T17:05:55.748 INFO:tasks.workunit.client.1.smithi195.stdout:2/793: creat d0/d4a/d47/d73/d75/d88/ff2 x:0 0 0 2024-09-13T17:05:55.748 INFO:tasks.workunit.client.1.smithi195.stdout:2/794: write d0/d4a/d47/d73/d75/d88/d1e/f65 [43264,84661] 0 2024-09-13T17:05:55.749 INFO:tasks.workunit.client.1.smithi195.stdout:6/728: getdents d1c/d24/d49/d5f/d35/d88 0 2024-09-13T17:05:55.749 INFO:tasks.workunit.client.1.smithi195.stdout:9/838: dwrite d6/d19/d21/fc7 [0,4194304] 0 2024-09-13T17:05:55.749 INFO:tasks.workunit.client.0.smithi115.stdout:1/528: dwrite d5/f6 [0,4194304] 0 2024-09-13T17:05:55.750 INFO:tasks.workunit.client.0.smithi115.stdout:1/529: chown d5/d26/f4d 0 1 2024-09-13T17:05:55.750 INFO:tasks.workunit.client.0.smithi115.stdout:1/530: stat d5/d7/l36 0 2024-09-13T17:05:55.750 INFO:tasks.workunit.client.0.smithi115.stdout:1/531: write d5/d7/d5c/f7b [223091,122598] 0 2024-09-13T17:05:55.750 INFO:tasks.workunit.client.0.smithi115.stdout:1/532: chown d5/d3e/l46 11392852 1 2024-09-13T17:05:55.750 INFO:tasks.workunit.client.0.smithi115.stdout:3/781: creat d1/d4b/d1a/f101 x:0 0 0 2024-09-13T17:05:55.751 INFO:tasks.workunit.client.1.smithi195.stdout:1/754: truncate db/df/f7f 3916911 0 2024-09-13T17:05:55.753 INFO:tasks.workunit.client.0.smithi115.stdout:1/533: creat d5/d3e/d59/d96/fb8 x:0 0 0 2024-09-13T17:05:55.753 INFO:tasks.workunit.client.0.smithi115.stdout:1/534: chown d5/d7/d33/f53 185 1 2024-09-13T17:05:55.753 INFO:tasks.workunit.client.1.smithi195.stdout:4/984: write f12 [4589712,72543] 0 2024-09-13T17:05:55.754 INFO:tasks.workunit.client.0.smithi115.stdout:3/782: symlink d1/da4/l102 0 2024-09-13T17:05:55.756 INFO:tasks.workunit.client.0.smithi115.stdout:1/535: rename d5/d7/d5c/fa6 to d5/d7/d86/fb9 0 2024-09-13T17:05:55.757 INFO:tasks.workunit.client.1.smithi195.stdout:1/755: dread db/df/d13/f21 [0,4194304] 0 2024-09-13T17:05:55.757 INFO:tasks.workunit.client.1.smithi195.stdout:1/756: write db/d19/d37/d3e/f43 [96555,126201] 0 2024-09-13T17:05:55.758 INFO:tasks.workunit.client.0.smithi115.stdout:3/783: link d1/l67 d1/d4b/l103 0 2024-09-13T17:05:55.758 INFO:tasks.workunit.client.0.smithi115.stdout:3/784: read d1/d12/d14/f19 [190544,105577] 0 2024-09-13T17:05:55.758 INFO:tasks.workunit.client.0.smithi115.stdout:3/785: fsync d1/d4b/d1a/d6e/f75 0 2024-09-13T17:05:55.759 INFO:tasks.workunit.client.1.smithi195.stdout:2/795: symlink d0/d4a/d47/d73/d75/d88/d2c/d51/lf3 0 2024-09-13T17:05:55.761 INFO:tasks.workunit.client.0.smithi115.stdout:1/536: creat d5/fba x:0 0 0 2024-09-13T17:05:55.761 INFO:tasks.workunit.client.0.smithi115.stdout:1/537: creat d5/d3e/d59/d96/fbb x:0 0 0 2024-09-13T17:05:55.762 INFO:tasks.workunit.client.1.smithi195.stdout:6/729: mknod d1c/df0/db9/d30/d6f/cf1 0 2024-09-13T17:05:55.766 INFO:tasks.workunit.client.1.smithi195.stdout:9/839: link d6/d19/d21/d45/dad/cee d6/df/d16/d5c/dcf/dd4/c112 0 2024-09-13T17:05:55.768 INFO:tasks.workunit.client.1.smithi195.stdout:6/730: dread d1c/df0/db9/d30/f92 [0,4194304] 0 2024-09-13T17:05:55.768 INFO:tasks.workunit.client.1.smithi195.stdout:6/731: fsync d1c/d24/f51 0 2024-09-13T17:05:55.768 INFO:tasks.workunit.client.1.smithi195.stdout:6/732: dread - d1c/d24/d49/d5f/d85/fe8 zero size 2024-09-13T17:05:55.768 INFO:tasks.workunit.client.1.smithi195.stdout:6/733: write d1c/d24/d49/d5f/f41 [1543045,113077] 0 2024-09-13T17:05:55.768 INFO:tasks.workunit.client.1.smithi195.stdout:6/734: chown d1c/d24/l86 18056 1 2024-09-13T17:05:55.769 INFO:tasks.workunit.client.0.smithi115.stdout:1/538: mkdir d5/d7/d5c/dbc 0 2024-09-13T17:05:55.769 INFO:tasks.workunit.client.1.smithi195.stdout:6/735: write d1c/d24/d49/d5f/f58 [500259,53693] 0 2024-09-13T17:05:55.769 INFO:tasks.workunit.client.1.smithi195.stdout:6/736: dread - d1c/df0/feb zero size 2024-09-13T17:05:55.769 INFO:tasks.workunit.client.1.smithi195.stdout:4/985: mkdir d1a/d1f/d43/d5a/d63/dd1/d121/d136/d154 0 2024-09-13T17:05:55.771 INFO:tasks.workunit.client.1.smithi195.stdout:8/842: mkdir d0/d17/d2f/d31/d101/d63/d71/de8/d11e 0 2024-09-13T17:05:55.771 INFO:tasks.workunit.client.1.smithi195.stdout:8/843: dread - d0/d17/d2f/f118 zero size 2024-09-13T17:05:55.771 INFO:tasks.workunit.client.1.smithi195.stdout:8/844: creat d0/d4/f11f x:0 0 0 2024-09-13T17:05:55.772 INFO:tasks.workunit.client.1.smithi195.stdout:1/757: creat db/d58/ffb x:0 0 0 2024-09-13T17:05:55.773 INFO:tasks.workunit.client.1.smithi195.stdout:3/779: sync 2024-09-13T17:05:55.773 INFO:tasks.workunit.client.1.smithi195.stdout:0/786: sync 2024-09-13T17:05:55.773 INFO:tasks.workunit.client.1.smithi195.stdout:7/780: sync 2024-09-13T17:05:55.773 INFO:tasks.workunit.client.1.smithi195.stdout:5/812: sync 2024-09-13T17:05:55.773 INFO:tasks.workunit.client.1.smithi195.stdout:7/781: fsync d5/d13/f32 0 2024-09-13T17:05:55.774 INFO:tasks.workunit.client.1.smithi195.stdout:8/845: dread d0/f89 [0,4194304] 0 2024-09-13T17:05:55.775 INFO:tasks.workunit.client.1.smithi195.stdout:9/840: dread d6/df/d16/d5c/dcf/dd4/fe6 [0,4194304] 0 2024-09-13T17:05:55.775 INFO:tasks.workunit.client.1.smithi195.stdout:9/841: fsync d6/d12/f46 0 2024-09-13T17:05:55.775 INFO:tasks.workunit.client.1.smithi195.stdout:9/842: chown d6/d12/d86/da7 15055 1 2024-09-13T17:05:55.777 INFO:tasks.workunit.client.1.smithi195.stdout:6/737: mknod d1c/d24/d49/d5f/db1/d95/cf2 0 2024-09-13T17:05:55.779 INFO:tasks.workunit.client.0.smithi115.stdout:1/539: write d5/d7/d33/d3a/f7a [1053254,64509] 0 2024-09-13T17:05:55.787 INFO:tasks.workunit.client.1.smithi195.stdout:9/843: dwrite d6/df/d16/de3/d68/d6d/fa2 [0,4194304] 0 2024-09-13T17:05:55.787 INFO:tasks.workunit.client.1.smithi195.stdout:9/844: stat d6/d19/d21/d45/f99 0 2024-09-13T17:05:55.936 INFO:tasks.workunit.client.1.smithi195.stdout:1/758: mknod db/d19/d5a/d66/df2/cfc 0 2024-09-13T17:05:55.939 INFO:tasks.workunit.client.1.smithi195.stdout:5/813: mknod d2/df/c111 0 2024-09-13T17:05:55.942 INFO:tasks.workunit.client.1.smithi195.stdout:3/780: creat d7/d21/d2a/ffe x:0 0 0 2024-09-13T17:05:55.942 INFO:tasks.workunit.client.1.smithi195.stdout:3/781: write d7/d19/fb2 [417062,44094] 0 2024-09-13T17:05:55.946 INFO:tasks.workunit.client.1.smithi195.stdout:8/846: creat d0/d17/d2f/d31/db4/dfc/f120 x:0 0 0 2024-09-13T17:05:55.951 INFO:tasks.workunit.client.1.smithi195.stdout:2/796: getdents d0/d4a/d47/d73/d75/d88/d1e 0 2024-09-13T17:05:55.955 INFO:tasks.workunit.client.1.smithi195.stdout:4/986: getdents d1a/d1f/d43/d5a/d63/dd1/d121/d136 0 2024-09-13T17:05:55.957 INFO:tasks.workunit.client.1.smithi195.stdout:2/797: write d0/d4a/d47/d73/d75/d88/d2c/d51/f81 [1653156,123583] 0 2024-09-13T17:05:55.957 INFO:tasks.workunit.client.1.smithi195.stdout:6/738: creat d1c/d24/d49/d5f/db1/ff3 x:0 0 0 2024-09-13T17:05:55.958 INFO:tasks.workunit.client.1.smithi195.stdout:6/739: dread d1c/df0/db9/d30/d6f/fdf [0,4194304] 0 2024-09-13T17:05:55.959 INFO:tasks.workunit.client.1.smithi195.stdout:5/814: dwrite d2/df/d90/dbb/dec/d10a/fbf [0,4194304] 0 2024-09-13T17:05:55.959 INFO:tasks.workunit.client.1.smithi195.stdout:5/815: fsync d2/df/d78/deb/d4e/d10/d8f/fa0 0 2024-09-13T17:05:55.959 INFO:tasks.workunit.client.1.smithi195.stdout:5/816: fsync d2/df/d78/deb/d4e/d10/d46/f96 0 2024-09-13T17:05:55.964 INFO:tasks.workunit.client.1.smithi195.stdout:9/845: creat d6/df/d13/f113 x:0 0 0 2024-09-13T17:05:55.972 INFO:tasks.workunit.client.0.smithi115.stdout:0/358: sync 2024-09-13T17:05:55.988 INFO:tasks.workunit.client.1.smithi195.stdout:6/740: dwrite d1c/df0/db9/d8c/fee [0,4194304] 0 2024-09-13T17:05:55.989 INFO:tasks.workunit.client.1.smithi195.stdout:6/741: dread d1c/df0/db9/d5e/fa0 [0,4194304] 0 2024-09-13T17:05:55.989 INFO:tasks.workunit.client.1.smithi195.stdout:6/742: write d1c/df0/db9/f40 [561622,8282] 0 2024-09-13T17:05:56.035 INFO:tasks.workunit.client.0.smithi115.stdout:1/540: getdents d5/d60 0 2024-09-13T17:05:56.038 INFO:tasks.workunit.client.0.smithi115.stdout:0/359: truncate d9/d1d/f42 1878928 0 2024-09-13T17:05:56.041 INFO:tasks.workunit.client.0.smithi115.stdout:1/541: dread d5/d26/d2c/d89/fa9 [0,4194304] 0 2024-09-13T17:05:56.046 INFO:tasks.workunit.client.0.smithi115.stdout:1/542: symlink d5/d7/d33/d3a/db2/lbd 0 2024-09-13T17:05:56.046 INFO:tasks.workunit.client.0.smithi115.stdout:1/543: write d5/d3e/d59/f8b [2146634,14429] 0 2024-09-13T17:05:56.049 INFO:tasks.workunit.client.0.smithi115.stdout:1/544: creat d5/d7/d5c/dab/fbe x:0 0 0 2024-09-13T17:05:56.068 INFO:tasks.workunit.client.1.smithi195.stdout:1/759: creat db/d19/d37/ffd x:0 0 0 2024-09-13T17:05:56.069 INFO:tasks.workunit.client.1.smithi195.stdout:1/760: chown db/df/f39 1645 1 2024-09-13T17:05:56.069 INFO:tasks.workunit.client.1.smithi195.stdout:3/782: symlink d7/d19/lff 0 2024-09-13T17:05:56.070 INFO:tasks.workunit.client.1.smithi195.stdout:4/987: symlink d1a/d1f/d21/d84/d9d/l155 0 2024-09-13T17:05:56.072 INFO:tasks.workunit.client.1.smithi195.stdout:9/846: getdents d6/d8d 0 2024-09-13T17:05:56.074 INFO:tasks.workunit.client.1.smithi195.stdout:6/743: link d1c/df0/db9/f32 d1c/d24/d49/d5f/de1/ff4 0 2024-09-13T17:05:56.075 INFO:tasks.workunit.client.1.smithi195.stdout:1/761: creat db/df/d4d/d74/dee/ffe x:0 0 0 2024-09-13T17:05:56.075 INFO:tasks.workunit.client.1.smithi195.stdout:1/762: fdatasync db/d19/f64 0 2024-09-13T17:05:56.075 INFO:tasks.workunit.client.1.smithi195.stdout:1/763: fsync db/df/d13/f22 0 2024-09-13T17:05:56.076 INFO:tasks.workunit.client.1.smithi195.stdout:6/744: read d1c/fa1 [1012961,75485] 0 2024-09-13T17:05:56.077 INFO:tasks.workunit.client.1.smithi195.stdout:4/988: creat d1a/d1f/d21/d84/d9d/d58/f156 x:0 0 0 2024-09-13T17:05:56.077 INFO:tasks.workunit.client.1.smithi195.stdout:6/745: write d1c/f6c [657431,1015] 0 2024-09-13T17:05:56.079 INFO:tasks.workunit.client.1.smithi195.stdout:1/764: symlink db/df/d51/d8e/lff 0 2024-09-13T17:05:56.079 INFO:tasks.workunit.client.1.smithi195.stdout:1/765: readlink db/d19/d37/d46/d7e/ldc 0 2024-09-13T17:05:56.081 INFO:tasks.workunit.client.1.smithi195.stdout:1/766: mkdir db/df/d51/d62/d70/d100 0 2024-09-13T17:05:56.095 INFO:tasks.workunit.client.0.smithi115.stdout:9/379: sync 2024-09-13T17:05:56.096 INFO:tasks.workunit.client.0.smithi115.stdout:9/380: mkdir d0/de/d37/d83 0 2024-09-13T17:05:56.097 INFO:tasks.workunit.client.0.smithi115.stdout:9/381: dread d0/d21/d4f/f72 [0,4194304] 0 2024-09-13T17:05:56.101 INFO:tasks.workunit.client.1.smithi195.stdout:6/746: dwrite d1c/df0/db9/d30/fef [0,4194304] 0 2024-09-13T17:05:56.101 INFO:tasks.workunit.client.1.smithi195.stdout:6/747: fsync d1c/d7d/f97 0 2024-09-13T17:05:56.101 INFO:tasks.workunit.client.1.smithi195.stdout:6/748: readlink d1c/d24/d49/d5f/d85/da5/lc8 0 2024-09-13T17:05:56.101 INFO:tasks.workunit.client.1.smithi195.stdout:1/767: dwrite db/df/d13/da7/fb7 [0,4194304] 0 2024-09-13T17:05:56.105 INFO:tasks.workunit.client.0.smithi115.stdout:1/545: unlink d5/d3e/cae 0 2024-09-13T17:05:56.109 INFO:tasks.workunit.client.0.smithi115.stdout:1/546: unlink d5/d3e/l8f 0 2024-09-13T17:05:56.109 INFO:tasks.workunit.client.0.smithi115.stdout:9/382: dread d0/f16 [0,4194304] 0 2024-09-13T17:05:56.109 INFO:tasks.workunit.client.0.smithi115.stdout:9/383: stat d0/d21/d65 0 2024-09-13T17:05:56.111 INFO:tasks.workunit.client.0.smithi115.stdout:9/384: creat d0/d21/d65/f84 x:0 0 0 2024-09-13T17:05:56.112 INFO:tasks.workunit.client.0.smithi115.stdout:9/385: getdents d0/d21 0 2024-09-13T17:05:56.113 INFO:tasks.workunit.client.0.smithi115.stdout:9/386: chown d0 235944 1 2024-09-13T17:05:56.120 INFO:tasks.workunit.client.1.smithi195.stdout:1/768: dwrite db/d19/d37/ffd [0,4194304] 0 2024-09-13T17:05:56.122 INFO:tasks.workunit.client.1.smithi195.stdout:1/769: truncate db/df/f3a 1226204 0 2024-09-13T17:05:56.127 INFO:tasks.workunit.client.0.smithi115.stdout:9/387: rename d0/de/f1e to d0/d21/d65/d79/f85 0 2024-09-13T17:05:56.131 INFO:tasks.workunit.client.0.smithi115.stdout:9/388: rename d0/de/d37/d5a to d0/de/d10/d15/d86 0 2024-09-13T17:05:56.131 INFO:tasks.workunit.client.0.smithi115.stdout:9/389: truncate d0/d34/f4c 796740 0 2024-09-13T17:05:56.131 INFO:tasks.workunit.client.0.smithi115.stdout:9/390: symlink d0/d21/d42/l87 0 2024-09-13T17:05:56.136 INFO:tasks.workunit.client.1.smithi195.stdout:4/989: rename d1a/d1f/d21/d22/d98 to d1a/d1f/d21/d22/d157 0 2024-09-13T17:05:56.141 INFO:tasks.workunit.client.0.smithi115.stdout:0/360: dwrite d9/d1d/f42 [0,4194304] 0 2024-09-13T17:05:56.141 INFO:tasks.workunit.client.1.smithi195.stdout:1/770: dwrite db/d19/d37/f4e [0,4194304] 0 2024-09-13T17:05:56.143 INFO:tasks.workunit.client.0.smithi115.stdout:0/361: rename d9/d1d/d24/d26/d36/d48/f4d to d9/d1d/d24/d26/d36/d48/f68 0 2024-09-13T17:05:56.146 INFO:tasks.workunit.client.1.smithi195.stdout:1/771: link db/d19/d5a/db0/c95 db/d19/d37/c101 0 2024-09-13T17:05:56.152 INFO:tasks.workunit.client.1.smithi195.stdout:5/817: unlink d2/c14 0 2024-09-13T17:05:56.152 INFO:tasks.workunit.client.1.smithi195.stdout:5/818: readlink d2/df/d78/le7 0 2024-09-13T17:05:56.152 INFO:tasks.workunit.client.1.smithi195.stdout:5/819: stat d2/df/d48/d5a/d92/c94 0 2024-09-13T17:05:56.153 INFO:tasks.workunit.client.1.smithi195.stdout:5/820: mknod d2/df/d86/c112 0 2024-09-13T17:05:56.154 INFO:tasks.workunit.client.0.smithi115.stdout:0/362: read d9/d1d/d24/f25 [2651028,47651] 0 2024-09-13T17:05:56.154 INFO:tasks.workunit.client.1.smithi195.stdout:5/821: creat d2/df/d78/d76/f113 x:0 0 0 2024-09-13T17:05:56.155 INFO:tasks.workunit.client.1.smithi195.stdout:5/822: rmdir d2/df/d62 39 2024-09-13T17:05:56.157 INFO:tasks.workunit.client.0.smithi115.stdout:9/391: dwrite d0/f1d [0,4194304] 0 2024-09-13T17:05:56.157 INFO:tasks.workunit.client.1.smithi195.stdout:5/823: truncate d2/d3e/f16 6421854 0 2024-09-13T17:05:56.157 INFO:tasks.workunit.client.1.smithi195.stdout:5/824: chown d2/df/d48 13312 1 2024-09-13T17:05:56.157 INFO:tasks.workunit.client.1.smithi195.stdout:5/825: write d2/d3e/f3a [1559075,10328] 0 2024-09-13T17:05:56.158 INFO:tasks.workunit.client.1.smithi195.stdout:5/826: mkdir d2/df/d78/d76/d114 0 2024-09-13T17:05:56.158 INFO:tasks.workunit.client.1.smithi195.stdout:4/990: dwrite d1a/d1f/d21/d22/f115 [0,4194304] 0 2024-09-13T17:05:56.160 INFO:tasks.workunit.client.1.smithi195.stdout:5/827: creat d2/df/d78/d54/de5/f115 x:0 0 0 2024-09-13T17:05:56.163 INFO:tasks.workunit.client.1.smithi195.stdout:4/991: mknod d1a/d1f/d43/d5a/d63/db8/dc8/c158 0 2024-09-13T17:05:56.165 INFO:tasks.workunit.client.1.smithi195.stdout:4/992: creat d1a/d1f/d21/d22/d157/da3/d123/f159 x:0 0 0 2024-09-13T17:05:56.166 INFO:tasks.workunit.client.1.smithi195.stdout:7/782: rename d5/f9e to d5/db/d19/d22/f113 0 2024-09-13T17:05:56.166 INFO:tasks.workunit.client.1.smithi195.stdout:4/993: mknod d1a/d1f/d108/d10b/c15a 0 2024-09-13T17:05:56.169 INFO:tasks.workunit.client.0.smithi115.stdout:9/392: write d0/de/d37/f41 [4684583,53213] 0 2024-09-13T17:05:56.169 INFO:tasks.workunit.client.0.smithi115.stdout:9/393: fdatasync d0/de/d10/d15/f3a 0 2024-09-13T17:05:56.170 INFO:tasks.workunit.client.1.smithi195.stdout:7/783: dread d5/db/d19/fb4 [0,4194304] 0 2024-09-13T17:05:56.171 INFO:tasks.workunit.client.1.smithi195.stdout:4/994: link d1a/d1f/d9c/dc2/fd2 d1a/d1f/d21/d84/d9d/df6/f15b 0 2024-09-13T17:05:56.172 INFO:tasks.workunit.client.1.smithi195.stdout:4/995: fsync d1a/d1f/d21/f104 0 2024-09-13T17:05:56.172 INFO:tasks.workunit.client.1.smithi195.stdout:4/996: readlink d1a/lfa 0 2024-09-13T17:05:56.173 INFO:tasks.workunit.client.1.smithi195.stdout:7/784: getdents d5/d13/d24 0 2024-09-13T17:05:56.174 INFO:tasks.workunit.client.1.smithi195.stdout:4/997: truncate fd 2314116 0 2024-09-13T17:05:56.174 INFO:tasks.workunit.client.1.smithi195.stdout:4/998: read d1a/d1f/d43/d24/d41/f70 [352051,38396] 0 2024-09-13T17:05:56.176 INFO:tasks.workunit.client.1.smithi195.stdout:8/847: rename d0/d17/d2f/d7c/d4c/d9b/ddf to d0/d121 0 2024-09-13T17:05:56.178 INFO:tasks.workunit.client.1.smithi195.stdout:7/785: truncate d5/db/d50/f87 222797 0 2024-09-13T17:05:56.179 INFO:tasks.workunit.client.1.smithi195.stdout:4/999: creat d1a/d1f/d21/d14e/d14f/f15c x:0 0 0 2024-09-13T17:05:56.180 INFO:tasks.workunit.client.1.smithi195.stdout:1/772: unlink db/f6b 0 2024-09-13T17:05:56.183 INFO:tasks.workunit.client.1.smithi195.stdout:2/798: rename d0/d4a/d47/d73/d75/d88/l6a to d0/d4a/d47/d73/d75/d88/d2c/d51/lf4 0 2024-09-13T17:05:56.183 INFO:tasks.workunit.client.1.smithi195.stdout:2/799: dread - d0/d4a/d47/d73/d75/f77 zero size 2024-09-13T17:05:56.193 INFO:tasks.workunit.client.1.smithi195.stdout:5/828: dwrite d2/d3e/f3a [0,4194304] 0 2024-09-13T17:05:56.193 INFO:tasks.workunit.client.1.smithi195.stdout:5/829: dread - d2/df/d78/deb/d4e/d10/d8f/dc9/fe4 zero size 2024-09-13T17:05:56.195 INFO:tasks.workunit.client.0.smithi115.stdout:9/394: dwrite d0/de/d10/f60 [0,4194304] 0 2024-09-13T17:05:56.196 INFO:tasks.workunit.client.1.smithi195.stdout:2/800: creat d0/d4a/d47/d73/d75/d88/ff5 x:0 0 0 2024-09-13T17:05:56.196 INFO:tasks.workunit.client.1.smithi195.stdout:2/801: write d0/d3/f82 [764255,71670] 0 2024-09-13T17:05:56.198 INFO:tasks.workunit.client.1.smithi195.stdout:3/783: rename d7/d21/d2a/d4a/d5a/c72 to d7/d21/d2a/d35/d60/d6f/d74/c100 0 2024-09-13T17:05:56.203 INFO:tasks.workunit.client.1.smithi195.stdout:7/786: dwrite d5/d13/d30/fd0 [0,4194304] 0 2024-09-13T17:05:56.205 INFO:tasks.workunit.client.1.smithi195.stdout:3/784: write f5 [3942889,118491] 0 2024-09-13T17:05:56.205 INFO:tasks.workunit.client.1.smithi195.stdout:1/773: dwrite db/d19/d5a/fc0 [0,4194304] 0 2024-09-13T17:05:56.206 INFO:tasks.workunit.client.1.smithi195.stdout:3/785: read d7/d19/fb2 [331778,97450] 0 2024-09-13T17:05:56.206 INFO:tasks.workunit.client.1.smithi195.stdout:3/786: chown d7/d21/d2a/d35/d8f 79416422 1 2024-09-13T17:05:56.208 INFO:tasks.workunit.client.1.smithi195.stdout:9/847: rename d6/d8d/c100 to d6/df/d16/de3/d68/de2/c114 0 2024-09-13T17:05:56.209 INFO:tasks.workunit.client.0.smithi115.stdout:0/363: getdents d9/d1d/d24/d26/d36/d48 0 2024-09-13T17:05:56.209 INFO:tasks.workunit.client.0.smithi115.stdout:0/364: chown d9/d1d/d24/d26/d2d/c43 145503188 1 2024-09-13T17:05:56.213 INFO:tasks.workunit.client.1.smithi195.stdout:7/787: dread d5/d13/d30/f7a [0,4194304] 0 2024-09-13T17:05:56.214 INFO:tasks.workunit.client.0.smithi115.stdout:0/365: getdents d9 0 2024-09-13T17:05:56.214 INFO:tasks.workunit.client.0.smithi115.stdout:0/366: readlink d9/d1d/d24/d26/l35 0 2024-09-13T17:05:56.217 INFO:tasks.workunit.client.1.smithi195.stdout:9/848: dread d6/df/d16/de3/d68/fbd [0,4194304] 0 2024-09-13T17:05:56.222 INFO:tasks.workunit.client.1.smithi195.stdout:1/774: dwrite db/d19/d5a/d66/d96/fed [0,4194304] 0 2024-09-13T17:05:56.233 INFO:tasks.workunit.client.1.smithi195.stdout:5/830: rmdir d2/df/d78 39 2024-09-13T17:05:56.237 INFO:tasks.workunit.client.1.smithi195.stdout:0/787: sync 2024-09-13T17:05:56.239 INFO:tasks.workunit.client.1.smithi195.stdout:3/787: rmdir d7/d21/d2a/d35/d60/d64/db3 39 2024-09-13T17:05:56.246 INFO:tasks.workunit.client.1.smithi195.stdout:2/802: rename d0/d3/df/dbe to d0/d4a/d47/d73/d75/d88/d2c/df6 0 2024-09-13T17:05:56.248 INFO:tasks.workunit.client.0.smithi115.stdout:0/367: dwrite d9/d1d/d24/d26/f55 [0,4194304] 0 2024-09-13T17:05:56.250 INFO:tasks.workunit.client.1.smithi195.stdout:3/788: fsync d7/d21/d2a/d35/d60/d6f/dbf/ff4 0 2024-09-13T17:05:56.250 INFO:tasks.workunit.client.1.smithi195.stdout:7/788: dwrite d5/d13/fe0 [0,4194304] 0 2024-09-13T17:05:56.250 INFO:tasks.workunit.client.1.smithi195.stdout:9/849: dwrite d6/d19/d21/d45/dad/d5e/da0/fb7 [0,4194304] 0 2024-09-13T17:05:56.250 INFO:tasks.workunit.client.1.smithi195.stdout:5/831: rename d2/df/d78/deb/d4e/f5b to d2/df/d86/f116 0 2024-09-13T17:05:56.251 INFO:tasks.workunit.client.0.smithi115.stdout:0/368: dread d9/d1d/d24/d26/d2d/d30/f5a [0,4194304] 0 2024-09-13T17:05:56.252 INFO:tasks.workunit.client.1.smithi195.stdout:2/803: symlink d0/d4a/d47/d73/lf7 0 2024-09-13T17:05:56.252 INFO:tasks.workunit.client.1.smithi195.stdout:2/804: dread - d0/d4a/d47/d73/d75/d88/d2c/f91 zero size 2024-09-13T17:05:56.253 INFO:tasks.workunit.client.1.smithi195.stdout:1/775: dwrite db/df/d13/f2e [0,4194304] 0 2024-09-13T17:05:56.254 INFO:tasks.workunit.client.1.smithi195.stdout:0/788: dwrite d7/d87/d9b/d4e/f5b [0,4194304] 0 2024-09-13T17:05:56.256 INFO:tasks.workunit.client.1.smithi195.stdout:7/789: creat d5/db/d50/d7f/d82/da1/f114 x:0 0 0 2024-09-13T17:05:56.257 INFO:tasks.workunit.client.1.smithi195.stdout:9/850: symlink d6/d12/d86/da7/dfb/l115 0 2024-09-13T17:05:56.258 INFO:tasks.workunit.client.1.smithi195.stdout:5/832: fdatasync d2/df/d78/deb/d4e/d10/f24 0 2024-09-13T17:05:56.258 INFO:tasks.workunit.client.1.smithi195.stdout:5/833: chown d2/df/d78/deb/d4e/d10/d46/cf9 52219 1 2024-09-13T17:05:56.259 INFO:tasks.workunit.client.0.smithi115.stdout:0/369: write d9/d1b/f57 [2627781,106809] 0 2024-09-13T17:05:56.260 INFO:tasks.workunit.client.1.smithi195.stdout:2/805: rename d0/d4a/d47/d73/d75/d88/d62/lbf to d0/d3/lf8 0 2024-09-13T17:05:56.264 INFO:tasks.workunit.client.0.smithi115.stdout:0/370: symlink d9/l69 0 2024-09-13T17:05:56.264 INFO:tasks.workunit.client.0.smithi115.stdout:0/371: dread - d9/d1d/d24/d26/d36/f62 zero size 2024-09-13T17:05:56.267 INFO:tasks.workunit.client.0.smithi115.stdout:0/372: rename d9/d1d/d24/d26/l35 to d9/d1d/d24/d26/d5d/d67/l6a 0 2024-09-13T17:05:56.267 INFO:tasks.workunit.client.0.smithi115.stdout:0/373: fsync d9/d1d/d24/d26/f55 0 2024-09-13T17:05:56.270 INFO:tasks.workunit.client.1.smithi195.stdout:5/834: write d2/df/d78/f49 [589983,76428] 0 2024-09-13T17:05:56.271 INFO:tasks.workunit.client.1.smithi195.stdout:0/789: mkdir d7/db/dd9/df9 0 2024-09-13T17:05:56.275 INFO:tasks.workunit.client.1.smithi195.stdout:9/851: link d6/d12/d86/cf3 d6/df/d16/de3/d68/d109/c116 0 2024-09-13T17:05:56.276 INFO:tasks.workunit.client.0.smithi115.stdout:0/374: dread d9/f20 [0,4194304] 0 2024-09-13T17:05:56.279 INFO:tasks.workunit.client.1.smithi195.stdout:1/776: rename db/fbf to db/d58/dae/f102 0 2024-09-13T17:05:56.279 INFO:tasks.workunit.client.1.smithi195.stdout:1/777: write db/df/d4d/d74/da8/fbc [856456,73934] 0 2024-09-13T17:05:56.280 INFO:tasks.workunit.client.0.smithi115.stdout:0/375: symlink d9/d1d/d24/l6b 0 2024-09-13T17:05:56.281 INFO:tasks.workunit.client.1.smithi195.stdout:0/790: write d7/f53 [409420,64610] 0 2024-09-13T17:05:56.282 INFO:tasks.workunit.client.1.smithi195.stdout:5/835: creat d2/df/d78/d76/f117 x:0 0 0 2024-09-13T17:05:56.283 INFO:tasks.workunit.client.0.smithi115.stdout:0/376: rmdir d9/d1d/d24/d26/d2d 39 2024-09-13T17:05:56.283 INFO:tasks.workunit.client.0.smithi115.stdout:0/377: dread - d9/d1d/d24/d26/d2d/d30/f47 zero size 2024-09-13T17:05:56.283 INFO:tasks.workunit.client.0.smithi115.stdout:0/378: write d9/d1b/f21 [933843,11756] 0 2024-09-13T17:05:56.285 INFO:tasks.workunit.client.1.smithi195.stdout:7/790: rename d5/db/d50/d7f/cd3 to d5/db/d50/d7f/d82/dcc/c115 0 2024-09-13T17:05:56.285 INFO:tasks.workunit.client.0.smithi115.stdout:0/379: mknod d9/d1d/d24/d26/d5d/d66/c6c 0 2024-09-13T17:05:56.286 INFO:tasks.workunit.client.1.smithi195.stdout:0/791: truncate d7/d88/d23/f62 2164118 0 2024-09-13T17:05:56.287 INFO:tasks.workunit.client.1.smithi195.stdout:5/836: creat d2/df/d90/dbb/dec/f118 x:0 0 0 2024-09-13T17:05:56.289 INFO:tasks.workunit.client.0.smithi115.stdout:0/380: creat d9/d1d/d24/d26/d2d/d30/f6d x:0 0 0 2024-09-13T17:05:56.289 INFO:tasks.workunit.client.0.smithi115.stdout:0/381: readlink d9/d1d/d24/l3b 0 2024-09-13T17:05:56.290 INFO:tasks.workunit.client.1.smithi195.stdout:9/852: mknod d6/c117 0 2024-09-13T17:05:56.290 INFO:tasks.workunit.client.1.smithi195.stdout:6/749: sync 2024-09-13T17:05:56.290 INFO:tasks.workunit.client.1.smithi195.stdout:8/848: sync 2024-09-13T17:05:56.295 INFO:tasks.workunit.client.1.smithi195.stdout:7/791: unlink d5/d13/da8/df9/c105 0 2024-09-13T17:05:56.295 INFO:tasks.workunit.client.1.smithi195.stdout:7/792: creat d5/db/d19/d22/d90/dd4/f116 x:0 0 0 2024-09-13T17:05:56.296 INFO:tasks.workunit.client.0.smithi115.stdout:0/382: unlink d9/l1e 0 2024-09-13T17:05:56.297 INFO:tasks.workunit.client.1.smithi195.stdout:5/837: mknod d2/c119 0 2024-09-13T17:05:56.298 INFO:tasks.workunit.client.1.smithi195.stdout:8/849: truncate d0/d13/f5d 10224114 0 2024-09-13T17:05:56.299 INFO:tasks.workunit.client.0.smithi115.stdout:0/383: symlink d9/d1d/d24/d26/d2c/l6e 0 2024-09-13T17:05:56.299 INFO:tasks.workunit.client.0.smithi115.stdout:0/384: write d9/f16 [3724244,779] 0 2024-09-13T17:05:56.300 INFO:tasks.workunit.client.0.smithi115.stdout:0/385: write d9/d1b/f61 [982237,129505] 0 2024-09-13T17:05:56.300 INFO:tasks.workunit.client.0.smithi115.stdout:0/386: write d9/d1d/d24/d26/d36/f3d [1306692,54077] 0 2024-09-13T17:05:56.300 INFO:tasks.workunit.client.0.smithi115.stdout:0/387: chown d9/d1d/d24/d26/d36/f62 4 1 2024-09-13T17:05:56.304 INFO:tasks.workunit.client.1.smithi195.stdout:7/793: link d5/d35/d37/f4a d5/db/d50/daa/dfc/f117 0 2024-09-13T17:05:56.304 INFO:tasks.workunit.client.1.smithi195.stdout:7/794: chown d5/d35/d37/l92 117 1 2024-09-13T17:05:56.304 INFO:tasks.workunit.client.1.smithi195.stdout:7/795: fsync d5/d13/fca 0 2024-09-13T17:05:56.306 INFO:tasks.workunit.client.1.smithi195.stdout:5/838: unlink d2/df/d78/deb/d4e/d10/d5c/lb4 0 2024-09-13T17:05:56.308 INFO:tasks.workunit.client.1.smithi195.stdout:2/806: rename d0/d3/df to d0/d4a/d47/d73/d75/d88/d2c/df6/df9 0 2024-09-13T17:05:56.308 INFO:tasks.workunit.client.1.smithi195.stdout:8/850: dread d0/d17/d2f/d7c/ffb [0,4194304] 0 2024-09-13T17:05:56.308 INFO:tasks.workunit.client.1.smithi195.stdout:8/851: fdatasync d0/d4/f11f 0 2024-09-13T17:05:56.309 INFO:tasks.workunit.client.0.smithi115.stdout:0/388: getdents d9/d1d/d24 0 2024-09-13T17:05:56.311 INFO:tasks.workunit.client.1.smithi195.stdout:7/796: symlink d5/db/d19/d22/d3c/l118 0 2024-09-13T17:05:56.311 INFO:tasks.workunit.client.1.smithi195.stdout:7/797: stat d5/db/d50/daa 0 2024-09-13T17:05:56.312 INFO:tasks.workunit.client.1.smithi195.stdout:6/750: dwrite d1c/df0/db9/d30/d6f/f7e [0,4194304] 0 2024-09-13T17:05:56.313 INFO:tasks.workunit.client.0.smithi115.stdout:0/389: link d9/c1c d9/d1d/d24/d26/d36/d48/c6f 0 2024-09-13T17:05:56.315 INFO:tasks.workunit.client.1.smithi195.stdout:1/778: rename db/df/d4d/l9c to db/d19/d5a/d66/df2/l103 0 2024-09-13T17:05:56.315 INFO:tasks.workunit.client.1.smithi195.stdout:1/779: creat db/df/f104 x:0 0 0 2024-09-13T17:05:56.317 INFO:tasks.workunit.client.1.smithi195.stdout:8/852: symlink d0/d17/d2f/d7c/d4c/d119/l122 0 2024-09-13T17:05:56.317 INFO:tasks.workunit.client.1.smithi195.stdout:8/853: chown d0/d17/d2f/d31/d101/d63/d71/de8/d11e 610 1 2024-09-13T17:05:56.317 INFO:tasks.workunit.client.1.smithi195.stdout:8/854: chown d0/d13/d69/dac 18 1 2024-09-13T17:05:56.317 INFO:tasks.workunit.client.1.smithi195.stdout:8/855: fdatasync d0/d4/f114 0 2024-09-13T17:05:56.319 INFO:tasks.workunit.client.1.smithi195.stdout:1/780: symlink db/df/l105 0 2024-09-13T17:05:56.322 INFO:tasks.workunit.client.1.smithi195.stdout:8/856: getdents d0/d17/d2f/d7c/d4c/d67 0 2024-09-13T17:05:56.322 INFO:tasks.workunit.client.1.smithi195.stdout:8/857: chown d0/d17/c66 92768520 1 2024-09-13T17:05:56.322 INFO:tasks.workunit.client.1.smithi195.stdout:8/858: creat d0/d17/d2f/d7c/f123 x:0 0 0 2024-09-13T17:05:56.322 INFO:tasks.workunit.client.1.smithi195.stdout:1/781: symlink db/d19/d5a/d66/d96/l106 0 2024-09-13T17:05:56.322 INFO:tasks.workunit.client.1.smithi195.stdout:1/782: fdatasync db/df/d51/f72 0 2024-09-13T17:05:56.324 INFO:tasks.workunit.client.1.smithi195.stdout:0/792: rename d7/d50/f67 to d7/d87/d9b/d4e/d86/ffa 0 2024-09-13T17:05:56.324 INFO:tasks.workunit.client.1.smithi195.stdout:0/793: stat d7/db/d38/d4f/c5a 0 2024-09-13T17:05:56.324 INFO:tasks.workunit.client.1.smithi195.stdout:0/794: fdatasync d7/db/d9a/dd6/ff1 0 2024-09-13T17:05:56.327 INFO:tasks.workunit.client.1.smithi195.stdout:8/859: creat d0/d13/db9/d113/f124 x:0 0 0 2024-09-13T17:05:56.327 INFO:tasks.workunit.client.1.smithi195.stdout:8/860: write d0/d17/d2f/d31/f87 [416030,16717] 0 2024-09-13T17:05:56.327 INFO:tasks.workunit.client.1.smithi195.stdout:5/839: dwrite d2/df/d78/d54/f73 [8388608,4194304] 0 2024-09-13T17:05:56.328 INFO:tasks.workunit.client.1.smithi195.stdout:7/798: dread d5/d13/d24/d70/f9f [0,4194304] 0 2024-09-13T17:05:56.328 INFO:tasks.workunit.client.1.smithi195.stdout:5/840: fdatasync d2/df/d86/f116 0 2024-09-13T17:05:56.328 INFO:tasks.workunit.client.1.smithi195.stdout:1/783: read db/df/d4d/d74/da8/fbc [292116,40604] 0 2024-09-13T17:05:56.328 INFO:tasks.workunit.client.1.smithi195.stdout:9/853: rename d6/d19/d21/f60 to d6/d12/d86/dd2/f118 0 2024-09-13T17:05:56.329 INFO:tasks.workunit.client.1.smithi195.stdout:2/807: dwrite d0/d4a/d47/d73/d75/fa2 [4194304,4194304] 0 2024-09-13T17:05:56.329 INFO:tasks.workunit.client.1.smithi195.stdout:8/861: truncate d0/d17/d2f/d31/db4/fcf 381583 0 2024-09-13T17:05:56.329 INFO:tasks.workunit.client.1.smithi195.stdout:8/862: chown d0/d17/d2f/d31/d101/d63/db3/fe6 790646272 1 2024-09-13T17:05:56.329 INFO:tasks.workunit.client.1.smithi195.stdout:2/808: write d0/d4a/d47/d73/d75/d88/d2c/df6/df9/fdb [1036696,81009] 0 2024-09-13T17:05:56.330 INFO:tasks.workunit.client.1.smithi195.stdout:5/841: symlink d2/df/d78/deb/l11a 0 2024-09-13T17:05:56.332 INFO:tasks.workunit.client.1.smithi195.stdout:9/854: mknod d6/d12/d86/d101/c119 0 2024-09-13T17:05:56.337 INFO:tasks.workunit.client.1.smithi195.stdout:9/855: symlink d6/df/d16/d5c/dcf/l11a 0 2024-09-13T17:05:56.340 INFO:tasks.workunit.client.1.smithi195.stdout:8/863: mkdir d0/d17/d2f/d31/d101/d63/d71/de8/d125 0 2024-09-13T17:05:56.340 INFO:tasks.workunit.client.1.smithi195.stdout:8/864: dread - d0/d17/d2f/d31/db4/ff3 zero size 2024-09-13T17:05:56.340 INFO:tasks.workunit.client.1.smithi195.stdout:6/751: dwrite d1c/d24/fd6 [0,4194304] 0 2024-09-13T17:05:56.340 INFO:tasks.workunit.client.1.smithi195.stdout:1/784: write db/df/d4d/fdf [771275,128205] 0 2024-09-13T17:05:56.340 INFO:tasks.workunit.client.1.smithi195.stdout:1/785: chown db/df/d4d/f9b 31812066 1 2024-09-13T17:05:56.340 INFO:tasks.workunit.client.1.smithi195.stdout:1/786: fdatasync db/d19/d37/d46/d7e/ffa 0 2024-09-13T17:05:56.342 INFO:tasks.workunit.client.1.smithi195.stdout:2/809: creat d0/d4a/d47/d73/d75/d88/d2c/dd7/ffa x:0 0 0 2024-09-13T17:05:56.347 INFO:tasks.workunit.client.1.smithi195.stdout:5/842: dread d2/df/d78/deb/f93 [0,4194304] 0 2024-09-13T17:05:56.348 INFO:tasks.workunit.client.1.smithi195.stdout:9/856: dread d6/df/d13/fd7 [0,4194304] 0 2024-09-13T17:05:56.349 INFO:tasks.workunit.client.1.smithi195.stdout:7/799: dwrite d5/db/d19/d22/fe3 [0,4194304] 0 2024-09-13T17:05:56.352 INFO:tasks.workunit.client.1.smithi195.stdout:6/752: unlink d1c/d3e/lae 0 2024-09-13T17:05:56.352 INFO:tasks.workunit.client.1.smithi195.stdout:6/753: stat d1c/d3e/f47 0 2024-09-13T17:05:56.352 INFO:tasks.workunit.client.1.smithi195.stdout:6/754: fdatasync d1c/d24/d49/d5f/d85/d8f/fdc 0 2024-09-13T17:05:56.353 INFO:tasks.workunit.client.1.smithi195.stdout:1/787: symlink db/df/d4d/d67/l107 0 2024-09-13T17:05:56.354 INFO:tasks.workunit.client.1.smithi195.stdout:2/810: mknod d0/d4a/d47/d73/d75/d88/d2c/df6/cfb 0 2024-09-13T17:05:56.356 INFO:tasks.workunit.client.1.smithi195.stdout:5/843: creat d2/df/d62/f11b x:0 0 0 2024-09-13T17:05:56.357 INFO:tasks.workunit.client.1.smithi195.stdout:9/857: mknod d6/d19/d21/d45/c11b 0 2024-09-13T17:05:56.360 INFO:tasks.workunit.client.1.smithi195.stdout:1/788: link db/df/d51/d62/d70/fda db/d19/d37/d3e/dea/f108 0 2024-09-13T17:05:56.361 INFO:tasks.workunit.client.1.smithi195.stdout:2/811: mknod d0/d4a/d47/d73/d75/d7e/cfc 0 2024-09-13T17:05:56.361 INFO:tasks.workunit.client.1.smithi195.stdout:0/795: dwrite d7/f53 [4194304,4194304] 0 2024-09-13T17:05:56.361 INFO:tasks.workunit.client.1.smithi195.stdout:8/865: dwrite d0/d17/f1d [0,4194304] 0 2024-09-13T17:05:56.363 INFO:tasks.workunit.client.1.smithi195.stdout:9/858: rename d6/ffa to d6/df/d16/de3/d68/d6d/f11c 0 2024-09-13T17:05:56.364 INFO:tasks.workunit.client.1.smithi195.stdout:7/800: mknod d5/db/d19/d22/d3c/c119 0 2024-09-13T17:05:56.364 INFO:tasks.workunit.client.1.smithi195.stdout:7/801: dread - d5/d35/dd2/f110 zero size 2024-09-13T17:05:56.366 INFO:tasks.workunit.client.1.smithi195.stdout:2/812: creat d0/df1/ffd x:0 0 0 2024-09-13T17:05:56.366 INFO:tasks.workunit.client.1.smithi195.stdout:0/796: rmdir d7/d88/d23/d96 39 2024-09-13T17:05:56.366 INFO:tasks.workunit.client.1.smithi195.stdout:0/797: creat d7/db/d38/d4f/ffb x:0 0 0 2024-09-13T17:05:56.367 INFO:tasks.workunit.client.1.smithi195.stdout:8/866: creat d0/d17/d2f/d31/d101/d63/d71/de8/f126 x:0 0 0 2024-09-13T17:05:56.369 INFO:tasks.workunit.client.1.smithi195.stdout:2/813: dread d0/d4a/d47/d73/f7c [0,4194304] 0 2024-09-13T17:05:56.369 INFO:tasks.workunit.client.1.smithi195.stdout:2/814: readlink d0/d4a/d47/d73/d75/d88/d2c/l5f 0 2024-09-13T17:05:56.369 INFO:tasks.workunit.client.1.smithi195.stdout:9/859: rmdir d6/d19/d21/d45/dd1 39 2024-09-13T17:05:56.372 INFO:tasks.workunit.client.1.smithi195.stdout:9/860: creat d6/d19/d21/d5b/f11d x:0 0 0 2024-09-13T17:05:56.372 INFO:tasks.workunit.client.1.smithi195.stdout:9/861: read - d6/df/d7b/fe4 zero size 2024-09-13T17:05:56.373 INFO:tasks.workunit.client.1.smithi195.stdout:2/815: mknod d0/d3/d3d/cfe 0 2024-09-13T17:05:56.374 INFO:tasks.workunit.client.1.smithi195.stdout:2/816: unlink d0/d4a/d47/d73/d75/d88/f3e 0 2024-09-13T17:05:56.376 INFO:tasks.workunit.client.1.smithi195.stdout:3/789: sync 2024-09-13T17:05:56.376 INFO:tasks.workunit.client.1.smithi195.stdout:3/790: read - d7/d62/d70/fe1 zero size 2024-09-13T17:05:56.376 INFO:tasks.workunit.client.1.smithi195.stdout:3/791: write d7/d21/d2a/d35/d60/d64/ffb [1033240,119851] 0 2024-09-13T17:05:56.378 INFO:tasks.workunit.client.1.smithi195.stdout:3/792: rename d7/f77 to d7/d21/d2a/d35/d8f/f101 0 2024-09-13T17:05:56.380 INFO:tasks.workunit.client.1.smithi195.stdout:3/793: creat d7/d21/d2a/d35/d60/d6f/dbf/f102 x:0 0 0 2024-09-13T17:05:56.384 INFO:tasks.workunit.client.1.smithi195.stdout:3/794: rename d7/d21/d2a/d35/d60/f9a to d7/d67/f103 0 2024-09-13T17:05:56.385 INFO:tasks.workunit.client.1.smithi195.stdout:3/795: mknod d7/d21/d2a/d35/d60/d6f/da4/c104 0 2024-09-13T17:05:56.387 INFO:tasks.workunit.client.1.smithi195.stdout:3/796: mkdir d7/d21/d2a/d35/d8f/d9f/d105 0 2024-09-13T17:05:56.387 INFO:tasks.workunit.client.1.smithi195.stdout:3/797: read - d7/d21/d2a/d35/d60/d64/db3/dc4/ff0 zero size 2024-09-13T17:05:56.387 INFO:tasks.workunit.client.1.smithi195.stdout:6/755: dwrite d1c/d7d/f97 [0,4194304] 0 2024-09-13T17:05:56.387 INFO:tasks.workunit.client.1.smithi195.stdout:8/867: dread d0/d17/d2f/d31/f37 [0,4194304] 0 2024-09-13T17:05:56.387 INFO:tasks.workunit.client.1.smithi195.stdout:6/756: stat d1c/d24/fd6 0 2024-09-13T17:05:56.388 INFO:tasks.workunit.client.1.smithi195.stdout:6/757: write d1c/df0/db9/d30/fd7 [1018405,130436] 0 2024-09-13T17:05:56.390 INFO:tasks.workunit.client.1.smithi195.stdout:8/868: getdents d0/d13/db9 0 2024-09-13T17:05:56.391 INFO:tasks.workunit.client.1.smithi195.stdout:8/869: link d0/d17/d2f/d7c/d4c/l97 d0/d17/d2f/d7c/d4c/d9b/l127 0 2024-09-13T17:05:56.392 INFO:tasks.workunit.client.1.smithi195.stdout:8/870: chown d0/d121 876471457 1 2024-09-13T17:05:56.392 INFO:tasks.workunit.client.1.smithi195.stdout:8/871: symlink d0/d17/d2f/d7c/d4c/d9a/dcd/l128 0 2024-09-13T17:05:56.393 INFO:tasks.workunit.client.1.smithi195.stdout:8/872: readlink d0/l5c 0 2024-09-13T17:05:56.393 INFO:tasks.workunit.client.1.smithi195.stdout:8/873: read d0/f8 [7945191,40785] 0 2024-09-13T17:05:56.393 INFO:tasks.workunit.client.1.smithi195.stdout:8/874: chown d0/d17/d2f/l84 417 1 2024-09-13T17:05:56.393 INFO:tasks.workunit.client.1.smithi195.stdout:8/875: creat d0/d62/f129 x:0 0 0 2024-09-13T17:05:56.393 INFO:tasks.workunit.client.1.smithi195.stdout:8/876: truncate d0/d62/f129 63310 0 2024-09-13T17:05:56.393 INFO:tasks.workunit.client.1.smithi195.stdout:8/877: chown d0/d17/d2f/d7c/ffb 0 1 2024-09-13T17:05:56.393 INFO:tasks.workunit.client.1.smithi195.stdout:8/878: truncate d0/d17/d2f/d31/f3f 2796454 0 2024-09-13T17:05:56.395 INFO:tasks.workunit.client.1.smithi195.stdout:8/879: unlink d0/d17/cf0 0 2024-09-13T17:05:56.398 INFO:tasks.workunit.client.1.smithi195.stdout:8/880: write d0/d62/f83 [250357,54803] 0 2024-09-13T17:05:56.399 INFO:tasks.workunit.client.1.smithi195.stdout:8/881: rename d0/d17/d2f/d31/d101/ld5 to d0/d13/l12a 0 2024-09-13T17:05:56.402 INFO:tasks.workunit.client.1.smithi195.stdout:5/844: dwrite d2/df/d86/f7e [0,4194304] 0 2024-09-13T17:05:56.402 INFO:tasks.workunit.client.1.smithi195.stdout:7/802: dwrite d5/d13/d24/d70/f9f [0,4194304] 0 2024-09-13T17:05:56.404 INFO:tasks.workunit.client.1.smithi195.stdout:7/803: creat d5/db/d50/d7f/d82/dad/df0/f11a x:0 0 0 2024-09-13T17:05:56.404 INFO:tasks.workunit.client.1.smithi195.stdout:6/758: dread d1c/d3e/f47 [0,4194304] 0 2024-09-13T17:05:56.405 INFO:tasks.workunit.client.1.smithi195.stdout:7/804: chown d5/db/d19/d22/fc3 1 1 2024-09-13T17:05:56.406 INFO:tasks.workunit.client.1.smithi195.stdout:6/759: unlink d1c/d3e/d6b/c79 0 2024-09-13T17:05:56.410 INFO:tasks.workunit.client.1.smithi195.stdout:7/805: creat d5/db/d19/d22/f11b x:0 0 0 2024-09-13T17:05:56.410 INFO:tasks.workunit.client.1.smithi195.stdout:0/798: dwrite d7/d88/d23/f35 [0,4194304] 0 2024-09-13T17:05:56.410 INFO:tasks.workunit.client.1.smithi195.stdout:9/862: dwrite d6/df/d16/fdd [0,4194304] 0 2024-09-13T17:05:56.410 INFO:tasks.workunit.client.1.smithi195.stdout:9/863: fdatasync d6/df/d16/d103/f10e 0 2024-09-13T17:05:56.410 INFO:tasks.workunit.client.1.smithi195.stdout:6/760: mkdir d1c/d3e/d6b/df5 0 2024-09-13T17:05:56.410 INFO:tasks.workunit.client.1.smithi195.stdout:5/845: dread d2/df/d78/deb/d4e/d10/f4a [0,4194304] 0 2024-09-13T17:05:56.412 INFO:tasks.workunit.client.1.smithi195.stdout:6/761: dread d1c/d3e/fa3 [0,4194304] 0 2024-09-13T17:05:56.413 INFO:tasks.workunit.client.1.smithi195.stdout:3/798: dwrite d7/d21/d2a/d4a/d71/fee [0,4194304] 0 2024-09-13T17:05:56.414 INFO:tasks.workunit.client.1.smithi195.stdout:9/864: rename d6/d19/d21/d45/dad/d5e/dd0 to d6/d12/d86/d11e 0 2024-09-13T17:05:56.415 INFO:tasks.workunit.client.1.smithi195.stdout:9/865: write d6/d19/d21/d45/fc9 [5138010,17512] 0 2024-09-13T17:05:56.415 INFO:tasks.workunit.client.1.smithi195.stdout:7/806: dread d5/d13/d30/f8a [0,4194304] 0 2024-09-13T17:05:56.415 INFO:tasks.workunit.client.1.smithi195.stdout:7/807: chown d5/d35/d37/cbe 39221888 1 2024-09-13T17:05:56.415 INFO:tasks.workunit.client.1.smithi195.stdout:6/762: mknod d1c/df0/db9/d5e/cf6 0 2024-09-13T17:05:56.418 INFO:tasks.workunit.client.1.smithi195.stdout:7/808: mkdir d5/db/d50/d7f/d10a/d11c 0 2024-09-13T17:05:56.418 INFO:tasks.workunit.client.1.smithi195.stdout:0/799: dread d7/d88/d23/f62 [0,4194304] 0 2024-09-13T17:05:56.418 INFO:tasks.workunit.client.1.smithi195.stdout:0/800: write d7/db/d38/d5d/f8f [186933,1250] 0 2024-09-13T17:05:56.418 INFO:tasks.workunit.client.1.smithi195.stdout:6/763: mknod d1c/d24/d49/d5f/db1/dcd/da9/cf7 0 2024-09-13T17:05:56.419 INFO:tasks.workunit.client.1.smithi195.stdout:7/809: mkdir d5/db/d50/d11d 0 2024-09-13T17:05:56.420 INFO:tasks.workunit.client.1.smithi195.stdout:6/764: mkdir d1c/d24/d49/d5f/d35/d88/df8 0 2024-09-13T17:05:56.421 INFO:tasks.workunit.client.1.smithi195.stdout:7/810: symlink d5/db/d50/d7f/d82/da1/l11e 0 2024-09-13T17:05:56.422 INFO:tasks.workunit.client.1.smithi195.stdout:6/765: creat d1c/d24/d49/d5f/d85/d8f/dc0/ff9 x:0 0 0 2024-09-13T17:05:56.422 INFO:tasks.workunit.client.1.smithi195.stdout:6/766: fsync d1c/d24/d49/d5f/f50 0 2024-09-13T17:05:56.422 INFO:tasks.workunit.client.1.smithi195.stdout:6/767: fsync d1c/d24/d49/d5f/de1/ff4 0 2024-09-13T17:05:56.426 INFO:tasks.workunit.client.1.smithi195.stdout:3/799: dread d7/d19/d1e/f50 [0,4194304] 0 2024-09-13T17:05:56.426 INFO:tasks.workunit.client.1.smithi195.stdout:3/800: dread - d7/d21/d2a/d4a/d5a/fe3 zero size 2024-09-13T17:05:56.427 INFO:tasks.workunit.client.1.smithi195.stdout:3/801: mknod d7/d5f/c106 0 2024-09-13T17:05:56.428 INFO:tasks.workunit.client.1.smithi195.stdout:3/802: truncate d7/d21/fe4 991606 0 2024-09-13T17:05:56.428 INFO:tasks.workunit.client.1.smithi195.stdout:3/803: chown d7/d21/f26 25423 1 2024-09-13T17:05:56.428 INFO:tasks.workunit.client.1.smithi195.stdout:1/789: dwrite db/df/d4d/fdf [0,4194304] 0 2024-09-13T17:05:56.428 INFO:tasks.workunit.client.1.smithi195.stdout:5/846: dread d2/df/d78/d54/f73 [8388608,4194304] 0 2024-09-13T17:05:56.428 INFO:tasks.workunit.client.1.smithi195.stdout:3/804: mknod d7/d21/d51/c107 0 2024-09-13T17:05:56.430 INFO:tasks.workunit.client.1.smithi195.stdout:8/882: dwrite d0/d17/d2f/d7c/f48 [0,4194304] 0 2024-09-13T17:05:56.430 INFO:tasks.workunit.client.1.smithi195.stdout:1/790: creat db/df/d51/d62/f109 x:0 0 0 2024-09-13T17:05:56.430 INFO:tasks.workunit.client.1.smithi195.stdout:7/811: write d5/d13/d30/f7a [3837194,112208] 0 2024-09-13T17:05:56.431 INFO:tasks.workunit.client.1.smithi195.stdout:5/847: symlink d2/df/d78/deb/d3f/dfa/l11c 0 2024-09-13T17:05:56.431 INFO:tasks.workunit.client.1.smithi195.stdout:6/768: dread d1c/f63 [4194304,4194304] 0 2024-09-13T17:05:56.431 INFO:tasks.workunit.client.1.smithi195.stdout:9/866: dwrite d6/d12/d86/f96 [0,4194304] 0 2024-09-13T17:05:56.431 INFO:tasks.workunit.client.1.smithi195.stdout:9/867: fsync d6/d19/d21/d45/f5a 0 2024-09-13T17:05:56.433 INFO:tasks.workunit.client.1.smithi195.stdout:3/805: unlink d7/d62/ld9 0 2024-09-13T17:05:56.435 INFO:tasks.workunit.client.1.smithi195.stdout:8/883: symlink d0/d17/d2f/d31/db4/dfc/l12b 0 2024-09-13T17:05:56.436 INFO:tasks.workunit.client.1.smithi195.stdout:7/812: dread - d5/db/d19/d22/d90/fe1 zero size 2024-09-13T17:05:56.439 INFO:tasks.workunit.client.1.smithi195.stdout:3/806: symlink d7/d21/d2a/d35/d60/d64/db3/dc4/dfd/l108 0 2024-09-13T17:05:56.439 INFO:tasks.workunit.client.1.smithi195.stdout:3/807: fdatasync d7/d19/f48 0 2024-09-13T17:05:56.439 INFO:tasks.workunit.client.1.smithi195.stdout:9/868: write d6/d12/d39/f3d [2285948,24971] 0 2024-09-13T17:05:56.439 INFO:tasks.workunit.client.1.smithi195.stdout:9/869: chown d6/f3f 7532 1 2024-09-13T17:05:56.441 INFO:tasks.workunit.client.0.smithi115.stdout:5/522: sync 2024-09-13T17:05:56.442 INFO:tasks.workunit.client.1.smithi195.stdout:8/884: symlink d0/d121/dff/l12c 0 2024-09-13T17:05:56.444 INFO:tasks.workunit.client.1.smithi195.stdout:7/813: symlink d5/d35/l11f 0 2024-09-13T17:05:56.445 INFO:tasks.workunit.client.1.smithi195.stdout:3/808: mknod d7/d62/c109 0 2024-09-13T17:05:56.445 INFO:tasks.workunit.client.1.smithi195.stdout:3/809: readlink d7/d21/d2a/d4a/d71/lb5 0 2024-09-13T17:05:56.445 INFO:tasks.workunit.client.1.smithi195.stdout:3/810: chown d7/d21/d2a/d4a/d71/fee 8183511 1 2024-09-13T17:05:56.447 INFO:tasks.workunit.client.0.smithi115.stdout:5/523: rename d19/d21/d3a/d5d/c66 to d19/d2b/d32/d55/d5e/d87/da4/da6/cae 0 2024-09-13T17:05:56.448 INFO:tasks.workunit.client.1.smithi195.stdout:9/870: truncate d6/df/f27 439579 0 2024-09-13T17:05:56.450 INFO:tasks.workunit.client.1.smithi195.stdout:7/814: symlink d5/db/d50/d7f/d82/dcc/l120 0 2024-09-13T17:05:56.451 INFO:tasks.workunit.client.0.smithi115.stdout:5/524: write d19/f1a [1970574,26990] 0 2024-09-13T17:05:56.452 INFO:tasks.workunit.client.1.smithi195.stdout:3/811: mkdir d7/d19/d10a 0 2024-09-13T17:05:56.452 INFO:tasks.workunit.client.1.smithi195.stdout:3/812: write d7/d21/d2a/d4a/f7a [5018961,111719] 0 2024-09-13T17:05:56.454 INFO:tasks.workunit.client.0.smithi115.stdout:5/525: unlink f16 0 2024-09-13T17:05:56.455 INFO:tasks.workunit.client.1.smithi195.stdout:7/815: truncate d5/f72 1334527 0 2024-09-13T17:05:56.455 INFO:tasks.workunit.client.1.smithi195.stdout:7/816: write d5/d13/f6a [1459808,120712] 0 2024-09-13T17:05:56.456 INFO:tasks.workunit.client.1.smithi195.stdout:9/871: getdents d6/df/d16/d5c 0 2024-09-13T17:05:56.457 INFO:tasks.workunit.client.0.smithi115.stdout:5/526: rename d19/d1d/f20 to d19/d2c/faf 0 2024-09-13T17:05:56.460 INFO:tasks.workunit.client.1.smithi195.stdout:9/872: mknod d6/df/d7b/df6/c11f 0 2024-09-13T17:05:56.460 INFO:tasks.workunit.client.1.smithi195.stdout:8/885: dwrite d0/d62/f129 [0,4194304] 0 2024-09-13T17:05:56.460 INFO:tasks.workunit.client.1.smithi195.stdout:9/873: truncate d6/d19/d21/d45/dd1/fec 472558 0 2024-09-13T17:05:56.465 INFO:tasks.workunit.client.1.smithi195.stdout:7/817: dread d5/db/d19/d22/f113 [0,4194304] 0 2024-09-13T17:05:56.465 INFO:tasks.workunit.client.1.smithi195.stdout:0/801: write f3 [1079805,109977] 0 2024-09-13T17:05:56.479 INFO:tasks.workunit.client.1.smithi195.stdout:7/818: dread d5/d13/d30/fdc [0,4194304] 0 2024-09-13T17:05:56.480 INFO:tasks.workunit.client.1.smithi195.stdout:0/802: dread d7/d87/d9b/d56/d46/f9e [0,4194304] 0 2024-09-13T17:05:56.480 INFO:tasks.workunit.client.1.smithi195.stdout:0/803: getdents d7/db/d38 0 2024-09-13T17:05:56.480 INFO:tasks.workunit.client.1.smithi195.stdout:7/819: write d5/db/d19/d22/f4e [778917,104198] 0 2024-09-13T17:05:56.482 INFO:tasks.workunit.client.1.smithi195.stdout:7/820: mkdir d5/d13/d24/d70/dd5/d121 0 2024-09-13T17:05:56.482 INFO:tasks.workunit.client.1.smithi195.stdout:7/821: truncate d5/d13/da8/ff4 540636 0 2024-09-13T17:05:56.482 INFO:tasks.workunit.client.1.smithi195.stdout:0/804: getdents d7/d50/da1 0 2024-09-13T17:05:56.482 INFO:tasks.workunit.client.1.smithi195.stdout:7/822: stat d5/d13/d30/lec 0 2024-09-13T17:05:56.482 INFO:tasks.workunit.client.1.smithi195.stdout:7/823: stat d5/db/d50/daa/lac 0 2024-09-13T17:05:56.482 INFO:tasks.workunit.client.1.smithi195.stdout:7/824: creat d5/d35/f122 x:0 0 0 2024-09-13T17:05:56.483 INFO:tasks.workunit.client.1.smithi195.stdout:9/874: dwrite d6/df/d16/de3/d68/fbd [0,4194304] 0 2024-09-13T17:05:56.485 INFO:tasks.workunit.client.1.smithi195.stdout:9/875: unlink d6/d12/d39/f3d 0 2024-09-13T17:05:56.488 INFO:tasks.workunit.client.1.smithi195.stdout:9/876: creat d6/d12/d86/da7/dfb/f120 x:0 0 0 2024-09-13T17:05:56.490 INFO:tasks.workunit.client.1.smithi195.stdout:8/886: dwrite d0/d17/d2f/d31/f87 [0,4194304] 0 2024-09-13T17:05:56.493 INFO:tasks.workunit.client.0.smithi115.stdout:5/527: dwrite d19/d21/f2a [0,4194304] 0 2024-09-13T17:05:56.501 INFO:tasks.workunit.client.1.smithi195.stdout:9/877: dread d6/df/d16/d5c/fdf [0,4194304] 0 2024-09-13T17:05:56.501 INFO:tasks.workunit.client.1.smithi195.stdout:9/878: stat d6/fb3 0 2024-09-13T17:05:56.513 INFO:tasks.workunit.client.1.smithi195.stdout:0/805: dwrite d7/d88/d23/f4a [0,4194304] 0 2024-09-13T17:05:56.513 INFO:tasks.workunit.client.1.smithi195.stdout:0/806: getdents d7/db/d9a/dd6 0 2024-09-13T17:05:56.513 INFO:tasks.workunit.client.1.smithi195.stdout:0/807: dread - d7/db/f7b zero size 2024-09-13T17:05:56.513 INFO:tasks.workunit.client.1.smithi195.stdout:7/825: dwrite d5/d13/d24/d70/f9f [0,4194304] 0 2024-09-13T17:05:56.513 INFO:tasks.workunit.client.1.smithi195.stdout:8/887: dwrite d0/d17/d2f/d31/d101/d63/db3/fe6 [0,4194304] 0 2024-09-13T17:05:56.514 INFO:tasks.workunit.client.1.smithi195.stdout:9/879: write d6/df/d16/d5c/fdf [284438,115608] 0 2024-09-13T17:05:56.514 INFO:tasks.workunit.client.1.smithi195.stdout:9/880: readlink d6/d19/l82 0 2024-09-13T17:05:56.515 INFO:tasks.workunit.client.1.smithi195.stdout:0/808: rename d7/d87/d9b/d4e/d68/lb2 to d7/db/lfc 0 2024-09-13T17:05:56.515 INFO:tasks.workunit.client.1.smithi195.stdout:0/809: readlink d7/d87/d9b/d4e/laa 0 2024-09-13T17:05:56.523 INFO:tasks.workunit.client.1.smithi195.stdout:7/826: chown d5/db/d19/f18 2 1 2024-09-13T17:05:56.524 INFO:tasks.workunit.client.1.smithi195.stdout:8/888: mkdir d0/d17/d2f/d7c/d4c/d9a/d109/d12d 0 2024-09-13T17:05:56.526 INFO:tasks.workunit.client.1.smithi195.stdout:9/881: link d6/d19/d21/d45/f99 d6/d19/d21/d45/dd1/f121 0 2024-09-13T17:05:56.526 INFO:tasks.workunit.client.1.smithi195.stdout:9/882: chown d6/df/d72/fb9 27 1 2024-09-13T17:05:56.527 INFO:tasks.workunit.client.1.smithi195.stdout:9/883: stat d6/d12/d86/d11e/d61/c6b 0 2024-09-13T17:05:56.527 INFO:tasks.workunit.client.1.smithi195.stdout:0/810: rename d7/d50/fc1 to d7/d87/d9b/d56/db0/ffd 0 2024-09-13T17:05:56.528 INFO:tasks.workunit.client.1.smithi195.stdout:7/827: creat d5/d13/d24/d10f/f123 x:0 0 0 2024-09-13T17:05:56.528 INFO:tasks.workunit.client.1.smithi195.stdout:7/828: dread - d5/db/fea zero size 2024-09-13T17:05:56.530 INFO:tasks.workunit.client.1.smithi195.stdout:9/884: creat d6/df/d16/de3/d68/d109/f122 x:0 0 0 2024-09-13T17:05:56.530 INFO:tasks.workunit.client.1.smithi195.stdout:9/885: chown d6/d19/l111 34 1 2024-09-13T17:05:56.531 INFO:tasks.workunit.client.1.smithi195.stdout:9/886: write d6/df/d72/f92 [4421090,13546] 0 2024-09-13T17:05:56.532 INFO:tasks.workunit.client.1.smithi195.stdout:0/811: rename d7/db/d38/f57 to d7/db/d9a/ffe 0 2024-09-13T17:05:56.533 INFO:tasks.workunit.client.1.smithi195.stdout:7/829: getdents d5/db/d50/d7f 0 2024-09-13T17:05:56.535 INFO:tasks.workunit.client.1.smithi195.stdout:9/887: creat d6/d12/d86/d101/f123 x:0 0 0 2024-09-13T17:05:56.535 INFO:tasks.workunit.client.1.smithi195.stdout:9/888: fsync d6/df/f3c 0 2024-09-13T17:05:56.535 INFO:tasks.workunit.client.1.smithi195.stdout:9/889: fsync d6/d19/d21/d45/fc9 0 2024-09-13T17:05:56.535 INFO:tasks.workunit.client.1.smithi195.stdout:9/890: write d6/df/f27 [1410320,53046] 0 2024-09-13T17:05:56.535 INFO:tasks.workunit.client.1.smithi195.stdout:9/891: chown d6/d12/d86/d11e 11906920 1 2024-09-13T17:05:56.535 INFO:tasks.workunit.client.1.smithi195.stdout:9/892: stat d6/d19/d21/c7f 0 2024-09-13T17:05:56.536 INFO:tasks.workunit.client.1.smithi195.stdout:0/812: chown d7/d87/d9b/d56/d46/f91 94031655 1 2024-09-13T17:05:56.537 INFO:tasks.workunit.client.1.smithi195.stdout:7/830: unlink d5/d13/d30/l3d 0 2024-09-13T17:05:56.537 INFO:tasks.workunit.client.1.smithi195.stdout:7/831: fdatasync d5/d13/f40 0 2024-09-13T17:05:56.538 INFO:tasks.workunit.client.1.smithi195.stdout:0/813: creat d7/db/d11/db5/df0/fff x:0 0 0 2024-09-13T17:05:56.540 INFO:tasks.workunit.client.1.smithi195.stdout:0/814: creat d7/d88/d23/d96/dd8/f100 x:0 0 0 2024-09-13T17:05:56.540 INFO:tasks.workunit.client.1.smithi195.stdout:0/815: fsync d7/d88/d7c/feb 0 2024-09-13T17:05:56.540 INFO:tasks.workunit.client.1.smithi195.stdout:7/832: mkdir d5/db/d19/dc4/d124 0 2024-09-13T17:05:56.540 INFO:tasks.workunit.client.1.smithi195.stdout:2/817: sync 2024-09-13T17:05:56.541 INFO:tasks.workunit.client.1.smithi195.stdout:8/889: dwrite d0/d17/d2f/d7c/f123 [0,4194304] 0 2024-09-13T17:05:56.541 INFO:tasks.workunit.client.1.smithi195.stdout:8/890: readlink d0/d17/d2f/l84 0 2024-09-13T17:05:56.541 INFO:tasks.workunit.client.1.smithi195.stdout:7/833: creat d5/db/d19/d22/d90/dd4/d10d/f125 x:0 0 0 2024-09-13T17:05:56.546 INFO:tasks.workunit.client.1.smithi195.stdout:8/891: truncate d0/d13/f16 186681 0 2024-09-13T17:05:56.548 INFO:tasks.workunit.client.1.smithi195.stdout:7/834: rename d5/d35/l42 to d5/db/d19/d22/d3c/df1/l126 0 2024-09-13T17:05:56.548 INFO:tasks.workunit.client.1.smithi195.stdout:0/816: write d7/d87/d9b/d4e/d68/f9f [488718,29510] 0 2024-09-13T17:05:56.548 INFO:tasks.workunit.client.1.smithi195.stdout:0/817: chown d7/d88/d7c/lba 23258 1 2024-09-13T17:05:56.548 INFO:tasks.workunit.client.1.smithi195.stdout:7/835: write d5/d13/d24/d10f/f123 [575900,39329] 0 2024-09-13T17:05:56.548 INFO:tasks.workunit.client.1.smithi195.stdout:0/818: write d7/db/d38/d5d/f72 [1009884,21860] 0 2024-09-13T17:05:56.549 INFO:tasks.workunit.client.1.smithi195.stdout:0/819: chown d7/d87/d9b/d4e/d86/cf2 2105 1 2024-09-13T17:05:56.549 INFO:tasks.workunit.client.1.smithi195.stdout:2/818: dread d0/d3/f68 [0,4194304] 0 2024-09-13T17:05:56.550 INFO:tasks.workunit.client.1.smithi195.stdout:8/892: creat d0/d17/d2f/d31/d101/d63/d71/f12e x:0 0 0 2024-09-13T17:05:56.550 INFO:tasks.workunit.client.1.smithi195.stdout:9/893: dwrite d6/d12/d39/f89 [0,4194304] 0 2024-09-13T17:05:56.551 INFO:tasks.workunit.client.1.smithi195.stdout:2/819: chown d0/d4a/d47/d73/d75/d88/c8f 405 1 2024-09-13T17:05:56.552 INFO:tasks.workunit.client.1.smithi195.stdout:2/820: write d0/d4a/d47/d73/d94/fd5 [644490,16920] 0 2024-09-13T17:05:56.556 INFO:tasks.workunit.client.1.smithi195.stdout:9/894: truncate d6/df/d16/de3/d68/d6d/fa2 3392772 0 2024-09-13T17:05:56.558 INFO:tasks.workunit.client.1.smithi195.stdout:2/821: creat d0/d4a/d47/d73/d75/d88/d2c/d51/fff x:0 0 0 2024-09-13T17:05:56.558 INFO:tasks.workunit.client.1.smithi195.stdout:7/836: getdents d5/d35 0 2024-09-13T17:05:56.560 INFO:tasks.workunit.client.1.smithi195.stdout:8/893: link d0/d17/d2f/d31/f3f d0/d17/d2f/d31/d101/d63/d71/de8/f12f 0 2024-09-13T17:05:56.561 INFO:tasks.workunit.client.1.smithi195.stdout:8/894: write d0/d17/d2f/d7c/d4c/d9a/f10d [14697,111307] 0 2024-09-13T17:05:56.561 INFO:tasks.workunit.client.1.smithi195.stdout:8/895: write d0/d13/d52/d55/fb6 [108746,55926] 0 2024-09-13T17:05:56.562 INFO:tasks.workunit.client.1.smithi195.stdout:9/895: symlink d6/d12/l124 0 2024-09-13T17:05:56.563 INFO:tasks.workunit.client.1.smithi195.stdout:7/837: mkdir d5/db/d19/d22/d90/d127 0 2024-09-13T17:05:56.563 INFO:tasks.workunit.client.1.smithi195.stdout:7/838: creat d5/db/d50/d7f/d82/da1/f128 x:0 0 0 2024-09-13T17:05:56.564 INFO:tasks.workunit.client.1.smithi195.stdout:7/839: readlink d5/d35/l3b 0 2024-09-13T17:05:56.564 INFO:tasks.workunit.client.1.smithi195.stdout:9/896: getdents d6/d12/d86/dd2/de1 0 2024-09-13T17:05:56.564 INFO:tasks.workunit.client.1.smithi195.stdout:9/897: fsync d6/d12/d39/fa1 0 2024-09-13T17:05:56.564 INFO:tasks.workunit.client.1.smithi195.stdout:9/898: write d6/df/d7b/f10d [166691,43753] 0 2024-09-13T17:05:56.567 INFO:tasks.workunit.client.1.smithi195.stdout:6/769: sync 2024-09-13T17:05:56.567 INFO:tasks.workunit.client.1.smithi195.stdout:3/813: sync 2024-09-13T17:05:56.567 INFO:tasks.workunit.client.1.smithi195.stdout:7/840: creat d5/db/d50/d7f/f129 x:0 0 0 2024-09-13T17:05:56.567 INFO:tasks.workunit.client.1.smithi195.stdout:5/848: sync 2024-09-13T17:05:56.569 INFO:tasks.workunit.client.1.smithi195.stdout:1/791: sync 2024-09-13T17:05:56.569 INFO:tasks.workunit.client.1.smithi195.stdout:1/792: chown db/df/f20 540201 1 2024-09-13T17:05:56.569 INFO:tasks.workunit.client.1.smithi195.stdout:9/899: dread d6/d12/d86/d11e/d61/fbe [0,4194304] 0 2024-09-13T17:05:56.570 INFO:tasks.workunit.client.1.smithi195.stdout:0/820: dwrite d7/d87/f99 [4194304,4194304] 0 2024-09-13T17:05:56.571 INFO:tasks.workunit.client.1.smithi195.stdout:5/849: dread d2/d3e/fa2 [0,4194304] 0 2024-09-13T17:05:56.571 INFO:tasks.workunit.client.1.smithi195.stdout:5/850: dread - d2/df/d90/db2/fd9 zero size 2024-09-13T17:05:56.573 INFO:tasks.workunit.client.1.smithi195.stdout:3/814: creat d7/d21/d2a/d35/d8f/d9f/dfc/f10b x:0 0 0 2024-09-13T17:05:56.573 INFO:tasks.workunit.client.1.smithi195.stdout:3/815: chown d7/d21/d2a/d35/f37 798353 1 2024-09-13T17:05:56.573 INFO:tasks.workunit.client.1.smithi195.stdout:3/816: readlink d7/d21/d2a/d35/d60/d64/dbc/le7 0 2024-09-13T17:05:56.574 INFO:tasks.workunit.client.1.smithi195.stdout:7/841: write d5/db/d19/f5e [9158711,106514] 0 2024-09-13T17:05:56.576 INFO:tasks.workunit.client.1.smithi195.stdout:9/900: unlink d6/d19/d21/d5b/fa6 0 2024-09-13T17:05:56.576 INFO:tasks.workunit.client.1.smithi195.stdout:9/901: readlink d6/df/d16/de3/l76 0 2024-09-13T17:05:56.577 INFO:tasks.workunit.client.1.smithi195.stdout:9/902: truncate d6/d12/f8a 12837574 0 2024-09-13T17:05:56.577 INFO:tasks.workunit.client.1.smithi195.stdout:2/822: dwrite d0/d3/f4 [0,4194304] 0 2024-09-13T17:05:56.579 INFO:tasks.workunit.client.1.smithi195.stdout:0/821: creat d7/d87/d9b/d56/d4d/f101 x:0 0 0 2024-09-13T17:05:56.579 INFO:tasks.workunit.client.1.smithi195.stdout:0/822: stat d7/d87/d9b/d56/l6f 0 2024-09-13T17:05:56.581 INFO:tasks.workunit.client.1.smithi195.stdout:1/793: dread db/df/f16 [4194304,4194304] 0 2024-09-13T17:05:56.581 INFO:tasks.workunit.client.1.smithi195.stdout:5/851: link d2/d3e/fa2 d2/df/d78/d54/f11d 0 2024-09-13T17:05:56.582 INFO:tasks.workunit.client.1.smithi195.stdout:3/817: link d7/d67/fda d7/d21/d2a/d35/d60/db0/f10c 0 2024-09-13T17:05:56.583 INFO:tasks.workunit.client.1.smithi195.stdout:7/842: rename d5/l8f to d5/db/d50/d11d/l12a 0 2024-09-13T17:05:56.585 INFO:tasks.workunit.client.1.smithi195.stdout:2/823: creat d0/d4a/d47/d73/d75/d7e/f100 x:0 0 0 2024-09-13T17:05:56.585 INFO:tasks.workunit.client.1.smithi195.stdout:2/824: chown d0/d4a/d47/d73/d75/d88/d8e 3 1 2024-09-13T17:05:56.585 INFO:tasks.workunit.client.1.smithi195.stdout:2/825: write d0/d3/fa8 [547490,95437] 0 2024-09-13T17:05:56.585 INFO:tasks.workunit.client.1.smithi195.stdout:2/826: chown d0/d4a/d47/d73/d75/d88/d2c/d43/f64 2791 1 2024-09-13T17:05:56.585 INFO:tasks.workunit.client.1.smithi195.stdout:2/827: dread - d0/d4a/d47/d73/d75/d88/d2c/d43/d84/f97 zero size 2024-09-13T17:05:56.586 INFO:tasks.workunit.client.1.smithi195.stdout:1/794: unlink db/df/d4d/d74/c7d 0 2024-09-13T17:05:56.587 INFO:tasks.workunit.client.1.smithi195.stdout:3/818: rename d7/d21/d66/f94 to d7/d21/d2a/d35/d60/d64/db3/dc4/f10d 0 2024-09-13T17:05:56.587 INFO:tasks.workunit.client.1.smithi195.stdout:3/819: write d7/d21/f4f [1030759,67573] 0 2024-09-13T17:05:56.588 INFO:tasks.workunit.client.1.smithi195.stdout:8/896: dwrite d0/d13/d52/d55/f95 [0,4194304] 0 2024-09-13T17:05:56.588 INFO:tasks.workunit.client.1.smithi195.stdout:8/897: chown d0/d17/faf 12472704 1 2024-09-13T17:05:56.588 INFO:tasks.workunit.client.1.smithi195.stdout:8/898: write d0/d17/d2f/d7c/d4c/d9b/fc8 [174305,126531] 0 2024-09-13T17:05:56.588 INFO:tasks.workunit.client.1.smithi195.stdout:8/899: write d0/d17/d2f/d31/d101/d63/fb5 [721719,74013] 0 2024-09-13T17:05:56.588 INFO:tasks.workunit.client.1.smithi195.stdout:8/900: chown d0/d13/d52/d55/fbf 2431275 1 2024-09-13T17:05:56.588 INFO:tasks.workunit.client.1.smithi195.stdout:7/843: rmdir d5/d13/d24/d70/dd5/d121 0 2024-09-13T17:05:56.589 INFO:tasks.workunit.client.1.smithi195.stdout:6/770: dwrite d1c/d24/f2e [4194304,4194304] 0 2024-09-13T17:05:56.592 INFO:tasks.workunit.client.1.smithi195.stdout:3/820: mknod d7/d19/d10a/c10e 0 2024-09-13T17:05:56.595 INFO:tasks.workunit.client.1.smithi195.stdout:5/852: read d2/df/d78/d54/d58/f6b [2409565,13668] 0 2024-09-13T17:05:56.595 INFO:tasks.workunit.client.1.smithi195.stdout:5/853: readlink d2/df/d78/l80 0 2024-09-13T17:05:56.595 INFO:tasks.workunit.client.1.smithi195.stdout:5/854: chown d2/f17 307066 1 2024-09-13T17:05:56.595 INFO:tasks.workunit.client.1.smithi195.stdout:8/901: unlink d0/d17/f68 0 2024-09-13T17:05:56.597 INFO:tasks.workunit.client.1.smithi195.stdout:7/844: unlink d5/d13/d24/d70/f89 0 2024-09-13T17:05:56.598 INFO:tasks.workunit.client.1.smithi195.stdout:2/828: dread d0/d4a/d47/d73/d75/d88/d2c/f34 [0,4194304] 0 2024-09-13T17:05:56.598 INFO:tasks.workunit.client.1.smithi195.stdout:6/771: truncate d1c/d24/d49/d5f/d85/d8f/dc0/fc1 3315196 0 2024-09-13T17:05:56.598 INFO:tasks.workunit.client.1.smithi195.stdout:6/772: write f1a [2004944,89014] 0 2024-09-13T17:05:56.600 INFO:tasks.workunit.client.1.smithi195.stdout:7/845: dread d5/db/d19/f18 [0,4194304] 0 2024-09-13T17:05:56.600 INFO:tasks.workunit.client.1.smithi195.stdout:7/846: creat d5/d13/da8/f12b x:0 0 0 2024-09-13T17:05:56.600 INFO:tasks.workunit.client.1.smithi195.stdout:7/847: readlink d5/d13/l71 0 2024-09-13T17:05:56.608 INFO:tasks.workunit.client.1.smithi195.stdout:7/848: write d5/db/d50/f81 [754945,98862] 0 2024-09-13T17:05:56.609 INFO:tasks.workunit.client.1.smithi195.stdout:9/903: truncate d6/d12/f8a 10769526 0 2024-09-13T17:05:56.609 INFO:tasks.workunit.client.1.smithi195.stdout:9/904: readlink d6/d19/d21/d45/dad/d5e/l95 0 2024-09-13T17:05:56.609 INFO:tasks.workunit.client.1.smithi195.stdout:9/905: fdatasync d6/d12/d86/dd2/f118 0 2024-09-13T17:05:56.609 INFO:tasks.workunit.client.1.smithi195.stdout:9/906: truncate d6/df/d7b/f10d 879625 0 2024-09-13T17:05:56.611 INFO:tasks.workunit.client.1.smithi195.stdout:1/795: rmdir db/df/d4d/d74/da8 39 2024-09-13T17:05:56.612 INFO:tasks.workunit.client.1.smithi195.stdout:3/821: getdents d7/d19/d10a 0 2024-09-13T17:05:56.613 INFO:tasks.workunit.client.1.smithi195.stdout:5/855: mkdir d2/df/d48/d11e 0 2024-09-13T17:05:56.614 INFO:tasks.workunit.client.1.smithi195.stdout:2/829: symlink d0/de8/l101 0 2024-09-13T17:05:56.615 INFO:tasks.workunit.client.1.smithi195.stdout:1/796: dread db/df/d4d/fb3 [0,4194304] 0 2024-09-13T17:05:56.615 INFO:tasks.workunit.client.1.smithi195.stdout:2/830: write d0/d4a/d47/d73/d75/d88/d2c/d51/f42 [1349044,90329] 0 2024-09-13T17:05:56.619 INFO:tasks.workunit.client.1.smithi195.stdout:7/849: write d5/db/d19/d22/f8e [502787,92682] 0 2024-09-13T17:05:56.619 INFO:tasks.workunit.client.1.smithi195.stdout:5/856: read - d2/df/d78/deb/d4e/d10/fd8 zero size 2024-09-13T17:05:56.621 INFO:tasks.workunit.client.1.smithi195.stdout:6/773: dwrite d1c/d24/d49/d5f/db1/d95/fc5 [0,4194304] 0 2024-09-13T17:05:56.621 INFO:tasks.workunit.client.1.smithi195.stdout:8/902: dwrite d0/d17/f56 [0,4194304] 0 2024-09-13T17:05:56.621 INFO:tasks.workunit.client.1.smithi195.stdout:8/903: fdatasync d0/d17/d2f/d7c/d4c/d9a/f10d 0 2024-09-13T17:05:56.622 INFO:tasks.workunit.client.1.smithi195.stdout:1/797: unlink db/fa3 0 2024-09-13T17:05:56.626 INFO:tasks.workunit.client.1.smithi195.stdout:7/850: creat d5/db/d19/dc4/d124/f12c x:0 0 0 2024-09-13T17:05:56.627 INFO:tasks.workunit.client.1.smithi195.stdout:5/857: creat d2/df/d78/deb/d4e/d10/d8f/f11f x:0 0 0 2024-09-13T17:05:56.627 INFO:tasks.workunit.client.1.smithi195.stdout:5/858: truncate d2/d3e/f7a 444023 0 2024-09-13T17:05:56.629 INFO:tasks.workunit.client.1.smithi195.stdout:8/904: link d0/d17/d2f/d7c/ffb d0/d121/f130 0 2024-09-13T17:05:56.629 INFO:tasks.workunit.client.0.smithi115.stdout:7/506: sync 2024-09-13T17:05:56.629 INFO:tasks.workunit.client.0.smithi115.stdout:7/507: creat d0/d59/fb8 x:0 0 0 2024-09-13T17:05:56.630 INFO:tasks.workunit.client.1.smithi195.stdout:3/822: dread d7/fd2 [0,4194304] 0 2024-09-13T17:05:56.630 INFO:tasks.workunit.client.1.smithi195.stdout:1/798: mknod db/d19/c10a 0 2024-09-13T17:05:56.630 INFO:tasks.workunit.client.1.smithi195.stdout:1/799: fsync db/df/d51/d62/d70/fda 0 2024-09-13T17:05:56.630 INFO:tasks.workunit.client.1.smithi195.stdout:1/800: truncate db/f97 103449 0 2024-09-13T17:05:56.631 INFO:tasks.workunit.client.1.smithi195.stdout:7/851: mknod d5/db/d50/daa/c12d 0 2024-09-13T17:05:56.631 INFO:tasks.workunit.client.1.smithi195.stdout:7/852: fsync d5/f72 0 2024-09-13T17:05:56.631 INFO:tasks.workunit.client.1.smithi195.stdout:7/853: fsync d5/d13/d30/f7a 0 2024-09-13T17:05:56.633 INFO:tasks.workunit.client.1.smithi195.stdout:5/859: mkdir d2/df/d48/d11e/d120 0 2024-09-13T17:05:56.635 INFO:tasks.workunit.client.0.smithi115.stdout:7/508: rename d0/d3b/d50/d21/d2f/f4e to d0/d2/d1e/d3d/d7c/fb9 0 2024-09-13T17:05:56.635 INFO:tasks.workunit.client.0.smithi115.stdout:7/509: readlink d0/l9 0 2024-09-13T17:05:56.636 INFO:tasks.workunit.client.0.smithi115.stdout:7/510: creat d0/d59/fba x:0 0 0 2024-09-13T17:05:56.636 INFO:tasks.workunit.client.0.smithi115.stdout:7/511: getdents d0/d2/d1e/d3d/d82/d44/dac 0 2024-09-13T17:05:56.636 INFO:tasks.workunit.client.0.smithi115.stdout:7/512: chown d0/l4 113 1 2024-09-13T17:05:56.636 INFO:tasks.workunit.client.0.smithi115.stdout:7/513: write d0/d2/d1e/d3d/d6c/f49 [1367323,32823] 0 2024-09-13T17:05:56.636 INFO:tasks.workunit.client.1.smithi195.stdout:6/774: write d1c/df0/db9/d30/fec [2455559,129492] 0 2024-09-13T17:05:56.636 INFO:tasks.workunit.client.1.smithi195.stdout:8/905: rmdir d0/d17/d2f/d7c/d4c/d9a/d109 39 2024-09-13T17:05:56.637 INFO:tasks.workunit.client.1.smithi195.stdout:8/906: creat d0/d17/d2f/d7c/f131 x:0 0 0 2024-09-13T17:05:56.639 INFO:tasks.workunit.client.1.smithi195.stdout:7/854: rename d5/db/d50/d7f/d82/de6 to d5/db/d50/d11d/d12e 0 2024-09-13T17:05:56.639 INFO:tasks.workunit.client.1.smithi195.stdout:7/855: dread - d5/db/d50/daa/fc1 zero size 2024-09-13T17:05:56.641 INFO:tasks.workunit.client.1.smithi195.stdout:5/860: getdents d2/df/d78/deb 0 2024-09-13T17:05:56.643 INFO:tasks.workunit.client.0.smithi115.stdout:7/514: mkdir d0/d2/d67/d86/d94/d9b/dbb 0 2024-09-13T17:05:56.643 INFO:tasks.workunit.client.1.smithi195.stdout:1/801: dread db/df/d13/f8d [0,4194304] 0 2024-09-13T17:05:56.643 INFO:tasks.workunit.client.1.smithi195.stdout:1/802: write db/df/d51/d62/f109 [494254,120439] 0 2024-09-13T17:05:56.645 INFO:tasks.workunit.client.0.smithi115.stdout:7/515: dread d0/d2/d1e/f6f [0,4194304] 0 2024-09-13T17:05:56.647 INFO:tasks.workunit.client.1.smithi195.stdout:3/823: dwrite f5 [0,4194304] 0 2024-09-13T17:05:56.647 INFO:tasks.workunit.client.1.smithi195.stdout:3/824: chown d7/d21/d2a/d4a/l9e 8090412 1 2024-09-13T17:05:56.647 INFO:tasks.workunit.client.1.smithi195.stdout:7/856: mknod d5/db/d50/d7f/d82/dad/df0/c12f 0 2024-09-13T17:05:56.647 INFO:tasks.workunit.client.1.smithi195.stdout:1/803: readlink db/df/d51/d8e/lff 0 2024-09-13T17:05:56.650 INFO:tasks.workunit.client.0.smithi115.stdout:7/516: creat d0/d2/d1e/d73/fbc x:0 0 0 2024-09-13T17:05:56.653 INFO:tasks.workunit.client.1.smithi195.stdout:3/825: mknod d7/d21/d2a/d35/c10f 0 2024-09-13T17:05:56.653 INFO:tasks.workunit.client.1.smithi195.stdout:6/775: dread d1c/d24/f2e [4194304,4194304] 0 2024-09-13T17:05:56.654 INFO:tasks.workunit.client.0.smithi115.stdout:7/517: mkdir d0/d3b/d50/d21/d2f/d9e/dbd 0 2024-09-13T17:05:56.656 INFO:tasks.workunit.client.1.smithi195.stdout:8/907: read d0/d17/d2f/d7c/d4c/d9b/fec [1037909,8954] 0 2024-09-13T17:05:56.656 INFO:tasks.workunit.client.1.smithi195.stdout:8/908: chown d0/fa8 275 1 2024-09-13T17:05:56.656 INFO:tasks.workunit.client.1.smithi195.stdout:2/831: dwrite d0/d4a/d47/d73/d75/d88/d1e/f2a [0,4194304] 0 2024-09-13T17:05:56.656 INFO:tasks.workunit.client.1.smithi195.stdout:7/857: creat d5/db/f130 x:0 0 0 2024-09-13T17:05:56.656 INFO:tasks.workunit.client.1.smithi195.stdout:7/858: stat d5/db/d50/d7f/d82/da1/cc5 0 2024-09-13T17:05:56.656 INFO:tasks.workunit.client.0.smithi115.stdout:7/518: symlink d0/d3b/d50/d21/d99/lbe 0 2024-09-13T17:05:56.657 INFO:tasks.workunit.client.1.smithi195.stdout:3/826: creat d7/d21/d2a/d35/d9c/dcf/f110 x:0 0 0 2024-09-13T17:05:56.661 INFO:tasks.workunit.client.0.smithi115.stdout:7/519: rmdir d0/d3b/d54 39 2024-09-13T17:05:56.665 INFO:tasks.workunit.client.0.smithi115.stdout:7/520: mkdir d0/d2/d1e/d3d/d82/d44/dac/dbf 0 2024-09-13T17:05:56.668 INFO:tasks.workunit.client.1.smithi195.stdout:5/861: dwrite d2/df/d78/deb/d4e/f3b [0,4194304] 0 2024-09-13T17:05:56.670 INFO:tasks.workunit.client.1.smithi195.stdout:2/832: truncate d0/f6c 515649 0 2024-09-13T17:05:56.672 INFO:tasks.workunit.client.1.smithi195.stdout:1/804: symlink db/d19/d5a/l10b 0 2024-09-13T17:05:56.674 INFO:tasks.workunit.client.1.smithi195.stdout:5/862: mkdir d2/d88/d121 0 2024-09-13T17:05:56.675 INFO:tasks.workunit.client.1.smithi195.stdout:2/833: symlink d0/d4a/d47/d73/d75/d88/d62/dc5/l102 0 2024-09-13T17:05:56.675 INFO:tasks.workunit.client.1.smithi195.stdout:3/827: dread d7/d21/f59 [0,4194304] 0 2024-09-13T17:05:56.675 INFO:tasks.workunit.client.1.smithi195.stdout:3/828: truncate d7/d21/d66/d7e/fec 300050 0 2024-09-13T17:05:56.675 INFO:tasks.workunit.client.1.smithi195.stdout:3/829: fsync d7/d67/f103 0 2024-09-13T17:05:56.680 INFO:tasks.workunit.client.1.smithi195.stdout:7/859: dwrite d5/db/d50/d7f/d82/f8b [0,4194304] 0 2024-09-13T17:05:56.680 INFO:tasks.workunit.client.1.smithi195.stdout:8/909: dwrite d0/d17/d2f/d7c/d4c/d9a/da5/f11c [0,4194304] 0 2024-09-13T17:05:56.680 INFO:tasks.workunit.client.1.smithi195.stdout:7/860: fsync d5/db/d50/daa/fc1 0 2024-09-13T17:05:56.680 INFO:tasks.workunit.client.1.smithi195.stdout:8/910: dread - d0/d17/d2f/d31/d101/d63/d71/f12e zero size 2024-09-13T17:05:56.688 INFO:tasks.workunit.client.0.smithi115.stdout:7/521: dwrite d0/faf [0,4194304] 0 2024-09-13T17:05:56.689 INFO:tasks.workunit.client.1.smithi195.stdout:8/911: rename d0/d17/d2f/d31/d101/d63/db3/dc9/f111 to d0/d17/d2f/d31/d101/d63/d71/de8/d125/f132 0 2024-09-13T17:05:56.689 INFO:tasks.workunit.client.1.smithi195.stdout:8/912: chown d0/d13/d52/d55/cd9 301 1 2024-09-13T17:05:56.697 INFO:tasks.workunit.client.1.smithi195.stdout:7/861: dread d5/d13/f40 [0,4194304] 0 2024-09-13T17:05:56.699 INFO:tasks.workunit.client.1.smithi195.stdout:7/862: mkdir d5/db/d19/d22/d90/d127/d131 0 2024-09-13T17:05:56.699 INFO:tasks.workunit.client.0.smithi115.stdout:7/522: write d0/d2/d1e/d3d/d6c/d71/f46 [471008,61936] 0 2024-09-13T17:05:56.700 INFO:tasks.workunit.client.1.smithi195.stdout:7/863: mknod d5/db/d50/d7f/d82/dad/df0/c132 0 2024-09-13T17:05:56.700 INFO:tasks.workunit.client.1.smithi195.stdout:7/864: rename d5/d35 to d5/d35/d37/d133 22 2024-09-13T17:05:56.702 INFO:tasks.workunit.client.1.smithi195.stdout:7/865: symlink d5/db/d50/d7f/d82/l134 0 2024-09-13T17:05:56.702 INFO:tasks.workunit.client.1.smithi195.stdout:8/913: dread d0/d17/d2f/d31/f87 [0,4194304] 0 2024-09-13T17:05:56.702 INFO:tasks.workunit.client.1.smithi195.stdout:8/914: creat d0/d13/d52/f133 x:0 0 0 2024-09-13T17:05:56.703 INFO:tasks.workunit.client.0.smithi115.stdout:7/523: rename d0/d51/cab to d0/d2/d1e/cc0 0 2024-09-13T17:05:56.703 INFO:tasks.workunit.client.0.smithi115.stdout:7/524: write d0/d97/f98 [970618,116913] 0 2024-09-13T17:05:56.704 INFO:tasks.workunit.client.1.smithi195.stdout:7/866: mkdir d5/d13/d135 0 2024-09-13T17:05:56.705 INFO:tasks.workunit.client.1.smithi195.stdout:1/805: dwrite db/df/d13/f21 [0,4194304] 0 2024-09-13T17:05:56.707 INFO:tasks.workunit.client.1.smithi195.stdout:3/830: dwrite d7/d21/d2a/d35/d8f/d9f/dfc/f10b [0,4194304] 0 2024-09-13T17:05:56.708 INFO:tasks.workunit.client.0.smithi115.stdout:7/525: rename d0/d2/d1e/d3d/d6c/f9c to d0/d51/fc1 0 2024-09-13T17:05:56.709 INFO:tasks.workunit.client.0.smithi115.stdout:7/526: chown d0/d59/fb8 0 1 2024-09-13T17:05:56.710 INFO:tasks.workunit.client.1.smithi195.stdout:8/915: symlink d0/d13/l134 0 2024-09-13T17:05:56.712 INFO:tasks.workunit.client.1.smithi195.stdout:7/867: creat d5/db/d19/d22/d90/d127/d131/f136 x:0 0 0 2024-09-13T17:05:56.712 INFO:tasks.workunit.client.1.smithi195.stdout:1/806: mkdir db/d19/d5a/d66/d7a/d10c 0 2024-09-13T17:05:56.712 INFO:tasks.workunit.client.1.smithi195.stdout:7/868: chown d5/db/d50/d7f/d82/cae 65881 1 2024-09-13T17:05:56.712 INFO:tasks.workunit.client.1.smithi195.stdout:1/807: chown db/df/d4d/d74/f7c 26 1 2024-09-13T17:05:56.715 INFO:tasks.workunit.client.1.smithi195.stdout:3/831: rename d7/d21/d2a/d35/d60/l7b to d7/d5f/l111 0 2024-09-13T17:05:56.718 INFO:tasks.workunit.client.1.smithi195.stdout:8/916: unlink d0/d4/f114 0 2024-09-13T17:05:56.720 INFO:tasks.workunit.client.1.smithi195.stdout:7/869: rmdir d5/d13/d135 0 2024-09-13T17:05:56.726 INFO:tasks.workunit.client.1.smithi195.stdout:1/808: rename db/df/d13/l25 to db/d19/d37/d46/d7e/de0/l10d 0 2024-09-13T17:05:56.729 INFO:tasks.workunit.client.1.smithi195.stdout:3/832: dread f5 [0,4194304] 0 2024-09-13T17:05:56.729 INFO:tasks.workunit.client.1.smithi195.stdout:7/870: creat d5/d13/d24/f137 x:0 0 0 2024-09-13T17:05:56.729 INFO:tasks.workunit.client.1.smithi195.stdout:7/871: readlink d5/db/d50/d7f/d82/dcc/l112 0 2024-09-13T17:05:56.729 INFO:tasks.workunit.client.1.smithi195.stdout:7/872: dread - d5/db/d19/d22/d90/fe1 zero size 2024-09-13T17:05:56.733 INFO:tasks.workunit.client.1.smithi195.stdout:7/873: mkdir d5/d13/d30/d138 0 2024-09-13T17:05:56.734 INFO:tasks.workunit.client.1.smithi195.stdout:7/874: truncate d5/d13/d30/fd0 3348779 0 2024-09-13T17:05:56.736 INFO:tasks.workunit.client.1.smithi195.stdout:3/833: dread d7/d21/d2a/d35/f37 [0,4194304] 0 2024-09-13T17:05:56.741 INFO:tasks.workunit.client.1.smithi195.stdout:0/823: sync 2024-09-13T17:05:56.741 INFO:tasks.workunit.client.1.smithi195.stdout:0/824: stat d7/d88/d7c/lba 0 2024-09-13T17:05:56.741 INFO:tasks.workunit.client.1.smithi195.stdout:0/825: write d7/d87/d9b/d56/d4d/d5e/f70 [1958669,70547] 0 2024-09-13T17:05:56.746 INFO:tasks.workunit.client.0.smithi115.stdout:7/527: dwrite d0/d2/d1e/d3d/d82/f2c [0,4194304] 0 2024-09-13T17:05:56.746 INFO:tasks.workunit.client.1.smithi195.stdout:8/917: dwrite d0/d17/d2f/d31/d101/d63/d71/de8/df6/df1/ff5 [4194304,4194304] 0 2024-09-13T17:05:56.746 INFO:tasks.workunit.client.1.smithi195.stdout:8/918: truncate d0/d17/faf 1934915 0 2024-09-13T17:05:56.747 INFO:tasks.workunit.client.1.smithi195.stdout:1/809: dwrite db/df/f7f [0,4194304] 0 2024-09-13T17:05:56.747 INFO:tasks.workunit.client.1.smithi195.stdout:3/834: dread d7/d21/d2a/f32 [0,4194304] 0 2024-09-13T17:05:56.747 INFO:tasks.workunit.client.1.smithi195.stdout:3/835: write d7/d19/f48 [4814191,36015] 0 2024-09-13T17:05:56.747 INFO:tasks.workunit.client.0.smithi115.stdout:7/528: symlink d0/d2/d1e/d3d/d82/lc2 0 2024-09-13T17:05:56.749 INFO:tasks.workunit.client.1.smithi195.stdout:7/875: rmdir d5/db/d19/d22 39 2024-09-13T17:05:56.750 INFO:tasks.workunit.client.0.smithi115.stdout:7/529: symlink d0/d3b/lc3 0 2024-09-13T17:05:56.750 INFO:tasks.workunit.client.0.smithi115.stdout:7/530: fdatasync d0/d51/fa8 0 2024-09-13T17:05:56.751 INFO:tasks.workunit.client.1.smithi195.stdout:3/836: getdents d7/d21/d2a/d35/d8f/d9f 0 2024-09-13T17:05:56.756 INFO:tasks.workunit.client.1.smithi195.stdout:8/919: dread d0/d17/d2f/d31/f3f [0,4194304] 0 2024-09-13T17:05:56.757 INFO:tasks.workunit.client.1.smithi195.stdout:9/907: sync 2024-09-13T17:05:56.758 INFO:tasks.workunit.client.0.smithi115.stdout:6/621: sync 2024-09-13T17:05:56.759 INFO:tasks.workunit.client.0.smithi115.stdout:8/574: sync 2024-09-13T17:05:56.759 INFO:tasks.workunit.client.0.smithi115.stdout:5/528: sync 2024-09-13T17:05:56.759 INFO:tasks.workunit.client.0.smithi115.stdout:6/622: fdatasync d8/db/dd/f3a 0 2024-09-13T17:05:56.759 INFO:tasks.workunit.client.0.smithi115.stdout:8/575: write d0/d15/d44/f75 [171491,80846] 0 2024-09-13T17:05:56.759 INFO:tasks.workunit.client.0.smithi115.stdout:0/390: sync 2024-09-13T17:05:56.759 INFO:tasks.workunit.client.0.smithi115.stdout:4/670: sync 2024-09-13T17:05:56.759 INFO:tasks.workunit.client.0.smithi115.stdout:2/783: sync 2024-09-13T17:05:56.759 INFO:tasks.workunit.client.0.smithi115.stdout:2/784: truncate d3/d4d/d13/d39/d46/da0/fde 549687 0 2024-09-13T17:05:56.759 INFO:tasks.workunit.client.0.smithi115.stdout:9/395: sync 2024-09-13T17:05:56.759 INFO:tasks.workunit.client.0.smithi115.stdout:4/671: write d7/dd/de/d4e/d6c/f8a [962959,65655] 0 2024-09-13T17:05:56.759 INFO:tasks.workunit.client.0.smithi115.stdout:1/547: sync 2024-09-13T17:05:56.759 INFO:tasks.workunit.client.0.smithi115.stdout:3/786: sync 2024-09-13T17:05:56.759 INFO:tasks.workunit.client.0.smithi115.stdout:3/787: creat d1/d4b/d69/db6/f104 x:0 0 0 2024-09-13T17:05:56.760 INFO:tasks.workunit.client.0.smithi115.stdout:7/531: dread d0/d2/d1e/f76 [4194304,4194304] 0 2024-09-13T17:05:56.760 INFO:tasks.workunit.client.0.smithi115.stdout:7/532: creat d0/d3b/d50/d21/d2f/fc4 x:0 0 0 2024-09-13T17:05:56.760 INFO:tasks.workunit.client.0.smithi115.stdout:7/533: chown d0/d2/d67/f80 0 1 2024-09-13T17:05:56.761 INFO:tasks.workunit.client.0.smithi115.stdout:5/529: dread d19/d21/d3a/f6d [0,4194304] 0 2024-09-13T17:05:56.761 INFO:tasks.workunit.client.1.smithi195.stdout:1/810: dread db/f1c [0,4194304] 0 2024-09-13T17:05:56.761 INFO:tasks.workunit.client.1.smithi195.stdout:3/837: symlink d7/d21/d2a/d35/d9c/dcf/l112 0 2024-09-13T17:05:56.762 INFO:tasks.workunit.client.0.smithi115.stdout:6/623: symlink d8/d33/d82/d80/lc1 0 2024-09-13T17:05:56.765 INFO:tasks.workunit.client.1.smithi195.stdout:8/920: rename d0/d17/d2f/d31/db4/fcf to d0/d121/f135 0 2024-09-13T17:05:56.766 INFO:tasks.workunit.client.0.smithi115.stdout:8/576: unlink d0/d21/d3a/d60/fa2 0 2024-09-13T17:05:56.768 INFO:tasks.workunit.client.1.smithi195.stdout:9/908: mkdir d6/df/d16/de3/d125 0 2024-09-13T17:05:56.769 INFO:tasks.workunit.client.0.smithi115.stdout:0/391: creat d9/d1d/d24/d26/d5d/f70 x:0 0 0 2024-09-13T17:05:56.770 INFO:tasks.workunit.client.1.smithi195.stdout:7/876: mknod d5/db/d19/d22/d3c/df1/c139 0 2024-09-13T17:05:56.771 INFO:tasks.workunit.client.0.smithi115.stdout:2/785: creat d3/d4d/dd/d1f/ff9 x:0 0 0 2024-09-13T17:05:56.772 INFO:tasks.workunit.client.1.smithi195.stdout:1/811: symlink db/df/d51/d62/l10e 0 2024-09-13T17:05:56.772 INFO:tasks.workunit.client.1.smithi195.stdout:1/812: fdatasync db/df/d4d/d74/fbd 0 2024-09-13T17:05:56.777 INFO:tasks.workunit.client.1.smithi195.stdout:8/921: rename d0/d17/d2f/d31/f87 to d0/d121/f136 0 2024-09-13T17:05:56.778 INFO:tasks.workunit.client.0.smithi115.stdout:9/396: creat d0/d21/d65/d6f/f88 x:0 0 0 2024-09-13T17:05:56.780 INFO:tasks.workunit.client.1.smithi195.stdout:9/909: link d6/df/d13/fd7 d6/d19/d21/d45/dad/d5e/da0/f126 0 2024-09-13T17:05:56.780 INFO:tasks.workunit.client.1.smithi195.stdout:5/863: sync 2024-09-13T17:05:56.780 INFO:tasks.workunit.client.1.smithi195.stdout:6/776: sync 2024-09-13T17:05:56.781 INFO:tasks.workunit.client.1.smithi195.stdout:6/777: chown d1c/df0/db9/d8c 9 1 2024-09-13T17:05:56.781 INFO:tasks.workunit.client.1.smithi195.stdout:5/864: creat d2/df/d78/deb/d4e/d10/d8f/f122 x:0 0 0 2024-09-13T17:05:56.781 INFO:tasks.workunit.client.1.smithi195.stdout:6/778: write d1c/d24/d49/d5f/d35/d88/fb2 [2747904,110804] 0 2024-09-13T17:05:56.782 INFO:tasks.workunit.client.1.smithi195.stdout:7/877: mkdir d5/db/d19/d22/d90/d127/d131/d13a 0 2024-09-13T17:05:56.784 INFO:tasks.workunit.client.0.smithi115.stdout:4/672: mkdir d7/dd/d3c/d74/d8b/dd2 0 2024-09-13T17:05:56.787 INFO:tasks.workunit.client.1.smithi195.stdout:3/838: dwrite d7/d21/d2a/f2b [0,4194304] 0 2024-09-13T17:05:56.787 INFO:tasks.workunit.client.1.smithi195.stdout:3/839: chown d7/d21/d2a/d35/d9c/dcf/ddb 1516716 1 2024-09-13T17:05:56.787 INFO:tasks.workunit.client.1.smithi195.stdout:3/840: write d7/d21/f26 [3042328,69049] 0 2024-09-13T17:05:56.787 INFO:tasks.workunit.client.1.smithi195.stdout:1/813: symlink db/d19/d37/d3e/l10f 0 2024-09-13T17:05:56.788 INFO:tasks.workunit.client.0.smithi115.stdout:1/548: dwrite d5/d7/d33/d3a/fac [0,4194304] 0 2024-09-13T17:05:56.789 INFO:tasks.workunit.client.0.smithi115.stdout:3/788: mkdir d1/d4b/d1a/d105 0 2024-09-13T17:05:56.790 INFO:tasks.workunit.client.0.smithi115.stdout:9/397: write d0/de/d37/f5d [3365896,47730] 0 2024-09-13T17:05:56.790 INFO:tasks.workunit.client.0.smithi115.stdout:9/398: chown d0/de/d37/f41 8204 1 2024-09-13T17:05:56.792 INFO:tasks.workunit.client.1.smithi195.stdout:8/922: creat d0/d17/d2f/d31/d101/d63/d71/de8/df6/df1/f137 x:0 0 0 2024-09-13T17:05:56.792 INFO:tasks.workunit.client.1.smithi195.stdout:8/923: read - d0/d17/d2f/d31/d101/d63/db3/fbd zero size 2024-09-13T17:05:56.792 INFO:tasks.workunit.client.1.smithi195.stdout:8/924: chown d0/d17/d2f/d31/db4/dfc/f120 8071 1 2024-09-13T17:05:56.794 INFO:tasks.workunit.client.0.smithi115.stdout:7/534: symlink d0/d2/d1e/d3d/d82/d44/da7/lc5 0 2024-09-13T17:05:56.794 INFO:tasks.workunit.client.0.smithi115.stdout:7/535: truncate d0/d51/fa8 1049415 0 2024-09-13T17:05:56.794 INFO:tasks.workunit.client.0.smithi115.stdout:7/536: truncate d0/d2/d1e/f32 4563339 0 2024-09-13T17:05:56.794 INFO:tasks.workunit.client.1.smithi195.stdout:9/910: write d6/df/d16/fdd [458451,8756] 0 2024-09-13T17:05:56.794 INFO:tasks.workunit.client.1.smithi195.stdout:9/911: fdatasync d6/d12/d86/d11e/d61/f9f 0 2024-09-13T17:05:56.795 INFO:tasks.workunit.client.1.smithi195.stdout:9/912: chown d6/d19/d21/d45/dad/d5e/de7 20053139 1 2024-09-13T17:05:56.795 INFO:tasks.workunit.client.0.smithi115.stdout:5/530: mkdir d19/d2b/d32/d55/d5e/d87/db0 0 2024-09-13T17:05:56.796 INFO:tasks.workunit.client.1.smithi195.stdout:5/865: mknod d2/df/d78/deb/d4e/d10/d8f/c123 0 2024-09-13T17:05:56.796 INFO:tasks.workunit.client.0.smithi115.stdout:2/786: dwrite d3/d4d/de/f10 [0,4194304] 0 2024-09-13T17:05:56.797 INFO:tasks.workunit.client.0.smithi115.stdout:6/624: read - d8/d33/d40/d4c/f62 zero size 2024-09-13T17:05:56.797 INFO:tasks.workunit.client.1.smithi195.stdout:6/779: mknod d1c/d24/d49/d5f/d85/cfa 0 2024-09-13T17:05:56.799 INFO:tasks.workunit.client.0.smithi115.stdout:8/577: rename d0/d21/f4a to d0/d26/d29/d59/d7e/da1/dbd/fbf 0 2024-09-13T17:05:56.799 INFO:tasks.workunit.client.0.smithi115.stdout:8/578: write d0/d26/d29/d59/d7e/da7/d2b/db1/fbc [506918,87193] 0 2024-09-13T17:05:56.799 INFO:tasks.workunit.client.0.smithi115.stdout:8/579: write d0/d26/d29/d98/f9f [725910,65156] 0 2024-09-13T17:05:56.799 INFO:tasks.workunit.client.0.smithi115.stdout:0/392: mknod d9/c71 0 2024-09-13T17:05:56.800 INFO:tasks.workunit.client.1.smithi195.stdout:7/878: mknod d5/d13/da8/df9/c13b 0 2024-09-13T17:05:56.800 INFO:tasks.workunit.client.1.smithi195.stdout:7/879: readlink d5/db/d50/d7f/d82/dcc/l120 0 2024-09-13T17:05:56.800 INFO:tasks.workunit.client.0.smithi115.stdout:1/549: mkdir d5/d60/dbf 0 2024-09-13T17:05:56.801 INFO:tasks.workunit.client.0.smithi115.stdout:1/550: chown d5/d7/d33/d3a 44686162 1 2024-09-13T17:05:56.801 INFO:tasks.workunit.client.1.smithi195.stdout:3/841: creat d7/d21/d2a/d35/d8f/f113 x:0 0 0 2024-09-13T17:05:56.803 INFO:tasks.workunit.client.0.smithi115.stdout:3/789: unlink d1/d12/d14/l49 0 2024-09-13T17:05:56.804 INFO:tasks.workunit.client.1.smithi195.stdout:1/814: symlink db/d19/d5a/d66/l110 0 2024-09-13T17:05:56.806 INFO:tasks.workunit.client.0.smithi115.stdout:4/673: dwrite d7/dd/de/f59 [0,4194304] 0 2024-09-13T17:05:56.806 INFO:tasks.workunit.client.0.smithi115.stdout:4/674: stat d7/dd/d3c/d72/f95 0 2024-09-13T17:05:56.806 INFO:tasks.workunit.client.0.smithi115.stdout:4/675: fdatasync d7/f19 0 2024-09-13T17:05:56.807 INFO:tasks.workunit.client.1.smithi195.stdout:9/913: mknod d6/d19/d21/d45/dd1/c127 0 2024-09-13T17:05:56.807 INFO:tasks.workunit.client.1.smithi195.stdout:9/914: dread - d6/df/d16/de3/d68/d6d/f11c zero size 2024-09-13T17:05:56.808 INFO:tasks.workunit.client.0.smithi115.stdout:9/399: unlink d0/de/f5c 0 2024-09-13T17:05:56.811 INFO:tasks.workunit.client.0.smithi115.stdout:6/625: truncate d8/f76 661942 0 2024-09-13T17:05:56.811 INFO:tasks.workunit.client.0.smithi115.stdout:6/626: stat d8/d13/f9d 0 2024-09-13T17:05:56.811 INFO:tasks.workunit.client.0.smithi115.stdout:6/627: fdatasync d8/d33/d40/d67/db4/d24/f81 0 2024-09-13T17:05:56.811 INFO:tasks.workunit.client.0.smithi115.stdout:6/628: chown d8/d33/d7f/cbb 14 1 2024-09-13T17:05:56.811 INFO:tasks.workunit.client.0.smithi115.stdout:6/629: truncate d8/db/d49/f5e 1212364 0 2024-09-13T17:05:56.811 INFO:tasks.workunit.client.0.smithi115.stdout:6/630: chown d8/db/dd/f16 37707561 1 2024-09-13T17:05:56.811 INFO:tasks.workunit.client.0.smithi115.stdout:6/631: write d8/d33/d82/f43 [5645205,82949] 0 2024-09-13T17:05:56.812 INFO:tasks.workunit.client.1.smithi195.stdout:5/866: link d2/df/d78/deb/d4e/d10/d8f/f11f d2/df/d78/deb/d3f/dfa/f124 0 2024-09-13T17:05:56.813 INFO:tasks.workunit.client.1.smithi195.stdout:6/780: mkdir d1c/d24/d49/d5f/db1/dfb 0 2024-09-13T17:05:56.814 INFO:tasks.workunit.client.0.smithi115.stdout:5/531: dread d19/d2b/d32/d55/d5e/f9f [0,4194304] 0 2024-09-13T17:05:56.817 INFO:tasks.workunit.client.0.smithi115.stdout:5/532: dread d19/d2b/d32/d55/f94 [0,4194304] 0 2024-09-13T17:05:56.817 INFO:tasks.workunit.client.0.smithi115.stdout:5/533: chown d19/d2b/d32/f8b 1 1 2024-09-13T17:05:56.817 INFO:tasks.workunit.client.0.smithi115.stdout:7/537: dwrite d0/faf [0,4194304] 0 2024-09-13T17:05:56.817 INFO:tasks.workunit.client.0.smithi115.stdout:8/580: mknod d0/d42/d80/d94/cc0 0 2024-09-13T17:05:56.818 INFO:tasks.workunit.client.1.smithi195.stdout:9/915: write d6/d19/d21/d45/dad/d5e/da0/fb7 [2843803,51502] 0 2024-09-13T17:05:56.818 INFO:tasks.workunit.client.0.smithi115.stdout:1/551: creat d5/d7/fc0 x:0 0 0 2024-09-13T17:05:56.822 INFO:tasks.workunit.client.1.smithi195.stdout:7/880: creat d5/db/d19/d22/d90/dd4/d10d/f13c x:0 0 0 2024-09-13T17:05:56.823 INFO:tasks.workunit.client.0.smithi115.stdout:9/400: write d0/d21/f36 [5705922,116849] 0 2024-09-13T17:05:56.823 INFO:tasks.workunit.client.0.smithi115.stdout:9/401: chown d0/de/d10/d15/c2b 407 1 2024-09-13T17:05:56.823 INFO:tasks.workunit.client.0.smithi115.stdout:5/534: read d19/d21/d62/f68 [286909,59300] 0 2024-09-13T17:05:56.825 INFO:tasks.workunit.client.1.smithi195.stdout:3/842: unlink d7/d21/l5e 0 2024-09-13T17:05:56.828 INFO:tasks.workunit.client.0.smithi115.stdout:0/393: dwrite d9/d1d/d24/d26/f45 [0,4194304] 0 2024-09-13T17:05:56.829 INFO:tasks.workunit.client.0.smithi115.stdout:4/676: unlink d7/dd/de/d4e/d5a/d4f/d53/fc4 0 2024-09-13T17:05:56.829 INFO:tasks.workunit.client.0.smithi115.stdout:4/677: fdatasync d7/f7f 0 2024-09-13T17:05:56.829 INFO:tasks.workunit.client.0.smithi115.stdout:4/678: write d7/dd/d3c/d72/db3/fb8 [1401514,98741] 0 2024-09-13T17:05:56.833 INFO:tasks.workunit.client.1.smithi195.stdout:9/916: truncate d6/df/d16/de3/d68/fbd 1811209 0 2024-09-13T17:05:56.833 INFO:tasks.workunit.client.1.smithi195.stdout:9/917: stat d6/d19/d21/d45/dad/d5e/de7/fe9 0 2024-09-13T17:05:56.834 INFO:tasks.workunit.client.1.smithi195.stdout:3/843: dread d7/d21/d2a/d4a/fc3 [0,4194304] 0 2024-09-13T17:05:56.835 INFO:tasks.workunit.client.0.smithi115.stdout:6/632: creat d8/d33/d40/d67/db4/d24/d53/d6a/fc2 x:0 0 0 2024-09-13T17:05:56.839 INFO:tasks.workunit.client.1.smithi195.stdout:7/881: truncate d5/d13/da8/fb6 532528 0 2024-09-13T17:05:56.839 INFO:tasks.workunit.client.1.smithi195.stdout:5/867: dwrite d2/df/d78/deb/d4e/d10/d5c/fcf [0,4194304] 0 2024-09-13T17:05:56.839 INFO:tasks.workunit.client.1.smithi195.stdout:5/868: readlink d2/df/d78/deb/d4e/d10/d5c/lca 0 2024-09-13T17:05:56.840 INFO:tasks.workunit.client.1.smithi195.stdout:1/815: rename db/df/f3a to db/df/d51/d8e/f111 0 2024-09-13T17:05:56.840 INFO:tasks.workunit.client.1.smithi195.stdout:1/816: fdatasync db/df/d4d/d74/da8/fb2 0 2024-09-13T17:05:56.841 INFO:tasks.workunit.client.1.smithi195.stdout:3/844: mknod d7/d21/d2a/d35/d60/db0/c114 0 2024-09-13T17:05:56.847 INFO:tasks.workunit.client.0.smithi115.stdout:7/538: dwrite d0/d2/d67/d86/fb1 [0,4194304] 0 2024-09-13T17:05:56.848 INFO:tasks.workunit.client.0.smithi115.stdout:2/787: rename d3/d4d/d13/d39 to d3/d4d/de/d99/d9a/df1/dfa 0 2024-09-13T17:05:56.848 INFO:tasks.workunit.client.0.smithi115.stdout:2/788: dread - d3/d4d/dd/d1f/ff9 zero size 2024-09-13T17:05:56.848 INFO:tasks.workunit.client.0.smithi115.stdout:2/789: chown d3/d4d/dd/f96 2 1 2024-09-13T17:05:56.848 INFO:tasks.workunit.client.0.smithi115.stdout:2/790: write d3/d4d/d13/d62/d92/dd7/d56/f42 [1202683,44990] 0 2024-09-13T17:05:56.848 INFO:tasks.workunit.client.0.smithi115.stdout:2/791: fsync d3/d4d/d13/f45 0 2024-09-13T17:05:56.850 INFO:tasks.workunit.client.1.smithi195.stdout:5/869: mknod d2/df/d78/d54/c125 0 2024-09-13T17:05:56.852 INFO:tasks.workunit.client.1.smithi195.stdout:1/817: mkdir db/d19/d5a/d66/df2/d112 0 2024-09-13T17:05:56.852 INFO:tasks.workunit.client.0.smithi115.stdout:8/581: chown d0/l9 2161 1 2024-09-13T17:05:56.854 INFO:tasks.workunit.client.1.smithi195.stdout:5/870: mknod d2/df/d78/d76/d114/c126 0 2024-09-13T17:05:56.855 INFO:tasks.workunit.client.0.smithi115.stdout:1/552: rmdir d5/d26/d2c/d62 39 2024-09-13T17:05:56.859 INFO:tasks.workunit.client.1.smithi195.stdout:9/918: dwrite d6/df/f3c [0,4194304] 0 2024-09-13T17:05:56.859 INFO:tasks.workunit.client.1.smithi195.stdout:9/919: creat d6/df/d13/f128 x:0 0 0 2024-09-13T17:05:56.860 INFO:tasks.workunit.client.0.smithi115.stdout:4/679: dwrite d7/dd/de/d4e/d5a/d4f/d53/f7a [0,4194304] 0 2024-09-13T17:05:56.860 INFO:tasks.workunit.client.0.smithi115.stdout:4/680: write d7/dd/de/d4e/d5a/d4f/f8f [856787,99227] 0 2024-09-13T17:05:56.860 INFO:tasks.workunit.client.0.smithi115.stdout:4/681: write d7/dd/f26 [173447,91411] 0 2024-09-13T17:05:56.860 INFO:tasks.workunit.client.0.smithi115.stdout:4/682: chown d7/dd/f4d 0 1 2024-09-13T17:05:56.861 INFO:tasks.workunit.client.1.smithi195.stdout:7/882: dwrite d5/db/d19/d22/d90/fe1 [0,4194304] 0 2024-09-13T17:05:56.862 INFO:tasks.workunit.client.1.smithi195.stdout:7/883: readlink d5/db/d50/d7f/d82/da1/ld8 0 2024-09-13T17:05:56.862 INFO:tasks.workunit.client.1.smithi195.stdout:5/871: link d2/df/d86/c112 d2/df/d78/deb/d4e/d10/d8f/dc9/c127 0 2024-09-13T17:05:56.862 INFO:tasks.workunit.client.1.smithi195.stdout:5/872: stat d2/df/d78/f8b 0 2024-09-13T17:05:56.862 INFO:tasks.workunit.client.1.smithi195.stdout:3/845: dwrite d7/fd2 [4194304,4194304] 0 2024-09-13T17:05:56.862 INFO:tasks.workunit.client.1.smithi195.stdout:5/873: write d2/df/d78/deb/d4e/d10/d5c/fe1 [880596,41397] 0 2024-09-13T17:05:56.862 INFO:tasks.workunit.client.1.smithi195.stdout:3/846: fdatasync d7/d21/d2a/d4a/fab 0 2024-09-13T17:05:56.862 INFO:tasks.workunit.client.1.smithi195.stdout:3/847: creat d7/d21/d2a/d35/d60/d6f/dbf/f115 x:0 0 0 2024-09-13T17:05:56.863 INFO:tasks.workunit.client.0.smithi115.stdout:9/402: dread d0/d34/f4c [0,4194304] 0 2024-09-13T17:05:56.863 INFO:tasks.workunit.client.1.smithi195.stdout:1/818: link db/df/d13/f5b db/d19/d5a/f113 0 2024-09-13T17:05:56.863 INFO:tasks.workunit.client.1.smithi195.stdout:2/834: sync 2024-09-13T17:05:56.863 INFO:tasks.workunit.client.1.smithi195.stdout:2/835: write d0/d4a/d47/d73/d75/d88/d2c/f91 [972398,34277] 0 2024-09-13T17:05:56.865 INFO:tasks.workunit.client.0.smithi115.stdout:5/535: getdents d19/d2b/d32 0 2024-09-13T17:05:56.870 INFO:tasks.workunit.client.0.smithi115.stdout:8/582: dwrite d0/d21/d76/d83/fab [0,4194304] 0 2024-09-13T17:05:56.871 INFO:tasks.workunit.client.0.smithi115.stdout:0/394: rmdir d9/d1d/d24/d26/d2c 39 2024-09-13T17:05:56.877 INFO:tasks.workunit.client.1.smithi195.stdout:3/848: unlink d7/d21/d66/c6d 0 2024-09-13T17:05:56.877 INFO:tasks.workunit.client.1.smithi195.stdout:3/849: chown d7/d21/d2a/d35/d60/db0/c114 74 1 2024-09-13T17:05:56.878 INFO:tasks.workunit.client.0.smithi115.stdout:7/539: rmdir d0/d2/d67/d70 39 2024-09-13T17:05:56.878 INFO:tasks.workunit.client.0.smithi115.stdout:7/540: getdents d0/d3b/d50/d21/d2f/d9e/dbd 0 2024-09-13T17:05:56.880 INFO:tasks.workunit.client.1.smithi195.stdout:9/920: dwrite d6/d19/d21/d45/dad/d5e/da0/fb7 [0,4194304] 0 2024-09-13T17:05:56.882 INFO:tasks.workunit.client.1.smithi195.stdout:1/819: link db/df/d13/f22 db/d19/d37/d46/d7e/f114 0 2024-09-13T17:05:56.883 INFO:tasks.workunit.client.1.smithi195.stdout:7/884: write d5/db/d19/f33 [2080032,35859] 0 2024-09-13T17:05:56.884 INFO:tasks.workunit.client.0.smithi115.stdout:2/792: link d3/d4d/d13/d62/d92/dd7/d56/d58/d72/l93 d3/d4d/dd/df/d5c/lfb 0 2024-09-13T17:05:56.884 INFO:tasks.workunit.client.1.smithi195.stdout:5/874: dwrite d2/df/d78/deb/d3f/dfa/f124 [0,4194304] 0 2024-09-13T17:05:56.884 INFO:tasks.workunit.client.1.smithi195.stdout:5/875: write d2/df/d78/deb/d4e/d10/d8f/f122 [1018097,64546] 0 2024-09-13T17:05:56.884 INFO:tasks.workunit.client.1.smithi195.stdout:5/876: write d2/df/d78/deb/d4e/d10/f24 [4770040,130011] 0 2024-09-13T17:05:56.889 INFO:tasks.workunit.client.1.smithi195.stdout:2/836: mknod d0/df1/c103 0 2024-09-13T17:05:56.891 INFO:tasks.workunit.client.0.smithi115.stdout:7/541: dread d0/f13 [0,4194304] 0 2024-09-13T17:05:56.891 INFO:tasks.workunit.client.0.smithi115.stdout:7/542: fdatasync d0/d2/d4a/fa2 0 2024-09-13T17:05:56.892 INFO:tasks.workunit.client.1.smithi195.stdout:7/885: dread d5/d13/d30/f36 [0,4194304] 0 2024-09-13T17:05:56.894 INFO:tasks.workunit.client.1.smithi195.stdout:3/850: mkdir d7/d21/d2a/d35/d60/d64/dbc/d116 0 2024-09-13T17:05:56.895 INFO:tasks.workunit.client.1.smithi195.stdout:3/851: chown d7/d19/d1e/f52 10105639 1 2024-09-13T17:05:56.895 INFO:tasks.workunit.client.1.smithi195.stdout:3/852: fdatasync d7/fe6 0 2024-09-13T17:05:56.895 INFO:tasks.workunit.client.0.smithi115.stdout:4/683: mknod d7/dd/de/d4e/d9f/cd3 0 2024-09-13T17:05:56.897 INFO:tasks.workunit.client.0.smithi115.stdout:9/403: creat d0/de/f89 x:0 0 0 2024-09-13T17:05:56.897 INFO:tasks.workunit.client.0.smithi115.stdout:9/404: chown d0/de/d37/l43 4 1 2024-09-13T17:05:56.899 INFO:tasks.workunit.client.1.smithi195.stdout:1/820: rename db/d19/c5f to db/d60/d73/c115 0 2024-09-13T17:05:56.900 INFO:tasks.workunit.client.1.smithi195.stdout:9/921: dwrite d6/df/d13/fd7 [4194304,4194304] 0 2024-09-13T17:05:56.901 INFO:tasks.workunit.client.0.smithi115.stdout:5/536: unlink d19/d2b/d32/d55/f57 0 2024-09-13T17:05:56.905 INFO:tasks.workunit.client.0.smithi115.stdout:8/583: mkdir d0/d21/d76/dc1 0 2024-09-13T17:05:56.906 INFO:tasks.workunit.client.0.smithi115.stdout:0/395: rename d9/f16 to d9/d1d/d24/f72 0 2024-09-13T17:05:56.908 INFO:tasks.workunit.client.0.smithi115.stdout:1/553: getdents d5/d7/d5c/d73 0 2024-09-13T17:05:56.911 INFO:tasks.workunit.client.0.smithi115.stdout:7/543: creat d0/d3b/d50/d21/d2f/d9e/fc6 x:0 0 0 2024-09-13T17:05:56.911 INFO:tasks.workunit.client.0.smithi115.stdout:7/544: read d0/d3b/d50/d21/f33 [136029,127260] 0 2024-09-13T17:05:56.911 INFO:tasks.workunit.client.0.smithi115.stdout:2/793: dwrite d3/d4d/de/f10 [0,4194304] 0 2024-09-13T17:05:56.911 INFO:tasks.workunit.client.0.smithi115.stdout:7/545: write d0/d2/d1e/d3d/d82/fb5 [4588,10232] 0 2024-09-13T17:05:56.912 INFO:tasks.workunit.client.0.smithi115.stdout:4/684: mkdir d7/dd/de/d4e/d9f/dd4 0 2024-09-13T17:05:56.912 INFO:tasks.workunit.client.0.smithi115.stdout:4/685: chown d7/dbe/f87 3 1 2024-09-13T17:05:56.913 INFO:tasks.workunit.client.1.smithi195.stdout:9/922: dread d6/d19/d21/d45/dad/d5e/de7/fe9 [0,4194304] 0 2024-09-13T17:05:56.917 INFO:tasks.workunit.client.0.smithi115.stdout:5/537: getdents d19/d21/d3a 0 2024-09-13T17:05:56.918 INFO:tasks.workunit.client.1.smithi195.stdout:5/877: symlink d2/df/d90/dbb/dec/d10a/l128 0 2024-09-13T17:05:56.919 INFO:tasks.workunit.client.0.smithi115.stdout:8/584: truncate d0/d26/d29/f38 2480654 0 2024-09-13T17:05:56.920 INFO:tasks.workunit.client.1.smithi195.stdout:2/837: rmdir d0/d4a/d47/d73/d75/d88/d2c/d43/d63/db2/db3 39 2024-09-13T17:05:56.921 INFO:tasks.workunit.client.0.smithi115.stdout:0/396: mknod d9/d1b/c73 0 2024-09-13T17:05:56.921 INFO:tasks.workunit.client.0.smithi115.stdout:0/397: stat d9/d1d/f42 0 2024-09-13T17:05:56.923 INFO:tasks.workunit.client.1.smithi195.stdout:2/838: fsync d0/d4a/d47/d73/d75/d88/d2c/fe4 0 2024-09-13T17:05:56.924 INFO:tasks.workunit.client.0.smithi115.stdout:1/554: symlink d5/d3e/d59/d96/lc1 0 2024-09-13T17:05:56.924 INFO:tasks.workunit.client.0.smithi115.stdout:1/555: chown d5/d7/d33/d3a/db2/lbd 10936349 1 2024-09-13T17:05:56.925 INFO:tasks.workunit.client.0.smithi115.stdout:9/405: dread d0/d21/d42/f50 [0,4194304] 0 2024-09-13T17:05:56.925 INFO:tasks.workunit.client.0.smithi115.stdout:9/406: creat d0/d21/d65/d6f/f8a x:0 0 0 2024-09-13T17:05:56.928 INFO:tasks.workunit.client.1.smithi195.stdout:9/923: dread d6/d12/f2b [4194304,4194304] 0 2024-09-13T17:05:56.928 INFO:tasks.workunit.client.1.smithi195.stdout:9/924: write d6/df/d16/d103/f10e [430887,59077] 0 2024-09-13T17:05:56.928 INFO:tasks.workunit.client.1.smithi195.stdout:3/853: unlink d7/d21/d2a/d35/lbb 0 2024-09-13T17:05:56.929 INFO:tasks.workunit.client.1.smithi195.stdout:3/854: creat d7/d62/d70/f117 x:0 0 0 2024-09-13T17:05:56.930 INFO:tasks.workunit.client.1.smithi195.stdout:1/821: symlink db/d19/d5a/d66/d7a/d10c/l116 0 2024-09-13T17:05:56.930 INFO:tasks.workunit.client.1.smithi195.stdout:1/822: truncate db/df/d4d/d74/da8/fb2 4221963 0 2024-09-13T17:05:56.930 INFO:tasks.workunit.client.0.smithi115.stdout:8/585: dread d0/d21/d76/d83/f6c [4194304,4194304] 0 2024-09-13T17:05:56.930 INFO:tasks.workunit.client.0.smithi115.stdout:8/586: stat d0/d15/d3e/f6d 0 2024-09-13T17:05:56.930 INFO:tasks.workunit.client.0.smithi115.stdout:8/587: write d0/d26/d29/f86 [503297,74661] 0 2024-09-13T17:05:56.931 INFO:tasks.workunit.client.0.smithi115.stdout:2/794: rename d3/d4d/d13/d62/d92/dd7/d56/l53 to d3/d4d/d13/d62/de2/lfc 0 2024-09-13T17:05:56.931 INFO:tasks.workunit.client.0.smithi115.stdout:2/795: write d3/d4d/dd/d1f/f7e [1217477,35969] 0 2024-09-13T17:05:56.933 INFO:tasks.workunit.client.0.smithi115.stdout:4/686: truncate d7/fc 177944 0 2024-09-13T17:05:56.933 INFO:tasks.workunit.client.0.smithi115.stdout:4/687: write d7/dd/f81 [493963,125039] 0 2024-09-13T17:05:56.933 INFO:tasks.workunit.client.1.smithi195.stdout:9/925: dread d6/df/d16/d58/f6e [0,4194304] 0 2024-09-13T17:05:56.933 INFO:tasks.workunit.client.1.smithi195.stdout:9/926: dread - d6/d19/d21/d45/dd1/f121 zero size 2024-09-13T17:05:56.934 INFO:tasks.workunit.client.0.smithi115.stdout:0/398: rmdir d9/d1d 39 2024-09-13T17:05:56.935 INFO:tasks.workunit.client.1.smithi195.stdout:0/826: sync 2024-09-13T17:05:56.935 INFO:tasks.workunit.client.1.smithi195.stdout:0/827: write d7/d87/d9b/d56/d46/f91 [4483887,5834] 0 2024-09-13T17:05:56.935 INFO:tasks.workunit.client.1.smithi195.stdout:3/855: dread d7/d21/d2a/d4a/f7a [0,4194304] 0 2024-09-13T17:05:56.936 INFO:tasks.workunit.client.0.smithi115.stdout:1/556: mknod d5/cc2 0 2024-09-13T17:05:56.936 INFO:tasks.workunit.client.0.smithi115.stdout:1/557: fdatasync d5/d26/d2c/f32 0 2024-09-13T17:05:56.938 INFO:tasks.workunit.client.0.smithi115.stdout:9/407: creat d0/de/d10/d15/d86/f8b x:0 0 0 2024-09-13T17:05:56.940 INFO:tasks.workunit.client.1.smithi195.stdout:7/886: write d5/db/d50/f87 [437827,102658] 0 2024-09-13T17:05:56.940 INFO:tasks.workunit.client.1.smithi195.stdout:7/887: write d5/db/d50/d7f/d82/da1/f114 [525637,45780] 0 2024-09-13T17:05:56.940 INFO:tasks.workunit.client.1.smithi195.stdout:7/888: write d5/d35/d37/f46 [4688867,13108] 0 2024-09-13T17:05:56.941 INFO:tasks.workunit.client.0.smithi115.stdout:7/546: rmdir d0/d3b/d50/d21/d2f/d9e 39 2024-09-13T17:05:56.941 INFO:tasks.workunit.client.0.smithi115.stdout:7/547: dread - d0/d2/d1e/f77 zero size 2024-09-13T17:05:56.941 INFO:tasks.workunit.client.0.smithi115.stdout:7/548: write d0/d2/d1e/d3d/d82/fb5 [859577,13099] 0 2024-09-13T17:05:56.945 INFO:tasks.workunit.client.1.smithi195.stdout:2/839: rmdir d0/d4a/d47/d73/d75/d88/d1e 39 2024-09-13T17:05:56.945 INFO:tasks.workunit.client.0.smithi115.stdout:8/588: creat d0/d26/d29/d59/d7e/da7/d2b/fc2 x:0 0 0 2024-09-13T17:05:56.948 INFO:tasks.workunit.client.0.smithi115.stdout:5/538: rename d19/f1a to d19/d21/fb1 0 2024-09-13T17:05:56.949 INFO:tasks.workunit.client.0.smithi115.stdout:7/549: dread d0/d2/d4a/f81 [0,4194304] 0 2024-09-13T17:05:56.950 INFO:tasks.workunit.client.1.smithi195.stdout:1/823: truncate db/df/d51/f53 1075537 0 2024-09-13T17:05:56.950 INFO:tasks.workunit.client.1.smithi195.stdout:1/824: stat db/f33 0 2024-09-13T17:05:56.950 INFO:tasks.workunit.client.1.smithi195.stdout:1/825: fdatasync db/f38 0 2024-09-13T17:05:56.950 INFO:tasks.workunit.client.1.smithi195.stdout:1/826: write db/d19/d37/d3e/fc9 [103503,68548] 0 2024-09-13T17:05:56.951 INFO:tasks.workunit.client.0.smithi115.stdout:2/796: creat d3/d4d/d13/d62/d92/ffd x:0 0 0 2024-09-13T17:05:56.955 INFO:tasks.workunit.client.1.smithi195.stdout:9/927: rename d6/d12/d86/da7/dfb/f120 to d6/d12/d86/dd2/f129 0 2024-09-13T17:05:56.958 INFO:tasks.workunit.client.1.smithi195.stdout:6/781: sync 2024-09-13T17:05:56.958 INFO:tasks.workunit.client.1.smithi195.stdout:8/925: sync 2024-09-13T17:05:56.958 INFO:tasks.workunit.client.1.smithi195.stdout:0/828: write d7/d50/f1c [1530226,116941] 0 2024-09-13T17:05:56.959 INFO:tasks.workunit.client.0.smithi115.stdout:9/408: dwrite d0/f8 [0,4194304] 0 2024-09-13T17:05:56.962 INFO:tasks.workunit.client.0.smithi115.stdout:4/688: unlink d7/dd/f26 0 2024-09-13T17:05:56.962 INFO:tasks.workunit.client.0.smithi115.stdout:4/689: fsync d7/f19 0 2024-09-13T17:05:56.963 INFO:tasks.workunit.client.1.smithi195.stdout:3/856: unlink d7/d21/d2a/d35/d60/db0/lb6 0 2024-09-13T17:05:56.965 INFO:tasks.workunit.client.0.smithi115.stdout:8/589: getdents d0/d26/d29 0 2024-09-13T17:05:56.968 INFO:tasks.workunit.client.0.smithi115.stdout:0/399: rename d9/d1d/d24/d26/d2d/d30/f47 to d9/d1d/d24/d26/d2c/f74 0 2024-09-13T17:05:56.968 INFO:tasks.workunit.client.0.smithi115.stdout:0/400: chown d9/d1d/l22 58 1 2024-09-13T17:05:56.969 INFO:tasks.workunit.client.0.smithi115.stdout:5/539: creat d19/d2b/d32/d55/d5e/d87/db0/fb2 x:0 0 0 2024-09-13T17:05:56.971 INFO:tasks.workunit.client.0.smithi115.stdout:2/797: creat d3/d4d/de/d99/d9a/df1/dfa/d46/d70/ffe x:0 0 0 2024-09-13T17:05:56.971 INFO:tasks.workunit.client.0.smithi115.stdout:2/798: fsync d3/f4 0 2024-09-13T17:05:56.972 INFO:tasks.workunit.client.0.smithi115.stdout:9/409: mknod d0/de/d10/d15/d7f/c8c 0 2024-09-13T17:05:56.973 INFO:tasks.workunit.client.0.smithi115.stdout:4/690: mkdir d7/d86/dd5 0 2024-09-13T17:05:56.976 INFO:tasks.workunit.client.0.smithi115.stdout:8/590: dread d0/d26/d29/d59/d7e/da7/d2b/d37/f64 [0,4194304] 0 2024-09-13T17:05:56.976 INFO:tasks.workunit.client.0.smithi115.stdout:1/558: rename d5/d7/d5c/d73 to d5/d7/d33/d3a/dc3 0 2024-09-13T17:05:56.978 INFO:tasks.workunit.client.1.smithi195.stdout:7/889: dwrite d5/d35/f60 [0,4194304] 0 2024-09-13T17:05:56.978 INFO:tasks.workunit.client.0.smithi115.stdout:0/401: symlink d9/d27/l75 0 2024-09-13T17:05:56.978 INFO:tasks.workunit.client.1.smithi195.stdout:2/840: dwrite d0/d4a/d47/d73/d75/f77 [0,4194304] 0 2024-09-13T17:05:56.978 INFO:tasks.workunit.client.1.smithi195.stdout:1/827: dwrite db/d19/d5a/f83 [0,4194304] 0 2024-09-13T17:05:56.980 INFO:tasks.workunit.client.1.smithi195.stdout:5/878: rmdir d2 39 2024-09-13T17:05:56.982 INFO:tasks.workunit.client.0.smithi115.stdout:2/799: symlink d3/d4d/d13/d62/d66/lff 0 2024-09-13T17:05:56.982 INFO:tasks.workunit.client.0.smithi115.stdout:2/800: chown d3/d4d/d13/d1c/l80 13896803 1 2024-09-13T17:05:56.982 INFO:tasks.workunit.client.0.smithi115.stdout:2/801: dread - d3/d4d/d13/da2/fe3 zero size 2024-09-13T17:05:56.984 INFO:tasks.workunit.client.1.smithi195.stdout:8/926: getdents d0/d17/d2f/d31 0 2024-09-13T17:05:56.985 INFO:tasks.workunit.client.0.smithi115.stdout:2/802: dread d3/d4d/d13/d62/d92/dd7/d7d/fda [0,4194304] 0 2024-09-13T17:05:56.986 INFO:tasks.workunit.client.0.smithi115.stdout:2/803: chown d3/d4d/d13/d62/d92/dd7/d7d/ddd 9533 1 2024-09-13T17:05:56.986 INFO:tasks.workunit.client.0.smithi115.stdout:9/410: mkdir d0/de/d10/d15/d86/d8d 0 2024-09-13T17:05:56.989 INFO:tasks.workunit.client.1.smithi195.stdout:6/782: creat d1c/d24/d49/d5f/d85/da5/ffc x:0 0 0 2024-09-13T17:05:56.990 INFO:tasks.workunit.client.0.smithi115.stdout:4/691: mkdir d7/dd/de/d4e/d6c/d77/dca/dd6 0 2024-09-13T17:05:56.992 INFO:tasks.workunit.client.1.smithi195.stdout:0/829: unlink d7/d88/c47 0 2024-09-13T17:05:56.996 INFO:tasks.workunit.client.0.smithi115.stdout:8/591: mknod d0/d26/d29/d59/cc3 0 2024-09-13T17:05:56.997 INFO:tasks.workunit.client.1.smithi195.stdout:7/890: dwrite d5/db/d50/d7f/d82/dad/df0/f11a [0,4194304] 0 2024-09-13T17:05:56.997 INFO:tasks.workunit.client.1.smithi195.stdout:7/891: getdents d5/db/d19/d22/d90/d127/d131/d13a 0 2024-09-13T17:05:56.999 INFO:tasks.workunit.client.0.smithi115.stdout:7/550: rename d0/d2/d67/c8a to d0/d2/d1e/d3d/cc7 0 2024-09-13T17:05:57.002 INFO:tasks.workunit.client.0.smithi115.stdout:1/559: symlink d5/d26/d2c/d62/lc4 0 2024-09-13T17:05:57.005 INFO:tasks.workunit.client.0.smithi115.stdout:0/402: mknod d9/d1d/d24/d26/d5d/d67/c76 0 2024-09-13T17:05:57.005 INFO:tasks.workunit.client.0.smithi115.stdout:0/403: fdatasync d9/f41 0 2024-09-13T17:05:57.005 INFO:tasks.workunit.client.0.smithi115.stdout:5/540: rmdir d19/d2e/d6b 39 2024-09-13T17:05:57.006 INFO:tasks.workunit.client.1.smithi195.stdout:3/857: unlink d7/d21/d2a/f32 0 2024-09-13T17:05:57.006 INFO:tasks.workunit.client.1.smithi195.stdout:3/858: write d7/d5f/f82 [915351,69782] 0 2024-09-13T17:05:57.006 INFO:tasks.workunit.client.1.smithi195.stdout:3/859: dread - d7/fde zero size 2024-09-13T17:05:57.006 INFO:tasks.workunit.client.1.smithi195.stdout:3/860: write d7/d21/f73 [2229983,117563] 0 2024-09-13T17:05:57.006 INFO:tasks.workunit.client.1.smithi195.stdout:3/861: write d7/d21/d2a/d4a/d5a/fa5 [953108,129896] 0 2024-09-13T17:05:57.007 INFO:tasks.workunit.client.0.smithi115.stdout:2/804: mknod d3/d4d/de/d99/c100 0 2024-09-13T17:05:57.007 INFO:tasks.workunit.client.0.smithi115.stdout:2/805: chown d3/d4d/dd/df/ce7 10716895 1 2024-09-13T17:05:57.008 INFO:tasks.workunit.client.1.smithi195.stdout:3/862: read d7/d21/d2a/d35/d60/d64/f78 [170929,62992] 0 2024-09-13T17:05:57.008 INFO:tasks.workunit.client.1.smithi195.stdout:3/863: chown d7/d21/d2a 6005 1 2024-09-13T17:05:57.009 INFO:tasks.workunit.client.0.smithi115.stdout:9/411: symlink d0/de/d10/l8e 0 2024-09-13T17:05:57.011 INFO:tasks.workunit.client.0.smithi115.stdout:7/551: symlink d0/d2/d67/d86/d94/d9b/dbb/lc8 0 2024-09-13T17:05:57.011 INFO:tasks.workunit.client.0.smithi115.stdout:7/552: read - d0/d59/fb8 zero size 2024-09-13T17:05:57.011 INFO:tasks.workunit.client.0.smithi115.stdout:7/553: dread - d0/d3b/d50/d21/d2f/f89 zero size 2024-09-13T17:05:57.015 INFO:tasks.workunit.client.0.smithi115.stdout:1/560: creat d5/d7/d33/d3a/db2/fc5 x:0 0 0 2024-09-13T17:05:57.015 INFO:tasks.workunit.client.1.smithi195.stdout:6/783: dread d1c/d24/d49/d5f/d85/d8f/dc0/fc1 [0,4194304] 0 2024-09-13T17:05:57.015 INFO:tasks.workunit.client.0.smithi115.stdout:0/404: getdents d9/d1d/d24/d26/d2d 0 2024-09-13T17:05:57.015 INFO:tasks.workunit.client.0.smithi115.stdout:1/561: dread d5/d26/f63 [0,4194304] 0 2024-09-13T17:05:57.018 INFO:tasks.workunit.client.0.smithi115.stdout:5/541: symlink d19/d2b/d69/d8f/lb3 0 2024-09-13T17:05:57.019 INFO:tasks.workunit.client.1.smithi195.stdout:5/879: dwrite d2/df/d78/deb/d4e/d74/fc3 [0,4194304] 0 2024-09-13T17:05:57.019 INFO:tasks.workunit.client.1.smithi195.stdout:2/841: creat d0/d4a/d47/f104 x:0 0 0 2024-09-13T17:05:57.021 INFO:tasks.workunit.client.0.smithi115.stdout:9/412: getdents d0/d21/d42 0 2024-09-13T17:05:57.023 INFO:tasks.workunit.client.0.smithi115.stdout:8/592: dwrite d0/d26/d29/f2a [4194304,4194304] 0 2024-09-13T17:05:57.023 INFO:tasks.workunit.client.0.smithi115.stdout:1/562: mkdir d5/d7/d5c/dc6 0 2024-09-13T17:05:57.023 INFO:tasks.workunit.client.0.smithi115.stdout:1/563: write d5/d7/d5c/f8c [439437,81484] 0 2024-09-13T17:05:57.025 INFO:tasks.workunit.client.1.smithi195.stdout:8/927: dwrite d0/d17/d2f/d7c/f131 [0,4194304] 0 2024-09-13T17:05:57.025 INFO:tasks.workunit.client.1.smithi195.stdout:8/928: readlink d0/d13/led 0 2024-09-13T17:05:57.025 INFO:tasks.workunit.client.0.smithi115.stdout:5/542: mknod d19/d75/cb4 0 2024-09-13T17:05:57.026 INFO:tasks.workunit.client.0.smithi115.stdout:4/692: dwrite d7/dd/de/d4e/d6c/d77/fce [0,4194304] 0 2024-09-13T17:05:57.026 INFO:tasks.workunit.client.0.smithi115.stdout:4/693: truncate d7/dd/d3c/d74/fa6 518230 0 2024-09-13T17:05:57.033 INFO:tasks.workunit.client.0.smithi115.stdout:9/413: creat d0/de/d10/d15/f8f x:0 0 0 2024-09-13T17:05:57.033 INFO:tasks.workunit.client.0.smithi115.stdout:9/414: chown d0/de/d10/f44 113294 1 2024-09-13T17:05:57.034 INFO:tasks.workunit.client.1.smithi195.stdout:1/828: unlink db/d60/c75 0 2024-09-13T17:05:57.034 INFO:tasks.workunit.client.1.smithi195.stdout:1/829: chown db/df/d51/c9a 8155 1 2024-09-13T17:05:57.034 INFO:tasks.workunit.client.1.smithi195.stdout:1/830: chown db/df/d51/d8e 526679055 1 2024-09-13T17:05:57.034 INFO:tasks.workunit.client.1.smithi195.stdout:1/831: fdatasync db/d19/f64 0 2024-09-13T17:05:57.034 INFO:tasks.workunit.client.1.smithi195.stdout:1/832: creat db/d58/f117 x:0 0 0 2024-09-13T17:05:57.035 INFO:tasks.workunit.client.0.smithi115.stdout:0/405: dwrite d9/d1b/f3a [4194304,4194304] 0 2024-09-13T17:05:57.036 INFO:tasks.workunit.client.1.smithi195.stdout:0/830: creat d7/d87/d9b/d56/d4d/d5e/dbb/f102 x:0 0 0 2024-09-13T17:05:57.037 INFO:tasks.workunit.client.0.smithi115.stdout:2/806: dwrite d3/d4d/dd/df/d5c/f7c [0,4194304] 0 2024-09-13T17:05:57.037 INFO:tasks.workunit.client.0.smithi115.stdout:2/807: readlink d3/d4d/d13/d1c/l76 0 2024-09-13T17:05:57.038 INFO:tasks.workunit.client.0.smithi115.stdout:7/554: dwrite d0/d2/f1a [4194304,4194304] 0 2024-09-13T17:05:57.041 INFO:tasks.workunit.client.1.smithi195.stdout:7/892: chown d5/db/d19/d22/c5c 1599855 1 2024-09-13T17:05:57.041 INFO:tasks.workunit.client.1.smithi195.stdout:7/893: dread - d5/d13/da8/f12b zero size 2024-09-13T17:05:57.042 INFO:tasks.workunit.client.0.smithi115.stdout:8/593: creat d0/d26/d29/d59/d7e/da7/d28/fc4 x:0 0 0 2024-09-13T17:05:57.044 INFO:tasks.workunit.client.0.smithi115.stdout:1/564: creat d5/d60/d8e/fc7 x:0 0 0 2024-09-13T17:05:57.045 INFO:tasks.workunit.client.0.smithi115.stdout:4/694: dwrite d7/dd/de/f5c [0,4194304] 0 2024-09-13T17:05:57.045 INFO:tasks.workunit.client.0.smithi115.stdout:4/695: dread - d7/dd/de/d4e/d5a/d4f/d53/fcf zero size 2024-09-13T17:05:57.046 INFO:tasks.workunit.client.1.smithi195.stdout:6/784: mknod d1c/df0/db9/d8c/da7/dc6/cfd 0 2024-09-13T17:05:57.048 INFO:tasks.workunit.client.0.smithi115.stdout:5/543: link d19/f1e d19/d2b/d32/d55/d5e/d87/d86/fb5 0 2024-09-13T17:05:57.051 INFO:tasks.workunit.client.1.smithi195.stdout:5/880: truncate d2/df/d86/f5d 1996917 0 2024-09-13T17:05:57.051 INFO:tasks.workunit.client.1.smithi195.stdout:5/881: chown d2/f26 178132 1 2024-09-13T17:05:57.053 INFO:tasks.workunit.client.1.smithi195.stdout:2/842: read d0/d4a/d47/d73/d75/d88/d2c/f8d [836108,27126] 0 2024-09-13T17:05:57.056 INFO:tasks.workunit.client.0.smithi115.stdout:4/696: dread d7/dbe/f87 [0,4194304] 0 2024-09-13T17:05:57.066 INFO:tasks.workunit.client.0.smithi115.stdout:1/565: dwrite d5/d60/d7d/fb6 [0,4194304] 0 2024-09-13T17:05:57.066 INFO:tasks.workunit.client.0.smithi115.stdout:1/566: chown d5/d3e/c4e 3 1 2024-09-13T17:05:57.066 INFO:tasks.workunit.client.0.smithi115.stdout:1/567: dread - d5/d3e/d59/d96/fb8 zero size 2024-09-13T17:05:57.066 INFO:tasks.workunit.client.0.smithi115.stdout:1/568: chown d5/d7/d33/d3a/f43 1 1 2024-09-13T17:05:57.066 INFO:tasks.workunit.client.0.smithi115.stdout:1/569: chown d5/d3e/d59/d96/lc1 13 1 2024-09-13T17:05:57.067 INFO:tasks.workunit.client.1.smithi195.stdout:8/929: creat d0/d17/d2f/d31/d101/d63/d71/de8/df6/f138 x:0 0 0 2024-09-13T17:05:57.067 INFO:tasks.workunit.client.1.smithi195.stdout:8/930: creat d0/d13/db9/d113/f139 x:0 0 0 2024-09-13T17:05:57.070 INFO:tasks.workunit.client.1.smithi195.stdout:1/833: symlink db/df/d4d/d74/da8/l118 0 2024-09-13T17:05:57.074 INFO:tasks.workunit.client.1.smithi195.stdout:3/864: rename d7/d19/d1e/c5b to d7/d5f/c118 0 2024-09-13T17:05:57.075 INFO:tasks.workunit.client.1.smithi195.stdout:6/785: creat d1c/d7d/dc7/ffe x:0 0 0 2024-09-13T17:05:57.076 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:56 smithi195 ceph-mon[34981]: pgmap v17: 65 pgs: 65 active+clean; 2.6 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 283 MiB/s rd, 344 MiB/s wr, 515 op/s 2024-09-13T17:05:57.078 INFO:tasks.workunit.client.1.smithi195.stdout:1/834: dread db/df/f39 [0,4194304] 0 2024-09-13T17:05:57.079 INFO:tasks.workunit.client.0.smithi115.stdout:0/406: mknod d9/d27/c77 0 2024-09-13T17:05:57.081 INFO:tasks.workunit.client.1.smithi195.stdout:6/786: creat d1c/df0/db9/d8c/dd1/fff x:0 0 0 2024-09-13T17:05:57.082 INFO:tasks.workunit.client.1.smithi195.stdout:8/931: link d0/d13/db9/d113/f139 d0/d17/d2f/d7c/d4c/d9b/f13a 0 2024-09-13T17:05:57.083 INFO:tasks.workunit.client.1.smithi195.stdout:2/843: dwrite d0/d4a/d47/d73/fe3 [0,4194304] 0 2024-09-13T17:05:57.083 INFO:tasks.workunit.client.1.smithi195.stdout:5/882: dwrite d2/d3e/f3a [0,4194304] 0 2024-09-13T17:05:57.083 INFO:tasks.workunit.client.0.smithi115.stdout:2/808: mknod d3/d4d/d13/d1c/dc8/df6/c101 0 2024-09-13T17:05:57.084 INFO:tasks.workunit.client.1.smithi195.stdout:3/865: mknod d7/c119 0 2024-09-13T17:05:57.085 INFO:tasks.workunit.client.1.smithi195.stdout:3/866: readlink d7/d21/d2a/ld5 0 2024-09-13T17:05:57.087 INFO:tasks.workunit.client.1.smithi195.stdout:7/894: rename d5/d35/d37/fc0 to d5/db/d19/f13d 0 2024-09-13T17:05:57.089 INFO:tasks.workunit.client.0.smithi115.stdout:7/555: creat d0/d97/fc9 x:0 0 0 2024-09-13T17:05:57.090 INFO:tasks.workunit.client.0.smithi115.stdout:9/415: dread d0/d21/d42/f5f [0,4194304] 0 2024-09-13T17:05:57.092 INFO:tasks.workunit.client.1.smithi195.stdout:8/932: creat d0/d17/d2f/d31/f13b x:0 0 0 2024-09-13T17:05:57.093 INFO:tasks.workunit.client.1.smithi195.stdout:5/883: unlink d2/fc4 0 2024-09-13T17:05:57.095 INFO:tasks.workunit.client.1.smithi195.stdout:9/928: sync 2024-09-13T17:05:57.095 INFO:tasks.workunit.client.1.smithi195.stdout:3/867: getdents d7/d21/d2a/d35/d9c/df6 0 2024-09-13T17:05:57.095 INFO:tasks.workunit.client.1.smithi195.stdout:3/868: fsync d7/f15 0 2024-09-13T17:05:57.096 INFO:tasks.workunit.client.0.smithi115.stdout:7/556: read d0/d51/fa8 [959231,25259] 0 2024-09-13T17:05:57.096 INFO:tasks.workunit.client.0.smithi115.stdout:5/544: mkdir d19/d2b/d69/db6 0 2024-09-13T17:05:57.098 INFO:tasks.workunit.client.0.smithi115.stdout:4/697: creat d7/dd/de/d4e/d5a/fd7 x:0 0 0 2024-09-13T17:05:57.101 INFO:tasks.workunit.client.1.smithi195.stdout:3/869: read d7/d21/fe4 [15354,101176] 0 2024-09-13T17:05:57.101 INFO:tasks.workunit.client.1.smithi195.stdout:2/844: dwrite d0/d4a/d47/d73/d75/d88/d2c/dd7/ffa [0,4194304] 0 2024-09-13T17:05:57.101 INFO:tasks.workunit.client.1.smithi195.stdout:2/845: chown d0/f76 117 1 2024-09-13T17:05:57.101 INFO:tasks.workunit.client.0.smithi115.stdout:1/570: getdents d5/d26/d2c/d62 0 2024-09-13T17:05:57.103 INFO:tasks.workunit.client.1.smithi195.stdout:6/787: getdents d1c/d24 0 2024-09-13T17:05:57.104 INFO:tasks.workunit.client.0.smithi115.stdout:0/407: mkdir d9/d1d/d24/d26/d2d/d78 0 2024-09-13T17:05:57.104 INFO:tasks.workunit.client.0.smithi115.stdout:0/408: fsync d9/f1f 0 2024-09-13T17:05:57.104 INFO:tasks.workunit.client.0.smithi115.stdout:0/409: write d9/d1d/d24/d26/d2d/d30/f5a [984553,13844] 0 2024-09-13T17:05:57.104 INFO:tasks.workunit.client.0.smithi115.stdout:0/410: chown d9/d1d/d24/d26/f64 22 1 2024-09-13T17:05:57.107 INFO:tasks.workunit.client.1.smithi195.stdout:8/933: rename d0/d17/f56 to d0/d13/f13c 0 2024-09-13T17:05:57.107 INFO:tasks.workunit.client.0.smithi115.stdout:9/416: dread d0/f16 [0,4194304] 0 2024-09-13T17:05:57.107 INFO:tasks.workunit.client.0.smithi115.stdout:9/417: truncate d0/f73 996149 0 2024-09-13T17:05:57.109 INFO:tasks.workunit.client.0.smithi115.stdout:8/594: mknod d0/cc5 0 2024-09-13T17:05:57.110 INFO:tasks.workunit.client.1.smithi195.stdout:5/884: creat d2/df/d78/deb/d4e/d10/d46/df3/f129 x:0 0 0 2024-09-13T17:05:57.113 INFO:tasks.workunit.client.1.smithi195.stdout:1/835: dwrite db/d19/d5a/feb [0,4194304] 0 2024-09-13T17:05:57.113 INFO:tasks.workunit.client.1.smithi195.stdout:1/836: chown db/df/d51/d62/d70/ca4 15 1 2024-09-13T17:05:57.114 INFO:tasks.workunit.client.0.smithi115.stdout:0/411: creat d9/d1d/d24/d26/d2d/f79 x:0 0 0 2024-09-13T17:05:57.114 INFO:tasks.workunit.client.0.smithi115.stdout:0/412: write d9/d1d/d24/f25 [5238369,34342] 0 2024-09-13T17:05:57.114 INFO:tasks.workunit.client.0.smithi115.stdout:0/413: dread - d9/d1d/d24/d26/d2c/f59 zero size 2024-09-13T17:05:57.114 INFO:tasks.workunit.client.0.smithi115.stdout:0/414: fdatasync d9/fb 0 2024-09-13T17:05:57.118 INFO:tasks.workunit.client.0.smithi115.stdout:9/418: creat d0/de/d10/d15/d86/d8d/f90 x:0 0 0 2024-09-13T17:05:57.118 INFO:tasks.workunit.client.0.smithi115.stdout:9/419: chown d0/de/c4d 28846488 1 2024-09-13T17:05:57.118 INFO:tasks.workunit.client.1.smithi195.stdout:3/870: mknod d7/d21/c11a 0 2024-09-13T17:05:57.119 INFO:tasks.workunit.client.0.smithi115.stdout:7/557: getdents d0/d59 0 2024-09-13T17:05:57.122 INFO:tasks.workunit.client.0.smithi115.stdout:9/420: dread d0/de/d37/f6b [0,4194304] 0 2024-09-13T17:05:57.122 INFO:tasks.workunit.client.0.smithi115.stdout:9/421: getdents d0/de/d37/d83 0 2024-09-13T17:05:57.122 INFO:tasks.workunit.client.1.smithi195.stdout:6/788: creat d1c/d24/d49/f100 x:0 0 0 2024-09-13T17:05:57.125 INFO:tasks.workunit.client.0.smithi115.stdout:5/545: dwrite f8 [0,4194304] 0 2024-09-13T17:05:57.125 INFO:tasks.workunit.client.1.smithi195.stdout:9/929: rename d6/d12/d86/l105 to d6/d19/d21/d45/dad/d5e/da0/l12a 0 2024-09-13T17:05:57.125 INFO:tasks.workunit.client.1.smithi195.stdout:9/930: chown d6/df/c35 0 1 2024-09-13T17:05:57.126 INFO:tasks.workunit.client.0.smithi115.stdout:7/558: truncate d0/d2/f8 8340432 0 2024-09-13T17:05:57.127 INFO:tasks.workunit.client.0.smithi115.stdout:9/422: mkdir d0/de/d37/d83/d91 0 2024-09-13T17:05:57.127 INFO:tasks.workunit.client.0.smithi115.stdout:9/423: creat d0/d21/d65/f92 x:0 0 0 2024-09-13T17:05:57.127 INFO:tasks.workunit.client.0.smithi115.stdout:9/424: chown d0/d21/d65/d6f/f88 15277758 1 2024-09-13T17:05:57.132 INFO:tasks.workunit.client.0.smithi115.stdout:7/559: link d0/d2/l92 d0/d2/d1e/d3d/d7c/lca 0 2024-09-13T17:05:57.132 INFO:tasks.workunit.client.0.smithi115.stdout:7/560: creat d0/d2/d4a/fcb x:0 0 0 2024-09-13T17:05:57.133 INFO:tasks.workunit.client.1.smithi195.stdout:1/837: mknod db/d19/d5a/d66/d7a/d10c/c119 0 2024-09-13T17:05:57.134 INFO:tasks.workunit.client.1.smithi195.stdout:3/871: symlink d7/d21/d2a/d35/d8f/d9f/dfc/l11b 0 2024-09-13T17:05:57.136 INFO:tasks.workunit.client.1.smithi195.stdout:6/789: mkdir d1c/d24/d49/d5f/de1/d101 0 2024-09-13T17:05:57.137 INFO:tasks.workunit.client.0.smithi115.stdout:7/561: mkdir d0/d2/d1e/d3d/d82/dcc 0 2024-09-13T17:05:57.137 INFO:tasks.workunit.client.0.smithi115.stdout:7/562: write d0/f13 [1135501,69167] 0 2024-09-13T17:05:57.137 INFO:tasks.workunit.client.0.smithi115.stdout:7/563: readlink d0/d2/l3f 0 2024-09-13T17:05:57.139 INFO:tasks.workunit.client.1.smithi195.stdout:5/885: rename d2/df/d86/fff to d2/df/d78/deb/d4e/d10/d8f/dc9/f12a 0 2024-09-13T17:05:57.140 INFO:tasks.workunit.client.1.smithi195.stdout:9/931: mkdir d6/df/d13/d8e/d12b 0 2024-09-13T17:05:57.140 INFO:tasks.workunit.client.0.smithi115.stdout:7/564: symlink d0/d2/lcd 0 2024-09-13T17:05:57.141 INFO:tasks.workunit.client.1.smithi195.stdout:9/932: creat d6/d12/d86/da7/f12c x:0 0 0 2024-09-13T17:05:57.141 INFO:tasks.workunit.client.1.smithi195.stdout:9/933: fsync d6/d19/d21/d45/f99 0 2024-09-13T17:05:57.142 INFO:tasks.workunit.client.1.smithi195.stdout:1/838: mknod db/d19/d37/d3e/dea/c11a 0 2024-09-13T17:05:57.144 INFO:tasks.workunit.client.1.smithi195.stdout:3/872: link d7/d19/d1e/laf d7/d21/d2a/d35/d9c/dcf/ddb/l11c 0 2024-09-13T17:05:57.145 INFO:tasks.workunit.client.0.smithi115.stdout:7/565: rename d0/d3b/d50/d21/d2f/f79 to d0/d2/d1e/d3d/d82/fce 0 2024-09-13T17:05:57.145 INFO:tasks.workunit.client.0.smithi115.stdout:7/566: write d0/d59/fba [210172,10123] 0 2024-09-13T17:05:57.145 INFO:tasks.workunit.client.0.smithi115.stdout:7/567: fdatasync d0/d51/fa8 0 2024-09-13T17:05:57.146 INFO:tasks.workunit.client.1.smithi195.stdout:5/886: mknod d2/df/d78/deb/d4e/d74/d91/dc0/c12b 0 2024-09-13T17:05:57.146 INFO:tasks.workunit.client.1.smithi195.stdout:5/887: dread - d2/df/d78/deb/d4e/d10/d46/ff8 zero size 2024-09-13T17:05:57.146 INFO:tasks.workunit.client.1.smithi195.stdout:5/888: truncate d2/df/d78/d76/f117 145640 0 2024-09-13T17:05:57.147 INFO:tasks.workunit.client.1.smithi195.stdout:6/790: dread d1c/df0/db9/d30/f92 [0,4194304] 0 2024-09-13T17:05:57.147 INFO:tasks.workunit.client.0.smithi115.stdout:7/568: mknod d0/d2/d1e/d3d/d82/dcc/ccf 0 2024-09-13T17:05:57.147 INFO:tasks.workunit.client.0.smithi115.stdout:7/569: getdents d0/d2/d1e/d3d/d82/d44/dac/dbf 0 2024-09-13T17:05:57.147 INFO:tasks.workunit.client.0.smithi115.stdout:7/570: read - d0/d2/d4a/fcb zero size 2024-09-13T17:05:57.148 INFO:tasks.workunit.client.0.smithi115.stdout:7/571: creat d0/d3b/d50/d21/d2f/fd0 x:0 0 0 2024-09-13T17:05:57.148 INFO:tasks.workunit.client.0.smithi115.stdout:7/572: dread - d0/d3b/d50/d21/d2f/f89 zero size 2024-09-13T17:05:57.150 INFO:tasks.workunit.client.1.smithi195.stdout:6/791: link d1c/d24/d49/d5f/d35/d88/fb2 d1c/df0/db9/d5e/dd9/f102 0 2024-09-13T17:05:57.152 INFO:tasks.workunit.client.1.smithi195.stdout:1/839: dread db/df/d51/d62/d70/fa5 [0,4194304] 0 2024-09-13T17:05:57.152 INFO:tasks.workunit.client.1.smithi195.stdout:1/840: fdatasync db/df/d51/d8e/f111 0 2024-09-13T17:05:57.152 INFO:tasks.workunit.client.1.smithi195.stdout:1/841: write db/df/d51/d62/d70/fda [283777,80704] 0 2024-09-13T17:05:57.153 INFO:tasks.workunit.client.1.smithi195.stdout:6/792: rename d1c/d24/d49/d5f/de1/ff4 to d1c/df0/db9/d8c/de5/f103 0 2024-09-13T17:05:57.155 INFO:tasks.workunit.client.0.smithi115.stdout:2/809: dwrite d3/d4d/de/d99/d9a/df1/dfa/d46/da0/fbc [0,4194304] 0 2024-09-13T17:05:57.157 INFO:tasks.workunit.client.0.smithi115.stdout:2/810: write d3/d4d/de/d99/d9a/df1/dfa/d46/d70/fc7 [138317,88860] 0 2024-09-13T17:05:57.159 INFO:tasks.workunit.client.0.smithi115.stdout:2/811: write d3/f14 [4463759,71779] 0 2024-09-13T17:05:57.160 INFO:tasks.workunit.client.0.smithi115.stdout:8/595: dwrite d0/d18/f65 [0,4194304] 0 2024-09-13T17:05:57.160 INFO:tasks.workunit.client.1.smithi195.stdout:6/793: dread d1c/d24/d49/d5f/f58 [0,4194304] 0 2024-09-13T17:05:57.161 INFO:tasks.workunit.client.1.smithi195.stdout:6/794: fdatasync d1c/d24/d49/d5f/d35/d88/fb2 0 2024-09-13T17:05:57.162 INFO:tasks.workunit.client.0.smithi115.stdout:5/546: dwrite d19/d21/fb1 [0,4194304] 0 2024-09-13T17:05:57.162 INFO:tasks.workunit.client.0.smithi115.stdout:9/425: dwrite d0/d21/f67 [0,4194304] 0 2024-09-13T17:05:57.162 INFO:tasks.workunit.client.1.smithi195.stdout:9/934: write d6/fb3 [2606603,86874] 0 2024-09-13T17:05:57.162 INFO:tasks.workunit.client.1.smithi195.stdout:9/935: chown d6/df/d7b/df6/c11f 0 1 2024-09-13T17:05:57.163 INFO:tasks.workunit.client.0.smithi115.stdout:2/812: truncate d3/d4d/d13/d62/d92/dd7/d7d/fda 47901 0 2024-09-13T17:05:57.163 INFO:tasks.workunit.client.0.smithi115.stdout:2/813: chown d3/d4d/d13/d1c/l76 50880429 1 2024-09-13T17:05:57.164 INFO:tasks.workunit.client.1.smithi195.stdout:6/795: mknod d1c/d24/d49/d5f/db1/dcd/da9/c104 0 2024-09-13T17:05:57.164 INFO:tasks.workunit.client.0.smithi115.stdout:1/571: dwrite d5/d3e/d59/fad [0,4194304] 0 2024-09-13T17:05:57.164 INFO:tasks.workunit.client.0.smithi115.stdout:1/572: dread - d5/d7/d33/d3a/f9b zero size 2024-09-13T17:05:57.164 INFO:tasks.workunit.client.0.smithi115.stdout:1/573: write d5/d3e/f92 [3340,30537] 0 2024-09-13T17:05:57.165 INFO:tasks.workunit.client.0.smithi115.stdout:1/574: chown d5/d60/dbf 2156934 1 2024-09-13T17:05:57.165 INFO:tasks.workunit.client.0.smithi115.stdout:1/575: readlink d5/d7/d33/l3b 0 2024-09-13T17:05:57.165 INFO:tasks.workunit.client.0.smithi115.stdout:0/415: dwrite d9/d1b/f21 [0,4194304] 0 2024-09-13T17:05:57.165 INFO:tasks.workunit.client.0.smithi115.stdout:8/596: mkdir d0/d21/d3a/d60/dc6 0 2024-09-13T17:05:57.165 INFO:tasks.workunit.client.0.smithi115.stdout:8/597: creat d0/d42/fc7 x:0 0 0 2024-09-13T17:05:57.166 INFO:tasks.workunit.client.1.smithi195.stdout:9/936: rename d6/df/d7b/ffe to d6/d19/d21/dd9/f12d 0 2024-09-13T17:05:57.167 INFO:tasks.workunit.client.1.smithi195.stdout:2/846: dwrite d0/d3/f4e [0,4194304] 0 2024-09-13T17:05:57.168 INFO:tasks.workunit.client.1.smithi195.stdout:2/847: chown d0/d4a/d47/d73/d75/d88/d2c/d43/d63/c95 263221808 1 2024-09-13T17:05:57.168 INFO:tasks.workunit.client.1.smithi195.stdout:6/796: truncate fd 3087413 0 2024-09-13T17:05:57.170 INFO:tasks.workunit.client.0.smithi115.stdout:9/426: creat d0/de/d10/f93 x:0 0 0 2024-09-13T17:05:57.170 INFO:tasks.workunit.client.0.smithi115.stdout:9/427: write d0/de/d10/f74 [3321457,119161] 0 2024-09-13T17:05:57.171 INFO:tasks.workunit.client.1.smithi195.stdout:9/937: mkdir d6/d19/d21/dd9/d12e 0 2024-09-13T17:05:57.172 INFO:tasks.workunit.client.1.smithi195.stdout:3/873: dread d7/d21/f59 [0,4194304] 0 2024-09-13T17:05:57.172 INFO:tasks.workunit.client.1.smithi195.stdout:7/895: dwrite d5/db/d19/d22/f5b [0,4194304] 0 2024-09-13T17:05:57.173 INFO:tasks.workunit.client.1.smithi195.stdout:6/797: rmdir d1c/d24/d49/d5f/de1/d101 0 2024-09-13T17:05:57.175 INFO:tasks.workunit.client.1.smithi195.stdout:9/938: link d6/df/d13/fc3 d6/d12/d86/da7/f12f 0 2024-09-13T17:05:57.175 INFO:tasks.workunit.client.1.smithi195.stdout:9/939: write d6/d12/d86/dd2/f118 [1139016,40279] 0 2024-09-13T17:05:57.176 INFO:tasks.workunit.client.1.smithi195.stdout:2/848: dread d0/d3/f4 [0,4194304] 0 2024-09-13T17:05:57.176 INFO:tasks.workunit.client.1.smithi195.stdout:2/849: read - d0/d4a/d47/d73/d75/d88/d62/fd9 zero size 2024-09-13T17:05:57.178 INFO:tasks.workunit.client.0.smithi115.stdout:0/416: stat d9/d1d/d24/d26/d2d/d30/d5c/c65 0 2024-09-13T17:05:57.178 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:56 smithi115 ceph-mon[27708]: pgmap v17: 65 pgs: 65 active+clean; 2.6 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 283 MiB/s rd, 344 MiB/s wr, 515 op/s 2024-09-13T17:05:57.180 INFO:tasks.workunit.client.0.smithi115.stdout:1/576: read d5/d26/f4d [3883793,59088] 0 2024-09-13T17:05:57.182 INFO:tasks.workunit.client.0.smithi115.stdout:8/598: link d0/d26/d29/d59/d7e/da7/d28/d4f/l99 d0/d42/d80/d94/db2/lc8 0 2024-09-13T17:05:57.182 INFO:tasks.workunit.client.0.smithi115.stdout:9/428: mknod d0/de/d10/d15/d7f/c94 0 2024-09-13T17:05:57.183 INFO:tasks.workunit.client.1.smithi195.stdout:3/874: mkdir d7/d21/d2a/d35/d60/d64/d11d 0 2024-09-13T17:05:57.184 INFO:tasks.workunit.client.0.smithi115.stdout:2/814: read d3/d4d/d13/d62/d92/dd7/d56/f29 [3540091,37730] 0 2024-09-13T17:05:57.184 INFO:tasks.workunit.client.0.smithi115.stdout:2/815: fsync d3/d4d/de/d99/d9a/df1/dfa/d46/d70/fcf 0 2024-09-13T17:05:57.184 INFO:tasks.workunit.client.0.smithi115.stdout:2/816: chown d3/d4d/dd/df/d57/d8b/l90 1 1 2024-09-13T17:05:57.185 INFO:tasks.workunit.client.1.smithi195.stdout:7/896: mkdir d5/d13/d24/d70/d13e 0 2024-09-13T17:05:57.185 INFO:tasks.workunit.client.1.smithi195.stdout:7/897: chown d5/db/d19/d22/d90/d127 19689010 1 2024-09-13T17:05:57.187 INFO:tasks.workunit.client.0.smithi115.stdout:0/417: unlink d9/d1b/f21 0 2024-09-13T17:05:57.188 INFO:tasks.workunit.client.1.smithi195.stdout:6/798: mkdir d1c/d24/d49/d5f/d35/d88/df8/d105 0 2024-09-13T17:05:57.189 INFO:tasks.workunit.client.0.smithi115.stdout:1/577: mkdir d5/d3e/dc8 0 2024-09-13T17:05:57.190 INFO:tasks.workunit.client.1.smithi195.stdout:9/940: unlink d6/d19/d21/d45/dad/cee 0 2024-09-13T17:05:57.190 INFO:tasks.workunit.client.1.smithi195.stdout:9/941: chown d6/d19/d21/d45/f5a 3817 1 2024-09-13T17:05:57.190 INFO:tasks.workunit.client.1.smithi195.stdout:9/942: write d6/d19/d21/d45/dd1/f121 [758206,26172] 0 2024-09-13T17:05:57.190 INFO:tasks.workunit.client.1.smithi195.stdout:9/943: read - d6/df/d16/de3/d68/d6d/f11c zero size 2024-09-13T17:05:57.191 INFO:tasks.workunit.client.1.smithi195.stdout:3/875: creat d7/d21/d51/f11e x:0 0 0 2024-09-13T17:05:57.191 INFO:tasks.workunit.client.0.smithi115.stdout:8/599: rmdir d0/d26/d29/d59/d7e/da7/d2b/d37 39 2024-09-13T17:05:57.191 INFO:tasks.workunit.client.0.smithi115.stdout:8/600: write d0/d26/d29/d59/d7e/da7/d28/fc4 [371397,124192] 0 2024-09-13T17:05:57.193 INFO:tasks.workunit.client.1.smithi195.stdout:7/898: mkdir d5/d13/d24/d13f 0 2024-09-13T17:05:57.193 INFO:tasks.workunit.client.1.smithi195.stdout:7/899: dread - d5/db/d50/daa/f104 zero size 2024-09-13T17:05:57.194 INFO:tasks.workunit.client.0.smithi115.stdout:9/429: write d0/f31 [661370,41779] 0 2024-09-13T17:05:57.194 INFO:tasks.workunit.client.0.smithi115.stdout:9/430: stat d0/de/d10/d15/d7f/c8c 0 2024-09-13T17:05:57.194 INFO:tasks.workunit.client.1.smithi195.stdout:9/944: mknod d6/d19/c130 0 2024-09-13T17:05:57.194 INFO:tasks.workunit.client.0.smithi115.stdout:2/817: link d3/d4d/d13/d62/d92/dd7/c48 d3/d4d/d13/d62/d92/dd7/d56/d58/c102 0 2024-09-13T17:05:57.195 INFO:tasks.workunit.client.0.smithi115.stdout:1/578: dread d5/d7/d5c/fa7 [0,4194304] 0 2024-09-13T17:05:57.195 INFO:tasks.workunit.client.1.smithi195.stdout:7/900: link d5/db/d50/d11d/l12a d5/db/d50/d7f/l140 0 2024-09-13T17:05:57.197 INFO:tasks.workunit.client.0.smithi115.stdout:0/418: unlink d9/d1d/d24/d26/d2c/l6e 0 2024-09-13T17:05:57.198 INFO:tasks.workunit.client.1.smithi195.stdout:9/945: symlink d6/df/d7b/df6/l131 0 2024-09-13T17:05:57.199 INFO:tasks.workunit.client.1.smithi195.stdout:7/901: mkdir d5/db/d50/d11d/d12e/d141 0 2024-09-13T17:05:57.200 INFO:tasks.workunit.client.0.smithi115.stdout:5/547: dwrite d19/d21/d3a/d5d/f9e [0,4194304] 0 2024-09-13T17:05:57.200 INFO:tasks.workunit.client.0.smithi115.stdout:5/548: fsync d19/d2b/d32/f4e 0 2024-09-13T17:05:57.200 INFO:tasks.workunit.client.0.smithi115.stdout:5/549: write d19/d2e/d6b/f8a [1029454,29690] 0 2024-09-13T17:05:57.201 INFO:tasks.workunit.client.1.smithi195.stdout:1/842: dwrite db/df/d13/fc2 [0,4194304] 0 2024-09-13T17:05:57.201 INFO:tasks.workunit.client.1.smithi195.stdout:1/843: dread - db/df/d4d/d74/dee/ffe zero size 2024-09-13T17:05:57.201 INFO:tasks.workunit.client.1.smithi195.stdout:2/850: dwrite d0/d4a/d47/d73/d75/d88/d2c/d51/f42 [0,4194304] 0 2024-09-13T17:05:57.201 INFO:tasks.workunit.client.1.smithi195.stdout:2/851: stat d0/d3/fe 0 2024-09-13T17:05:57.202 INFO:tasks.workunit.client.0.smithi115.stdout:7/573: dwrite d0/d2/d1e/d3d/d7c/fb9 [4194304,4194304] 0 2024-09-13T17:05:57.202 INFO:tasks.workunit.client.1.smithi195.stdout:9/946: creat d6/d12/d86/d11e/d61/f132 x:0 0 0 2024-09-13T17:05:57.203 INFO:tasks.workunit.client.1.smithi195.stdout:5/889: dwrite d2/df/d90/dbb/dec/f118 [0,4194304] 0 2024-09-13T17:05:57.206 INFO:tasks.workunit.client.0.smithi115.stdout:2/818: symlink d3/d4d/d13/d62/d92/dd7/d7d/dc2/l103 0 2024-09-13T17:05:57.208 INFO:tasks.workunit.client.1.smithi195.stdout:7/902: creat d5/db/d19/dc4/f142 x:0 0 0 2024-09-13T17:05:57.208 INFO:tasks.workunit.client.0.smithi115.stdout:1/579: mkdir d5/d26/dc9 0 2024-09-13T17:05:57.210 INFO:tasks.workunit.client.1.smithi195.stdout:3/876: dread d7/f2d [4194304,4194304] 0 2024-09-13T17:05:57.210 INFO:tasks.workunit.client.1.smithi195.stdout:3/877: fdatasync d7/d21/d2a/d35/d60/d64/f78 0 2024-09-13T17:05:57.210 INFO:tasks.workunit.client.0.smithi115.stdout:8/601: symlink d0/lc9 0 2024-09-13T17:05:57.211 INFO:tasks.workunit.client.0.smithi115.stdout:8/602: chown d0/d26/d29/d59/d7e/da7/d2b/d37 62508 1 2024-09-13T17:05:57.211 INFO:tasks.workunit.client.0.smithi115.stdout:8/603: chown d0/d26/d29/d59/d7e/da1 0 1 2024-09-13T17:05:57.211 INFO:tasks.workunit.client.0.smithi115.stdout:8/604: truncate d0/d15/d3e/fb3 85693 0 2024-09-13T17:05:57.211 INFO:tasks.workunit.client.0.smithi115.stdout:8/605: write d0/d18/f9a [843623,102579] 0 2024-09-13T17:05:57.211 INFO:tasks.workunit.client.0.smithi115.stdout:8/606: chown d0/d26/d29/d59/d7e/da7/d2b/d37/f64 820705 1 2024-09-13T17:05:57.212 INFO:tasks.workunit.client.0.smithi115.stdout:9/431: dwrite d0/d21/d4f/f5e [0,4194304] 0 2024-09-13T17:05:57.216 INFO:tasks.workunit.client.0.smithi115.stdout:5/550: link l17 d19/d21/d62/lb7 0 2024-09-13T17:05:57.221 INFO:tasks.workunit.client.1.smithi195.stdout:9/947: rename d6/df/d16/de3/l10a to d6/d19/d21/l133 0 2024-09-13T17:05:57.221 INFO:tasks.workunit.client.1.smithi195.stdout:9/948: creat d6/d12/d86/da7/f134 x:0 0 0 2024-09-13T17:05:57.221 INFO:tasks.workunit.client.0.smithi115.stdout:7/574: dwrite d0/d59/fb8 [0,4194304] 0 2024-09-13T17:05:57.230 INFO:tasks.workunit.client.1.smithi195.stdout:5/890: truncate d2/df/d78/deb/d4e/d10/f4a 83568 0 2024-09-13T17:05:57.230 INFO:tasks.workunit.client.1.smithi195.stdout:5/891: fsync d2/df/d78/deb/d4e/f2b 0 2024-09-13T17:05:57.231 INFO:tasks.workunit.client.1.smithi195.stdout:7/903: symlink d5/l143 0 2024-09-13T17:05:57.233 INFO:tasks.workunit.client.1.smithi195.stdout:3/878: truncate d7/fd2 8138922 0 2024-09-13T17:05:57.235 INFO:tasks.workunit.client.1.smithi195.stdout:2/852: mknod d0/d4a/d47/d73/d75/d88/d2c/c105 0 2024-09-13T17:05:57.239 INFO:tasks.workunit.client.1.smithi195.stdout:9/949: rmdir d6/df/d16/de3/d68/de2 39 2024-09-13T17:05:57.239 INFO:tasks.workunit.client.1.smithi195.stdout:9/950: dread - d6/df/d7b/fe4 zero size 2024-09-13T17:05:57.240 INFO:tasks.workunit.client.1.smithi195.stdout:7/904: dread d5/d35/f75 [0,4194304] 0 2024-09-13T17:05:57.241 INFO:tasks.workunit.client.1.smithi195.stdout:7/905: stat d5/db/d50/daa/ffe 0 2024-09-13T17:05:57.241 INFO:tasks.workunit.client.1.smithi195.stdout:5/892: unlink d2/df/d90/fcb 0 2024-09-13T17:05:57.242 INFO:tasks.workunit.client.1.smithi195.stdout:3/879: rename d7/d21/d2a/d4a/d5a/l89 to d7/d19/l11f 0 2024-09-13T17:05:57.243 INFO:tasks.workunit.client.1.smithi195.stdout:3/880: dread - d7/d21/d2a/d35/d60/d64/db3/dc4/f10d zero size 2024-09-13T17:05:57.244 INFO:tasks.workunit.client.1.smithi195.stdout:2/853: write d0/d3/d3d/f8a [8564545,98168] 0 2024-09-13T17:05:57.244 INFO:tasks.workunit.client.1.smithi195.stdout:2/854: chown d0/de8 12547 1 2024-09-13T17:05:57.244 INFO:tasks.workunit.client.1.smithi195.stdout:2/855: stat d0 0 2024-09-13T17:05:57.245 INFO:tasks.workunit.client.0.smithi115.stdout:2/819: mkdir d3/d4d/de/d3a/d47/d104 0 2024-09-13T17:05:57.246 INFO:tasks.workunit.client.1.smithi195.stdout:0/831: sync 2024-09-13T17:05:57.246 INFO:tasks.workunit.client.1.smithi195.stdout:0/832: readlink d7/l1d 0 2024-09-13T17:05:57.247 INFO:tasks.workunit.client.0.smithi115.stdout:2/820: dread d3/d4d/dd/df/d57/fd1 [0,4194304] 0 2024-09-13T17:05:57.247 INFO:tasks.workunit.client.1.smithi195.stdout:9/951: unlink d6/d19/fa8 0 2024-09-13T17:05:57.249 INFO:tasks.workunit.client.0.smithi115.stdout:1/580: link d5/d3e/d59/fb7 d5/d60/d7d/d87/fca 0 2024-09-13T17:05:57.250 INFO:tasks.workunit.client.1.smithi195.stdout:5/893: rmdir d2/df/d78/d76 39 2024-09-13T17:05:57.252 INFO:tasks.workunit.client.0.smithi115.stdout:8/607: mkdir d0/d26/d29/d59/d7e/da7/dca 0 2024-09-13T17:05:57.252 INFO:tasks.workunit.client.0.smithi115.stdout:8/608: dread - d0/d42/d80/d94/fba zero size 2024-09-13T17:05:57.252 INFO:tasks.workunit.client.0.smithi115.stdout:8/609: creat d0/d26/d29/d59/d7e/da7/d2b/fcb x:0 0 0 2024-09-13T17:05:57.253 INFO:tasks.workunit.client.1.smithi195.stdout:3/881: symlink d7/d21/d2a/d35/d60/d6f/l120 0 2024-09-13T17:05:57.255 INFO:tasks.workunit.client.1.smithi195.stdout:3/882: write d7/d21/d2a/d35/d9c/fd8 [484953,60815] 0 2024-09-13T17:05:57.256 INFO:tasks.workunit.client.1.smithi195.stdout:7/906: dwrite d5/db/d19/d22/d90/fe1 [4194304,4194304] 0 2024-09-13T17:05:57.256 INFO:tasks.workunit.client.1.smithi195.stdout:3/883: dread d7/d19/fb2 [0,4194304] 0 2024-09-13T17:05:57.258 INFO:tasks.workunit.client.0.smithi115.stdout:9/432: mkdir d0/d21/d95 0 2024-09-13T17:05:57.258 INFO:tasks.workunit.client.0.smithi115.stdout:9/433: dread - d0/de/d10/f93 zero size 2024-09-13T17:05:57.260 INFO:tasks.workunit.client.1.smithi195.stdout:2/856: link d0/d3/c44 d0/d4a/d47/d73/c106 0 2024-09-13T17:05:57.260 INFO:tasks.workunit.client.1.smithi195.stdout:2/857: creat d0/d4a/d47/d73/d75/d88/d62/f107 x:0 0 0 2024-09-13T17:05:57.261 INFO:tasks.workunit.client.0.smithi115.stdout:5/551: mknod d19/d21/cb8 0 2024-09-13T17:05:57.261 INFO:tasks.workunit.client.0.smithi115.stdout:5/552: truncate d19/d2b/d32/d55/d5e/d87/da4/fa9 404605 0 2024-09-13T17:05:57.262 INFO:tasks.workunit.client.1.smithi195.stdout:9/952: creat d6/d19/d21/dd9/f135 x:0 0 0 2024-09-13T17:05:57.262 INFO:tasks.workunit.client.1.smithi195.stdout:9/953: truncate d6/d12/d86/da7/f12c 334390 0 2024-09-13T17:05:57.263 INFO:tasks.workunit.client.1.smithi195.stdout:7/907: dread d5/f6 [4194304,4194304] 0 2024-09-13T17:05:57.264 INFO:tasks.workunit.client.1.smithi195.stdout:5/894: creat d2/df/d78/d76/d114/f12c x:0 0 0 2024-09-13T17:05:57.265 INFO:tasks.workunit.client.1.smithi195.stdout:5/895: write d2/df/d90/db2/fe8 [1363469,72846] 0 2024-09-13T17:05:57.265 INFO:tasks.workunit.client.1.smithi195.stdout:5/896: chown d2/df/d86/d110 12604045 1 2024-09-13T17:05:57.268 INFO:tasks.workunit.client.1.smithi195.stdout:5/897: dread d2/df/d78/deb/d4e/d10/d8f/f122 [0,4194304] 0 2024-09-13T17:05:57.268 INFO:tasks.workunit.client.1.smithi195.stdout:5/898: creat d2/df/d78/d76/d114/f12d x:0 0 0 2024-09-13T17:05:57.268 INFO:tasks.workunit.client.1.smithi195.stdout:5/899: write d2/df/d78/d54/d58/f6b [4559657,72794] 0 2024-09-13T17:05:57.269 INFO:tasks.workunit.client.0.smithi115.stdout:7/575: creat d0/d59/fd1 x:0 0 0 2024-09-13T17:05:57.269 INFO:tasks.workunit.client.0.smithi115.stdout:7/576: truncate d0/d3b/d50/d21/d2f/d9e/fc6 518352 0 2024-09-13T17:05:57.269 INFO:tasks.workunit.client.0.smithi115.stdout:7/577: fdatasync d0/d2/d1e/d3d/d7c/fb9 0 2024-09-13T17:05:57.271 INFO:tasks.workunit.client.1.smithi195.stdout:0/833: dwrite d7/db/f81 [0,4194304] 0 2024-09-13T17:05:57.271 INFO:tasks.workunit.client.1.smithi195.stdout:3/884: rename d7/d67/f103 to d7/d21/d2a/d35/d9c/dcf/ddb/f121 0 2024-09-13T17:05:57.271 INFO:tasks.workunit.client.1.smithi195.stdout:3/885: chown d7/d21/d2a/d35/d60/d6f/d74/la1 427156 1 2024-09-13T17:05:57.271 INFO:tasks.workunit.client.1.smithi195.stdout:3/886: chown d7/d21/d2a/d35/d8f/fcd 433157 1 2024-09-13T17:05:57.275 INFO:tasks.workunit.client.1.smithi195.stdout:2/858: rmdir d0/d4a/d47/d73/d75/d88/d2c/d43/d63/db2/db3 39 2024-09-13T17:05:57.275 INFO:tasks.workunit.client.1.smithi195.stdout:2/859: creat d0/d4a/d47/d73/d75/d88/d2c/dd7/f108 x:0 0 0 2024-09-13T17:05:57.276 INFO:tasks.workunit.client.0.smithi115.stdout:9/434: dwrite d0/d21/d65/f84 [0,4194304] 0 2024-09-13T17:05:57.277 INFO:tasks.workunit.client.0.smithi115.stdout:1/581: symlink d5/lcb 0 2024-09-13T17:05:57.278 INFO:tasks.workunit.client.0.smithi115.stdout:1/582: stat d5/d7/l1a 0 2024-09-13T17:05:57.278 INFO:tasks.workunit.client.1.smithi195.stdout:7/908: read d5/fa [1120829,34480] 0 2024-09-13T17:05:57.281 INFO:tasks.workunit.client.0.smithi115.stdout:8/610: rename d0/d21/f32 to d0/d21/fcc 0 2024-09-13T17:05:57.282 INFO:tasks.workunit.client.0.smithi115.stdout:5/553: symlink d19/d2b/d69/db6/lb9 0 2024-09-13T17:05:57.283 INFO:tasks.workunit.client.0.smithi115.stdout:5/554: fsync d19/d2b/d32/f4e 0 2024-09-13T17:05:57.284 INFO:tasks.workunit.client.1.smithi195.stdout:5/900: creat d2/df/d90/dbb/dec/d10a/f12e x:0 0 0 2024-09-13T17:05:57.285 INFO:tasks.workunit.client.0.smithi115.stdout:7/578: symlink d0/d2/d1e/d3d/d82/ld2 0 2024-09-13T17:05:57.285 INFO:tasks.workunit.client.0.smithi115.stdout:8/611: dread d0/d21/fbe [0,4194304] 0 2024-09-13T17:05:57.286 INFO:tasks.workunit.client.0.smithi115.stdout:9/435: read d0/f3f [328085,86799] 0 2024-09-13T17:05:57.292 INFO:tasks.workunit.client.0.smithi115.stdout:1/583: rename d5/d7/d33/f54 to d5/d60/d7d/d87/fcc 0 2024-09-13T17:05:57.294 INFO:tasks.workunit.client.1.smithi195.stdout:8/934: sync 2024-09-13T17:05:57.295 INFO:tasks.workunit.client.0.smithi115.stdout:8/612: mkdir d0/d26/d29/d59/d7e/da7/d28/dcd 0 2024-09-13T17:05:57.297 INFO:tasks.workunit.client.0.smithi115.stdout:9/436: mknod d0/de/d37/d83/d91/c96 0 2024-09-13T17:05:57.297 INFO:tasks.workunit.client.0.smithi115.stdout:9/437: chown d0/lc 3753586 1 2024-09-13T17:05:57.301 INFO:tasks.workunit.client.0.smithi115.stdout:1/584: rename d5/d7/d33/d3a/dc3/l82 to d5/d7/d5c/dbc/lcd 0 2024-09-13T17:05:57.304 INFO:tasks.workunit.client.0.smithi115.stdout:7/579: dwrite d0/d97/f98 [0,4194304] 0 2024-09-13T17:05:57.305 INFO:tasks.workunit.client.1.smithi195.stdout:0/834: creat d7/f103 x:0 0 0 2024-09-13T17:05:57.307 INFO:tasks.workunit.client.0.smithi115.stdout:5/555: dwrite d19/d21/d3a/f82 [0,4194304] 0 2024-09-13T17:05:57.307 INFO:tasks.workunit.client.0.smithi115.stdout:5/556: chown f5 234138 1 2024-09-13T17:05:57.307 INFO:tasks.workunit.client.1.smithi195.stdout:8/935: write d0/d17/d2f/d31/d101/d63/d71/f9c [1101147,66118] 0 2024-09-13T17:05:57.308 INFO:tasks.workunit.client.0.smithi115.stdout:1/585: creat d5/d7/d33/fce x:0 0 0 2024-09-13T17:05:57.308 INFO:tasks.workunit.client.0.smithi115.stdout:1/586: write d5/d7/d5c/f5d [1005683,73750] 0 2024-09-13T17:05:57.310 INFO:tasks.workunit.client.1.smithi195.stdout:2/860: rename d0/d3/d3d/f8a to d0/d4a/d47/d73/d75/f109 0 2024-09-13T17:05:57.312 INFO:tasks.workunit.client.1.smithi195.stdout:2/861: dread d0/d4a/d47/d73/f7c [0,4194304] 0 2024-09-13T17:05:57.315 INFO:tasks.workunit.client.1.smithi195.stdout:7/909: creat d5/d13/d24/d70/f144 x:0 0 0 2024-09-13T17:05:57.317 INFO:tasks.workunit.client.1.smithi195.stdout:2/862: dread d0/d4a/f3a [0,4194304] 0 2024-09-13T17:05:57.318 INFO:tasks.workunit.client.1.smithi195.stdout:5/901: creat d2/df/d78/d54/f12f x:0 0 0 2024-09-13T17:05:57.322 INFO:tasks.workunit.client.1.smithi195.stdout:8/936: creat d0/d17/d2f/d7c/d4c/d119/f13d x:0 0 0 2024-09-13T17:05:57.324 INFO:tasks.workunit.client.1.smithi195.stdout:7/910: rmdir d5/db/d50/d11d 39 2024-09-13T17:05:57.324 INFO:tasks.workunit.client.1.smithi195.stdout:7/911: chown d5/d35/l11f 4696 1 2024-09-13T17:05:57.325 INFO:tasks.workunit.client.0.smithi115.stdout:9/438: dwrite d0/de/d10/f14 [4194304,4194304] 0 2024-09-13T17:05:57.326 INFO:tasks.workunit.client.0.smithi115.stdout:5/557: dwrite d19/d2b/d32/d55/d5e/f67 [0,4194304] 0 2024-09-13T17:05:57.327 INFO:tasks.workunit.client.1.smithi195.stdout:5/902: unlink d2/df/d78/l80 0 2024-09-13T17:05:57.330 INFO:tasks.workunit.client.1.smithi195.stdout:8/937: symlink d0/d13/db9/l13e 0 2024-09-13T17:05:57.330 INFO:tasks.workunit.client.1.smithi195.stdout:8/938: chown d0/d17/d2f/d7c/d4c/d9b/ldb 1767197 1 2024-09-13T17:05:57.330 INFO:tasks.workunit.client.1.smithi195.stdout:8/939: fsync d0/d17/d2f/d7c/d4c/fa0 0 2024-09-13T17:05:57.331 INFO:tasks.workunit.client.1.smithi195.stdout:5/903: write d2/df/d86/f5d [1810407,77120] 0 2024-09-13T17:05:57.331 INFO:tasks.workunit.client.1.smithi195.stdout:5/904: fsync d2/df/d78/deb/d4e/d10/d5c/fe1 0 2024-09-13T17:05:57.332 INFO:tasks.workunit.client.1.smithi195.stdout:5/905: write d2/f7c [1192045,88535] 0 2024-09-13T17:05:57.332 INFO:tasks.workunit.client.1.smithi195.stdout:5/906: fdatasync d2/df/f81 0 2024-09-13T17:05:57.332 INFO:tasks.workunit.client.1.smithi195.stdout:0/835: write d7/d87/d9b/d56/d46/f49 [11050898,60885] 0 2024-09-13T17:05:57.332 INFO:tasks.workunit.client.1.smithi195.stdout:7/912: symlink d5/db/d50/d7f/d82/dad/l145 0 2024-09-13T17:05:57.332 INFO:tasks.workunit.client.1.smithi195.stdout:7/913: fdatasync d5/db/d19/d22/fe3 0 2024-09-13T17:05:57.333 INFO:tasks.workunit.client.1.smithi195.stdout:7/914: readlink d5/db/d19/d22/d3c/l118 0 2024-09-13T17:05:57.336 INFO:tasks.workunit.client.0.smithi115.stdout:7/580: creat d0/d3b/d50/d21/d2f/d9e/dbd/fd3 x:0 0 0 2024-09-13T17:05:57.337 INFO:tasks.workunit.client.1.smithi195.stdout:8/940: getdents d0/d17/d2f/d7c/d4c 0 2024-09-13T17:05:57.337 INFO:tasks.workunit.client.1.smithi195.stdout:8/941: write d0/d4/f11f [32295,87691] 0 2024-09-13T17:05:57.337 INFO:tasks.workunit.client.1.smithi195.stdout:2/863: dwrite d0/d4a/d47/d73/d75/d88/d2c/d43/fcd [0,4194304] 0 2024-09-13T17:05:57.338 INFO:tasks.workunit.client.1.smithi195.stdout:5/907: write d2/df/d78/d54/de5/f101 [1621414,75893] 0 2024-09-13T17:05:57.341 INFO:tasks.workunit.client.1.smithi195.stdout:8/942: mkdir d0/d17/d2f/d31/d101/d63/d71/d13f 0 2024-09-13T17:05:57.341 INFO:tasks.workunit.client.1.smithi195.stdout:8/943: creat d0/d17/d2f/d31/db4/dfc/f140 x:0 0 0 2024-09-13T17:05:57.342 INFO:tasks.workunit.client.1.smithi195.stdout:0/836: dread d7/db/f7a [4194304,4194304] 0 2024-09-13T17:05:57.342 INFO:tasks.workunit.client.0.smithi115.stdout:9/439: creat d0/de/d37/d83/d91/f97 x:0 0 0 2024-09-13T17:05:57.342 INFO:tasks.workunit.client.0.smithi115.stdout:9/440: chown d0/de/d37/f6b 613 1 2024-09-13T17:05:57.343 INFO:tasks.workunit.client.1.smithi195.stdout:7/915: write d5/db/d50/d7f/d82/f8b [2076111,124027] 0 2024-09-13T17:05:57.345 INFO:tasks.workunit.client.0.smithi115.stdout:3/790: sync 2024-09-13T17:05:57.345 INFO:tasks.workunit.client.0.smithi115.stdout:3/791: chown d1/d4b/d1a/d30/c7e 221 1 2024-09-13T17:05:57.347 INFO:tasks.workunit.client.1.smithi195.stdout:9/954: write d6/d12/d39/fc5 [1421873,40686] 0 2024-09-13T17:05:57.348 INFO:tasks.workunit.client.1.smithi195.stdout:9/955: write d6/df/d16/de3/d68/d109/f122 [52190,58483] 0 2024-09-13T17:05:57.349 INFO:tasks.workunit.client.0.smithi115.stdout:5/558: creat d19/d2c/fba x:0 0 0 2024-09-13T17:05:57.351 INFO:tasks.workunit.client.1.smithi195.stdout:5/908: write d2/df/d78/deb/d3f/dfa/f124 [1048907,88334] 0 2024-09-13T17:05:57.352 INFO:tasks.workunit.client.0.smithi115.stdout:7/581: rename d0/l3 to d0/d2/d1e/d73/ld4 0 2024-09-13T17:05:57.352 INFO:tasks.workunit.client.0.smithi115.stdout:7/582: stat d0/d59/l91 0 2024-09-13T17:05:57.354 INFO:tasks.workunit.client.1.smithi195.stdout:8/944: creat d0/d13/d69/f141 x:0 0 0 2024-09-13T17:05:57.354 INFO:tasks.workunit.client.1.smithi195.stdout:8/945: stat d0/d13/f16 0 2024-09-13T17:05:57.356 INFO:tasks.workunit.client.0.smithi115.stdout:3/792: symlink d1/da6/dd1/l106 0 2024-09-13T17:05:57.360 INFO:tasks.workunit.client.1.smithi195.stdout:0/837: link d7/d88/d23/d96/dd8/f100 d7/d87/d9b/d4e/d86/f104 0 2024-09-13T17:05:57.360 INFO:tasks.workunit.client.1.smithi195.stdout:0/838: chown d7/db/f7b 98957 1 2024-09-13T17:05:57.360 INFO:tasks.workunit.client.1.smithi195.stdout:0/839: truncate d7/db/d38/d4f/ffb 552367 0 2024-09-13T17:05:57.360 INFO:tasks.workunit.client.1.smithi195.stdout:0/840: write d7/db/d38/d5d/f72 [1960825,128578] 0 2024-09-13T17:05:57.362 INFO:tasks.workunit.client.1.smithi195.stdout:2/864: dwrite d0/d4a/d47/d73/d75/d88/d2c/d43/d84/f97 [0,4194304] 0 2024-09-13T17:05:57.362 INFO:tasks.workunit.client.0.smithi115.stdout:5/559: creat d19/d21/d3a/fbb x:0 0 0 2024-09-13T17:05:57.364 INFO:tasks.workunit.client.1.smithi195.stdout:7/916: write d5/db/d19/fed [287265,39368] 0 2024-09-13T17:05:57.365 INFO:tasks.workunit.client.0.smithi115.stdout:9/441: dwrite d0/de/d10/d15/f3b [0,4194304] 0 2024-09-13T17:05:57.365 INFO:tasks.workunit.client.0.smithi115.stdout:9/442: fsync d0/d21/d42/f81 0 2024-09-13T17:05:57.365 INFO:tasks.workunit.client.0.smithi115.stdout:9/443: readlink d0/de/d10/l8e 0 2024-09-13T17:05:57.365 INFO:tasks.workunit.client.0.smithi115.stdout:9/444: chown d0/d21/l26 10262282 1 2024-09-13T17:05:57.366 INFO:tasks.workunit.client.1.smithi195.stdout:9/956: symlink d6/df/d13/d8e/d12b/l136 0 2024-09-13T17:05:57.367 INFO:tasks.workunit.client.1.smithi195.stdout:5/909: mknod d2/df/d86/c130 0 2024-09-13T17:05:57.369 INFO:tasks.workunit.client.1.smithi195.stdout:0/841: write d7/d50/f30 [1457652,17015] 0 2024-09-13T17:05:57.369 INFO:tasks.workunit.client.1.smithi195.stdout:0/842: creat d7/d87/d9b/d4e/d68/f105 x:0 0 0 2024-09-13T17:05:57.373 INFO:tasks.workunit.client.0.smithi115.stdout:8/613: rmdir d0/d26 39 2024-09-13T17:05:57.375 INFO:tasks.workunit.client.1.smithi195.stdout:6/799: sync 2024-09-13T17:05:57.375 INFO:tasks.workunit.client.1.smithi195.stdout:1/844: sync 2024-09-13T17:05:57.376 INFO:tasks.workunit.client.0.smithi115.stdout:8/614: mkdir d0/d95/dce 0 2024-09-13T17:05:57.378 INFO:tasks.workunit.client.0.smithi115.stdout:8/615: rename d0/d26/d29/d59/d7e/da7/d2b/fcb to d0/d21/fcf 0 2024-09-13T17:05:57.379 INFO:tasks.workunit.client.0.smithi115.stdout:5/560: dread f5 [0,4194304] 0 2024-09-13T17:05:57.380 INFO:tasks.workunit.client.1.smithi195.stdout:2/865: rmdir d0/d4a/d47/d73/d75/d88/d2c/d43/d63/db2 39 2024-09-13T17:05:57.381 INFO:tasks.workunit.client.0.smithi115.stdout:8/616: mknod d0/d26/d29/d59/d7e/da7/d28/d4f/cd0 0 2024-09-13T17:05:57.381 INFO:tasks.workunit.client.0.smithi115.stdout:8/617: write d0/d26/d29/f38 [1077828,130971] 0 2024-09-13T17:05:57.381 INFO:tasks.workunit.client.0.smithi115.stdout:8/618: chown d0/l9 15064 1 2024-09-13T17:05:57.383 INFO:tasks.workunit.client.1.smithi195.stdout:7/917: symlink d5/d13/da8/df9/l146 0 2024-09-13T17:05:57.383 INFO:tasks.workunit.client.1.smithi195.stdout:7/918: write d5/db/d19/dc4/f142 [365145,130729] 0 2024-09-13T17:05:57.383 INFO:tasks.workunit.client.1.smithi195.stdout:7/919: chown d5/db/d19/d22/d90/dd4/le4 133128402 1 2024-09-13T17:05:57.383 INFO:tasks.workunit.client.1.smithi195.stdout:7/920: write d5/db/d50/daa/fd9 [93323,122510] 0 2024-09-13T17:05:57.384 INFO:tasks.workunit.client.0.smithi115.stdout:5/561: mknod d19/d2b/d32/d55/d5e/cbc 0 2024-09-13T17:05:57.384 INFO:tasks.workunit.client.0.smithi115.stdout:5/562: chown d19/d2b/l9b 3 1 2024-09-13T17:05:57.386 INFO:tasks.workunit.client.1.smithi195.stdout:9/957: rename d6/df/d16/d58/cc0 to d6/df/d7b/c137 0 2024-09-13T17:05:57.387 INFO:tasks.workunit.client.0.smithi115.stdout:5/563: dread d19/d2c/f76 [0,4194304] 0 2024-09-13T17:05:57.387 INFO:tasks.workunit.client.0.smithi115.stdout:7/583: dwrite d0/d2/d4a/f5f [0,4194304] 0 2024-09-13T17:05:57.388 INFO:tasks.workunit.client.0.smithi115.stdout:8/619: creat d0/d21/d76/d83/fd1 x:0 0 0 2024-09-13T17:05:57.388 INFO:tasks.workunit.client.0.smithi115.stdout:8/620: chown d0/d18/d51/l73 14 1 2024-09-13T17:05:57.388 INFO:tasks.workunit.client.0.smithi115.stdout:7/584: dread d0/d3b/d50/d21/d2f/d9e/fc6 [0,4194304] 0 2024-09-13T17:05:57.390 INFO:tasks.workunit.client.0.smithi115.stdout:5/564: unlink d19/d2b/d32/f45 0 2024-09-13T17:05:57.391 INFO:tasks.workunit.client.0.smithi115.stdout:8/621: symlink d0/d21/d76/d83/d5a/ld2 0 2024-09-13T17:05:57.395 INFO:tasks.workunit.client.1.smithi195.stdout:0/843: symlink d7/db/d9a/dde/l106 0 2024-09-13T17:05:57.396 INFO:tasks.workunit.client.0.smithi115.stdout:7/585: getdents d0/d2 0 2024-09-13T17:05:57.397 INFO:tasks.workunit.client.0.smithi115.stdout:7/586: read d0/d3b/f6a [654969,84698] 0 2024-09-13T17:05:57.399 INFO:tasks.workunit.client.0.smithi115.stdout:9/445: dwrite d0/f73 [0,4194304] 0 2024-09-13T17:05:57.399 INFO:tasks.workunit.client.0.smithi115.stdout:9/446: chown d0/de/d10/d15/d7f/c94 14914895 1 2024-09-13T17:05:57.399 INFO:tasks.workunit.client.0.smithi115.stdout:9/447: chown d0/d21/d65/d79 28210 1 2024-09-13T17:05:57.399 INFO:tasks.workunit.client.1.smithi195.stdout:8/946: dwrite d0/d17/d2f/d31/f37 [0,4194304] 0 2024-09-13T17:05:57.399 INFO:tasks.workunit.client.1.smithi195.stdout:8/947: fsync d0/d4/fb 0 2024-09-13T17:05:57.400 INFO:tasks.workunit.client.1.smithi195.stdout:5/910: dwrite d2/df/d78/deb/d4e/d10/f4a [0,4194304] 0 2024-09-13T17:05:57.400 INFO:tasks.workunit.client.1.smithi195.stdout:9/958: dread d6/d19/d21/d45/fb6 [0,4194304] 0 2024-09-13T17:05:57.400 INFO:tasks.workunit.client.1.smithi195.stdout:6/800: mkdir d1c/df0/db9/d8c/dd1/d106 0 2024-09-13T17:05:57.402 INFO:tasks.workunit.client.1.smithi195.stdout:1/845: creat db/df/d13/da7/f11b x:0 0 0 2024-09-13T17:05:57.403 INFO:tasks.workunit.client.0.smithi115.stdout:8/622: rename d0/d15/d3e/fad to d0/d26/d29/d59/d7e/da7/d2b/d37/fd3 0 2024-09-13T17:05:57.406 INFO:tasks.workunit.client.1.smithi195.stdout:2/866: unlink d0/d3/f4e 0 2024-09-13T17:05:57.406 INFO:tasks.workunit.client.1.smithi195.stdout:2/867: creat d0/d4a/d47/d73/d75/d88/d2c/dd7/f10a x:0 0 0 2024-09-13T17:05:57.406 INFO:tasks.workunit.client.1.smithi195.stdout:2/868: chown d0/d4a/d47/d73/d75/d88/d2c/d43/d84/cea 23219659 1 2024-09-13T17:05:57.406 INFO:tasks.workunit.client.1.smithi195.stdout:2/869: readlink d0/d4a/d47/lc2 0 2024-09-13T17:05:57.407 INFO:tasks.workunit.client.0.smithi115.stdout:7/587: creat d0/d2/d1e/d3d/d82/d44/dac/dbf/fd5 x:0 0 0 2024-09-13T17:05:57.407 INFO:tasks.workunit.client.0.smithi115.stdout:7/588: chown d0/d2/d1e/d3d/d6c/d71/f46 38 1 2024-09-13T17:05:57.407 INFO:tasks.workunit.client.0.smithi115.stdout:3/793: dwrite d1/d12/d14/d61/fc3 [0,4194304] 0 2024-09-13T17:05:57.408 INFO:tasks.workunit.client.0.smithi115.stdout:3/794: read d1/d4b/d1a/d6e/fc4 [1494922,7000] 0 2024-09-13T17:05:57.408 INFO:tasks.workunit.client.1.smithi195.stdout:7/921: mknod d5/db/d50/d7f/d10a/d11c/c147 0 2024-09-13T17:05:57.408 INFO:tasks.workunit.client.1.smithi195.stdout:7/922: fdatasync d5/d35/f122 0 2024-09-13T17:05:57.410 INFO:tasks.workunit.client.1.smithi195.stdout:0/844: stat d7/d50/da2/dbd 0 2024-09-13T17:05:57.410 INFO:tasks.workunit.client.1.smithi195.stdout:6/801: dread d1c/d24/d49/d5f/f41 [0,4194304] 0 2024-09-13T17:05:57.410 INFO:tasks.workunit.client.1.smithi195.stdout:6/802: creat d1c/d24/d49/d5f/db1/d95/f107 x:0 0 0 2024-09-13T17:05:57.410 INFO:tasks.workunit.client.1.smithi195.stdout:6/803: fdatasync d1c/df0/db9/f55 0 2024-09-13T17:05:57.412 INFO:tasks.workunit.client.0.smithi115.stdout:7/589: rmdir d0/d2/d67/d86/d94/d9b/dbb 39 2024-09-13T17:05:57.412 INFO:tasks.workunit.client.0.smithi115.stdout:7/590: chown d0/d2/d1e/d3d/d6c/d71/f61 36879180 1 2024-09-13T17:05:57.417 INFO:tasks.workunit.client.0.smithi115.stdout:7/591: mknod d0/d3b/cd6 0 2024-09-13T17:05:57.417 INFO:tasks.workunit.client.0.smithi115.stdout:7/592: chown d0/d3b/d50/d21/d99/lbe 0 1 2024-09-13T17:05:57.420 INFO:tasks.workunit.client.1.smithi195.stdout:5/911: getdents d2/df/d48/d5a 0 2024-09-13T17:05:57.421 INFO:tasks.workunit.client.1.smithi195.stdout:9/959: unlink d6/df/d16/d5c/dcf/cef 0 2024-09-13T17:05:57.422 INFO:tasks.workunit.client.0.smithi115.stdout:7/593: mknod d0/d2/d1e/d3d/d82/d44/dac/cd7 0 2024-09-13T17:05:57.422 INFO:tasks.workunit.client.0.smithi115.stdout:7/594: fsync d0/d3b/d50/d21/f33 0 2024-09-13T17:05:57.423 INFO:tasks.workunit.client.1.smithi195.stdout:2/870: dread d0/d4a/d47/d73/d94/fb0 [0,4194304] 0 2024-09-13T17:05:57.425 INFO:tasks.workunit.client.1.smithi195.stdout:1/846: rename db/d19/d37/d3e/dea/fef to db/df/d51/d62/f11c 0 2024-09-13T17:05:57.429 INFO:tasks.workunit.client.1.smithi195.stdout:7/923: unlink d5/d35/f75 0 2024-09-13T17:05:57.431 INFO:tasks.workunit.client.1.smithi195.stdout:5/912: getdents d2/df/d78/deb/d4e/d10/d5c 0 2024-09-13T17:05:57.433 INFO:tasks.workunit.client.1.smithi195.stdout:8/948: dwrite d0/d17/d2f/d31/f53 [0,4194304] 0 2024-09-13T17:05:57.434 INFO:tasks.workunit.client.1.smithi195.stdout:9/960: creat d6/d19/d21/d45/dad/dca/f138 x:0 0 0 2024-09-13T17:05:57.434 INFO:tasks.workunit.client.1.smithi195.stdout:9/961: stat d6/d19/d21/d45/dad/d5e/de7 0 2024-09-13T17:05:57.438 INFO:tasks.workunit.client.0.smithi115.stdout:3/795: dread d1/d4b/d1a/d30/f37 [0,4194304] 0 2024-09-13T17:05:57.438 INFO:tasks.workunit.client.0.smithi115.stdout:5/565: dwrite d19/d21/f2a [0,4194304] 0 2024-09-13T17:05:57.438 INFO:tasks.workunit.client.0.smithi115.stdout:3/796: chown d1/d12/d14/c60 2550081 1 2024-09-13T17:05:57.439 INFO:tasks.workunit.client.0.smithi115.stdout:3/797: chown d1/d12/d14/fcd 122822 1 2024-09-13T17:05:57.439 INFO:tasks.workunit.client.0.smithi115.stdout:3/798: write d1/d4b/d1a/d30/f99 [644206,43184] 0 2024-09-13T17:05:57.439 INFO:tasks.workunit.client.0.smithi115.stdout:5/566: mknod d19/d2b/d77/cbd 0 2024-09-13T17:05:57.441 INFO:tasks.workunit.client.1.smithi195.stdout:3/887: sync 2024-09-13T17:05:57.441 INFO:tasks.workunit.client.1.smithi195.stdout:1/847: write db/d19/d5a/fd3 [747429,118038] 0 2024-09-13T17:05:57.441 INFO:tasks.workunit.client.1.smithi195.stdout:1/848: write db/d19/d5a/d66/d7a/ff7 [56443,48750] 0 2024-09-13T17:05:57.441 INFO:tasks.workunit.client.1.smithi195.stdout:8/949: truncate d0/d17/d2f/d7c/d4c/d9b/fec 272118 0 2024-09-13T17:05:57.441 INFO:tasks.workunit.client.1.smithi195.stdout:9/962: mkdir d6/df/d16/d103/d139 0 2024-09-13T17:05:57.442 INFO:tasks.workunit.client.1.smithi195.stdout:3/888: unlink d7/d21/d2a/d4a/d71/cf9 0 2024-09-13T17:05:57.445 INFO:tasks.workunit.client.0.smithi115.stdout:7/595: write d0/f2e [2396120,120041] 0 2024-09-13T17:05:57.446 INFO:tasks.workunit.client.1.smithi195.stdout:1/849: mkdir db/df/d4d/d67/d11d 0 2024-09-13T17:05:57.446 INFO:tasks.workunit.client.1.smithi195.stdout:1/850: stat db/d58/f117 0 2024-09-13T17:05:57.449 INFO:tasks.workunit.client.1.smithi195.stdout:9/963: symlink d6/df/d13/l13a 0 2024-09-13T17:05:57.451 INFO:tasks.workunit.client.1.smithi195.stdout:7/924: dread d5/d35/d37/f46 [0,4194304] 0 2024-09-13T17:05:57.451 INFO:tasks.workunit.client.1.smithi195.stdout:3/889: creat d7/d21/d2a/de9/f122 x:0 0 0 2024-09-13T17:05:57.453 INFO:tasks.workunit.client.1.smithi195.stdout:1/851: unlink db/df/l42 0 2024-09-13T17:05:57.453 INFO:tasks.workunit.client.1.smithi195.stdout:1/852: read db/df/d51/f72 [2581538,75839] 0 2024-09-13T17:05:57.453 INFO:tasks.workunit.client.0.smithi115.stdout:7/596: mkdir d0/d2/d1e/dd8 0 2024-09-13T17:05:57.456 INFO:tasks.workunit.client.1.smithi195.stdout:3/890: truncate d7/f15 7062009 0 2024-09-13T17:05:57.456 INFO:tasks.workunit.client.1.smithi195.stdout:3/891: readlink d7/lae 0 2024-09-13T17:05:57.456 INFO:tasks.workunit.client.1.smithi195.stdout:3/892: dread - d7/d21/d2a/d35/d60/d6f/dbf/f115 zero size 2024-09-13T17:05:57.456 INFO:tasks.workunit.client.1.smithi195.stdout:3/893: stat d7/d21/d2a/d35/d60/db0/lf2 0 2024-09-13T17:05:57.456 INFO:tasks.workunit.client.1.smithi195.stdout:3/894: chown d7/d21/d2a/d35/d60/d6f/d74/ffa 5120776 1 2024-09-13T17:05:57.457 INFO:tasks.workunit.client.1.smithi195.stdout:3/895: readlink d7/d21/d2a/d35/d60/d6f/l80 0 2024-09-13T17:05:57.457 INFO:tasks.workunit.client.1.smithi195.stdout:3/896: chown d7/d21/d66/d7e/cef 26717 1 2024-09-13T17:05:57.458 INFO:tasks.workunit.client.0.smithi115.stdout:3/799: write d1/d83/f91 [1295702,28424] 0 2024-09-13T17:05:57.458 INFO:tasks.workunit.client.0.smithi115.stdout:3/800: chown d1/d83/lee 88 1 2024-09-13T17:05:57.458 INFO:tasks.workunit.client.0.smithi115.stdout:5/567: dread d19/d21/f80 [0,4194304] 0 2024-09-13T17:05:57.459 INFO:tasks.workunit.client.1.smithi195.stdout:3/897: truncate d7/d62/d70/fe5 6465039 0 2024-09-13T17:05:57.459 INFO:tasks.workunit.client.1.smithi195.stdout:7/925: dread d5/db/d19/d22/fe3 [0,4194304] 0 2024-09-13T17:05:57.460 INFO:tasks.workunit.client.1.smithi195.stdout:9/964: dread d6/d12/f4d [0,4194304] 0 2024-09-13T17:05:57.461 INFO:tasks.workunit.client.1.smithi195.stdout:9/965: fsync d6/df/d16/d5c/fdf 0 2024-09-13T17:05:57.461 INFO:tasks.workunit.client.0.smithi115.stdout:3/801: symlink d1/dc2/l107 0 2024-09-13T17:05:57.462 INFO:tasks.workunit.client.1.smithi195.stdout:7/926: rmdir d5/db/d50/d7f/d82 39 2024-09-13T17:05:57.463 INFO:tasks.workunit.client.1.smithi195.stdout:7/927: chown d5/db/d50/d7f/d82/dcc/lfd 248341 1 2024-09-13T17:05:57.463 INFO:tasks.workunit.client.1.smithi195.stdout:7/928: creat d5/d13/d24/f148 x:0 0 0 2024-09-13T17:05:57.463 INFO:tasks.workunit.client.1.smithi195.stdout:7/929: chown d5/d35/lbd 30 1 2024-09-13T17:05:57.463 INFO:tasks.workunit.client.1.smithi195.stdout:7/930: write d5/db/d19/d22/d90/dd4/f116 [428056,26754] 0 2024-09-13T17:05:57.463 INFO:tasks.workunit.client.1.smithi195.stdout:7/931: stat d5/d35/lce 0 2024-09-13T17:05:57.464 INFO:tasks.workunit.client.1.smithi195.stdout:3/898: write d7/d19/d1e/f50 [922154,31735] 0 2024-09-13T17:05:57.464 INFO:tasks.workunit.client.1.smithi195.stdout:7/932: chown d5/db/d19/d22/l74 204109680 1 2024-09-13T17:05:57.465 INFO:tasks.workunit.client.1.smithi195.stdout:7/933: dread - d5/d35/dd2/f110 zero size 2024-09-13T17:05:57.465 INFO:tasks.workunit.client.1.smithi195.stdout:7/934: getdents d5/d13/d24/d70/d13e 0 2024-09-13T17:05:57.465 INFO:tasks.workunit.client.1.smithi195.stdout:7/935: fsync d5/d13/d30/f36 0 2024-09-13T17:05:57.466 INFO:tasks.workunit.client.0.smithi115.stdout:5/568: mkdir d19/d21/d3a/d5d/dbe 0 2024-09-13T17:05:57.466 INFO:tasks.workunit.client.1.smithi195.stdout:7/936: unlink d5/d13/d30/l5a 0 2024-09-13T17:05:57.467 INFO:tasks.workunit.client.0.smithi115.stdout:5/569: link d19/d21/d3a/d5d/f70 d19/d2b/d32/d55/d5e/fbf 0 2024-09-13T17:05:57.467 INFO:tasks.workunit.client.0.smithi115.stdout:5/570: write d19/d21/d3a/f6d [1631351,85219] 0 2024-09-13T17:05:57.467 INFO:tasks.workunit.client.0.smithi115.stdout:5/571: fdatasync d19/d2c/fba 0 2024-09-13T17:05:57.467 INFO:tasks.workunit.client.0.smithi115.stdout:7/597: write d0/d3b/d50/f10 [4231244,24795] 0 2024-09-13T17:05:57.468 INFO:tasks.workunit.client.1.smithi195.stdout:7/937: getdents d5/db/d50/d11d/d12e 0 2024-09-13T17:05:57.468 INFO:tasks.workunit.client.1.smithi195.stdout:7/938: symlink d5/d13/d24/d13f/l149 0 2024-09-13T17:05:57.469 INFO:tasks.workunit.client.1.smithi195.stdout:9/966: dread d6/f69 [0,4194304] 0 2024-09-13T17:05:57.469 INFO:tasks.workunit.client.1.smithi195.stdout:9/967: chown d6/df/d16/de3/d68/fbd 829946381 1 2024-09-13T17:05:57.470 INFO:tasks.workunit.client.1.smithi195.stdout:3/899: dread d7/d19/fb2 [0,4194304] 0 2024-09-13T17:05:57.470 INFO:tasks.workunit.client.1.smithi195.stdout:3/900: chown d7/d21/d51 45 1 2024-09-13T17:05:57.470 INFO:tasks.workunit.client.1.smithi195.stdout:3/901: stat d7/fe6 0 2024-09-13T17:05:57.471 INFO:tasks.workunit.client.0.smithi115.stdout:8/623: dwrite d0/d26/d29/d59/d7e/da7/d2b/d37/fd3 [0,4194304] 0 2024-09-13T17:05:57.471 INFO:tasks.workunit.client.0.smithi115.stdout:8/624: truncate d0/d26/d29/d98/f9f 855223 0 2024-09-13T17:05:57.471 INFO:tasks.workunit.client.1.smithi195.stdout:9/968: creat d6/d19/d21/d45/dad/d5e/da0/f13b x:0 0 0 2024-09-13T17:05:57.471 INFO:tasks.workunit.client.1.smithi195.stdout:9/969: truncate d6/df/d16/de3/d68/d6d/f7e 4536695 0 2024-09-13T17:05:57.472 INFO:tasks.workunit.client.1.smithi195.stdout:9/970: rmdir d6/df/d16/de3/d68 39 2024-09-13T17:05:57.474 INFO:tasks.workunit.client.1.smithi195.stdout:9/971: unlink d6/df/l59 0 2024-09-13T17:05:57.474 INFO:tasks.workunit.client.1.smithi195.stdout:9/972: write d6/d19/d21/d45/dd1/fec [1163854,47853] 0 2024-09-13T17:05:57.474 INFO:tasks.workunit.client.1.smithi195.stdout:9/973: creat d6/d12/d86/d101/f13c x:0 0 0 2024-09-13T17:05:57.476 INFO:tasks.workunit.client.0.smithi115.stdout:8/625: dread d0/d26/d29/d59/d7e/da7/d28/d71/fb5 [0,4194304] 0 2024-09-13T17:05:57.476 INFO:tasks.workunit.client.0.smithi115.stdout:3/802: write d1/d12/d14/fcf [356096,124464] 0 2024-09-13T17:05:57.476 INFO:tasks.workunit.client.1.smithi195.stdout:9/974: creat d6/df/d16/d58/f13d x:0 0 0 2024-09-13T17:05:57.477 INFO:tasks.workunit.client.0.smithi115.stdout:9/448: dwrite d0/f3f [0,4194304] 0 2024-09-13T17:05:57.477 INFO:tasks.workunit.client.0.smithi115.stdout:9/449: stat d0/de/d10/c48 0 2024-09-13T17:05:57.478 INFO:tasks.workunit.client.0.smithi115.stdout:8/626: symlink d0/d42/ld4 0 2024-09-13T17:05:57.479 INFO:tasks.workunit.client.1.smithi195.stdout:7/939: dread d5/db/d50/d7f/fcd [0,4194304] 0 2024-09-13T17:05:57.479 INFO:tasks.workunit.client.1.smithi195.stdout:1/853: dwrite db/f11 [4194304,4194304] 0 2024-09-13T17:05:57.479 INFO:tasks.workunit.client.1.smithi195.stdout:5/913: dwrite d2/df/d78/d54/d58/f60 [0,4194304] 0 2024-09-13T17:05:57.479 INFO:tasks.workunit.client.1.smithi195.stdout:5/914: rename d2 to d2/df/d78/d131 22 2024-09-13T17:05:57.480 INFO:tasks.workunit.client.0.smithi115.stdout:3/803: creat d1/d4b/d69/d7b/dbb/f108 x:0 0 0 2024-09-13T17:05:57.481 INFO:tasks.workunit.client.1.smithi195.stdout:6/804: dwrite f19 [0,4194304] 0 2024-09-13T17:05:57.481 INFO:tasks.workunit.client.1.smithi195.stdout:0/845: dwrite d7/db/f81 [0,4194304] 0 2024-09-13T17:05:57.481 INFO:tasks.workunit.client.1.smithi195.stdout:0/846: read - d7/db/fdf zero size 2024-09-13T17:05:57.481 INFO:tasks.workunit.client.1.smithi195.stdout:0/847: write d7/d87/d9b/d4e/d68/f78 [576681,11955] 0 2024-09-13T17:05:57.481 INFO:tasks.workunit.client.1.smithi195.stdout:0/848: fdatasync d7/d50/da1/faf 0 2024-09-13T17:05:57.481 INFO:tasks.workunit.client.1.smithi195.stdout:0/849: chown d7/d87/d9b/d56/d4d/f101 2034 1 2024-09-13T17:05:57.482 INFO:tasks.workunit.client.1.smithi195.stdout:0/850: write d7/db/d38/d5d/f8f [770203,98610] 0 2024-09-13T17:05:57.482 INFO:tasks.workunit.client.1.smithi195.stdout:0/851: stat d7/d50/da2/de8 0 2024-09-13T17:05:57.482 INFO:tasks.workunit.client.1.smithi195.stdout:2/871: dwrite d0/d4a/d47/d73/d75/d88/d2c/d43/d63/f99 [0,4194304] 0 2024-09-13T17:05:57.482 INFO:tasks.workunit.client.1.smithi195.stdout:2/872: chown d0/d4a/d47/d73/d75/d88/d2c/f8d 15441 1 2024-09-13T17:05:57.482 INFO:tasks.workunit.client.1.smithi195.stdout:6/805: dread d1c/d24/d49/f4c [0,4194304] 0 2024-09-13T17:05:57.482 INFO:tasks.workunit.client.1.smithi195.stdout:6/806: truncate d1c/df0/db9/d30/d6f/f7e 4747435 0 2024-09-13T17:05:57.485 INFO:tasks.workunit.client.1.smithi195.stdout:7/940: symlink d5/db/d50/d11d/d12e/l14a 0 2024-09-13T17:05:57.485 INFO:tasks.workunit.client.1.smithi195.stdout:7/941: chown d5/d13/d24/d70/d13e 0 1 2024-09-13T17:05:57.488 INFO:tasks.workunit.client.1.smithi195.stdout:1/854: mkdir db/d11e 0 2024-09-13T17:05:57.489 INFO:tasks.workunit.client.0.smithi115.stdout:5/572: dwrite d19/d2b/d32/d55/f4c [0,4194304] 0 2024-09-13T17:05:57.489 INFO:tasks.workunit.client.0.smithi115.stdout:5/573: chown d19/d2b/d32/d55/d5e/l51 2 1 2024-09-13T17:05:57.489 INFO:tasks.workunit.client.1.smithi195.stdout:3/902: dread d7/d21/d51/f54 [0,4194304] 0 2024-09-13T17:05:57.489 INFO:tasks.workunit.client.1.smithi195.stdout:3/903: chown d7/d21/d2a 48 1 2024-09-13T17:05:57.489 INFO:tasks.workunit.client.1.smithi195.stdout:3/904: chown d7/d21/d2a/d35/d8f/d9f 43824470 1 2024-09-13T17:05:57.490 INFO:tasks.workunit.client.1.smithi195.stdout:6/807: write d1c/d24/d49/d5f/f41 [1357168,110285] 0 2024-09-13T17:05:57.491 INFO:tasks.workunit.client.0.smithi115.stdout:9/450: dread d0/f11 [8388608,4194304] 0 2024-09-13T17:05:57.491 INFO:tasks.workunit.client.1.smithi195.stdout:5/915: symlink d2/df/d78/deb/d4e/d10/d5c/da1/l132 0 2024-09-13T17:05:57.492 INFO:tasks.workunit.client.1.smithi195.stdout:5/916: write d2/df/d78/deb/d3f/d7b/fda [1031994,13525] 0 2024-09-13T17:05:57.492 INFO:tasks.workunit.client.1.smithi195.stdout:1/855: dread db/df/d4d/f9b [0,4194304] 0 2024-09-13T17:05:57.505 INFO:tasks.workunit.client.1.smithi195.stdout:9/975: dwrite d6/d19/d21/d5b/f79 [4194304,4194304] 0 2024-09-13T17:05:57.505 INFO:tasks.workunit.client.1.smithi195.stdout:9/976: dread - d6/d19/d21/dd9/f12d zero size 2024-09-13T17:05:57.505 INFO:tasks.workunit.client.1.smithi195.stdout:9/977: chown d6/d12/dbc/f102 6 1 2024-09-13T17:05:57.512 INFO:tasks.workunit.client.0.smithi115.stdout:8/627: link d0/d26/d29/d59/d7e/da7/d28/f8d d0/d42/fd5 0 2024-09-13T17:05:57.513 INFO:tasks.workunit.client.0.smithi115.stdout:3/804: mknod d1/d4b/d1a/c109 0 2024-09-13T17:05:57.516 INFO:tasks.workunit.client.0.smithi115.stdout:5/574: mkdir d19/d21/dc0 0 2024-09-13T17:05:57.517 INFO:tasks.workunit.client.0.smithi115.stdout:9/451: mkdir d0/de/d10/d15/d7f/d98 0 2024-09-13T17:05:57.518 INFO:tasks.workunit.client.0.smithi115.stdout:9/452: write d0/de/d10/d15/d86/f8b [160701,92588] 0 2024-09-13T17:05:57.519 INFO:tasks.workunit.client.1.smithi195.stdout:3/905: mkdir d7/d19/d10a/d123 0 2024-09-13T17:05:57.521 INFO:tasks.workunit.client.0.smithi115.stdout:8/628: mknod d0/d21/d3a/d60/cd6 0 2024-09-13T17:05:57.521 INFO:tasks.workunit.client.0.smithi115.stdout:8/629: write d0/d42/fc7 [888504,37329] 0 2024-09-13T17:05:57.522 INFO:tasks.workunit.client.1.smithi195.stdout:9/978: dread d6/df/d16/de3/f53 [0,4194304] 0 2024-09-13T17:05:57.522 INFO:tasks.workunit.client.1.smithi195.stdout:7/942: dwrite d5/db/d19/d22/d90/d127/d131/f136 [0,4194304] 0 2024-09-13T17:05:57.522 INFO:tasks.workunit.client.1.smithi195.stdout:7/943: creat d5/d13/d30/f14b x:0 0 0 2024-09-13T17:05:57.523 INFO:tasks.workunit.client.0.smithi115.stdout:3/805: dread d1/d4b/d1a/d6e/dd9/f59 [0,4194304] 0 2024-09-13T17:05:57.523 INFO:tasks.workunit.client.1.smithi195.stdout:0/852: dwrite d7/db/d11/f61 [0,4194304] 0 2024-09-13T17:05:57.523 INFO:tasks.workunit.client.1.smithi195.stdout:6/808: rename f14 to d1c/d3e/d6b/f108 0 2024-09-13T17:05:57.523 INFO:tasks.workunit.client.1.smithi195.stdout:2/873: dwrite d0/d4a/d47/d73/d75/fb9 [0,4194304] 0 2024-09-13T17:05:57.524 INFO:tasks.workunit.client.1.smithi195.stdout:2/874: fdatasync d0/d3/fa7 0 2024-09-13T17:05:57.526 INFO:tasks.workunit.client.1.smithi195.stdout:5/917: creat d2/df/d48/f133 x:0 0 0 2024-09-13T17:05:57.526 INFO:tasks.workunit.client.1.smithi195.stdout:5/918: chown d2/df/d48/d5a/dc5/fc6 517961 1 2024-09-13T17:05:57.526 INFO:tasks.workunit.client.1.smithi195.stdout:5/919: truncate d2/df/d90/dbb/dec/d10a/f12e 621776 0 2024-09-13T17:05:57.527 INFO:tasks.workunit.client.1.smithi195.stdout:1/856: getdents db/df/d4d 0 2024-09-13T17:05:57.529 INFO:tasks.workunit.client.0.smithi115.stdout:3/806: mkdir d1/d4b/d69/d7b/d8b/d90/deb/d10a 0 2024-09-13T17:05:57.530 INFO:tasks.workunit.client.1.smithi195.stdout:5/920: write d2/f6a [5305199,65513] 0 2024-09-13T17:05:57.530 INFO:tasks.workunit.client.1.smithi195.stdout:1/857: dread db/df/d4d/fc7 [0,4194304] 0 2024-09-13T17:05:57.532 INFO:tasks.workunit.client.1.smithi195.stdout:3/906: symlink d7/d21/d66/l124 0 2024-09-13T17:05:57.533 INFO:tasks.workunit.client.0.smithi115.stdout:9/453: getdents d0/de/d10/d15/d86 0 2024-09-13T17:05:57.533 INFO:tasks.workunit.client.0.smithi115.stdout:9/454: creat d0/de/d37/d83/d91/f99 x:0 0 0 2024-09-13T17:05:57.542 INFO:tasks.workunit.client.0.smithi115.stdout:9/455: symlink d0/de/d37/l9a 0 2024-09-13T17:05:57.543 INFO:tasks.workunit.client.1.smithi195.stdout:5/921: dread d2/df/d78/deb/d3f/f4d [0,4194304] 0 2024-09-13T17:05:57.544 INFO:tasks.workunit.client.1.smithi195.stdout:9/979: mknod d6/d19/d21/c13e 0 2024-09-13T17:05:57.548 INFO:tasks.workunit.client.1.smithi195.stdout:7/944: mknod d5/db/d50/d7f/d10a/c14c 0 2024-09-13T17:05:57.549 INFO:tasks.workunit.client.1.smithi195.stdout:3/907: read d7/d62/d70/fe5 [4082393,42533] 0 2024-09-13T17:05:57.549 INFO:tasks.workunit.client.1.smithi195.stdout:6/809: mknod d1c/d3e/d6b/dd2/c109 0 2024-09-13T17:05:57.554 INFO:tasks.workunit.client.1.smithi195.stdout:0/853: dwrite d7/d88/d23/f35 [0,4194304] 0 2024-09-13T17:05:57.554 INFO:tasks.workunit.client.1.smithi195.stdout:0/854: dread - d7/d87/d9b/d56/d46/da4/fac zero size 2024-09-13T17:05:57.555 INFO:tasks.workunit.client.1.smithi195.stdout:0/855: chown d7/db/d9a/dde/l106 1871998144 1 2024-09-13T17:05:57.556 INFO:tasks.workunit.client.1.smithi195.stdout:2/875: dwrite d0/d4a/d47/d73/d75/d88/d2c/d43/d84/f97 [0,4194304] 0 2024-09-13T17:05:57.556 INFO:tasks.workunit.client.1.smithi195.stdout:2/876: fsync d0/d3/f82 0 2024-09-13T17:05:57.558 INFO:tasks.workunit.client.0.smithi115.stdout:5/575: truncate d19/d21/f2a 1918362 0 2024-09-13T17:05:57.560 INFO:tasks.workunit.client.1.smithi195.stdout:1/858: rename db/d19/d5a/d66/d96/dd0 to db/df/d4d/d67/d11f 0 2024-09-13T17:05:57.560 INFO:tasks.workunit.client.1.smithi195.stdout:1/859: fsync db/d58/f117 0 2024-09-13T17:05:57.561 INFO:tasks.workunit.client.1.smithi195.stdout:7/945: write d5/db/d19/d22/fe3 [3409304,53402] 0 2024-09-13T17:05:57.564 INFO:tasks.workunit.client.0.smithi115.stdout:5/576: creat d19/dac/fc1 x:0 0 0 2024-09-13T17:05:57.564 INFO:tasks.workunit.client.0.smithi115.stdout:5/577: stat d19/d2b/d32/d55/d5e/d87 0 2024-09-13T17:05:57.564 INFO:tasks.workunit.client.0.smithi115.stdout:5/578: readlink d19/d2b/d32/d55/d5e/d87/da4/lab 0 2024-09-13T17:05:57.564 INFO:tasks.workunit.client.0.smithi115.stdout:5/579: fdatasync d19/d21/d3a/f82 0 2024-09-13T17:05:57.565 INFO:tasks.workunit.client.0.smithi115.stdout:5/580: fdatasync d19/fa2 0 2024-09-13T17:05:57.565 INFO:tasks.workunit.client.0.smithi115.stdout:5/581: fsync d19/d2b/fa8 0 2024-09-13T17:05:57.566 INFO:tasks.workunit.client.1.smithi195.stdout:9/980: creat d6/d12/d86/dd2/de1/d10b/f13f x:0 0 0 2024-09-13T17:05:57.566 INFO:tasks.workunit.client.0.smithi115.stdout:5/582: rename lb to d19/d2b/d32/d55/d5e/lc2 0 2024-09-13T17:05:57.567 INFO:tasks.workunit.client.1.smithi195.stdout:2/877: mkdir d0/d4a/d47/d73/d10b 0 2024-09-13T17:05:57.567 INFO:tasks.workunit.client.1.smithi195.stdout:1/860: creat db/df/d4d/d67/dc6/f120 x:0 0 0 2024-09-13T17:05:57.567 INFO:tasks.workunit.client.1.smithi195.stdout:1/861: read db/df/d4d/d74/da8/fbc [481064,117683] 0 2024-09-13T17:05:57.569 INFO:tasks.workunit.client.0.smithi115.stdout:5/583: symlink d19/d2b/d69/d8f/lc3 0 2024-09-13T17:05:57.569 INFO:tasks.workunit.client.0.smithi115.stdout:3/807: dwrite d1/d4b/d69/fca [0,4194304] 0 2024-09-13T17:05:57.569 INFO:tasks.workunit.client.0.smithi115.stdout:3/808: truncate d1/d4b/d1a/d30/f3c 4882504 0 2024-09-13T17:05:57.569 INFO:tasks.workunit.client.0.smithi115.stdout:3/809: creat d1/d4b/d1a/d30/dc5/f10b x:0 0 0 2024-09-13T17:05:57.569 INFO:tasks.workunit.client.0.smithi115.stdout:3/810: write d1/d4b/d1a/d30/dc5/ff6 [831009,116328] 0 2024-09-13T17:05:57.570 INFO:tasks.workunit.client.1.smithi195.stdout:9/981: mkdir d6/df/d16/d140 0 2024-09-13T17:05:57.570 INFO:tasks.workunit.client.1.smithi195.stdout:9/982: write d6/df/d16/d5c/f7a [482910,86860] 0 2024-09-13T17:05:57.571 INFO:tasks.workunit.client.1.smithi195.stdout:2/878: rename d0/d4a/d47/d73/d75/d88/d8e/f9b to d0/d4a/f10c 0 2024-09-13T17:05:57.572 INFO:tasks.workunit.client.0.smithi115.stdout:8/630: dwrite d0/d21/fbe [0,4194304] 0 2024-09-13T17:05:57.573 INFO:tasks.workunit.client.1.smithi195.stdout:2/879: dread d0/d4a/d47/d73/d75/fde [0,4194304] 0 2024-09-13T17:05:57.573 INFO:tasks.workunit.client.1.smithi195.stdout:2/880: truncate d0/d4a/d47/d73/d75/d88/d2c/df6/fe1 722458 0 2024-09-13T17:05:57.574 INFO:tasks.workunit.client.1.smithi195.stdout:5/922: dwrite d2/df/d78/deb/d4e/fdd [0,4194304] 0 2024-09-13T17:05:57.574 INFO:tasks.workunit.client.1.smithi195.stdout:3/908: dwrite d7/d21/d2a/d35/d60/d64/db3/dc4/ff0 [0,4194304] 0 2024-09-13T17:05:57.575 INFO:tasks.workunit.client.0.smithi115.stdout:9/456: dwrite d0/de/d10/f44 [4194304,4194304] 0 2024-09-13T17:05:57.575 INFO:tasks.workunit.client.0.smithi115.stdout:9/457: chown d0/de/d37/l4e 76408 1 2024-09-13T17:05:57.575 INFO:tasks.workunit.client.0.smithi115.stdout:9/458: dread - d0/de/d37/d83/d91/f97 zero size 2024-09-13T17:05:57.576 INFO:tasks.workunit.client.0.smithi115.stdout:5/584: dread d19/f1e [0,4194304] 0 2024-09-13T17:05:57.577 INFO:tasks.workunit.client.1.smithi195.stdout:1/862: creat db/df/d51/d8e/f121 x:0 0 0 2024-09-13T17:05:57.577 INFO:tasks.workunit.client.1.smithi195.stdout:1/863: read db/df/d4d/f81 [22467,12809] 0 2024-09-13T17:05:57.579 INFO:tasks.workunit.client.1.smithi195.stdout:7/946: getdents d5/db/d50/d7f/d82/da1 0 2024-09-13T17:05:57.582 INFO:tasks.workunit.client.1.smithi195.stdout:2/881: dread d0/fab [0,4194304] 0 2024-09-13T17:05:57.583 INFO:tasks.workunit.client.0.smithi115.stdout:3/811: unlink d1/d4b/d1a/d30/lb9 0 2024-09-13T17:05:57.583 INFO:tasks.workunit.client.1.smithi195.stdout:2/882: creat d0/d4a/d47/dba/f10d x:0 0 0 2024-09-13T17:05:57.589 INFO:tasks.workunit.client.1.smithi195.stdout:7/947: dread d5/d35/fe2 [0,4194304] 0 2024-09-13T17:05:57.589 INFO:tasks.workunit.client.1.smithi195.stdout:7/948: truncate d5/db/d19/fb4 659191 0 2024-09-13T17:05:57.590 INFO:tasks.workunit.client.0.smithi115.stdout:8/631: mknod d0/d26/d29/d59/d7e/da1/cd7 0 2024-09-13T17:05:57.592 INFO:tasks.workunit.client.1.smithi195.stdout:5/923: truncate d2/df/d78/deb/d4e/d10/d8f/fa0 398945 0 2024-09-13T17:05:57.592 INFO:tasks.workunit.client.1.smithi195.stdout:5/924: dread - d2/df/d78/d76/d114/f12c zero size 2024-09-13T17:05:57.593 INFO:tasks.workunit.client.0.smithi115.stdout:9/459: creat d0/d21/d95/f9b x:0 0 0 2024-09-13T17:05:57.595 INFO:tasks.workunit.client.0.smithi115.stdout:5/585: mknod d19/d2b/d32/d55/d5e/cc4 0 2024-09-13T17:05:57.598 INFO:tasks.workunit.client.0.smithi115.stdout:8/632: stat d0/fb 0 2024-09-13T17:05:57.598 INFO:tasks.workunit.client.1.smithi195.stdout:0/856: dwrite d7/db/d38/d5d/f8f [0,4194304] 0 2024-09-13T17:05:57.601 INFO:tasks.workunit.client.0.smithi115.stdout:9/460: rmdir d0/de/d10/d15/d7f/d98 0 2024-09-13T17:05:57.601 INFO:tasks.workunit.client.1.smithi195.stdout:1/864: dwrite db/df/d13/f80 [0,4194304] 0 2024-09-13T17:05:57.602 INFO:tasks.workunit.client.0.smithi115.stdout:8/633: dread d0/d15/f4d [0,4194304] 0 2024-09-13T17:05:57.603 INFO:tasks.workunit.client.0.smithi115.stdout:5/586: symlink d19/d21/d62/lc5 0 2024-09-13T17:05:57.604 INFO:tasks.workunit.client.1.smithi195.stdout:5/925: dread d2/df/d78/d76/f8d [0,4194304] 0 2024-09-13T17:05:57.604 INFO:tasks.workunit.client.1.smithi195.stdout:5/926: fdatasync d2/df/d90/db2/fd9 0 2024-09-13T17:05:57.604 INFO:tasks.workunit.client.1.smithi195.stdout:5/927: chown d2/df/d78/d54/d58/la5 133074 1 2024-09-13T17:05:57.604 INFO:tasks.workunit.client.1.smithi195.stdout:5/928: chown d2/df/d78/deb/d3f/f4d 10676 1 2024-09-13T17:05:57.606 INFO:tasks.workunit.client.1.smithi195.stdout:7/949: dwrite d5/d13/fca [0,4194304] 0 2024-09-13T17:05:57.607 INFO:tasks.workunit.client.0.smithi115.stdout:8/634: symlink d0/d21/d3a/d60/ld8 0 2024-09-13T17:05:57.609 INFO:tasks.workunit.client.1.smithi195.stdout:3/909: link d7/d19/d1e/laf d7/d21/d2a/d35/d60/d64/db3/dc4/dfd/l125 0 2024-09-13T17:05:57.609 INFO:tasks.workunit.client.1.smithi195.stdout:3/910: stat f5 0 2024-09-13T17:05:57.609 INFO:tasks.workunit.client.1.smithi195.stdout:3/911: chown d7/d21/c28 124818494 1 2024-09-13T17:05:57.610 INFO:tasks.workunit.client.1.smithi195.stdout:0/857: write d7/d88/d7c/feb [1263169,125069] 0 2024-09-13T17:05:57.610 INFO:tasks.workunit.client.1.smithi195.stdout:0/858: fdatasync d7/d88/f7e 0 2024-09-13T17:05:57.610 INFO:tasks.workunit.client.0.smithi115.stdout:5/587: mkdir d19/d2e/dc6 0 2024-09-13T17:05:57.611 INFO:tasks.workunit.client.0.smithi115.stdout:9/461: dread d0/de/d37/f5d [0,4194304] 0 2024-09-13T17:05:57.611 INFO:tasks.workunit.client.1.smithi195.stdout:3/912: write d7/d19/f48 [4275812,15343] 0 2024-09-13T17:05:57.612 INFO:tasks.workunit.client.0.smithi115.stdout:3/812: rename d1/d4b/d69/d7b/dbb/dcb to d1/d4b/d1a/d30/d10c 0 2024-09-13T17:05:57.612 INFO:tasks.workunit.client.0.smithi115.stdout:3/813: read - d1/d4b/d69/db6/dd2/fe2 zero size 2024-09-13T17:05:57.613 INFO:tasks.workunit.client.1.smithi195.stdout:2/883: mknod d0/d4a/d47/d73/d75/d88/d1e/c10e 0 2024-09-13T17:05:57.613 INFO:tasks.workunit.client.1.smithi195.stdout:2/884: chown d0/d4a/d47/d73/d75/d88/d2c/df6/fed 2612 1 2024-09-13T17:05:57.614 INFO:tasks.workunit.client.0.smithi115.stdout:8/635: creat d0/d26/d29/d59/fd9 x:0 0 0 2024-09-13T17:05:57.614 INFO:tasks.workunit.client.0.smithi115.stdout:8/636: write d0/d21/d76/d83/f7b [1029573,82621] 0 2024-09-13T17:05:57.614 INFO:tasks.workunit.client.0.smithi115.stdout:8/637: fsync d0/d15/d44/f70 0 2024-09-13T17:05:57.614 INFO:tasks.workunit.client.0.smithi115.stdout:8/638: dread - d0/d21/d76/d83/fd1 zero size 2024-09-13T17:05:57.614 INFO:tasks.workunit.client.0.smithi115.stdout:8/639: write d0/d18/f65 [5065701,10600] 0 2024-09-13T17:05:57.614 INFO:tasks.workunit.client.1.smithi195.stdout:9/983: getdents d6/df/d16/de3/d68/d6d 0 2024-09-13T17:05:57.616 INFO:tasks.workunit.client.0.smithi115.stdout:5/588: mknod d19/d21/cc7 0 2024-09-13T17:05:57.616 INFO:tasks.workunit.client.1.smithi195.stdout:8/950: sync 2024-09-13T17:05:57.616 INFO:tasks.workunit.client.1.smithi195.stdout:8/951: truncate d0/d17/d2f/d7c/d4c/d9b/fec 1257871 0 2024-09-13T17:05:57.619 INFO:tasks.workunit.client.0.smithi115.stdout:9/462: mkdir d0/d9c 0 2024-09-13T17:05:57.619 INFO:tasks.workunit.client.0.smithi115.stdout:9/463: stat d0/l80 0 2024-09-13T17:05:57.619 INFO:tasks.workunit.client.0.smithi115.stdout:9/464: chown d0/de/d10/f46 2551 1 2024-09-13T17:05:57.620 INFO:tasks.workunit.client.0.smithi115.stdout:3/814: write d1/d12/d14/f51 [5805987,10946] 0 2024-09-13T17:05:57.620 INFO:tasks.workunit.client.0.smithi115.stdout:8/640: mkdir d0/d26/d29/d59/d7e/da7/d2b/db1/dda 0 2024-09-13T17:05:57.626 INFO:tasks.workunit.client.1.smithi195.stdout:9/984: dread d6/d19/d21/d45/dad/d5e/da0/f126 [4194304,4194304] 0 2024-09-13T17:05:57.626 INFO:tasks.workunit.client.1.smithi195.stdout:9/985: creat d6/d19/d21/d5b/f141 x:0 0 0 2024-09-13T17:05:57.631 INFO:tasks.workunit.client.1.smithi195.stdout:5/929: creat d2/df/d78/deb/d4e/d10/f134 x:0 0 0 2024-09-13T17:05:57.636 INFO:tasks.workunit.client.1.smithi195.stdout:5/930: dread d2/df/d78/deb/d4e/d10/d46/f96 [0,4194304] 0 2024-09-13T17:05:57.637 INFO:tasks.workunit.client.1.smithi195.stdout:7/950: mkdir d5/d13/da8/d14d 0 2024-09-13T17:05:57.638 INFO:tasks.workunit.client.0.smithi115.stdout:3/815: mknod d1/d4b/d1a/d105/c10d 0 2024-09-13T17:05:57.638 INFO:tasks.workunit.client.0.smithi115.stdout:3/816: read d1/d12/d14/f51 [7128888,60889] 0 2024-09-13T17:05:57.640 INFO:tasks.workunit.client.1.smithi195.stdout:0/859: mkdir d7/d87/d9b/d4e/d68/dda/d107 0 2024-09-13T17:05:57.642 INFO:tasks.workunit.client.0.smithi115.stdout:8/641: rename d0/d15/d3e/c74 to d0/d21/d76/dc1/cdb 0 2024-09-13T17:05:57.642 INFO:tasks.workunit.client.0.smithi115.stdout:8/642: fdatasync d0/d21/d3a/d60/f7a 0 2024-09-13T17:05:57.643 INFO:tasks.workunit.client.0.smithi115.stdout:8/643: read d0/d26/d29/d59/d7e/da7/d28/d71/fb5 [485050,26201] 0 2024-09-13T17:05:57.646 INFO:tasks.workunit.client.1.smithi195.stdout:3/913: truncate d7/d21/d2a/d35/d8f/fcd 1953926 0 2024-09-13T17:05:57.646 INFO:tasks.workunit.client.1.smithi195.stdout:3/914: chown d7/d21/d2a/ffe 0 1 2024-09-13T17:05:57.646 INFO:tasks.workunit.client.1.smithi195.stdout:3/915: fdatasync d7/d21/d2a/d35/d60/d64/db3/dc4/f10d 0 2024-09-13T17:05:57.646 INFO:tasks.workunit.client.1.smithi195.stdout:3/916: dread - d7/d21/d2a/ffe zero size 2024-09-13T17:05:57.647 INFO:tasks.workunit.client.0.smithi115.stdout:9/465: rmdir d0/d21/d65 39 2024-09-13T17:05:57.647 INFO:tasks.workunit.client.0.smithi115.stdout:9/466: chown d0 14 1 2024-09-13T17:05:57.647 INFO:tasks.workunit.client.0.smithi115.stdout:9/467: creat d0/de/d10/f9d x:0 0 0 2024-09-13T17:05:57.650 INFO:tasks.workunit.client.1.smithi195.stdout:2/885: rename d0/d4a/d47/d73/d75/d88/f7f to d0/d4a/d47/d73/d75/d88/d2c/d43/f10f 0 2024-09-13T17:05:57.650 INFO:tasks.workunit.client.1.smithi195.stdout:2/886: chown d0/d4a/d47/dba/f10d 40 1 2024-09-13T17:05:57.650 INFO:tasks.workunit.client.1.smithi195.stdout:2/887: write d0/d4a/d47/d73/d75/d88/ff2 [178196,100442] 0 2024-09-13T17:05:57.651 INFO:tasks.workunit.client.0.smithi115.stdout:6/633: sync 2024-09-13T17:05:57.651 INFO:tasks.workunit.client.0.smithi115.stdout:3/817: dread d1/d4b/d1a/d6e/fc4 [0,4194304] 0 2024-09-13T17:05:57.651 INFO:tasks.workunit.client.0.smithi115.stdout:3/818: write d1/d4b/d69/d7b/dbb/f108 [144176,86562] 0 2024-09-13T17:05:57.651 INFO:tasks.workunit.client.0.smithi115.stdout:3/819: truncate d1/d4b/d1a/d30/dc5/f10b 698465 0 2024-09-13T17:05:57.652 INFO:tasks.workunit.client.1.smithi195.stdout:8/952: creat d0/d17/d2f/d7c/d4c/d9b/f142 x:0 0 0 2024-09-13T17:05:57.653 INFO:tasks.workunit.client.1.smithi195.stdout:8/953: write d0/d13/fc6 [353512,92689] 0 2024-09-13T17:05:57.653 INFO:tasks.workunit.client.1.smithi195.stdout:8/954: fdatasync d0/d17/d2f/d7c/d4c/d9b/f142 0 2024-09-13T17:05:57.653 INFO:tasks.workunit.client.1.smithi195.stdout:8/955: chown d0/d13/f5d 328 1 2024-09-13T17:05:57.653 INFO:tasks.workunit.client.1.smithi195.stdout:8/956: write d0/d17/d2f/d7c/d4c/d119/f13d [35526,109099] 0 2024-09-13T17:05:57.655 INFO:tasks.workunit.client.0.smithi115.stdout:8/644: link d0/d26/d29/f38 d0/d21/d76/dc1/fdc 0 2024-09-13T17:05:57.659 INFO:tasks.workunit.client.1.smithi195.stdout:8/957: dread d0/d17/d2f/d7c/fca [0,4194304] 0 2024-09-13T17:05:57.659 INFO:tasks.workunit.client.1.smithi195.stdout:1/865: rmdir db/d60 39 2024-09-13T17:05:57.662 INFO:tasks.workunit.client.0.smithi115.stdout:3/820: creat d1/d4b/d69/d7b/d8b/f10e x:0 0 0 2024-09-13T17:05:57.663 INFO:tasks.workunit.client.1.smithi195.stdout:7/951: dwrite d5/d13/d30/f95 [0,4194304] 0 2024-09-13T17:05:57.663 INFO:tasks.workunit.client.1.smithi195.stdout:7/952: write d5/db/d19/d22/d90/d127/d131/f136 [4390269,88111] 0 2024-09-13T17:05:57.664 INFO:tasks.workunit.client.1.smithi195.stdout:5/931: unlink d2/df/d78/deb/d4e/d74/d91/cc2 0 2024-09-13T17:05:57.667 INFO:tasks.workunit.client.1.smithi195.stdout:2/888: dread d0/d4a/d47/d73/d75/d88/d2c/dd7/ffa [0,4194304] 0 2024-09-13T17:05:57.669 INFO:tasks.workunit.client.1.smithi195.stdout:3/917: dwrite d7/d21/d2a/d35/d60/fea [0,4194304] 0 2024-09-13T17:05:57.669 INFO:tasks.workunit.client.1.smithi195.stdout:3/918: stat d7/d21/d2a/ffe 0 2024-09-13T17:05:57.669 INFO:tasks.workunit.client.0.smithi115.stdout:8/645: dread d0/d26/d29/f2a [0,4194304] 0 2024-09-13T17:05:57.670 INFO:tasks.workunit.client.0.smithi115.stdout:3/821: link d1/d4b/d69/d7b/d8b/f10e d1/d4b/d69/d7b/d8b/f10f 0 2024-09-13T17:05:57.670 INFO:tasks.workunit.client.1.smithi195.stdout:0/860: symlink d7/d87/d9b/d56/d46/da4/l108 0 2024-09-13T17:05:57.672 INFO:tasks.workunit.client.0.smithi115.stdout:6/634: dwrite d8/d33/d40/d67/db4/f65 [0,4194304] 0 2024-09-13T17:05:57.674 INFO:tasks.workunit.client.0.smithi115.stdout:3/822: creat d1/d4b/d69/db6/dd2/f110 x:0 0 0 2024-09-13T17:05:57.674 INFO:tasks.workunit.client.0.smithi115.stdout:3/823: write d1/d4b/f2b [4975392,24047] 0 2024-09-13T17:05:57.674 INFO:tasks.workunit.client.1.smithi195.stdout:1/866: rmdir db/df/d4d/d74/da8 39 2024-09-13T17:05:57.677 INFO:tasks.workunit.client.0.smithi115.stdout:9/468: rmdir d0/de/d10/d15 39 2024-09-13T17:05:57.680 INFO:tasks.workunit.client.0.smithi115.stdout:8/646: rmdir d0/d21/d76/d83 39 2024-09-13T17:05:57.682 INFO:tasks.workunit.client.1.smithi195.stdout:2/889: dread d0/d4a/d47/d73/d75/fa2 [0,4194304] 0 2024-09-13T17:05:57.683 INFO:tasks.workunit.client.1.smithi195.stdout:5/932: dwrite d2/df/d78/deb/d4e/d10/d46/f104 [0,4194304] 0 2024-09-13T17:05:57.683 INFO:tasks.workunit.client.1.smithi195.stdout:5/933: stat d2/df/c111 0 2024-09-13T17:05:57.683 INFO:tasks.workunit.client.0.smithi115.stdout:3/824: symlink d1/d12/d14/l111 0 2024-09-13T17:05:57.685 INFO:tasks.workunit.client.0.smithi115.stdout:9/469: creat d0/d21/d65/f9e x:0 0 0 2024-09-13T17:05:57.686 INFO:tasks.workunit.client.0.smithi115.stdout:3/825: rmdir d1/d4b/d69/d7b 39 2024-09-13T17:05:57.689 INFO:tasks.workunit.client.0.smithi115.stdout:3/826: unlink d1/d4b/d1a/f9b 0 2024-09-13T17:05:57.690 INFO:tasks.workunit.client.1.smithi195.stdout:3/919: creat d7/d21/d2a/d35/db7/dc2/f126 x:0 0 0 2024-09-13T17:05:57.691 INFO:tasks.workunit.client.1.smithi195.stdout:3/920: dread d7/d19/fb2 [0,4194304] 0 2024-09-13T17:05:57.693 INFO:tasks.workunit.client.0.smithi115.stdout:8/647: dread d0/d15/d44/f52 [0,4194304] 0 2024-09-13T17:05:57.693 INFO:tasks.workunit.client.0.smithi115.stdout:8/648: truncate d0/d26/d29/f38 2706001 0 2024-09-13T17:05:57.693 INFO:tasks.workunit.client.0.smithi115.stdout:3/827: getdents d1/da6 0 2024-09-13T17:05:57.696 INFO:tasks.workunit.client.0.smithi115.stdout:8/649: write d0/f13 [3575505,29378] 0 2024-09-13T17:05:57.696 INFO:tasks.workunit.client.0.smithi115.stdout:8/650: chown d0/d21/d76/d83/d5a/ld2 30 1 2024-09-13T17:05:57.696 INFO:tasks.workunit.client.0.smithi115.stdout:8/651: chown d0/d26 288474238 1 2024-09-13T17:05:57.700 INFO:tasks.workunit.client.1.smithi195.stdout:7/953: rename d5/d13/d24/f51 to d5/db/d19/d22/d90/f14e 0 2024-09-13T17:05:57.701 INFO:tasks.workunit.client.1.smithi195.stdout:2/890: mknod d0/d4a/d47/d73/d75/d88/d2c/dd7/c110 0 2024-09-13T17:05:57.705 INFO:tasks.workunit.client.1.smithi195.stdout:5/934: mkdir d2/df/d48/d135 0 2024-09-13T17:05:57.706 INFO:tasks.workunit.client.1.smithi195.stdout:5/935: write d2/f26 [1758467,106353] 0 2024-09-13T17:05:57.706 INFO:tasks.workunit.client.1.smithi195.stdout:3/921: mknod d7/d21/d2a/c127 0 2024-09-13T17:05:57.707 INFO:tasks.workunit.client.1.smithi195.stdout:5/936: write d2/df/d78/deb/d4e/d10/d8f/f122 [133740,7328] 0 2024-09-13T17:05:57.708 INFO:tasks.workunit.client.1.smithi195.stdout:5/937: readlink d2/df/d78/le7 0 2024-09-13T17:05:57.708 INFO:tasks.workunit.client.1.smithi195.stdout:5/938: write d2/df/d78/d76/f117 [679090,129480] 0 2024-09-13T17:05:57.710 INFO:tasks.workunit.client.1.smithi195.stdout:2/891: unlink d0/d4a/d47/d73/d75/d88/d2c/dd7/f108 0 2024-09-13T17:05:57.710 INFO:tasks.workunit.client.1.smithi195.stdout:2/892: fsync d0/d4a/d47/d73/d75/d88/d2c/df6/df9/f10 0 2024-09-13T17:05:57.710 INFO:tasks.workunit.client.1.smithi195.stdout:2/893: stat d0/fe9 0 2024-09-13T17:05:57.711 INFO:tasks.workunit.client.1.smithi195.stdout:3/922: symlink d7/d21/d2a/d4a/d5a/l128 0 2024-09-13T17:05:57.715 INFO:tasks.workunit.client.1.smithi195.stdout:3/923: rename d7/d21/d2a/d35/d9c/dcf/fd7 to d7/d21/d2a/de9/f129 0 2024-09-13T17:05:57.715 INFO:tasks.workunit.client.1.smithi195.stdout:3/924: chown d7/d21/d2a/d35/d60/db0 1579768 1 2024-09-13T17:05:57.715 INFO:tasks.workunit.client.1.smithi195.stdout:2/894: getdents d0/d4a/d47/d73/d75/d88/d2c/d43/d84/dac 0 2024-09-13T17:05:57.715 INFO:tasks.workunit.client.1.smithi195.stdout:2/895: write d0/d4a/d47/d73/d75/d88/d2c/df6/df9/f9e [1290461,48925] 0 2024-09-13T17:05:57.716 INFO:tasks.workunit.client.1.smithi195.stdout:3/925: mknod d7/d21/d2a/d35/d60/d64/dbc/d116/c12a 0 2024-09-13T17:05:57.717 INFO:tasks.workunit.client.1.smithi195.stdout:2/896: symlink d0/d4a/d47/d73/d75/d88/d2c/d43/d63/db2/l111 0 2024-09-13T17:05:57.728 INFO:tasks.workunit.client.0.smithi115.stdout:9/470: dwrite d0/fb [0,4194304] 0 2024-09-13T17:05:57.728 INFO:tasks.workunit.client.0.smithi115.stdout:3/828: dwrite d1/d12/d14/fbe [0,4194304] 0 2024-09-13T17:05:57.729 INFO:tasks.workunit.client.0.smithi115.stdout:6/635: dwrite d8/db/f7e [0,4194304] 0 2024-09-13T17:05:57.731 INFO:tasks.workunit.client.1.smithi195.stdout:3/926: read d7/d21/d2a/d35/d8f/d9f/dfc/f10b [2707245,116620] 0 2024-09-13T17:05:57.731 INFO:tasks.workunit.client.1.smithi195.stdout:3/927: write d7/d21/d2a/d4a/d5a/f8e [9403370,22065] 0 2024-09-13T17:05:57.731 INFO:tasks.workunit.client.1.smithi195.stdout:5/939: dwrite d2/df/d48/ff1 [0,4194304] 0 2024-09-13T17:05:57.731 INFO:tasks.workunit.client.0.smithi115.stdout:3/829: link d1/d4b/d1a/d30/fa7 d1/d4b/d1a/d30/dc5/f112 0 2024-09-13T17:05:57.731 INFO:tasks.workunit.client.0.smithi115.stdout:3/830: dread - d1/da4/fe4 zero size 2024-09-13T17:05:57.731 INFO:tasks.workunit.client.0.smithi115.stdout:3/831: fdatasync d1/d12/f45 0 2024-09-13T17:05:57.732 INFO:tasks.workunit.client.0.smithi115.stdout:3/832: chown d1/d12/d14/l4a 548778 1 2024-09-13T17:05:57.732 INFO:tasks.workunit.client.0.smithi115.stdout:3/833: readlink d1/d4b/d1a/d30/l3d 0 2024-09-13T17:05:57.733 INFO:tasks.workunit.client.0.smithi115.stdout:8/652: dwrite d0/d15/f1b [0,4194304] 0 2024-09-13T17:05:57.734 INFO:tasks.workunit.client.1.smithi195.stdout:2/897: dwrite d0/d4a/d47/dba/fc0 [0,4194304] 0 2024-09-13T17:05:57.737 INFO:tasks.workunit.client.1.smithi195.stdout:3/928: dread d7/f61 [0,4194304] 0 2024-09-13T17:05:57.752 INFO:tasks.workunit.client.0.smithi115.stdout:9/471: creat d0/d9c/f9f x:0 0 0 2024-09-13T17:05:57.752 INFO:tasks.workunit.client.0.smithi115.stdout:9/472: creat d0/de/d37/d83/d91/fa0 x:0 0 0 2024-09-13T17:05:57.756 INFO:tasks.workunit.client.0.smithi115.stdout:6/636: rmdir d8/d33/d40/d4c 39 2024-09-13T17:05:57.757 INFO:tasks.workunit.client.1.smithi195.stdout:5/940: chown d2/df/d78/deb/d4e/d10/d8f/f122 226 1 2024-09-13T17:05:57.759 INFO:tasks.workunit.client.0.smithi115.stdout:3/834: creat d1/d4b/d69/db6/dcc/f113 x:0 0 0 2024-09-13T17:05:57.763 INFO:tasks.workunit.client.1.smithi195.stdout:2/898: symlink d0/d4a/d47/d73/l112 0 2024-09-13T17:05:57.763 INFO:tasks.workunit.client.1.smithi195.stdout:2/899: stat d0/f54 0 2024-09-13T17:05:57.765 INFO:tasks.workunit.client.1.smithi195.stdout:5/941: rename d2/d3e/f3a to d2/df/d78/deb/d4e/d74/d91/f136 0 2024-09-13T17:05:57.768 INFO:tasks.workunit.client.0.smithi115.stdout:3/835: write d1/d4b/d1a/d6e/dd9/f59 [2544248,38847] 0 2024-09-13T17:05:57.769 INFO:tasks.workunit.client.0.smithi115.stdout:3/836: chown d1/f1d 2 1 2024-09-13T17:05:57.769 INFO:tasks.workunit.client.0.smithi115.stdout:3/837: dread - d1/d4b/d1a/d30/f82 zero size 2024-09-13T17:05:57.769 INFO:tasks.workunit.client.1.smithi195.stdout:5/942: unlink d2/df/d78/deb/d4e/f2b 0 2024-09-13T17:05:57.770 INFO:tasks.workunit.client.0.smithi115.stdout:8/653: mknod d0/d26/d29/d59/d7e/da1/dbd/cdd 0 2024-09-13T17:05:57.770 INFO:tasks.workunit.client.0.smithi115.stdout:8/654: truncate d0/d42/fc7 1229540 0 2024-09-13T17:05:57.772 INFO:tasks.workunit.client.1.smithi195.stdout:5/943: mkdir d2/df/d62/d137 0 2024-09-13T17:05:57.773 INFO:tasks.workunit.client.1.smithi195.stdout:2/900: write d0/d4a/d47/d73/d75/d88/d2c/df6/df9/f10 [2202965,124993] 0 2024-09-13T17:05:57.773 INFO:tasks.workunit.client.1.smithi195.stdout:2/901: write d0/d3/fd8 [866557,78153] 0 2024-09-13T17:05:57.774 INFO:tasks.workunit.client.1.smithi195.stdout:0/861: dwrite d7/db/d9a/ffe [0,4194304] 0 2024-09-13T17:05:57.774 INFO:tasks.workunit.client.0.smithi115.stdout:9/473: mknod d0/d21/ca1 0 2024-09-13T17:05:57.778 INFO:tasks.workunit.client.0.smithi115.stdout:6/637: rename d8/db/dd/c6c to d8/db/dd/da2/cc3 0 2024-09-13T17:05:57.779 INFO:tasks.workunit.client.0.smithi115.stdout:3/838: dread d1/d4b/d1a/f27 [0,4194304] 0 2024-09-13T17:05:57.782 INFO:tasks.workunit.client.0.smithi115.stdout:9/474: unlink d0/de/d37/d83/d91/f97 0 2024-09-13T17:05:57.782 INFO:tasks.workunit.client.0.smithi115.stdout:9/475: chown d0/de/d10 10965896 1 2024-09-13T17:05:57.782 INFO:tasks.workunit.client.0.smithi115.stdout:9/476: chown d0/de 1 1 2024-09-13T17:05:57.783 INFO:tasks.workunit.client.0.smithi115.stdout:9/477: fdatasync d0/de/d10/d15/f24 0 2024-09-13T17:05:57.785 INFO:tasks.workunit.client.0.smithi115.stdout:3/839: mkdir d1/d83/d114 0 2024-09-13T17:05:57.787 INFO:tasks.workunit.client.0.smithi115.stdout:9/478: symlink d0/de/d10/d15/d86/la2 0 2024-09-13T17:05:57.790 INFO:tasks.workunit.client.0.smithi115.stdout:8/655: dwrite d0/d26/d29/d59/d7e/da7/d28/d71/f8f [0,4194304] 0 2024-09-13T17:05:57.791 INFO:tasks.workunit.client.1.smithi195.stdout:0/862: mknod d7/d87/d9b/d56/db0/c109 0 2024-09-13T17:05:57.795 INFO:tasks.workunit.client.1.smithi195.stdout:6/810: sync 2024-09-13T17:05:57.795 INFO:tasks.workunit.client.1.smithi195.stdout:0/863: rename d7/d87/d9b/d4e/d86/ffa to d7/d87/d9b/d56/d4d/d5e/f10a 0 2024-09-13T17:05:57.795 INFO:tasks.workunit.client.1.smithi195.stdout:0/864: getdents d7/d87/d9b/d56/da6 0 2024-09-13T17:05:57.797 INFO:tasks.workunit.client.1.smithi195.stdout:6/811: creat d1c/df0/db9/d8c/dd1/d106/f10a x:0 0 0 2024-09-13T17:05:57.800 INFO:tasks.workunit.client.1.smithi195.stdout:5/944: dwrite d2/df/d78/d76/f113 [0,4194304] 0 2024-09-13T17:05:57.801 INFO:tasks.workunit.client.0.smithi115.stdout:8/656: getdents d0/d26/d29/d59/d7e/da1/dbd 0 2024-09-13T17:05:57.804 INFO:tasks.workunit.client.0.smithi115.stdout:8/657: mknod d0/d26/d29/d59/d7e/da7/d28/dcd/cde 0 2024-09-13T17:05:57.804 INFO:tasks.workunit.client.0.smithi115.stdout:8/658: write d0/d26/d29/d59/d7e/da7/d2b/db1/fbc [1308973,20364] 0 2024-09-13T17:05:57.804 INFO:tasks.workunit.client.0.smithi115.stdout:8/659: chown d0/d26/d29/d59/d7e/da7/d2b/lae 15873 1 2024-09-13T17:05:57.805 INFO:tasks.workunit.client.1.smithi195.stdout:5/945: creat d2/df/d78/deb/d3f/d7b/f138 x:0 0 0 2024-09-13T17:05:57.805 INFO:tasks.workunit.client.0.smithi115.stdout:4/698: sync 2024-09-13T17:05:57.806 INFO:tasks.workunit.client.0.smithi115.stdout:4/699: dread - d7/fc3 zero size 2024-09-13T17:05:57.807 INFO:tasks.workunit.client.0.smithi115.stdout:8/660: creat d0/d26/d29/d59/d7e/da7/fdf x:0 0 0 2024-09-13T17:05:57.808 INFO:tasks.workunit.client.0.smithi115.stdout:4/700: stat d7/dd/de/d4e/d6c/c85 0 2024-09-13T17:05:57.809 INFO:tasks.workunit.client.0.smithi115.stdout:6/638: dwrite d8/d33/d7f/fbd [0,4194304] 0 2024-09-13T17:05:57.810 INFO:tasks.workunit.client.0.smithi115.stdout:6/639: rmdir d8/d33/d82 39 2024-09-13T17:05:57.812 INFO:tasks.workunit.client.1.smithi195.stdout:9/986: sync 2024-09-13T17:05:57.812 INFO:tasks.workunit.client.0.smithi115.stdout:8/661: dread d0/d26/f9b [0,4194304] 0 2024-09-13T17:05:57.812 INFO:tasks.workunit.client.0.smithi115.stdout:8/662: chown d0/d26/d29/d59/d7e/da7/d2b/l92 369 1 2024-09-13T17:05:57.812 INFO:tasks.workunit.client.0.smithi115.stdout:6/640: unlink d8/d33/d40/d4c/d66/l97 0 2024-09-13T17:05:57.813 INFO:tasks.workunit.client.1.smithi195.stdout:0/865: dwrite d7/db/d38/d5d/ff7 [0,4194304] 0 2024-09-13T17:05:57.813 INFO:tasks.workunit.client.1.smithi195.stdout:0/866: chown d7/db/d9a/ffe 404 1 2024-09-13T17:05:57.813 INFO:tasks.workunit.client.1.smithi195.stdout:6/812: dread d1c/d24/f38 [0,4194304] 0 2024-09-13T17:05:57.813 INFO:tasks.workunit.client.1.smithi195.stdout:6/813: creat d1c/d24/d49/d5f/db1/d95/f10b x:0 0 0 2024-09-13T17:05:57.813 INFO:tasks.workunit.client.0.smithi115.stdout:6/641: creat d8/d33/d40/d67/fc4 x:0 0 0 2024-09-13T17:05:57.817 INFO:tasks.workunit.client.1.smithi195.stdout:0/867: rename d7/db/d11/l9c to d7/db/d11/db5/df0/l10b 0 2024-09-13T17:05:57.818 INFO:tasks.workunit.client.1.smithi195.stdout:0/868: symlink d7/d87/d9b/d56/da6/l10c 0 2024-09-13T17:05:57.822 INFO:tasks.workunit.client.0.smithi115.stdout:4/701: read d7/dd/de/d4e/f62 [5176386,72452] 0 2024-09-13T17:05:57.822 INFO:tasks.workunit.client.0.smithi115.stdout:4/702: write d7/dd/d3c/d72/f95 [471188,90650] 0 2024-09-13T17:05:57.825 INFO:tasks.workunit.client.1.smithi195.stdout:6/814: read d1c/df0/db9/d8c/fee [147557,121670] 0 2024-09-13T17:05:57.827 INFO:tasks.workunit.client.1.smithi195.stdout:9/987: dread d6/d19/d21/d45/f5a [0,4194304] 0 2024-09-13T17:05:57.827 INFO:tasks.workunit.client.1.smithi195.stdout:6/815: mknod d1c/d24/d49/d5f/d85/d8f/c10c 0 2024-09-13T17:05:57.827 INFO:tasks.workunit.client.0.smithi115.stdout:8/663: write d0/d21/d76/fa4 [2998153,86611] 0 2024-09-13T17:05:57.828 INFO:tasks.workunit.client.1.smithi195.stdout:9/988: truncate d6/d12/d39/f89 2220197 0 2024-09-13T17:05:57.830 INFO:tasks.workunit.client.1.smithi195.stdout:6/816: creat d1c/d24/d49/d5f/d85/d8f/f10d x:0 0 0 2024-09-13T17:05:57.830 INFO:tasks.workunit.client.1.smithi195.stdout:6/817: write d1c/d24/f51 [4584800,32083] 0 2024-09-13T17:05:57.830 INFO:tasks.workunit.client.1.smithi195.stdout:6/818: write d1c/df0/db9/d8c/dd1/fff [896761,95372] 0 2024-09-13T17:05:57.831 INFO:tasks.workunit.client.1.smithi195.stdout:5/946: dwrite d2/df/d90/dbb/dec/d10a/f12e [0,4194304] 0 2024-09-13T17:05:57.831 INFO:tasks.workunit.client.1.smithi195.stdout:5/947: truncate d2/df/d78/d76/f8d 4774444 0 2024-09-13T17:05:57.831 INFO:tasks.workunit.client.0.smithi115.stdout:8/664: truncate d0/d21/fcc 2553323 0 2024-09-13T17:05:57.833 INFO:tasks.workunit.client.0.smithi115.stdout:8/665: symlink d0/d21/d3a/d60/dc6/le0 0 2024-09-13T17:05:57.833 INFO:tasks.workunit.client.0.smithi115.stdout:9/479: dwrite d0/f31 [0,4194304] 0 2024-09-13T17:05:57.833 INFO:tasks.workunit.client.0.smithi115.stdout:3/840: dwrite d1/d12/d14/fbe [0,4194304] 0 2024-09-13T17:05:57.833 INFO:tasks.workunit.client.0.smithi115.stdout:9/480: write d0/de/f89 [722855,100427] 0 2024-09-13T17:05:57.839 INFO:tasks.workunit.client.1.smithi195.stdout:2/902: dwrite d0/d4a/d47/d73/d75/d88/d2c/f8d [0,4194304] 0 2024-09-13T17:05:57.840 INFO:tasks.workunit.client.1.smithi195.stdout:0/869: read d7/db/f81 [1520532,116578] 0 2024-09-13T17:05:57.841 INFO:tasks.workunit.client.0.smithi115.stdout:6/642: dwrite d8/d33/d40/d67/db4/d24/f1e [0,4194304] 0 2024-09-13T17:05:57.841 INFO:tasks.workunit.client.0.smithi115.stdout:6/643: readlink d8/db/d1d/l72 0 2024-09-13T17:05:57.850 INFO:tasks.workunit.client.0.smithi115.stdout:3/841: unlink d1/d83/f85 0 2024-09-13T17:05:57.850 INFO:tasks.workunit.client.0.smithi115.stdout:3/842: read d1/d12/d14/fad [1243253,123131] 0 2024-09-13T17:05:57.850 INFO:tasks.workunit.client.0.smithi115.stdout:3/843: dread - d1/d12/d14/d61/ff0 zero size 2024-09-13T17:05:57.852 INFO:tasks.workunit.client.0.smithi115.stdout:4/703: dwrite d7/dd/de/d4e/f91 [0,4194304] 0 2024-09-13T17:05:57.852 INFO:tasks.workunit.client.0.smithi115.stdout:4/704: fdatasync d7/dbe/f99 0 2024-09-13T17:05:57.853 INFO:tasks.workunit.client.0.smithi115.stdout:6/644: dread d8/d33/d40/d67/db4/d24/d53/f9c [0,4194304] 0 2024-09-13T17:05:57.853 INFO:tasks.workunit.client.0.smithi115.stdout:9/481: creat d0/de/d10/d15/fa3 x:0 0 0 2024-09-13T17:05:57.858 INFO:tasks.workunit.client.1.smithi195.stdout:0/870: link d7/d87/d9b/d56/d4d/le5 d7/d87/d9b/d56/d4d/d5e/dbb/l10d 0 2024-09-13T17:05:57.858 INFO:tasks.workunit.client.1.smithi195.stdout:0/871: stat d7/d87/d9b/d56/d46/fc2 0 2024-09-13T17:05:57.860 INFO:tasks.workunit.client.0.smithi115.stdout:9/482: creat d0/d21/d4f/fa4 x:0 0 0 2024-09-13T17:05:57.861 INFO:tasks.workunit.client.1.smithi195.stdout:0/872: mknod d7/db/dd9/df9/c10e 0 2024-09-13T17:05:57.863 INFO:tasks.workunit.client.1.smithi195.stdout:0/873: mkdir d7/d87/d9b/d56/d4d/d10f 0 2024-09-13T17:05:57.864 INFO:tasks.workunit.client.0.smithi115.stdout:8/666: write d0/d21/f55 [1597405,97934] 0 2024-09-13T17:05:57.864 INFO:tasks.workunit.client.0.smithi115.stdout:8/667: write d0/d26/d29/f38 [619637,66679] 0 2024-09-13T17:05:57.864 INFO:tasks.workunit.client.1.smithi195.stdout:8/958: sync 2024-09-13T17:05:57.865 INFO:tasks.workunit.client.1.smithi195.stdout:1/867: sync 2024-09-13T17:05:57.865 INFO:tasks.workunit.client.1.smithi195.stdout:1/868: write db/d58/fe4 [595894,44631] 0 2024-09-13T17:05:57.865 INFO:tasks.workunit.client.1.smithi195.stdout:1/869: truncate db/df/d4d/f9b 824585 0 2024-09-13T17:05:57.865 INFO:tasks.workunit.client.1.smithi195.stdout:1/870: truncate db/df/d51/d62/d70/fa5 1004355 0 2024-09-13T17:05:57.866 INFO:tasks.workunit.client.1.smithi195.stdout:1/871: symlink db/d19/d37/d46/d7e/de0/l122 0 2024-09-13T17:05:57.866 INFO:tasks.workunit.client.1.smithi195.stdout:1/872: fsync db/fa2 0 2024-09-13T17:05:57.867 INFO:tasks.workunit.client.0.smithi115.stdout:8/668: dread d0/d15/d44/f70 [0,4194304] 0 2024-09-13T17:05:57.867 INFO:tasks.workunit.client.0.smithi115.stdout:8/669: readlink d0/d26/l54 0 2024-09-13T17:05:57.868 INFO:tasks.workunit.client.1.smithi195.stdout:1/873: mknod db/df/d13/c123 0 2024-09-13T17:05:57.870 INFO:tasks.workunit.client.1.smithi195.stdout:6/819: dwrite d1c/df0/db9/d30/f5b [0,4194304] 0 2024-09-13T17:05:57.870 INFO:tasks.workunit.client.1.smithi195.stdout:6/820: dread - d1c/df0/feb zero size 2024-09-13T17:05:57.870 INFO:tasks.workunit.client.1.smithi195.stdout:6/821: write d1c/fa1 [2014998,59133] 0 2024-09-13T17:05:57.870 INFO:tasks.workunit.client.1.smithi195.stdout:1/874: getdents db/d60/d73 0 2024-09-13T17:05:57.870 INFO:tasks.workunit.client.1.smithi195.stdout:1/875: stat db/l3c 0 2024-09-13T17:05:57.872 INFO:tasks.workunit.client.1.smithi195.stdout:6/822: rename d1c/d3e/f87 to d1c/df0/db9/d30/d6f/f10e 0 2024-09-13T17:05:57.875 INFO:tasks.workunit.client.1.smithi195.stdout:1/876: rename db/d19/d5a/d66/d96/l106 to db/df/d4d/d67/dc6/l124 0 2024-09-13T17:05:57.876 INFO:tasks.workunit.client.1.smithi195.stdout:1/877: creat db/d19/d5a/d66/df2/d112/f125 x:0 0 0 2024-09-13T17:05:57.876 INFO:tasks.workunit.client.1.smithi195.stdout:1/878: creat db/df/d4d/d67/d11f/f126 x:0 0 0 2024-09-13T17:05:57.878 INFO:tasks.workunit.client.1.smithi195.stdout:1/879: creat db/d19/d5a/d66/d96/f127 x:0 0 0 2024-09-13T17:05:57.882 INFO:tasks.workunit.client.1.smithi195.stdout:0/874: dwrite d7/db/d38/d5d/ff7 [0,4194304] 0 2024-09-13T17:05:57.884 INFO:tasks.workunit.client.1.smithi195.stdout:5/948: dwrite d2/df/d78/deb/d4e/d10/d8f/dc9/f12a [0,4194304] 0 2024-09-13T17:05:57.885 INFO:tasks.workunit.client.1.smithi195.stdout:0/875: link d7/d87/d9b/d56/d4d/d9d/ld4 d7/d87/l110 0 2024-09-13T17:05:57.886 INFO:tasks.workunit.client.1.smithi195.stdout:6/823: write d1c/df0/db9/f32 [785595,103512] 0 2024-09-13T17:05:57.886 INFO:tasks.workunit.client.1.smithi195.stdout:6/824: write d1c/d24/d49/f100 [4187,883] 0 2024-09-13T17:05:57.886 INFO:tasks.workunit.client.1.smithi195.stdout:2/903: dwrite d0/f76 [0,4194304] 0 2024-09-13T17:05:57.887 INFO:tasks.workunit.client.0.smithi115.stdout:8/670: read d0/d15/d3e/f47 [1773327,71165] 0 2024-09-13T17:05:57.887 INFO:tasks.workunit.client.0.smithi115.stdout:8/671: fsync d0/d15/f1b 0 2024-09-13T17:05:57.887 INFO:tasks.workunit.client.0.smithi115.stdout:8/672: chown d0/d26/d29/d59/d7e/da7/c8e 91022 1 2024-09-13T17:05:57.888 INFO:tasks.workunit.client.0.smithi115.stdout:4/705: dwrite d7/dd/de/d4e/d5a/d4f/d53/fcf [0,4194304] 0 2024-09-13T17:05:57.888 INFO:tasks.workunit.client.0.smithi115.stdout:6/645: dwrite d8/d33/d82/d80/fa5 [4194304,4194304] 0 2024-09-13T17:05:57.889 INFO:tasks.workunit.client.1.smithi195.stdout:8/959: dwrite d0/d17/f9e [0,4194304] 0 2024-09-13T17:05:57.889 INFO:tasks.workunit.client.1.smithi195.stdout:8/960: dread - d0/d13/d52/f133 zero size 2024-09-13T17:05:57.889 INFO:tasks.workunit.client.1.smithi195.stdout:5/949: mknod d2/df/d78/d54/de5/c139 0 2024-09-13T17:05:57.891 INFO:tasks.workunit.client.1.smithi195.stdout:0/876: mknod d7/d87/d9b/d56/c111 0 2024-09-13T17:05:57.891 INFO:tasks.workunit.client.1.smithi195.stdout:8/961: dread d0/d13/fc6 [0,4194304] 0 2024-09-13T17:05:57.894 INFO:tasks.workunit.client.1.smithi195.stdout:6/825: truncate d1c/df0/db9/d30/fef 4039477 0 2024-09-13T17:05:57.897 INFO:tasks.workunit.client.1.smithi195.stdout:3/929: sync 2024-09-13T17:05:57.897 INFO:tasks.workunit.client.1.smithi195.stdout:7/954: sync 2024-09-13T17:05:57.897 INFO:tasks.workunit.client.1.smithi195.stdout:3/930: chown d7/d19/d10a/d123 0 1 2024-09-13T17:05:57.897 INFO:tasks.workunit.client.1.smithi195.stdout:7/955: dread - d5/db/d50/daa/fdd zero size 2024-09-13T17:05:57.897 INFO:tasks.workunit.client.1.smithi195.stdout:3/931: rename d7/d21/d2a to d7/d21/d2a/d35/d60/d64/d12b 22 2024-09-13T17:05:57.898 INFO:tasks.workunit.client.1.smithi195.stdout:3/932: write d7/d21/fe4 [578167,83548] 0 2024-09-13T17:05:57.898 INFO:tasks.workunit.client.1.smithi195.stdout:1/880: dwrite db/df/d13/fc2 [0,4194304] 0 2024-09-13T17:05:57.899 INFO:tasks.workunit.client.0.smithi115.stdout:4/706: link d7/dd/de/d4e/d6c/db0/fcc d7/dbe/fd8 0 2024-09-13T17:05:57.899 INFO:tasks.workunit.client.0.smithi115.stdout:4/707: write d7/f47 [960302,36322] 0 2024-09-13T17:05:57.903 INFO:tasks.workunit.client.0.smithi115.stdout:6/646: mkdir d8/db/d1d/dc5 0 2024-09-13T17:05:57.905 INFO:tasks.workunit.client.0.smithi115.stdout:8/673: getdents d0/d15 0 2024-09-13T17:05:57.905 INFO:tasks.workunit.client.0.smithi115.stdout:8/674: write d0/d26/d29/f2a [664908,86546] 0 2024-09-13T17:05:57.907 INFO:tasks.workunit.client.1.smithi195.stdout:5/950: mknod d2/df/d78/d54/de5/c13a 0 2024-09-13T17:05:57.909 INFO:tasks.workunit.client.1.smithi195.stdout:2/904: dwrite d0/d4a/d47/d73/d75/d7e/f100 [0,4194304] 0 2024-09-13T17:05:57.909 INFO:tasks.workunit.client.1.smithi195.stdout:5/951: read d2/df/d78/deb/d3f/d7b/fda [205577,6268] 0 2024-09-13T17:05:57.909 INFO:tasks.workunit.client.1.smithi195.stdout:8/962: dwrite d0/d13/d52/d55/f95 [0,4194304] 0 2024-09-13T17:05:57.910 INFO:tasks.workunit.client.1.smithi195.stdout:0/877: creat d7/db/d38/d5d/f112 x:0 0 0 2024-09-13T17:05:57.913 INFO:tasks.workunit.client.1.smithi195.stdout:7/956: mkdir d5/db/d50/d7f/d82/dcc/d14f 0 2024-09-13T17:05:57.914 INFO:tasks.workunit.client.1.smithi195.stdout:3/933: mknod d7/d21/d2a/d35/d60/d6f/d74/c12c 0 2024-09-13T17:05:57.917 INFO:tasks.workunit.client.0.smithi115.stdout:4/708: link d7/dd/d3c/d7b/ld0 d7/dd/d3c/d74/d8b/dd2/ld9 0 2024-09-13T17:05:57.917 INFO:tasks.workunit.client.1.smithi195.stdout:1/881: mkdir db/d19/d5a/db0/d128 0 2024-09-13T17:05:57.918 INFO:tasks.workunit.client.1.smithi195.stdout:1/882: chown db/d58/caa 1367374 1 2024-09-13T17:05:57.918 INFO:tasks.workunit.client.0.smithi115.stdout:6/647: mknod d8/d33/d40/d67/db4/d24/d17/d9b/cc6 0 2024-09-13T17:05:57.921 INFO:tasks.workunit.client.0.smithi115.stdout:8/675: dwrite d0/d21/d76/d83/fab [0,4194304] 0 2024-09-13T17:05:57.922 INFO:tasks.workunit.client.0.smithi115.stdout:8/676: dread - d0/d26/d29/d59/fd9 zero size 2024-09-13T17:05:57.922 INFO:tasks.workunit.client.0.smithi115.stdout:8/677: truncate d0/d26/f9b 1191324 0 2024-09-13T17:05:57.922 INFO:tasks.workunit.client.0.smithi115.stdout:8/678: fsync d0/d21/d76/d83/f88 0 2024-09-13T17:05:57.924 INFO:tasks.workunit.client.0.smithi115.stdout:4/709: mkdir d7/dd/d3c/d72/db3/dda 0 2024-09-13T17:05:57.924 INFO:tasks.workunit.client.0.smithi115.stdout:4/710: write d7/dd/de/d4e/d5a/d4f/d70/db6/fc6 [140331,40384] 0 2024-09-13T17:05:57.925 INFO:tasks.workunit.client.1.smithi195.stdout:2/905: symlink d0/d3/l113 0 2024-09-13T17:05:57.926 INFO:tasks.workunit.client.0.smithi115.stdout:8/679: creat d0/d21/d76/d83/d5a/fe1 x:0 0 0 2024-09-13T17:05:57.929 INFO:tasks.workunit.client.0.smithi115.stdout:4/711: link d7/dd/d3c/d72/ca7 d7/dd/de/cdb 0 2024-09-13T17:05:57.931 INFO:tasks.workunit.client.1.smithi195.stdout:5/952: rename d2/df/d78/deb/d4e/d10/d46/ff8 to d2/df/d78/deb/d4e/d10/d5c/de3/f13b 0 2024-09-13T17:05:57.932 INFO:tasks.workunit.client.0.smithi115.stdout:8/680: creat d0/d26/d29/d59/d7e/da7/d28/dcd/fe2 x:0 0 0 2024-09-13T17:05:57.935 INFO:tasks.workunit.client.0.smithi115.stdout:6/648: dwrite d8/d33/d40/d67/db4/f4f [0,4194304] 0 2024-09-13T17:05:57.935 INFO:tasks.workunit.client.0.smithi115.stdout:6/649: chown d8/d33/d40/d67/db4/d24/d53/d6a/fa4 392169 1 2024-09-13T17:05:57.935 INFO:tasks.workunit.client.1.smithi195.stdout:8/963: mkdir d0/d17/d2f/d7c/d4c/d9b/d143 0 2024-09-13T17:05:57.935 INFO:tasks.workunit.client.1.smithi195.stdout:8/964: read - d0/d17/d2f/d31/db4/dfc/f140 zero size 2024-09-13T17:05:57.936 INFO:tasks.workunit.client.0.smithi115.stdout:8/681: symlink d0/d18/d51/le3 0 2024-09-13T17:05:57.936 INFO:tasks.workunit.client.1.smithi195.stdout:2/906: dread d0/d4a/d47/d73/d75/d88/d8e/fdf [0,4194304] 0 2024-09-13T17:05:57.937 INFO:tasks.workunit.client.1.smithi195.stdout:0/878: symlink d7/d88/d23/dd5/l113 0 2024-09-13T17:05:57.937 INFO:tasks.workunit.client.1.smithi195.stdout:0/879: creat d7/d88/d23/d96/dd8/f114 x:0 0 0 2024-09-13T17:05:57.940 INFO:tasks.workunit.client.1.smithi195.stdout:7/957: truncate d5/db/f2c 4526241 0 2024-09-13T17:05:57.940 INFO:tasks.workunit.client.1.smithi195.stdout:7/958: readlink d5/d35/d37/l92 0 2024-09-13T17:05:57.942 INFO:tasks.workunit.client.1.smithi195.stdout:3/934: symlink d7/d19/l12d 0 2024-09-13T17:05:57.944 INFO:tasks.workunit.client.0.smithi115.stdout:6/650: link d8/d33/d40/d4c/f91 d8/d33/d40/d67/fc7 0 2024-09-13T17:05:57.947 INFO:tasks.workunit.client.0.smithi115.stdout:8/682: mkdir d0/d26/d29/de4 0 2024-09-13T17:05:57.947 INFO:tasks.workunit.client.1.smithi195.stdout:1/883: rename db/d19/d5a/d66/d96/fed to db/d11e/f129 0 2024-09-13T17:05:57.948 INFO:tasks.workunit.client.1.smithi195.stdout:5/953: link d2/d3e/l53 d2/df/d48/d5a/dc5/l13c 0 2024-09-13T17:05:57.949 INFO:tasks.workunit.client.0.smithi115.stdout:6/651: symlink d8/d33/d82/lc8 0 2024-09-13T17:05:57.949 INFO:tasks.workunit.client.0.smithi115.stdout:6/652: fdatasync d8/d33/d40/d67/db4/f4f 0 2024-09-13T17:05:57.949 INFO:tasks.workunit.client.0.smithi115.stdout:4/712: rmdir d7/dd/d3c/d72/db3 39 2024-09-13T17:05:57.950 INFO:tasks.workunit.client.1.smithi195.stdout:8/965: dwrite d0/d17/d2f/d7c/d4c/fa0 [0,4194304] 0 2024-09-13T17:05:57.950 INFO:tasks.workunit.client.1.smithi195.stdout:8/966: read d0/d17/d2f/d31/d101/d63/d71/de8/df6/df1/ff5 [502895,103153] 0 2024-09-13T17:05:57.951 INFO:tasks.workunit.client.0.smithi115.stdout:8/683: readlink d0/l8 0 2024-09-13T17:05:57.952 INFO:tasks.workunit.client.1.smithi195.stdout:8/967: dread d0/d17/d2f/d7c/d4c/d119/f13d [0,4194304] 0 2024-09-13T17:05:57.952 INFO:tasks.workunit.client.1.smithi195.stdout:8/968: write d0/d17/d2f/d7c/d4c/d9b/fc8 [942849,94431] 0 2024-09-13T17:05:57.954 INFO:tasks.workunit.client.0.smithi115.stdout:0/419: sync 2024-09-13T17:05:57.955 INFO:tasks.workunit.client.0.smithi115.stdout:6/653: mkdir d8/d33/d40/d67/db4/dc9 0 2024-09-13T17:05:57.956 INFO:tasks.workunit.client.1.smithi195.stdout:0/880: dwrite d7/db/fdf [0,4194304] 0 2024-09-13T17:05:57.956 INFO:tasks.workunit.client.1.smithi195.stdout:0/881: write d7/d87/d9b/d56/d46/da4/fac [516568,101064] 0 2024-09-13T17:05:57.958 INFO:tasks.workunit.client.1.smithi195.stdout:7/959: truncate d5/db/d50/d7f/fcd 39881 0 2024-09-13T17:05:57.962 INFO:tasks.workunit.client.0.smithi115.stdout:6/654: symlink d8/d33/d40/d67/db4/d24/d53/d6a/lca 0 2024-09-13T17:05:57.965 INFO:tasks.workunit.client.1.smithi195.stdout:1/884: creat db/df/d4d/d67/dd8/f12a x:0 0 0 2024-09-13T17:05:57.969 INFO:tasks.workunit.client.1.smithi195.stdout:2/907: mknod d0/c114 0 2024-09-13T17:05:57.973 INFO:tasks.workunit.client.1.smithi195.stdout:2/908: symlink d0/d4a/d47/d73/d75/l115 0 2024-09-13T17:05:57.975 INFO:tasks.workunit.client.1.smithi195.stdout:1/885: truncate db/d19/d37/f8a 969695 0 2024-09-13T17:05:57.976 INFO:tasks.workunit.client.1.smithi195.stdout:2/909: link d0/d4a/d47/d73/d75/d88/d1e/dd0/ld6 d0/d4a/d47/d73/d75/d88/d1e/dd0/l116 0 2024-09-13T17:05:57.977 INFO:tasks.workunit.client.1.smithi195.stdout:2/910: mknod d0/d4a/d47/d73/d75/d88/d2c/d43/c117 0 2024-09-13T17:05:57.978 INFO:tasks.workunit.client.1.smithi195.stdout:2/911: readlink d0/d4a/d47/d73/d75/l115 0 2024-09-13T17:05:57.978 INFO:tasks.workunit.client.1.smithi195.stdout:7/960: dread d5/d13/d30/fd0 [0,4194304] 0 2024-09-13T17:05:57.979 INFO:tasks.workunit.client.1.smithi195.stdout:2/912: creat d0/d4a/d47/d73/d75/d88/d2c/df6/df9/f118 x:0 0 0 2024-09-13T17:05:57.979 INFO:tasks.workunit.client.1.smithi195.stdout:2/913: fdatasync d0/d4a/d47/d73/d75/f77 0 2024-09-13T17:05:57.979 INFO:tasks.workunit.client.1.smithi195.stdout:2/914: fdatasync d0/d4a/d47/d73/d75/d88/d2c/df6/df9/fdb 0 2024-09-13T17:05:57.980 INFO:tasks.workunit.client.1.smithi195.stdout:7/961: rmdir d5/db/d50/d7f/d82/dad 39 2024-09-13T17:05:57.980 INFO:tasks.workunit.client.1.smithi195.stdout:7/962: write d5/d13/d30/f7a [76179,65002] 0 2024-09-13T17:05:57.980 INFO:tasks.workunit.client.1.smithi195.stdout:7/963: chown d5/db/d19/d22/fc3 127215280 1 2024-09-13T17:05:57.980 INFO:tasks.workunit.client.1.smithi195.stdout:2/915: creat d0/d4a/d47/d73/d75/d88/d1e/f119 x:0 0 0 2024-09-13T17:05:57.981 INFO:tasks.workunit.client.1.smithi195.stdout:2/916: read d0/d4a/d47/d73/f7c [15013,116921] 0 2024-09-13T17:05:57.982 INFO:tasks.workunit.client.1.smithi195.stdout:7/964: rename d5/d13/d24/d13f/l149 to d5/d13/da8/df9/l150 0 2024-09-13T17:05:57.982 INFO:tasks.workunit.client.1.smithi195.stdout:7/965: creat d5/d13/f151 x:0 0 0 2024-09-13T17:05:57.982 INFO:tasks.workunit.client.1.smithi195.stdout:2/917: creat d0/f11a x:0 0 0 2024-09-13T17:05:57.984 INFO:tasks.workunit.client.1.smithi195.stdout:7/966: unlink d5/db/f2c 0 2024-09-13T17:05:57.984 INFO:tasks.workunit.client.1.smithi195.stdout:7/967: fsync d5/d13/f9c 0 2024-09-13T17:05:57.984 INFO:tasks.workunit.client.1.smithi195.stdout:2/918: mkdir d0/d4a/d47/d73/d75/d88/d2c/d43/d84/dac/d11b 0 2024-09-13T17:05:57.984 INFO:tasks.workunit.client.1.smithi195.stdout:2/919: write d0/d4a/d47/d73/d75/d88/d2c/d43/d84/dac/fc7 [580244,105779] 0 2024-09-13T17:05:57.985 INFO:tasks.workunit.client.1.smithi195.stdout:2/920: stat d0/d4a/d47/d73/d75/d7e/f100 0 2024-09-13T17:05:57.985 INFO:tasks.workunit.client.1.smithi195.stdout:2/921: readlink d0/d4a/d47/d73/d75/d88/d2c/d51/l90 0 2024-09-13T17:05:57.985 INFO:tasks.workunit.client.1.smithi195.stdout:7/968: symlink d5/db/d50/daa/l152 0 2024-09-13T17:05:57.986 INFO:tasks.workunit.client.1.smithi195.stdout:2/922: getdents d0/d4a/d47/d73/d75/d88 0 2024-09-13T17:05:57.986 INFO:tasks.workunit.client.1.smithi195.stdout:2/923: write d0/d3/d3d/f50 [4731267,21262] 0 2024-09-13T17:05:57.987 INFO:tasks.workunit.client.1.smithi195.stdout:3/935: dwrite d7/d21/d66/d7e/fec [0,4194304] 0 2024-09-13T17:05:57.988 INFO:tasks.workunit.client.1.smithi195.stdout:7/969: getdents d5/db/d50/d7f/d82/dad/df0 0 2024-09-13T17:05:57.988 INFO:tasks.workunit.client.1.smithi195.stdout:2/924: unlink d0/d4a/d47/d73/lca 0 2024-09-13T17:05:57.992 INFO:tasks.workunit.client.1.smithi195.stdout:7/970: creat d5/db/d19/d22/d90/f153 x:0 0 0 2024-09-13T17:05:57.993 INFO:tasks.workunit.client.1.smithi195.stdout:7/971: write d5/d13/d24/fba [911231,114868] 0 2024-09-13T17:05:57.993 INFO:tasks.workunit.client.1.smithi195.stdout:7/972: chown d5/d13/l71 222830 1 2024-09-13T17:05:57.997 INFO:tasks.workunit.client.1.smithi195.stdout:5/954: dwrite d2/df/fa [0,4194304] 0 2024-09-13T17:05:57.997 INFO:tasks.workunit.client.1.smithi195.stdout:5/955: write d2/df/d90/db2/fd9 [724464,92172] 0 2024-09-13T17:05:57.998 INFO:tasks.workunit.client.1.smithi195.stdout:1/886: dwrite db/df/f39 [0,4194304] 0 2024-09-13T17:05:57.998 INFO:tasks.workunit.client.1.smithi195.stdout:1/887: stat db/ccf 0 2024-09-13T17:05:57.998 INFO:tasks.workunit.client.1.smithi195.stdout:1/888: write db/df/d4d/f52 [4901203,99609] 0 2024-09-13T17:05:57.999 INFO:tasks.workunit.client.0.smithi115.stdout:8/684: dwrite d0/d26/d29/f2a [0,4194304] 0 2024-09-13T17:05:57.999 INFO:tasks.workunit.client.0.smithi115.stdout:8/685: write d0/d26/d29/d59/d7e/da7/fdf [311148,69990] 0 2024-09-13T17:05:57.999 INFO:tasks.workunit.client.1.smithi195.stdout:7/973: dread d5/db/d50/d7f/d82/f8b [0,4194304] 0 2024-09-13T17:05:58.000 INFO:tasks.workunit.client.1.smithi195.stdout:5/956: mkdir d2/d13d 0 2024-09-13T17:05:58.000 INFO:tasks.workunit.client.0.smithi115.stdout:4/713: dwrite d7/dd/de/f3a [0,4194304] 0 2024-09-13T17:05:58.001 INFO:tasks.workunit.client.0.smithi115.stdout:0/420: dwrite d9/f5f [0,4194304] 0 2024-09-13T17:05:58.001 INFO:tasks.workunit.client.0.smithi115.stdout:0/421: fsync d9/d1d/d24/f25 0 2024-09-13T17:05:58.001 INFO:tasks.workunit.client.0.smithi115.stdout:0/422: stat d9/d1d/d24/d26/d36/d48/f68 0 2024-09-13T17:05:58.001 INFO:tasks.workunit.client.0.smithi115.stdout:4/714: write d7/dd/d3c/d74/d8b/fb9 [479653,32909] 0 2024-09-13T17:05:58.001 INFO:tasks.workunit.client.0.smithi115.stdout:4/715: chown d7/dd/de/d4e/d5a/d4f/d70/fb5 34288 1 2024-09-13T17:05:58.001 INFO:tasks.workunit.client.0.smithi115.stdout:4/716: write d7/dd/de/d4e/f92 [2333256,88000] 0 2024-09-13T17:05:58.001 INFO:tasks.workunit.client.0.smithi115.stdout:8/686: dread d0/d26/d29/d59/d7e/da7/d28/fc4 [0,4194304] 0 2024-09-13T17:05:58.003 INFO:tasks.workunit.client.1.smithi195.stdout:0/882: dwrite d7/d87/d9b/d4e/d68/f79 [0,4194304] 0 2024-09-13T17:05:58.013 INFO:tasks.workunit.client.0.smithi115.stdout:8/687: link d0/d21/d76/d83/d5a/ld2 d0/d26/d29/d59/d7e/da7/d2b/d3b/le5 0 2024-09-13T17:05:58.013 INFO:tasks.workunit.client.0.smithi115.stdout:4/717: dread d7/f29 [0,4194304] 0 2024-09-13T17:05:58.013 INFO:tasks.workunit.client.0.smithi115.stdout:4/718: chown d7/dd/de/d4e/d5a/d4f/d70/db6/fc6 15731043 1 2024-09-13T17:05:58.015 INFO:tasks.workunit.client.1.smithi195.stdout:1/889: mknod db/df/d4d/c12b 0 2024-09-13T17:05:58.017 INFO:tasks.workunit.client.1.smithi195.stdout:5/957: stat d2/df/d78/c6f 0 2024-09-13T17:05:58.017 INFO:tasks.workunit.client.0.smithi115.stdout:4/719: dread d7/dd/d3c/d7b/f9a [0,4194304] 0 2024-09-13T17:05:58.022 INFO:tasks.workunit.client.1.smithi195.stdout:0/883: creat d7/d87/d9b/d56/d46/da4/f115 x:0 0 0 2024-09-13T17:05:58.025 INFO:tasks.workunit.client.1.smithi195.stdout:5/958: getdents d2/df/d78/deb/d4e/d10/d5c/de3 0 2024-09-13T17:05:58.027 INFO:tasks.workunit.client.1.smithi195.stdout:0/884: rename d7/db/f7a to d7/db/dd9/df9/f116 0 2024-09-13T17:05:58.030 INFO:tasks.workunit.client.1.smithi195.stdout:5/959: mknod d2/df/d78/c13e 0 2024-09-13T17:05:58.031 INFO:tasks.workunit.client.0.smithi115.stdout:0/423: getdents d9/d1b 0 2024-09-13T17:05:58.031 INFO:tasks.workunit.client.0.smithi115.stdout:0/424: fdatasync d9/f17 0 2024-09-13T17:05:58.033 INFO:tasks.workunit.client.0.smithi115.stdout:8/688: unlink d0/d26/d29/d59/d7e/da7/d28/la8 0 2024-09-13T17:05:58.034 INFO:tasks.workunit.client.1.smithi195.stdout:5/960: mknod d2/df/d62/d137/c13f 0 2024-09-13T17:05:58.034 INFO:tasks.workunit.client.1.smithi195.stdout:5/961: truncate d2/df/d78/deb/d4e/d10/d46/f103 978792 0 2024-09-13T17:05:58.037 INFO:tasks.workunit.client.0.smithi115.stdout:0/425: mknod d9/d1d/d24/d26/d36/d48/c7a 0 2024-09-13T17:05:58.038 INFO:tasks.workunit.client.0.smithi115.stdout:8/689: creat d0/d21/d76/fe6 x:0 0 0 2024-09-13T17:05:58.039 INFO:tasks.workunit.client.0.smithi115.stdout:0/426: unlink d9/d27/c44 0 2024-09-13T17:05:58.041 INFO:tasks.workunit.client.0.smithi115.stdout:0/427: mkdir d9/d1d/d24/d26/d7b 0 2024-09-13T17:05:58.042 INFO:tasks.workunit.client.1.smithi195.stdout:3/936: dwrite d7/f15 [0,4194304] 0 2024-09-13T17:05:58.042 INFO:tasks.workunit.client.1.smithi195.stdout:0/885: dread d7/d88/d23/f25 [0,4194304] 0 2024-09-13T17:05:58.042 INFO:tasks.workunit.client.1.smithi195.stdout:0/886: fdatasync d7/d87/d9b/d56/d4d/d5e/f71 0 2024-09-13T17:05:58.043 INFO:tasks.workunit.client.1.smithi195.stdout:7/974: dwrite d5/d13/d30/f8a [0,4194304] 0 2024-09-13T17:05:58.044 INFO:tasks.workunit.client.1.smithi195.stdout:3/937: dread d7/d62/d70/fb9 [0,4194304] 0 2024-09-13T17:05:58.044 INFO:tasks.workunit.client.1.smithi195.stdout:3/938: stat d7/d21/d2a/lcb 0 2024-09-13T17:05:58.044 INFO:tasks.workunit.client.1.smithi195.stdout:3/939: truncate d7/d21/d2a/d35/db7/dc2/f126 992058 0 2024-09-13T17:05:58.044 INFO:tasks.workunit.client.1.smithi195.stdout:3/940: chown d7/d21/f26 1480090613 1 2024-09-13T17:05:58.044 INFO:tasks.workunit.client.0.smithi115.stdout:0/428: rename d9/d1d/d24/d26/d2c/f59 to d9/d1d/d24/d26/d36/f7c 0 2024-09-13T17:05:58.044 INFO:tasks.workunit.client.0.smithi115.stdout:0/429: chown d9/d27/c4a 1825 1 2024-09-13T17:05:58.045 INFO:tasks.workunit.client.1.smithi195.stdout:1/890: dwrite db/df/d51/fd2 [0,4194304] 0 2024-09-13T17:05:58.045 INFO:tasks.workunit.client.1.smithi195.stdout:1/891: write db/df/d4d/d67/d11f/f126 [299389,105250] 0 2024-09-13T17:05:58.049 INFO:tasks.workunit.client.1.smithi195.stdout:0/887: unlink d7/db/d38/d5d/c84 0 2024-09-13T17:05:58.052 INFO:tasks.workunit.client.1.smithi195.stdout:3/941: truncate d7/d21/d66/d7e/fec 3039913 0 2024-09-13T17:05:58.052 INFO:tasks.workunit.client.1.smithi195.stdout:3/942: stat d7/d21/d2a/d35/d8f/f101 0 2024-09-13T17:05:58.053 INFO:tasks.workunit.client.1.smithi195.stdout:3/943: fsync d7/d21/d2a/d35/db7/dc2/f126 0 2024-09-13T17:05:58.055 INFO:tasks.workunit.client.1.smithi195.stdout:1/892: getdents db/d58/dae 0 2024-09-13T17:05:58.055 INFO:tasks.workunit.client.1.smithi195.stdout:1/893: truncate db/df/d51/d62/d70/fda 634855 0 2024-09-13T17:05:58.057 INFO:tasks.workunit.client.0.smithi115.stdout:4/720: dread d7/dd/de/f43 [0,4194304] 0 2024-09-13T17:05:58.058 INFO:tasks.workunit.client.1.smithi195.stdout:7/975: rename d5/l143 to d5/d13/d24/d70/dd5/l154 0 2024-09-13T17:05:58.059 INFO:tasks.workunit.client.1.smithi195.stdout:3/944: symlink d7/d21/d2a/de9/l12e 0 2024-09-13T17:05:58.060 INFO:tasks.workunit.client.1.smithi195.stdout:7/976: symlink d5/db/d19/d22/d90/d127/d131/l155 0 2024-09-13T17:05:58.063 INFO:tasks.workunit.client.1.smithi195.stdout:3/945: creat d7/d21/d2a/d35/d9c/dcf/ddb/f12f x:0 0 0 2024-09-13T17:05:58.063 INFO:tasks.workunit.client.1.smithi195.stdout:3/946: stat d7/d21/d2a/d35/d8f 0 2024-09-13T17:05:58.063 INFO:tasks.workunit.client.1.smithi195.stdout:9/989: sync 2024-09-13T17:05:58.064 INFO:tasks.workunit.client.1.smithi195.stdout:9/990: mkdir d6/d12/d86/da7/d142 0 2024-09-13T17:05:58.064 INFO:tasks.workunit.client.1.smithi195.stdout:9/991: readlink d6/d19/la9 0 2024-09-13T17:05:58.068 INFO:tasks.workunit.client.1.smithi195.stdout:9/992: rename d6/d12/d86/dd2/f129 to d6/df/d16/d65/f143 0 2024-09-13T17:05:58.068 INFO:tasks.workunit.client.1.smithi195.stdout:9/993: getdents d6/d19/d21/d45/dad/d5e/de7 0 2024-09-13T17:05:58.068 INFO:tasks.workunit.client.1.smithi195.stdout:9/994: chown d6/df/d16/de3/d68/d6d 109 1 2024-09-13T17:05:58.068 INFO:tasks.workunit.client.1.smithi195.stdout:9/995: chown d6/d12/f8a 9845414 1 2024-09-13T17:05:58.069 INFO:tasks.workunit.client.0.smithi115.stdout:8/690: dwrite d0/d21/d3a/d60/f78 [0,4194304] 0 2024-09-13T17:05:58.069 INFO:tasks.workunit.client.0.smithi115.stdout:8/691: dread - d0/d42/fd5 zero size 2024-09-13T17:05:58.070 INFO:tasks.workunit.client.1.smithi195.stdout:9/996: link d6/d19/d21/d45/f99 d6/df/d16/de3/d125/f144 0 2024-09-13T17:05:58.070 INFO:tasks.workunit.client.1.smithi195.stdout:9/997: fsync d6/d19/d21/d5b/f11d 0 2024-09-13T17:05:58.070 INFO:tasks.workunit.client.1.smithi195.stdout:9/998: write d6/d19/d21/d45/f99 [1587441,105745] 0 2024-09-13T17:05:58.070 INFO:tasks.workunit.client.1.smithi195.stdout:9/999: stat d6/df/d13/d8e/d12b 0 2024-09-13T17:05:58.071 INFO:tasks.workunit.client.0.smithi115.stdout:0/430: dwrite d9/d1d/d24/d26/d36/d48/f4c [0,4194304] 0 2024-09-13T17:05:58.072 INFO:tasks.workunit.client.0.smithi115.stdout:0/431: readlink d9/d1d/l2e 0 2024-09-13T17:05:58.072 INFO:tasks.workunit.client.0.smithi115.stdout:0/432: truncate d9/d1d/d24/d26/f64 113117 0 2024-09-13T17:05:58.072 INFO:tasks.workunit.client.0.smithi115.stdout:0/433: dread - d9/d1d/d24/d26/d2d/f79 zero size 2024-09-13T17:05:58.072 INFO:tasks.workunit.client.1.smithi195.stdout:5/962: getdents d2/df/d78 0 2024-09-13T17:05:58.073 INFO:tasks.workunit.client.1.smithi195.stdout:0/888: dwrite d7/d88/d23/f62 [0,4194304] 0 2024-09-13T17:05:58.074 INFO:tasks.workunit.client.0.smithi115.stdout:8/692: creat d0/d95/db6/fe7 x:0 0 0 2024-09-13T17:05:58.074 INFO:tasks.workunit.client.0.smithi115.stdout:8/693: chown d0/d26/d29/d59/d7e/da7/d2b 183984 1 2024-09-13T17:05:58.075 INFO:tasks.workunit.client.1.smithi195.stdout:1/894: dread db/f11 [0,4194304] 0 2024-09-13T17:05:58.076 INFO:tasks.workunit.client.0.smithi115.stdout:0/434: mkdir d9/d1d/d24/d7d 0 2024-09-13T17:05:58.078 INFO:tasks.workunit.client.0.smithi115.stdout:8/694: truncate d0/d21/fcc 3049704 0 2024-09-13T17:05:58.078 INFO:tasks.workunit.client.0.smithi115.stdout:8/695: dread - d0/d18/fb9 zero size 2024-09-13T17:05:58.078 INFO:tasks.workunit.client.0.smithi115.stdout:8/696: creat d0/d15/d3e/fe8 x:0 0 0 2024-09-13T17:05:58.078 INFO:tasks.workunit.client.0.smithi115.stdout:8/697: creat d0/d26/d29/d59/d7e/da7/fe9 x:0 0 0 2024-09-13T17:05:58.078 INFO:tasks.workunit.client.1.smithi195.stdout:3/947: dread d7/d19/d1e/f4c [0,4194304] 0 2024-09-13T17:05:58.079 INFO:tasks.workunit.client.1.smithi195.stdout:7/977: dwrite d5/db/d19/d22/f62 [0,4194304] 0 2024-09-13T17:05:58.086 INFO:tasks.workunit.client.0.smithi115.stdout:8/698: symlink d0/d26/d29/d59/d7e/lea 0 2024-09-13T17:05:58.086 INFO:tasks.workunit.client.1.smithi195.stdout:0/889: symlink d7/d50/da2/l117 0 2024-09-13T17:05:58.088 INFO:tasks.workunit.client.1.smithi195.stdout:1/895: mknod db/df/d4d/d67/dd8/c12c 0 2024-09-13T17:05:58.088 INFO:tasks.workunit.client.1.smithi195.stdout:1/896: chown db/d58 91 1 2024-09-13T17:05:58.088 INFO:tasks.workunit.client.1.smithi195.stdout:6/826: sync 2024-09-13T17:05:58.088 INFO:tasks.workunit.client.0.smithi115.stdout:8/699: symlink d0/d26/d29/d59/d7e/da1/dbd/leb 0 2024-09-13T17:05:58.089 INFO:tasks.workunit.client.1.smithi195.stdout:3/948: mknod d7/d21/d2a/d4a/d5a/c130 0 2024-09-13T17:05:58.089 INFO:tasks.workunit.client.1.smithi195.stdout:3/949: readlink d7/ldc 0 2024-09-13T17:05:58.091 INFO:tasks.workunit.client.0.smithi115.stdout:8/700: mknod d0/d42/cec 0 2024-09-13T17:05:58.092 INFO:tasks.workunit.client.1.smithi195.stdout:7/978: mknod d5/db/d50/d7f/d82/da1/c156 0 2024-09-13T17:05:58.093 INFO:tasks.workunit.client.0.smithi115.stdout:1/587: sync 2024-09-13T17:05:58.093 INFO:tasks.workunit.client.1.smithi195.stdout:0/890: mknod d7/d50/da1/c118 0 2024-09-13T17:05:58.094 INFO:tasks.workunit.client.0.smithi115.stdout:8/701: unlink d0/d18/d51/f5f 0 2024-09-13T17:05:58.095 INFO:tasks.workunit.client.1.smithi195.stdout:1/897: dread - db/d19/d37/fab zero size 2024-09-13T17:05:58.095 INFO:tasks.workunit.client.1.smithi195.stdout:1/898: truncate db/d19/d37/d3e/f4c 2409949 0 2024-09-13T17:05:58.095 INFO:tasks.workunit.client.1.smithi195.stdout:1/899: truncate db/d19/f79 2973273 0 2024-09-13T17:05:58.096 INFO:tasks.workunit.client.0.smithi115.stdout:1/588: symlink d5/d7/d33/d3a/db2/lcf 0 2024-09-13T17:05:58.097 INFO:tasks.workunit.client.1.smithi195.stdout:6/827: symlink d1c/d24/d49/d5f/db1/dcd/da9/l10f 0 2024-09-13T17:05:58.098 INFO:tasks.workunit.client.0.smithi115.stdout:2/821: sync 2024-09-13T17:05:58.098 INFO:tasks.workunit.client.0.smithi115.stdout:8/702: creat d0/d42/d80/fed x:0 0 0 2024-09-13T17:05:58.099 INFO:tasks.workunit.client.1.smithi195.stdout:6/828: dread d1c/d24/d49/d5f/d85/f9e [0,4194304] 0 2024-09-13T17:05:58.099 INFO:tasks.workunit.client.0.smithi115.stdout:0/435: dwrite d9/d1d/d24/d26/d2d/d30/f5a [0,4194304] 0 2024-09-13T17:05:58.099 INFO:tasks.workunit.client.0.smithi115.stdout:0/436: write d9/d1b/f3a [190224,125465] 0 2024-09-13T17:05:58.100 INFO:tasks.workunit.client.1.smithi195.stdout:3/950: rename d7/d21/d2a/d35/d60/d64/db3/dc4/dfd/l108 to d7/d21/d2a/d35/d60/d6f/l131 0 2024-09-13T17:05:58.101 INFO:tasks.workunit.client.1.smithi195.stdout:5/963: dwrite d2/d88/fa8 [0,4194304] 0 2024-09-13T17:05:58.102 INFO:tasks.workunit.client.0.smithi115.stdout:1/589: symlink d5/ld0 0 2024-09-13T17:05:58.102 INFO:tasks.workunit.client.0.smithi115.stdout:1/590: write d5/d7/d5c/faa [891490,112282] 0 2024-09-13T17:05:58.102 INFO:tasks.workunit.client.0.smithi115.stdout:1/591: chown d5/d60/d7d/d87/f9e 757912012 1 2024-09-13T17:05:58.102 INFO:tasks.workunit.client.0.smithi115.stdout:1/592: write d5/d7/d33/d3a/f57 [1756363,79655] 0 2024-09-13T17:05:58.102 INFO:tasks.workunit.client.0.smithi115.stdout:1/593: fdatasync d5/f6b 0 2024-09-13T17:05:58.103 INFO:tasks.workunit.client.1.smithi195.stdout:0/891: write d7/d87/d9b/d56/d46/f8a [867771,116705] 0 2024-09-13T17:05:58.104 INFO:tasks.workunit.client.0.smithi115.stdout:8/703: mkdir d0/d26/d29/d59/d7e/da7/dee 0 2024-09-13T17:05:58.107 INFO:tasks.workunit.client.1.smithi195.stdout:1/900: creat db/df/d4d/d67/d11d/f12d x:0 0 0 2024-09-13T17:05:58.107 INFO:tasks.workunit.client.1.smithi195.stdout:8/969: sync 2024-09-13T17:05:58.107 INFO:tasks.workunit.client.1.smithi195.stdout:7/979: dread d5/db/d19/d22/d3c/fa6 [0,4194304] 0 2024-09-13T17:05:58.107 INFO:tasks.workunit.client.1.smithi195.stdout:3/951: rename d7/d21/d2a/ca8 to d7/d21/d2a/d35/d9c/df6/c132 0 2024-09-13T17:05:58.107 INFO:tasks.workunit.client.1.smithi195.stdout:2/925: sync 2024-09-13T17:05:58.107 INFO:tasks.workunit.client.1.smithi195.stdout:2/926: fsync d0/f54 0 2024-09-13T17:05:58.110 INFO:tasks.workunit.client.0.smithi115.stdout:0/437: unlink d9/d1d/d24/d26/d2d/c43 0 2024-09-13T17:05:58.111 INFO:tasks.workunit.client.0.smithi115.stdout:0/438: fdatasync d9/d1d/f39 0 2024-09-13T17:05:58.113 INFO:tasks.workunit.client.0.smithi115.stdout:1/594: mknod d5/d7/d5c/dbc/cd1 0 2024-09-13T17:05:58.113 INFO:tasks.workunit.client.0.smithi115.stdout:1/595: dread - d5/fba zero size 2024-09-13T17:05:58.114 INFO:tasks.workunit.client.1.smithi195.stdout:5/964: mkdir d2/df/d90/db2/d140 0 2024-09-13T17:05:58.115 INFO:tasks.workunit.client.1.smithi195.stdout:5/965: chown d2/df/lfe 1 1 2024-09-13T17:05:58.115 INFO:tasks.workunit.client.0.smithi115.stdout:0/439: mkdir d9/d1d/d24/d7e 0 2024-09-13T17:05:58.115 INFO:tasks.workunit.client.0.smithi115.stdout:0/440: write d9/f1f [8001761,109052] 0 2024-09-13T17:05:58.115 INFO:tasks.workunit.client.0.smithi115.stdout:0/441: readlink d9/d1d/d24/d26/d2c/l58 0 2024-09-13T17:05:58.117 INFO:tasks.workunit.client.1.smithi195.stdout:2/927: dread d0/d4a/d47/d73/d75/d88/d2c/d43/d84/dac/fc7 [0,4194304] 0 2024-09-13T17:05:58.117 INFO:tasks.workunit.client.1.smithi195.stdout:8/970: unlink d0/d4/cc1 0 2024-09-13T17:05:58.117 INFO:tasks.workunit.client.0.smithi115.stdout:1/596: truncate d5/d26/d2c/f32 2505115 0 2024-09-13T17:05:58.120 INFO:tasks.workunit.client.1.smithi195.stdout:6/829: dwrite d1c/f23 [0,4194304] 0 2024-09-13T17:05:58.120 INFO:tasks.workunit.client.1.smithi195.stdout:6/830: truncate d1c/d24/d49/d5f/db1/d95/fc5 4610277 0 2024-09-13T17:05:58.120 INFO:tasks.workunit.client.1.smithi195.stdout:1/901: dread db/df/d4d/fdf [0,4194304] 0 2024-09-13T17:05:58.120 INFO:tasks.workunit.client.1.smithi195.stdout:7/980: truncate d5/fa 1775671 0 2024-09-13T17:05:58.121 INFO:tasks.workunit.client.0.smithi115.stdout:8/704: write d0/fb [3239301,121368] 0 2024-09-13T17:05:58.121 INFO:tasks.workunit.client.0.smithi115.stdout:8/705: dread - d0/d21/d76/fe6 zero size 2024-09-13T17:05:58.124 INFO:tasks.workunit.client.0.smithi115.stdout:0/442: unlink d9/d1d/d24/d26/d2c/f74 0 2024-09-13T17:05:58.126 INFO:tasks.workunit.client.1.smithi195.stdout:5/966: rename d2/df/d78/deb/d3f/l105 to d2/d13d/l141 0 2024-09-13T17:05:58.129 INFO:tasks.workunit.client.1.smithi195.stdout:2/928: link d0/d4a/d47/d73/d75/d88/d2c/d51/c37 d0/d4a/d47/dba/c11c 0 2024-09-13T17:05:58.130 INFO:tasks.workunit.client.0.smithi115.stdout:0/443: link d9/d1b/f34 d9/d1d/d24/d26/d2d/d78/f7f 0 2024-09-13T17:05:58.132 INFO:tasks.workunit.client.0.smithi115.stdout:1/597: getdents d5/d60/d8e 0 2024-09-13T17:05:58.132 INFO:tasks.workunit.client.0.smithi115.stdout:1/598: fdatasync d5/d3e/d59/fad 0 2024-09-13T17:05:58.133 INFO:tasks.workunit.client.1.smithi195.stdout:1/902: unlink db/df/d13/cb8 0 2024-09-13T17:05:58.135 INFO:tasks.workunit.client.1.smithi195.stdout:7/981: truncate d5/db/d19/d22/f5b 3829193 0 2024-09-13T17:05:58.135 INFO:tasks.workunit.client.1.smithi195.stdout:7/982: write d5/db/d50/d7f/d82/da1/f114 [937490,56228] 0 2024-09-13T17:05:58.136 INFO:tasks.workunit.client.0.smithi115.stdout:0/444: unlink d9/d1d/d24/d26/d2d/d30/d46/f5e 0 2024-09-13T17:05:58.138 INFO:tasks.workunit.client.1.smithi195.stdout:5/967: truncate d2/f7c 556389 0 2024-09-13T17:05:58.138 INFO:tasks.workunit.client.1.smithi195.stdout:5/968: truncate d2/df/d78/deb/d3f/dfa/f100 390788 0 2024-09-13T17:05:58.139 INFO:tasks.workunit.client.0.smithi115.stdout:1/599: dread d5/f95 [0,4194304] 0 2024-09-13T17:05:58.139 INFO:tasks.workunit.client.0.smithi115.stdout:1/600: creat d5/d7/d33/d3a/db2/fd2 x:0 0 0 2024-09-13T17:05:58.139 INFO:tasks.workunit.client.1.smithi195.stdout:5/969: write d2/df/d78/d54/fa7 [689455,98451] 0 2024-09-13T17:05:58.139 INFO:tasks.workunit.client.1.smithi195.stdout:5/970: write d2/df/d78/d76/d114/f12c [312146,36059] 0 2024-09-13T17:05:58.140 INFO:tasks.workunit.client.0.smithi115.stdout:0/445: symlink d9/d1d/d24/d26/d2d/d30/l80 0 2024-09-13T17:05:58.141 INFO:tasks.workunit.client.1.smithi195.stdout:3/952: dwrite d7/d21/d2a/d4a/fbe [4194304,4194304] 0 2024-09-13T17:05:58.141 INFO:tasks.workunit.client.1.smithi195.stdout:3/953: write d7/fde [150322,31434] 0 2024-09-13T17:05:58.142 INFO:tasks.workunit.client.1.smithi195.stdout:2/929: symlink d0/d4a/d47/d73/d75/d88/d2c/d43/d63/db2/db3/l11d 0 2024-09-13T17:05:58.142 INFO:tasks.workunit.client.1.smithi195.stdout:0/892: dwrite d7/d87/d9b/d4e/d86/f104 [0,4194304] 0 2024-09-13T17:05:58.142 INFO:tasks.workunit.client.1.smithi195.stdout:0/893: write d7/d87/d9b/d56/d46/da4/f115 [476949,123068] 0 2024-09-13T17:05:58.142 INFO:tasks.workunit.client.1.smithi195.stdout:0/894: read d7/db/d38/f3b [2237275,32195] 0 2024-09-13T17:05:58.143 INFO:tasks.workunit.client.0.smithi115.stdout:2/822: dwrite d3/d4d/de/d98/f9f [0,4194304] 0 2024-09-13T17:05:58.145 INFO:tasks.workunit.client.1.smithi195.stdout:1/903: mknod db/df/d4d/d74/da8/c12e 0 2024-09-13T17:05:58.145 INFO:tasks.workunit.client.0.smithi115.stdout:1/601: getdents d5/d7/d33/d3a/dc3 0 2024-09-13T17:05:58.147 INFO:tasks.workunit.client.1.smithi195.stdout:5/971: creat d2/d10e/f142 x:0 0 0 2024-09-13T17:05:58.150 INFO:tasks.workunit.client.0.smithi115.stdout:0/446: symlink d9/d1d/d24/d26/d5d/d66/l81 0 2024-09-13T17:05:58.152 INFO:tasks.workunit.client.1.smithi195.stdout:8/971: dwrite d0/d17/d2f/d31/d101/d63/d71/de8/f106 [0,4194304] 0 2024-09-13T17:05:58.152 INFO:tasks.workunit.client.1.smithi195.stdout:7/983: dwrite d5/db/d19/d22/f11b [0,4194304] 0 2024-09-13T17:05:58.152 INFO:tasks.workunit.client.1.smithi195.stdout:7/984: read d5/db/d50/d7f/fcd [27514,58763] 0 2024-09-13T17:05:58.153 INFO:tasks.workunit.client.1.smithi195.stdout:3/954: unlink l2 0 2024-09-13T17:05:58.156 INFO:tasks.workunit.client.1.smithi195.stdout:0/895: dread d7/db/d11/f61 [0,4194304] 0 2024-09-13T17:05:58.156 INFO:tasks.workunit.client.1.smithi195.stdout:0/896: fdatasync d7/f53 0 2024-09-13T17:05:58.156 INFO:tasks.workunit.client.1.smithi195.stdout:0/897: write d7/d87/d9b/d4e/d86/fe7 [278682,50182] 0 2024-09-13T17:05:58.161 INFO:tasks.workunit.client.1.smithi195.stdout:2/930: dwrite d0/f54 [0,4194304] 0 2024-09-13T17:05:58.161 INFO:tasks.workunit.client.1.smithi195.stdout:2/931: dread - d0/d4a/d47/d73/d75/d88/d2c/d43/d63/fce zero size 2024-09-13T17:05:58.161 INFO:tasks.workunit.client.1.smithi195.stdout:2/932: stat d0/d4a/d47/d73/d94/fc1 0 2024-09-13T17:05:58.169 INFO:tasks.workunit.client.0.smithi115.stdout:2/823: mknod d3/d4d/d13/d62/d92/dd7/d56/c105 0 2024-09-13T17:05:58.171 INFO:tasks.workunit.client.0.smithi115.stdout:1/602: creat d5/d60/d8e/fd3 x:0 0 0 2024-09-13T17:05:58.171 INFO:tasks.workunit.client.0.smithi115.stdout:1/603: fdatasync d5/d3e/d59/d96/fb4 0 2024-09-13T17:05:58.172 INFO:tasks.workunit.client.0.smithi115.stdout:0/447: rmdir d9/d1d/d24/d26/d36/d48 39 2024-09-13T17:05:58.176 INFO:tasks.workunit.client.0.smithi115.stdout:2/824: symlink d3/d4d/dd/df/d57/l106 0 2024-09-13T17:05:58.178 INFO:tasks.workunit.client.0.smithi115.stdout:1/604: mkdir d5/d7/d5c/dc6/dd4 0 2024-09-13T17:05:58.178 INFO:tasks.workunit.client.0.smithi115.stdout:1/605: stat d5/d7/d5c/dc6/dd4 0 2024-09-13T17:05:58.178 INFO:tasks.workunit.client.0.smithi115.stdout:1/606: write d5/d7/d33/f53 [966564,81331] 0 2024-09-13T17:05:58.180 INFO:tasks.workunit.client.0.smithi115.stdout:0/448: rename d9/d1d/c3c to d9/d1d/d24/c82 0 2024-09-13T17:05:58.181 INFO:tasks.workunit.client.1.smithi195.stdout:1/904: symlink db/d19/d37/d46/l12f 0 2024-09-13T17:05:58.182 INFO:tasks.workunit.client.1.smithi195.stdout:1/905: dread db/d19/d37/d46/d7e/f114 [0,4194304] 0 2024-09-13T17:05:58.182 INFO:tasks.workunit.client.1.smithi195.stdout:1/906: truncate db/d19/f4a 5217814 0 2024-09-13T17:05:58.182 INFO:tasks.workunit.client.1.smithi195.stdout:1/907: chown db/d19/d37/d3e/c9f 4690628 1 2024-09-13T17:05:58.185 INFO:tasks.workunit.client.0.smithi115.stdout:2/825: write d3/d4d/de/d99/d9a/df1/dfa/f5d [1835313,126909] 0 2024-09-13T17:05:58.185 INFO:tasks.workunit.client.0.smithi115.stdout:2/826: stat d3/d4d/de/d99/d9a/df1/dfa/f3b 0 2024-09-13T17:05:58.186 INFO:tasks.workunit.client.0.smithi115.stdout:1/607: unlink d5/d7/d5c/dab/fbe 0 2024-09-13T17:05:58.186 INFO:tasks.workunit.client.0.smithi115.stdout:1/608: creat d5/d60/d8e/fd5 x:0 0 0 2024-09-13T17:05:58.186 INFO:tasks.workunit.client.1.smithi195.stdout:1/908: dread db/df/d4d/d74/fbd [0,4194304] 0 2024-09-13T17:05:58.187 INFO:tasks.workunit.client.1.smithi195.stdout:8/972: rmdir d0/d17/d2f/d31/d101/d63/d71/de8/df6/df1 39 2024-09-13T17:05:58.187 INFO:tasks.workunit.client.1.smithi195.stdout:8/973: creat d0/d17/d2f/d31/d101/d63/d71/f144 x:0 0 0 2024-09-13T17:05:58.188 INFO:tasks.workunit.client.0.smithi115.stdout:0/449: mkdir d9/d1d/d24/d26/d5d/d66/d83 0 2024-09-13T17:05:58.191 INFO:tasks.workunit.client.0.smithi115.stdout:1/609: creat d5/d3e/da1/fd6 x:0 0 0 2024-09-13T17:05:58.193 INFO:tasks.workunit.client.1.smithi195.stdout:3/955: mkdir d7/d21/d2a/d35/d60/db0/d133 0 2024-09-13T17:05:58.196 INFO:tasks.workunit.client.0.smithi115.stdout:0/450: creat d9/d1d/d24/f84 x:0 0 0 2024-09-13T17:05:58.196 INFO:tasks.workunit.client.1.smithi195.stdout:8/974: dread d0/d17/d2f/d7c/ffb [0,4194304] 0 2024-09-13T17:05:58.197 INFO:tasks.workunit.client.0.smithi115.stdout:1/610: symlink d5/d26/d2c/ld7 0 2024-09-13T17:05:58.198 INFO:tasks.workunit.client.1.smithi195.stdout:2/933: truncate d0/d4a/d47/d73/d75/d88/d2c/d51/f81 2467727 0 2024-09-13T17:05:58.199 INFO:tasks.workunit.client.1.smithi195.stdout:2/934: creat d0/d4a/d47/d73/d75/d88/d62/dc5/f11e x:0 0 0 2024-09-13T17:05:58.199 INFO:tasks.workunit.client.1.smithi195.stdout:2/935: stat d0/d4a/d47/d73/lbb 0 2024-09-13T17:05:58.200 INFO:tasks.workunit.client.0.smithi115.stdout:1/611: rmdir d5/d7/d5c 39 2024-09-13T17:05:58.202 INFO:tasks.workunit.client.0.smithi115.stdout:1/612: mknod d5/cd8 0 2024-09-13T17:05:58.204 INFO:tasks.workunit.client.1.smithi195.stdout:5/972: rmdir d2/df/d78/deb/d4e 39 2024-09-13T17:05:58.205 INFO:tasks.workunit.client.0.smithi115.stdout:0/451: write d9/d1b/f61 [207717,67240] 0 2024-09-13T17:05:58.205 INFO:tasks.workunit.client.0.smithi115.stdout:0/452: chown d9 0 1 2024-09-13T17:05:58.205 INFO:tasks.workunit.client.0.smithi115.stdout:0/453: chown l4 1 1 2024-09-13T17:05:58.206 INFO:tasks.workunit.client.1.smithi195.stdout:1/909: mknod db/df/d4d/d67/d11d/c130 0 2024-09-13T17:05:58.209 INFO:tasks.workunit.client.1.smithi195.stdout:7/985: rename d5/db/d19/c2f to d5/db/d50/d11d/c157 0 2024-09-13T17:05:58.212 INFO:tasks.workunit.client.1.smithi195.stdout:3/956: mknod d7/d21/d2a/d35/d60/d6f/dbf/c134 0 2024-09-13T17:05:58.212 INFO:tasks.workunit.client.1.smithi195.stdout:3/957: creat d7/d21/d51/f135 x:0 0 0 2024-09-13T17:05:58.212 INFO:tasks.workunit.client.1.smithi195.stdout:3/958: chown d7/d21/d2a/d4a/d5a/fe3 43 1 2024-09-13T17:05:58.214 INFO:tasks.workunit.client.1.smithi195.stdout:2/936: creat d0/d4a/d47/d73/d75/d88/d2c/d43/d63/db2/f11f x:0 0 0 2024-09-13T17:05:58.216 INFO:tasks.workunit.client.0.smithi115.stdout:0/454: dread d9/d1b/f57 [0,4194304] 0 2024-09-13T17:05:58.218 INFO:tasks.workunit.client.1.smithi195.stdout:0/898: rename d7/d87/d9b/d56/db0/fd7 to d7/d88/d23/d96/dd8/f119 0 2024-09-13T17:05:58.218 INFO:tasks.workunit.client.1.smithi195.stdout:0/899: stat d7/d87/d9b/d56/fd3 0 2024-09-13T17:05:58.219 INFO:tasks.workunit.client.0.smithi115.stdout:1/613: dwrite d5/d7/fc0 [0,4194304] 0 2024-09-13T17:05:58.220 INFO:tasks.workunit.client.1.smithi195.stdout:7/986: unlink d5/d13/d24/fba 0 2024-09-13T17:05:58.220 INFO:tasks.workunit.client.1.smithi195.stdout:7/987: chown d5/d13/l71 15652 1 2024-09-13T17:05:58.221 INFO:tasks.workunit.client.0.smithi115.stdout:0/455: rmdir d9/d1d/d24/d7e 0 2024-09-13T17:05:58.221 INFO:tasks.workunit.client.0.smithi115.stdout:0/456: fdatasync d9/d1d/d24/f5b 0 2024-09-13T17:05:58.221 INFO:tasks.workunit.client.1.smithi195.stdout:1/910: dwrite db/df/d51/d62/d70/fda [0,4194304] 0 2024-09-13T17:05:58.222 INFO:tasks.workunit.client.1.smithi195.stdout:1/911: chown db/d19/d37/d46/d7e/lf5 24306 1 2024-09-13T17:05:58.225 INFO:tasks.workunit.client.1.smithi195.stdout:6/831: sync 2024-09-13T17:05:58.225 INFO:tasks.workunit.client.1.smithi195.stdout:6/832: fsync f17 0 2024-09-13T17:05:58.225 INFO:tasks.workunit.client.1.smithi195.stdout:6/833: chown d1c/d24/d49/d5f/d85/da5/lc9 0 1 2024-09-13T17:05:58.226 INFO:tasks.workunit.client.1.smithi195.stdout:7/988: write d5/f72 [351510,18057] 0 2024-09-13T17:05:58.226 INFO:tasks.workunit.client.0.smithi115.stdout:1/614: symlink d5/d26/d2c/ld9 0 2024-09-13T17:05:58.227 INFO:tasks.workunit.client.1.smithi195.stdout:3/959: rename d7/d21/d2a/d35/d60/d6f/d74/c12c to d7/d21/d2a/d35/d9c/df6/c136 0 2024-09-13T17:05:58.227 INFO:tasks.workunit.client.1.smithi195.stdout:3/960: chown d7/d21/d2a/d35/d9c/dcf/ddb 451 1 2024-09-13T17:05:58.228 INFO:tasks.workunit.client.0.smithi115.stdout:0/457: creat d9/d1d/d24/d26/d36/d48/f85 x:0 0 0 2024-09-13T17:05:58.229 INFO:tasks.workunit.client.1.smithi195.stdout:0/900: mknod d7/d87/d9b/d56/d4d/c11a 0 2024-09-13T17:05:58.229 INFO:tasks.workunit.client.1.smithi195.stdout:0/901: creat d7/d88/d23/d96/dd8/f11b x:0 0 0 2024-09-13T17:05:58.229 INFO:tasks.workunit.client.1.smithi195.stdout:0/902: readlink d7/db/d11/l33 0 2024-09-13T17:05:58.230 INFO:tasks.workunit.client.0.smithi115.stdout:1/615: mkdir d5/d7/d86/dda 0 2024-09-13T17:05:58.230 INFO:tasks.workunit.client.0.smithi115.stdout:1/616: chown d5/d3e/c66 69095126 1 2024-09-13T17:05:58.232 INFO:tasks.workunit.client.0.smithi115.stdout:0/458: symlink d9/d1d/d24/d26/l86 0 2024-09-13T17:05:58.232 INFO:tasks.workunit.client.0.smithi115.stdout:0/459: chown d9/d1d/d24/f84 1 1 2024-09-13T17:05:58.233 INFO:tasks.workunit.client.0.smithi115.stdout:1/617: rename d5/d60/d8e/fd5 to d5/d7/d33/d3a/dc3/fdb 0 2024-09-13T17:05:58.234 INFO:tasks.workunit.client.1.smithi195.stdout:1/912: symlink db/d19/d37/d3e/l131 0 2024-09-13T17:05:58.236 INFO:tasks.workunit.client.1.smithi195.stdout:0/903: write d7/db/d38/d5d/f8f [1364405,76730] 0 2024-09-13T17:05:58.236 INFO:tasks.workunit.client.0.smithi115.stdout:0/460: unlink d9/d1d/d24/d26/d36/d48/f68 0 2024-09-13T17:05:58.236 INFO:tasks.workunit.client.0.smithi115.stdout:0/461: getdents d9/d1d/d24/d26/d5d/d66/d83 0 2024-09-13T17:05:58.236 INFO:tasks.workunit.client.0.smithi115.stdout:0/462: creat d9/d1d/d24/d26/d5d/f87 x:0 0 0 2024-09-13T17:05:58.237 INFO:tasks.workunit.client.1.smithi195.stdout:2/937: getdents d0/d4a/d47/d73/d75/d88/d2c/d51 0 2024-09-13T17:05:58.239 INFO:tasks.workunit.client.0.smithi115.stdout:1/618: mknod d5/d7/d86/cdc 0 2024-09-13T17:05:58.239 INFO:tasks.workunit.client.0.smithi115.stdout:1/619: fsync d5/d7/f15 0 2024-09-13T17:05:58.239 INFO:tasks.workunit.client.0.smithi115.stdout:1/620: chown d5/d7/d33/d3a/db2/lcf 20 1 2024-09-13T17:05:58.240 INFO:tasks.workunit.client.1.smithi195.stdout:6/834: rmdir d1c/df0/db9/d8c/da7/dc6 39 2024-09-13T17:05:58.243 INFO:tasks.workunit.client.0.smithi115.stdout:1/621: dread d5/f95 [0,4194304] 0 2024-09-13T17:05:58.243 INFO:tasks.workunit.client.0.smithi115.stdout:0/463: mkdir d9/d27/d88 0 2024-09-13T17:05:58.245 INFO:tasks.workunit.client.1.smithi195.stdout:7/989: mknod d5/d35/d37/c158 0 2024-09-13T17:05:58.245 INFO:tasks.workunit.client.1.smithi195.stdout:7/990: stat d5/d35/d37 0 2024-09-13T17:05:58.246 INFO:tasks.workunit.client.0.smithi115.stdout:1/622: mkdir d5/d7/d33/d3a/dc3/ddd 0 2024-09-13T17:05:58.246 INFO:tasks.workunit.client.0.smithi115.stdout:1/623: chown d5/d3e/f92 996270 1 2024-09-13T17:05:58.247 INFO:tasks.workunit.client.0.smithi115.stdout:1/624: readlink d5/d7/d5c/dab/lb0 0 2024-09-13T17:05:58.247 INFO:tasks.workunit.client.0.smithi115.stdout:3/844: sync 2024-09-13T17:05:58.247 INFO:tasks.workunit.client.0.smithi115.stdout:7/598: sync 2024-09-13T17:05:58.248 INFO:tasks.workunit.client.1.smithi195.stdout:3/961: rename d7/lf to d7/d62/l137 0 2024-09-13T17:05:58.248 INFO:tasks.workunit.client.1.smithi195.stdout:3/962: stat d7/d21/d2a/d35/d60/d64/db3/dc4 0 2024-09-13T17:05:58.249 INFO:tasks.workunit.client.0.smithi115.stdout:5/589: sync 2024-09-13T17:05:58.249 INFO:tasks.workunit.client.0.smithi115.stdout:5/590: write d19/d2b/d32/d55/f5a [6223150,44136] 0 2024-09-13T17:05:58.249 INFO:tasks.workunit.client.0.smithi115.stdout:5/591: write d19/d2b/f49 [1457756,53590] 0 2024-09-13T17:05:58.249 INFO:tasks.workunit.client.0.smithi115.stdout:0/464: creat d9/d1b/f89 x:0 0 0 2024-09-13T17:05:58.250 INFO:tasks.workunit.client.1.smithi195.stdout:1/913: dwrite db/df/d13/f5b [0,4194304] 0 2024-09-13T17:05:58.250 INFO:tasks.workunit.client.0.smithi115.stdout:1/625: symlink d5/d26/lde 0 2024-09-13T17:05:58.251 INFO:tasks.workunit.client.0.smithi115.stdout:7/599: stat d0/d2/d1e/d3d/d6c/ca0 0 2024-09-13T17:05:58.254 INFO:tasks.workunit.client.0.smithi115.stdout:3/845: link d1/d4b/c3f d1/d4b/d1a/d30/dc5/c115 0 2024-09-13T17:05:58.256 INFO:tasks.workunit.client.1.smithi195.stdout:0/904: unlink d7/db/d9a/dde/l106 0 2024-09-13T17:05:58.257 INFO:tasks.workunit.client.0.smithi115.stdout:5/592: mknod d19/d2e/d6b/cc8 0 2024-09-13T17:05:58.258 INFO:tasks.workunit.client.0.smithi115.stdout:5/593: dread d19/d2b/d32/d55/d5e/d87/da4/fa9 [0,4194304] 0 2024-09-13T17:05:58.258 INFO:tasks.workunit.client.1.smithi195.stdout:2/938: mkdir d0/d4a/d47/d73/d75/d88/d2c/df6/d120 0 2024-09-13T17:05:58.259 INFO:tasks.workunit.client.1.smithi195.stdout:2/939: fsync d0/f45 0 2024-09-13T17:05:58.259 INFO:tasks.workunit.client.0.smithi115.stdout:0/465: link d9/d1d/d24/d26/d5d/f70 d9/d1d/d24/d26/d36/d48/f8a 0 2024-09-13T17:05:58.261 INFO:tasks.workunit.client.1.smithi195.stdout:6/835: mknod d1c/d24/d49/d5f/d35/c110 0 2024-09-13T17:05:58.264 INFO:tasks.workunit.client.1.smithi195.stdout:7/991: symlink d5/db/d19/d22/d90/dd4/d10d/l159 0 2024-09-13T17:05:58.264 INFO:tasks.workunit.client.0.smithi115.stdout:3/846: dread d1/f9 [0,4194304] 0 2024-09-13T17:05:58.265 INFO:tasks.workunit.client.1.smithi195.stdout:6/836: dread d1c/d24/d49/d5f/db1/dcd/fe2 [0,4194304] 0 2024-09-13T17:05:58.265 INFO:tasks.workunit.client.1.smithi195.stdout:3/963: symlink d7/d21/d2a/l138 0 2024-09-13T17:05:58.265 INFO:tasks.workunit.client.1.smithi195.stdout:3/964: readlink d7/d21/d2a/d35/d60/d6f/l9b 0 2024-09-13T17:05:58.269 INFO:tasks.workunit.client.0.smithi115.stdout:5/594: rename d19/d2b/c4d to d19/d2b/d69/d8f/cc9 0 2024-09-13T17:05:58.271 INFO:tasks.workunit.client.0.smithi115.stdout:7/600: rmdir d0/d51 39 2024-09-13T17:05:58.272 INFO:tasks.workunit.client.1.smithi195.stdout:1/914: truncate db/df/d13/fc2 3394565 0 2024-09-13T17:05:58.272 INFO:tasks.workunit.client.1.smithi195.stdout:1/915: fdatasync db/d19/d5a/d66/d7a/ff7 0 2024-09-13T17:05:58.274 INFO:tasks.workunit.client.0.smithi115.stdout:0/466: rename d9/d1d/d24/d26/d36/d48/f85 to d9/d1d/d24/d26/d2d/d78/f8b 0 2024-09-13T17:05:58.276 INFO:tasks.workunit.client.1.smithi195.stdout:0/905: creat d7/d88/d23/d96/ded/f11c x:0 0 0 2024-09-13T17:05:58.276 INFO:tasks.workunit.client.1.smithi195.stdout:2/940: dwrite d0/f24 [0,4194304] 0 2024-09-13T17:05:58.276 INFO:tasks.workunit.client.1.smithi195.stdout:2/941: fdatasync d0/d3/f26 0 2024-09-13T17:05:58.277 INFO:tasks.workunit.client.1.smithi195.stdout:2/942: read d0/d3/f26 [789211,124222] 0 2024-09-13T17:05:58.277 INFO:tasks.workunit.client.1.smithi195.stdout:2/943: chown d0/d3/f68 3744462 1 2024-09-13T17:05:58.278 INFO:tasks.workunit.client.1.smithi195.stdout:7/992: creat d5/db/d50/d7f/d82/da1/f15a x:0 0 0 2024-09-13T17:05:58.279 INFO:tasks.workunit.client.0.smithi115.stdout:5/595: write d19/d2e/f5c [2094041,44809] 0 2024-09-13T17:05:58.282 INFO:tasks.workunit.client.0.smithi115.stdout:3/847: rename d1/d4b/d1a/d105 to d1/d83/d9d/dba/d116 0 2024-09-13T17:05:58.285 INFO:tasks.workunit.client.1.smithi195.stdout:3/965: creat d7/d21/d2a/d35/d60/d64/db3/dc4/dfd/f139 x:0 0 0 2024-09-13T17:05:58.287 INFO:tasks.workunit.client.1.smithi195.stdout:0/906: mkdir d7/db/dd9/df9/d11d 0 2024-09-13T17:05:58.290 INFO:tasks.workunit.client.0.smithi115.stdout:3/848: rmdir d1/d4b/d69/d7b/d8b 39 2024-09-13T17:05:58.291 INFO:tasks.workunit.client.1.smithi195.stdout:3/966: chown d7/d5f/c118 47 1 2024-09-13T17:05:58.291 INFO:tasks.workunit.client.1.smithi195.stdout:3/967: dread - d7/d21/d2a/d35/d60/d6f/d74/ffa zero size 2024-09-13T17:05:58.291 INFO:tasks.workunit.client.1.smithi195.stdout:7/993: mknod d5/db/d19/d22/c15b 0 2024-09-13T17:05:58.292 INFO:tasks.workunit.client.0.smithi115.stdout:3/849: symlink d1/d4b/d69/d7b/l117 0 2024-09-13T17:05:58.293 INFO:tasks.workunit.client.1.smithi195.stdout:3/968: creat d7/d19/f13a x:0 0 0 2024-09-13T17:05:58.293 INFO:tasks.workunit.client.1.smithi195.stdout:3/969: chown d7/d19/d1e/laf 3193670 1 2024-09-13T17:05:58.294 INFO:tasks.workunit.client.1.smithi195.stdout:7/994: mkdir d5/db/d50/d7f/d82/dad/d15c 0 2024-09-13T17:05:58.296 INFO:tasks.workunit.client.1.smithi195.stdout:7/995: write d5/d13/f6a [686674,11713] 0 2024-09-13T17:05:58.296 INFO:tasks.workunit.client.1.smithi195.stdout:7/996: stat d5/db/d50/d7f/d10a/c10b 0 2024-09-13T17:05:58.296 INFO:tasks.workunit.client.1.smithi195.stdout:7/997: write d5/d35/dd2/f110 [509190,30511] 0 2024-09-13T17:05:58.297 INFO:tasks.workunit.client.1.smithi195.stdout:0/907: dread d7/db/d38/d5d/ff7 [0,4194304] 0 2024-09-13T17:05:58.297 INFO:tasks.workunit.client.1.smithi195.stdout:0/908: write d7/db/f34 [24597,4630] 0 2024-09-13T17:05:58.297 INFO:tasks.workunit.client.1.smithi195.stdout:0/909: write d7/d87/d9b/d56/d46/f49 [1284368,100246] 0 2024-09-13T17:05:58.303 INFO:tasks.workunit.client.1.smithi195.stdout:3/970: dread d7/d21/f4f [0,4194304] 0 2024-09-13T17:05:58.304 INFO:tasks.workunit.client.1.smithi195.stdout:3/971: creat d7/d21/d2a/d35/db7/f13b x:0 0 0 2024-09-13T17:05:58.304 INFO:tasks.workunit.client.1.smithi195.stdout:3/972: fsync d7/d21/d2a/d35/d60/f84 0 2024-09-13T17:05:58.304 INFO:tasks.workunit.client.1.smithi195.stdout:3/973: fdatasync d7/d19/fb2 0 2024-09-13T17:05:58.305 INFO:tasks.workunit.client.1.smithi195.stdout:3/974: fdatasync d7/d21/d2a/d4a/f6e 0 2024-09-13T17:05:58.305 INFO:tasks.workunit.client.1.smithi195.stdout:3/975: stat d7/d21/d2a/d35/d8f/c91 0 2024-09-13T17:05:58.305 INFO:tasks.workunit.client.1.smithi195.stdout:3/976: mkdir d7/d21/d2a/d4a/d5a/d13c 0 2024-09-13T17:05:58.306 INFO:tasks.workunit.client.0.smithi115.stdout:7/601: dwrite d0/d2/d1e/d3d/d7c/fb9 [4194304,4194304] 0 2024-09-13T17:05:58.306 INFO:tasks.workunit.client.1.smithi195.stdout:1/916: dwrite db/d58/f117 [0,4194304] 0 2024-09-13T17:05:58.307 INFO:tasks.workunit.client.0.smithi115.stdout:3/850: write d1/d4b/d69/fca [713341,30755] 0 2024-09-13T17:05:58.307 INFO:tasks.workunit.client.0.smithi115.stdout:0/467: dwrite d9/d1d/d24/d26/f64 [0,4194304] 0 2024-09-13T17:05:58.307 INFO:tasks.workunit.client.0.smithi115.stdout:3/851: chown d1/d83/fef 1368662510 1 2024-09-13T17:05:58.307 INFO:tasks.workunit.client.0.smithi115.stdout:3/852: fdatasync d1/d12/fbd 0 2024-09-13T17:05:58.307 INFO:tasks.workunit.client.0.smithi115.stdout:5/596: dwrite d19/d1d/f9a [0,4194304] 0 2024-09-13T17:05:58.308 INFO:tasks.workunit.client.0.smithi115.stdout:5/597: write d19/d21/f2a [2849118,4482] 0 2024-09-13T17:05:58.311 INFO:tasks.workunit.client.1.smithi195.stdout:0/910: write d7/f53 [5403491,96223] 0 2024-09-13T17:05:58.316 INFO:tasks.workunit.client.0.smithi115.stdout:0/468: stat d9/c1a 0 2024-09-13T17:05:58.316 INFO:tasks.workunit.client.1.smithi195.stdout:0/911: write d7/d50/f4c [48923,54499] 0 2024-09-13T17:05:58.316 INFO:tasks.workunit.client.1.smithi195.stdout:7/998: dwrite d5/db/d19/f5e [0,4194304] 0 2024-09-13T17:05:58.317 INFO:tasks.workunit.client.1.smithi195.stdout:0/912: stat d7/db/d38/d5d/f7f 0 2024-09-13T17:05:58.317 INFO:tasks.workunit.client.1.smithi195.stdout:7/999: chown d5/db/d19/d22/fe3 55671406 1 2024-09-13T17:05:58.317 INFO:tasks.workunit.client.1.smithi195.stdout:0/913: write d7/d87/d9b/d4e/d68/f105 [256202,48148] 0 2024-09-13T17:05:58.317 INFO:tasks.workunit.client.1.smithi195.stdout:0/914: readlink d7/d87/d9b/d56/da6/l10c 0 2024-09-13T17:05:58.317 INFO:tasks.workunit.client.1.smithi195.stdout:0/915: truncate d7/d87/d9b/d4e/f5b 8640110 0 2024-09-13T17:05:58.320 INFO:tasks.workunit.client.1.smithi195.stdout:8/975: sync 2024-09-13T17:05:58.320 INFO:tasks.workunit.client.1.smithi195.stdout:8/976: truncate d0/d17/d2f/d7c/d4c/d9a/da5/fd8 790817 0 2024-09-13T17:05:58.320 INFO:tasks.workunit.client.0.smithi115.stdout:5/598: symlink d19/d2b/d32/d55/d5e/d87/d86/lca 0 2024-09-13T17:05:58.322 INFO:tasks.workunit.client.1.smithi195.stdout:1/917: write db/df/f28 [3023737,83655] 0 2024-09-13T17:05:58.324 INFO:tasks.workunit.client.0.smithi115.stdout:5/599: symlink d19/d2b/d69/db6/lcb 0 2024-09-13T17:05:58.324 INFO:tasks.workunit.client.0.smithi115.stdout:7/602: dread d0/d2/d1e/d3d/d82/f2c [0,4194304] 0 2024-09-13T17:05:58.324 INFO:tasks.workunit.client.0.smithi115.stdout:7/603: chown d0/d2/d1e/d3d/d82/d44/dac 697106 1 2024-09-13T17:05:58.324 INFO:tasks.workunit.client.0.smithi115.stdout:7/604: readlink d0/d2/d1e/l38 0 2024-09-13T17:05:58.328 INFO:tasks.workunit.client.0.smithi115.stdout:7/605: creat d0/d3b/d50/d21/d99/fd9 x:0 0 0 2024-09-13T17:05:58.328 INFO:tasks.workunit.client.0.smithi115.stdout:7/606: stat d0/d2/d1e/d3d/d82/d44/dac/cd7 0 2024-09-13T17:05:58.329 INFO:tasks.workunit.client.1.smithi195.stdout:8/977: rmdir d0/d17/d2f/d31/d101/d63/db3/dc9 39 2024-09-13T17:05:58.333 INFO:tasks.workunit.client.0.smithi115.stdout:7/607: rmdir d0/d2/d67/d86/d94 39 2024-09-13T17:05:58.333 INFO:tasks.workunit.client.0.smithi115.stdout:7/608: chown d0/d2/d1e/d3d/d82/d44/dac/dbf/fd5 64278275 1 2024-09-13T17:05:58.335 INFO:tasks.workunit.client.0.smithi115.stdout:7/609: mknod d0/d3b/cda 0 2024-09-13T17:05:58.337 INFO:tasks.workunit.client.1.smithi195.stdout:8/978: link d0/d17/d2f/d31/d101/d63/d71/f12e d0/d17/d2f/d7c/d4c/d67/f145 0 2024-09-13T17:05:58.338 INFO:tasks.workunit.client.0.smithi115.stdout:7/610: symlink d0/d2/d4a/ldb 0 2024-09-13T17:05:58.338 INFO:tasks.workunit.client.0.smithi115.stdout:7/611: chown d0/f13 6549392 1 2024-09-13T17:05:58.340 INFO:tasks.workunit.client.0.smithi115.stdout:7/612: dread d0/d2/d67/d86/d94/f95 [0,4194304] 0 2024-09-13T17:05:58.342 INFO:tasks.workunit.client.0.smithi115.stdout:7/613: rename d0/d2/d1e/d3d/d82/d44/da7/lc5 to d0/d2/d1e/d3d/d82/d44/da7/ldc 0 2024-09-13T17:05:58.342 INFO:tasks.workunit.client.1.smithi195.stdout:3/977: dwrite d7/d21/d2a/fc8 [0,4194304] 0 2024-09-13T17:05:58.343 INFO:tasks.workunit.client.0.smithi115.stdout:7/614: mknod d0/d2/d67/d70/cdd 0 2024-09-13T17:05:58.344 INFO:tasks.workunit.client.0.smithi115.stdout:7/615: read d0/d2/d1e/d3d/d82/d44/f4f [320336,86205] 0 2024-09-13T17:05:58.344 INFO:tasks.workunit.client.0.smithi115.stdout:0/469: dwrite d9/d1d/d24/d26/d2d/f79 [0,4194304] 0 2024-09-13T17:05:58.345 INFO:tasks.workunit.client.0.smithi115.stdout:3/853: dwrite d1/fa [4194304,4194304] 0 2024-09-13T17:05:58.346 INFO:tasks.workunit.client.0.smithi115.stdout:7/616: mknod d0/d3b/d50/d21/cde 0 2024-09-13T17:05:58.346 INFO:tasks.workunit.client.0.smithi115.stdout:7/617: creat d0/d3b/d50/d21/d99/fdf x:0 0 0 2024-09-13T17:05:58.347 INFO:tasks.workunit.client.0.smithi115.stdout:7/618: chown d0/d3b/d50/d21/d2f/f5b 2129516 1 2024-09-13T17:05:58.347 INFO:tasks.workunit.client.0.smithi115.stdout:7/619: fsync d0/d2/d67/f84 0 2024-09-13T17:05:58.351 INFO:tasks.workunit.client.1.smithi195.stdout:3/978: read d7/d21/d2a/f2b [3423757,124566] 0 2024-09-13T17:05:58.352 INFO:tasks.workunit.client.1.smithi195.stdout:3/979: chown d7/d21/d2a/d35/d60/d6f/d74 12 1 2024-09-13T17:05:58.352 INFO:tasks.workunit.client.0.smithi115.stdout:3/854: symlink d1/d83/d114/l118 0 2024-09-13T17:05:58.352 INFO:tasks.workunit.client.0.smithi115.stdout:5/600: dwrite d19/d2c/f7e [0,4194304] 0 2024-09-13T17:05:58.354 INFO:tasks.workunit.client.0.smithi115.stdout:3/855: mknod d1/d4b/d1a/c119 0 2024-09-13T17:05:58.354 INFO:tasks.workunit.client.0.smithi115.stdout:3/856: write d1/d4b/d1a/d6e/dd9/f59 [2941430,57380] 0 2024-09-13T17:05:58.355 INFO:tasks.workunit.client.1.smithi195.stdout:1/918: dwrite db/d58/f117 [4194304,4194304] 0 2024-09-13T17:05:58.355 INFO:tasks.workunit.client.1.smithi195.stdout:3/980: getdents d7/d21/d2a/d35/d9c 0 2024-09-13T17:05:58.355 INFO:tasks.workunit.client.0.smithi115.stdout:3/857: creat d1/d4b/d69/d7b/da0/f11a x:0 0 0 2024-09-13T17:05:58.360 INFO:tasks.workunit.client.1.smithi195.stdout:1/919: unlink db/df/d4d/d74/da8/fbc 0 2024-09-13T17:05:58.361 INFO:tasks.workunit.client.0.smithi115.stdout:0/470: write d9/d1b/f3a [8247745,74349] 0 2024-09-13T17:05:58.362 INFO:tasks.workunit.client.1.smithi195.stdout:8/979: dwrite d0/d17/d2f/d31/d101/d63/d71/de8/f126 [0,4194304] 0 2024-09-13T17:05:58.362 INFO:tasks.workunit.client.1.smithi195.stdout:8/980: fsync d0/d62/f83 0 2024-09-13T17:05:58.365 INFO:tasks.workunit.client.1.smithi195.stdout:8/981: mknod d0/d17/d2f/d7c/d4c/d119/c146 0 2024-09-13T17:05:58.367 INFO:tasks.workunit.client.1.smithi195.stdout:8/982: link d0/d13/l134 d0/d17/d2f/d31/d101/d63/d71/de8/df6/l147 0 2024-09-13T17:05:58.369 INFO:tasks.workunit.client.1.smithi195.stdout:3/981: dread d7/d21/d2a/d35/d60/d6f/dbf/ff4 [0,4194304] 0 2024-09-13T17:05:58.369 INFO:tasks.workunit.client.1.smithi195.stdout:8/983: rename d0/d13/f16 to d0/d17/d2f/d31/d101/d63/d71/d13f/f148 0 2024-09-13T17:05:58.373 INFO:tasks.workunit.client.0.smithi115.stdout:7/620: dwrite d0/d3b/d50/d21/f33 [0,4194304] 0 2024-09-13T17:05:58.373 INFO:tasks.workunit.client.0.smithi115.stdout:7/621: stat d0/d2/d1e/d3d 0 2024-09-13T17:05:58.373 INFO:tasks.workunit.client.0.smithi115.stdout:7/622: chown d0/d2/d1e/d3d/d82/l74 2506 1 2024-09-13T17:05:58.373 INFO:tasks.workunit.client.0.smithi115.stdout:7/623: write d0/d2/d4a/fcb [881726,2414] 0 2024-09-13T17:05:58.374 INFO:tasks.workunit.client.1.smithi195.stdout:3/982: rename d7/d19/c58 to d7/d19/d1e/c13d 0 2024-09-13T17:05:58.375 INFO:tasks.workunit.client.1.smithi195.stdout:8/984: mknod d0/d17/d2f/d31/d101/d63/db3/df2/c149 0 2024-09-13T17:05:58.375 INFO:tasks.workunit.client.1.smithi195.stdout:8/985: write d0/d17/d2f/d7c/d4c/d9b/fc8 [1306160,66309] 0 2024-09-13T17:05:58.376 INFO:tasks.workunit.client.1.smithi195.stdout:3/983: mknod d7/d21/d2a/d35/d60/c13e 0 2024-09-13T17:05:58.377 INFO:tasks.workunit.client.1.smithi195.stdout:3/984: read d7/d21/d2a/d4a/d5a/fa5 [452465,47926] 0 2024-09-13T17:05:58.380 INFO:tasks.workunit.client.1.smithi195.stdout:8/986: rename d0/l5f to d0/d17/d2f/d7c/d4c/d119/l14a 0 2024-09-13T17:05:58.383 INFO:tasks.workunit.client.0.smithi115.stdout:7/624: mkdir d0/d2/d1e/d3d/d6c/de0 0 2024-09-13T17:05:58.383 INFO:tasks.workunit.client.0.smithi115.stdout:7/625: symlink d0/d2/d4a/le1 0 2024-09-13T17:05:58.384 INFO:tasks.workunit.client.0.smithi115.stdout:7/626: chown d0/c6 0 1 2024-09-13T17:05:58.384 INFO:tasks.workunit.client.0.smithi115.stdout:7/627: truncate d0/d2/d1e/d73/fbc 29910 0 2024-09-13T17:05:58.385 INFO:tasks.workunit.client.1.smithi195.stdout:1/920: dwrite db/df/d13/f27 [0,4194304] 0 2024-09-13T17:05:58.386 INFO:tasks.workunit.client.0.smithi115.stdout:5/601: dwrite d19/d21/d62/f68 [0,4194304] 0 2024-09-13T17:05:58.386 INFO:tasks.workunit.client.0.smithi115.stdout:0/471: dwrite d9/d1d/d24/d26/d2d/f79 [0,4194304] 0 2024-09-13T17:05:58.386 INFO:tasks.workunit.client.0.smithi115.stdout:0/472: write d9/d1d/d24/d26/f45 [3888147,12931] 0 2024-09-13T17:05:58.387 INFO:tasks.workunit.client.1.smithi195.stdout:1/921: creat db/d19/d5a/db0/d128/f132 x:0 0 0 2024-09-13T17:05:58.389 INFO:tasks.workunit.client.0.smithi115.stdout:5/602: mkdir d19/d21/dcc 0 2024-09-13T17:05:58.389 INFO:tasks.workunit.client.0.smithi115.stdout:5/603: fsync d19/d2c/f7e 0 2024-09-13T17:05:58.389 INFO:tasks.workunit.client.0.smithi115.stdout:5/604: dread - d19/d2b/d32/d55/d5e/d87/fa0 zero size 2024-09-13T17:05:58.390 INFO:tasks.workunit.client.0.smithi115.stdout:5/605: write d19/d2c/f7e [4921269,38277] 0 2024-09-13T17:05:58.390 INFO:tasks.workunit.client.0.smithi115.stdout:5/606: chown d19/d2b/d32/d55/d5e/lc2 66525 1 2024-09-13T17:05:58.390 INFO:tasks.workunit.client.0.smithi115.stdout:5/607: chown d19/d21/cc7 11 1 2024-09-13T17:05:58.390 INFO:tasks.workunit.client.0.smithi115.stdout:5/608: readlink d19/d2b/d32/d55/d5e/d87/d86/lca 0 2024-09-13T17:05:58.391 INFO:tasks.workunit.client.1.smithi195.stdout:8/987: write d0/d13/f5d [9140749,110629] 0 2024-09-13T17:05:58.391 INFO:tasks.workunit.client.1.smithi195.stdout:3/985: write d7/d21/d2a/d4a/f7a [2952651,70894] 0 2024-09-13T17:05:58.392 INFO:tasks.workunit.client.0.smithi115.stdout:5/609: truncate d19/d21/fb1 3979972 0 2024-09-13T17:05:58.397 INFO:tasks.workunit.client.1.smithi195.stdout:1/922: mknod db/d19/d5a/c133 0 2024-09-13T17:05:58.397 INFO:tasks.workunit.client.1.smithi195.stdout:1/923: creat db/d19/d5a/d66/d96/f134 x:0 0 0 2024-09-13T17:05:58.397 INFO:tasks.workunit.client.0.smithi115.stdout:4/721: sync 2024-09-13T17:05:58.398 INFO:tasks.workunit.client.0.smithi115.stdout:9/483: sync 2024-09-13T17:05:58.398 INFO:tasks.workunit.client.0.smithi115.stdout:6/655: sync 2024-09-13T17:05:58.398 INFO:tasks.workunit.client.0.smithi115.stdout:4/722: chown d7/dbe/f99 110795663 1 2024-09-13T17:05:58.398 INFO:tasks.workunit.client.0.smithi115.stdout:6/656: fsync d8/d33/d40/f5c 0 2024-09-13T17:05:58.398 INFO:tasks.workunit.client.0.smithi115.stdout:4/723: truncate d7/dd/de/f5e 1422549 0 2024-09-13T17:05:58.399 INFO:tasks.workunit.client.1.smithi195.stdout:3/986: mknod d7/d21/d2a/d35/d60/d64/db3/dc4/dfd/c13f 0 2024-09-13T17:05:58.401 INFO:tasks.workunit.client.0.smithi115.stdout:4/724: creat d7/d86/d88/dba/fdc x:0 0 0 2024-09-13T17:05:58.406 INFO:tasks.workunit.client.0.smithi115.stdout:7/628: rmdir d0/d2/d4a 39 2024-09-13T17:05:58.408 INFO:tasks.workunit.client.1.smithi195.stdout:3/987: mknod d7/d21/d2a/d35/db7/c140 0 2024-09-13T17:05:58.408 INFO:tasks.workunit.client.1.smithi195.stdout:5/973: sync 2024-09-13T17:05:58.409 INFO:tasks.workunit.client.0.smithi115.stdout:6/657: dread d8/d33/d40/d67/db4/d24/f29 [0,4194304] 0 2024-09-13T17:05:58.410 INFO:tasks.workunit.client.1.smithi195.stdout:5/974: dread d2/df/d78/deb/d3f/dfa/f100 [0,4194304] 0 2024-09-13T17:05:58.412 INFO:tasks.workunit.client.1.smithi195.stdout:3/988: rename d7/d21/d2a/d35/d60/d6f/l120 to d7/d21/d2a/d35/d8f/d9f/d105/l141 0 2024-09-13T17:05:58.414 INFO:tasks.workunit.client.1.smithi195.stdout:5/975: mkdir d2/df/d90/db2/d143 0 2024-09-13T17:05:58.415 INFO:tasks.workunit.client.0.smithi115.stdout:4/725: truncate d7/dbe/f6a 133748 0 2024-09-13T17:05:58.416 INFO:tasks.workunit.client.1.smithi195.stdout:6/837: sync 2024-09-13T17:05:58.416 INFO:tasks.workunit.client.1.smithi195.stdout:2/944: sync 2024-09-13T17:05:58.416 INFO:tasks.workunit.client.1.smithi195.stdout:6/838: fdatasync d1c/d3e/f47 0 2024-09-13T17:05:58.416 INFO:tasks.workunit.client.1.smithi195.stdout:2/945: stat d0/d4a/d47/d73/d75/d88/d8e/cb6 0 2024-09-13T17:05:58.416 INFO:tasks.workunit.client.1.smithi195.stdout:6/839: dread - d1c/df0/db9/d5e/fed zero size 2024-09-13T17:05:58.416 INFO:tasks.workunit.client.1.smithi195.stdout:6/840: write d1c/d24/f2e [2634085,116238] 0 2024-09-13T17:05:58.417 INFO:tasks.workunit.client.0.smithi115.stdout:7/629: mkdir d0/d3b/d50/d21/de2 0 2024-09-13T17:05:58.417 INFO:tasks.workunit.client.0.smithi115.stdout:7/630: readlink d0/l19 0 2024-09-13T17:05:58.417 INFO:tasks.workunit.client.1.smithi195.stdout:3/989: mkdir d7/d19/d1e/d142 0 2024-09-13T17:05:58.419 INFO:tasks.workunit.client.0.smithi115.stdout:6/658: creat d8/d13/d7b/fcb x:0 0 0 2024-09-13T17:05:58.421 INFO:tasks.workunit.client.1.smithi195.stdout:2/946: creat d0/d4a/d47/d73/d75/d88/d8e/f121 x:0 0 0 2024-09-13T17:05:58.423 INFO:tasks.workunit.client.0.smithi115.stdout:4/726: rename d7/dbe/f8e to d7/dd/de/d4e/d6c/fdd 0 2024-09-13T17:05:58.426 INFO:tasks.workunit.client.0.smithi115.stdout:7/631: link d0/d2/d67/d86/d94/d9b/lae d0/d3b/d54/le3 0 2024-09-13T17:05:58.427 INFO:tasks.workunit.client.1.smithi195.stdout:8/988: dwrite d0/d13/d52/d55/fb6 [0,4194304] 0 2024-09-13T17:05:58.427 INFO:tasks.workunit.client.1.smithi195.stdout:8/989: dread - d0/d17/d2f/d31/d101/d63/d71/de8/d125/f132 zero size 2024-09-13T17:05:58.427 INFO:tasks.workunit.client.1.smithi195.stdout:8/990: chown d0/d13/c38 0 1 2024-09-13T17:05:58.427 INFO:tasks.workunit.client.1.smithi195.stdout:8/991: dread - d0/d17/d2f/d31/f13b zero size 2024-09-13T17:05:58.429 INFO:tasks.workunit.client.0.smithi115.stdout:6/659: unlink d8/d33/d40/d4c/l68 0 2024-09-13T17:05:58.433 INFO:tasks.workunit.client.1.smithi195.stdout:6/841: mknod d1c/d24/d49/d5f/db1/c111 0 2024-09-13T17:05:58.433 INFO:tasks.workunit.client.1.smithi195.stdout:3/990: creat d7/d21/d2a/d35/d9c/df6/f143 x:0 0 0 2024-09-13T17:05:58.433 INFO:tasks.workunit.client.1.smithi195.stdout:5/976: creat d2/df/d78/deb/d4e/d10/d46/f144 x:0 0 0 2024-09-13T17:05:58.433 INFO:tasks.workunit.client.0.smithi115.stdout:7/632: link d0/d3b/d50/d21/f33 d0/d2/d1e/d3d/d7c/fe4 0 2024-09-13T17:05:58.433 INFO:tasks.workunit.client.0.smithi115.stdout:7/633: fdatasync d0/d51/fc1 0 2024-09-13T17:05:58.434 INFO:tasks.workunit.client.0.smithi115.stdout:9/484: dwrite d0/de/d10/d15/d86/f75 [0,4194304] 0 2024-09-13T17:05:58.434 INFO:tasks.workunit.client.0.smithi115.stdout:0/473: dwrite d9/d1d/d24/f5b [0,4194304] 0 2024-09-13T17:05:58.434 INFO:tasks.workunit.client.0.smithi115.stdout:5/610: dwrite d19/d2b/d32/d55/f5a [0,4194304] 0 2024-09-13T17:05:58.435 INFO:tasks.workunit.client.0.smithi115.stdout:0/474: write d9/d1d/d24/d26/d5d/f87 [439673,11466] 0 2024-09-13T17:05:58.435 INFO:tasks.workunit.client.0.smithi115.stdout:0/475: fsync d9/d1b/f3a 0 2024-09-13T17:05:58.436 INFO:tasks.workunit.client.1.smithi195.stdout:6/842: symlink d1c/df0/db9/d5e/l112 0 2024-09-13T17:05:58.437 INFO:tasks.workunit.client.0.smithi115.stdout:9/485: creat d0/d21/d42/fa5 x:0 0 0 2024-09-13T17:05:58.440 INFO:tasks.workunit.client.1.smithi195.stdout:5/977: mknod d2/df/d90/c145 0 2024-09-13T17:05:58.443 INFO:tasks.workunit.client.1.smithi195.stdout:6/843: unlink d1c/df0/db9/d8c/da7/dc6/cfd 0 2024-09-13T17:05:58.443 INFO:tasks.workunit.client.1.smithi195.stdout:8/992: write d0/d17/d2f/d31/f37 [1406459,42854] 0 2024-09-13T17:05:58.443 INFO:tasks.workunit.client.1.smithi195.stdout:8/993: stat d0/d17/faf 0 2024-09-13T17:05:58.445 INFO:tasks.workunit.client.1.smithi195.stdout:2/947: dwrite d0/d3/f7a [0,4194304] 0 2024-09-13T17:05:58.445 INFO:tasks.workunit.client.1.smithi195.stdout:5/978: dread d2/df/d78/d76/d114/f12c [0,4194304] 0 2024-09-13T17:05:58.445 INFO:tasks.workunit.client.0.smithi115.stdout:5/611: mkdir d19/d75/dcd 0 2024-09-13T17:05:58.445 INFO:tasks.workunit.client.0.smithi115.stdout:5/612: chown d19/d2b/d69 11547219 1 2024-09-13T17:05:58.445 INFO:tasks.workunit.client.0.smithi115.stdout:0/476: rmdir d9/d1d/d24/d26/d5d/d67 39 2024-09-13T17:05:58.447 INFO:tasks.workunit.client.1.smithi195.stdout:1/924: dwrite db/f33 [0,4194304] 0 2024-09-13T17:05:58.447 INFO:tasks.workunit.client.0.smithi115.stdout:7/634: mkdir d0/d2/d1e/de5 0 2024-09-13T17:05:58.456 INFO:tasks.workunit.client.1.smithi195.stdout:3/991: dwrite d7/d19/fa2 [0,4194304] 0 2024-09-13T17:05:58.459 INFO:tasks.workunit.client.0.smithi115.stdout:6/660: dwrite d8/db/d1d/fa1 [0,4194304] 0 2024-09-13T17:05:58.460 INFO:tasks.workunit.client.1.smithi195.stdout:5/979: dread d2/df/f1c [0,4194304] 0 2024-09-13T17:05:58.461 INFO:tasks.workunit.client.0.smithi115.stdout:4/727: dwrite d7/dd/de/d4e/d5a/d4f/d53/fcf [0,4194304] 0 2024-09-13T17:05:58.471 INFO:tasks.workunit.client.1.smithi195.stdout:2/948: mknod d0/d4a/d47/d73/d75/d88/d2c/dd7/c122 0 2024-09-13T17:05:58.472 INFO:tasks.workunit.client.0.smithi115.stdout:6/661: dread d8/db/d1d/f18 [0,4194304] 0 2024-09-13T17:05:58.472 INFO:tasks.workunit.client.0.smithi115.stdout:6/662: creat d8/d33/d40/d67/db4/d24/d53/d6a/fcc x:0 0 0 2024-09-13T17:05:58.473 INFO:tasks.workunit.client.0.smithi115.stdout:0/477: mknod d9/d1d/d24/d26/d36/d48/c8c 0 2024-09-13T17:05:58.473 INFO:tasks.workunit.client.0.smithi115.stdout:0/478: readlink d9/d1d/d24/d26/l56 0 2024-09-13T17:05:58.479 INFO:tasks.workunit.client.0.smithi115.stdout:4/728: mknod d7/dd/d3c/d72/db3/cde 0 2024-09-13T17:05:58.481 INFO:tasks.workunit.client.1.smithi195.stdout:3/992: write d7/d5f/f68 [782056,67319] 0 2024-09-13T17:05:58.483 INFO:tasks.workunit.client.1.smithi195.stdout:5/980: unlink d2/df/d78/c13e 0 2024-09-13T17:05:58.483 INFO:tasks.workunit.client.1.smithi195.stdout:2/949: rmdir d0/d4a/d47/d73/d75/d88/d1e/dd0 39 2024-09-13T17:05:58.484 INFO:tasks.workunit.client.0.smithi115.stdout:9/486: rmdir d0/de 39 2024-09-13T17:05:58.485 INFO:tasks.workunit.client.1.smithi195.stdout:5/981: symlink d2/df/d78/deb/d4e/d74/d91/l146 0 2024-09-13T17:05:58.486 INFO:tasks.workunit.client.0.smithi115.stdout:6/663: truncate d8/d33/d40/d67/fc7 613900 0 2024-09-13T17:05:58.486 INFO:tasks.workunit.client.0.smithi115.stdout:0/479: symlink d9/d27/l8d 0 2024-09-13T17:05:58.487 INFO:tasks.workunit.client.0.smithi115.stdout:0/480: chown d9/d1d/d24/d26/d36 57040 1 2024-09-13T17:05:58.488 INFO:tasks.workunit.client.0.smithi115.stdout:4/729: symlink d7/dd/de/d4e/d5a/d4f/d70/db6/ldf 0 2024-09-13T17:05:58.488 INFO:tasks.workunit.client.0.smithi115.stdout:4/730: readlink d7/l22 0 2024-09-13T17:05:58.488 INFO:tasks.workunit.client.0.smithi115.stdout:4/731: chown d7/dd/de/d4e/d6c/fdd 3137 1 2024-09-13T17:05:58.488 INFO:tasks.workunit.client.0.smithi115.stdout:9/487: rmdir d0/de 39 2024-09-13T17:05:58.489 INFO:tasks.workunit.client.0.smithi115.stdout:4/732: getdents d7/d86 0 2024-09-13T17:05:58.489 INFO:tasks.workunit.client.0.smithi115.stdout:4/733: fdatasync d7/dd/de/d4e/d5a/d4f/d70/fb5 0 2024-09-13T17:05:58.492 INFO:tasks.workunit.client.0.smithi115.stdout:6/664: link d8/db/d49/c50 d8/db/ccd 0 2024-09-13T17:05:58.493 INFO:tasks.workunit.client.0.smithi115.stdout:6/665: rmdir d8/db/d49 39 2024-09-13T17:05:58.495 INFO:tasks.workunit.client.0.smithi115.stdout:6/666: rename d8/db/l4a to d8/db/dd/da2/db3/lce 0 2024-09-13T17:05:58.496 INFO:tasks.workunit.client.0.smithi115.stdout:7/635: dwrite d0/d2/d1e/d3d/d82/d44/f4f [0,4194304] 0 2024-09-13T17:05:58.496 INFO:tasks.workunit.client.0.smithi115.stdout:0/481: dread d9/d1b/f61 [0,4194304] 0 2024-09-13T17:05:58.497 INFO:tasks.workunit.client.0.smithi115.stdout:6/667: symlink d8/d33/d40/d67/db4/d24/d53/d6a/lcf 0 2024-09-13T17:05:58.500 INFO:tasks.workunit.client.0.smithi115.stdout:9/488: dread d0/f31 [0,4194304] 0 2024-09-13T17:05:58.501 INFO:tasks.workunit.client.1.smithi195.stdout:1/925: dwrite db/df/d4d/fc7 [0,4194304] 0 2024-09-13T17:05:58.502 INFO:tasks.workunit.client.1.smithi195.stdout:8/994: dwrite d0/d17/d2f/d7c/ffb [0,4194304] 0 2024-09-13T17:05:58.504 INFO:tasks.workunit.client.0.smithi115.stdout:7/636: link d0/ca6 d0/d2/d1e/d73/ce6 0 2024-09-13T17:05:58.504 INFO:tasks.workunit.client.0.smithi115.stdout:0/482: truncate d9/d1d/d24/d26/d2d/d30/f5a 1440970 0 2024-09-13T17:05:58.504 INFO:tasks.workunit.client.0.smithi115.stdout:0/483: stat d9/d1d/d24/c3e 0 2024-09-13T17:05:58.504 INFO:tasks.workunit.client.0.smithi115.stdout:0/484: chown d9/d1d/d24/d26/d7b 457 1 2024-09-13T17:05:58.504 INFO:tasks.workunit.client.0.smithi115.stdout:0/485: chown d9/c11 689240 1 2024-09-13T17:05:58.504 INFO:tasks.workunit.client.0.smithi115.stdout:0/486: readlink d9/d27/l75 0 2024-09-13T17:05:58.505 INFO:tasks.workunit.client.1.smithi195.stdout:6/844: dwrite d1c/df0/db9/f55 [0,4194304] 0 2024-09-13T17:05:58.505 INFO:tasks.workunit.client.1.smithi195.stdout:6/845: write d1c/df0/db9/d8c/f99 [8276956,32026] 0 2024-09-13T17:05:58.505 INFO:tasks.workunit.client.1.smithi195.stdout:6/846: write d1c/d3e/fa3 [308936,90062] 0 2024-09-13T17:05:58.506 INFO:tasks.workunit.client.0.smithi115.stdout:6/668: rename d8/d33/d40/l73 to d8/d13/ld0 0 2024-09-13T17:05:58.508 INFO:tasks.workunit.client.0.smithi115.stdout:4/734: write d7/dd/f2c [2694325,83160] 0 2024-09-13T17:05:58.509 INFO:tasks.workunit.client.1.smithi195.stdout:3/993: dwrite d7/d62/d70/fb9 [0,4194304] 0 2024-09-13T17:05:58.509 INFO:tasks.workunit.client.1.smithi195.stdout:3/994: creat d7/d21/d2a/d35/d60/d64/f144 x:0 0 0 2024-09-13T17:05:58.509 INFO:tasks.workunit.client.1.smithi195.stdout:3/995: chown d7/d21/d2a/d35/d8f 799753 1 2024-09-13T17:05:58.511 INFO:tasks.workunit.client.0.smithi115.stdout:7/637: mknod d0/d2/ce7 0 2024-09-13T17:05:58.511 INFO:tasks.workunit.client.0.smithi115.stdout:7/638: write d0/d2/d1e/f9d [272086,66034] 0 2024-09-13T17:05:58.511 INFO:tasks.workunit.client.1.smithi195.stdout:1/926: dread db/d19/d37/f4e [4194304,4194304] 0 2024-09-13T17:05:58.513 INFO:tasks.workunit.client.1.smithi195.stdout:2/950: dwrite d0/d4a/d47/d73/d75/d88/d2c/df6/df9/f10 [0,4194304] 0 2024-09-13T17:05:58.515 INFO:tasks.workunit.client.0.smithi115.stdout:6/669: mknod d8/d33/d40/cd1 0 2024-09-13T17:05:58.515 INFO:tasks.workunit.client.0.smithi115.stdout:6/670: fdatasync d8/d33/d82/f43 0 2024-09-13T17:05:58.515 INFO:tasks.workunit.client.0.smithi115.stdout:6/671: dread - d8/d33/d82/f5b zero size 2024-09-13T17:05:58.515 INFO:tasks.workunit.client.0.smithi115.stdout:4/735: mknod d7/dd/de/d4e/dae/ce0 0 2024-09-13T17:05:58.515 INFO:tasks.workunit.client.0.smithi115.stdout:4/736: truncate d7/dd/de/d4e/d6c/fdd 1583699 0 2024-09-13T17:05:58.517 INFO:tasks.workunit.client.1.smithi195.stdout:8/995: link d0/d17/d2f/d31/d101/d63/db3/cce d0/d17/d2f/d31/d101/d63/db3/c14b 0 2024-09-13T17:05:58.519 INFO:tasks.workunit.client.1.smithi195.stdout:0/916: sync 2024-09-13T17:05:58.526 INFO:tasks.workunit.client.1.smithi195.stdout:5/982: dwrite d2/df/d78/deb/f93 [0,4194304] 0 2024-09-13T17:05:58.530 INFO:tasks.workunit.client.1.smithi195.stdout:3/996: rmdir d7/d5f 39 2024-09-13T17:05:58.530 INFO:tasks.workunit.client.1.smithi195.stdout:1/927: truncate db/df/d4d/d74/f7c 229452 0 2024-09-13T17:05:58.531 INFO:tasks.workunit.client.0.smithi115.stdout:4/737: dread d7/f2d [0,4194304] 0 2024-09-13T17:05:58.531 INFO:tasks.workunit.client.1.smithi195.stdout:2/951: rmdir d0/d3/d3d 39 2024-09-13T17:05:58.531 INFO:tasks.workunit.client.1.smithi195.stdout:2/952: read - d0/d4a/d47/d73/d75/d88/d2c/d43/d63/db2/f11f zero size 2024-09-13T17:05:58.534 INFO:tasks.workunit.client.1.smithi195.stdout:8/996: rename d0/d121/dff/l12c to d0/d17/d2f/d31/d101/d63/db3/l14c 0 2024-09-13T17:05:58.534 INFO:tasks.workunit.client.1.smithi195.stdout:8/997: write d0/d4/f11f [334772,78727] 0 2024-09-13T17:05:58.535 INFO:tasks.workunit.client.0.smithi115.stdout:4/738: dread d7/dd/de/d4e/d9f/dc8/fc9 [0,4194304] 0 2024-09-13T17:05:58.537 INFO:tasks.workunit.client.1.smithi195.stdout:5/983: link d2/df/d78/l9e d2/df/d78/deb/d4e/d10/d46/l147 0 2024-09-13T17:05:58.541 INFO:tasks.workunit.client.1.smithi195.stdout:1/928: mkdir db/df/d4d/d74/d135 0 2024-09-13T17:05:58.542 INFO:tasks.workunit.client.1.smithi195.stdout:2/953: creat d0/d4a/d47/d73/d75/d88/d2c/f123 x:0 0 0 2024-09-13T17:05:58.542 INFO:tasks.workunit.client.1.smithi195.stdout:2/954: dread - d0/d4a/d47/d73/d75/d88/d1e/f119 zero size 2024-09-13T17:05:58.544 INFO:tasks.workunit.client.1.smithi195.stdout:1/929: mknod db/d19/d5a/d66/d96/c136 0 2024-09-13T17:05:58.545 INFO:tasks.workunit.client.1.smithi195.stdout:2/955: mkdir d0/d4a/d47/dba/d124 0 2024-09-13T17:05:58.548 INFO:tasks.workunit.client.1.smithi195.stdout:3/997: write d7/d67/f6c [1080682,59690] 0 2024-09-13T17:05:58.548 INFO:tasks.workunit.client.1.smithi195.stdout:1/930: mknod db/df/d4d/d67/d11d/c137 0 2024-09-13T17:05:58.548 INFO:tasks.workunit.client.1.smithi195.stdout:1/931: write db/d19/d5a/fd4 [80583,38083] 0 2024-09-13T17:05:58.550 INFO:tasks.workunit.client.1.smithi195.stdout:2/956: link d0/d4a/d47/d73/d75/d88/d2c/d43/c46 d0/d4a/d47/d73/d75/d88/d2c/d43/d84/dac/c125 0 2024-09-13T17:05:58.550 INFO:tasks.workunit.client.1.smithi195.stdout:2/957: write d0/d4a/d47/d73/d75/d88/d2c/df6/df9/f9e [1450566,46522] 0 2024-09-13T17:05:58.550 INFO:tasks.workunit.client.1.smithi195.stdout:2/958: write d0/d4a/d47/dba/f10d [842035,14451] 0 2024-09-13T17:05:58.551 INFO:tasks.workunit.client.1.smithi195.stdout:2/959: read - d0/d4a/d47/d73/d75/d88/d2c/dd7/f10a zero size 2024-09-13T17:05:58.552 INFO:tasks.workunit.client.1.smithi195.stdout:6/847: dwrite d1c/f6c [0,4194304] 0 2024-09-13T17:05:58.553 INFO:tasks.workunit.client.1.smithi195.stdout:6/848: dread - d1c/d7d/dc7/ffe zero size 2024-09-13T17:05:58.553 INFO:tasks.workunit.client.1.smithi195.stdout:3/998: creat d7/d21/d2a/d4a/d5a/d13c/f145 x:0 0 0 2024-09-13T17:05:58.555 INFO:tasks.workunit.client.1.smithi195.stdout:1/932: mknod db/d60/d73/c138 0 2024-09-13T17:05:58.555 INFO:tasks.workunit.client.0.smithi115.stdout:9/489: dwrite d0/de/d37/f5d [0,4194304] 0 2024-09-13T17:05:58.557 INFO:tasks.workunit.client.1.smithi195.stdout:6/849: mkdir d1c/df0/db9/d8c/de5/d113 0 2024-09-13T17:05:58.557 INFO:tasks.workunit.client.0.smithi115.stdout:0/487: dwrite d9/d1d/d24/d26/f45 [4194304,4194304] 0 2024-09-13T17:05:58.559 INFO:tasks.workunit.client.1.smithi195.stdout:1/933: creat db/d19/d5a/f139 x:0 0 0 2024-09-13T17:05:58.559 INFO:tasks.workunit.client.1.smithi195.stdout:1/934: fdatasync db/df/d51/d62/f11c 0 2024-09-13T17:05:58.562 INFO:tasks.workunit.client.0.smithi115.stdout:9/490: unlink d0/c39 0 2024-09-13T17:05:58.563 INFO:tasks.workunit.client.0.smithi115.stdout:6/672: dwrite d8/db/f6f [0,4194304] 0 2024-09-13T17:05:58.563 INFO:tasks.workunit.client.0.smithi115.stdout:6/673: truncate d8/db/d1d/f2b 1826363 0 2024-09-13T17:05:58.564 INFO:tasks.workunit.client.1.smithi195.stdout:0/917: dwrite d7/d87/d9b/d4e/d68/f9f [0,4194304] 0 2024-09-13T17:05:58.568 INFO:tasks.workunit.client.0.smithi115.stdout:7/639: dwrite d0/d3b/d50/f47 [0,4194304] 0 2024-09-13T17:05:58.568 INFO:tasks.workunit.client.0.smithi115.stdout:5/613: dwrite d19/d2e/f84 [0,4194304] 0 2024-09-13T17:05:58.569 INFO:tasks.workunit.client.1.smithi195.stdout:0/918: mkdir d7/d87/d9b/d56/da6/d11e 0 2024-09-13T17:05:58.569 INFO:tasks.workunit.client.1.smithi195.stdout:2/960: write d0/d3/d3d/f50 [681198,111268] 0 2024-09-13T17:05:58.569 INFO:tasks.workunit.client.1.smithi195.stdout:0/919: creat d7/db/dd9/df9/f11f x:0 0 0 2024-09-13T17:05:58.571 INFO:tasks.workunit.client.1.smithi195.stdout:8/998: dwrite d0/d17/d2f/d31/d101/f50 [4194304,4194304] 0 2024-09-13T17:05:58.571 INFO:tasks.workunit.client.1.smithi195.stdout:8/999: truncate d0/d4/f11f 534650 0 2024-09-13T17:05:58.572 INFO:tasks.workunit.client.0.smithi115.stdout:0/488: mkdir d9/d27/d88/d8e 0 2024-09-13T17:05:58.574 INFO:tasks.workunit.client.0.smithi115.stdout:4/739: dwrite d7/dd/da0/fbc [0,4194304] 0 2024-09-13T17:05:58.574 INFO:tasks.workunit.client.0.smithi115.stdout:4/740: stat d7/f2d 0 2024-09-13T17:05:58.574 INFO:tasks.workunit.client.0.smithi115.stdout:4/741: creat d7/dd/de/d4e/d6c/d77/fe1 x:0 0 0 2024-09-13T17:05:58.574 INFO:tasks.workunit.client.1.smithi195.stdout:0/920: rename d7/db/d11/c80 to d7/d87/d9b/d56/d46/dca/c120 0 2024-09-13T17:05:58.574 INFO:tasks.workunit.client.1.smithi195.stdout:0/921: readlink d7/db/d11/l97 0 2024-09-13T17:05:58.575 INFO:tasks.workunit.client.1.smithi195.stdout:1/935: write db/d19/d37/f4e [1394160,126967] 0 2024-09-13T17:05:58.575 INFO:tasks.workunit.client.0.smithi115.stdout:9/491: mkdir d0/de/da6 0 2024-09-13T17:05:58.575 INFO:tasks.workunit.client.0.smithi115.stdout:9/492: read - d0/d21/d42/f81 zero size 2024-09-13T17:05:58.575 INFO:tasks.workunit.client.0.smithi115.stdout:9/493: fsync d0/d21/d65/f84 0 2024-09-13T17:05:58.575 INFO:tasks.workunit.client.0.smithi115.stdout:9/494: dread - d0/de/d10/d15/f8f zero size 2024-09-13T17:05:58.577 INFO:tasks.workunit.client.1.smithi195.stdout:3/999: dwrite d7/d21/d51/f135 [0,4194304] 0 2024-09-13T17:05:58.577 INFO:tasks.workunit.client.1.smithi195.stdout:6/850: dwrite d1c/d24/d49/d5f/d85/da5/fbc [0,4194304] 0 2024-09-13T17:05:58.577 INFO:tasks.workunit.client.1.smithi195.stdout:5/984: dwrite d2/df/d78/d54/d58/f85 [0,4194304] 0 2024-09-13T17:05:58.577 INFO:tasks.workunit.client.1.smithi195.stdout:5/985: chown d2/ccd 1934156 1 2024-09-13T17:05:58.578 INFO:tasks.workunit.client.0.smithi115.stdout:0/489: dread d9/fb [0,4194304] 0 2024-09-13T17:05:58.580 INFO:tasks.workunit.client.1.smithi195.stdout:1/936: mknod db/df/d51/c13a 0 2024-09-13T17:05:58.582 INFO:tasks.workunit.client.0.smithi115.stdout:7/640: write d0/d2/d1e/d3d/d6c/f30 [978698,32134] 0 2024-09-13T17:05:58.586 INFO:tasks.workunit.client.0.smithi115.stdout:6/674: mknod d8/db/dd/cd2 0 2024-09-13T17:05:58.588 INFO:tasks.workunit.client.1.smithi195.stdout:1/937: dread db/d19/f79 [0,4194304] 0 2024-09-13T17:05:58.588 INFO:tasks.workunit.client.1.smithi195.stdout:1/938: creat db/d19/d5a/db0/d128/f13b x:0 0 0 2024-09-13T17:05:58.588 INFO:tasks.workunit.client.1.smithi195.stdout:1/939: chown db/d58/fe4 184 1 2024-09-13T17:05:58.590 INFO:tasks.workunit.client.1.smithi195.stdout:0/922: dread d7/db/d38/d5d/f7f [4194304,4194304] 0 2024-09-13T17:05:58.591 INFO:tasks.workunit.client.1.smithi195.stdout:6/851: symlink d1c/d24/d49/d5f/d35/d88/df8/d105/l114 0 2024-09-13T17:05:58.593 INFO:tasks.workunit.client.1.smithi195.stdout:5/986: creat d2/df/d86/f148 x:0 0 0 2024-09-13T17:05:58.595 INFO:tasks.workunit.client.0.smithi115.stdout:7/641: write d0/d2/d1e/d3d/d7c/fb9 [5647984,66781] 0 2024-09-13T17:05:58.600 INFO:tasks.workunit.client.1.smithi195.stdout:6/852: mkdir d1c/d3e/d6b/df5/d115 0 2024-09-13T17:05:58.604 INFO:tasks.workunit.client.1.smithi195.stdout:5/987: creat d2/df/d90/db2/f149 x:0 0 0 2024-09-13T17:05:58.604 INFO:tasks.workunit.client.0.smithi115.stdout:5/614: dwrite d19/d2b/fa8 [0,4194304] 0 2024-09-13T17:05:58.605 INFO:tasks.workunit.client.0.smithi115.stdout:4/742: dwrite d7/dd/de/d4e/d6c/d77/fc2 [0,4194304] 0 2024-09-13T17:05:58.608 INFO:tasks.workunit.client.0.smithi115.stdout:9/495: creat d0/d21/d65/d6f/fa7 x:0 0 0 2024-09-13T17:05:58.612 INFO:tasks.workunit.client.1.smithi195.stdout:2/961: dwrite d0/d4a/d47/d73/d75/d88/ff2 [0,4194304] 0 2024-09-13T17:05:58.612 INFO:tasks.workunit.client.1.smithi195.stdout:5/988: mknod d2/df/d90/db2/c14a 0 2024-09-13T17:05:58.612 INFO:tasks.workunit.client.1.smithi195.stdout:5/989: dread - d2/df/d78/deb/d4e/d10/d46/df3/f129 zero size 2024-09-13T17:05:58.612 INFO:tasks.workunit.client.0.smithi115.stdout:7/642: dread d0/d2/d1e/f76 [0,4194304] 0 2024-09-13T17:05:58.612 INFO:tasks.workunit.client.0.smithi115.stdout:7/643: dread - d0/d2/d1e/d3d/f5e zero size 2024-09-13T17:05:58.613 INFO:tasks.workunit.client.0.smithi115.stdout:0/490: link d9/d1d/d24/d26/d2d/d30/c52 d9/d1d/d24/d26/d5d/d66/d83/c8f 0 2024-09-13T17:05:58.613 INFO:tasks.workunit.client.0.smithi115.stdout:0/491: chown d9/d1d/d24/d26/d2c 1245330 1 2024-09-13T17:05:58.613 INFO:tasks.workunit.client.0.smithi115.stdout:0/492: readlink d9/l69 0 2024-09-13T17:05:58.615 INFO:tasks.workunit.client.0.smithi115.stdout:6/675: rename d8/d33/d82/l83 to d8/d33/d40/d67/db4/dbf/ld3 0 2024-09-13T17:05:58.620 INFO:tasks.workunit.client.0.smithi115.stdout:5/615: rmdir d19/d2e/d6b 39 2024-09-13T17:05:58.621 INFO:tasks.workunit.client.1.smithi195.stdout:2/962: symlink d0/d4a/d47/d73/d94/l126 0 2024-09-13T17:05:58.622 INFO:tasks.workunit.client.1.smithi195.stdout:5/990: truncate d2/df/d90/db2/fe8 347788 0 2024-09-13T17:05:58.626 INFO:tasks.workunit.client.0.smithi115.stdout:8/706: sync 2024-09-13T17:05:58.626 INFO:tasks.workunit.client.0.smithi115.stdout:8/707: readlink d0/l9 0 2024-09-13T17:05:58.627 INFO:tasks.workunit.client.0.smithi115.stdout:7/644: creat d0/d2/d1e/d3d/d6c/d71/fe8 x:0 0 0 2024-09-13T17:05:58.627 INFO:tasks.workunit.client.0.smithi115.stdout:7/645: creat d0/d2/d1e/d3d/d82/d44/dac/dbf/fe9 x:0 0 0 2024-09-13T17:05:58.628 INFO:tasks.workunit.client.0.smithi115.stdout:0/493: truncate d9/d1d/f42 2829681 0 2024-09-13T17:05:58.628 INFO:tasks.workunit.client.0.smithi115.stdout:0/494: write d9/d1d/d24/d26/d36/f7c [553255,102319] 0 2024-09-13T17:05:58.630 INFO:tasks.workunit.client.0.smithi115.stdout:9/496: rename d0/d21/l26 to d0/d21/d65/la8 0 2024-09-13T17:05:58.630 INFO:tasks.workunit.client.1.smithi195.stdout:0/923: dwrite d7/d88/d23/fcb [0,4194304] 0 2024-09-13T17:05:58.630 INFO:tasks.workunit.client.1.smithi195.stdout:0/924: write d7/d87/d9b/d4e/d68/f105 [303052,34336] 0 2024-09-13T17:05:58.632 INFO:tasks.workunit.client.0.smithi115.stdout:8/708: mknod d0/d95/db6/cef 0 2024-09-13T17:05:58.633 INFO:tasks.workunit.client.1.smithi195.stdout:2/963: read d0/f54 [246303,56803] 0 2024-09-13T17:05:58.633 INFO:tasks.workunit.client.1.smithi195.stdout:1/940: dwrite db/d19/f64 [0,4194304] 0 2024-09-13T17:05:58.633 INFO:tasks.workunit.client.1.smithi195.stdout:6/853: dwrite d1c/d3e/f47 [0,4194304] 0 2024-09-13T17:05:58.633 INFO:tasks.workunit.client.1.smithi195.stdout:6/854: write d1c/df0/db9/d8c/f99 [13124603,59646] 0 2024-09-13T17:05:58.633 INFO:tasks.workunit.client.1.smithi195.stdout:6/855: chown d1c/df0/db9/d30/f80 1 1 2024-09-13T17:05:58.634 INFO:tasks.workunit.client.1.smithi195.stdout:6/856: fsync f2 0 2024-09-13T17:05:58.635 INFO:tasks.workunit.client.0.smithi115.stdout:7/646: mkdir d0/d2/d1e/d3d/d82/d44/da7/dea 0 2024-09-13T17:05:58.635 INFO:tasks.workunit.client.0.smithi115.stdout:7/647: stat d0/d2/d4a 0 2024-09-13T17:05:58.635 INFO:tasks.workunit.client.0.smithi115.stdout:7/648: readlink d0/d2/d1e/d3d/d82/ld2 0 2024-09-13T17:05:58.635 INFO:tasks.workunit.client.0.smithi115.stdout:7/649: write d0/d2/d1e/d3d/d6c/d71/f61 [575369,89622] 0 2024-09-13T17:05:58.637 INFO:tasks.workunit.client.0.smithi115.stdout:4/743: dwrite d7/dd/de/d4e/d9f/dc8/fc9 [0,4194304] 0 2024-09-13T17:05:58.639 INFO:tasks.workunit.client.0.smithi115.stdout:0/495: link d9/d1d/d24/d26/d36/d48/c6f d9/d1d/d24/d26/d2d/c90 0 2024-09-13T17:05:58.641 INFO:tasks.workunit.client.1.smithi195.stdout:2/964: rename d0/f11a to d0/d4a/d47/f127 0 2024-09-13T17:05:58.645 INFO:tasks.workunit.client.0.smithi115.stdout:5/616: rename d19/d2b/d77/cbd to d19/d21/d3a/d5d/dbe/cce 0 2024-09-13T17:05:58.647 INFO:tasks.workunit.client.0.smithi115.stdout:8/709: getdents d0/d26/d29/d59/d7e/da1 0 2024-09-13T17:05:58.650 INFO:tasks.workunit.client.0.smithi115.stdout:7/650: write d0/d2/d1e/d3d/d82/d44/f4f [2463046,50866] 0 2024-09-13T17:05:58.650 INFO:tasks.workunit.client.0.smithi115.stdout:7/651: creat d0/d2/d1e/d3d/d6c/d71/feb x:0 0 0 2024-09-13T17:05:58.650 INFO:tasks.workunit.client.1.smithi195.stdout:1/941: creat db/d60/d73/f13c x:0 0 0 2024-09-13T17:05:58.650 INFO:tasks.workunit.client.1.smithi195.stdout:1/942: fsync db/df/d4d/d67/dc6/f120 0 2024-09-13T17:05:58.655 INFO:tasks.workunit.client.1.smithi195.stdout:6/857: creat d1c/df0/db9/d5e/dd9/f116 x:0 0 0 2024-09-13T17:05:58.659 INFO:tasks.workunit.client.0.smithi115.stdout:0/496: link d9/d1d/d24/d26/d2d/d30/d46/c4e d9/d1d/d24/d26/d36/d48/c91 0 2024-09-13T17:05:58.660 INFO:tasks.workunit.client.1.smithi195.stdout:1/943: truncate db/df/d4d/d74/f7c 1076905 0 2024-09-13T17:05:58.662 INFO:tasks.workunit.client.1.smithi195.stdout:5/991: dwrite d2/df/d78/ff2 [0,4194304] 0 2024-09-13T17:05:58.663 INFO:tasks.workunit.client.0.smithi115.stdout:8/710: rename d0/d18/d51/c5d to d0/d26/d29/d59/d7e/da7/cf0 0 2024-09-13T17:05:58.664 INFO:tasks.workunit.client.0.smithi115.stdout:8/711: write d0/d21/d76/d83/f7b [1229982,63276] 0 2024-09-13T17:05:58.664 INFO:tasks.workunit.client.0.smithi115.stdout:8/712: chown d0/d26/la0 61434 1 2024-09-13T17:05:58.664 INFO:tasks.workunit.client.1.smithi195.stdout:1/944: rename db/d19/d37/f6a to db/df/d13/df6/f13d 0 2024-09-13T17:05:58.666 INFO:tasks.workunit.client.0.smithi115.stdout:6/676: dwrite d8/db/d1d/f26 [0,4194304] 0 2024-09-13T17:05:58.667 INFO:tasks.workunit.client.1.smithi195.stdout:1/945: dread db/d19/d5a/d66/d7a/fce [0,4194304] 0 2024-09-13T17:05:58.669 INFO:tasks.workunit.client.0.smithi115.stdout:7/652: creat d0/d2/d1e/de5/fec x:0 0 0 2024-09-13T17:05:58.669 INFO:tasks.workunit.client.0.smithi115.stdout:7/653: creat d0/d3b/d50/d21/d2f/fed x:0 0 0 2024-09-13T17:05:58.669 INFO:tasks.workunit.client.0.smithi115.stdout:7/654: write d0/d2/d1e/d3d/d6c/d71/feb [225678,101800] 0 2024-09-13T17:05:58.669 INFO:tasks.workunit.client.1.smithi195.stdout:1/946: dread db/d19/f79 [0,4194304] 0 2024-09-13T17:05:58.670 INFO:tasks.workunit.client.1.smithi195.stdout:0/925: dwrite d7/db/d11/f73 [4194304,4194304] 0 2024-09-13T17:05:58.670 INFO:tasks.workunit.client.1.smithi195.stdout:0/926: creat d7/d88/d23/d96/dd8/f121 x:0 0 0 2024-09-13T17:05:58.670 INFO:tasks.workunit.client.1.smithi195.stdout:5/992: link d2/df/d90/dbb/dec/d10a/l128 d2/df/d78/deb/d3f/d7b/l14b 0 2024-09-13T17:05:58.671 INFO:tasks.workunit.client.0.smithi115.stdout:0/497: rename d9/d1b/f34 to d9/d1b/f92 0 2024-09-13T17:05:58.672 INFO:tasks.workunit.client.0.smithi115.stdout:8/713: truncate d0/d26/d29/d59/d7e/da7/d2b/d37/f64 2882855 0 2024-09-13T17:05:58.673 INFO:tasks.workunit.client.1.smithi195.stdout:1/947: creat db/df/d4d/d67/f13e x:0 0 0 2024-09-13T17:05:58.675 INFO:tasks.workunit.client.0.smithi115.stdout:6/677: stat d8/db/l35 0 2024-09-13T17:05:58.675 INFO:tasks.workunit.client.0.smithi115.stdout:6/678: dread - d8/d33/d40/d67/db4/d24/d53/d6a/fa4 zero size 2024-09-13T17:05:58.675 INFO:tasks.workunit.client.1.smithi195.stdout:0/927: creat d7/d50/da2/de8/f122 x:0 0 0 2024-09-13T17:05:58.680 INFO:tasks.workunit.client.1.smithi195.stdout:2/965: dwrite d0/d4a/d47/d73/d75/fa2 [0,4194304] 0 2024-09-13T17:05:58.680 INFO:tasks.workunit.client.0.smithi115.stdout:0/498: rename d9/d1d/d24/d26/d5d/d66/c6c to d9/c93 0 2024-09-13T17:05:58.680 INFO:tasks.workunit.client.0.smithi115.stdout:0/499: chown d9/d1b/c33 1 1 2024-09-13T17:05:58.680 INFO:tasks.workunit.client.0.smithi115.stdout:2/827: sync 2024-09-13T17:05:58.680 INFO:tasks.workunit.client.0.smithi115.stdout:1/626: sync 2024-09-13T17:05:58.680 INFO:tasks.workunit.client.0.smithi115.stdout:1/627: creat d5/fdf x:0 0 0 2024-09-13T17:05:58.680 INFO:tasks.workunit.client.0.smithi115.stdout:3/858: sync 2024-09-13T17:05:58.681 INFO:tasks.workunit.client.1.smithi195.stdout:6/858: dwrite d1c/d24/d49/d5f/d85/d8f/fdc [0,4194304] 0 2024-09-13T17:05:58.683 INFO:tasks.workunit.client.0.smithi115.stdout:5/617: dwrite d19/d2c/faf [0,4194304] 0 2024-09-13T17:05:58.683 INFO:tasks.workunit.client.0.smithi115.stdout:5/618: creat d19/d2b/d32/d55/d5e/d87/d86/fcf x:0 0 0 2024-09-13T17:05:58.686 INFO:tasks.workunit.client.0.smithi115.stdout:8/714: mkdir d0/d21/d3a/d60/df1 0 2024-09-13T17:05:58.686 INFO:tasks.workunit.client.0.smithi115.stdout:6/679: write d8/d33/d40/d67/db4/d24/f29 [3994534,87441] 0 2024-09-13T17:05:58.687 INFO:tasks.workunit.client.0.smithi115.stdout:0/500: mknod d9/d1d/d24/d26/d5d/c94 0 2024-09-13T17:05:58.688 INFO:tasks.workunit.client.1.smithi195.stdout:5/993: dread d2/f17 [0,4194304] 0 2024-09-13T17:05:58.690 INFO:tasks.workunit.client.0.smithi115.stdout:7/655: dwrite d0/f2e [0,4194304] 0 2024-09-13T17:05:58.691 INFO:tasks.workunit.client.0.smithi115.stdout:1/628: link d5/d26/d2c/f74 d5/d60/fe0 0 2024-09-13T17:05:58.692 INFO:tasks.workunit.client.0.smithi115.stdout:1/629: chown d5/d7/d33/d3a/f71 1 1 2024-09-13T17:05:58.694 INFO:tasks.workunit.client.0.smithi115.stdout:3/859: mkdir d1/d12/d11b 0 2024-09-13T17:05:58.694 INFO:tasks.workunit.client.1.smithi195.stdout:6/859: read d1c/d24/d49/d5f/d85/d8f/fdc [1167061,69239] 0 2024-09-13T17:05:58.696 INFO:tasks.workunit.client.1.smithi195.stdout:6/860: chown d1c/d24/d49/d5f/d35/d88/cbe 8 1 2024-09-13T17:05:58.699 INFO:tasks.workunit.client.0.smithi115.stdout:5/619: rename d19/d21/d62 to d19/d2c/dd0 0 2024-09-13T17:05:58.701 INFO:tasks.workunit.client.0.smithi115.stdout:6/680: write d8/d33/d40/d67/db4/d24/f1e [2702156,41453] 0 2024-09-13T17:05:58.702 INFO:tasks.workunit.client.0.smithi115.stdout:8/715: link d0/d26/d29/d59/cc3 d0/d15/cf2 0 2024-09-13T17:05:58.702 INFO:tasks.workunit.client.0.smithi115.stdout:4/744: write d7/dd/de/f5e [159941,128305] 0 2024-09-13T17:05:58.703 INFO:tasks.workunit.client.1.smithi195.stdout:0/928: truncate d7/d88/d23/fcb 34345 0 2024-09-13T17:05:58.703 INFO:tasks.workunit.client.1.smithi195.stdout:0/929: chown d7/d88/c1e 122967 1 2024-09-13T17:05:58.703 INFO:tasks.workunit.client.1.smithi195.stdout:0/930: readlink d7/d87/l110 0 2024-09-13T17:05:58.704 INFO:tasks.workunit.client.1.smithi195.stdout:6/861: write d1c/d24/d49/d5f/db1/d95/fc5 [1401970,55337] 0 2024-09-13T17:05:58.706 INFO:tasks.workunit.client.1.smithi195.stdout:2/966: rmdir d0/d4a/d47/d73/d75/d7e 39 2024-09-13T17:05:58.707 INFO:tasks.workunit.client.0.smithi115.stdout:0/501: symlink d9/d1d/d24/d26/d2c/l95 0 2024-09-13T17:05:58.709 INFO:tasks.workunit.client.1.smithi195.stdout:0/931: mknod d7/d50/da2/dbd/c123 0 2024-09-13T17:05:58.711 INFO:tasks.workunit.client.0.smithi115.stdout:7/656: creat d0/d2/d4a/fee x:0 0 0 2024-09-13T17:05:58.711 INFO:tasks.workunit.client.0.smithi115.stdout:7/657: stat d0/l64 0 2024-09-13T17:05:58.711 INFO:tasks.workunit.client.0.smithi115.stdout:7/658: write d0/d2/d1e/d3d/d82/d44/f6e [1332510,76819] 0 2024-09-13T17:05:58.712 INFO:tasks.workunit.client.1.smithi195.stdout:6/862: mknod d1c/d24/d49/d5f/db1/dcd/da9/c117 0 2024-09-13T17:05:58.716 INFO:tasks.workunit.client.0.smithi115.stdout:6/681: write d8/db/f6f [2107153,122681] 0 2024-09-13T17:05:58.716 INFO:tasks.workunit.client.0.smithi115.stdout:6/682: truncate d8/d33/d40/d4c/f91 1553547 0 2024-09-13T17:05:58.717 INFO:tasks.workunit.client.0.smithi115.stdout:1/630: creat d5/d60/fe1 x:0 0 0 2024-09-13T17:05:58.717 INFO:tasks.workunit.client.0.smithi115.stdout:1/631: chown d5/d26/f29 80319 1 2024-09-13T17:05:58.721 INFO:tasks.workunit.client.0.smithi115.stdout:3/860: creat d1/d4b/d69/d7b/f11c x:0 0 0 2024-09-13T17:05:58.722 INFO:tasks.workunit.client.0.smithi115.stdout:2/828: dwrite d3/d4d/d13/d62/d92/dd7/fd5 [4194304,4194304] 0 2024-09-13T17:05:58.724 INFO:tasks.workunit.client.0.smithi115.stdout:5/620: unlink d19/d2c/c2d 0 2024-09-13T17:05:58.727 INFO:tasks.workunit.client.1.smithi195.stdout:2/967: write d0/d4a/d47/d73/d75/d88/ff2 [2916324,68045] 0 2024-09-13T17:05:58.728 INFO:tasks.workunit.client.1.smithi195.stdout:5/994: dwrite d2/df/d48/fef [0,4194304] 0 2024-09-13T17:05:58.728 INFO:tasks.workunit.client.1.smithi195.stdout:5/995: creat d2/df/d90/dbb/dec/d10a/f14c x:0 0 0 2024-09-13T17:05:58.728 INFO:tasks.workunit.client.0.smithi115.stdout:8/716: symlink d0/d21/d3a/d60/dc6/lf3 0 2024-09-13T17:05:58.728 INFO:tasks.workunit.client.0.smithi115.stdout:8/717: chown d0/d21/d3a/d60/df1 12 1 2024-09-13T17:05:58.729 INFO:tasks.workunit.client.0.smithi115.stdout:0/502: dwrite d9/d1d/d24/d26/d5d/f70 [0,4194304] 0 2024-09-13T17:05:58.729 INFO:tasks.workunit.client.0.smithi115.stdout:0/503: creat d9/d1d/d24/d26/d5d/f96 x:0 0 0 2024-09-13T17:05:58.729 INFO:tasks.workunit.client.1.smithi195.stdout:1/948: rmdir db/df/d4d/d67 39 2024-09-13T17:05:58.730 INFO:tasks.workunit.client.0.smithi115.stdout:4/745: mknod d7/dd/d3c/d7b/ce2 0 2024-09-13T17:05:58.730 INFO:tasks.workunit.client.0.smithi115.stdout:4/746: stat d7/dd/f2c 0 2024-09-13T17:05:58.730 INFO:tasks.workunit.client.1.smithi195.stdout:0/932: dread d7/d88/d23/f25 [0,4194304] 0 2024-09-13T17:05:58.731 INFO:tasks.workunit.client.0.smithi115.stdout:7/659: symlink d0/d3b/d50/d21/d2f/d9e/dbd/lef 0 2024-09-13T17:05:58.731 INFO:tasks.workunit.client.0.smithi115.stdout:7/660: chown d0/l9 26 1 2024-09-13T17:05:58.735 INFO:tasks.workunit.client.0.smithi115.stdout:1/632: mkdir d5/d7/d33/d3a/db2/de2 0 2024-09-13T17:05:58.736 INFO:tasks.workunit.client.0.smithi115.stdout:1/633: chown d5/d7/d5c/dc6 2 1 2024-09-13T17:05:58.736 INFO:tasks.workunit.client.0.smithi115.stdout:1/634: read - d5/d7/d33/f9d zero size 2024-09-13T17:05:58.736 INFO:tasks.workunit.client.0.smithi115.stdout:1/635: write d5/d7/f15 [689386,100079] 0 2024-09-13T17:05:58.736 INFO:tasks.workunit.client.1.smithi195.stdout:5/996: dread d2/df/d78/deb/d4e/d10/d5c/f87 [0,4194304] 0 2024-09-13T17:05:58.738 INFO:tasks.workunit.client.1.smithi195.stdout:1/949: symlink db/df/d13/df6/l13f 0 2024-09-13T17:05:58.739 INFO:tasks.workunit.client.0.smithi115.stdout:3/861: dread d1/d4b/d1a/d6e/dd9/f3a [0,4194304] 0 2024-09-13T17:05:58.742 INFO:tasks.workunit.client.1.smithi195.stdout:0/933: mknod d7/d88/d23/dd5/c124 0 2024-09-13T17:05:58.742 INFO:tasks.workunit.client.0.smithi115.stdout:6/683: dwrite d8/d13/f9d [0,4194304] 0 2024-09-13T17:05:58.743 INFO:tasks.workunit.client.0.smithi115.stdout:5/621: truncate d19/f1e 4085264 0 2024-09-13T17:05:58.744 INFO:tasks.workunit.client.0.smithi115.stdout:6/684: read d8/db/f70 [91,125129] 0 2024-09-13T17:05:58.744 INFO:tasks.workunit.client.0.smithi115.stdout:6/685: chown d8/d33/d40/la3 213 1 2024-09-13T17:05:58.744 INFO:tasks.workunit.client.0.smithi115.stdout:6/686: chown d8/d33/lad 239423320 1 2024-09-13T17:05:58.745 INFO:tasks.workunit.client.1.smithi195.stdout:2/968: truncate d0/f6c 873686 0 2024-09-13T17:05:58.748 INFO:tasks.workunit.client.0.smithi115.stdout:2/829: dwrite d3/d4d/dd/d1f/fc9 [0,4194304] 0 2024-09-13T17:05:58.748 INFO:tasks.workunit.client.0.smithi115.stdout:2/830: readlink d3/d4d/dd/l50 0 2024-09-13T17:05:58.749 INFO:tasks.workunit.client.1.smithi195.stdout:1/950: creat db/d19/d5a/d66/d7a/d10c/f140 x:0 0 0 2024-09-13T17:05:58.751 INFO:tasks.workunit.client.1.smithi195.stdout:0/934: rename d7/d88/c3f to d7/d88/d7c/c125 0 2024-09-13T17:05:58.755 INFO:tasks.workunit.client.1.smithi195.stdout:1/951: creat db/d11e/f141 x:0 0 0 2024-09-13T17:05:58.756 INFO:tasks.workunit.client.1.smithi195.stdout:1/952: truncate db/df/d51/d8e/f121 951215 0 2024-09-13T17:05:58.756 INFO:tasks.workunit.client.0.smithi115.stdout:0/504: symlink d9/d27/l97 0 2024-09-13T17:05:58.756 INFO:tasks.workunit.client.0.smithi115.stdout:0/505: dread - d9/d1b/f89 zero size 2024-09-13T17:05:58.757 INFO:tasks.workunit.client.1.smithi195.stdout:0/935: rmdir d7/d50/da1 39 2024-09-13T17:05:58.757 INFO:tasks.workunit.client.1.smithi195.stdout:0/936: creat d7/db/d11/f126 x:0 0 0 2024-09-13T17:05:58.758 INFO:tasks.workunit.client.0.smithi115.stdout:4/747: creat d7/dd/d3c/d74/d8b/dd2/fe3 x:0 0 0 2024-09-13T17:05:58.758 INFO:tasks.workunit.client.0.smithi115.stdout:4/748: fdatasync d7/dd/de/d4e/dae/fc5 0 2024-09-13T17:05:58.760 INFO:tasks.workunit.client.1.smithi195.stdout:2/969: getdents d0/d3 0 2024-09-13T17:05:58.762 INFO:tasks.workunit.client.0.smithi115.stdout:1/636: getdents d5/d7/d33/d3a/dc3 0 2024-09-13T17:05:58.764 INFO:tasks.workunit.client.1.smithi195.stdout:6/863: truncate d1c/df0/db9/d8c/f99 8173357 0 2024-09-13T17:05:58.767 INFO:tasks.workunit.client.1.smithi195.stdout:5/997: dwrite d2/df/d78/fd7 [0,4194304] 0 2024-09-13T17:05:58.767 INFO:tasks.workunit.client.1.smithi195.stdout:5/998: readlink d2/df/d78/deb/d3f/lb0 0 2024-09-13T17:05:58.768 INFO:tasks.workunit.client.0.smithi115.stdout:7/661: dwrite d0/d2/d1e/d3d/d6c/f30 [4194304,4194304] 0 2024-09-13T17:05:58.768 INFO:tasks.workunit.client.0.smithi115.stdout:3/862: dwrite d1/f1d [0,4194304] 0 2024-09-13T17:05:58.768 INFO:tasks.workunit.client.1.smithi195.stdout:0/937: rename d7/d88/d23/c44 to d7/d88/d23/d96/ded/c127 0 2024-09-13T17:05:58.772 INFO:tasks.workunit.client.1.smithi195.stdout:6/864: creat d1c/df0/db9/d8c/f118 x:0 0 0 2024-09-13T17:05:58.774 INFO:tasks.workunit.client.0.smithi115.stdout:5/622: unlink d19/d2b/d32/d55/d5e/f9f 0 2024-09-13T17:05:58.775 INFO:tasks.workunit.client.0.smithi115.stdout:5/623: dread d19/d2b/d32/d55/d5e/d87/da4/fa9 [0,4194304] 0 2024-09-13T17:05:58.776 INFO:tasks.workunit.client.0.smithi115.stdout:5/624: fsync d19/d2c/f76 0 2024-09-13T17:05:58.777 INFO:tasks.workunit.client.0.smithi115.stdout:6/687: link d8/db/d49/f5e d8/d33/d40/fd4 0 2024-09-13T17:05:58.777 INFO:tasks.workunit.client.0.smithi115.stdout:6/688: fdatasync d8/d33/d40/d67/db4/d24/d53/d6a/f9a 0 2024-09-13T17:05:58.779 INFO:tasks.workunit.client.0.smithi115.stdout:8/718: rmdir d0/d26/d29/d59/d7e/da7/d28/dcd 39 2024-09-13T17:05:58.781 INFO:tasks.workunit.client.1.smithi195.stdout:0/938: mkdir d7/db/d11/db5/d128 0 2024-09-13T17:05:58.781 INFO:tasks.workunit.client.1.smithi195.stdout:0/939: fdatasync d7/d87/d9b/d56/d46/f6e 0 2024-09-13T17:05:58.781 INFO:tasks.workunit.client.0.smithi115.stdout:7/662: dread d0/d2/d1e/d3d/d82/d44/f4f [0,4194304] 0 2024-09-13T17:05:58.782 INFO:tasks.workunit.client.1.smithi195.stdout:2/970: getdents d0/d4a 0 2024-09-13T17:05:58.782 INFO:tasks.workunit.client.1.smithi195.stdout:2/971: fsync d0/d4a/d47/d73/d75/d88/d2c/df6/fed 0 2024-09-13T17:05:58.782 INFO:tasks.workunit.client.1.smithi195.stdout:2/972: fdatasync d0/d4a/d47/d73/d75/d88/d2c/d51/fff 0 2024-09-13T17:05:58.783 INFO:tasks.workunit.client.0.smithi115.stdout:2/831: mknod d3/d4d/d13/d62/d92/dd7/d7d/c107 0 2024-09-13T17:05:58.785 INFO:tasks.workunit.client.1.smithi195.stdout:1/953: dwrite db/df/d51/d62/f11c [0,4194304] 0 2024-09-13T17:05:58.785 INFO:tasks.workunit.client.1.smithi195.stdout:1/954: getdents db/df/d4d/d74/d135 0 2024-09-13T17:05:58.785 INFO:tasks.workunit.client.1.smithi195.stdout:6/865: unlink d1c/df0/db9/d5e/fa0 0 2024-09-13T17:05:58.786 INFO:tasks.workunit.client.0.smithi115.stdout:4/749: creat d7/dd/de/d4e/d6c/fe4 x:0 0 0 2024-09-13T17:05:58.786 INFO:tasks.workunit.client.0.smithi115.stdout:4/750: creat d7/dd/d3c/d74/d8b/fe5 x:0 0 0 2024-09-13T17:05:58.786 INFO:tasks.workunit.client.0.smithi115.stdout:4/751: chown d7/dd/f1e 534 1 2024-09-13T17:05:58.791 INFO:tasks.workunit.client.0.smithi115.stdout:0/506: dwrite d9/d1d/d24/d26/d36/f62 [0,4194304] 0 2024-09-13T17:05:58.791 INFO:tasks.workunit.client.0.smithi115.stdout:0/507: readlink d9/d27/l97 0 2024-09-13T17:05:58.791 INFO:tasks.workunit.client.1.smithi195.stdout:5/999: dwrite d2/df/d86/f148 [0,4194304] 0 2024-09-13T17:05:58.792 INFO:tasks.workunit.client.1.smithi195.stdout:0/940: creat d7/d50/da1/f129 x:0 0 0 2024-09-13T17:05:58.792 INFO:tasks.workunit.client.1.smithi195.stdout:0/941: chown d7/db/d9a/ca0 422141 1 2024-09-13T17:05:58.792 INFO:tasks.workunit.client.1.smithi195.stdout:0/942: readlink d7/db/lfc 0 2024-09-13T17:05:58.792 INFO:tasks.workunit.client.0.smithi115.stdout:1/637: mknod d5/d3e/dc8/ce3 0 2024-09-13T17:05:58.792 INFO:tasks.workunit.client.0.smithi115.stdout:1/638: fsync d5/d60/fe0 0 2024-09-13T17:05:58.793 INFO:tasks.workunit.client.1.smithi195.stdout:2/973: rename d0/d4a/d47/d73/d75/d88/d2c/d43/d63/f99 to d0/d4a/d47/d73/f128 0 2024-09-13T17:05:58.798 INFO:tasks.workunit.client.1.smithi195.stdout:0/943: dread d7/d87/d9b/d4e/d86/fe7 [0,4194304] 0 2024-09-13T17:05:58.798 INFO:tasks.workunit.client.0.smithi115.stdout:3/863: unlink d1/d12/d14/f2e 0 2024-09-13T17:05:58.803 INFO:tasks.workunit.client.1.smithi195.stdout:1/955: mkdir db/d19/d37/d46/d7e/de0/d142 0 2024-09-13T17:05:58.813 INFO:tasks.workunit.client.0.smithi115.stdout:8/719: creat d0/d26/d29/d59/d7e/da1/dbd/ff4 x:0 0 0 2024-09-13T17:05:58.813 INFO:tasks.workunit.client.0.smithi115.stdout:8/720: read d0/d26/d29/d59/d7e/da1/dbd/fbf [3368010,49027] 0 2024-09-13T17:05:58.814 INFO:tasks.workunit.client.1.smithi195.stdout:2/974: dwrite d0/d4a/d47/d73/d75/d88/d2c/dd7/f10a [0,4194304] 0 2024-09-13T17:05:58.814 INFO:tasks.workunit.client.1.smithi195.stdout:0/944: dwrite d7/f103 [0,4194304] 0 2024-09-13T17:05:58.818 INFO:tasks.workunit.client.0.smithi115.stdout:7/663: creat d0/d51/ff0 x:0 0 0 2024-09-13T17:05:58.820 INFO:tasks.workunit.client.0.smithi115.stdout:2/832: mkdir d3/d108 0 2024-09-13T17:05:58.820 INFO:tasks.workunit.client.1.smithi195.stdout:2/975: write d0/f24 [2580300,59866] 0 2024-09-13T17:05:58.820 INFO:tasks.workunit.client.1.smithi195.stdout:2/976: creat d0/df1/f129 x:0 0 0 2024-09-13T17:05:58.831 INFO:tasks.workunit.client.0.smithi115.stdout:4/752: mkdir d7/dd/de/de6 0 2024-09-13T17:05:58.831 INFO:tasks.workunit.client.0.smithi115.stdout:4/753: fdatasync d7/dd/de/d4e/d5a/d4f/d53/f7a 0 2024-09-13T17:05:58.834 INFO:tasks.workunit.client.1.smithi195.stdout:2/977: dwrite d0/d4a/d47/d73/d75/d88/d2c/d43/d84/f97 [0,4194304] 0 2024-09-13T17:05:58.834 INFO:tasks.workunit.client.1.smithi195.stdout:2/978: truncate d0/d4a/d47/d73/d75/d88/d1e/f9c 630328 0 2024-09-13T17:05:58.834 INFO:tasks.workunit.client.1.smithi195.stdout:2/979: write d0/d4a/d47/d73/d75/fb9 [4966288,16417] 0 2024-09-13T17:05:58.837 INFO:tasks.workunit.client.1.smithi195.stdout:0/945: rename d7/db/d38/d5d/ff7 to d7/d87/d9b/d56/d46/da4/f12a 0 2024-09-13T17:05:58.838 INFO:tasks.workunit.client.0.smithi115.stdout:0/508: symlink d9/d1d/d24/d7d/l98 0 2024-09-13T17:05:58.841 INFO:tasks.workunit.client.0.smithi115.stdout:1/639: creat d5/d7/d86/fe4 x:0 0 0 2024-09-13T17:05:58.845 INFO:tasks.workunit.client.0.smithi115.stdout:5/625: mknod d19/d21/d3a/d5d/cd1 0 2024-09-13T17:05:58.847 INFO:tasks.workunit.client.1.smithi195.stdout:1/956: dwrite db/df/d51/d8e/fd1 [0,4194304] 0 2024-09-13T17:05:58.847 INFO:tasks.workunit.client.0.smithi115.stdout:8/721: rmdir d0/d26/d29/d59/d7e/da7/d28 39 2024-09-13T17:05:58.848 INFO:tasks.workunit.client.0.smithi115.stdout:8/722: read d0/d21/d76/dc1/fdc [1891220,109611] 0 2024-09-13T17:05:58.850 INFO:tasks.workunit.client.0.smithi115.stdout:7/664: unlink d0/d2/d1e/d3d/d82/c2a 0 2024-09-13T17:05:58.854 INFO:tasks.workunit.client.0.smithi115.stdout:7/665: dread d0/d2/d1e/f6f [0,4194304] 0 2024-09-13T17:05:58.856 INFO:tasks.workunit.client.0.smithi115.stdout:0/509: mkdir d9/d27/d88/d99 0 2024-09-13T17:05:58.856 INFO:tasks.workunit.client.0.smithi115.stdout:0/510: dread - d9/d1d/d24/d26/d5d/f96 zero size 2024-09-13T17:05:58.857 INFO:tasks.workunit.client.0.smithi115.stdout:1/640: symlink d5/d7/d33/d3a/db2/de2/le5 0 2024-09-13T17:05:58.861 INFO:tasks.workunit.client.0.smithi115.stdout:3/864: rmdir d1/d4b/d1a/d6e/dd9 39 2024-09-13T17:05:58.862 INFO:tasks.workunit.client.1.smithi195.stdout:2/980: dwrite d0/d4a/d47/d73/d75/d88/d2c/d51/f81 [0,4194304] 0 2024-09-13T17:05:58.863 INFO:tasks.workunit.client.0.smithi115.stdout:4/754: rename d7/dd/de/d4e/d5a/d4f/d53/l68 to d7/dd/de/d4e/d6c/db0/le7 0 2024-09-13T17:05:58.865 INFO:tasks.workunit.client.0.smithi115.stdout:7/666: mkdir d0/d2/d1e/d3d/d6c/de0/df1 0 2024-09-13T17:05:58.866 INFO:tasks.workunit.client.0.smithi115.stdout:7/667: fsync d0/d2/d1e/d3d/d82/fb5 0 2024-09-13T17:05:58.867 INFO:tasks.workunit.client.0.smithi115.stdout:3/865: creat d1/d83/d9d/dba/d116/f11d x:0 0 0 2024-09-13T17:05:58.870 INFO:tasks.workunit.client.0.smithi115.stdout:1/641: dread d5/d26/f35 [0,4194304] 0 2024-09-13T17:05:58.870 INFO:tasks.workunit.client.0.smithi115.stdout:8/723: dwrite d0/d21/d76/fe6 [0,4194304] 0 2024-09-13T17:05:58.871 INFO:tasks.workunit.client.1.smithi195.stdout:0/946: rename d7/d87/d9b/d56/d46/f8a to d7/d87/d9b/d4e/d68/dda/f12b 0 2024-09-13T17:05:58.871 INFO:tasks.workunit.client.1.smithi195.stdout:0/947: chown d7/d87/d9b/d56/d4d/d5e/dbb/f102 38 1 2024-09-13T17:05:58.871 INFO:tasks.workunit.client.1.smithi195.stdout:0/948: write d7/d87/d9b/d4e/d86/fe7 [393132,6602] 0 2024-09-13T17:05:58.875 INFO:tasks.workunit.client.0.smithi115.stdout:5/626: dwrite d19/d2b/f49 [0,4194304] 0 2024-09-13T17:05:58.875 INFO:tasks.workunit.client.0.smithi115.stdout:4/755: dread d7/f19 [0,4194304] 0 2024-09-13T17:05:58.876 INFO:tasks.workunit.client.1.smithi195.stdout:1/957: creat db/d19/d5a/d66/df2/f143 x:0 0 0 2024-09-13T17:05:58.876 INFO:tasks.workunit.client.1.smithi195.stdout:1/958: readlink db/d19/d37/d46/d7e/lf5 0 2024-09-13T17:05:58.876 INFO:tasks.workunit.client.1.smithi195.stdout:1/959: dread - db/f5e zero size 2024-09-13T17:05:58.878 INFO:tasks.workunit.client.0.smithi115.stdout:0/511: dwrite d9/f17 [0,4194304] 0 2024-09-13T17:05:58.879 INFO:tasks.workunit.client.1.smithi195.stdout:0/949: dread d7/d87/d9b/d56/d46/f6e [0,4194304] 0 2024-09-13T17:05:58.879 INFO:tasks.workunit.client.0.smithi115.stdout:8/724: mknod d0/d21/d3a/d60/df1/cf5 0 2024-09-13T17:05:58.880 INFO:tasks.workunit.client.0.smithi115.stdout:3/866: dread d1/d12/d14/fcf [0,4194304] 0 2024-09-13T17:05:58.881 INFO:tasks.workunit.client.1.smithi195.stdout:2/981: creat d0/d4a/d47/dba/d124/f12a x:0 0 0 2024-09-13T17:05:58.883 INFO:tasks.workunit.client.0.smithi115.stdout:4/756: rename d7/dd/de/d4e/d5a/d4f/d53/f98 to d7/dd/de/de6/fe8 0 2024-09-13T17:05:58.883 INFO:tasks.workunit.client.0.smithi115.stdout:4/757: dread - d7/dd/de/d4e/d6c/d77/fbf zero size 2024-09-13T17:05:58.883 INFO:tasks.workunit.client.0.smithi115.stdout:7/668: dwrite d0/d3b/d50/d21/d2f/fd0 [0,4194304] 0 2024-09-13T17:05:58.883 INFO:tasks.workunit.client.0.smithi115.stdout:7/669: dread - d0/d3b/d50/d21/d2f/f89 zero size 2024-09-13T17:05:58.883 INFO:tasks.workunit.client.0.smithi115.stdout:1/642: dread d5/d26/f35 [0,4194304] 0 2024-09-13T17:05:58.883 INFO:tasks.workunit.client.0.smithi115.stdout:8/725: dread d0/d26/d29/d59/d7e/da7/d28/d71/fb5 [0,4194304] 0 2024-09-13T17:05:58.884 INFO:tasks.workunit.client.0.smithi115.stdout:5/627: symlink d19/d2e/d6b/ld2 0 2024-09-13T17:05:58.885 INFO:tasks.workunit.client.1.smithi195.stdout:1/960: symlink db/d11e/l144 0 2024-09-13T17:05:58.886 INFO:tasks.workunit.client.1.smithi195.stdout:1/961: write db/df/f28 [4805993,42321] 0 2024-09-13T17:05:58.886 INFO:tasks.workunit.client.1.smithi195.stdout:1/962: rename db/df/d4d/d67/d11d to db/df/d4d/d67/d11d/d145 22 2024-09-13T17:05:58.886 INFO:tasks.workunit.client.1.smithi195.stdout:0/950: chown d7/d87/d9b/d56/d46/cc7 324738699 1 2024-09-13T17:05:58.888 INFO:tasks.workunit.client.1.smithi195.stdout:1/963: write db/df/d51/d62/d70/fca [317948,121424] 0 2024-09-13T17:05:58.889 INFO:tasks.workunit.client.1.smithi195.stdout:2/982: mkdir d0/d4a/d47/d73/d75/d7e/d12b 0 2024-09-13T17:05:58.890 INFO:tasks.workunit.client.0.smithi115.stdout:3/867: mkdir d1/d4b/d69/d7b/da0/d11e 0 2024-09-13T17:05:58.893 INFO:tasks.workunit.client.1.smithi195.stdout:0/951: creat d7/d87/d9b/d4e/d68/dda/f12c x:0 0 0 2024-09-13T17:05:58.893 INFO:tasks.workunit.client.1.smithi195.stdout:0/952: chown d7/d88/d23/f4a 37 1 2024-09-13T17:05:58.895 INFO:tasks.workunit.client.1.smithi195.stdout:1/964: mkdir db/df/d4d/d67/d146 0 2024-09-13T17:05:58.899 INFO:tasks.workunit.client.0.smithi115.stdout:4/758: unlink d7/dd/de/d4e/d6c/fe4 0 2024-09-13T17:05:58.901 INFO:tasks.workunit.client.0.smithi115.stdout:1/643: dwrite d5/f95 [0,4194304] 0 2024-09-13T17:05:58.901 INFO:tasks.workunit.client.1.smithi195.stdout:0/953: dread d7/d87/d9b/d4e/d68/f9f [0,4194304] 0 2024-09-13T17:05:58.904 INFO:tasks.workunit.client.1.smithi195.stdout:0/954: symlink d7/d87/d9b/d56/d4d/d10f/l12d 0 2024-09-13T17:05:58.905 INFO:tasks.workunit.client.0.smithi115.stdout:8/726: mkdir d0/d18/df6 0 2024-09-13T17:05:58.905 INFO:tasks.workunit.client.0.smithi115.stdout:8/727: fdatasync d0/d18/d51/f9c 0 2024-09-13T17:05:58.905 INFO:tasks.workunit.client.0.smithi115.stdout:8/728: truncate d0/d21/d76/d83/d5a/f90 264459 0 2024-09-13T17:05:58.905 INFO:tasks.workunit.client.0.smithi115.stdout:8/729: readlink d0/d26/d29/d59/d7e/da7/d2b/l92 0 2024-09-13T17:05:58.905 INFO:tasks.workunit.client.0.smithi115.stdout:5/628: mkdir d19/d2c/dd3 0 2024-09-13T17:05:58.906 INFO:tasks.workunit.client.0.smithi115.stdout:5/629: write d19/d2c/faf [5157362,4967] 0 2024-09-13T17:05:58.906 INFO:tasks.workunit.client.0.smithi115.stdout:5/630: chown d19/d21/d3a/f6d 473461 1 2024-09-13T17:05:58.906 INFO:tasks.workunit.client.1.smithi195.stdout:0/955: getdents d7/d87 0 2024-09-13T17:05:58.907 INFO:tasks.workunit.client.0.smithi115.stdout:0/512: rmdir d9/d1d/d24/d26/d2d/d30/d46 39 2024-09-13T17:05:58.909 INFO:tasks.workunit.client.0.smithi115.stdout:3/868: mknod d1/d4b/d69/d7b/c11f 0 2024-09-13T17:05:58.910 INFO:tasks.workunit.client.1.smithi195.stdout:1/965: dread db/d19/d37/f3b [0,4194304] 0 2024-09-13T17:05:58.910 INFO:tasks.workunit.client.1.smithi195.stdout:0/956: symlink d7/d87/d9b/d56/d46/dca/l12e 0 2024-09-13T17:05:58.910 INFO:tasks.workunit.client.1.smithi195.stdout:0/957: write d7/d87/d9b/d56/fd3 [451766,9000] 0 2024-09-13T17:05:58.910 INFO:tasks.workunit.client.1.smithi195.stdout:0/958: truncate d7/d87/d9b/d56/d4d/d5e/dbb/f102 181807 0 2024-09-13T17:05:58.911 INFO:tasks.workunit.client.0.smithi115.stdout:4/759: creat d7/dd/d3c/d72/db3/fe9 x:0 0 0 2024-09-13T17:05:58.911 INFO:tasks.workunit.client.0.smithi115.stdout:1/644: mknod d5/d26/d2c/d62/ce6 0 2024-09-13T17:05:58.912 INFO:tasks.workunit.client.1.smithi195.stdout:1/966: getdents db/df/d4d 0 2024-09-13T17:05:58.912 INFO:tasks.workunit.client.0.smithi115.stdout:1/645: read d5/d26/d2c/d89/fa3 [66430,124442] 0 2024-09-13T17:05:58.912 INFO:tasks.workunit.client.0.smithi115.stdout:7/670: symlink d0/d2/d67/d70/lf2 0 2024-09-13T17:05:58.913 INFO:tasks.workunit.client.0.smithi115.stdout:5/631: creat d19/d2c/dd0/fd4 x:0 0 0 2024-09-13T17:05:58.913 INFO:tasks.workunit.client.0.smithi115.stdout:5/632: chown d19/d21/c71 678 1 2024-09-13T17:05:58.915 INFO:tasks.workunit.client.0.smithi115.stdout:3/869: mkdir d1/d12/d14/d120 0 2024-09-13T17:05:58.916 INFO:tasks.workunit.client.0.smithi115.stdout:3/870: write d1/d4b/d1a/d6e/f75 [2987168,78911] 0 2024-09-13T17:05:58.917 INFO:tasks.workunit.client.1.smithi195.stdout:1/967: getdents db/d19/d5a/d66/d7a 0 2024-09-13T17:05:58.918 INFO:tasks.workunit.client.1.smithi195.stdout:1/968: read db/d19/d5a/d66/d7a/fce [90653,130868] 0 2024-09-13T17:05:58.919 INFO:tasks.workunit.client.0.smithi115.stdout:4/760: mkdir d7/dd/d3c/d72/db3/dea 0 2024-09-13T17:05:58.919 INFO:tasks.workunit.client.0.smithi115.stdout:4/761: write d7/dd/d3c/d74/d8b/dd2/fe3 [603316,42141] 0 2024-09-13T17:05:58.921 INFO:tasks.workunit.client.0.smithi115.stdout:1/646: link d5/d60/f5e d5/d3e/d59/fe7 0 2024-09-13T17:05:58.924 INFO:tasks.workunit.client.1.smithi195.stdout:1/969: symlink db/d60/l147 0 2024-09-13T17:05:58.924 INFO:tasks.workunit.client.0.smithi115.stdout:0/513: mkdir d9/d1d/d24/d26/d2d/d30/d5c/d9a 0 2024-09-13T17:05:58.924 INFO:tasks.workunit.client.0.smithi115.stdout:0/514: chown d9/f18 1 1 2024-09-13T17:05:58.925 INFO:tasks.workunit.client.0.smithi115.stdout:3/871: creat d1/d4b/d69/db6/dd2/f121 x:0 0 0 2024-09-13T17:05:58.926 INFO:tasks.workunit.client.0.smithi115.stdout:0/515: symlink d9/l9b 0 2024-09-13T17:05:58.929 INFO:tasks.workunit.client.0.smithi115.stdout:3/872: link d1/d4b/d69/db6/dcc/l74 d1/da6/l122 0 2024-09-13T17:05:58.930 INFO:tasks.workunit.client.0.smithi115.stdout:1/647: dread d5/d26/f35 [0,4194304] 0 2024-09-13T17:05:58.930 INFO:tasks.workunit.client.0.smithi115.stdout:1/648: write d5/fdf [727576,130131] 0 2024-09-13T17:05:58.931 INFO:tasks.workunit.client.0.smithi115.stdout:0/516: rename d9/d1d/d24/d26/d5d/d67/l6a to d9/d1d/d24/d26/d5d/l9c 0 2024-09-13T17:05:58.932 INFO:tasks.workunit.client.0.smithi115.stdout:3/873: creat d1/d4b/d69/f123 x:0 0 0 2024-09-13T17:05:58.933 INFO:tasks.workunit.client.1.smithi195.stdout:6/866: sync 2024-09-13T17:05:58.934 INFO:tasks.workunit.client.0.smithi115.stdout:0/517: truncate d9/d1d/d24/d26/d36/f62 2208044 0 2024-09-13T17:05:58.934 INFO:tasks.workunit.client.0.smithi115.stdout:0/518: readlink d9/d1d/d24/d26/d2d/l54 0 2024-09-13T17:05:58.934 INFO:tasks.workunit.client.0.smithi115.stdout:0/519: fdatasync d9/d1d/d24/d26/d36/f7c 0 2024-09-13T17:05:58.934 INFO:tasks.workunit.client.0.smithi115.stdout:3/874: rename d1/d4b/d1a/d30/lb0 to d1/d4b/d1a/l124 0 2024-09-13T17:05:58.935 INFO:tasks.workunit.client.0.smithi115.stdout:1/649: getdents d5/d60 0 2024-09-13T17:05:58.936 INFO:tasks.workunit.client.1.smithi195.stdout:1/970: read db/d58/f117 [3946899,97336] 0 2024-09-13T17:05:58.937 INFO:tasks.workunit.client.1.smithi195.stdout:6/867: creat d1c/d24/d49/d5f/db1/d95/dda/f119 x:0 0 0 2024-09-13T17:05:58.938 INFO:tasks.workunit.client.0.smithi115.stdout:3/875: creat d1/d4b/d1a/d30/f125 x:0 0 0 2024-09-13T17:05:58.938 INFO:tasks.workunit.client.0.smithi115.stdout:3/876: creat d1/d4b/f126 x:0 0 0 2024-09-13T17:05:58.938 INFO:tasks.workunit.client.0.smithi115.stdout:3/877: truncate d1/d4b/d69/f123 41931 0 2024-09-13T17:05:58.938 INFO:tasks.workunit.client.0.smithi115.stdout:3/878: chown d1/d4b/d1a/d30/c7e 1118 1 2024-09-13T17:05:58.938 INFO:tasks.workunit.client.1.smithi195.stdout:0/959: dwrite d7/d88/d23/f62 [0,4194304] 0 2024-09-13T17:05:58.943 INFO:tasks.workunit.client.1.smithi195.stdout:1/971: dread db/df/f1f [0,4194304] 0 2024-09-13T17:05:58.945 INFO:tasks.workunit.client.1.smithi195.stdout:1/972: creat db/df/d13/df6/f148 x:0 0 0 2024-09-13T17:05:58.945 INFO:tasks.workunit.client.0.smithi115.stdout:0/520: dread d9/d1d/d24/f25 [0,4194304] 0 2024-09-13T17:05:58.945 INFO:tasks.workunit.client.1.smithi195.stdout:6/868: write d1c/df0/db9/d30/d6f/f10e [2668081,21448] 0 2024-09-13T17:05:58.946 INFO:tasks.workunit.client.0.smithi115.stdout:7/671: dwrite d0/d97/fc9 [0,4194304] 0 2024-09-13T17:05:58.946 INFO:tasks.workunit.client.0.smithi115.stdout:5/633: dwrite d19/d2e/d6b/f8a [0,4194304] 0 2024-09-13T17:05:58.946 INFO:tasks.workunit.client.1.smithi195.stdout:1/973: mkdir db/df/d4d/d74/dee/d149 0 2024-09-13T17:05:58.946 INFO:tasks.workunit.client.1.smithi195.stdout:1/974: truncate db/d58/ffb 397151 0 2024-09-13T17:05:58.948 INFO:tasks.workunit.client.1.smithi195.stdout:6/869: symlink d1c/d3e/d6b/dd2/l11a 0 2024-09-13T17:05:58.949 INFO:tasks.workunit.client.0.smithi115.stdout:1/650: rmdir d5/d3e 39 2024-09-13T17:05:58.949 INFO:tasks.workunit.client.0.smithi115.stdout:1/651: readlink d5/d7/l90 0 2024-09-13T17:05:58.951 INFO:tasks.workunit.client.1.smithi195.stdout:6/870: link d1c/df0/db9/d8c/dd1/ce3 d1c/d3e/d6b/df5/c11b 0 2024-09-13T17:05:58.952 INFO:tasks.workunit.client.0.smithi115.stdout:7/672: truncate d0/d2/d1e/d3d/d6c/f4c 1479961 0 2024-09-13T17:05:58.953 INFO:tasks.workunit.client.1.smithi195.stdout:0/960: dread d7/db/d11/f61 [0,4194304] 0 2024-09-13T17:05:58.953 INFO:tasks.workunit.client.1.smithi195.stdout:6/871: mkdir d1c/df0/db9/d8c/de5/d11c 0 2024-09-13T17:05:58.954 INFO:tasks.workunit.client.1.smithi195.stdout:1/975: write db/df/d13/da7/fb7 [2254213,79112] 0 2024-09-13T17:05:58.955 INFO:tasks.workunit.client.1.smithi195.stdout:1/976: dread db/d58/ffb [0,4194304] 0 2024-09-13T17:05:58.955 INFO:tasks.workunit.client.1.smithi195.stdout:1/977: fdatasync db/df/ff4 0 2024-09-13T17:05:58.955 INFO:tasks.workunit.client.1.smithi195.stdout:1/978: write db/df/f16 [2514394,3045] 0 2024-09-13T17:05:58.957 INFO:tasks.workunit.client.1.smithi195.stdout:0/961: rename d7/db/ld0 to d7/d87/d9b/d4e/d68/dda/l12f 0 2024-09-13T17:05:58.959 INFO:tasks.workunit.client.1.smithi195.stdout:6/872: creat d1c/df0/db9/d5e/f11d x:0 0 0 2024-09-13T17:05:58.959 INFO:tasks.workunit.client.0.smithi115.stdout:0/521: truncate d9/f18 7349688 0 2024-09-13T17:05:58.959 INFO:tasks.workunit.client.0.smithi115.stdout:0/522: dread - d9/f41 zero size 2024-09-13T17:05:58.959 INFO:tasks.workunit.client.0.smithi115.stdout:0/523: readlink d9/d27/l8d 0 2024-09-13T17:05:58.961 INFO:tasks.workunit.client.0.smithi115.stdout:7/673: symlink d0/d2/d67/d86/d94/d9b/dbb/lf3 0 2024-09-13T17:05:58.961 INFO:tasks.workunit.client.0.smithi115.stdout:7/674: write d0/d59/fb8 [4604504,73591] 0 2024-09-13T17:05:58.961 INFO:tasks.workunit.client.0.smithi115.stdout:7/675: stat d0/d2/d67/d86/d94/d9b/dbb/lf3 0 2024-09-13T17:05:58.961 INFO:tasks.workunit.client.0.smithi115.stdout:3/879: dwrite d1/d4b/d1a/d30/dc5/ff6 [0,4194304] 0 2024-09-13T17:05:58.962 INFO:tasks.workunit.client.1.smithi195.stdout:1/979: symlink db/df/d4d/d67/dd8/l14a 0 2024-09-13T17:05:58.962 INFO:tasks.workunit.client.1.smithi195.stdout:1/980: write db/d19/d37/fab [857088,63932] 0 2024-09-13T17:05:58.963 INFO:tasks.workunit.client.0.smithi115.stdout:0/524: link d9/d1d/d24/d26/d5d/f96 d9/d1d/d24/d26/d2c/f9d 0 2024-09-13T17:05:58.963 INFO:tasks.workunit.client.0.smithi115.stdout:3/880: dread d1/da6/fa9 [0,4194304] 0 2024-09-13T17:05:58.963 INFO:tasks.workunit.client.0.smithi115.stdout:3/881: dread - d1/d4b/d69/db6/dcc/f113 zero size 2024-09-13T17:05:58.968 INFO:tasks.workunit.client.0.smithi115.stdout:7/676: creat d0/d2/d67/d86/ff4 x:0 0 0 2024-09-13T17:05:58.968 INFO:tasks.workunit.client.0.smithi115.stdout:7/677: write d0/d2/d1e/d3d/d6c/d71/fe8 [111625,11920] 0 2024-09-13T17:05:58.969 INFO:tasks.workunit.client.0.smithi115.stdout:0/525: dread d9/d1d/d24/d26/f45 [0,4194304] 0 2024-09-13T17:05:58.969 INFO:tasks.workunit.client.0.smithi115.stdout:0/526: stat d9/d27/l8d 0 2024-09-13T17:05:58.969 INFO:tasks.workunit.client.0.smithi115.stdout:0/527: write d9/d1d/d24/d26/d2d/d30/d46/f49 [1746759,130152] 0 2024-09-13T17:05:58.973 INFO:tasks.workunit.client.0.smithi115.stdout:3/882: creat d1/d12/f127 x:0 0 0 2024-09-13T17:05:58.973 INFO:tasks.workunit.client.0.smithi115.stdout:3/883: chown d1/d4b/d1a/f4e 22758 1 2024-09-13T17:05:58.975 INFO:tasks.workunit.client.0.smithi115.stdout:5/634: write d19/d2e/d6b/f8a [4485256,20618] 0 2024-09-13T17:05:58.977 INFO:tasks.workunit.client.1.smithi195.stdout:1/981: creat db/df/d13/df6/f14b x:0 0 0 2024-09-13T17:05:58.977 INFO:tasks.workunit.client.1.smithi195.stdout:0/962: unlink d7/d88/d23/f27 0 2024-09-13T17:05:58.978 INFO:tasks.workunit.client.0.smithi115.stdout:7/678: fdatasync d0/d59/fb8 0 2024-09-13T17:05:58.979 INFO:tasks.workunit.client.0.smithi115.stdout:1/652: dwrite d5/d7/f21 [0,4194304] 0 2024-09-13T17:05:58.979 INFO:tasks.workunit.client.0.smithi115.stdout:1/653: dread - d5/d7/d33/d3a/f71 zero size 2024-09-13T17:05:58.979 INFO:tasks.workunit.client.0.smithi115.stdout:1/654: dread - d5/d60/d8e/fd3 zero size 2024-09-13T17:05:58.979 INFO:tasks.workunit.client.0.smithi115.stdout:1/655: write d5/d26/d2c/f32 [2024429,66099] 0 2024-09-13T17:05:58.980 INFO:tasks.workunit.client.1.smithi195.stdout:6/873: link d1c/d3e/f47 d1c/d24/d7f/f11e 0 2024-09-13T17:05:58.980 INFO:tasks.workunit.client.0.smithi115.stdout:7/679: read d0/d2/d1e/d3d/d82/fce [296922,74031] 0 2024-09-13T17:05:58.980 INFO:tasks.workunit.client.0.smithi115.stdout:7/680: chown d0/d2/d1e/d3d/d7c/fb9 5 1 2024-09-13T17:05:58.981 INFO:tasks.workunit.client.0.smithi115.stdout:7/681: dread d0/d59/fba [0,4194304] 0 2024-09-13T17:05:58.983 INFO:tasks.workunit.client.0.smithi115.stdout:5/635: rmdir d19/d21/d3a/d5d/da5 0 2024-09-13T17:05:58.983 INFO:tasks.workunit.client.1.smithi195.stdout:1/982: symlink db/d19/d37/d46/l14c 0 2024-09-13T17:05:58.985 INFO:tasks.workunit.client.1.smithi195.stdout:0/963: mknod d7/db/d9a/c130 0 2024-09-13T17:05:58.986 INFO:tasks.workunit.client.1.smithi195.stdout:6/874: getdents d1c/df0/db9/d30/d6f 0 2024-09-13T17:05:58.989 INFO:tasks.workunit.client.0.smithi115.stdout:3/884: getdents d1/d83/d9d/dba/d116 0 2024-09-13T17:05:58.990 INFO:tasks.workunit.client.1.smithi195.stdout:1/983: creat db/d60/f14d x:0 0 0 2024-09-13T17:05:58.990 INFO:tasks.workunit.client.1.smithi195.stdout:1/984: write db/d19/d5a/f139 [491644,62240] 0 2024-09-13T17:05:58.990 INFO:tasks.workunit.client.1.smithi195.stdout:1/985: readlink db/df/d13/da7/lcd 0 2024-09-13T17:05:58.992 INFO:tasks.workunit.client.1.smithi195.stdout:0/964: creat d7/d87/d9b/d56/f131 x:0 0 0 2024-09-13T17:05:58.992 INFO:tasks.workunit.client.0.smithi115.stdout:7/682: dread d0/d2/d1e/f32 [0,4194304] 0 2024-09-13T17:05:58.994 INFO:tasks.workunit.client.0.smithi115.stdout:5/636: write d19/d2c/faf [2251814,104118] 0 2024-09-13T17:05:58.996 INFO:tasks.workunit.client.1.smithi195.stdout:6/875: link f19 d1c/f11f 0 2024-09-13T17:05:58.997 INFO:tasks.workunit.client.0.smithi115.stdout:1/656: rmdir d5/d7/d33/d3a/db2 39 2024-09-13T17:05:58.999 INFO:tasks.workunit.client.0.smithi115.stdout:5/637: mknod d19/d21/d3a/cd5 0 2024-09-13T17:05:59.000 INFO:tasks.workunit.client.0.smithi115.stdout:1/657: mknod d5/d7/d5c/dc6/ce8 0 2024-09-13T17:05:59.000 INFO:tasks.workunit.client.1.smithi195.stdout:1/986: dread db/df/d51/f72 [0,4194304] 0 2024-09-13T17:05:59.002 INFO:tasks.workunit.client.0.smithi115.stdout:5/638: unlink d19/d2e/d6b/f78 0 2024-09-13T17:05:59.003 INFO:tasks.workunit.client.1.smithi195.stdout:2/983: sync 2024-09-13T17:05:59.003 INFO:tasks.workunit.client.1.smithi195.stdout:2/984: fsync d0/d4a/d47/d73/d75/d88/d8e/f121 0 2024-09-13T17:05:59.003 INFO:tasks.workunit.client.1.smithi195.stdout:2/985: write d0/d4a/d47/d73/d75/d88/d1e/fe7 [700572,130537] 0 2024-09-13T17:05:59.004 INFO:tasks.workunit.client.1.smithi195.stdout:1/987: creat db/d19/d37/d3e/f14e x:0 0 0 2024-09-13T17:05:59.006 INFO:tasks.workunit.client.0.smithi115.stdout:1/658: creat d5/d7/d33/d3a/db2/fe9 x:0 0 0 2024-09-13T17:05:59.007 INFO:tasks.workunit.client.0.smithi115.stdout:3/885: dwrite d1/d4b/d1a/d6e/fc4 [4194304,4194304] 0 2024-09-13T17:05:59.009 INFO:tasks.workunit.client.0.smithi115.stdout:0/528: write d9/f18 [6824202,83927] 0 2024-09-13T17:05:59.013 INFO:tasks.workunit.client.1.smithi195.stdout:2/986: mkdir d0/d3/d3d/d12c 0 2024-09-13T17:05:59.013 INFO:tasks.workunit.client.1.smithi195.stdout:2/987: write d0/faf [1181803,112812] 0 2024-09-13T17:05:59.013 INFO:tasks.workunit.client.1.smithi195.stdout:2/988: read d0/f21 [164900,8028] 0 2024-09-13T17:05:59.013 INFO:tasks.workunit.client.0.smithi115.stdout:5/639: link d19/d2c/dd0/c74 d19/d1d/cd6 0 2024-09-13T17:05:59.017 INFO:tasks.workunit.client.1.smithi195.stdout:1/988: getdents db/d19/d5a/d66/df2/d112 0 2024-09-13T17:05:59.017 INFO:tasks.workunit.client.1.smithi195.stdout:1/989: write db/df/d51/f72 [2877723,42202] 0 2024-09-13T17:05:59.017 INFO:tasks.workunit.client.0.smithi115.stdout:3/886: dread d1/d12/d14/fce [4194304,4194304] 0 2024-09-13T17:05:59.018 INFO:tasks.workunit.client.0.smithi115.stdout:1/659: dread d5/d7/d86/fb9 [0,4194304] 0 2024-09-13T17:05:59.018 INFO:tasks.workunit.client.0.smithi115.stdout:1/660: readlink d5/d7/l1e 0 2024-09-13T17:05:59.018 INFO:tasks.workunit.client.0.smithi115.stdout:1/661: chown d5/d3e/dc8 165428193 1 2024-09-13T17:05:59.018 INFO:tasks.workunit.client.1.smithi195.stdout:2/989: creat d0/d3/d3d/f12d x:0 0 0 2024-09-13T17:05:59.021 INFO:tasks.workunit.client.0.smithi115.stdout:0/529: unlink d9/d1d/d24/d26/d36/d48/c6f 0 2024-09-13T17:05:59.022 INFO:tasks.workunit.client.1.smithi195.stdout:0/965: dwrite d7/d50/da1/faf [0,4194304] 0 2024-09-13T17:05:59.023 INFO:tasks.workunit.client.0.smithi115.stdout:5/640: truncate d19/d2b/f6a 3967124 0 2024-09-13T17:05:59.023 INFO:tasks.workunit.client.1.smithi195.stdout:1/990: creat db/df/d4d/d67/d11d/f14f x:0 0 0 2024-09-13T17:05:59.023 INFO:tasks.workunit.client.1.smithi195.stdout:6/876: dwrite d1c/f11f [0,4194304] 0 2024-09-13T17:05:59.023 INFO:tasks.workunit.client.1.smithi195.stdout:6/877: truncate d1c/d24/d49/d5f/db1/d95/f107 979639 0 2024-09-13T17:05:59.026 INFO:tasks.workunit.client.0.smithi115.stdout:1/662: rename d5/d3e/d59/d96 to d5/d26/dc9/dea 0 2024-09-13T17:05:59.026 INFO:tasks.workunit.client.1.smithi195.stdout:1/991: dread db/df/d51/f53 [0,4194304] 0 2024-09-13T17:05:59.026 INFO:tasks.workunit.client.1.smithi195.stdout:1/992: write db/df/d13/da7/fc8 [936538,61670] 0 2024-09-13T17:05:59.028 INFO:tasks.workunit.client.0.smithi115.stdout:5/641: symlink d19/d2e/d6b/ld7 0 2024-09-13T17:05:59.030 INFO:tasks.workunit.client.1.smithi195.stdout:0/966: getdents d7/d87/d9b/d56/d46 0 2024-09-13T17:05:59.030 INFO:tasks.workunit.client.1.smithi195.stdout:0/967: creat d7/d87/d9b/d4e/d68/dda/f132 x:0 0 0 2024-09-13T17:05:59.031 INFO:tasks.workunit.client.1.smithi195.stdout:6/878: symlink d1c/df0/db9/d8c/dd1/d106/l120 0 2024-09-13T17:05:59.033 INFO:tasks.workunit.client.0.smithi115.stdout:1/663: truncate d5/d26/dc9/dea/fb4 1870253 0 2024-09-13T17:05:59.033 INFO:tasks.workunit.client.0.smithi115.stdout:1/664: write d5/d26/d2c/f32 [1175489,25467] 0 2024-09-13T17:05:59.036 INFO:tasks.workunit.client.0.smithi115.stdout:0/530: dread d9/d1d/d24/d26/d2d/d78/f7f [4194304,4194304] 0 2024-09-13T17:05:59.038 INFO:tasks.workunit.client.1.smithi195.stdout:0/968: creat d7/d88/d7c/f133 x:0 0 0 2024-09-13T17:05:59.038 INFO:tasks.workunit.client.1.smithi195.stdout:2/990: dwrite d0/d3/f82 [0,4194304] 0 2024-09-13T17:05:59.039 INFO:tasks.workunit.client.1.smithi195.stdout:2/991: truncate d0/d4a/d47/d73/d75/d88/d2c/f123 52491 0 2024-09-13T17:05:59.040 INFO:tasks.workunit.client.0.smithi115.stdout:3/887: dwrite d1/d4b/fe0 [0,4194304] 0 2024-09-13T17:05:59.042 INFO:tasks.workunit.client.1.smithi195.stdout:1/993: read db/d58/fd6 [2794458,31049] 0 2024-09-13T17:05:59.047 INFO:tasks.workunit.client.1.smithi195.stdout:2/992: symlink d0/d4a/d47/d73/d75/d88/d2c/d43/d84/dac/d11b/l12e 0 2024-09-13T17:05:59.047 INFO:tasks.workunit.client.1.smithi195.stdout:6/879: dwrite d1c/df0/db9/d8c/fee [0,4194304] 0 2024-09-13T17:05:59.050 INFO:tasks.workunit.client.1.smithi195.stdout:1/994: mknod db/d19/c150 0 2024-09-13T17:05:59.050 INFO:tasks.workunit.client.1.smithi195.stdout:1/995: readlink db/d19/d37/d3e/l131 0 2024-09-13T17:05:59.050 INFO:tasks.workunit.client.0.smithi115.stdout:0/531: read d9/d1d/d24/d26/d36/d48/f8a [743934,131071] 0 2024-09-13T17:05:59.053 INFO:tasks.workunit.client.0.smithi115.stdout:0/532: truncate d9/d1d/d24/d26/d2d/d30/f5a 139243 0 2024-09-13T17:05:59.054 INFO:tasks.workunit.client.1.smithi195.stdout:1/996: symlink db/d19/d37/d3e/l151 0 2024-09-13T17:05:59.054 INFO:tasks.workunit.client.1.smithi195.stdout:1/997: write db/df/f1f [3373715,75894] 0 2024-09-13T17:05:59.055 INFO:tasks.workunit.client.1.smithi195.stdout:1/998: creat db/d11e/f152 x:0 0 0 2024-09-13T17:05:59.055 INFO:tasks.workunit.client.0.smithi115.stdout:0/533: mkdir d9/d27/d88/d9e 0 2024-09-13T17:05:59.055 INFO:tasks.workunit.client.1.smithi195.stdout:6/880: dread d1c/df0/db9/d30/f92 [0,4194304] 0 2024-09-13T17:05:59.055 INFO:tasks.workunit.client.1.smithi195.stdout:6/881: dread - d1c/d24/d49/d5f/d85/fe8 zero size 2024-09-13T17:05:59.057 INFO:tasks.workunit.client.1.smithi195.stdout:1/999: symlink db/d19/d5a/db0/d128/l153 0 2024-09-13T17:05:59.066 INFO:tasks.workunit.client.0.smithi115.stdout:3/888: dwrite d1/d4b/d69/f77 [0,4194304] 0 2024-09-13T17:05:59.066 INFO:tasks.workunit.client.0.smithi115.stdout:3/889: write d1/d4b/d69/d7b/dbb/f108 [478494,1425] 0 2024-09-13T17:05:59.066 INFO:tasks.workunit.client.1.smithi195.stdout:6/882: write d1c/d24/d49/d5f/d85/d8f/dc0/fc1 [1678526,31810] 0 2024-09-13T17:05:59.067 INFO:tasks.workunit.client.1.smithi195.stdout:6/883: chown d1c/d24/d49/d5f/l6e 807789 1 2024-09-13T17:05:59.068 INFO:tasks.workunit.client.1.smithi195.stdout:6/884: truncate d1c/f63 1502789 0 2024-09-13T17:05:59.070 INFO:tasks.workunit.client.1.smithi195.stdout:6/885: mknod d1c/df0/c121 0 2024-09-13T17:05:59.071 INFO:tasks.workunit.client.1.smithi195.stdout:6/886: truncate d1c/df0/db9/d8c/de5/f103 5383656 0 2024-09-13T17:05:59.072 INFO:tasks.workunit.client.1.smithi195.stdout:6/887: getdents d1c 0 2024-09-13T17:05:59.072 INFO:tasks.workunit.client.0.smithi115.stdout:0/534: dwrite d9/f1f [8388608,4194304] 0 2024-09-13T17:05:59.073 INFO:tasks.workunit.client.0.smithi115.stdout:0/535: creat d9/d1d/d24/d26/d2d/d30/f9f x:0 0 0 2024-09-13T17:05:59.073 INFO:tasks.workunit.client.0.smithi115.stdout:0/536: creat d9/d1b/fa0 x:0 0 0 2024-09-13T17:05:59.075 INFO:tasks.workunit.client.0.smithi115.stdout:0/537: symlink d9/d27/d88/d9e/la1 0 2024-09-13T17:05:59.076 INFO:tasks.workunit.client.0.smithi115.stdout:0/538: creat d9/d27/d88/fa2 x:0 0 0 2024-09-13T17:05:59.076 INFO:tasks.workunit.client.0.smithi115.stdout:0/539: creat d9/d1d/d24/d26/d5d/fa3 x:0 0 0 2024-09-13T17:05:59.077 INFO:tasks.workunit.client.0.smithi115.stdout:0/540: unlink d9/f17 0 2024-09-13T17:05:59.077 INFO:tasks.workunit.client.0.smithi115.stdout:0/541: chown d9/d1d/d24/d26/d2d/d30/d5c/c65 6 1 2024-09-13T17:05:59.077 INFO:tasks.workunit.client.0.smithi115.stdout:0/542: creat d9/d1d/d24/d26/d36/d48/fa4 x:0 0 0 2024-09-13T17:05:59.079 INFO:tasks.workunit.client.1.smithi195.stdout:6/888: dread d1c/d24/d49/d5f/d35/f39 [0,4194304] 0 2024-09-13T17:05:59.080 INFO:tasks.workunit.client.1.smithi195.stdout:6/889: symlink d1c/d24/d49/d5f/d35/d88/df8/l122 0 2024-09-13T17:05:59.080 INFO:tasks.workunit.client.1.smithi195.stdout:6/890: write d1c/df0/db9/f40 [716316,78658] 0 2024-09-13T17:05:59.080 INFO:tasks.workunit.client.1.smithi195.stdout:6/891: write d1c/df0/db9/d30/d6f/f10e [408045,99964] 0 2024-09-13T17:05:59.081 INFO:tasks.workunit.client.0.smithi115.stdout:1/665: dwrite d5/d7/d33/d3a/fac [0,4194304] 0 2024-09-13T17:05:59.081 INFO:tasks.workunit.client.1.smithi195.stdout:6/892: mknod d1c/d3e/c123 0 2024-09-13T17:05:59.081 INFO:tasks.workunit.client.1.smithi195.stdout:6/893: write d1c/d24/d49/d5f/d85/da5/ffc [346723,52867] 0 2024-09-13T17:05:59.083 INFO:tasks.workunit.client.0.smithi115.stdout:1/666: rename d5/d3e/d59/f75 to d5/d7/d33/d3a/db2/de2/feb 0 2024-09-13T17:05:59.083 INFO:tasks.workunit.client.0.smithi115.stdout:1/667: truncate d5/d7/f9f 565649 0 2024-09-13T17:05:59.085 INFO:tasks.workunit.client.1.smithi195.stdout:6/894: rename d1c/d24/c52 to d1c/d24/d49/d5f/db1/c124 0 2024-09-13T17:05:59.085 INFO:tasks.workunit.client.0.smithi115.stdout:1/668: mkdir d5/d7/d86/dec 0 2024-09-13T17:05:59.086 INFO:tasks.workunit.client.1.smithi195.stdout:6/895: mkdir d1c/d24/d49/d5f/d125 0 2024-09-13T17:05:59.089 INFO:tasks.workunit.client.0.smithi115.stdout:3/890: dwrite d1/d4b/d1a/d6e/dd9/f8e [4194304,4194304] 0 2024-09-13T17:05:59.089 INFO:tasks.workunit.client.1.smithi195.stdout:2/993: dwrite d0/faf [0,4194304] 0 2024-09-13T17:05:59.092 INFO:tasks.workunit.client.0.smithi115.stdout:3/891: rmdir d1/d4b/d69/d7b/d8b/d90/deb/d10a 0 2024-09-13T17:05:59.092 INFO:tasks.workunit.client.0.smithi115.stdout:3/892: fsync d1/d4b/f126 0 2024-09-13T17:05:59.095 INFO:tasks.workunit.client.1.smithi195.stdout:2/994: link d0/d3/c40 d0/d4a/c12f 0 2024-09-13T17:05:59.096 INFO:tasks.workunit.client.1.smithi195.stdout:0/969: dread d7/d88/f7e [0,4194304] 0 2024-09-13T17:05:59.099 INFO:tasks.workunit.client.1.smithi195.stdout:2/995: creat d0/d3/f130 x:0 0 0 2024-09-13T17:05:59.101 INFO:tasks.workunit.client.1.smithi195.stdout:0/970: creat d7/d50/f134 x:0 0 0 2024-09-13T17:05:59.102 INFO:tasks.workunit.client.1.smithi195.stdout:6/896: read d1c/d3e/f47 [2263708,80762] 0 2024-09-13T17:05:59.102 INFO:tasks.workunit.client.1.smithi195.stdout:6/897: dread - d1c/df0/db9/d30/f80 zero size 2024-09-13T17:05:59.102 INFO:tasks.workunit.client.1.smithi195.stdout:6/898: chown d1c/df0/db9/d30/lb0 873 1 2024-09-13T17:05:59.102 INFO:tasks.workunit.client.1.smithi195.stdout:2/996: mknod d0/d4a/d47/d73/d75/d7e/d12b/c131 0 2024-09-13T17:05:59.105 INFO:tasks.workunit.client.1.smithi195.stdout:6/899: unlink d1c/d24/d49/d5f/db1/dcd/da9/c117 0 2024-09-13T17:05:59.105 INFO:tasks.workunit.client.1.smithi195.stdout:6/900: fdatasync d1c/d24/d49/d5f/db1/d95/fc5 0 2024-09-13T17:05:59.106 INFO:tasks.workunit.client.0.smithi115.stdout:3/893: rename d1/d4b/d1a/d6e/f75 to d1/da6/f128 0 2024-09-13T17:05:59.107 INFO:tasks.workunit.client.1.smithi195.stdout:0/971: getdents d7/d50/da2/de8 0 2024-09-13T17:05:59.109 INFO:tasks.workunit.client.1.smithi195.stdout:6/901: rename d1c/d24/c26 to d1c/d24/d49/c126 0 2024-09-13T17:05:59.111 INFO:tasks.workunit.client.1.smithi195.stdout:0/972: mknod d7/d87/d9b/d56/d4d/d10f/c135 0 2024-09-13T17:05:59.113 INFO:tasks.workunit.client.1.smithi195.stdout:6/902: rename d1c/d24/d49/d5f/c81 to d1c/df0/db9/d8c/dd1/d106/c127 0 2024-09-13T17:05:59.118 INFO:tasks.workunit.client.0.smithi115.stdout:0/543: rmdir d9/d27 39 2024-09-13T17:05:59.118 INFO:tasks.workunit.client.0.smithi115.stdout:0/544: chown d9/d1d/d24/c82 748 1 2024-09-13T17:05:59.119 INFO:tasks.workunit.client.1.smithi195.stdout:2/997: dwrite d0/d4a/f3a [0,4194304] 0 2024-09-13T17:05:59.122 INFO:tasks.workunit.client.1.smithi195.stdout:2/998: readlink d0/d4a/d47/d73/d75/d88/d2c/lc9 0 2024-09-13T17:05:59.122 INFO:tasks.workunit.client.1.smithi195.stdout:2/999: fdatasync d0/d4a/d47/d73/d75/d88/d2c/d43/fcd 0 2024-09-13T17:05:59.126 INFO:tasks.workunit.client.0.smithi115.stdout:1/669: truncate d5/d26/d2c/f32 1457127 0 2024-09-13T17:05:59.127 INFO:tasks.workunit.client.0.smithi115.stdout:1/670: mkdir d5/d3e/dc8/ded 0 2024-09-13T17:05:59.128 INFO:tasks.workunit.client.1.smithi195.stdout:0/973: write d7/d88/d23/f62 [1737941,22529] 0 2024-09-13T17:05:59.128 INFO:tasks.workunit.client.1.smithi195.stdout:0/974: truncate d7/d88/fe2 464174 0 2024-09-13T17:05:59.128 INFO:tasks.workunit.client.1.smithi195.stdout:0/975: fdatasync d7/f103 0 2024-09-13T17:05:59.128 INFO:tasks.workunit.client.1.smithi195.stdout:0/976: creat d7/d87/d9b/d56/f136 x:0 0 0 2024-09-13T17:05:59.128 INFO:tasks.workunit.client.0.smithi115.stdout:0/545: dread d9/d1d/d24/d26/d2d/d78/f7f [0,4194304] 0 2024-09-13T17:05:59.130 INFO:tasks.workunit.client.1.smithi195.stdout:0/977: truncate d7/db/d38/d5d/f8f 1581120 0 2024-09-13T17:05:59.131 INFO:tasks.workunit.client.0.smithi115.stdout:0/546: symlink d9/d27/la5 0 2024-09-13T17:05:59.131 INFO:tasks.workunit.client.0.smithi115.stdout:0/547: readlink d9/d1d/d24/d26/d5d/l63 0 2024-09-13T17:05:59.135 INFO:tasks.workunit.client.1.smithi195.stdout:6/903: dwrite d1c/d3e/fa3 [0,4194304] 0 2024-09-13T17:05:59.140 INFO:tasks.workunit.client.1.smithi195.stdout:6/904: mkdir d1c/d7d/d128 0 2024-09-13T17:05:59.142 INFO:tasks.workunit.client.1.smithi195.stdout:6/905: unlink d1c/d24/d49/d5f/l4f 0 2024-09-13T17:05:59.143 INFO:tasks.workunit.client.1.smithi195.stdout:6/906: creat d1c/d24/d49/d5f/db1/dfb/f129 x:0 0 0 2024-09-13T17:05:59.144 INFO:tasks.workunit.client.0.smithi115.stdout:1/671: dread d5/d7/f16 [0,4194304] 0 2024-09-13T17:05:59.145 INFO:tasks.workunit.client.0.smithi115.stdout:1/672: chown d5/d26/f6e 630237212 1 2024-09-13T17:05:59.145 INFO:tasks.workunit.client.0.smithi115.stdout:1/673: write d5/d7/d33/fce [465774,83026] 0 2024-09-13T17:05:59.145 INFO:tasks.workunit.client.0.smithi115.stdout:1/674: stat d5/d26/d2c/d62/ce6 0 2024-09-13T17:05:59.145 INFO:tasks.workunit.client.0.smithi115.stdout:3/894: dwrite d1/d12/fbd [0,4194304] 0 2024-09-13T17:05:59.145 INFO:tasks.workunit.client.0.smithi115.stdout:0/548: dread d9/d1d/d24/f72 [0,4194304] 0 2024-09-13T17:05:59.146 INFO:tasks.workunit.client.1.smithi195.stdout:6/907: link d1c/d24/d49/d5f/d35/c3b d1c/d3e/d6b/df5/d115/c12a 0 2024-09-13T17:05:59.146 INFO:tasks.workunit.client.1.smithi195.stdout:6/908: chown d1c/c2f 2882013 1 2024-09-13T17:05:59.147 INFO:tasks.workunit.client.1.smithi195.stdout:0/978: dwrite d7/d87/d9b/d4e/d68/dda/f12c [0,4194304] 0 2024-09-13T17:05:59.147 INFO:tasks.workunit.client.1.smithi195.stdout:0/979: fdatasync d7/d87/d9b/d56/d46/fc2 0 2024-09-13T17:05:59.150 INFO:tasks.workunit.client.1.smithi195.stdout:6/909: creat d1c/d3e/d6b/df5/f12b x:0 0 0 2024-09-13T17:05:59.153 INFO:tasks.workunit.client.0.smithi115.stdout:3/895: unlink d1/d12/f45 0 2024-09-13T17:05:59.155 INFO:tasks.workunit.client.0.smithi115.stdout:1/675: symlink d5/d7/lee 0 2024-09-13T17:05:59.157 INFO:tasks.workunit.client.1.smithi195.stdout:0/980: mknod d7/db/c137 0 2024-09-13T17:05:59.157 INFO:tasks.workunit.client.1.smithi195.stdout:6/910: mkdir d1c/d7d/d128/d12c 0 2024-09-13T17:05:59.157 INFO:tasks.workunit.client.1.smithi195.stdout:6/911: creat d1c/d24/d49/f12d x:0 0 0 2024-09-13T17:05:59.159 INFO:tasks.workunit.client.1.smithi195.stdout:6/912: mkdir d1c/df0/db9/d5e/dd9/d12e 0 2024-09-13T17:05:59.159 INFO:tasks.workunit.client.1.smithi195.stdout:6/913: fsync d1c/df0/db9/d30/f57 0 2024-09-13T17:05:59.160 INFO:tasks.workunit.client.0.smithi115.stdout:0/549: dwrite d9/d1d/d24/d26/d2d/d78/f8b [0,4194304] 0 2024-09-13T17:05:59.160 INFO:tasks.workunit.client.0.smithi115.stdout:0/550: readlink d9/d1d/d24/d26/d2d/d30/l80 0 2024-09-13T17:05:59.160 INFO:tasks.workunit.client.0.smithi115.stdout:0/551: fsync d9/d1d/d24/d26/d36/f3d 0 2024-09-13T17:05:59.160 INFO:tasks.workunit.client.0.smithi115.stdout:0/552: creat d9/d1d/d24/fa6 x:0 0 0 2024-09-13T17:05:59.161 INFO:tasks.workunit.client.1.smithi195.stdout:6/914: getdents d1c/d24/d49/d5f/d85/d8f/dc0 0 2024-09-13T17:05:59.161 INFO:tasks.workunit.client.1.smithi195.stdout:6/915: write d1c/df0/fce [787353,27290] 0 2024-09-13T17:05:59.163 INFO:tasks.workunit.client.1.smithi195.stdout:0/981: dread d7/d87/d9b/d56/fd3 [0,4194304] 0 2024-09-13T17:05:59.163 INFO:tasks.workunit.client.1.smithi195.stdout:0/982: fsync d7/db/d38/d4f/ffb 0 2024-09-13T17:05:59.165 INFO:tasks.workunit.client.0.smithi115.stdout:0/553: symlink d9/d1d/la7 0 2024-09-13T17:05:59.165 INFO:tasks.workunit.client.0.smithi115.stdout:3/896: write d1/d4b/fac [6047651,71256] 0 2024-09-13T17:05:59.166 INFO:tasks.workunit.client.1.smithi195.stdout:0/983: symlink d7/d87/d9b/d4e/d68/l138 0 2024-09-13T17:05:59.167 INFO:tasks.workunit.client.1.smithi195.stdout:0/984: readlink d7/l1d 0 2024-09-13T17:05:59.170 INFO:tasks.workunit.client.1.smithi195.stdout:6/916: write d1c/df0/db9/d30/f57 [4070367,24455] 0 2024-09-13T17:05:59.175 INFO:tasks.workunit.client.1.smithi195.stdout:6/917: rename d1c/df0/db9/d8c/f118 to d1c/d3e/d6b/dd2/f12f 0 2024-09-13T17:05:59.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:58 smithi115 ceph-mon[27708]: pgmap v18: 65 pgs: 65 active+clean; 2.6 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 233 MiB/s rd, 277 MiB/s wr, 401 op/s 2024-09-13T17:05:59.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:05:58 smithi115 ceph-mon[27708]: from='mgr.24317 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:05:59.184 INFO:tasks.workunit.client.0.smithi115.stdout:1/676: dwrite d5/d7/d33/f53 [0,4194304] 0 2024-09-13T17:05:59.185 INFO:tasks.workunit.client.0.smithi115.stdout:1/677: rmdir d5/d7/d86/dda 0 2024-09-13T17:05:59.198 INFO:tasks.workunit.client.0.smithi115.stdout:0/554: dwrite d9/f1f [12582912,4194304] 0 2024-09-13T17:05:59.198 INFO:tasks.workunit.client.0.smithi115.stdout:0/555: write d9/d1d/d24/d26/d36/f3d [1457547,110136] 0 2024-09-13T17:05:59.200 INFO:tasks.workunit.client.0.smithi115.stdout:0/556: rename d9/c11 to d9/d1d/d24/d26/d2d/d30/d5c/ca8 0 2024-09-13T17:05:59.200 INFO:tasks.workunit.client.0.smithi115.stdout:0/557: truncate d9/d1d/d24/d26/f45 8625494 0 2024-09-13T17:05:59.201 INFO:tasks.workunit.client.0.smithi115.stdout:0/558: link d9/d27/d88/d9e/la1 d9/d1d/d24/d26/la9 0 2024-09-13T17:05:59.201 INFO:tasks.workunit.client.0.smithi115.stdout:0/559: chown d9/d1d/d24/f72 104 1 2024-09-13T17:05:59.202 INFO:tasks.workunit.client.0.smithi115.stdout:0/560: link d9/d1d/d24/d26/d36/d48/f8a d9/d27/d88/d99/faa 0 2024-09-13T17:05:59.202 INFO:tasks.workunit.client.0.smithi115.stdout:0/561: chown d9/d1d/d24/d26/d5d 43888 1 2024-09-13T17:05:59.202 INFO:tasks.workunit.client.0.smithi115.stdout:0/562: symlink d9/d1d/d24/d26/d2d/d30/d46/lab 0 2024-09-13T17:05:59.202 INFO:tasks.workunit.client.0.smithi115.stdout:0/563: chown d9/d1d/d24/d26/d5d/f96 578 1 2024-09-13T17:05:59.210 INFO:tasks.workunit.client.1.smithi195.stdout:0/985: dwrite d7/d87/d9b/d56/d46/f91 [4194304,4194304] 0 2024-09-13T17:05:59.210 INFO:tasks.workunit.client.1.smithi195.stdout:0/986: truncate d7/db/d38/f76 5968689 0 2024-09-13T17:05:59.211 INFO:tasks.workunit.client.1.smithi195.stdout:6/918: dwrite d1c/df0/db9/d30/fec [0,4194304] 0 2024-09-13T17:05:59.211 INFO:tasks.workunit.client.1.smithi195.stdout:6/919: chown d1c/d24/d49/d5f/db1/dfb 743 1 2024-09-13T17:05:59.212 INFO:tasks.workunit.client.0.smithi115.stdout:3/897: dwrite d1/d4b/d69/d7b/f9f [0,4194304] 0 2024-09-13T17:05:59.212 INFO:tasks.workunit.client.0.smithi115.stdout:1/678: dwrite d5/d60/d7d/fb6 [0,4194304] 0 2024-09-13T17:05:59.213 INFO:tasks.workunit.client.0.smithi115.stdout:3/898: symlink d1/d4b/d69/d7b/d8b/d90/deb/l129 0 2024-09-13T17:05:59.214 INFO:tasks.workunit.client.0.smithi115.stdout:3/899: dread - d1/d4b/d69/d7b/dbb/fd6 zero size 2024-09-13T17:05:59.214 INFO:tasks.workunit.client.0.smithi115.stdout:3/900: write d1/d12/d14/fad [1536594,40617] 0 2024-09-13T17:05:59.214 INFO:tasks.workunit.client.1.smithi195.stdout:6/920: symlink d1c/d24/d7f/l130 0 2024-09-13T17:05:59.214 INFO:tasks.workunit.client.1.smithi195.stdout:6/921: chown d1c/fa1 140387 1 2024-09-13T17:05:59.214 INFO:tasks.workunit.client.1.smithi195.stdout:6/922: getdents d1c/df0/db9/d5e/dd9/d12e 0 2024-09-13T17:05:59.215 INFO:tasks.workunit.client.0.smithi115.stdout:1/679: rename d5/d3e/ca0 to d5/d7/d5c/dbc/cef 0 2024-09-13T17:05:59.217 INFO:tasks.workunit.client.0.smithi115.stdout:3/901: mknod d1/d83/c12a 0 2024-09-13T17:05:59.219 INFO:tasks.workunit.client.0.smithi115.stdout:9/497: sync 2024-09-13T17:05:59.219 INFO:tasks.workunit.client.0.smithi115.stdout:6/689: sync 2024-09-13T17:05:59.220 INFO:tasks.workunit.client.0.smithi115.stdout:6/690: fsync d8/d33/d40/d4c/f71 0 2024-09-13T17:05:59.220 INFO:tasks.workunit.client.0.smithi115.stdout:0/564: dwrite d9/d1d/d24/d26/d5d/f87 [0,4194304] 0 2024-09-13T17:05:59.220 INFO:tasks.workunit.client.0.smithi115.stdout:0/565: chown d9/d1d/d24/d26/d5d 1807529727 1 2024-09-13T17:05:59.220 INFO:tasks.workunit.client.0.smithi115.stdout:0/566: dread - d9/f41 zero size 2024-09-13T17:05:59.221 INFO:tasks.workunit.client.0.smithi115.stdout:9/498: creat d0/d21/d65/d79/fa9 x:0 0 0 2024-09-13T17:05:59.224 INFO:tasks.workunit.client.1.smithi195.stdout:0/987: write d7/db/d38/f76 [1177055,99387] 0 2024-09-13T17:05:59.224 INFO:tasks.workunit.client.1.smithi195.stdout:0/988: write d7/d50/f1c [106778,4392] 0 2024-09-13T17:05:59.227 INFO:tasks.workunit.client.0.smithi115.stdout:6/691: creat d8/db/d49/d8d/fd5 x:0 0 0 2024-09-13T17:05:59.230 INFO:tasks.workunit.client.0.smithi115.stdout:0/567: truncate d9/d1d/d24/d26/d2d/d30/d46/f49 806558 0 2024-09-13T17:05:59.237 INFO:tasks.workunit.client.0.smithi115.stdout:3/902: dread d1/d4b/d1a/d6e/dd9/f62 [0,4194304] 0 2024-09-13T17:05:59.237 INFO:tasks.workunit.client.0.smithi115.stdout:9/499: rename d0/d21/d42/fa5 to d0/de/d10/faa 0 2024-09-13T17:05:59.237 INFO:tasks.workunit.client.0.smithi115.stdout:9/500: creat d0/d21/d4f/fab x:0 0 0 2024-09-13T17:05:59.241 INFO:tasks.workunit.client.0.smithi115.stdout:9/501: symlink d0/d21/d95/lac 0 2024-09-13T17:05:59.246 INFO:tasks.workunit.client.0.smithi115.stdout:3/903: write d1/da6/f128 [5645569,27646] 0 2024-09-13T17:05:59.246 INFO:tasks.workunit.client.0.smithi115.stdout:3/904: chown d1/d12/d14/l111 439200 1 2024-09-13T17:05:59.246 INFO:tasks.workunit.client.0.smithi115.stdout:9/502: mkdir d0/d21/d65/d6f/dad 0 2024-09-13T17:05:59.246 INFO:tasks.workunit.client.0.smithi115.stdout:9/503: fdatasync d0/d21/f58 0 2024-09-13T17:05:59.246 INFO:tasks.workunit.client.0.smithi115.stdout:9/504: truncate d0/de/d10/d15/d86/f8b 1038382 0 2024-09-13T17:05:59.247 INFO:tasks.workunit.client.1.smithi195.stdout:0/989: unlink d7/d50/da1/cdc 0 2024-09-13T17:05:59.257 INFO:tasks.workunit.client.0.smithi115.stdout:6/692: dwrite d8/d33/d40/d67/db4/d24/d53/d6a/fcc [0,4194304] 0 2024-09-13T17:05:59.259 INFO:tasks.workunit.client.0.smithi115.stdout:1/680: dwrite d5/d7/f16 [4194304,4194304] 0 2024-09-13T17:05:59.259 INFO:tasks.workunit.client.0.smithi115.stdout:3/905: write d1/d12/d14/fcd [1090691,14290] 0 2024-09-13T17:05:59.260 INFO:tasks.workunit.client.0.smithi115.stdout:9/505: dread d0/de/d10/f3e [0,4194304] 0 2024-09-13T17:05:59.260 INFO:tasks.workunit.client.0.smithi115.stdout:9/506: fdatasync d0/d21/d42/f50 0 2024-09-13T17:05:59.262 INFO:tasks.workunit.client.0.smithi115.stdout:6/693: creat d8/d33/d40/d67/db4/d24/d17/d9b/fd6 x:0 0 0 2024-09-13T17:05:59.262 INFO:tasks.workunit.client.0.smithi115.stdout:6/694: fdatasync d8/db/dd/fba 0 2024-09-13T17:05:59.262 INFO:tasks.workunit.client.0.smithi115.stdout:6/695: truncate d8/d33/f57 222077 0 2024-09-13T17:05:59.262 INFO:tasks.workunit.client.0.smithi115.stdout:0/568: dwrite d9/d1d/d24/d26/d2d/d78/f7f [0,4194304] 0 2024-09-13T17:05:59.264 INFO:tasks.workunit.client.0.smithi115.stdout:1/681: rename d5/d7/d33/l3b to d5/d3e/d59/lf0 0 2024-09-13T17:05:59.265 INFO:tasks.workunit.client.0.smithi115.stdout:9/507: mknod d0/d34/cae 0 2024-09-13T17:05:59.268 INFO:tasks.workunit.client.0.smithi115.stdout:3/906: write d1/d4b/d1a/d6e/dd9/f8e [2802942,111508] 0 2024-09-13T17:05:59.272 INFO:tasks.workunit.client.1.smithi195.stdout:0/990: dwrite d7/d87/d9b/d56/d46/f6e [4194304,4194304] 0 2024-09-13T17:05:59.274 INFO:tasks.workunit.client.0.smithi115.stdout:0/569: creat d9/d27/fac x:0 0 0 2024-09-13T17:05:59.277 INFO:tasks.workunit.client.0.smithi115.stdout:3/907: write d1/d4b/f21 [3197324,64524] 0 2024-09-13T17:05:59.277 INFO:tasks.workunit.client.0.smithi115.stdout:3/908: stat d1/d12/d14/f51 0 2024-09-13T17:05:59.278 INFO:tasks.workunit.client.1.smithi195.stdout:0/991: rename d7/d87/d9b/d56/d46/f9e to d7/d88/d7c/f139 0 2024-09-13T17:05:59.279 INFO:tasks.workunit.client.0.smithi115.stdout:9/508: truncate d0/fb 2109432 0 2024-09-13T17:05:59.279 INFO:tasks.workunit.client.0.smithi115.stdout:9/509: chown d0/de/d37/f38 15901951 1 2024-09-13T17:05:59.279 INFO:tasks.workunit.client.0.smithi115.stdout:9/510: dread - d0/d21/d42/f81 zero size 2024-09-13T17:05:59.280 INFO:tasks.workunit.client.0.smithi115.stdout:1/682: write d5/f6b [2522679,86366] 0 2024-09-13T17:05:59.281 INFO:tasks.workunit.client.0.smithi115.stdout:6/696: unlink d8/db/c88 0 2024-09-13T17:05:59.281 INFO:tasks.workunit.client.0.smithi115.stdout:6/697: getdents d8/d33/d7f/d99 0 2024-09-13T17:05:59.285 INFO:tasks.workunit.client.0.smithi115.stdout:9/511: creat d0/faf x:0 0 0 2024-09-13T17:05:59.285 INFO:tasks.workunit.client.0.smithi115.stdout:9/512: write d0/f3 [2419367,122599] 0 2024-09-13T17:05:59.285 INFO:tasks.workunit.client.0.smithi115.stdout:9/513: creat d0/d21/d65/d6f/fb0 x:0 0 0 2024-09-13T17:05:59.285 INFO:tasks.workunit.client.0.smithi115.stdout:9/514: fdatasync d0/de/d10/d15/f3a 0 2024-09-13T17:05:59.285 INFO:tasks.workunit.client.0.smithi115.stdout:9/515: readlink d0/d21/d65/l77 0 2024-09-13T17:05:59.285 INFO:tasks.workunit.client.0.smithi115.stdout:1/683: dread d5/d26/f6e [0,4194304] 0 2024-09-13T17:05:59.286 INFO:tasks.workunit.client.0.smithi115.stdout:6/698: mkdir d8/d13/dd7 0 2024-09-13T17:05:59.289 INFO:tasks.workunit.client.0.smithi115.stdout:9/516: truncate d0/de/d37/f41 7858590 0 2024-09-13T17:05:59.291 INFO:tasks.workunit.client.0.smithi115.stdout:1/684: getdents d5/d7/d5c 0 2024-09-13T17:05:59.292 INFO:tasks.workunit.client.1.smithi195.stdout:0/992: dread d7/d87/d9b/d4e/d68/f79 [0,4194304] 0 2024-09-13T17:05:59.297 INFO:tasks.workunit.client.0.smithi115.stdout:1/685: rename d5/d7/d33/f53 to d5/d26/dc9/dea/ff1 0 2024-09-13T17:05:59.297 INFO:tasks.workunit.client.0.smithi115.stdout:1/686: write d5/d7/f15 [1751612,114663] 0 2024-09-13T17:05:59.297 INFO:tasks.workunit.client.0.smithi115.stdout:3/909: dwrite d1/da6/faf [4194304,4194304] 0 2024-09-13T17:05:59.298 INFO:tasks.workunit.client.0.smithi115.stdout:3/910: write d1/d4b/d1a/d30/f125 [211384,93376] 0 2024-09-13T17:05:59.299 INFO:tasks.workunit.client.0.smithi115.stdout:1/687: truncate d5/f6 473876 0 2024-09-13T17:05:59.303 INFO:tasks.workunit.client.0.smithi115.stdout:3/911: mkdir d1/d4b/d69/d7b/d12b 0 2024-09-13T17:05:59.304 INFO:tasks.workunit.client.0.smithi115.stdout:1/688: mknod d5/d7/d5c/dc6/dd4/cf2 0 2024-09-13T17:05:59.308 INFO:tasks.workunit.client.0.smithi115.stdout:1/689: rename d5/c88 to d5/d7/d33/d3a/db2/cf3 0 2024-09-13T17:05:59.308 INFO:tasks.workunit.client.0.smithi115.stdout:1/690: chown d5/d60/d8e/l9c 409657633 1 2024-09-13T17:05:59.308 INFO:tasks.workunit.client.0.smithi115.stdout:1/691: write d5/d3e/da1/fd6 [354356,45874] 0 2024-09-13T17:05:59.309 INFO:tasks.workunit.client.0.smithi115.stdout:1/692: mkdir d5/d7/d33/d3a/dc3/ddd/df4 0 2024-09-13T17:05:59.314 INFO:tasks.workunit.client.0.smithi115.stdout:6/699: dwrite d8/db/d1d/f18 [0,4194304] 0 2024-09-13T17:05:59.315 INFO:tasks.workunit.client.0.smithi115.stdout:6/700: fsync d8/d33/d40/d67/db4/d24/f79 0 2024-09-13T17:05:59.315 INFO:tasks.workunit.client.0.smithi115.stdout:9/517: dwrite d0/d21/d4f/fa4 [0,4194304] 0 2024-09-13T17:05:59.318 INFO:tasks.workunit.client.0.smithi115.stdout:6/701: creat d8/db/fd8 x:0 0 0 2024-09-13T17:05:59.318 INFO:tasks.workunit.client.0.smithi115.stdout:6/702: stat d8/d33/lad 0 2024-09-13T17:05:59.321 INFO:tasks.workunit.client.1.smithi195.stdout:6/923: sync 2024-09-13T17:05:59.325 INFO:tasks.workunit.client.1.smithi195.stdout:0/993: rmdir d7 39 2024-09-13T17:05:59.326 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:58 smithi195 ceph-mon[34981]: pgmap v18: 65 pgs: 65 active+clean; 2.6 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 233 MiB/s rd, 277 MiB/s wr, 401 op/s 2024-09-13T17:05:59.326 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:05:58 smithi195 ceph-mon[34981]: from='mgr.24317 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:05:59.328 INFO:tasks.workunit.client.1.smithi195.stdout:6/924: creat d1c/d24/d49/d5f/db1/dcd/da9/f131 x:0 0 0 2024-09-13T17:05:59.328 INFO:tasks.workunit.client.1.smithi195.stdout:6/925: creat d1c/d24/d49/d5f/db1/d95/dda/f132 x:0 0 0 2024-09-13T17:05:59.328 INFO:tasks.workunit.client.1.smithi195.stdout:6/926: truncate d1c/d24/d49/d5f/db1/d95/dda/f132 430386 0 2024-09-13T17:05:59.330 INFO:tasks.workunit.client.0.smithi115.stdout:9/518: dread d0/de/d37/f5d [0,4194304] 0 2024-09-13T17:05:59.331 INFO:tasks.workunit.client.0.smithi115.stdout:6/703: write d8/d33/d40/d67/db4/d24/d53/d6a/f9a [800308,10103] 0 2024-09-13T17:05:59.332 INFO:tasks.workunit.client.0.smithi115.stdout:2/833: sync 2024-09-13T17:05:59.333 INFO:tasks.workunit.client.0.smithi115.stdout:2/834: write d3/d4d/d13/d6b/fdc [386734,24205] 0 2024-09-13T17:05:59.336 INFO:tasks.workunit.client.0.smithi115.stdout:6/704: rename d8/d33/d40/d67/db4/d24/d53/d6a/fa4 to d8/d33/d40/d4c/fd9 0 2024-09-13T17:05:59.336 INFO:tasks.workunit.client.0.smithi115.stdout:3/912: dwrite d1/d12/d14/d61/ff0 [0,4194304] 0 2024-09-13T17:05:59.337 INFO:tasks.workunit.client.0.smithi115.stdout:1/693: dwrite d5/d26/f4d [0,4194304] 0 2024-09-13T17:05:59.337 INFO:tasks.workunit.client.1.smithi195.stdout:6/927: dread f17 [4194304,4194304] 0 2024-09-13T17:05:59.339 INFO:tasks.workunit.client.0.smithi115.stdout:2/835: rename d3/d4d/d13/d62/d92/dd7/d56/d58/dac/cc4 to d3/d4d/d13/d1c/c109 0 2024-09-13T17:05:59.339 INFO:tasks.workunit.client.0.smithi115.stdout:2/836: dread - d3/d4d/dd/d1f/ff9 zero size 2024-09-13T17:05:59.339 INFO:tasks.workunit.client.0.smithi115.stdout:2/837: creat d3/d4d/dd/df/d5b/f10a x:0 0 0 2024-09-13T17:05:59.339 INFO:tasks.workunit.client.0.smithi115.stdout:2/838: chown d3/d4d/dd/l52 387749 1 2024-09-13T17:05:59.339 INFO:tasks.workunit.client.0.smithi115.stdout:6/705: symlink d8/d33/d40/d67/db4/d24/d17/d9b/lda 0 2024-09-13T17:05:59.340 INFO:tasks.workunit.client.0.smithi115.stdout:9/519: dread d0/d21/f36 [4194304,4194304] 0 2024-09-13T17:05:59.342 INFO:tasks.workunit.client.0.smithi115.stdout:6/706: dread d8/d33/d40/d67/db4/d24/f79 [0,4194304] 0 2024-09-13T17:05:59.343 INFO:tasks.workunit.client.0.smithi115.stdout:1/694: dread d5/d26/d2c/f32 [0,4194304] 0 2024-09-13T17:05:59.346 INFO:tasks.workunit.client.0.smithi115.stdout:2/839: dread d3/d4d/de/d99/fb1 [0,4194304] 0 2024-09-13T17:05:59.346 INFO:tasks.workunit.client.0.smithi115.stdout:2/840: chown d3/d4d/d13/d62/d92/dd7/d56/d58/de1/le6 236461 1 2024-09-13T17:05:59.347 INFO:tasks.workunit.client.1.smithi195.stdout:0/994: dwrite d7/d87/d9b/d56/d46/f74 [0,4194304] 0 2024-09-13T17:05:59.348 INFO:tasks.workunit.client.0.smithi115.stdout:9/520: getdents d0/de/d37/d83/d91 0 2024-09-13T17:05:59.350 INFO:tasks.workunit.client.0.smithi115.stdout:3/913: getdents d1/d4b/d69/d7b/da0 0 2024-09-13T17:05:59.351 INFO:tasks.workunit.client.1.smithi195.stdout:0/995: creat d7/d88/f13a x:0 0 0 2024-09-13T17:05:59.352 INFO:tasks.workunit.client.0.smithi115.stdout:6/707: mkdir d8/d33/d40/d67/db4/dbf/ddb 0 2024-09-13T17:05:59.352 INFO:tasks.workunit.client.1.smithi195.stdout:6/928: read d1c/d24/d49/d5f/db1/dcd/fe2 [2357528,83811] 0 2024-09-13T17:05:59.353 INFO:tasks.workunit.client.0.smithi115.stdout:1/695: creat d5/d26/d2c/ff5 x:0 0 0 2024-09-13T17:05:59.354 INFO:tasks.workunit.client.1.smithi195.stdout:0/996: symlink d7/d50/da1/l13b 0 2024-09-13T17:05:59.354 INFO:tasks.workunit.client.1.smithi195.stdout:0/997: fsync f3 0 2024-09-13T17:05:59.355 INFO:tasks.workunit.client.1.smithi195.stdout:0/998: dread d7/d88/d7c/f8b [0,4194304] 0 2024-09-13T17:05:59.355 INFO:tasks.workunit.client.0.smithi115.stdout:2/841: mkdir d3/d4d/de/d3a/d47/d104/d10b 0 2024-09-13T17:05:59.357 INFO:tasks.workunit.client.1.smithi195.stdout:6/929: symlink d1c/d7d/dc7/l133 0 2024-09-13T17:05:59.358 INFO:tasks.workunit.client.1.smithi195.stdout:6/930: chown d1c/df0/db9/d30/fef 273 1 2024-09-13T17:05:59.358 INFO:tasks.workunit.client.1.smithi195.stdout:6/931: chown d1c/d24/d49/d5f/d85/l5a 31074986 1 2024-09-13T17:05:59.359 INFO:tasks.workunit.client.0.smithi115.stdout:9/521: mkdir d0/de/d10/d15/d86/d8d/db1 0 2024-09-13T17:05:59.359 INFO:tasks.workunit.client.0.smithi115.stdout:9/522: creat d0/d21/d65/d79/fb2 x:0 0 0 2024-09-13T17:05:59.364 INFO:tasks.workunit.client.1.smithi195.stdout:6/932: mknod d1c/df0/db9/c134 0 2024-09-13T17:05:59.364 INFO:tasks.workunit.client.1.smithi195.stdout:6/933: write d1c/df0/feb [214734,66083] 0 2024-09-13T17:05:59.364 INFO:tasks.workunit.client.0.smithi115.stdout:6/708: symlink d8/db/d1d/dc5/ldc 0 2024-09-13T17:05:59.365 INFO:tasks.workunit.client.0.smithi115.stdout:1/696: truncate d5/d7/f77 277980 0 2024-09-13T17:05:59.367 INFO:tasks.workunit.client.1.smithi195.stdout:6/934: mkdir d1c/df0/db9/d8c/da7/dc6/d135 0 2024-09-13T17:05:59.369 INFO:tasks.workunit.client.1.smithi195.stdout:6/935: unlink d1c/d24/d49/d5f/db1/dcd/da9/f131 0 2024-09-13T17:05:59.370 INFO:tasks.workunit.client.0.smithi115.stdout:3/914: mkdir d1/d4b/d69/db6/dd2/d12c 0 2024-09-13T17:05:59.371 INFO:tasks.workunit.client.0.smithi115.stdout:6/709: link d8/db/d1d/f2b d8/d13/fdd 0 2024-09-13T17:05:59.372 INFO:tasks.workunit.client.0.smithi115.stdout:3/915: write d1/d4b/d69/d7b/dbb/fda [469825,39670] 0 2024-09-13T17:05:59.372 INFO:tasks.workunit.client.0.smithi115.stdout:3/916: stat d1/d4b/d1a/d30 0 2024-09-13T17:05:59.372 INFO:tasks.workunit.client.0.smithi115.stdout:3/917: fdatasync d1/d4b/d69/d7b/f11c 0 2024-09-13T17:05:59.373 INFO:tasks.workunit.client.0.smithi115.stdout:9/523: getdents d0/d21/d65/d6f 0 2024-09-13T17:05:59.374 INFO:tasks.workunit.client.0.smithi115.stdout:3/918: symlink d1/d4b/d69/d7b/dbb/l12d 0 2024-09-13T17:05:59.375 INFO:tasks.workunit.client.0.smithi115.stdout:9/524: rename d0/de/d10/d15/d7f/c94 to d0/cb3 0 2024-09-13T17:05:59.376 INFO:tasks.workunit.client.0.smithi115.stdout:3/919: symlink d1/d4b/d69/db6/dcc/l12e 0 2024-09-13T17:05:59.376 INFO:tasks.workunit.client.0.smithi115.stdout:3/920: getdents d1/d4b/d69/d7b/d12b 0 2024-09-13T17:05:59.376 INFO:tasks.workunit.client.0.smithi115.stdout:3/921: chown d1 41202 1 2024-09-13T17:05:59.376 INFO:tasks.workunit.client.0.smithi115.stdout:3/922: write d1/d4b/f4d [4456013,45921] 0 2024-09-13T17:05:59.377 INFO:tasks.workunit.client.0.smithi115.stdout:9/525: rename d0/de/d10/d15/d86/la2 to d0/de/lb4 0 2024-09-13T17:05:59.377 INFO:tasks.workunit.client.0.smithi115.stdout:9/526: readlink d0/de/d37/l63 0 2024-09-13T17:05:59.378 INFO:tasks.workunit.client.0.smithi115.stdout:3/923: link d1/d12/d14/cf8 d1/d4b/d69/d7b/da0/d11e/c12f 0 2024-09-13T17:05:59.384 INFO:tasks.workunit.client.0.smithi115.stdout:3/924: rename d1/d4b/d1a/d6e/dd9/c7f to d1/d4b/d1a/d30/d10c/c130 0 2024-09-13T17:05:59.384 INFO:tasks.workunit.client.0.smithi115.stdout:3/925: chown d1/da6/faf 1 1 2024-09-13T17:05:59.384 INFO:tasks.workunit.client.0.smithi115.stdout:3/926: link d1/da6/f128 d1/d4b/d1a/d30/f131 0 2024-09-13T17:05:59.384 INFO:tasks.workunit.client.0.smithi115.stdout:3/927: readlink d1/l6 0 2024-09-13T17:05:59.385 INFO:tasks.workunit.client.0.smithi115.stdout:2/842: dwrite d3/d4d/de/d99/d9a/df1/dfa/d46/d70/fcf [0,4194304] 0 2024-09-13T17:05:59.385 INFO:tasks.workunit.client.0.smithi115.stdout:3/928: unlink d1/d4b/d69/db6/f104 0 2024-09-13T17:05:59.386 INFO:tasks.workunit.client.0.smithi115.stdout:6/710: dread d8/d33/d40/d67/db4/d24/d53/d6a/fcc [0,4194304] 0 2024-09-13T17:05:59.386 INFO:tasks.workunit.client.0.smithi115.stdout:6/711: chown d8/d13/c45 56374 1 2024-09-13T17:05:59.387 INFO:tasks.workunit.client.0.smithi115.stdout:2/843: mknod d3/d4d/de/d98/c10c 0 2024-09-13T17:05:59.387 INFO:tasks.workunit.client.0.smithi115.stdout:2/844: creat d3/d4d/de/f10d x:0 0 0 2024-09-13T17:05:59.387 INFO:tasks.workunit.client.0.smithi115.stdout:2/845: stat d3/ld2 0 2024-09-13T17:05:59.387 INFO:tasks.workunit.client.0.smithi115.stdout:2/846: chown d3/d4d/dd/df/lc3 0 1 2024-09-13T17:05:59.388 INFO:tasks.workunit.client.1.smithi195.stdout:6/936: dread d1c/d24/f2e [0,4194304] 0 2024-09-13T17:05:59.388 INFO:tasks.workunit.client.0.smithi115.stdout:3/929: mkdir d1/d4b/d132 0 2024-09-13T17:05:59.389 INFO:tasks.workunit.client.1.smithi195.stdout:6/937: unlink d1c/d24/d7f/f11e 0 2024-09-13T17:05:59.389 INFO:tasks.workunit.client.0.smithi115.stdout:2/847: creat d3/d4d/d13/da2/dba/f10e x:0 0 0 2024-09-13T17:05:59.390 INFO:tasks.workunit.client.0.smithi115.stdout:3/930: creat d1/d4b/d69/d7b/d12b/f133 x:0 0 0 2024-09-13T17:05:59.390 INFO:tasks.workunit.client.0.smithi115.stdout:3/931: write d1/d4b/d1a/d30/f99 [1265452,101113] 0 2024-09-13T17:05:59.390 INFO:tasks.workunit.client.0.smithi115.stdout:3/932: readlink d1/d4b/d69/d7b/lb1 0 2024-09-13T17:05:59.390 INFO:tasks.workunit.client.0.smithi115.stdout:3/933: chown d1/d4b/c3f 519342 1 2024-09-13T17:05:59.392 INFO:tasks.workunit.client.0.smithi115.stdout:2/848: mknod d3/d4d/dd/df/d57/c10f 0 2024-09-13T17:05:59.392 INFO:tasks.workunit.client.1.smithi195.stdout:6/938: unlink d1c/df0/db9/d30/fec 0 2024-09-13T17:05:59.392 INFO:tasks.workunit.client.1.smithi195.stdout:0/999: dwrite d7/db/d38/d5d/f7f [4194304,4194304] 0 2024-09-13T17:05:59.392 INFO:tasks.workunit.client.0.smithi115.stdout:3/934: mkdir d1/d4b/d69/db6/dd2/d12c/d134 0 2024-09-13T17:05:59.393 INFO:tasks.workunit.client.0.smithi115.stdout:9/527: dwrite d0/d21/d65/d6f/fb0 [0,4194304] 0 2024-09-13T17:05:59.393 INFO:tasks.workunit.client.0.smithi115.stdout:2/849: getdents d3/d4d/de/d99/d9a/df1 0 2024-09-13T17:05:59.397 INFO:tasks.workunit.client.0.smithi115.stdout:9/528: rename d0/f3f to d0/d21/d95/fb5 0 2024-09-13T17:05:59.399 INFO:tasks.workunit.client.0.smithi115.stdout:6/712: dread d8/d33/d40/d67/db4/d24/d53/d6a/f9a [0,4194304] 0 2024-09-13T17:05:59.400 INFO:tasks.workunit.client.0.smithi115.stdout:9/529: rename d0/de/d37/d83/d91/c96 to d0/de/d10/d15/d7f/cb6 0 2024-09-13T17:05:59.401 INFO:tasks.workunit.client.0.smithi115.stdout:9/530: readlink d0/de/d10/d15/l64 0 2024-09-13T17:05:59.401 INFO:tasks.workunit.client.0.smithi115.stdout:6/713: readlink d8/db/l74 0 2024-09-13T17:05:59.401 INFO:tasks.workunit.client.0.smithi115.stdout:6/714: readlink d8/d33/lad 0 2024-09-13T17:05:59.403 INFO:tasks.workunit.client.0.smithi115.stdout:9/531: truncate d0/f1f 3152656 0 2024-09-13T17:05:59.403 INFO:tasks.workunit.client.0.smithi115.stdout:9/532: readlink d0/lc 0 2024-09-13T17:05:59.404 INFO:tasks.workunit.client.0.smithi115.stdout:3/935: write d1/d83/fef [40732,34809] 0 2024-09-13T17:05:59.404 INFO:tasks.workunit.client.0.smithi115.stdout:3/936: chown d1/d4b/d69/fca 28 1 2024-09-13T17:05:59.404 INFO:tasks.workunit.client.1.smithi195.stdout:6/939: dread d1c/d24/d49/d5f/db1/dcd/fe2 [0,4194304] 0 2024-09-13T17:05:59.404 INFO:tasks.workunit.client.1.smithi195.stdout:6/940: chown d1c/df0/db9/c134 123922 1 2024-09-13T17:05:59.404 INFO:tasks.workunit.client.1.smithi195.stdout:6/941: creat d1c/d24/d49/d5f/db1/f136 x:0 0 0 2024-09-13T17:05:59.404 INFO:tasks.workunit.client.1.smithi195.stdout:6/942: fsync d1c/df0/db9/d5e/dd9/f102 0 2024-09-13T17:05:59.405 INFO:tasks.workunit.client.0.smithi115.stdout:6/715: mknod d8/d33/d7f/d99/cde 0 2024-09-13T17:05:59.405 INFO:tasks.workunit.client.0.smithi115.stdout:9/533: mknod d0/d21/d65/d6f/dad/cb7 0 2024-09-13T17:05:59.405 INFO:tasks.workunit.client.0.smithi115.stdout:9/534: creat d0/d21/d95/fb8 x:0 0 0 2024-09-13T17:05:59.405 INFO:tasks.workunit.client.0.smithi115.stdout:9/535: write d0/d21/f67 [4674580,106884] 0 2024-09-13T17:05:59.406 INFO:tasks.workunit.client.0.smithi115.stdout:1/697: truncate d5/d7/f77 1099782 0 2024-09-13T17:05:59.408 INFO:tasks.workunit.client.0.smithi115.stdout:3/937: mknod d1/d4b/d1a/d30/dc5/c135 0 2024-09-13T17:05:59.410 INFO:tasks.workunit.client.1.smithi195.stdout:6/943: rename d1c/d24/d49/d5f/d35/d88/df8/d105 to d1c/d7d/dc7/d137 0 2024-09-13T17:05:59.412 INFO:tasks.workunit.client.0.smithi115.stdout:6/716: link d8/d33/lad d8/d33/d82/db0/ldf 0 2024-09-13T17:05:59.412 INFO:tasks.workunit.client.0.smithi115.stdout:6/717: stat d8/db/d1d 0 2024-09-13T17:05:59.412 INFO:tasks.workunit.client.0.smithi115.stdout:2/850: dwrite d3/d4d/dd/df/d5b/f10a [0,4194304] 0 2024-09-13T17:05:59.412 INFO:tasks.workunit.client.0.smithi115.stdout:2/851: truncate d3/d4d/dd/df/fed 5278396 0 2024-09-13T17:05:59.415 INFO:tasks.workunit.client.1.smithi195.stdout:6/944: link f2 d1c/d24/d49/d5f/de1/f138 0 2024-09-13T17:05:59.415 INFO:tasks.workunit.client.1.smithi195.stdout:6/945: read - d1c/d3e/d6b/df5/f12b zero size 2024-09-13T17:05:59.421 INFO:tasks.workunit.client.0.smithi115.stdout:1/698: mknod d5/d3e/dc8/ded/cf6 0 2024-09-13T17:05:59.421 INFO:tasks.workunit.client.0.smithi115.stdout:1/699: read - d5/d7/d33/d3a/db2/fd2 zero size 2024-09-13T17:05:59.421 INFO:tasks.workunit.client.0.smithi115.stdout:1/700: truncate d5/d7/d5c/f7b 557209 0 2024-09-13T17:05:59.425 INFO:tasks.workunit.client.0.smithi115.stdout:6/718: creat d8/d33/d40/d67/db4/dc9/fe0 x:0 0 0 2024-09-13T17:05:59.431 INFO:tasks.workunit.client.0.smithi115.stdout:1/701: rmdir d5/d26/d2c 39 2024-09-13T17:05:59.431 INFO:tasks.workunit.client.0.smithi115.stdout:1/702: truncate d5/d3e/f92 65408 0 2024-09-13T17:05:59.432 INFO:tasks.workunit.client.1.smithi195.stdout:6/946: dwrite d1c/d24/fd6 [4194304,4194304] 0 2024-09-13T17:05:59.432 INFO:tasks.workunit.client.0.smithi115.stdout:3/938: write d1/f1d [1730913,87328] 0 2024-09-13T17:05:59.432 INFO:tasks.workunit.client.0.smithi115.stdout:3/939: chown d1/d4b/fac 53816361 1 2024-09-13T17:05:59.432 INFO:tasks.workunit.client.0.smithi115.stdout:3/940: stat d1/da6/fa9 0 2024-09-13T17:05:59.433 INFO:tasks.workunit.client.0.smithi115.stdout:3/941: write d1/f10 [1183411,116721] 0 2024-09-13T17:05:59.433 INFO:tasks.workunit.client.0.smithi115.stdout:3/942: write d1/d4b/d69/d7b/dbb/fd6 [496656,128480] 0 2024-09-13T17:05:59.433 INFO:tasks.workunit.client.0.smithi115.stdout:2/852: dwrite d3/d4d/de/d99/d9a/df1/dfa/d46/da0/fde [0,4194304] 0 2024-09-13T17:05:59.433 INFO:tasks.workunit.client.0.smithi115.stdout:1/703: link d5/d26/lde d5/d7/d5c/dab/lf7 0 2024-09-13T17:05:59.433 INFO:tasks.workunit.client.0.smithi115.stdout:1/704: readlink d5/d7/l17 0 2024-09-13T17:05:59.436 INFO:tasks.workunit.client.1.smithi195.stdout:6/947: creat d1c/d7d/dc7/d137/f139 x:0 0 0 2024-09-13T17:05:59.436 INFO:tasks.workunit.client.1.smithi195.stdout:6/948: creat d1c/d24/d49/d5f/db1/dcd/da9/f13a x:0 0 0 2024-09-13T17:05:59.439 INFO:tasks.workunit.client.1.smithi195.stdout:6/949: getdents d1c/df0/db9/d8c/de5 0 2024-09-13T17:05:59.443 INFO:tasks.workunit.client.1.smithi195.stdout:6/950: link d1c/df0/db9/f40 d1c/d7d/f13b 0 2024-09-13T17:05:59.444 INFO:tasks.workunit.client.0.smithi115.stdout:9/536: getdents d0/d21/d65/d6f/dad 0 2024-09-13T17:05:59.450 INFO:tasks.workunit.client.0.smithi115.stdout:3/943: rename d1/d12/d14/f51 to d1/d4b/d69/d7b/f136 0 2024-09-13T17:05:59.450 INFO:tasks.workunit.client.0.smithi115.stdout:3/944: chown d1/d83/l8a 1 1 2024-09-13T17:05:59.452 INFO:tasks.workunit.client.0.smithi115.stdout:2/853: mkdir d3/d4d/d13/d77/d110 0 2024-09-13T17:05:59.452 INFO:tasks.workunit.client.0.smithi115.stdout:2/854: fsync d3/d4d/d13/f51 0 2024-09-13T17:05:59.452 INFO:tasks.workunit.client.0.smithi115.stdout:1/705: mknod d5/d7/d33/d3a/dc3/ddd/cf8 0 2024-09-13T17:05:59.452 INFO:tasks.workunit.client.0.smithi115.stdout:1/706: getdents d5/d7/d33/d3a/dc3 0 2024-09-13T17:05:59.453 INFO:tasks.workunit.client.0.smithi115.stdout:1/707: fsync d5/d7/f9f 0 2024-09-13T17:05:59.454 INFO:tasks.workunit.client.0.smithi115.stdout:9/537: link d0/de/d10/d15/f8f d0/d21/d65/fb9 0 2024-09-13T17:05:59.455 INFO:tasks.workunit.client.0.smithi115.stdout:2/855: mknod d3/d4d/d13/d1c/dc8/c111 0 2024-09-13T17:05:59.456 INFO:tasks.workunit.client.0.smithi115.stdout:1/708: symlink d5/d60/dbf/lf9 0 2024-09-13T17:05:59.456 INFO:tasks.workunit.client.0.smithi115.stdout:1/709: readlink d5/l7c 0 2024-09-13T17:05:59.456 INFO:tasks.workunit.client.0.smithi115.stdout:1/710: stat d5/d60 0 2024-09-13T17:05:59.458 INFO:tasks.workunit.client.1.smithi195.stdout:6/951: dwrite d1c/df0/db9/d5e/fb5 [0,4194304] 0 2024-09-13T17:05:59.458 INFO:tasks.workunit.client.1.smithi195.stdout:6/952: write d1c/d24/d49/d5f/db1/d95/f107 [1978042,48879] 0 2024-09-13T17:05:59.458 INFO:tasks.workunit.client.0.smithi115.stdout:1/711: mknod d5/d26/cfa 0 2024-09-13T17:05:59.459 INFO:tasks.workunit.client.0.smithi115.stdout:3/945: read d1/d4b/d1a/fa2 [1149674,12195] 0 2024-09-13T17:05:59.459 INFO:tasks.workunit.client.0.smithi115.stdout:1/712: creat d5/d3e/dc8/ffb x:0 0 0 2024-09-13T17:05:59.459 INFO:tasks.workunit.client.0.smithi115.stdout:1/713: chown d5/d60/d7d/d87/fcc 349917 1 2024-09-13T17:05:59.460 INFO:tasks.workunit.client.0.smithi115.stdout:9/538: dread d0/fb [0,4194304] 0 2024-09-13T17:05:59.462 INFO:tasks.workunit.client.0.smithi115.stdout:3/946: symlink d1/d4b/d69/db6/dcc/l137 0 2024-09-13T17:05:59.463 INFO:tasks.workunit.client.0.smithi115.stdout:3/947: truncate d1/d4b/d1a/d6e/dd9/f8e 2662107 0 2024-09-13T17:05:59.464 INFO:tasks.workunit.client.0.smithi115.stdout:3/948: creat d1/d12/d14/d120/f138 x:0 0 0 2024-09-13T17:05:59.465 INFO:tasks.workunit.client.0.smithi115.stdout:3/949: creat d1/d83/d114/f139 x:0 0 0 2024-09-13T17:05:59.468 INFO:tasks.workunit.client.0.smithi115.stdout:3/950: dread d1/d4b/d1a/d6e/dd9/f3a [0,4194304] 0 2024-09-13T17:05:59.468 INFO:tasks.workunit.client.0.smithi115.stdout:3/951: creat d1/d4b/d69/d7b/dbb/f13a x:0 0 0 2024-09-13T17:05:59.468 INFO:tasks.workunit.client.0.smithi115.stdout:3/952: creat d1/d12/f13b x:0 0 0 2024-09-13T17:05:59.469 INFO:tasks.workunit.client.0.smithi115.stdout:2/856: dread d3/d4d/fc1 [0,4194304] 0 2024-09-13T17:05:59.469 INFO:tasks.workunit.client.0.smithi115.stdout:1/714: dread d5/d26/d2c/d62/f7f [0,4194304] 0 2024-09-13T17:05:59.471 INFO:tasks.workunit.client.0.smithi115.stdout:3/953: mknod d1/d4b/d69/db6/dd2/d12c/d134/c13c 0 2024-09-13T17:05:59.472 INFO:tasks.workunit.client.0.smithi115.stdout:9/539: read d0/d21/d65/d79/f7a [808792,99812] 0 2024-09-13T17:05:59.472 INFO:tasks.workunit.client.0.smithi115.stdout:9/540: chown d0/de/c3d 33368777 1 2024-09-13T17:05:59.472 INFO:tasks.workunit.client.0.smithi115.stdout:9/541: dread - d0/d21/d65/d6f/fa7 zero size 2024-09-13T17:05:59.472 INFO:tasks.workunit.client.0.smithi115.stdout:9/542: chown d0/de/l2a 4 1 2024-09-13T17:05:59.474 INFO:tasks.workunit.client.0.smithi115.stdout:2/857: rename d3/d4d/dd/d1f/f7e to d3/d4d/d13/d62/d92/dd7/d7d/f112 0 2024-09-13T17:05:59.474 INFO:tasks.workunit.client.0.smithi115.stdout:2/858: read d3/d4d/de/f2a [3155844,111959] 0 2024-09-13T17:05:59.474 INFO:tasks.workunit.client.0.smithi115.stdout:2/859: write d3/d4d/d13/f45 [248296,116936] 0 2024-09-13T17:05:59.477 INFO:tasks.workunit.client.0.smithi115.stdout:2/860: mkdir d3/d4d/dd/d113 0 2024-09-13T17:05:59.477 INFO:tasks.workunit.client.0.smithi115.stdout:2/861: chown d3/f8f 1102938823 1 2024-09-13T17:05:59.478 INFO:tasks.workunit.client.1.smithi195.stdout:6/953: dwrite d1c/d24/d49/d5f/d85/da5/fbc [0,4194304] 0 2024-09-13T17:05:59.479 INFO:tasks.workunit.client.0.smithi115.stdout:2/862: mkdir d3/d4d/d13/d6b/d114 0 2024-09-13T17:05:59.481 INFO:tasks.workunit.client.0.smithi115.stdout:2/863: creat d3/d4d/f115 x:0 0 0 2024-09-13T17:05:59.482 INFO:tasks.workunit.client.0.smithi115.stdout:2/864: dread d3/d4d/de/d99/fcb [0,4194304] 0 2024-09-13T17:05:59.484 INFO:tasks.workunit.client.0.smithi115.stdout:2/865: rename d3/d4d/d13/d1c/dc8 to d3/d4d/d13/da2/dba/d116 0 2024-09-13T17:05:59.486 INFO:tasks.workunit.client.1.smithi195.stdout:6/954: dread d1c/df0/db9/d30/d6f/f10e [0,4194304] 0 2024-09-13T17:05:59.486 INFO:tasks.workunit.client.1.smithi195.stdout:6/955: stat d1c/df0/db9/d8c/da7 0 2024-09-13T17:05:59.487 INFO:tasks.workunit.client.1.smithi195.stdout:6/956: getdents d1c/df0/db9/d8c 0 2024-09-13T17:05:59.488 INFO:tasks.workunit.client.1.smithi195.stdout:6/957: chown d1c/d24/d49/d5f/db1/d95/fc5 3 1 2024-09-13T17:05:59.488 INFO:tasks.workunit.client.1.smithi195.stdout:6/958: readlink d1c/d24/d49/d5f/d35/l54 0 2024-09-13T17:05:59.493 INFO:tasks.workunit.client.0.smithi115.stdout:9/543: dwrite d0/faf [0,4194304] 0 2024-09-13T17:05:59.494 INFO:tasks.workunit.client.0.smithi115.stdout:1/715: dwrite d5/d7/f21 [0,4194304] 0 2024-09-13T17:05:59.495 INFO:tasks.workunit.client.0.smithi115.stdout:9/544: creat d0/de/d37/fba x:0 0 0 2024-09-13T17:05:59.496 INFO:tasks.workunit.client.1.smithi195.stdout:6/959: dread d1c/f23 [0,4194304] 0 2024-09-13T17:05:59.498 INFO:tasks.workunit.client.0.smithi115.stdout:1/716: creat d5/d3e/ffc x:0 0 0 2024-09-13T17:05:59.498 INFO:tasks.workunit.client.0.smithi115.stdout:1/717: fsync d5/d7/f18 0 2024-09-13T17:05:59.498 INFO:tasks.workunit.client.0.smithi115.stdout:1/718: chown d5/d7/d33/d3a/f7a 347 1 2024-09-13T17:05:59.499 INFO:tasks.workunit.client.1.smithi195.stdout:6/960: symlink d1c/d24/d49/l13c 0 2024-09-13T17:05:59.501 INFO:tasks.workunit.client.0.smithi115.stdout:2/866: dwrite d3/d4d/de/ff4 [0,4194304] 0 2024-09-13T17:05:59.501 INFO:tasks.workunit.client.0.smithi115.stdout:2/867: dread - d3/d4d/de/d99/d9a/df1/dfa/d46/da0/ff5 zero size 2024-09-13T17:05:59.501 INFO:tasks.workunit.client.0.smithi115.stdout:1/719: unlink d5/d60/d8e/fc7 0 2024-09-13T17:05:59.501 INFO:tasks.workunit.client.0.smithi115.stdout:1/720: fsync d5/d26/d2c/d89/fa9 0 2024-09-13T17:05:59.502 INFO:tasks.workunit.client.1.smithi195.stdout:6/961: creat d1c/df0/f13d x:0 0 0 2024-09-13T17:05:59.507 INFO:tasks.workunit.client.0.smithi115.stdout:2/868: rename d3/d4d/de/cdf to d3/d4d/d13/d6b/d114/c117 0 2024-09-13T17:05:59.512 INFO:tasks.workunit.client.1.smithi195.stdout:6/962: dread d1c/d24/d49/d5f/de1/f138 [4194304,4194304] 0 2024-09-13T17:05:59.512 INFO:tasks.workunit.client.1.smithi195.stdout:6/963: dread - d1c/df0/db9/d5e/dd9/f116 zero size 2024-09-13T17:05:59.513 INFO:tasks.workunit.client.1.smithi195.stdout:6/964: rename d1c/d24/d7f/le9 to d1c/df0/db9/d8c/l13e 0 2024-09-13T17:05:59.517 INFO:tasks.workunit.client.0.smithi115.stdout:9/545: dwrite d0/d21/d65/d79/f85 [0,4194304] 0 2024-09-13T17:05:59.517 INFO:tasks.workunit.client.0.smithi115.stdout:9/546: truncate d0/de/d10/faa 334822 0 2024-09-13T17:05:59.518 INFO:tasks.workunit.client.0.smithi115.stdout:9/547: fsync d0/f11 0 2024-09-13T17:05:59.518 INFO:tasks.workunit.client.0.smithi115.stdout:9/548: fsync d0/de/d37/f38 0 2024-09-13T17:05:59.518 INFO:tasks.workunit.client.0.smithi115.stdout:9/549: read - d0/d21/d42/f7e zero size 2024-09-13T17:05:59.522 INFO:tasks.workunit.client.0.smithi115.stdout:1/721: dwrite d5/d3e/d59/f8b [0,4194304] 0 2024-09-13T17:05:59.522 INFO:tasks.workunit.client.0.smithi115.stdout:1/722: fdatasync d5/d3e/d59/fe7 0 2024-09-13T17:05:59.523 INFO:tasks.workunit.client.0.smithi115.stdout:8/730: sync 2024-09-13T17:05:59.524 INFO:tasks.workunit.client.0.smithi115.stdout:8/731: symlink d0/d26/d29/d59/d7e/da1/dbd/lf7 0 2024-09-13T17:05:59.525 INFO:tasks.workunit.client.0.smithi115.stdout:8/732: mkdir d0/d26/d29/d59/d7e/da7/d2b/db1/dda/df8 0 2024-09-13T17:05:59.525 INFO:tasks.workunit.client.0.smithi115.stdout:8/733: creat d0/d18/ff9 x:0 0 0 2024-09-13T17:05:59.525 INFO:tasks.workunit.client.0.smithi115.stdout:8/734: chown d0/d21/d76/d83/f6c 418995662 1 2024-09-13T17:05:59.527 INFO:tasks.workunit.client.0.smithi115.stdout:9/550: dread d0/d21/d4f/f5e [0,4194304] 0 2024-09-13T17:05:59.528 INFO:tasks.workunit.client.0.smithi115.stdout:9/551: write d0/de/d10/d15/d86/f8b [1417177,93800] 0 2024-09-13T17:05:59.528 INFO:tasks.workunit.client.0.smithi115.stdout:9/552: chown d0/d21/d95/lac 13756 1 2024-09-13T17:05:59.528 INFO:tasks.workunit.client.0.smithi115.stdout:8/735: mkdir d0/d15/d3e/dfa 0 2024-09-13T17:05:59.528 INFO:tasks.workunit.client.0.smithi115.stdout:8/736: chown d0/d26/d29/d59/d7e/da7/d2b/d37/fd3 0 1 2024-09-13T17:05:59.553 INFO:tasks.workunit.client.0.smithi115.stdout:2/869: dwrite d3/d4d/dd/df/fed [0,4194304] 0 2024-09-13T17:05:59.554 INFO:tasks.workunit.client.1.smithi195.stdout:6/965: dwrite d1c/df0/db9/d8c/dd1/fff [0,4194304] 0 2024-09-13T17:05:59.555 INFO:tasks.workunit.client.0.smithi115.stdout:1/723: dwrite d5/d3e/d59/fb7 [0,4194304] 0 2024-09-13T17:05:59.556 INFO:tasks.workunit.client.0.smithi115.stdout:9/553: dwrite d0/d21/d4f/fa4 [0,4194304] 0 2024-09-13T17:05:59.556 INFO:tasks.workunit.client.1.smithi195.stdout:6/966: mkdir d1c/d7d/dc7/d137/d13f 0 2024-09-13T17:05:59.559 INFO:tasks.workunit.client.0.smithi115.stdout:1/724: mkdir d5/d7/d33/d3a/dc3/dfd 0 2024-09-13T17:05:59.559 INFO:tasks.workunit.client.0.smithi115.stdout:1/725: fdatasync d5/d7/d86/fb9 0 2024-09-13T17:05:59.559 INFO:tasks.workunit.client.0.smithi115.stdout:1/726: stat d5/d60/d8e 0 2024-09-13T17:05:59.559 INFO:tasks.workunit.client.0.smithi115.stdout:1/727: creat d5/d7/d86/ffe x:0 0 0 2024-09-13T17:05:59.559 INFO:tasks.workunit.client.0.smithi115.stdout:1/728: write d5/d3e/d59/f8b [5154464,123800] 0 2024-09-13T17:05:59.561 INFO:tasks.workunit.client.0.smithi115.stdout:9/554: link d0/d21/d65/d79/fb2 d0/d21/d4f/fbb 0 2024-09-13T17:05:59.562 INFO:tasks.workunit.client.0.smithi115.stdout:4/762: sync 2024-09-13T17:05:59.563 INFO:tasks.workunit.client.0.smithi115.stdout:7/683: sync 2024-09-13T17:05:59.563 INFO:tasks.workunit.client.0.smithi115.stdout:5/642: sync 2024-09-13T17:05:59.563 INFO:tasks.workunit.client.0.smithi115.stdout:4/763: chown d7/dd/d3c/d72 14 1 2024-09-13T17:05:59.563 INFO:tasks.workunit.client.0.smithi115.stdout:0/570: sync 2024-09-13T17:05:59.564 INFO:tasks.workunit.client.1.smithi195.stdout:6/967: dread d1c/d24/d7f/f8d [0,4194304] 0 2024-09-13T17:05:59.564 INFO:tasks.workunit.client.1.smithi195.stdout:6/968: readlink d1c/d24/d49/d5f/db1/d95/lb6 0 2024-09-13T17:05:59.566 INFO:tasks.workunit.client.0.smithi115.stdout:7/684: mkdir d0/d2/d1e/d3d/d6c/de0/df5 0 2024-09-13T17:05:59.567 INFO:tasks.workunit.client.0.smithi115.stdout:5/643: symlink d19/d2b/d32/ld8 0 2024-09-13T17:05:59.568 INFO:tasks.workunit.client.1.smithi195.stdout:6/969: mkdir d1c/df0/db9/d8c/de5/d140 0 2024-09-13T17:05:59.570 INFO:tasks.workunit.client.0.smithi115.stdout:5/644: symlink d19/d2b/d32/d55/d5e/ld9 0 2024-09-13T17:05:59.571 INFO:tasks.workunit.client.0.smithi115.stdout:5/645: mkdir d19/d2b/d69/d8f/dda 0 2024-09-13T17:05:59.571 INFO:tasks.workunit.client.0.smithi115.stdout:5/646: chown d19/fa2 470650250 1 2024-09-13T17:05:59.571 INFO:tasks.workunit.client.0.smithi115.stdout:5/647: creat d19/d2c/dd0/fdb x:0 0 0 2024-09-13T17:05:59.577 INFO:tasks.workunit.client.0.smithi115.stdout:0/571: dread d9/f1f [8388608,4194304] 0 2024-09-13T17:05:59.580 INFO:tasks.workunit.client.0.smithi115.stdout:0/572: mkdir d9/d27/d88/d9e/dad 0 2024-09-13T17:05:59.581 INFO:tasks.workunit.client.0.smithi115.stdout:0/573: truncate d9/d1d/d24/d26/d36/d48/f8a 4297524 0 2024-09-13T17:05:59.582 INFO:tasks.workunit.client.1.smithi195.stdout:6/970: dread d1c/f67 [0,4194304] 0 2024-09-13T17:05:59.582 INFO:tasks.workunit.client.1.smithi195.stdout:6/971: fdatasync d1c/df0/db9/d8c/f99 0 2024-09-13T17:05:59.582 INFO:tasks.workunit.client.0.smithi115.stdout:2/870: dwrite d3/d4d/dd/df/d57/d8b/fcc [0,4194304] 0 2024-09-13T17:05:59.583 INFO:tasks.workunit.client.0.smithi115.stdout:2/871: stat d3/d4d/dd/df/d57/d8b/l90 0 2024-09-13T17:05:59.584 INFO:tasks.workunit.client.0.smithi115.stdout:1/729: dwrite d5/d7/d5c/f8c [0,4194304] 0 2024-09-13T17:05:59.588 INFO:tasks.workunit.client.0.smithi115.stdout:2/872: creat d3/d4d/de/d99/d9a/df1/dfa/d46/f118 x:0 0 0 2024-09-13T17:05:59.588 INFO:tasks.workunit.client.0.smithi115.stdout:2/873: chown d3/d4d/dd/df/d57/l60 1857907629 1 2024-09-13T17:05:59.588 INFO:tasks.workunit.client.0.smithi115.stdout:1/730: rmdir d5/d26 39 2024-09-13T17:05:59.595 INFO:tasks.workunit.client.0.smithi115.stdout:9/555: dwrite d0/d21/d65/d6f/f88 [0,4194304] 0 2024-09-13T17:05:59.596 INFO:tasks.workunit.client.0.smithi115.stdout:9/556: chown d0/de/f89 246892279 1 2024-09-13T17:05:59.597 INFO:tasks.workunit.client.0.smithi115.stdout:9/557: readlink d0/l57 0 2024-09-13T17:05:59.597 INFO:tasks.workunit.client.0.smithi115.stdout:4/764: dwrite d7/dd/de/d4e/d6c/fdd [0,4194304] 0 2024-09-13T17:05:59.597 INFO:tasks.workunit.client.0.smithi115.stdout:4/765: chown d7/d86/d88/f93 53 1 2024-09-13T17:05:59.597 INFO:tasks.workunit.client.0.smithi115.stdout:4/766: chown d7/dd/d3c/d7b/d97/l9e 246 1 2024-09-13T17:05:59.598 INFO:tasks.workunit.client.0.smithi115.stdout:9/558: unlink d0/de/d10/d15/f8f 0 2024-09-13T17:05:59.599 INFO:tasks.workunit.client.0.smithi115.stdout:9/559: readlink d0/d21/d65/la8 0 2024-09-13T17:05:59.599 INFO:tasks.workunit.client.0.smithi115.stdout:9/560: fsync d0/de/d10/f14 0 2024-09-13T17:05:59.599 INFO:tasks.workunit.client.0.smithi115.stdout:9/561: fsync d0/de/d10/f9d 0 2024-09-13T17:05:59.600 INFO:tasks.workunit.client.0.smithi115.stdout:4/767: mkdir d7/dd/de/d4e/d6c/db0/deb 0 2024-09-13T17:05:59.600 INFO:tasks.workunit.client.0.smithi115.stdout:9/562: rmdir d0/de/d37/d83/d91 39 2024-09-13T17:05:59.601 INFO:tasks.workunit.client.0.smithi115.stdout:9/563: creat d0/d34/fbc x:0 0 0 2024-09-13T17:05:59.602 INFO:tasks.workunit.client.0.smithi115.stdout:9/564: read - d0/d21/d65/d79/fb2 zero size 2024-09-13T17:05:59.602 INFO:tasks.workunit.client.0.smithi115.stdout:9/565: creat d0/d21/d65/fbd x:0 0 0 2024-09-13T17:05:59.602 INFO:tasks.workunit.client.0.smithi115.stdout:9/566: rename d0/d21/d65/d79 to d0/d21/d65/d79/dbe 22 2024-09-13T17:05:59.602 INFO:tasks.workunit.client.0.smithi115.stdout:9/567: write d0/de/d10/f71 [1016171,110319] 0 2024-09-13T17:05:59.607 INFO:tasks.workunit.client.0.smithi115.stdout:5/648: dwrite d19/d2b/f50 [0,4194304] 0 2024-09-13T17:05:59.609 INFO:tasks.workunit.client.0.smithi115.stdout:5/649: truncate d19/d2b/d77/f79 4397311 0 2024-09-13T17:05:59.610 INFO:tasks.workunit.client.0.smithi115.stdout:5/650: truncate d19/d21/f2a 2393247 0 2024-09-13T17:05:59.610 INFO:tasks.workunit.client.0.smithi115.stdout:5/651: readlink l18 0 2024-09-13T17:05:59.612 INFO:tasks.workunit.client.0.smithi115.stdout:5/652: creat d19/d75/dcd/fdc x:0 0 0 2024-09-13T17:05:59.616 INFO:tasks.workunit.client.0.smithi115.stdout:2/874: dwrite d3/d4d/d13/da2/fd8 [0,4194304] 0 2024-09-13T17:05:59.616 INFO:tasks.workunit.client.0.smithi115.stdout:2/875: stat d3/d4d/de/d99/d9a/df1/dfa 0 2024-09-13T17:05:59.616 INFO:tasks.workunit.client.0.smithi115.stdout:2/876: write d3/d4d/f115 [391704,57088] 0 2024-09-13T17:05:59.618 INFO:tasks.workunit.client.0.smithi115.stdout:1/731: dwrite d5/d7/d5c/f5d [0,4194304] 0 2024-09-13T17:05:59.618 INFO:tasks.workunit.client.0.smithi115.stdout:1/732: write d5/d7/d86/ffe [994173,18834] 0 2024-09-13T17:05:59.618 INFO:tasks.workunit.client.0.smithi115.stdout:7/685: dwrite d0/d2/d1e/de5/fec [0,4194304] 0 2024-09-13T17:05:59.622 INFO:tasks.workunit.client.1.smithi195.stdout:6/972: dwrite d1c/df0/db9/d5e/dd9/f116 [0,4194304] 0 2024-09-13T17:05:59.622 INFO:tasks.workunit.client.1.smithi195.stdout:6/973: dread - d1c/d24/d49/d5f/db1/d95/dda/f119 zero size 2024-09-13T17:05:59.625 INFO:tasks.workunit.client.0.smithi115.stdout:0/574: dwrite d9/d1d/d24/d26/d36/f62 [0,4194304] 0 2024-09-13T17:05:59.625 INFO:tasks.workunit.client.0.smithi115.stdout:7/686: fsync d0/d2/d4a/fee 0 2024-09-13T17:05:59.627 INFO:tasks.workunit.client.0.smithi115.stdout:4/768: dwrite d7/dd/f2b [0,4194304] 0 2024-09-13T17:05:59.627 INFO:tasks.workunit.client.0.smithi115.stdout:4/769: truncate d7/dd/de/d4e/d6c/f8a 724566 0 2024-09-13T17:05:59.629 INFO:tasks.workunit.client.1.smithi195.stdout:6/974: getdents d1c/d24/d49/d5f/de1 0 2024-09-13T17:05:59.629 INFO:tasks.workunit.client.0.smithi115.stdout:9/568: rmdir d0/de/d10/d15 39 2024-09-13T17:05:59.631 INFO:tasks.workunit.client.0.smithi115.stdout:5/653: dwrite d19/d75/f7b [0,4194304] 0 2024-09-13T17:05:59.641 INFO:tasks.workunit.client.0.smithi115.stdout:7/687: creat d0/d3b/d50/ff6 x:0 0 0 2024-09-13T17:05:59.647 INFO:tasks.workunit.client.0.smithi115.stdout:4/770: creat d7/dd/d3c/d7b/fec x:0 0 0 2024-09-13T17:05:59.647 INFO:tasks.workunit.client.0.smithi115.stdout:4/771: chown d7/dd/de/d4e/d5a/d4f/lb4 388253508 1 2024-09-13T17:05:59.650 INFO:tasks.workunit.client.0.smithi115.stdout:9/569: link d0/d21/d95/lac d0/d21/d65/d79/lbf 0 2024-09-13T17:05:59.652 INFO:tasks.workunit.client.1.smithi195.stdout:6/975: dwrite ff [4194304,4194304] 0 2024-09-13T17:05:59.654 INFO:tasks.workunit.client.0.smithi115.stdout:7/688: rmdir d0/d3b/d54 39 2024-09-13T17:05:59.656 INFO:tasks.workunit.client.0.smithi115.stdout:9/570: creat d0/de/fc0 x:0 0 0 2024-09-13T17:05:59.656 INFO:tasks.workunit.client.0.smithi115.stdout:7/689: creat d0/d2/d1e/d3d/d82/d44/ff7 x:0 0 0 2024-09-13T17:05:59.657 INFO:tasks.workunit.client.1.smithi195.stdout:6/976: mkdir d1c/df0/db9/d8c/dd1/d141 0 2024-09-13T17:05:59.658 INFO:tasks.workunit.client.0.smithi115.stdout:7/690: truncate d0/d3b/d50/f10 4167596 0 2024-09-13T17:05:59.661 INFO:tasks.workunit.client.1.smithi195.stdout:6/977: dread f17 [4194304,4194304] 0 2024-09-13T17:05:59.661 INFO:tasks.workunit.client.1.smithi195.stdout:6/978: chown d1c/df0/c121 936588 1 2024-09-13T17:05:59.661 INFO:tasks.workunit.client.1.smithi195.stdout:6/979: chown d1c/f23 30 1 2024-09-13T17:05:59.662 INFO:tasks.workunit.client.1.smithi195.stdout:6/980: symlink d1c/d3e/l142 0 2024-09-13T17:05:59.662 INFO:tasks.workunit.client.1.smithi195.stdout:6/981: stat d1c/d24/d49/d5f/d85/c6d 0 2024-09-13T17:05:59.663 INFO:tasks.workunit.client.0.smithi115.stdout:2/877: dwrite d3/d4d/dd/df/f65 [0,4194304] 0 2024-09-13T17:05:59.666 INFO:tasks.workunit.client.0.smithi115.stdout:1/733: dwrite d5/fc [0,4194304] 0 2024-09-13T17:05:59.668 INFO:tasks.workunit.client.0.smithi115.stdout:0/575: dwrite d9/d1d/d24/f84 [0,4194304] 0 2024-09-13T17:05:59.668 INFO:tasks.workunit.client.0.smithi115.stdout:5/654: dwrite d19/f8d [0,4194304] 0 2024-09-13T17:05:59.668 INFO:tasks.workunit.client.0.smithi115.stdout:5/655: creat d19/d21/fdd x:0 0 0 2024-09-13T17:05:59.672 INFO:tasks.workunit.client.0.smithi115.stdout:4/772: dwrite d7/dd/de/f5c [0,4194304] 0 2024-09-13T17:05:59.677 INFO:tasks.workunit.client.0.smithi115.stdout:0/576: mknod d9/d27/cae 0 2024-09-13T17:05:59.677 INFO:tasks.workunit.client.0.smithi115.stdout:2/878: dread d3/f18 [0,4194304] 0 2024-09-13T17:05:59.680 INFO:tasks.workunit.client.0.smithi115.stdout:5/656: mkdir d19/d2b/d32/d55/d5e/d87/db0/dde 0 2024-09-13T17:05:59.680 INFO:tasks.workunit.client.0.smithi115.stdout:5/657: write d19/d21/fdd [1036368,43237] 0 2024-09-13T17:05:59.680 INFO:tasks.workunit.client.0.smithi115.stdout:5/658: write d19/f53 [665265,119117] 0 2024-09-13T17:05:59.682 INFO:tasks.workunit.client.0.smithi115.stdout:0/577: truncate d9/d1d/f39 1246495 0 2024-09-13T17:05:59.682 INFO:tasks.workunit.client.0.smithi115.stdout:0/578: fdatasync d9/d1d/d24/d26/d36/f7c 0 2024-09-13T17:05:59.683 INFO:tasks.workunit.client.0.smithi115.stdout:0/579: read d9/d1d/d24/d26/d36/f7c [19967,19007] 0 2024-09-13T17:05:59.685 INFO:tasks.workunit.client.0.smithi115.stdout:5/659: creat d19/d2b/d32/d55/d5e/d87/db0/dde/fdf x:0 0 0 2024-09-13T17:05:59.686 INFO:tasks.workunit.client.0.smithi115.stdout:4/773: mknod d7/dd/d3c/ced 0 2024-09-13T17:05:59.687 INFO:tasks.workunit.client.0.smithi115.stdout:4/774: readlink d7/dd/de/d4e/d6c/d77/l78 0 2024-09-13T17:05:59.687 INFO:tasks.workunit.client.0.smithi115.stdout:4/775: fdatasync d7/dd/de/d4e/d6c/d77/fbf 0 2024-09-13T17:05:59.688 INFO:tasks.workunit.client.0.smithi115.stdout:0/580: symlink d9/d1d/d24/d26/d7b/laf 0 2024-09-13T17:05:59.690 INFO:tasks.workunit.client.1.smithi195.stdout:6/982: dwrite d1c/d24/d49/d5f/db1/dcd/fe2 [0,4194304] 0 2024-09-13T17:05:59.691 INFO:tasks.workunit.client.0.smithi115.stdout:0/581: rename d9/d1d/d24/c29 to d9/d1d/d24/d26/d36/cb0 0 2024-09-13T17:05:59.691 INFO:tasks.workunit.client.0.smithi115.stdout:0/582: chown d9/c13 2063 1 2024-09-13T17:05:59.693 INFO:tasks.workunit.client.1.smithi195.stdout:6/983: creat d1c/d7d/f143 x:0 0 0 2024-09-13T17:05:59.694 INFO:tasks.workunit.client.1.smithi195.stdout:6/984: readlink l3 0 2024-09-13T17:05:59.695 INFO:tasks.workunit.client.0.smithi115.stdout:0/583: mkdir d9/d1d/d24/d26/d5d/d66/db1 0 2024-09-13T17:05:59.695 INFO:tasks.workunit.client.0.smithi115.stdout:1/734: dwrite d5/d7/f21 [4194304,4194304] 0 2024-09-13T17:05:59.695 INFO:tasks.workunit.client.0.smithi115.stdout:4/776: write d7/dd/de/f13 [7136287,47329] 0 2024-09-13T17:05:59.695 INFO:tasks.workunit.client.1.smithi195.stdout:6/985: symlink d1c/d7d/l144 0 2024-09-13T17:05:59.696 INFO:tasks.workunit.client.0.smithi115.stdout:6/719: sync 2024-09-13T17:05:59.696 INFO:tasks.workunit.client.0.smithi115.stdout:6/720: write d8/d33/d40/d67/db4/d24/d17/f85 [875694,118792] 0 2024-09-13T17:05:59.697 INFO:tasks.workunit.client.0.smithi115.stdout:5/660: dread d19/d2b/d77/f79 [0,4194304] 0 2024-09-13T17:05:59.697 INFO:tasks.workunit.client.0.smithi115.stdout:0/584: unlink d9/d1d/l22 0 2024-09-13T17:05:59.700 INFO:tasks.workunit.client.1.smithi195.stdout:6/986: rename d1c/d3e/fa3 to d1c/d3e/d6b/f145 0 2024-09-13T17:05:59.702 INFO:tasks.workunit.client.1.smithi195.stdout:6/987: dread d1c/d24/d49/f100 [0,4194304] 0 2024-09-13T17:05:59.702 INFO:tasks.workunit.client.1.smithi195.stdout:6/988: fdatasync d1c/d24/d49/d5f/db1/d95/f10b 0 2024-09-13T17:05:59.703 INFO:tasks.workunit.client.0.smithi115.stdout:5/661: mkdir d19/d2b/d69/d8f/de0 0 2024-09-13T17:05:59.706 INFO:tasks.workunit.client.0.smithi115.stdout:0/585: creat d9/d1d/fb2 x:0 0 0 2024-09-13T17:05:59.706 INFO:tasks.workunit.client.0.smithi115.stdout:0/586: readlink d9/d27/l75 0 2024-09-13T17:05:59.707 INFO:tasks.workunit.client.1.smithi195.stdout:6/989: dread d1c/df0/db9/d30/fd7 [0,4194304] 0 2024-09-13T17:05:59.707 INFO:tasks.workunit.client.0.smithi115.stdout:1/735: getdents d5/d7/d5c/dab 0 2024-09-13T17:05:59.710 INFO:tasks.workunit.client.1.smithi195.stdout:6/990: creat d1c/df0/db9/d30/d6f/f146 x:0 0 0 2024-09-13T17:05:59.713 INFO:tasks.workunit.client.0.smithi115.stdout:1/736: mkdir d5/d26/d2c/d89/dff 0 2024-09-13T17:05:59.715 INFO:tasks.workunit.client.1.smithi195.stdout:6/991: mkdir d1c/d24/d49/d5f/d35/d88/df8/d147 0 2024-09-13T17:05:59.720 INFO:tasks.workunit.client.1.smithi195.stdout:6/992: write d1c/d24/d49/d5f/d85/da5/fbc [682464,54675] 0 2024-09-13T17:05:59.733 INFO:tasks.workunit.client.0.smithi115.stdout:4/777: dwrite d7/dd/de/d4e/d6c/f8a [0,4194304] 0 2024-09-13T17:05:59.737 INFO:tasks.workunit.client.0.smithi115.stdout:6/721: dwrite d8/d33/f61 [0,4194304] 0 2024-09-13T17:05:59.738 INFO:tasks.workunit.client.1.smithi195.stdout:6/993: fsync d1c/f67 0 2024-09-13T17:05:59.738 INFO:tasks.workunit.client.1.smithi195.stdout:6/994: chown d1c/df0/db9/l72 0 1 2024-09-13T17:05:59.738 INFO:tasks.workunit.client.0.smithi115.stdout:0/587: dwrite d9/d1d/fb2 [0,4194304] 0 2024-09-13T17:05:59.738 INFO:tasks.workunit.client.0.smithi115.stdout:5/662: dwrite d19/d2b/d32/d55/d5e/f67 [4194304,4194304] 0 2024-09-13T17:05:59.739 INFO:tasks.workunit.client.0.smithi115.stdout:5/663: chown d19/d2b/d32/d55/d5e 358 1 2024-09-13T17:05:59.740 INFO:tasks.workunit.client.0.smithi115.stdout:6/722: rename d8/d33/d40/d67/db4/d24/d53/c9f to d8/db/dd/da2/db3/ce1 0 2024-09-13T17:05:59.741 INFO:tasks.workunit.client.0.smithi115.stdout:6/723: fdatasync d8/d33/d40/f5a 0 2024-09-13T17:05:59.743 INFO:tasks.workunit.client.1.smithi195.stdout:6/995: dread d1c/df0/db9/d30/d6f/f10e [0,4194304] 0 2024-09-13T17:05:59.744 INFO:tasks.workunit.client.0.smithi115.stdout:0/588: dread d9/fb [0,4194304] 0 2024-09-13T17:05:59.744 INFO:tasks.workunit.client.0.smithi115.stdout:4/778: write d7/f36 [1223622,87057] 0 2024-09-13T17:05:59.750 INFO:tasks.workunit.client.0.smithi115.stdout:6/724: dread d8/d33/d40/d67/db4/d24/f3b [0,4194304] 0 2024-09-13T17:05:59.756 INFO:tasks.workunit.client.0.smithi115.stdout:5/664: dwrite d19/f53 [0,4194304] 0 2024-09-13T17:05:59.756 INFO:tasks.workunit.client.0.smithi115.stdout:5/665: chown d19/d2c/dd0/f68 415 1 2024-09-13T17:05:59.758 INFO:tasks.workunit.client.0.smithi115.stdout:0/589: write d9/fc [2091711,17598] 0 2024-09-13T17:05:59.759 INFO:tasks.workunit.client.0.smithi115.stdout:0/590: rename d9/d1d/d24/d26/d2d/d30/c52 to d9/d1d/d24/d26/d2c/cb3 0 2024-09-13T17:05:59.760 INFO:tasks.workunit.client.1.smithi195.stdout:6/996: dread f19 [0,4194304] 0 2024-09-13T17:05:59.761 INFO:tasks.workunit.client.1.smithi195.stdout:6/997: mkdir d1c/d3e/d148 0 2024-09-13T17:05:59.762 INFO:tasks.workunit.client.1.smithi195.stdout:6/998: rmdir d1c/df0/db9/d30 39 2024-09-13T17:05:59.765 INFO:tasks.workunit.client.0.smithi115.stdout:0/591: write d9/f1f [8854365,11988] 0 2024-09-13T17:05:59.766 INFO:tasks.workunit.client.0.smithi115.stdout:0/592: mknod d9/d1d/d24/d26/d2d/cb4 0 2024-09-13T17:05:59.767 INFO:tasks.workunit.client.0.smithi115.stdout:5/666: truncate d19/d2b/d32/d55/d5e/f67 5122840 0 2024-09-13T17:05:59.769 INFO:tasks.workunit.client.0.smithi115.stdout:0/593: dread d9/f20 [4194304,4194304] 0 2024-09-13T17:05:59.769 INFO:tasks.workunit.client.0.smithi115.stdout:5/667: unlink d19/d21/d3a/c52 0 2024-09-13T17:05:59.770 INFO:tasks.workunit.client.1.smithi195.stdout:6/999: write d1c/df0/db9/d8c/dd1/fff [1791215,66789] 0 2024-09-13T17:05:59.770 INFO:tasks.workunit.client.0.smithi115.stdout:0/594: mknod d9/d1d/d24/d26/d2c/cb5 0 2024-09-13T17:05:59.771 INFO:tasks.workunit.client.0.smithi115.stdout:0/595: mkdir d9/d1d/d24/d26/d2d/d78/db6 0 2024-09-13T17:05:59.771 INFO:tasks.workunit.client.0.smithi115.stdout:0/596: creat d9/d1d/d24/d26/d36/d48/fb7 x:0 0 0 2024-09-13T17:05:59.772 INFO:tasks.workunit.client.0.smithi115.stdout:0/597: creat d9/d1d/d24/d26/d5d/d66/db1/fb8 x:0 0 0 2024-09-13T17:05:59.772 INFO:tasks.workunit.client.0.smithi115.stdout:3/954: sync 2024-09-13T17:05:59.772 INFO:tasks.workunit.client.0.smithi115.stdout:8/737: sync 2024-09-13T17:05:59.773 INFO:tasks.workunit.client.0.smithi115.stdout:3/955: mkdir d1/d83/d13d 0 2024-09-13T17:05:59.777 INFO:tasks.workunit.client.1.smithi195.stderr:+ rm -rf -- ./tmp.TwgO5kqBcR 2024-09-13T17:05:59.777 INFO:tasks.workunit.client.0.smithi115.stdout:8/738: mknod d0/d26/d29/cfb 0 2024-09-13T17:05:59.778 INFO:tasks.workunit.client.0.smithi115.stdout:8/739: dread d0/d15/d44/f61 [0,4194304] 0 2024-09-13T17:05:59.778 INFO:tasks.workunit.client.0.smithi115.stdout:5/668: write f8 [406234,85401] 0 2024-09-13T17:05:59.778 INFO:tasks.workunit.client.0.smithi115.stdout:8/740: mkdir d0/d18/df6/dfc 0 2024-09-13T17:05:59.783 INFO:tasks.workunit.client.0.smithi115.stdout:0/598: write d9/d1d/d24/d26/f55 [2179693,69764] 0 2024-09-13T17:05:59.783 INFO:tasks.workunit.client.0.smithi115.stdout:0/599: dread - d9/d1d/d24/d26/d2d/d30/f9f zero size 2024-09-13T17:05:59.794 INFO:tasks.workunit.client.0.smithi115.stdout:0/600: dread d9/fb [0,4194304] 0 2024-09-13T17:05:59.796 INFO:tasks.workunit.client.0.smithi115.stdout:0/601: getdents d9/d1d/d24/d26/d2d/d30 0 2024-09-13T17:05:59.796 INFO:tasks.workunit.client.0.smithi115.stdout:0/602: fdatasync d9/d1d/d24/d26/d5d/f96 0 2024-09-13T17:05:59.806 INFO:tasks.workunit.client.0.smithi115.stdout:5/669: dwrite d19/d2b/d32/d55/f4c [0,4194304] 0 2024-09-13T17:05:59.808 INFO:tasks.workunit.client.0.smithi115.stdout:5/670: mknod d19/d75/ce1 0 2024-09-13T17:05:59.808 INFO:tasks.workunit.client.0.smithi115.stdout:5/671: chown d19/c3e 158674066 1 2024-09-13T17:05:59.809 INFO:tasks.workunit.client.0.smithi115.stdout:5/672: fdatasync f8 0 2024-09-13T17:05:59.811 INFO:tasks.workunit.client.0.smithi115.stdout:5/673: truncate f5 3496888 0 2024-09-13T17:05:59.813 INFO:tasks.workunit.client.0.smithi115.stdout:5/674: mknod d19/d2c/ce2 0 2024-09-13T17:05:59.814 INFO:tasks.workunit.client.0.smithi115.stdout:8/741: dwrite d0/d21/d3a/f3f [0,4194304] 0 2024-09-13T17:05:59.817 INFO:tasks.workunit.client.0.smithi115.stdout:0/603: dwrite d9/d1d/d24/d26/d36/f3d [0,4194304] 0 2024-09-13T17:05:59.817 INFO:tasks.workunit.client.0.smithi115.stdout:0/604: chown d9/d1d/d24/d26/d2d/d30/d46/c4f 1 1 2024-09-13T17:05:59.817 INFO:tasks.workunit.client.0.smithi115.stdout:0/605: chown d9/d1d/d24/d26/d2c/f9d 67251 1 2024-09-13T17:05:59.825 INFO:tasks.workunit.client.0.smithi115.stdout:8/742: dread d0/d26/d29/d59/d7e/da7/d2b/d3b/fb4 [0,4194304] 0 2024-09-13T17:05:59.825 INFO:tasks.workunit.client.0.smithi115.stdout:5/675: write d19/d2b/fa8 [2881985,5418] 0 2024-09-13T17:05:59.828 INFO:tasks.workunit.client.0.smithi115.stdout:0/606: read d9/d1d/d24/d26/f64 [73137,116022] 0 2024-09-13T17:05:59.829 INFO:tasks.workunit.client.0.smithi115.stdout:8/743: mkdir d0/d18/df6/dfc/dfd 0 2024-09-13T17:05:59.832 INFO:tasks.workunit.client.0.smithi115.stdout:5/676: creat d19/d21/d3a/d5d/dbe/fe3 x:0 0 0 2024-09-13T17:05:59.832 INFO:tasks.workunit.client.0.smithi115.stdout:5/677: chown d19/c1f 77 1 2024-09-13T17:05:59.837 INFO:tasks.workunit.client.0.smithi115.stdout:0/607: dread d9/fc [0,4194304] 0 2024-09-13T17:05:59.838 INFO:tasks.workunit.client.0.smithi115.stdout:0/608: chown d9/d27/d88/d9e 53284 1 2024-09-13T17:05:59.838 INFO:tasks.workunit.client.0.smithi115.stdout:8/744: dread d0/d15/f1b [0,4194304] 0 2024-09-13T17:05:59.838 INFO:tasks.workunit.client.0.smithi115.stdout:5/678: stat d19/d1d/c64 0 2024-09-13T17:05:59.840 INFO:tasks.workunit.client.0.smithi115.stdout:8/745: mkdir d0/d18/df6/dfc/dfe 0 2024-09-13T17:05:59.842 INFO:tasks.workunit.client.0.smithi115.stdout:5/679: creat d19/d1d/fe4 x:0 0 0 2024-09-13T17:05:59.842 INFO:tasks.workunit.client.0.smithi115.stdout:5/680: chown d19/d2b/d32/d55/d5e/d87/fa3 11956 1 2024-09-13T17:05:59.842 INFO:tasks.workunit.client.0.smithi115.stdout:5/681: dread - d19/d2c/dd0/fd4 zero size 2024-09-13T17:05:59.842 INFO:tasks.workunit.client.0.smithi115.stdout:5/682: creat d19/d2b/d32/d55/d5e/d87/db0/fe5 x:0 0 0 2024-09-13T17:05:59.843 INFO:tasks.workunit.client.0.smithi115.stdout:5/683: write d19/d21/d3a/f6d [110917,65069] 0 2024-09-13T17:05:59.844 INFO:tasks.workunit.client.0.smithi115.stdout:8/746: unlink d0/d21/d3a/d60/f78 0 2024-09-13T17:05:59.851 INFO:tasks.workunit.client.0.smithi115.stdout:5/684: write d19/d2b/d32/d55/d5e/f67 [3726689,87063] 0 2024-09-13T17:05:59.851 INFO:tasks.workunit.client.0.smithi115.stdout:5/685: chown d19/d2e/d6b/cc8 63 1 2024-09-13T17:05:59.851 INFO:tasks.workunit.client.0.smithi115.stdout:5/686: chown d19 5855987 1 2024-09-13T17:05:59.851 INFO:tasks.workunit.client.0.smithi115.stdout:5/687: getdents d19/d2e/dc6 0 2024-09-13T17:05:59.851 INFO:tasks.workunit.client.0.smithi115.stdout:5/688: write d19/d2c/dd0/fdb [350567,105580] 0 2024-09-13T17:05:59.852 INFO:tasks.workunit.client.0.smithi115.stdout:5/689: mkdir d19/d2b/de6 0 2024-09-13T17:05:59.856 INFO:tasks.workunit.client.0.smithi115.stdout:0/609: dwrite d9/d1d/d24/d26/d5d/fa3 [0,4194304] 0 2024-09-13T17:05:59.856 INFO:tasks.workunit.client.0.smithi115.stdout:0/610: write d9/d1b/f92 [5034775,91232] 0 2024-09-13T17:05:59.856 INFO:tasks.workunit.client.0.smithi115.stdout:0/611: write d9/d1d/d24/d26/d36/d48/f8a [3658733,42904] 0 2024-09-13T17:05:59.860 INFO:tasks.workunit.client.0.smithi115.stdout:8/747: dwrite d0/d15/f2f [0,4194304] 0 2024-09-13T17:05:59.861 INFO:tasks.workunit.client.0.smithi115.stdout:0/612: rename d9/d1d/d24/d26/d2c/l58 to d9/d27/d88/d99/lb9 0 2024-09-13T17:05:59.861 INFO:tasks.workunit.client.0.smithi115.stdout:0/613: creat d9/d27/fba x:0 0 0 2024-09-13T17:05:59.868 INFO:tasks.workunit.client.0.smithi115.stdout:8/748: unlink d0/d18/c4c 0 2024-09-13T17:05:59.870 INFO:tasks.workunit.client.0.smithi115.stdout:0/614: unlink d9/d1d/d24/d26/f55 0 2024-09-13T17:05:59.872 INFO:tasks.workunit.client.0.smithi115.stdout:5/690: dwrite d19/d2c/dd0/fdb [0,4194304] 0 2024-09-13T17:05:59.873 INFO:tasks.workunit.client.0.smithi115.stdout:8/749: mknod d0/d42/cff 0 2024-09-13T17:05:59.873 INFO:tasks.workunit.client.0.smithi115.stdout:8/750: dread - d0/d26/d29/d59/fd9 zero size 2024-09-13T17:05:59.873 INFO:tasks.workunit.client.0.smithi115.stdout:8/751: fdatasync d0/f53 0 2024-09-13T17:05:59.874 INFO:tasks.workunit.client.0.smithi115.stdout:0/615: mkdir d9/d1d/d24/d26/d36/d48/dbb 0 2024-09-13T17:05:59.876 INFO:tasks.workunit.client.0.smithi115.stdout:8/752: rmdir d0/d21/d3a/da3 39 2024-09-13T17:05:59.876 INFO:tasks.workunit.client.0.smithi115.stdout:8/753: truncate d0/d15/d3e/f47 3345880 0 2024-09-13T17:05:59.876 INFO:tasks.workunit.client.0.smithi115.stdout:8/754: stat d0/d18/df6/dfc/dfe 0 2024-09-13T17:05:59.877 INFO:tasks.workunit.client.0.smithi115.stdout:8/755: getdents d0/d18/df6/dfc 0 2024-09-13T17:05:59.881 INFO:tasks.workunit.client.0.smithi115.stdout:5/691: dread d19/d2c/faf [0,4194304] 0 2024-09-13T17:05:59.881 INFO:tasks.workunit.client.0.smithi115.stdout:5/692: chown d19/dac/fc1 277 1 2024-09-13T17:05:59.882 INFO:tasks.workunit.client.0.smithi115.stdout:0/616: dread d9/d1b/f92 [4194304,4194304] 0 2024-09-13T17:05:59.884 INFO:tasks.workunit.client.0.smithi115.stdout:8/756: rmdir d0/d21/d3a/d60 39 2024-09-13T17:05:59.884 INFO:tasks.workunit.client.0.smithi115.stdout:8/757: stat d0/d26/d29/de4 0 2024-09-13T17:05:59.884 INFO:tasks.workunit.client.0.smithi115.stdout:8/758: write d0/d21/d76/d83/d5a/f90 [637426,111018] 0 2024-09-13T17:05:59.885 INFO:tasks.workunit.client.0.smithi115.stdout:8/759: write d0/d15/f4d [2042259,14340] 0 2024-09-13T17:05:59.887 INFO:tasks.workunit.client.0.smithi115.stdout:0/617: rename d9/d27/l97 to d9/d1d/d24/d26/d2d/d78/db6/lbc 0 2024-09-13T17:05:59.887 INFO:tasks.workunit.client.0.smithi115.stdout:0/618: dread - d9/d27/d88/fa2 zero size 2024-09-13T17:05:59.887 INFO:tasks.workunit.client.0.smithi115.stdout:0/619: chown d9/d1d/d24/d26/d5d/d66/l81 2538 1 2024-09-13T17:05:59.887 INFO:tasks.workunit.client.0.smithi115.stdout:0/620: write d9/d1d/d24/d26/d5d/f70 [2627383,110649] 0 2024-09-13T17:05:59.887 INFO:tasks.workunit.client.0.smithi115.stdout:0/621: truncate d9/d1d/d24/d26/d5d/f96 147937 0 2024-09-13T17:05:59.888 INFO:tasks.workunit.client.0.smithi115.stdout:5/693: dread d19/d2b/d77/f79 [0,4194304] 0 2024-09-13T17:05:59.892 INFO:tasks.workunit.client.0.smithi115.stdout:5/694: truncate d19/d2b/d32/d55/f5a 5073098 0 2024-09-13T17:05:59.894 INFO:tasks.workunit.client.0.smithi115.stdout:8/760: mkdir d0/d100 0 2024-09-13T17:05:59.895 INFO:tasks.workunit.client.0.smithi115.stdout:5/695: getdents d19/d75 0 2024-09-13T17:05:59.895 INFO:tasks.workunit.client.0.smithi115.stdout:5/696: readlink d19/d2c/dd0/lb7 0 2024-09-13T17:05:59.895 INFO:tasks.workunit.client.0.smithi115.stdout:5/697: fdatasync d19/d21/d3a/f82 0 2024-09-13T17:05:59.898 INFO:tasks.workunit.client.0.smithi115.stdout:8/761: link d0/d15/d3e/l46 d0/d18/d51/l101 0 2024-09-13T17:05:59.904 INFO:tasks.workunit.client.0.smithi115.stdout:0/622: dwrite d9/d1d/d24/d26/d5d/f87 [0,4194304] 0 2024-09-13T17:05:59.904 INFO:tasks.workunit.client.0.smithi115.stdout:0/623: getdents d9/d1d/d24/d26/d5d/d67 0 2024-09-13T17:05:59.906 INFO:tasks.workunit.client.0.smithi115.stdout:0/624: unlink d9/l9b 0 2024-09-13T17:05:59.907 INFO:tasks.workunit.client.0.smithi115.stdout:8/762: read d0/d15/f1b [1214002,80365] 0 2024-09-13T17:05:59.907 INFO:tasks.workunit.client.0.smithi115.stdout:8/763: readlink d0/d15/d3e/l5b 0 2024-09-13T17:05:59.907 INFO:tasks.workunit.client.0.smithi115.stdout:0/625: unlink d9/d1d/d24/d26/d36/d48/c7a 0 2024-09-13T17:05:59.909 INFO:tasks.workunit.client.0.smithi115.stdout:8/764: mkdir d0/d42/d80/d94/db2/d102 0 2024-09-13T17:05:59.917 INFO:tasks.workunit.client.0.smithi115.stdout:5/698: dwrite d19/dac/fc1 [0,4194304] 0 2024-09-13T17:05:59.926 INFO:tasks.workunit.client.0.smithi115.stdout:5/699: dread d19/d2b/d32/d55/d5e/d87/d86/fb5 [0,4194304] 0 2024-09-13T17:05:59.926 INFO:tasks.workunit.client.0.smithi115.stdout:5/700: fsync d19/d2c/faf 0 2024-09-13T17:05:59.926 INFO:tasks.workunit.client.0.smithi115.stdout:0/626: dwrite d9/d1d/d24/f5b [4194304,4194304] 0 2024-09-13T17:05:59.927 INFO:tasks.workunit.client.0.smithi115.stdout:5/701: symlink d19/d21/dcc/le7 0 2024-09-13T17:05:59.929 INFO:tasks.workunit.client.0.smithi115.stdout:8/765: dwrite d0/d26/f35 [0,4194304] 0 2024-09-13T17:05:59.930 INFO:tasks.workunit.client.0.smithi115.stdout:0/627: getdents d9/d1d/d24/d26/d36 0 2024-09-13T17:05:59.930 INFO:tasks.workunit.client.0.smithi115.stdout:0/628: write d9/d1d/d24/d26/d2d/d30/d46/f53 [1330826,33162] 0 2024-09-13T17:05:59.931 INFO:tasks.workunit.client.0.smithi115.stdout:5/702: mkdir d19/d2b/d32/d55/d5e/d87/d86/de8 0 2024-09-13T17:05:59.932 INFO:tasks.workunit.client.0.smithi115.stdout:8/766: dread d0/d26/d29/d59/d7e/da7/d2b/db1/fbc [0,4194304] 0 2024-09-13T17:05:59.932 INFO:tasks.workunit.client.0.smithi115.stdout:8/767: fdatasync d0/d26/d29/d59/fd9 0 2024-09-13T17:05:59.933 INFO:tasks.workunit.client.0.smithi115.stdout:0/629: symlink d9/d1d/d24/d26/d5d/d66/lbd 0 2024-09-13T17:05:59.933 INFO:tasks.workunit.client.0.smithi115.stdout:0/630: write d9/d1d/d24/d26/d5d/d66/db1/fb8 [346672,16929] 0 2024-09-13T17:05:59.933 INFO:tasks.workunit.client.0.smithi115.stdout:5/703: truncate d19/d2b/d32/d55/f94 271204 0 2024-09-13T17:05:59.935 INFO:tasks.workunit.client.0.smithi115.stdout:8/768: symlink d0/d26/d29/d59/d7e/da7/d2b/d37/l103 0 2024-09-13T17:05:59.937 INFO:tasks.workunit.client.0.smithi115.stdout:0/631: creat d9/d1d/d24/d26/d2d/d78/fbe x:0 0 0 2024-09-13T17:05:59.938 INFO:tasks.workunit.client.0.smithi115.stdout:0/632: fsync d9/d1d/d24/d26/d36/d48/f8a 0 2024-09-13T17:05:59.951 INFO:tasks.workunit.client.0.smithi115.stdout:5/704: rmdir d19/d2b/d32/d55/d5e/d87/db0 39 2024-09-13T17:05:59.953 INFO:tasks.workunit.client.0.smithi115.stdout:5/705: symlink d19/d21/d3a/le9 0 2024-09-13T17:05:59.953 INFO:tasks.workunit.client.0.smithi115.stdout:5/706: dread - d19/d2b/d32/d55/d5e/d87/fa3 zero size 2024-09-13T17:05:59.955 INFO:tasks.workunit.client.0.smithi115.stdout:5/707: mkdir d19/d2b/d32/d55/d5e/d87/d86/de8/dea 0 2024-09-13T17:05:59.957 INFO:tasks.workunit.client.0.smithi115.stdout:5/708: creat d19/d2b/d69/d8f/de0/feb x:0 0 0 2024-09-13T17:05:59.957 INFO:tasks.workunit.client.0.smithi115.stdout:5/709: fdatasync d19/d2e/f84 0 2024-09-13T17:05:59.959 INFO:tasks.workunit.client.0.smithi115.stdout:5/710: mknod d19/d2c/cec 0 2024-09-13T17:05:59.966 INFO:tasks.workunit.client.0.smithi115.stdout:5/711: dread f5 [0,4194304] 0 2024-09-13T17:05:59.981 INFO:tasks.workunit.client.0.smithi115.stdout:5/712: dwrite d19/f9c [0,4194304] 0 2024-09-13T17:05:59.985 INFO:tasks.workunit.client.0.smithi115.stdout:5/713: symlink d19/d2b/d32/led 0 2024-09-13T17:05:59.998 INFO:tasks.workunit.client.0.smithi115.stdout:5/714: dwrite d19/d2b/d32/d55/d5e/f67 [4194304,4194304] 0 2024-09-13T17:06:00.080 INFO:tasks.workunit.client.0.smithi115.stdout:5/715: rename d19/d2b/d32/d55/d5e/d87/fa0 to d19/d2b/d32/d55/d5e/d87/d86/fee 0 2024-09-13T17:06:00.084 INFO:tasks.workunit.client.0.smithi115.stdout:5/716: mknod d19/d2c/da7/cef 0 2024-09-13T17:06:00.087 INFO:tasks.workunit.client.0.smithi115.stdout:5/717: rename d19/d2c/dd0/f68 to d19/d2b/d69/d8f/dda/ff0 0 2024-09-13T17:06:00.091 INFO:tasks.workunit.client.0.smithi115.stdout:5/718: unlink d19/d2b/ca1 0 2024-09-13T17:06:00.096 INFO:tasks.workunit.client.0.smithi115.stdout:5/719: mknod d19/d2b/d32/d55/cf1 0 2024-09-13T17:06:00.113 INFO:tasks.workunit.client.0.smithi115.stdout:5/720: dwrite d19/d21/d3a/d5d/f70 [0,4194304] 0 2024-09-13T17:06:00.113 INFO:tasks.workunit.client.0.smithi115.stdout:5/721: stat d19/d2e/d6b 0 2024-09-13T17:06:00.113 INFO:tasks.workunit.client.0.smithi115.stdout:5/722: fsync d19/d21/d3a/f82 0 2024-09-13T17:06:00.120 INFO:tasks.workunit.client.0.smithi115.stdout:5/723: truncate d19/d21/f22 16008 0 2024-09-13T17:06:00.120 INFO:tasks.workunit.client.0.smithi115.stdout:5/724: read - d19/d2c/fba zero size 2024-09-13T17:06:00.121 INFO:tasks.workunit.client.0.smithi115.stdout:5/725: symlink d19/d21/dcc/lf2 0 2024-09-13T17:06:00.122 INFO:tasks.workunit.client.0.smithi115.stdout:5/726: creat d19/d2e/ff3 x:0 0 0 2024-09-13T17:06:00.122 INFO:tasks.workunit.client.0.smithi115.stdout:5/727: write f14 [4065230,21541] 0 2024-09-13T17:06:00.130 INFO:tasks.workunit.client.0.smithi115.stdout:5/728: write d19/f9c [832845,99197] 0 2024-09-13T17:06:00.132 INFO:tasks.workunit.client.0.smithi115.stdout:5/729: getdents d19/d21/dcc 0 2024-09-13T17:06:00.132 INFO:tasks.workunit.client.0.smithi115.stdout:5/730: creat d19/d75/dcd/ff4 x:0 0 0 2024-09-13T17:06:00.142 INFO:tasks.workunit.client.0.smithi115.stdout:9/571: sync 2024-09-13T17:06:00.144 INFO:tasks.workunit.client.0.smithi115.stdout:9/572: unlink d0/de/d10/f7c 0 2024-09-13T17:06:00.144 INFO:tasks.workunit.client.0.smithi115.stdout:9/573: chown d0/d21/d4f/fab 2 1 2024-09-13T17:06:00.144 INFO:tasks.workunit.client.0.smithi115.stdout:9/574: write d0/d21/d42/f7b [1058324,41805] 0 2024-09-13T17:06:00.145 INFO:tasks.workunit.client.0.smithi115.stdout:9/575: creat d0/de/d10/d15/fc1 x:0 0 0 2024-09-13T17:06:00.145 INFO:tasks.workunit.client.0.smithi115.stdout:9/576: chown d0/faf 1144747895 1 2024-09-13T17:06:00.146 INFO:tasks.workunit.client.0.smithi115.stdout:9/577: fdatasync d0/de/d10/f74 0 2024-09-13T17:06:00.147 INFO:tasks.workunit.client.0.smithi115.stdout:9/578: mkdir d0/de/d37/d83/dc2 0 2024-09-13T17:06:00.148 INFO:tasks.workunit.client.0.smithi115.stdout:9/579: mkdir d0/d21/d65/d6f/dad/dc3 0 2024-09-13T17:06:00.157 INFO:tasks.workunit.client.0.smithi115.stdout:9/580: write d0/de/d10/d15/f3b [2769790,76323] 0 2024-09-13T17:06:00.158 INFO:tasks.workunit.client.0.smithi115.stdout:9/581: symlink d0/de/d37/lc4 0 2024-09-13T17:06:00.172 INFO:tasks.workunit.client.0.smithi115.stdout:9/582: dwrite d0/de/d10/f60 [0,4194304] 0 2024-09-13T17:06:00.173 INFO:tasks.workunit.client.0.smithi115.stdout:9/583: getdents d0/de/d10/d15/d86/d8d 0 2024-09-13T17:06:00.233 INFO:tasks.workunit.client.0.smithi115.stdout:7/691: sync 2024-09-13T17:06:00.233 INFO:tasks.workunit.client.0.smithi115.stdout:7/692: read d0/f13 [4009410,25086] 0 2024-09-13T17:06:00.233 INFO:tasks.workunit.client.0.smithi115.stdout:7/693: chown d0/d2/d1e/d3d/d7c/fe4 29890 1 2024-09-13T17:06:00.237 INFO:tasks.workunit.client.0.smithi115.stdout:7/694: mkdir d0/d2/d1e/d3d/d82/d44/da7/dea/df8 0 2024-09-13T17:06:00.238 INFO:tasks.workunit.client.0.smithi115.stdout:7/695: fsync d0/d3b/d50/f47 0 2024-09-13T17:06:00.241 INFO:tasks.workunit.client.0.smithi115.stdout:7/696: creat d0/d2/d1e/d3d/d82/ff9 x:0 0 0 2024-09-13T17:06:00.242 INFO:tasks.workunit.client.0.smithi115.stdout:7/697: truncate d0/d3b/d50/f88 170262 0 2024-09-13T17:06:00.242 INFO:tasks.workunit.client.0.smithi115.stdout:7/698: truncate d0/d2/d1e/d3d/d82/d44/f6e 1952372 0 2024-09-13T17:06:00.247 INFO:tasks.workunit.client.0.smithi115.stdout:7/699: rename d0/ca6 to d0/d3b/d50/d21/d99/cfa 0 2024-09-13T17:06:00.247 INFO:tasks.workunit.client.0.smithi115.stdout:7/700: dread - d0/d3b/d50/d21/d2f/f89 zero size 2024-09-13T17:06:00.247 INFO:tasks.workunit.client.0.smithi115.stdout:7/701: truncate d0/d2/d1e/de5/fec 4462684 0 2024-09-13T17:06:00.249 INFO:tasks.workunit.client.0.smithi115.stdout:7/702: mkdir d0/d2/d1e/de5/dfb 0 2024-09-13T17:06:00.251 INFO:tasks.workunit.client.0.smithi115.stdout:7/703: rename d0/d2/d1e/d3d/cc7 to d0/d3b/d50/cfc 0 2024-09-13T17:06:00.266 INFO:tasks.workunit.client.0.smithi115.stdout:7/704: dwrite d0/d2/d4a/f5f [4194304,4194304] 0 2024-09-13T17:06:00.267 INFO:tasks.workunit.client.0.smithi115.stdout:7/705: dread d0/d51/fc1 [4194304,4194304] 0 2024-09-13T17:06:00.271 INFO:tasks.workunit.client.0.smithi115.stdout:7/706: dread d0/d2/d1e/d3d/d6c/f4c [0,4194304] 0 2024-09-13T17:06:00.288 INFO:tasks.workunit.client.0.smithi115.stdout:7/707: dwrite d0/f3e [0,4194304] 0 2024-09-13T17:06:00.288 INFO:tasks.workunit.client.0.smithi115.stdout:7/708: dread - d0/d3b/d50/d21/d99/fd9 zero size 2024-09-13T17:06:00.288 INFO:tasks.workunit.client.0.smithi115.stdout:7/709: chown d0/d2/d67/d86/d94 682347 1 2024-09-13T17:06:00.290 INFO:tasks.workunit.client.0.smithi115.stdout:7/710: getdents d0/d51 0 2024-09-13T17:06:00.291 INFO:tasks.workunit.client.0.smithi115.stdout:7/711: mknod d0/d2/d4a/cfd 0 2024-09-13T17:06:00.307 INFO:tasks.workunit.client.0.smithi115.stdout:7/712: dwrite d0/d3b/fad [0,4194304] 0 2024-09-13T17:06:00.307 INFO:tasks.workunit.client.0.smithi115.stdout:7/713: write d0/d3b/d50/f10 [1060232,19348] 0 2024-09-13T17:06:00.309 INFO:tasks.workunit.client.0.smithi115.stdout:7/714: rename d0/d2/d1e/d3d/f5e to d0/d2/d1e/de5/dfb/ffe 0 2024-09-13T17:06:00.326 INFO:tasks.workunit.client.0.smithi115.stdout:7/715: dwrite d0/d3b/d50/d21/d99/fdf [0,4194304] 0 2024-09-13T17:06:00.335 INFO:tasks.workunit.client.0.smithi115.stdout:7/716: dread d0/d2/d67/d86/fb1 [0,4194304] 0 2024-09-13T17:06:00.335 INFO:tasks.workunit.client.0.smithi115.stdout:7/717: write d0/d3b/d50/d21/d2f/f5b [1351541,41075] 0 2024-09-13T17:06:00.337 INFO:tasks.workunit.client.0.smithi115.stdout:7/718: unlink d0/d2/d1e/l72 0 2024-09-13T17:06:00.338 INFO:tasks.workunit.client.0.smithi115.stdout:7/719: stat d0/d2/d1e/cc0 0 2024-09-13T17:06:00.338 INFO:tasks.workunit.client.0.smithi115.stdout:7/720: write d0/d2/d1e/f32 [4578226,127668] 0 2024-09-13T17:06:00.345 INFO:tasks.workunit.client.0.smithi115.stdout:7/721: dread d0/d2/d1e/f32 [0,4194304] 0 2024-09-13T17:06:00.346 INFO:tasks.workunit.client.0.smithi115.stdout:7/722: mkdir d0/d3b/d50/d21/d2f/d9e/dff 0 2024-09-13T17:06:00.348 INFO:tasks.workunit.client.0.smithi115.stdout:7/723: rename d0/d2/d1e/d3d/l69 to d0/d3b/d54/l100 0 2024-09-13T17:06:00.348 INFO:tasks.workunit.client.0.smithi115.stdout:7/724: chown d0/d2/d1e/d3d/d6c/de0/df1 472701907 1 2024-09-13T17:06:00.348 INFO:tasks.workunit.client.0.smithi115.stdout:7/725: chown d0/d2/d1e/d3d/d82/dcc/ccf 172710 1 2024-09-13T17:06:00.349 INFO:tasks.workunit.client.0.smithi115.stdout:7/726: truncate d0/d2/d67/d70/f8e 176406 0 2024-09-13T17:06:00.349 INFO:tasks.workunit.client.0.smithi115.stdout:7/727: link d0/d51/l8d d0/d3b/d50/d21/d2f/d9e/l101 0 2024-09-13T17:06:00.350 INFO:tasks.workunit.client.0.smithi115.stdout:7/728: fdatasync d0/d2/d1e/f77 0 2024-09-13T17:06:00.350 INFO:tasks.workunit.client.0.smithi115.stdout:7/729: getdents d0/d2/d1e/d3d/d82/d44/da7/dea 0 2024-09-13T17:06:00.351 INFO:tasks.workunit.client.0.smithi115.stdout:7/730: creat d0/d2/d1e/dd8/f102 x:0 0 0 2024-09-13T17:06:00.353 INFO:tasks.workunit.client.0.smithi115.stdout:7/731: link d0/d2/d67/c6b d0/d2/d1e/c103 0 2024-09-13T17:06:00.361 INFO:tasks.workunit.client.0.smithi115.stdout:7/732: read d0/d97/fc9 [2851970,48822] 0 2024-09-13T17:06:00.362 INFO:tasks.workunit.client.0.smithi115.stdout:7/733: chown d0/d2/d1e/d3d/d6c/c23 132 1 2024-09-13T17:06:00.362 INFO:tasks.workunit.client.0.smithi115.stdout:7/734: dread d0/d3b/d50/d21/d2f/d9e/fc6 [0,4194304] 0 2024-09-13T17:06:00.369 INFO:tasks.workunit.client.0.smithi115.stdout:7/735: dread d0/d3b/d50/f16 [0,4194304] 0 2024-09-13T17:06:00.371 INFO:tasks.workunit.client.0.smithi115.stdout:7/736: mkdir d0/d2/d67/d86/d94/d9b/dbb/d104 0 2024-09-13T17:06:00.388 INFO:tasks.workunit.client.0.smithi115.stdout:7/737: dwrite d0/d2/d4a/fee [0,4194304] 0 2024-09-13T17:06:00.393 INFO:tasks.workunit.client.0.smithi115.stdout:7/738: rename d0/d3b/c7f to d0/d2/d67/d86/c105 0 2024-09-13T17:06:00.393 INFO:tasks.workunit.client.0.smithi115.stdout:7/739: dread - d0/f56 zero size 2024-09-13T17:06:00.394 INFO:tasks.workunit.client.0.smithi115.stdout:7/740: creat d0/d3b/d50/d21/d2f/d9e/f106 x:0 0 0 2024-09-13T17:06:00.412 INFO:tasks.workunit.client.0.smithi115.stdout:4/779: sync 2024-09-13T17:06:00.412 INFO:tasks.workunit.client.0.smithi115.stdout:2/879: sync 2024-09-13T17:06:00.412 INFO:tasks.workunit.client.0.smithi115.stdout:1/737: sync 2024-09-13T17:06:00.413 INFO:tasks.workunit.client.0.smithi115.stdout:2/880: unlink d3/d4d/d13/d62/de2/lfc 0 2024-09-13T17:06:00.414 INFO:tasks.workunit.client.0.smithi115.stdout:2/881: mkdir d3/d4d/de/d99/d9a/d119 0 2024-09-13T17:06:00.439 INFO:tasks.workunit.client.0.smithi115.stdout:1/738: dwrite d5/d3e/d59/fad [0,4194304] 0 2024-09-13T17:06:00.439 INFO:tasks.workunit.client.0.smithi115.stdout:4/780: dwrite d7/dd/f2c [0,4194304] 0 2024-09-13T17:06:00.439 INFO:tasks.workunit.client.0.smithi115.stdout:4/781: chown d7/dd/d3c/d74 145153 1 2024-09-13T17:06:00.439 INFO:tasks.workunit.client.0.smithi115.stdout:2/882: dwrite d3/d4d/dd/d1f/fc9 [0,4194304] 0 2024-09-13T17:06:00.441 INFO:tasks.workunit.client.0.smithi115.stdout:1/739: mkdir d5/d60/d7d/d100 0 2024-09-13T17:06:00.444 INFO:tasks.workunit.client.0.smithi115.stdout:4/782: mkdir d7/dd/de/d4e/dd1/dee 0 2024-09-13T17:06:00.447 INFO:tasks.workunit.client.0.smithi115.stdout:2/883: rename d3/d4d/dd/l50 to d3/d4d/de/d99/d9a/df1/dfa/d87/de9/l11a 0 2024-09-13T17:06:00.448 INFO:tasks.workunit.client.0.smithi115.stdout:2/884: fdatasync d3/d4d/de/d99/d9a/df1/dfa/f5d 0 2024-09-13T17:06:00.449 INFO:tasks.workunit.client.0.smithi115.stdout:1/740: rename d5/d7/f16 to d5/d7/d33/f101 0 2024-09-13T17:06:00.450 INFO:tasks.workunit.client.0.smithi115.stdout:2/885: mkdir d3/d4d/d13/d62/d92/dd7/d56/d58/de1/d11b 0 2024-09-13T17:06:00.451 INFO:tasks.workunit.client.0.smithi115.stdout:2/886: creat d3/d4d/de/d99/d9a/d119/f11c x:0 0 0 2024-09-13T17:06:00.460 INFO:tasks.workunit.client.0.smithi115.stdout:2/887: dread d3/f8f [0,4194304] 0 2024-09-13T17:06:00.460 INFO:tasks.workunit.client.0.smithi115.stdout:2/888: symlink d3/d4d/de/l11d 0 2024-09-13T17:06:00.461 INFO:tasks.workunit.client.0.smithi115.stdout:2/889: creat d3/d4d/de/d3a/d47/d104/f11e x:0 0 0 2024-09-13T17:06:00.465 INFO:tasks.workunit.client.0.smithi115.stdout:1/741: dwrite d5/d7/d33/fce [0,4194304] 0 2024-09-13T17:06:00.467 INFO:tasks.workunit.client.0.smithi115.stdout:1/742: write d5/d7/d86/ffe [814891,103641] 0 2024-09-13T17:06:00.471 INFO:tasks.workunit.client.0.smithi115.stdout:2/890: dread d3/d4d/d13/d62/d92/dd7/d56/f2b [0,4194304] 0 2024-09-13T17:06:00.474 INFO:tasks.workunit.client.0.smithi115.stdout:2/891: rmdir d3/d4d/dd/df/d57 39 2024-09-13T17:06:00.476 INFO:tasks.workunit.client.0.smithi115.stdout:1/743: write d5/d26/d2c/d62/f7f [2149029,98874] 0 2024-09-13T17:06:00.483 INFO:tasks.workunit.client.0.smithi115.stdout:1/744: mkdir d5/d7/d33/d3a/dc3/ddd/df4/d102 0 2024-09-13T17:06:00.494 INFO:tasks.workunit.client.0.smithi115.stdout:1/745: dread d5/d60/d7d/d87/fca [0,4194304] 0 2024-09-13T17:06:00.494 INFO:tasks.workunit.client.0.smithi115.stdout:2/892: dwrite d3/d4d/d13/da2/fe3 [0,4194304] 0 2024-09-13T17:06:00.495 INFO:tasks.workunit.client.0.smithi115.stdout:2/893: read d3/d4d/dd/df/f24 [1470141,110374] 0 2024-09-13T17:06:00.499 INFO:tasks.workunit.client.0.smithi115.stdout:2/894: mkdir d3/d4d/d13/d77/d11f 0 2024-09-13T17:06:00.499 INFO:tasks.workunit.client.0.smithi115.stdout:2/895: fsync d3/d4d/d13/d62/d92/dd7/d56/f34 0 2024-09-13T17:06:00.499 INFO:tasks.workunit.client.0.smithi115.stdout:2/896: chown d3/d4d/dd/df/f65 66845143 1 2024-09-13T17:06:00.499 INFO:tasks.workunit.client.0.smithi115.stdout:2/897: fdatasync d3/d4d/d13/d62/d66/f82 0 2024-09-13T17:06:00.499 INFO:tasks.workunit.client.0.smithi115.stdout:2/898: readlink d3/d4d/d13/d62/l8e 0 2024-09-13T17:06:00.500 INFO:tasks.workunit.client.0.smithi115.stdout:2/899: getdents d3/d4d/d13/d62/d92/dd7/da6 0 2024-09-13T17:06:00.524 INFO:tasks.workunit.client.0.smithi115.stdout:1/746: dwrite d5/d7/d33/d3a/f43 [0,4194304] 0 2024-09-13T17:06:00.524 INFO:tasks.workunit.client.0.smithi115.stdout:1/747: creat d5/f103 x:0 0 0 2024-09-13T17:06:00.524 INFO:tasks.workunit.client.0.smithi115.stdout:1/748: chown d5/d60/d7d/d87/cb1 1 1 2024-09-13T17:06:00.524 INFO:tasks.workunit.client.0.smithi115.stdout:1/749: truncate d5/d7/d33/d3a/db2/fc5 598487 0 2024-09-13T17:06:00.524 INFO:tasks.workunit.client.0.smithi115.stdout:2/900: dwrite d3/d4d/dd/df/d5b/fd3 [0,4194304] 0 2024-09-13T17:06:00.525 INFO:tasks.workunit.client.0.smithi115.stdout:2/901: dread d3/d4d/de/d99/d9a/df1/dfa/d46/d70/fc7 [0,4194304] 0 2024-09-13T17:06:00.526 INFO:tasks.workunit.client.0.smithi115.stdout:2/902: fdatasync d3/d4d/de/d99/fcb 0 2024-09-13T17:06:00.526 INFO:tasks.workunit.client.0.smithi115.stdout:2/903: fsync d3/d4d/d13/d6b/fb9 0 2024-09-13T17:06:00.526 INFO:tasks.workunit.client.0.smithi115.stdout:2/904: chown d3/d4d/d13/d62/d66/f82 5225 1 2024-09-13T17:06:00.526 INFO:tasks.workunit.client.0.smithi115.stdout:2/905: write d3/d4d/d13/d77/fc6 [841847,60596] 0 2024-09-13T17:06:00.526 INFO:tasks.workunit.client.0.smithi115.stdout:1/750: creat d5/d60/f104 x:0 0 0 2024-09-13T17:06:00.528 INFO:tasks.workunit.client.0.smithi115.stdout:2/906: mkdir d3/d4d/d13/d62/d92/dd7/d56/d58/de1/d120 0 2024-09-13T17:06:00.528 INFO:tasks.workunit.client.0.smithi115.stdout:2/907: chown d3/d4d/de/d99/d9a/df1/dfa/d46/d70/lb7 62430018 1 2024-09-13T17:06:00.528 INFO:tasks.workunit.client.0.smithi115.stdout:2/908: chown d3/d4d/dd/d1f/cbf 302104 1 2024-09-13T17:06:00.529 INFO:tasks.workunit.client.0.smithi115.stdout:1/751: mknod d5/d26/d2c/c105 0 2024-09-13T17:06:00.529 INFO:tasks.workunit.client.0.smithi115.stdout:1/752: write d5/d3e/f92 [298479,127709] 0 2024-09-13T17:06:00.529 INFO:tasks.workunit.client.0.smithi115.stdout:1/753: read - d5/d7/d5c/f79 zero size 2024-09-13T17:06:00.529 INFO:tasks.workunit.client.0.smithi115.stdout:1/754: fdatasync d5/d3e/f64 0 2024-09-13T17:06:00.530 INFO:tasks.workunit.client.0.smithi115.stdout:2/909: mkdir d3/d4d/de/d99/d9a/df1/dfa/d87/de9/d121 0 2024-09-13T17:06:00.551 INFO:tasks.workunit.client.0.smithi115.stdout:2/910: dwrite d3/d4d/de/f59 [0,4194304] 0 2024-09-13T17:06:00.551 INFO:tasks.workunit.client.0.smithi115.stdout:2/911: readlink d3/d4d/d13/d62/l8e 0 2024-09-13T17:06:00.552 INFO:tasks.workunit.client.0.smithi115.stdout:1/755: dwrite d5/d26/dc9/dea/fb8 [0,4194304] 0 2024-09-13T17:06:00.553 INFO:tasks.workunit.client.0.smithi115.stdout:2/912: symlink d3/d4d/de/d99/d9a/l122 0 2024-09-13T17:06:00.558 INFO:tasks.workunit.client.0.smithi115.stdout:1/756: rename d5/d26/d2c/ff5 to d5/d60/f106 0 2024-09-13T17:06:00.616 INFO:tasks.workunit.client.0.smithi115.stdout:3/956: sync 2024-09-13T17:06:00.616 INFO:tasks.workunit.client.0.smithi115.stdout:8/769: sync 2024-09-13T17:06:00.616 INFO:tasks.workunit.client.0.smithi115.stdout:6/725: sync 2024-09-13T17:06:00.617 INFO:tasks.workunit.client.0.smithi115.stdout:3/957: dread - d1/d4b/d69/d7b/dbb/f13a zero size 2024-09-13T17:06:00.617 INFO:tasks.workunit.client.0.smithi115.stdout:8/770: creat d0/d26/d29/d59/f104 x:0 0 0 2024-09-13T17:06:00.617 INFO:tasks.workunit.client.0.smithi115.stdout:3/958: write d1/d4b/d69/d7b/da0/f11a [491598,59060] 0 2024-09-13T17:06:00.617 INFO:tasks.workunit.client.0.smithi115.stdout:8/771: symlink d0/d26/d29/d59/d7e/da1/dbd/l105 0 2024-09-13T17:06:00.619 INFO:tasks.workunit.client.0.smithi115.stdout:3/959: mknod d1/d4b/d1a/d6e/dd9/c13e 0 2024-09-13T17:06:00.620 INFO:tasks.workunit.client.0.smithi115.stdout:3/960: write d1/d83/d9d/f9e [561212,125498] 0 2024-09-13T17:06:00.621 INFO:tasks.workunit.client.0.smithi115.stdout:8/772: creat d0/d26/d29/d59/d7e/da7/d2b/f106 x:0 0 0 2024-09-13T17:06:00.622 INFO:tasks.workunit.client.0.smithi115.stdout:3/961: mknod d1/d83/d13d/c13f 0 2024-09-13T17:06:00.625 INFO:tasks.workunit.client.0.smithi115.stdout:8/773: rmdir d0/d15/d3e/dfa 0 2024-09-13T17:06:00.626 INFO:tasks.workunit.client.0.smithi115.stdout:8/774: symlink d0/d21/d3a/d60/dc6/l107 0 2024-09-13T17:06:00.626 INFO:tasks.workunit.client.0.smithi115.stdout:8/775: chown d0/d15/d44/c8a 13114 1 2024-09-13T17:06:00.627 INFO:tasks.workunit.client.0.smithi115.stdout:8/776: mknod d0/d15/c108 0 2024-09-13T17:06:00.627 INFO:tasks.workunit.client.0.smithi115.stdout:8/777: fdatasync d0/d26/d29/d59/d7e/da7/d28/dcd/fe2 0 2024-09-13T17:06:00.627 INFO:tasks.workunit.client.0.smithi115.stdout:8/778: fsync d0/d26/d29/d59/d7e/da1/dbd/fbf 0 2024-09-13T17:06:00.627 INFO:tasks.workunit.client.0.smithi115.stdout:3/962: dread d1/d4b/d69/d7b/dbb/fd6 [0,4194304] 0 2024-09-13T17:06:00.629 INFO:tasks.workunit.client.0.smithi115.stdout:3/963: creat d1/d12/d11b/f140 x:0 0 0 2024-09-13T17:06:00.629 INFO:tasks.workunit.client.0.smithi115.stdout:3/964: write d1/da6/f128 [1380828,49730] 0 2024-09-13T17:06:00.629 INFO:tasks.workunit.client.0.smithi115.stdout:8/779: write d0/d21/f55 [486643,79333] 0 2024-09-13T17:06:00.631 INFO:tasks.workunit.client.0.smithi115.stdout:8/780: mknod d0/d42/d80/d94/db2/d102/c109 0 2024-09-13T17:06:00.632 INFO:tasks.workunit.client.0.smithi115.stdout:3/965: getdents d1/d4b/d1a 0 2024-09-13T17:06:00.633 INFO:tasks.workunit.client.0.smithi115.stdout:6/726: dwrite d8/d33/f61 [0,4194304] 0 2024-09-13T17:06:00.635 INFO:tasks.workunit.client.0.smithi115.stdout:8/781: link d0/d21/d3a/d60/f7a d0/d26/d29/d59/d7e/da7/dca/f10a 0 2024-09-13T17:06:00.647 INFO:tasks.workunit.client.0.smithi115.stdout:3/966: rename d1/d83/d9d/dba to d1/d4b/d1a/d141 0 2024-09-13T17:06:00.649 INFO:tasks.workunit.client.0.smithi115.stdout:8/782: dwrite d0/d18/f2e [0,4194304] 0 2024-09-13T17:06:00.652 INFO:tasks.workunit.client.0.smithi115.stdout:8/783: unlink d0/d15/cf2 0 2024-09-13T17:06:00.664 INFO:tasks.workunit.client.0.smithi115.stdout:8/784: write d0/d21/d76/fe6 [2148303,67483] 0 2024-09-13T17:06:00.664 INFO:tasks.workunit.client.0.smithi115.stdout:8/785: write d0/d26/d29/d59/d7e/da7/fe9 [611026,51949] 0 2024-09-13T17:06:00.667 INFO:tasks.workunit.client.0.smithi115.stdout:3/967: dwrite d1/d12/d14/f3e [0,4194304] 0 2024-09-13T17:06:00.667 INFO:tasks.workunit.client.0.smithi115.stdout:3/968: fdatasync d1/d12/d14/d61/f7c 0 2024-09-13T17:06:00.667 INFO:tasks.workunit.client.0.smithi115.stdout:8/786: getdents d0 0 2024-09-13T17:06:00.670 INFO:tasks.workunit.client.0.smithi115.stdout:3/969: mkdir d1/d12/d11b/d142 0 2024-09-13T17:06:00.670 INFO:tasks.workunit.client.0.smithi115.stdout:3/970: chown d1/d12/d14/c42 14269300 1 2024-09-13T17:06:00.670 INFO:tasks.workunit.client.0.smithi115.stdout:3/971: stat d1/f1d 0 2024-09-13T17:06:00.671 INFO:tasks.workunit.client.0.smithi115.stdout:3/972: chown d1/d4b/d1a/f6b 67264684 1 2024-09-13T17:06:00.674 INFO:tasks.workunit.client.0.smithi115.stdout:3/973: mkdir d1/da4/d143 0 2024-09-13T17:06:00.675 INFO:tasks.workunit.client.0.smithi115.stdout:8/787: dread d0/d21/d76/dc1/fdc [0,4194304] 0 2024-09-13T17:06:00.675 INFO:tasks.workunit.client.0.smithi115.stdout:8/788: write d0/d15/d3e/fb3 [308404,71682] 0 2024-09-13T17:06:00.675 INFO:tasks.workunit.client.0.smithi115.stdout:8/789: stat d0/d15/d3e/fe8 0 2024-09-13T17:06:00.677 INFO:tasks.workunit.client.0.smithi115.stdout:3/974: creat d1/da6/f144 x:0 0 0 2024-09-13T17:06:00.679 INFO:tasks.workunit.client.0.smithi115.stdout:3/975: mkdir d1/d12/d145 0 2024-09-13T17:06:00.679 INFO:tasks.workunit.client.0.smithi115.stdout:3/976: readlink d1/d83/d114/l118 0 2024-09-13T17:06:00.682 INFO:tasks.workunit.client.0.smithi115.stdout:3/977: rename d1/d4b/d1a/d141/d116 to d1/d12/d14/d146 0 2024-09-13T17:06:00.684 INFO:tasks.workunit.client.0.smithi115.stdout:8/790: read d0/d26/d29/d59/d7e/da7/d2b/d37/fd3 [1691147,32574] 0 2024-09-13T17:06:00.685 INFO:tasks.workunit.client.0.smithi115.stdout:3/978: creat d1/d83/d13d/f147 x:0 0 0 2024-09-13T17:06:00.685 INFO:tasks.workunit.client.0.smithi115.stdout:3/979: truncate d1/d4b/d69/d7b/d8b/f10f 966290 0 2024-09-13T17:06:00.686 INFO:tasks.workunit.client.0.smithi115.stdout:3/980: creat d1/d12/d14/d61/f148 x:0 0 0 2024-09-13T17:06:00.686 INFO:tasks.workunit.client.0.smithi115.stdout:8/791: creat d0/d26/d29/d59/d7e/da7/dca/f10b x:0 0 0 2024-09-13T17:06:00.687 INFO:tasks.workunit.client.0.smithi115.stdout:3/981: write d1/f9 [4256053,8201] 0 2024-09-13T17:06:00.687 INFO:tasks.workunit.client.0.smithi115.stdout:3/982: write d1/d4b/d69/db6/dd2/f121 [487212,74066] 0 2024-09-13T17:06:00.687 INFO:tasks.workunit.client.0.smithi115.stdout:3/983: dread - d1/d4b/d69/db6/ffe zero size 2024-09-13T17:06:00.702 INFO:tasks.workunit.client.0.smithi115.stdout:8/792: read d0/d26/d29/d59/d7e/da7/d28/d71/f8f [3577028,115172] 0 2024-09-13T17:06:00.704 INFO:tasks.workunit.client.0.smithi115.stdout:8/793: dread d0/d26/d29/f86 [0,4194304] 0 2024-09-13T17:06:00.710 INFO:tasks.workunit.client.0.smithi115.stdout:8/794: creat d0/d26/d29/d59/d7e/da7/d2b/db1/dda/f10c x:0 0 0 2024-09-13T17:06:00.710 INFO:tasks.workunit.client.0.smithi115.stdout:8/795: readlink d0/l8 0 2024-09-13T17:06:00.710 INFO:tasks.workunit.client.0.smithi115.stdout:8/796: creat d0/d42/d80/d94/f10d x:0 0 0 2024-09-13T17:06:00.710 INFO:tasks.workunit.client.0.smithi115.stdout:8/797: creat d0/d21/d76/d83/d5a/f10e x:0 0 0 2024-09-13T17:06:00.711 INFO:tasks.workunit.client.0.smithi115.stdout:3/984: dwrite d1/d12/fbd [0,4194304] 0 2024-09-13T17:06:00.716 INFO:tasks.workunit.client.0.smithi115.stdout:8/798: mknod d0/d26/d29/d98/c10f 0 2024-09-13T17:06:00.716 INFO:tasks.workunit.client.0.smithi115.stdout:8/799: fsync d0/d42/fd5 0 2024-09-13T17:06:00.716 INFO:tasks.workunit.client.0.smithi115.stdout:8/800: fdatasync d0/d21/d76/fa4 0 2024-09-13T17:06:00.720 INFO:tasks.workunit.client.0.smithi115.stdout:3/985: rename d1/c1f to d1/d83/d13d/c149 0 2024-09-13T17:06:00.728 INFO:tasks.workunit.client.0.smithi115.stdout:8/801: creat d0/d21/d3a/d60/df1/f110 x:0 0 0 2024-09-13T17:06:00.730 INFO:tasks.workunit.client.0.smithi115.stdout:3/986: chown d1/d4b/d1a/c109 294 1 2024-09-13T17:06:00.734 INFO:tasks.workunit.client.0.smithi115.stdout:8/802: getdents d0/d15 0 2024-09-13T17:06:00.735 INFO:tasks.workunit.client.0.smithi115.stdout:3/987: chown d1/d4b/d1a/d6e/dd9 172379 1 2024-09-13T17:06:00.742 INFO:tasks.workunit.client.0.smithi115.stdout:8/803: symlink d0/d26/d29/d59/d72/l111 0 2024-09-13T17:06:00.743 INFO:tasks.workunit.client.0.smithi115.stdout:3/988: chown d1/d4b/d1a/la3 2703 1 2024-09-13T17:06:00.745 INFO:tasks.workunit.client.0.smithi115.stdout:8/804: creat d0/d26/d29/f112 x:0 0 0 2024-09-13T17:06:00.746 INFO:tasks.workunit.client.0.smithi115.stdout:3/989: mknod d1/d4b/c14a 0 2024-09-13T17:06:00.748 INFO:tasks.workunit.client.0.smithi115.stdout:3/990: mknod d1/d4b/d69/d7b/da0/d11e/c14b 0 2024-09-13T17:06:00.748 INFO:tasks.workunit.client.0.smithi115.stdout:3/991: chown d1/d12/d14/d61/lc8 0 1 2024-09-13T17:06:00.749 INFO:tasks.workunit.client.0.smithi115.stdout:3/992: symlink d1/d12/d14/d146/l14c 0 2024-09-13T17:06:00.749 INFO:tasks.workunit.client.0.smithi115.stdout:3/993: chown d1/d4b/d69/d7b/d12b/f133 1373 1 2024-09-13T17:06:00.752 INFO:tasks.workunit.client.0.smithi115.stdout:3/994: mkdir d1/da6/d14d 0 2024-09-13T17:06:00.752 INFO:tasks.workunit.client.0.smithi115.stdout:8/805: read d0/d26/d29/d59/d7e/da7/d2b/d3b/fb4 [746258,118540] 0 2024-09-13T17:06:00.762 INFO:tasks.workunit.client.0.smithi115.stdout:8/806: mknod d0/c113 0 2024-09-13T17:06:00.762 INFO:tasks.workunit.client.0.smithi115.stdout:8/807: chown d0/d26/d29/d59/d7e/da7/fe9 1452876 1 2024-09-13T17:06:00.765 INFO:tasks.workunit.client.0.smithi115.stdout:8/808: creat d0/d21/d76/d83/f114 x:0 0 0 2024-09-13T17:06:00.767 INFO:tasks.workunit.client.0.smithi115.stdout:8/809: creat d0/d26/d29/d59/d7e/da7/d2b/d37/f115 x:0 0 0 2024-09-13T17:06:00.774 INFO:tasks.workunit.client.0.smithi115.stdout:3/995: dwrite d1/d83/f91 [0,4194304] 0 2024-09-13T17:06:00.774 INFO:tasks.workunit.client.0.smithi115.stdout:3/996: creat d1/d4b/f14e x:0 0 0 2024-09-13T17:06:00.774 INFO:tasks.workunit.client.0.smithi115.stdout:3/997: write d1/d4b/d1a/f6b [4550843,6897] 0 2024-09-13T17:06:00.774 INFO:tasks.workunit.client.0.smithi115.stdout:3/998: fdatasync d1/d4b/d1a/d6e/dd9/f3a 0 2024-09-13T17:06:00.774 INFO:tasks.workunit.client.0.smithi115.stdout:3/999: dread - d1/da6/f144 zero size 2024-09-13T17:06:00.783 INFO:tasks.workunit.client.0.smithi115.stdout:8/810: dwrite d0/d15/d3e/fe8 [0,4194304] 0 2024-09-13T17:06:00.789 INFO:tasks.workunit.client.0.smithi115.stdout:8/811: mkdir d0/d21/d76/d83/d116 0 2024-09-13T17:06:00.803 INFO:tasks.workunit.client.0.smithi115.stdout:8/812: dwrite d0/d18/f56 [0,4194304] 0 2024-09-13T17:06:00.804 INFO:tasks.workunit.client.0.smithi115.stdout:8/813: fdatasync d0/d26/d29/d59/d7e/da7/d2b/f9e 0 2024-09-13T17:06:00.804 INFO:tasks.workunit.client.0.smithi115.stdout:8/814: rename d0/d21 to d0/d21/d117 22 2024-09-13T17:06:00.823 INFO:tasks.workunit.client.0.smithi115.stdout:8/815: dwrite d0/d21/d3a/d60/f7a [0,4194304] 0 2024-09-13T17:06:00.825 INFO:tasks.workunit.client.0.smithi115.stdout:8/816: dread d0/d15/d44/f61 [0,4194304] 0 2024-09-13T17:06:00.825 INFO:tasks.workunit.client.0.smithi115.stdout:8/817: truncate d0/d26/d29/d59/d7e/da7/d2b/db1/dda/f10c 927184 0 2024-09-13T17:06:00.827 INFO:tasks.workunit.client.0.smithi115.stdout:8/818: creat d0/d21/f118 x:0 0 0 2024-09-13T17:06:00.827 INFO:tasks.workunit.client.0.smithi115.stdout:8/819: truncate d0/d21/d76/d83/fd1 216266 0 2024-09-13T17:06:00.829 INFO:tasks.workunit.client.0.smithi115.stdout:8/820: link d0/d21/d76/d83/d5a/ld2 d0/d26/l119 0 2024-09-13T17:06:00.831 INFO:tasks.workunit.client.0.smithi115.stdout:8/821: mkdir d0/d26/d29/d59/d11a 0 2024-09-13T17:06:00.836 INFO:tasks.workunit.client.0.smithi115.stdout:8/822: rmdir d0/d42/d80 39 2024-09-13T17:06:00.836 INFO:tasks.workunit.client.0.smithi115.stdout:8/823: readlink d0/d18/d51/le3 0 2024-09-13T17:06:00.836 INFO:tasks.workunit.client.0.smithi115.stdout:8/824: read d0/d21/d76/fa4 [1192160,5663] 0 2024-09-13T17:06:00.836 INFO:tasks.workunit.client.0.smithi115.stdout:8/825: chown d0/d21/d76/d83/d5a/fe1 33 1 2024-09-13T17:06:00.836 INFO:tasks.workunit.client.0.smithi115.stdout:8/826: chown d0/d15/d44/c8a 3698 1 2024-09-13T17:06:00.836 INFO:tasks.workunit.client.0.smithi115.stdout:8/827: truncate d0/d26/d29/d59/d7e/da1/dbd/ff4 1036652 0 2024-09-13T17:06:00.836 INFO:tasks.workunit.client.0.smithi115.stdout:8/828: chown d0/d21/d76/d83/d5a/ld2 146162 1 2024-09-13T17:06:00.837 INFO:tasks.workunit.client.0.smithi115.stdout:8/829: mknod d0/d42/d80/c11b 0 2024-09-13T17:06:00.851 INFO:tasks.workunit.client.0.smithi115.stdout:8/830: dwrite d0/d15/d44/f75 [0,4194304] 0 2024-09-13T17:06:00.861 INFO:tasks.workunit.client.0.smithi115.stdout:0/633: sync 2024-09-13T17:06:00.861 INFO:tasks.workunit.client.0.smithi115.stdout:5/731: sync 2024-09-13T17:06:00.862 INFO:tasks.workunit.client.0.smithi115.stdout:5/732: truncate d19/d2b/d32/d55/f4c 277382 0 2024-09-13T17:06:00.862 INFO:tasks.workunit.client.0.smithi115.stdout:5/733: stat d19/fa2 0 2024-09-13T17:06:00.863 INFO:tasks.workunit.client.0.smithi115.stdout:0/634: creat d9/d27/d88/d9e/fbf x:0 0 0 2024-09-13T17:06:00.869 INFO:tasks.workunit.client.0.smithi115.stdout:5/734: write d19/d2b/d32/d55/f5f [889124,88791] 0 2024-09-13T17:06:00.869 INFO:tasks.workunit.client.0.smithi115.stdout:0/635: dread d9/d1d/d24/d26/d2d/d78/f7f [4194304,4194304] 0 2024-09-13T17:06:00.869 INFO:tasks.workunit.client.0.smithi115.stdout:8/831: dwrite d0/d21/d76/d83/f88 [0,4194304] 0 2024-09-13T17:06:00.873 INFO:tasks.workunit.client.0.smithi115.stdout:8/832: mknod d0/d42/d80/d94/db2/c11c 0 2024-09-13T17:06:00.875 INFO:tasks.workunit.client.0.smithi115.stdout:0/636: symlink d9/d1d/d24/d26/d36/d48/lc0 0 2024-09-13T17:06:00.875 INFO:tasks.workunit.client.0.smithi115.stdout:0/637: dread - d9/d27/d88/fa2 zero size 2024-09-13T17:06:00.877 INFO:tasks.workunit.client.0.smithi115.stdout:5/735: write d19/d75/f7b [3536597,78105] 0 2024-09-13T17:06:00.878 INFO:tasks.workunit.client.0.smithi115.stdout:5/736: stat d19/d2b/d32/f4e 0 2024-09-13T17:06:00.878 INFO:tasks.workunit.client.0.smithi115.stdout:5/737: stat d19/d2b/d32/f8b 0 2024-09-13T17:06:00.878 INFO:tasks.workunit.client.0.smithi115.stdout:5/738: read d19/d21/f4a [2211998,46156] 0 2024-09-13T17:06:00.879 INFO:tasks.workunit.client.0.smithi115.stdout:8/833: mkdir d0/d18/df6/dfc/dfe/d11d 0 2024-09-13T17:06:00.882 INFO:tasks.workunit.client.0.smithi115.stdout:5/739: mkdir d19/d2b/d69/d8f/de0/df5 0 2024-09-13T17:06:00.883 INFO:tasks.workunit.client.0.smithi115.stdout:8/834: creat d0/d26/d29/d98/f11e x:0 0 0 2024-09-13T17:06:00.886 INFO:tasks.workunit.client.0.smithi115.stdout:8/835: rename d0/d26/d29/d59/d7e/da1 to d0/d26/d29/d59/d7e/da7/d2b/d3b/d11f 0 2024-09-13T17:06:00.886 INFO:tasks.workunit.client.0.smithi115.stdout:8/836: chown d0/d21/d76/d83/d5a 2 1 2024-09-13T17:06:00.894 INFO:tasks.workunit.client.0.smithi115.stdout:0/638: dwrite d9/d1b/f89 [0,4194304] 0 2024-09-13T17:06:00.913 INFO:tasks.workunit.client.0.smithi115.stdout:5/740: dwrite d19/d2b/f6a [0,4194304] 0 2024-09-13T17:06:00.913 INFO:tasks.workunit.client.0.smithi115.stdout:5/741: chown d19/d21/f4a 19762849 1 2024-09-13T17:06:00.913 INFO:tasks.workunit.client.0.smithi115.stdout:8/837: dwrite d0/d18/f56 [4194304,4194304] 0 2024-09-13T17:06:00.929 INFO:tasks.workunit.client.0.smithi115.stdout:8/838: dwrite d0/d26/d29/d59/d7e/da7/d2b/fc2 [0,4194304] 0 2024-09-13T17:06:00.929 INFO:tasks.workunit.client.0.smithi115.stdout:8/839: readlink d0/d18/d51/le3 0 2024-09-13T17:06:00.938 INFO:tasks.workunit.client.0.smithi115.stdout:8/840: dread d0/d21/d76/d83/f88 [0,4194304] 0 2024-09-13T17:06:00.955 INFO:tasks.workunit.client.0.smithi115.stdout:0/639: mkdir d9/d1d/d24/d26/d5d/d66/d83/dc1 0 2024-09-13T17:06:00.956 INFO:tasks.workunit.client.0.smithi115.stdout:8/841: dwrite d0/d26/d29/d59/d7e/da7/d2b/db1/fbc [0,4194304] 0 2024-09-13T17:06:00.956 INFO:tasks.workunit.client.0.smithi115.stdout:8/842: dread - d0/d26/d29/d59/d7e/da7/d2b/f9e zero size 2024-09-13T17:06:00.981 INFO:tasks.workunit.client.0.smithi115.stdout:0/640: dwrite d9/d1d/d24/d26/d36/d48/fb7 [0,4194304] 0 2024-09-13T17:06:00.993 INFO:tasks.workunit.client.0.smithi115.stdout:5/742: truncate f5 3118201 0 2024-09-13T17:06:01.010 INFO:tasks.workunit.client.0.smithi115.stdout:5/743: dwrite d19/d21/d3a/f6d [0,4194304] 0 2024-09-13T17:06:01.091 INFO:tasks.workunit.client.0.smithi115.stdout:8/843: unlink d0/d26/d29/d59/d7e/da7/d28/d71/fb5 0 2024-09-13T17:06:01.097 INFO:tasks.workunit.client.0.smithi115.stdout:0/641: mkdir d9/d1d/d24/d26/d2d/d30/dc2 0 2024-09-13T17:06:01.101 INFO:tasks.workunit.client.0.smithi115.stdout:5/744: symlink d19/d2b/d32/d55/d5e/d87/d86/lf6 0 2024-09-13T17:06:01.106 INFO:tasks.workunit.client.0.smithi115.stdout:8/844: mknod d0/d100/c120 0 2024-09-13T17:06:01.107 INFO:tasks.workunit.client.0.smithi115.stdout:0/642: mkdir d9/d27/d88/d8e/dc3 0 2024-09-13T17:06:01.108 INFO:tasks.workunit.client.0.smithi115.stdout:5/745: creat d19/d2b/de6/ff7 x:0 0 0 2024-09-13T17:06:01.110 INFO:tasks.workunit.client.0.smithi115.stdout:0/643: mknod d9/d27/d88/d9e/cc4 0 2024-09-13T17:06:01.110 INFO:tasks.workunit.client.0.smithi115.stdout:5/746: symlink d19/d21/d3a/d5d/dbe/lf8 0 2024-09-13T17:06:01.110 INFO:tasks.workunit.client.0.smithi115.stdout:5/747: truncate d19/d2b/d32/d55/f94 635239 0 2024-09-13T17:06:01.112 INFO:tasks.workunit.client.0.smithi115.stdout:0/644: symlink d9/d1d/d24/d26/d36/d48/dbb/lc5 0 2024-09-13T17:06:01.112 INFO:tasks.workunit.client.0.smithi115.stdout:0/645: chown d9/fb 4470018 1 2024-09-13T17:06:01.112 INFO:tasks.workunit.client.0.smithi115.stdout:0/646: creat d9/d1b/fc6 x:0 0 0 2024-09-13T17:06:01.127 INFO:tasks.workunit.client.0.smithi115.stdout:5/748: dwrite d19/d2c/dd0/fd4 [0,4194304] 0 2024-09-13T17:06:01.136 INFO:tasks.workunit.client.0.smithi115.stdout:5/749: dread d19/d2b/d32/d55/d5e/fbf [0,4194304] 0 2024-09-13T17:06:01.137 INFO:tasks.workunit.client.0.smithi115.stdout:5/750: write d19/d21/d3a/d5d/dbe/fe3 [1012172,72744] 0 2024-09-13T17:06:01.137 INFO:tasks.workunit.client.0.smithi115.stdout:5/751: dread - d19/d2b/d32/d55/d5e/d87/fa3 zero size 2024-09-13T17:06:01.137 INFO:tasks.workunit.client.0.smithi115.stdout:5/752: truncate d19/d21/f80 443336 0 2024-09-13T17:06:01.138 INFO:tasks.workunit.client.0.smithi115.stdout:5/753: mknod d19/d2c/cf9 0 2024-09-13T17:06:01.142 INFO:tasks.workunit.client.0.smithi115.stdout:8/845: mkdir d0/d42/d121 0 2024-09-13T17:06:01.143 INFO:tasks.workunit.client.0.smithi115.stdout:8/846: truncate d0/fb 1441583 0 2024-09-13T17:06:01.144 INFO:tasks.workunit.client.0.smithi115.stdout:8/847: stat d0/d21/d3a/d60/cd6 0 2024-09-13T17:06:01.144 INFO:tasks.workunit.client.0.smithi115.stdout:8/848: truncate d0/d26/d29/d59/d7e/da7/d28/fc4 588336 0 2024-09-13T17:06:01.144 INFO:tasks.workunit.client.0.smithi115.stdout:8/849: write d0/d26/d29/d59/d7e/da7/d2b/f106 [776371,19732] 0 2024-09-13T17:06:01.144 INFO:tasks.workunit.client.0.smithi115.stdout:8/850: unlink d0/d26/d29/d59/d7e/da7/d28/dcd/cde 0 2024-09-13T17:06:01.145 INFO:tasks.workunit.client.0.smithi115.stdout:5/754: dread d19/d2b/d77/f79 [0,4194304] 0 2024-09-13T17:06:01.145 INFO:tasks.workunit.client.0.smithi115.stdout:8/851: mkdir d0/d42/d122 0 2024-09-13T17:06:01.145 INFO:tasks.workunit.client.0.smithi115.stdout:8/852: write d0/d26/f35 [4379299,27295] 0 2024-09-13T17:06:01.146 INFO:tasks.workunit.client.0.smithi115.stdout:5/755: link d19/d2e/ff3 d19/d2b/de6/ffa 0 2024-09-13T17:06:01.148 INFO:tasks.workunit.client.0.smithi115.stdout:8/853: symlink d0/d26/d29/d59/d7e/da7/d28/dcd/l123 0 2024-09-13T17:06:01.148 INFO:tasks.workunit.client.0.smithi115.stdout:8/854: chown d0/d26/d29/l6a 291031 1 2024-09-13T17:06:01.148 INFO:tasks.workunit.client.0.smithi115.stdout:8/855: readlink d0/d21/d3a/da3/lb7 0 2024-09-13T17:06:01.148 INFO:tasks.workunit.client.0.smithi115.stdout:8/856: dread - d0/d21/d76/d83/d5a/fe1 zero size 2024-09-13T17:06:01.148 INFO:tasks.workunit.client.0.smithi115.stdout:8/857: dread - d0/d42/fd5 zero size 2024-09-13T17:06:01.149 INFO:tasks.workunit.client.0.smithi115.stdout:5/756: symlink d19/lfb 0 2024-09-13T17:06:01.149 INFO:tasks.workunit.client.0.smithi115.stdout:5/757: write d19/d1d/fe4 [809740,88037] 0 2024-09-13T17:06:01.149 INFO:tasks.workunit.client.0.smithi115.stdout:8/858: rmdir d0/d18/df6/dfc/dfe 39 2024-09-13T17:06:01.150 INFO:tasks.workunit.client.0.smithi115.stdout:5/758: symlink d19/d2e/d6b/lfc 0 2024-09-13T17:06:01.150 INFO:tasks.workunit.client.0.smithi115.stdout:5/759: creat d19/d2e/ffd x:0 0 0 2024-09-13T17:06:01.150 INFO:tasks.workunit.client.0.smithi115.stdout:5/760: dread - d19/d2e/ffd zero size 2024-09-13T17:06:01.150 INFO:tasks.workunit.client.0.smithi115.stdout:5/761: fdatasync d19/d2b/d32/d55/f4c 0 2024-09-13T17:06:01.150 INFO:tasks.workunit.client.0.smithi115.stdout:8/859: getdents d0/d26/d29/d59/d7e/da7/d28/d4f 0 2024-09-13T17:06:01.150 INFO:tasks.workunit.client.0.smithi115.stdout:8/860: chown d0/d21/l97 475274 1 2024-09-13T17:06:01.152 INFO:tasks.workunit.client.0.smithi115.stdout:8/861: link d0/d26/d29/f38 d0/d42/d80/d94/f124 0 2024-09-13T17:06:01.161 INFO:tasks.workunit.client.0.smithi115.stdout:8/862: write d0/d21/d76/d83/fab [3105186,110106] 0 2024-09-13T17:06:01.162 INFO:tasks.workunit.client.0.smithi115.stdout:8/863: link d0/d42/ld4 d0/d18/df6/dfc/dfe/l125 0 2024-09-13T17:06:01.164 INFO:tasks.workunit.client.0.smithi115.stdout:6/727: sync 2024-09-13T17:06:01.164 INFO:tasks.workunit.client.0.smithi115.stdout:7/741: sync 2024-09-13T17:06:01.164 INFO:tasks.workunit.client.0.smithi115.stdout:9/584: sync 2024-09-13T17:06:01.164 INFO:tasks.workunit.client.0.smithi115.stdout:4/783: sync 2024-09-13T17:06:01.164 INFO:tasks.workunit.client.0.smithi115.stdout:2/913: sync 2024-09-13T17:06:01.164 INFO:tasks.workunit.client.0.smithi115.stdout:1/757: sync 2024-09-13T17:06:01.164 INFO:tasks.workunit.client.0.smithi115.stdout:2/914: mkdir d3/d4d/dd/d1f/d123 0 2024-09-13T17:06:01.166 INFO:tasks.workunit.client.0.smithi115.stdout:6/728: rename d8/d33/d40/d67/db4/d24/lb6 to d8/d33/d40/d67/db4/d24/le2 0 2024-09-13T17:06:01.168 INFO:tasks.workunit.client.0.smithi115.stdout:7/742: symlink d0/d2/d1e/d3d/d6c/d71/l107 0 2024-09-13T17:06:01.168 INFO:tasks.workunit.client.0.smithi115.stdout:5/762: dwrite d19/f8d [0,4194304] 0 2024-09-13T17:06:01.172 INFO:tasks.workunit.client.0.smithi115.stdout:4/784: creat d7/dd/de/d4e/d9f/dd4/fef x:0 0 0 2024-09-13T17:06:01.173 INFO:tasks.workunit.client.0.smithi115.stdout:4/785: creat d7/d86/d88/ff0 x:0 0 0 2024-09-13T17:06:01.173 INFO:tasks.workunit.client.0.smithi115.stdout:4/786: chown d7/dd/l3d 15401065 1 2024-09-13T17:06:01.174 INFO:tasks.workunit.client.0.smithi115.stdout:8/864: write d0/d26/f35 [1679332,74389] 0 2024-09-13T17:06:01.174 INFO:tasks.workunit.client.0.smithi115.stdout:8/865: fsync d0/d21/d3a/d60/df1/f110 0 2024-09-13T17:06:01.174 INFO:tasks.workunit.client.0.smithi115.stdout:8/866: chown d0/l77 121 1 2024-09-13T17:06:01.175 INFO:tasks.workunit.client.0.smithi115.stdout:1/758: getdents d5/d7/d86 0 2024-09-13T17:06:01.178 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:00 smithi115 ceph-mon[27708]: pgmap v19: 65 pgs: 65 active+clean; 3.4 GiB data, 9.6 GiB used, 527 GiB / 536 GiB avail; 351 MiB/s rd, 422 MiB/s wr, 613 op/s 2024-09-13T17:06:01.180 INFO:tasks.workunit.client.0.smithi115.stdout:4/787: mknod d7/dd/de/d4e/d5a/d4f/d70/db6/cf1 0 2024-09-13T17:06:01.182 INFO:tasks.workunit.client.0.smithi115.stdout:4/788: creat d7/dd/de/d4e/d9f/ff2 x:0 0 0 2024-09-13T17:06:01.191 INFO:tasks.workunit.client.0.smithi115.stdout:1/759: read d5/d7/f21 [1647256,121933] 0 2024-09-13T17:06:01.191 INFO:tasks.workunit.client.0.smithi115.stdout:1/760: chown d5/c2a 6029 1 2024-09-13T17:06:01.191 INFO:tasks.workunit.client.0.smithi115.stdout:1/761: stat d5/f103 0 2024-09-13T17:06:01.191 INFO:tasks.workunit.client.0.smithi115.stdout:1/762: chown d5/f6 5831 1 2024-09-13T17:06:01.191 INFO:tasks.workunit.client.0.smithi115.stdout:1/763: fsync d5/d7/d33/d3a/fac 0 2024-09-13T17:06:01.191 INFO:tasks.workunit.client.0.smithi115.stdout:1/764: readlink d5/l19 0 2024-09-13T17:06:01.192 INFO:tasks.workunit.client.0.smithi115.stdout:1/765: stat d5/d7/d5c/dbc/cd1 0 2024-09-13T17:06:01.192 INFO:tasks.workunit.client.0.smithi115.stdout:1/766: mknod d5/d7/d33/d3a/dc3/c107 0 2024-09-13T17:06:01.193 INFO:tasks.workunit.client.0.smithi115.stdout:5/763: read d19/d2b/f44 [146107,35915] 0 2024-09-13T17:06:01.193 INFO:tasks.workunit.client.0.smithi115.stdout:5/764: fdatasync d19/d2b/d32/d55/d5e/f67 0 2024-09-13T17:06:01.195 INFO:tasks.workunit.client.0.smithi115.stdout:1/767: creat d5/d3e/da1/f108 x:0 0 0 2024-09-13T17:06:01.197 INFO:tasks.workunit.client.0.smithi115.stdout:1/768: mknod d5/d7/d33/d3a/dc3/ddd/df4/d102/c109 0 2024-09-13T17:06:01.197 INFO:tasks.workunit.client.0.smithi115.stdout:1/769: write d5/d7/d5c/fa5 [976617,123404] 0 2024-09-13T17:06:01.197 INFO:tasks.workunit.client.0.smithi115.stdout:1/770: creat d5/d60/d8e/f10a x:0 0 0 2024-09-13T17:06:01.197 INFO:tasks.workunit.client.0.smithi115.stdout:1/771: chown d5/d26/d2c/d89/fa9 124327 1 2024-09-13T17:06:01.197 INFO:tasks.workunit.client.0.smithi115.stdout:4/789: dread d7/f7f [0,4194304] 0 2024-09-13T17:06:01.198 INFO:tasks.workunit.client.0.smithi115.stdout:9/585: dwrite d0/d21/d4f/fab [0,4194304] 0 2024-09-13T17:06:01.198 INFO:tasks.workunit.client.0.smithi115.stdout:5/765: dread d19/d2c/f76 [0,4194304] 0 2024-09-13T17:06:01.198 INFO:tasks.workunit.client.0.smithi115.stdout:9/586: write d0/de/d10/f46 [47322,83419] 0 2024-09-13T17:06:01.198 INFO:tasks.workunit.client.0.smithi115.stdout:5/766: stat fd 0 2024-09-13T17:06:01.198 INFO:tasks.workunit.client.0.smithi115.stdout:5/767: chown d19/f8d 8664219 1 2024-09-13T17:06:01.199 INFO:tasks.workunit.client.0.smithi115.stdout:1/772: rename d5/d7/d5c/dab to d5/d7/d33/d3a/dc3/ddd/d10b 0 2024-09-13T17:06:01.202 INFO:tasks.workunit.client.0.smithi115.stdout:5/768: symlink d19/d2e/dc6/lfe 0 2024-09-13T17:06:01.204 INFO:tasks.workunit.client.0.smithi115.stdout:4/790: rename d7/dd/de/d4e/d5a/d4f/d70/db6/cbd to d7/dd/cf3 0 2024-09-13T17:06:01.206 INFO:tasks.workunit.client.0.smithi115.stdout:1/773: mknod d5/d60/d8e/c10c 0 2024-09-13T17:06:01.206 INFO:tasks.workunit.client.0.smithi115.stdout:1/774: write d5/d7/d33/d3a/f71 [436505,99136] 0 2024-09-13T17:06:01.208 INFO:tasks.workunit.client.0.smithi115.stdout:7/743: dwrite d0/d2/d67/d86/fb1 [0,4194304] 0 2024-09-13T17:06:01.208 INFO:tasks.workunit.client.0.smithi115.stdout:8/867: dwrite d0/d26/d29/f38 [0,4194304] 0 2024-09-13T17:06:01.208 INFO:tasks.workunit.client.0.smithi115.stdout:8/868: fdatasync d0/d26/d29/d59/d7e/da7/d28/dcd/fe2 0 2024-09-13T17:06:01.209 INFO:tasks.workunit.client.0.smithi115.stdout:4/791: getdents d7/dd/de/de6 0 2024-09-13T17:06:01.211 INFO:tasks.workunit.client.0.smithi115.stdout:1/775: creat d5/d7/d86/dec/f10d x:0 0 0 2024-09-13T17:06:01.215 INFO:tasks.workunit.client.0.smithi115.stdout:9/587: dread d0/d21/d42/f52 [0,4194304] 0 2024-09-13T17:06:01.216 INFO:tasks.workunit.client.0.smithi115.stdout:8/869: unlink d0/d21/d76/d83/l8c 0 2024-09-13T17:06:01.218 INFO:tasks.workunit.client.0.smithi115.stdout:5/769: read d19/d1d/f26 [813952,16912] 0 2024-09-13T17:06:01.218 INFO:tasks.workunit.client.0.smithi115.stdout:5/770: write d19/d2c/f76 [1170347,90690] 0 2024-09-13T17:06:01.219 INFO:tasks.workunit.client.0.smithi115.stdout:8/870: mkdir d0/d26/d29/d59/d7e/da7/d2b/d37/d126 0 2024-09-13T17:06:01.219 INFO:tasks.workunit.client.0.smithi115.stdout:8/871: write d0/d18/fb9 [624927,44868] 0 2024-09-13T17:06:01.221 INFO:tasks.workunit.client.0.smithi115.stdout:4/792: dread d7/dd/de/d4e/d6c/fdd [0,4194304] 0 2024-09-13T17:06:01.222 INFO:tasks.workunit.client.0.smithi115.stdout:9/588: rename d0/d21/d95 to d0/de/d37/dc5 0 2024-09-13T17:06:01.223 INFO:tasks.workunit.client.0.smithi115.stdout:9/589: fsync d0/d21/d42/f7b 0 2024-09-13T17:06:01.224 INFO:tasks.workunit.client.0.smithi115.stdout:5/771: mknod d19/d21/d3a/d5d/cff 0 2024-09-13T17:06:01.224 INFO:tasks.workunit.client.0.smithi115.stdout:4/793: dread d7/dd/f25 [0,4194304] 0 2024-09-13T17:06:01.230 INFO:tasks.workunit.client.0.smithi115.stdout:4/794: mkdir d7/dd/de/d4e/d6c/db0/deb/df4 0 2024-09-13T17:06:01.232 INFO:tasks.workunit.client.0.smithi115.stdout:4/795: write d7/dd/de/f5e [1168564,94511] 0 2024-09-13T17:06:01.238 INFO:tasks.workunit.client.0.smithi115.stdout:1/776: dwrite d5/d7/d33/d3a/f9b [0,4194304] 0 2024-09-13T17:06:01.239 INFO:tasks.workunit.client.0.smithi115.stdout:4/796: read d7/dd/f25 [1007046,17128] 0 2024-09-13T17:06:01.239 INFO:tasks.workunit.client.0.smithi115.stdout:4/797: write d7/dd/de/d4e/d5a/d4f/f8d [49138,21287] 0 2024-09-13T17:06:01.239 INFO:tasks.workunit.client.0.smithi115.stdout:4/798: truncate d7/dd/d3c/f6e 981577 0 2024-09-13T17:06:01.239 INFO:tasks.workunit.client.0.smithi115.stdout:7/744: dwrite d0/d2/d1e/d3d/d7c/fe4 [0,4194304] 0 2024-09-13T17:06:01.242 INFO:tasks.workunit.client.0.smithi115.stdout:1/777: symlink d5/d60/d7d/d87/l10e 0 2024-09-13T17:06:01.243 INFO:tasks.workunit.client.0.smithi115.stdout:1/778: stat d5/d7/d33/d3a/db2/lbd 0 2024-09-13T17:06:01.243 INFO:tasks.workunit.client.0.smithi115.stdout:4/799: mknod d7/dd/cf5 0 2024-09-13T17:06:01.245 INFO:tasks.workunit.client.0.smithi115.stdout:1/779: rename d5/d7/l1a to d5/d60/d7d/l10f 0 2024-09-13T17:06:01.246 INFO:tasks.workunit.client.0.smithi115.stdout:4/800: creat d7/dd/d3c/d7b/d97/ff6 x:0 0 0 2024-09-13T17:06:01.249 INFO:tasks.workunit.client.0.smithi115.stdout:1/780: mknod d5/d7/d33/d3a/dc3/ddd/c110 0 2024-09-13T17:06:01.250 INFO:tasks.workunit.client.0.smithi115.stdout:5/772: dwrite d19/d2b/d32/f95 [0,4194304] 0 2024-09-13T17:06:01.251 INFO:tasks.workunit.client.0.smithi115.stdout:4/801: link d7/dd/c1f d7/dd/de/d4e/d6c/d77/cf7 0 2024-09-13T17:06:01.254 INFO:tasks.workunit.client.0.smithi115.stdout:9/590: dwrite d0/f1d [0,4194304] 0 2024-09-13T17:06:01.255 INFO:tasks.workunit.client.0.smithi115.stdout:1/781: dread d5/d26/f29 [0,4194304] 0 2024-09-13T17:06:01.258 INFO:tasks.workunit.client.0.smithi115.stdout:7/745: dwrite d0/d2/d1e/d3d/d6c/f30 [4194304,4194304] 0 2024-09-13T17:06:01.259 INFO:tasks.workunit.client.0.smithi115.stdout:5/773: rmdir d19/d21/dc0 0 2024-09-13T17:06:01.259 INFO:tasks.workunit.client.0.smithi115.stdout:5/774: creat d19/d21/d3a/d5d/dbe/f100 x:0 0 0 2024-09-13T17:06:01.259 INFO:tasks.workunit.client.0.smithi115.stdout:5/775: readlink l11 0 2024-09-13T17:06:01.259 INFO:tasks.workunit.client.0.smithi115.stdout:5/776: dread - d19/d2b/d32/d55/d5e/d87/d86/fee zero size 2024-09-13T17:06:01.261 INFO:tasks.workunit.client.0.smithi115.stdout:4/802: link d7/dd/d3c/d74/d8b/cc1 d7/dd/de/d4e/cf8 0 2024-09-13T17:06:01.264 INFO:tasks.workunit.client.0.smithi115.stdout:9/591: creat d0/de/d37/dc5/fc6 x:0 0 0 2024-09-13T17:06:01.266 INFO:tasks.workunit.client.0.smithi115.stdout:7/746: dread d0/d97/f98 [0,4194304] 0 2024-09-13T17:06:01.267 INFO:tasks.workunit.client.0.smithi115.stdout:5/777: dread d19/f3c [0,4194304] 0 2024-09-13T17:06:01.270 INFO:tasks.workunit.client.0.smithi115.stdout:4/803: rename d7/dd/de/d4e/d5a/d4f/d53/l54 to d7/dd/d3c/d7b/d97/lf9 0 2024-09-13T17:06:01.273 INFO:tasks.workunit.client.0.smithi115.stdout:7/747: truncate d0/d3b/f6a 1929084 0 2024-09-13T17:06:01.273 INFO:tasks.workunit.client.0.smithi115.stdout:7/748: stat d0/d2/d1e/cc0 0 2024-09-13T17:06:01.273 INFO:tasks.workunit.client.0.smithi115.stdout:9/592: dread d0/d21/d4f/fab [0,4194304] 0 2024-09-13T17:06:01.273 INFO:tasks.workunit.client.0.smithi115.stdout:5/778: dread d19/d21/f4a [0,4194304] 0 2024-09-13T17:06:01.274 INFO:tasks.workunit.client.0.smithi115.stdout:5/779: write d19/d2c/fba [733327,75499] 0 2024-09-13T17:06:01.275 INFO:tasks.workunit.client.0.smithi115.stdout:5/780: mkdir d19/d1d/d101 0 2024-09-13T17:06:01.276 INFO:tasks.workunit.client.0.smithi115.stdout:5/781: truncate d19/d2b/f50 2684009 0 2024-09-13T17:06:01.278 INFO:tasks.workunit.client.0.smithi115.stdout:4/804: dread d7/dd/de/d4e/d9f/fb1 [0,4194304] 0 2024-09-13T17:06:01.278 INFO:tasks.workunit.client.0.smithi115.stdout:4/805: write d7/dd/de/fac [1362898,38670] 0 2024-09-13T17:06:01.278 INFO:tasks.workunit.client.0.smithi115.stdout:5/782: write d19/d2b/d32/d55/f94 [465988,88427] 0 2024-09-13T17:06:01.279 INFO:tasks.workunit.client.0.smithi115.stdout:5/783: creat d19/d2c/dd0/d63/f102 x:0 0 0 2024-09-13T17:06:01.280 INFO:tasks.workunit.client.0.smithi115.stdout:5/784: creat d19/d2c/f103 x:0 0 0 2024-09-13T17:06:01.280 INFO:tasks.workunit.client.0.smithi115.stdout:5/785: write d19/d2b/d32/d55/d5e/d87/db0/fe5 [477985,11066] 0 2024-09-13T17:06:01.281 INFO:tasks.workunit.client.0.smithi115.stdout:7/749: write d0/faf [84175,16599] 0 2024-09-13T17:06:01.286 INFO:tasks.workunit.client.0.smithi115.stdout:9/593: dread d0/de/d10/d15/f24 [0,4194304] 0 2024-09-13T17:06:01.290 INFO:tasks.workunit.client.0.smithi115.stdout:9/594: symlink d0/de/d10/d15/d86/lc7 0 2024-09-13T17:06:01.293 INFO:tasks.workunit.client.0.smithi115.stdout:9/595: dread - d0/d21/d65/fb9 zero size 2024-09-13T17:06:01.304 INFO:tasks.workunit.client.0.smithi115.stdout:4/806: dwrite d7/dd/d3c/d74/d8b/fb9 [0,4194304] 0 2024-09-13T17:06:01.305 INFO:tasks.workunit.client.0.smithi115.stdout:5/786: dwrite d19/d2b/f6a [0,4194304] 0 2024-09-13T17:06:01.305 INFO:tasks.workunit.client.0.smithi115.stdout:7/750: dwrite d0/d2/f8 [4194304,4194304] 0 2024-09-13T17:06:01.307 INFO:tasks.workunit.client.0.smithi115.stdout:4/807: rmdir d7/dd/de/d4e/d6c/db0/deb/df4 0 2024-09-13T17:06:01.307 INFO:tasks.workunit.client.0.smithi115.stdout:4/808: write d7/dd/de/d4e/d5a/d4f/f8d [817199,46134] 0 2024-09-13T17:06:01.307 INFO:tasks.workunit.client.0.smithi115.stdout:4/809: readlink d7/dd/de/d4e/d5a/l82 0 2024-09-13T17:06:01.312 INFO:tasks.workunit.client.0.smithi115.stdout:5/787: rename d19/d2b/f44 to d19/d2e/f104 0 2024-09-13T17:06:01.316 INFO:tasks.workunit.client.0.smithi115.stdout:7/751: rename d0/f56 to d0/d3b/d50/d21/d2f/f108 0 2024-09-13T17:06:01.317 INFO:tasks.workunit.client.0.smithi115.stdout:5/788: creat d19/d21/dcc/f105 x:0 0 0 2024-09-13T17:06:01.320 INFO:tasks.workunit.client.0.smithi115.stdout:7/752: mkdir d0/d2/d67/d109 0 2024-09-13T17:06:01.322 INFO:tasks.workunit.client.0.smithi115.stdout:5/789: mkdir d19/d2b/d32/d55/d5e/d87/da4/da6/d106 0 2024-09-13T17:06:01.324 INFO:tasks.workunit.client.0.smithi115.stdout:5/790: rmdir d19/d2b/d32/d55/d5e 39 2024-09-13T17:06:01.326 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:00 smithi195 ceph-mon[34981]: pgmap v19: 65 pgs: 65 active+clean; 3.4 GiB data, 9.6 GiB used, 527 GiB / 536 GiB avail; 351 MiB/s rd, 422 MiB/s wr, 613 op/s 2024-09-13T17:06:01.327 INFO:tasks.workunit.client.0.smithi115.stdout:5/791: truncate d19/f1e 4069743 0 2024-09-13T17:06:01.327 INFO:tasks.workunit.client.0.smithi115.stdout:5/792: creat d19/d21/d3a/d5d/dbe/f107 x:0 0 0 2024-09-13T17:06:01.330 INFO:tasks.workunit.client.0.smithi115.stdout:5/793: link cf d19/d2c/dd0/c108 0 2024-09-13T17:06:01.333 INFO:tasks.workunit.client.0.smithi115.stdout:5/794: symlink d19/d2b/d32/d55/d5e/d87/da4/da6/d106/l109 0 2024-09-13T17:06:01.334 INFO:tasks.workunit.client.0.smithi115.stdout:5/795: getdents d19/d2e/dc6 0 2024-09-13T17:06:01.337 INFO:tasks.workunit.client.0.smithi115.stdout:7/753: dwrite d0/d51/fc1 [4194304,4194304] 0 2024-09-13T17:06:01.340 INFO:tasks.workunit.client.0.smithi115.stdout:5/796: getdents d19/d2e/d6b 0 2024-09-13T17:06:01.344 INFO:tasks.workunit.client.0.smithi115.stdout:5/797: chown d19/d1d/c24 86618 1 2024-09-13T17:06:01.344 INFO:tasks.workunit.client.0.smithi115.stdout:5/798: write d19/d2e/ffd [290586,110341] 0 2024-09-13T17:06:01.347 INFO:tasks.workunit.client.0.smithi115.stdout:5/799: creat d19/d2b/d69/f10a x:0 0 0 2024-09-13T17:06:01.347 INFO:tasks.workunit.client.0.smithi115.stdout:5/800: dread - d19/d21/d3a/fbb zero size 2024-09-13T17:06:01.347 INFO:tasks.workunit.client.0.smithi115.stdout:5/801: chown d19/d2b/d32/d55/d5e/c88 86343 1 2024-09-13T17:06:01.347 INFO:tasks.workunit.client.0.smithi115.stdout:7/754: dread d0/d3b/d50/f47 [0,4194304] 0 2024-09-13T17:06:01.347 INFO:tasks.workunit.client.0.smithi115.stdout:4/810: dwrite d7/dd/d3c/d74/fa6 [0,4194304] 0 2024-09-13T17:06:01.349 INFO:tasks.workunit.client.0.smithi115.stdout:5/802: link d19/d2e/d6b/lfc d19/d75/dcd/l10b 0 2024-09-13T17:06:01.352 INFO:tasks.workunit.client.0.smithi115.stdout:4/811: mknod d7/dd/de/d4e/d5a/d4f/d70/cfa 0 2024-09-13T17:06:01.352 INFO:tasks.workunit.client.0.smithi115.stdout:4/812: fsync d7/d86/d88/f93 0 2024-09-13T17:06:01.354 INFO:tasks.workunit.client.0.smithi115.stdout:5/803: creat d19/d2b/d32/d55/d5e/d87/f10c x:0 0 0 2024-09-13T17:06:01.354 INFO:tasks.workunit.client.0.smithi115.stdout:5/804: chown d19/d2b/f6a 264888807 1 2024-09-13T17:06:01.355 INFO:tasks.workunit.client.0.smithi115.stdout:7/755: write d0/d2/d1e/f76 [5684513,29348] 0 2024-09-13T17:06:01.355 INFO:tasks.workunit.client.0.smithi115.stdout:4/813: creat d7/dd/de/d4e/d5a/ffb x:0 0 0 2024-09-13T17:06:01.357 INFO:tasks.workunit.client.0.smithi115.stdout:5/805: mkdir d19/d21/d3a/d5d/dbe/d10d 0 2024-09-13T17:06:01.358 INFO:tasks.workunit.client.0.smithi115.stdout:4/814: rename d7/d86/lad to d7/lfc 0 2024-09-13T17:06:01.358 INFO:tasks.workunit.client.0.smithi115.stdout:4/815: stat d7/dd/de/l39 0 2024-09-13T17:06:01.358 INFO:tasks.workunit.client.0.smithi115.stdout:4/816: stat d7/dd/d3c/d74/d8b/dd2 0 2024-09-13T17:06:01.360 INFO:tasks.workunit.client.0.smithi115.stdout:7/756: getdents d0/d3b/d50/d21 0 2024-09-13T17:06:01.362 INFO:tasks.workunit.client.0.smithi115.stdout:5/806: mkdir d19/d2c/dd3/d10e 0 2024-09-13T17:06:01.363 INFO:tasks.workunit.client.0.smithi115.stdout:7/757: mknod d0/d2/c10a 0 2024-09-13T17:06:01.363 INFO:tasks.workunit.client.0.smithi115.stdout:7/758: creat d0/d2/d1e/de5/f10b x:0 0 0 2024-09-13T17:06:01.363 INFO:tasks.workunit.client.0.smithi115.stdout:5/807: truncate d19/d2b/d32/f95 2346251 0 2024-09-13T17:06:01.365 INFO:tasks.workunit.client.0.smithi115.stdout:7/759: symlink d0/d2/d67/d86/d94/d9b/dbb/l10c 0 2024-09-13T17:06:01.366 INFO:tasks.workunit.client.0.smithi115.stdout:5/808: unlink d19/f3c 0 2024-09-13T17:06:01.367 INFO:tasks.workunit.client.0.smithi115.stdout:5/809: creat d19/d2b/d32/d55/d5e/d87/d86/f10f x:0 0 0 2024-09-13T17:06:01.367 INFO:tasks.workunit.client.0.smithi115.stdout:5/810: read - d19/d21/d3a/d5d/dbe/f107 zero size 2024-09-13T17:06:01.367 INFO:tasks.workunit.client.0.smithi115.stdout:5/811: fdatasync d19/d21/fb1 0 2024-09-13T17:06:01.369 INFO:tasks.workunit.client.0.smithi115.stdout:5/812: creat d19/d2b/d32/d55/d5e/d87/db0/dde/f110 x:0 0 0 2024-09-13T17:06:01.369 INFO:tasks.workunit.client.0.smithi115.stdout:5/813: write d19/d21/f80 [1417006,25844] 0 2024-09-13T17:06:01.369 INFO:tasks.workunit.client.0.smithi115.stdout:5/814: creat d19/d75/dcd/f111 x:0 0 0 2024-09-13T17:06:01.371 INFO:tasks.workunit.client.0.smithi115.stdout:5/815: link d19/d2b/d69/l7f d19/d21/d3a/d5d/dbe/d10d/l112 0 2024-09-13T17:06:01.371 INFO:tasks.workunit.client.0.smithi115.stdout:5/816: fdatasync d19/d2b/f6a 0 2024-09-13T17:06:01.372 INFO:tasks.workunit.client.0.smithi115.stdout:5/817: write d19/d2b/d32/d55/d5e/d87/d86/f8c [36501,11657] 0 2024-09-13T17:06:01.372 INFO:tasks.workunit.client.0.smithi115.stdout:5/818: fsync d19/d21/d3a/d5d/f9e 0 2024-09-13T17:06:01.373 INFO:tasks.workunit.client.0.smithi115.stdout:7/760: dread d0/d2/d1e/d3d/d82/f2c [0,4194304] 0 2024-09-13T17:06:01.374 INFO:tasks.workunit.client.0.smithi115.stdout:4/817: dwrite d7/dd/de/d4e/d9f/ff2 [0,4194304] 0 2024-09-13T17:06:01.374 INFO:tasks.workunit.client.0.smithi115.stdout:5/819: link d19/d21/fdd d19/d2b/d32/d55/d5e/d87/d86/de8/f113 0 2024-09-13T17:06:01.381 INFO:tasks.workunit.client.0.smithi115.stdout:4/818: rename d7/dbe/f99 to d7/dd/de/d4e/d5a/ffd 0 2024-09-13T17:06:01.399 INFO:tasks.workunit.client.0.smithi115.stdout:5/820: dwrite d19/d21/d3a/d5d/dbe/f107 [0,4194304] 0 2024-09-13T17:06:01.399 INFO:tasks.workunit.client.0.smithi115.stdout:7/761: dwrite d0/d2/d1e/de5/dfb/ffe [0,4194304] 0 2024-09-13T17:06:01.402 INFO:tasks.workunit.client.0.smithi115.stdout:5/821: rmdir d19/d21/d3a/d5d/dbe/d10d 39 2024-09-13T17:06:01.404 INFO:tasks.workunit.client.0.smithi115.stdout:5/822: mkdir d19/d2b/d32/d55/d5e/d114 0 2024-09-13T17:06:01.405 INFO:tasks.workunit.client.0.smithi115.stdout:5/823: creat d19/d21/f115 x:0 0 0 2024-09-13T17:06:01.407 INFO:tasks.workunit.client.0.smithi115.stdout:5/824: mknod d19/d2b/d32/d55/d5e/d87/c116 0 2024-09-13T17:06:01.407 INFO:tasks.workunit.client.0.smithi115.stdout:7/762: write d0/d2/d1e/f32 [6384140,15662] 0 2024-09-13T17:06:01.408 INFO:tasks.workunit.client.0.smithi115.stdout:5/825: rmdir d19/d21/d3a/d5d/dbe/d10d 39 2024-09-13T17:06:01.408 INFO:tasks.workunit.client.0.smithi115.stdout:5/826: fdatasync d19/d2b/d32/d55/d5e/d87/d86/fb5 0 2024-09-13T17:06:01.411 INFO:tasks.workunit.client.0.smithi115.stdout:7/763: link d0/d2/d4a/cfd d0/d2/d67/d86/d94/d9b/dbb/c10d 0 2024-09-13T17:06:01.415 INFO:tasks.workunit.client.0.smithi115.stdout:5/827: getdents d19/d21/d3a/d5d/dbe/d10d 0 2024-09-13T17:06:01.435 INFO:tasks.workunit.client.0.smithi115.stdout:7/764: dwrite d0/d2/d1e/de5/dfb/ffe [0,4194304] 0 2024-09-13T17:06:01.436 INFO:tasks.workunit.client.0.smithi115.stdout:7/765: creat d0/d3b/d54/f10e x:0 0 0 2024-09-13T17:06:01.437 INFO:tasks.workunit.client.0.smithi115.stdout:7/766: symlink d0/d2/d1e/dd8/l10f 0 2024-09-13T17:06:01.438 INFO:tasks.workunit.client.0.smithi115.stdout:5/828: dwrite d19/f9c [0,4194304] 0 2024-09-13T17:06:01.446 INFO:tasks.workunit.client.0.smithi115.stdout:5/829: dread d19/d21/d3a/d5d/f9e [0,4194304] 0 2024-09-13T17:06:01.446 INFO:tasks.workunit.client.0.smithi115.stdout:7/767: dread d0/d2/d4a/f5f [4194304,4194304] 0 2024-09-13T17:06:01.447 INFO:tasks.workunit.client.0.smithi115.stdout:7/768: symlink d0/d2/d1e/d73/l110 0 2024-09-13T17:06:01.450 INFO:tasks.workunit.client.0.smithi115.stdout:7/769: symlink d0/d2/d1e/l111 0 2024-09-13T17:06:01.452 INFO:tasks.workunit.client.0.smithi115.stdout:7/770: rmdir d0/d2/d1e/d3d/d82/d44/da7/dea/df8 0 2024-09-13T17:06:01.452 INFO:tasks.workunit.client.0.smithi115.stdout:7/771: dread - d0/d3b/d50/ff6 zero size 2024-09-13T17:06:01.454 INFO:tasks.workunit.client.0.smithi115.stdout:7/772: creat d0/d2/d1e/d3d/d82/d44/dac/f112 x:0 0 0 2024-09-13T17:06:01.863 INFO:tasks.workunit.client.0.smithi115.stdout:0/647: sync 2024-09-13T17:06:01.880 INFO:tasks.workunit.client.0.smithi115.stdout:0/648: dwrite d9/d1d/d24/d26/d36/d48/f4c [4194304,4194304] 0 2024-09-13T17:06:02.016 INFO:tasks.workunit.client.0.smithi115.stdout:8/872: sync 2024-09-13T17:06:02.017 INFO:tasks.workunit.client.0.smithi115.stdout:9/596: sync 2024-09-13T17:06:02.017 INFO:tasks.workunit.client.0.smithi115.stdout:6/729: sync 2024-09-13T17:06:02.017 INFO:tasks.workunit.client.0.smithi115.stdout:2/915: sync 2024-09-13T17:06:02.017 INFO:tasks.workunit.client.0.smithi115.stdout:7/773: sync 2024-09-13T17:06:02.017 INFO:tasks.workunit.client.0.smithi115.stdout:4/819: sync 2024-09-13T17:06:02.017 INFO:tasks.workunit.client.0.smithi115.stdout:8/873: chown d0/cf 409442443 1 2024-09-13T17:06:02.017 INFO:tasks.workunit.client.0.smithi115.stdout:2/916: chown d3/d4d/de/d99/d9a/df1/dfa/d55/lee 1542808 1 2024-09-13T17:06:02.017 INFO:tasks.workunit.client.0.smithi115.stdout:6/730: dread - d8/db/dd/fba zero size 2024-09-13T17:06:02.017 INFO:tasks.workunit.client.0.smithi115.stdout:8/874: fsync d0/f53 0 2024-09-13T17:06:02.017 INFO:tasks.workunit.client.0.smithi115.stdout:1/782: sync 2024-09-13T17:06:02.017 INFO:tasks.workunit.client.0.smithi115.stdout:5/830: sync 2024-09-13T17:06:02.017 INFO:tasks.workunit.client.0.smithi115.stdout:5/831: fsync d19/d2c/f7e 0 2024-09-13T17:06:02.018 INFO:tasks.workunit.client.0.smithi115.stdout:5/832: chown d19/d21/d3a 14666 1 2024-09-13T17:06:02.018 INFO:tasks.workunit.client.0.smithi115.stdout:1/783: write d5/d26/d2c/d89/fa3 [1273227,68480] 0 2024-09-13T17:06:02.018 INFO:tasks.workunit.client.0.smithi115.stdout:1/784: fdatasync d5/f95 0 2024-09-13T17:06:02.018 INFO:tasks.workunit.client.0.smithi115.stdout:4/820: creat d7/dd/de/d4e/ffe x:0 0 0 2024-09-13T17:06:02.020 INFO:tasks.workunit.client.0.smithi115.stdout:2/917: symlink d3/d108/l124 0 2024-09-13T17:06:02.023 INFO:tasks.workunit.client.0.smithi115.stdout:8/875: mkdir d0/d26/d29/d59/d7e/da7/d2b/d3b/d11f/d127 0 2024-09-13T17:06:02.023 INFO:tasks.workunit.client.0.smithi115.stdout:5/833: dread d19/d21/d3a/d5d/f70 [0,4194304] 0 2024-09-13T17:06:02.025 INFO:tasks.workunit.client.0.smithi115.stdout:9/597: dread d0/d21/d65/d6f/fb0 [0,4194304] 0 2024-09-13T17:06:02.025 INFO:tasks.workunit.client.0.smithi115.stdout:1/785: creat d5/d60/d7d/d100/f111 x:0 0 0 2024-09-13T17:06:02.026 INFO:tasks.workunit.client.0.smithi115.stdout:2/918: getdents d3/d4d/d13/d77 0 2024-09-13T17:06:02.031 INFO:tasks.workunit.client.0.smithi115.stdout:8/876: link d0/d26/d29/d59/d7e/da7/c8e d0/d42/c128 0 2024-09-13T17:06:02.031 INFO:tasks.workunit.client.0.smithi115.stdout:5/834: write d19/d1d/f2f [5213830,47522] 0 2024-09-13T17:06:02.031 INFO:tasks.workunit.client.0.smithi115.stdout:4/821: dread d7/f12 [0,4194304] 0 2024-09-13T17:06:02.031 INFO:tasks.workunit.client.0.smithi115.stdout:4/822: creat d7/dd/de/d4e/d9f/fff x:0 0 0 2024-09-13T17:06:02.033 INFO:tasks.workunit.client.0.smithi115.stdout:9/598: symlink d0/de/d10/d15/d86/lc8 0 2024-09-13T17:06:02.034 INFO:tasks.workunit.client.0.smithi115.stdout:1/786: link d5/d26/d2c/d62/f7f d5/d7/d33/d3a/f112 0 2024-09-13T17:06:02.037 INFO:tasks.workunit.client.0.smithi115.stdout:8/877: rename d0/d15/d3e/f47 to d0/d26/d29/f129 0 2024-09-13T17:06:02.038 INFO:tasks.workunit.client.0.smithi115.stdout:2/919: dread d3/d4d/dd/df/d5c/f7c [0,4194304] 0 2024-09-13T17:06:02.038 INFO:tasks.workunit.client.0.smithi115.stdout:2/920: stat d3/d4d/d13/da2/fe3 0 2024-09-13T17:06:02.039 INFO:tasks.workunit.client.0.smithi115.stdout:6/731: dwrite d8/d33/d40/d4c/f62 [0,4194304] 0 2024-09-13T17:06:02.039 INFO:tasks.workunit.client.0.smithi115.stdout:5/835: creat d19/f117 x:0 0 0 2024-09-13T17:06:02.039 INFO:tasks.workunit.client.0.smithi115.stdout:5/836: stat d19/d21/f80 0 2024-09-13T17:06:02.040 INFO:tasks.workunit.client.0.smithi115.stdout:7/774: dwrite d0/d3b/d50/d21/d99/fdf [0,4194304] 0 2024-09-13T17:06:02.040 INFO:tasks.workunit.client.0.smithi115.stdout:7/775: readlink d0/d3b/lc3 0 2024-09-13T17:06:02.041 INFO:tasks.workunit.client.0.smithi115.stdout:4/823: creat d7/dd/de/d4e/d5a/d4f/d70/f100 x:0 0 0 2024-09-13T17:06:02.043 INFO:tasks.workunit.client.0.smithi115.stdout:1/787: rename d5/d7/l17 to d5/d7/d33/d3a/dc3/dfd/l113 0 2024-09-13T17:06:02.044 INFO:tasks.workunit.client.0.smithi115.stdout:8/878: mknod d0/d26/d29/d59/d7e/da7/d2b/d37/c12a 0 2024-09-13T17:06:02.044 INFO:tasks.workunit.client.0.smithi115.stdout:8/879: write d0/d26/d29/f38 [4785245,119905] 0 2024-09-13T17:06:02.044 INFO:tasks.workunit.client.0.smithi115.stdout:8/880: fdatasync d0/d21/d76/d83/d5a/fbb 0 2024-09-13T17:06:02.046 INFO:tasks.workunit.client.0.smithi115.stdout:6/732: mkdir d8/d33/d40/d4c/d66/de3 0 2024-09-13T17:06:02.046 INFO:tasks.workunit.client.0.smithi115.stdout:6/733: fsync d8/db/d1d/f3d 0 2024-09-13T17:06:02.046 INFO:tasks.workunit.client.0.smithi115.stdout:9/599: dread d0/de/d37/dc5/fb5 [0,4194304] 0 2024-09-13T17:06:02.047 INFO:tasks.workunit.client.0.smithi115.stdout:7/776: creat d0/d2/d1e/d3d/d7c/f113 x:0 0 0 2024-09-13T17:06:02.048 INFO:tasks.workunit.client.0.smithi115.stdout:4/824: rmdir d7/dd/de/de6 39 2024-09-13T17:06:02.048 INFO:tasks.workunit.client.0.smithi115.stdout:6/734: dread d8/d33/d40/fd4 [0,4194304] 0 2024-09-13T17:06:02.049 INFO:tasks.workunit.client.0.smithi115.stdout:8/881: dread d0/d21/d76/d83/f7b [0,4194304] 0 2024-09-13T17:06:02.051 INFO:tasks.workunit.client.0.smithi115.stdout:2/921: rename d3/d4d/d13/d77/l88 to d3/d4d/d13/da2/l125 0 2024-09-13T17:06:02.051 INFO:tasks.workunit.client.0.smithi115.stdout:2/922: fsync d3/d4d/dd/fca 0 2024-09-13T17:06:02.051 INFO:tasks.workunit.client.0.smithi115.stdout:2/923: creat d3/d4d/d13/d62/d92/dd7/d7d/f126 x:0 0 0 2024-09-13T17:06:02.052 INFO:tasks.workunit.client.0.smithi115.stdout:1/788: link d5/d7/d33/d3a/dc3/c107 d5/d26/dc9/c114 0 2024-09-13T17:06:02.056 INFO:tasks.workunit.client.0.smithi115.stdout:9/600: unlink d0/d21/ca1 0 2024-09-13T17:06:02.057 INFO:tasks.workunit.client.0.smithi115.stdout:8/882: dread d0/d18/f65 [0,4194304] 0 2024-09-13T17:06:02.057 INFO:tasks.workunit.client.0.smithi115.stdout:7/777: symlink d0/d2/d1e/d73/l114 0 2024-09-13T17:06:02.058 INFO:tasks.workunit.client.0.smithi115.stdout:7/778: stat d0/d3b/d50/d21/d2f/d9e/fc6 0 2024-09-13T17:06:02.063 INFO:tasks.workunit.client.0.smithi115.stdout:2/924: rename d3/d4d/d13/da2/fe0 to d3/d4d/de/d99/d9a/df1/dfa/d46/f127 0 2024-09-13T17:06:02.065 INFO:tasks.workunit.client.0.smithi115.stdout:1/789: creat d5/d7/d33/d3a/dc3/ddd/d10b/f115 x:0 0 0 2024-09-13T17:06:02.065 INFO:tasks.workunit.client.0.smithi115.stdout:1/790: readlink d5/d7/d33/d3a/dc3/ddd/d10b/lb0 0 2024-09-13T17:06:02.065 INFO:tasks.workunit.client.0.smithi115.stdout:5/837: dwrite d19/d2b/f49 [0,4194304] 0 2024-09-13T17:06:02.066 INFO:tasks.workunit.client.0.smithi115.stdout:9/601: symlink d0/d21/d65/d6f/lc9 0 2024-09-13T17:06:02.067 INFO:tasks.workunit.client.0.smithi115.stdout:8/883: rmdir d0/d42/d80/d94/db2/d102 39 2024-09-13T17:06:02.067 INFO:tasks.workunit.client.0.smithi115.stdout:8/884: rename d0/d26/d29 to d0/d26/d29/d98/d12b 22 2024-09-13T17:06:02.073 INFO:tasks.workunit.client.0.smithi115.stdout:4/825: mkdir d7/dd/d3c/d101 0 2024-09-13T17:06:02.074 INFO:tasks.workunit.client.0.smithi115.stdout:6/735: getdents d8/d33/d40/d67/db4/d24/d17/d9b 0 2024-09-13T17:06:02.076 INFO:tasks.workunit.client.0.smithi115.stdout:1/791: getdents d5/d3e/d59 0 2024-09-13T17:06:02.081 INFO:tasks.workunit.client.0.smithi115.stdout:5/838: rmdir d19/d2e/dc6 39 2024-09-13T17:06:02.081 INFO:tasks.workunit.client.0.smithi115.stdout:5/839: creat d19/d2b/d69/f118 x:0 0 0 2024-09-13T17:06:02.084 INFO:tasks.workunit.client.0.smithi115.stdout:1/792: dread d5/d7/f49 [0,4194304] 0 2024-09-13T17:06:02.085 INFO:tasks.workunit.client.0.smithi115.stdout:9/602: mknod d0/de/d10/d15/d86/d8d/db1/cca 0 2024-09-13T17:06:02.088 INFO:tasks.workunit.client.0.smithi115.stdout:8/885: mkdir d0/d42/d80/d94/db2/d12c 0 2024-09-13T17:06:02.088 INFO:tasks.workunit.client.0.smithi115.stdout:8/886: stat d0/f13 0 2024-09-13T17:06:02.097 INFO:tasks.workunit.client.0.smithi115.stdout:1/793: symlink d5/d7/d86/l116 0 2024-09-13T17:06:02.097 INFO:tasks.workunit.client.0.smithi115.stdout:7/779: write d0/d2/d1e/d3d/d6c/f4c [1997935,54810] 0 2024-09-13T17:06:02.097 INFO:tasks.workunit.client.0.smithi115.stdout:7/780: chown d0/d3b 939 1 2024-09-13T17:06:02.098 INFO:tasks.workunit.client.0.smithi115.stdout:8/887: rename d0/d21/d76/dc1/cdb to d0/d26/d29/d59/d7e/da7/d28/d71/c12d 0 2024-09-13T17:06:02.099 INFO:tasks.workunit.client.0.smithi115.stdout:5/840: getdents d19/d2b/de6 0 2024-09-13T17:06:02.100 INFO:tasks.workunit.client.0.smithi115.stdout:1/794: truncate d5/d3e/d59/fe7 3942328 0 2024-09-13T17:06:02.100 INFO:tasks.workunit.client.0.smithi115.stdout:1/795: readlink d5/d3e/d59/lf0 0 2024-09-13T17:06:02.102 INFO:tasks.workunit.client.0.smithi115.stdout:7/781: unlink d0/d2/d1e/c57 0 2024-09-13T17:06:02.106 INFO:tasks.workunit.client.0.smithi115.stdout:4/826: dwrite d7/dd/d3c/d74/d8b/fb9 [0,4194304] 0 2024-09-13T17:06:02.107 INFO:tasks.workunit.client.0.smithi115.stdout:9/603: dwrite d0/d21/d65/fb9 [0,4194304] 0 2024-09-13T17:06:02.107 INFO:tasks.workunit.client.0.smithi115.stdout:6/736: dwrite d8/db/f70 [0,4194304] 0 2024-09-13T17:06:02.109 INFO:tasks.workunit.client.0.smithi115.stdout:5/841: dread d19/d2b/d32/d55/d5e/d87/d86/fb5 [0,4194304] 0 2024-09-13T17:06:02.111 INFO:tasks.workunit.client.0.smithi115.stdout:7/782: dread d0/d3b/fad [0,4194304] 0 2024-09-13T17:06:02.113 INFO:tasks.workunit.client.0.smithi115.stdout:8/888: write d0/d18/f2e [1268984,33638] 0 2024-09-13T17:06:02.114 INFO:tasks.workunit.client.0.smithi115.stdout:6/737: rename d8/db/d1d/fbe to d8/d33/d40/d67/db4/d24/d53/fe4 0 2024-09-13T17:06:02.117 INFO:tasks.workunit.client.0.smithi115.stdout:9/604: write d0/d21/d65/d6f/fb0 [1646474,123015] 0 2024-09-13T17:06:02.118 INFO:tasks.workunit.client.0.smithi115.stdout:9/605: write d0/d21/d65/d6f/f8a [163867,12483] 0 2024-09-13T17:06:02.118 INFO:tasks.workunit.client.0.smithi115.stdout:7/783: rename d0/d51 to d0/d2/d1e/de5/d115 0 2024-09-13T17:06:02.119 INFO:tasks.workunit.client.0.smithi115.stdout:5/842: write f5 [2877220,55514] 0 2024-09-13T17:06:02.122 INFO:tasks.workunit.client.0.smithi115.stdout:5/843: symlink d19/d2b/d32/d55/l119 0 2024-09-13T17:06:02.122 INFO:tasks.workunit.client.0.smithi115.stdout:0/649: sync 2024-09-13T17:06:02.125 INFO:tasks.workunit.client.0.smithi115.stdout:8/889: write d0/d15/f2f [3782824,91939] 0 2024-09-13T17:06:02.125 INFO:tasks.workunit.client.0.smithi115.stdout:1/796: dwrite d5/d7/f15 [0,4194304] 0 2024-09-13T17:06:02.127 INFO:tasks.workunit.client.0.smithi115.stdout:4/827: dwrite d7/dd/de/d4e/d5a/ffb [0,4194304] 0 2024-09-13T17:06:02.131 INFO:tasks.workunit.client.0.smithi115.stdout:5/844: getdents d19/d2c/dd0 0 2024-09-13T17:06:02.132 INFO:tasks.workunit.client.0.smithi115.stdout:5/845: write d19/d1d/f26 [4407750,78798] 0 2024-09-13T17:06:02.132 INFO:tasks.workunit.client.0.smithi115.stdout:5/846: write d19/d2c/f103 [795193,109368] 0 2024-09-13T17:06:02.132 INFO:tasks.workunit.client.0.smithi115.stdout:8/890: symlink d0/d26/d29/d59/d7e/da7/dca/l12e 0 2024-09-13T17:06:02.141 INFO:tasks.workunit.client.0.smithi115.stdout:9/606: write d0/de/d10/f14 [7312571,83766] 0 2024-09-13T17:06:02.145 INFO:tasks.workunit.client.0.smithi115.stdout:5/847: mknod d19/d21/d3a/d5d/dbe/d10d/c11a 0 2024-09-13T17:06:02.145 INFO:tasks.workunit.client.0.smithi115.stdout:6/738: dwrite d8/db/d1d/f26 [0,4194304] 0 2024-09-13T17:06:02.147 INFO:tasks.workunit.client.0.smithi115.stdout:0/650: rename d9/d1b to d9/d27/d88/d99/dc7 0 2024-09-13T17:06:02.149 INFO:tasks.workunit.client.0.smithi115.stdout:9/607: mknod d0/de/d10/d15/d7f/ccb 0 2024-09-13T17:06:02.149 INFO:tasks.workunit.client.0.smithi115.stdout:9/608: dread - d0/d21/f59 zero size 2024-09-13T17:06:02.152 INFO:tasks.workunit.client.0.smithi115.stdout:5/848: getdents d19/d2b/d69/d8f/dda 0 2024-09-13T17:06:02.152 INFO:tasks.workunit.client.0.smithi115.stdout:5/849: truncate d19/fa2 848679 0 2024-09-13T17:06:02.152 INFO:tasks.workunit.client.0.smithi115.stdout:6/739: symlink d8/d33/d7f/d99/le5 0 2024-09-13T17:06:02.152 INFO:tasks.workunit.client.0.smithi115.stdout:0/651: truncate d9/d1d/d24/d26/d36/d48/f4c 2900364 0 2024-09-13T17:06:02.152 INFO:tasks.workunit.client.0.smithi115.stdout:0/652: fdatasync d9/d27/d88/fa2 0 2024-09-13T17:06:02.157 INFO:tasks.workunit.client.0.smithi115.stdout:4/828: dwrite d7/dd/de/d4e/d6c/f7c [0,4194304] 0 2024-09-13T17:06:02.157 INFO:tasks.workunit.client.0.smithi115.stdout:4/829: chown d7/dd/d3c/d74/d8b/dd2 23092 1 2024-09-13T17:06:02.158 INFO:tasks.workunit.client.0.smithi115.stdout:4/830: read d7/dd/de/fac [908489,417] 0 2024-09-13T17:06:02.159 INFO:tasks.workunit.client.0.smithi115.stdout:4/831: fsync d7/dd/d3c/d7b/f9a 0 2024-09-13T17:06:02.159 INFO:tasks.workunit.client.0.smithi115.stdout:4/832: dread - d7/dd/de/fc0 zero size 2024-09-13T17:06:02.159 INFO:tasks.workunit.client.0.smithi115.stdout:4/833: creat d7/dd/de/d4e/d6c/f102 x:0 0 0 2024-09-13T17:06:02.162 INFO:tasks.workunit.client.0.smithi115.stdout:7/784: dwrite d0/faf [0,4194304] 0 2024-09-13T17:06:02.163 INFO:tasks.workunit.client.0.smithi115.stdout:1/797: dwrite d5/d7/d33/d3a/fac [0,4194304] 0 2024-09-13T17:06:02.166 INFO:tasks.workunit.client.0.smithi115.stdout:5/850: write d19/d2c/dd0/fd4 [1841071,61850] 0 2024-09-13T17:06:02.166 INFO:tasks.workunit.client.0.smithi115.stdout:5/851: dread - d19/d2b/d32/d55/d5e/d87/d86/fcf zero size 2024-09-13T17:06:02.173 INFO:tasks.workunit.client.0.smithi115.stdout:4/834: write d7/f29 [1185433,97407] 0 2024-09-13T17:06:02.185 INFO:tasks.workunit.client.0.smithi115.stdout:4/835: write d7/dd/de/f3a [247773,22354] 0 2024-09-13T17:06:02.186 INFO:tasks.workunit.client.0.smithi115.stdout:8/891: dwrite d0/d26/d29/d59/d7e/da7/d28/dcd/fe2 [0,4194304] 0 2024-09-13T17:06:02.190 INFO:tasks.workunit.client.0.smithi115.stdout:4/836: rename d7/dd/de/d4e/d5a/d4f/f76 to d7/dd/de/d4e/d5a/d4f/d70/f103 0 2024-09-13T17:06:02.194 INFO:tasks.workunit.client.0.smithi115.stdout:0/653: dwrite d9/d1d/d24/d26/f45 [8388608,4194304] 0 2024-09-13T17:06:02.194 INFO:tasks.workunit.client.0.smithi115.stdout:8/892: creat d0/d26/d29/d59/d11a/f12f x:0 0 0 2024-09-13T17:06:02.196 INFO:tasks.workunit.client.0.smithi115.stdout:1/798: dwrite d5/d7/d33/d3a/db2/fd2 [0,4194304] 0 2024-09-13T17:06:02.198 INFO:tasks.workunit.client.0.smithi115.stdout:9/609: dwrite d0/de/d10/d15/f3b [0,4194304] 0 2024-09-13T17:06:02.198 INFO:tasks.workunit.client.0.smithi115.stdout:5/852: dwrite d19/dac/fc1 [0,4194304] 0 2024-09-13T17:06:02.198 INFO:tasks.workunit.client.0.smithi115.stdout:6/740: dwrite d8/db/dd/da2/db3/fb5 [0,4194304] 0 2024-09-13T17:06:02.202 INFO:tasks.workunit.client.0.smithi115.stdout:8/893: creat d0/d26/d29/d59/d7e/da7/d2b/db1/dda/df8/f130 x:0 0 0 2024-09-13T17:06:02.202 INFO:tasks.workunit.client.0.smithi115.stdout:7/785: write d0/d2/d67/d70/f8e [591341,65147] 0 2024-09-13T17:06:02.202 INFO:tasks.workunit.client.0.smithi115.stdout:7/786: chown d0/d2/d1e/de5/d115/l8d 57839481 1 2024-09-13T17:06:02.209 INFO:tasks.workunit.client.0.smithi115.stdout:1/799: dread d5/d60/f5e [0,4194304] 0 2024-09-13T17:06:02.209 INFO:tasks.workunit.client.0.smithi115.stdout:1/800: write d5/d7/d86/ffe [1419467,22628] 0 2024-09-13T17:06:02.210 INFO:tasks.workunit.client.0.smithi115.stdout:1/801: chown d5/d60/l50 13 1 2024-09-13T17:06:02.217 INFO:tasks.workunit.client.0.smithi115.stdout:5/853: creat d19/d2b/d69/db6/f11b x:0 0 0 2024-09-13T17:06:02.219 INFO:tasks.workunit.client.0.smithi115.stdout:0/654: dwrite d9/d1d/d24/d26/d2d/d30/d46/f53 [0,4194304] 0 2024-09-13T17:06:02.219 INFO:tasks.workunit.client.0.smithi115.stdout:0/655: chown d9/d27/fac 362242 1 2024-09-13T17:06:02.220 INFO:tasks.workunit.client.0.smithi115.stdout:6/741: creat d8/d33/d40/d67/db4/dbf/fe6 x:0 0 0 2024-09-13T17:06:02.221 INFO:tasks.workunit.client.0.smithi115.stdout:4/837: getdents d7/dd/d3c/d72/db3 0 2024-09-13T17:06:02.221 INFO:tasks.workunit.client.0.smithi115.stdout:9/610: dwrite d0/d21/d4f/fa4 [0,4194304] 0 2024-09-13T17:06:02.224 INFO:tasks.workunit.client.0.smithi115.stdout:1/802: link d5/d60/d7d/l10f d5/d7/d33/d3a/dc3/ddd/d10b/l117 0 2024-09-13T17:06:02.226 INFO:tasks.workunit.client.0.smithi115.stdout:1/803: dread d5/d7/f49 [0,4194304] 0 2024-09-13T17:06:02.232 INFO:tasks.workunit.client.0.smithi115.stdout:5/854: getdents d19/d2b/d69/d8f 0 2024-09-13T17:06:02.232 INFO:tasks.workunit.client.0.smithi115.stdout:5/855: write d19/d75/f7b [4736621,5618] 0 2024-09-13T17:06:02.232 INFO:tasks.workunit.client.0.smithi115.stdout:5/856: write d19/d75/f7b [3564671,77088] 0 2024-09-13T17:06:02.233 INFO:tasks.workunit.client.0.smithi115.stdout:5/857: stat d19/d2b/d32/d55/d5e/d87/c116 0 2024-09-13T17:06:02.236 INFO:tasks.workunit.client.0.smithi115.stdout:0/656: link d9/d1d/d24/d26/d2d/d30/d5c/ca8 d9/d1d/d24/d26/d2d/d30/d5c/d9a/cc8 0 2024-09-13T17:06:02.238 INFO:tasks.workunit.client.0.smithi115.stdout:6/742: truncate d8/d33/d40/d4c/d66/fb9 3596298 0 2024-09-13T17:06:02.240 INFO:tasks.workunit.client.0.smithi115.stdout:4/838: creat d7/dbe/f104 x:0 0 0 2024-09-13T17:06:02.241 INFO:tasks.workunit.client.0.smithi115.stdout:5/858: write d19/d21/d3a/d5d/dbe/f107 [476515,34430] 0 2024-09-13T17:06:02.241 INFO:tasks.workunit.client.0.smithi115.stdout:5/859: fsync d19/d2e/f84 0 2024-09-13T17:06:02.242 INFO:tasks.workunit.client.0.smithi115.stdout:9/611: mknod d0/de/d10/d15/d7f/ccc 0 2024-09-13T17:06:02.243 INFO:tasks.workunit.client.0.smithi115.stdout:1/804: creat d5/d3e/d59/f118 x:0 0 0 2024-09-13T17:06:02.245 INFO:tasks.workunit.client.0.smithi115.stdout:0/657: creat d9/d1d/d24/d26/d5d/d66/d83/dc1/fc9 x:0 0 0 2024-09-13T17:06:02.245 INFO:tasks.workunit.client.0.smithi115.stdout:0/658: write d9/d1d/d24/d26/d5d/f96 [526884,65449] 0 2024-09-13T17:06:02.246 INFO:tasks.workunit.client.0.smithi115.stdout:6/743: link d8/f76 d8/db/d49/fe7 0 2024-09-13T17:06:02.246 INFO:tasks.workunit.client.0.smithi115.stdout:6/744: fdatasync d8/d33/d7f/fbd 0 2024-09-13T17:06:02.248 INFO:tasks.workunit.client.0.smithi115.stdout:4/839: mknod d7/d86/c105 0 2024-09-13T17:06:02.249 INFO:tasks.workunit.client.0.smithi115.stdout:5/860: creat d19/d2c/dd3/f11c x:0 0 0 2024-09-13T17:06:02.252 INFO:tasks.workunit.client.0.smithi115.stdout:9/612: symlink d0/de/d10/d15/lcd 0 2024-09-13T17:06:02.252 INFO:tasks.workunit.client.0.smithi115.stdout:5/861: dread d19/d2e/f104 [0,4194304] 0 2024-09-13T17:06:02.253 INFO:tasks.workunit.client.0.smithi115.stdout:8/894: rename d0/d18/d51 to d0/d100/d131 0 2024-09-13T17:06:02.253 INFO:tasks.workunit.client.0.smithi115.stdout:8/895: readlink d0/d21/d3a/d60/dc6/le0 0 2024-09-13T17:06:02.255 INFO:tasks.workunit.client.0.smithi115.stdout:1/805: truncate d5/d26/d2c/d89/fa9 2030443 0 2024-09-13T17:06:02.255 INFO:tasks.workunit.client.0.smithi115.stdout:1/806: fdatasync d5/d26/d2c/f39 0 2024-09-13T17:06:02.257 INFO:tasks.workunit.client.0.smithi115.stdout:4/840: dread d7/dd/de/d4e/d5a/ffb [0,4194304] 0 2024-09-13T17:06:02.257 INFO:tasks.workunit.client.0.smithi115.stdout:4/841: creat d7/dd/da0/f106 x:0 0 0 2024-09-13T17:06:02.257 INFO:tasks.workunit.client.0.smithi115.stdout:0/659: symlink d9/d1d/d24/d26/d2d/d30/lca 0 2024-09-13T17:06:02.257 INFO:tasks.workunit.client.0.smithi115.stdout:0/660: write d9/d1d/d24/d26/d2d/d30/d46/f49 [1329824,62707] 0 2024-09-13T17:06:02.262 INFO:tasks.workunit.client.0.smithi115.stdout:6/745: symlink d8/d33/d40/d4c/d66/de3/le8 0 2024-09-13T17:06:02.262 INFO:tasks.workunit.client.0.smithi115.stdout:6/746: dread - d8/db/f5d zero size 2024-09-13T17:06:02.262 INFO:tasks.workunit.client.0.smithi115.stdout:6/747: creat d8/d33/d7f/fe9 x:0 0 0 2024-09-13T17:06:02.268 INFO:tasks.workunit.client.0.smithi115.stdout:9/613: mknod d0/de/d37/d83/cce 0 2024-09-13T17:06:02.270 INFO:tasks.workunit.client.0.smithi115.stdout:7/787: rename d0/d2/d1e/d3d/d6c/de0/df5 to d0/d2/d1e/d3d/d7c/d116 0 2024-09-13T17:06:02.273 INFO:tasks.workunit.client.0.smithi115.stdout:8/896: link d0/d100/c120 d0/d18/c132 0 2024-09-13T17:06:02.278 INFO:tasks.workunit.client.0.smithi115.stdout:0/661: dwrite d9/d1d/d24/d26/d36/d48/fa4 [0,4194304] 0 2024-09-13T17:06:02.278 INFO:tasks.workunit.client.0.smithi115.stdout:0/662: fsync d9/d27/d88/d99/dc7/fc6 0 2024-09-13T17:06:02.278 INFO:tasks.workunit.client.0.smithi115.stdout:5/862: rmdir d19/d21/d3a/d5d/dbe 39 2024-09-13T17:06:02.281 INFO:tasks.workunit.client.0.smithi115.stdout:6/748: rename d8/d33/d40/d4c/d66/fb9 to d8/d13/fea 0 2024-09-13T17:06:02.281 INFO:tasks.workunit.client.0.smithi115.stdout:8/897: getdents d0/d21/d3a/d60 0 2024-09-13T17:06:02.281 INFO:tasks.workunit.client.0.smithi115.stdout:8/898: read - d0/d42/d80/d94/f10d zero size 2024-09-13T17:06:02.282 INFO:tasks.workunit.client.0.smithi115.stdout:1/807: dwrite d5/d7/d33/d3a/db2/fd2 [0,4194304] 0 2024-09-13T17:06:02.282 INFO:tasks.workunit.client.0.smithi115.stdout:1/808: write d5/d7/d33/d3a/f71 [1108536,20087] 0 2024-09-13T17:06:02.282 INFO:tasks.workunit.client.0.smithi115.stdout:9/614: dwrite d0/de/d10/faa [0,4194304] 0 2024-09-13T17:06:02.285 INFO:tasks.workunit.client.0.smithi115.stdout:4/842: getdents d7/dd/de/d4e/d5a/d4f/d70 0 2024-09-13T17:06:02.285 INFO:tasks.workunit.client.0.smithi115.stdout:4/843: chown d7/dd/de/d4e 164453 1 2024-09-13T17:06:02.286 INFO:tasks.workunit.client.0.smithi115.stdout:6/749: dread d8/d33/d40/d67/db4/d24/f5f [0,4194304] 0 2024-09-13T17:06:02.288 INFO:tasks.workunit.client.0.smithi115.stdout:0/663: creat d9/d1d/d24/d26/d36/fcb x:0 0 0 2024-09-13T17:06:02.288 INFO:tasks.workunit.client.0.smithi115.stdout:0/664: stat d9/d1d/d24/d26/d36/fcb 0 2024-09-13T17:06:02.289 INFO:tasks.workunit.client.0.smithi115.stdout:0/665: chown d9/d1d/d24/d26/d2d/cb4 431734266 1 2024-09-13T17:06:02.289 INFO:tasks.workunit.client.0.smithi115.stdout:0/666: chown d9/d1d/d24/d26/d36/d48/c8c 26 1 2024-09-13T17:06:02.290 INFO:tasks.workunit.client.0.smithi115.stdout:5/863: link d19/d2b/d32/d55/d5e/ld9 d19/d2c/l11d 0 2024-09-13T17:06:02.290 INFO:tasks.workunit.client.0.smithi115.stdout:5/864: getdents d19/d2e/d6b 0 2024-09-13T17:06:02.294 INFO:tasks.workunit.client.0.smithi115.stdout:8/899: symlink d0/d100/l133 0 2024-09-13T17:06:02.294 INFO:tasks.workunit.client.0.smithi115.stdout:8/900: chown d0/d26/d29/d59/d7e/da7/d2b/d3b/fb4 8529364 1 2024-09-13T17:06:02.294 INFO:tasks.workunit.client.0.smithi115.stdout:8/901: chown d0/d42/d121 17421451 1 2024-09-13T17:06:02.295 INFO:tasks.workunit.client.0.smithi115.stdout:1/809: symlink d5/d7/d33/d3a/dc3/dfd/l119 0 2024-09-13T17:06:02.295 INFO:tasks.workunit.client.0.smithi115.stdout:1/810: dread - d5/d3e/d59/f118 zero size 2024-09-13T17:06:02.295 INFO:tasks.workunit.client.0.smithi115.stdout:1/811: chown d5/d3e/l5b 41363078 1 2024-09-13T17:06:02.296 INFO:tasks.workunit.client.0.smithi115.stdout:0/667: dread d9/d1d/d24/d26/d36/d48/fa4 [0,4194304] 0 2024-09-13T17:06:02.296 INFO:tasks.workunit.client.0.smithi115.stdout:1/812: dread d5/d7/d33/d3a/db2/fc5 [0,4194304] 0 2024-09-13T17:06:02.303 INFO:tasks.workunit.client.0.smithi115.stdout:6/750: truncate d8/db/d1d/fa1 3104350 0 2024-09-13T17:06:02.303 INFO:tasks.workunit.client.0.smithi115.stdout:6/751: creat d8/d33/d40/d67/db4/dbf/feb x:0 0 0 2024-09-13T17:06:02.305 INFO:tasks.workunit.client.0.smithi115.stdout:5/865: link d19/d2b/d69/c85 d19/d2c/dd0/c11e 0 2024-09-13T17:06:02.305 INFO:tasks.workunit.client.0.smithi115.stdout:5/866: fsync d19/d2b/d32/d55/d5e/d87/da4/fa9 0 2024-09-13T17:06:02.305 INFO:tasks.workunit.client.0.smithi115.stdout:5/867: fsync d19/d2b/d32/d55/f5f 0 2024-09-13T17:06:02.305 INFO:tasks.workunit.client.0.smithi115.stdout:5/868: dread - d19/d21/d3a/d5d/dbe/f100 zero size 2024-09-13T17:06:02.312 INFO:tasks.workunit.client.0.smithi115.stdout:0/668: creat d9/d27/d88/d9e/dad/fcc x:0 0 0 2024-09-13T17:06:02.313 INFO:tasks.workunit.client.0.smithi115.stdout:8/902: dwrite d0/d15/f1b [0,4194304] 0 2024-09-13T17:06:02.313 INFO:tasks.workunit.client.0.smithi115.stdout:8/903: chown d0/d26 3522099 1 2024-09-13T17:06:02.313 INFO:tasks.workunit.client.0.smithi115.stdout:1/813: symlink d5/d7/d5c/dc6/dd4/l11a 0 2024-09-13T17:06:02.314 INFO:tasks.workunit.client.0.smithi115.stdout:9/615: rmdir d0/d21/d4f 39 2024-09-13T17:06:02.316 INFO:tasks.workunit.client.0.smithi115.stdout:4/844: getdents d7/d86/d88 0 2024-09-13T17:06:02.323 INFO:tasks.workunit.client.0.smithi115.stdout:7/788: rename d0/d2/d1e/d3d/d82 to d0/d3b/d50/d21/d99/db3/d117 0 2024-09-13T17:06:02.324 INFO:tasks.workunit.client.0.smithi115.stdout:1/814: write d5/d3e/d59/fb7 [1740504,48213] 0 2024-09-13T17:06:02.325 INFO:tasks.workunit.client.0.smithi115.stdout:1/815: creat d5/d60/d8e/f11b x:0 0 0 2024-09-13T17:06:02.325 INFO:tasks.workunit.client.0.smithi115.stdout:1/816: stat d5/d7/d33 0 2024-09-13T17:06:02.326 INFO:tasks.workunit.client.0.smithi115.stdout:8/904: write d0/d21/d76/dc1/fdc [2535483,11835] 0 2024-09-13T17:06:02.327 INFO:tasks.workunit.client.0.smithi115.stdout:5/869: rename d19/d2e/d6b/ld7 to d19/d2b/d69/d8f/dda/l11f 0 2024-09-13T17:06:02.331 INFO:tasks.workunit.client.0.smithi115.stdout:1/817: getdents d5/d7 0 2024-09-13T17:06:02.332 INFO:tasks.workunit.client.0.smithi115.stdout:8/905: symlink d0/d21/d76/dc1/l134 0 2024-09-13T17:06:02.332 INFO:tasks.workunit.client.0.smithi115.stdout:8/906: fdatasync d0/d21/d76/d83/fab 0 2024-09-13T17:06:02.334 INFO:tasks.workunit.client.0.smithi115.stdout:0/669: rename d9/d1d/d24/d26/c28 to d9/d1d/d24/d26/d36/d48/dbb/ccd 0 2024-09-13T17:06:02.334 INFO:tasks.workunit.client.0.smithi115.stdout:0/670: fdatasync d9/d27/d88/d99/dc7/fa0 0 2024-09-13T17:06:02.335 INFO:tasks.workunit.client.0.smithi115.stdout:9/616: dwrite d0/de/d10/d15/f3b [0,4194304] 0 2024-09-13T17:06:02.337 INFO:tasks.workunit.client.0.smithi115.stdout:5/870: creat d19/d2b/d32/d55/d5e/d87/d86/de8/dea/f120 x:0 0 0 2024-09-13T17:06:02.337 INFO:tasks.workunit.client.0.smithi115.stdout:5/871: creat d19/d2c/dd3/f121 x:0 0 0 2024-09-13T17:06:02.337 INFO:tasks.workunit.client.0.smithi115.stdout:5/872: dread - d19/d2b/d32/d55/d5e/d87/fa3 zero size 2024-09-13T17:06:02.338 INFO:tasks.workunit.client.0.smithi115.stdout:1/818: mkdir d5/d7/d33/d3a/d11c 0 2024-09-13T17:06:02.340 INFO:tasks.workunit.client.0.smithi115.stdout:8/907: rmdir d0/d42/d80 39 2024-09-13T17:06:02.340 INFO:tasks.workunit.client.0.smithi115.stdout:8/908: write d0/d26/d29/d59/d7e/da7/d2b/d37/f115 [1017225,71236] 0 2024-09-13T17:06:02.340 INFO:tasks.workunit.client.0.smithi115.stdout:8/909: getdents d0/d26/d29/d59/d7e/da7/dee 0 2024-09-13T17:06:02.340 INFO:tasks.workunit.client.0.smithi115.stdout:8/910: write d0/d21/d76/d83/d5a/f90 [1156978,73254] 0 2024-09-13T17:06:02.340 INFO:tasks.workunit.client.0.smithi115.stdout:8/911: read d0/d26/d29/d59/d7e/da7/d2b/d37/fd3 [3742035,41656] 0 2024-09-13T17:06:02.341 INFO:tasks.workunit.client.0.smithi115.stdout:7/789: rename d0/d2/d1e/d3d/d6c/d71/f46 to d0/d3b/d50/d21/d99/db3/d117/d44/dac/f118 0 2024-09-13T17:06:02.342 INFO:tasks.workunit.client.0.smithi115.stdout:2/925: sync 2024-09-13T17:06:02.344 INFO:tasks.workunit.client.0.smithi115.stdout:1/819: mkdir d5/d7/d33/d3a/db2/d11d 0 2024-09-13T17:06:02.345 INFO:tasks.workunit.client.0.smithi115.stdout:9/617: write d0/d21/d4f/fa4 [3857997,14654] 0 2024-09-13T17:06:02.345 INFO:tasks.workunit.client.0.smithi115.stdout:9/618: fsync d0/de/d10/d15/f3b 0 2024-09-13T17:06:02.346 INFO:tasks.workunit.client.0.smithi115.stdout:8/912: unlink d0/d26/d29/ca6 0 2024-09-13T17:06:02.348 INFO:tasks.workunit.client.0.smithi115.stdout:9/619: dread d0/de/d10/f71 [0,4194304] 0 2024-09-13T17:06:02.348 INFO:tasks.workunit.client.0.smithi115.stdout:4/845: dwrite d7/f29 [0,4194304] 0 2024-09-13T17:06:02.348 INFO:tasks.workunit.client.0.smithi115.stdout:7/790: unlink d0/l4 0 2024-09-13T17:06:02.349 INFO:tasks.workunit.client.0.smithi115.stdout:5/873: rename d19/d21/l34 to d19/d2c/dd0/d63/l122 0 2024-09-13T17:06:02.350 INFO:tasks.workunit.client.0.smithi115.stdout:0/671: dwrite d9/d27/fac [0,4194304] 0 2024-09-13T17:06:02.350 INFO:tasks.workunit.client.0.smithi115.stdout:2/926: creat d3/d4d/d13/d62/d92/dd7/d7d/dc2/f128 x:0 0 0 2024-09-13T17:06:02.350 INFO:tasks.workunit.client.0.smithi115.stdout:2/927: chown d3/d4d/dd/df/f65 568053 1 2024-09-13T17:06:02.351 INFO:tasks.workunit.client.0.smithi115.stdout:2/928: fdatasync d3/d4d/de/d3a/d47/d104/f11e 0 2024-09-13T17:06:02.351 INFO:tasks.workunit.client.0.smithi115.stdout:2/929: chown d3/d4d/de 154 1 2024-09-13T17:06:02.351 INFO:tasks.workunit.client.0.smithi115.stdout:1/820: creat d5/d7/f11e x:0 0 0 2024-09-13T17:06:02.353 INFO:tasks.workunit.client.0.smithi115.stdout:8/913: symlink d0/d42/d80/d94/l135 0 2024-09-13T17:06:02.356 INFO:tasks.workunit.client.0.smithi115.stdout:4/846: creat d7/dd/d3c/f107 x:0 0 0 2024-09-13T17:06:02.358 INFO:tasks.workunit.client.0.smithi115.stdout:5/874: link d19/d2e/f5c d19/d2e/dc6/f123 0 2024-09-13T17:06:02.362 INFO:tasks.workunit.client.0.smithi115.stdout:7/791: dwrite d0/d2/d4a/f81 [0,4194304] 0 2024-09-13T17:06:02.363 INFO:tasks.workunit.client.0.smithi115.stdout:2/930: mknod d3/d4d/d13/d6b/d114/c129 0 2024-09-13T17:06:02.366 INFO:tasks.workunit.client.0.smithi115.stdout:1/821: mkdir d5/d3e/dc8/d11f 0 2024-09-13T17:06:02.366 INFO:tasks.workunit.client.0.smithi115.stdout:1/822: creat d5/d60/d8e/f120 x:0 0 0 2024-09-13T17:06:02.366 INFO:tasks.workunit.client.0.smithi115.stdout:1/823: dread - d5/d7/d33/d3a/dc3/fdb zero size 2024-09-13T17:06:02.366 INFO:tasks.workunit.client.0.smithi115.stdout:8/914: mkdir d0/d26/d29/d59/d136 0 2024-09-13T17:06:02.367 INFO:tasks.workunit.client.0.smithi115.stdout:9/620: getdents d0/de/d10/d15 0 2024-09-13T17:06:02.369 INFO:tasks.workunit.client.0.smithi115.stdout:4/847: creat d7/dd/d3c/d72/db3/f108 x:0 0 0 2024-09-13T17:06:02.369 INFO:tasks.workunit.client.0.smithi115.stdout:4/848: truncate d7/dd/de/d4e/d9f/dd4/fef 224577 0 2024-09-13T17:06:02.373 INFO:tasks.workunit.client.0.smithi115.stdout:5/875: creat d19/d1d/f124 x:0 0 0 2024-09-13T17:06:02.373 INFO:tasks.workunit.client.0.smithi115.stdout:0/672: symlink d9/d1d/d24/d26/d2d/d30/d5c/lce 0 2024-09-13T17:06:02.373 INFO:tasks.workunit.client.0.smithi115.stdout:0/673: dread - d9/d27/d88/d99/dc7/fc6 zero size 2024-09-13T17:06:02.374 INFO:tasks.workunit.client.0.smithi115.stdout:4/849: dread d7/dd/d3c/d72/db3/fb8 [0,4194304] 0 2024-09-13T17:06:02.377 INFO:tasks.workunit.client.0.smithi115.stdout:8/915: dread d0/d21/fbe [0,4194304] 0 2024-09-13T17:06:02.377 INFO:tasks.workunit.client.0.smithi115.stdout:8/916: stat d0/d26/d29/d59/d7e/da7/fe9 0 2024-09-13T17:06:02.377 INFO:tasks.workunit.client.0.smithi115.stdout:8/917: read d0/d42/fc7 [1150068,6669] 0 2024-09-13T17:06:02.378 INFO:tasks.workunit.client.0.smithi115.stdout:8/918: truncate d0/d15/f4d 2665759 0 2024-09-13T17:06:02.379 INFO:tasks.workunit.client.0.smithi115.stdout:7/792: mknod d0/c119 0 2024-09-13T17:06:02.379 INFO:tasks.workunit.client.0.smithi115.stdout:7/793: creat d0/d3b/d54/f11a x:0 0 0 2024-09-13T17:06:02.381 INFO:tasks.workunit.client.0.smithi115.stdout:5/876: truncate d19/d2e/d6b/f8a 249335 0 2024-09-13T17:06:02.381 INFO:tasks.workunit.client.0.smithi115.stdout:5/877: fsync d19/d2b/fa8 0 2024-09-13T17:06:02.382 INFO:tasks.workunit.client.0.smithi115.stdout:5/878: write d19/d2c/f103 [136730,33422] 0 2024-09-13T17:06:02.383 INFO:tasks.workunit.client.0.smithi115.stdout:0/674: link d9/d1d/d24/d26/d2d/d30/c37 d9/d1d/d24/d26/d36/d48/dbb/ccf 0 2024-09-13T17:06:02.383 INFO:tasks.workunit.client.0.smithi115.stdout:0/675: chown d9/d27/d88/d99/dc7/f89 437 1 2024-09-13T17:06:02.386 INFO:tasks.workunit.client.0.smithi115.stdout:4/850: creat d7/dd/de/d4e/d5a/d4f/d9c/f109 x:0 0 0 2024-09-13T17:06:02.386 INFO:tasks.workunit.client.0.smithi115.stdout:4/851: truncate d7/dd/d3c/d74/d8b/fe5 356755 0 2024-09-13T17:06:02.389 INFO:tasks.workunit.client.0.smithi115.stdout:8/919: link d0/d18/l22 d0/d26/d29/d59/d7e/da7/d2b/d3b/d11f/l137 0 2024-09-13T17:06:02.392 INFO:tasks.workunit.client.0.smithi115.stdout:2/931: dwrite d3/f40 [0,4194304] 0 2024-09-13T17:06:02.393 INFO:tasks.workunit.client.0.smithi115.stdout:1/824: dwrite d5/d26/f29 [0,4194304] 0 2024-09-13T17:06:02.394 INFO:tasks.workunit.client.0.smithi115.stdout:7/794: rename d0/d2/d1e/d3d/d6c/f4c to d0/d2/d1e/dd8/f11b 0 2024-09-13T17:06:02.397 INFO:tasks.workunit.client.0.smithi115.stdout:4/852: dread d7/dd/d3c/f58 [0,4194304] 0 2024-09-13T17:06:02.397 INFO:tasks.workunit.client.0.smithi115.stdout:9/621: dwrite d0/d21/f22 [0,4194304] 0 2024-09-13T17:06:02.397 INFO:tasks.workunit.client.0.smithi115.stdout:4/853: fsync d7/dd/de/d4e/d5a/d4f/f7e 0 2024-09-13T17:06:02.397 INFO:tasks.workunit.client.0.smithi115.stdout:9/622: write d0/de/d37/dc5/f9b [40821,28468] 0 2024-09-13T17:06:02.397 INFO:tasks.workunit.client.0.smithi115.stdout:2/932: mkdir d3/d4d/dd/df/d5c/d12a 0 2024-09-13T17:06:02.401 INFO:tasks.workunit.client.0.smithi115.stdout:5/879: dwrite d19/d2e/f84 [0,4194304] 0 2024-09-13T17:06:02.402 INFO:tasks.workunit.client.0.smithi115.stdout:7/795: unlink d0/d3b/d50/d21/d99/db3/d117/d44/dac/f112 0 2024-09-13T17:06:02.405 INFO:tasks.workunit.client.0.smithi115.stdout:4/854: symlink d7/dd/de/d4e/dd1/dee/l10a 0 2024-09-13T17:06:02.406 INFO:tasks.workunit.client.0.smithi115.stdout:9/623: symlink d0/de/d37/d83/dc2/lcf 0 2024-09-13T17:06:02.408 INFO:tasks.workunit.client.0.smithi115.stdout:2/933: symlink d3/d4d/d13/d62/d92/dd7/d56/d58/dac/l12b 0 2024-09-13T17:06:02.410 INFO:tasks.workunit.client.0.smithi115.stdout:9/624: dread d0/de/d10/f71 [0,4194304] 0 2024-09-13T17:06:02.413 INFO:tasks.workunit.client.0.smithi115.stdout:7/796: rename d0/d2/d1e/d3d/d6c/de0 to d0/d59/d11c 0 2024-09-13T17:06:02.413 INFO:tasks.workunit.client.0.smithi115.stdout:4/855: dread d7/dd/de/d4e/d6c/f8a [0,4194304] 0 2024-09-13T17:06:02.414 INFO:tasks.workunit.client.0.smithi115.stdout:4/856: truncate d7/dd/de/d4e/d6c/f7c 5159155 0 2024-09-13T17:06:02.414 INFO:tasks.workunit.client.0.smithi115.stdout:4/857: chown d7/dd/d3c/d7b 0 1 2024-09-13T17:06:02.414 INFO:tasks.workunit.client.0.smithi115.stdout:4/858: fdatasync d7/dd/f4d 0 2024-09-13T17:06:02.414 INFO:tasks.workunit.client.0.smithi115.stdout:4/859: write d7/dd/de/d4e/d6c/f7c [4816814,69751] 0 2024-09-13T17:06:02.415 INFO:tasks.workunit.client.0.smithi115.stdout:2/934: truncate d3/d4d/d13/d62/d92/dd7/fd5 2908986 0 2024-09-13T17:06:02.415 INFO:tasks.workunit.client.0.smithi115.stdout:5/880: getdents d19/d2b/d69/d8f/de0 0 2024-09-13T17:06:02.415 INFO:tasks.workunit.client.0.smithi115.stdout:5/881: chown d19/d2b/d32/d55/cf1 1338006631 1 2024-09-13T17:06:02.420 INFO:tasks.workunit.client.0.smithi115.stdout:4/860: symlink d7/l10b 0 2024-09-13T17:06:02.421 INFO:tasks.workunit.client.0.smithi115.stdout:2/935: mkdir d3/d4d/d13/d12c 0 2024-09-13T17:06:02.424 INFO:tasks.workunit.client.0.smithi115.stdout:5/882: mkdir d19/d2c/d125 0 2024-09-13T17:06:02.426 INFO:tasks.workunit.client.0.smithi115.stdout:4/861: symlink d7/dd/l10c 0 2024-09-13T17:06:02.430 INFO:tasks.workunit.client.0.smithi115.stdout:5/883: symlink d19/d2c/l126 0 2024-09-13T17:06:02.431 INFO:tasks.workunit.client.0.smithi115.stdout:5/884: unlink l17 0 2024-09-13T17:06:02.439 INFO:tasks.workunit.client.0.smithi115.stdout:9/625: dwrite d0/de/d10/d15/fc1 [0,4194304] 0 2024-09-13T17:06:02.439 INFO:tasks.workunit.client.0.smithi115.stdout:2/936: dwrite d3/d4d/de/f59 [0,4194304] 0 2024-09-13T17:06:02.442 INFO:tasks.workunit.client.0.smithi115.stdout:4/862: write d7/dd/f4d [1040482,40450] 0 2024-09-13T17:06:02.442 INFO:tasks.workunit.client.0.smithi115.stdout:4/863: getdents d7/dd/d3c/d72/db3/dda 0 2024-09-13T17:06:02.442 INFO:tasks.workunit.client.0.smithi115.stdout:4/864: truncate d7/dd/de/d4e/d5a/d4f/f7e 486463 0 2024-09-13T17:06:02.442 INFO:tasks.workunit.client.0.smithi115.stdout:7/797: dwrite d0/d59/fba [0,4194304] 0 2024-09-13T17:06:02.442 INFO:tasks.workunit.client.0.smithi115.stdout:7/798: truncate d0/d3b/d50/d21/d99/db3/d117/d44/dac/dbf/fd5 1007934 0 2024-09-13T17:06:02.445 INFO:tasks.workunit.client.0.smithi115.stdout:9/626: truncate d0/f16 360076 0 2024-09-13T17:06:02.445 INFO:tasks.workunit.client.0.smithi115.stdout:9/627: fdatasync d0/d21/d42/f81 0 2024-09-13T17:06:02.448 INFO:tasks.workunit.client.0.smithi115.stdout:2/937: rename d3/d4d/dd/df/d57/d8b/l90 to d3/d4d/de/d3a/l12d 0 2024-09-13T17:06:02.451 INFO:tasks.workunit.client.0.smithi115.stdout:5/885: dwrite d19/d1d/f26 [0,4194304] 0 2024-09-13T17:06:02.451 INFO:tasks.workunit.client.0.smithi115.stdout:5/886: read d19/d2e/f5c [3923552,20480] 0 2024-09-13T17:06:02.451 INFO:tasks.workunit.client.0.smithi115.stdout:5/887: fdatasync fd 0 2024-09-13T17:06:02.455 INFO:tasks.workunit.client.0.smithi115.stdout:4/865: rename d7/dd/de/f43 to d7/dd/d3c/d72/db3/dda/f10d 0 2024-09-13T17:06:02.457 INFO:tasks.workunit.client.0.smithi115.stdout:5/888: symlink d19/d2c/d125/l127 0 2024-09-13T17:06:02.457 INFO:tasks.workunit.client.0.smithi115.stdout:5/889: dread - d19/d2e/ff3 zero size 2024-09-13T17:06:02.457 INFO:tasks.workunit.client.0.smithi115.stdout:9/628: write d0/de/d10/d15/d86/f75 [3962688,51014] 0 2024-09-13T17:06:02.458 INFO:tasks.workunit.client.0.smithi115.stdout:2/938: write d3/d4d/dd/df/d57/d8b/fcc [437609,79953] 0 2024-09-13T17:06:02.460 INFO:tasks.workunit.client.0.smithi115.stdout:4/866: rename d7/dd/de/d4e/d6c/f8a to d7/dd/de/f10e 0 2024-09-13T17:06:02.465 INFO:tasks.workunit.client.0.smithi115.stdout:5/890: link d19/d2b/d32/d55/d5e/d87/db0/dde/fdf d19/d21/d3a/d5d/dbe/f128 0 2024-09-13T17:06:02.466 INFO:tasks.workunit.client.0.smithi115.stdout:9/629: mknod d0/de/d10/d15/d7f/cd0 0 2024-09-13T17:06:02.466 INFO:tasks.workunit.client.0.smithi115.stdout:9/630: getdents d0/de/d10/d15 0 2024-09-13T17:06:02.466 INFO:tasks.workunit.client.0.smithi115.stdout:9/631: creat d0/fd1 x:0 0 0 2024-09-13T17:06:02.466 INFO:tasks.workunit.client.0.smithi115.stdout:9/632: stat d0/d21/d65/d6f/fb0 0 2024-09-13T17:06:02.469 INFO:tasks.workunit.client.0.smithi115.stdout:2/939: creat d3/d4d/d13/da2/df8/f12e x:0 0 0 2024-09-13T17:06:02.472 INFO:tasks.workunit.client.0.smithi115.stdout:2/940: dread - d3/d4d/d13/d62/d92/dd7/d7d/f126 zero size 2024-09-13T17:06:02.472 INFO:tasks.workunit.client.0.smithi115.stdout:4/867: mknod d7/dd/de/d4e/d6c/d77/dca/c10f 0 2024-09-13T17:06:02.473 INFO:tasks.workunit.client.0.smithi115.stdout:5/891: mkdir d19/d2c/dd3/d10e/d129 0 2024-09-13T17:06:02.473 INFO:tasks.workunit.client.0.smithi115.stdout:5/892: write d19/d2b/d32/d55/d5e/d87/d86/fcf [952769,99150] 0 2024-09-13T17:06:02.473 INFO:tasks.workunit.client.0.smithi115.stdout:5/893: write d19/d2e/f84 [6193988,16089] 0 2024-09-13T17:06:02.473 INFO:tasks.workunit.client.0.smithi115.stdout:5/894: readlink d19/d2b/d32/l72 0 2024-09-13T17:06:02.473 INFO:tasks.workunit.client.0.smithi115.stdout:5/895: dread - d19/f117 zero size 2024-09-13T17:06:02.476 INFO:tasks.workunit.client.0.smithi115.stdout:9/633: rename d0/de/d10/d15/f24 to d0/de/da6/fd2 0 2024-09-13T17:06:02.477 INFO:tasks.workunit.client.0.smithi115.stdout:4/868: link d7/dd/de/cdb d7/dd/d3c/d74/d8b/c110 0 2024-09-13T17:06:02.483 INFO:tasks.workunit.client.0.smithi115.stdout:9/634: write d0/faf [1469448,94081] 0 2024-09-13T17:06:02.484 INFO:tasks.workunit.client.0.smithi115.stdout:2/941: rename d3/d4d/d13/d6b/d114/c129 to d3/d4d/de/d3a/d47/da4/c12f 0 2024-09-13T17:06:02.484 INFO:tasks.workunit.client.0.smithi115.stdout:4/869: dread d7/fc [0,4194304] 0 2024-09-13T17:06:02.484 INFO:tasks.workunit.client.0.smithi115.stdout:4/870: creat d7/dd/de/d4e/d5a/f111 x:0 0 0 2024-09-13T17:06:02.486 INFO:tasks.workunit.client.0.smithi115.stdout:9/635: creat d0/d21/fd3 x:0 0 0 2024-09-13T17:06:02.493 INFO:tasks.workunit.client.0.smithi115.stdout:2/942: write d3/d4d/d13/d62/d66/f82 [3232844,127088] 0 2024-09-13T17:06:02.494 INFO:tasks.workunit.client.0.smithi115.stdout:2/943: chown d3/d4d/dd/df/f24 1377 1 2024-09-13T17:06:02.494 INFO:tasks.workunit.client.0.smithi115.stdout:4/871: write d7/fb [2766416,112523] 0 2024-09-13T17:06:02.494 INFO:tasks.workunit.client.0.smithi115.stdout:4/872: write d7/dd/d3c/f45 [967016,24441] 0 2024-09-13T17:06:02.496 INFO:tasks.workunit.client.0.smithi115.stdout:9/636: creat d0/de/d10/d15/d86/fd4 x:0 0 0 2024-09-13T17:06:02.496 INFO:tasks.workunit.client.0.smithi115.stdout:9/637: read d0/de/d37/dc5/f9b [11961,25187] 0 2024-09-13T17:06:02.498 INFO:tasks.workunit.client.0.smithi115.stdout:5/896: dwrite d19/d1d/f6c [0,4194304] 0 2024-09-13T17:06:02.499 INFO:tasks.workunit.client.0.smithi115.stdout:2/944: truncate d3/d4d/de/f10 3601532 0 2024-09-13T17:06:02.502 INFO:tasks.workunit.client.0.smithi115.stdout:9/638: symlink d0/d21/d42/ld5 0 2024-09-13T17:06:02.506 INFO:tasks.workunit.client.0.smithi115.stdout:2/945: truncate d3/d4d/f115 444999 0 2024-09-13T17:06:02.507 INFO:tasks.workunit.client.0.smithi115.stdout:4/873: mknod d7/dd/d3c/c112 0 2024-09-13T17:06:02.509 INFO:tasks.workunit.client.0.smithi115.stdout:9/639: fsync d0/d21/d65/d79/fa9 0 2024-09-13T17:06:02.509 INFO:tasks.workunit.client.0.smithi115.stdout:9/640: readlink d0/d21/d65/d79/lbf 0 2024-09-13T17:06:02.509 INFO:tasks.workunit.client.0.smithi115.stdout:9/641: dread - d0/de/d10/d15/fa3 zero size 2024-09-13T17:06:02.509 INFO:tasks.workunit.client.0.smithi115.stdout:9/642: write d0/de/d37/dc5/fb5 [4217180,48947] 0 2024-09-13T17:06:02.510 INFO:tasks.workunit.client.0.smithi115.stdout:2/946: dread d3/d4d/d13/f45 [0,4194304] 0 2024-09-13T17:06:02.514 INFO:tasks.workunit.client.0.smithi115.stdout:5/897: dwrite d19/d2b/d32/d55/d5e/d87/d86/f8c [0,4194304] 0 2024-09-13T17:06:02.515 INFO:tasks.workunit.client.0.smithi115.stdout:4/874: creat d7/dd/de/d4e/dd1/f113 x:0 0 0 2024-09-13T17:06:02.515 INFO:tasks.workunit.client.0.smithi115.stdout:9/643: creat d0/de/da6/fd6 x:0 0 0 2024-09-13T17:06:02.519 INFO:tasks.workunit.client.0.smithi115.stdout:5/898: read d19/d2b/d32/d55/d5e/fbf [2970781,121650] 0 2024-09-13T17:06:02.519 INFO:tasks.workunit.client.0.smithi115.stdout:5/899: dread - d19/d2b/d32/d55/d5e/d87/db0/fb2 zero size 2024-09-13T17:06:02.520 INFO:tasks.workunit.client.0.smithi115.stdout:5/900: write d19/d2e/dc6/f123 [4239437,90512] 0 2024-09-13T17:06:02.524 INFO:tasks.workunit.client.0.smithi115.stdout:9/644: mkdir d0/dd7 0 2024-09-13T17:06:02.525 INFO:tasks.workunit.client.0.smithi115.stdout:5/901: mknod d19/d2b/d32/d55/d5e/d114/c12a 0 2024-09-13T17:06:02.525 INFO:tasks.workunit.client.0.smithi115.stdout:4/875: write d7/dd/d3c/d74/fa6 [526862,12013] 0 2024-09-13T17:06:02.527 INFO:tasks.workunit.client.0.smithi115.stdout:9/645: symlink d0/de/d10/d15/d7f/ld8 0 2024-09-13T17:06:02.528 INFO:tasks.workunit.client.0.smithi115.stdout:4/876: unlink d7/dd/f81 0 2024-09-13T17:06:02.531 INFO:tasks.workunit.client.0.smithi115.stdout:9/646: rename d0/d21/f22 to d0/d21/d65/d79/fd9 0 2024-09-13T17:06:02.532 INFO:tasks.workunit.client.0.smithi115.stdout:4/877: unlink d7/dd/cb7 0 2024-09-13T17:06:02.533 INFO:tasks.workunit.client.0.smithi115.stdout:5/902: read d19/dac/fc1 [3093289,32697] 0 2024-09-13T17:06:02.533 INFO:tasks.workunit.client.0.smithi115.stdout:9/647: mknod d0/de/d37/d83/d91/cda 0 2024-09-13T17:06:02.535 INFO:tasks.workunit.client.0.smithi115.stdout:4/878: unlink d7/dd/d3c/d7b/d97/lf9 0 2024-09-13T17:06:02.535 INFO:tasks.workunit.client.0.smithi115.stdout:5/903: getdents d19/d2c/dd0 0 2024-09-13T17:06:02.537 INFO:tasks.workunit.client.0.smithi115.stdout:9/648: creat d0/d21/d65/d6f/dad/dc3/fdb x:0 0 0 2024-09-13T17:06:02.539 INFO:tasks.workunit.client.0.smithi115.stdout:9/649: dread d0/de/d37/dc5/f9b [0,4194304] 0 2024-09-13T17:06:02.539 INFO:tasks.workunit.client.0.smithi115.stdout:5/904: creat d19/d21/d3a/d5d/f12b x:0 0 0 2024-09-13T17:06:02.540 INFO:tasks.workunit.client.0.smithi115.stdout:4/879: write d7/dd/d3c/f58 [885793,2446] 0 2024-09-13T17:06:02.540 INFO:tasks.workunit.client.0.smithi115.stdout:4/880: truncate d7/dd/de/d4e/d9f/fff 83265 0 2024-09-13T17:06:02.540 INFO:tasks.workunit.client.0.smithi115.stdout:4/881: stat d7/dd/de/d4e/d5a/d4f/c84 0 2024-09-13T17:06:02.544 INFO:tasks.workunit.client.0.smithi115.stdout:4/882: rmdir d7/dd/d3c/d101 0 2024-09-13T17:06:02.545 INFO:tasks.workunit.client.0.smithi115.stdout:9/650: mknod d0/d21/d65/cdc 0 2024-09-13T17:06:02.577 INFO:tasks.workunit.client.0.smithi115.stdout:5/905: rmdir d19 39 2024-09-13T17:06:02.578 INFO:tasks.workunit.client.0.smithi115.stdout:4/883: creat d7/d86/dd5/f114 x:0 0 0 2024-09-13T17:06:02.585 INFO:tasks.workunit.client.0.smithi115.stdout:5/906: creat d19/d2b/d77/f12c x:0 0 0 2024-09-13T17:06:02.595 INFO:tasks.workunit.client.0.smithi115.stdout:5/907: mknod d19/d2b/d32/d55/d5e/d87/da4/da6/c12d 0 2024-09-13T17:06:02.597 INFO:tasks.workunit.client.0.smithi115.stdout:4/884: truncate d7/dd/de/d4e/d6c/f7c 4222512 0 2024-09-13T17:06:02.600 INFO:tasks.workunit.client.0.smithi115.stdout:9/651: rename d0/de/d10/d15/d86 to d0/de/d37/d83/dc2/ddd 0 2024-09-13T17:06:02.602 INFO:tasks.workunit.client.0.smithi115.stdout:5/908: creat d19/d2b/d32/d55/f12e x:0 0 0 2024-09-13T17:06:02.603 INFO:tasks.workunit.client.0.smithi115.stdout:9/652: truncate d0/d21/d65/fbd 78139 0 2024-09-13T17:06:02.607 INFO:tasks.workunit.client.0.smithi115.stdout:9/653: link d0/de/d10/d15/c2b d0/de/d10/d15/cde 0 2024-09-13T17:06:02.616 INFO:tasks.workunit.client.0.smithi115.stdout:4/885: dwrite d7/dd/d3c/d7b/d97/ff6 [0,4194304] 0 2024-09-13T17:06:02.621 INFO:tasks.workunit.client.0.smithi115.stdout:4/886: rename d7/dd/d3c/d7b/d97/ff6 to d7/dd/de/d4e/d6c/d77/dca/f115 0 2024-09-13T17:06:02.623 INFO:tasks.workunit.client.0.smithi115.stdout:4/887: mknod d7/dd/de/d4e/d5a/d4f/d70/db6/c116 0 2024-09-13T17:06:02.623 INFO:tasks.workunit.client.0.smithi115.stdout:9/654: dwrite d0/f31 [4194304,4194304] 0 2024-09-13T17:06:02.627 INFO:tasks.workunit.client.0.smithi115.stdout:9/655: rename d0/d21/d42/l87 to d0/de/ldf 0 2024-09-13T17:06:02.629 INFO:tasks.workunit.client.0.smithi115.stdout:9/656: creat d0/d21/d65/d6f/dad/fe0 x:0 0 0 2024-09-13T17:06:02.633 INFO:tasks.workunit.client.0.smithi115.stdout:9/657: rename d0/de/d37/d83/d91/f99 to d0/d21/fe1 0 2024-09-13T17:06:02.633 INFO:tasks.workunit.client.0.smithi115.stdout:9/658: write d0/d21/f58 [324722,70017] 0 2024-09-13T17:06:02.634 INFO:tasks.workunit.client.0.smithi115.stdout:9/659: creat d0/de/d10/fe2 x:0 0 0 2024-09-13T17:06:02.636 INFO:tasks.workunit.client.0.smithi115.stdout:4/888: dwrite d7/dd/f2c [4194304,4194304] 0 2024-09-13T17:06:02.636 INFO:tasks.workunit.client.0.smithi115.stdout:9/660: truncate d0/de/d10/f60 986398 0 2024-09-13T17:06:02.638 INFO:tasks.workunit.client.0.smithi115.stdout:4/889: fdatasync d7/dd/de/f5c 0 2024-09-13T17:06:02.649 INFO:tasks.workunit.client.0.smithi115.stdout:4/890: dread d7/dd/de/f10e [0,4194304] 0 2024-09-13T17:06:02.649 INFO:tasks.workunit.client.0.smithi115.stdout:4/891: chown d7/d86 23844708 1 2024-09-13T17:06:02.649 INFO:tasks.workunit.client.0.smithi115.stdout:4/892: dread - d7/d86/d88/ff0 zero size 2024-09-13T17:06:02.650 INFO:tasks.workunit.client.0.smithi115.stdout:4/893: mknod d7/dd/de/d4e/d6c/d77/c117 0 2024-09-13T17:06:02.651 INFO:tasks.workunit.client.0.smithi115.stdout:4/894: getdents d7/dd/de/de6 0 2024-09-13T17:06:02.653 INFO:tasks.workunit.client.0.smithi115.stdout:4/895: rmdir d7/dd/d3c/d74/d8b 39 2024-09-13T17:06:02.653 INFO:tasks.workunit.client.0.smithi115.stdout:9/661: dwrite d0/d9c/f9f [0,4194304] 0 2024-09-13T17:06:02.653 INFO:tasks.workunit.client.0.smithi115.stdout:9/662: chown d0/d21/d42/f5f 7456 1 2024-09-13T17:06:02.654 INFO:tasks.workunit.client.0.smithi115.stdout:4/896: mknod d7/dd/d3c/d72/db3/c118 0 2024-09-13T17:06:02.655 INFO:tasks.workunit.client.0.smithi115.stdout:4/897: creat d7/dd/de/d4e/f119 x:0 0 0 2024-09-13T17:06:02.655 INFO:tasks.workunit.client.0.smithi115.stdout:4/898: chown d7/f2e 968284 1 2024-09-13T17:06:02.657 INFO:tasks.workunit.client.0.smithi115.stdout:4/899: link d7/dd/de/d4e/d5a/d4f/c89 d7/dd/de/de6/c11a 0 2024-09-13T17:06:02.658 INFO:tasks.workunit.client.0.smithi115.stdout:4/900: unlink d7/dd/l10c 0 2024-09-13T17:06:02.669 INFO:tasks.workunit.client.0.smithi115.stdout:9/663: dwrite d0/d21/d65/d6f/f8a [0,4194304] 0 2024-09-13T17:06:02.669 INFO:tasks.workunit.client.0.smithi115.stdout:9/664: write d0/f3 [819349,10472] 0 2024-09-13T17:06:02.669 INFO:tasks.workunit.client.0.smithi115.stdout:9/665: chown d0/d21/d65/fbd 994391 1 2024-09-13T17:06:02.672 INFO:tasks.workunit.client.0.smithi115.stdout:9/666: symlink d0/d21/d42/le3 0 2024-09-13T17:06:02.673 INFO:tasks.workunit.client.0.smithi115.stdout:9/667: mkdir d0/de4 0 2024-09-13T17:06:02.673 INFO:tasks.workunit.client.0.smithi115.stdout:9/668: fsync d0/d34/f4c 0 2024-09-13T17:06:02.676 INFO:tasks.workunit.client.0.smithi115.stdout:9/669: rename d0/lc to d0/d21/d65/d6f/dad/dc3/le5 0 2024-09-13T17:06:02.693 INFO:tasks.workunit.client.0.smithi115.stdout:9/670: dwrite d0/de/f89 [0,4194304] 0 2024-09-13T17:06:02.699 INFO:tasks.workunit.client.0.smithi115.stdout:9/671: symlink d0/de/d37/le6 0 2024-09-13T17:06:02.699 INFO:tasks.workunit.client.0.smithi115.stdout:9/672: write d0/d21/d42/f81 [701600,78947] 0 2024-09-13T17:06:02.703 INFO:tasks.workunit.client.0.smithi115.stdout:9/673: link d0/d34/l69 d0/d21/le7 0 2024-09-13T17:06:02.710 INFO:tasks.workunit.client.0.smithi115.stdout:9/674: unlink d0/f1d 0 2024-09-13T17:06:02.712 INFO:tasks.workunit.client.0.smithi115.stdout:9/675: creat d0/de/d10/d15/fe8 x:0 0 0 2024-09-13T17:06:02.713 INFO:tasks.workunit.client.0.smithi115.stdout:9/676: read d0/de/d10/d15/f3a [30556,35109] 0 2024-09-13T17:06:02.716 INFO:tasks.workunit.client.0.smithi115.stdout:9/677: dwrite - open d0/d21/d65/fbd failed 14 2024-09-13T17:06:02.726 INFO:tasks.workunit.client.0.smithi115.stdout:9/678: dread d0/d21/d42/f52 [0,4194304] 0 2024-09-13T17:06:02.730 INFO:tasks.workunit.client.0.smithi115.stdout:9/679: rename d0/de/da6/fd2 to d0/de/d37/dc5/fe9 0 2024-09-13T17:06:02.731 INFO:tasks.workunit.client.0.smithi115.stdout:9/680: write d0/f3 [2345631,91628] 0 2024-09-13T17:06:02.732 INFO:tasks.workunit.client.0.smithi115.stdout:9/681: dread d0/d21/d4f/f72 [0,4194304] 0 2024-09-13T17:06:02.735 INFO:tasks.workunit.client.0.smithi115.stdout:9/682: symlink d0/d21/lea 0 2024-09-13T17:06:02.735 INFO:tasks.workunit.client.0.smithi115.stdout:9/683: fsync d0/de/d37/dc5/fc6 0 2024-09-13T17:06:02.735 INFO:tasks.workunit.client.0.smithi115.stdout:9/684: creat d0/de/d10/feb x:0 0 0 2024-09-13T17:06:02.742 INFO:tasks.workunit.client.0.smithi115.stdout:9/685: link d0/f31 d0/de/d10/d15/fec 0 2024-09-13T17:06:02.756 INFO:tasks.workunit.client.0.smithi115.stdout:9/686: dread d0/de/d10/faa [0,4194304] 0 2024-09-13T17:06:02.757 INFO:tasks.workunit.client.0.smithi115.stdout:9/687: mkdir d0/d21/d65/d6f/dad/ded 0 2024-09-13T17:06:02.758 INFO:tasks.workunit.client.0.smithi115.stdout:9/688: chown d0/d21/d4f/fbb 10145350 1 2024-09-13T17:06:02.758 INFO:tasks.workunit.client.0.smithi115.stdout:9/689: truncate d0/de/d10/d15/f3a 1379345 0 2024-09-13T17:06:02.764 INFO:tasks.workunit.client.0.smithi115.stdout:9/690: rmdir d0/de/d37 39 2024-09-13T17:06:02.765 INFO:tasks.workunit.client.0.smithi115.stdout:9/691: getdents d0/d9c 0 2024-09-13T17:06:02.765 INFO:tasks.workunit.client.0.smithi115.stdout:9/692: fsync d0/de/d37/f6b 0 2024-09-13T17:06:02.767 INFO:tasks.workunit.client.0.smithi115.stdout:9/693: mkdir d0/de/d37/d83/dc2/ddd/dee 0 2024-09-13T17:06:02.767 INFO:tasks.workunit.client.0.smithi115.stdout:9/694: chown d0/de/d10/d15/fc1 4799 1 2024-09-13T17:06:02.767 INFO:tasks.workunit.client.0.smithi115.stdout:9/695: fdatasync d0/d21/d65/d79/fb2 0 2024-09-13T17:06:02.767 INFO:tasks.workunit.client.0.smithi115.stdout:9/696: write d0/de/d10/f46 [248692,112476] 0 2024-09-13T17:06:02.767 INFO:tasks.workunit.client.0.smithi115.stdout:9/697: stat d0/de 0 2024-09-13T17:06:02.767 INFO:tasks.workunit.client.0.smithi115.stdout:9/698: dread - d0/de/d10/d15/fa3 zero size 2024-09-13T17:06:02.767 INFO:tasks.workunit.client.0.smithi115.stdout:9/699: chown d0/de/d37/d83/dc2/ddd/d8d/db1/cca 66340 1 2024-09-13T17:06:02.768 INFO:tasks.workunit.client.0.smithi115.stdout:9/700: rename d0/de/d10/d15/d7f/ld8 to d0/de/d37/d83/dc2/ddd/lef 0 2024-09-13T17:06:02.769 INFO:tasks.workunit.client.0.smithi115.stdout:9/701: creat d0/d21/d65/d6f/ff0 x:0 0 0 2024-09-13T17:06:02.784 INFO:tasks.workunit.client.0.smithi115.stdout:9/702: dwrite d0/de/d37/d83/dc2/ddd/f8b [0,4194304] 0 2024-09-13T17:06:02.786 INFO:tasks.workunit.client.0.smithi115.stdout:9/703: creat d0/de/d37/dc5/ff1 x:0 0 0 2024-09-13T17:06:02.788 INFO:tasks.workunit.client.0.smithi115.stdout:9/704: mknod d0/de/d37/d83/dc2/ddd/d8d/cf2 0 2024-09-13T17:06:02.796 INFO:tasks.workunit.client.0.smithi115.stdout:9/705: dread d0/d21/d65/d79/f7a [0,4194304] 0 2024-09-13T17:06:02.797 INFO:tasks.workunit.client.0.smithi115.stdout:9/706: symlink d0/de4/lf3 0 2024-09-13T17:06:02.799 INFO:tasks.workunit.client.0.smithi115.stdout:9/707: mkdir d0/d21/d65/d79/df4 0 2024-09-13T17:06:02.815 INFO:tasks.workunit.client.0.smithi115.stdout:9/708: dwrite d0/de/f89 [0,4194304] 0 2024-09-13T17:06:02.823 INFO:tasks.workunit.client.0.smithi115.stdout:9/709: dread d0/de/d10/f14 [0,4194304] 0 2024-09-13T17:06:02.840 INFO:tasks.workunit.client.0.smithi115.stdout:9/710: dwrite d0/d21/f58 [0,4194304] 0 2024-09-13T17:06:02.849 INFO:tasks.workunit.client.0.smithi115.stdout:9/711: dread d0/d21/d65/d79/f85 [0,4194304] 0 2024-09-13T17:06:02.863 INFO:tasks.workunit.client.0.smithi115.stdout:9/712: dwrite d0/de/f2d [0,4194304] 0 2024-09-13T17:06:02.910 INFO:tasks.workunit.client.0.smithi115.stdout:9/713: creat d0/de/d37/d83/dc2/ddd/dee/ff5 x:0 0 0 2024-09-13T17:06:02.913 INFO:tasks.workunit.client.0.smithi115.stdout:9/714: symlink d0/de/d37/d83/dc2/ddd/d8d/db1/lf6 0 2024-09-13T17:06:02.916 INFO:tasks.workunit.client.0.smithi115.stdout:9/715: unlink d0/f3 0 2024-09-13T17:06:02.925 INFO:tasks.workunit.client.0.smithi115.stdout:9/716: dread d0/f73 [0,4194304] 0 2024-09-13T17:06:02.941 INFO:tasks.workunit.client.0.smithi115.stdout:9/717: dwrite d0/f1f [0,4194304] 0 2024-09-13T17:06:02.942 INFO:tasks.workunit.client.0.smithi115.stdout:9/718: read d0/d21/d42/f81 [766513,63986] 0 2024-09-13T17:06:02.951 INFO:tasks.workunit.client.0.smithi115.stdout:9/719: dread d0/de/d10/faa [0,4194304] 0 2024-09-13T17:06:02.951 INFO:tasks.workunit.client.0.smithi115.stdout:9/720: chown d0/de/d10/l8e 1087 1 2024-09-13T17:06:02.965 INFO:tasks.workunit.client.0.smithi115.stdout:9/721: dwrite d0/de/d10/f60 [0,4194304] 0 2024-09-13T17:06:02.969 INFO:tasks.workunit.client.0.smithi115.stdout:9/722: symlink d0/d21/d4f/lf7 0 2024-09-13T17:06:02.969 INFO:tasks.workunit.client.0.smithi115.stdout:9/723: chown d0/d21/d4f/f5e 12 1 2024-09-13T17:06:02.969 INFO:tasks.workunit.client.0.smithi115.stdout:9/724: dread - d0/de/d37/d83/d91/fa0 zero size 2024-09-13T17:06:02.970 INFO:tasks.workunit.client.0.smithi115.stdout:9/725: symlink d0/de/d10/d15/lf8 0 2024-09-13T17:06:02.987 INFO:tasks.workunit.client.0.smithi115.stdout:9/726: dwrite d0/de/d10/d15/f3b [4194304,4194304] 0 2024-09-13T17:06:02.988 INFO:tasks.workunit.client.0.smithi115.stdout:9/727: mknod d0/de/cf9 0 2024-09-13T17:06:02.990 INFO:tasks.workunit.client.0.smithi115.stdout:9/728: mkdir d0/de/d37/d83/dc2/ddd/d8d/db1/dfa 0 2024-09-13T17:06:02.990 INFO:tasks.workunit.client.0.smithi115.stdout:9/729: getdents d0/d21/d65/d79/df4 0 2024-09-13T17:06:02.992 INFO:tasks.workunit.client.0.smithi115.stdout:9/730: mkdir d0/d21/d65/dfb 0 2024-09-13T17:06:02.993 INFO:tasks.workunit.client.0.smithi115.stdout:9/731: rename d0/de/d37/d83/dc2/ddd/f8b to d0/de/d37/d83/dc2/ddd/d8d/db1/dfa/ffc 0 2024-09-13T17:06:02.995 INFO:tasks.workunit.client.0.smithi115.stdout:9/732: mknod d0/d34/cfd 0 2024-09-13T17:06:02.996 INFO:tasks.workunit.client.0.smithi115.stdout:9/733: mknod d0/d21/cfe 0 2024-09-13T17:06:02.997 INFO:tasks.workunit.client.0.smithi115.stdout:9/734: mkdir d0/d34/dff 0 2024-09-13T17:06:02.997 INFO:tasks.workunit.client.0.smithi115.stdout:9/735: chown d0/d21/d65/d6f/f88 492135 1 2024-09-13T17:06:02.997 INFO:tasks.workunit.client.0.smithi115.stdout:9/736: fsync d0/de/d37/dc5/fc6 0 2024-09-13T17:06:02.997 INFO:tasks.workunit.client.0.smithi115.stdout:9/737: symlink d0/de4/l100 0 2024-09-13T17:06:02.999 INFO:tasks.workunit.client.0.smithi115.stdout:9/738: truncate d0/de/d37/d83/dc2/ddd/d8d/db1/dfa/ffc 3087861 0 2024-09-13T17:06:03.000 INFO:tasks.workunit.client.0.smithi115.stdout:9/739: rename d0/de/d10/c48 to d0/d21/d65/d6f/dad/ded/c101 0 2024-09-13T17:06:03.001 INFO:tasks.workunit.client.0.smithi115.stdout:9/740: write d0/d21/d65/f9e [287244,24949] 0 2024-09-13T17:06:03.001 INFO:tasks.workunit.client.0.smithi115.stdout:9/741: readlink d0/d21/lea 0 2024-09-13T17:06:03.002 INFO:tasks.workunit.client.0.smithi115.stdout:9/742: creat d0/d21/d65/d6f/dad/ded/f102 x:0 0 0 2024-09-13T17:06:03.002 INFO:tasks.workunit.client.0.smithi115.stdout:9/743: creat d0/d21/d65/d6f/f103 x:0 0 0 2024-09-13T17:06:03.002 INFO:tasks.workunit.client.0.smithi115.stdout:9/744: dread - d0/d21/d65/d79/fb2 zero size 2024-09-13T17:06:03.004 INFO:tasks.workunit.client.0.smithi115.stdout:9/745: mknod d0/de/d10/c104 0 2024-09-13T17:06:03.007 INFO:tasks.workunit.client.0.smithi115.stdout:9/746: getdents d0/d21/d65/d6f/dad 0 2024-09-13T17:06:03.010 INFO:tasks.workunit.client.0.smithi115.stdout:9/747: mkdir d0/de/d37/d105 0 2024-09-13T17:06:03.010 INFO:tasks.workunit.client.0.smithi115.stdout:9/748: creat d0/de/d37/dc5/f106 x:0 0 0 2024-09-13T17:06:03.010 INFO:tasks.workunit.client.0.smithi115.stdout:9/749: write d0/de/da6/fd6 [345322,112636] 0 2024-09-13T17:06:03.012 INFO:tasks.workunit.client.0.smithi115.stdout:9/750: creat d0/d21/d65/f107 x:0 0 0 2024-09-13T17:06:03.014 INFO:tasks.workunit.client.0.smithi115.stdout:9/751: rename d0/de/d10/d15/lf8 to d0/de/d37/l108 0 2024-09-13T17:06:03.014 INFO:tasks.workunit.client.0.smithi115.stdout:9/752: read - d0/de/d10/f9d zero size 2024-09-13T17:06:03.015 INFO:tasks.workunit.client.0.smithi115.stdout:9/753: write d0/de/d10/d15/fa3 [850242,49433] 0 2024-09-13T17:06:03.016 INFO:tasks.workunit.client.0.smithi115.stdout:9/754: creat d0/d9c/f109 x:0 0 0 2024-09-13T17:06:03.016 INFO:tasks.workunit.client.0.smithi115.stdout:9/755: dread - d0/d21/d65/d6f/dad/ded/f102 zero size 2024-09-13T17:06:03.016 INFO:tasks.workunit.client.0.smithi115.stdout:9/756: creat d0/d21/d65/d79/f10a x:0 0 0 2024-09-13T17:06:03.024 INFO:tasks.workunit.client.0.smithi115.stdout:9/757: write d0/de/f89 [153791,47969] 0 2024-09-13T17:06:03.025 INFO:tasks.workunit.client.0.smithi115.stdout:9/758: readlink d0/de/d37/l9a 0 2024-09-13T17:06:03.025 INFO:tasks.workunit.client.0.smithi115.stdout:9/759: creat d0/d34/f10b x:0 0 0 2024-09-13T17:06:03.026 INFO:tasks.workunit.client.0.smithi115.stdout:9/760: symlink d0/de/d37/d83/dc2/ddd/d8d/db1/dfa/l10c 0 2024-09-13T17:06:03.026 INFO:tasks.workunit.client.0.smithi115.stdout:9/761: chown d0/d21/d42/c6d 239 1 2024-09-13T17:06:03.027 INFO:tasks.workunit.client.0.smithi115.stdout:9/762: mkdir d0/de/d37/d83/dc2/ddd/d8d/db1/dfa/d10d 0 2024-09-13T17:06:03.027 INFO:tasks.workunit.client.0.smithi115.stdout:9/763: chown d0/de/d37/l9a 89816 1 2024-09-13T17:06:03.029 INFO:tasks.workunit.client.0.smithi115.stdout:9/764: creat d0/de/d37/d83/dc2/ddd/d8d/f10e x:0 0 0 2024-09-13T17:06:03.030 INFO:tasks.workunit.client.0.smithi115.stdout:9/765: rename d0/de/d10/c35 to d0/d21/d65/d6f/dad/dc3/c10f 0 2024-09-13T17:06:03.031 INFO:tasks.workunit.client.0.smithi115.stdout:9/766: mknod d0/de/d37/d83/c110 0 2024-09-13T17:06:03.048 INFO:tasks.workunit.client.0.smithi115.stdout:9/767: dwrite d0/d21/d65/f9e [0,4194304] 0 2024-09-13T17:06:03.050 INFO:tasks.workunit.client.0.smithi115.stdout:9/768: rmdir d0/de/d37/dc5 39 2024-09-13T17:06:03.057 INFO:tasks.workunit.client.0.smithi115.stdout:9/769: write d0/de/d37/d83/dc2/ddd/d8d/db1/dfa/ffc [1367485,52754] 0 2024-09-13T17:06:03.057 INFO:tasks.workunit.client.0.smithi115.stdout:9/770: creat d0/de/da6/f111 x:0 0 0 2024-09-13T17:06:03.057 INFO:tasks.workunit.client.0.smithi115.stdout:9/771: chown d0/de/d37/d83/dc2/ddd/f75 246745498 1 2024-09-13T17:06:03.057 INFO:tasks.workunit.client.0.smithi115.stdout:9/772: readlink d0/de/d37/l63 0 2024-09-13T17:06:03.073 INFO:tasks.workunit.client.0.smithi115.stdout:9/773: dwrite d0/fb [0,4194304] 0 2024-09-13T17:06:03.087 INFO:tasks.workunit.client.0.smithi115.stdout:9/774: dwrite d0/d21/d42/f7b [0,4194304] 0 2024-09-13T17:06:03.091 INFO:tasks.workunit.client.0.smithi115.stdout:9/775: mknod d0/de/d10/d15/c112 0 2024-09-13T17:06:03.093 INFO:tasks.workunit.client.0.smithi115.stdout:9/776: creat d0/de/d37/d83/dc2/ddd/d8d/db1/f113 x:0 0 0 2024-09-13T17:06:03.104 INFO:tasks.workunit.client.0.smithi115.stdout:9/777: rename d0/de/d10 to d0/dd7/d114 0 2024-09-13T17:06:03.105 INFO:tasks.workunit.client.0.smithi115.stdout:9/778: truncate d0/d21/d42/f52 3880179 0 2024-09-13T17:06:03.105 INFO:tasks.workunit.client.0.smithi115.stdout:9/779: fsync d0/d21/fe1 0 2024-09-13T17:06:03.105 INFO:tasks.workunit.client.0.smithi115.stdout:9/780: chown d0/de/d37/d83/dc2/ddd/d8d/f90 6490145 1 2024-09-13T17:06:03.105 INFO:tasks.workunit.client.0.smithi115.stdout:9/781: write d0/d21/fe1 [696572,71158] 0 2024-09-13T17:06:03.178 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:02 smithi115 ceph-mon[27708]: pgmap v20: 65 pgs: 65 active+clean; 3.4 GiB data, 9.6 GiB used, 527 GiB / 536 GiB avail; 236 MiB/s rd, 274 MiB/s wr, 404 op/s 2024-09-13T17:06:03.232 INFO:tasks.workunit.client.0.smithi115.stdout:9/782: rename d0/d21/d42/f52 to d0/d21/d65/d79/df4/f115 0 2024-09-13T17:06:03.234 INFO:tasks.workunit.client.0.smithi115.stdout:9/783: write d0/dd7/d114/f71 [288965,25563] 0 2024-09-13T17:06:03.234 INFO:tasks.workunit.client.0.smithi115.stdout:9/784: chown d0/d21/f59 3421460 1 2024-09-13T17:06:03.234 INFO:tasks.workunit.client.0.smithi115.stdout:9/785: write d0/d21/fd3 [691405,65457] 0 2024-09-13T17:06:03.235 INFO:tasks.workunit.client.0.smithi115.stdout:9/786: mknod d0/d9c/c116 0 2024-09-13T17:06:03.235 INFO:tasks.workunit.client.0.smithi115.stdout:9/787: readlink d0/de/d37/l43 0 2024-09-13T17:06:03.237 INFO:tasks.workunit.client.0.smithi115.stdout:9/788: symlink d0/d21/l117 0 2024-09-13T17:06:03.261 INFO:tasks.workunit.client.0.smithi115.stdout:6/752: sync 2024-09-13T17:06:03.264 INFO:tasks.workunit.client.0.smithi115.stdout:0/676: sync 2024-09-13T17:06:03.264 INFO:tasks.workunit.client.0.smithi115.stdout:1/825: sync 2024-09-13T17:06:03.264 INFO:tasks.workunit.client.0.smithi115.stdout:8/920: sync 2024-09-13T17:06:03.271 INFO:tasks.workunit.client.0.smithi115.stdout:0/677: rename d9/d1d/d24/f84 to d9/d27/d88/d9e/fd0 0 2024-09-13T17:06:03.275 INFO:tasks.workunit.client.0.smithi115.stdout:0/678: rename d9/d1d/d24/l3b to d9/d27/d88/d9e/dad/ld1 0 2024-09-13T17:06:03.276 INFO:tasks.workunit.client.0.smithi115.stdout:0/679: readlink d9/d27/d88/d99/lb9 0 2024-09-13T17:06:03.277 INFO:tasks.workunit.client.0.smithi115.stdout:0/680: dread d9/d1d/d24/d26/d5d/f96 [0,4194304] 0 2024-09-13T17:06:03.282 INFO:tasks.workunit.client.0.smithi115.stdout:6/753: dwrite d8/db/f70 [0,4194304] 0 2024-09-13T17:06:03.282 INFO:tasks.workunit.client.0.smithi115.stdout:6/754: fsync d8/d33/d40/d67/db4/f4f 0 2024-09-13T17:06:03.283 INFO:tasks.workunit.client.0.smithi115.stdout:0/681: rename d9/d1d/d24/d26/f45 to d9/d1d/d24/d26/d7b/fd2 0 2024-09-13T17:06:03.286 INFO:tasks.workunit.client.0.smithi115.stdout:6/755: creat d8/d33/d82/fec x:0 0 0 2024-09-13T17:06:03.290 INFO:tasks.workunit.client.0.smithi115.stdout:6/756: mknod d8/d33/d40/d67/db4/dbf/ddb/ced 0 2024-09-13T17:06:03.290 INFO:tasks.workunit.client.0.smithi115.stdout:6/757: dread - d8/d33/d40/d67/db4/dc9/fe0 zero size 2024-09-13T17:06:03.290 INFO:tasks.workunit.client.0.smithi115.stdout:8/921: dwrite d0/d26/d29/d59/d7e/da7/d2b/db1/fbc [0,4194304] 0 2024-09-13T17:06:03.294 INFO:tasks.workunit.client.0.smithi115.stdout:6/758: truncate d8/db/dd/da2/db3/fb5 990756 0 2024-09-13T17:06:03.295 INFO:tasks.workunit.client.0.smithi115.stdout:0/682: read d9/f18 [3310523,37120] 0 2024-09-13T17:06:03.295 INFO:tasks.workunit.client.0.smithi115.stdout:0/683: chown d9/d1d/d24/d26/d2d/d30/d46/f49 764524 1 2024-09-13T17:06:03.295 INFO:tasks.workunit.client.0.smithi115.stdout:0/684: write d9/d1d/d24/d26/d36/f7c [246939,104349] 0 2024-09-13T17:06:03.297 INFO:tasks.workunit.client.0.smithi115.stdout:6/759: dread d8/d33/d40/d67/db4/d24/d17/f85 [0,4194304] 0 2024-09-13T17:06:03.299 INFO:tasks.workunit.client.0.smithi115.stdout:0/685: symlink d9/d1d/d24/d26/d36/d48/dbb/ld3 0 2024-09-13T17:06:03.302 INFO:tasks.workunit.client.0.smithi115.stdout:6/760: symlink d8/d33/d40/d67/db4/d24/d53/d6a/lee 0 2024-09-13T17:06:03.302 INFO:tasks.workunit.client.0.smithi115.stdout:6/761: write d8/d33/d40/d67/db4/dbf/feb [904133,50247] 0 2024-09-13T17:06:03.303 INFO:tasks.workunit.client.0.smithi115.stdout:6/762: mknod d8/db/d49/d8d/cef 0 2024-09-13T17:06:03.304 INFO:tasks.workunit.client.0.smithi115.stdout:6/763: chown d8/d33/d40/d4c/fa0 5231886 1 2024-09-13T17:06:03.305 INFO:tasks.workunit.client.0.smithi115.stdout:6/764: symlink d8/db/d49/lf0 0 2024-09-13T17:06:03.305 INFO:tasks.workunit.client.0.smithi115.stdout:6/765: write d8/d33/d40/d4c/fd9 [89446,63608] 0 2024-09-13T17:06:03.306 INFO:tasks.workunit.client.0.smithi115.stdout:6/766: fsync d8/db/f70 0 2024-09-13T17:06:03.307 INFO:tasks.workunit.client.0.smithi115.stdout:8/922: dwrite d0/d26/d29/f38 [0,4194304] 0 2024-09-13T17:06:03.307 INFO:tasks.workunit.client.0.smithi115.stdout:6/767: mkdir d8/db/d49/df1 0 2024-09-13T17:06:03.310 INFO:tasks.workunit.client.0.smithi115.stdout:8/923: rename d0/d26/d29/d59/d7e/da7/d2b/lae to d0/d95/db6/l138 0 2024-09-13T17:06:03.310 INFO:tasks.workunit.client.0.smithi115.stdout:8/924: chown d0/d26/d29/d59/d7e/da7/d2b/d3b/fb4 5817660 1 2024-09-13T17:06:03.311 INFO:tasks.workunit.client.0.smithi115.stdout:8/925: chown d0/d26 63407368 1 2024-09-13T17:06:03.311 INFO:tasks.workunit.client.0.smithi115.stdout:8/926: creat d0/d15/d3e/f139 x:0 0 0 2024-09-13T17:06:03.313 INFO:tasks.workunit.client.0.smithi115.stdout:0/686: write d9/d1d/d24/f5b [1023292,122785] 0 2024-09-13T17:06:03.314 INFO:tasks.workunit.client.0.smithi115.stdout:0/687: truncate d9/d1d/d24/f72 1882474 0 2024-09-13T17:06:03.315 INFO:tasks.workunit.client.0.smithi115.stdout:0/688: mkdir d9/d27/d88/d99/dd4 0 2024-09-13T17:06:03.315 INFO:tasks.workunit.client.0.smithi115.stdout:0/689: chown d9/d1d/d24/d26/d36/d48/dbb/ccf 459420999 1 2024-09-13T17:06:03.317 INFO:tasks.workunit.client.0.smithi115.stdout:0/690: mknod d9/d1d/d24/d7d/cd5 0 2024-09-13T17:06:03.323 INFO:tasks.workunit.client.0.smithi115.stdout:8/927: dread d0/d26/d29/d59/d7e/da7/d2b/d3b/d11f/dbd/fbf [0,4194304] 0 2024-09-13T17:06:03.326 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:02 smithi195 ceph-mon[34981]: pgmap v20: 65 pgs: 65 active+clean; 3.4 GiB data, 9.6 GiB used, 527 GiB / 536 GiB avail; 236 MiB/s rd, 274 MiB/s wr, 404 op/s 2024-09-13T17:06:03.342 INFO:tasks.workunit.client.0.smithi115.stdout:6/768: dwrite d8/d33/d40/d67/db4/f4f [0,4194304] 0 2024-09-13T17:06:03.342 INFO:tasks.workunit.client.0.smithi115.stdout:6/769: creat d8/d13/d7b/ff2 x:0 0 0 2024-09-13T17:06:03.343 INFO:tasks.workunit.client.0.smithi115.stdout:0/691: dwrite d9/d27/d88/d99/dc7/f92 [4194304,4194304] 0 2024-09-13T17:06:03.344 INFO:tasks.workunit.client.0.smithi115.stdout:8/928: dwrite d0/d21/d76/d83/d5a/fbb [0,4194304] 0 2024-09-13T17:06:03.346 INFO:tasks.workunit.client.0.smithi115.stdout:0/692: creat d9/d1d/d24/d26/fd6 x:0 0 0 2024-09-13T17:06:03.346 INFO:tasks.workunit.client.0.smithi115.stdout:0/693: fsync d9/d1d/d24/d26/d2d/d78/fbe 0 2024-09-13T17:06:03.348 INFO:tasks.workunit.client.0.smithi115.stdout:6/770: dread d8/db/dd/f3a [0,4194304] 0 2024-09-13T17:06:03.348 INFO:tasks.workunit.client.0.smithi115.stdout:8/929: mkdir d0/d26/d29/d59/d7e/da7/d28/d71/d13a 0 2024-09-13T17:06:03.350 INFO:tasks.workunit.client.0.smithi115.stdout:0/694: truncate d9/d1d/d24/d26/d36/d48/f4c 768847 0 2024-09-13T17:06:03.350 INFO:tasks.workunit.client.0.smithi115.stdout:0/695: chown d9/d27/d88/fa2 256234857 1 2024-09-13T17:06:03.350 INFO:tasks.workunit.client.0.smithi115.stdout:0/696: chown d9/d1d/d24/d26/d36/fcb 18005 1 2024-09-13T17:06:03.351 INFO:tasks.workunit.client.0.smithi115.stdout:6/771: getdents d8/d33/d40/d67/db4/d24 0 2024-09-13T17:06:03.352 INFO:tasks.workunit.client.0.smithi115.stdout:0/697: mkdir d9/d1d/d24/d26/d36/dd7 0 2024-09-13T17:06:03.353 INFO:tasks.workunit.client.0.smithi115.stdout:0/698: readlink d9/d1d/d24/d26/d5d/l9c 0 2024-09-13T17:06:03.354 INFO:tasks.workunit.client.0.smithi115.stdout:6/772: mknod d8/d33/d40/d4c/d66/de3/cf3 0 2024-09-13T17:06:03.354 INFO:tasks.workunit.client.0.smithi115.stdout:6/773: chown d8/d33/d40/d67/db4/dbf/ddb 1251919 1 2024-09-13T17:06:03.355 INFO:tasks.workunit.client.0.smithi115.stdout:0/699: creat d9/d1d/d24/d26/d5d/d67/fd8 x:0 0 0 2024-09-13T17:06:03.398 INFO:tasks.workunit.client.0.smithi115.stdout:6/774: mkdir d8/d33/d40/d4c/d66/df4 0 2024-09-13T17:06:03.400 INFO:tasks.workunit.client.0.smithi115.stdout:8/930: dwrite d0/d21/fcc [0,4194304] 0 2024-09-13T17:06:03.400 INFO:tasks.workunit.client.0.smithi115.stdout:8/931: readlink d0/d21/d3a/d60/dc6/l107 0 2024-09-13T17:06:03.400 INFO:tasks.workunit.client.0.smithi115.stdout:0/700: mknod d9/d1d/d24/d26/d5d/d66/d83/dc1/cd9 0 2024-09-13T17:06:03.402 INFO:tasks.workunit.client.0.smithi115.stdout:6/775: dread d8/d33/d40/f5c [0,4194304] 0 2024-09-13T17:06:03.402 INFO:tasks.workunit.client.0.smithi115.stdout:6/776: chown d8/d33/d40/d67/db4/f65 1073766017 1 2024-09-13T17:06:03.408 INFO:tasks.workunit.client.0.smithi115.stdout:0/701: dread d9/d1d/d24/d26/d36/d48/fb7 [0,4194304] 0 2024-09-13T17:06:03.415 INFO:tasks.workunit.client.0.smithi115.stdout:6/777: creat d8/d33/d40/d4c/ff5 x:0 0 0 2024-09-13T17:06:03.417 INFO:tasks.workunit.client.0.smithi115.stdout:0/702: link d9/d1d/d24/d26/d36/c4b d9/d1d/d24/d26/d2d/d30/dc2/cda 0 2024-09-13T17:06:03.417 INFO:tasks.workunit.client.0.smithi115.stdout:0/703: dread - d9/d1d/d24/fa6 zero size 2024-09-13T17:06:03.420 INFO:tasks.workunit.client.0.smithi115.stdout:0/704: creat d9/d1d/d24/d7d/fdb x:0 0 0 2024-09-13T17:06:03.420 INFO:tasks.workunit.client.0.smithi115.stdout:0/705: chown d9/d1d/d24/d26/d5d/d67 3601305 1 2024-09-13T17:06:03.422 INFO:tasks.workunit.client.0.smithi115.stdout:0/706: rename d9/d1d/d24/d26/d2d/d30/d5c/d9a to d9/d1d/d24/d26/d2d/d30/dc2/ddc 0 2024-09-13T17:06:03.422 INFO:tasks.workunit.client.0.smithi115.stdout:0/707: fsync d9/d27/d88/d99/faa 0 2024-09-13T17:06:03.424 INFO:tasks.workunit.client.0.smithi115.stdout:0/708: rename d9/d1d/d24/d26/d36/d48/f8a to d9/d1d/d24/d26/d5d/fdd 0 2024-09-13T17:06:03.424 INFO:tasks.workunit.client.0.smithi115.stdout:6/778: dread d8/d33/d40/d67/db4/f65 [0,4194304] 0 2024-09-13T17:06:03.424 INFO:tasks.workunit.client.0.smithi115.stdout:6/779: fdatasync d8/d33/d40/d67/db4/d24/d53/d6a/f9a 0 2024-09-13T17:06:03.424 INFO:tasks.workunit.client.0.smithi115.stdout:6/780: truncate d8/db/dd/f16 4391230 0 2024-09-13T17:06:03.425 INFO:tasks.workunit.client.0.smithi115.stdout:0/709: symlink d9/d27/d88/d8e/lde 0 2024-09-13T17:06:03.425 INFO:tasks.workunit.client.0.smithi115.stdout:0/710: read d9/d1d/d24/d26/d7b/fd2 [1818558,109868] 0 2024-09-13T17:06:03.427 INFO:tasks.workunit.client.0.smithi115.stdout:6/781: rename d8/d33/d40/d67/db4/d24/f63 to d8/db/ff6 0 2024-09-13T17:06:03.432 INFO:tasks.workunit.client.0.smithi115.stdout:0/711: dread d9/d1d/d24/d26/d2d/f79 [0,4194304] 0 2024-09-13T17:06:03.436 INFO:tasks.workunit.client.0.smithi115.stdout:7/799: sync 2024-09-13T17:06:03.436 INFO:tasks.workunit.client.0.smithi115.stdout:2/947: sync 2024-09-13T17:06:03.438 INFO:tasks.workunit.client.0.smithi115.stdout:6/782: getdents d8/db 0 2024-09-13T17:06:03.438 INFO:tasks.workunit.client.0.smithi115.stdout:6/783: stat d8/d33/d40/d67/db4/d24/d53/lbc 0 2024-09-13T17:06:03.438 INFO:tasks.workunit.client.0.smithi115.stdout:6/784: dread - d8/d33/d40/d67/db4/dbf/fe6 zero size 2024-09-13T17:06:03.438 INFO:tasks.workunit.client.0.smithi115.stdout:6/785: truncate d8/d33/d7f/fe9 589065 0 2024-09-13T17:06:03.440 INFO:tasks.workunit.client.0.smithi115.stdout:2/948: rmdir d3/d4d/d13/d62/d92/dd7 39 2024-09-13T17:06:03.441 INFO:tasks.workunit.client.0.smithi115.stdout:7/800: mkdir d0/d2/d67/d86/d94/d9b/dbb/d11d 0 2024-09-13T17:06:03.444 INFO:tasks.workunit.client.0.smithi115.stdout:6/786: mknod d8/d13/dd7/cf7 0 2024-09-13T17:06:03.444 INFO:tasks.workunit.client.0.smithi115.stdout:2/949: symlink d3/d4d/de/d99/l130 0 2024-09-13T17:06:03.446 INFO:tasks.workunit.client.0.smithi115.stdout:6/787: rename d8/d33/d40/d67/db4/d24/d17/d9b to d8/d33/d40/d4c/d66/df8 0 2024-09-13T17:06:03.447 INFO:tasks.workunit.client.0.smithi115.stdout:0/712: dwrite d9/d1d/d24/d26/d2d/d30/f9f [0,4194304] 0 2024-09-13T17:06:03.448 INFO:tasks.workunit.client.0.smithi115.stdout:2/950: getdents d3/d4d/d13 0 2024-09-13T17:06:03.448 INFO:tasks.workunit.client.0.smithi115.stdout:2/951: readlink d3/d4d/de/l11d 0 2024-09-13T17:06:03.448 INFO:tasks.workunit.client.0.smithi115.stdout:6/788: symlink d8/d13/dd7/lf9 0 2024-09-13T17:06:03.451 INFO:tasks.workunit.client.0.smithi115.stdout:7/801: dread d0/d3b/d50/d21/d99/db3/d117/d44/dac/f118 [0,4194304] 0 2024-09-13T17:06:03.455 INFO:tasks.workunit.client.0.smithi115.stdout:2/952: symlink d3/d4d/de/d99/d9a/df1/dfa/d55/l131 0 2024-09-13T17:06:03.456 INFO:tasks.workunit.client.0.smithi115.stdout:7/802: truncate d0/d2/d1e/d3d/d6c/f49 375754 0 2024-09-13T17:06:03.460 INFO:tasks.workunit.client.0.smithi115.stdout:6/789: write d8/d33/d40/d67/db4/d24/d53/d6a/fcc [3441496,107817] 0 2024-09-13T17:06:03.467 INFO:tasks.workunit.client.0.smithi115.stdout:0/713: dwrite d9/d1d/d24/d26/d2d/d30/f5a [0,4194304] 0 2024-09-13T17:06:03.467 INFO:tasks.workunit.client.0.smithi115.stdout:7/803: write d0/d2/d1e/d3d/d7c/fe4 [3559310,42884] 0 2024-09-13T17:06:03.468 INFO:tasks.workunit.client.0.smithi115.stdout:6/790: dread d8/f51 [4194304,4194304] 0 2024-09-13T17:06:03.468 INFO:tasks.workunit.client.0.smithi115.stdout:6/791: read - d8/d33/d40/d4c/d66/df8/fd6 zero size 2024-09-13T17:06:03.468 INFO:tasks.workunit.client.0.smithi115.stdout:6/792: write d8/db/fab [1096137,75278] 0 2024-09-13T17:06:03.469 INFO:tasks.workunit.client.0.smithi115.stdout:0/714: mkdir d9/d1d/d24/d26/d2d/d30/ddf 0 2024-09-13T17:06:03.472 INFO:tasks.workunit.client.0.smithi115.stdout:7/804: rename d0/d3b/d50/d21/d99/db3/d117/ff9 to d0/d3b/d50/d21/d99/db3/d117/d44/f11e 0 2024-09-13T17:06:03.473 INFO:tasks.workunit.client.0.smithi115.stdout:6/793: creat d8/d33/d40/d4c/d66/df4/ffa x:0 0 0 2024-09-13T17:06:03.474 INFO:tasks.workunit.client.0.smithi115.stdout:0/715: symlink d9/d1d/d24/d26/d2d/d30/le0 0 2024-09-13T17:06:03.474 INFO:tasks.workunit.client.0.smithi115.stdout:0/716: getdents d9/d1d/d24/d26/d36/dd7 0 2024-09-13T17:06:03.474 INFO:tasks.workunit.client.0.smithi115.stdout:0/717: chown d9/d1d/d24/c82 91448036 1 2024-09-13T17:06:03.477 INFO:tasks.workunit.client.0.smithi115.stdout:7/805: rmdir d0/d97 39 2024-09-13T17:06:03.479 INFO:tasks.workunit.client.0.smithi115.stdout:6/794: dread d8/d13/fdd [0,4194304] 0 2024-09-13T17:06:03.481 INFO:tasks.workunit.client.0.smithi115.stdout:0/718: dread d9/d1d/d24/d26/d2d/d30/f9f [0,4194304] 0 2024-09-13T17:06:03.481 INFO:tasks.workunit.client.0.smithi115.stdout:0/719: fsync d9/d1d/d24/d26/d2d/d78/f7f 0 2024-09-13T17:06:03.482 INFO:tasks.workunit.client.0.smithi115.stdout:7/806: rmdir d0/d3b/d50/d21/d2f/d9e 39 2024-09-13T17:06:03.489 INFO:tasks.workunit.client.0.smithi115.stdout:6/795: dread d8/db/d1d/f18 [0,4194304] 0 2024-09-13T17:06:03.492 INFO:tasks.workunit.client.0.smithi115.stdout:0/720: truncate d9/d1d/d24/d26/d5d/fdd 2300427 0 2024-09-13T17:06:03.497 INFO:tasks.workunit.client.0.smithi115.stdout:5/909: sync 2024-09-13T17:06:03.497 INFO:tasks.workunit.client.0.smithi115.stdout:4/901: sync 2024-09-13T17:06:03.497 INFO:tasks.workunit.client.0.smithi115.stdout:6/796: creat d8/d33/d40/d67/db4/ffb x:0 0 0 2024-09-13T17:06:03.497 INFO:tasks.workunit.client.0.smithi115.stdout:6/797: dread - d8/d13/d7b/ff2 zero size 2024-09-13T17:06:03.500 INFO:tasks.workunit.client.0.smithi115.stdout:6/798: rename d8/d33/d40/d4c/f91 to d8/db/d49/d8d/ffc 0 2024-09-13T17:06:03.500 INFO:tasks.workunit.client.0.smithi115.stdout:6/799: read d8/f76 [490242,52527] 0 2024-09-13T17:06:03.502 INFO:tasks.workunit.client.0.smithi115.stdout:0/721: getdents d9/d27 0 2024-09-13T17:06:03.502 INFO:tasks.workunit.client.0.smithi115.stdout:0/722: fdatasync d9/d27/d88/d99/dc7/f57 0 2024-09-13T17:06:03.513 INFO:tasks.workunit.client.0.smithi115.stdout:0/723: rename d9/d1d/d24/d26/d2d to d9/d1d/de1 0 2024-09-13T17:06:03.516 INFO:tasks.workunit.client.0.smithi115.stdout:7/807: dwrite d0/d59/fb8 [0,4194304] 0 2024-09-13T17:06:03.529 INFO:tasks.workunit.client.0.smithi115.stdout:7/808: write d0/d2/d4a/f5f [4543940,52764] 0 2024-09-13T17:06:03.530 INFO:tasks.workunit.client.0.smithi115.stdout:7/809: mkdir d0/d3b/d50/d21/d99/db3/d117/d44/da7/dea/d11f 0 2024-09-13T17:06:03.530 INFO:tasks.workunit.client.0.smithi115.stdout:7/810: fsync d0/d2/d1e/d3d/d6c/d71/feb 0 2024-09-13T17:06:03.530 INFO:tasks.workunit.client.0.smithi115.stdout:4/902: dwrite d7/dd/de/d4e/dae/fc5 [0,4194304] 0 2024-09-13T17:06:03.530 INFO:tasks.workunit.client.0.smithi115.stdout:4/903: write d7/d86/dd5/f114 [12516,4649] 0 2024-09-13T17:06:03.531 INFO:tasks.workunit.client.0.smithi115.stdout:5/910: dwrite d19/d2b/d32/d55/d5e/d87/d86/fb5 [4194304,4194304] 0 2024-09-13T17:06:03.531 INFO:tasks.workunit.client.0.smithi115.stdout:5/911: chown d19/d2c/cf9 7196 1 2024-09-13T17:06:03.531 INFO:tasks.workunit.client.0.smithi115.stdout:6/800: dwrite d8/db/f5d [0,4194304] 0 2024-09-13T17:06:03.531 INFO:tasks.workunit.client.0.smithi115.stdout:6/801: chown d8/d33/d82/db0 26232 1 2024-09-13T17:06:03.531 INFO:tasks.workunit.client.0.smithi115.stdout:0/724: dwrite d9/d1d/d24/d26/d5d/fa3 [0,4194304] 0 2024-09-13T17:06:03.531 INFO:tasks.workunit.client.0.smithi115.stdout:6/802: stat d8/d33/d40/d67/db4/d24/c22 0 2024-09-13T17:06:03.531 INFO:tasks.workunit.client.0.smithi115.stdout:6/803: chown d8/d33/d40/d67/db4/d24/d53/f9c 8140202 1 2024-09-13T17:06:03.532 INFO:tasks.workunit.client.0.smithi115.stdout:6/804: chown d8/d33/d40/d67/db4/d24/f8b 200526 1 2024-09-13T17:06:03.533 INFO:tasks.workunit.client.0.smithi115.stdout:7/811: truncate d0/d3b/d54/f55 35386 0 2024-09-13T17:06:03.533 INFO:tasks.workunit.client.0.smithi115.stdout:7/812: chown d0/d3b/d50/d21/d99/db3/d117/d44/dac/dbf 15939 1 2024-09-13T17:06:03.533 INFO:tasks.workunit.client.0.smithi115.stdout:7/813: write d0/d59/fa9 [741607,103545] 0 2024-09-13T17:06:03.534 INFO:tasks.workunit.client.0.smithi115.stdout:4/904: mknod d7/dd/de/d4e/dd1/c11b 0 2024-09-13T17:06:03.534 INFO:tasks.workunit.client.0.smithi115.stdout:4/905: chown d7/dd/d3c/d72/db3/dda/f10d 76554638 1 2024-09-13T17:06:03.542 INFO:tasks.workunit.client.0.smithi115.stdout:5/912: link d19/d2e/ff3 d19/d2e/dc6/f12f 0 2024-09-13T17:06:03.544 INFO:tasks.workunit.client.0.smithi115.stdout:0/725: creat d9/d1d/de1/d30/ddf/fe2 x:0 0 0 2024-09-13T17:06:03.544 INFO:tasks.workunit.client.0.smithi115.stdout:6/805: mkdir d8/db/d1d/dfd 0 2024-09-13T17:06:03.548 INFO:tasks.workunit.client.0.smithi115.stdout:7/814: link d0/d2/d1e/d73/fbc d0/d2/d1e/d3d/d6c/d71/f120 0 2024-09-13T17:06:03.551 INFO:tasks.workunit.client.0.smithi115.stdout:4/906: symlink d7/dd/de/d4e/d9f/dd4/l11c 0 2024-09-13T17:06:03.553 INFO:tasks.workunit.client.0.smithi115.stdout:5/913: symlink d19/d2b/d32/d55/d5e/d87/da4/da6/l130 0 2024-09-13T17:06:03.554 INFO:tasks.workunit.client.0.smithi115.stdout:5/914: chown d19/fa2 404 1 2024-09-13T17:06:03.554 INFO:tasks.workunit.client.0.smithi115.stdout:6/806: dread d8/db/f70 [0,4194304] 0 2024-09-13T17:06:03.554 INFO:tasks.workunit.client.0.smithi115.stdout:0/726: link d9/d1d/d24/f5b d9/d1d/d24/d26/fe3 0 2024-09-13T17:06:03.554 INFO:tasks.workunit.client.0.smithi115.stdout:0/727: fdatasync d9/d1d/d24/d26/d36/f62 0 2024-09-13T17:06:03.556 INFO:tasks.workunit.client.0.smithi115.stdout:4/907: unlink d7/dd/de/d4e/f91 0 2024-09-13T17:06:03.556 INFO:tasks.workunit.client.0.smithi115.stdout:4/908: creat d7/dd/d3c/d7b/f11d x:0 0 0 2024-09-13T17:06:03.556 INFO:tasks.workunit.client.0.smithi115.stdout:4/909: write d7/dd/d3c/d72/db3/dda/f10d [4826275,64329] 0 2024-09-13T17:06:03.557 INFO:tasks.workunit.client.0.smithi115.stdout:5/915: symlink d19/d2b/d32/d55/d5e/d87/l131 0 2024-09-13T17:06:03.558 INFO:tasks.workunit.client.0.smithi115.stdout:6/807: mkdir d8/d33/d40/d67/db4/d24/d53/d6a/dfe 0 2024-09-13T17:06:03.560 INFO:tasks.workunit.client.0.smithi115.stdout:0/728: rename d9/d1d/d24/d26/d5d/l9c to d9/d1d/de1/d78/le4 0 2024-09-13T17:06:03.560 INFO:tasks.workunit.client.0.smithi115.stdout:0/729: write d9/d27/d88/d99/dc7/fc6 [472914,22894] 0 2024-09-13T17:06:03.560 INFO:tasks.workunit.client.0.smithi115.stdout:0/730: readlink d9/d1d/d24/d26/d36/d48/lc0 0 2024-09-13T17:06:03.560 INFO:tasks.workunit.client.0.smithi115.stdout:0/731: write d9/d1d/d24/d26/d36/fcb [738362,67820] 0 2024-09-13T17:06:03.560 INFO:tasks.workunit.client.0.smithi115.stdout:0/732: truncate d9/d27/d88/d9e/fbf 122974 0 2024-09-13T17:06:03.560 INFO:tasks.workunit.client.0.smithi115.stdout:0/733: chown d9/d1d/d24/d26/d5d/d67 60 1 2024-09-13T17:06:03.562 INFO:tasks.workunit.client.0.smithi115.stdout:7/815: dwrite d0/d3b/fad [0,4194304] 0 2024-09-13T17:06:03.563 INFO:tasks.workunit.client.0.smithi115.stdout:4/910: mknod d7/d86/d88/c11e 0 2024-09-13T17:06:03.563 INFO:tasks.workunit.client.0.smithi115.stdout:4/911: chown d7/dd/de/d4e/d5a/d4f/c89 6637176 1 2024-09-13T17:06:03.563 INFO:tasks.workunit.client.0.smithi115.stdout:5/916: mkdir d19/d2b/d32/d55/d5e/d87/d132 0 2024-09-13T17:06:03.565 INFO:tasks.workunit.client.0.smithi115.stdout:0/734: truncate d9/d1d/d24/d26/f64 396770 0 2024-09-13T17:06:03.565 INFO:tasks.workunit.client.0.smithi115.stdout:0/735: readlink d9/d1d/d24/d26/l86 0 2024-09-13T17:06:03.566 INFO:tasks.workunit.client.0.smithi115.stdout:7/816: mknod d0/d3b/d50/d21/d99/db3/d117/dcc/c121 0 2024-09-13T17:06:03.569 INFO:tasks.workunit.client.0.smithi115.stdout:5/917: rename d19/d2e/f104 to d19/d2b/d32/f133 0 2024-09-13T17:06:03.586 INFO:tasks.workunit.client.0.smithi115.stdout:4/912: rmdir d7/dd/de/d4e/d5a/d4f/d70/db6 39 2024-09-13T17:06:03.593 INFO:tasks.workunit.client.0.smithi115.stdout:4/913: mknod d7/dd/de/d4e/d9f/dd4/c11f 0 2024-09-13T17:06:03.594 INFO:tasks.workunit.client.0.smithi115.stdout:0/736: rename d9/d1d/d24/d26/d5d/d66/d83 to d9/d1d/de1/d78/de5 0 2024-09-13T17:06:03.594 INFO:tasks.workunit.client.0.smithi115.stdout:0/737: stat d9/f18 0 2024-09-13T17:06:03.594 INFO:tasks.workunit.client.0.smithi115.stdout:0/738: write d9/d27/d88/d9e/fd0 [4704888,26794] 0 2024-09-13T17:06:03.597 INFO:tasks.workunit.client.0.smithi115.stdout:7/817: rename d0/d2/d1e/cc0 to d0/d97/c122 0 2024-09-13T17:06:03.603 INFO:tasks.workunit.client.0.smithi115.stdout:4/914: write d7/dbe/f87 [787410,31394] 0 2024-09-13T17:06:03.605 INFO:tasks.workunit.client.0.smithi115.stdout:0/739: mknod d9/d1d/d24/d26/d36/d48/dbb/ce6 0 2024-09-13T17:06:03.605 INFO:tasks.workunit.client.0.smithi115.stdout:0/740: chown d9/d1d/d24/d26/d5d/d66/db1/fb8 1 1 2024-09-13T17:06:03.606 INFO:tasks.workunit.client.0.smithi115.stdout:4/915: creat d7/dd/de/d4e/d9f/dc8/f120 x:0 0 0 2024-09-13T17:06:03.608 INFO:tasks.workunit.client.0.smithi115.stdout:0/741: truncate d9/d1d/d24/d26/d36/d48/fb7 2214637 0 2024-09-13T17:06:03.608 INFO:tasks.workunit.client.0.smithi115.stdout:9/789: sync 2024-09-13T17:06:03.608 INFO:tasks.workunit.client.0.smithi115.stdout:1/826: sync 2024-09-13T17:06:03.608 INFO:tasks.workunit.client.0.smithi115.stdout:8/932: sync 2024-09-13T17:06:03.609 INFO:tasks.workunit.client.0.smithi115.stdout:8/933: creat d0/d26/d29/d59/d11a/f13b x:0 0 0 2024-09-13T17:06:03.609 INFO:tasks.workunit.client.0.smithi115.stdout:8/934: creat d0/d26/d29/d59/d7e/da7/d2b/d37/f13c x:0 0 0 2024-09-13T17:06:03.609 INFO:tasks.workunit.client.0.smithi115.stdout:4/916: getdents d7/dd/d3c/d74 0 2024-09-13T17:06:03.610 INFO:tasks.workunit.client.0.smithi115.stdout:8/935: dread d0/d26/d29/d59/d7e/da7/d2b/d3b/d11f/dbd/ff4 [0,4194304] 0 2024-09-13T17:06:03.610 INFO:tasks.workunit.client.0.smithi115.stdout:8/936: truncate d0/d15/d44/f61 560085 0 2024-09-13T17:06:03.612 INFO:tasks.workunit.client.0.smithi115.stdout:9/790: rmdir d0/d21/d4f 39 2024-09-13T17:06:03.612 INFO:tasks.workunit.client.0.smithi115.stdout:9/791: readlink d0/dd7/d114/d15/l64 0 2024-09-13T17:06:03.614 INFO:tasks.workunit.client.0.smithi115.stdout:1/827: creat d5/d60/d7d/f121 x:0 0 0 2024-09-13T17:06:03.619 INFO:tasks.workunit.client.0.smithi115.stdout:6/808: dwrite d8/d13/fdd [0,4194304] 0 2024-09-13T17:06:03.619 INFO:tasks.workunit.client.0.smithi115.stdout:6/809: chown d8/d13/fea 5687 1 2024-09-13T17:06:03.623 INFO:tasks.workunit.client.0.smithi115.stdout:1/828: dread d5/d60/f5e [0,4194304] 0 2024-09-13T17:06:03.624 INFO:tasks.workunit.client.0.smithi115.stdout:8/937: mknod d0/d26/d29/d59/d7e/da7/c13d 0 2024-09-13T17:06:03.624 INFO:tasks.workunit.client.0.smithi115.stdout:8/938: fsync d0/d26/d29/d59/d7e/da7/d2b/d37/f115 0 2024-09-13T17:06:03.626 INFO:tasks.workunit.client.0.smithi115.stdout:6/810: creat d8/d33/d40/d67/db4/d24/d53/d6a/dfe/fff x:0 0 0 2024-09-13T17:06:03.629 INFO:tasks.workunit.client.0.smithi115.stdout:1/829: rename d5/d7/f21 to d5/d60/d8e/f122 0 2024-09-13T17:06:03.629 INFO:tasks.workunit.client.0.smithi115.stdout:1/830: write d5/d7/d33/d3a/f112 [1375792,81832] 0 2024-09-13T17:06:03.629 INFO:tasks.workunit.client.0.smithi115.stdout:1/831: creat d5/d60/d8e/f123 x:0 0 0 2024-09-13T17:06:03.629 INFO:tasks.workunit.client.0.smithi115.stdout:0/742: dwrite d9/d1d/d24/d26/d5d/fdd [0,4194304] 0 2024-09-13T17:06:03.629 INFO:tasks.workunit.client.0.smithi115.stdout:4/917: getdents d7/d86/d88/dba 0 2024-09-13T17:06:03.632 INFO:tasks.workunit.client.0.smithi115.stdout:6/811: symlink d8/d33/d40/d4c/d66/l100 0 2024-09-13T17:06:03.633 INFO:tasks.workunit.client.0.smithi115.stdout:7/818: dwrite d0/d2/d1e/de5/d115/fa8 [0,4194304] 0 2024-09-13T17:06:03.634 INFO:tasks.workunit.client.0.smithi115.stdout:7/819: creat d0/d2/d1e/de5/f123 x:0 0 0 2024-09-13T17:06:03.634 INFO:tasks.workunit.client.0.smithi115.stdout:8/939: write d0/d21/fcc [2510882,109005] 0 2024-09-13T17:06:03.634 INFO:tasks.workunit.client.0.smithi115.stdout:8/940: chown d0/d26/d29/d59/d7e/da7/d2b/d3b/l67 158 1 2024-09-13T17:06:03.634 INFO:tasks.workunit.client.0.smithi115.stdout:8/941: chown d0/d42/d80/d94/cc0 11 1 2024-09-13T17:06:03.634 INFO:tasks.workunit.client.0.smithi115.stdout:1/832: mknod d5/d60/c124 0 2024-09-13T17:06:03.635 INFO:tasks.workunit.client.0.smithi115.stdout:1/833: read - d5/fba zero size 2024-09-13T17:06:03.635 INFO:tasks.workunit.client.0.smithi115.stdout:0/743: getdents d9/d1d/de1/d78 0 2024-09-13T17:06:03.640 INFO:tasks.workunit.client.0.smithi115.stdout:9/792: dwrite d0/d21/d4f/fab [0,4194304] 0 2024-09-13T17:06:03.644 INFO:tasks.workunit.client.0.smithi115.stdout:8/942: rename d0/d26/d29/d59/d7e/da7/dca/l12e to d0/d21/d3a/d60/dc6/l13e 0 2024-09-13T17:06:03.644 INFO:tasks.workunit.client.0.smithi115.stdout:8/943: truncate d0/d21/d3a/f3f 5137458 0 2024-09-13T17:06:03.646 INFO:tasks.workunit.client.0.smithi115.stdout:0/744: symlink d9/d1d/d24/d26/d36/dd7/le7 0 2024-09-13T17:06:03.647 INFO:tasks.workunit.client.0.smithi115.stdout:0/745: creat d9/d1d/d24/d26/fe8 x:0 0 0 2024-09-13T17:06:03.649 INFO:tasks.workunit.client.0.smithi115.stdout:6/812: symlink d8/d33/d40/d4c/l101 0 2024-09-13T17:06:03.652 INFO:tasks.workunit.client.0.smithi115.stdout:1/834: rename d5/d3e/da1/fd6 to d5/d7/d33/d3a/dc3/ddd/df4/d102/f125 0 2024-09-13T17:06:03.653 INFO:tasks.workunit.client.0.smithi115.stdout:8/944: rmdir d0/d26/d29/d59/d72 39 2024-09-13T17:06:03.653 INFO:tasks.workunit.client.0.smithi115.stdout:8/945: truncate d0/d26/d29/f2a 4934556 0 2024-09-13T17:06:03.655 INFO:tasks.workunit.client.0.smithi115.stdout:0/746: getdents d9/d1d/de1/d78/de5/dc1 0 2024-09-13T17:06:03.655 INFO:tasks.workunit.client.0.smithi115.stdout:0/747: truncate d9/d27/d88/d99/dc7/fa0 830899 0 2024-09-13T17:06:03.656 INFO:tasks.workunit.client.0.smithi115.stdout:6/813: symlink d8/db/dd/da2/l102 0 2024-09-13T17:06:03.656 INFO:tasks.workunit.client.0.smithi115.stdout:6/814: creat d8/d33/d7f/f103 x:0 0 0 2024-09-13T17:06:03.656 INFO:tasks.workunit.client.0.smithi115.stdout:6/815: readlink d8/d33/d40/d67/db4/l21 0 2024-09-13T17:06:03.657 INFO:tasks.workunit.client.0.smithi115.stdout:7/820: dwrite d0/d2/d1e/de5/f123 [0,4194304] 0 2024-09-13T17:06:03.658 INFO:tasks.workunit.client.0.smithi115.stdout:8/946: rename d0/d18/df6 to d0/d26/d29/d59/d13f 0 2024-09-13T17:06:03.659 INFO:tasks.workunit.client.0.smithi115.stdout:8/947: chown d0/d21/d3a 793074 1 2024-09-13T17:06:03.659 INFO:tasks.workunit.client.0.smithi115.stdout:9/793: dwrite d0/d21/d42/f50 [0,4194304] 0 2024-09-13T17:06:03.660 INFO:tasks.workunit.client.0.smithi115.stdout:0/748: link d9/d27/c77 d9/d27/d88/d8e/dc3/ce9 0 2024-09-13T17:06:03.660 INFO:tasks.workunit.client.0.smithi115.stdout:0/749: chown d9/d27/d88/d99/faa 35172 1 2024-09-13T17:06:03.660 INFO:tasks.workunit.client.0.smithi115.stdout:0/750: chown d9/d1d/d24/d26/d5d 531 1 2024-09-13T17:06:03.661 INFO:tasks.workunit.client.0.smithi115.stdout:0/751: read d9/d1d/d24/d26/d36/fcb [192704,126607] 0 2024-09-13T17:06:03.662 INFO:tasks.workunit.client.0.smithi115.stdout:6/816: link d8/d33/d40/d4c/ff5 d8/d33/d40/d67/db4/dbf/f104 0 2024-09-13T17:06:03.663 INFO:tasks.workunit.client.0.smithi115.stdout:1/835: getdents d5/d7/d33/d3a/dc3/ddd/d10b 0 2024-09-13T17:06:03.667 INFO:tasks.workunit.client.0.smithi115.stdout:6/817: write d8/db/dd/da2/db3/fb5 [555004,14455] 0 2024-09-13T17:06:03.667 INFO:tasks.workunit.client.0.smithi115.stdout:6/818: read d8/f76 [415356,120713] 0 2024-09-13T17:06:03.675 INFO:tasks.workunit.client.0.smithi115.stdout:7/821: mknod d0/d3b/d50/c124 0 2024-09-13T17:06:03.676 INFO:tasks.workunit.client.0.smithi115.stdout:8/948: symlink d0/d26/d29/d59/d7e/da7/d2b/d3b/d11f/d127/l140 0 2024-09-13T17:06:03.680 INFO:tasks.workunit.client.0.smithi115.stdout:0/752: truncate d9/f1f 1037502 0 2024-09-13T17:06:03.680 INFO:tasks.workunit.client.0.smithi115.stdout:6/819: rmdir d8/d33/d40/d67 39 2024-09-13T17:06:03.680 INFO:tasks.workunit.client.0.smithi115.stdout:0/753: write d9/d1d/d24/d26/fd6 [258539,4532] 0 2024-09-13T17:06:03.683 INFO:tasks.workunit.client.0.smithi115.stdout:7/822: symlink d0/d3b/d54/l125 0 2024-09-13T17:06:03.686 INFO:tasks.workunit.client.0.smithi115.stdout:8/949: symlink d0/d42/d80/d94/l141 0 2024-09-13T17:06:03.687 INFO:tasks.workunit.client.0.smithi115.stdout:9/794: getdents d0/de/d37/d83/dc2/ddd/d8d/db1 0 2024-09-13T17:06:03.691 INFO:tasks.workunit.client.0.smithi115.stdout:0/754: creat d9/d1d/d24/d26/d7b/fea x:0 0 0 2024-09-13T17:06:03.692 INFO:tasks.workunit.client.0.smithi115.stdout:8/950: mkdir d0/d21/d3a/d142 0 2024-09-13T17:06:03.694 INFO:tasks.workunit.client.0.smithi115.stdout:1/836: dwrite d5/d3e/ffc [0,4194304] 0 2024-09-13T17:06:03.694 INFO:tasks.workunit.client.0.smithi115.stdout:9/795: mkdir d0/d21/d65/d79/d118 0 2024-09-13T17:06:03.697 INFO:tasks.workunit.client.0.smithi115.stdout:8/951: creat d0/d95/f143 x:0 0 0 2024-09-13T17:06:03.699 INFO:tasks.workunit.client.0.smithi115.stdout:8/952: write d0/d15/f4d [575942,55398] 0 2024-09-13T17:06:03.700 INFO:tasks.workunit.client.0.smithi115.stdout:4/918: dwrite d7/dd/d3c/f6e [0,4194304] 0 2024-09-13T17:06:03.700 INFO:tasks.workunit.client.0.smithi115.stdout:6/820: dwrite d8/db/d49/f4d [0,4194304] 0 2024-09-13T17:06:03.705 INFO:tasks.workunit.client.0.smithi115.stdout:0/755: mknod d9/d1d/de1/d30/d5c/ceb 0 2024-09-13T17:06:03.715 INFO:tasks.workunit.client.0.smithi115.stdout:9/796: rmdir d0/d34 39 2024-09-13T17:06:03.715 INFO:tasks.workunit.client.0.smithi115.stdout:9/797: fdatasync d0/de/d37/d83/dc2/ddd/dee/ff5 0 2024-09-13T17:06:03.715 INFO:tasks.workunit.client.0.smithi115.stdout:9/798: fdatasync d0/dd7/d114/f3e 0 2024-09-13T17:06:03.715 INFO:tasks.workunit.client.0.smithi115.stdout:9/799: truncate d0/de/d37/dc5/f106 155012 0 2024-09-13T17:06:03.717 INFO:tasks.workunit.client.0.smithi115.stdout:0/756: symlink d9/d1d/de1/d78/db6/lec 0 2024-09-13T17:06:03.717 INFO:tasks.workunit.client.0.smithi115.stdout:0/757: chown d9/d27/d88/d99/dc7 1 1 2024-09-13T17:06:03.717 INFO:tasks.workunit.client.0.smithi115.stdout:0/758: truncate d9/d1d/d24/d26/d7b/fea 81477 0 2024-09-13T17:06:03.718 INFO:tasks.workunit.client.0.smithi115.stdout:9/800: creat d0/de/d37/dc5/f119 x:0 0 0 2024-09-13T17:06:03.719 INFO:tasks.workunit.client.0.smithi115.stdout:0/759: creat d9/d1d/de1/d78/de5/fed x:0 0 0 2024-09-13T17:06:03.719 INFO:tasks.workunit.client.0.smithi115.stdout:0/760: chown d9/d1d/d24/d26/d36/d48/dbb/lc5 395 1 2024-09-13T17:06:03.721 INFO:tasks.workunit.client.0.smithi115.stdout:8/953: dwrite d0/d21/d76/d83/f6c [8388608,4194304] 0 2024-09-13T17:06:03.723 INFO:tasks.workunit.client.0.smithi115.stdout:6/821: dwrite d8/db/d1d/f26 [0,4194304] 0 2024-09-13T17:06:03.723 INFO:tasks.workunit.client.0.smithi115.stdout:0/761: getdents d9/d1d/d24/d26 0 2024-09-13T17:06:03.729 INFO:tasks.workunit.client.0.smithi115.stdout:8/954: write d0/d21/d76/dc1/fdc [3523526,82009] 0 2024-09-13T17:06:03.732 INFO:tasks.workunit.client.0.smithi115.stdout:2/953: sync 2024-09-13T17:06:03.734 INFO:tasks.workunit.client.0.smithi115.stdout:2/954: rmdir d3/d108 39 2024-09-13T17:06:03.734 INFO:tasks.workunit.client.0.smithi115.stdout:6/822: dread d8/d33/d40/d67/db4/d24/f29 [0,4194304] 0 2024-09-13T17:06:03.736 INFO:tasks.workunit.client.0.smithi115.stdout:6/823: getdents d8/d33/d40/d67/db4/d24 0 2024-09-13T17:06:03.736 INFO:tasks.workunit.client.0.smithi115.stdout:6/824: write d8/d33/d7f/f103 [382299,38073] 0 2024-09-13T17:06:03.737 INFO:tasks.workunit.client.0.smithi115.stdout:2/955: mkdir d3/d4d/de/d132 0 2024-09-13T17:06:03.737 INFO:tasks.workunit.client.0.smithi115.stdout:2/956: readlink d3/d4d/d13/d1c/l3d 0 2024-09-13T17:06:03.738 INFO:tasks.workunit.client.0.smithi115.stdout:2/957: write d3/d4d/de/d99/d9a/d119/f11c [370149,43402] 0 2024-09-13T17:06:03.738 INFO:tasks.workunit.client.0.smithi115.stdout:2/958: stat d3/d4d/de/f2a 0 2024-09-13T17:06:03.738 INFO:tasks.workunit.client.0.smithi115.stdout:9/801: dwrite d0/d21/d42/f7b [0,4194304] 0 2024-09-13T17:06:03.739 INFO:tasks.workunit.client.0.smithi115.stdout:6/825: rmdir d8/d33/d7f/d99 39 2024-09-13T17:06:03.739 INFO:tasks.workunit.client.0.smithi115.stdout:6/826: chown d8/d33/d40/d67/db4/dc9/fe0 75256214 1 2024-09-13T17:06:03.739 INFO:tasks.workunit.client.0.smithi115.stdout:6/827: fsync d8/db/dd/f16 0 2024-09-13T17:06:03.741 INFO:tasks.workunit.client.0.smithi115.stdout:8/955: dread d0/d42/d80/d94/f124 [0,4194304] 0 2024-09-13T17:06:03.742 INFO:tasks.workunit.client.0.smithi115.stdout:2/959: symlink d3/d4d/d13/d1c/l133 0 2024-09-13T17:06:03.742 INFO:tasks.workunit.client.0.smithi115.stdout:9/802: mknod d0/de/d37/d83/dc2/ddd/d8d/db1/c11a 0 2024-09-13T17:06:03.743 INFO:tasks.workunit.client.0.smithi115.stdout:9/803: readlink d0/de/d37/d83/dc2/ddd/lef 0 2024-09-13T17:06:03.746 INFO:tasks.workunit.client.0.smithi115.stdout:8/956: rename d0/d15/l63 to d0/d18/l144 0 2024-09-13T17:06:03.748 INFO:tasks.workunit.client.0.smithi115.stdout:9/804: unlink d0/de/d37/l47 0 2024-09-13T17:06:03.749 INFO:tasks.workunit.client.0.smithi115.stdout:9/805: creat d0/de/d37/d83/dc2/f11b x:0 0 0 2024-09-13T17:06:03.752 INFO:tasks.workunit.client.0.smithi115.stdout:9/806: truncate d0/dd7/d114/f44 2882843 0 2024-09-13T17:06:03.755 INFO:tasks.workunit.client.0.smithi115.stdout:8/957: dread d0/f13 [0,4194304] 0 2024-09-13T17:06:03.758 INFO:tasks.workunit.client.0.smithi115.stdout:2/960: dwrite d3/d4d/d13/da2/dba/f10e [0,4194304] 0 2024-09-13T17:06:03.760 INFO:tasks.workunit.client.0.smithi115.stdout:9/807: rename d0/dd7/d114/l8e to d0/de/d37/d83/dc2/ddd/d8d/db1/l11c 0 2024-09-13T17:06:03.762 INFO:tasks.workunit.client.0.smithi115.stdout:9/808: dread d0/dd7/d114/f46 [0,4194304] 0 2024-09-13T17:06:03.763 INFO:tasks.workunit.client.0.smithi115.stdout:8/958: mknod d0/d26/d29/d59/d7e/da7/d2b/db1/dda/df8/c145 0 2024-09-13T17:06:03.763 INFO:tasks.workunit.client.0.smithi115.stdout:8/959: fsync d0/d26/d29/d59/d7e/da7/dca/f10a 0 2024-09-13T17:06:03.763 INFO:tasks.workunit.client.0.smithi115.stdout:8/960: chown d0/d21/d3a/d60/df1/cf5 287 1 2024-09-13T17:06:03.766 INFO:tasks.workunit.client.0.smithi115.stdout:2/961: mknod d3/d4d/d13/d62/d92/dd7/d56/d58/de1/c134 0 2024-09-13T17:06:03.766 INFO:tasks.workunit.client.0.smithi115.stdout:2/962: truncate d3/d4d/de/d99/d9a/fb4 4667547 0 2024-09-13T17:06:03.769 INFO:tasks.workunit.client.0.smithi115.stdout:8/961: getdents d0/d18 0 2024-09-13T17:06:03.770 INFO:tasks.workunit.client.0.smithi115.stdout:2/963: mkdir d3/d4d/d13/d1c/d135 0 2024-09-13T17:06:03.770 INFO:tasks.workunit.client.0.smithi115.stdout:9/809: write d0/de/d37/dc5/fb5 [1321358,123588] 0 2024-09-13T17:06:03.771 INFO:tasks.workunit.client.0.smithi115.stdout:9/810: creat d0/de/d37/d83/dc2/ddd/dee/f11d x:0 0 0 2024-09-13T17:06:03.771 INFO:tasks.workunit.client.0.smithi115.stdout:9/811: chown d0/d21/l117 13424 1 2024-09-13T17:06:03.775 INFO:tasks.workunit.client.0.smithi115.stdout:8/962: link d0/d100/d131/l101 d0/d26/d29/d59/d7e/da7/d2b/d37/d126/l146 0 2024-09-13T17:06:03.775 INFO:tasks.workunit.client.0.smithi115.stdout:8/963: creat d0/d15/d44/f147 x:0 0 0 2024-09-13T17:06:03.793 INFO:tasks.workunit.client.0.smithi115.stdout:2/964: dwrite d3/d4d/d13/f45 [0,4194304] 0 2024-09-13T17:06:03.798 INFO:tasks.workunit.client.0.smithi115.stdout:9/812: dwrite d0/de/d37/dc5/f106 [0,4194304] 0 2024-09-13T17:06:03.799 INFO:tasks.workunit.client.0.smithi115.stdout:9/813: write d0/d21/d65/d6f/ff0 [799109,54560] 0 2024-09-13T17:06:03.799 INFO:tasks.workunit.client.0.smithi115.stdout:9/814: read d0/de/d37/d83/dc2/ddd/f75 [1101159,109914] 0 2024-09-13T17:06:03.799 INFO:tasks.workunit.client.0.smithi115.stdout:9/815: fdatasync d0/f31 0 2024-09-13T17:06:03.801 INFO:tasks.workunit.client.0.smithi115.stdout:8/964: dwrite d0/d15/f1b [4194304,4194304] 0 2024-09-13T17:06:03.802 INFO:tasks.workunit.client.0.smithi115.stdout:2/965: dread d3/d4d/dd/df/d5b/f10a [0,4194304] 0 2024-09-13T17:06:03.802 INFO:tasks.workunit.client.0.smithi115.stdout:2/966: dread - d3/d4d/d13/d62/d92/ffd zero size 2024-09-13T17:06:03.802 INFO:tasks.workunit.client.0.smithi115.stdout:8/965: dread d0/d26/d29/d59/d7e/da7/d2b/d3b/d11f/dbd/ff4 [0,4194304] 0 2024-09-13T17:06:03.808 INFO:tasks.workunit.client.0.smithi115.stdout:9/816: read d0/d21/d65/d79/fd9 [3957594,29369] 0 2024-09-13T17:06:03.816 INFO:tasks.workunit.client.0.smithi115.stdout:8/966: dwrite d0/d21/f118 [0,4194304] 0 2024-09-13T17:06:03.816 INFO:tasks.workunit.client.0.smithi115.stdout:8/967: creat d0/d15/d3e/f148 x:0 0 0 2024-09-13T17:06:03.875 INFO:tasks.workunit.client.0.smithi115.stdout:2/967: mkdir d3/d4d/d13/d62/d92/d136 0 2024-09-13T17:06:03.876 INFO:tasks.workunit.client.0.smithi115.stdout:9/817: truncate d0/dd7/d114/d15/f3a 1015703 0 2024-09-13T17:06:03.876 INFO:tasks.workunit.client.0.smithi115.stdout:9/818: fdatasync d0/d9c/f9f 0 2024-09-13T17:06:03.876 INFO:tasks.workunit.client.0.smithi115.stdout:9/819: stat d0/d21/d65/d6f/f8a 0 2024-09-13T17:06:03.885 INFO:tasks.workunit.client.0.smithi115.stdout:8/968: creat d0/d21/d3a/da3/f149 x:0 0 0 2024-09-13T17:06:03.900 INFO:tasks.workunit.client.0.smithi115.stdout:2/968: unlink d3/d4d/de/d3a/d47/c64 0 2024-09-13T17:06:03.903 INFO:tasks.workunit.client.0.smithi115.stdout:9/820: creat d0/de/d37/f11e x:0 0 0 2024-09-13T17:06:03.904 INFO:tasks.workunit.client.0.smithi115.stdout:9/821: dread - d0/de/d37/d83/dc2/ddd/d8d/f10e zero size 2024-09-13T17:06:03.905 INFO:tasks.workunit.client.0.smithi115.stdout:9/822: mknod d0/de4/c11f 0 2024-09-13T17:06:03.909 INFO:tasks.workunit.client.0.smithi115.stdout:8/969: dwrite d0/f53 [0,4194304] 0 2024-09-13T17:06:03.913 INFO:tasks.workunit.client.0.smithi115.stdout:8/970: truncate d0/d21/f96 7287446 0 2024-09-13T17:06:03.913 INFO:tasks.workunit.client.0.smithi115.stdout:8/971: dread - d0/d21/d76/d83/f114 zero size 2024-09-13T17:06:03.915 INFO:tasks.workunit.client.0.smithi115.stdout:9/823: write d0/d9c/f9f [994773,25144] 0 2024-09-13T17:06:03.916 INFO:tasks.workunit.client.0.smithi115.stdout:9/824: chown d0/d21/d4f/c54 88539332 1 2024-09-13T17:06:03.916 INFO:tasks.workunit.client.0.smithi115.stdout:9/825: chown d0/d21/d65/f9e 21118 1 2024-09-13T17:06:03.916 INFO:tasks.workunit.client.0.smithi115.stdout:9/826: readlink d0/de/d37/l9a 0 2024-09-13T17:06:03.916 INFO:tasks.workunit.client.0.smithi115.stdout:8/972: mkdir d0/d95/dce/d14a 0 2024-09-13T17:06:03.916 INFO:tasks.workunit.client.0.smithi115.stdout:8/973: write d0/d26/d29/f86 [979025,105919] 0 2024-09-13T17:06:03.918 INFO:tasks.workunit.client.0.smithi115.stdout:2/969: dwrite d3/d4d/de/d3a/d47/d104/f11e [0,4194304] 0 2024-09-13T17:06:03.920 INFO:tasks.workunit.client.0.smithi115.stdout:9/827: rmdir d0/de/d37/d83/d91 39 2024-09-13T17:06:03.921 INFO:tasks.workunit.client.0.smithi115.stdout:8/974: mkdir d0/d26/d29/d59/d7e/da7/d2b/d14b 0 2024-09-13T17:06:03.925 INFO:tasks.workunit.client.0.smithi115.stdout:2/970: symlink d3/d4d/de/d99/d9a/df1/dfa/d87/l137 0 2024-09-13T17:06:03.926 INFO:tasks.workunit.client.0.smithi115.stdout:9/828: unlink d0/de/d37/d83/c110 0 2024-09-13T17:06:03.927 INFO:tasks.workunit.client.0.smithi115.stdout:8/975: mkdir d0/d42/d121/d14c 0 2024-09-13T17:06:03.928 INFO:tasks.workunit.client.0.smithi115.stdout:2/971: rmdir d3/d4d/d13/d62 39 2024-09-13T17:06:03.928 INFO:tasks.workunit.client.0.smithi115.stdout:2/972: chown d3/d4d/de/f10d 398193966 1 2024-09-13T17:06:03.928 INFO:tasks.workunit.client.0.smithi115.stdout:2/973: dread - d3/d4d/de/d99/d9a/fb0 zero size 2024-09-13T17:06:03.928 INFO:tasks.workunit.client.0.smithi115.stdout:2/974: write d3/f4 [2214733,39111] 0 2024-09-13T17:06:03.932 INFO:tasks.workunit.client.0.smithi115.stdout:9/829: symlink d0/d21/d65/d6f/dad/ded/l120 0 2024-09-13T17:06:03.932 INFO:tasks.workunit.client.0.smithi115.stdout:9/830: chown d0/c5 218906 1 2024-09-13T17:06:03.935 INFO:tasks.workunit.client.0.smithi115.stdout:9/831: symlink d0/de/d37/d105/l121 0 2024-09-13T17:06:03.935 INFO:tasks.workunit.client.0.smithi115.stdout:9/832: chown d0/d34/l5b 32323106 1 2024-09-13T17:06:03.936 INFO:tasks.workunit.client.0.smithi115.stdout:9/833: truncate d0/d21/d4f/f72 1362057 0 2024-09-13T17:06:03.936 INFO:tasks.workunit.client.0.smithi115.stdout:9/834: chown d0/d21/d42 118879341 1 2024-09-13T17:06:03.943 INFO:tasks.workunit.client.0.smithi115.stdout:8/976: rename d0/d21 to d0/d95/dce/d14d 0 2024-09-13T17:06:03.943 INFO:tasks.workunit.client.0.smithi115.stdout:9/835: mknod d0/de/d37/d83/dc2/ddd/d8d/db1/c122 0 2024-09-13T17:06:03.944 INFO:tasks.workunit.client.0.smithi115.stdout:9/836: creat d0/d21/d42/f123 x:0 0 0 2024-09-13T17:06:03.944 INFO:tasks.workunit.client.0.smithi115.stdout:9/837: fdatasync d0/d21/f58 0 2024-09-13T17:06:03.945 INFO:tasks.workunit.client.0.smithi115.stdout:2/975: dwrite d3/d4d/d13/d62/d92/dd7/d56/f34 [0,4194304] 0 2024-09-13T17:06:03.945 INFO:tasks.workunit.client.0.smithi115.stdout:2/976: fdatasync d3/d4d/de/d99/d9a/df1/dfa/d46/da0/fe5 0 2024-09-13T17:06:03.945 INFO:tasks.workunit.client.0.smithi115.stdout:2/977: truncate d3/d4d/de/d98/fd0 622139 0 2024-09-13T17:06:03.948 INFO:tasks.workunit.client.0.smithi115.stdout:9/838: getdents d0/d21/d65/d6f/dad/ded 0 2024-09-13T17:06:03.948 INFO:tasks.workunit.client.0.smithi115.stdout:9/839: stat d0/de/d37/d83/dc2/ddd/d8d/db1/dfa/d10d 0 2024-09-13T17:06:03.950 INFO:tasks.workunit.client.0.smithi115.stdout:9/840: mkdir d0/de/d37/d83/dc2/d124 0 2024-09-13T17:06:03.950 INFO:tasks.workunit.client.0.smithi115.stdout:9/841: readlink d0/d21/le7 0 2024-09-13T17:06:03.952 INFO:tasks.workunit.client.0.smithi115.stdout:8/977: write d0/d42/f6f [2260519,72976] 0 2024-09-13T17:06:03.952 INFO:tasks.workunit.client.0.smithi115.stdout:8/978: truncate d0/d18/ff9 553579 0 2024-09-13T17:06:03.968 INFO:tasks.workunit.client.0.smithi115.stdout:9/842: dwrite d0/d21/d65/d79/f10a [0,4194304] 0 2024-09-13T17:06:03.968 INFO:tasks.workunit.client.0.smithi115.stdout:9/843: chown d0/d21/d4f/fab 5 1 2024-09-13T17:06:03.968 INFO:tasks.workunit.client.0.smithi115.stdout:9/844: stat d0/d9c/f109 0 2024-09-13T17:06:03.970 INFO:tasks.workunit.client.0.smithi115.stdout:9/845: truncate d0/dd7/d114/faa 2732683 0 2024-09-13T17:06:03.970 INFO:tasks.workunit.client.0.smithi115.stdout:9/846: dread - d0/d21/d65/d6f/fa7 zero size 2024-09-13T17:06:03.970 INFO:tasks.workunit.client.0.smithi115.stdout:2/978: dwrite d3/d4d/de/d3a/d47/f49 [0,4194304] 0 2024-09-13T17:06:03.978 INFO:tasks.workunit.client.0.smithi115.stdout:2/979: dread d3/d4d/de/ff4 [0,4194304] 0 2024-09-13T17:06:03.979 INFO:tasks.workunit.client.0.smithi115.stdout:2/980: rmdir d3/d4d/d13/d62/d92/dd7 39 2024-09-13T17:06:03.979 INFO:tasks.workunit.client.0.smithi115.stdout:2/981: chown d3/d4d/de/d3a/d47/f8d 2 1 2024-09-13T17:06:03.980 INFO:tasks.workunit.client.0.smithi115.stdout:2/982: rename d3/d4d/de/c6f to d3/d4d/de/d99/d9a/c138 0 2024-09-13T17:06:03.991 INFO:tasks.workunit.client.0.smithi115.stdout:7/823: sync 2024-09-13T17:06:03.991 INFO:tasks.workunit.client.0.smithi115.stdout:5/918: sync 2024-09-13T17:06:03.991 INFO:tasks.workunit.client.0.smithi115.stdout:5/919: write d19/d2e/dc6/f123 [234811,63301] 0 2024-09-13T17:06:03.993 INFO:tasks.workunit.client.0.smithi115.stdout:7/824: mknod d0/d2/d67/d86/d94/d9b/dbb/d104/c126 0 2024-09-13T17:06:03.995 INFO:tasks.workunit.client.0.smithi115.stdout:2/983: dwrite d3/d4d/d13/da2/fe3 [0,4194304] 0 2024-09-13T17:06:03.999 INFO:tasks.workunit.client.0.smithi115.stdout:7/825: mkdir d0/d59/d11c/df1/d127 0 2024-09-13T17:06:03.999 INFO:tasks.workunit.client.0.smithi115.stdout:7/826: chown d0/d3b/d50/d21/d2f/la1 657 1 2024-09-13T17:06:03.999 INFO:tasks.workunit.client.0.smithi115.stdout:7/827: read - d0/d2/d1e/dd8/f102 zero size 2024-09-13T17:06:04.003 INFO:tasks.workunit.client.0.smithi115.stdout:7/828: truncate d0/d59/fb8 3441042 0 2024-09-13T17:06:04.003 INFO:tasks.workunit.client.0.smithi115.stdout:7/829: write d0/d2/d1e/d3d/d7c/f113 [208209,7620] 0 2024-09-13T17:06:04.006 INFO:tasks.workunit.client.0.smithi115.stdout:5/920: dwrite d19/d1d/f124 [0,4194304] 0 2024-09-13T17:06:04.011 INFO:tasks.workunit.client.0.smithi115.stdout:5/921: rename d19/d2b/d32/d55/cf1 to d19/d2b/d32/d55/d5e/d87/db0/dde/c134 0 2024-09-13T17:06:04.015 INFO:tasks.workunit.client.0.smithi115.stdout:5/922: getdents d19/d2b/d32/d55 0 2024-09-13T17:06:04.018 INFO:tasks.workunit.client.0.smithi115.stdout:5/923: mkdir d19/d21/d3a/d5d/d135 0 2024-09-13T17:06:04.018 INFO:tasks.workunit.client.0.smithi115.stdout:5/924: stat d19/d2b/d69 0 2024-09-13T17:06:04.020 INFO:tasks.workunit.client.0.smithi115.stdout:5/925: rename d19/d2b/d32/f8b to d19/d2b/d69/d8f/dda/f136 0 2024-09-13T17:06:04.021 INFO:tasks.workunit.client.0.smithi115.stdout:5/926: getdents d19/d2c/dd0/d63 0 2024-09-13T17:06:04.023 INFO:tasks.workunit.client.0.smithi115.stdout:5/927: creat d19/d2b/f137 x:0 0 0 2024-09-13T17:06:04.023 INFO:tasks.workunit.client.0.smithi115.stdout:5/928: readlink d19/d21/d3a/le9 0 2024-09-13T17:06:04.031 INFO:tasks.workunit.client.0.smithi115.stdout:5/929: write d19/d1d/f124 [3969543,68362] 0 2024-09-13T17:06:04.031 INFO:tasks.workunit.client.0.smithi115.stdout:5/930: chown d19/d2b/d32/caa 589 1 2024-09-13T17:06:04.038 INFO:tasks.workunit.client.0.smithi115.stdout:5/931: dread f5 [0,4194304] 0 2024-09-13T17:06:04.039 INFO:tasks.workunit.client.0.smithi115.stdout:5/932: rename d19/d2b/d32/d55/d5e/d87/d86/de8/dea/f120 to d19/d2b/d77/f138 0 2024-09-13T17:06:04.041 INFO:tasks.workunit.client.0.smithi115.stdout:5/933: rename d19/d2c/dd0/d63/l122 to d19/d2e/l139 0 2024-09-13T17:06:04.053 INFO:tasks.workunit.client.0.smithi115.stdout:5/934: dwrite d19/d21/dcc/f105 [0,4194304] 0 2024-09-13T17:06:04.057 INFO:tasks.workunit.client.0.smithi115.stdout:5/935: rename cf to d19/d2b/d32/d55/d5e/d87/d86/de8/c13a 0 2024-09-13T17:06:04.061 INFO:tasks.workunit.client.0.smithi115.stdout:5/936: link d19/d2b/d32/d55/d5e/d87/da4/da6/c12d d19/d21/c13b 0 2024-09-13T17:06:04.061 INFO:tasks.workunit.client.0.smithi115.stdout:5/937: fsync d19/d75/dcd/fdc 0 2024-09-13T17:06:04.064 INFO:tasks.workunit.client.0.smithi115.stdout:5/938: unlink d19/d21/d3a/le9 0 2024-09-13T17:06:04.269 INFO:tasks.workunit.client.0.smithi115.stdout:4/919: sync 2024-09-13T17:06:04.269 INFO:tasks.workunit.client.0.smithi115.stdout:1/837: sync 2024-09-13T17:06:04.269 INFO:tasks.workunit.client.0.smithi115.stdout:1/838: fdatasync d5/d7/d33/d3a/f112 0 2024-09-13T17:06:04.270 INFO:tasks.workunit.client.0.smithi115.stdout:4/920: truncate d7/dd/d3c/f107 793909 0 2024-09-13T17:06:04.270 INFO:tasks.workunit.client.0.smithi115.stdout:4/921: truncate d7/dd/de/d4e/d5a/d4f/d53/fcf 173256 0 2024-09-13T17:06:04.271 INFO:tasks.workunit.client.0.smithi115.stdout:1/839: rename d5/d7/d33/d3a/f57 to d5/d3e/dc8/f126 0 2024-09-13T17:06:04.271 INFO:tasks.workunit.client.0.smithi115.stdout:1/840: chown d5/d60/dbf 19707753 1 2024-09-13T17:06:04.272 INFO:tasks.workunit.client.0.smithi115.stdout:4/922: write d7/dd/de/f5e [470743,10815] 0 2024-09-13T17:06:04.273 INFO:tasks.workunit.client.0.smithi115.stdout:1/841: mknod d5/d7/d86/dec/c127 0 2024-09-13T17:06:04.274 INFO:tasks.workunit.client.0.smithi115.stdout:1/842: truncate d5/d26/f35 4910598 0 2024-09-13T17:06:04.275 INFO:tasks.workunit.client.0.smithi115.stdout:4/923: rename d7/dd/de/d4e/d5a/l7d to d7/dd/de/d4e/d5a/d4f/d70/l121 0 2024-09-13T17:06:04.277 INFO:tasks.workunit.client.0.smithi115.stdout:1/843: mkdir d5/d7/d33/d3a/dc3/ddd/df4/d102/d128 0 2024-09-13T17:06:04.280 INFO:tasks.workunit.client.0.smithi115.stdout:4/924: unlink d7/d86/c105 0 2024-09-13T17:06:04.280 INFO:tasks.workunit.client.0.smithi115.stdout:4/925: creat d7/dd/de/d4e/dae/f122 x:0 0 0 2024-09-13T17:06:04.280 INFO:tasks.workunit.client.0.smithi115.stdout:4/926: truncate d7/dd/de/d4e/d5a/d4f/f8d 1817826 0 2024-09-13T17:06:04.290 INFO:tasks.workunit.client.0.smithi115.stdout:1/844: read d5/d26/f29 [3576062,22222] 0 2024-09-13T17:06:04.292 INFO:tasks.workunit.client.0.smithi115.stdout:4/927: dwrite d7/dd/d3c/f58 [4194304,4194304] 0 2024-09-13T17:06:04.296 INFO:tasks.workunit.client.0.smithi115.stdout:4/928: symlink d7/dd/de/d4e/d5a/d4f/d53/l123 0 2024-09-13T17:06:04.297 INFO:tasks.workunit.client.0.smithi115.stdout:4/929: creat d7/dd/de/d4e/d5a/d4f/d9c/f124 x:0 0 0 2024-09-13T17:06:04.298 INFO:tasks.workunit.client.0.smithi115.stdout:4/930: read d7/dd/de/f3a [1819830,26274] 0 2024-09-13T17:06:04.299 INFO:tasks.workunit.client.0.smithi115.stdout:4/931: chown d7/dd/de/d4e/d5a/c9d 8 1 2024-09-13T17:06:04.301 INFO:tasks.workunit.client.0.smithi115.stdout:4/932: mkdir d7/d86/d125 0 2024-09-13T17:06:04.301 INFO:tasks.workunit.client.0.smithi115.stdout:4/933: stat d7/dd/de/d4e/d5a/d4f 0 2024-09-13T17:06:04.302 INFO:tasks.workunit.client.0.smithi115.stdout:1/845: dwrite d5/d3e/dc8/f126 [0,4194304] 0 2024-09-13T17:06:04.306 INFO:tasks.workunit.client.0.smithi115.stdout:1/846: link d5/c24 d5/d26/d2c/d89/c129 0 2024-09-13T17:06:04.310 INFO:tasks.workunit.client.0.smithi115.stdout:1/847: rename d5/d7/f9f to d5/d60/d7d/f12a 0 2024-09-13T17:06:04.310 INFO:tasks.workunit.client.0.smithi115.stdout:1/848: chown d5/d60/fe0 55447 1 2024-09-13T17:06:04.310 INFO:tasks.workunit.client.0.smithi115.stdout:1/849: creat d5/d3e/d59/f12b x:0 0 0 2024-09-13T17:06:04.311 INFO:tasks.workunit.client.0.smithi115.stdout:4/934: dread d7/dd/f83 [0,4194304] 0 2024-09-13T17:06:04.311 INFO:tasks.workunit.client.0.smithi115.stdout:1/850: getdents d5/d7/d5c 0 2024-09-13T17:06:04.313 INFO:tasks.workunit.client.0.smithi115.stdout:1/851: dread d5/d7/d33/d3a/db2/fc5 [0,4194304] 0 2024-09-13T17:06:04.317 INFO:tasks.workunit.client.0.smithi115.stdout:4/935: mknod d7/dbe/c126 0 2024-09-13T17:06:04.317 INFO:tasks.workunit.client.0.smithi115.stdout:1/852: mkdir d5/d3e/dc8/d11f/d12c 0 2024-09-13T17:06:04.317 INFO:tasks.workunit.client.0.smithi115.stdout:1/853: readlink d5/d3e/d59/l97 0 2024-09-13T17:06:04.317 INFO:tasks.workunit.client.0.smithi115.stdout:1/854: write d5/d26/dc9/dea/fbb [911268,94669] 0 2024-09-13T17:06:04.317 INFO:tasks.workunit.client.0.smithi115.stdout:1/855: creat d5/d7/d33/d3a/db2/f12d x:0 0 0 2024-09-13T17:06:04.317 INFO:tasks.workunit.client.0.smithi115.stdout:4/936: truncate d7/f36 2131217 0 2024-09-13T17:06:04.321 INFO:tasks.workunit.client.0.smithi115.stdout:1/856: rename d5/d26/dc9/dea/fb8 to d5/d26/d2c/d89/dff/f12e 0 2024-09-13T17:06:04.321 INFO:tasks.workunit.client.0.smithi115.stdout:1/857: chown d5/d60/d7d/f12a 556 1 2024-09-13T17:06:04.324 INFO:tasks.workunit.client.0.smithi115.stdout:1/858: rename d5/d7/d5c/dc6 to d5/d26/d2c/d12f 0 2024-09-13T17:06:04.324 INFO:tasks.workunit.client.0.smithi115.stdout:1/859: fsync d5/d60/fe1 0 2024-09-13T17:06:04.337 INFO:tasks.workunit.client.0.smithi115.stdout:4/937: dwrite d7/dd/d3c/d74/d8b/fe5 [0,4194304] 0 2024-09-13T17:06:04.340 INFO:tasks.workunit.client.0.smithi115.stdout:1/860: dwrite d5/d60/f104 [0,4194304] 0 2024-09-13T17:06:04.343 INFO:tasks.workunit.client.0.smithi115.stdout:4/938: creat d7/dd/d3c/f127 x:0 0 0 2024-09-13T17:06:04.344 INFO:tasks.workunit.client.0.smithi115.stdout:4/939: truncate d7/dd/da0/f106 408982 0 2024-09-13T17:06:04.349 INFO:tasks.workunit.client.0.smithi115.stdout:1/861: creat d5/d7/d33/d3a/dc3/dfd/f130 x:0 0 0 2024-09-13T17:06:04.351 INFO:tasks.workunit.client.0.smithi115.stdout:4/940: mkdir d7/dd/de/d4e/d9f/dd4/d128 0 2024-09-13T17:06:04.351 INFO:tasks.workunit.client.0.smithi115.stdout:1/862: write d5/f6 [113890,130429] 0 2024-09-13T17:06:04.352 INFO:tasks.workunit.client.0.smithi115.stdout:4/941: fdatasync d7/dd/de/f5e 0 2024-09-13T17:06:04.355 INFO:tasks.workunit.client.0.smithi115.stdout:0/762: sync 2024-09-13T17:06:04.355 INFO:tasks.workunit.client.0.smithi115.stdout:6/828: sync 2024-09-13T17:06:04.355 INFO:tasks.workunit.client.0.smithi115.stdout:8/979: sync 2024-09-13T17:06:04.355 INFO:tasks.workunit.client.0.smithi115.stdout:8/980: truncate d0/d18/fb9 1435069 0 2024-09-13T17:06:04.356 INFO:tasks.workunit.client.0.smithi115.stdout:6/829: readlink d8/d33/d40/d67/db4/d24/d53/d6a/lee 0 2024-09-13T17:06:04.356 INFO:tasks.workunit.client.0.smithi115.stdout:5/939: sync 2024-09-13T17:06:04.357 INFO:tasks.workunit.client.0.smithi115.stdout:7/830: sync 2024-09-13T17:06:04.357 INFO:tasks.workunit.client.0.smithi115.stdout:9/847: sync 2024-09-13T17:06:04.357 INFO:tasks.workunit.client.0.smithi115.stdout:9/848: truncate d0/dd7/d114/f71 2004589 0 2024-09-13T17:06:04.357 INFO:tasks.workunit.client.0.smithi115.stdout:9/849: truncate d0/d21/d42/f81 874701 0 2024-09-13T17:06:04.357 INFO:tasks.workunit.client.0.smithi115.stdout:9/850: creat d0/de/d37/f125 x:0 0 0 2024-09-13T17:06:04.357 INFO:tasks.workunit.client.0.smithi115.stdout:2/984: sync 2024-09-13T17:06:04.357 INFO:tasks.workunit.client.0.smithi115.stdout:2/985: dread - d3/d4d/de/d99/d9a/df1/dfa/d46/da0/ff5 zero size 2024-09-13T17:06:04.357 INFO:tasks.workunit.client.0.smithi115.stdout:5/940: dread d19/d2b/d32/d55/d5e/d87/d86/de8/f113 [0,4194304] 0 2024-09-13T17:06:04.359 INFO:tasks.workunit.client.0.smithi115.stdout:0/763: link d9/d1d/de1/d30/f9f d9/d1d/de1/d30/dc2/fee 0 2024-09-13T17:06:04.359 INFO:tasks.workunit.client.0.smithi115.stdout:8/981: rmdir d0/d42/d80/d94 39 2024-09-13T17:06:04.362 INFO:tasks.workunit.client.0.smithi115.stdout:6/830: creat d8/d33/d7f/d99/f105 x:0 0 0 2024-09-13T17:06:04.362 INFO:tasks.workunit.client.0.smithi115.stdout:6/831: write d8/db/ff6 [2484975,41630] 0 2024-09-13T17:06:04.363 INFO:tasks.workunit.client.0.smithi115.stdout:7/831: creat d0/d2/d67/d70/f128 x:0 0 0 2024-09-13T17:06:04.365 INFO:tasks.workunit.client.0.smithi115.stdout:9/851: creat d0/d21/d65/d6f/dad/f126 x:0 0 0 2024-09-13T17:06:04.365 INFO:tasks.workunit.client.0.smithi115.stdout:9/852: truncate d0/d21/d42/f50 4762031 0 2024-09-13T17:06:04.366 INFO:tasks.workunit.client.0.smithi115.stdout:7/832: dread d0/d2/d67/f80 [0,4194304] 0 2024-09-13T17:06:04.367 INFO:tasks.workunit.client.0.smithi115.stdout:2/986: creat d3/d4d/dd/df/d5c/d12a/f139 x:0 0 0 2024-09-13T17:06:04.368 INFO:tasks.workunit.client.0.smithi115.stdout:5/941: link d19/d2b/d32/caa d19/d2b/d32/d55/d5e/d87/d86/c13c 0 2024-09-13T17:06:04.368 INFO:tasks.workunit.client.0.smithi115.stdout:5/942: truncate d19/d2b/d77/f12c 963445 0 2024-09-13T17:06:04.371 INFO:tasks.workunit.client.0.smithi115.stdout:7/833: dread d0/d2/d1e/dd8/f11b [0,4194304] 0 2024-09-13T17:06:04.371 INFO:tasks.workunit.client.0.smithi115.stdout:0/764: creat d9/d27/d88/d8e/fef x:0 0 0 2024-09-13T17:06:04.371 INFO:tasks.workunit.client.0.smithi115.stdout:0/765: fsync d9/d1d/d24/d26/d7b/fea 0 2024-09-13T17:06:04.371 INFO:tasks.workunit.client.0.smithi115.stdout:0/766: fsync d9/d1d/de1/d30/f6d 0 2024-09-13T17:06:04.372 INFO:tasks.workunit.client.0.smithi115.stdout:8/982: symlink d0/d26/d29/d59/d7e/da7/d2b/db1/dda/l14e 0 2024-09-13T17:06:04.372 INFO:tasks.workunit.client.0.smithi115.stdout:7/834: dread d0/d2/d1e/d3d/d6c/d71/feb [0,4194304] 0 2024-09-13T17:06:04.373 INFO:tasks.workunit.client.0.smithi115.stdout:6/832: creat d8/d33/d82/db0/f106 x:0 0 0 2024-09-13T17:06:04.374 INFO:tasks.workunit.client.0.smithi115.stdout:9/853: link d0/d21/d65/d6f/dad/ded/f102 d0/de/da6/f127 0 2024-09-13T17:06:04.375 INFO:tasks.workunit.client.0.smithi115.stdout:9/854: dread - d0/d21/d42/f7e zero size 2024-09-13T17:06:04.376 INFO:tasks.workunit.client.0.smithi115.stdout:5/943: mknod d19/d1d/d101/c13d 0 2024-09-13T17:06:04.376 INFO:tasks.workunit.client.0.smithi115.stdout:1/863: dwrite d5/d7/d5c/faa [0,4194304] 0 2024-09-13T17:06:04.376 INFO:tasks.workunit.client.0.smithi115.stdout:4/942: dwrite d7/dd/d3c/d74/fa6 [0,4194304] 0 2024-09-13T17:06:04.376 INFO:tasks.workunit.client.0.smithi115.stdout:4/943: readlink d7/dd/de/d4e/d6c/d77/l78 0 2024-09-13T17:06:04.378 INFO:tasks.workunit.client.0.smithi115.stdout:0/767: rename d9/d1d/de1/d30/d46/c4f to d9/d27/d88/d99/dc7/cf0 0 2024-09-13T17:06:04.379 INFO:tasks.workunit.client.0.smithi115.stdout:8/983: truncate d0/d95/dce/d14d/d76/d83/f6c 7414026 0 2024-09-13T17:06:04.380 INFO:tasks.workunit.client.0.smithi115.stdout:7/835: creat d0/d2/d67/d86/d94/d9b/f129 x:0 0 0 2024-09-13T17:06:04.381 INFO:tasks.workunit.client.0.smithi115.stdout:2/987: dread d3/d4d/de/f59 [0,4194304] 0 2024-09-13T17:06:04.381 INFO:tasks.workunit.client.0.smithi115.stdout:2/988: write d3/f8f [1674313,82464] 0 2024-09-13T17:06:04.382 INFO:tasks.workunit.client.0.smithi115.stdout:7/836: read d0/d3b/d50/d21/d99/db3/d117/d44/f6e [707326,2426] 0 2024-09-13T17:06:04.383 INFO:tasks.workunit.client.0.smithi115.stdout:9/855: mkdir d0/de/d37/d83/d128 0 2024-09-13T17:06:04.383 INFO:tasks.workunit.client.0.smithi115.stdout:6/833: dread d8/db/d1d/f2b [0,4194304] 0 2024-09-13T17:06:04.387 INFO:tasks.workunit.client.0.smithi115.stdout:1/864: mkdir d5/d131 0 2024-09-13T17:06:04.387 INFO:tasks.workunit.client.0.smithi115.stdout:1/865: chown d5/d26/d2c/l30 772 1 2024-09-13T17:06:04.388 INFO:tasks.workunit.client.0.smithi115.stdout:4/944: getdents d7/dd/de/d4e/d5a/d4f/d70/db6 0 2024-09-13T17:06:04.391 INFO:tasks.workunit.client.0.smithi115.stdout:7/837: dread d0/d3b/d50/d21/d99/db3/d117/d44/f4f [0,4194304] 0 2024-09-13T17:06:04.392 INFO:tasks.workunit.client.0.smithi115.stdout:0/768: mkdir d9/d1d/de1/d78/df1 0 2024-09-13T17:06:04.393 INFO:tasks.workunit.client.0.smithi115.stdout:9/856: dread d0/d21/d65/d6f/fb0 [0,4194304] 0 2024-09-13T17:06:04.393 INFO:tasks.workunit.client.0.smithi115.stdout:8/984: unlink d0/d26/d29/d59/d7e/da7/d28/d71/f8f 0 2024-09-13T17:06:04.395 INFO:tasks.workunit.client.0.smithi115.stdout:2/989: truncate d3/d4d/dd/df/d5b/fd3 3092226 0 2024-09-13T17:06:04.396 INFO:tasks.workunit.client.0.smithi115.stdout:5/944: dwrite d19/d21/fb1 [0,4194304] 0 2024-09-13T17:06:04.397 INFO:tasks.workunit.client.0.smithi115.stdout:5/945: truncate d19/d21/f80 1909169 0 2024-09-13T17:06:04.397 INFO:tasks.workunit.client.0.smithi115.stdout:6/834: creat d8/d13/f107 x:0 0 0 2024-09-13T17:06:04.397 INFO:tasks.workunit.client.0.smithi115.stdout:6/835: truncate d8/d33/d40/d67/db4/d24/d53/d6a/fc2 595288 0 2024-09-13T17:06:04.401 INFO:tasks.workunit.client.0.smithi115.stdout:4/945: mknod d7/dd/de/d4e/d6c/db0/deb/c129 0 2024-09-13T17:06:04.406 INFO:tasks.workunit.client.0.smithi115.stdout:0/769: rename d9/d27/d88/d8e/lde to d9/d1d/d24/d26/d2c/lf2 0 2024-09-13T17:06:04.408 INFO:tasks.workunit.client.0.smithi115.stdout:6/836: creat d8/d33/d40/d4c/d66/df8/f108 x:0 0 0 2024-09-13T17:06:04.409 INFO:tasks.workunit.client.0.smithi115.stdout:1/866: rmdir d5/d60/d7d/d87 39 2024-09-13T17:06:04.409 INFO:tasks.workunit.client.0.smithi115.stdout:1/867: write d5/d60/d7d/f121 [875998,43277] 0 2024-09-13T17:06:04.409 INFO:tasks.workunit.client.0.smithi115.stdout:1/868: chown d5/d7/fc0 0 1 2024-09-13T17:06:04.409 INFO:tasks.workunit.client.0.smithi115.stdout:8/985: read d0/d15/d44/f52 [3007827,10921] 0 2024-09-13T17:06:04.411 INFO:tasks.workunit.client.0.smithi115.stdout:2/990: rename d3/d4d/de/l11d to d3/d4d/d13/l13a 0 2024-09-13T17:06:04.411 INFO:tasks.workunit.client.0.smithi115.stdout:2/991: chown d3/d4d/d13/d62/d92/dd7/d7d/dc2/l103 36 1 2024-09-13T17:06:04.411 INFO:tasks.workunit.client.0.smithi115.stdout:0/770: dread d9/d1d/d24/d26/d36/d48/fb7 [0,4194304] 0 2024-09-13T17:06:04.413 INFO:tasks.workunit.client.0.smithi115.stdout:6/837: link d8/d33/d40/d67/db4/f4f d8/d33/d40/d67/db4/f109 0 2024-09-13T17:06:04.413 INFO:tasks.workunit.client.0.smithi115.stdout:6/838: read - d8/d13/d7b/ff2 zero size 2024-09-13T17:06:04.416 INFO:tasks.workunit.client.0.smithi115.stdout:9/857: dwrite d0/de/d37/d83/dc2/ddd/dee/ff5 [0,4194304] 0 2024-09-13T17:06:04.416 INFO:tasks.workunit.client.0.smithi115.stdout:1/869: truncate d5/d7/d33/d3a/db2/de2/feb 3465700 0 2024-09-13T17:06:04.416 INFO:tasks.workunit.client.0.smithi115.stdout:4/946: dread d7/f31 [4194304,4194304] 0 2024-09-13T17:06:04.417 INFO:tasks.workunit.client.0.smithi115.stdout:8/986: rmdir d0/d95/dce/d14d/d76/dc1 39 2024-09-13T17:06:04.417 INFO:tasks.workunit.client.0.smithi115.stdout:5/946: dwrite d19/dac/fc1 [0,4194304] 0 2024-09-13T17:06:04.419 INFO:tasks.workunit.client.0.smithi115.stdout:6/839: rmdir d8/d33/d40/d67 39 2024-09-13T17:06:04.419 INFO:tasks.workunit.client.0.smithi115.stdout:6/840: truncate d8/d33/d82/fec 363323 0 2024-09-13T17:06:04.421 INFO:tasks.workunit.client.0.smithi115.stdout:2/992: dread d3/f18 [0,4194304] 0 2024-09-13T17:06:04.421 INFO:tasks.workunit.client.0.smithi115.stdout:2/993: chown d3/d4d/d13/da2/dba/d116/df6/c101 4435 1 2024-09-13T17:06:04.425 INFO:tasks.workunit.client.0.smithi115.stdout:9/858: creat d0/dd7/d114/f129 x:0 0 0 2024-09-13T17:06:04.427 INFO:tasks.workunit.client.0.smithi115.stdout:1/870: creat d5/d7/d5c/dbc/f132 x:0 0 0 2024-09-13T17:06:04.432 INFO:tasks.workunit.client.0.smithi115.stdout:5/947: link d19/d2b/d32/f4e d19/d2c/dd3/f13e 0 2024-09-13T17:06:04.432 INFO:tasks.workunit.client.0.smithi115.stdout:6/841: dwrite d8/d33/d40/d67/db4/d24/f86 [0,4194304] 0 2024-09-13T17:06:04.434 INFO:tasks.workunit.client.0.smithi115.stdout:8/987: creat d0/d26/d29/d59/d7e/da7/d2b/db1/f14f x:0 0 0 2024-09-13T17:06:04.438 INFO:tasks.workunit.client.0.smithi115.stdout:2/994: rename d3/d108 to d3/d4d/dd/d1f/d13b 0 2024-09-13T17:06:04.441 INFO:tasks.workunit.client.0.smithi115.stdout:9/859: mkdir d0/de/d37/d105/d12a 0 2024-09-13T17:06:04.442 INFO:tasks.workunit.client.0.smithi115.stdout:1/871: symlink d5/d26/d2c/l133 0 2024-09-13T17:06:04.444 INFO:tasks.workunit.client.0.smithi115.stdout:7/838: write d0/d3b/d50/f88 [593748,65244] 0 2024-09-13T17:06:04.448 INFO:tasks.workunit.client.0.smithi115.stdout:2/995: dread d3/d4d/de/d3a/d47/f49 [0,4194304] 0 2024-09-13T17:06:04.448 INFO:tasks.workunit.client.0.smithi115.stdout:2/996: chown d3/d4d/d13/f51 2229331 1 2024-09-13T17:06:04.448 INFO:tasks.workunit.client.0.smithi115.stdout:8/988: dwrite d0/d15/d3e/f148 [0,4194304] 0 2024-09-13T17:06:04.450 INFO:tasks.workunit.client.0.smithi115.stdout:5/948: rename d19/d2b/d32/d55/f94 to d19/d2e/d6b/f13f 0 2024-09-13T17:06:04.452 INFO:tasks.workunit.client.0.smithi115.stdout:9/860: creat d0/d21/d65/f12b x:0 0 0 2024-09-13T17:06:04.452 INFO:tasks.workunit.client.0.smithi115.stdout:9/861: write d0/de/d37/d83/dc2/f11b [287168,129934] 0 2024-09-13T17:06:04.452 INFO:tasks.workunit.client.0.smithi115.stdout:9/862: getdents d0/de/d37/d83/dc2/d124 0 2024-09-13T17:06:04.455 INFO:tasks.workunit.client.0.smithi115.stdout:1/872: creat d5/d26/d2c/d89/f134 x:0 0 0 2024-09-13T17:06:04.456 INFO:tasks.workunit.client.0.smithi115.stdout:7/839: truncate d0/d3b/d50/d21/d2f/f5b 33415 0 2024-09-13T17:06:04.458 INFO:tasks.workunit.client.0.smithi115.stdout:4/947: write d7/dbe/f6a [407440,28986] 0 2024-09-13T17:06:04.460 INFO:tasks.workunit.client.0.smithi115.stdout:6/842: mkdir d8/d33/d40/d4c/d10a 0 2024-09-13T17:06:04.462 INFO:tasks.workunit.client.0.smithi115.stdout:9/863: dread d0/de/d37/f38 [0,4194304] 0 2024-09-13T17:06:04.462 INFO:tasks.workunit.client.0.smithi115.stdout:2/997: link d3/d4d/d13/d62/d66/lff d3/d4d/de/d99/d9a/df1/dfa/d87/l13c 0 2024-09-13T17:06:04.462 INFO:tasks.workunit.client.0.smithi115.stdout:2/998: creat d3/d4d/d13/d62/d92/dd7/d7d/dc2/f13d x:0 0 0 2024-09-13T17:06:04.463 INFO:tasks.workunit.client.0.smithi115.stdout:2/999: chown d3/d4d/de/d99/d9a/df1/dfa/d46/da0/ff5 15 1 2024-09-13T17:06:04.470 INFO:tasks.workunit.client.0.smithi115.stdout:8/989: rename d0/d95/dce/d14d/d76/d83 to d0/d95/dce/d14d/d3a/da3/d150 0 2024-09-13T17:06:04.472 INFO:tasks.workunit.client.0.smithi115.stdout:1/873: dwrite d5/d26/d2c/d89/fa3 [0,4194304] 0 2024-09-13T17:06:04.472 INFO:tasks.workunit.client.0.smithi115.stdout:1/874: fsync d5/d60/d7d/d87/f9e 0 2024-09-13T17:06:04.474 INFO:tasks.workunit.client.0.smithi115.stdout:7/840: creat d0/d2/d67/d86/d94/d9b/dbb/f12a x:0 0 0 2024-09-13T17:06:04.482 INFO:tasks.workunit.client.0.smithi115.stdout:4/948: dwrite d7/dd/de/d4e/d5a/d4f/f8d [0,4194304] 0 2024-09-13T17:06:04.487 INFO:tasks.workunit.client.0.smithi115.stdout:8/990: creat d0/d26/d29/d59/d7e/da7/d2b/d3b/d11f/dbd/f151 x:0 0 0 2024-09-13T17:06:04.493 INFO:tasks.workunit.client.0.smithi115.stdout:7/841: dwrite d0/d2/d67/d86/fb1 [0,4194304] 0 2024-09-13T17:06:04.493 INFO:tasks.workunit.client.0.smithi115.stdout:7/842: fsync d0/d2/d1e/de5/fec 0 2024-09-13T17:06:04.493 INFO:tasks.workunit.client.0.smithi115.stdout:7/843: dread - d0/d3b/d50/ff6 zero size 2024-09-13T17:06:04.494 INFO:tasks.workunit.client.0.smithi115.stdout:7/844: fsync d0/d2/d1e/d3d/d6c/f49 0 2024-09-13T17:06:04.495 INFO:tasks.workunit.client.0.smithi115.stdout:1/875: mknod d5/d3e/c135 0 2024-09-13T17:06:04.495 INFO:tasks.workunit.client.0.smithi115.stdout:1/876: chown d5/d7/d33/f101 221 1 2024-09-13T17:06:04.496 INFO:tasks.workunit.client.0.smithi115.stdout:6/843: getdents d8/d33/d40/d4c/d66 0 2024-09-13T17:06:04.496 INFO:tasks.workunit.client.0.smithi115.stdout:6/844: creat d8/d33/d40/d67/db4/d24/d53/d6a/f10b x:0 0 0 2024-09-13T17:06:04.496 INFO:tasks.workunit.client.0.smithi115.stdout:6/845: creat d8/d33/d40/d4c/d66/df4/f10c x:0 0 0 2024-09-13T17:06:04.500 INFO:tasks.workunit.client.0.smithi115.stdout:4/949: truncate d7/f31 7172712 0 2024-09-13T17:06:04.502 INFO:tasks.workunit.client.0.smithi115.stdout:8/991: dwrite d0/d95/dce/d14d/f118 [0,4194304] 0 2024-09-13T17:06:04.503 INFO:tasks.workunit.client.0.smithi115.stdout:6/846: dread d8/db/dd/da2/db3/fb5 [0,4194304] 0 2024-09-13T17:06:04.503 INFO:tasks.workunit.client.0.smithi115.stdout:6/847: dread - d8/d33/d40/d4c/d66/df4/ffa zero size 2024-09-13T17:06:04.503 INFO:tasks.workunit.client.0.smithi115.stdout:6/848: fsync d8/d33/d40/d4c/d66/df4/ffa 0 2024-09-13T17:06:04.503 INFO:tasks.workunit.client.0.smithi115.stdout:6/849: chown d8/d33/d40/d67/db4/d24/d53/d6a/fc2 112310 1 2024-09-13T17:06:04.504 INFO:tasks.workunit.client.0.smithi115.stdout:7/845: truncate d0/d3b/d50/d21/f33 3209338 0 2024-09-13T17:06:04.505 INFO:tasks.workunit.client.0.smithi115.stdout:7/846: read d0/d3b/d50/f88 [544097,35051] 0 2024-09-13T17:06:04.507 INFO:tasks.workunit.client.0.smithi115.stdout:1/877: mknod d5/d26/d2c/d62/c136 0 2024-09-13T17:06:04.507 INFO:tasks.workunit.client.0.smithi115.stdout:1/878: read - d5/d7/d33/d3a/dc3/fdb zero size 2024-09-13T17:06:04.507 INFO:tasks.workunit.client.0.smithi115.stdout:1/879: creat d5/d60/d7d/f137 x:0 0 0 2024-09-13T17:06:04.507 INFO:tasks.workunit.client.0.smithi115.stdout:1/880: dread - d5/d7/d33/d3a/dc3/ddd/d10b/f115 zero size 2024-09-13T17:06:04.511 INFO:tasks.workunit.client.0.smithi115.stdout:8/992: dread d0/d15/d44/f70 [0,4194304] 0 2024-09-13T17:06:04.517 INFO:tasks.workunit.client.0.smithi115.stdout:6/850: symlink d8/l10d 0 2024-09-13T17:06:04.518 INFO:tasks.workunit.client.0.smithi115.stdout:7/847: mkdir d0/d3b/d50/d21/d99/db3/d117/d44/d12b 0 2024-09-13T17:06:04.522 INFO:tasks.workunit.client.0.smithi115.stdout:1/881: creat d5/d26/d2c/d12f/dd4/f138 x:0 0 0 2024-09-13T17:06:04.525 INFO:tasks.workunit.client.0.smithi115.stdout:6/851: rename d8/d33/d82/d80/c93 to d8/d33/d82/d80/c10e 0 2024-09-13T17:06:04.526 INFO:tasks.workunit.client.0.smithi115.stdout:7/848: mknod d0/d3b/d50/d21/d99/db3/c12c 0 2024-09-13T17:06:04.526 INFO:tasks.workunit.client.0.smithi115.stdout:7/849: fdatasync d0/d3b/d50/d21/d2f/fed 0 2024-09-13T17:06:04.527 INFO:tasks.workunit.client.0.smithi115.stdout:1/882: creat d5/d3e/dc8/d11f/d12c/f139 x:0 0 0 2024-09-13T17:06:04.529 INFO:tasks.workunit.client.0.smithi115.stdout:6/852: rename d8/db/f70 to d8/d33/d40/d67/db4/d24/f10f 0 2024-09-13T17:06:04.530 INFO:tasks.workunit.client.0.smithi115.stdout:4/950: dwrite d7/dd/de/f61 [0,4194304] 0 2024-09-13T17:06:04.532 INFO:tasks.workunit.client.0.smithi115.stdout:7/850: mknod d0/d3b/d50/d21/d99/db3/d117/d44/dac/c12d 0 2024-09-13T17:06:04.534 INFO:tasks.workunit.client.0.smithi115.stdout:1/883: creat d5/d7/d33/d3a/d11c/f13a x:0 0 0 2024-09-13T17:06:04.534 INFO:tasks.workunit.client.0.smithi115.stdout:1/884: chown d5/d26/d2c/d62 11 1 2024-09-13T17:06:04.534 INFO:tasks.workunit.client.0.smithi115.stdout:1/885: creat d5/d60/d8e/f13b x:0 0 0 2024-09-13T17:06:04.534 INFO:tasks.workunit.client.0.smithi115.stdout:1/886: creat d5/d7/d33/d3a/dc3/dfd/f13c x:0 0 0 2024-09-13T17:06:04.535 INFO:tasks.workunit.client.0.smithi115.stdout:6/853: unlink d8/d33/d40/d4c/d66/df8/lda 0 2024-09-13T17:06:04.542 INFO:tasks.workunit.client.0.smithi115.stdout:7/851: rmdir d0/d3b/d50/d21/d2f/d9e 39 2024-09-13T17:06:04.542 INFO:tasks.workunit.client.0.smithi115.stdout:7/852: truncate d0/d3b/d50/d21/d2f/fc4 153879 0 2024-09-13T17:06:04.544 INFO:tasks.workunit.client.0.smithi115.stdout:1/887: dread d5/d60/f104 [0,4194304] 0 2024-09-13T17:06:04.550 INFO:tasks.workunit.client.0.smithi115.stdout:1/888: truncate d5/d7/f18 180381 0 2024-09-13T17:06:04.550 INFO:tasks.workunit.client.0.smithi115.stdout:1/889: chown d5/d3e/da1/f108 3 1 2024-09-13T17:06:04.551 INFO:tasks.workunit.client.0.smithi115.stdout:4/951: dwrite d7/dd/de/d4e/d5a/f111 [0,4194304] 0 2024-09-13T17:06:04.552 INFO:tasks.workunit.client.0.smithi115.stdout:4/952: read d7/dd/de/d4e/d6c/fc7 [271427,38600] 0 2024-09-13T17:06:04.553 INFO:tasks.workunit.client.0.smithi115.stdout:1/890: creat d5/d26/dc9/f13d x:0 0 0 2024-09-13T17:06:04.555 INFO:tasks.workunit.client.0.smithi115.stdout:6/854: dwrite d8/d33/d40/d4c/f71 [0,4194304] 0 2024-09-13T17:06:04.556 INFO:tasks.workunit.client.0.smithi115.stdout:7/853: dread d0/d3b/d50/d21/d99/fdf [0,4194304] 0 2024-09-13T17:06:04.562 INFO:tasks.workunit.client.0.smithi115.stdout:6/855: mknod d8/db/d49/d8d/c110 0 2024-09-13T17:06:04.562 INFO:tasks.workunit.client.0.smithi115.stdout:6/856: fdatasync d8/d33/d40/d67/db4/f109 0 2024-09-13T17:06:04.564 INFO:tasks.workunit.client.0.smithi115.stdout:4/953: rename d7/dd/de/d4e/ffe to d7/dd/de/d4e/d5a/d4f/d53/f12a 0 2024-09-13T17:06:04.568 INFO:tasks.workunit.client.0.smithi115.stdout:6/857: creat d8/db/dd/da2/f111 x:0 0 0 2024-09-13T17:06:04.572 INFO:tasks.workunit.client.0.smithi115.stdout:4/954: unlink d7/f2e 0 2024-09-13T17:06:04.576 INFO:tasks.workunit.client.0.smithi115.stdout:6/858: unlink d8/d33/d40/d4c/d66/de3/le8 0 2024-09-13T17:06:04.576 INFO:tasks.workunit.client.0.smithi115.stdout:1/891: dwrite d5/d7/d33/d3a/dc3/dfd/f13c [0,4194304] 0 2024-09-13T17:06:04.577 INFO:tasks.workunit.client.0.smithi115.stdout:7/854: dwrite d0/d2/d67/d86/d94/d9b/f129 [0,4194304] 0 2024-09-13T17:06:04.577 INFO:tasks.workunit.client.0.smithi115.stdout:7/855: read d0/d2/d1e/d73/fbc [3665,117297] 0 2024-09-13T17:06:04.577 INFO:tasks.workunit.client.0.smithi115.stdout:7/856: stat d0/d3b/d50/d21/d99/db3/d117/d44/f6e 0 2024-09-13T17:06:04.584 INFO:tasks.workunit.client.0.smithi115.stdout:6/859: dread d8/d33/d40/d67/db4/d24/f29 [0,4194304] 0 2024-09-13T17:06:04.590 INFO:tasks.workunit.client.0.smithi115.stdout:7/857: mkdir d0/d3b/d50/d21/d99/db3/d117/d12e 0 2024-09-13T17:06:04.591 INFO:tasks.workunit.client.0.smithi115.stdout:4/955: getdents d7/dbe 0 2024-09-13T17:06:04.593 INFO:tasks.workunit.client.0.smithi115.stdout:6/860: symlink d8/db/d49/df1/l112 0 2024-09-13T17:06:04.593 INFO:tasks.workunit.client.0.smithi115.stdout:1/892: dwrite d5/d26/d2c/d12f/dd4/f138 [0,4194304] 0 2024-09-13T17:06:04.596 INFO:tasks.workunit.client.0.smithi115.stdout:4/956: read d7/dbe/f6a [35012,21952] 0 2024-09-13T17:06:04.597 INFO:tasks.workunit.client.0.smithi115.stdout:6/861: dread d8/d33/f57 [0,4194304] 0 2024-09-13T17:06:04.608 INFO:tasks.workunit.client.0.smithi115.stdout:1/893: creat d5/d26/d2c/f13e x:0 0 0 2024-09-13T17:06:04.610 INFO:tasks.workunit.client.0.smithi115.stdout:7/858: unlink d0/d2/d1e/c3c 0 2024-09-13T17:06:04.613 INFO:tasks.workunit.client.0.smithi115.stdout:6/862: mkdir d8/db/d49/d8d/d113 0 2024-09-13T17:06:04.613 INFO:tasks.workunit.client.0.smithi115.stdout:6/863: fdatasync d8/d13/f107 0 2024-09-13T17:06:04.615 INFO:tasks.workunit.client.0.smithi115.stdout:1/894: mkdir d5/d3e/d13f 0 2024-09-13T17:06:04.616 INFO:tasks.workunit.client.0.smithi115.stdout:7/859: unlink d0/d2/d1e/c7d 0 2024-09-13T17:06:04.619 INFO:tasks.workunit.client.0.smithi115.stdout:1/895: rename d5/d7/d33/d3a/db2/f12d to d5/d26/d2c/d12f/dd4/f140 0 2024-09-13T17:06:04.620 INFO:tasks.workunit.client.0.smithi115.stdout:7/860: truncate d0/d3b/d50/d21/f33 2031464 0 2024-09-13T17:06:04.622 INFO:tasks.workunit.client.0.smithi115.stdout:6/864: getdents d8/d33/d40/d67/db4/d24/d53/d6a/dfe 0 2024-09-13T17:06:04.624 INFO:tasks.workunit.client.0.smithi115.stdout:4/957: dwrite d7/dd/d3c/f45 [0,4194304] 0 2024-09-13T17:06:04.624 INFO:tasks.workunit.client.0.smithi115.stdout:1/896: truncate d5/d7/d33/d3a/dc3/f81 1405617 0 2024-09-13T17:06:04.624 INFO:tasks.workunit.client.0.smithi115.stdout:4/958: write d7/dd/de/d4e/d5a/d4f/d53/f12a [716276,19776] 0 2024-09-13T17:06:04.625 INFO:tasks.workunit.client.0.smithi115.stdout:7/861: getdents d0/d2/d67 0 2024-09-13T17:06:04.626 INFO:tasks.workunit.client.0.smithi115.stdout:7/862: write d0/d2/d67/d86/ff4 [624623,29474] 0 2024-09-13T17:06:04.626 INFO:tasks.workunit.client.0.smithi115.stdout:6/865: rmdir d8/db 39 2024-09-13T17:06:04.637 INFO:tasks.workunit.client.0.smithi115.stdout:4/959: mknod d7/dd/da0/c12b 0 2024-09-13T17:06:04.637 INFO:tasks.workunit.client.0.smithi115.stdout:4/960: fdatasync d7/dd/de/d4e/d6c/d77/fc2 0 2024-09-13T17:06:04.637 INFO:tasks.workunit.client.0.smithi115.stdout:4/961: dread - d7/dd/de/d4e/dae/f122 zero size 2024-09-13T17:06:04.640 INFO:tasks.workunit.client.0.smithi115.stdout:6/866: link d8/d33/d7f/faa d8/db/f114 0 2024-09-13T17:06:04.641 INFO:tasks.workunit.client.0.smithi115.stdout:7/863: dwrite d0/d59/fb8 [0,4194304] 0 2024-09-13T17:06:04.642 INFO:tasks.workunit.client.0.smithi115.stdout:1/897: rename d5/d26/d2c/d12f to d5/d3e/dc8/d141 0 2024-09-13T17:06:04.642 INFO:tasks.workunit.client.0.smithi115.stdout:1/898: read d5/d3e/d59/fb7 [2574827,85762] 0 2024-09-13T17:06:04.642 INFO:tasks.workunit.client.0.smithi115.stdout:1/899: fdatasync d5/d7/d33/d3a/dc3/ddd/d10b/f115 0 2024-09-13T17:06:04.642 INFO:tasks.workunit.client.0.smithi115.stdout:1/900: chown d5/d26/d2c/fb3 2108851 1 2024-09-13T17:06:04.644 INFO:tasks.workunit.client.0.smithi115.stdout:4/962: creat d7/dd/d3c/d72/db3/dea/f12c x:0 0 0 2024-09-13T17:06:04.647 INFO:tasks.workunit.client.0.smithi115.stdout:6/867: mkdir d8/d13/d7b/d115 0 2024-09-13T17:06:04.647 INFO:tasks.workunit.client.0.smithi115.stdout:6/868: stat d8/d13/dd7/cf7 0 2024-09-13T17:06:04.647 INFO:tasks.workunit.client.0.smithi115.stdout:6/869: creat d8/db/dd/da2/f116 x:0 0 0 2024-09-13T17:06:04.648 INFO:tasks.workunit.client.0.smithi115.stdout:1/901: mknod d5/d7/d33/d3a/dc3/ddd/c142 0 2024-09-13T17:06:04.653 INFO:tasks.workunit.client.0.smithi115.stdout:4/963: mkdir d7/dd/d3c/d7b/d97/d12d 0 2024-09-13T17:06:04.661 INFO:tasks.workunit.client.0.smithi115.stdout:6/870: rename d8/d33/d82/db0 to d8/db/dd/da2/d117 0 2024-09-13T17:06:04.664 INFO:tasks.workunit.client.0.smithi115.stdout:1/902: rename d5/d7/d5c/dbc/f132 to d5/d7/d33/d3a/db2/d11d/f143 0 2024-09-13T17:06:04.664 INFO:tasks.workunit.client.0.smithi115.stdout:1/903: chown d5/d7/d33/d3a/dc3/dfd/l113 0 1 2024-09-13T17:06:04.664 INFO:tasks.workunit.client.0.smithi115.stdout:1/904: creat d5/d7/d33/d3a/d11c/f144 x:0 0 0 2024-09-13T17:06:04.664 INFO:tasks.workunit.client.0.smithi115.stdout:1/905: write d5/d26/d2c/f32 [1418613,2612] 0 2024-09-13T17:06:04.664 INFO:tasks.workunit.client.0.smithi115.stdout:1/906: chown d5/d3e/dc8/ded 239 1 2024-09-13T17:06:04.664 INFO:tasks.workunit.client.0.smithi115.stdout:6/871: truncate d8/db/dd/da2/db3/fb5 597412 0 2024-09-13T17:06:04.669 INFO:tasks.workunit.client.0.smithi115.stdout:4/964: rename d7/dd/de/f5c to d7/dd/da0/f12e 0 2024-09-13T17:06:04.671 INFO:tasks.workunit.client.0.smithi115.stdout:4/965: dread d7/dbe/f6a [0,4194304] 0 2024-09-13T17:06:04.673 INFO:tasks.workunit.client.0.smithi115.stdout:1/907: rmdir d5/d60 39 2024-09-13T17:06:04.673 INFO:tasks.workunit.client.0.smithi115.stdout:1/908: write d5/d7/d33/d3a/db2/d11d/f143 [927857,1199] 0 2024-09-13T17:06:04.675 INFO:tasks.workunit.client.0.smithi115.stdout:1/909: link d5/d26/d2c/d62/c136 d5/d7/d86/c145 0 2024-09-13T17:06:04.678 INFO:tasks.workunit.client.0.smithi115.stdout:6/872: dwrite d8/d33/d40/d4c/d66/df8/f108 [0,4194304] 0 2024-09-13T17:06:04.678 INFO:tasks.workunit.client.0.smithi115.stdout:4/966: rename d7/f7f to d7/dd/d3c/d72/db3/f12f 0 2024-09-13T17:06:04.678 INFO:tasks.workunit.client.0.smithi115.stdout:4/967: stat d7/dd/de/d4e/d5a/fd7 0 2024-09-13T17:06:04.679 INFO:tasks.workunit.client.0.smithi115.stdout:1/910: dread d5/d26/f35 [4194304,4194304] 0 2024-09-13T17:06:04.679 INFO:tasks.workunit.client.0.smithi115.stdout:1/911: truncate d5/d7/d33/d3a/dc3/dfd/f130 988164 0 2024-09-13T17:06:04.684 INFO:tasks.workunit.client.0.smithi115.stdout:6/873: creat d8/db/d49/f118 x:0 0 0 2024-09-13T17:06:04.684 INFO:tasks.workunit.client.0.smithi115.stdout:6/874: creat d8/db/dd/da2/f119 x:0 0 0 2024-09-13T17:06:04.684 INFO:tasks.workunit.client.0.smithi115.stdout:6/875: fdatasync d8/d33/d40/d4c/fa0 0 2024-09-13T17:06:04.687 INFO:tasks.workunit.client.0.smithi115.stdout:4/968: creat d7/dd/de/d4e/d9f/dd4/d128/f130 x:0 0 0 2024-09-13T17:06:04.689 INFO:tasks.workunit.client.0.smithi115.stdout:6/876: symlink d8/d33/d40/d67/db4/dbf/ddb/l11a 0 2024-09-13T17:06:04.690 INFO:tasks.workunit.client.0.smithi115.stdout:6/877: write d8/d33/d40/d67/db4/d24/f81 [6020392,66611] 0 2024-09-13T17:06:04.692 INFO:tasks.workunit.client.0.smithi115.stdout:6/878: truncate d8/db/d1d/fa1 109370 0 2024-09-13T17:06:04.694 INFO:tasks.workunit.client.0.smithi115.stdout:6/879: mkdir d8/db/d49/d8d/d11b 0 2024-09-13T17:06:04.694 INFO:tasks.workunit.client.0.smithi115.stdout:6/880: write d8/d33/f61 [4341934,15203] 0 2024-09-13T17:06:04.695 INFO:tasks.workunit.client.0.smithi115.stdout:1/912: dwrite d5/d7/d33/d3a/d11c/f13a [0,4194304] 0 2024-09-13T17:06:04.696 INFO:tasks.workunit.client.0.smithi115.stdout:6/881: rmdir d8/d33/d40/d67/db4/d24 39 2024-09-13T17:06:04.696 INFO:tasks.workunit.client.0.smithi115.stdout:6/882: write d8/d33/d40/d67/db4/d24/f81 [6532758,33996] 0 2024-09-13T17:06:04.698 INFO:tasks.workunit.client.0.smithi115.stdout:6/883: rmdir d8/d13/dd7 39 2024-09-13T17:06:04.700 INFO:tasks.workunit.client.0.smithi115.stdout:6/884: rmdir d8/d33/d40/d67/db4/dc9 39 2024-09-13T17:06:04.702 INFO:tasks.workunit.client.0.smithi115.stdout:6/885: dread d8/d33/d40/d4c/fa0 [0,4194304] 0 2024-09-13T17:06:04.702 INFO:tasks.workunit.client.0.smithi115.stdout:6/886: dread - d8/db/dd/da2/d117/f106 zero size 2024-09-13T17:06:04.702 INFO:tasks.workunit.client.0.smithi115.stdout:6/887: fdatasync d8/d33/d40/d67/db4/dc9/fe0 0 2024-09-13T17:06:04.703 INFO:tasks.workunit.client.0.smithi115.stdout:6/888: mknod d8/db/d49/df1/c11c 0 2024-09-13T17:06:04.704 INFO:tasks.workunit.client.0.smithi115.stdout:6/889: unlink d8/d33/d40/cd1 0 2024-09-13T17:06:04.706 INFO:tasks.workunit.client.0.smithi115.stdout:6/890: truncate d8/f25 3747179 0 2024-09-13T17:06:04.709 INFO:tasks.workunit.client.0.smithi115.stdout:4/969: dwrite d7/fc [0,4194304] 0 2024-09-13T17:06:04.714 INFO:tasks.workunit.client.0.smithi115.stdout:6/891: dread d8/d33/d40/d67/db4/d24/d53/d6a/fcc [0,4194304] 0 2024-09-13T17:06:04.715 INFO:tasks.workunit.client.0.smithi115.stdout:6/892: stat d8/d13/d7b/ff2 0 2024-09-13T17:06:04.715 INFO:tasks.workunit.client.0.smithi115.stdout:6/893: chown d8/d33/d40/d67/db4/l21 219696125 1 2024-09-13T17:06:04.715 INFO:tasks.workunit.client.0.smithi115.stdout:6/894: rmdir d8/db/d49/d8d/d113 0 2024-09-13T17:06:04.716 INFO:tasks.workunit.client.0.smithi115.stdout:1/913: dwrite d5/d26/f4d [4194304,4194304] 0 2024-09-13T17:06:04.719 INFO:tasks.workunit.client.0.smithi115.stdout:1/914: mkdir d5/d7/d33/d3a/d146 0 2024-09-13T17:06:04.724 INFO:tasks.workunit.client.0.smithi115.stdout:4/970: read d7/dd/de/d4e/d6c/f7c [565119,49501] 0 2024-09-13T17:06:04.726 INFO:tasks.workunit.client.0.smithi115.stdout:4/971: mkdir d7/dd/de/d4e/d5a/d131 0 2024-09-13T17:06:04.730 INFO:tasks.workunit.client.0.smithi115.stdout:6/895: dwrite d8/db/d49/d8d/fd5 [0,4194304] 0 2024-09-13T17:06:04.731 INFO:tasks.workunit.client.0.smithi115.stdout:4/972: dread d7/f47 [0,4194304] 0 2024-09-13T17:06:04.731 INFO:tasks.workunit.client.0.smithi115.stdout:4/973: fdatasync d7/dd/de/d4e/d6c/d77/dca/f115 0 2024-09-13T17:06:04.734 INFO:tasks.workunit.client.0.smithi115.stdout:6/896: mkdir d8/d33/d40/d4c/d66/df4/d11d 0 2024-09-13T17:06:04.735 INFO:tasks.workunit.client.0.smithi115.stdout:4/974: symlink d7/dd/de/d4e/d5a/l132 0 2024-09-13T17:06:04.736 INFO:tasks.workunit.client.0.smithi115.stdout:6/897: mknod d8/db/d1d/dc5/c11e 0 2024-09-13T17:06:04.759 INFO:tasks.workunit.client.0.smithi115.stdout:4/975: dwrite d7/dd/de/d4e/d9f/dd4/d128/f130 [0,4194304] 0 2024-09-13T17:06:04.759 INFO:tasks.workunit.client.0.smithi115.stdout:6/898: dwrite d8/d33/d40/d67/db4/dbf/feb [0,4194304] 0 2024-09-13T17:06:04.760 INFO:tasks.workunit.client.0.smithi115.stdout:6/899: getdents d8/db/d1d/dfd 0 2024-09-13T17:06:05.076 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:04 smithi195 ceph-mon[34981]: pgmap v21: 65 pgs: 65 active+clean; 3.4 GiB data, 9.6 GiB used, 527 GiB / 536 GiB avail; 236 MiB/s rd, 274 MiB/s wr, 404 op/s 2024-09-13T17:06:05.178 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:04 smithi115 ceph-mon[27708]: pgmap v21: 65 pgs: 65 active+clean; 3.4 GiB data, 9.6 GiB used, 527 GiB / 536 GiB avail; 236 MiB/s rd, 274 MiB/s wr, 404 op/s 2024-09-13T17:06:05.333 INFO:tasks.workunit.client.0.smithi115.stdout:0/771: sync 2024-09-13T17:06:05.341 INFO:tasks.workunit.client.0.smithi115.stdout:0/772: write d9/d27/d88/d99/faa [3308141,98506] 0 2024-09-13T17:06:05.343 INFO:tasks.workunit.client.0.smithi115.stdout:0/773: mknod d9/d27/d88/d99/dc7/cf3 0 2024-09-13T17:06:05.345 INFO:tasks.workunit.client.0.smithi115.stdout:0/774: getdents d9/d1d/d24/d26/d5d/d66/db1 0 2024-09-13T17:06:05.362 INFO:tasks.workunit.client.0.smithi115.stdout:0/775: dwrite d9/d1d/de1/d30/f9f [0,4194304] 0 2024-09-13T17:06:05.362 INFO:tasks.workunit.client.0.smithi115.stdout:0/776: read d9/d27/d88/d99/faa [3709709,123690] 0 2024-09-13T17:06:05.367 INFO:tasks.workunit.client.0.smithi115.stdout:0/777: dread d9/f1f [0,4194304] 0 2024-09-13T17:06:05.369 INFO:tasks.workunit.client.0.smithi115.stdout:0/778: symlink d9/d1d/de1/d30/dc2/ddc/lf4 0 2024-09-13T17:06:05.369 INFO:tasks.workunit.client.0.smithi115.stdout:0/779: fsync d9/d1d/d24/d7d/fdb 0 2024-09-13T17:06:05.369 INFO:tasks.workunit.client.0.smithi115.stdout:0/780: stat d9/d1d/d24/d26/fe8 0 2024-09-13T17:06:05.371 INFO:tasks.workunit.client.0.smithi115.stdout:0/781: creat d9/d1d/de1/d30/d5c/ff5 x:0 0 0 2024-09-13T17:06:05.372 INFO:tasks.workunit.client.0.smithi115.stdout:0/782: unlink d9/d27/d88/d99/dc7/cf3 0 2024-09-13T17:06:05.374 INFO:tasks.workunit.client.0.smithi115.stdout:0/783: link d9/d1d/de1/d30/le0 d9/d1d/de1/d30/d46/lf6 0 2024-09-13T17:06:05.378 INFO:tasks.workunit.client.0.smithi115.stdout:0/784: write d9/d1d/d24/d26/d36/d48/fb7 [788531,27386] 0 2024-09-13T17:06:05.378 INFO:tasks.workunit.client.0.smithi115.stdout:0/785: chown d9/d27/fac 281851 1 2024-09-13T17:06:05.381 INFO:tasks.workunit.client.0.smithi115.stdout:0/786: link d9/d27/d88/fa2 d9/d1d/d24/d26/d7b/ff7 0 2024-09-13T17:06:05.383 INFO:tasks.workunit.client.0.smithi115.stdout:0/787: fdatasync d9/d27/d88/d99/faa 0 2024-09-13T17:06:05.385 INFO:tasks.workunit.client.0.smithi115.stdout:0/788: rmdir d9/d1d/d24/d7d 39 2024-09-13T17:06:05.385 INFO:tasks.workunit.client.0.smithi115.stdout:0/789: chown d9/d1d/l2e 3043 1 2024-09-13T17:06:05.385 INFO:tasks.workunit.client.0.smithi115.stdout:0/790: read - d9/d1d/d24/d26/fe8 zero size 2024-09-13T17:06:05.389 INFO:tasks.workunit.client.0.smithi115.stdout:0/791: rmdir d9/d1d/d24/d26/d5d 39 2024-09-13T17:06:05.389 INFO:tasks.workunit.client.0.smithi115.stdout:0/792: fsync d9/d1d/d24/d26/d5d/d67/fd8 0 2024-09-13T17:06:05.389 INFO:tasks.workunit.client.0.smithi115.stdout:0/793: chown d9/d1d/d24/d26/d5d/f87 31 1 2024-09-13T17:06:05.390 INFO:tasks.workunit.client.0.smithi115.stdout:0/794: truncate d9/d1d/d24/d26/d5d/d66/db1/fb8 1398062 0 2024-09-13T17:06:05.390 INFO:tasks.workunit.client.0.smithi115.stdout:0/795: write d9/d1d/de1/d78/fbe [41680,114894] 0 2024-09-13T17:06:05.390 INFO:tasks.workunit.client.0.smithi115.stdout:0/796: creat d9/d1d/d24/ff8 x:0 0 0 2024-09-13T17:06:05.391 INFO:tasks.workunit.client.0.smithi115.stdout:0/797: symlink d9/d1d/de1/d78/lf9 0 2024-09-13T17:06:05.393 INFO:tasks.workunit.client.0.smithi115.stdout:0/798: mknod d9/d27/d88/d9e/dad/cfa 0 2024-09-13T17:06:05.394 INFO:tasks.workunit.client.0.smithi115.stdout:0/799: getdents d9/d1d/de1/d30/d5c 0 2024-09-13T17:06:05.397 INFO:tasks.workunit.client.0.smithi115.stdout:0/800: truncate d9/d27/d88/d99/faa 915017 0 2024-09-13T17:06:05.399 INFO:tasks.workunit.client.0.smithi115.stdout:0/801: truncate d9/d27/d88/d99/dc7/f57 1420469 0 2024-09-13T17:06:05.418 INFO:tasks.workunit.client.0.smithi115.stdout:0/802: dwrite d9/d1d/d24/d26/d36/f7c [0,4194304] 0 2024-09-13T17:06:05.421 INFO:tasks.workunit.client.0.smithi115.stdout:0/803: link d9/d1d/d24/d26/f64 d9/d1d/d24/d26/d36/dd7/ffb 0 2024-09-13T17:06:05.421 INFO:tasks.workunit.client.0.smithi115.stdout:0/804: truncate d9/d27/d88/d99/dc7/f89 4211765 0 2024-09-13T17:06:05.422 INFO:tasks.workunit.client.0.smithi115.stdout:0/805: creat d9/d1d/de1/d78/db6/ffc x:0 0 0 2024-09-13T17:06:05.423 INFO:tasks.workunit.client.0.smithi115.stdout:0/806: mknod d9/d27/d88/d8e/dc3/cfd 0 2024-09-13T17:06:05.424 INFO:tasks.workunit.client.0.smithi115.stdout:0/807: read d9/d1d/d24/d26/d5d/fdd [55414,68747] 0 2024-09-13T17:06:05.424 INFO:tasks.workunit.client.0.smithi115.stdout:0/808: write d9/d27/d88/fa2 [674161,110272] 0 2024-09-13T17:06:05.425 INFO:tasks.workunit.client.0.smithi115.stdout:0/809: unlink d9/d1d/la7 0 2024-09-13T17:06:05.442 INFO:tasks.workunit.client.0.smithi115.stdout:0/810: dwrite d9/d1d/d24/d26/d5d/fdd [0,4194304] 0 2024-09-13T17:06:05.443 INFO:tasks.workunit.client.0.smithi115.stdout:0/811: write d9/d1d/f39 [1261345,39693] 0 2024-09-13T17:06:05.443 INFO:tasks.workunit.client.0.smithi115.stdout:0/812: getdents d9/d27/d88/d99/dd4 0 2024-09-13T17:06:05.451 INFO:tasks.workunit.client.0.smithi115.stdout:0/813: write d9/f5f [2557688,11793] 0 2024-09-13T17:06:05.451 INFO:tasks.workunit.client.0.smithi115.stdout:0/814: write d9/d1d/de1/d30/d5c/ff5 [1040431,78467] 0 2024-09-13T17:06:05.451 INFO:tasks.workunit.client.0.smithi115.stdout:0/815: write d9/d27/d88/d9e/dad/fcc [850667,70100] 0 2024-09-13T17:06:05.466 INFO:tasks.workunit.client.0.smithi115.stdout:0/816: dwrite d9/d1d/de1/d30/d5c/ff5 [0,4194304] 0 2024-09-13T17:06:05.468 INFO:tasks.workunit.client.0.smithi115.stdout:0/817: truncate d9/d1d/d24/d26/d36/f62 2144508 0 2024-09-13T17:06:05.471 INFO:tasks.workunit.client.0.smithi115.stdout:0/818: mkdir d9/d1d/d24/d7d/dfe 0 2024-09-13T17:06:05.480 INFO:tasks.workunit.client.0.smithi115.stdout:0/819: truncate d9/d27/d88/d99/dc7/f92 3993342 0 2024-09-13T17:06:05.486 INFO:tasks.workunit.client.0.smithi115.stdout:0/820: unlink d9/d1d/d24/d26/d36/fcb 0 2024-09-13T17:06:05.489 INFO:tasks.workunit.client.0.smithi115.stdout:5/949: sync 2024-09-13T17:06:05.489 INFO:tasks.workunit.client.0.smithi115.stdout:9/864: sync 2024-09-13T17:06:05.489 INFO:tasks.workunit.client.0.smithi115.stdout:4/976: sync 2024-09-13T17:06:05.489 INFO:tasks.workunit.client.0.smithi115.stdout:7/864: sync 2024-09-13T17:06:05.489 INFO:tasks.workunit.client.0.smithi115.stdout:8/993: sync 2024-09-13T17:06:05.489 INFO:tasks.workunit.client.0.smithi115.stdout:8/994: chown d0/d26/d29/d59/d7e/da7/dee 2678688 1 2024-09-13T17:06:05.490 INFO:tasks.workunit.client.0.smithi115.stdout:1/915: sync 2024-09-13T17:06:05.490 INFO:tasks.workunit.client.0.smithi115.stdout:6/900: sync 2024-09-13T17:06:05.490 INFO:tasks.workunit.client.0.smithi115.stdout:6/901: write d8/d13/d7b/f8f [930666,20650] 0 2024-09-13T17:06:05.490 INFO:tasks.workunit.client.0.smithi115.stdout:6/902: chown d8/db/d1d 6948 1 2024-09-13T17:06:05.491 INFO:tasks.workunit.client.0.smithi115.stdout:9/865: dread d0/d21/d42/f81 [0,4194304] 0 2024-09-13T17:06:05.491 INFO:tasks.workunit.client.0.smithi115.stdout:0/821: creat d9/d1d/de1/d78/fff x:0 0 0 2024-09-13T17:06:05.493 INFO:tasks.workunit.client.0.smithi115.stdout:5/950: getdents d19/d2c/d125 0 2024-09-13T17:06:05.493 INFO:tasks.workunit.client.0.smithi115.stdout:5/951: dread - d19/d21/d3a/fbb zero size 2024-09-13T17:06:05.493 INFO:tasks.workunit.client.0.smithi115.stdout:5/952: read d19/d21/f22 [6643,13249] 0 2024-09-13T17:06:05.497 INFO:tasks.workunit.client.0.smithi115.stdout:0/822: dread d9/d27/d88/d9e/dad/fcc [0,4194304] 0 2024-09-13T17:06:05.503 INFO:tasks.workunit.client.0.smithi115.stdout:7/865: symlink d0/d2/d4a/l12f 0 2024-09-13T17:06:05.505 INFO:tasks.workunit.client.0.smithi115.stdout:7/866: dread d0/d2/d67/f80 [0,4194304] 0 2024-09-13T17:06:05.506 INFO:tasks.workunit.client.0.smithi115.stdout:9/866: dwrite d0/d21/d42/f50 [0,4194304] 0 2024-09-13T17:06:05.506 INFO:tasks.workunit.client.0.smithi115.stdout:1/916: rename d5/d7/d33/d3a/d146 to d5/d60/d7d/d87/d147 0 2024-09-13T17:06:05.506 INFO:tasks.workunit.client.0.smithi115.stdout:1/917: fdatasync d5/d26/dc9/f13d 0 2024-09-13T17:06:05.508 INFO:tasks.workunit.client.0.smithi115.stdout:5/953: link d19/f9c d19/d21/d3a/f140 0 2024-09-13T17:06:05.511 INFO:tasks.workunit.client.0.smithi115.stdout:0/823: mkdir d9/d1d/de1/d100 0 2024-09-13T17:06:05.511 INFO:tasks.workunit.client.0.smithi115.stdout:0/824: readlink d9/d1d/de1/d30/le0 0 2024-09-13T17:06:05.512 INFO:tasks.workunit.client.0.smithi115.stdout:4/977: mkdir d7/d86/d125/d133 0 2024-09-13T17:06:05.525 INFO:tasks.workunit.client.0.smithi115.stdout:8/995: rmdir d0/d26/d29 39 2024-09-13T17:06:05.528 INFO:tasks.workunit.client.0.smithi115.stdout:9/867: symlink d0/de/d37/d83/dc2/ddd/l12c 0 2024-09-13T17:06:05.531 INFO:tasks.workunit.client.0.smithi115.stdout:6/903: rename d8/d33/d40/d67/db4/d24/d17/c8a to d8/db/dd/c11f 0 2024-09-13T17:06:05.533 INFO:tasks.workunit.client.0.smithi115.stdout:1/918: dwrite d5/d7/d86/fe4 [0,4194304] 0 2024-09-13T17:06:05.537 INFO:tasks.workunit.client.0.smithi115.stdout:5/954: truncate d19/d21/d3a/d5d/f70 1191231 0 2024-09-13T17:06:05.538 INFO:tasks.workunit.client.0.smithi115.stdout:0/825: mkdir d9/d27/d88/d8e/dc3/d101 0 2024-09-13T17:06:05.538 INFO:tasks.workunit.client.0.smithi115.stdout:0/826: fdatasync d9/f41 0 2024-09-13T17:06:05.541 INFO:tasks.workunit.client.0.smithi115.stdout:4/978: creat d7/dd/de/d4e/d6c/d77/dca/f134 x:0 0 0 2024-09-13T17:06:05.543 INFO:tasks.workunit.client.0.smithi115.stdout:7/867: getdents d0/d59 0 2024-09-13T17:06:05.543 INFO:tasks.workunit.client.0.smithi115.stdout:7/868: stat d0/d3b/d54 0 2024-09-13T17:06:05.543 INFO:tasks.workunit.client.0.smithi115.stdout:7/869: creat d0/d3b/d54/f130 x:0 0 0 2024-09-13T17:06:05.543 INFO:tasks.workunit.client.0.smithi115.stdout:7/870: readlink d0/d59/l91 0 2024-09-13T17:06:05.546 INFO:tasks.workunit.client.0.smithi115.stdout:8/996: dwrite d0/d18/f9a [0,4194304] 0 2024-09-13T17:06:05.546 INFO:tasks.workunit.client.0.smithi115.stdout:8/997: dread - d0/d26/d29/d59/d11a/f13b zero size 2024-09-13T17:06:05.548 INFO:tasks.workunit.client.0.smithi115.stdout:1/919: mknod d5/d60/dbf/c148 0 2024-09-13T17:06:05.549 INFO:tasks.workunit.client.0.smithi115.stdout:1/920: dread - d5/d26/d2c/d89/f134 zero size 2024-09-13T17:06:05.550 INFO:tasks.workunit.client.0.smithi115.stdout:5/955: mkdir d19/d2c/d125/d141 0 2024-09-13T17:06:05.552 INFO:tasks.workunit.client.0.smithi115.stdout:0/827: creat d9/d1d/de1/f102 x:0 0 0 2024-09-13T17:06:05.552 INFO:tasks.workunit.client.0.smithi115.stdout:4/979: write d7/dd/de/d4e/d6c/fdd [2231848,45061] 0 2024-09-13T17:06:05.552 INFO:tasks.workunit.client.0.smithi115.stdout:9/868: dwrite d0/de/d37/d83/dc2/f11b [0,4194304] 0 2024-09-13T17:06:05.552 INFO:tasks.workunit.client.0.smithi115.stdout:4/980: creat d7/dd/de/d4e/d9f/dc8/f135 x:0 0 0 2024-09-13T17:06:05.554 INFO:tasks.workunit.client.0.smithi115.stdout:4/981: write d7/dd/d3c/d72/db3/fb8 [56709,79530] 0 2024-09-13T17:06:05.558 INFO:tasks.workunit.client.0.smithi115.stdout:7/871: mknod d0/d3b/d50/d21/d99/c131 0 2024-09-13T17:06:05.558 INFO:tasks.workunit.client.0.smithi115.stdout:7/872: fdatasync d0/d2/d1e/de5/d115/fa8 0 2024-09-13T17:06:05.558 INFO:tasks.workunit.client.0.smithi115.stdout:7/873: fdatasync d0/d2/d1e/d3d/d7c/f113 0 2024-09-13T17:06:05.563 INFO:tasks.workunit.client.0.smithi115.stdout:8/998: mknod d0/d26/d29/d59/d7e/da7/d28/d71/c152 0 2024-09-13T17:06:05.567 INFO:tasks.workunit.client.0.smithi115.stdout:8/999: dread d0/d26/d29/d59/d7e/da7/d2b/f106 [0,4194304] 0 2024-09-13T17:06:05.568 INFO:tasks.workunit.client.0.smithi115.stdout:5/956: mkdir d19/d1d/d101/d142 0 2024-09-13T17:06:05.568 INFO:tasks.workunit.client.0.smithi115.stdout:5/957: dread - d19/d21/d3a/d5d/f12b zero size 2024-09-13T17:06:05.571 INFO:tasks.workunit.client.0.smithi115.stdout:0/828: creat d9/d1d/d24/d26/d5d/d66/db1/f103 x:0 0 0 2024-09-13T17:06:05.580 INFO:tasks.workunit.client.0.smithi115.stdout:1/921: rmdir d5/d3e/dc8/d11f/d12c 39 2024-09-13T17:06:05.581 INFO:tasks.workunit.client.0.smithi115.stdout:5/958: rmdir d19/d2b/d32/d55/d5e 39 2024-09-13T17:06:05.581 INFO:tasks.workunit.client.0.smithi115.stdout:5/959: chown d19/d21/d3a/d5d/f12b 0 1 2024-09-13T17:06:05.581 INFO:tasks.workunit.client.0.smithi115.stdout:5/960: truncate d19/d2b/d77/f138 214725 0 2024-09-13T17:06:05.583 INFO:tasks.workunit.client.0.smithi115.stdout:7/874: dwrite d0/d2/d1e/d3d/d6c/d71/feb [0,4194304] 0 2024-09-13T17:06:05.584 INFO:tasks.workunit.client.0.smithi115.stdout:1/922: mkdir d5/d3e/da1/d149 0 2024-09-13T17:06:05.584 INFO:tasks.workunit.client.0.smithi115.stdout:5/961: truncate f5 1751177 0 2024-09-13T17:06:05.585 INFO:tasks.workunit.client.0.smithi115.stdout:4/982: rename d7/fb to d7/dd/d3c/f136 0 2024-09-13T17:06:05.587 INFO:tasks.workunit.client.0.smithi115.stdout:1/923: mknod d5/d3e/dc8/d141/c14a 0 2024-09-13T17:06:05.588 INFO:tasks.workunit.client.0.smithi115.stdout:1/924: write d5/d7/d33/d3a/d11c/f144 [1023497,103982] 0 2024-09-13T17:06:05.588 INFO:tasks.workunit.client.0.smithi115.stdout:0/829: dwrite d9/d27/d88/d99/faa [0,4194304] 0 2024-09-13T17:06:05.588 INFO:tasks.workunit.client.0.smithi115.stdout:5/962: creat d19/f143 x:0 0 0 2024-09-13T17:06:05.589 INFO:tasks.workunit.client.0.smithi115.stdout:4/983: symlink d7/dbe/l137 0 2024-09-13T17:06:05.590 INFO:tasks.workunit.client.0.smithi115.stdout:1/925: getdents d5/d7/d33/d3a/dc3/ddd 0 2024-09-13T17:06:05.591 INFO:tasks.workunit.client.0.smithi115.stdout:0/830: truncate d9/d1d/d24/d26/d36/f7c 2476176 0 2024-09-13T17:06:05.594 INFO:tasks.workunit.client.0.smithi115.stdout:7/875: dread d0/d2/d1e/d3d/d7c/fb9 [0,4194304] 0 2024-09-13T17:06:05.595 INFO:tasks.workunit.client.0.smithi115.stdout:1/926: mknod d5/d26/dc9/c14b 0 2024-09-13T17:06:05.601 INFO:tasks.workunit.client.0.smithi115.stdout:0/831: dread d9/f20 [0,4194304] 0 2024-09-13T17:06:05.602 INFO:tasks.workunit.client.0.smithi115.stdout:0/832: mkdir d9/d1d/d24/d26/d36/d48/dbb/d104 0 2024-09-13T17:06:05.604 INFO:tasks.workunit.client.0.smithi115.stdout:0/833: symlink d9/d1d/de1/d78/db6/l105 0 2024-09-13T17:06:05.610 INFO:tasks.workunit.client.0.smithi115.stdout:7/876: dread d0/d3b/d50/d21/d99/fdf [0,4194304] 0 2024-09-13T17:06:05.610 INFO:tasks.workunit.client.0.smithi115.stdout:7/877: fdatasync d0/d59/fd1 0 2024-09-13T17:06:05.610 INFO:tasks.workunit.client.0.smithi115.stdout:7/878: chown d0/d2/d4a/c90 2944161 1 2024-09-13T17:06:05.610 INFO:tasks.workunit.client.0.smithi115.stdout:7/879: fsync d0/d2/d67/d86/ff4 0 2024-09-13T17:06:05.611 INFO:tasks.workunit.client.0.smithi115.stdout:7/880: fdatasync d0/d2/d1e/f32 0 2024-09-13T17:06:05.613 INFO:tasks.workunit.client.0.smithi115.stdout:5/963: dwrite d19/d2b/d69/d8f/de0/feb [0,4194304] 0 2024-09-13T17:06:05.617 INFO:tasks.workunit.client.0.smithi115.stdout:0/834: dread d9/d27/fac [0,4194304] 0 2024-09-13T17:06:05.623 INFO:tasks.workunit.client.0.smithi115.stdout:1/927: dwrite d5/d7/d33/d3a/f9b [4194304,4194304] 0 2024-09-13T17:06:05.624 INFO:tasks.workunit.client.0.smithi115.stdout:4/984: dwrite d7/dbe/fd8 [0,4194304] 0 2024-09-13T17:06:05.627 INFO:tasks.workunit.client.0.smithi115.stdout:7/881: dwrite d0/d3b/d50/d21/d2f/f108 [0,4194304] 0 2024-09-13T17:06:05.633 INFO:tasks.workunit.client.0.smithi115.stdout:5/964: unlink d19/d2c/dd0/d63/c8e 0 2024-09-13T17:06:05.633 INFO:tasks.workunit.client.0.smithi115.stdout:5/965: write d19/d2b/d32/d55/f5a [5350367,85228] 0 2024-09-13T17:06:05.636 INFO:tasks.workunit.client.0.smithi115.stdout:0/835: link d9/d27/d88/d99/dc7/fc6 d9/d1d/d24/d26/d36/d48/f106 0 2024-09-13T17:06:05.643 INFO:tasks.workunit.client.0.smithi115.stdout:5/966: dread d19/f9c [0,4194304] 0 2024-09-13T17:06:05.643 INFO:tasks.workunit.client.0.smithi115.stdout:1/928: rename d5/d7/d33/d3a/dc3/ddd/d10b/lf7 to d5/d7/d86/l14c 0 2024-09-13T17:06:05.643 INFO:tasks.workunit.client.0.smithi115.stdout:1/929: stat d5/d7/fc0 0 2024-09-13T17:06:05.643 INFO:tasks.workunit.client.0.smithi115.stdout:5/967: chown d19/d1d/f26 78977212 1 2024-09-13T17:06:05.652 INFO:tasks.workunit.client.0.smithi115.stdout:4/985: mkdir d7/dd/de/d4e/d6c/db0/d138 0 2024-09-13T17:06:05.652 INFO:tasks.workunit.client.0.smithi115.stdout:4/986: chown d7/dd/de/d4e/d6c/d77/cbb 403988 1 2024-09-13T17:06:05.663 INFO:tasks.workunit.client.0.smithi115.stdout:7/882: rmdir d0/d2/d67/d86/d94/d9b/dbb 39 2024-09-13T17:06:05.665 INFO:tasks.workunit.client.0.smithi115.stdout:7/883: creat d0/d3b/d50/d21/f132 x:0 0 0 2024-09-13T17:06:05.667 INFO:tasks.workunit.client.0.smithi115.stdout:7/884: mknod d0/d2/d67/d86/d94/d9b/c133 0 2024-09-13T17:06:05.669 INFO:tasks.workunit.client.0.smithi115.stdout:7/885: creat d0/d3b/d50/d21/d99/db3/d117/f134 x:0 0 0 2024-09-13T17:06:05.669 INFO:tasks.workunit.client.0.smithi115.stdout:0/836: dwrite d9/d27/d88/fa2 [0,4194304] 0 2024-09-13T17:06:05.671 INFO:tasks.workunit.client.0.smithi115.stdout:7/886: unlink d0/d2/d4a/le1 0 2024-09-13T17:06:05.671 INFO:tasks.workunit.client.0.smithi115.stdout:7/887: truncate d0/d97/f98 4813126 0 2024-09-13T17:06:05.674 INFO:tasks.workunit.client.0.smithi115.stdout:0/837: creat d9/d27/d88/d99/f107 x:0 0 0 2024-09-13T17:06:05.674 INFO:tasks.workunit.client.0.smithi115.stdout:0/838: creat d9/d1d/de1/d78/db6/f108 x:0 0 0 2024-09-13T17:06:05.674 INFO:tasks.workunit.client.0.smithi115.stdout:0/839: fdatasync d9/d27/d88/d99/dc7/fa0 0 2024-09-13T17:06:05.674 INFO:tasks.workunit.client.0.smithi115.stdout:5/968: dwrite d19/f143 [0,4194304] 0 2024-09-13T17:06:05.674 INFO:tasks.workunit.client.0.smithi115.stdout:4/987: dwrite d7/fc [4194304,4194304] 0 2024-09-13T17:06:05.675 INFO:tasks.workunit.client.0.smithi115.stdout:1/930: dwrite d5/d7/d5c/f7b [0,4194304] 0 2024-09-13T17:06:05.677 INFO:tasks.workunit.client.0.smithi115.stdout:7/888: rename d0/d2/d1e/d3d/d7c/d116 to d0/d2/d67/d86/d94/d135 0 2024-09-13T17:06:05.682 INFO:tasks.workunit.client.0.smithi115.stdout:0/840: creat d9/d1d/de1/d78/de5/dc1/f109 x:0 0 0 2024-09-13T17:06:05.682 INFO:tasks.workunit.client.0.smithi115.stdout:0/841: chown d9/d27/la5 92978 1 2024-09-13T17:06:05.682 INFO:tasks.workunit.client.0.smithi115.stdout:0/842: chown d9/fb 29230479 1 2024-09-13T17:06:05.684 INFO:tasks.workunit.client.0.smithi115.stdout:4/988: dread d7/dd/d3c/d74/fa6 [0,4194304] 0 2024-09-13T17:06:05.690 INFO:tasks.workunit.client.0.smithi115.stdout:1/931: truncate d5/d7/d5c/f8c 3595462 0 2024-09-13T17:06:05.691 INFO:tasks.workunit.client.0.smithi115.stdout:5/969: rename d19/c61 to d19/d2b/c144 0 2024-09-13T17:06:05.691 INFO:tasks.workunit.client.0.smithi115.stdout:5/970: getdents d19/d2c/dd3/d10e/d129 0 2024-09-13T17:06:05.691 INFO:tasks.workunit.client.0.smithi115.stdout:5/971: creat d19/d2b/d77/f145 x:0 0 0 2024-09-13T17:06:05.692 INFO:tasks.workunit.client.0.smithi115.stdout:0/843: mknod d9/d1d/d24/d26/d36/d48/dbb/d104/c10a 0 2024-09-13T17:06:05.692 INFO:tasks.workunit.client.0.smithi115.stdout:0/844: chown d9/d1d/d24/d26/d5d/fa3 144 1 2024-09-13T17:06:05.693 INFO:tasks.workunit.client.0.smithi115.stdout:4/989: unlink d7/dd/da0/fbc 0 2024-09-13T17:06:05.697 INFO:tasks.workunit.client.0.smithi115.stdout:1/932: creat d5/f14d x:0 0 0 2024-09-13T17:06:05.699 INFO:tasks.workunit.client.0.smithi115.stdout:7/889: rename d0/d3b/d50/d21/d99/db3/d117/d44/l93 to d0/d3b/d50/d21/d99/db3/d117/l136 0 2024-09-13T17:06:05.704 INFO:tasks.workunit.client.0.smithi115.stdout:5/972: unlink d19/d2b/d32/d55/d5e/d87/db0/dde/c134 0 2024-09-13T17:06:05.708 INFO:tasks.workunit.client.0.smithi115.stdout:0/845: dwrite d9/f5f [0,4194304] 0 2024-09-13T17:06:05.708 INFO:tasks.workunit.client.0.smithi115.stdout:4/990: mkdir d7/dd/de/d4e/d6c/db0/deb/d139 0 2024-09-13T17:06:05.710 INFO:tasks.workunit.client.0.smithi115.stdout:1/933: truncate d5/fc 3829497 0 2024-09-13T17:06:05.712 INFO:tasks.workunit.client.0.smithi115.stdout:7/890: creat d0/d3b/d50/d21/d99/db3/d117/d44/dac/f137 x:0 0 0 2024-09-13T17:06:05.719 INFO:tasks.workunit.client.0.smithi115.stdout:0/846: truncate d9/d1d/d24/d26/d5d/fa3 3207756 0 2024-09-13T17:06:05.722 INFO:tasks.workunit.client.0.smithi115.stdout:4/991: dwrite d7/dd/d3c/d72/db3/f108 [0,4194304] 0 2024-09-13T17:06:05.723 INFO:tasks.workunit.client.0.smithi115.stdout:1/934: mkdir d5/d26/dc9/d14e 0 2024-09-13T17:06:05.724 INFO:tasks.workunit.client.0.smithi115.stdout:7/891: link d0/l9 d0/d3b/d50/d21/d99/db3/d117/d12e/l138 0 2024-09-13T17:06:05.725 INFO:tasks.workunit.client.0.smithi115.stdout:0/847: creat d9/d27/d88/d8e/dc3/f10b x:0 0 0 2024-09-13T17:06:05.725 INFO:tasks.workunit.client.0.smithi115.stdout:0/848: dread - d9/d1d/de1/d78/de5/fed zero size 2024-09-13T17:06:05.726 INFO:tasks.workunit.client.0.smithi115.stdout:0/849: fsync d9/d1d/d24/f5b 0 2024-09-13T17:06:05.730 INFO:tasks.workunit.client.0.smithi115.stdout:4/992: symlink d7/dd/de/d4e/d6c/l13a 0 2024-09-13T17:06:05.733 INFO:tasks.workunit.client.0.smithi115.stdout:1/935: creat d5/d7/d33/d3a/db2/d11d/f14f x:0 0 0 2024-09-13T17:06:05.737 INFO:tasks.workunit.client.0.smithi115.stdout:7/892: unlink d0/d3b/d50/d21/d99/db3/d117/d44/dac/c12d 0 2024-09-13T17:06:05.741 INFO:tasks.workunit.client.0.smithi115.stdout:4/993: write d7/dd/f44 [1792597,55745] 0 2024-09-13T17:06:05.741 INFO:tasks.workunit.client.0.smithi115.stdout:4/994: dread - d7/dd/de/d4e/d6c/d77/dca/f134 zero size 2024-09-13T17:06:05.741 INFO:tasks.workunit.client.0.smithi115.stdout:4/995: chown d7/dd/da0/f12e 690678058 1 2024-09-13T17:06:05.741 INFO:tasks.workunit.client.0.smithi115.stdout:4/996: write d7/dd/de/d4e/d9f/dc8/f135 [771530,86435] 0 2024-09-13T17:06:05.741 INFO:tasks.workunit.client.0.smithi115.stdout:4/997: fdatasync d7/dd/d3c/d72/db3/fe9 0 2024-09-13T17:06:05.741 INFO:tasks.workunit.client.0.smithi115.stdout:7/893: mknod d0/d3b/d50/d21/de2/c139 0 2024-09-13T17:06:05.742 INFO:tasks.workunit.client.0.smithi115.stdout:1/936: rmdir d5/d60/d7d/d100 39 2024-09-13T17:06:05.744 INFO:tasks.workunit.client.0.smithi115.stdout:0/850: dwrite d9/f41 [0,4194304] 0 2024-09-13T17:06:05.744 INFO:tasks.workunit.client.0.smithi115.stdout:0/851: truncate d9/d1d/d24/fa6 306191 0 2024-09-13T17:06:05.746 INFO:tasks.workunit.client.0.smithi115.stdout:7/894: mknod d0/d59/d11c/c13a 0 2024-09-13T17:06:05.752 INFO:tasks.workunit.client.0.smithi115.stdout:0/852: creat d9/d1d/d24/d26/d36/dd7/f10c x:0 0 0 2024-09-13T17:06:05.754 INFO:tasks.workunit.client.0.smithi115.stdout:4/998: rmdir d7/dd/de/d4e/d6c/d77/dca 39 2024-09-13T17:06:05.754 INFO:tasks.workunit.client.0.smithi115.stdout:4/999: fdatasync d7/dd/d3c/d72/db3/fe9 0 2024-09-13T17:06:05.756 INFO:tasks.workunit.client.0.smithi115.stdout:7/895: creat d0/d2/d67/d109/f13b x:0 0 0 2024-09-13T17:06:05.759 INFO:tasks.workunit.client.0.smithi115.stdout:7/896: rmdir d0/d3b/d50/d21/de2 39 2024-09-13T17:06:05.760 INFO:tasks.workunit.client.0.smithi115.stdout:1/937: dwrite d5/d26/d2c/d89/dff/f12e [0,4194304] 0 2024-09-13T17:06:05.761 INFO:tasks.workunit.client.0.smithi115.stdout:7/897: link d0/d3b/d50/d21/d99/db3/d117/d44/dac/f118 d0/d59/f13c 0 2024-09-13T17:06:05.766 INFO:tasks.workunit.client.0.smithi115.stdout:1/938: mknod d5/d3e/c150 0 2024-09-13T17:06:05.767 INFO:tasks.workunit.client.0.smithi115.stdout:7/898: symlink d0/d2/d1e/de5/dfb/l13d 0 2024-09-13T17:06:05.767 INFO:tasks.workunit.client.0.smithi115.stdout:7/899: readlink d0/d2/d4a/ldb 0 2024-09-13T17:06:05.774 INFO:tasks.workunit.client.0.smithi115.stdout:7/900: dread d0/d3b/f6a [0,4194304] 0 2024-09-13T17:06:05.779 INFO:tasks.workunit.client.0.smithi115.stdout:1/939: symlink d5/d26/d2c/d62/l151 0 2024-09-13T17:06:05.779 INFO:tasks.workunit.client.0.smithi115.stdout:1/940: truncate d5/fba 831231 0 2024-09-13T17:06:05.783 INFO:tasks.workunit.client.0.smithi115.stdout:7/901: symlink d0/d2/d67/d109/l13e 0 2024-09-13T17:06:05.784 INFO:tasks.workunit.client.0.smithi115.stdout:7/902: write d0/f13 [4165254,80323] 0 2024-09-13T17:06:05.786 INFO:tasks.workunit.client.0.smithi115.stdout:1/941: rmdir d5/d60/d7d/d87 39 2024-09-13T17:06:05.786 INFO:tasks.workunit.client.0.smithi115.stdout:1/942: write d5/d7/f77 [1387362,129706] 0 2024-09-13T17:06:05.788 INFO:tasks.workunit.client.0.smithi115.stdout:7/903: unlink d0/c96 0 2024-09-13T17:06:05.792 INFO:tasks.workunit.client.0.smithi115.stdout:7/904: creat d0/d2/d67/d86/d94/f13f x:0 0 0 2024-09-13T17:06:05.804 INFO:tasks.workunit.client.0.smithi115.stdout:1/943: dwrite d5/d60/d7d/fb6 [0,4194304] 0 2024-09-13T17:06:05.806 INFO:tasks.workunit.client.0.smithi115.stdout:1/944: creat d5/d60/d7d/d87/d147/f152 x:0 0 0 2024-09-13T17:06:05.810 INFO:tasks.workunit.client.0.smithi115.stdout:7/905: dwrite d0/d2/d67/d86/fb1 [0,4194304] 0 2024-09-13T17:06:05.813 INFO:tasks.workunit.client.0.smithi115.stdout:7/906: creat d0/d3b/d50/d21/d2f/d9e/f140 x:0 0 0 2024-09-13T17:06:05.813 INFO:tasks.workunit.client.0.smithi115.stdout:7/907: creat d0/d3b/d50/d21/d2f/f141 x:0 0 0 2024-09-13T17:06:05.816 INFO:tasks.workunit.client.0.smithi115.stdout:7/908: mkdir d0/d2/d4a/d142 0 2024-09-13T17:06:05.816 INFO:tasks.workunit.client.0.smithi115.stdout:7/909: creat d0/d3b/d50/d21/f143 x:0 0 0 2024-09-13T17:06:05.818 INFO:tasks.workunit.client.0.smithi115.stdout:7/910: link d0/d3b/d50/d21/d99/db3/d117/fb5 d0/d2/d1e/d73/f144 0 2024-09-13T17:06:05.819 INFO:tasks.workunit.client.0.smithi115.stdout:7/911: mknod d0/d2/d1e/d3d/d7c/c145 0 2024-09-13T17:06:05.819 INFO:tasks.workunit.client.0.smithi115.stdout:7/912: write d0/d3b/d50/d21/f143 [285126,130714] 0 2024-09-13T17:06:05.821 INFO:tasks.workunit.client.0.smithi115.stdout:1/945: dwrite d5/d7/d33/d3a/dc3/ddd/d10b/f115 [0,4194304] 0 2024-09-13T17:06:05.821 INFO:tasks.workunit.client.0.smithi115.stdout:1/946: write d5/d60/d7d/d87/fca [710624,76617] 0 2024-09-13T17:06:05.821 INFO:tasks.workunit.client.0.smithi115.stdout:1/947: write d5/d3e/ffc [4233544,95879] 0 2024-09-13T17:06:05.822 INFO:tasks.workunit.client.0.smithi115.stdout:7/913: rename d0/d2/d1e/d3d/d7c/fe4 to d0/d59/d11c/df1/f146 0 2024-09-13T17:06:05.822 INFO:tasks.workunit.client.0.smithi115.stdout:7/914: write d0/d3b/d50/d21/d99/db3/d117/d44/f4f [1450873,123036] 0 2024-09-13T17:06:05.822 INFO:tasks.workunit.client.0.smithi115.stdout:7/915: chown d0/d2/d1e/d3d/d6c/f30 0 1 2024-09-13T17:06:05.822 INFO:tasks.workunit.client.0.smithi115.stdout:7/916: chown d0/d2/d4a/fcb 3253288 1 2024-09-13T17:06:05.824 INFO:tasks.workunit.client.0.smithi115.stdout:1/948: symlink d5/d60/d7d/d87/d147/l153 0 2024-09-13T17:06:05.825 INFO:tasks.workunit.client.0.smithi115.stdout:1/949: creat d5/d7/f154 x:0 0 0 2024-09-13T17:06:05.825 INFO:tasks.workunit.client.0.smithi115.stdout:1/950: fdatasync d5/d7/d86/dec/f10d 0 2024-09-13T17:06:05.827 INFO:tasks.workunit.client.0.smithi115.stdout:1/951: rename d5/d3e/da1/f108 to d5/d7/f155 0 2024-09-13T17:06:05.828 INFO:tasks.workunit.client.0.smithi115.stdout:1/952: mkdir d5/d3e/dc8/ded/d156 0 2024-09-13T17:06:05.828 INFO:tasks.workunit.client.0.smithi115.stdout:1/953: dread - d5/d7/f155 zero size 2024-09-13T17:06:05.829 INFO:tasks.workunit.client.0.smithi115.stdout:1/954: truncate d5/d3e/d59/fad 1094382 0 2024-09-13T17:06:05.829 INFO:tasks.workunit.client.0.smithi115.stdout:1/955: stat d5/d3e/dc8/ffb 0 2024-09-13T17:06:05.830 INFO:tasks.workunit.client.0.smithi115.stdout:1/956: unlink d5/c24 0 2024-09-13T17:06:05.830 INFO:tasks.workunit.client.0.smithi115.stdout:1/957: fdatasync d5/fba 0 2024-09-13T17:06:05.830 INFO:tasks.workunit.client.0.smithi115.stdout:1/958: write d5/d7/d33/d3a/f9b [9012966,11743] 0 2024-09-13T17:06:05.833 INFO:tasks.workunit.client.0.smithi115.stdout:1/959: dread d5/d7/d5c/fa5 [0,4194304] 0 2024-09-13T17:06:05.834 INFO:tasks.workunit.client.0.smithi115.stdout:1/960: mknod d5/d3e/dc8/ded/c157 0 2024-09-13T17:06:05.842 INFO:tasks.workunit.client.0.smithi115.stdout:1/961: write d5/d7/d33/d3a/d11c/f13a [3451442,9622] 0 2024-09-13T17:06:05.843 INFO:tasks.workunit.client.0.smithi115.stdout:1/962: mknod d5/d7/d33/d3a/dc3/dfd/c158 0 2024-09-13T17:06:05.844 INFO:tasks.workunit.client.0.smithi115.stdout:1/963: creat d5/d3e/d59/f159 x:0 0 0 2024-09-13T17:06:05.844 INFO:tasks.workunit.client.0.smithi115.stdout:1/964: write d5/d3e/dc8/ffb [180906,9958] 0 2024-09-13T17:06:05.852 INFO:tasks.workunit.client.0.smithi115.stdout:1/965: write d5/d26/f4d [7136808,125121] 0 2024-09-13T17:06:05.859 INFO:tasks.workunit.client.0.smithi115.stdout:1/966: dread d5/d7/d5c/f7b [0,4194304] 0 2024-09-13T17:06:05.861 INFO:tasks.workunit.client.0.smithi115.stdout:1/967: getdents d5/d7/d33/d3a/dc3 0 2024-09-13T17:06:05.869 INFO:tasks.workunit.client.0.smithi115.stdout:7/917: fsync d0/d3b/d50/d21/f33 0 2024-09-13T17:06:05.869 INFO:tasks.workunit.client.0.smithi115.stdout:7/918: readlink d0/d2/d1e/d3d/d6c/d71/l107 0 2024-09-13T17:06:05.869 INFO:tasks.workunit.client.0.smithi115.stdout:7/919: getdents d0/d3b/d50/d21/d99/db3/d117/d44/da7/dea 0 2024-09-13T17:06:05.871 INFO:tasks.workunit.client.0.smithi115.stdout:7/920: mknod d0/d2/d1e/de5/dfb/c147 0 2024-09-13T17:06:05.871 INFO:tasks.workunit.client.0.smithi115.stdout:7/921: fdatasync d0/d3b/d54/f11a 0 2024-09-13T17:06:05.873 INFO:tasks.workunit.client.0.smithi115.stdout:7/922: dread d0/d2/d4a/fcb [0,4194304] 0 2024-09-13T17:06:05.873 INFO:tasks.workunit.client.0.smithi115.stdout:7/923: write d0/d2/d67/d86/ff4 [1682374,32332] 0 2024-09-13T17:06:05.875 INFO:tasks.workunit.client.0.smithi115.stdout:7/924: symlink d0/d2/d1e/d3d/d7c/l148 0 2024-09-13T17:06:05.876 INFO:tasks.workunit.client.0.smithi115.stdout:7/925: mkdir d0/d3b/d50/d21/de2/d149 0 2024-09-13T17:06:05.878 INFO:tasks.workunit.client.0.smithi115.stdout:7/926: link d0/d3b/lc3 d0/d2/d67/d86/d94/d9b/dbb/d11d/l14a 0 2024-09-13T17:06:05.880 INFO:tasks.workunit.client.0.smithi115.stdout:7/927: unlink d0/d3b/d50/d21/d2f/lb2 0 2024-09-13T17:06:05.880 INFO:tasks.workunit.client.0.smithi115.stdout:7/928: write d0/d3b/d50/d21/d99/db3/d117/fce [1611754,12520] 0 2024-09-13T17:06:05.880 INFO:tasks.workunit.client.0.smithi115.stdout:7/929: fsync d0/d2/d4a/f81 0 2024-09-13T17:06:05.882 INFO:tasks.workunit.client.0.smithi115.stdout:7/930: truncate d0/d2/d67/d86/d94/d9b/f129 48201 0 2024-09-13T17:06:06.131 INFO:tasks.workunit.client.0.smithi115.stdout:7/931: rmdir d0/d2/d67/d86/d94/d9b 39 2024-09-13T17:06:06.142 INFO:tasks.workunit.client.0.smithi115.stdout:1/968: dwrite d5/d7/d33/d3a/db2/de2/feb [0,4194304] 0 2024-09-13T17:06:06.160 INFO:tasks.workunit.client.0.smithi115.stdout:7/932: dwrite d0/d2/d1e/f6f [0,4194304] 0 2024-09-13T17:06:06.166 INFO:tasks.workunit.client.0.smithi115.stdout:1/969: dwrite d5/f6b [4194304,4194304] 0 2024-09-13T17:06:06.166 INFO:tasks.workunit.client.0.smithi115.stdout:1/970: creat d5/d7/d33/d3a/dc3/dfd/f15a x:0 0 0 2024-09-13T17:06:06.208 INFO:tasks.workunit.client.0.smithi115.stdout:7/933: unlink d0/d3b/d50/d21/d2f/d9e/l101 0 2024-09-13T17:06:06.208 INFO:tasks.workunit.client.0.smithi115.stdout:7/934: write d0/d2/d1e/dd8/f11b [180686,110003] 0 2024-09-13T17:06:06.209 INFO:tasks.workunit.client.0.smithi115.stdout:7/935: creat d0/d97/f14b x:0 0 0 2024-09-13T17:06:06.234 INFO:tasks.workunit.client.0.smithi115.stdout:7/936: link d0/d2/d1e/d3d/d6c/d71/l107 d0/d3b/d50/d21/d99/db3/d117/d44/l14c 0 2024-09-13T17:06:06.235 INFO:tasks.workunit.client.0.smithi115.stdout:7/937: truncate d0/d2/d67/d86/d94/d9b/f129 201565 0 2024-09-13T17:06:06.235 INFO:tasks.workunit.client.0.smithi115.stdout:7/938: read - d0/d2/d67/d86/d94/f13f zero size 2024-09-13T17:06:06.235 INFO:tasks.workunit.client.0.smithi115.stdout:7/939: write d0/d3b/d50/d21/d2f/fed [872769,13991] 0 2024-09-13T17:06:06.235 INFO:tasks.workunit.client.0.smithi115.stdout:7/940: creat d0/d2/d4a/d142/f14d x:0 0 0 2024-09-13T17:06:06.244 INFO:tasks.workunit.client.0.smithi115.stdout:7/941: dread d0/d2/d1e/d3d/d6c/f30 [4194304,4194304] 0 2024-09-13T17:06:06.244 INFO:tasks.workunit.client.0.smithi115.stdout:7/942: chown d0/c119 5040 1 2024-09-13T17:06:06.245 INFO:tasks.workunit.client.0.smithi115.stdout:7/943: write d0/d2/d67/d70/f128 [710703,42141] 0 2024-09-13T17:06:06.245 INFO:tasks.workunit.client.0.smithi115.stdout:1/971: mkdir d5/d7/d33/d3a/d15b 0 2024-09-13T17:06:06.247 INFO:tasks.workunit.client.0.smithi115.stdout:1/972: rename d5/d60/d7d/d87/cb1 to d5/d60/d7d/d87/d147/c15c 0 2024-09-13T17:06:06.250 INFO:tasks.workunit.client.0.smithi115.stdout:1/973: rename d5/d60/d8e/f123 to d5/d7/d33/d3a/dc3/ddd/df4/d102/f15d 0 2024-09-13T17:06:06.250 INFO:tasks.workunit.client.0.smithi115.stdout:1/974: read d5/f6b [592388,110682] 0 2024-09-13T17:06:06.251 INFO:tasks.workunit.client.0.smithi115.stdout:1/975: mknod d5/d60/d7d/c15e 0 2024-09-13T17:06:06.251 INFO:tasks.workunit.client.0.smithi115.stdout:1/976: chown d5/d60/c124 9268 1 2024-09-13T17:06:06.253 INFO:tasks.workunit.client.0.smithi115.stdout:1/977: symlink d5/d7/d33/d3a/db2/de2/l15f 0 2024-09-13T17:06:06.253 INFO:tasks.workunit.client.0.smithi115.stdout:1/978: chown d5/d60/d7d/d87/d147/f152 6725 1 2024-09-13T17:06:06.253 INFO:tasks.workunit.client.0.smithi115.stdout:1/979: creat d5/f160 x:0 0 0 2024-09-13T17:06:06.253 INFO:tasks.workunit.client.0.smithi115.stdout:1/980: write d5/d7/d5c/faa [5163160,129328] 0 2024-09-13T17:06:06.256 INFO:tasks.workunit.client.0.smithi115.stdout:1/981: dread d5/d26/d2c/f32 [0,4194304] 0 2024-09-13T17:06:06.258 INFO:tasks.workunit.client.0.smithi115.stdout:1/982: mknod d5/d3e/dc8/d11f/c161 0 2024-09-13T17:06:06.261 INFO:tasks.workunit.client.0.smithi115.stdout:7/944: dwrite d0/d3b/d50/d21/d99/db3/d117/d44/f11e [0,4194304] 0 2024-09-13T17:06:06.268 INFO:tasks.workunit.client.0.smithi115.stdout:7/945: dread d0/d3b/d50/d21/d2f/fed [0,4194304] 0 2024-09-13T17:06:06.268 INFO:tasks.workunit.client.0.smithi115.stdout:7/946: chown d0/d3b/cd6 15 1 2024-09-13T17:06:06.269 INFO:tasks.workunit.client.0.smithi115.stdout:7/947: link d0/l9 d0/d59/l14e 0 2024-09-13T17:06:06.271 INFO:tasks.workunit.client.0.smithi115.stdout:7/948: rename d0/d59/ca4 to d0/d3b/d50/d21/de2/c14f 0 2024-09-13T17:06:06.272 INFO:tasks.workunit.client.0.smithi115.stdout:7/949: rename d0/c119 to d0/d59/d11c/df1/d127/c150 0 2024-09-13T17:06:06.272 INFO:tasks.workunit.client.0.smithi115.stdout:7/950: write d0/d2/d1e/f32 [9207333,1439] 0 2024-09-13T17:06:06.275 INFO:tasks.workunit.client.0.smithi115.stdout:7/951: rename d0/d2/d67/d86/d94/d9b/lae to d0/d3b/d50/d21/d2f/d9e/dff/l151 0 2024-09-13T17:06:06.275 INFO:tasks.workunit.client.0.smithi115.stdout:7/952: write d0/d59/fd1 [1033694,113384] 0 2024-09-13T17:06:06.276 INFO:tasks.workunit.client.0.smithi115.stdout:1/983: dwrite d5/d7/d86/ffe [0,4194304] 0 2024-09-13T17:06:06.279 INFO:tasks.workunit.client.0.smithi115.stdout:7/953: dread d0/d3b/d50/d21/f143 [0,4194304] 0 2024-09-13T17:06:06.279 INFO:tasks.workunit.client.0.smithi115.stdout:7/954: chown d0/d3b/d50/d21/d99/db3/d117/d44/dac/dbf 1903982 1 2024-09-13T17:06:06.280 INFO:tasks.workunit.client.0.smithi115.stdout:1/984: rename d5/ld0 to d5/d3e/da1/l162 0 2024-09-13T17:06:06.282 INFO:tasks.workunit.client.0.smithi115.stdout:7/955: mknod d0/d3b/d50/d21/d99/db3/d117/c152 0 2024-09-13T17:06:06.287 INFO:tasks.workunit.client.0.smithi115.stdout:7/956: mkdir d0/d3b/d50/d21/d99/db3/d117/d44/d12b/d153 0 2024-09-13T17:06:06.289 INFO:tasks.workunit.client.0.smithi115.stdout:7/957: truncate d0/d2/d1e/d3d/d6c/d71/f61 157742 0 2024-09-13T17:06:06.295 INFO:tasks.workunit.client.0.smithi115.stdout:1/985: dwrite d5/d3e/d59/fe7 [0,4194304] 0 2024-09-13T17:06:06.295 INFO:tasks.workunit.client.0.smithi115.stdout:1/986: fsync d5/d26/dc9/dea/ff1 0 2024-09-13T17:06:06.298 INFO:tasks.workunit.client.0.smithi115.stdout:1/987: creat d5/d26/dc9/dea/f163 x:0 0 0 2024-09-13T17:06:06.298 INFO:tasks.workunit.client.0.smithi115.stdout:1/988: fdatasync d5/d3e/d59/f159 0 2024-09-13T17:06:06.315 INFO:tasks.workunit.client.0.smithi115.stdout:1/989: dwrite d5/d7/d5c/faa [0,4194304] 0 2024-09-13T17:06:06.315 INFO:tasks.workunit.client.0.smithi115.stdout:1/990: getdents d5/d3e/da1/d149 0 2024-09-13T17:06:06.317 INFO:tasks.workunit.client.0.smithi115.stdout:1/991: mkdir d5/d3e/d59/d164 0 2024-09-13T17:06:06.317 INFO:tasks.workunit.client.0.smithi115.stdout:1/992: truncate d5/d26/d2c/fb3 1129033 0 2024-09-13T17:06:06.317 INFO:tasks.workunit.client.0.smithi115.stdout:1/993: readlink d5/l11 0 2024-09-13T17:06:06.317 INFO:tasks.workunit.client.0.smithi115.stdout:1/994: creat d5/d7/d5c/dbc/f165 x:0 0 0 2024-09-13T17:06:06.333 INFO:tasks.workunit.client.0.smithi115.stdout:1/995: dwrite d5/d3e/dc8/f126 [4194304,4194304] 0 2024-09-13T17:06:06.333 INFO:tasks.workunit.client.0.smithi115.stdout:1/996: stat d5/d3e/d59/f12b 0 2024-09-13T17:06:06.334 INFO:tasks.workunit.client.0.smithi115.stdout:1/997: write d5/d7/d33/d3a/d11c/f13a [2556842,117487] 0 2024-09-13T17:06:06.337 INFO:tasks.workunit.client.0.smithi115.stdout:1/998: rmdir d5/d3e/dc8/ded/d156 0 2024-09-13T17:06:06.337 INFO:tasks.workunit.client.0.smithi115.stdout:1/999: read d5/d60/d7d/d87/fca [2008116,9602] 0 2024-09-13T17:06:06.368 INFO:tasks.workunit.client.0.smithi115.stdout:6/904: sync 2024-09-13T17:06:06.368 INFO:tasks.workunit.client.0.smithi115.stdout:0/853: sync 2024-09-13T17:06:06.368 INFO:tasks.workunit.client.0.smithi115.stdout:9/869: sync 2024-09-13T17:06:06.368 INFO:tasks.workunit.client.0.smithi115.stdout:5/973: sync 2024-09-13T17:06:06.368 INFO:tasks.workunit.client.0.smithi115.stdout:5/974: fsync d19/f143 0 2024-09-13T17:06:06.368 INFO:tasks.workunit.client.0.smithi115.stdout:6/905: fdatasync d8/d13/d7b/f8f 0 2024-09-13T17:06:06.368 INFO:tasks.workunit.client.0.smithi115.stdout:9/870: read d0/dd7/d114/f71 [157215,84117] 0 2024-09-13T17:06:06.371 INFO:tasks.workunit.client.0.smithi115.stdout:0/854: creat d9/d1d/de1/d30/dc2/f10d x:0 0 0 2024-09-13T17:06:06.372 INFO:tasks.workunit.client.0.smithi115.stdout:0/855: read - d9/d1d/d24/d26/fe8 zero size 2024-09-13T17:06:06.376 INFO:tasks.workunit.client.0.smithi115.stdout:9/871: link d0/dd7/d114/d15/l2c d0/de/d37/d83/d128/l12d 0 2024-09-13T17:06:06.377 INFO:tasks.workunit.client.0.smithi115.stdout:5/975: truncate d19/d1d/f9a 4658750 0 2024-09-13T17:06:06.379 INFO:tasks.workunit.client.0.smithi115.stdout:0/856: mkdir d9/d1d/d24/d26/d36/d48/d10e 0 2024-09-13T17:06:06.381 INFO:tasks.workunit.client.0.smithi115.stdout:5/976: getdents d19 0 2024-09-13T17:06:06.381 INFO:tasks.workunit.client.0.smithi115.stdout:5/977: creat d19/d2b/f146 x:0 0 0 2024-09-13T17:06:06.381 INFO:tasks.workunit.client.0.smithi115.stdout:5/978: chown d19/d2b/d32/d55/d5e/l42 3 1 2024-09-13T17:06:06.382 INFO:tasks.workunit.client.0.smithi115.stdout:5/979: symlink d19/d2b/d77/l147 0 2024-09-13T17:06:06.387 INFO:tasks.workunit.client.0.smithi115.stdout:6/906: dwrite d8/d33/d40/d4c/f62 [0,4194304] 0 2024-09-13T17:06:06.389 INFO:tasks.workunit.client.0.smithi115.stdout:0/857: dread d9/d1d/d24/d26/fe3 [4194304,4194304] 0 2024-09-13T17:06:06.391 INFO:tasks.workunit.client.0.smithi115.stdout:5/980: rmdir d19/d2b 39 2024-09-13T17:06:06.392 INFO:tasks.workunit.client.0.smithi115.stdout:6/907: mkdir d8/db/d49/d8d/d11b/d120 0 2024-09-13T17:06:06.395 INFO:tasks.workunit.client.0.smithi115.stdout:5/981: creat d19/d2b/d32/d55/d5e/d87/db0/f148 x:0 0 0 2024-09-13T17:06:06.395 INFO:tasks.workunit.client.0.smithi115.stdout:5/982: write d19/d2e/d6b/f13f [767116,78941] 0 2024-09-13T17:06:06.395 INFO:tasks.workunit.client.0.smithi115.stdout:5/983: truncate d19/d2b/d32/d55/d5e/d87/db0/dde/f110 606619 0 2024-09-13T17:06:06.396 INFO:tasks.workunit.client.0.smithi115.stdout:5/984: truncate f3 931190 0 2024-09-13T17:06:06.397 INFO:tasks.workunit.client.0.smithi115.stdout:9/872: dwrite d0/de/d37/dc5/f9b [0,4194304] 0 2024-09-13T17:06:06.397 INFO:tasks.workunit.client.0.smithi115.stdout:9/873: chown d0/d21/d65/d79/fd9 330394727 1 2024-09-13T17:06:06.400 INFO:tasks.workunit.client.0.smithi115.stdout:9/874: mknod d0/d21/d65/c12e 0 2024-09-13T17:06:06.401 INFO:tasks.workunit.client.0.smithi115.stdout:9/875: symlink d0/d21/d65/d6f/dad/ded/l12f 0 2024-09-13T17:06:06.403 INFO:tasks.workunit.client.0.smithi115.stdout:9/876: rename d0/d34 to d0/de/d37/d105/d12a/d130 0 2024-09-13T17:06:06.403 INFO:tasks.workunit.client.0.smithi115.stdout:9/877: chown d0/de4 7 1 2024-09-13T17:06:06.403 INFO:tasks.workunit.client.0.smithi115.stdout:9/878: write d0/de/d37/fba [652763,8235] 0 2024-09-13T17:06:06.405 INFO:tasks.workunit.client.0.smithi115.stdout:9/879: unlink d0/de4/c11f 0 2024-09-13T17:06:06.406 INFO:tasks.workunit.client.0.smithi115.stdout:5/985: dread d19/d1d/f124 [0,4194304] 0 2024-09-13T17:06:06.406 INFO:tasks.workunit.client.0.smithi115.stdout:9/880: mkdir d0/de/d37/d105/d12a/d131 0 2024-09-13T17:06:06.407 INFO:tasks.workunit.client.0.smithi115.stdout:5/986: symlink d19/d2c/dd0/l149 0 2024-09-13T17:06:06.407 INFO:tasks.workunit.client.0.smithi115.stdout:5/987: fdatasync d19/d2e/dc6/f12f 0 2024-09-13T17:06:06.411 INFO:tasks.workunit.client.0.smithi115.stdout:0/858: dwrite d9/f18 [4194304,4194304] 0 2024-09-13T17:06:06.411 INFO:tasks.workunit.client.0.smithi115.stdout:6/908: dwrite d8/d33/d40/d67/db4/dbf/feb [4194304,4194304] 0 2024-09-13T17:06:06.411 INFO:tasks.workunit.client.0.smithi115.stdout:6/909: dread - d8/d33/d40/d67/db4/d24/d53/d6a/f10b zero size 2024-09-13T17:06:06.412 INFO:tasks.workunit.client.0.smithi115.stdout:6/910: fdatasync d8/d33/d40/d67/db4/d24/d53/d6a/fcc 0 2024-09-13T17:06:06.415 INFO:tasks.workunit.client.0.smithi115.stdout:6/911: mknod d8/d33/d40/d4c/d66/c121 0 2024-09-13T17:06:06.416 INFO:tasks.workunit.client.0.smithi115.stdout:9/881: dread d0/d21/d65/f84 [0,4194304] 0 2024-09-13T17:06:06.416 INFO:tasks.workunit.client.0.smithi115.stdout:0/859: dread d9/d1d/de1/d78/fbe [0,4194304] 0 2024-09-13T17:06:06.417 INFO:tasks.workunit.client.0.smithi115.stdout:6/912: rmdir d8/d13/dd7 39 2024-09-13T17:06:06.417 INFO:tasks.workunit.client.0.smithi115.stdout:6/913: stat d8/db/dd/da2/d117/f106 0 2024-09-13T17:06:06.418 INFO:tasks.workunit.client.0.smithi115.stdout:9/882: truncate d0/f8 1592624 0 2024-09-13T17:06:06.420 INFO:tasks.workunit.client.0.smithi115.stdout:6/914: mkdir d8/d33/d7f/d122 0 2024-09-13T17:06:06.421 INFO:tasks.workunit.client.0.smithi115.stdout:9/883: link d0/d9c/c116 d0/de/d37/d83/dc2/ddd/dee/c132 0 2024-09-13T17:06:06.422 INFO:tasks.workunit.client.0.smithi115.stdout:9/884: dread - d0/d21/d65/f12b zero size 2024-09-13T17:06:06.422 INFO:tasks.workunit.client.0.smithi115.stdout:5/988: dwrite d19/d2c/dd3/f121 [0,4194304] 0 2024-09-13T17:06:06.426 INFO:tasks.workunit.client.0.smithi115.stdout:6/915: mkdir d8/db/d49/d8d/d123 0 2024-09-13T17:06:06.429 INFO:tasks.workunit.client.0.smithi115.stdout:9/885: link d0/d21/d4f/f5e d0/de4/f133 0 2024-09-13T17:06:06.431 INFO:tasks.workunit.client.0.smithi115.stdout:5/989: write d19/d2b/d32/d55/d5e/f67 [6032998,92910] 0 2024-09-13T17:06:06.436 INFO:tasks.workunit.client.0.smithi115.stdout:6/916: mkdir d8/db/dd/d124 0 2024-09-13T17:06:06.438 INFO:tasks.workunit.client.0.smithi115.stdout:9/886: dread d0/de/d37/dc5/f9b [0,4194304] 0 2024-09-13T17:06:06.438 INFO:tasks.workunit.client.0.smithi115.stdout:9/887: fdatasync d0/de/d37/dc5/ff1 0 2024-09-13T17:06:06.440 INFO:tasks.workunit.client.0.smithi115.stdout:5/990: read d19/d21/dcc/f105 [1092577,55282] 0 2024-09-13T17:06:06.440 INFO:tasks.workunit.client.0.smithi115.stdout:5/991: fsync d19/d2b/d32/d55/f4c 0 2024-09-13T17:06:06.442 INFO:tasks.workunit.client.0.smithi115.stdout:9/888: link d0/d21/d42/c76 d0/d21/d65/d6f/dad/dc3/c134 0 2024-09-13T17:06:06.442 INFO:tasks.workunit.client.0.smithi115.stdout:5/992: getdents d19/d2b/d77 0 2024-09-13T17:06:06.442 INFO:tasks.workunit.client.0.smithi115.stdout:5/993: fdatasync d19/d2b/d69/f118 0 2024-09-13T17:06:06.444 INFO:tasks.workunit.client.0.smithi115.stdout:9/889: creat d0/dd7/d114/d15/f135 x:0 0 0 2024-09-13T17:06:06.445 INFO:tasks.workunit.client.0.smithi115.stdout:6/917: write d8/db/d49/d8d/fd5 [3708812,43533] 0 2024-09-13T17:06:06.446 INFO:tasks.workunit.client.0.smithi115.stdout:5/994: link d19/d2e/dc6/f123 d19/d2b/d32/d55/d5e/d87/da4/da6/d106/f14a 0 2024-09-13T17:06:06.446 INFO:tasks.workunit.client.0.smithi115.stdout:5/995: write d19/d2b/fa8 [4457629,72275] 0 2024-09-13T17:06:06.450 INFO:tasks.workunit.client.0.smithi115.stdout:9/890: rename d0/d21/d42/c82 to d0/d21/d65/d79/c136 0 2024-09-13T17:06:06.453 INFO:tasks.workunit.client.0.smithi115.stdout:9/891: mkdir d0/d21/d65/d79/d137 0 2024-09-13T17:06:06.455 INFO:tasks.workunit.client.0.smithi115.stdout:9/892: symlink d0/dd7/l138 0 2024-09-13T17:06:06.455 INFO:tasks.workunit.client.0.smithi115.stdout:9/893: write d0/d21/d65/d79/fd9 [1309550,106410] 0 2024-09-13T17:06:06.455 INFO:tasks.workunit.client.0.smithi115.stdout:9/894: chown d0/de/d37/d105/d12a/d130/l5b 392588458 1 2024-09-13T17:06:06.457 INFO:tasks.workunit.client.0.smithi115.stdout:9/895: mknod d0/d21/d4f/c139 0 2024-09-13T17:06:06.461 INFO:tasks.workunit.client.0.smithi115.stdout:9/896: link d0/dd7/d114/d15/d7f/c8c d0/de/d37/c13a 0 2024-09-13T17:06:06.467 INFO:tasks.workunit.client.0.smithi115.stdout:6/918: dwrite d8/d33/d40/d4c/f62 [0,4194304] 0 2024-09-13T17:06:06.469 INFO:tasks.workunit.client.0.smithi115.stdout:5/996: dwrite d19/d2b/d32/f133 [0,4194304] 0 2024-09-13T17:06:06.469 INFO:tasks.workunit.client.0.smithi115.stdout:5/997: write d19/d2b/d32/f95 [3186948,38058] 0 2024-09-13T17:06:06.474 INFO:tasks.workunit.client.0.smithi115.stdout:5/998: creat d19/d2b/d69/db6/f14b x:0 0 0 2024-09-13T17:06:06.481 INFO:tasks.workunit.client.0.smithi115.stdout:6/919: dwrite d8/d33/d40/d4c/d66/df8/f108 [0,4194304] 0 2024-09-13T17:06:06.483 INFO:tasks.workunit.client.0.smithi115.stdout:5/999: dread d19/d21/d3a/f82 [0,4194304] 0 2024-09-13T17:06:06.497 INFO:tasks.workunit.client.0.smithi115.stdout:6/920: dwrite d8/db/d49/d8d/ffc [0,4194304] 0 2024-09-13T17:06:06.497 INFO:tasks.workunit.client.0.smithi115.stdout:6/921: truncate d8/d33/d40/d4c/ff5 182348 0 2024-09-13T17:06:06.499 INFO:tasks.workunit.client.0.smithi115.stdout:6/922: link d8/d33/d40/d67/db4/d24/d53/lbc d8/d33/d7f/d99/l125 0 2024-09-13T17:06:06.507 INFO:tasks.workunit.client.0.smithi115.stdout:6/923: write d8/db/f7e [2581557,34631] 0 2024-09-13T17:06:06.508 INFO:tasks.workunit.client.0.smithi115.stdout:6/924: truncate d8/db/d49/fe7 1642639 0 2024-09-13T17:06:06.508 INFO:tasks.workunit.client.0.smithi115.stdout:6/925: mkdir d8/d13/dd7/d126 0 2024-09-13T17:06:06.509 INFO:tasks.workunit.client.0.smithi115.stdout:6/926: creat d8/d13/d7b/d115/f127 x:0 0 0 2024-09-13T17:06:06.511 INFO:tasks.workunit.client.0.smithi115.stdout:6/927: rename d8/d33/d40/d67/db4/f109 to d8/d13/dd7/f128 0 2024-09-13T17:06:06.511 INFO:tasks.workunit.client.0.smithi115.stdout:6/928: chown d8/d13/dd7/d126 3228086 1 2024-09-13T17:06:06.513 INFO:tasks.workunit.client.0.smithi115.stdout:6/929: dread d8/d13/f4e [0,4194304] 0 2024-09-13T17:06:06.513 INFO:tasks.workunit.client.0.smithi115.stdout:6/930: stat d8/d33/d82/d80/fa5 0 2024-09-13T17:06:06.513 INFO:tasks.workunit.client.0.smithi115.stdout:6/931: dread - d8/d13/d7b/d115/f127 zero size 2024-09-13T17:06:06.515 INFO:tasks.workunit.client.0.smithi115.stdout:6/932: mkdir d8/d33/d40/d67/db4/dbf/d129 0 2024-09-13T17:06:06.518 INFO:tasks.workunit.client.0.smithi115.stdout:6/933: creat d8/d33/d40/d67/db4/d24/f12a x:0 0 0 2024-09-13T17:06:06.519 INFO:tasks.workunit.client.0.smithi115.stdout:6/934: mknod d8/d33/d7f/d122/c12b 0 2024-09-13T17:06:06.522 INFO:tasks.workunit.client.0.smithi115.stdout:6/935: mkdir d8/d13/d7b/d115/d12c 0 2024-09-13T17:06:06.523 INFO:tasks.workunit.client.0.smithi115.stdout:6/936: dread d8/db/dd/da2/db3/fb5 [0,4194304] 0 2024-09-13T17:06:06.536 INFO:tasks.workunit.client.0.smithi115.stdout:6/937: dwrite d8/d33/d40/d67/db4/f4f [4194304,4194304] 0 2024-09-13T17:06:06.538 INFO:tasks.workunit.client.0.smithi115.stdout:6/938: symlink d8/db/d1d/l12d 0 2024-09-13T17:06:06.539 INFO:tasks.workunit.client.0.smithi115.stdout:6/939: unlink d8/db/d49/d8d/cef 0 2024-09-13T17:06:06.540 INFO:tasks.workunit.client.0.smithi115.stdout:6/940: dread d8/d33/d40/d4c/fd9 [0,4194304] 0 2024-09-13T17:06:06.548 INFO:tasks.workunit.client.0.smithi115.stdout:6/941: write d8/d13/f9d [2955137,74748] 0 2024-09-13T17:06:06.548 INFO:tasks.workunit.client.0.smithi115.stdout:6/942: stat d8/l44 0 2024-09-13T17:06:06.548 INFO:tasks.workunit.client.0.smithi115.stdout:6/943: stat d8/d13/dd7/d126 0 2024-09-13T17:06:06.549 INFO:tasks.workunit.client.0.smithi115.stdout:6/944: truncate d8/d33/d40/d67/db4/d24/d53/d6a/f9a 756097 0 2024-09-13T17:06:06.551 INFO:tasks.workunit.client.0.smithi115.stdout:6/945: symlink d8/db/dd/da2/db3/l12e 0 2024-09-13T17:06:07.136 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:06 smithi195 ceph-mon[34981]: pgmap v22: 65 pgs: 65 active+clean; 3.6 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 291 MiB/s rd, 343 MiB/s wr, 509 op/s 2024-09-13T17:06:07.178 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:06 smithi115 ceph-mon[27708]: pgmap v22: 65 pgs: 65 active+clean; 3.6 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 291 MiB/s rd, 343 MiB/s wr, 509 op/s 2024-09-13T17:06:07.271 INFO:tasks.workunit.client.0.smithi115.stdout:0/860: sync 2024-09-13T17:06:07.271 INFO:tasks.workunit.client.0.smithi115.stdout:7/958: sync 2024-09-13T17:06:07.272 INFO:tasks.workunit.client.0.smithi115.stdout:0/861: chown d9/d27/d88 881 1 2024-09-13T17:06:07.272 INFO:tasks.workunit.client.0.smithi115.stdout:0/862: dread - d9/d1d/d24/d26/d36/dd7/f10c zero size 2024-09-13T17:06:07.272 INFO:tasks.workunit.client.0.smithi115.stdout:0/863: write d9/d1d/de1/d30/dc2/f10d [982009,78301] 0 2024-09-13T17:06:07.272 INFO:tasks.workunit.client.0.smithi115.stdout:7/959: creat d0/d3b/d50/d21/d99/db3/d117/d44/d12b/f154 x:0 0 0 2024-09-13T17:06:07.273 INFO:tasks.workunit.client.0.smithi115.stdout:0/864: creat d9/d1d/d24/d26/f10f x:0 0 0 2024-09-13T17:06:07.274 INFO:tasks.workunit.client.0.smithi115.stdout:0/865: chown d9/d1d/de1/d30/dc2/ddc/lf4 842 1 2024-09-13T17:06:07.274 INFO:tasks.workunit.client.0.smithi115.stdout:0/866: write d9/d1d/de1/d30/d46/f49 [1773525,41086] 0 2024-09-13T17:06:07.274 INFO:tasks.workunit.client.0.smithi115.stdout:0/867: chown d9/d1d/d24/d26/d5d/d66/db1/f103 3637 1 2024-09-13T17:06:07.275 INFO:tasks.workunit.client.0.smithi115.stdout:7/960: creat d0/d3b/d50/d21/de2/d149/f155 x:0 0 0 2024-09-13T17:06:07.275 INFO:tasks.workunit.client.0.smithi115.stdout:7/961: unlink d0/d2/d67/d86/ff4 0 2024-09-13T17:06:07.277 INFO:tasks.workunit.client.0.smithi115.stdout:7/962: getdents d0/d2/d1e/de5 0 2024-09-13T17:06:07.277 INFO:tasks.workunit.client.0.smithi115.stdout:7/963: chown d0/d3b/d50/d21/d2f/d9e/dff 51444430 1 2024-09-13T17:06:07.277 INFO:tasks.workunit.client.0.smithi115.stdout:7/964: fsync d0/d2/d1e/d3d/d6c/d71/fe8 0 2024-09-13T17:06:07.282 INFO:tasks.workunit.client.0.smithi115.stdout:0/868: dread d9/d1d/de1/d78/f7f [4194304,4194304] 0 2024-09-13T17:06:07.290 INFO:tasks.workunit.client.0.smithi115.stdout:0/869: dread d9/d1d/d24/d26/d7b/ff7 [0,4194304] 0 2024-09-13T17:06:07.291 INFO:tasks.workunit.client.0.smithi115.stdout:0/870: truncate d9/d27/fac 874273 0 2024-09-13T17:06:07.293 INFO:tasks.workunit.client.0.smithi115.stdout:0/871: rename d9/d1d/de1/d30/d5c to d9/d1d/de1/d110 0 2024-09-13T17:06:07.296 INFO:tasks.workunit.client.0.smithi115.stdout:7/965: dwrite d0/d2/d1e/d3d/d6c/f30 [0,4194304] 0 2024-09-13T17:06:07.299 INFO:tasks.workunit.client.0.smithi115.stdout:7/966: rename d0/d3b/d50/d21/d99/db3/d117/d44/d12b/d153 to d0/d3b/d50/d156 0 2024-09-13T17:06:07.309 INFO:tasks.workunit.client.0.smithi115.stdout:7/967: write d0/d3b/d50/d21/d99/db3/d117/f2c [299114,24747] 0 2024-09-13T17:06:07.312 INFO:tasks.workunit.client.0.smithi115.stdout:7/968: mkdir d0/d2/d1e/d157 0 2024-09-13T17:06:07.315 INFO:tasks.workunit.client.0.smithi115.stdout:0/872: dwrite d9/d27/d88/d9e/fd0 [4194304,4194304] 0 2024-09-13T17:06:07.315 INFO:tasks.workunit.client.0.smithi115.stdout:0/873: creat d9/d27/d88/d9e/dad/f111 x:0 0 0 2024-09-13T17:06:07.325 INFO:tasks.workunit.client.0.smithi115.stdout:0/874: rmdir d9/d1d/d24/d7d 39 2024-09-13T17:06:07.327 INFO:tasks.workunit.client.0.smithi115.stdout:0/875: mkdir d9/d1d/d24/d26/d36/dd7/d112 0 2024-09-13T17:06:07.327 INFO:tasks.workunit.client.0.smithi115.stdout:0/876: truncate d9/d1d/d24/ff8 33474 0 2024-09-13T17:06:07.481 INFO:tasks.workunit.client.0.smithi115.stdout:6/946: sync 2024-09-13T17:06:07.481 INFO:tasks.workunit.client.0.smithi115.stdout:9/897: sync 2024-09-13T17:06:07.481 INFO:tasks.workunit.client.0.smithi115.stdout:6/947: write d8/db/d49/fe7 [421638,117119] 0 2024-09-13T17:06:07.481 INFO:tasks.workunit.client.0.smithi115.stdout:6/948: readlink d8/d33/d7f/d99/l125 0 2024-09-13T17:06:07.481 INFO:tasks.workunit.client.0.smithi115.stdout:6/949: stat d8/d13/dd7/cf7 0 2024-09-13T17:06:07.483 INFO:tasks.workunit.client.0.smithi115.stdout:9/898: creat d0/de/d37/d83/dc2/d124/f13b x:0 0 0 2024-09-13T17:06:07.483 INFO:tasks.workunit.client.0.smithi115.stdout:9/899: write d0/de/d37/d83/dc2/ddd/d8d/f10e [197022,107450] 0 2024-09-13T17:06:07.484 INFO:tasks.workunit.client.0.smithi115.stdout:6/950: mkdir d8/db/dd/da2/d117/d12f 0 2024-09-13T17:06:07.486 INFO:tasks.workunit.client.0.smithi115.stdout:9/900: getdents d0/de/d37/d83/d91 0 2024-09-13T17:06:07.487 INFO:tasks.workunit.client.0.smithi115.stdout:9/901: creat d0/dd7/d114/f13c x:0 0 0 2024-09-13T17:06:07.489 INFO:tasks.workunit.client.0.smithi115.stdout:9/902: mkdir d0/d21/d65/dfb/d13d 0 2024-09-13T17:06:07.490 INFO:tasks.workunit.client.0.smithi115.stdout:9/903: stat d0/d21/c68 0 2024-09-13T17:06:07.492 INFO:tasks.workunit.client.0.smithi115.stdout:9/904: link d0/d21/d65/d6f/dad/fe0 d0/f13e 0 2024-09-13T17:06:07.494 INFO:tasks.workunit.client.0.smithi115.stdout:9/905: truncate d0/d21/d4f/f5e 1002027 0 2024-09-13T17:06:07.539 INFO:tasks.workunit.client.0.smithi115.stdout:0/877: dwrite d9/d27/fba [0,4194304] 0 2024-09-13T17:06:07.543 INFO:tasks.workunit.client.0.smithi115.stdout:0/878: unlink d9/d27/d88/d99/dc7/f92 0 2024-09-13T17:06:08.000 INFO:tasks.workunit.client.0.smithi115.stdout:6/951: sync 2024-09-13T17:06:08.001 INFO:tasks.workunit.client.0.smithi115.stdout:7/969: sync 2024-09-13T17:06:08.001 INFO:tasks.workunit.client.0.smithi115.stdout:7/970: write d0/d59/d11c/df1/f146 [1029106,72758] 0 2024-09-13T17:06:08.001 INFO:tasks.workunit.client.0.smithi115.stdout:7/971: dread - d0/d3b/d50/d21/d99/db3/d117/d44/d12b/f154 zero size 2024-09-13T17:06:08.001 INFO:tasks.workunit.client.0.smithi115.stdout:7/972: write d0/d2/d1e/dd8/f102 [740340,11422] 0 2024-09-13T17:06:08.001 INFO:tasks.workunit.client.0.smithi115.stdout:7/973: chown d0/d59/fba 1 1 2024-09-13T17:06:08.018 INFO:tasks.workunit.client.0.smithi115.stdout:6/952: dwrite d8/d33/d40/d67/db4/d24/d17/f85 [0,4194304] 0 2024-09-13T17:06:08.021 INFO:tasks.workunit.client.0.smithi115.stdout:6/953: link d8/d33/d40/d67/db4/d24/d53/f9c d8/d13/dd7/d126/f130 0 2024-09-13T17:06:08.021 INFO:tasks.workunit.client.0.smithi115.stdout:6/954: chown d8/d33/d40/d67/db4/d24/f29 925 1 2024-09-13T17:06:08.345 INFO:tasks.workunit.client.0.smithi115.stdout:0/879: sync 2024-09-13T17:06:08.345 INFO:tasks.workunit.client.0.smithi115.stdout:9/906: sync 2024-09-13T17:06:08.347 INFO:tasks.workunit.client.0.smithi115.stdout:9/907: symlink d0/d21/d4f/l13f 0 2024-09-13T17:06:08.351 INFO:tasks.workunit.client.0.smithi115.stdout:9/908: rename d0/d21/d4f/fa4 to d0/de/d37/d83/dc2/ddd/d8d/f140 0 2024-09-13T17:06:08.353 INFO:tasks.workunit.client.0.smithi115.stdout:9/909: creat d0/d21/d65/f141 x:0 0 0 2024-09-13T17:06:08.353 INFO:tasks.workunit.client.0.smithi115.stdout:9/910: chown d0/dd7/d114/d15/fa3 6002688 1 2024-09-13T17:06:08.355 INFO:tasks.workunit.client.0.smithi115.stdout:9/911: rename d0/dd7/d114/d15/d7f/cd0 to d0/d9c/c142 0 2024-09-13T17:06:08.356 INFO:tasks.workunit.client.0.smithi115.stdout:9/912: truncate d0/de/d37/f5d 2134922 0 2024-09-13T17:06:08.356 INFO:tasks.workunit.client.0.smithi115.stdout:9/913: creat d0/d21/d65/d6f/dad/dc3/f143 x:0 0 0 2024-09-13T17:06:08.359 INFO:tasks.workunit.client.0.smithi115.stdout:9/914: mkdir d0/de/d144 0 2024-09-13T17:06:08.359 INFO:tasks.workunit.client.0.smithi115.stdout:9/915: dread - d0/dd7/d114/fe2 zero size 2024-09-13T17:06:08.359 INFO:tasks.workunit.client.0.smithi115.stdout:9/916: dread - d0/dd7/d114/d15/f135 zero size 2024-09-13T17:06:08.359 INFO:tasks.workunit.client.0.smithi115.stdout:9/917: fdatasync d0/d21/d65/f141 0 2024-09-13T17:06:08.360 INFO:tasks.workunit.client.0.smithi115.stdout:9/918: rmdir d0/de/d37/d83/dc2/d124 39 2024-09-13T17:06:08.362 INFO:tasks.workunit.client.0.smithi115.stdout:9/919: truncate d0/d21/d65/d79/f7a 272830 0 2024-09-13T17:06:08.362 INFO:tasks.workunit.client.0.smithi115.stdout:9/920: write d0/dd7/d114/fe2 [968400,109546] 0 2024-09-13T17:06:08.362 INFO:tasks.workunit.client.0.smithi115.stdout:9/921: write d0/faf [3908720,105099] 0 2024-09-13T17:06:08.363 INFO:tasks.workunit.client.0.smithi115.stdout:9/922: truncate d0/d21/f36 819905 0 2024-09-13T17:06:08.363 INFO:tasks.workunit.client.0.smithi115.stdout:9/923: chown d0/d21/d65/d79/f7a 0 1 2024-09-13T17:06:08.363 INFO:tasks.workunit.client.0.smithi115.stdout:9/924: chown d0/d9c/c116 4716 1 2024-09-13T17:06:08.363 INFO:tasks.workunit.client.0.smithi115.stdout:0/880: dwrite d9/d1d/d24/d26/d5d/fdd [0,4194304] 0 2024-09-13T17:06:08.365 INFO:tasks.workunit.client.0.smithi115.stdout:9/925: symlink d0/de/d37/d83/dc2/ddd/l145 0 2024-09-13T17:06:08.365 INFO:tasks.workunit.client.0.smithi115.stdout:9/926: creat d0/d21/d65/d6f/dad/dc3/f146 x:0 0 0 2024-09-13T17:06:08.368 INFO:tasks.workunit.client.0.smithi115.stdout:9/927: truncate d0/dd7/d114/f74 996034 0 2024-09-13T17:06:08.368 INFO:tasks.workunit.client.0.smithi115.stdout:9/928: truncate d0/de/d37/dc5/fb8 561706 0 2024-09-13T17:06:08.370 INFO:tasks.workunit.client.0.smithi115.stdout:9/929: creat d0/de/d37/d83/dc2/ddd/d8d/db1/dfa/f147 x:0 0 0 2024-09-13T17:06:08.370 INFO:tasks.workunit.client.0.smithi115.stdout:9/930: dread - d0/dd7/d114/feb zero size 2024-09-13T17:06:08.380 INFO:tasks.workunit.client.0.smithi115.stdout:0/881: dwrite d9/d1d/de1/d78/de5/dc1/f109 [0,4194304] 0 2024-09-13T17:06:08.381 INFO:tasks.workunit.client.0.smithi115.stdout:9/931: dread d0/d21/d42/f5f [0,4194304] 0 2024-09-13T17:06:08.387 INFO:tasks.workunit.client.0.smithi115.stdout:9/932: symlink d0/de/d37/d83/l148 0 2024-09-13T17:06:08.399 INFO:tasks.workunit.client.0.smithi115.stdout:0/882: dwrite d9/d1d/fb2 [0,4194304] 0 2024-09-13T17:06:08.403 INFO:tasks.workunit.client.0.smithi115.stdout:0/883: dread d9/fb [0,4194304] 0 2024-09-13T17:06:08.404 INFO:tasks.workunit.client.0.smithi115.stdout:0/884: write d9/d1d/d24/d26/d36/d48/fb7 [1749603,57628] 0 2024-09-13T17:06:08.405 INFO:tasks.workunit.client.0.smithi115.stdout:9/933: dwrite d0/fb [0,4194304] 0 2024-09-13T17:06:08.405 INFO:tasks.workunit.client.0.smithi115.stdout:9/934: dread - d0/de/d37/d83/dc2/ddd/dee/f11d zero size 2024-09-13T17:06:08.406 INFO:tasks.workunit.client.0.smithi115.stdout:0/885: getdents d9/d27/d88/d9e 0 2024-09-13T17:06:08.409 INFO:tasks.workunit.client.0.smithi115.stdout:9/935: unlink d0/d21/d65/d6f/dad/dc3/le5 0 2024-09-13T17:06:08.412 INFO:tasks.workunit.client.0.smithi115.stdout:0/886: mkdir d9/d1d/de1/d78/db6/d113 0 2024-09-13T17:06:08.413 INFO:tasks.workunit.client.0.smithi115.stdout:9/936: mknod d0/d21/d65/dfb/c149 0 2024-09-13T17:06:08.413 INFO:tasks.workunit.client.0.smithi115.stdout:9/937: chown d0/dd7/d114/c29 1469952 1 2024-09-13T17:06:08.416 INFO:tasks.workunit.client.0.smithi115.stdout:9/938: creat d0/f14a x:0 0 0 2024-09-13T17:06:08.416 INFO:tasks.workunit.client.0.smithi115.stdout:9/939: chown d0/dd7/d114/f44 53 1 2024-09-13T17:06:08.418 INFO:tasks.workunit.client.0.smithi115.stdout:9/940: mkdir d0/de/d144/d14b 0 2024-09-13T17:06:08.420 INFO:tasks.workunit.client.0.smithi115.stdout:9/941: rename d0/dd7/d114/d15/f3a to d0/d21/d65/d79/d137/f14c 0 2024-09-13T17:06:08.420 INFO:tasks.workunit.client.0.smithi115.stdout:9/942: read - d0/dd7/d114/feb zero size 2024-09-13T17:06:08.420 INFO:tasks.workunit.client.0.smithi115.stdout:9/943: chown d0/dd7/d114/f44 5 1 2024-09-13T17:06:08.420 INFO:tasks.workunit.client.0.smithi115.stdout:9/944: chown d0/de/l51 1 1 2024-09-13T17:06:08.421 INFO:tasks.workunit.client.0.smithi115.stdout:9/945: symlink d0/d21/d65/d79/d137/l14d 0 2024-09-13T17:06:08.421 INFO:tasks.workunit.client.0.smithi115.stdout:9/946: write d0/d21/d65/d79/fd9 [2041736,38343] 0 2024-09-13T17:06:08.422 INFO:tasks.workunit.client.0.smithi115.stdout:9/947: mknod d0/d21/d65/d6f/dad/dc3/c14e 0 2024-09-13T17:06:08.425 INFO:tasks.workunit.client.0.smithi115.stdout:0/887: dwrite d9/d27/d88/d9e/dad/f111 [0,4194304] 0 2024-09-13T17:06:08.430 INFO:tasks.workunit.client.0.smithi115.stdout:0/888: mknod d9/d1d/d24/d7d/c114 0 2024-09-13T17:06:08.541 INFO:tasks.workunit.client.0.smithi115.stdout:7/974: sync 2024-09-13T17:06:08.541 INFO:tasks.workunit.client.0.smithi115.stdout:6/955: sync 2024-09-13T17:06:08.542 INFO:tasks.workunit.client.0.smithi115.stdout:6/956: chown d8/db/d49 378 1 2024-09-13T17:06:08.555 INFO:tasks.workunit.client.0.smithi115.stdout:6/957: dwrite d8/d33/d7f/fe9 [0,4194304] 0 2024-09-13T17:06:08.558 INFO:tasks.workunit.client.0.smithi115.stdout:6/958: unlink d8/d33/d40/la3 0 2024-09-13T17:06:08.561 INFO:tasks.workunit.client.0.smithi115.stdout:6/959: mkdir d8/d33/d40/d4c/d66/df8/d131 0 2024-09-13T17:06:08.564 INFO:tasks.workunit.client.0.smithi115.stdout:6/960: dread d8/d13/d7b/f8f [0,4194304] 0 2024-09-13T17:06:08.564 INFO:tasks.workunit.client.0.smithi115.stdout:6/961: write d8/d13/d7b/ff2 [963701,74448] 0 2024-09-13T17:06:08.564 INFO:tasks.workunit.client.0.smithi115.stdout:6/962: chown d8/db/d49/df1 692907 1 2024-09-13T17:06:08.565 INFO:tasks.workunit.client.0.smithi115.stdout:6/963: readlink d8/d33/d40/d67/db4/dbf/ddb/l11a 0 2024-09-13T17:06:08.573 INFO:tasks.workunit.client.0.smithi115.stdout:6/964: write d8/db/d1d/fa1 [1031395,93150] 0 2024-09-13T17:06:08.578 INFO:tasks.workunit.client.0.smithi115.stdout:6/965: dread d8/db/d1d/fa1 [0,4194304] 0 2024-09-13T17:06:08.578 INFO:tasks.workunit.client.0.smithi115.stdout:6/966: chown d8/db/d1d/fa1 31366727 1 2024-09-13T17:06:08.585 INFO:tasks.workunit.client.0.smithi115.stdout:6/967: dread d8/db/f6f [0,4194304] 0 2024-09-13T17:06:08.603 INFO:tasks.workunit.client.0.smithi115.stdout:6/968: dwrite d8/d33/d40/d67/db4/d24/d17/f85 [0,4194304] 0 2024-09-13T17:06:08.604 INFO:tasks.workunit.client.0.smithi115.stdout:6/969: creat d8/d33/d40/d67/db4/d24/d53/f132 x:0 0 0 2024-09-13T17:06:08.606 INFO:tasks.workunit.client.0.smithi115.stdout:6/970: rename d8/d33/d40/d67/db4/d24/d17 to d8/d33/d40/d67/db4/dbf/d133 0 2024-09-13T17:06:08.608 INFO:tasks.workunit.client.0.smithi115.stdout:6/971: dread d8/db/faf [0,4194304] 0 2024-09-13T17:06:08.608 INFO:tasks.workunit.client.0.smithi115.stdout:6/972: truncate d8/db/dd/fba 17298 0 2024-09-13T17:06:08.615 INFO:tasks.workunit.client.0.smithi115.stdout:6/973: write d8/d33/d40/d67/db4/d24/f3b [7149980,125811] 0 2024-09-13T17:06:08.624 INFO:tasks.workunit.client.0.smithi115.stdout:6/974: dread d8/d13/f9d [0,4194304] 0 2024-09-13T17:06:08.624 INFO:tasks.workunit.client.0.smithi115.stdout:6/975: dread - d8/d13/d7b/fa9 zero size 2024-09-13T17:06:08.625 INFO:tasks.workunit.client.0.smithi115.stdout:6/976: creat d8/db/d49/df1/f134 x:0 0 0 2024-09-13T17:06:08.625 INFO:tasks.workunit.client.0.smithi115.stdout:6/977: chown d8/db/dd/da2/d117/d12f 1839 1 2024-09-13T17:06:08.625 INFO:tasks.workunit.client.0.smithi115.stdout:6/978: chown d8/d13/f9d 1419402641 1 2024-09-13T17:06:08.630 INFO:tasks.workunit.client.0.smithi115.stdout:6/979: rmdir d8/d33/d40/d67/db4 39 2024-09-13T17:06:08.632 INFO:tasks.workunit.client.0.smithi115.stdout:6/980: creat d8/d33/d40/d67/f135 x:0 0 0 2024-09-13T17:06:08.632 INFO:tasks.workunit.client.0.smithi115.stdout:6/981: dread - d8/d33/d40/d67/db4/d24/d53/fe4 zero size 2024-09-13T17:06:08.653 INFO:tasks.workunit.client.0.smithi115.stdout:6/982: dwrite d8/d33/d40/d4c/fd9 [0,4194304] 0 2024-09-13T17:06:08.653 INFO:tasks.workunit.client.0.smithi115.stdout:6/983: chown d8/db/dd 1047778858 1 2024-09-13T17:06:08.653 INFO:tasks.workunit.client.0.smithi115.stdout:6/984: read - d8/d33/d40/d67/db4/d24/d53/d6a/f10b zero size 2024-09-13T17:06:08.660 INFO:tasks.workunit.client.0.smithi115.stdout:6/985: rename d8/db/d49/d8d/d11b/d120 to d8/d33/d40/d4c/d66/df4/d136 0 2024-09-13T17:06:08.660 INFO:tasks.workunit.client.0.smithi115.stdout:6/986: read - d8/d33/d40/d67/db4/ffb zero size 2024-09-13T17:06:08.665 INFO:tasks.workunit.client.0.smithi115.stdout:6/987: truncate d8/db/fab 928396 0 2024-09-13T17:06:08.665 INFO:tasks.workunit.client.0.smithi115.stdout:6/988: dread - d8/d33/d40/d4c/d66/df4/f10c zero size 2024-09-13T17:06:08.688 INFO:tasks.workunit.client.0.smithi115.stdout:6/989: dwrite d8/d33/d40/d4c/ff5 [0,4194304] 0 2024-09-13T17:06:08.688 INFO:tasks.workunit.client.0.smithi115.stdout:6/990: write d8/db/f6f [4256212,82944] 0 2024-09-13T17:06:08.688 INFO:tasks.workunit.client.0.smithi115.stdout:6/991: write d8/d33/d40/fd4 [1233017,130970] 0 2024-09-13T17:06:08.691 INFO:tasks.workunit.client.0.smithi115.stdout:6/992: rmdir d8/db/dd/da2/d117 39 2024-09-13T17:06:08.692 INFO:tasks.workunit.client.0.smithi115.stdout:6/993: stat d8/db/ccd 0 2024-09-13T17:06:08.692 INFO:tasks.workunit.client.0.smithi115.stdout:6/994: read - d8/d33/d40/d67/db4/d24/d53/fe4 zero size 2024-09-13T17:06:08.696 INFO:tasks.workunit.client.0.smithi115.stdout:6/995: rename d8/d33/d40/d67 to d8/d33/d40/d4c/d66/df4/d137 0 2024-09-13T17:06:08.696 INFO:tasks.workunit.client.0.smithi115.stdout:6/996: fdatasync d8/d33/d82/f5b 0 2024-09-13T17:06:08.696 INFO:tasks.workunit.client.0.smithi115.stdout:6/997: chown d8/db/d49/lf0 1550 1 2024-09-13T17:06:08.696 INFO:tasks.workunit.client.0.smithi115.stdout:6/998: fsync d8/d33/d40/d4c/d66/df8/f108 0 2024-09-13T17:06:08.761 INFO:tasks.workunit.client.0.smithi115.stdout:0/889: sync 2024-09-13T17:06:08.762 INFO:tasks.workunit.client.0.smithi115.stdout:9/948: sync 2024-09-13T17:06:08.767 INFO:tasks.workunit.client.0.smithi115.stdout:0/890: mknod d9/d1d/de1/d78/db6/d113/c115 0 2024-09-13T17:06:08.767 INFO:tasks.workunit.client.0.smithi115.stdout:0/891: write d9/d1d/d24/d7d/fdb [792638,65566] 0 2024-09-13T17:06:08.767 INFO:tasks.workunit.client.0.smithi115.stdout:0/892: chown d9/d1d/de1/d100 11539 1 2024-09-13T17:06:08.776 INFO:tasks.workunit.client.0.smithi115.stdout:0/893: creat d9/f116 x:0 0 0 2024-09-13T17:06:08.776 INFO:tasks.workunit.client.0.smithi115.stdout:0/894: chown d9/d1d/de1/d78/de5/dc1 14107055 1 2024-09-13T17:06:08.780 INFO:tasks.workunit.client.0.smithi115.stdout:9/949: dwrite d0/d21/d65/d79/df4/f115 [0,4194304] 0 2024-09-13T17:06:08.802 INFO:tasks.workunit.client.0.smithi115.stdout:0/895: dwrite d9/f41 [0,4194304] 0 2024-09-13T17:06:08.802 INFO:tasks.workunit.client.0.smithi115.stdout:0/896: fsync d9/d1d/de1/d78/fbe 0 2024-09-13T17:06:08.804 INFO:tasks.workunit.client.0.smithi115.stdout:0/897: dread d9/d1d/d24/d26/d5d/f96 [0,4194304] 0 2024-09-13T17:06:08.806 INFO:tasks.workunit.client.0.smithi115.stdout:9/950: dwrite d0/de/d37/d83/dc2/ddd/d8d/f140 [4194304,4194304] 0 2024-09-13T17:06:08.824 INFO:tasks.workunit.client.0.smithi115.stdout:0/898: dwrite d9/f116 [0,4194304] 0 2024-09-13T17:06:08.828 INFO:tasks.workunit.client.0.smithi115.stdout:9/951: dwrite d0/d21/d65/fb9 [4194304,4194304] 0 2024-09-13T17:06:08.828 INFO:tasks.workunit.client.0.smithi115.stdout:9/952: readlink d0/de/d37/d83/dc2/ddd/d8d/db1/dfa/l10c 0 2024-09-13T17:06:08.828 INFO:tasks.workunit.client.0.smithi115.stdout:9/953: fdatasync d0/de/d37/dc5/f106 0 2024-09-13T17:06:08.828 INFO:tasks.workunit.client.0.smithi115.stdout:9/954: write d0/dd7/d114/f129 [760317,16007] 0 2024-09-13T17:06:08.830 INFO:tasks.workunit.client.0.smithi115.stdout:9/955: symlink d0/de/d37/d83/dc2/ddd/d8d/db1/l14f 0 2024-09-13T17:06:08.842 INFO:tasks.workunit.client.0.smithi115.stdout:0/899: dwrite d9/d27/d88/d99/dc7/f57 [0,4194304] 0 2024-09-13T17:06:08.842 INFO:tasks.workunit.client.0.smithi115.stdout:0/900: write d9/d27/d88/d99/dc7/fc6 [580819,31775] 0 2024-09-13T17:06:08.843 INFO:tasks.workunit.client.0.smithi115.stdout:0/901: write d9/d27/d88/d9e/dad/fcc [235058,55945] 0 2024-09-13T17:06:08.847 INFO:tasks.workunit.client.0.smithi115.stdout:9/956: dwrite d0/d21/d65/d6f/ff0 [0,4194304] 0 2024-09-13T17:06:08.847 INFO:tasks.workunit.client.0.smithi115.stdout:9/957: write d0/dd7/d114/d15/f135 [348532,88175] 0 2024-09-13T17:06:08.853 INFO:tasks.workunit.client.0.smithi115.stdout:9/958: mkdir d0/d150 0 2024-09-13T17:06:08.855 INFO:tasks.workunit.client.0.smithi115.stdout:9/959: truncate d0/d21/d65/d79/f10a 3378741 0 2024-09-13T17:06:08.857 INFO:tasks.workunit.client.0.smithi115.stdout:9/960: mkdir d0/d21/d42/d151 0 2024-09-13T17:06:08.858 INFO:tasks.workunit.client.0.smithi115.stdout:9/961: mknod d0/de/d144/c152 0 2024-09-13T17:06:08.858 INFO:tasks.workunit.client.0.smithi115.stdout:9/962: read d0/f11 [1744399,107181] 0 2024-09-13T17:06:08.859 INFO:tasks.workunit.client.0.smithi115.stdout:9/963: creat d0/de/f153 x:0 0 0 2024-09-13T17:06:08.860 INFO:tasks.workunit.client.0.smithi115.stdout:9/964: write d0/de/d37/d83/dc2/ddd/d8d/db1/f113 [701823,43132] 0 2024-09-13T17:06:08.860 INFO:tasks.workunit.client.0.smithi115.stdout:9/965: chown d0/de 0 1 2024-09-13T17:06:08.860 INFO:tasks.workunit.client.0.smithi115.stdout:0/902: dwrite d9/d1d/d24/fa6 [0,4194304] 0 2024-09-13T17:06:08.861 INFO:tasks.workunit.client.0.smithi115.stdout:9/966: mkdir d0/d21/d42/d154 0 2024-09-13T17:06:08.864 INFO:tasks.workunit.client.0.smithi115.stdout:0/903: symlink d9/d1d/l117 0 2024-09-13T17:06:08.864 INFO:tasks.workunit.client.0.smithi115.stdout:0/904: dread - d9/d1d/d24/d26/d5d/d66/db1/f103 zero size 2024-09-13T17:06:08.864 INFO:tasks.workunit.client.0.smithi115.stdout:0/905: fdatasync d9/d1d/de1/d78/db6/f108 0 2024-09-13T17:06:08.867 INFO:tasks.workunit.client.0.smithi115.stdout:9/967: creat d0/d21/d42/d151/f155 x:0 0 0 2024-09-13T17:06:08.869 INFO:tasks.workunit.client.0.smithi115.stdout:0/906: creat d9/d1d/de1/d110/f118 x:0 0 0 2024-09-13T17:06:08.869 INFO:tasks.workunit.client.0.smithi115.stdout:0/907: fsync d9/d1d/d24/d26/d36/d48/fb7 0 2024-09-13T17:06:08.875 INFO:tasks.workunit.client.0.smithi115.stdout:9/968: dread d0/faf [0,4194304] 0 2024-09-13T17:06:08.876 INFO:tasks.workunit.client.0.smithi115.stdout:9/969: symlink d0/d21/d65/d6f/dad/dc3/l156 0 2024-09-13T17:06:08.877 INFO:tasks.workunit.client.0.smithi115.stdout:0/908: dread d9/d1d/de1/d78/f8b [0,4194304] 0 2024-09-13T17:06:08.878 INFO:tasks.workunit.client.0.smithi115.stdout:9/970: dread - d0/d21/d65/f92 zero size 2024-09-13T17:06:08.886 INFO:tasks.workunit.client.0.smithi115.stdout:9/971: dread d0/dd7/d114/f60 [0,4194304] 0 2024-09-13T17:06:08.894 INFO:tasks.workunit.client.0.smithi115.stdout:0/909: rmdir d9 39 2024-09-13T17:06:08.896 INFO:tasks.workunit.client.0.smithi115.stdout:0/910: symlink d9/d1d/de1/d30/dc2/l119 0 2024-09-13T17:06:08.896 INFO:tasks.workunit.client.0.smithi115.stdout:0/911: fsync d9/d1d/de1/d78/fbe 0 2024-09-13T17:06:08.897 INFO:tasks.workunit.client.0.smithi115.stdout:0/912: creat d9/d27/d88/d99/dd4/f11a x:0 0 0 2024-09-13T17:06:08.898 INFO:tasks.workunit.client.0.smithi115.stdout:0/913: creat d9/f11b x:0 0 0 2024-09-13T17:06:08.905 INFO:tasks.workunit.client.0.smithi115.stdout:9/972: dwrite d0/de/d37/d105/d12a/d130/f4c [0,4194304] 0 2024-09-13T17:06:08.910 INFO:tasks.workunit.client.0.smithi115.stdout:0/914: dread d9/d27/d88/d99/dc7/f57 [0,4194304] 0 2024-09-13T17:06:08.912 INFO:tasks.workunit.client.0.smithi115.stdout:9/973: mknod d0/d21/d65/d6f/dad/c157 0 2024-09-13T17:06:08.912 INFO:tasks.workunit.client.0.smithi115.stdout:9/974: dread - d0/de/d37/d105/d12a/d130/f10b zero size 2024-09-13T17:06:08.912 INFO:tasks.workunit.client.0.smithi115.stdout:9/975: readlink d0/d21/d42/le3 0 2024-09-13T17:06:08.912 INFO:tasks.workunit.client.0.smithi115.stdout:9/976: fdatasync d0/d21/d65/fbd 0 2024-09-13T17:06:08.912 INFO:tasks.workunit.client.0.smithi115.stdout:9/977: write d0/de/da6/fd6 [1268452,36955] 0 2024-09-13T17:06:08.914 INFO:tasks.workunit.client.0.smithi115.stdout:9/978: mkdir d0/de/d37/d83/d91/d158 0 2024-09-13T17:06:08.917 INFO:tasks.workunit.client.0.smithi115.stdout:0/915: dread d9/d1d/de1/d30/f9f [0,4194304] 0 2024-09-13T17:06:08.923 INFO:tasks.workunit.client.0.smithi115.stdout:7/975: sync 2024-09-13T17:06:08.925 INFO:tasks.workunit.client.0.smithi115.stdout:7/976: symlink d0/d97/l158 0 2024-09-13T17:06:08.925 INFO:tasks.workunit.client.0.smithi115.stdout:7/977: dread - d0/d3b/d50/d21/d2f/d9e/f106 zero size 2024-09-13T17:06:08.927 INFO:tasks.workunit.client.0.smithi115.stdout:7/978: rmdir d0/d3b/d50/d21/d99/db3 39 2024-09-13T17:06:08.928 INFO:tasks.workunit.client.0.smithi115.stdout:6/999: sync 2024-09-13T17:06:08.928 INFO:tasks.workunit.client.0.smithi115.stdout:9/979: truncate d0/de/da6/fd6 955486 0 2024-09-13T17:06:08.930 INFO:tasks.workunit.client.0.smithi115.stdout:9/980: link d0/d21/d42/f7b d0/d21/d42/d154/f159 0 2024-09-13T17:06:08.930 INFO:tasks.workunit.client.0.smithi115.stdout:9/981: chown d0/d21/fd3 1723 1 2024-09-13T17:06:08.931 INFO:tasks.workunit.client.0.smithi115.stdout:9/982: creat d0/d21/d4f/f15a x:0 0 0 2024-09-13T17:06:08.935 INFO:tasks.workunit.client.0.smithi115.stdout:7/979: dread d0/d3b/d50/d21/d2f/f108 [0,4194304] 0 2024-09-13T17:06:08.937 INFO:tasks.workunit.client.0.smithi115.stdout:7/980: mkdir d0/d2/d1e/d3d/d159 0 2024-09-13T17:06:08.939 INFO:tasks.workunit.client.0.smithi115.stdout:7/981: symlink d0/d2/d1e/de5/dfb/l15a 0 2024-09-13T17:06:08.939 INFO:tasks.workunit.client.0.smithi115.stdout:9/983: dread d0/dd7/d114/d15/fc1 [0,4194304] 0 2024-09-13T17:06:08.941 INFO:tasks.workunit.client.0.smithi115.stdout:7/982: creat d0/d2/d67/f15b x:0 0 0 2024-09-13T17:06:08.941 INFO:tasks.workunit.client.0.smithi115.stdout:7/983: creat d0/d3b/d50/d21/de2/d149/f15c x:0 0 0 2024-09-13T17:06:08.941 INFO:tasks.workunit.client.0.smithi115.stdout:9/984: rmdir d0/d21/d65/dfb 39 2024-09-13T17:06:08.943 INFO:tasks.workunit.client.0.smithi115.stdout:7/984: stat d0/d3b/d54/le3 0 2024-09-13T17:06:08.944 INFO:tasks.workunit.client.0.smithi115.stdout:9/985: rename d0/d21/d65/f92 to d0/de/d37/d105/d12a/d130/f15b 0 2024-09-13T17:06:08.945 INFO:tasks.workunit.client.0.smithi115.stdout:7/985: mkdir d0/d2/d1e/d73/d15d 0 2024-09-13T17:06:08.947 INFO:tasks.workunit.client.0.smithi115.stdout:9/986: link d0/d21/d65/f107 d0/d21/f15c 0 2024-09-13T17:06:08.948 INFO:tasks.workunit.client.0.smithi115.stdout:7/986: creat d0/d3b/d50/d21/d99/db3/d117/d12e/f15e x:0 0 0 2024-09-13T17:06:08.948 INFO:tasks.workunit.client.0.smithi115.stdout:7/987: stat d0/d2/d1e/de5/dfb/l15a 0 2024-09-13T17:06:08.949 INFO:tasks.workunit.client.0.smithi115.stdout:7/988: rename d0/d3b/d50/d21/d2f/d9e/dbd to d0/d3b/d50/d21/d99/db3/d15f 0 2024-09-13T17:06:08.951 INFO:tasks.workunit.client.0.smithi115.stdout:7/989: creat d0/d2/d1e/de5/d115/f160 x:0 0 0 2024-09-13T17:06:08.967 INFO:tasks.workunit.client.0.smithi115.stdout:7/990: dwrite d0/d59/fb8 [0,4194304] 0 2024-09-13T17:06:08.980 INFO:tasks.workunit.client.0.smithi115.stdout:7/991: dread d0/d2/f8 [4194304,4194304] 0 2024-09-13T17:06:08.993 INFO:tasks.workunit.client.0.smithi115.stdout:7/992: dwrite d0/d59/fd1 [0,4194304] 0 2024-09-13T17:06:08.993 INFO:tasks.workunit.client.0.smithi115.stdout:7/993: fdatasync d0/d3b/fad 0 2024-09-13T17:06:08.993 INFO:tasks.workunit.client.0.smithi115.stdout:7/994: creat d0/d2/d67/d109/f161 x:0 0 0 2024-09-13T17:06:09.002 INFO:tasks.workunit.client.0.smithi115.stdout:7/995: write d0/f2e [100291,18546] 0 2024-09-13T17:06:09.003 INFO:tasks.workunit.client.0.smithi115.stdout:7/996: mkdir d0/d3b/d50/d21/d2f/d9e/d162 0 2024-09-13T17:06:09.004 INFO:tasks.workunit.client.0.smithi115.stdout:7/997: mknod d0/d59/d11c/df1/d127/c163 0 2024-09-13T17:06:09.004 INFO:tasks.workunit.client.0.smithi115.stdout:7/998: readlink d0/d3b/d50/d21/d99/db3/d117/ld2 0 2024-09-13T17:06:09.006 INFO:tasks.workunit.client.0.smithi115.stdout:7/999: truncate d0/d3b/f6a 772497 0 2024-09-13T17:06:09.178 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:08 smithi115 ceph-mon[27708]: pgmap v23: 65 pgs: 65 active+clean; 3.6 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 191 MiB/s rd, 230 MiB/s wr, 366 op/s 2024-09-13T17:06:09.325 INFO:tasks.workunit.client.0.smithi115.stdout:0/916: sync 2024-09-13T17:06:09.325 INFO:tasks.workunit.client.0.smithi115.stdout:0/917: dread - d9/d1d/d24/d26/d5d/d66/db1/f103 zero size 2024-09-13T17:06:09.326 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:08 smithi195 ceph-mon[34981]: pgmap v23: 65 pgs: 65 active+clean; 3.6 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 191 MiB/s rd, 230 MiB/s wr, 366 op/s 2024-09-13T17:06:09.328 INFO:tasks.workunit.client.0.smithi115.stdout:0/918: dread d9/d1d/f39 [0,4194304] 0 2024-09-13T17:06:09.329 INFO:tasks.workunit.client.0.smithi115.stdout:0/919: symlink d9/d1d/d24/d7d/l11c 0 2024-09-13T17:06:09.329 INFO:tasks.workunit.client.0.smithi115.stdout:0/920: dread - d9/d1d/de1/d110/f118 zero size 2024-09-13T17:06:09.329 INFO:tasks.workunit.client.0.smithi115.stdout:0/921: readlink d9/l69 0 2024-09-13T17:06:09.330 INFO:tasks.workunit.client.0.smithi115.stdout:0/922: mkdir d9/d27/d88/d8e/dc3/d11d 0 2024-09-13T17:06:09.331 INFO:tasks.workunit.client.0.smithi115.stdout:0/923: mknod d9/d27/c11e 0 2024-09-13T17:06:09.332 INFO:tasks.workunit.client.0.smithi115.stdout:0/924: rename d9/d1d/de1/c90 to d9/d1d/d24/d26/d5d/d66/db1/c11f 0 2024-09-13T17:06:09.333 INFO:tasks.workunit.client.0.smithi115.stdout:0/925: write d9/d27/d88/d9e/dad/fcc [1854420,107465] 0 2024-09-13T17:06:09.339 INFO:tasks.workunit.client.0.smithi115.stdout:0/926: getdents d9/d1d/d24/d26/d5d/d66/db1 0 2024-09-13T17:06:09.341 INFO:tasks.workunit.client.0.smithi115.stdout:0/927: creat d9/d1d/d24/d26/f120 x:0 0 0 2024-09-13T17:06:09.359 INFO:tasks.workunit.client.0.smithi115.stdout:0/928: dwrite d9/d1d/de1/f79 [4194304,4194304] 0 2024-09-13T17:06:09.359 INFO:tasks.workunit.client.0.smithi115.stdout:0/929: fdatasync d9/d1d/d24/f25 0 2024-09-13T17:06:09.359 INFO:tasks.workunit.client.0.smithi115.stdout:0/930: rmdir d9/d1d/d24/d26/d36/dd7 39 2024-09-13T17:06:09.359 INFO:tasks.workunit.client.0.smithi115.stdout:0/931: chown d9/d1d/d24/d26/d36/d48/f4c 14281 1 2024-09-13T17:06:09.368 INFO:tasks.workunit.client.0.smithi115.stdout:0/932: write d9/d1d/d24/d26/d7b/ff7 [1316662,35966] 0 2024-09-13T17:06:09.386 INFO:tasks.workunit.client.0.smithi115.stdout:0/933: dwrite d9/d1d/de1/f79 [0,4194304] 0 2024-09-13T17:06:09.386 INFO:tasks.workunit.client.0.smithi115.stdout:0/934: write d9/d1d/d24/d26/d5d/d67/fd8 [215730,61039] 0 2024-09-13T17:06:09.388 INFO:tasks.workunit.client.0.smithi115.stdout:0/935: creat d9/d1d/d24/d26/d5d/d67/f121 x:0 0 0 2024-09-13T17:06:09.388 INFO:tasks.workunit.client.0.smithi115.stdout:0/936: write d9/d1d/d24/f72 [1167132,99992] 0 2024-09-13T17:06:09.388 INFO:tasks.workunit.client.0.smithi115.stdout:0/937: read d9/d1d/d24/f72 [68829,3520] 0 2024-09-13T17:06:09.391 INFO:tasks.workunit.client.0.smithi115.stdout:0/938: dread d9/d1d/d24/d7d/fdb [0,4194304] 0 2024-09-13T17:06:09.391 INFO:tasks.workunit.client.0.smithi115.stdout:0/939: chown d9/d27/fba 2 1 2024-09-13T17:06:09.400 INFO:tasks.workunit.client.0.smithi115.stdout:9/987: sync 2024-09-13T17:06:09.400 INFO:tasks.workunit.client.0.smithi115.stdout:9/988: symlink d0/de/d37/d105/d12a/d131/l15d 0 2024-09-13T17:06:09.403 INFO:tasks.workunit.client.0.smithi115.stdout:9/989: read d0/d21/f36 [91591,99585] 0 2024-09-13T17:06:09.403 INFO:tasks.workunit.client.0.smithi115.stdout:9/990: chown d0/de/da6/fd6 168489 1 2024-09-13T17:06:09.409 INFO:tasks.workunit.client.0.smithi115.stdout:0/940: dwrite d9/d27/d88/d99/dc7/f89 [0,4194304] 0 2024-09-13T17:06:09.420 INFO:tasks.workunit.client.0.smithi115.stdout:9/991: dwrite d0/de/d37/d83/d91/fa0 [0,4194304] 0 2024-09-13T17:06:09.424 INFO:tasks.workunit.client.0.smithi115.stdout:9/992: dread d0/de/d37/d83/dc2/ddd/d8d/db1/f113 [0,4194304] 0 2024-09-13T17:06:09.425 INFO:tasks.workunit.client.0.smithi115.stdout:9/993: symlink d0/d21/d65/dfb/l15e 0 2024-09-13T17:06:09.425 INFO:tasks.workunit.client.0.smithi115.stdout:9/994: stat d0/d9c 0 2024-09-13T17:06:09.425 INFO:tasks.workunit.client.0.smithi115.stdout:9/995: stat d0/dd7/d114/d15/cde 0 2024-09-13T17:06:09.425 INFO:tasks.workunit.client.0.smithi115.stdout:9/996: truncate d0/f8 1352889 0 2024-09-13T17:06:09.442 INFO:tasks.workunit.client.0.smithi115.stdout:9/997: dwrite d0/dd7/d114/fe2 [0,4194304] 0 2024-09-13T17:06:09.442 INFO:tasks.workunit.client.0.smithi115.stdout:9/998: write d0/f14a [682188,110925] 0 2024-09-13T17:06:09.442 INFO:tasks.workunit.client.0.smithi115.stdout:9/999: creat d0/dd7/d114/f15f x:0 0 0 2024-09-13T17:06:09.634 INFO:tasks.workunit.client.0.smithi115.stdout:0/941: sync 2024-09-13T17:06:09.649 INFO:tasks.workunit.client.0.smithi115.stdout:0/942: dwrite d9/d1d/d24/d26/d36/d48/f4c [0,4194304] 0 2024-09-13T17:06:09.650 INFO:tasks.workunit.client.0.smithi115.stdout:0/943: truncate d9/f1f 786110 0 2024-09-13T17:06:09.651 INFO:tasks.workunit.client.0.smithi115.stdout:0/944: mkdir d9/d1d/de1/d30/ddf/d122 0 2024-09-13T17:06:09.654 INFO:tasks.workunit.client.0.smithi115.stdout:0/945: link d9/d1d/de1/d110/ff5 d9/d1d/d24/d26/d36/d48/dbb/d104/f123 0 2024-09-13T17:06:09.654 INFO:tasks.workunit.client.0.smithi115.stdout:0/946: write d9/d1d/de1/d30/d46/f49 [1903003,66548] 0 2024-09-13T17:06:09.654 INFO:tasks.workunit.client.0.smithi115.stdout:0/947: fsync d9/d1d/d24/d26/d5d/f70 0 2024-09-13T17:06:09.668 INFO:tasks.workunit.client.0.smithi115.stdout:0/948: dwrite d9/fb [0,4194304] 0 2024-09-13T17:06:09.677 INFO:tasks.workunit.client.0.smithi115.stdout:0/949: read d9/d1d/d24/fa6 [3080108,65203] 0 2024-09-13T17:06:09.677 INFO:tasks.workunit.client.0.smithi115.stdout:0/950: truncate d9/d1d/d24/d26/f10f 152350 0 2024-09-13T17:06:09.677 INFO:tasks.workunit.client.0.smithi115.stdout:0/951: write d9/d1d/de1/d30/d46/f49 [773128,8813] 0 2024-09-13T17:06:09.677 INFO:tasks.workunit.client.0.smithi115.stdout:0/952: write d9/d1d/d24/d26/d7b/fea [335958,124576] 0 2024-09-13T17:06:09.677 INFO:tasks.workunit.client.0.smithi115.stdout:0/953: stat d9/d1d/d24/d26/d5d/d67/fd8 0 2024-09-13T17:06:09.692 INFO:tasks.workunit.client.0.smithi115.stdout:0/954: dwrite d9/d1d/d24/d26/d2c/f9d [0,4194304] 0 2024-09-13T17:06:09.695 INFO:tasks.workunit.client.0.smithi115.stdout:0/955: mkdir d9/d1d/d24/d26/d36/d48/d124 0 2024-09-13T17:06:09.701 INFO:tasks.workunit.client.0.smithi115.stdout:0/956: dread d9/d1d/de1/d30/f9f [0,4194304] 0 2024-09-13T17:06:09.701 INFO:tasks.workunit.client.0.smithi115.stdout:0/957: fdatasync d9/d1d/d24/d26/f64 0 2024-09-13T17:06:09.724 INFO:tasks.workunit.client.0.smithi115.stdout:0/958: dwrite d9/d1d/d24/d26/f64 [0,4194304] 0 2024-09-13T17:06:10.051 INFO:tasks.workunit.client.0.smithi115.stdout:0/959: sync 2024-09-13T17:06:10.052 INFO:tasks.workunit.client.0.smithi115.stdout:0/960: fdatasync d9/d27/d88/fa2 0 2024-09-13T17:06:10.069 INFO:tasks.workunit.client.0.smithi115.stdout:0/961: dwrite d9/f18 [4194304,4194304] 0 2024-09-13T17:06:10.084 INFO:tasks.workunit.client.0.smithi115.stdout:0/962: dwrite d9/d1d/d24/d26/d36/d48/dbb/d104/f123 [0,4194304] 0 2024-09-13T17:06:10.084 INFO:tasks.workunit.client.0.smithi115.stdout:0/963: fdatasync d9/d1d/d24/ff8 0 2024-09-13T17:06:10.085 INFO:tasks.workunit.client.0.smithi115.stdout:0/964: getdents d9/d1d/de1/d30/ddf 0 2024-09-13T17:06:10.095 INFO:tasks.workunit.client.0.smithi115.stdout:0/965: dread d9/d27/d88/d9e/dad/f111 [0,4194304] 0 2024-09-13T17:06:10.095 INFO:tasks.workunit.client.0.smithi115.stdout:0/966: write d9/d1d/d24/f72 [1821701,54176] 0 2024-09-13T17:06:10.104 INFO:tasks.workunit.client.0.smithi115.stdout:0/967: read d9/d27/d88/d9e/fd0 [4872251,111752] 0 2024-09-13T17:06:10.112 INFO:tasks.workunit.client.0.smithi115.stdout:0/968: dread d9/d27/d88/d99/dc7/f61 [4194304,4194304] 0 2024-09-13T17:06:10.129 INFO:tasks.workunit.client.0.smithi115.stdout:0/969: dwrite d9/d1d/d24/d26/d5d/f87 [4194304,4194304] 0 2024-09-13T17:06:10.130 INFO:tasks.workunit.client.0.smithi115.stdout:0/970: getdents d9/d1d/d24/d26/d36/dd7 0 2024-09-13T17:06:10.132 INFO:tasks.workunit.client.0.smithi115.stdout:0/971: creat d9/d1d/d24/f125 x:0 0 0 2024-09-13T17:06:10.133 INFO:tasks.workunit.client.0.smithi115.stdout:0/972: symlink d9/d1d/de1/d78/de5/l126 0 2024-09-13T17:06:10.135 INFO:tasks.workunit.client.0.smithi115.stdout:0/973: creat d9/d27/f127 x:0 0 0 2024-09-13T17:06:10.138 INFO:tasks.workunit.client.0.smithi115.stdout:0/974: dread d9/f1f [0,4194304] 0 2024-09-13T17:06:10.138 INFO:tasks.workunit.client.0.smithi115.stdout:0/975: write d9/d1d/de1/d30/f9f [4874676,94265] 0 2024-09-13T17:06:10.765 INFO:tasks.workunit.client.0.smithi115.stdout:0/976: sync 2024-09-13T17:06:10.770 INFO:tasks.workunit.client.0.smithi115.stdout:0/977: read d9/d1d/d24/d26/d36/f62 [1648235,51673] 0 2024-09-13T17:06:10.771 INFO:tasks.workunit.client.0.smithi115.stdout:0/978: getdents d9/d1d/d24/d26/d36/d48/dbb 0 2024-09-13T17:06:10.772 INFO:tasks.workunit.client.0.smithi115.stdout:0/979: mknod d9/d1d/de1/d78/de5/c128 0 2024-09-13T17:06:10.772 INFO:tasks.workunit.client.0.smithi115.stdout:0/980: dread - d9/d1d/de1/d30/f6d zero size 2024-09-13T17:06:10.775 INFO:tasks.workunit.client.0.smithi115.stdout:0/981: rename d9/d1d/d24/ff8 to d9/d27/d88/d9e/dad/f129 0 2024-09-13T17:06:10.775 INFO:tasks.workunit.client.0.smithi115.stdout:0/982: fsync d9/d27/d88/d8e/fef 0 2024-09-13T17:06:10.775 INFO:tasks.workunit.client.0.smithi115.stdout:0/983: creat d9/f12a x:0 0 0 2024-09-13T17:06:10.775 INFO:tasks.workunit.client.0.smithi115.stdout:0/984: write d9/f18 [2926529,39161] 0 2024-09-13T17:06:10.775 INFO:tasks.workunit.client.0.smithi115.stdout:0/985: write d9/d1d/d24/d26/d5d/fdd [4417803,15164] 0 2024-09-13T17:06:10.778 INFO:tasks.workunit.client.0.smithi115.stdout:0/986: creat d9/d1d/d24/d26/d36/d48/dbb/f12b x:0 0 0 2024-09-13T17:06:10.780 INFO:tasks.workunit.client.0.smithi115.stdout:0/987: creat d9/d1d/d24/d26/d36/dd7/d112/f12c x:0 0 0 2024-09-13T17:06:10.780 INFO:tasks.workunit.client.0.smithi115.stdout:0/988: creat d9/d1d/d24/f12d x:0 0 0 2024-09-13T17:06:10.800 INFO:tasks.workunit.client.0.smithi115.stdout:0/989: dwrite d9/f1f [0,4194304] 0 2024-09-13T17:06:10.800 INFO:tasks.workunit.client.0.smithi115.stdout:0/990: fsync d9/d1d/d24/d26/d5d/d66/db1/f103 0 2024-09-13T17:06:10.810 INFO:tasks.workunit.client.0.smithi115.stdout:0/991: write d9/d1d/d24/d26/d36/dd7/ffb [616820,118888] 0 2024-09-13T17:06:10.810 INFO:tasks.workunit.client.0.smithi115.stdout:0/992: fdatasync d9/d1d/d24/d26/d5d/f96 0 2024-09-13T17:06:10.810 INFO:tasks.workunit.client.0.smithi115.stdout:0/993: creat d9/d1d/d24/d26/d36/dd7/d112/f12e x:0 0 0 2024-09-13T17:06:10.818 INFO:tasks.workunit.client.0.smithi115.stdout:0/994: creat d9/d27/d88/d99/f12f x:0 0 0 2024-09-13T17:06:10.818 INFO:tasks.workunit.client.0.smithi115.stdout:0/995: readlink d9/d1d/de1/d30/d46/lf6 0 2024-09-13T17:06:10.818 INFO:tasks.workunit.client.0.smithi115.stdout:0/996: stat d9/d1d/d24/f25 0 2024-09-13T17:06:10.820 INFO:tasks.workunit.client.0.smithi115.stdout:0/997: creat d9/d1d/d24/d26/d5d/d66/f130 x:0 0 0 2024-09-13T17:06:10.824 INFO:tasks.workunit.client.0.smithi115.stdout:0/998: creat d9/d1d/d24/d7d/dfe/f131 x:0 0 0 2024-09-13T17:06:10.824 INFO:tasks.workunit.client.0.smithi115.stdout:0/999: chown d9/d1d/de1/d30 62319 1 2024-09-13T17:06:10.831 INFO:tasks.workunit.client.0.smithi115.stderr:+ rm -rf -- ./tmp.UwJuJJp2BL 2024-09-13T17:06:11.137 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:10 smithi115 ceph-mon[27708]: pgmap v24: 65 pgs: 65 active+clean; 3.0 GiB data, 9.1 GiB used, 527 GiB / 536 GiB avail; 215 MiB/s rd, 267 MiB/s wr, 483 op/s 2024-09-13T17:06:11.326 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:10 smithi195 ceph-mon[34981]: pgmap v24: 65 pgs: 65 active+clean; 3.0 GiB data, 9.1 GiB used, 527 GiB / 536 GiB avail; 215 MiB/s rd, 267 MiB/s wr, 483 op/s 2024-09-13T17:06:11.513 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-13T17:06:11.513 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-09-13T17:06:12.758 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:12.755+0000 7f6f05a4d640 1 -- 172.21.15.115:0/1169927731 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6f000fddf0 msgr2=0x7f6f000fe1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:12.759 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:12.755+0000 7f6f05a4d640 1 --2- 172.21.15.115:0/1169927731 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6f000fddf0 0x7f6f000fe1f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f6ef0009880 tx=0x7f6ef002a4a0 comp rx=0 tx=0).stop 2024-09-13T17:06:12.759 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:12.755+0000 7f6f05a4d640 1 -- 172.21.15.115:0/1169927731 shutdown_connections 2024-09-13T17:06:12.759 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:12.755+0000 7f6f05a4d640 1 --2- 172.21.15.115:0/1169927731 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6f00100dd0 0x7f6f00101250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:12.759 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:12.755+0000 7f6f05a4d640 1 --2- 172.21.15.115:0/1169927731 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6f000fddf0 0x7f6f000fe1f0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:12.759 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:12.755+0000 7f6f05a4d640 1 -- 172.21.15.115:0/1169927731 >> 172.21.15.115:0/1169927731 conn(0x7f6f000f9940 msgr2=0x7f6f000fbd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:12.759 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:12.755+0000 7f6f05a4d640 1 -- 172.21.15.115:0/1169927731 shutdown_connections 2024-09-13T17:06:12.759 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:12.755+0000 7f6f05a4d640 1 -- 172.21.15.115:0/1169927731 wait complete. 2024-09-13T17:06:12.759 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:12.756+0000 7f6f05a4d640 1 Processor -- start 2024-09-13T17:06:12.759 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:12.756+0000 7f6f05a4d640 1 -- start start 2024-09-13T17:06:12.759 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:12.756+0000 7f6f05a4d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6f000fddf0 0x7f6f00193350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:12.759 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:12.756+0000 7f6f05a4d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6f00100dd0 0x7f6f00193890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:12.759 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:12.756+0000 7f6f05a4d640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f00193e60 con 0x7f6f00100dd0 2024-09-13T17:06:12.760 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:12.756+0000 7f6f05a4d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f00193fd0 con 0x7f6f000fddf0 2024-09-13T17:06:12.760 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:12.757+0000 7f6efeffd640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6f000fddf0 0x7f6f00193350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:12.760 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:12.757+0000 7f6efeffd640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6f000fddf0 0x7f6f00193350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.115:40108/0 (socket says 172.21.15.115:40108) 2024-09-13T17:06:12.760 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:12.757+0000 7f6efeffd640 1 -- 172.21.15.115:0/3325774968 learned_addr learned my addr 172.21.15.115:0/3325774968 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:06:12.760 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:12.757+0000 7f6ef7fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6f00100dd0 0x7f6f00193890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:12.760 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:12.757+0000 7f6efeffd640 1 -- 172.21.15.115:0/3325774968 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6f00100dd0 msgr2=0x7f6f00193890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:12.760 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:12.757+0000 7f6efeffd640 1 --2- 172.21.15.115:0/3325774968 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6f00100dd0 0x7f6f00193890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:12.760 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:12.757+0000 7f6efeffd640 1 -- 172.21.15.115:0/3325774968 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ef0009560 con 0x7f6f000fddf0 2024-09-13T17:06:12.760 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:12.757+0000 7f6efeffd640 1 --2- 172.21.15.115:0/3325774968 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6f000fddf0 0x7f6f00193350 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6ef0004650 tx=0x7f6ef00055a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:12.760 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:12.757+0000 7f6f04a4b640 1 -- 172.21.15.115:0/3325774968 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ef0004aa0 con 0x7f6f000fddf0 2024-09-13T17:06:12.760 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:12.757+0000 7f6f04a4b640 1 -- 172.21.15.115:0/3325774968 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6ef0004c00 con 0x7f6f000fddf0 2024-09-13T17:06:12.760 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:12.757+0000 7f6f05a4d640 1 -- 172.21.15.115:0/3325774968 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f00198a10 con 0x7f6f000fddf0 2024-09-13T17:06:12.760 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:12.757+0000 7f6f04a4b640 1 -- 172.21.15.115:0/3325774968 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ef00318f0 con 0x7f6f000fddf0 2024-09-13T17:06:12.761 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:12.758+0000 7f6f05a4d640 1 -- 172.21.15.115:0/3325774968 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f00198f80 con 0x7f6f000fddf0 2024-09-13T17:06:12.762 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:12.759+0000 7f6f05a4d640 1 -- 172.21.15.115:0/3325774968 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f00106400 con 0x7f6f000fddf0 2024-09-13T17:06:12.762 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:12.759+0000 7f6f04a4b640 1 -- 172.21.15.115:0/3325774968 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 24) v1 ==== 90954+0+0 (secure 0 0 0) 0x7f6ef0031af0 con 0x7f6f000fddf0 2024-09-13T17:06:12.762 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:12.760+0000 7f6f04a4b640 1 --2- 172.21.15.115:0/3325774968 >> [v2:172.21.15.195:6828/1660911692,v1:172.21.15.195:6829/1660911692] conn(0x7f6eec06cd90 0x7f6eec06f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:12.762 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:12.760+0000 7f6f04a4b640 1 -- 172.21.15.115:0/3325774968 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f6ef00ad640 con 0x7f6f000fddf0 2024-09-13T17:06:12.762 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:12.760+0000 7f6ef7fff640 1 --2- 172.21.15.115:0/3325774968 >> [v2:172.21.15.195:6828/1660911692,v1:172.21.15.195:6829/1660911692] conn(0x7f6eec06cd90 0x7f6eec06f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:12.762 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:12.760+0000 7f6ef7fff640 1 --2- 172.21.15.115:0/3325774968 >> [v2:172.21.15.195:6828/1660911692,v1:172.21.15.195:6829/1660911692] conn(0x7f6eec06cd90 0x7f6eec06f250 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6f00194870 tx=0x7f6ee8011040 comp rx=0 tx=0).ready entity=mgr.24317 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:12.764 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:12.763+0000 7f6f04a4b640 1 -- 172.21.15.115:0/3325774968 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f6ef0077900 con 0x7f6f000fddf0 2024-09-13T17:06:13.033 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:12 smithi115 ceph-mon[27708]: pgmap v25: 65 pgs: 65 active+clean; 3.0 GiB data, 9.1 GiB used, 527 GiB / 536 GiB avail; 97 MiB/s rd, 122 MiB/s wr, 270 op/s 2024-09-13T17:06:13.070 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.068+0000 7f6f05a4d640 1 -- 172.21.15.115:0/3325774968 --> [v2:172.21.15.195:6828/1660911692,v1:172.21.15.195:6829/1660911692] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6f001991f0 con 0x7f6eec06cd90 2024-09-13T17:06:13.070 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.069+0000 7f6f04a4b640 1 -- 172.21.15.115:0/3325774968 <== mgr.24317 v2:172.21.15.195:6828/1660911692 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f6f001991f0 con 0x7f6eec06cd90 2024-09-13T17:06:13.074 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.073+0000 7f6f05a4d640 1 -- 172.21.15.115:0/3325774968 >> [v2:172.21.15.195:6828/1660911692,v1:172.21.15.195:6829/1660911692] conn(0x7f6eec06cd90 msgr2=0x7f6eec06f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:13.074 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.073+0000 7f6f05a4d640 1 --2- 172.21.15.115:0/3325774968 >> [v2:172.21.15.195:6828/1660911692,v1:172.21.15.195:6829/1660911692] conn(0x7f6eec06cd90 0x7f6eec06f250 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6f00194870 tx=0x7f6ee8011040 comp rx=0 tx=0).stop 2024-09-13T17:06:13.074 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.073+0000 7f6f05a4d640 1 -- 172.21.15.115:0/3325774968 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6f000fddf0 msgr2=0x7f6f00193350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:13.074 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.073+0000 7f6f05a4d640 1 --2- 172.21.15.115:0/3325774968 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6f000fddf0 0x7f6f00193350 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6ef0004650 tx=0x7f6ef00055a0 comp rx=0 tx=0).stop 2024-09-13T17:06:13.075 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.073+0000 7f6f05a4d640 1 -- 172.21.15.115:0/3325774968 shutdown_connections 2024-09-13T17:06:13.075 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.073+0000 7f6f05a4d640 1 --2- 172.21.15.115:0/3325774968 >> [v2:172.21.15.195:6828/1660911692,v1:172.21.15.195:6829/1660911692] conn(0x7f6eec06cd90 0x7f6eec06f250 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:13.075 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.073+0000 7f6f05a4d640 1 --2- 172.21.15.115:0/3325774968 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6f00100dd0 0x7f6f00193890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:13.075 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.073+0000 7f6f05a4d640 1 --2- 172.21.15.115:0/3325774968 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6f000fddf0 0x7f6f00193350 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:13.075 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.073+0000 7f6f05a4d640 1 -- 172.21.15.115:0/3325774968 >> 172.21.15.115:0/3325774968 conn(0x7f6f000f9940 msgr2=0x7f6f00104000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:13.075 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.073+0000 7f6f05a4d640 1 -- 172.21.15.115:0/3325774968 shutdown_connections 2024-09-13T17:06:13.075 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.073+0000 7f6f05a4d640 1 -- 172.21.15.115:0/3325774968 wait complete. 2024-09-13T17:06:13.087 INFO:teuthology.orchestra.run.smithi115.stdout:true 2024-09-13T17:06:13.185 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.183+0000 7fb6c933c640 1 -- 172.21.15.115:0/834459105 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb6c40fe430 msgr2=0x7fb6c40fe830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:13.185 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.183+0000 7fb6c933c640 1 --2- 172.21.15.115:0/834459105 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb6c40fe430 0x7fb6c40fe830 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb6b4009880 tx=0x7fb6b402a4a0 comp rx=0 tx=0).stop 2024-09-13T17:06:13.185 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.183+0000 7fb6c933c640 1 -- 172.21.15.115:0/834459105 shutdown_connections 2024-09-13T17:06:13.185 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.183+0000 7fb6c933c640 1 --2- 172.21.15.115:0/834459105 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb6c40fed70 0x7fb6c40ff1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:13.185 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.183+0000 7fb6c933c640 1 --2- 172.21.15.115:0/834459105 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb6c40fe430 0x7fb6c40fe830 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:13.185 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.183+0000 7fb6c933c640 1 -- 172.21.15.115:0/834459105 >> 172.21.15.115:0/834459105 conn(0x7fb6c40fa1c0 msgr2=0x7fb6c40fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:13.185 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.183+0000 7fb6c933c640 1 -- 172.21.15.115:0/834459105 shutdown_connections 2024-09-13T17:06:13.186 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.183+0000 7fb6c933c640 1 -- 172.21.15.115:0/834459105 wait complete. 2024-09-13T17:06:13.186 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.184+0000 7fb6c933c640 1 Processor -- start 2024-09-13T17:06:13.189 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.184+0000 7fb6c933c640 1 -- start start 2024-09-13T17:06:13.189 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.184+0000 7fb6c933c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb6c40fe430 0x7fb6c41976b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:13.190 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.184+0000 7fb6c933c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb6c40fed70 0x7fb6c4197bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:13.190 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.184+0000 7fb6c933c640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c41981c0 con 0x7fb6c40fed70 2024-09-13T17:06:13.190 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.184+0000 7fb6c933c640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c4198330 con 0x7fb6c40fe430 2024-09-13T17:06:13.190 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.185+0000 7fb6c27fc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb6c40fed70 0x7fb6c4197bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:13.190 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.185+0000 7fb6c27fc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb6c40fed70 0x7fb6c4197bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49148/0 (socket says 172.21.15.115:49148) 2024-09-13T17:06:13.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.185+0000 7fb6c27fc640 1 -- 172.21.15.115:0/1198347918 learned_addr learned my addr 172.21.15.115:0/1198347918 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:06:13.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.185+0000 7fb6c2ffd640 1 --2- 172.21.15.115:0/1198347918 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb6c40fe430 0x7fb6c41976b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:13.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.185+0000 7fb6c27fc640 1 -- 172.21.15.115:0/1198347918 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb6c40fe430 msgr2=0x7fb6c41976b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:13.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.185+0000 7fb6c27fc640 1 --2- 172.21.15.115:0/1198347918 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb6c40fe430 0x7fb6c41976b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:13.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.185+0000 7fb6c27fc640 1 -- 172.21.15.115:0/1198347918 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6b4009560 con 0x7fb6c40fed70 2024-09-13T17:06:13.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.185+0000 7fb6c27fc640 1 --2- 172.21.15.115:0/1198347918 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb6c40fed70 0x7fb6c4197bf0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb6b800e9a0 tx=0x7fb6b800ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:13.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.185+0000 7fb6abfff640 1 -- 172.21.15.115:0/1198347918 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb6b800cc90 con 0x7fb6c40fed70 2024-09-13T17:06:13.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.185+0000 7fb6abfff640 1 -- 172.21.15.115:0/1198347918 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb6b800cdf0 con 0x7fb6c40fed70 2024-09-13T17:06:13.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.185+0000 7fb6abfff640 1 -- 172.21.15.115:0/1198347918 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb6b8018770 con 0x7fb6c40fed70 2024-09-13T17:06:13.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.185+0000 7fb6c933c640 1 -- 172.21.15.115:0/1198347918 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6c419cd60 con 0x7fb6c40fed70 2024-09-13T17:06:13.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.186+0000 7fb6c933c640 1 -- 172.21.15.115:0/1198347918 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6c419d2d0 con 0x7fb6c40fed70 2024-09-13T17:06:13.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.187+0000 7fb6c933c640 1 -- 172.21.15.115:0/1198347918 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6c410a7d0 con 0x7fb6c40fed70 2024-09-13T17:06:13.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.188+0000 7fb6abfff640 1 -- 172.21.15.115:0/1198347918 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 24) v1 ==== 90954+0+0 (secure 0 0 0) 0x7fb6b8010b60 con 0x7fb6c40fed70 2024-09-13T17:06:13.192 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.188+0000 7fb6abfff640 1 --2- 172.21.15.115:0/1198347918 >> [v2:172.21.15.195:6828/1660911692,v1:172.21.15.195:6829/1660911692] conn(0x7fb6ac06cd90 0x7fb6ac06f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:13.192 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.188+0000 7fb6abfff640 1 -- 172.21.15.115:0/1198347918 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fb6b8014070 con 0x7fb6c40fed70 2024-09-13T17:06:13.192 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.189+0000 7fb6c2ffd640 1 --2- 172.21.15.115:0/1198347918 >> [v2:172.21.15.195:6828/1660911692,v1:172.21.15.195:6829/1660911692] conn(0x7fb6ac06cd90 0x7fb6ac06f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:13.192 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.190+0000 7fb6c2ffd640 1 --2- 172.21.15.115:0/1198347918 >> [v2:172.21.15.195:6828/1660911692,v1:172.21.15.195:6829/1660911692] conn(0x7fb6ac06cd90 0x7fb6ac06f250 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb6b4031460 tx=0x7fb6b4000bc0 comp rx=0 tx=0).ready entity=mgr.24317 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:13.198 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.197+0000 7fb6abfff640 1 -- 172.21.15.115:0/1198347918 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fb6b8056fb0 con 0x7fb6c40fed70 2024-09-13T17:06:13.326 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:12 smithi195 ceph-mon[34981]: pgmap v25: 65 pgs: 65 active+clean; 3.0 GiB data, 9.1 GiB used, 527 GiB / 536 GiB avail; 97 MiB/s rd, 122 MiB/s wr, 270 op/s 2024-09-13T17:06:13.474 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.472+0000 7fb6c933c640 1 -- 172.21.15.115:0/1198347918 --> [v2:172.21.15.195:6828/1660911692,v1:172.21.15.195:6829/1660911692] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb6c4108180 con 0x7fb6ac06cd90 2024-09-13T17:06:13.474 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.473+0000 7fb6abfff640 1 -- 172.21.15.115:0/1198347918 <== mgr.24317 v2:172.21.15.195:6828/1660911692 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7fb6c4108180 con 0x7fb6ac06cd90 2024-09-13T17:06:13.477 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.476+0000 7fb6c933c640 1 -- 172.21.15.115:0/1198347918 >> [v2:172.21.15.195:6828/1660911692,v1:172.21.15.195:6829/1660911692] conn(0x7fb6ac06cd90 msgr2=0x7fb6ac06f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:13.478 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.476+0000 7fb6c933c640 1 --2- 172.21.15.115:0/1198347918 >> [v2:172.21.15.195:6828/1660911692,v1:172.21.15.195:6829/1660911692] conn(0x7fb6ac06cd90 0x7fb6ac06f250 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb6b4031460 tx=0x7fb6b4000bc0 comp rx=0 tx=0).stop 2024-09-13T17:06:13.478 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.476+0000 7fb6c933c640 1 -- 172.21.15.115:0/1198347918 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb6c40fed70 msgr2=0x7fb6c4197bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:13.478 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.476+0000 7fb6c933c640 1 --2- 172.21.15.115:0/1198347918 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb6c40fed70 0x7fb6c4197bf0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb6b800e9a0 tx=0x7fb6b800ee60 comp rx=0 tx=0).stop 2024-09-13T17:06:13.478 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.476+0000 7fb6c933c640 1 -- 172.21.15.115:0/1198347918 shutdown_connections 2024-09-13T17:06:13.478 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.476+0000 7fb6c933c640 1 --2- 172.21.15.115:0/1198347918 >> [v2:172.21.15.195:6828/1660911692,v1:172.21.15.195:6829/1660911692] conn(0x7fb6ac06cd90 0x7fb6ac06f250 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:13.478 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.476+0000 7fb6c933c640 1 --2- 172.21.15.115:0/1198347918 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb6c40fed70 0x7fb6c4197bf0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:13.478 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.476+0000 7fb6c933c640 1 --2- 172.21.15.115:0/1198347918 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb6c40fe430 0x7fb6c41976b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:13.478 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.476+0000 7fb6c933c640 1 -- 172.21.15.115:0/1198347918 >> 172.21.15.115:0/1198347918 conn(0x7fb6c40fa1c0 msgr2=0x7fb6c4106a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:13.478 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.476+0000 7fb6c933c640 1 -- 172.21.15.115:0/1198347918 shutdown_connections 2024-09-13T17:06:13.478 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.477+0000 7fb6c933c640 1 -- 172.21.15.115:0/1198347918 wait complete. 2024-09-13T17:06:13.573 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.571+0000 7fdb1fa80640 1 -- 172.21.15.115:0/4198045048 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb180ffc30 msgr2=0x7fdb181000b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:13.574 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.571+0000 7fdb1fa80640 1 --2- 172.21.15.115:0/4198045048 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb180ffc30 0x7fdb181000b0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fdb08009880 tx=0x7fdb0802a4a0 comp rx=0 tx=0).stop 2024-09-13T17:06:13.574 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.572+0000 7fdb1fa80640 1 -- 172.21.15.115:0/4198045048 shutdown_connections 2024-09-13T17:06:13.574 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.572+0000 7fdb1fa80640 1 --2- 172.21.15.115:0/4198045048 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb180ffc30 0x7fdb181000b0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:13.574 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.572+0000 7fdb1fa80640 1 --2- 172.21.15.115:0/4198045048 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdb180fea30 0x7fdb180fee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:13.574 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.572+0000 7fdb1fa80640 1 -- 172.21.15.115:0/4198045048 >> 172.21.15.115:0/4198045048 conn(0x7fdb180fa1c0 msgr2=0x7fdb180fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:13.574 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.572+0000 7fdb1fa80640 1 -- 172.21.15.115:0/4198045048 shutdown_connections 2024-09-13T17:06:13.574 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.572+0000 7fdb1fa80640 1 -- 172.21.15.115:0/4198045048 wait complete. 2024-09-13T17:06:13.576 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.573+0000 7fdb1fa80640 1 Processor -- start 2024-09-13T17:06:13.576 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.573+0000 7fdb1fa80640 1 -- start start 2024-09-13T17:06:13.576 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.573+0000 7fdb1fa80640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdb180fea30 0x7fdb18068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:13.576 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.573+0000 7fdb1fa80640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb180ffc30 0x7fdb1819a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:13.576 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.573+0000 7fdb1fa80640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1819a8a0 con 0x7fdb180ffc30 2024-09-13T17:06:13.576 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.573+0000 7fdb1fa80640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1819a9e0 con 0x7fdb180fea30 2024-09-13T17:06:13.576 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.573+0000 7fdb1d81c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdb180fea30 0x7fdb18068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:13.576 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.573+0000 7fdb1d01b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb180ffc30 0x7fdb1819a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:13.577 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.573+0000 7fdb1d81c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdb180fea30 0x7fdb18068730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.115:40134/0 (socket says 172.21.15.115:40134) 2024-09-13T17:06:13.577 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.573+0000 7fdb1d81c640 1 -- 172.21.15.115:0/2181929006 learned_addr learned my addr 172.21.15.115:0/2181929006 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:06:13.577 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.574+0000 7fdb1d81c640 1 -- 172.21.15.115:0/2181929006 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb180ffc30 msgr2=0x7fdb1819a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:13.577 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.574+0000 7fdb1d81c640 1 --2- 172.21.15.115:0/2181929006 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb180ffc30 0x7fdb1819a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:13.577 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.574+0000 7fdb1d81c640 1 -- 172.21.15.115:0/2181929006 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb08009560 con 0x7fdb180fea30 2024-09-13T17:06:13.577 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.574+0000 7fdb1d01b640 1 --2- 172.21.15.115:0/2181929006 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb180ffc30 0x7fdb1819a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:06:13.577 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.574+0000 7fdb1d81c640 1 --2- 172.21.15.115:0/2181929006 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdb180fea30 0x7fdb18068730 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdb1400e940 tx=0x7fdb1400ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:13.577 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.574+0000 7fdb0effd640 1 -- 172.21.15.115:0/2181929006 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb140096e0 con 0x7fdb180fea30 2024-09-13T17:06:13.577 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.574+0000 7fdb0effd640 1 -- 172.21.15.115:0/2181929006 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdb140044d0 con 0x7fdb180fea30 2024-09-13T17:06:13.577 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.574+0000 7fdb1fa80640 1 -- 172.21.15.115:0/2181929006 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb1819ac70 con 0x7fdb180fea30 2024-09-13T17:06:13.577 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.574+0000 7fdb0effd640 1 -- 172.21.15.115:0/2181929006 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb14003ea0 con 0x7fdb180fea30 2024-09-13T17:06:13.578 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.574+0000 7fdb1fa80640 1 -- 172.21.15.115:0/2181929006 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb1819b1c0 con 0x7fdb180fea30 2024-09-13T17:06:13.578 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.575+0000 7fdb1fa80640 1 -- 172.21.15.115:0/2181929006 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb18107500 con 0x7fdb180fea30 2024-09-13T17:06:13.578 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.576+0000 7fdb0effd640 1 -- 172.21.15.115:0/2181929006 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 24) v1 ==== 90954+0+0 (secure 0 0 0) 0x7fdb1400cc90 con 0x7fdb180fea30 2024-09-13T17:06:13.578 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.576+0000 7fdb0effd640 1 --2- 172.21.15.115:0/2181929006 >> [v2:172.21.15.195:6828/1660911692,v1:172.21.15.195:6829/1660911692] conn(0x7fdb0406cd90 0x7fdb0406f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:13.579 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.577+0000 7fdb0effd640 1 -- 172.21.15.115:0/2181929006 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fdb14014070 con 0x7fdb180fea30 2024-09-13T17:06:13.579 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.577+0000 7fdb1d01b640 1 --2- 172.21.15.115:0/2181929006 >> [v2:172.21.15.195:6828/1660911692,v1:172.21.15.195:6829/1660911692] conn(0x7fdb0406cd90 0x7fdb0406f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:13.579 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.577+0000 7fdb1d01b640 1 --2- 172.21.15.115:0/2181929006 >> [v2:172.21.15.195:6828/1660911692,v1:172.21.15.195:6829/1660911692] conn(0x7fdb0406cd90 0x7fdb0406f250 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fdb180684b0 tx=0x7fdb08031400 comp rx=0 tx=0).ready entity=mgr.24317 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:13.582 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.581+0000 7fdb0effd640 1 -- 172.21.15.115:0/2181929006 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fdb14056ae0 con 0x7fdb180fea30 2024-09-13T17:06:13.824 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.823+0000 7fdb1fa80640 1 -- 172.21.15.115:0/2181929006 --> [v2:172.21.15.195:6828/1660911692,v1:172.21.15.195:6829/1660911692] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fdb1819b470 con 0x7fdb0406cd90 2024-09-13T17:06:13.833 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.832+0000 7fdb0effd640 1 -- 172.21.15.115:0/2181929006 <== mgr.24317 v2:172.21.15.195:6828/1660911692 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7fdb1819b470 con 0x7fdb0406cd90 2024-09-13T17:06:13.834 INFO:teuthology.orchestra.run.smithi115.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T17:06:13.834 INFO:teuthology.orchestra.run.smithi115.stdout:alertmanager.smithi115 smithi115 *:9093,9094 running (6m) 24s ago 8m 25.1M - 0.25.0 c8568f914cd2 cbe091cee151 2024-09-13T17:06:13.834 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-exporter.smithi115 smithi115 running (8m) 24s ago 8m 7838k - 18.2.4-843-g2c01458a c129f5a2fd4e 0f1eebeaf9bb 2024-09-13T17:06:13.834 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-exporter.smithi195 smithi195 running (7m) 42s ago 7m 7440k - 18.2.4-843-g2c01458a c129f5a2fd4e 6d05bafbac8a 2024-09-13T17:06:13.834 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi115 smithi115 running (8m) 24s ago 8m 6899k - 18.2.4-843-g2c01458a c129f5a2fd4e 624a903fec23 2024-09-13T17:06:13.834 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi195 smithi195 running (7m) 42s ago 7m 6891k - 18.2.4-843-g2c01458a c129f5a2fd4e 42e6ce26130d 2024-09-13T17:06:13.834 INFO:teuthology.orchestra.run.smithi115.stdout:grafana.smithi115 smithi115 *:3000 running (6m) 24s ago 8m 87.7M - 9.4.7 954c08fa6188 41183f0705c8 2024-09-13T17:06:13.834 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi115.hbtxod smithi115 running (2m) 24s ago 2m 100M - 18.2.4-843-g2c01458a c129f5a2fd4e 12b4f4874491 2024-09-13T17:06:13.834 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi115.ijznvr smithi115 running (2m) 24s ago 2m 162M - 18.2.4-843-g2c01458a c129f5a2fd4e 2d552564a9f4 2024-09-13T17:06:13.834 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi195.aevvgz smithi195 running (2m) 42s ago 2m 15.0M - 18.2.4-843-g2c01458a c129f5a2fd4e 299b9ad657c9 2024-09-13T17:06:13.834 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi195.qzghxj smithi195 running (2m) 42s ago 2m 13.2M - 18.2.4-843-g2c01458a c129f5a2fd4e fb16b16181ff 2024-09-13T17:06:13.835 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi115.hetcni smithi115 *:9283,8765,8443 running (9m) 24s ago 9m 124M - 18.2.4-843-g2c01458a c129f5a2fd4e f2f0af4ec38c 2024-09-13T17:06:13.835 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi195.hjjifz smithi195 *:8443,9283,8765 running (67s) 42s ago 7m 463M - 18.2.4-860-g6c6b083f 8a91f241d7d4 efed836fb2b0 2024-09-13T17:06:13.835 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi115 smithi115 running (9m) 24s ago 9m 49.4M 2048M 18.2.4-843-g2c01458a c129f5a2fd4e 202375d41e68 2024-09-13T17:06:13.835 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi195 smithi195 running (7m) 42s ago 7m 39.7M 2048M 18.2.4-843-g2c01458a c129f5a2fd4e 0f54c30e5970 2024-09-13T17:06:13.835 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi115 smithi115 *:9100 running (8m) 24s ago 8m 16.2M - 1.5.0 0da6a335fe13 9074300dbe31 2024-09-13T17:06:13.835 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi195 smithi195 *:9100 running (7m) 42s ago 7m 15.8M - 1.5.0 0da6a335fe13 d7b54e5d8c97 2024-09-13T17:06:13.835 INFO:teuthology.orchestra.run.smithi115.stdout:osd.0 smithi115 running (6m) 24s ago 6m 113M 1216M 18.2.4-843-g2c01458a c129f5a2fd4e 8a8ad231962e 2024-09-13T17:06:13.835 INFO:teuthology.orchestra.run.smithi115.stdout:osd.1 smithi115 running (6m) 24s ago 6m 122M 1216M 18.2.4-843-g2c01458a c129f5a2fd4e 3fbc020102a0 2024-09-13T17:06:13.835 INFO:teuthology.orchestra.run.smithi115.stdout:osd.2 smithi115 running (5m) 24s ago 5m 111M 1216M 18.2.4-843-g2c01458a c129f5a2fd4e 7c623823e920 2024-09-13T17:06:13.835 INFO:teuthology.orchestra.run.smithi115.stdout:osd.3 smithi195 running (5m) 42s ago 5m 128M 2240M 18.2.4-843-g2c01458a c129f5a2fd4e 10ea833fd5c5 2024-09-13T17:06:13.835 INFO:teuthology.orchestra.run.smithi115.stdout:osd.4 smithi195 running (4m) 42s ago 4m 122M 2240M 18.2.4-843-g2c01458a c129f5a2fd4e 4bbc3acb9aff 2024-09-13T17:06:13.835 INFO:teuthology.orchestra.run.smithi115.stdout:osd.5 smithi195 running (4m) 42s ago 4m 113M 2240M 18.2.4-843-g2c01458a c129f5a2fd4e 4bd1b3a232d0 2024-09-13T17:06:13.835 INFO:teuthology.orchestra.run.smithi115.stdout:prometheus.smithi115 smithi115 *:9095 starting - - - - 2024-09-13T17:06:13.837 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.836+0000 7fdb1fa80640 1 -- 172.21.15.115:0/2181929006 >> [v2:172.21.15.195:6828/1660911692,v1:172.21.15.195:6829/1660911692] conn(0x7fdb0406cd90 msgr2=0x7fdb0406f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:13.837 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.836+0000 7fdb1fa80640 1 --2- 172.21.15.115:0/2181929006 >> [v2:172.21.15.195:6828/1660911692,v1:172.21.15.195:6829/1660911692] conn(0x7fdb0406cd90 0x7fdb0406f250 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fdb180684b0 tx=0x7fdb08031400 comp rx=0 tx=0).stop 2024-09-13T17:06:13.837 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.836+0000 7fdb1fa80640 1 -- 172.21.15.115:0/2181929006 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdb180fea30 msgr2=0x7fdb18068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:13.837 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.836+0000 7fdb1fa80640 1 --2- 172.21.15.115:0/2181929006 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdb180fea30 0x7fdb18068730 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdb1400e940 tx=0x7fdb1400ee00 comp rx=0 tx=0).stop 2024-09-13T17:06:13.837 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.836+0000 7fdb1fa80640 1 -- 172.21.15.115:0/2181929006 shutdown_connections 2024-09-13T17:06:13.837 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.836+0000 7fdb1fa80640 1 --2- 172.21.15.115:0/2181929006 >> [v2:172.21.15.195:6828/1660911692,v1:172.21.15.195:6829/1660911692] conn(0x7fdb0406cd90 0x7fdb0406f250 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:13.837 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.836+0000 7fdb1fa80640 1 --2- 172.21.15.115:0/2181929006 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb180ffc30 0x7fdb1819a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:13.838 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.836+0000 7fdb1fa80640 1 --2- 172.21.15.115:0/2181929006 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdb180fea30 0x7fdb18068730 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:13.838 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.836+0000 7fdb1fa80640 1 -- 172.21.15.115:0/2181929006 >> 172.21.15.115:0/2181929006 conn(0x7fdb180fa1c0 msgr2=0x7fdb18102e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:13.838 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.836+0000 7fdb1fa80640 1 -- 172.21.15.115:0/2181929006 shutdown_connections 2024-09-13T17:06:13.838 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.836+0000 7fdb1fa80640 1 -- 172.21.15.115:0/2181929006 wait complete. 2024-09-13T17:06:13.973 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.971+0000 7f0e3b932640 1 -- 172.21.15.115:0/955488016 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e341077d0 msgr2=0x7f0e34107c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:13.973 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.971+0000 7f0e3b932640 1 --2- 172.21.15.115:0/955488016 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e341077d0 0x7f0e34107c50 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f0e24009880 tx=0x7f0e2402a4b0 comp rx=0 tx=0).stop 2024-09-13T17:06:13.973 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.972+0000 7f0e3b932640 1 -- 172.21.15.115:0/955488016 shutdown_connections 2024-09-13T17:06:13.973 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.972+0000 7f0e3b932640 1 --2- 172.21.15.115:0/955488016 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e341077d0 0x7f0e34107c50 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:13.974 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.972+0000 7f0e3b932640 1 --2- 172.21.15.115:0/955488016 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0e34071890 0x7f0e34071c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:13.974 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.972+0000 7f0e3b932640 1 -- 172.21.15.115:0/955488016 >> 172.21.15.115:0/955488016 conn(0x7f0e3406cf90 msgr2=0x7f0e3406f3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:13.974 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.973+0000 7f0e3b932640 1 -- 172.21.15.115:0/955488016 shutdown_connections 2024-09-13T17:06:13.974 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.973+0000 7f0e3b932640 1 -- 172.21.15.115:0/955488016 wait complete. 2024-09-13T17:06:13.975 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.974+0000 7f0e3b932640 1 Processor -- start 2024-09-13T17:06:13.975 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.974+0000 7f0e3b932640 1 -- start start 2024-09-13T17:06:13.975 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.975+0000 7f0e3b932640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e34071890 0x7f0e3419cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:13.976 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.975+0000 7f0e3b932640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0e341077d0 0x7f0e3419d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:13.976 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.975+0000 7f0e3b932640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3419d770 con 0x7f0e34071890 2024-09-13T17:06:13.976 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.975+0000 7f0e3b932640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3419d8e0 con 0x7f0e341077d0 2024-09-13T17:06:13.977 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.976+0000 7f0e396ce640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e34071890 0x7f0e3419cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:13.977 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.976+0000 7f0e38ecd640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0e341077d0 0x7f0e3419d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:13.977 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.976+0000 7f0e396ce640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e34071890 0x7f0e3419cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49178/0 (socket says 172.21.15.115:49178) 2024-09-13T17:06:13.977 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.976+0000 7f0e396ce640 1 -- 172.21.15.115:0/1823413834 learned_addr learned my addr 172.21.15.115:0/1823413834 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:06:13.978 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.976+0000 7f0e396ce640 1 -- 172.21.15.115:0/1823413834 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0e341077d0 msgr2=0x7f0e3419d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:13.978 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.976+0000 7f0e396ce640 1 --2- 172.21.15.115:0/1823413834 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0e341077d0 0x7f0e3419d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:13.978 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.977+0000 7f0e396ce640 1 -- 172.21.15.115:0/1823413834 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e24009560 con 0x7f0e34071890 2024-09-13T17:06:13.980 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.979+0000 7f0e396ce640 1 --2- 172.21.15.115:0/1823413834 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e34071890 0x7f0e3419cc60 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f0e3000d8d0 tx=0x7f0e3000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:13.981 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.980+0000 7f0e2a7fc640 1 -- 172.21.15.115:0/1823413834 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e3000bea0 con 0x7f0e34071890 2024-09-13T17:06:13.981 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.980+0000 7f0e2a7fc640 1 -- 172.21.15.115:0/1823413834 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0e30009c00 con 0x7f0e34071890 2024-09-13T17:06:13.981 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.980+0000 7f0e3b932640 1 -- 172.21.15.115:0/1823413834 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e341a2370 con 0x7f0e34071890 2024-09-13T17:06:13.982 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.980+0000 7f0e3b932640 1 -- 172.21.15.115:0/1823413834 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e341a2940 con 0x7f0e34071890 2024-09-13T17:06:13.983 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.982+0000 7f0e2a7fc640 1 -- 172.21.15.115:0/1823413834 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e3000f680 con 0x7f0e34071890 2024-09-13T17:06:13.984 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.983+0000 7f0e2a7fc640 1 -- 172.21.15.115:0/1823413834 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 24) v1 ==== 90954+0+0 (secure 0 0 0) 0x7f0e30010460 con 0x7f0e34071890 2024-09-13T17:06:13.984 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.983+0000 7f0e1ffff640 1 -- 172.21.15.115:0/1823413834 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e34071c90 con 0x7f0e34071890 2024-09-13T17:06:13.985 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.984+0000 7f0e2a7fc640 1 --2- 172.21.15.115:0/1823413834 >> [v2:172.21.15.195:6828/1660911692,v1:172.21.15.195:6829/1660911692] conn(0x7f0e2006cc10 0x7f0e2006f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:13.985 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.984+0000 7f0e2a7fc640 1 -- 172.21.15.115:0/1823413834 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f0e3008c450 con 0x7f0e34071890 2024-09-13T17:06:13.985 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.984+0000 7f0e38ecd640 1 --2- 172.21.15.115:0/1823413834 >> [v2:172.21.15.195:6828/1660911692,v1:172.21.15.195:6829/1660911692] conn(0x7f0e2006cc10 0x7f0e2006f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:13.986 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.986+0000 7f0e38ecd640 1 --2- 172.21.15.115:0/1823413834 >> [v2:172.21.15.195:6828/1660911692,v1:172.21.15.195:6829/1660911692] conn(0x7f0e2006cc10 0x7f0e2006f0d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0e24006010 tx=0x7f0e24031420 comp rx=0 tx=0).ready entity=mgr.24317 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:13.994 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:13.993+0000 7f0e2a7fc640 1 -- 172.21.15.115:0/1823413834 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f0e30059f10 con 0x7f0e34071890 2024-09-13T17:06:14.011 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:13 smithi115 ceph-mon[27708]: from='client.24381 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:06:14.011 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:13 smithi115 ceph-mon[27708]: from='mgr.24317 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:06:14.011 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:13 smithi115 ceph-mon[27708]: from='mgr.24317 ' entity='mgr.smithi195.hjjifz' 2024-09-13T17:06:14.011 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:13 smithi115 ceph-mon[27708]: from='mgr.24317 ' entity='mgr.smithi195.hjjifz' 2024-09-13T17:06:14.011 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:13 smithi115 ceph-mon[27708]: from='mgr.24317 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T17:06:14.011 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:13 smithi115 ceph-mon[27708]: from='mgr.24317 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:06:14.328 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:13 smithi195 ceph-mon[34981]: from='client.24381 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:06:14.329 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:13 smithi195 ceph-mon[34981]: from='mgr.24317 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:06:14.329 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:13 smithi195 ceph-mon[34981]: from='mgr.24317 ' entity='mgr.smithi195.hjjifz' 2024-09-13T17:06:14.329 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:13 smithi195 ceph-mon[34981]: from='mgr.24317 ' entity='mgr.smithi195.hjjifz' 2024-09-13T17:06:14.329 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:13 smithi195 ceph-mon[34981]: from='mgr.24317 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T17:06:14.329 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:13 smithi195 ceph-mon[34981]: from='mgr.24317 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:06:14.356 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:14.355+0000 7f0e1ffff640 1 -- 172.21.15.115:0/1823413834 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0e3410fdf0 con 0x7f0e34071890 2024-09-13T17:06:14.357 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:14.356+0000 7f0e2a7fc640 1 -- 172.21.15.115:0/1823413834 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+838 (secure 0 0 0) 0x7f0e30020360 con 0x7f0e34071890 2024-09-13T17:06:14.357 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-13T17:06:14.357 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": { 2024-09-13T17:06:14.357 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-843-g2c01458a (2c01458affee2b2435cd231b6e392435c1c21661) reef (stable)": 2 2024-09-13T17:06:14.357 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T17:06:14.357 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": { 2024-09-13T17:06:14.357 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-843-g2c01458a (2c01458affee2b2435cd231b6e392435c1c21661) reef (stable)": 1, 2024-09-13T17:06:14.357 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 1 2024-09-13T17:06:14.357 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T17:06:14.358 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": { 2024-09-13T17:06:14.358 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-843-g2c01458a (2c01458affee2b2435cd231b6e392435c1c21661) reef (stable)": 6 2024-09-13T17:06:14.358 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T17:06:14.358 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": { 2024-09-13T17:06:14.358 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-843-g2c01458a (2c01458affee2b2435cd231b6e392435c1c21661) reef (stable)": 4 2024-09-13T17:06:14.358 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T17:06:14.358 INFO:teuthology.orchestra.run.smithi115.stdout: "overall": { 2024-09-13T17:06:14.358 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-843-g2c01458a (2c01458affee2b2435cd231b6e392435c1c21661) reef (stable)": 13, 2024-09-13T17:06:14.358 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 1 2024-09-13T17:06:14.358 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-13T17:06:14.358 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-13T17:06:14.359 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:14.358+0000 7f0e1ffff640 1 -- 172.21.15.115:0/1823413834 >> [v2:172.21.15.195:6828/1660911692,v1:172.21.15.195:6829/1660911692] conn(0x7f0e2006cc10 msgr2=0x7f0e2006f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:14.359 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:14.358+0000 7f0e1ffff640 1 --2- 172.21.15.115:0/1823413834 >> [v2:172.21.15.195:6828/1660911692,v1:172.21.15.195:6829/1660911692] conn(0x7f0e2006cc10 0x7f0e2006f0d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0e24006010 tx=0x7f0e24031420 comp rx=0 tx=0).stop 2024-09-13T17:06:14.359 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:14.358+0000 7f0e1ffff640 1 -- 172.21.15.115:0/1823413834 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e34071890 msgr2=0x7f0e3419cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:14.360 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:14.358+0000 7f0e1ffff640 1 --2- 172.21.15.115:0/1823413834 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e34071890 0x7f0e3419cc60 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f0e3000d8d0 tx=0x7f0e3000dd90 comp rx=0 tx=0).stop 2024-09-13T17:06:14.360 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:14.358+0000 7f0e1ffff640 1 -- 172.21.15.115:0/1823413834 shutdown_connections 2024-09-13T17:06:14.360 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:14.358+0000 7f0e1ffff640 1 --2- 172.21.15.115:0/1823413834 >> [v2:172.21.15.195:6828/1660911692,v1:172.21.15.195:6829/1660911692] conn(0x7f0e2006cc10 0x7f0e2006f0d0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:14.360 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:14.358+0000 7f0e1ffff640 1 --2- 172.21.15.115:0/1823413834 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0e341077d0 0x7f0e3419d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:14.360 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:14.358+0000 7f0e1ffff640 1 --2- 172.21.15.115:0/1823413834 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e34071890 0x7f0e3419cc60 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:14.360 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:14.358+0000 7f0e1ffff640 1 -- 172.21.15.115:0/1823413834 >> 172.21.15.115:0/1823413834 conn(0x7f0e3406cf90 msgr2=0x7f0e3410aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:14.360 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:14.358+0000 7f0e1ffff640 1 -- 172.21.15.115:0/1823413834 shutdown_connections 2024-09-13T17:06:14.360 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:14.358+0000 7f0e1ffff640 1 -- 172.21.15.115:0/1823413834 wait complete. 2024-09-13T17:06:14.458 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:14.457+0000 7fe55858b640 1 -- 172.21.15.115:0/931593291 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe550100610 msgr2=0x7fe550102a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:14.459 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:14.457+0000 7fe55858b640 1 --2- 172.21.15.115:0/931593291 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe550100610 0x7fe550102a00 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fe54c0098b0 tx=0x7fe54c02a4d0 comp rx=0 tx=0).stop 2024-09-13T17:06:14.459 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:14.457+0000 7fe55858b640 1 -- 172.21.15.115:0/931593291 shutdown_connections 2024-09-13T17:06:14.459 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:14.457+0000 7fe55858b640 1 --2- 172.21.15.115:0/931593291 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe550102f40 0x7fe550105330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:14.459 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:14.457+0000 7fe55858b640 1 --2- 172.21.15.115:0/931593291 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe550100610 0x7fe550102a00 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:14.459 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:14.457+0000 7fe55858b640 1 -- 172.21.15.115:0/931593291 >> 172.21.15.115:0/931593291 conn(0x7fe5500fa210 msgr2=0x7fe5500fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:14.459 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:14.457+0000 7fe55858b640 1 -- 172.21.15.115:0/931593291 shutdown_connections 2024-09-13T17:06:14.459 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:14.457+0000 7fe55858b640 1 -- 172.21.15.115:0/931593291 wait complete. 2024-09-13T17:06:14.460 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:14.458+0000 7fe55858b640 1 Processor -- start 2024-09-13T17:06:14.461 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:14.458+0000 7fe55858b640 1 -- start start 2024-09-13T17:06:14.461 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:14.458+0000 7fe55858b640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe550100610 0x7fe5501955a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:14.461 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:14.458+0000 7fe55858b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe550102f40 0x7fe550195ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:14.461 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:14.458+0000 7fe55858b640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5501960b0 con 0x7fe550102f40 2024-09-13T17:06:14.461 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:14.458+0000 7fe55858b640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe550196220 con 0x7fe550100610 2024-09-13T17:06:14.461 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:14.458+0000 7fe555b26640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe550102f40 0x7fe550195ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:14.461 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:14.458+0000 7fe556327640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe550100610 0x7fe5501955a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:14.461 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:14.458+0000 7fe555b26640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe550102f40 0x7fe550195ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57984/0 (socket says 172.21.15.115:57984) 2024-09-13T17:06:14.461 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:14.458+0000 7fe555b26640 1 -- 172.21.15.115:0/2721193394 learned_addr learned my addr 172.21.15.115:0/2721193394 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:06:14.461 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:14.459+0000 7fe556327640 1 -- 172.21.15.115:0/2721193394 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe550102f40 msgr2=0x7fe550195ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:14.461 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:14.459+0000 7fe556327640 1 --2- 172.21.15.115:0/2721193394 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe550102f40 0x7fe550195ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:14.461 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:14.459+0000 7fe556327640 1 -- 172.21.15.115:0/2721193394 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe54c009560 con 0x7fe550100610 2024-09-13T17:06:14.461 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:14.459+0000 7fe556327640 1 --2- 172.21.15.115:0/2721193394 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe550100610 0x7fe5501955a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe54c02a9f0 tx=0x7fe54c0055a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:14.461 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:14.459+0000 7fe5477fe640 1 -- 172.21.15.115:0/2721193394 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe54c004aa0 con 0x7fe550100610 2024-09-13T17:06:14.462 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:14.459+0000 7fe5477fe640 1 -- 172.21.15.115:0/2721193394 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe54c004c00 con 0x7fe550100610 2024-09-13T17:06:14.462 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:14.459+0000 7fe55858b640 1 -- 172.21.15.115:0/2721193394 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe55019ac60 con 0x7fe550100610 2024-09-13T17:06:14.462 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:14.460+0000 7fe5477fe640 1 -- 172.21.15.115:0/2721193394 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe54c0319f0 con 0x7fe550100610 2024-09-13T17:06:14.462 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:14.460+0000 7fe55858b640 1 -- 172.21.15.115:0/2721193394 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe55019b150 con 0x7fe550100610 2024-09-13T17:06:14.462 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:14.461+0000 7fe5477fe640 1 -- 172.21.15.115:0/2721193394 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 24) v1 ==== 90954+0+0 (secure 0 0 0) 0x7fe54c031ba0 con 0x7fe550100610 2024-09-13T17:06:14.462 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:14.462+0000 7fe5457fa640 1 -- 172.21.15.115:0/2721193394 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe550108680 con 0x7fe550100610 2024-09-13T17:06:14.463 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:14.462+0000 7fe5477fe640 1 --2- 172.21.15.115:0/2721193394 >> [v2:172.21.15.195:6828/1660911692,v1:172.21.15.195:6829/1660911692] conn(0x7fe53c06cd90 0x7fe53c06f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:14.463 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:14.463+0000 7fe555b26640 1 --2- 172.21.15.115:0/2721193394 >> [v2:172.21.15.195:6828/1660911692,v1:172.21.15.195:6829/1660911692] conn(0x7fe53c06cd90 0x7fe53c06f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:14.464 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:14.463+0000 7fe5477fe640 1 -- 172.21.15.115:0/2721193394 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fe54c0accd0 con 0x7fe550100610 2024-09-13T17:06:14.464 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:14.463+0000 7fe555b26640 1 --2- 172.21.15.115:0/2721193394 >> [v2:172.21.15.195:6828/1660911692,v1:172.21.15.195:6829/1660911692] conn(0x7fe53c06cd90 0x7fe53c06f250 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe550196ac0 tx=0x7fe54000b410 comp rx=0 tx=0).ready entity=mgr.24317 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:14.467 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:14.466+0000 7fe5477fe640 1 -- 172.21.15.115:0/2721193394 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe54c076f30 con 0x7fe550100610 2024-09-13T17:06:14.753 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:14.752+0000 7fe5457fa640 1 -- 172.21.15.115:0/2721193394 --> [v2:172.21.15.195:6828/1660911692,v1:172.21.15.195:6829/1660911692] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe550108810 con 0x7fe53c06cd90 2024-09-13T17:06:14.754 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:14.753+0000 7fe5477fe640 1 -- 172.21.15.115:0/2721193394 <== mgr.24317 v2:172.21.15.195:6828/1660911692 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7fe550108810 con 0x7fe53c06cd90 2024-09-13T17:06:14.754 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-13T17:06:14.754 INFO:teuthology.orchestra.run.smithi115.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256", 2024-09-13T17:06:14.755 INFO:teuthology.orchestra.run.smithi115.stdout: "in_progress": true, 2024-09-13T17:06:14.755 INFO:teuthology.orchestra.run.smithi115.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-13T17:06:14.755 INFO:teuthology.orchestra.run.smithi115.stdout: "services_complete": [], 2024-09-13T17:06:14.755 INFO:teuthology.orchestra.run.smithi115.stdout: "progress": "1/2 daemons upgraded", 2024-09-13T17:06:14.755 INFO:teuthology.orchestra.run.smithi115.stdout: "message": "Currently upgrading mgr daemons", 2024-09-13T17:06:14.755 INFO:teuthology.orchestra.run.smithi115.stdout: "is_paused": false 2024-09-13T17:06:14.755 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-13T17:06:14.757 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:14.756+0000 7fe5457fa640 1 -- 172.21.15.115:0/2721193394 >> [v2:172.21.15.195:6828/1660911692,v1:172.21.15.195:6829/1660911692] conn(0x7fe53c06cd90 msgr2=0x7fe53c06f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:14.757 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:14.756+0000 7fe5457fa640 1 --2- 172.21.15.115:0/2721193394 >> [v2:172.21.15.195:6828/1660911692,v1:172.21.15.195:6829/1660911692] conn(0x7fe53c06cd90 0x7fe53c06f250 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe550196ac0 tx=0x7fe54000b410 comp rx=0 tx=0).stop 2024-09-13T17:06:14.757 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:14.756+0000 7fe5457fa640 1 -- 172.21.15.115:0/2721193394 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe550100610 msgr2=0x7fe5501955a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:14.757 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:14.756+0000 7fe5457fa640 1 --2- 172.21.15.115:0/2721193394 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe550100610 0x7fe5501955a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe54c02a9f0 tx=0x7fe54c0055a0 comp rx=0 tx=0).stop 2024-09-13T17:06:14.757 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:14.756+0000 7fe5457fa640 1 -- 172.21.15.115:0/2721193394 shutdown_connections 2024-09-13T17:06:14.757 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:14.756+0000 7fe5457fa640 1 --2- 172.21.15.115:0/2721193394 >> [v2:172.21.15.195:6828/1660911692,v1:172.21.15.195:6829/1660911692] conn(0x7fe53c06cd90 0x7fe53c06f250 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:14.758 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:14.756+0000 7fe5457fa640 1 --2- 172.21.15.115:0/2721193394 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe550102f40 0x7fe550195ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:14.758 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:14.756+0000 7fe5457fa640 1 --2- 172.21.15.115:0/2721193394 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe550100610 0x7fe5501955a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:14.758 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:14.756+0000 7fe5457fa640 1 -- 172.21.15.115:0/2721193394 >> 172.21.15.115:0/2721193394 conn(0x7fe5500fa210 msgr2=0x7fe5500fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:14.758 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:14.756+0000 7fe5457fa640 1 -- 172.21.15.115:0/2721193394 shutdown_connections 2024-09-13T17:06:14.758 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:14.756+0000 7fe5457fa640 1 -- 172.21.15.115:0/2721193394 wait complete. 2024-09-13T17:06:15.081 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:14 smithi115 ceph-mon[27708]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T17:06:15.081 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:14 smithi115 ceph-mon[27708]: Upgrade: Need to upgrade myself (mgr.smithi195.hjjifz) 2024-09-13T17:06:15.081 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:14 smithi115 ceph-mon[27708]: Upgrade: Need to upgrade myself (mgr.smithi195.hjjifz) 2024-09-13T17:06:15.081 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:14 smithi115 ceph-mon[27708]: from='client.14644 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:06:15.082 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:14 smithi115 ceph-mon[27708]: pgmap v26: 65 pgs: 65 active+clean; 2.8 GiB data, 8.7 GiB used, 528 GiB / 536 GiB avail; 98 MiB/s rd, 126 MiB/s wr, 315 op/s 2024-09-13T17:06:15.082 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:14 smithi115 ceph-mon[27708]: from='client.24389 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:06:15.082 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:14 smithi115 ceph-mon[27708]: from='client.? 172.21.15.115:0/1823413834' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:06:15.082 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:14 smithi115 ceph-mon[27708]: from='mgr.24317 ' entity='mgr.smithi195.hjjifz' 2024-09-13T17:06:15.082 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:14 smithi115 ceph-mon[27708]: from='mgr.24317 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi115.hetcni", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T17:06:15.082 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:14 smithi115 ceph-mon[27708]: from='mgr.24317 ' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi115.hetcni", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T17:06:15.082 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:14 smithi115 ceph-mon[27708]: from='mgr.24317 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T17:06:15.082 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:14 smithi115 ceph-mon[27708]: from='mgr.24317 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:06:15.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:14 smithi195 ceph-mon[34981]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T17:06:15.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:14 smithi195 ceph-mon[34981]: Upgrade: Need to upgrade myself (mgr.smithi195.hjjifz) 2024-09-13T17:06:15.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:14 smithi195 ceph-mon[34981]: Upgrade: Need to upgrade myself (mgr.smithi195.hjjifz) 2024-09-13T17:06:15.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:14 smithi195 ceph-mon[34981]: from='client.14644 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:06:15.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:14 smithi195 ceph-mon[34981]: pgmap v26: 65 pgs: 65 active+clean; 2.8 GiB data, 8.7 GiB used, 528 GiB / 536 GiB avail; 98 MiB/s rd, 126 MiB/s wr, 315 op/s 2024-09-13T17:06:15.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:14 smithi195 ceph-mon[34981]: from='client.24389 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:06:15.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:14 smithi195 ceph-mon[34981]: from='client.? 172.21.15.115:0/1823413834' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:06:15.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:14 smithi195 ceph-mon[34981]: from='mgr.24317 ' entity='mgr.smithi195.hjjifz' 2024-09-13T17:06:15.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:14 smithi195 ceph-mon[34981]: from='mgr.24317 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi115.hetcni", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T17:06:15.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:14 smithi195 ceph-mon[34981]: from='mgr.24317 ' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi115.hetcni", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T17:06:15.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:14 smithi195 ceph-mon[34981]: from='mgr.24317 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T17:06:15.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:14 smithi195 ceph-mon[34981]: from='mgr.24317 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:06:16.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:15 smithi115 ceph-mon[27708]: Upgrade: Updating mgr.smithi115.hetcni 2024-09-13T17:06:16.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:15 smithi115 ceph-mon[27708]: Deploying daemon mgr.smithi115.hetcni on smithi115 2024-09-13T17:06:16.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:15 smithi115 ceph-mon[27708]: from='client.24397 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:06:16.326 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:15 smithi195 ceph-mon[34981]: Upgrade: Updating mgr.smithi115.hetcni 2024-09-13T17:06:16.326 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:15 smithi195 ceph-mon[34981]: Deploying daemon mgr.smithi115.hetcni on smithi115 2024-09-13T17:06:16.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:15 smithi195 ceph-mon[34981]: from='client.24397 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:06:17.178 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:16 smithi115 ceph-mon[27708]: pgmap v27: 65 pgs: 65 active+clean; 2.0 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 104 MiB/s rd, 132 MiB/s wr, 378 op/s 2024-09-13T17:06:17.326 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:16 smithi195 ceph-mon[34981]: pgmap v27: 65 pgs: 65 active+clean; 2.0 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 104 MiB/s rd, 132 MiB/s wr, 378 op/s 2024-09-13T17:06:19.178 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:18 smithi115 ceph-mon[27708]: pgmap v28: 65 pgs: 65 active+clean; 2.0 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 31 MiB/s rd, 47 MiB/s wr, 224 op/s 2024-09-13T17:06:19.326 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:18 smithi195 ceph-mon[34981]: pgmap v28: 65 pgs: 65 active+clean; 2.0 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 31 MiB/s rd, 47 MiB/s wr, 224 op/s 2024-09-13T17:06:21.178 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:20 smithi115 ceph-mon[27708]: pgmap v29: 65 pgs: 65 active+clean; 1.4 GiB data, 4.7 GiB used, 532 GiB / 536 GiB avail; 32 MiB/s rd, 48 MiB/s wr, 361 op/s 2024-09-13T17:06:21.326 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:20 smithi195 ceph-mon[34981]: pgmap v29: 65 pgs: 65 active+clean; 1.4 GiB data, 4.7 GiB used, 532 GiB / 536 GiB avail; 32 MiB/s rd, 48 MiB/s wr, 361 op/s 2024-09-13T17:06:22.928 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:22 smithi115 ceph-mon[27708]: pgmap v30: 65 pgs: 65 active+clean; 1.4 GiB data, 4.7 GiB used, 532 GiB / 536 GiB avail; 8.1 MiB/s rd, 11 MiB/s wr, 244 op/s 2024-09-13T17:06:23.326 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:22 smithi195 ceph-mon[34981]: pgmap v30: 65 pgs: 65 active+clean; 1.4 GiB data, 4.7 GiB used, 532 GiB / 536 GiB avail; 8.1 MiB/s rd, 11 MiB/s wr, 244 op/s 2024-09-13T17:06:25.148 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:24 smithi115 ceph-mon[27708]: pgmap v31: 65 pgs: 65 active+clean; 1.2 GiB data, 4.4 GiB used, 532 GiB / 536 GiB avail; 8.1 MiB/s rd, 11 MiB/s wr, 272 op/s 2024-09-13T17:06:25.148 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:24 smithi115 ceph-mon[27708]: from='mgr.24317 ' entity='mgr.smithi195.hjjifz' 2024-09-13T17:06:25.148 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:24 smithi115 ceph-mon[27708]: from='mgr.24317 ' entity='mgr.smithi195.hjjifz' 2024-09-13T17:06:25.148 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:24 smithi115 ceph-mon[27708]: from='mgr.24317 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:06:25.326 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:24 smithi195 ceph-mon[34981]: pgmap v31: 65 pgs: 65 active+clean; 1.2 GiB data, 4.4 GiB used, 532 GiB / 536 GiB avail; 8.1 MiB/s rd, 11 MiB/s wr, 272 op/s 2024-09-13T17:06:25.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:24 smithi195 ceph-mon[34981]: from='mgr.24317 ' entity='mgr.smithi195.hjjifz' 2024-09-13T17:06:25.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:24 smithi195 ceph-mon[34981]: from='mgr.24317 ' entity='mgr.smithi195.hjjifz' 2024-09-13T17:06:25.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:24 smithi195 ceph-mon[34981]: from='mgr.24317 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:06:27.326 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:26 smithi195 ceph-mon[34981]: pgmap v32: 65 pgs: 65 active+clean; 801 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail; 7.2 MiB/s rd, 7.9 MiB/s wr, 338 op/s 2024-09-13T17:06:27.428 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:26 smithi115 ceph-mon[27708]: pgmap v32: 65 pgs: 65 active+clean; 801 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail; 7.2 MiB/s rd, 7.9 MiB/s wr, 338 op/s 2024-09-13T17:06:27.447 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-13T17:06:27.447 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-13T17:06:29.326 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:28 smithi195 ceph-mon[34981]: pgmap v33: 65 pgs: 65 active+clean; 801 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 275 op/s 2024-09-13T17:06:29.326 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:28 smithi195 ceph-mon[34981]: from='mgr.24317 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:06:29.428 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:28 smithi115 ceph-mon[27708]: pgmap v33: 65 pgs: 65 active+clean; 801 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 275 op/s 2024-09-13T17:06:29.428 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:28 smithi115 ceph-mon[27708]: from='mgr.24317 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:06:31.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:31 smithi195 ceph-mon[34981]: pgmap v34: 65 pgs: 65 active+clean; 316 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 429 op/s 2024-09-13T17:06:31.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:31 smithi195 ceph-mon[34981]: Standby manager daemon smithi115.hetcni restarted 2024-09-13T17:06:31.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:31 smithi195 ceph-mon[34981]: Standby manager daemon smithi115.hetcni started 2024-09-13T17:06:31.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:31 smithi195 ceph-mon[34981]: from='mgr.? 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi115.hetcni/crt"}]: dispatch 2024-09-13T17:06:31.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:31 smithi195 ceph-mon[34981]: from='mgr.? 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T17:06:31.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:31 smithi195 ceph-mon[34981]: from='mgr.? 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi115.hetcni/key"}]: dispatch 2024-09-13T17:06:31.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:31 smithi195 ceph-mon[34981]: from='mgr.? 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T17:06:31.428 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:31 smithi115 ceph-mon[27708]: pgmap v34: 65 pgs: 65 active+clean; 316 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 429 op/s 2024-09-13T17:06:31.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:31 smithi115 ceph-mon[27708]: Standby manager daemon smithi115.hetcni restarted 2024-09-13T17:06:31.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:31 smithi115 ceph-mon[27708]: Standby manager daemon smithi115.hetcni started 2024-09-13T17:06:31.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:31 smithi115 ceph-mon[27708]: from='mgr.? 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi115.hetcni/crt"}]: dispatch 2024-09-13T17:06:31.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:31 smithi115 ceph-mon[27708]: from='mgr.? 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T17:06:31.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:31 smithi115 ceph-mon[27708]: from='mgr.? 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi115.hetcni/key"}]: dispatch 2024-09-13T17:06:31.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:31 smithi115 ceph-mon[27708]: from='mgr.? 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T17:06:32.323 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:32 smithi115 ceph-mon[27708]: mgrmap e25: smithi195.hjjifz(active, since 63s), standbys: smithi115.hetcni 2024-09-13T17:06:32.323 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:32 smithi115 ceph-mon[27708]: from='mgr.24317 ' entity='mgr.smithi195.hjjifz' 2024-09-13T17:06:32.323 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:32 smithi115 ceph-mon[27708]: from='mgr.24317 ' entity='mgr.smithi195.hjjifz' 2024-09-13T17:06:32.323 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:32 smithi115 ceph-mon[27708]: from='mgr.24317 ' entity='mgr.smithi195.hjjifz' 2024-09-13T17:06:32.323 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:32 smithi115 ceph-mon[27708]: from='mgr.24317 ' entity='mgr.smithi195.hjjifz' 2024-09-13T17:06:32.326 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:32 smithi195 ceph-mon[34981]: mgrmap e25: smithi195.hjjifz(active, since 63s), standbys: smithi115.hetcni 2024-09-13T17:06:32.326 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:32 smithi195 ceph-mon[34981]: from='mgr.24317 ' entity='mgr.smithi195.hjjifz' 2024-09-13T17:06:32.326 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:32 smithi195 ceph-mon[34981]: from='mgr.24317 ' entity='mgr.smithi195.hjjifz' 2024-09-13T17:06:32.326 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:32 smithi195 ceph-mon[34981]: from='mgr.24317 ' entity='mgr.smithi195.hjjifz' 2024-09-13T17:06:32.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:32 smithi195 ceph-mon[34981]: from='mgr.24317 ' entity='mgr.smithi195.hjjifz' 2024-09-13T17:06:33.326 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:33 smithi195 ceph-mon[34981]: pgmap v35: 65 pgs: 65 active+clean; 316 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 293 op/s 2024-09-13T17:06:33.365 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:33 smithi115 ceph-mon[27708]: pgmap v35: 65 pgs: 65 active+clean; 316 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 293 op/s 2024-09-13T17:06:35.178 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:35 smithi115 ceph-mon[27708]: pgmap v36: 65 pgs: 65 active+clean; 319 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 340 op/s 2024-09-13T17:06:35.326 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:35 smithi195 ceph-mon[34981]: pgmap v36: 65 pgs: 65 active+clean; 319 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 340 op/s 2024-09-13T17:06:36.228 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:36 smithi195 ceph-mon[34981]: from='mgr.24317 ' entity='mgr.smithi195.hjjifz' 2024-09-13T17:06:36.229 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:36 smithi195 ceph-mon[34981]: from='mgr.24317 ' entity='mgr.smithi195.hjjifz' 2024-09-13T17:06:36.229 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:36 smithi195 ceph-mon[34981]: from='mgr.24317 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:06:36.229 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:36 smithi195 ceph-mon[34981]: from='mgr.24317 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:06:36.229 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:36 smithi195 ceph-mon[34981]: from='mgr.24317 ' entity='mgr.smithi195.hjjifz' 2024-09-13T17:06:36.229 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:36 smithi195 ceph-mon[34981]: from='mgr.24317 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:06:36.229 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:36 smithi195 ceph-mon[34981]: from='mgr.24317 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "mgr fail", "who": "smithi195.hjjifz"}]: dispatch 2024-09-13T17:06:36.229 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:36 smithi195 ceph-mon[34981]: from='mgr.24317 ' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "mgr fail", "who": "smithi195.hjjifz"}]: dispatch 2024-09-13T17:06:36.229 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:36 smithi195 ceph-mon[34981]: Activating manager daemon smithi115.hetcni 2024-09-13T17:06:36.229 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:36 smithi195 ceph-mon[34981]: osdmap e48: 6 total, 6 up, 6 in 2024-09-13T17:06:36.229 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:36 smithi195 ceph-mon[34981]: from='mgr.24317 ' entity='mgr.smithi195.hjjifz' cmd='[{"prefix": "mgr fail", "who": "smithi195.hjjifz"}]': finished 2024-09-13T17:06:36.229 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:36 smithi195 ceph-mon[34981]: mgrmap e26: smithi115.hetcni(active, starting, since 0.0070433s) 2024-09-13T17:06:36.230 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:36 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mon metadata", "id": "smithi115"}]: dispatch 2024-09-13T17:06:36.230 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:36 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-09-13T17:06:36.230 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:36 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi115.ijznvr"}]: dispatch 2024-09-13T17:06:36.230 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:36 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi115.hbtxod"}]: dispatch 2024-09-13T17:06:36.496 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:36 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.aevvgz"}]: dispatch 2024-09-13T17:06:36.497 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:36 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.qzghxj"}]: dispatch 2024-09-13T17:06:36.497 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:36 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mgr metadata", "who": "smithi115.hetcni", "id": "smithi115.hetcni"}]: dispatch 2024-09-13T17:06:36.497 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:36 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T17:06:36.497 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:36 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T17:06:36.497 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:36 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T17:06:36.497 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:36 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T17:06:36.497 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:36 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T17:06:36.497 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:36 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T17:06:36.497 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:36 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T17:06:36.497 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:36 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T17:06:36.498 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:36 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T17:06:36.498 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:36 smithi195 ceph-mon[34981]: Manager daemon smithi115.hetcni is now available 2024-09-13T17:06:36.498 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:36 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:06:36.498 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:36 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:06:36.498 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:36 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi115.hetcni/mirror_snapshot_schedule"}]: dispatch 2024-09-13T17:06:36.498 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:36 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi115.hetcni/trash_purge_schedule"}]: dispatch 2024-09-13T17:06:36.633 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:36 smithi115 ceph-mon[27708]: from='mgr.24317 ' entity='mgr.smithi195.hjjifz' 2024-09-13T17:06:36.633 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:36 smithi115 ceph-mon[27708]: from='mgr.24317 ' entity='mgr.smithi195.hjjifz' 2024-09-13T17:06:36.633 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:36 smithi115 ceph-mon[27708]: from='mgr.24317 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:06:36.633 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:36 smithi115 ceph-mon[27708]: from='mgr.24317 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:06:36.633 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:36 smithi115 ceph-mon[27708]: from='mgr.24317 ' entity='mgr.smithi195.hjjifz' 2024-09-13T17:06:36.634 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:36 smithi115 ceph-mon[27708]: from='mgr.24317 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:06:36.634 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:36 smithi115 ceph-mon[27708]: from='mgr.24317 172.21.15.195:0/721711277' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "mgr fail", "who": "smithi195.hjjifz"}]: dispatch 2024-09-13T17:06:36.634 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:36 smithi115 ceph-mon[27708]: from='mgr.24317 ' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "mgr fail", "who": "smithi195.hjjifz"}]: dispatch 2024-09-13T17:06:36.634 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:36 smithi115 ceph-mon[27708]: Activating manager daemon smithi115.hetcni 2024-09-13T17:06:36.634 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:36 smithi115 ceph-mon[27708]: osdmap e48: 6 total, 6 up, 6 in 2024-09-13T17:06:36.634 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:36 smithi115 ceph-mon[27708]: from='mgr.24317 ' entity='mgr.smithi195.hjjifz' cmd='[{"prefix": "mgr fail", "who": "smithi195.hjjifz"}]': finished 2024-09-13T17:06:36.634 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:36 smithi115 ceph-mon[27708]: mgrmap e26: smithi115.hetcni(active, starting, since 0.0070433s) 2024-09-13T17:06:36.634 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:36 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mon metadata", "id": "smithi115"}]: dispatch 2024-09-13T17:06:36.634 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:36 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-09-13T17:06:36.634 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:36 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi115.ijznvr"}]: dispatch 2024-09-13T17:06:36.634 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:36 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi115.hbtxod"}]: dispatch 2024-09-13T17:06:36.634 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:36 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.aevvgz"}]: dispatch 2024-09-13T17:06:36.634 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:36 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.qzghxj"}]: dispatch 2024-09-13T17:06:36.634 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:36 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mgr metadata", "who": "smithi115.hetcni", "id": "smithi115.hetcni"}]: dispatch 2024-09-13T17:06:36.635 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:36 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T17:06:36.635 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:36 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T17:06:36.635 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:36 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T17:06:36.635 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:36 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T17:06:36.635 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:36 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T17:06:36.635 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:36 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T17:06:36.635 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:36 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T17:06:36.635 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:36 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T17:06:36.635 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:36 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T17:06:36.635 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:36 smithi115 ceph-mon[27708]: Manager daemon smithi115.hetcni is now available 2024-09-13T17:06:36.635 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:36 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:06:36.635 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:36 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:06:36.635 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:36 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi115.hetcni/mirror_snapshot_schedule"}]: dispatch 2024-09-13T17:06:36.635 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:36 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi115.hetcni/trash_purge_schedule"}]: dispatch 2024-09-13T17:06:37.613 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:37 smithi195 ceph-mon[34981]: mgrmap e27: smithi115.hetcni(active, since 1.01189s) 2024-09-13T17:06:37.613 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:37 smithi195 ceph-mon[34981]: pgmap v3: 65 pgs: 65 active+clean; 323 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T17:06:37.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:37 smithi115 ceph-mon[27708]: mgrmap e27: smithi115.hetcni(active, since 1.01189s) 2024-09-13T17:06:37.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:37 smithi115 ceph-mon[27708]: pgmap v3: 65 pgs: 65 active+clean; 323 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T17:06:38.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:38 smithi115 ceph-mon[27708]: [13/Sep/2024:17:06:36] ENGINE Bus STARTING 2024-09-13T17:06:38.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:38 smithi115 ceph-mon[27708]: [13/Sep/2024:17:06:37] ENGINE Serving on http://172.21.15.115:8765 2024-09-13T17:06:38.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:38 smithi115 ceph-mon[27708]: [13/Sep/2024:17:06:37] ENGINE Serving on https://172.21.15.115:7150 2024-09-13T17:06:38.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:38 smithi115 ceph-mon[27708]: [13/Sep/2024:17:06:37] ENGINE Bus STARTED 2024-09-13T17:06:38.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:38 smithi115 ceph-mon[27708]: [13/Sep/2024:17:06:37] ENGINE Error in HTTPServer.serve 2024-09-13T17:06:38.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Traceback (most recent call last): 2024-09-13T17:06:38.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T17:06:38.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: self._connections.run(self.expiration_interval) 2024-09-13T17:06:38.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T17:06:38.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: self._run(expiration_interval) 2024-09-13T17:06:38.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T17:06:38.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T17:06:38.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T17:06:38.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T17:06:38.680 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T17:06:38.680 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: s = self.context.wrap_socket( 2024-09-13T17:06:38.680 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T17:06:38.680 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: return self.sslsocket_class._create( 2024-09-13T17:06:38.680 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T17:06:38.680 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: self.do_handshake() 2024-09-13T17:06:38.680 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T17:06:38.680 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: self._sslobj.do_handshake() 2024-09-13T17:06:38.680 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T17:06:38.680 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:38 smithi115 ceph-mon[27708]: pgmap v4: 65 pgs: 65 active+clean; 323 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T17:06:38.739 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:38 smithi195 ceph-mon[34981]: [13/Sep/2024:17:06:36] ENGINE Bus STARTING 2024-09-13T17:06:38.739 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:38 smithi195 ceph-mon[34981]: [13/Sep/2024:17:06:37] ENGINE Serving on http://172.21.15.115:8765 2024-09-13T17:06:38.739 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:38 smithi195 ceph-mon[34981]: [13/Sep/2024:17:06:37] ENGINE Serving on https://172.21.15.115:7150 2024-09-13T17:06:38.739 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:38 smithi195 ceph-mon[34981]: [13/Sep/2024:17:06:37] ENGINE Bus STARTED 2024-09-13T17:06:38.739 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:38 smithi195 ceph-mon[34981]: [13/Sep/2024:17:06:37] ENGINE Error in HTTPServer.serve 2024-09-13T17:06:38.739 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Traceback (most recent call last): 2024-09-13T17:06:38.740 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T17:06:38.740 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: self._connections.run(self.expiration_interval) 2024-09-13T17:06:38.740 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T17:06:38.740 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: self._run(expiration_interval) 2024-09-13T17:06:38.740 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T17:06:38.740 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T17:06:38.740 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T17:06:38.740 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T17:06:38.740 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T17:06:38.740 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: s = self.context.wrap_socket( 2024-09-13T17:06:38.740 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T17:06:38.740 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: return self.sslsocket_class._create( 2024-09-13T17:06:38.741 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T17:06:38.741 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: self.do_handshake() 2024-09-13T17:06:38.741 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T17:06:38.741 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: self._sslobj.do_handshake() 2024-09-13T17:06:38.741 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T17:06:38.741 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:38 smithi195 ceph-mon[34981]: pgmap v4: 65 pgs: 65 active+clean; 323 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T17:06:39.521 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:39 smithi195 ceph-mon[34981]: mgrmap e28: smithi115.hetcni(active, since 3s) 2024-09-13T17:06:39.521 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:39 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:06:39.521 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:39 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:06:39.671 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:39 smithi115 ceph-mon[27708]: mgrmap e28: smithi115.hetcni(active, since 3s) 2024-09-13T17:06:39.671 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:39 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:06:39.671 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:39 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:06:40.576 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:40 smithi195 ceph-mon[34981]: pgmap v5: 65 pgs: 65 active+clean; 323 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T17:06:40.576 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:40 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:06:40.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:40 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:06:40.928 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:40 smithi115 ceph-mon[27708]: pgmap v5: 65 pgs: 65 active+clean; 323 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T17:06:40.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:40 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:06:40.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:40 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:06:41.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:41 smithi115 ceph-mon[27708]: Standby manager daemon smithi195.hjjifz started 2024-09-13T17:06:41.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:41 smithi115 ceph-mon[27708]: from='mgr.? 172.21.15.195:0/2716278965' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi195.hjjifz/crt"}]: dispatch 2024-09-13T17:06:41.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:41 smithi115 ceph-mon[27708]: from='mgr.? 172.21.15.195:0/2716278965' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T17:06:41.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:41 smithi115 ceph-mon[27708]: from='mgr.? 172.21.15.195:0/2716278965' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi195.hjjifz/key"}]: dispatch 2024-09-13T17:06:41.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:41 smithi115 ceph-mon[27708]: from='mgr.? 172.21.15.195:0/2716278965' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T17:06:41.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:41 smithi195 ceph-mon[34981]: Standby manager daemon smithi195.hjjifz started 2024-09-13T17:06:41.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:41 smithi195 ceph-mon[34981]: from='mgr.? 172.21.15.195:0/2716278965' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi195.hjjifz/crt"}]: dispatch 2024-09-13T17:06:41.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:41 smithi195 ceph-mon[34981]: from='mgr.? 172.21.15.195:0/2716278965' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T17:06:41.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:41 smithi195 ceph-mon[34981]: from='mgr.? 172.21.15.195:0/2716278965' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi195.hjjifz/key"}]: dispatch 2024-09-13T17:06:41.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:41 smithi195 ceph-mon[34981]: from='mgr.? 172.21.15.195:0/2716278965' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T17:06:42.789 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:42 smithi115 ceph-mon[27708]: pgmap v6: 65 pgs: 65 active+clean; 323 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T17:06:42.789 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:42 smithi115 ceph-mon[27708]: mgrmap e29: smithi115.hetcni(active, since 6s), standbys: smithi195.hjjifz 2024-09-13T17:06:42.789 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:42 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mgr metadata", "who": "smithi195.hjjifz", "id": "smithi195.hjjifz"}]: dispatch 2024-09-13T17:06:42.789 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:42 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:06:42.789 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:42 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:06:42.790 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:42 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:06:42.790 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:42 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:06:42.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:42 smithi195 ceph-mon[34981]: pgmap v6: 65 pgs: 65 active+clean; 323 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T17:06:42.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:42 smithi195 ceph-mon[34981]: mgrmap e29: smithi115.hetcni(active, since 6s), standbys: smithi195.hjjifz 2024-09-13T17:06:42.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:42 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mgr metadata", "who": "smithi195.hjjifz", "id": "smithi195.hjjifz"}]: dispatch 2024-09-13T17:06:42.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:42 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:06:42.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:42 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:06:42.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:42 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:06:42.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:42 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:06:44.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:44 smithi195 ceph-mon[34981]: pgmap v7: 65 pgs: 65 active+clean; 310 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 1.7 MiB/s wr, 321 op/s 2024-09-13T17:06:44.858 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:44 smithi115 ceph-mon[27708]: pgmap v7: 65 pgs: 65 active+clean; 310 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 1.7 MiB/s wr, 321 op/s 2024-09-13T17:06:44.858 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:44.856+0000 7fbfcce26640 1 -- 172.21.15.115:0/1159899815 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbfc80ffc30 msgr2=0x7fbfc81000b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:44.858 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:44.856+0000 7fbfcce26640 1 --2- 172.21.15.115:0/1159899815 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbfc80ffc30 0x7fbfc81000b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fbfb0009880 tx=0x7fbfb002a4a0 comp rx=0 tx=0).stop 2024-09-13T17:06:44.859 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:44.856+0000 7fbfcce26640 1 -- 172.21.15.115:0/1159899815 shutdown_connections 2024-09-13T17:06:44.859 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:44.856+0000 7fbfcce26640 1 --2- 172.21.15.115:0/1159899815 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbfc80ffc30 0x7fbfc81000b0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:44.859 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:44.856+0000 7fbfcce26640 1 --2- 172.21.15.115:0/1159899815 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbfc80fea30 0x7fbfc80fee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:44.859 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:44.856+0000 7fbfcce26640 1 -- 172.21.15.115:0/1159899815 >> 172.21.15.115:0/1159899815 conn(0x7fbfc80fa1c0 msgr2=0x7fbfc80fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:44.859 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:44.856+0000 7fbfcce26640 1 -- 172.21.15.115:0/1159899815 shutdown_connections 2024-09-13T17:06:44.859 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:44.856+0000 7fbfcce26640 1 -- 172.21.15.115:0/1159899815 wait complete. 2024-09-13T17:06:44.861 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:44.857+0000 7fbfcce26640 1 Processor -- start 2024-09-13T17:06:44.861 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:44.857+0000 7fbfcce26640 1 -- start start 2024-09-13T17:06:44.861 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:44.857+0000 7fbfcce26640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbfc80fea30 0x7fbfc80686f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:44.861 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:44.857+0000 7fbfcce26640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbfc80ffc30 0x7fbfc819c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:44.861 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:44.857+0000 7fbfcce26640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc81960f0 con 0x7fbfc80ffc30 2024-09-13T17:06:44.861 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:44.857+0000 7fbfcce26640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc819cc50 con 0x7fbfc80fea30 2024-09-13T17:06:44.861 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:44.857+0000 7fbfbffff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbfc80ffc30 0x7fbfc819c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:44.861 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:44.857+0000 7fbfbffff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbfc80ffc30 0x7fbfc819c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:34622/0 (socket says 172.21.15.115:34622) 2024-09-13T17:06:44.861 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:44.857+0000 7fbfbffff640 1 -- 172.21.15.115:0/1822268566 learned_addr learned my addr 172.21.15.115:0/1822268566 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:06:44.861 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:44.857+0000 7fbfc659c640 1 --2- 172.21.15.115:0/1822268566 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbfc80fea30 0x7fbfc80686f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:44.861 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:44.858+0000 7fbfc659c640 1 -- 172.21.15.115:0/1822268566 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbfc80ffc30 msgr2=0x7fbfc819c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:44.862 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:44.858+0000 7fbfc659c640 1 --2- 172.21.15.115:0/1822268566 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbfc80ffc30 0x7fbfc819c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:44.862 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:44.858+0000 7fbfc659c640 1 -- 172.21.15.115:0/1822268566 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfb0009560 con 0x7fbfc80fea30 2024-09-13T17:06:44.862 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:44.858+0000 7fbfc659c640 1 --2- 172.21.15.115:0/1822268566 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbfc80fea30 0x7fbfc80686f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbfb800e940 tx=0x7fbfb800ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:44.862 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:44.858+0000 7fbfbf7fe640 1 -- 172.21.15.115:0/1822268566 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbfb800cc90 con 0x7fbfc80fea30 2024-09-13T17:06:44.862 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:44.858+0000 7fbfbf7fe640 1 -- 172.21.15.115:0/1822268566 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbfb80044d0 con 0x7fbfc80fea30 2024-09-13T17:06:44.862 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:44.858+0000 7fbfbf7fe640 1 -- 172.21.15.115:0/1822268566 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbfb8010430 con 0x7fbfc80fea30 2024-09-13T17:06:44.863 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:44.858+0000 7fbfcce26640 1 -- 172.21.15.115:0/1822268566 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfc819ceb0 con 0x7fbfc80fea30 2024-09-13T17:06:44.863 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:44.859+0000 7fbfcce26640 1 -- 172.21.15.115:0/1822268566 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfc819d3f0 con 0x7fbfc80fea30 2024-09-13T17:06:44.863 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:44.860+0000 7fbfcce26640 1 -- 172.21.15.115:0/1822268566 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfc80fee30 con 0x7fbfc80fea30 2024-09-13T17:06:44.863 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:44.860+0000 7fbfbf7fe640 1 -- 172.21.15.115:0/1822268566 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 29) v1 ==== 90954+0+0 (secure 0 0 0) 0x7fbfb8003f10 con 0x7fbfc80fea30 2024-09-13T17:06:44.863 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:44.861+0000 7fbfbf7fe640 1 --2- 172.21.15.115:0/1822268566 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fbfb406cd90 0x7fbfb406f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:44.863 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:44.861+0000 7fbfbf7fe640 1 -- 172.21.15.115:0/1822268566 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fbfb8014070 con 0x7fbfc80fea30 2024-09-13T17:06:44.863 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:44.861+0000 7fbfbffff640 1 --2- 172.21.15.115:0/1822268566 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fbfb406cd90 0x7fbfb406f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:44.864 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:44.861+0000 7fbfbffff640 1 --2- 172.21.15.115:0/1822268566 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fbfb406cd90 0x7fbfb406f250 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fbfc8068470 tx=0x7fbfb00058d0 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:44.867 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:44.865+0000 7fbfbf7fe640 1 -- 172.21.15.115:0/1822268566 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fbfb80569c0 con 0x7fbfc80fea30 2024-09-13T17:06:45.117 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.114+0000 7fbfcce26640 1 -- 172.21.15.115:0/1822268566 --> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbfc8104580 con 0x7fbfb406cd90 2024-09-13T17:06:45.118 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.116+0000 7fbfbf7fe640 1 -- 172.21.15.115:0/1822268566 <== mgr.14660 v2:172.21.15.115:6800/1049502673 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7fbfc8104580 con 0x7fbfb406cd90 2024-09-13T17:06:45.121 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.119+0000 7fbfcce26640 1 -- 172.21.15.115:0/1822268566 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fbfb406cd90 msgr2=0x7fbfb406f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:45.121 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.119+0000 7fbfcce26640 1 --2- 172.21.15.115:0/1822268566 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fbfb406cd90 0x7fbfb406f250 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fbfc8068470 tx=0x7fbfb00058d0 comp rx=0 tx=0).stop 2024-09-13T17:06:45.121 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.119+0000 7fbfcce26640 1 -- 172.21.15.115:0/1822268566 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbfc80fea30 msgr2=0x7fbfc80686f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:45.121 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.119+0000 7fbfcce26640 1 --2- 172.21.15.115:0/1822268566 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbfc80fea30 0x7fbfc80686f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbfb800e940 tx=0x7fbfb800ee00 comp rx=0 tx=0).stop 2024-09-13T17:06:45.121 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.119+0000 7fbfcce26640 1 -- 172.21.15.115:0/1822268566 shutdown_connections 2024-09-13T17:06:45.121 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.119+0000 7fbfcce26640 1 --2- 172.21.15.115:0/1822268566 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fbfb406cd90 0x7fbfb406f250 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:45.121 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.119+0000 7fbfcce26640 1 --2- 172.21.15.115:0/1822268566 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbfc80ffc30 0x7fbfc819c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:45.122 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.119+0000 7fbfcce26640 1 --2- 172.21.15.115:0/1822268566 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbfc80fea30 0x7fbfc80686f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:45.122 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.119+0000 7fbfcce26640 1 -- 172.21.15.115:0/1822268566 >> 172.21.15.115:0/1822268566 conn(0x7fbfc80fa1c0 msgr2=0x7fbfc8102e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:45.122 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.119+0000 7fbfcce26640 1 -- 172.21.15.115:0/1822268566 shutdown_connections 2024-09-13T17:06:45.122 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.119+0000 7fbfcce26640 1 -- 172.21.15.115:0/1822268566 wait complete. 2024-09-13T17:06:45.132 INFO:teuthology.orchestra.run.smithi115.stdout:true 2024-09-13T17:06:45.229 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.226+0000 7f59857d8640 1 -- 172.21.15.115:0/1440882758 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f59800ffc30 msgr2=0x7f59801000b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:45.233 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.226+0000 7f59857d8640 1 --2- 172.21.15.115:0/1440882758 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f59800ffc30 0x7f59801000b0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f5968009880 tx=0x7f596802a4a0 comp rx=0 tx=0).stop 2024-09-13T17:06:45.233 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.226+0000 7f59857d8640 1 -- 172.21.15.115:0/1440882758 shutdown_connections 2024-09-13T17:06:45.233 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.226+0000 7f59857d8640 1 --2- 172.21.15.115:0/1440882758 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f59800ffc30 0x7f59801000b0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:45.233 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.226+0000 7f59857d8640 1 --2- 172.21.15.115:0/1440882758 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f59800fea30 0x7f59800fee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:45.233 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.226+0000 7f59857d8640 1 -- 172.21.15.115:0/1440882758 >> 172.21.15.115:0/1440882758 conn(0x7f59800fa1c0 msgr2=0x7f59800fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:45.234 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.227+0000 7f59857d8640 1 -- 172.21.15.115:0/1440882758 shutdown_connections 2024-09-13T17:06:45.234 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.227+0000 7f59857d8640 1 -- 172.21.15.115:0/1440882758 wait complete. 2024-09-13T17:06:45.234 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.227+0000 7f59857d8640 1 Processor -- start 2024-09-13T17:06:45.234 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.227+0000 7f59857d8640 1 -- start start 2024-09-13T17:06:45.236 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.228+0000 7f59857d8640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f59800fea30 0x7f59800686f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:45.236 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.228+0000 7f59857d8640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f59800ffc30 0x7f598019a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:45.236 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.228+0000 7f59857d8640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f598019a830 con 0x7f59800fea30 2024-09-13T17:06:45.236 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.228+0000 7f59857d8640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f598019a9a0 con 0x7f59800ffc30 2024-09-13T17:06:45.236 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.228+0000 7f597effd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f59800fea30 0x7f59800686f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:45.236 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.228+0000 7f597effd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f59800fea30 0x7f59800686f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:34640/0 (socket says 172.21.15.115:34640) 2024-09-13T17:06:45.236 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.228+0000 7f597effd640 1 -- 172.21.15.115:0/2298293186 learned_addr learned my addr 172.21.15.115:0/2298293186 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:06:45.236 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.228+0000 7f5977fff640 1 --2- 172.21.15.115:0/2298293186 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f59800ffc30 0x7f598019a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:45.236 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.228+0000 7f597effd640 1 -- 172.21.15.115:0/2298293186 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f59800ffc30 msgr2=0x7f598019a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:45.236 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.228+0000 7f597effd640 1 --2- 172.21.15.115:0/2298293186 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f59800ffc30 0x7f598019a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:45.236 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.228+0000 7f597effd640 1 -- 172.21.15.115:0/2298293186 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5970009490 con 0x7f59800fea30 2024-09-13T17:06:45.237 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.228+0000 7f597effd640 1 --2- 172.21.15.115:0/2298293186 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f59800fea30 0x7f59800686f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f597000e940 tx=0x7f597000ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:45.237 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.229+0000 7f597cff9640 1 -- 172.21.15.115:0/2298293186 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f597000cd50 con 0x7f59800fea30 2024-09-13T17:06:45.237 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.229+0000 7f597cff9640 1 -- 172.21.15.115:0/2298293186 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f59700108d0 con 0x7f59800fea30 2024-09-13T17:06:45.237 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.229+0000 7f59857d8640 1 -- 172.21.15.115:0/2298293186 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5968009560 con 0x7f59800fea30 2024-09-13T17:06:45.237 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.229+0000 7f597cff9640 1 -- 172.21.15.115:0/2298293186 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5970018830 con 0x7f59800fea30 2024-09-13T17:06:45.237 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.229+0000 7f59857d8640 1 -- 172.21.15.115:0/2298293186 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f598019b040 con 0x7f59800fea30 2024-09-13T17:06:45.237 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.230+0000 7f59857d8640 1 -- 172.21.15.115:0/2298293186 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5960005280 con 0x7f59800fea30 2024-09-13T17:06:45.237 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.231+0000 7f597cff9640 1 -- 172.21.15.115:0/2298293186 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 29) v1 ==== 90954+0+0 (secure 0 0 0) 0x7f5970018b20 con 0x7f59800fea30 2024-09-13T17:06:45.237 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.231+0000 7f597cff9640 1 --2- 172.21.15.115:0/2298293186 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f596c06cde0 0x7f596c06f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:45.237 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.232+0000 7f597cff9640 1 -- 172.21.15.115:0/2298293186 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f5970014070 con 0x7f59800fea30 2024-09-13T17:06:45.237 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.232+0000 7f5977fff640 1 --2- 172.21.15.115:0/2298293186 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f596c06cde0 0x7f596c06f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:45.237 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.232+0000 7f5977fff640 1 --2- 172.21.15.115:0/2298293186 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f596c06cde0 0x7f596c06f2a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5980068470 tx=0x7f5968031400 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:45.240 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.238+0000 7f597cff9640 1 -- 172.21.15.115:0/2298293186 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f5970056f00 con 0x7f59800fea30 2024-09-13T17:06:45.540 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.538+0000 7f59857d8640 1 -- 172.21.15.115:0/2298293186 --> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5960000bf0 con 0x7f596c06cde0 2024-09-13T17:06:45.541 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.539+0000 7f597cff9640 1 -- 172.21.15.115:0/2298293186 <== mgr.14660 v2:172.21.15.115:6800/1049502673 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7f5960000bf0 con 0x7f596c06cde0 2024-09-13T17:06:45.543 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.541+0000 7f59857d8640 1 -- 172.21.15.115:0/2298293186 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f596c06cde0 msgr2=0x7f596c06f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:45.544 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.541+0000 7f59857d8640 1 --2- 172.21.15.115:0/2298293186 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f596c06cde0 0x7f596c06f2a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5980068470 tx=0x7f5968031400 comp rx=0 tx=0).stop 2024-09-13T17:06:45.544 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.541+0000 7f59857d8640 1 -- 172.21.15.115:0/2298293186 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f59800fea30 msgr2=0x7f59800686f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:45.544 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.541+0000 7f59857d8640 1 --2- 172.21.15.115:0/2298293186 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f59800fea30 0x7f59800686f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f597000e940 tx=0x7f597000ee00 comp rx=0 tx=0).stop 2024-09-13T17:06:45.544 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.541+0000 7f59857d8640 1 -- 172.21.15.115:0/2298293186 shutdown_connections 2024-09-13T17:06:45.544 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.541+0000 7f59857d8640 1 --2- 172.21.15.115:0/2298293186 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f596c06cde0 0x7f596c06f2a0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:45.544 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.541+0000 7f59857d8640 1 --2- 172.21.15.115:0/2298293186 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f59800ffc30 0x7f598019a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:45.544 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.541+0000 7f59857d8640 1 --2- 172.21.15.115:0/2298293186 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f59800fea30 0x7f59800686f0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:45.544 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.542+0000 7f59857d8640 1 -- 172.21.15.115:0/2298293186 >> 172.21.15.115:0/2298293186 conn(0x7f59800fa1c0 msgr2=0x7f5980102e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:45.544 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.542+0000 7f59857d8640 1 -- 172.21.15.115:0/2298293186 shutdown_connections 2024-09-13T17:06:45.545 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.542+0000 7f59857d8640 1 -- 172.21.15.115:0/2298293186 wait complete. 2024-09-13T17:06:45.641 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.638+0000 7f19cb52e640 1 -- 172.21.15.115:0/1901524655 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19c40fea30 msgr2=0x7f19c40fee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:45.641 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.638+0000 7f19cb52e640 1 --2- 172.21.15.115:0/1901524655 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19c40fea30 0x7f19c40fee30 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f19c0009880 tx=0x7f19c002a4a0 comp rx=0 tx=0).stop 2024-09-13T17:06:45.641 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.639+0000 7f19cb52e640 1 -- 172.21.15.115:0/1901524655 shutdown_connections 2024-09-13T17:06:45.641 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.639+0000 7f19cb52e640 1 --2- 172.21.15.115:0/1901524655 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f19c40ffc30 0x7f19c41000b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:45.642 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.639+0000 7f19cb52e640 1 --2- 172.21.15.115:0/1901524655 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19c40fea30 0x7f19c40fee30 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:45.642 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.639+0000 7f19cb52e640 1 -- 172.21.15.115:0/1901524655 >> 172.21.15.115:0/1901524655 conn(0x7f19c40fa1c0 msgr2=0x7f19c40fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:45.642 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.639+0000 7f19cb52e640 1 -- 172.21.15.115:0/1901524655 shutdown_connections 2024-09-13T17:06:45.642 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.639+0000 7f19cb52e640 1 -- 172.21.15.115:0/1901524655 wait complete. 2024-09-13T17:06:45.643 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.640+0000 7f19cb52e640 1 Processor -- start 2024-09-13T17:06:45.643 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.640+0000 7f19cb52e640 1 -- start start 2024-09-13T17:06:45.644 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.640+0000 7f19cb52e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19c40fea30 0x7f19c4197790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:45.644 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.640+0000 7f19cb52e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f19c40ffc30 0x7f19c4197cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:45.644 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.640+0000 7f19cb52e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c41982a0 con 0x7f19c40fea30 2024-09-13T17:06:45.644 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.640+0000 7f19cb52e640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c4198410 con 0x7f19c40ffc30 2024-09-13T17:06:45.644 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.640+0000 7f19c92ca640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19c40fea30 0x7f19c4197790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:45.644 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.640+0000 7f19c92ca640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19c40fea30 0x7f19c4197790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:34648/0 (socket says 172.21.15.115:34648) 2024-09-13T17:06:45.644 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.640+0000 7f19c92ca640 1 -- 172.21.15.115:0/577661441 learned_addr learned my addr 172.21.15.115:0/577661441 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:06:45.644 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.640+0000 7f19c8ac9640 1 --2- 172.21.15.115:0/577661441 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f19c40ffc30 0x7f19c4197cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:45.644 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.641+0000 7f19c92ca640 1 -- 172.21.15.115:0/577661441 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f19c40ffc30 msgr2=0x7f19c4197cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:45.644 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.641+0000 7f19c92ca640 1 --2- 172.21.15.115:0/577661441 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f19c40ffc30 0x7f19c4197cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:45.644 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.641+0000 7f19c92ca640 1 -- 172.21.15.115:0/577661441 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19c0009560 con 0x7f19c40fea30 2024-09-13T17:06:45.644 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.641+0000 7f19c92ca640 1 --2- 172.21.15.115:0/577661441 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19c40fea30 0x7f19c4197790 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f19c00055a0 tx=0x7f19c00055d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:45.644 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.641+0000 7f19ba7fc640 1 -- 172.21.15.115:0/577661441 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19c0004aa0 con 0x7f19c40fea30 2024-09-13T17:06:45.645 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.641+0000 7f19cb52e640 1 -- 172.21.15.115:0/577661441 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19c419ce50 con 0x7f19c40fea30 2024-09-13T17:06:45.645 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.641+0000 7f19ba7fc640 1 -- 172.21.15.115:0/577661441 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f19c0004c00 con 0x7f19c40fea30 2024-09-13T17:06:45.645 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.641+0000 7f19cb52e640 1 -- 172.21.15.115:0/577661441 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19c419d340 con 0x7f19c40fea30 2024-09-13T17:06:45.645 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.641+0000 7f19ba7fc640 1 -- 172.21.15.115:0/577661441 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19c00318a0 con 0x7f19c40fea30 2024-09-13T17:06:45.645 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.643+0000 7f19ba7fc640 1 -- 172.21.15.115:0/577661441 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 29) v1 ==== 90954+0+0 (secure 0 0 0) 0x7f19c0031b60 con 0x7f19c40fea30 2024-09-13T17:06:45.645 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.643+0000 7f19affff640 1 -- 172.21.15.115:0/577661441 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19c4107500 con 0x7f19c40fea30 2024-09-13T17:06:45.645 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.643+0000 7f19ba7fc640 1 --2- 172.21.15.115:0/577661441 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f19b006cdd0 0x7f19b006f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:45.646 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.643+0000 7f19ba7fc640 1 -- 172.21.15.115:0/577661441 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f19c00ad970 con 0x7f19c40fea30 2024-09-13T17:06:45.646 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.644+0000 7f19c8ac9640 1 --2- 172.21.15.115:0/577661441 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f19b006cdd0 0x7f19b006f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:45.646 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.644+0000 7f19c8ac9640 1 --2- 172.21.15.115:0/577661441 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f19b006cdd0 0x7f19b006f290 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f19c4198cb0 tx=0x7f19b4005f90 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:45.652 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.650+0000 7f19ba7fc640 1 -- 172.21.15.115:0/577661441 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f19c0077870 con 0x7f19c40fea30 2024-09-13T17:06:45.911 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.909+0000 7f19affff640 1 -- 172.21.15.115:0/577661441 --> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f19c4107690 con 0x7f19b006cdd0 2024-09-13T17:06:45.922 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.920+0000 7f19ba7fc640 1 -- 172.21.15.115:0/577661441 <== mgr.14660 v2:172.21.15.115:6800/1049502673 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7f19c4107690 con 0x7f19b006cdd0 2024-09-13T17:06:45.922 INFO:teuthology.orchestra.run.smithi115.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T17:06:45.922 INFO:teuthology.orchestra.run.smithi115.stdout:alertmanager.smithi115 smithi115 *:9093,9094 running (7m) 4s ago 8m 25.1M - 0.25.0 c8568f914cd2 cbe091cee151 2024-09-13T17:06:45.922 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-exporter.smithi115 smithi115 running (9m) 4s ago 9m 7956k - 18.2.4-843-g2c01458a c129f5a2fd4e 0f1eebeaf9bb 2024-09-13T17:06:45.922 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-exporter.smithi195 smithi195 running (8m) 7s ago 8m 7528k - 18.2.4-843-g2c01458a c129f5a2fd4e 6d05bafbac8a 2024-09-13T17:06:45.922 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi115 smithi115 running (8m) 4s ago 8m 6899k - 18.2.4-843-g2c01458a c129f5a2fd4e 624a903fec23 2024-09-13T17:06:45.923 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi195 smithi195 running (8m) 7s ago 8m 6891k - 18.2.4-843-g2c01458a c129f5a2fd4e 42e6ce26130d 2024-09-13T17:06:45.923 INFO:teuthology.orchestra.run.smithi115.stdout:grafana.smithi115 smithi115 *:3000 running (7m) 4s ago 8m 86.7M - 9.4.7 954c08fa6188 41183f0705c8 2024-09-13T17:06:45.923 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi115.hbtxod smithi115 running (3m) 4s ago 3m 152M - 18.2.4-843-g2c01458a c129f5a2fd4e 12b4f4874491 2024-09-13T17:06:45.923 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi115.ijznvr smithi115 running (3m) 4s ago 3m 244M - 18.2.4-843-g2c01458a c129f5a2fd4e 2d552564a9f4 2024-09-13T17:06:45.923 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi195.aevvgz smithi195 running (3m) 7s ago 3m 15.6M - 18.2.4-843-g2c01458a c129f5a2fd4e 299b9ad657c9 2024-09-13T17:06:45.923 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi195.qzghxj smithi195 running (3m) 7s ago 3m 13.7M - 18.2.4-843-g2c01458a c129f5a2fd4e fb16b16181ff 2024-09-13T17:06:45.923 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi115.hetcni smithi115 *:8443,9283,8765 running (22s) 4s ago 10m 457M - 18.2.4-860-g6c6b083f 8a91f241d7d4 b945dbde1934 2024-09-13T17:06:45.923 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi195.hjjifz smithi195 *:8443,9283,8765 running (99s) 7s ago 7m 96.5M - 18.2.4-860-g6c6b083f 8a91f241d7d4 efed836fb2b0 2024-09-13T17:06:45.923 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi115 smithi115 running (10m) 4s ago 10m 51.4M 2048M 18.2.4-843-g2c01458a c129f5a2fd4e 202375d41e68 2024-09-13T17:06:45.923 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi195 smithi195 running (7m) 7s ago 7m 40.5M 2048M 18.2.4-843-g2c01458a c129f5a2fd4e 0f54c30e5970 2024-09-13T17:06:45.923 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi115 smithi115 *:9100 running (8m) 4s ago 8m 15.8M - 1.5.0 0da6a335fe13 9074300dbe31 2024-09-13T17:06:45.923 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi195 smithi195 *:9100 running (7m) 7s ago 7m 15.3M - 1.5.0 0da6a335fe13 d7b54e5d8c97 2024-09-13T17:06:45.923 INFO:teuthology.orchestra.run.smithi115.stdout:osd.0 smithi115 running (7m) 4s ago 7m 193M 1216M 18.2.4-843-g2c01458a c129f5a2fd4e 8a8ad231962e 2024-09-13T17:06:45.924 INFO:teuthology.orchestra.run.smithi115.stdout:osd.1 smithi115 running (6m) 4s ago 6m 217M 1216M 18.2.4-843-g2c01458a c129f5a2fd4e 3fbc020102a0 2024-09-13T17:06:45.924 INFO:teuthology.orchestra.run.smithi115.stdout:osd.2 smithi115 running (6m) 4s ago 6m 184M 1216M 18.2.4-843-g2c01458a c129f5a2fd4e 7c623823e920 2024-09-13T17:06:45.924 INFO:teuthology.orchestra.run.smithi115.stdout:osd.3 smithi195 running (5m) 7s ago 5m 246M 2240M 18.2.4-843-g2c01458a c129f5a2fd4e 10ea833fd5c5 2024-09-13T17:06:45.924 INFO:teuthology.orchestra.run.smithi115.stdout:osd.4 smithi195 running (5m) 7s ago 5m 217M 2240M 18.2.4-843-g2c01458a c129f5a2fd4e 4bbc3acb9aff 2024-09-13T17:06:45.924 INFO:teuthology.orchestra.run.smithi115.stdout:osd.5 smithi195 running (4m) 7s ago 4m 203M 2240M 18.2.4-843-g2c01458a c129f5a2fd4e 4bd1b3a232d0 2024-09-13T17:06:45.924 INFO:teuthology.orchestra.run.smithi115.stdout:prometheus.smithi115 smithi115 *:9095 running (33s) 4s ago 8m 42.8M - 2.43.0 a07b618ecd1d 50ea283c3c00 2024-09-13T17:06:45.925 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.922+0000 7f19affff640 1 -- 172.21.15.115:0/577661441 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f19b006cdd0 msgr2=0x7f19b006f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:45.925 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.922+0000 7f19affff640 1 --2- 172.21.15.115:0/577661441 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f19b006cdd0 0x7f19b006f290 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f19c4198cb0 tx=0x7f19b4005f90 comp rx=0 tx=0).stop 2024-09-13T17:06:45.925 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.923+0000 7f19affff640 1 -- 172.21.15.115:0/577661441 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19c40fea30 msgr2=0x7f19c4197790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:45.925 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.923+0000 7f19affff640 1 --2- 172.21.15.115:0/577661441 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19c40fea30 0x7f19c4197790 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f19c00055a0 tx=0x7f19c00055d0 comp rx=0 tx=0).stop 2024-09-13T17:06:45.925 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.923+0000 7f19affff640 1 -- 172.21.15.115:0/577661441 shutdown_connections 2024-09-13T17:06:45.925 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.923+0000 7f19affff640 1 --2- 172.21.15.115:0/577661441 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f19b006cdd0 0x7f19b006f290 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:45.925 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.923+0000 7f19affff640 1 --2- 172.21.15.115:0/577661441 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f19c40ffc30 0x7f19c4197cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:45.925 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.923+0000 7f19affff640 1 --2- 172.21.15.115:0/577661441 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19c40fea30 0x7f19c4197790 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:45.925 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.923+0000 7f19affff640 1 -- 172.21.15.115:0/577661441 >> 172.21.15.115:0/577661441 conn(0x7f19c40fa1c0 msgr2=0x7f19c4067be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:45.926 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.923+0000 7f19affff640 1 -- 172.21.15.115:0/577661441 shutdown_connections 2024-09-13T17:06:45.926 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:45.923+0000 7f19affff640 1 -- 172.21.15.115:0/577661441 wait complete. 2024-09-13T17:06:46.055 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.052+0000 7fe234c30640 1 -- 172.21.15.115:0/441292241 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe230100d00 msgr2=0x7fe230103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:46.055 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.052+0000 7fe234c30640 1 --2- 172.21.15.115:0/441292241 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe230100d00 0x7fe230103170 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe228009c20 tx=0x7fe22802a9a0 comp rx=0 tx=0).stop 2024-09-13T17:06:46.057 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.055+0000 7fe234c30640 1 -- 172.21.15.115:0/441292241 shutdown_connections 2024-09-13T17:06:46.057 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.055+0000 7fe234c30640 1 --2- 172.21.15.115:0/441292241 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe230100d00 0x7fe230103170 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:46.057 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.055+0000 7fe234c30640 1 --2- 172.21.15.115:0/441292241 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2300fe3b0 0x7fe2301007c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:46.057 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.055+0000 7fe234c30640 1 -- 172.21.15.115:0/441292241 >> 172.21.15.115:0/441292241 conn(0x7fe2300fa1c0 msgr2=0x7fe2300fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:46.057 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.055+0000 7fe234c30640 1 -- 172.21.15.115:0/441292241 shutdown_connections 2024-09-13T17:06:46.057 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.055+0000 7fe234c30640 1 -- 172.21.15.115:0/441292241 wait complete. 2024-09-13T17:06:46.058 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.056+0000 7fe234c30640 1 Processor -- start 2024-09-13T17:06:46.058 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.056+0000 7fe234c30640 1 -- start start 2024-09-13T17:06:46.059 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.057+0000 7fe234c30640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2300fe3b0 0x7fe2301a43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:46.059 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.057+0000 7fe234c30640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe230100d00 0x7fe2301a48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:46.059 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.057+0000 7fe234c30640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2301a4f00 con 0x7fe2300fe3b0 2024-09-13T17:06:46.059 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.057+0000 7fe234c30640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2301a5040 con 0x7fe230100d00 2024-09-13T17:06:46.060 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.057+0000 7fe22e59c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2300fe3b0 0x7fe2301a43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:46.060 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.057+0000 7fe22e59c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2300fe3b0 0x7fe2301a43a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:34664/0 (socket says 172.21.15.115:34664) 2024-09-13T17:06:46.060 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.057+0000 7fe22e59c640 1 -- 172.21.15.115:0/306070872 learned_addr learned my addr 172.21.15.115:0/306070872 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:06:46.060 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.058+0000 7fe22e59c640 1 -- 172.21.15.115:0/306070872 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe230100d00 msgr2=0x7fe2301a48e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-13T17:06:46.061 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.058+0000 7fe22e59c640 1 --2- 172.21.15.115:0/306070872 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe230100d00 0x7fe2301a48e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:46.061 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.058+0000 7fe22e59c640 1 -- 172.21.15.115:0/306070872 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe228009900 con 0x7fe2300fe3b0 2024-09-13T17:06:46.061 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.058+0000 7fe22e59c640 1 --2- 172.21.15.115:0/306070872 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2300fe3b0 0x7fe2301a43a0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fe22000d8d0 tx=0x7fe22000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:46.061 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.059+0000 7fe21f7fe640 1 -- 172.21.15.115:0/306070872 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe22000bea0 con 0x7fe2300fe3b0 2024-09-13T17:06:46.061 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.059+0000 7fe21f7fe640 1 -- 172.21.15.115:0/306070872 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe220009c00 con 0x7fe2300fe3b0 2024-09-13T17:06:46.062 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.059+0000 7fe21f7fe640 1 -- 172.21.15.115:0/306070872 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe22000bea0 con 0x7fe2300fe3b0 2024-09-13T17:06:46.062 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.059+0000 7fe234c30640 1 -- 172.21.15.115:0/306070872 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2301a9a30 con 0x7fe2300fe3b0 2024-09-13T17:06:46.062 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.059+0000 7fe234c30640 1 -- 172.21.15.115:0/306070872 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2301a9fb0 con 0x7fe2300fe3b0 2024-09-13T17:06:46.065 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.063+0000 7fe234c30640 1 -- 172.21.15.115:0/306070872 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe230106c00 con 0x7fe2300fe3b0 2024-09-13T17:06:46.066 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.064+0000 7fe21f7fe640 1 -- 172.21.15.115:0/306070872 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 29) v1 ==== 90954+0+0 (secure 0 0 0) 0x7fe22000f550 con 0x7fe2300fe3b0 2024-09-13T17:06:46.067 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.064+0000 7fe21f7fe640 1 --2- 172.21.15.115:0/306070872 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fe21806ce30 0x7fe21806f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:46.067 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.064+0000 7fe21f7fe640 1 -- 172.21.15.115:0/306070872 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fe22008d210 con 0x7fe2300fe3b0 2024-09-13T17:06:46.068 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.066+0000 7fe22dd9b640 1 --2- 172.21.15.115:0/306070872 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fe21806ce30 0x7fe21806f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:46.073 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.071+0000 7fe22dd9b640 1 --2- 172.21.15.115:0/306070872 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fe21806ce30 0x7fe21806f2f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe228036aa0 tx=0x7fe228000f40 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:46.077 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.075+0000 7fe21f7fe640 1 -- 172.21.15.115:0/306070872 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe220057070 con 0x7fe2300fe3b0 2024-09-13T17:06:46.531 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.529+0000 7fe234c30640 1 -- 172.21.15.115:0/306070872 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe2301aa260 con 0x7fe2300fe3b0 2024-09-13T17:06:46.531 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.530+0000 7fe21f7fe640 1 -- 172.21.15.115:0/306070872 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+733 (secure 0 0 0) 0x7fe2301aa260 con 0x7fe2300fe3b0 2024-09-13T17:06:46.531 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-13T17:06:46.531 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": { 2024-09-13T17:06:46.531 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-843-g2c01458a (2c01458affee2b2435cd231b6e392435c1c21661) reef (stable)": 2 2024-09-13T17:06:46.531 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T17:06:46.531 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": { 2024-09-13T17:06:46.531 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 2 2024-09-13T17:06:46.532 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T17:06:46.532 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": { 2024-09-13T17:06:46.532 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-843-g2c01458a (2c01458affee2b2435cd231b6e392435c1c21661) reef (stable)": 6 2024-09-13T17:06:46.532 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T17:06:46.532 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": { 2024-09-13T17:06:46.532 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-843-g2c01458a (2c01458affee2b2435cd231b6e392435c1c21661) reef (stable)": 4 2024-09-13T17:06:46.532 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T17:06:46.532 INFO:teuthology.orchestra.run.smithi115.stdout: "overall": { 2024-09-13T17:06:46.532 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-843-g2c01458a (2c01458affee2b2435cd231b6e392435c1c21661) reef (stable)": 12, 2024-09-13T17:06:46.532 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 2 2024-09-13T17:06:46.532 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-13T17:06:46.532 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-13T17:06:46.534 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.532+0000 7fe234c30640 1 -- 172.21.15.115:0/306070872 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fe21806ce30 msgr2=0x7fe21806f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:46.534 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.532+0000 7fe234c30640 1 --2- 172.21.15.115:0/306070872 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fe21806ce30 0x7fe21806f2f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe228036aa0 tx=0x7fe228000f40 comp rx=0 tx=0).stop 2024-09-13T17:06:46.534 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.532+0000 7fe234c30640 1 -- 172.21.15.115:0/306070872 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2300fe3b0 msgr2=0x7fe2301a43a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:46.534 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.532+0000 7fe234c30640 1 --2- 172.21.15.115:0/306070872 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2300fe3b0 0x7fe2301a43a0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fe22000d8d0 tx=0x7fe22000dd90 comp rx=0 tx=0).stop 2024-09-13T17:06:46.534 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.533+0000 7fe234c30640 1 -- 172.21.15.115:0/306070872 shutdown_connections 2024-09-13T17:06:46.534 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.533+0000 7fe234c30640 1 --2- 172.21.15.115:0/306070872 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fe21806ce30 0x7fe21806f2f0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:46.534 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.533+0000 7fe234c30640 1 --2- 172.21.15.115:0/306070872 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe230100d00 0x7fe2301a48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:46.534 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.533+0000 7fe234c30640 1 --2- 172.21.15.115:0/306070872 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2300fe3b0 0x7fe2301a43a0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:46.534 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.533+0000 7fe234c30640 1 -- 172.21.15.115:0/306070872 >> 172.21.15.115:0/306070872 conn(0x7fe2300fa1c0 msgr2=0x7fe2300fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:46.534 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.533+0000 7fe234c30640 1 -- 172.21.15.115:0/306070872 shutdown_connections 2024-09-13T17:06:46.535 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.533+0000 7fe234c30640 1 -- 172.21.15.115:0/306070872 wait complete. 2024-09-13T17:06:46.623 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.622+0000 7f5b36f06640 1 -- 172.21.15.115:0/1428552687 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b300ffc30 msgr2=0x7f5b301000b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:46.623 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.622+0000 7f5b36f06640 1 --2- 172.21.15.115:0/1428552687 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b300ffc30 0x7f5b301000b0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c009880 tx=0x7f5b1c02a4a0 comp rx=0 tx=0).stop 2024-09-13T17:06:46.623 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.622+0000 7f5b36f06640 1 -- 172.21.15.115:0/1428552687 shutdown_connections 2024-09-13T17:06:46.624 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.622+0000 7f5b36f06640 1 --2- 172.21.15.115:0/1428552687 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b300ffc30 0x7f5b301000b0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:46.624 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.622+0000 7f5b36f06640 1 --2- 172.21.15.115:0/1428552687 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5b300fea30 0x7f5b300fee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:46.624 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.622+0000 7f5b36f06640 1 -- 172.21.15.115:0/1428552687 >> 172.21.15.115:0/1428552687 conn(0x7f5b300fa1c0 msgr2=0x7f5b300fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:46.624 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.622+0000 7f5b36f06640 1 -- 172.21.15.115:0/1428552687 shutdown_connections 2024-09-13T17:06:46.624 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.622+0000 7f5b36f06640 1 -- 172.21.15.115:0/1428552687 wait complete. 2024-09-13T17:06:46.625 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.623+0000 7f5b36f06640 1 Processor -- start 2024-09-13T17:06:46.625 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.623+0000 7f5b36f06640 1 -- start start 2024-09-13T17:06:46.625 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.623+0000 7f5b36f06640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5b300fea30 0x7f5b30195670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:46.625 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.623+0000 7f5b36f06640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b300ffc30 0x7f5b30195bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:46.626 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.623+0000 7f5b36f06640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b30196180 con 0x7f5b300ffc30 2024-09-13T17:06:46.626 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.623+0000 7f5b36f06640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b301962f0 con 0x7f5b300fea30 2024-09-13T17:06:46.626 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.623+0000 7f5b2ffff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b300ffc30 0x7f5b30195bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:46.626 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.623+0000 7f5b2ffff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b300ffc30 0x7f5b30195bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:34678/0 (socket says 172.21.15.115:34678) 2024-09-13T17:06:46.626 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.623+0000 7f5b2ffff640 1 -- 172.21.15.115:0/1717092548 learned_addr learned my addr 172.21.15.115:0/1717092548 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:06:46.626 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.623+0000 7f5b34ca2640 1 --2- 172.21.15.115:0/1717092548 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5b300fea30 0x7f5b30195670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:46.626 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.624+0000 7f5b2ffff640 1 -- 172.21.15.115:0/1717092548 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5b300fea30 msgr2=0x7f5b30195670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:46.626 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.624+0000 7f5b2ffff640 1 --2- 172.21.15.115:0/1717092548 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5b300fea30 0x7f5b30195670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:46.626 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.624+0000 7f5b2ffff640 1 -- 172.21.15.115:0/1717092548 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b1c009560 con 0x7f5b300ffc30 2024-09-13T17:06:46.626 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.624+0000 7f5b34ca2640 1 --2- 172.21.15.115:0/1717092548 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5b300fea30 0x7f5b30195670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:06:46.626 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.624+0000 7f5b2ffff640 1 --2- 172.21.15.115:0/1717092548 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b300ffc30 0x7f5b30195bb0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c006010 tx=0x7f5b1c0056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:46.626 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.624+0000 7f5b2dffb640 1 -- 172.21.15.115:0/1717092548 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b1c004ba0 con 0x7f5b300ffc30 2024-09-13T17:06:46.626 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.624+0000 7f5b2dffb640 1 -- 172.21.15.115:0/1717092548 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5b1c004d00 con 0x7f5b300ffc30 2024-09-13T17:06:46.627 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.624+0000 7f5b36f06640 1 -- 172.21.15.115:0/1717092548 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b3019ad30 con 0x7f5b300ffc30 2024-09-13T17:06:46.627 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.624+0000 7f5b2dffb640 1 -- 172.21.15.115:0/1717092548 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b1c003ae0 con 0x7f5b300ffc30 2024-09-13T17:06:46.627 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.624+0000 7f5b36f06640 1 -- 172.21.15.115:0/1717092548 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b3019b2a0 con 0x7f5b300ffc30 2024-09-13T17:06:46.627 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.625+0000 7f5b36f06640 1 -- 172.21.15.115:0/1717092548 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b30107580 con 0x7f5b300ffc30 2024-09-13T17:06:46.627 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.627+0000 7f5b2dffb640 1 -- 172.21.15.115:0/1717092548 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 29) v1 ==== 90954+0+0 (secure 0 0 0) 0x7f5b1c031d00 con 0x7f5b300ffc30 2024-09-13T17:06:46.628 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.627+0000 7f5b2dffb640 1 --2- 172.21.15.115:0/1717092548 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f5b2006cd90 0x7f5b2006f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:46.628 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.627+0000 7f5b2dffb640 1 -- 172.21.15.115:0/1717092548 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f5b1c0adff0 con 0x7f5b300ffc30 2024-09-13T17:06:46.628 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.627+0000 7f5b34ca2640 1 --2- 172.21.15.115:0/1717092548 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f5b2006cd90 0x7f5b2006f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:46.629 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.628+0000 7f5b34ca2640 1 --2- 172.21.15.115:0/1717092548 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f5b2006cd90 0x7f5b2006f250 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5b300ffa90 tx=0x7f5b24009110 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:46.632 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.631+0000 7f5b2dffb640 1 -- 172.21.15.115:0/1717092548 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f5b1c077f70 con 0x7f5b300ffc30 2024-09-13T17:06:46.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:46 smithi195 ceph-mon[34981]: from='client.24429 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:06:46.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:46 smithi195 ceph-mon[34981]: pgmap v8: 65 pgs: 65 active+clean; 310 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 250 op/s 2024-09-13T17:06:46.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:46 smithi195 ceph-mon[34981]: from='client.14694 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:06:46.863 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.862+0000 7f5b36f06640 1 -- 172.21.15.115:0/1717092548 --> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5b3019b490 con 0x7f5b2006cd90 2024-09-13T17:06:46.863 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:46 smithi115 ceph-mon[27708]: from='client.24429 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:06:46.863 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:46 smithi115 ceph-mon[27708]: pgmap v8: 65 pgs: 65 active+clean; 310 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 250 op/s 2024-09-13T17:06:46.863 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:46 smithi115 ceph-mon[27708]: from='client.14694 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:06:46.864 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.863+0000 7f5b2dffb640 1 -- 172.21.15.115:0/1717092548 <== mgr.14660 v2:172.21.15.115:6800/1049502673 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7f5b3019b490 con 0x7f5b2006cd90 2024-09-13T17:06:46.864 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-13T17:06:46.864 INFO:teuthology.orchestra.run.smithi115.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256", 2024-09-13T17:06:46.864 INFO:teuthology.orchestra.run.smithi115.stdout: "in_progress": true, 2024-09-13T17:06:46.864 INFO:teuthology.orchestra.run.smithi115.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-13T17:06:46.864 INFO:teuthology.orchestra.run.smithi115.stdout: "services_complete": [ 2024-09-13T17:06:46.864 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr" 2024-09-13T17:06:46.864 INFO:teuthology.orchestra.run.smithi115.stdout: ], 2024-09-13T17:06:46.865 INFO:teuthology.orchestra.run.smithi115.stdout: "progress": "2/2 daemons upgraded", 2024-09-13T17:06:46.865 INFO:teuthology.orchestra.run.smithi115.stdout: "message": "", 2024-09-13T17:06:46.865 INFO:teuthology.orchestra.run.smithi115.stdout: "is_paused": false 2024-09-13T17:06:46.865 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-13T17:06:46.868 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.866+0000 7f5b36f06640 1 -- 172.21.15.115:0/1717092548 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f5b2006cd90 msgr2=0x7f5b2006f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:46.868 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.866+0000 7f5b36f06640 1 --2- 172.21.15.115:0/1717092548 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f5b2006cd90 0x7f5b2006f250 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5b300ffa90 tx=0x7f5b24009110 comp rx=0 tx=0).stop 2024-09-13T17:06:46.868 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.866+0000 7f5b36f06640 1 -- 172.21.15.115:0/1717092548 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b300ffc30 msgr2=0x7f5b30195bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:46.868 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.866+0000 7f5b36f06640 1 --2- 172.21.15.115:0/1717092548 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b300ffc30 0x7f5b30195bb0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c006010 tx=0x7f5b1c0056e0 comp rx=0 tx=0).stop 2024-09-13T17:06:46.868 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.866+0000 7f5b36f06640 1 -- 172.21.15.115:0/1717092548 shutdown_connections 2024-09-13T17:06:46.868 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.866+0000 7f5b36f06640 1 --2- 172.21.15.115:0/1717092548 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f5b2006cd90 0x7f5b2006f250 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:46.869 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.866+0000 7f5b36f06640 1 --2- 172.21.15.115:0/1717092548 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b300ffc30 0x7f5b30195bb0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:46.869 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.866+0000 7f5b36f06640 1 --2- 172.21.15.115:0/1717092548 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5b300fea30 0x7f5b30195670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:46.869 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.866+0000 7f5b36f06640 1 -- 172.21.15.115:0/1717092548 >> 172.21.15.115:0/1717092548 conn(0x7f5b300fa1c0 msgr2=0x7f5b30067be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:46.869 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.866+0000 7f5b36f06640 1 -- 172.21.15.115:0/1717092548 shutdown_connections 2024-09-13T17:06:46.869 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:06:46.866+0000 7f5b36f06640 1 -- 172.21.15.115:0/1717092548 wait complete. 2024-09-13T17:06:47.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:47 smithi195 ceph-mon[34981]: from='client.14698 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:06:47.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:47 smithi195 ceph-mon[34981]: from='client.? 172.21.15.115:0/306070872' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:06:47.928 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:47 smithi115 ceph-mon[27708]: from='client.14698 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:06:47.928 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:47 smithi115 ceph-mon[27708]: from='client.? 172.21.15.115:0/306070872' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:06:48.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:48 smithi195 ceph-mon[34981]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:06:48.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:48 smithi195 ceph-mon[34981]: pgmap v9: 65 pgs: 65 active+clean; 318 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 579 op/s 2024-09-13T17:06:48.928 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:48 smithi115 ceph-mon[27708]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:06:48.928 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:48 smithi115 ceph-mon[27708]: pgmap v9: 65 pgs: 65 active+clean; 318 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 579 op/s 2024-09-13T17:06:50.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:50 smithi195 ceph-mon[34981]: pgmap v10: 65 pgs: 65 active+clean; 318 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 531 op/s 2024-09-13T17:06:50.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:50 smithi115 ceph-mon[27708]: pgmap v10: 65 pgs: 65 active+clean; 318 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 531 op/s 2024-09-13T17:06:51.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:51 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:06:51.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:51 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:06:52.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:52 smithi195 ceph-mon[34981]: pgmap v11: 65 pgs: 65 active+clean; 318 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 531 op/s 2024-09-13T17:06:52.884 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:52 smithi115 ceph-mon[27708]: pgmap v11: 65 pgs: 65 active+clean; 318 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 531 op/s 2024-09-13T17:06:54.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:54 smithi195 ceph-mon[34981]: pgmap v12: 65 pgs: 65 active+clean; 323 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.7 MiB/s rd, 2.9 MiB/s wr, 983 op/s 2024-09-13T17:06:54.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:54 smithi115 ceph-mon[27708]: pgmap v12: 65 pgs: 65 active+clean; 323 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.7 MiB/s rd, 2.9 MiB/s wr, 983 op/s 2024-09-13T17:06:56.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:56 smithi195 ceph-mon[34981]: pgmap v13: 65 pgs: 65 active+clean; 323 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.9 MiB/s wr, 796 op/s 2024-09-13T17:06:56.827 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:56 smithi115 ceph-mon[27708]: pgmap v13: 65 pgs: 65 active+clean; 323 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.9 MiB/s wr, 796 op/s 2024-09-13T17:06:58.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:06:58 smithi195 ceph-mon[34981]: pgmap v14: 65 pgs: 65 active+clean; 312 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 2.3 MiB/s rd, 2.6 MiB/s wr, 1.22k op/s 2024-09-13T17:06:58.928 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:06:58 smithi115 ceph-mon[27708]: pgmap v14: 65 pgs: 65 active+clean; 312 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 2.3 MiB/s rd, 2.6 MiB/s wr, 1.22k op/s 2024-09-13T17:07:00.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:00 smithi195 ceph-mon[34981]: pgmap v15: 65 pgs: 65 active+clean; 312 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 872 op/s 2024-09-13T17:07:00.928 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:00 smithi115 ceph-mon[27708]: pgmap v15: 65 pgs: 65 active+clean; 312 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 872 op/s 2024-09-13T17:07:02.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:02 smithi115 ceph-mon[27708]: pgmap v16: 65 pgs: 65 active+clean; 312 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 872 op/s 2024-09-13T17:07:02.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:02 smithi195 ceph-mon[34981]: pgmap v16: 65 pgs: 65 active+clean; 312 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 872 op/s 2024-09-13T17:07:04.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:04 smithi195 ceph-mon[34981]: pgmap v17: 65 pgs: 65 active+clean; 293 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 2.3 MiB/s rd, 2.5 MiB/s wr, 1.21k op/s 2024-09-13T17:07:04.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:04 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:04.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:04 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:04.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:04 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:07:04.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:04 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:07:04.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:04 smithi195 ceph-mon[34981]: Updating smithi115:/etc/ceph/ceph.conf 2024-09-13T17:07:04.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:04 smithi195 ceph-mon[34981]: Updating smithi195:/etc/ceph/ceph.conf 2024-09-13T17:07:04.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:04 smithi195 ceph-mon[34981]: Updating smithi195:/var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T17:07:04.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:04 smithi195 ceph-mon[34981]: Updating smithi115:/var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T17:07:04.928 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:04 smithi115 ceph-mon[27708]: pgmap v17: 65 pgs: 65 active+clean; 293 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 2.3 MiB/s rd, 2.5 MiB/s wr, 1.21k op/s 2024-09-13T17:07:04.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:04 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:04.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:04 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:04.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:04 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:07:04.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:04 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:07:04.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:04 smithi115 ceph-mon[27708]: Updating smithi115:/etc/ceph/ceph.conf 2024-09-13T17:07:04.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:04 smithi115 ceph-mon[27708]: Updating smithi195:/etc/ceph/ceph.conf 2024-09-13T17:07:04.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:04 smithi115 ceph-mon[27708]: Updating smithi195:/var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T17:07:04.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:04 smithi115 ceph-mon[27708]: Updating smithi115:/var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T17:07:05.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:05 smithi115 ceph-mon[27708]: Updating smithi195:/etc/ceph/ceph.client.admin.keyring 2024-09-13T17:07:05.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:05 smithi115 ceph-mon[27708]: Updating smithi115:/etc/ceph/ceph.client.admin.keyring 2024-09-13T17:07:05.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:05 smithi115 ceph-mon[27708]: Updating smithi195:/var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T17:07:05.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:05 smithi115 ceph-mon[27708]: Updating smithi115:/var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T17:07:05.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:05 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:05.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:05 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:05.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:05 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:05.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:05 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:05.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:05 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:05.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:05 smithi115 ceph-mon[27708]: Reconfiguring prometheus.smithi115 (dependencies changed)... 2024-09-13T17:07:05.810 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:05 smithi195 ceph-mon[34981]: Updating smithi195:/etc/ceph/ceph.client.admin.keyring 2024-09-13T17:07:05.810 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:05 smithi195 ceph-mon[34981]: Updating smithi115:/etc/ceph/ceph.client.admin.keyring 2024-09-13T17:07:05.810 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:05 smithi195 ceph-mon[34981]: Updating smithi195:/var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T17:07:05.810 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:05 smithi195 ceph-mon[34981]: Updating smithi115:/var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T17:07:05.810 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:05 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:05.810 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:05 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:05.810 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:05 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:05.810 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:05 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:05.810 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:05 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:05.810 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:05 smithi195 ceph-mon[34981]: Reconfiguring prometheus.smithi115 (dependencies changed)... 2024-09-13T17:07:06.741 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:06 smithi115 ceph-mon[27708]: Reconfiguring daemon prometheus.smithi115 on smithi115 2024-09-13T17:07:06.741 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:06 smithi115 ceph-mon[27708]: pgmap v18: 65 pgs: 65 active+clean; 293 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 754 op/s 2024-09-13T17:07:06.741 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:06 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:07:06.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:06 smithi195 ceph-mon[34981]: Reconfiguring daemon prometheus.smithi115 on smithi115 2024-09-13T17:07:06.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:06 smithi195 ceph-mon[34981]: pgmap v18: 65 pgs: 65 active+clean; 293 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 754 op/s 2024-09-13T17:07:06.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:06 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:07:08.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:08 smithi195 ceph-mon[34981]: pgmap v19: 65 pgs: 65 active+clean; 282 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.4 MiB/s rd, 2.6 MiB/s wr, 1.14k op/s 2024-09-13T17:07:08.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:08 smithi115 ceph-mon[27708]: pgmap v19: 65 pgs: 65 active+clean; 282 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.4 MiB/s rd, 2.6 MiB/s wr, 1.14k op/s 2024-09-13T17:07:10.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:10 smithi195 ceph-mon[34981]: pgmap v20: 65 pgs: 65 active+clean; 282 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 716 op/s 2024-09-13T17:07:10.928 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:10 smithi115 ceph-mon[27708]: pgmap v20: 65 pgs: 65 active+clean; 282 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 716 op/s 2024-09-13T17:07:12.796 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:12 smithi115 ceph-mon[27708]: pgmap v21: 65 pgs: 65 active+clean; 282 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 716 op/s 2024-09-13T17:07:12.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:12 smithi195 ceph-mon[34981]: pgmap v21: 65 pgs: 65 active+clean; 282 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 716 op/s 2024-09-13T17:07:14.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:14 smithi195 ceph-mon[34981]: pgmap v22: 65 pgs: 65 active+clean; 268 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.4 MiB/s rd, 2.6 MiB/s wr, 1.15k op/s 2024-09-13T17:07:14.928 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:14 smithi115 ceph-mon[27708]: pgmap v22: 65 pgs: 65 active+clean; 268 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.4 MiB/s rd, 2.6 MiB/s wr, 1.15k op/s 2024-09-13T17:07:16.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:15 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:16.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:15 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:16.328 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:15 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T17:07:16.328 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:15 smithi195 ceph-mon[34981]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T17:07:16.328 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:15 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:07:16.328 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:15 smithi195 ceph-mon[34981]: pgmap v23: 65 pgs: 65 active+clean; 268 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 810 op/s 2024-09-13T17:07:16.428 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:15 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:16.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:15 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:16.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:15 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T17:07:16.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:15 smithi115 ceph-mon[27708]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T17:07:16.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:15 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:07:16.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:15 smithi115 ceph-mon[27708]: pgmap v23: 65 pgs: 65 active+clean; 268 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 810 op/s 2024-09-13T17:07:17.013 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.010+0000 7f89c3bfb640 1 -- 172.21.15.115:0/1285915677 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89bc1085c0 msgr2=0x7f89bc108a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:17.014 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.010+0000 7f89c3bfb640 1 --2- 172.21.15.115:0/1285915677 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89bc1085c0 0x7f89bc108a20 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f89b4009c20 tx=0x7f89b402a9a0 comp rx=0 tx=0).stop 2024-09-13T17:07:17.015 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.014+0000 7f89c3bfb640 1 -- 172.21.15.115:0/1285915677 shutdown_connections 2024-09-13T17:07:17.015 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.014+0000 7f89c3bfb640 1 --2- 172.21.15.115:0/1285915677 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89bc1085c0 0x7f89bc108a20 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:17.015 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.014+0000 7f89c3bfb640 1 --2- 172.21.15.115:0/1285915677 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f89bc071420 0x7f89bc071820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:17.015 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.014+0000 7f89c3bfb640 1 -- 172.21.15.115:0/1285915677 >> 172.21.15.115:0/1285915677 conn(0x7f89bc06cf90 msgr2=0x7f89bc06f3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:17.018 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.014+0000 7f89c3bfb640 1 -- 172.21.15.115:0/1285915677 shutdown_connections 2024-09-13T17:07:17.019 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.017+0000 7f89c3bfb640 1 -- 172.21.15.115:0/1285915677 wait complete. 2024-09-13T17:07:17.019 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.018+0000 7f89c3bfb640 1 Processor -- start 2024-09-13T17:07:17.019 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.018+0000 7f89c3bfb640 1 -- start start 2024-09-13T17:07:17.020 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.019+0000 7f89c3bfb640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f89bc071420 0x7f89bc108050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:17.020 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.019+0000 7f89c3bfb640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89bc1085c0 0x7f89bc1a4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:17.020 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.019+0000 7f89c1997640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f89bc071420 0x7f89bc108050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:17.020 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.019+0000 7f89c1997640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f89bc071420 0x7f89bc108050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.115:55358/0 (socket says 172.21.15.115:55358) 2024-09-13T17:07:17.021 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.019+0000 7f89c1997640 1 -- 172.21.15.115:0/1888016207 learned_addr learned my addr 172.21.15.115:0/1888016207 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:07:17.021 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.019+0000 7f89c3bfb640 1 -- 172.21.15.115:0/1888016207 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89bc19e9d0 con 0x7f89bc1085c0 2024-09-13T17:07:17.021 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.019+0000 7f89c3bfb640 1 -- 172.21.15.115:0/1888016207 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89bc1a54a0 con 0x7f89bc071420 2024-09-13T17:07:17.021 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.019+0000 7f89c1196640 1 --2- 172.21.15.115:0/1888016207 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89bc1085c0 0x7f89bc1a4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:17.022 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.020+0000 7f89c1997640 1 -- 172.21.15.115:0/1888016207 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89bc1085c0 msgr2=0x7f89bc1a4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:17.022 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.020+0000 7f89c1997640 1 --2- 172.21.15.115:0/1888016207 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89bc1085c0 0x7f89bc1a4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:17.022 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.020+0000 7f89c1997640 1 -- 172.21.15.115:0/1888016207 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89b4009900 con 0x7f89bc071420 2024-09-13T17:07:17.022 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.020+0000 7f89c1196640 1 --2- 172.21.15.115:0/1888016207 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89bc1085c0 0x7f89bc1a4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:07:17.022 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.020+0000 7f89c1997640 1 --2- 172.21.15.115:0/1888016207 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f89bc071420 0x7f89bc108050 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f89b800b3d0 tx=0x7f89b800b890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:17.022 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.021+0000 7f89b2ffd640 1 -- 172.21.15.115:0/1888016207 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f89b8011800 con 0x7f89bc071420 2024-09-13T17:07:17.022 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.021+0000 7f89b2ffd640 1 -- 172.21.15.115:0/1888016207 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f89b8011e00 con 0x7f89bc071420 2024-09-13T17:07:17.022 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.021+0000 7f89c3bfb640 1 -- 172.21.15.115:0/1888016207 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89bc1a5780 con 0x7f89bc071420 2024-09-13T17:07:17.022 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.021+0000 7f89b2ffd640 1 -- 172.21.15.115:0/1888016207 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f89b800f2e0 con 0x7f89bc071420 2024-09-13T17:07:17.023 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.021+0000 7f89c3bfb640 1 -- 172.21.15.115:0/1888016207 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89bc1a5d20 con 0x7f89bc071420 2024-09-13T17:07:17.025 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.024+0000 7f89b0ff9640 1 -- 172.21.15.115:0/1888016207 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89bc0718a0 con 0x7f89bc071420 2024-09-13T17:07:17.025 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.024+0000 7f89b2ffd640 1 -- 172.21.15.115:0/1888016207 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 29) v1 ==== 90954+0+0 (secure 0 0 0) 0x7f89b8010380 con 0x7f89bc071420 2024-09-13T17:07:17.026 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.025+0000 7f89b2ffd640 1 --2- 172.21.15.115:0/1888016207 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f89a806cd90 0x7f89a806f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:17.026 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.025+0000 7f89b2ffd640 1 -- 172.21.15.115:0/1888016207 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f89b808c260 con 0x7f89bc071420 2024-09-13T17:07:17.026 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.025+0000 7f89c1196640 1 --2- 172.21.15.115:0/1888016207 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f89a806cd90 0x7f89a806f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:17.027 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.026+0000 7f89c1196640 1 --2- 172.21.15.115:0/1888016207 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f89a806cd90 0x7f89a806f250 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f89b402eba0 tx=0x7f89b403b040 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:17.035 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.033+0000 7f89b2ffd640 1 -- 172.21.15.115:0/1888016207 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f89b8056290 con 0x7f89bc071420 2024-09-13T17:07:17.073 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:16 smithi195 ceph-mon[34981]: Upgrade: Updating mgr.smithi195.hjjifz 2024-09-13T17:07:17.073 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:16 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi195.hjjifz", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T17:07:17.073 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:16 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T17:07:17.073 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:17 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:07:17.073 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:17 smithi195 ceph-mon[34981]: Deploying daemon mgr.smithi195.hjjifz on smithi195 2024-09-13T17:07:17.311 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.309+0000 7f89b0ff9640 1 -- 172.21.15.115:0/1888016207 --> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f89bc10fdc0 con 0x7f89a806cd90 2024-09-13T17:07:17.311 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:16 smithi115 ceph-mon[27708]: Upgrade: Updating mgr.smithi195.hjjifz 2024-09-13T17:07:17.311 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:16 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi195.hjjifz", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T17:07:17.311 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:16 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T17:07:17.311 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:16 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:07:17.312 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:16 smithi115 ceph-mon[27708]: Deploying daemon mgr.smithi195.hjjifz on smithi195 2024-09-13T17:07:17.312 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.311+0000 7f89b2ffd640 1 -- 172.21.15.115:0/1888016207 <== mgr.14660 v2:172.21.15.115:6800/1049502673 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7f89bc10fdc0 con 0x7f89a806cd90 2024-09-13T17:07:17.314 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.313+0000 7f89b0ff9640 1 -- 172.21.15.115:0/1888016207 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f89a806cd90 msgr2=0x7f89a806f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:17.314 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.313+0000 7f89b0ff9640 1 --2- 172.21.15.115:0/1888016207 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f89a806cd90 0x7f89a806f250 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f89b402eba0 tx=0x7f89b403b040 comp rx=0 tx=0).stop 2024-09-13T17:07:17.314 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.313+0000 7f89b0ff9640 1 -- 172.21.15.115:0/1888016207 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f89bc071420 msgr2=0x7f89bc108050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:17.314 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.313+0000 7f89b0ff9640 1 --2- 172.21.15.115:0/1888016207 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f89bc071420 0x7f89bc108050 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f89b800b3d0 tx=0x7f89b800b890 comp rx=0 tx=0).stop 2024-09-13T17:07:17.314 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.313+0000 7f89b0ff9640 1 -- 172.21.15.115:0/1888016207 shutdown_connections 2024-09-13T17:07:17.314 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.313+0000 7f89b0ff9640 1 --2- 172.21.15.115:0/1888016207 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f89a806cd90 0x7f89a806f250 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:17.314 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.313+0000 7f89b0ff9640 1 --2- 172.21.15.115:0/1888016207 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89bc1085c0 0x7f89bc1a4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:17.315 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.313+0000 7f89b0ff9640 1 --2- 172.21.15.115:0/1888016207 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f89bc071420 0x7f89bc108050 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:17.315 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.313+0000 7f89b0ff9640 1 -- 172.21.15.115:0/1888016207 >> 172.21.15.115:0/1888016207 conn(0x7f89bc06cf90 msgr2=0x7f89bc10b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:17.315 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.313+0000 7f89b0ff9640 1 -- 172.21.15.115:0/1888016207 shutdown_connections 2024-09-13T17:07:17.315 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.313+0000 7f89b0ff9640 1 -- 172.21.15.115:0/1888016207 wait complete. 2024-09-13T17:07:17.324 INFO:teuthology.orchestra.run.smithi115.stdout:true 2024-09-13T17:07:17.423 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.422+0000 7f8bbcd85640 1 -- 172.21.15.115:0/1679192339 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8bb80fea30 msgr2=0x7f8bb80fee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:17.423 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.422+0000 7f8bbcd85640 1 --2- 172.21.15.115:0/1679192339 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8bb80fea30 0x7f8bb80fee30 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f8ba8009880 tx=0x7f8ba802a4a0 comp rx=0 tx=0).stop 2024-09-13T17:07:17.424 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.422+0000 7f8bbcd85640 1 -- 172.21.15.115:0/1679192339 shutdown_connections 2024-09-13T17:07:17.424 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.422+0000 7f8bbcd85640 1 --2- 172.21.15.115:0/1679192339 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8bb80ffc30 0x7f8bb81000b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:17.424 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.422+0000 7f8bbcd85640 1 --2- 172.21.15.115:0/1679192339 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8bb80fea30 0x7f8bb80fee30 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:17.424 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.422+0000 7f8bbcd85640 1 -- 172.21.15.115:0/1679192339 >> 172.21.15.115:0/1679192339 conn(0x7f8bb80fa1c0 msgr2=0x7f8bb80fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:17.425 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.422+0000 7f8bbcd85640 1 -- 172.21.15.115:0/1679192339 shutdown_connections 2024-09-13T17:07:17.425 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.422+0000 7f8bbcd85640 1 -- 172.21.15.115:0/1679192339 wait complete. 2024-09-13T17:07:17.429 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.423+0000 7f8bbcd85640 1 Processor -- start 2024-09-13T17:07:17.429 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.423+0000 7f8bbcd85640 1 -- start start 2024-09-13T17:07:17.429 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.423+0000 7f8bbcd85640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8bb80fea30 0x7f8bb8068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:17.429 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.423+0000 7f8bbcd85640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8bb80ffc30 0x7f8bb819a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:17.429 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.423+0000 7f8bbcd85640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb819a8a0 con 0x7f8bb80ffc30 2024-09-13T17:07:17.429 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.423+0000 7f8bbcd85640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb819a9e0 con 0x7f8bb80fea30 2024-09-13T17:07:17.429 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.423+0000 7f8bb5d9b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8bb80ffc30 0x7f8bb819a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:17.429 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.423+0000 7f8bb5d9b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8bb80ffc30 0x7f8bb819a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52422/0 (socket says 172.21.15.115:52422) 2024-09-13T17:07:17.430 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.423+0000 7f8bb5d9b640 1 -- 172.21.15.115:0/1774499700 learned_addr learned my addr 172.21.15.115:0/1774499700 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:07:17.430 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.424+0000 7f8bb659c640 1 --2- 172.21.15.115:0/1774499700 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8bb80fea30 0x7f8bb8068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:17.430 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.424+0000 7f8bb5d9b640 1 -- 172.21.15.115:0/1774499700 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8bb80fea30 msgr2=0x7f8bb8068740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:17.430 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.424+0000 7f8bb5d9b640 1 --2- 172.21.15.115:0/1774499700 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8bb80fea30 0x7f8bb8068740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:17.430 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.424+0000 7f8bb5d9b640 1 -- 172.21.15.115:0/1774499700 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ba8009560 con 0x7f8bb80ffc30 2024-09-13T17:07:17.430 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.424+0000 7f8bb5d9b640 1 --2- 172.21.15.115:0/1774499700 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8bb80ffc30 0x7f8bb819a2d0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f8bac00c8f0 tx=0x7f8bac00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:17.430 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.424+0000 7f8ba77fe640 1 -- 172.21.15.115:0/1774499700 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8bac007b80 con 0x7f8bb80ffc30 2024-09-13T17:07:17.430 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.424+0000 7f8ba77fe640 1 -- 172.21.15.115:0/1774499700 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8bac007ce0 con 0x7f8bb80ffc30 2024-09-13T17:07:17.430 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.424+0000 7f8ba77fe640 1 -- 172.21.15.115:0/1774499700 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8bac00f450 con 0x7f8bb80ffc30 2024-09-13T17:07:17.430 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.424+0000 7f8bbcd85640 1 -- 172.21.15.115:0/1774499700 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bb819ac90 con 0x7f8bb80ffc30 2024-09-13T17:07:17.430 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.424+0000 7f8bbcd85640 1 -- 172.21.15.115:0/1774499700 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bb819b260 con 0x7f8bb80ffc30 2024-09-13T17:07:17.430 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.426+0000 7f8bbcd85640 1 -- 172.21.15.115:0/1774499700 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bb8107500 con 0x7f8bb80ffc30 2024-09-13T17:07:17.430 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.427+0000 7f8ba77fe640 1 -- 172.21.15.115:0/1774499700 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 29) v1 ==== 90954+0+0 (secure 0 0 0) 0x7f8bac004f10 con 0x7f8bb80ffc30 2024-09-13T17:07:17.431 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.427+0000 7f8ba77fe640 1 --2- 172.21.15.115:0/1774499700 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f8ba006cd90 0x7f8ba006f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:17.431 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.427+0000 7f8ba77fe640 1 -- 172.21.15.115:0/1774499700 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f8bac08c1e0 con 0x7f8bb80ffc30 2024-09-13T17:07:17.431 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.427+0000 7f8bb659c640 1 --2- 172.21.15.115:0/1774499700 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f8ba006cd90 0x7f8ba006f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:17.431 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.428+0000 7f8bb659c640 1 --2- 172.21.15.115:0/1774499700 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f8ba006cd90 0x7f8ba006f250 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8ba8006010 tx=0x7f8ba8031400 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:17.433 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.432+0000 7f8ba77fe640 1 -- 172.21.15.115:0/1774499700 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f8bac056210 con 0x7f8bb80ffc30 2024-09-13T17:07:17.685 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.684+0000 7f8bbcd85640 1 -- 172.21.15.115:0/1774499700 --> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8bb8104580 con 0x7f8ba006cd90 2024-09-13T17:07:17.686 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.685+0000 7f8ba77fe640 1 -- 172.21.15.115:0/1774499700 <== mgr.14660 v2:172.21.15.115:6800/1049502673 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7f8bb8104580 con 0x7f8ba006cd90 2024-09-13T17:07:17.689 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.688+0000 7f8bbcd85640 1 -- 172.21.15.115:0/1774499700 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f8ba006cd90 msgr2=0x7f8ba006f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:17.689 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.688+0000 7f8bbcd85640 1 --2- 172.21.15.115:0/1774499700 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f8ba006cd90 0x7f8ba006f250 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8ba8006010 tx=0x7f8ba8031400 comp rx=0 tx=0).stop 2024-09-13T17:07:17.689 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.688+0000 7f8bbcd85640 1 -- 172.21.15.115:0/1774499700 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8bb80ffc30 msgr2=0x7f8bb819a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:17.689 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.688+0000 7f8bbcd85640 1 --2- 172.21.15.115:0/1774499700 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8bb80ffc30 0x7f8bb819a2d0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f8bac00c8f0 tx=0x7f8bac00cdb0 comp rx=0 tx=0).stop 2024-09-13T17:07:17.690 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.688+0000 7f8bbcd85640 1 -- 172.21.15.115:0/1774499700 shutdown_connections 2024-09-13T17:07:17.690 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.688+0000 7f8bbcd85640 1 --2- 172.21.15.115:0/1774499700 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f8ba006cd90 0x7f8ba006f250 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:17.690 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.688+0000 7f8bbcd85640 1 --2- 172.21.15.115:0/1774499700 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8bb80ffc30 0x7f8bb819a2d0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:17.690 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.688+0000 7f8bbcd85640 1 --2- 172.21.15.115:0/1774499700 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8bb80fea30 0x7f8bb8068740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:17.690 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.688+0000 7f8bbcd85640 1 -- 172.21.15.115:0/1774499700 >> 172.21.15.115:0/1774499700 conn(0x7f8bb80fa1c0 msgr2=0x7f8bb8102e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:17.690 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.688+0000 7f8bbcd85640 1 -- 172.21.15.115:0/1774499700 shutdown_connections 2024-09-13T17:07:17.690 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.688+0000 7f8bbcd85640 1 -- 172.21.15.115:0/1774499700 wait complete. 2024-09-13T17:07:17.787 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.785+0000 7f603612a640 1 -- 172.21.15.115:0/3781751375 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6030101d90 msgr2=0x7f6030102190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:17.787 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.785+0000 7f603612a640 1 --2- 172.21.15.115:0/3781751375 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6030101d90 0x7f6030102190 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f6020009880 tx=0x7f602002a4a0 comp rx=0 tx=0).stop 2024-09-13T17:07:17.787 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.785+0000 7f603612a640 1 -- 172.21.15.115:0/3781751375 shutdown_connections 2024-09-13T17:07:17.787 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.785+0000 7f603612a640 1 --2- 172.21.15.115:0/3781751375 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6030102f90 0x7f6030103410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:17.787 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.785+0000 7f603612a640 1 --2- 172.21.15.115:0/3781751375 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6030101d90 0x7f6030102190 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:17.787 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.785+0000 7f603612a640 1 -- 172.21.15.115:0/3781751375 >> 172.21.15.115:0/3781751375 conn(0x7f60300fd540 msgr2=0x7f60300ff960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:17.788 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.785+0000 7f603612a640 1 -- 172.21.15.115:0/3781751375 shutdown_connections 2024-09-13T17:07:17.788 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.785+0000 7f603612a640 1 -- 172.21.15.115:0/3781751375 wait complete. 2024-09-13T17:07:17.788 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.786+0000 7f603612a640 1 Processor -- start 2024-09-13T17:07:17.791 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.786+0000 7f603612a640 1 -- start start 2024-09-13T17:07:17.791 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.786+0000 7f603612a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6030101d90 0x7f6030197720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:17.791 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.786+0000 7f603612a640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6030102f90 0x7f6030197c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:17.791 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.786+0000 7f603612a640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6030198230 con 0x7f6030101d90 2024-09-13T17:07:17.791 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.786+0000 7f603612a640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60301983a0 con 0x7f6030102f90 2024-09-13T17:07:17.792 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.786+0000 7f602f7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6030101d90 0x7f6030197720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:17.792 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.786+0000 7f602f7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6030101d90 0x7f6030197720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52430/0 (socket says 172.21.15.115:52430) 2024-09-13T17:07:17.792 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.787+0000 7f602f7fe640 1 -- 172.21.15.115:0/169006475 learned_addr learned my addr 172.21.15.115:0/169006475 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:07:17.792 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.786+0000 7f602effd640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6030102f90 0x7f6030197c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:17.792 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.787+0000 7f602effd640 1 -- 172.21.15.115:0/169006475 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6030101d90 msgr2=0x7f6030197720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:17.792 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.787+0000 7f602effd640 1 --2- 172.21.15.115:0/169006475 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6030101d90 0x7f6030197720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:17.792 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.787+0000 7f602effd640 1 -- 172.21.15.115:0/169006475 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6020009560 con 0x7f6030102f90 2024-09-13T17:07:17.792 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.787+0000 7f602f7fe640 1 --2- 172.21.15.115:0/169006475 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6030101d90 0x7f6030197720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:07:17.792 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.787+0000 7f602effd640 1 --2- 172.21.15.115:0/169006475 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6030102f90 0x7f6030197c60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f601800e970 tx=0x7f601800ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:17.792 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.787+0000 7f602cff9640 1 -- 172.21.15.115:0/169006475 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6018009620 con 0x7f6030102f90 2024-09-13T17:07:17.793 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.788+0000 7f603612a640 1 -- 172.21.15.115:0/169006475 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f603019ce40 con 0x7f6030102f90 2024-09-13T17:07:17.793 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.788+0000 7f603612a640 1 -- 172.21.15.115:0/169006475 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f603019d3e0 con 0x7f6030102f90 2024-09-13T17:07:17.793 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.788+0000 7f602cff9640 1 -- 172.21.15.115:0/169006475 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f60180044d0 con 0x7f6030102f90 2024-09-13T17:07:17.793 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.788+0000 7f602cff9640 1 -- 172.21.15.115:0/169006475 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6018004800 con 0x7f6030102f90 2024-09-13T17:07:17.793 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.789+0000 7f603612a640 1 -- 172.21.15.115:0/169006475 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6010005280 con 0x7f6030102f90 2024-09-13T17:07:17.793 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.789+0000 7f602cff9640 1 -- 172.21.15.115:0/169006475 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 29) v1 ==== 90954+0+0 (secure 0 0 0) 0x7f6018004aa0 con 0x7f6030102f90 2024-09-13T17:07:17.793 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.790+0000 7f602cff9640 1 --2- 172.21.15.115:0/169006475 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f601c06cd90 0x7f601c06f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:17.793 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.790+0000 7f602cff9640 1 -- 172.21.15.115:0/169006475 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f6018014070 con 0x7f6030102f90 2024-09-13T17:07:17.793 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.790+0000 7f602f7fe640 1 --2- 172.21.15.115:0/169006475 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f601c06cd90 0x7f601c06f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:17.794 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.791+0000 7f602f7fe640 1 --2- 172.21.15.115:0/169006475 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f601c06cd90 0x7f601c06f250 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6020000c00 tx=0x7f6020031400 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:17.795 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:17.794+0000 7f602cff9640 1 -- 172.21.15.115:0/169006475 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f6018056880 con 0x7f6030102f90 2024-09-13T17:07:18.043 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.042+0000 7f603612a640 1 -- 172.21.15.115:0/169006475 --> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6010000bf0 con 0x7f601c06cd90 2024-09-13T17:07:18.060 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.059+0000 7f602cff9640 1 -- 172.21.15.115:0/169006475 <== mgr.14660 v2:172.21.15.115:6800/1049502673 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7f6010000bf0 con 0x7f601c06cd90 2024-09-13T17:07:18.061 INFO:teuthology.orchestra.run.smithi115.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T17:07:18.061 INFO:teuthology.orchestra.run.smithi115.stdout:alertmanager.smithi115 smithi115 *:9093,9094 running (7m) 36s ago 9m 25.1M - 0.25.0 c8568f914cd2 cbe091cee151 2024-09-13T17:07:18.061 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-exporter.smithi115 smithi115 running (9m) 36s ago 9m 7956k - 18.2.4-843-g2c01458a c129f5a2fd4e 0f1eebeaf9bb 2024-09-13T17:07:18.061 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-exporter.smithi195 smithi195 running (8m) 39s ago 8m 7528k - 18.2.4-843-g2c01458a c129f5a2fd4e 6d05bafbac8a 2024-09-13T17:07:18.061 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi115 smithi115 running (9m) 36s ago 9m 6899k - 18.2.4-843-g2c01458a c129f5a2fd4e 624a903fec23 2024-09-13T17:07:18.061 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi195 smithi195 running (8m) 39s ago 8m 6891k - 18.2.4-843-g2c01458a c129f5a2fd4e 42e6ce26130d 2024-09-13T17:07:18.061 INFO:teuthology.orchestra.run.smithi115.stdout:grafana.smithi115 smithi115 *:3000 running (7m) 36s ago 9m 86.7M - 9.4.7 954c08fa6188 41183f0705c8 2024-09-13T17:07:18.061 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi115.hbtxod smithi115 running (3m) 36s ago 3m 152M - 18.2.4-843-g2c01458a c129f5a2fd4e 12b4f4874491 2024-09-13T17:07:18.061 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi115.ijznvr smithi115 running (3m) 36s ago 3m 244M - 18.2.4-843-g2c01458a c129f5a2fd4e 2d552564a9f4 2024-09-13T17:07:18.061 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi195.aevvgz smithi195 running (3m) 39s ago 3m 15.6M - 18.2.4-843-g2c01458a c129f5a2fd4e 299b9ad657c9 2024-09-13T17:07:18.061 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi195.qzghxj smithi195 running (3m) 39s ago 3m 13.7M - 18.2.4-843-g2c01458a c129f5a2fd4e fb16b16181ff 2024-09-13T17:07:18.061 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi115.hetcni smithi115 *:8443,9283,8765 running (54s) 36s ago 10m 457M - 18.2.4-860-g6c6b083f 8a91f241d7d4 b945dbde1934 2024-09-13T17:07:18.062 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi195.hjjifz smithi195 *:8443,9283,8765 running (2m) 39s ago 8m 96.5M - 18.2.4-860-g6c6b083f 8a91f241d7d4 efed836fb2b0 2024-09-13T17:07:18.062 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi115 smithi115 running (10m) 36s ago 10m 51.4M 2048M 18.2.4-843-g2c01458a c129f5a2fd4e 202375d41e68 2024-09-13T17:07:18.062 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi195 smithi195 running (8m) 39s ago 8m 40.5M 2048M 18.2.4-843-g2c01458a c129f5a2fd4e 0f54c30e5970 2024-09-13T17:07:18.062 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi115 smithi115 *:9100 running (9m) 36s ago 9m 15.8M - 1.5.0 0da6a335fe13 9074300dbe31 2024-09-13T17:07:18.062 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi195 smithi195 *:9100 running (8m) 39s ago 8m 15.3M - 1.5.0 0da6a335fe13 d7b54e5d8c97 2024-09-13T17:07:18.062 INFO:teuthology.orchestra.run.smithi115.stdout:osd.0 smithi115 running (7m) 36s ago 7m 193M 1216M 18.2.4-843-g2c01458a c129f5a2fd4e 8a8ad231962e 2024-09-13T17:07:18.062 INFO:teuthology.orchestra.run.smithi115.stdout:osd.1 smithi115 running (7m) 36s ago 7m 217M 1216M 18.2.4-843-g2c01458a c129f5a2fd4e 3fbc020102a0 2024-09-13T17:07:18.062 INFO:teuthology.orchestra.run.smithi115.stdout:osd.2 smithi115 running (6m) 36s ago 6m 184M 1216M 18.2.4-843-g2c01458a c129f5a2fd4e 7c623823e920 2024-09-13T17:07:18.062 INFO:teuthology.orchestra.run.smithi115.stdout:osd.3 smithi195 running (6m) 39s ago 6m 246M 2240M 18.2.4-843-g2c01458a c129f5a2fd4e 10ea833fd5c5 2024-09-13T17:07:18.062 INFO:teuthology.orchestra.run.smithi115.stdout:osd.4 smithi195 running (5m) 39s ago 5m 217M 2240M 18.2.4-843-g2c01458a c129f5a2fd4e 4bbc3acb9aff 2024-09-13T17:07:18.062 INFO:teuthology.orchestra.run.smithi115.stdout:osd.5 smithi195 running (5m) 39s ago 5m 203M 2240M 18.2.4-843-g2c01458a c129f5a2fd4e 4bd1b3a232d0 2024-09-13T17:07:18.062 INFO:teuthology.orchestra.run.smithi115.stdout:prometheus.smithi115 smithi115 *:9095 starting - - - - 2024-09-13T17:07:18.065 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.064+0000 7f60267fc640 1 -- 172.21.15.115:0/169006475 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f601c06cd90 msgr2=0x7f601c06f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:18.065 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.064+0000 7f60267fc640 1 --2- 172.21.15.115:0/169006475 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f601c06cd90 0x7f601c06f250 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6020000c00 tx=0x7f6020031400 comp rx=0 tx=0).stop 2024-09-13T17:07:18.065 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.064+0000 7f60267fc640 1 -- 172.21.15.115:0/169006475 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6030102f90 msgr2=0x7f6030197c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:18.065 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.064+0000 7f60267fc640 1 --2- 172.21.15.115:0/169006475 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6030102f90 0x7f6030197c60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f601800e970 tx=0x7f601800ee30 comp rx=0 tx=0).stop 2024-09-13T17:07:18.066 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.064+0000 7f60267fc640 1 -- 172.21.15.115:0/169006475 shutdown_connections 2024-09-13T17:07:18.066 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.064+0000 7f60267fc640 1 --2- 172.21.15.115:0/169006475 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f601c06cd90 0x7f601c06f250 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:18.066 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.064+0000 7f60267fc640 1 --2- 172.21.15.115:0/169006475 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6030102f90 0x7f6030197c60 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:18.066 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.064+0000 7f60267fc640 1 --2- 172.21.15.115:0/169006475 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6030101d90 0x7f6030197720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:18.066 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.064+0000 7f60267fc640 1 -- 172.21.15.115:0/169006475 >> 172.21.15.115:0/169006475 conn(0x7f60300fd540 msgr2=0x7f60301061c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:18.066 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.065+0000 7f60267fc640 1 -- 172.21.15.115:0/169006475 shutdown_connections 2024-09-13T17:07:18.067 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.066+0000 7f60267fc640 1 -- 172.21.15.115:0/169006475 wait complete. 2024-09-13T17:07:18.183 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.176+0000 7fbcc4955640 1 -- 172.21.15.115:0/2541816727 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbcc0100630 msgr2=0x7fbcc0102a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:18.183 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.176+0000 7fbcc4955640 1 --2- 172.21.15.115:0/2541816727 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbcc0100630 0x7fbcc0102a20 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fbcb00098b0 tx=0x7fbcb002a4d0 comp rx=0 tx=0).stop 2024-09-13T17:07:18.183 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.176+0000 7fbcc4955640 1 -- 172.21.15.115:0/2541816727 shutdown_connections 2024-09-13T17:07:18.183 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.176+0000 7fbcc4955640 1 --2- 172.21.15.115:0/2541816727 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbcc0102f60 0x7fbcc0105350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:18.183 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.176+0000 7fbcc4955640 1 --2- 172.21.15.115:0/2541816727 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbcc0100630 0x7fbcc0102a20 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:18.183 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.176+0000 7fbcc4955640 1 -- 172.21.15.115:0/2541816727 >> 172.21.15.115:0/2541816727 conn(0x7fbcc00fa230 msgr2=0x7fbcc00fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:18.183 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.176+0000 7fbcc4955640 1 -- 172.21.15.115:0/2541816727 shutdown_connections 2024-09-13T17:07:18.183 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.176+0000 7fbcc4955640 1 -- 172.21.15.115:0/2541816727 wait complete. 2024-09-13T17:07:18.183 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.177+0000 7fbcc4955640 1 Processor -- start 2024-09-13T17:07:18.183 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.177+0000 7fbcc4955640 1 -- start start 2024-09-13T17:07:18.184 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.178+0000 7fbcc4955640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbcc0100630 0x7fbcc00fff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:18.184 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.178+0000 7fbcc4955640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbcc0102f60 0x7fbcc00fe5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:18.184 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.178+0000 7fbcc4955640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc00feb20 con 0x7fbcc0100630 2024-09-13T17:07:18.184 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.178+0000 7fbcc4955640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc00fec90 con 0x7fbcc0102f60 2024-09-13T17:07:18.184 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.178+0000 7fbcbe59c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbcc0100630 0x7fbcc00fff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:18.184 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.178+0000 7fbcbe59c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbcc0100630 0x7fbcc00fff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52434/0 (socket says 172.21.15.115:52434) 2024-09-13T17:07:18.184 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.178+0000 7fbcbe59c640 1 -- 172.21.15.115:0/4124708862 learned_addr learned my addr 172.21.15.115:0/4124708862 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:07:18.184 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.178+0000 7fbcbdd9b640 1 --2- 172.21.15.115:0/4124708862 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbcc0102f60 0x7fbcc00fe5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:18.184 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.178+0000 7fbcbdd9b640 1 -- 172.21.15.115:0/4124708862 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbcc0100630 msgr2=0x7fbcc00fff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:18.184 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.178+0000 7fbcbdd9b640 1 --2- 172.21.15.115:0/4124708862 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbcc0100630 0x7fbcc00fff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:18.184 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.178+0000 7fbcbdd9b640 1 -- 172.21.15.115:0/4124708862 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcb0009560 con 0x7fbcc0102f60 2024-09-13T17:07:18.184 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.178+0000 7fbcbe59c640 1 --2- 172.21.15.115:0/4124708862 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbcc0100630 0x7fbcc00fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:07:18.185 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.178+0000 7fbcbdd9b640 1 --2- 172.21.15.115:0/4124708862 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbcc0102f60 0x7fbcc00fe5e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbcb400e940 tx=0x7fbcb400ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:18.185 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.179+0000 7fbcaf7fe640 1 -- 172.21.15.115:0/4124708862 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbcb4009620 con 0x7fbcc0102f60 2024-09-13T17:07:18.185 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.179+0000 7fbcc4955640 1 -- 172.21.15.115:0/4124708862 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcc00fef70 con 0x7fbcc0102f60 2024-09-13T17:07:18.185 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.179+0000 7fbcaf7fe640 1 -- 172.21.15.115:0/4124708862 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbcb40044d0 con 0x7fbcc0102f60 2024-09-13T17:07:18.185 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.179+0000 7fbcaf7fe640 1 -- 172.21.15.115:0/4124708862 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbcb4004800 con 0x7fbcc0102f60 2024-09-13T17:07:18.185 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.179+0000 7fbcc4955640 1 -- 172.21.15.115:0/4124708862 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcc019d5e0 con 0x7fbcc0102f60 2024-09-13T17:07:18.185 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.180+0000 7fbcc4955640 1 -- 172.21.15.115:0/4124708862 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcc0100a10 con 0x7fbcc0102f60 2024-09-13T17:07:18.185 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.180+0000 7fbcaf7fe640 1 -- 172.21.15.115:0/4124708862 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 29) v1 ==== 90954+0+0 (secure 0 0 0) 0x7fbcb4004030 con 0x7fbcc0102f60 2024-09-13T17:07:18.185 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.181+0000 7fbcaf7fe640 1 --2- 172.21.15.115:0/4124708862 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fbca806cd90 0x7fbca806f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:18.185 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.181+0000 7fbcaf7fe640 1 -- 172.21.15.115:0/4124708862 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fbcb4014070 con 0x7fbcc0102f60 2024-09-13T17:07:18.185 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.181+0000 7fbcbe59c640 1 --2- 172.21.15.115:0/4124708862 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fbca806cd90 0x7fbca806f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:18.185 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.181+0000 7fbcbe59c640 1 --2- 172.21.15.115:0/4124708862 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fbca806cd90 0x7fbca806f250 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fbcb0006010 tx=0x7fbcb0005d50 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:18.186 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.185+0000 7fbcaf7fe640 1 -- 172.21.15.115:0/4124708862 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fbcb4056990 con 0x7fbcc0102f60 2024-09-13T17:07:18.190 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:18 smithi195 ceph-mon[34981]: from='client.24443 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:07:18.190 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:18 smithi195 ceph-mon[34981]: pgmap v24: 65 pgs: 65 active+clean; 250 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.4 MiB/s wr, 1.11k op/s 2024-09-13T17:07:18.190 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:18 smithi195 ceph-mon[34981]: from='client.14714 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:07:18.428 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:18 smithi115 ceph-mon[27708]: from='client.24443 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:07:18.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:18 smithi115 ceph-mon[27708]: pgmap v24: 65 pgs: 65 active+clean; 250 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.4 MiB/s wr, 1.11k op/s 2024-09-13T17:07:18.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:18 smithi115 ceph-mon[27708]: from='client.14714 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:07:18.469 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.467+0000 7fbcc4955640 1 -- 172.21.15.115:0/4124708862 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fbcc01086a0 con 0x7fbcc0102f60 2024-09-13T17:07:18.469 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.468+0000 7fbcaf7fe640 1 -- 172.21.15.115:0/4124708862 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+733 (secure 0 0 0) 0x7fbcb4059fb0 con 0x7fbcc0102f60 2024-09-13T17:07:18.469 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-13T17:07:18.469 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": { 2024-09-13T17:07:18.470 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-843-g2c01458a (2c01458affee2b2435cd231b6e392435c1c21661) reef (stable)": 2 2024-09-13T17:07:18.470 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T17:07:18.470 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": { 2024-09-13T17:07:18.470 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 2 2024-09-13T17:07:18.470 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T17:07:18.470 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": { 2024-09-13T17:07:18.470 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-843-g2c01458a (2c01458affee2b2435cd231b6e392435c1c21661) reef (stable)": 6 2024-09-13T17:07:18.470 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T17:07:18.470 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": { 2024-09-13T17:07:18.470 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-843-g2c01458a (2c01458affee2b2435cd231b6e392435c1c21661) reef (stable)": 4 2024-09-13T17:07:18.470 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T17:07:18.470 INFO:teuthology.orchestra.run.smithi115.stdout: "overall": { 2024-09-13T17:07:18.470 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-843-g2c01458a (2c01458affee2b2435cd231b6e392435c1c21661) reef (stable)": 12, 2024-09-13T17:07:18.470 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 2 2024-09-13T17:07:18.470 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-13T17:07:18.471 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-13T17:07:18.472 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.470+0000 7fbcc4955640 1 -- 172.21.15.115:0/4124708862 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fbca806cd90 msgr2=0x7fbca806f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:18.472 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.470+0000 7fbcc4955640 1 --2- 172.21.15.115:0/4124708862 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fbca806cd90 0x7fbca806f250 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fbcb0006010 tx=0x7fbcb0005d50 comp rx=0 tx=0).stop 2024-09-13T17:07:18.472 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.470+0000 7fbcc4955640 1 -- 172.21.15.115:0/4124708862 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbcc0102f60 msgr2=0x7fbcc00fe5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:18.472 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.470+0000 7fbcc4955640 1 --2- 172.21.15.115:0/4124708862 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbcc0102f60 0x7fbcc00fe5e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbcb400e940 tx=0x7fbcb400ee00 comp rx=0 tx=0).stop 2024-09-13T17:07:18.472 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.470+0000 7fbcc4955640 1 -- 172.21.15.115:0/4124708862 shutdown_connections 2024-09-13T17:07:18.472 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.470+0000 7fbcc4955640 1 --2- 172.21.15.115:0/4124708862 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fbca806cd90 0x7fbca806f250 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:18.472 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.470+0000 7fbcc4955640 1 --2- 172.21.15.115:0/4124708862 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbcc0102f60 0x7fbcc00fe5e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:18.473 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.470+0000 7fbcc4955640 1 --2- 172.21.15.115:0/4124708862 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbcc0100630 0x7fbcc00fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:18.473 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.471+0000 7fbcc4955640 1 -- 172.21.15.115:0/4124708862 >> 172.21.15.115:0/4124708862 conn(0x7fbcc00fa230 msgr2=0x7fbcc00fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:18.473 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.471+0000 7fbcc4955640 1 -- 172.21.15.115:0/4124708862 shutdown_connections 2024-09-13T17:07:18.473 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.471+0000 7fbcc4955640 1 -- 172.21.15.115:0/4124708862 wait complete. 2024-09-13T17:07:18.581 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.579+0000 7f0727234640 1 -- 172.21.15.115:0/1039575943 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07200ffc30 msgr2=0x7f07201000b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:18.581 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.579+0000 7f0727234640 1 --2- 172.21.15.115:0/1039575943 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07200ffc30 0x7f07201000b0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f070c009880 tx=0x7f070c02a4a0 comp rx=0 tx=0).stop 2024-09-13T17:07:18.581 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.579+0000 7f0727234640 1 -- 172.21.15.115:0/1039575943 shutdown_connections 2024-09-13T17:07:18.581 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.579+0000 7f0727234640 1 --2- 172.21.15.115:0/1039575943 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07200ffc30 0x7f07201000b0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:18.581 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.579+0000 7f0727234640 1 --2- 172.21.15.115:0/1039575943 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f07200fea30 0x7f07200fee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:18.581 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.579+0000 7f0727234640 1 -- 172.21.15.115:0/1039575943 >> 172.21.15.115:0/1039575943 conn(0x7f07200fa1c0 msgr2=0x7f07200fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:18.581 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.579+0000 7f0727234640 1 -- 172.21.15.115:0/1039575943 shutdown_connections 2024-09-13T17:07:18.581 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.579+0000 7f0727234640 1 -- 172.21.15.115:0/1039575943 wait complete. 2024-09-13T17:07:18.583 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.580+0000 7f0727234640 1 Processor -- start 2024-09-13T17:07:18.583 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.580+0000 7f0727234640 1 -- start start 2024-09-13T17:07:18.583 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.580+0000 7f0727234640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f07200fea30 0x7f0720195540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:18.583 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.580+0000 7f0727234640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07200ffc30 0x7f0720195a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:18.583 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.580+0000 7f0727234640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0720196050 con 0x7f07200ffc30 2024-09-13T17:07:18.583 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.580+0000 7f0727234640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07201961c0 con 0x7f07200fea30 2024-09-13T17:07:18.583 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.581+0000 7f0724fd0640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f07200fea30 0x7f0720195540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:18.583 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.581+0000 7f0724fd0640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f07200fea30 0x7f0720195540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.115:55414/0 (socket says 172.21.15.115:55414) 2024-09-13T17:07:18.583 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.581+0000 7f0724fd0640 1 -- 172.21.15.115:0/2244253465 learned_addr learned my addr 172.21.15.115:0/2244253465 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:07:18.583 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.581+0000 7f071ffff640 1 --2- 172.21.15.115:0/2244253465 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07200ffc30 0x7f0720195a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:18.583 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.581+0000 7f0724fd0640 1 -- 172.21.15.115:0/2244253465 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07200ffc30 msgr2=0x7f0720195a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:18.584 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.581+0000 7f0724fd0640 1 --2- 172.21.15.115:0/2244253465 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07200ffc30 0x7f0720195a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:18.584 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.581+0000 7f0724fd0640 1 -- 172.21.15.115:0/2244253465 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f070c009560 con 0x7f07200fea30 2024-09-13T17:07:18.584 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.581+0000 7f0724fd0640 1 --2- 172.21.15.115:0/2244253465 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f07200fea30 0x7f0720195540 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f071400e940 tx=0x7f071400ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:18.584 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.581+0000 7f071dffb640 1 -- 172.21.15.115:0/2244253465 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0714009700 con 0x7f07200fea30 2024-09-13T17:07:18.584 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.581+0000 7f071dffb640 1 -- 172.21.15.115:0/2244253465 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f07140044c0 con 0x7f07200fea30 2024-09-13T17:07:18.584 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.581+0000 7f071dffb640 1 -- 172.21.15.115:0/2244253465 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0714010430 con 0x7f07200fea30 2024-09-13T17:07:18.584 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.581+0000 7f0727234640 1 -- 172.21.15.115:0/2244253465 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f072019ac60 con 0x7f07200fea30 2024-09-13T17:07:18.584 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.582+0000 7f0727234640 1 -- 172.21.15.115:0/2244253465 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f072019b1b0 con 0x7f07200fea30 2024-09-13T17:07:18.585 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.583+0000 7f0727234640 1 -- 172.21.15.115:0/2244253465 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07201074e0 con 0x7f07200fea30 2024-09-13T17:07:18.585 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.583+0000 7f071dffb640 1 -- 172.21.15.115:0/2244253465 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 29) v1 ==== 90954+0+0 (secure 0 0 0) 0x7f071400cc90 con 0x7f07200fea30 2024-09-13T17:07:18.585 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.583+0000 7f071dffb640 1 --2- 172.21.15.115:0/2244253465 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f071006cd90 0x7f071006f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:18.585 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.584+0000 7f071dffb640 1 -- 172.21.15.115:0/2244253465 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f0714014070 con 0x7f07200fea30 2024-09-13T17:07:18.585 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.584+0000 7f071ffff640 1 --2- 172.21.15.115:0/2244253465 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f071006cd90 0x7f071006f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:18.585 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.584+0000 7f071ffff640 1 --2- 172.21.15.115:0/2244253465 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f071006cd90 0x7f071006f250 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0720196a60 tx=0x7f070c031400 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:18.589 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.588+0000 7f071dffb640 1 -- 172.21.15.115:0/2244253465 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f0714056ac0 con 0x7f07200fea30 2024-09-13T17:07:18.820 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.819+0000 7f0727234640 1 -- 172.21.15.115:0/2244253465 --> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f07200682f0 con 0x7f071006cd90 2024-09-13T17:07:18.821 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.820+0000 7f071dffb640 1 -- 172.21.15.115:0/2244253465 <== mgr.14660 v2:172.21.15.115:6800/1049502673 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7f07200682f0 con 0x7f071006cd90 2024-09-13T17:07:18.822 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-13T17:07:18.822 INFO:teuthology.orchestra.run.smithi115.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256", 2024-09-13T17:07:18.822 INFO:teuthology.orchestra.run.smithi115.stdout: "in_progress": true, 2024-09-13T17:07:18.822 INFO:teuthology.orchestra.run.smithi115.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-13T17:07:18.822 INFO:teuthology.orchestra.run.smithi115.stdout: "services_complete": [ 2024-09-13T17:07:18.822 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr" 2024-09-13T17:07:18.822 INFO:teuthology.orchestra.run.smithi115.stdout: ], 2024-09-13T17:07:18.822 INFO:teuthology.orchestra.run.smithi115.stdout: "progress": "2/2 daemons upgraded", 2024-09-13T17:07:18.822 INFO:teuthology.orchestra.run.smithi115.stdout: "message": "Currently upgrading mgr daemons", 2024-09-13T17:07:18.822 INFO:teuthology.orchestra.run.smithi115.stdout: "is_paused": false 2024-09-13T17:07:18.822 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-13T17:07:18.825 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.823+0000 7f0727234640 1 -- 172.21.15.115:0/2244253465 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f071006cd90 msgr2=0x7f071006f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:18.825 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.823+0000 7f0727234640 1 --2- 172.21.15.115:0/2244253465 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f071006cd90 0x7f071006f250 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0720196a60 tx=0x7f070c031400 comp rx=0 tx=0).stop 2024-09-13T17:07:18.825 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.823+0000 7f0727234640 1 -- 172.21.15.115:0/2244253465 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f07200fea30 msgr2=0x7f0720195540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:18.825 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.823+0000 7f0727234640 1 --2- 172.21.15.115:0/2244253465 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f07200fea30 0x7f0720195540 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f071400e940 tx=0x7f071400ee00 comp rx=0 tx=0).stop 2024-09-13T17:07:18.825 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.823+0000 7f0727234640 1 -- 172.21.15.115:0/2244253465 shutdown_connections 2024-09-13T17:07:18.825 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.823+0000 7f0727234640 1 --2- 172.21.15.115:0/2244253465 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f071006cd90 0x7f071006f250 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:18.825 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.823+0000 7f0727234640 1 --2- 172.21.15.115:0/2244253465 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07200ffc30 0x7f0720195a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:18.826 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.823+0000 7f0727234640 1 --2- 172.21.15.115:0/2244253465 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f07200fea30 0x7f0720195540 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:18.826 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.823+0000 7f0727234640 1 -- 172.21.15.115:0/2244253465 >> 172.21.15.115:0/2244253465 conn(0x7f07200fa1c0 msgr2=0x7f0720067be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:18.826 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.824+0000 7f0727234640 1 -- 172.21.15.115:0/2244253465 shutdown_connections 2024-09-13T17:07:18.826 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:18.824+0000 7f0727234640 1 -- 172.21.15.115:0/2244253465 wait complete. 2024-09-13T17:07:19.076 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:19 smithi195 ceph-mon[34981]: from='client.24449 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:07:19.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:19 smithi195 ceph-mon[34981]: from='client.? 172.21.15.115:0/4124708862' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:07:19.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:19 smithi195 ceph-mon[34981]: from='client.24457 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:07:19.178 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:19 smithi115 ceph-mon[27708]: from='client.24449 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:07:19.178 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:19 smithi115 ceph-mon[27708]: from='client.? 172.21.15.115:0/4124708862' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:07:19.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:19 smithi115 ceph-mon[27708]: from='client.24457 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:07:20.182 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:20 smithi195 ceph-mon[34981]: pgmap v25: 65 pgs: 65 active+clean; 250 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 731 op/s 2024-09-13T17:07:20.428 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:20 smithi115 ceph-mon[27708]: pgmap v25: 65 pgs: 65 active+clean; 250 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 731 op/s 2024-09-13T17:07:20.681 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2024-09-13T17:07:20.682 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-09-13T17:07:20.991 DEBUG:teuthology.parallel:result is None 2024-09-13T17:07:21.305 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:21 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:21.305 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:21 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:21.305 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:21 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:07:21.305 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:21 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:21.306 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:21 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:21.306 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:21 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:07:21.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:21 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:21.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:21 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:21.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:21 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:07:21.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:21 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:21.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:21 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:21.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:21 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:07:22.291 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:22 smithi195 ceph-mon[34981]: pgmap v26: 65 pgs: 65 active+clean; 250 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 731 op/s 2024-09-13T17:07:22.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:22 smithi115 ceph-mon[27708]: pgmap v26: 65 pgs: 65 active+clean; 250 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 731 op/s 2024-09-13T17:07:24.488 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:24 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:24.488 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:24 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:24.488 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:24 smithi195 ceph-mon[34981]: pgmap v27: 65 pgs: 65 active+clean; 237 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.3 MiB/s wr, 961 op/s 2024-09-13T17:07:24.488 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:24 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:24.488 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:24 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:24.510 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:24 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:24.510 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:24 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:24.510 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:24 smithi115 ceph-mon[27708]: pgmap v27: 65 pgs: 65 active+clean; 237 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.3 MiB/s wr, 961 op/s 2024-09-13T17:07:24.510 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:24 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:24.511 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:24 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:26.576 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:26 smithi195 ceph-mon[34981]: pgmap v28: 65 pgs: 65 active+clean; 237 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 532 op/s 2024-09-13T17:07:26.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:26 smithi195 ceph-mon[34981]: Standby manager daemon smithi195.hjjifz restarted 2024-09-13T17:07:26.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:26 smithi195 ceph-mon[34981]: Standby manager daemon smithi195.hjjifz started 2024-09-13T17:07:26.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:26 smithi195 ceph-mon[34981]: from='mgr.? 172.21.15.195:0/2965330030' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi195.hjjifz/crt"}]: dispatch 2024-09-13T17:07:26.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:26 smithi195 ceph-mon[34981]: from='mgr.? 172.21.15.195:0/2965330030' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T17:07:26.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:26 smithi195 ceph-mon[34981]: from='mgr.? 172.21.15.195:0/2965330030' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi195.hjjifz/key"}]: dispatch 2024-09-13T17:07:26.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:26 smithi195 ceph-mon[34981]: from='mgr.? 172.21.15.195:0/2965330030' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T17:07:26.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:26 smithi115 ceph-mon[27708]: pgmap v28: 65 pgs: 65 active+clean; 237 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 532 op/s 2024-09-13T17:07:26.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:26 smithi115 ceph-mon[27708]: Standby manager daemon smithi195.hjjifz restarted 2024-09-13T17:07:26.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:26 smithi115 ceph-mon[27708]: Standby manager daemon smithi195.hjjifz started 2024-09-13T17:07:26.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:26 smithi115 ceph-mon[27708]: from='mgr.? 172.21.15.195:0/2965330030' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi195.hjjifz/crt"}]: dispatch 2024-09-13T17:07:26.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:26 smithi115 ceph-mon[27708]: from='mgr.? 172.21.15.195:0/2965330030' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T17:07:26.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:26 smithi115 ceph-mon[27708]: from='mgr.? 172.21.15.195:0/2965330030' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi195.hjjifz/key"}]: dispatch 2024-09-13T17:07:26.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:26 smithi115 ceph-mon[27708]: from='mgr.? 172.21.15.195:0/2965330030' entity='mgr.smithi195.hjjifz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T17:07:27.774 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:27 smithi115 ceph-mon[27708]: mgrmap e30: smithi115.hetcni(active, since 51s), standbys: smithi195.hjjifz 2024-09-13T17:07:27.774 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:27 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:27.774 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:27 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:27.774 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:27 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:27.774 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:27 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:27.774 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:27 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:07:27.774 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:27 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:07:27.774 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:27 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:27.774 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:27 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:07:27.775 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:27 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:07:27.775 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:27 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:27.775 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:27 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi115.hetcni"}]: dispatch 2024-09-13T17:07:27.775 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:27 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi115.hetcni"}]': finished 2024-09-13T17:07:27.775 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:27 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi195.hjjifz"}]: dispatch 2024-09-13T17:07:27.775 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:27 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi195.hjjifz"}]': finished 2024-09-13T17:07:27.775 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:27 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:07:27.775 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:27 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:27.775 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:27 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:07:27.775 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:27 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:27.775 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:27 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:07:27.775 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:27 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:27.775 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:27 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:07:27.776 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:27 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:27.776 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:27 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:07:27.776 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:27 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:27.776 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:27 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:07:27.776 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:27 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:27.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:27 smithi195 ceph-mon[34981]: mgrmap e30: smithi115.hetcni(active, since 51s), standbys: smithi195.hjjifz 2024-09-13T17:07:27.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:27 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:27.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:27 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:27.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:27 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:27.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:27 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:27.828 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:27 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:07:27.828 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:27 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:07:27.828 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:27 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:27.828 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:27 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:07:27.828 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:27 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:07:27.828 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:27 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:27.828 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:27 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi115.hetcni"}]: dispatch 2024-09-13T17:07:27.828 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:27 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi115.hetcni"}]': finished 2024-09-13T17:07:27.828 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:27 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi195.hjjifz"}]: dispatch 2024-09-13T17:07:27.828 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:27 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi195.hjjifz"}]': finished 2024-09-13T17:07:27.828 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:27 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:07:27.829 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:27 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:27.829 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:27 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:07:27.829 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:27 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:27.829 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:27 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:07:27.829 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:27 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:27.829 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:27 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:07:27.829 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:27 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:27.829 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:27 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:07:27.829 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:27 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:27.829 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:27 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:07:27.829 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:27 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:28.797 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:28 smithi115 ceph-mon[27708]: Upgrade: Setting container_image for all mgr 2024-09-13T17:07:28.797 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:28 smithi115 ceph-mon[27708]: Upgrade: Setting container_image for all rgw 2024-09-13T17:07:28.797 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:28 smithi115 ceph-mon[27708]: Upgrade: Setting container_image for all rbd-mirror 2024-09-13T17:07:28.797 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:28 smithi115 ceph-mon[27708]: Upgrade: Setting container_image for all cephfs-mirror 2024-09-13T17:07:28.797 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:28 smithi115 ceph-mon[27708]: pgmap v29: 65 pgs: 65 active+clean; 223 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.3 MiB/s wr, 728 op/s 2024-09-13T17:07:28.797 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:28 smithi115 ceph-mon[27708]: Upgrade: Setting container_image for all iscsi 2024-09-13T17:07:28.797 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:28 smithi115 ceph-mon[27708]: Upgrade: Setting container_image for all nfs 2024-09-13T17:07:28.798 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:28 smithi115 ceph-mon[27708]: Upgrade: Setting container_image for all nvmeof 2024-09-13T17:07:28.821 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-09-13T17:07:28.822 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-13T17:07:28.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:28 smithi195 ceph-mon[34981]: Upgrade: Setting container_image for all mgr 2024-09-13T17:07:28.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:28 smithi195 ceph-mon[34981]: Upgrade: Setting container_image for all rgw 2024-09-13T17:07:28.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:28 smithi195 ceph-mon[34981]: Upgrade: Setting container_image for all rbd-mirror 2024-09-13T17:07:28.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:28 smithi195 ceph-mon[34981]: Upgrade: Setting container_image for all cephfs-mirror 2024-09-13T17:07:28.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:28 smithi195 ceph-mon[34981]: pgmap v29: 65 pgs: 65 active+clean; 223 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.3 MiB/s wr, 728 op/s 2024-09-13T17:07:28.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:28 smithi195 ceph-mon[34981]: Upgrade: Setting container_image for all iscsi 2024-09-13T17:07:28.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:28 smithi195 ceph-mon[34981]: Upgrade: Setting container_image for all nfs 2024-09-13T17:07:28.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:28 smithi195 ceph-mon[34981]: Upgrade: Setting container_image for all nvmeof 2024-09-13T17:07:29.171 DEBUG:teuthology.parallel:result is None 2024-09-13T17:07:29.172 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-13T17:07:29.203 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-13T17:07:29.204 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-09-13T17:07:29.234 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-09-13T17:07:29.234 DEBUG:teuthology.parallel:result is None 2024-09-13T17:07:30.631 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:30 smithi115 ceph-mon[27708]: Upgrade: Updating node-exporter.smithi115 (1/2) 2024-09-13T17:07:30.631 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:30 smithi115 ceph-mon[27708]: Deploying daemon node-exporter.smithi115 on smithi115 2024-09-13T17:07:30.631 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:30 smithi115 ceph-mon[27708]: pgmap v30: 65 pgs: 65 active+clean; 223 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 426 op/s 2024-09-13T17:07:30.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:30 smithi195 ceph-mon[34981]: Upgrade: Updating node-exporter.smithi115 (1/2) 2024-09-13T17:07:30.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:30 smithi195 ceph-mon[34981]: Deploying daemon node-exporter.smithi115 on smithi115 2024-09-13T17:07:30.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:30 smithi195 ceph-mon[34981]: pgmap v30: 65 pgs: 65 active+clean; 223 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 426 op/s 2024-09-13T17:07:32.790 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:32 smithi115 ceph-mon[27708]: pgmap v31: 65 pgs: 65 active+clean; 223 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 426 op/s 2024-09-13T17:07:32.790 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:32 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:32.790 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:32 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:32.808 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:32 smithi195 ceph-mon[34981]: pgmap v31: 65 pgs: 65 active+clean; 223 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 426 op/s 2024-09-13T17:07:32.808 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:32 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:32.809 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:32 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:33.785 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:33 smithi195 ceph-mon[34981]: Upgrade: Updating node-exporter.smithi195 (2/2) 2024-09-13T17:07:33.785 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:33 smithi195 ceph-mon[34981]: Deploying daemon node-exporter.smithi195 on smithi195 2024-09-13T17:07:33.795 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:33 smithi115 ceph-mon[27708]: Upgrade: Updating node-exporter.smithi195 (2/2) 2024-09-13T17:07:33.796 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:33 smithi115 ceph-mon[27708]: Deploying daemon node-exporter.smithi195 on smithi195 2024-09-13T17:07:34.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:34 smithi195 ceph-mon[34981]: pgmap v32: 65 pgs: 65 active+clean; 203 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 540 op/s 2024-09-13T17:07:34.928 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:34 smithi115 ceph-mon[27708]: pgmap v32: 65 pgs: 65 active+clean; 203 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 540 op/s 2024-09-13T17:07:36.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:36 smithi195 ceph-mon[34981]: pgmap v33: 65 pgs: 65 active+clean; 203 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 310 op/s 2024-09-13T17:07:36.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:36 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:07:36.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:36 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:36.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:36 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:36.828 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:36 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:07:36.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:36 smithi115 ceph-mon[27708]: pgmap v33: 65 pgs: 65 active+clean; 203 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 310 op/s 2024-09-13T17:07:36.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:36 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:07:36.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:36 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:36.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:36 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:36.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:36 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:07:38.591 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:38 smithi115 ceph-mon[27708]: pgmap v34: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 317 op/s 2024-09-13T17:07:38.591 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:38 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:38.591 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:38 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:38.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:38 smithi195 ceph-mon[34981]: pgmap v34: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 317 op/s 2024-09-13T17:07:38.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:38 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:38.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:38 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:40.178 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:40 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:40.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:40 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:40.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:40 smithi115 ceph-mon[27708]: pgmap v35: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 470 KiB/s rd, 415 KiB/s wr, 121 op/s 2024-09-13T17:07:40.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:40 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:40.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:40 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:40.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:40 smithi195 ceph-mon[34981]: pgmap v35: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 470 KiB/s rd, 415 KiB/s wr, 121 op/s 2024-09-13T17:07:41.681 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:41 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:41.682 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:41 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:41.682 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:41 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:41.682 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:41 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:41.787 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:41 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:41.787 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:41 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:41.787 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:41 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:41.787 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:41 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:42.709 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:42 smithi115 ceph-mon[27708]: pgmap v36: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 470 KiB/s rd, 415 KiB/s wr, 121 op/s 2024-09-13T17:07:42.709 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:42 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:42.709 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:42 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:43.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:42 smithi195 ceph-mon[34981]: pgmap v36: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 470 KiB/s rd, 415 KiB/s wr, 121 op/s 2024-09-13T17:07:43.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:42 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:43.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:42 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:44.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:44 smithi115 ceph-mon[27708]: pgmap v37: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 471 KiB/s rd, 415 KiB/s wr, 122 op/s 2024-09-13T17:07:44.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:44 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:44.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:44 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:44.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:44 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:07:44.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:44 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:07:44.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:44 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:44.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:44 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:07:44.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:44 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:07:44.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:44 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:07:44.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:44 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:07:44.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:44 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:07:44.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:44 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:07:44.680 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:44 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:07:44.680 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:44 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:07:44.680 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:44 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:07:45.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:44 smithi195 ceph-mon[34981]: pgmap v37: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 471 KiB/s rd, 415 KiB/s wr, 122 op/s 2024-09-13T17:07:45.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:44 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:45.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:44 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:45.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:44 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:07:45.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:44 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:07:45.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:44 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:45.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:44 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:07:45.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:44 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:07:45.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:44 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:07:45.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:44 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:07:45.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:44 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:07:45.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:44 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:07:45.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:44 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:07:45.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:44 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:07:45.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:44 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:07:46.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:46 smithi195 ceph-mon[34981]: pgmap v38: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 4.6 KiB/s rd, 4.2 KiB/s wr, 8 op/s 2024-09-13T17:07:46.834 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:46 smithi115 ceph-mon[27708]: pgmap v38: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 4.6 KiB/s rd, 4.2 KiB/s wr, 8 op/s 2024-09-13T17:07:47.906 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:47 smithi115 ceph-mon[27708]: Upgrade: Updating prometheus.smithi115 2024-09-13T17:07:47.907 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:47 smithi115 ceph-mon[27708]: Deploying daemon prometheus.smithi115 on smithi115 2024-09-13T17:07:48.076 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:47 smithi195 ceph-mon[34981]: Upgrade: Updating prometheus.smithi115 2024-09-13T17:07:48.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:47 smithi195 ceph-mon[34981]: Deploying daemon prometheus.smithi115 on smithi115 2024-09-13T17:07:48.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:48 smithi195 ceph-mon[34981]: pgmap v39: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 5.0 KiB/s rd, 4.2 KiB/s wr, 8 op/s 2024-09-13T17:07:48.897 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:48 smithi115 ceph-mon[27708]: pgmap v39: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 5.0 KiB/s rd, 4.2 KiB/s wr, 8 op/s 2024-09-13T17:07:48.918 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:48.917+0000 7f2dcb522640 1 -- 172.21.15.115:0/382588577 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2dc40fea30 msgr2=0x7f2dc40fee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:48.919 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:48.917+0000 7f2dcb522640 1 --2- 172.21.15.115:0/382588577 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2dc40fea30 0x7f2dc40fee30 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f2dc0009880 tx=0x7f2dc002a4a0 comp rx=0 tx=0).stop 2024-09-13T17:07:48.919 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:48.917+0000 7f2dcb522640 1 -- 172.21.15.115:0/382588577 shutdown_connections 2024-09-13T17:07:48.919 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:48.917+0000 7f2dcb522640 1 --2- 172.21.15.115:0/382588577 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2dc40ffc30 0x7f2dc41000b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:48.919 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:48.917+0000 7f2dcb522640 1 --2- 172.21.15.115:0/382588577 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2dc40fea30 0x7f2dc40fee30 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:48.919 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:48.917+0000 7f2dcb522640 1 -- 172.21.15.115:0/382588577 >> 172.21.15.115:0/382588577 conn(0x7f2dc40fa1c0 msgr2=0x7f2dc40fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:48.919 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:48.917+0000 7f2dcb522640 1 -- 172.21.15.115:0/382588577 shutdown_connections 2024-09-13T17:07:48.919 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:48.917+0000 7f2dcb522640 1 -- 172.21.15.115:0/382588577 wait complete. 2024-09-13T17:07:48.921 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:48.918+0000 7f2dcb522640 1 Processor -- start 2024-09-13T17:07:48.921 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:48.918+0000 7f2dcb522640 1 -- start start 2024-09-13T17:07:48.921 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:48.918+0000 7f2dcb522640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2dc40fea30 0x7f2dc4068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:48.921 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:48.918+0000 7f2dcb522640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2dc40ffc30 0x7f2dc419a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:48.921 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:48.919+0000 7f2dcb522640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc419a8a0 con 0x7f2dc40ffc30 2024-09-13T17:07:48.921 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:48.919+0000 7f2dcb522640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc419a9e0 con 0x7f2dc40fea30 2024-09-13T17:07:48.921 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:48.919+0000 7f2dc8abd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2dc40ffc30 0x7f2dc419a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:48.921 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:48.919+0000 7f2dc8abd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2dc40ffc30 0x7f2dc419a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:58316/0 (socket says 172.21.15.115:58316) 2024-09-13T17:07:48.921 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:48.919+0000 7f2dc8abd640 1 -- 172.21.15.115:0/2607469651 learned_addr learned my addr 172.21.15.115:0/2607469651 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:07:48.921 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:48.919+0000 7f2dc92be640 1 --2- 172.21.15.115:0/2607469651 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2dc40fea30 0x7f2dc4068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:48.921 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:48.919+0000 7f2dc8abd640 1 -- 172.21.15.115:0/2607469651 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2dc40fea30 msgr2=0x7f2dc4068740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:48.921 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:48.919+0000 7f2dc8abd640 1 --2- 172.21.15.115:0/2607469651 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2dc40fea30 0x7f2dc4068740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:48.921 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:48.919+0000 7f2dc8abd640 1 -- 172.21.15.115:0/2607469651 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dc0009560 con 0x7f2dc40ffc30 2024-09-13T17:07:48.922 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:48.919+0000 7f2dc8abd640 1 --2- 172.21.15.115:0/2607469651 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2dc40ffc30 0x7f2dc419a2d0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f2db400d6f0 tx=0x7f2db400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:48.922 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:48.919+0000 7f2dba7fc640 1 -- 172.21.15.115:0/2607469651 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2db4009a30 con 0x7f2dc40ffc30 2024-09-13T17:07:48.922 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:48.920+0000 7f2dcb522640 1 -- 172.21.15.115:0/2607469651 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dc419ac90 con 0x7f2dc40ffc30 2024-09-13T17:07:48.922 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:48.920+0000 7f2dba7fc640 1 -- 172.21.15.115:0/2607469651 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2db40054c0 con 0x7f2dc40ffc30 2024-09-13T17:07:48.922 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:48.920+0000 7f2dba7fc640 1 -- 172.21.15.115:0/2607469651 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2db4004db0 con 0x7f2dc40ffc30 2024-09-13T17:07:48.922 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:48.920+0000 7f2dcb522640 1 -- 172.21.15.115:0/2607469651 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dc419b260 con 0x7f2dc40ffc30 2024-09-13T17:07:48.922 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:48.921+0000 7f2dcb522640 1 -- 172.21.15.115:0/2607469651 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dc4107500 con 0x7f2dc40ffc30 2024-09-13T17:07:48.923 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:48.921+0000 7f2dba7fc640 1 -- 172.21.15.115:0/2607469651 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 30) v1 ==== 90954+0+0 (secure 0 0 0) 0x7f2db4004f30 con 0x7f2dc40ffc30 2024-09-13T17:07:48.923 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:48.922+0000 7f2dba7fc640 1 --2- 172.21.15.115:0/2607469651 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f2db006cd20 0x7f2db006f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:48.923 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:48.922+0000 7f2dba7fc640 1 -- 172.21.15.115:0/2607469651 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f2db408c2d0 con 0x7f2dc40ffc30 2024-09-13T17:07:48.924 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:48.922+0000 7f2dc92be640 1 --2- 172.21.15.115:0/2607469651 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f2db006cd20 0x7f2db006f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:48.924 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:48.923+0000 7f2dc92be640 1 --2- 172.21.15.115:0/2607469651 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f2db006cd20 0x7f2db006f1e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2dc0000c00 tx=0x7f2dc0031400 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:48.927 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:48.926+0000 7f2dba7fc640 1 -- 172.21.15.115:0/2607469651 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f2db40561e0 con 0x7f2dc40ffc30 2024-09-13T17:07:49.107 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.106+0000 7f2dcb522640 1 -- 172.21.15.115:0/2607469651 --> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2dc4104580 con 0x7f2db006cd20 2024-09-13T17:07:49.108 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.107+0000 7f2dba7fc640 1 -- 172.21.15.115:0/2607469651 <== mgr.14660 v2:172.21.15.115:6800/1049502673 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+367 (secure 0 0 0) 0x7f2dc4104580 con 0x7f2db006cd20 2024-09-13T17:07:49.110 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.109+0000 7f2dcb522640 1 -- 172.21.15.115:0/2607469651 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f2db006cd20 msgr2=0x7f2db006f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:49.111 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.109+0000 7f2dcb522640 1 --2- 172.21.15.115:0/2607469651 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f2db006cd20 0x7f2db006f1e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2dc0000c00 tx=0x7f2dc0031400 comp rx=0 tx=0).stop 2024-09-13T17:07:49.111 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.109+0000 7f2dcb522640 1 -- 172.21.15.115:0/2607469651 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2dc40ffc30 msgr2=0x7f2dc419a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:49.111 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.109+0000 7f2dcb522640 1 --2- 172.21.15.115:0/2607469651 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2dc40ffc30 0x7f2dc419a2d0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f2db400d6f0 tx=0x7f2db400dbb0 comp rx=0 tx=0).stop 2024-09-13T17:07:49.111 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.109+0000 7f2dcb522640 1 -- 172.21.15.115:0/2607469651 shutdown_connections 2024-09-13T17:07:49.111 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.109+0000 7f2dcb522640 1 --2- 172.21.15.115:0/2607469651 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f2db006cd20 0x7f2db006f1e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:49.111 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.109+0000 7f2dcb522640 1 --2- 172.21.15.115:0/2607469651 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2dc40ffc30 0x7f2dc419a2d0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:49.111 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.109+0000 7f2dcb522640 1 --2- 172.21.15.115:0/2607469651 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2dc40fea30 0x7f2dc4068740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:49.111 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.109+0000 7f2dcb522640 1 -- 172.21.15.115:0/2607469651 >> 172.21.15.115:0/2607469651 conn(0x7f2dc40fa1c0 msgr2=0x7f2dc4102e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:49.111 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.109+0000 7f2dcb522640 1 -- 172.21.15.115:0/2607469651 shutdown_connections 2024-09-13T17:07:49.111 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.109+0000 7f2dcb522640 1 -- 172.21.15.115:0/2607469651 wait complete. 2024-09-13T17:07:49.119 INFO:teuthology.orchestra.run.smithi115.stdout:true 2024-09-13T17:07:49.195 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.193+0000 7f773cb10640 1 -- 172.21.15.115:0/2631490312 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77380ffb40 msgr2=0x7f77380fff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:49.195 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.193+0000 7f773cb10640 1 --2- 172.21.15.115:0/2631490312 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77380ffb40 0x7f77380fff40 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f7728009880 tx=0x7f772802a4a0 comp rx=0 tx=0).stop 2024-09-13T17:07:49.195 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.193+0000 7f773cb10640 1 -- 172.21.15.115:0/2631490312 shutdown_connections 2024-09-13T17:07:49.195 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.193+0000 7f773cb10640 1 --2- 172.21.15.115:0/2631490312 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7738100d40 0x7f77381011c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:49.195 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.193+0000 7f773cb10640 1 --2- 172.21.15.115:0/2631490312 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77380ffb40 0x7f77380fff40 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:49.195 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.193+0000 7f773cb10640 1 -- 172.21.15.115:0/2631490312 >> 172.21.15.115:0/2631490312 conn(0x7f77380fb2f0 msgr2=0x7f77380fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:49.195 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.193+0000 7f773cb10640 1 -- 172.21.15.115:0/2631490312 shutdown_connections 2024-09-13T17:07:49.195 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.193+0000 7f773cb10640 1 -- 172.21.15.115:0/2631490312 wait complete. 2024-09-13T17:07:49.197 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.194+0000 7f773cb10640 1 Processor -- start 2024-09-13T17:07:49.197 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.194+0000 7f773cb10640 1 -- start start 2024-09-13T17:07:49.197 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.194+0000 7f773cb10640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f77380ffb40 0x7f7738195640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:49.197 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.194+0000 7f773cb10640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7738100d40 0x7f7738195b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:49.197 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.194+0000 7f773cb10640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7738196150 con 0x7f7738100d40 2024-09-13T17:07:49.197 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.194+0000 7f773cb10640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77381962c0 con 0x7f77380ffb40 2024-09-13T17:07:49.197 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.194+0000 7f7735d9b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7738100d40 0x7f7738195b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:49.197 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.194+0000 7f7735d9b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7738100d40 0x7f7738195b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:58338/0 (socket says 172.21.15.115:58338) 2024-09-13T17:07:49.197 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.194+0000 7f7735d9b640 1 -- 172.21.15.115:0/1738642911 learned_addr learned my addr 172.21.15.115:0/1738642911 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:07:49.198 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.195+0000 7f773659c640 1 --2- 172.21.15.115:0/1738642911 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f77380ffb40 0x7f7738195640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:49.198 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.195+0000 7f7735d9b640 1 -- 172.21.15.115:0/1738642911 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f77380ffb40 msgr2=0x7f7738195640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:49.198 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.195+0000 7f7735d9b640 1 --2- 172.21.15.115:0/1738642911 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f77380ffb40 0x7f7738195640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:49.198 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.195+0000 7f7735d9b640 1 -- 172.21.15.115:0/1738642911 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7728009560 con 0x7f7738100d40 2024-09-13T17:07:49.198 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.195+0000 7f7735d9b640 1 --2- 172.21.15.115:0/1738642911 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7738100d40 0x7f7738195b80 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f772c00b450 tx=0x7f772c00b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:49.198 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.195+0000 7f77277fe640 1 -- 172.21.15.115:0/1738642911 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f772c011860 con 0x7f7738100d40 2024-09-13T17:07:49.198 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.195+0000 7f773cb10640 1 -- 172.21.15.115:0/1738642911 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f773819ad60 con 0x7f7738100d40 2024-09-13T17:07:49.198 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.195+0000 7f77277fe640 1 -- 172.21.15.115:0/1738642911 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f772c011e60 con 0x7f7738100d40 2024-09-13T17:07:49.198 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.195+0000 7f77277fe640 1 -- 172.21.15.115:0/1738642911 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f772c00f340 con 0x7f7738100d40 2024-09-13T17:07:49.198 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.195+0000 7f773cb10640 1 -- 172.21.15.115:0/1738642911 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f773819b330 con 0x7f7738100d40 2024-09-13T17:07:49.198 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.196+0000 7f773cb10640 1 -- 172.21.15.115:0/1738642911 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7738108670 con 0x7f7738100d40 2024-09-13T17:07:49.199 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.196+0000 7f77277fe640 1 -- 172.21.15.115:0/1738642911 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 30) v1 ==== 90954+0+0 (secure 0 0 0) 0x7f772c0103e0 con 0x7f7738100d40 2024-09-13T17:07:49.199 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.197+0000 7f77277fe640 1 --2- 172.21.15.115:0/1738642911 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f772006cd90 0x7f772006f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:49.199 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.197+0000 7f77277fe640 1 -- 172.21.15.115:0/1738642911 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f772c08c580 con 0x7f7738100d40 2024-09-13T17:07:49.199 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.197+0000 7f773659c640 1 --2- 172.21.15.115:0/1738642911 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f772006cd90 0x7f772006f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:49.199 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.197+0000 7f773659c640 1 --2- 172.21.15.115:0/1738642911 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f772006cd90 0x7f772006f250 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7728031460 tx=0x7f7728000bc0 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:49.202 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.201+0000 7f77277fe640 1 -- 172.21.15.115:0/1738642911 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f772c056590 con 0x7f7738100d40 2024-09-13T17:07:49.387 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.385+0000 7f773cb10640 1 -- 172.21.15.115:0/1738642911 --> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f773819b580 con 0x7f772006cd90 2024-09-13T17:07:49.387 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.386+0000 7f77277fe640 1 -- 172.21.15.115:0/1738642911 <== mgr.14660 v2:172.21.15.115:6800/1049502673 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+367 (secure 0 0 0) 0x7f773819b580 con 0x7f772006cd90 2024-09-13T17:07:49.390 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.388+0000 7f773cb10640 1 -- 172.21.15.115:0/1738642911 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f772006cd90 msgr2=0x7f772006f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:49.390 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.388+0000 7f773cb10640 1 --2- 172.21.15.115:0/1738642911 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f772006cd90 0x7f772006f250 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7728031460 tx=0x7f7728000bc0 comp rx=0 tx=0).stop 2024-09-13T17:07:49.390 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.388+0000 7f773cb10640 1 -- 172.21.15.115:0/1738642911 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7738100d40 msgr2=0x7f7738195b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:49.390 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.388+0000 7f773cb10640 1 --2- 172.21.15.115:0/1738642911 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7738100d40 0x7f7738195b80 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f772c00b450 tx=0x7f772c00b910 comp rx=0 tx=0).stop 2024-09-13T17:07:49.390 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.388+0000 7f773cb10640 1 -- 172.21.15.115:0/1738642911 shutdown_connections 2024-09-13T17:07:49.390 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.388+0000 7f773cb10640 1 --2- 172.21.15.115:0/1738642911 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f772006cd90 0x7f772006f250 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:49.390 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.388+0000 7f773cb10640 1 --2- 172.21.15.115:0/1738642911 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7738100d40 0x7f7738195b80 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:49.390 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.388+0000 7f773cb10640 1 --2- 172.21.15.115:0/1738642911 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f77380ffb40 0x7f7738195640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:49.390 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.388+0000 7f773cb10640 1 -- 172.21.15.115:0/1738642911 >> 172.21.15.115:0/1738642911 conn(0x7f77380fb2f0 msgr2=0x7f7738103f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:49.390 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.389+0000 7f773cb10640 1 -- 172.21.15.115:0/1738642911 shutdown_connections 2024-09-13T17:07:49.391 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.389+0000 7f773cb10640 1 -- 172.21.15.115:0/1738642911 wait complete. 2024-09-13T17:07:49.473 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.470+0000 7f5cbc2fb640 1 -- 172.21.15.115:0/2938088389 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5cb40fea30 msgr2=0x7f5cb40fee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:49.473 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.470+0000 7f5cbc2fb640 1 --2- 172.21.15.115:0/2938088389 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5cb40fea30 0x7f5cb40fee30 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f5cb0009880 tx=0x7f5cb002a4a0 comp rx=0 tx=0).stop 2024-09-13T17:07:49.474 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.471+0000 7f5cbc2fb640 1 -- 172.21.15.115:0/2938088389 shutdown_connections 2024-09-13T17:07:49.474 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.471+0000 7f5cbc2fb640 1 --2- 172.21.15.115:0/2938088389 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5cb40ffc30 0x7f5cb41000b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:49.474 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.471+0000 7f5cbc2fb640 1 --2- 172.21.15.115:0/2938088389 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5cb40fea30 0x7f5cb40fee30 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:49.474 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.471+0000 7f5cbc2fb640 1 -- 172.21.15.115:0/2938088389 >> 172.21.15.115:0/2938088389 conn(0x7f5cb40fa1c0 msgr2=0x7f5cb40fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:49.474 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.471+0000 7f5cbc2fb640 1 -- 172.21.15.115:0/2938088389 shutdown_connections 2024-09-13T17:07:49.474 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.471+0000 7f5cbc2fb640 1 -- 172.21.15.115:0/2938088389 wait complete. 2024-09-13T17:07:49.474 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.471+0000 7f5cbc2fb640 1 Processor -- start 2024-09-13T17:07:49.474 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.471+0000 7f5cbc2fb640 1 -- start start 2024-09-13T17:07:49.474 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.471+0000 7f5cbc2fb640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5cb40fea30 0x7f5cb4068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:49.474 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.471+0000 7f5cbc2fb640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5cb40ffc30 0x7f5cb419a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:49.474 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.471+0000 7f5cbc2fb640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb419a8a0 con 0x7f5cb40ffc30 2024-09-13T17:07:49.474 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.471+0000 7f5cbc2fb640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb419a9e0 con 0x7f5cb40fea30 2024-09-13T17:07:49.475 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.472+0000 7f5cb9896640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5cb40ffc30 0x7f5cb419a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:49.475 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.472+0000 7f5cb9896640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5cb40ffc30 0x7f5cb419a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:58354/0 (socket says 172.21.15.115:58354) 2024-09-13T17:07:49.475 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.472+0000 7f5cb9896640 1 -- 172.21.15.115:0/2736321915 learned_addr learned my addr 172.21.15.115:0/2736321915 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:07:49.475 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.472+0000 7f5cba097640 1 --2- 172.21.15.115:0/2736321915 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5cb40fea30 0x7f5cb4068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:49.475 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.472+0000 7f5cb9896640 1 -- 172.21.15.115:0/2736321915 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5cb40fea30 msgr2=0x7f5cb4068740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:49.475 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.472+0000 7f5cb9896640 1 --2- 172.21.15.115:0/2736321915 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5cb40fea30 0x7f5cb4068740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:49.475 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.472+0000 7f5cb9896640 1 -- 172.21.15.115:0/2736321915 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cb0009560 con 0x7f5cb40ffc30 2024-09-13T17:07:49.475 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.472+0000 7f5cb9896640 1 --2- 172.21.15.115:0/2736321915 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5cb40ffc30 0x7f5cb419a2d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f5ca800d6f0 tx=0x7f5ca800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:49.475 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.472+0000 7f5ca77fe640 1 -- 172.21.15.115:0/2736321915 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ca8009a30 con 0x7f5cb40ffc30 2024-09-13T17:07:49.475 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.472+0000 7f5ca77fe640 1 -- 172.21.15.115:0/2736321915 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5ca80054c0 con 0x7f5cb40ffc30 2024-09-13T17:07:49.475 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.472+0000 7f5cbc2fb640 1 -- 172.21.15.115:0/2736321915 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cb419ac90 con 0x7f5cb40ffc30 2024-09-13T17:07:49.475 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.472+0000 7f5ca77fe640 1 -- 172.21.15.115:0/2736321915 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ca8004db0 con 0x7f5cb40ffc30 2024-09-13T17:07:49.475 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.472+0000 7f5cbc2fb640 1 -- 172.21.15.115:0/2736321915 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cb419b260 con 0x7f5cb40ffc30 2024-09-13T17:07:49.476 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.473+0000 7f5cbc2fb640 1 -- 172.21.15.115:0/2736321915 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cb4107500 con 0x7f5cb40ffc30 2024-09-13T17:07:49.476 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.474+0000 7f5ca77fe640 1 -- 172.21.15.115:0/2736321915 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 30) v1 ==== 90954+0+0 (secure 0 0 0) 0x7f5ca8005020 con 0x7f5cb40ffc30 2024-09-13T17:07:49.476 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.474+0000 7f5ca77fe640 1 --2- 172.21.15.115:0/2736321915 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f5ca006cd20 0x7f5ca006f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:49.476 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.474+0000 7f5cba097640 1 --2- 172.21.15.115:0/2736321915 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f5ca006cd20 0x7f5ca006f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:49.477 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.474+0000 7f5ca77fe640 1 -- 172.21.15.115:0/2736321915 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f5ca808c1b0 con 0x7f5cb40ffc30 2024-09-13T17:07:49.477 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.475+0000 7f5cba097640 1 --2- 172.21.15.115:0/2736321915 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f5ca006cd20 0x7f5ca006f1e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f5cb0000c00 tx=0x7f5cb0031400 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:49.480 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.480+0000 7f5ca77fe640 1 -- 172.21.15.115:0/2736321915 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f5ca8056160 con 0x7f5cb40ffc30 2024-09-13T17:07:49.655 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.654+0000 7f5cbc2fb640 1 -- 172.21.15.115:0/2736321915 --> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5cb419b4a0 con 0x7f5ca006cd20 2024-09-13T17:07:49.665 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.663+0000 7f5ca77fe640 1 -- 172.21.15.115:0/2736321915 <== mgr.14660 v2:172.21.15.115:6800/1049502673 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7f5cb419b4a0 con 0x7f5ca006cd20 2024-09-13T17:07:49.665 INFO:teuthology.orchestra.run.smithi115.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T17:07:49.665 INFO:teuthology.orchestra.run.smithi115.stdout:alertmanager.smithi115 smithi115 *:9093,9094 running (8m) 9s ago 9m 24.9M - 0.25.0 c8568f914cd2 cbe091cee151 2024-09-13T17:07:49.665 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-exporter.smithi115 smithi115 running (10m) 9s ago 10m 8040k - 18.2.4-843-g2c01458a c129f5a2fd4e 0f1eebeaf9bb 2024-09-13T17:07:49.665 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-exporter.smithi195 smithi195 running (9m) 11s ago 9m 7600k - 18.2.4-843-g2c01458a c129f5a2fd4e 6d05bafbac8a 2024-09-13T17:07:49.665 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi115 smithi115 running (10m) 9s ago 10m 6899k - 18.2.4-843-g2c01458a c129f5a2fd4e 624a903fec23 2024-09-13T17:07:49.665 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi195 smithi195 running (9m) 11s ago 9m 6891k - 18.2.4-843-g2c01458a c129f5a2fd4e 42e6ce26130d 2024-09-13T17:07:49.665 INFO:teuthology.orchestra.run.smithi115.stdout:grafana.smithi115 smithi115 *:3000 running (8m) 9s ago 9m 86.7M - 9.4.7 954c08fa6188 41183f0705c8 2024-09-13T17:07:49.665 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi115.hbtxod smithi115 running (4m) 9s ago 4m 109M - 18.2.4-843-g2c01458a c129f5a2fd4e 12b4f4874491 2024-09-13T17:07:49.665 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi115.ijznvr smithi115 running (4m) 9s ago 4m 167M - 18.2.4-843-g2c01458a c129f5a2fd4e 2d552564a9f4 2024-09-13T17:07:49.666 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi195.aevvgz smithi195 running (4m) 11s ago 4m 16.1M - 18.2.4-843-g2c01458a c129f5a2fd4e 299b9ad657c9 2024-09-13T17:07:49.666 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi195.qzghxj smithi195 running (4m) 11s ago 4m 14.3M - 18.2.4-843-g2c01458a c129f5a2fd4e fb16b16181ff 2024-09-13T17:07:49.666 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi115.hetcni smithi115 *:8443,9283,8765 running (86s) 9s ago 11m 484M - 18.2.4-860-g6c6b083f 8a91f241d7d4 b945dbde1934 2024-09-13T17:07:49.666 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi195.hjjifz smithi195 *:8443,9283,8765 running (29s) 11s ago 8m 438M - 18.2.4-860-g6c6b083f 8a91f241d7d4 17bccdfbcae1 2024-09-13T17:07:49.666 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi115 smithi115 running (11m) 9s ago 11m 55.2M 2048M 18.2.4-843-g2c01458a c129f5a2fd4e 202375d41e68 2024-09-13T17:07:49.666 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi195 smithi195 running (8m) 11s ago 8m 42.7M 2048M 18.2.4-843-g2c01458a c129f5a2fd4e 0f54c30e5970 2024-09-13T17:07:49.666 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi115 smithi115 *:9100 running (18s) 9s ago 9m 3401k - 1.5.0 0da6a335fe13 26fb6f9844b5 2024-09-13T17:07:49.666 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi195 smithi195 *:9100 running (15s) 11s ago 9m 3581k - 1.5.0 0da6a335fe13 6d38e798fb16 2024-09-13T17:07:49.666 INFO:teuthology.orchestra.run.smithi115.stdout:osd.0 smithi115 running (8m) 9s ago 8m 245M 1216M 18.2.4-843-g2c01458a c129f5a2fd4e 8a8ad231962e 2024-09-13T17:07:49.666 INFO:teuthology.orchestra.run.smithi115.stdout:osd.1 smithi115 running (7m) 9s ago 7m 263M 1216M 18.2.4-843-g2c01458a c129f5a2fd4e 3fbc020102a0 2024-09-13T17:07:49.666 INFO:teuthology.orchestra.run.smithi115.stdout:osd.2 smithi115 running (7m) 9s ago 7m 222M 1216M 18.2.4-843-g2c01458a c129f5a2fd4e 7c623823e920 2024-09-13T17:07:49.666 INFO:teuthology.orchestra.run.smithi115.stdout:osd.3 smithi195 running (6m) 11s ago 6m 293M 2240M 18.2.4-843-g2c01458a c129f5a2fd4e 10ea833fd5c5 2024-09-13T17:07:49.666 INFO:teuthology.orchestra.run.smithi115.stdout:osd.4 smithi195 running (6m) 11s ago 6m 263M 2240M 18.2.4-843-g2c01458a c129f5a2fd4e 4bbc3acb9aff 2024-09-13T17:07:49.667 INFO:teuthology.orchestra.run.smithi115.stdout:osd.5 smithi195 running (5m) 11s ago 5m 234M 2240M 18.2.4-843-g2c01458a c129f5a2fd4e 4bd1b3a232d0 2024-09-13T17:07:49.667 INFO:teuthology.orchestra.run.smithi115.stdout:prometheus.smithi115 smithi115 *:9095 running (39s) 9s ago 9m 50.0M - 2.43.0 a07b618ecd1d 6a923a074662 2024-09-13T17:07:49.667 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.665+0000 7f5cbc2fb640 1 -- 172.21.15.115:0/2736321915 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f5ca006cd20 msgr2=0x7f5ca006f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:49.667 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.665+0000 7f5cbc2fb640 1 --2- 172.21.15.115:0/2736321915 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f5ca006cd20 0x7f5ca006f1e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f5cb0000c00 tx=0x7f5cb0031400 comp rx=0 tx=0).stop 2024-09-13T17:07:49.667 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.665+0000 7f5cbc2fb640 1 -- 172.21.15.115:0/2736321915 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5cb40ffc30 msgr2=0x7f5cb419a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:49.667 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.665+0000 7f5cbc2fb640 1 --2- 172.21.15.115:0/2736321915 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5cb40ffc30 0x7f5cb419a2d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f5ca800d6f0 tx=0x7f5ca800dbb0 comp rx=0 tx=0).stop 2024-09-13T17:07:49.668 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.665+0000 7f5cbc2fb640 1 -- 172.21.15.115:0/2736321915 shutdown_connections 2024-09-13T17:07:49.668 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.665+0000 7f5cbc2fb640 1 --2- 172.21.15.115:0/2736321915 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f5ca006cd20 0x7f5ca006f1e0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:49.668 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.665+0000 7f5cbc2fb640 1 --2- 172.21.15.115:0/2736321915 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5cb40ffc30 0x7f5cb419a2d0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:49.668 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.665+0000 7f5cbc2fb640 1 --2- 172.21.15.115:0/2736321915 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5cb40fea30 0x7f5cb4068740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:49.668 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.665+0000 7f5cbc2fb640 1 -- 172.21.15.115:0/2736321915 >> 172.21.15.115:0/2736321915 conn(0x7f5cb40fa1c0 msgr2=0x7f5cb4102e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:49.668 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.666+0000 7f5cbc2fb640 1 -- 172.21.15.115:0/2736321915 shutdown_connections 2024-09-13T17:07:49.668 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.666+0000 7f5cbc2fb640 1 -- 172.21.15.115:0/2736321915 wait complete. 2024-09-13T17:07:49.751 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.745+0000 7fd226e53640 1 -- 172.21.15.115:0/1906942022 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd220100630 msgr2=0x7fd220102a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:49.752 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.745+0000 7fd226e53640 1 --2- 172.21.15.115:0/1906942022 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd220100630 0x7fd220102a20 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fd2140098b0 tx=0x7fd21402a4d0 comp rx=0 tx=0).stop 2024-09-13T17:07:49.752 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.745+0000 7fd226e53640 1 -- 172.21.15.115:0/1906942022 shutdown_connections 2024-09-13T17:07:49.752 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.745+0000 7fd226e53640 1 --2- 172.21.15.115:0/1906942022 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd220102f60 0x7fd220105350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:49.752 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.745+0000 7fd226e53640 1 --2- 172.21.15.115:0/1906942022 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd220100630 0x7fd220102a20 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:49.752 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.745+0000 7fd226e53640 1 -- 172.21.15.115:0/1906942022 >> 172.21.15.115:0/1906942022 conn(0x7fd2200fa230 msgr2=0x7fd2200fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:49.752 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.746+0000 7fd226e53640 1 -- 172.21.15.115:0/1906942022 shutdown_connections 2024-09-13T17:07:49.752 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.746+0000 7fd226e53640 1 -- 172.21.15.115:0/1906942022 wait complete. 2024-09-13T17:07:49.752 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.746+0000 7fd226e53640 1 Processor -- start 2024-09-13T17:07:49.752 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.746+0000 7fd226e53640 1 -- start start 2024-09-13T17:07:49.752 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.746+0000 7fd226e53640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd220100630 0x7fd2201956a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:49.753 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.746+0000 7fd226e53640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd220102f60 0x7fd220195be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:49.753 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.746+0000 7fd226e53640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2201961b0 con 0x7fd220102f60 2024-09-13T17:07:49.753 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.746+0000 7fd226e53640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd220196320 con 0x7fd220100630 2024-09-13T17:07:49.753 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.747+0000 7fd21ffff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd220102f60 0x7fd220195be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:49.753 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.747+0000 7fd21ffff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd220102f60 0x7fd220195be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:58366/0 (socket says 172.21.15.115:58366) 2024-09-13T17:07:49.753 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.747+0000 7fd21ffff640 1 -- 172.21.15.115:0/1302402249 learned_addr learned my addr 172.21.15.115:0/1302402249 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:07:49.753 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.747+0000 7fd224bef640 1 --2- 172.21.15.115:0/1302402249 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd220100630 0x7fd2201956a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:49.753 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.747+0000 7fd21ffff640 1 -- 172.21.15.115:0/1302402249 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd220100630 msgr2=0x7fd2201956a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:49.753 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.747+0000 7fd21ffff640 1 --2- 172.21.15.115:0/1302402249 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd220100630 0x7fd2201956a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:49.753 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.747+0000 7fd21ffff640 1 -- 172.21.15.115:0/1302402249 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd214009560 con 0x7fd220102f60 2024-09-13T17:07:49.753 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.747+0000 7fd21ffff640 1 --2- 172.21.15.115:0/1302402249 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd220102f60 0x7fd220195be0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fd20c00b400 tx=0x7fd20c00b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:49.754 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.747+0000 7fd21dffb640 1 -- 172.21.15.115:0/1302402249 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd20c011800 con 0x7fd220102f60 2024-09-13T17:07:49.754 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.747+0000 7fd21dffb640 1 -- 172.21.15.115:0/1302402249 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd20c011e00 con 0x7fd220102f60 2024-09-13T17:07:49.754 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.747+0000 7fd226e53640 1 -- 172.21.15.115:0/1302402249 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd22019ad70 con 0x7fd220102f60 2024-09-13T17:07:49.754 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.747+0000 7fd21dffb640 1 -- 172.21.15.115:0/1302402249 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd20c00f2e0 con 0x7fd220102f60 2024-09-13T17:07:49.754 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.748+0000 7fd226e53640 1 -- 172.21.15.115:0/1302402249 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd22019b340 con 0x7fd220102f60 2024-09-13T17:07:49.754 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.748+0000 7fd226e53640 1 -- 172.21.15.115:0/1302402249 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2201086f0 con 0x7fd220102f60 2024-09-13T17:07:49.754 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.749+0000 7fd21dffb640 1 -- 172.21.15.115:0/1302402249 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 30) v1 ==== 90954+0+0 (secure 0 0 0) 0x7fd20c010380 con 0x7fd220102f60 2024-09-13T17:07:49.754 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.749+0000 7fd21dffb640 1 --2- 172.21.15.115:0/1302402249 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fd21006cd90 0x7fd21006f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:49.754 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.749+0000 7fd21dffb640 1 -- 172.21.15.115:0/1302402249 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fd20c08c260 con 0x7fd220102f60 2024-09-13T17:07:49.754 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.749+0000 7fd224bef640 1 --2- 172.21.15.115:0/1302402249 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fd21006cd90 0x7fd21006f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:49.754 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.750+0000 7fd224bef640 1 --2- 172.21.15.115:0/1302402249 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fd21006cd90 0x7fd21006f250 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd214000c00 tx=0x7fd214031400 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:49.755 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.753+0000 7fd21dffb640 1 -- 172.21.15.115:0/1302402249 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd20c0562f0 con 0x7fd220102f60 2024-09-13T17:07:49.986 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.985+0000 7fd226e53640 1 -- 172.21.15.115:0/1302402249 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd22019b5e0 con 0x7fd220102f60 2024-09-13T17:07:49.987 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.985+0000 7fd21dffb640 1 -- 172.21.15.115:0/1302402249 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+733 (secure 0 0 0) 0x7fd22019b5e0 con 0x7fd220102f60 2024-09-13T17:07:49.987 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-13T17:07:49.987 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": { 2024-09-13T17:07:49.987 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-843-g2c01458a (2c01458affee2b2435cd231b6e392435c1c21661) reef (stable)": 2 2024-09-13T17:07:49.987 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T17:07:49.987 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": { 2024-09-13T17:07:49.987 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 2 2024-09-13T17:07:49.987 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T17:07:49.987 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": { 2024-09-13T17:07:49.987 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-843-g2c01458a (2c01458affee2b2435cd231b6e392435c1c21661) reef (stable)": 6 2024-09-13T17:07:49.987 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T17:07:49.988 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": { 2024-09-13T17:07:49.988 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-843-g2c01458a (2c01458affee2b2435cd231b6e392435c1c21661) reef (stable)": 4 2024-09-13T17:07:49.988 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T17:07:49.988 INFO:teuthology.orchestra.run.smithi115.stdout: "overall": { 2024-09-13T17:07:49.988 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-843-g2c01458a (2c01458affee2b2435cd231b6e392435c1c21661) reef (stable)": 12, 2024-09-13T17:07:49.988 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 2 2024-09-13T17:07:49.988 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-13T17:07:49.988 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-13T17:07:49.989 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.987+0000 7fd226e53640 1 -- 172.21.15.115:0/1302402249 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fd21006cd90 msgr2=0x7fd21006f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:49.989 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.987+0000 7fd226e53640 1 --2- 172.21.15.115:0/1302402249 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fd21006cd90 0x7fd21006f250 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd214000c00 tx=0x7fd214031400 comp rx=0 tx=0).stop 2024-09-13T17:07:49.989 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.987+0000 7fd226e53640 1 -- 172.21.15.115:0/1302402249 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd220102f60 msgr2=0x7fd220195be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:49.989 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.987+0000 7fd226e53640 1 --2- 172.21.15.115:0/1302402249 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd220102f60 0x7fd220195be0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fd20c00b400 tx=0x7fd20c00b8c0 comp rx=0 tx=0).stop 2024-09-13T17:07:49.989 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.988+0000 7fd226e53640 1 -- 172.21.15.115:0/1302402249 shutdown_connections 2024-09-13T17:07:49.989 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.988+0000 7fd226e53640 1 --2- 172.21.15.115:0/1302402249 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fd21006cd90 0x7fd21006f250 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:49.989 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.988+0000 7fd226e53640 1 --2- 172.21.15.115:0/1302402249 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd220102f60 0x7fd220195be0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:49.989 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.988+0000 7fd226e53640 1 --2- 172.21.15.115:0/1302402249 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd220100630 0x7fd2201956a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:49.989 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.988+0000 7fd226e53640 1 -- 172.21.15.115:0/1302402249 >> 172.21.15.115:0/1302402249 conn(0x7fd2200fa230 msgr2=0x7fd2200fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:49.990 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.988+0000 7fd226e53640 1 -- 172.21.15.115:0/1302402249 shutdown_connections 2024-09-13T17:07:49.990 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:49.988+0000 7fd226e53640 1 -- 172.21.15.115:0/1302402249 wait complete. 2024-09-13T17:07:50.096 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:50.095+0000 7f0a99230640 1 -- 172.21.15.115:0/3837137409 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a94102f60 msgr2=0x7f0a94105350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:50.096 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:50.095+0000 7f0a99230640 1 --2- 172.21.15.115:0/3837137409 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a94102f60 0x7f0a94105350 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f0a880098b0 tx=0x7f0a8802a4d0 comp rx=0 tx=0).stop 2024-09-13T17:07:50.097 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:50.095+0000 7f0a99230640 1 -- 172.21.15.115:0/3837137409 shutdown_connections 2024-09-13T17:07:50.097 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:50.095+0000 7f0a99230640 1 --2- 172.21.15.115:0/3837137409 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a94102f60 0x7f0a94105350 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:50.097 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:50.095+0000 7f0a99230640 1 --2- 172.21.15.115:0/3837137409 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0a94100630 0x7f0a94102a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:50.097 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:50.095+0000 7f0a99230640 1 -- 172.21.15.115:0/3837137409 >> 172.21.15.115:0/3837137409 conn(0x7f0a940fa230 msgr2=0x7f0a940fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:50.097 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:50.095+0000 7f0a99230640 1 -- 172.21.15.115:0/3837137409 shutdown_connections 2024-09-13T17:07:50.097 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:50.095+0000 7f0a99230640 1 -- 172.21.15.115:0/3837137409 wait complete. 2024-09-13T17:07:50.098 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:50.096+0000 7f0a99230640 1 Processor -- start 2024-09-13T17:07:50.099 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:50.096+0000 7f0a99230640 1 -- start start 2024-09-13T17:07:50.099 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:50.096+0000 7f0a99230640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0a94100630 0x7f0a941956a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:50.099 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:50.096+0000 7f0a99230640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a94102f60 0x7f0a94195be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:50.099 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:50.096+0000 7f0a99230640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a941961b0 con 0x7f0a94102f60 2024-09-13T17:07:50.099 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:50.096+0000 7f0a99230640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a94196320 con 0x7f0a94100630 2024-09-13T17:07:50.099 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:50.096+0000 7f0a9259c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a94102f60 0x7f0a94195be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:50.099 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:50.096+0000 7f0a9259c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a94102f60 0x7f0a94195be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:58388/0 (socket says 172.21.15.115:58388) 2024-09-13T17:07:50.099 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:50.096+0000 7f0a9259c640 1 -- 172.21.15.115:0/2077140733 learned_addr learned my addr 172.21.15.115:0/2077140733 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:07:50.099 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:50.096+0000 7f0a92d9d640 1 --2- 172.21.15.115:0/2077140733 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0a94100630 0x7f0a941956a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:50.099 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:50.097+0000 7f0a9259c640 1 -- 172.21.15.115:0/2077140733 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0a94100630 msgr2=0x7f0a941956a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:50.099 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:50.097+0000 7f0a9259c640 1 --2- 172.21.15.115:0/2077140733 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0a94100630 0x7f0a941956a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:50.100 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:50.097+0000 7f0a9259c640 1 -- 172.21.15.115:0/2077140733 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a88009560 con 0x7f0a94102f60 2024-09-13T17:07:50.100 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:50.097+0000 7f0a9259c640 1 --2- 172.21.15.115:0/2077140733 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a94102f60 0x7f0a94195be0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f0a88005610 tx=0x7f0a88005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:50.100 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:50.097+0000 7f0a7bfff640 1 -- 172.21.15.115:0/2077140733 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a88004b20 con 0x7f0a94102f60 2024-09-13T17:07:50.100 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:50.097+0000 7f0a99230640 1 -- 172.21.15.115:0/2077140733 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a9419ad60 con 0x7f0a94102f60 2024-09-13T17:07:50.100 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:50.097+0000 7f0a7bfff640 1 -- 172.21.15.115:0/2077140733 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0a88004c80 con 0x7f0a94102f60 2024-09-13T17:07:50.100 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:50.097+0000 7f0a7bfff640 1 -- 172.21.15.115:0/2077140733 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a88031ac0 con 0x7f0a94102f60 2024-09-13T17:07:50.100 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:50.097+0000 7f0a99230640 1 -- 172.21.15.115:0/2077140733 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a9419b2d0 con 0x7f0a94102f60 2024-09-13T17:07:50.101 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:50.098+0000 7f0a99230640 1 -- 172.21.15.115:0/2077140733 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a941086d0 con 0x7f0a94102f60 2024-09-13T17:07:50.101 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:50.099+0000 7f0a7bfff640 1 -- 172.21.15.115:0/2077140733 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 30) v1 ==== 90954+0+0 (secure 0 0 0) 0x7f0a880035f0 con 0x7f0a94102f60 2024-09-13T17:07:50.101 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:50.099+0000 7f0a7bfff640 1 --2- 172.21.15.115:0/2077140733 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f0a7c06cd90 0x7f0a7c06f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:50.101 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:50.099+0000 7f0a7bfff640 1 -- 172.21.15.115:0/2077140733 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f0a880ada30 con 0x7f0a94102f60 2024-09-13T17:07:50.101 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:50.099+0000 7f0a92d9d640 1 --2- 172.21.15.115:0/2077140733 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f0a7c06cd90 0x7f0a7c06f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:50.101 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:50.100+0000 7f0a92d9d640 1 --2- 172.21.15.115:0/2077140733 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f0a7c06cd90 0x7f0a7c06f250 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0a84009890 tx=0x7f0a84008040 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:50.105 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:50.103+0000 7f0a7bfff640 1 -- 172.21.15.115:0/2077140733 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f0a88077930 con 0x7f0a94102f60 2024-09-13T17:07:50.295 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:50.294+0000 7f0a99230640 1 -- 172.21.15.115:0/2077140733 --> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0a94103a20 con 0x7f0a7c06cd90 2024-09-13T17:07:50.296 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:50.295+0000 7f0a7bfff640 1 -- 172.21.15.115:0/2077140733 <== mgr.14660 v2:172.21.15.115:6800/1049502673 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+367 (secure 0 0 0) 0x7f0a94103a20 con 0x7f0a7c06cd90 2024-09-13T17:07:50.296 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-13T17:07:50.296 INFO:teuthology.orchestra.run.smithi115.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256", 2024-09-13T17:07:50.296 INFO:teuthology.orchestra.run.smithi115.stdout: "in_progress": true, 2024-09-13T17:07:50.296 INFO:teuthology.orchestra.run.smithi115.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-13T17:07:50.297 INFO:teuthology.orchestra.run.smithi115.stdout: "services_complete": [ 2024-09-13T17:07:50.297 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr" 2024-09-13T17:07:50.297 INFO:teuthology.orchestra.run.smithi115.stdout: ], 2024-09-13T17:07:50.297 INFO:teuthology.orchestra.run.smithi115.stdout: "progress": "2/2 daemons upgraded", 2024-09-13T17:07:50.297 INFO:teuthology.orchestra.run.smithi115.stdout: "message": "Currently upgrading prometheus daemons", 2024-09-13T17:07:50.297 INFO:teuthology.orchestra.run.smithi115.stdout: "is_paused": false 2024-09-13T17:07:50.297 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-13T17:07:50.299 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:50.297+0000 7f0a99230640 1 -- 172.21.15.115:0/2077140733 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f0a7c06cd90 msgr2=0x7f0a7c06f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:50.299 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:50.297+0000 7f0a99230640 1 --2- 172.21.15.115:0/2077140733 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f0a7c06cd90 0x7f0a7c06f250 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0a84009890 tx=0x7f0a84008040 comp rx=0 tx=0).stop 2024-09-13T17:07:50.300 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:50.297+0000 7f0a99230640 1 -- 172.21.15.115:0/2077140733 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a94102f60 msgr2=0x7f0a94195be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:50.300 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:50.297+0000 7f0a99230640 1 --2- 172.21.15.115:0/2077140733 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a94102f60 0x7f0a94195be0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f0a88005610 tx=0x7f0a88005640 comp rx=0 tx=0).stop 2024-09-13T17:07:50.300 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:50.297+0000 7f0a99230640 1 -- 172.21.15.115:0/2077140733 shutdown_connections 2024-09-13T17:07:50.300 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:50.297+0000 7f0a99230640 1 --2- 172.21.15.115:0/2077140733 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f0a7c06cd90 0x7f0a7c06f250 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:50.300 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:50.297+0000 7f0a99230640 1 --2- 172.21.15.115:0/2077140733 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a94102f60 0x7f0a94195be0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:50.300 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:50.297+0000 7f0a99230640 1 --2- 172.21.15.115:0/2077140733 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0a94100630 0x7f0a941956a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:50.300 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:50.297+0000 7f0a99230640 1 -- 172.21.15.115:0/2077140733 >> 172.21.15.115:0/2077140733 conn(0x7f0a940fa230 msgr2=0x7f0a940fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:50.300 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:50.298+0000 7f0a99230640 1 -- 172.21.15.115:0/2077140733 shutdown_connections 2024-09-13T17:07:50.300 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:07:50.298+0000 7f0a99230640 1 -- 172.21.15.115:0/2077140733 wait complete. 2024-09-13T17:07:50.743 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:50 smithi115 ceph-mon[27708]: from='client.14734 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:07:50.743 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:50 smithi115 ceph-mon[27708]: pgmap v40: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-13T17:07:50.743 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:50 smithi115 ceph-mon[27708]: from='client.14738 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:07:50.743 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:50 smithi115 ceph-mon[27708]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:07:50.743 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:50 smithi115 ceph-mon[27708]: from='client.? 172.21.15.115:0/1302402249' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:07:50.744 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:50 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:07:51.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:50 smithi195 ceph-mon[34981]: from='client.14734 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:07:51.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:50 smithi195 ceph-mon[34981]: pgmap v40: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-13T17:07:51.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:50 smithi195 ceph-mon[34981]: from='client.14738 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:07:51.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:50 smithi195 ceph-mon[34981]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:07:51.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:50 smithi195 ceph-mon[34981]: from='client.? 172.21.15.115:0/1302402249' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:07:51.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:50 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:07:51.862 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:51 smithi115 ceph-mon[27708]: from='client.14750 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:07:52.076 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:51 smithi195 ceph-mon[34981]: from='client.14750 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:07:52.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:52 smithi115 ceph-mon[27708]: pgmap v41: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-13T17:07:53.076 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:52 smithi195 ceph-mon[34981]: pgmap v41: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-13T17:07:54.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:54 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:54.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:54 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:54.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:54 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:07:54.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:54 smithi195 ceph-mon[34981]: pgmap v42: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-13T17:07:54.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:54 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:54.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:54 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:07:54.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:54 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:07:54.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:54 smithi115 ceph-mon[27708]: pgmap v42: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-13T17:07:56.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:56 smithi195 ceph-mon[34981]: pgmap v43: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:07:56.919 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:56 smithi115 ceph-mon[27708]: pgmap v43: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:07:58.652 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:07:58 smithi115 ceph-mon[27708]: pgmap v44: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:07:58.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:07:58 smithi195 ceph-mon[34981]: pgmap v44: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:08:00.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:00 smithi115 ceph-mon[27708]: pgmap v45: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:08:00.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:00 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:08:00.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:00 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:08:00.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:00 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:08:00.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:00 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:08:01.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:00 smithi195 ceph-mon[34981]: pgmap v45: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:08:01.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:00 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:08:01.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:00 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:08:01.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:00 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:08:01.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:00 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:08:02.867 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:02 smithi115 ceph-mon[27708]: pgmap v46: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:08:03.076 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:02 smithi195 ceph-mon[34981]: pgmap v46: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:08:04.319 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:04 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:08:04.319 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:04 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:08:04.320 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:04 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:08:04.320 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:04 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:08:04.320 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:04 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:08:04.320 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:04 smithi115 ceph-mon[27708]: pgmap v47: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:08:04.320 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:04 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T17:08:04.320 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:04 smithi115 ceph-mon[27708]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T17:08:04.320 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:04 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:08:04.320 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:04 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:08:04.320 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:04 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:08:04.321 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:04 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:08:04.321 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:04 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:08:04.321 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:04 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:08:04.321 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:04 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:08:04.321 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:04 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:08:04.321 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:04 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:08:04.321 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:04 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:08:04.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:04 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:08:04.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:04 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:08:04.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:04 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:08:04.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:04 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:08:04.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:04 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:08:04.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:04 smithi195 ceph-mon[34981]: pgmap v47: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:08:04.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:04 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T17:08:04.578 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:04 smithi195 ceph-mon[34981]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T17:08:04.578 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:04 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:08:04.578 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:04 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:08:04.578 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:04 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:08:04.578 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:04 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:08:04.578 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:04 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:08:04.578 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:04 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:08:04.578 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:04 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:08:04.578 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:04 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:08:04.578 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:04 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:08:04.578 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:04 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:08:05.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:05 smithi115 ceph-mon[27708]: Upgrade: Updating alertmanager.smithi115 2024-09-13T17:08:05.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:05 smithi115 ceph-mon[27708]: Deploying daemon alertmanager.smithi115 on smithi115 2024-09-13T17:08:05.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:05 smithi195 ceph-mon[34981]: Upgrade: Updating alertmanager.smithi115 2024-09-13T17:08:05.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:05 smithi195 ceph-mon[34981]: Deploying daemon alertmanager.smithi115 on smithi115 2024-09-13T17:08:06.606 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:06 smithi115 ceph-mon[27708]: pgmap v48: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:08:06.606 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:06 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:08:06.728 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:06 smithi195 ceph-mon[34981]: pgmap v48: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:08:06.728 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:06 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:08:08.413 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:08 smithi115 ceph-mon[27708]: mgrmap e31: smithi115.hetcni(active, since 91s), standbys: smithi195.hjjifz 2024-09-13T17:08:08.413 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:08 smithi115 ceph-mon[27708]: pgmap v49: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-13T17:08:08.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:08 smithi195 ceph-mon[34981]: mgrmap e31: smithi115.hetcni(active, since 91s), standbys: smithi195.hjjifz 2024-09-13T17:08:08.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:08 smithi195 ceph-mon[34981]: pgmap v49: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-13T17:08:10.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:10 smithi115 ceph-mon[27708]: pgmap v50: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-09-13T17:08:10.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:10 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:08:10.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:10 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:08:10.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:10 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:08:10.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:10 smithi195 ceph-mon[34981]: pgmap v50: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-09-13T17:08:10.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:10 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:08:10.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:10 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:08:10.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:10 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:08:12.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:12 smithi115 ceph-mon[27708]: pgmap v51: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-09-13T17:08:12.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:12 smithi195 ceph-mon[34981]: pgmap v51: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-09-13T17:08:14.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:14 smithi195 ceph-mon[34981]: pgmap v52: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-13T17:08:14.928 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:14 smithi115 ceph-mon[27708]: pgmap v52: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-13T17:08:16.217 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:16 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:08:16.217 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:16 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:08:16.217 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:16 smithi115 ceph-mon[27708]: pgmap v53: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-09-13T17:08:16.217 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:16 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:08:16.217 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:16 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:08:16.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:16 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:08:16.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:16 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:08:16.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:16 smithi195 ceph-mon[34981]: pgmap v53: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-09-13T17:08:16.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:16 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:08:16.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:16 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:08:18.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:18 smithi115 ceph-mon[27708]: pgmap v54: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-13T17:08:18.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:18 smithi195 ceph-mon[34981]: pgmap v54: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-13T17:08:20.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:19 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:08:20.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:19 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:08:20.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:19 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:08:20.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:19 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:08:20.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:19 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:08:20.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:19 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-13T17:08:20.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:19 smithi195 ceph-mon[34981]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-13T17:08:20.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:19 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:08:20.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:19 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:08:20.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:19 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:08:20.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:19 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:08:20.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:19 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:08:20.079 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:19 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:08:20.079 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:19 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:08:20.079 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:19 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:08:20.079 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:19 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:08:20.079 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:19 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:08:20.079 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:19 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:08:20.152 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:19 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:08:20.153 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:19 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:08:20.153 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:19 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:08:20.153 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:19 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:08:20.153 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:19 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:08:20.153 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:19 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-13T17:08:20.153 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:19 smithi115 ceph-mon[27708]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-13T17:08:20.153 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:19 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:08:20.153 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:19 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:08:20.153 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:19 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:08:20.153 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:19 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:08:20.153 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:19 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:08:20.153 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:19 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:08:20.154 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:19 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:08:20.154 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:19 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:08:20.154 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:19 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:08:20.154 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:19 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:08:20.154 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:19 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:08:20.389 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.388+0000 7fce941b0640 1 -- 172.21.15.115:0/1949751775 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce8c100dd0 msgr2=0x7fce8c101250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:20.389 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.388+0000 7fce941b0640 1 --2- 172.21.15.115:0/1949751775 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce8c100dd0 0x7fce8c101250 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fce7c009880 tx=0x7fce7c02a4a0 comp rx=0 tx=0).stop 2024-09-13T17:08:20.389 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.388+0000 7fce941b0640 1 -- 172.21.15.115:0/1949751775 shutdown_connections 2024-09-13T17:08:20.389 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.388+0000 7fce941b0640 1 --2- 172.21.15.115:0/1949751775 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce8c100dd0 0x7fce8c101250 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:20.390 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.388+0000 7fce941b0640 1 --2- 172.21.15.115:0/1949751775 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce8c0fddf0 0x7fce8c0fe1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:20.390 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.388+0000 7fce941b0640 1 -- 172.21.15.115:0/1949751775 >> 172.21.15.115:0/1949751775 conn(0x7fce8c0f9940 msgr2=0x7fce8c0fbd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:20.390 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.388+0000 7fce941b0640 1 -- 172.21.15.115:0/1949751775 shutdown_connections 2024-09-13T17:08:20.390 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.388+0000 7fce941b0640 1 -- 172.21.15.115:0/1949751775 wait complete. 2024-09-13T17:08:20.391 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.389+0000 7fce941b0640 1 Processor -- start 2024-09-13T17:08:20.391 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.389+0000 7fce941b0640 1 -- start start 2024-09-13T17:08:20.391 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.389+0000 7fce941b0640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce8c0fddf0 0x7fce8c100730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:20.392 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.389+0000 7fce941b0640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce8c100dd0 0x7fce8c0fed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:20.392 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.389+0000 7fce941b0640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce8c0ff2c0 con 0x7fce8c0fddf0 2024-09-13T17:08:20.392 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.389+0000 7fce941b0640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce8c0ff430 con 0x7fce8c100dd0 2024-09-13T17:08:20.392 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.389+0000 7fce91f4c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce8c0fddf0 0x7fce8c100730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:20.392 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.389+0000 7fce91f4c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce8c0fddf0 0x7fce8c100730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:37544/0 (socket says 172.21.15.115:37544) 2024-09-13T17:08:20.392 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.389+0000 7fce91f4c640 1 -- 172.21.15.115:0/1750485000 learned_addr learned my addr 172.21.15.115:0/1750485000 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:08:20.392 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.389+0000 7fce9174b640 1 --2- 172.21.15.115:0/1750485000 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce8c100dd0 0x7fce8c0fed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:20.392 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.390+0000 7fce91f4c640 1 -- 172.21.15.115:0/1750485000 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce8c100dd0 msgr2=0x7fce8c0fed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:20.392 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.390+0000 7fce91f4c640 1 --2- 172.21.15.115:0/1750485000 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce8c100dd0 0x7fce8c0fed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:20.392 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.390+0000 7fce91f4c640 1 -- 172.21.15.115:0/1750485000 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce7c009560 con 0x7fce8c0fddf0 2024-09-13T17:08:20.392 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.390+0000 7fce91f4c640 1 --2- 172.21.15.115:0/1750485000 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce8c0fddf0 0x7fce8c100730 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fce8800d8d0 tx=0x7fce8800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:20.392 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.390+0000 7fce82ffd640 1 -- 172.21.15.115:0/1750485000 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce88009a30 con 0x7fce8c0fddf0 2024-09-13T17:08:20.393 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.390+0000 7fce82ffd640 1 -- 172.21.15.115:0/1750485000 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fce88009b90 con 0x7fce8c0fddf0 2024-09-13T17:08:20.393 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.390+0000 7fce941b0640 1 -- 172.21.15.115:0/1750485000 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce8c0ff710 con 0x7fce8c0fddf0 2024-09-13T17:08:20.393 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.390+0000 7fce82ffd640 1 -- 172.21.15.115:0/1750485000 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce8800f5f0 con 0x7fce8c0fddf0 2024-09-13T17:08:20.393 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.390+0000 7fce941b0640 1 -- 172.21.15.115:0/1750485000 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce8c19d560 con 0x7fce8c0fddf0 2024-09-13T17:08:20.393 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.391+0000 7fce941b0640 1 -- 172.21.15.115:0/1750485000 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce8c0fe1f0 con 0x7fce8c0fddf0 2024-09-13T17:08:20.393 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.392+0000 7fce82ffd640 1 -- 172.21.15.115:0/1750485000 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fce88009d00 con 0x7fce8c0fddf0 2024-09-13T17:08:20.393 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.393+0000 7fce82ffd640 1 --2- 172.21.15.115:0/1750485000 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fce7806cc50 0x7fce7806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:20.394 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.393+0000 7fce82ffd640 1 -- 172.21.15.115:0/1750485000 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fce8808c340 con 0x7fce8c0fddf0 2024-09-13T17:08:20.394 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.393+0000 7fce9174b640 1 --2- 172.21.15.115:0/1750485000 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fce7806cc50 0x7fce7806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:20.394 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.393+0000 7fce9174b640 1 --2- 172.21.15.115:0/1750485000 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fce7806cc50 0x7fce7806f110 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fce8c1004b0 tx=0x7fce7c031400 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:20.398 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.397+0000 7fce82ffd640 1 -- 172.21.15.115:0/1750485000 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fce88056460 con 0x7fce8c0fddf0 2024-09-13T17:08:20.582 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.581+0000 7fce941b0640 1 -- 172.21.15.115:0/1750485000 --> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fce8c105720 con 0x7fce7806cc50 2024-09-13T17:08:20.583 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.582+0000 7fce82ffd640 1 -- 172.21.15.115:0/1750485000 <== mgr.14660 v2:172.21.15.115:6800/1049502673 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7fce8c105720 con 0x7fce7806cc50 2024-09-13T17:08:20.585 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.584+0000 7fce941b0640 1 -- 172.21.15.115:0/1750485000 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fce7806cc50 msgr2=0x7fce7806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:20.585 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.584+0000 7fce941b0640 1 --2- 172.21.15.115:0/1750485000 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fce7806cc50 0x7fce7806f110 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fce8c1004b0 tx=0x7fce7c031400 comp rx=0 tx=0).stop 2024-09-13T17:08:20.585 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.584+0000 7fce941b0640 1 -- 172.21.15.115:0/1750485000 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce8c0fddf0 msgr2=0x7fce8c100730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:20.585 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.584+0000 7fce941b0640 1 --2- 172.21.15.115:0/1750485000 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce8c0fddf0 0x7fce8c100730 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fce8800d8d0 tx=0x7fce8800dd90 comp rx=0 tx=0).stop 2024-09-13T17:08:20.585 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.584+0000 7fce941b0640 1 -- 172.21.15.115:0/1750485000 shutdown_connections 2024-09-13T17:08:20.585 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.584+0000 7fce941b0640 1 --2- 172.21.15.115:0/1750485000 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fce7806cc50 0x7fce7806f110 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:20.586 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.584+0000 7fce941b0640 1 --2- 172.21.15.115:0/1750485000 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce8c100dd0 0x7fce8c0fed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:20.586 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.584+0000 7fce941b0640 1 --2- 172.21.15.115:0/1750485000 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce8c0fddf0 0x7fce8c100730 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:20.586 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.584+0000 7fce941b0640 1 -- 172.21.15.115:0/1750485000 >> 172.21.15.115:0/1750485000 conn(0x7fce8c0f9940 msgr2=0x7fce8c104000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:20.586 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.584+0000 7fce941b0640 1 -- 172.21.15.115:0/1750485000 shutdown_connections 2024-09-13T17:08:20.586 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.584+0000 7fce941b0640 1 -- 172.21.15.115:0/1750485000 wait complete. 2024-09-13T17:08:20.593 INFO:teuthology.orchestra.run.smithi115.stdout:true 2024-09-13T17:08:20.669 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.667+0000 7f26b402e640 1 -- 172.21.15.115:0/1251312052 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26ac0ffc30 msgr2=0x7f26ac1000b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:20.669 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.667+0000 7f26b402e640 1 --2- 172.21.15.115:0/1251312052 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26ac0ffc30 0x7f26ac1000b0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f26a4009880 tx=0x7f26a402a4a0 comp rx=0 tx=0).stop 2024-09-13T17:08:20.669 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.667+0000 7f26b402e640 1 -- 172.21.15.115:0/1251312052 shutdown_connections 2024-09-13T17:08:20.669 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.667+0000 7f26b402e640 1 --2- 172.21.15.115:0/1251312052 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26ac0ffc30 0x7f26ac1000b0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:20.669 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.667+0000 7f26b402e640 1 --2- 172.21.15.115:0/1251312052 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f26ac0fea30 0x7f26ac0fee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:20.670 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.667+0000 7f26b402e640 1 -- 172.21.15.115:0/1251312052 >> 172.21.15.115:0/1251312052 conn(0x7f26ac0fa1c0 msgr2=0x7f26ac0fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:20.670 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.668+0000 7f26b402e640 1 -- 172.21.15.115:0/1251312052 shutdown_connections 2024-09-13T17:08:20.670 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.668+0000 7f26b402e640 1 -- 172.21.15.115:0/1251312052 wait complete. 2024-09-13T17:08:20.670 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.668+0000 7f26b402e640 1 Processor -- start 2024-09-13T17:08:20.670 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.668+0000 7f26b402e640 1 -- start start 2024-09-13T17:08:20.671 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.668+0000 7f26b402e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f26ac0fea30 0x7f26ac1029c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:20.671 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.668+0000 7f26b402e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26ac0ffc30 0x7f26ac101010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:20.671 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.668+0000 7f26b402e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26ac101550 con 0x7f26ac0ffc30 2024-09-13T17:08:20.671 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.668+0000 7f26b402e640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26ac1016c0 con 0x7f26ac0fea30 2024-09-13T17:08:20.671 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.668+0000 7f26b15c9640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26ac0ffc30 0x7f26ac101010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:20.671 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.669+0000 7f26b15c9640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26ac0ffc30 0x7f26ac101010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:37558/0 (socket says 172.21.15.115:37558) 2024-09-13T17:08:20.671 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.669+0000 7f26b15c9640 1 -- 172.21.15.115:0/3520828791 learned_addr learned my addr 172.21.15.115:0/3520828791 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:08:20.671 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.669+0000 7f26b1dca640 1 --2- 172.21.15.115:0/3520828791 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f26ac0fea30 0x7f26ac1029c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:20.671 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.669+0000 7f26b15c9640 1 -- 172.21.15.115:0/3520828791 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f26ac0fea30 msgr2=0x7f26ac1029c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:20.672 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.669+0000 7f26b15c9640 1 --2- 172.21.15.115:0/3520828791 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f26ac0fea30 0x7f26ac1029c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:20.672 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.669+0000 7f26b15c9640 1 -- 172.21.15.115:0/3520828791 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26a4009560 con 0x7f26ac0ffc30 2024-09-13T17:08:20.672 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.669+0000 7f26b15c9640 1 --2- 172.21.15.115:0/3520828791 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26ac0ffc30 0x7f26ac101010 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f26a4031460 tx=0x7f26a40056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:20.672 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.669+0000 7f26aaffd640 1 -- 172.21.15.115:0/3520828791 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f26a4004c60 con 0x7f26ac0ffc30 2024-09-13T17:08:20.672 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.669+0000 7f26b402e640 1 -- 172.21.15.115:0/3520828791 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26ac101940 con 0x7f26ac0ffc30 2024-09-13T17:08:20.672 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.669+0000 7f26aaffd640 1 -- 172.21.15.115:0/3520828791 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f26a4003a90 con 0x7f26ac0ffc30 2024-09-13T17:08:20.672 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.669+0000 7f26aaffd640 1 -- 172.21.15.115:0/3520828791 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f26a4031b10 con 0x7f26ac0ffc30 2024-09-13T17:08:20.672 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.669+0000 7f26b402e640 1 -- 172.21.15.115:0/3520828791 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26ac19d700 con 0x7f26ac0ffc30 2024-09-13T17:08:20.674 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.671+0000 7f26b402e640 1 -- 172.21.15.115:0/3520828791 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26ac0feeb0 con 0x7f26ac0ffc30 2024-09-13T17:08:20.674 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.671+0000 7f26aaffd640 1 -- 172.21.15.115:0/3520828791 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f26a403c470 con 0x7f26ac0ffc30 2024-09-13T17:08:20.674 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.671+0000 7f26aaffd640 1 --2- 172.21.15.115:0/3520828791 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f269406cc50 0x7f269406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:20.674 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.671+0000 7f26aaffd640 1 -- 172.21.15.115:0/3520828791 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f26a40ad860 con 0x7f26ac0ffc30 2024-09-13T17:08:20.674 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.671+0000 7f26b1dca640 1 --2- 172.21.15.115:0/3520828791 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f269406cc50 0x7f269406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:20.674 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.672+0000 7f26b1dca640 1 --2- 172.21.15.115:0/3520828791 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f269406cc50 0x7f269406f110 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f26ac0ffa90 tx=0x7f26a0008040 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:20.677 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.676+0000 7f26aaffd640 1 -- 172.21.15.115:0/3520828791 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f26a4077980 con 0x7f26ac0ffc30 2024-09-13T17:08:20.788 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:20 smithi115 ceph-mon[27708]: pgmap v55: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:08:20.789 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:20 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:08:20.862 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.860+0000 7f26b402e640 1 -- 172.21.15.115:0/3520828791 --> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f26ac0682f0 con 0x7f269406cc50 2024-09-13T17:08:20.863 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.861+0000 7f26aaffd640 1 -- 172.21.15.115:0/3520828791 <== mgr.14660 v2:172.21.15.115:6800/1049502673 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7f26ac0682f0 con 0x7f269406cc50 2024-09-13T17:08:20.865 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.863+0000 7f26b402e640 1 -- 172.21.15.115:0/3520828791 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f269406cc50 msgr2=0x7f269406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:20.865 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.863+0000 7f26b402e640 1 --2- 172.21.15.115:0/3520828791 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f269406cc50 0x7f269406f110 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f26ac0ffa90 tx=0x7f26a0008040 comp rx=0 tx=0).stop 2024-09-13T17:08:20.866 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.863+0000 7f26b402e640 1 -- 172.21.15.115:0/3520828791 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26ac0ffc30 msgr2=0x7f26ac101010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:20.866 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.863+0000 7f26b402e640 1 --2- 172.21.15.115:0/3520828791 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26ac0ffc30 0x7f26ac101010 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f26a4031460 tx=0x7f26a40056e0 comp rx=0 tx=0).stop 2024-09-13T17:08:20.866 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.863+0000 7f26b402e640 1 -- 172.21.15.115:0/3520828791 shutdown_connections 2024-09-13T17:08:20.866 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.863+0000 7f26b402e640 1 --2- 172.21.15.115:0/3520828791 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f269406cc50 0x7f269406f110 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:20.866 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.863+0000 7f26b402e640 1 --2- 172.21.15.115:0/3520828791 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26ac0ffc30 0x7f26ac101010 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:20.866 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.863+0000 7f26b402e640 1 --2- 172.21.15.115:0/3520828791 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f26ac0fea30 0x7f26ac1029c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:20.866 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.863+0000 7f26b402e640 1 -- 172.21.15.115:0/3520828791 >> 172.21.15.115:0/3520828791 conn(0x7f26ac0fa1c0 msgr2=0x7f26ac067be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:20.866 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.863+0000 7f26b402e640 1 -- 172.21.15.115:0/3520828791 shutdown_connections 2024-09-13T17:08:20.866 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.863+0000 7f26b402e640 1 -- 172.21.15.115:0/3520828791 wait complete. 2024-09-13T17:08:20.946 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.944+0000 7f61c8fbf640 1 -- 172.21.15.115:0/434028396 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61c4100630 msgr2=0x7f61c4102a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:20.947 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.944+0000 7f61c8fbf640 1 --2- 172.21.15.115:0/434028396 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61c4100630 0x7f61c4102a20 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f61b40098b0 tx=0x7f61b402a4d0 comp rx=0 tx=0).stop 2024-09-13T17:08:20.947 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.944+0000 7f61c8fbf640 1 -- 172.21.15.115:0/434028396 shutdown_connections 2024-09-13T17:08:20.947 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.944+0000 7f61c8fbf640 1 --2- 172.21.15.115:0/434028396 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61c4102f60 0x7f61c4105350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:20.947 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.944+0000 7f61c8fbf640 1 --2- 172.21.15.115:0/434028396 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61c4100630 0x7f61c4102a20 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:20.947 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.944+0000 7f61c8fbf640 1 -- 172.21.15.115:0/434028396 >> 172.21.15.115:0/434028396 conn(0x7f61c40fa230 msgr2=0x7f61c40fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:20.947 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.944+0000 7f61c8fbf640 1 -- 172.21.15.115:0/434028396 shutdown_connections 2024-09-13T17:08:20.947 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.944+0000 7f61c8fbf640 1 -- 172.21.15.115:0/434028396 wait complete. 2024-09-13T17:08:20.949 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.945+0000 7f61c8fbf640 1 Processor -- start 2024-09-13T17:08:20.949 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.945+0000 7f61c8fbf640 1 -- start start 2024-09-13T17:08:20.949 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.945+0000 7f61c8fbf640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61c4100630 0x7f61c40fff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:20.949 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.945+0000 7f61c8fbf640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61c4102f60 0x7f61c40fe5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:20.949 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.945+0000 7f61c8fbf640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61c40feb20 con 0x7f61c4102f60 2024-09-13T17:08:20.949 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.945+0000 7f61c8fbf640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61c40fec90 con 0x7f61c4100630 2024-09-13T17:08:20.949 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.945+0000 7f61b9d9b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61c4102f60 0x7f61c40fe5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:20.949 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.945+0000 7f61b9d9b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61c4102f60 0x7f61c40fe5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:37574/0 (socket says 172.21.15.115:37574) 2024-09-13T17:08:20.949 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.945+0000 7f61b9d9b640 1 -- 172.21.15.115:0/2530818685 learned_addr learned my addr 172.21.15.115:0/2530818685 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:08:20.949 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.946+0000 7f61c259c640 1 --2- 172.21.15.115:0/2530818685 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61c4100630 0x7f61c40fff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:20.949 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.946+0000 7f61b9d9b640 1 -- 172.21.15.115:0/2530818685 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61c4100630 msgr2=0x7f61c40fff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:20.950 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.946+0000 7f61b9d9b640 1 --2- 172.21.15.115:0/2530818685 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61c4100630 0x7f61c40fff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:20.950 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.946+0000 7f61b9d9b640 1 -- 172.21.15.115:0/2530818685 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61b4009560 con 0x7f61c4102f60 2024-09-13T17:08:20.950 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.946+0000 7f61c259c640 1 --2- 172.21.15.115:0/2530818685 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61c4100630 0x7f61c40fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:08:20.950 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.946+0000 7f61b9d9b640 1 --2- 172.21.15.115:0/2530818685 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61c4102f60 0x7f61c40fe5e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f61ac00d6f0 tx=0x7f61ac00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:20.950 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.946+0000 7f61bbfff640 1 -- 172.21.15.115:0/2530818685 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f61ac009a30 con 0x7f61c4102f60 2024-09-13T17:08:20.950 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.946+0000 7f61c8fbf640 1 -- 172.21.15.115:0/2530818685 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61c40fef70 con 0x7f61c4102f60 2024-09-13T17:08:20.950 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.946+0000 7f61bbfff640 1 -- 172.21.15.115:0/2530818685 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f61ac009b90 con 0x7f61c4102f60 2024-09-13T17:08:20.950 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.946+0000 7f61bbfff640 1 -- 172.21.15.115:0/2530818685 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f61ac00f5d0 con 0x7f61c4102f60 2024-09-13T17:08:20.950 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.946+0000 7f61c8fbf640 1 -- 172.21.15.115:0/2530818685 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61c419d5c0 con 0x7f61c4102f60 2024-09-13T17:08:20.951 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.947+0000 7f61c8fbf640 1 -- 172.21.15.115:0/2530818685 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61c4108680 con 0x7f61c4102f60 2024-09-13T17:08:20.951 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.948+0000 7f61bbfff640 1 -- 172.21.15.115:0/2530818685 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f61ac009d00 con 0x7f61c4102f60 2024-09-13T17:08:20.951 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.948+0000 7f61bbfff640 1 --2- 172.21.15.115:0/2530818685 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f61b006cc50 0x7f61b006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:20.951 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.948+0000 7f61bbfff640 1 -- 172.21.15.115:0/2530818685 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f61ac08c390 con 0x7f61c4102f60 2024-09-13T17:08:20.951 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.948+0000 7f61c259c640 1 --2- 172.21.15.115:0/2530818685 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f61b006cc50 0x7f61b006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:20.951 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.949+0000 7f61c259c640 1 --2- 172.21.15.115:0/2530818685 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f61b006cc50 0x7f61b006f110 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f61b4031460 tx=0x7f61b4005de0 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:20.955 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:20.952+0000 7f61bbfff640 1 -- 172.21.15.115:0/2530818685 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f61ac0564b0 con 0x7f61c4102f60 2024-09-13T17:08:21.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:20 smithi195 ceph-mon[34981]: pgmap v55: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:08:21.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:20 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:08:21.127 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.125+0000 7f61c8fbf640 1 -- 172.21.15.115:0/2530818685 --> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f61c4103980 con 0x7f61b006cc50 2024-09-13T17:08:21.137 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.135+0000 7f61bbfff640 1 -- 172.21.15.115:0/2530818685 <== mgr.14660 v2:172.21.15.115:6800/1049502673 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f61c4103980 con 0x7f61b006cc50 2024-09-13T17:08:21.137 INFO:teuthology.orchestra.run.smithi115.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T17:08:21.137 INFO:teuthology.orchestra.run.smithi115.stdout:alertmanager.smithi115 smithi115 *:9093,9094 running (11s) 6s ago 10m 16.0M - 0.25.0 c8568f914cd2 d56b91240fe1 2024-09-13T17:08:21.137 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-exporter.smithi115 smithi115 running (10m) 6s ago 10m 8086k - 18.2.4-843-g2c01458a c129f5a2fd4e 0f1eebeaf9bb 2024-09-13T17:08:21.137 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-exporter.smithi195 smithi195 running (9m) 42s ago 9m 7600k - 18.2.4-843-g2c01458a c129f5a2fd4e 6d05bafbac8a 2024-09-13T17:08:21.137 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi115 smithi115 running (10m) 6s ago 10m 6899k - 18.2.4-843-g2c01458a c129f5a2fd4e 624a903fec23 2024-09-13T17:08:21.138 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi195 smithi195 running (9m) 42s ago 9m 6891k - 18.2.4-843-g2c01458a c129f5a2fd4e 42e6ce26130d 2024-09-13T17:08:21.138 INFO:teuthology.orchestra.run.smithi115.stdout:grafana.smithi115 smithi115 *:3000 running (8m) 6s ago 10m 86.7M - 9.4.7 954c08fa6188 41183f0705c8 2024-09-13T17:08:21.138 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi115.hbtxod smithi115 running (5m) 6s ago 5m 99.0M - 18.2.4-843-g2c01458a c129f5a2fd4e 12b4f4874491 2024-09-13T17:08:21.138 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi115.ijznvr smithi115 running (4m) 6s ago 4m 167M - 18.2.4-843-g2c01458a c129f5a2fd4e 2d552564a9f4 2024-09-13T17:08:21.138 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi195.aevvgz smithi195 running (4m) 42s ago 4m 16.1M - 18.2.4-843-g2c01458a c129f5a2fd4e 299b9ad657c9 2024-09-13T17:08:21.138 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi195.qzghxj smithi195 running (4m) 42s ago 4m 14.3M - 18.2.4-843-g2c01458a c129f5a2fd4e fb16b16181ff 2024-09-13T17:08:21.138 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi115.hetcni smithi115 *:8443,9283,8765 running (117s) 6s ago 11m 486M - 18.2.4-860-g6c6b083f 8a91f241d7d4 b945dbde1934 2024-09-13T17:08:21.138 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi195.hjjifz smithi195 *:8443,9283,8765 running (61s) 42s ago 9m 438M - 18.2.4-860-g6c6b083f 8a91f241d7d4 17bccdfbcae1 2024-09-13T17:08:21.138 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi115 smithi115 running (11m) 6s ago 11m 56.3M 2048M 18.2.4-843-g2c01458a c129f5a2fd4e 202375d41e68 2024-09-13T17:08:21.138 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi195 smithi195 running (9m) 42s ago 9m 42.7M 2048M 18.2.4-843-g2c01458a c129f5a2fd4e 0f54c30e5970 2024-09-13T17:08:21.138 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi115 smithi115 *:9100 running (50s) 6s ago 10m 16.4M - 1.5.0 0da6a335fe13 26fb6f9844b5 2024-09-13T17:08:21.138 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi195 smithi195 *:9100 running (46s) 42s ago 9m 3581k - 1.5.0 0da6a335fe13 6d38e798fb16 2024-09-13T17:08:21.138 INFO:teuthology.orchestra.run.smithi115.stdout:osd.0 smithi115 running (8m) 6s ago 8m 245M 1216M 18.2.4-843-g2c01458a c129f5a2fd4e 8a8ad231962e 2024-09-13T17:08:21.138 INFO:teuthology.orchestra.run.smithi115.stdout:osd.1 smithi115 running (8m) 6s ago 8m 264M 1216M 18.2.4-843-g2c01458a c129f5a2fd4e 3fbc020102a0 2024-09-13T17:08:21.139 INFO:teuthology.orchestra.run.smithi115.stdout:osd.2 smithi115 running (7m) 6s ago 7m 223M 1216M 18.2.4-843-g2c01458a c129f5a2fd4e 7c623823e920 2024-09-13T17:08:21.139 INFO:teuthology.orchestra.run.smithi115.stdout:osd.3 smithi195 running (7m) 42s ago 7m 293M 2240M 18.2.4-843-g2c01458a c129f5a2fd4e 10ea833fd5c5 2024-09-13T17:08:21.139 INFO:teuthology.orchestra.run.smithi115.stdout:osd.4 smithi195 running (6m) 42s ago 6m 263M 2240M 18.2.4-843-g2c01458a c129f5a2fd4e 4bbc3acb9aff 2024-09-13T17:08:21.139 INFO:teuthology.orchestra.run.smithi115.stdout:osd.5 smithi195 running (6m) 42s ago 6m 234M 2240M 18.2.4-843-g2c01458a c129f5a2fd4e 4bd1b3a232d0 2024-09-13T17:08:21.139 INFO:teuthology.orchestra.run.smithi115.stdout:prometheus.smithi115 smithi115 *:9095 running (29s) 6s ago 9m 44.9M - 2.43.0 a07b618ecd1d e03fb39f6b76 2024-09-13T17:08:21.140 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.137+0000 7f61c8fbf640 1 -- 172.21.15.115:0/2530818685 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f61b006cc50 msgr2=0x7f61b006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:21.140 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.137+0000 7f61c8fbf640 1 --2- 172.21.15.115:0/2530818685 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f61b006cc50 0x7f61b006f110 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f61b4031460 tx=0x7f61b4005de0 comp rx=0 tx=0).stop 2024-09-13T17:08:21.140 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.137+0000 7f61c8fbf640 1 -- 172.21.15.115:0/2530818685 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61c4102f60 msgr2=0x7f61c40fe5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:21.140 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.137+0000 7f61c8fbf640 1 --2- 172.21.15.115:0/2530818685 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61c4102f60 0x7f61c40fe5e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f61ac00d6f0 tx=0x7f61ac00dbb0 comp rx=0 tx=0).stop 2024-09-13T17:08:21.140 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.137+0000 7f61c8fbf640 1 -- 172.21.15.115:0/2530818685 shutdown_connections 2024-09-13T17:08:21.140 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.137+0000 7f61c8fbf640 1 --2- 172.21.15.115:0/2530818685 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f61b006cc50 0x7f61b006f110 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:21.140 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.137+0000 7f61c8fbf640 1 --2- 172.21.15.115:0/2530818685 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61c4102f60 0x7f61c40fe5e0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:21.140 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.137+0000 7f61c8fbf640 1 --2- 172.21.15.115:0/2530818685 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61c4100630 0x7f61c40fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:21.140 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.137+0000 7f61c8fbf640 1 -- 172.21.15.115:0/2530818685 >> 172.21.15.115:0/2530818685 conn(0x7f61c40fa230 msgr2=0x7f61c40fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:21.141 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.138+0000 7f61c8fbf640 1 -- 172.21.15.115:0/2530818685 shutdown_connections 2024-09-13T17:08:21.141 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.138+0000 7f61c8fbf640 1 -- 172.21.15.115:0/2530818685 wait complete. 2024-09-13T17:08:21.222 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.218+0000 7f0cc7a43640 1 -- 172.21.15.115:0/349458156 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0cc00fea30 msgr2=0x7f0cc00fee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:21.222 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.218+0000 7f0cc7a43640 1 --2- 172.21.15.115:0/349458156 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0cc00fea30 0x7f0cc00fee30 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f0cb0009880 tx=0x7f0cb002a4a0 comp rx=0 tx=0).stop 2024-09-13T17:08:21.222 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.218+0000 7f0cc7a43640 1 -- 172.21.15.115:0/349458156 shutdown_connections 2024-09-13T17:08:21.223 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.218+0000 7f0cc7a43640 1 --2- 172.21.15.115:0/349458156 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0cc00ffc30 0x7f0cc01000b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:21.223 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.218+0000 7f0cc7a43640 1 --2- 172.21.15.115:0/349458156 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0cc00fea30 0x7f0cc00fee30 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:21.223 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.218+0000 7f0cc7a43640 1 -- 172.21.15.115:0/349458156 >> 172.21.15.115:0/349458156 conn(0x7f0cc00fa1c0 msgr2=0x7f0cc00fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:21.223 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.219+0000 7f0cc7a43640 1 -- 172.21.15.115:0/349458156 shutdown_connections 2024-09-13T17:08:21.223 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.219+0000 7f0cc7a43640 1 -- 172.21.15.115:0/349458156 wait complete. 2024-09-13T17:08:21.223 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.219+0000 7f0cc7a43640 1 Processor -- start 2024-09-13T17:08:21.223 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.219+0000 7f0cc7a43640 1 -- start start 2024-09-13T17:08:21.223 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.219+0000 7f0cc7a43640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0cc00fea30 0x7f0cc0195590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:21.223 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.219+0000 7f0cc7a43640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0cc00ffc30 0x7f0cc0195ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:21.223 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.219+0000 7f0cc7a43640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc01960a0 con 0x7f0cc00ffc30 2024-09-13T17:08:21.223 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.219+0000 7f0cc7a43640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc0196210 con 0x7f0cc00fea30 2024-09-13T17:08:21.223 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.219+0000 7f0cc4fde640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0cc00ffc30 0x7f0cc0195ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:21.223 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.219+0000 7f0cc4fde640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0cc00ffc30 0x7f0cc0195ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:37598/0 (socket says 172.21.15.115:37598) 2024-09-13T17:08:21.224 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.219+0000 7f0cc4fde640 1 -- 172.21.15.115:0/2103648516 learned_addr learned my addr 172.21.15.115:0/2103648516 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:08:21.224 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.220+0000 7f0cc57df640 1 --2- 172.21.15.115:0/2103648516 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0cc00fea30 0x7f0cc0195590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:21.224 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.220+0000 7f0cc4fde640 1 -- 172.21.15.115:0/2103648516 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0cc00fea30 msgr2=0x7f0cc0195590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:21.224 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.220+0000 7f0cc4fde640 1 --2- 172.21.15.115:0/2103648516 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0cc00fea30 0x7f0cc0195590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:21.224 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.220+0000 7f0cc4fde640 1 -- 172.21.15.115:0/2103648516 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cb0009560 con 0x7f0cc00ffc30 2024-09-13T17:08:21.224 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.220+0000 7f0cc57df640 1 --2- 172.21.15.115:0/2103648516 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0cc00fea30 0x7f0cc0195590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:08:21.224 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.220+0000 7f0cc4fde640 1 --2- 172.21.15.115:0/2103648516 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0cc00ffc30 0x7f0cc0195ad0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f0cb400d720 tx=0x7f0cb400dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:21.224 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.220+0000 7f0cbe7fc640 1 -- 172.21.15.115:0/2103648516 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0cb40051f0 con 0x7f0cc00ffc30 2024-09-13T17:08:21.224 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.220+0000 7f0cc7a43640 1 -- 172.21.15.115:0/2103648516 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cc019acb0 con 0x7f0cc00ffc30 2024-09-13T17:08:21.224 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.220+0000 7f0cbe7fc640 1 -- 172.21.15.115:0/2103648516 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0cb4009820 con 0x7f0cc00ffc30 2024-09-13T17:08:21.224 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.220+0000 7f0cbe7fc640 1 -- 172.21.15.115:0/2103648516 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0cb4004d40 con 0x7f0cc00ffc30 2024-09-13T17:08:21.224 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.220+0000 7f0cc7a43640 1 -- 172.21.15.115:0/2103648516 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cc019b280 con 0x7f0cc00ffc30 2024-09-13T17:08:21.225 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.221+0000 7f0cc7a43640 1 -- 172.21.15.115:0/2103648516 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cc0068840 con 0x7f0cc00ffc30 2024-09-13T17:08:21.226 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.222+0000 7f0cbe7fc640 1 -- 172.21.15.115:0/2103648516 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f0cb4009990 con 0x7f0cc00ffc30 2024-09-13T17:08:21.226 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.222+0000 7f0cbe7fc640 1 --2- 172.21.15.115:0/2103648516 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f0ca806cc50 0x7f0ca806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:21.226 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.222+0000 7f0cbe7fc640 1 -- 172.21.15.115:0/2103648516 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f0cb408c0c0 con 0x7f0cc00ffc30 2024-09-13T17:08:21.226 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.222+0000 7f0cc57df640 1 --2- 172.21.15.115:0/2103648516 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f0ca806cc50 0x7f0ca806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:21.226 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.223+0000 7f0cc57df640 1 --2- 172.21.15.115:0/2103648516 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f0ca806cc50 0x7f0ca806f110 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0cb0000c00 tx=0x7f0cb0031400 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:21.229 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.227+0000 7f0cbe7fc640 1 -- 172.21.15.115:0/2103648516 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f0cb40561e0 con 0x7f0cc00ffc30 2024-09-13T17:08:21.463 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.461+0000 7f0cc7a43640 1 -- 172.21.15.115:0/2103648516 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0cc019b470 con 0x7f0cc00ffc30 2024-09-13T17:08:21.463 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.461+0000 7f0cbe7fc640 1 -- 172.21.15.115:0/2103648516 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+733 (secure 0 0 0) 0x7f0cc019b470 con 0x7f0cc00ffc30 2024-09-13T17:08:21.463 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-13T17:08:21.464 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": { 2024-09-13T17:08:21.464 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-843-g2c01458a (2c01458affee2b2435cd231b6e392435c1c21661) reef (stable)": 2 2024-09-13T17:08:21.464 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T17:08:21.464 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": { 2024-09-13T17:08:21.464 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 2 2024-09-13T17:08:21.464 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T17:08:21.464 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": { 2024-09-13T17:08:21.464 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-843-g2c01458a (2c01458affee2b2435cd231b6e392435c1c21661) reef (stable)": 6 2024-09-13T17:08:21.464 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T17:08:21.464 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": { 2024-09-13T17:08:21.464 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-843-g2c01458a (2c01458affee2b2435cd231b6e392435c1c21661) reef (stable)": 4 2024-09-13T17:08:21.464 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T17:08:21.464 INFO:teuthology.orchestra.run.smithi115.stdout: "overall": { 2024-09-13T17:08:21.465 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-843-g2c01458a (2c01458affee2b2435cd231b6e392435c1c21661) reef (stable)": 12, 2024-09-13T17:08:21.465 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 2 2024-09-13T17:08:21.465 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-13T17:08:21.465 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-13T17:08:21.465 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.463+0000 7f0cc7a43640 1 -- 172.21.15.115:0/2103648516 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f0ca806cc50 msgr2=0x7f0ca806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:21.466 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.463+0000 7f0cc7a43640 1 --2- 172.21.15.115:0/2103648516 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f0ca806cc50 0x7f0ca806f110 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0cb0000c00 tx=0x7f0cb0031400 comp rx=0 tx=0).stop 2024-09-13T17:08:21.466 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.463+0000 7f0cc7a43640 1 -- 172.21.15.115:0/2103648516 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0cc00ffc30 msgr2=0x7f0cc0195ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:21.466 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.463+0000 7f0cc7a43640 1 --2- 172.21.15.115:0/2103648516 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0cc00ffc30 0x7f0cc0195ad0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f0cb400d720 tx=0x7f0cb400dbe0 comp rx=0 tx=0).stop 2024-09-13T17:08:21.466 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.463+0000 7f0cc7a43640 1 -- 172.21.15.115:0/2103648516 shutdown_connections 2024-09-13T17:08:21.466 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.463+0000 7f0cc7a43640 1 --2- 172.21.15.115:0/2103648516 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f0ca806cc50 0x7f0ca806f110 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:21.466 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.463+0000 7f0cc7a43640 1 --2- 172.21.15.115:0/2103648516 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0cc00ffc30 0x7f0cc0195ad0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:21.466 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.463+0000 7f0cc7a43640 1 --2- 172.21.15.115:0/2103648516 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0cc00fea30 0x7f0cc0195590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:21.466 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.463+0000 7f0cc7a43640 1 -- 172.21.15.115:0/2103648516 >> 172.21.15.115:0/2103648516 conn(0x7f0cc00fa1c0 msgr2=0x7f0cc0102e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:21.466 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.463+0000 7f0cc7a43640 1 -- 172.21.15.115:0/2103648516 shutdown_connections 2024-09-13T17:08:21.466 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.464+0000 7f0cc7a43640 1 -- 172.21.15.115:0/2103648516 wait complete. 2024-09-13T17:08:21.550 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.545+0000 7f8aa27cd640 1 -- 172.21.15.115:0/2404579079 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a9c0fe220 msgr2=0x7f8a9c0fe620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:21.550 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.545+0000 7f8aa27cd640 1 --2- 172.21.15.115:0/2404579079 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a9c0fe220 0x7f8a9c0fe620 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c00a990 tx=0x7f8a8c02b7d0 comp rx=0 tx=0).stop 2024-09-13T17:08:21.550 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.545+0000 7f8aa27cd640 1 -- 172.21.15.115:0/2404579079 shutdown_connections 2024-09-13T17:08:21.550 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.545+0000 7f8aa27cd640 1 --2- 172.21.15.115:0/2404579079 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a9c0ff420 0x7f8a9c0ff8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:21.550 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.545+0000 7f8aa27cd640 1 --2- 172.21.15.115:0/2404579079 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a9c0fe220 0x7f8a9c0fe620 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:21.550 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.545+0000 7f8aa27cd640 1 -- 172.21.15.115:0/2404579079 >> 172.21.15.115:0/2404579079 conn(0x7f8a9c0f99b0 msgr2=0x7f8a9c0fbdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:21.550 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.545+0000 7f8aa27cd640 1 -- 172.21.15.115:0/2404579079 shutdown_connections 2024-09-13T17:08:21.550 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.545+0000 7f8aa27cd640 1 -- 172.21.15.115:0/2404579079 wait complete. 2024-09-13T17:08:21.550 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.545+0000 7f8aa27cd640 1 Processor -- start 2024-09-13T17:08:21.550 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.545+0000 7f8aa27cd640 1 -- start start 2024-09-13T17:08:21.551 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.546+0000 7f8aa27cd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a9c0fe220 0x7f8a9c1955b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:21.551 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.546+0000 7f8aa27cd640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a9c0ff420 0x7f8a9c195af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:21.551 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.546+0000 7f8aa27cd640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a9c1960c0 con 0x7f8a9c0fe220 2024-09-13T17:08:21.551 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.546+0000 7f8aa27cd640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a9c196230 con 0x7f8a9c0ff420 2024-09-13T17:08:21.551 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.546+0000 7f8a9bfff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a9c0fe220 0x7f8a9c1955b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:21.551 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.546+0000 7f8a9bfff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a9c0fe220 0x7f8a9c1955b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:37626/0 (socket says 172.21.15.115:37626) 2024-09-13T17:08:21.551 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.546+0000 7f8a9bfff640 1 -- 172.21.15.115:0/997324240 learned_addr learned my addr 172.21.15.115:0/997324240 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:08:21.551 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.546+0000 7f8a9b7fe640 1 --2- 172.21.15.115:0/997324240 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a9c0ff420 0x7f8a9c195af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:21.551 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.546+0000 7f8a9bfff640 1 -- 172.21.15.115:0/997324240 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a9c0ff420 msgr2=0x7f8a9c195af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:21.551 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.546+0000 7f8a9bfff640 1 --2- 172.21.15.115:0/997324240 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a9c0ff420 0x7f8a9c195af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:21.551 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.546+0000 7f8a9bfff640 1 -- 172.21.15.115:0/997324240 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a8c00a670 con 0x7f8a9c0fe220 2024-09-13T17:08:21.551 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.546+0000 7f8a9bfff640 1 --2- 172.21.15.115:0/997324240 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a9c0fe220 0x7f8a9c1955b0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c000c00 tx=0x7f8a8c004250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:21.552 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.546+0000 7f8a997fa640 1 -- 172.21.15.115:0/997324240 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a8c0039d0 con 0x7f8a9c0fe220 2024-09-13T17:08:21.552 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.546+0000 7f8a997fa640 1 -- 172.21.15.115:0/997324240 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8a8c004500 con 0x7f8a9c0fe220 2024-09-13T17:08:21.552 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.547+0000 7f8aa27cd640 1 -- 172.21.15.115:0/997324240 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a9c19ac70 con 0x7f8a9c0fe220 2024-09-13T17:08:21.552 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.547+0000 7f8a997fa640 1 -- 172.21.15.115:0/997324240 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a8c034460 con 0x7f8a9c0fe220 2024-09-13T17:08:21.552 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.547+0000 7f8aa27cd640 1 -- 172.21.15.115:0/997324240 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a9c19b1c0 con 0x7f8a9c0fe220 2024-09-13T17:08:21.552 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.548+0000 7f8aa27cd640 1 -- 172.21.15.115:0/997324240 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a9c106450 con 0x7f8a9c0fe220 2024-09-13T17:08:21.553 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.548+0000 7f8a997fa640 1 -- 172.21.15.115:0/997324240 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f8a8c040800 con 0x7f8a9c0fe220 2024-09-13T17:08:21.553 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.549+0000 7f8a997fa640 1 --2- 172.21.15.115:0/997324240 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f8a8406cc60 0x7f8a8406f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:21.553 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.549+0000 7f8a997fa640 1 -- 172.21.15.115:0/997324240 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f8a8c0ae0a0 con 0x7f8a9c0fe220 2024-09-13T17:08:21.553 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.549+0000 7f8a9b7fe640 1 --2- 172.21.15.115:0/997324240 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f8a8406cc60 0x7f8a8406f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:21.553 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.549+0000 7f8a9b7fe640 1 --2- 172.21.15.115:0/997324240 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f8a8406cc60 0x7f8a8406f120 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c196ad0 tx=0x7f8a90008040 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:21.555 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.553+0000 7f8a997fa640 1 -- 172.21.15.115:0/997324240 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f8a8c0781c0 con 0x7f8a9c0fe220 2024-09-13T17:08:21.741 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.739+0000 7f8aa27cd640 1 -- 172.21.15.115:0/997324240 --> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8a9c19b350 con 0x7f8a8406cc60 2024-09-13T17:08:21.742 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.740+0000 7f8a997fa640 1 -- 172.21.15.115:0/997324240 <== mgr.14660 v2:172.21.15.115:6800/1049502673 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7f8a9c19b350 con 0x7f8a8406cc60 2024-09-13T17:08:21.743 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-13T17:08:21.743 INFO:teuthology.orchestra.run.smithi115.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256", 2024-09-13T17:08:21.743 INFO:teuthology.orchestra.run.smithi115.stdout: "in_progress": true, 2024-09-13T17:08:21.743 INFO:teuthology.orchestra.run.smithi115.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-13T17:08:21.743 INFO:teuthology.orchestra.run.smithi115.stdout: "services_complete": [ 2024-09-13T17:08:21.743 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr" 2024-09-13T17:08:21.743 INFO:teuthology.orchestra.run.smithi115.stdout: ], 2024-09-13T17:08:21.743 INFO:teuthology.orchestra.run.smithi115.stdout: "progress": "2/2 daemons upgraded", 2024-09-13T17:08:21.743 INFO:teuthology.orchestra.run.smithi115.stdout: "message": "Currently upgrading grafana daemons", 2024-09-13T17:08:21.743 INFO:teuthology.orchestra.run.smithi115.stdout: "is_paused": false 2024-09-13T17:08:21.743 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-13T17:08:21.745 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.742+0000 7f8aa27cd640 1 -- 172.21.15.115:0/997324240 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f8a8406cc60 msgr2=0x7f8a8406f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:21.745 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.742+0000 7f8aa27cd640 1 --2- 172.21.15.115:0/997324240 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f8a8406cc60 0x7f8a8406f120 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c196ad0 tx=0x7f8a90008040 comp rx=0 tx=0).stop 2024-09-13T17:08:21.745 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.742+0000 7f8aa27cd640 1 -- 172.21.15.115:0/997324240 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a9c0fe220 msgr2=0x7f8a9c1955b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:21.745 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.742+0000 7f8aa27cd640 1 --2- 172.21.15.115:0/997324240 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a9c0fe220 0x7f8a9c1955b0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c000c00 tx=0x7f8a8c004250 comp rx=0 tx=0).stop 2024-09-13T17:08:21.745 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.742+0000 7f8aa27cd640 1 -- 172.21.15.115:0/997324240 shutdown_connections 2024-09-13T17:08:21.745 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.742+0000 7f8aa27cd640 1 --2- 172.21.15.115:0/997324240 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f8a8406cc60 0x7f8a8406f120 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:21.745 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.742+0000 7f8aa27cd640 1 --2- 172.21.15.115:0/997324240 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a9c0ff420 0x7f8a9c195af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:21.745 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.742+0000 7f8aa27cd640 1 --2- 172.21.15.115:0/997324240 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a9c0fe220 0x7f8a9c1955b0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:21.745 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.742+0000 7f8aa27cd640 1 -- 172.21.15.115:0/997324240 >> 172.21.15.115:0/997324240 conn(0x7f8a9c0f99b0 msgr2=0x7f8a9c102650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:21.745 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.742+0000 7f8aa27cd640 1 -- 172.21.15.115:0/997324240 shutdown_connections 2024-09-13T17:08:21.746 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:21.743+0000 7f8aa27cd640 1 -- 172.21.15.115:0/997324240 wait complete. 2024-09-13T17:08:22.022 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:21 smithi195 ceph-mon[34981]: Upgrade: Updating grafana.smithi115 2024-09-13T17:08:22.022 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:21 smithi195 ceph-mon[34981]: Deploying daemon grafana.smithi115 on smithi115 2024-09-13T17:08:22.022 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:21 smithi195 ceph-mon[34981]: from='client.14754 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:08:22.022 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:21 smithi195 ceph-mon[34981]: from='client.14758 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:08:22.022 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:21 smithi195 ceph-mon[34981]: from='client.? 172.21.15.115:0/2103648516' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:08:22.030 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:21 smithi115 ceph-mon[27708]: Upgrade: Updating grafana.smithi115 2024-09-13T17:08:22.030 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:21 smithi115 ceph-mon[27708]: Deploying daemon grafana.smithi115 on smithi115 2024-09-13T17:08:22.030 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:21 smithi115 ceph-mon[27708]: from='client.14754 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:08:22.030 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:21 smithi115 ceph-mon[27708]: from='client.14758 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:08:22.030 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:21 smithi115 ceph-mon[27708]: from='client.? 172.21.15.115:0/2103648516' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:08:23.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:22 smithi195 ceph-mon[34981]: from='client.14762 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:08:23.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:22 smithi195 ceph-mon[34981]: pgmap v56: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:08:23.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:22 smithi195 ceph-mon[34981]: from='client.14770 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:08:23.123 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:22 smithi115 ceph-mon[27708]: from='client.14762 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:08:23.123 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:22 smithi115 ceph-mon[27708]: pgmap v56: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:08:23.123 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:22 smithi115 ceph-mon[27708]: from='client.14770 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:08:25.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:24 smithi195 ceph-mon[34981]: pgmap v57: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:08:25.078 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:24 smithi115 ceph-mon[27708]: pgmap v57: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:08:26.428 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:26 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:08:26.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:26 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:08:26.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:26 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:08:26.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:26 smithi115 ceph-mon[27708]: pgmap v58: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:08:26.576 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:26 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:08:26.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:26 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:08:26.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:26 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:08:26.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:26 smithi195 ceph-mon[34981]: pgmap v58: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:08:28.791 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:28 smithi115 ceph-mon[27708]: pgmap v59: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:08:28.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:28 smithi195 ceph-mon[34981]: pgmap v59: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:08:30.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:30 smithi195 ceph-mon[34981]: pgmap v60: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:08:30.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:30 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:08:30.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:30 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:08:30.903 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:30 smithi115 ceph-mon[27708]: pgmap v60: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:08:30.904 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:30 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:08:30.904 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:30 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:08:31.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:31 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:08:31.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:31 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:08:31.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:31 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:08:31.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:31 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:08:32.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:32 smithi195 ceph-mon[34981]: pgmap v61: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:08:32.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:32 smithi115 ceph-mon[27708]: pgmap v61: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:08:34.864 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:34 smithi115 ceph-mon[27708]: pgmap v62: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:08:34.864 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:34 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:08:34.864 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:34 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:08:34.865 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:34 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:08:34.865 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:34 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:08:34.865 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:34 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:08:34.865 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:34 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T17:08:34.865 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:34 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:08:34.865 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:34 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:08:34.865 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:34 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:08:34.865 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:34 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:08:34.865 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:34 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:08:34.865 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:34 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:08:34.865 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:34 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:08:34.865 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:34 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:08:34.865 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:34 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:08:34.866 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:34 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:08:34.866 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:34 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:08:34.866 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:34 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:08:34.866 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:34 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:08:34.866 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:34 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:08:34.866 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:34 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:08:34.866 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:34 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-13T17:08:34.866 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:34 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-13T17:08:34.866 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:34 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T17:08:34.867 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:34 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-13T17:08:34.867 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:34 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-13T17:08:34.867 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:34 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-13T17:08:34.867 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:34 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-13T17:08:34.867 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:34 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-13T17:08:34.867 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:34 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-13T17:08:34.867 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:34 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-13T17:08:34.867 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:34 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-13T17:08:34.867 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:34 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T17:08:34.868 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:34 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-13T17:08:34.868 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:34 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-13T17:08:34.868 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:34 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-13T17:08:34.868 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:34 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-13T17:08:34.868 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:34 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-13T17:08:34.868 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:34 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-13T17:08:34.868 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:34 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-13T17:08:34.868 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:34 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T17:08:34.868 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:34 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T17:08:34.868 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:34 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T17:08:34.868 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:34 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T17:08:34.869 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:34 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T17:08:34.869 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:34 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T17:08:34.869 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:34 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-09-13T17:08:34.869 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:34 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]': finished 2024-09-13T17:08:34.869 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:34 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-13T17:08:34.869 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:34 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-13T17:08:34.869 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:34 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:08:34.869 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:34 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:08:34.869 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:34 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:08:34.869 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:34 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:08:34.869 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:34 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:08:34.870 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:34 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:08:34.870 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:34 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:08:34.870 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:34 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:08:34.870 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:34 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:08:34.870 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:34 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:08:35.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:34 smithi195 ceph-mon[34981]: pgmap v62: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:08:35.328 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:34 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:08:35.328 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:34 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:08:35.328 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:34 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:08:35.328 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:34 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:08:35.328 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:34 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:08:35.328 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:34 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T17:08:35.328 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:34 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:08:35.328 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:34 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:08:35.328 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:34 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:08:35.328 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:34 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:08:35.328 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:34 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:08:35.329 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:34 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:08:35.329 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:34 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:08:35.329 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:34 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:08:35.329 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:34 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:08:35.329 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:34 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:08:35.329 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:34 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:08:35.329 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:34 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:08:35.329 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:34 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:08:35.329 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:34 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:08:35.329 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:34 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:08:35.329 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:34 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-13T17:08:35.329 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:34 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-13T17:08:35.329 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:34 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T17:08:35.330 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:34 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-13T17:08:35.330 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:34 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-13T17:08:35.330 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:34 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-13T17:08:35.330 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:34 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-13T17:08:35.330 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:34 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-13T17:08:35.330 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:34 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-13T17:08:35.330 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:34 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-13T17:08:35.330 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:34 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-13T17:08:35.330 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:34 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T17:08:35.330 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:34 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-13T17:08:35.330 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:34 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-13T17:08:35.330 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:34 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-13T17:08:35.330 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:34 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-13T17:08:35.331 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:34 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-13T17:08:35.331 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:34 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-13T17:08:35.331 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:34 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-13T17:08:35.331 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:34 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T17:08:35.331 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:34 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T17:08:35.331 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:34 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T17:08:35.331 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:34 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T17:08:35.331 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:34 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T17:08:35.331 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:34 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T17:08:35.331 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:34 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-09-13T17:08:35.331 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:34 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]': finished 2024-09-13T17:08:35.331 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:34 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-13T17:08:35.331 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:34 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-13T17:08:35.331 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:34 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:08:35.332 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:34 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:08:35.332 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:34 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:08:35.332 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:34 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:08:35.332 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:34 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:08:35.332 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:34 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:08:35.332 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:34 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:08:35.332 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:34 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:08:35.332 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:34 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:08:35.332 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:34 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:08:36.180 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:35 smithi115 ceph-mon[27708]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T17:08:36.180 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:35 smithi115 ceph-mon[27708]: Upgrade: Finalizing container_image settings 2024-09-13T17:08:36.180 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:35 smithi115 ceph-mon[27708]: Upgrade: Complete! 2024-09-13T17:08:36.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:35 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:08:36.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:35 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:08:36.232 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:35 smithi195 ceph-mon[34981]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T17:08:36.233 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:35 smithi195 ceph-mon[34981]: Upgrade: Finalizing container_image settings 2024-09-13T17:08:36.233 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:35 smithi195 ceph-mon[34981]: Upgrade: Complete! 2024-09-13T17:08:36.233 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:35 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:08:36.233 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:35 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:08:37.178 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:36 smithi115 ceph-mon[27708]: pgmap v63: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:08:37.227 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:36 smithi195 ceph-mon[34981]: pgmap v63: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:08:38.178 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:37 smithi115 ceph-mon[27708]: pgmap v64: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:08:38.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:37 smithi195 ceph-mon[34981]: pgmap v64: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:08:40.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:40 smithi195 ceph-mon[34981]: pgmap v65: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:08:40.928 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:40 smithi115 ceph-mon[27708]: pgmap v65: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:08:42.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:42 smithi195 ceph-mon[34981]: pgmap v66: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:08:42.730 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:42 smithi115 ceph-mon[27708]: pgmap v66: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:08:44.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:44 smithi195 ceph-mon[34981]: pgmap v67: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:08:44.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:44 smithi115 ceph-mon[27708]: pgmap v67: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:08:46.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:46 smithi195 ceph-mon[34981]: pgmap v68: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:08:46.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:46 smithi115 ceph-mon[27708]: pgmap v68: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:08:48.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:48 smithi195 ceph-mon[34981]: pgmap v69: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:08:48.928 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:48 smithi115 ceph-mon[27708]: pgmap v69: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:08:50.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:50 smithi195 ceph-mon[34981]: pgmap v70: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:08:50.928 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:50 smithi115 ceph-mon[27708]: pgmap v70: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:08:51.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:51 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:08:51.839 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:51 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:08:51.841 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:51.837+0000 7fb92d099640 1 -- 172.21.15.115:0/2785295961 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb928102f60 msgr2=0x7fb928105350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:51.841 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:51.837+0000 7fb92d099640 1 --2- 172.21.15.115:0/2785295961 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb928102f60 0x7fb928105350 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fb91c0098b0 tx=0x7fb91c02a4d0 comp rx=0 tx=0).stop 2024-09-13T17:08:51.841 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:51.838+0000 7fb92d099640 1 -- 172.21.15.115:0/2785295961 shutdown_connections 2024-09-13T17:08:51.841 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:51.838+0000 7fb92d099640 1 --2- 172.21.15.115:0/2785295961 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb928102f60 0x7fb928105350 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:51.841 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:51.838+0000 7fb92d099640 1 --2- 172.21.15.115:0/2785295961 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb928100630 0x7fb928102a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:51.842 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:51.838+0000 7fb92d099640 1 -- 172.21.15.115:0/2785295961 >> 172.21.15.115:0/2785295961 conn(0x7fb9280fa230 msgr2=0x7fb9280fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:51.842 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:51.838+0000 7fb92d099640 1 -- 172.21.15.115:0/2785295961 shutdown_connections 2024-09-13T17:08:51.842 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:51.838+0000 7fb92d099640 1 -- 172.21.15.115:0/2785295961 wait complete. 2024-09-13T17:08:51.842 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:51.838+0000 7fb92d099640 1 Processor -- start 2024-09-13T17:08:51.842 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:51.839+0000 7fb92d099640 1 -- start start 2024-09-13T17:08:51.842 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:51.839+0000 7fb92d099640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb928100630 0x7fb9281956a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:51.842 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:51.839+0000 7fb92d099640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb928102f60 0x7fb928195be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:51.842 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:51.839+0000 7fb92d099640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9281961b0 con 0x7fb928100630 2024-09-13T17:08:51.842 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:51.839+0000 7fb92d099640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb928196320 con 0x7fb928102f60 2024-09-13T17:08:51.842 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:51.839+0000 7fb926d9d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb928100630 0x7fb9281956a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:51.842 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:51.839+0000 7fb926d9d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb928100630 0x7fb9281956a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:45546/0 (socket says 172.21.15.115:45546) 2024-09-13T17:08:51.842 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:51.839+0000 7fb926d9d640 1 -- 172.21.15.115:0/3095501461 learned_addr learned my addr 172.21.15.115:0/3095501461 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:08:51.842 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:51.839+0000 7fb92659c640 1 --2- 172.21.15.115:0/3095501461 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb928102f60 0x7fb928195be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:51.843 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:51.839+0000 7fb926d9d640 1 -- 172.21.15.115:0/3095501461 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb928102f60 msgr2=0x7fb928195be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:51.843 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:51.839+0000 7fb926d9d640 1 --2- 172.21.15.115:0/3095501461 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb928102f60 0x7fb928195be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:51.843 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:51.839+0000 7fb926d9d640 1 -- 172.21.15.115:0/3095501461 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb91c009560 con 0x7fb928100630 2024-09-13T17:08:51.843 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:51.840+0000 7fb926d9d640 1 --2- 172.21.15.115:0/3095501461 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb928100630 0x7fb9281956a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fb91800ba80 tx=0x7fb91800bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:51.843 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:51.840+0000 7fb90ffff640 1 -- 172.21.15.115:0/3095501461 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb91800cb50 con 0x7fb928100630 2024-09-13T17:08:51.843 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:51.840+0000 7fb92d099640 1 -- 172.21.15.115:0/3095501461 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb92819adc0 con 0x7fb928100630 2024-09-13T17:08:51.843 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:51.840+0000 7fb90ffff640 1 -- 172.21.15.115:0/3095501461 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb91800ccb0 con 0x7fb928100630 2024-09-13T17:08:51.843 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:51.840+0000 7fb90ffff640 1 -- 172.21.15.115:0/3095501461 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb918007740 con 0x7fb928100630 2024-09-13T17:08:51.843 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:51.840+0000 7fb92d099640 1 -- 172.21.15.115:0/3095501461 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb92819b310 con 0x7fb928100630 2024-09-13T17:08:51.844 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:51.841+0000 7fb92d099640 1 -- 172.21.15.115:0/3095501461 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9281086d0 con 0x7fb928100630 2024-09-13T17:08:51.844 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:51.842+0000 7fb90ffff640 1 -- 172.21.15.115:0/3095501461 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fb918014440 con 0x7fb928100630 2024-09-13T17:08:51.844 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:51.842+0000 7fb90ffff640 1 --2- 172.21.15.115:0/3095501461 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fb91006cc50 0x7fb91006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:51.844 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:51.842+0000 7fb90ffff640 1 -- 172.21.15.115:0/3095501461 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fb91808be10 con 0x7fb928100630 2024-09-13T17:08:51.845 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:51.842+0000 7fb92659c640 1 --2- 172.21.15.115:0/3095501461 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fb91006cc50 0x7fb91006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:51.845 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:51.843+0000 7fb92659c640 1 --2- 172.21.15.115:0/3095501461 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fb91006cc50 0x7fb91006f110 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb91c006010 tx=0x7fb91c031400 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:51.848 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:51.847+0000 7fb90ffff640 1 -- 172.21.15.115:0/3095501461 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fb918056060 con 0x7fb928100630 2024-09-13T17:08:52.026 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:52.025+0000 7fb92d099640 1 -- 172.21.15.115:0/3095501461 --> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb928103a20 con 0x7fb91006cc50 2024-09-13T17:08:52.027 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:52.026+0000 7fb90ffff640 1 -- 172.21.15.115:0/3095501461 <== mgr.14660 v2:172.21.15.115:6800/1049502673 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7fb928103a20 con 0x7fb91006cc50 2024-09-13T17:08:52.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:52.028+0000 7fb92d099640 1 -- 172.21.15.115:0/3095501461 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fb91006cc50 msgr2=0x7fb91006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:52.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:52.028+0000 7fb92d099640 1 --2- 172.21.15.115:0/3095501461 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fb91006cc50 0x7fb91006f110 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb91c006010 tx=0x7fb91c031400 comp rx=0 tx=0).stop 2024-09-13T17:08:52.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:52.028+0000 7fb92d099640 1 -- 172.21.15.115:0/3095501461 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb928100630 msgr2=0x7fb9281956a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:52.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:52.028+0000 7fb92d099640 1 --2- 172.21.15.115:0/3095501461 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb928100630 0x7fb9281956a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fb91800ba80 tx=0x7fb91800bf40 comp rx=0 tx=0).stop 2024-09-13T17:08:52.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:52.028+0000 7fb92d099640 1 -- 172.21.15.115:0/3095501461 shutdown_connections 2024-09-13T17:08:52.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:52.028+0000 7fb92d099640 1 --2- 172.21.15.115:0/3095501461 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fb91006cc50 0x7fb91006f110 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:52.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:52.028+0000 7fb92d099640 1 --2- 172.21.15.115:0/3095501461 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb928102f60 0x7fb928195be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:52.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:52.028+0000 7fb92d099640 1 --2- 172.21.15.115:0/3095501461 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb928100630 0x7fb9281956a0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:52.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:52.028+0000 7fb92d099640 1 -- 172.21.15.115:0/3095501461 >> 172.21.15.115:0/3095501461 conn(0x7fb9280fa230 msgr2=0x7fb9280fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:52.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:52.029+0000 7fb92d099640 1 -- 172.21.15.115:0/3095501461 shutdown_connections 2024-09-13T17:08:52.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:52.029+0000 7fb92d099640 1 -- 172.21.15.115:0/3095501461 wait complete. 2024-09-13T17:08:52.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:52 smithi115 ceph-mon[27708]: pgmap v71: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:08:52.779 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -e sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 -- bash -c 'ceph versions | jq -e '"'"'.mgr | length == 1'"'"'' 2024-09-13T17:08:52.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:52 smithi195 ceph-mon[34981]: pgmap v71: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:08:52.984 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T17:08:53.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:53 smithi115 ceph-mon[27708]: from='client.14774 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:08:53.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:53 smithi195 ceph-mon[34981]: from='client.14774 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:08:54.694 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:54.691+0000 7f287fb23640 1 -- 172.21.15.115:0/608937299 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28781049a0 msgr2=0x7f2878104d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:54.694 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:54.691+0000 7f287fb23640 1 --2- 172.21.15.115:0/608937299 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28781049a0 0x7f2878104d80 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f2874009880 tx=0x7f287402a4a0 comp rx=0 tx=0).stop 2024-09-13T17:08:54.694 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:54.691+0000 7f287fb23640 1 -- 172.21.15.115:0/608937299 shutdown_connections 2024-09-13T17:08:54.694 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:54.691+0000 7f287fb23640 1 --2- 172.21.15.115:0/608937299 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f28780fe9a0 0x7f28780fee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:54.694 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:54.691+0000 7f287fb23640 1 --2- 172.21.15.115:0/608937299 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28781049a0 0x7f2878104d80 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:54.694 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:54.691+0000 7f287fb23640 1 -- 172.21.15.115:0/608937299 >> 172.21.15.115:0/608937299 conn(0x7f28780758c0 msgr2=0x7f28780fcc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:54.695 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:54.691+0000 7f287fb23640 1 -- 172.21.15.115:0/608937299 shutdown_connections 2024-09-13T17:08:54.695 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:54.691+0000 7f287fb23640 1 -- 172.21.15.115:0/608937299 wait complete. 2024-09-13T17:08:54.695 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:54.691+0000 7f287fb23640 1 Processor -- start 2024-09-13T17:08:54.695 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:54.692+0000 7f287fb23640 1 -- start start 2024-09-13T17:08:54.695 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:54.692+0000 7f287fb23640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f28780fe9a0 0x7f287819b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:54.695 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:54.692+0000 7f287fb23640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28781049a0 0x7f287819be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:54.695 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:54.692+0000 7f287fb23640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28781959b0 con 0x7f28781049a0 2024-09-13T17:08:54.695 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:54.692+0000 7f287fb23640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2878195af0 con 0x7f28780fe9a0 2024-09-13T17:08:54.695 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:54.692+0000 7f287d0be640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28781049a0 0x7f287819be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:54.695 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:54.692+0000 7f287d0be640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28781049a0 0x7f287819be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47274/0 (socket says 172.21.15.115:47274) 2024-09-13T17:08:54.696 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:54.692+0000 7f287d0be640 1 -- 172.21.15.115:0/444572897 learned_addr learned my addr 172.21.15.115:0/444572897 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:08:54.696 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:54.692+0000 7f287d8bf640 1 --2- 172.21.15.115:0/444572897 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f28780fe9a0 0x7f287819b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:54.696 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:54.692+0000 7f287d0be640 1 -- 172.21.15.115:0/444572897 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f28780fe9a0 msgr2=0x7f287819b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:54.696 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:54.692+0000 7f287d0be640 1 --2- 172.21.15.115:0/444572897 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f28780fe9a0 0x7f287819b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:54.696 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:54.692+0000 7f287d0be640 1 -- 172.21.15.115:0/444572897 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2874009560 con 0x7f28781049a0 2024-09-13T17:08:54.696 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:54.692+0000 7f287d0be640 1 --2- 172.21.15.115:0/444572897 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28781049a0 0x7f287819be90 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f286800b420 tx=0x7f286800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:54.696 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:54.693+0000 7f286effd640 1 -- 172.21.15.115:0/444572897 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2868011800 con 0x7f28781049a0 2024-09-13T17:08:54.696 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:54.693+0000 7f287fb23640 1 -- 172.21.15.115:0/444572897 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2878195dd0 con 0x7f28781049a0 2024-09-13T17:08:54.696 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:54.693+0000 7f286effd640 1 -- 172.21.15.115:0/444572897 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2868011e00 con 0x7f28781049a0 2024-09-13T17:08:54.696 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:54.693+0000 7f286effd640 1 -- 172.21.15.115:0/444572897 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f286800f2e0 con 0x7f28781049a0 2024-09-13T17:08:54.696 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:54.693+0000 7f287fb23640 1 -- 172.21.15.115:0/444572897 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2878196320 con 0x7f28781049a0 2024-09-13T17:08:54.697 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:54 smithi115 ceph-mon[27708]: pgmap v72: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:08:54.698 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:54.694+0000 7f287fb23640 1 -- 172.21.15.115:0/444572897 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28781000e0 con 0x7f28781049a0 2024-09-13T17:08:54.698 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:54.694+0000 7f286effd640 1 -- 172.21.15.115:0/444572897 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f2868010380 con 0x7f28781049a0 2024-09-13T17:08:54.698 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:54.695+0000 7f286effd640 1 --2- 172.21.15.115:0/444572897 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f2864071060 0x7f2864073520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:54.698 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:54.695+0000 7f287d8bf640 1 --2- 172.21.15.115:0/444572897 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f2864071060 0x7f2864073520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:54.698 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:54.695+0000 7f286effd640 1 -- 172.21.15.115:0/444572897 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f286808bd50 con 0x7f28781049a0 2024-09-13T17:08:54.698 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:54.696+0000 7f287d8bf640 1 --2- 172.21.15.115:0/444572897 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f2864071060 0x7f2864073520 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2874000c00 tx=0x7f28740058d0 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:54.701 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:54.700+0000 7f286effd640 1 -- 172.21.15.115:0/444572897 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f2868055ef0 con 0x7f28781049a0 2024-09-13T17:08:54.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:54 smithi195 ceph-mon[34981]: pgmap v72: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:08:54.927 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:54.926+0000 7f287fb23640 1 -- 172.21.15.115:0/444572897 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f28781965f0 con 0x7f28781049a0 2024-09-13T17:08:54.927 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:54.926+0000 7f286effd640 1 -- 172.21.15.115:0/444572897 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+733 (secure 0 0 0) 0x7f2868059510 con 0x7f28781049a0 2024-09-13T17:08:54.933 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:54.928+0000 7f287fb23640 1 -- 172.21.15.115:0/444572897 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f2864071060 msgr2=0x7f2864073520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:54.933 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:54.928+0000 7f287fb23640 1 --2- 172.21.15.115:0/444572897 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f2864071060 0x7f2864073520 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2874000c00 tx=0x7f28740058d0 comp rx=0 tx=0).stop 2024-09-13T17:08:54.933 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:54.928+0000 7f287fb23640 1 -- 172.21.15.115:0/444572897 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28781049a0 msgr2=0x7f287819be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:54.933 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:54.928+0000 7f287fb23640 1 --2- 172.21.15.115:0/444572897 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28781049a0 0x7f287819be90 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f286800b420 tx=0x7f286800b8e0 comp rx=0 tx=0).stop 2024-09-13T17:08:54.934 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:54.928+0000 7f287fb23640 1 -- 172.21.15.115:0/444572897 shutdown_connections 2024-09-13T17:08:54.934 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:54.928+0000 7f287fb23640 1 --2- 172.21.15.115:0/444572897 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f2864071060 0x7f2864073520 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:54.934 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:54.928+0000 7f287fb23640 1 --2- 172.21.15.115:0/444572897 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28781049a0 0x7f287819be90 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:54.934 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:54.928+0000 7f287fb23640 1 --2- 172.21.15.115:0/444572897 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f28780fe9a0 0x7f287819b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:54.934 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:54.928+0000 7f287fb23640 1 -- 172.21.15.115:0/444572897 >> 172.21.15.115:0/444572897 conn(0x7f28780758c0 msgr2=0x7f2878102ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:54.934 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:54.928+0000 7f287fb23640 1 -- 172.21.15.115:0/444572897 shutdown_connections 2024-09-13T17:08:54.934 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:54.928+0000 7f287fb23640 1 -- 172.21.15.115:0/444572897 wait complete. 2024-09-13T17:08:54.938 INFO:teuthology.orchestra.run.smithi115.stdout:true 2024-09-13T17:08:55.655 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:55 smithi115 ceph-mon[27708]: from='client.? 172.21.15.115:0/444572897' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:08:55.677 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -e sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 -- bash -c 'ceph versions | jq -e '"'"'.mgr | keys'"'"' | grep $sha1' 2024-09-13T17:08:55.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:55 smithi195 ceph-mon[34981]: from='client.? 172.21.15.115:0/444572897' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:08:55.876 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T17:08:56.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:56 smithi115 ceph-mon[27708]: pgmap v73: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:08:56.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:56 smithi195 ceph-mon[34981]: pgmap v73: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:08:57.569 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:57.549+0000 7f8a12c96640 1 -- 172.21.15.115:0/1973160842 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a0c104a10 msgr2=0x7f8a0c104df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:57.570 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:57.549+0000 7f8a12c96640 1 --2- 172.21.15.115:0/1973160842 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a0c104a10 0x7f8a0c104df0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f89fc009880 tx=0x7f89fc02a4a0 comp rx=0 tx=0).stop 2024-09-13T17:08:57.570 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:57.549+0000 7f8a12c96640 1 -- 172.21.15.115:0/1973160842 shutdown_connections 2024-09-13T17:08:57.570 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:57.549+0000 7f8a12c96640 1 --2- 172.21.15.115:0/1973160842 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a0c0fea10 0x7f8a0c0fee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:57.570 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:57.549+0000 7f8a12c96640 1 --2- 172.21.15.115:0/1973160842 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a0c104a10 0x7f8a0c104df0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:57.570 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:57.549+0000 7f8a12c96640 1 -- 172.21.15.115:0/1973160842 >> 172.21.15.115:0/1973160842 conn(0x7f8a0c0fa730 msgr2=0x7f8a0c0fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:57.570 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:57.549+0000 7f8a12c96640 1 -- 172.21.15.115:0/1973160842 shutdown_connections 2024-09-13T17:08:57.570 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:57.549+0000 7f8a12c96640 1 -- 172.21.15.115:0/1973160842 wait complete. 2024-09-13T17:08:57.570 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:57.550+0000 7f8a12c96640 1 Processor -- start 2024-09-13T17:08:57.570 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:57.550+0000 7f8a12c96640 1 -- start start 2024-09-13T17:08:57.570 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:57.550+0000 7f8a12c96640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a0c0fea10 0x7f8a0c1968c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:57.570 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:57.550+0000 7f8a12c96640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a0c104a10 0x7f8a0c196e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:57.570 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:57.550+0000 7f8a12c96640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a0c197340 con 0x7f8a0c104a10 2024-09-13T17:08:57.571 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:57.550+0000 7f8a12c96640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a0c1974b0 con 0x7f8a0c0fea10 2024-09-13T17:08:57.571 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:57.550+0000 7f8a0bfff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a0c104a10 0x7f8a0c196e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:57.571 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:57.550+0000 7f8a0bfff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a0c104a10 0x7f8a0c196e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47300/0 (socket says 172.21.15.115:47300) 2024-09-13T17:08:57.571 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:57.550+0000 7f8a0bfff640 1 -- 172.21.15.115:0/2541672614 learned_addr learned my addr 172.21.15.115:0/2541672614 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:08:57.571 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:57.550+0000 7f8a10a32640 1 --2- 172.21.15.115:0/2541672614 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a0c0fea10 0x7f8a0c1968c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:57.571 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:57.551+0000 7f8a0bfff640 1 -- 172.21.15.115:0/2541672614 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a0c0fea10 msgr2=0x7f8a0c1968c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:57.571 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:57.551+0000 7f8a0bfff640 1 --2- 172.21.15.115:0/2541672614 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a0c0fea10 0x7f8a0c1968c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:57.571 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:57.551+0000 7f8a0bfff640 1 -- 172.21.15.115:0/2541672614 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89fc009560 con 0x7f8a0c104a10 2024-09-13T17:08:57.571 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:57.551+0000 7f8a0bfff640 1 --2- 172.21.15.115:0/2541672614 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a0c104a10 0x7f8a0c196e00 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f8a0000d6f0 tx=0x7f8a0000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:57.571 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:57.551+0000 7f8a09ffb640 1 -- 172.21.15.115:0/2541672614 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a00009a30 con 0x7f8a0c104a10 2024-09-13T17:08:57.571 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:57.551+0000 7f8a09ffb640 1 -- 172.21.15.115:0/2541672614 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8a000054c0 con 0x7f8a0c104a10 2024-09-13T17:08:57.571 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:57.551+0000 7f8a12c96640 1 -- 172.21.15.115:0/2541672614 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a0c19f930 con 0x7f8a0c104a10 2024-09-13T17:08:57.571 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:57.551+0000 7f8a09ffb640 1 -- 172.21.15.115:0/2541672614 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a00004db0 con 0x7f8a0c104a10 2024-09-13T17:08:57.572 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:57.551+0000 7f8a12c96640 1 -- 172.21.15.115:0/2541672614 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a0c19fd40 con 0x7f8a0c104a10 2024-09-13T17:08:57.572 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:57.552+0000 7f8a12c96640 1 -- 172.21.15.115:0/2541672614 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a0c100150 con 0x7f8a0c104a10 2024-09-13T17:08:57.572 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:57.552+0000 7f8a09ffb640 1 -- 172.21.15.115:0/2541672614 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f8a00004f10 con 0x7f8a0c104a10 2024-09-13T17:08:57.572 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:57.553+0000 7f8a09ffb640 1 --2- 172.21.15.115:0/2541672614 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f89f406cc50 0x7f89f406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:57.572 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:57.553+0000 7f8a09ffb640 1 -- 172.21.15.115:0/2541672614 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f8a0008be90 con 0x7f8a0c104a10 2024-09-13T17:08:57.572 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:57.553+0000 7f8a10a32640 1 --2- 172.21.15.115:0/2541672614 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f89f406cc50 0x7f89f406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:57.572 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:57.553+0000 7f8a10a32640 1 --2- 172.21.15.115:0/2541672614 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f89f406cc50 0x7f89f406f110 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f89fc000c00 tx=0x7f89fc0058d0 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:57.572 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:57.557+0000 7f8a09ffb640 1 -- 172.21.15.115:0/2541672614 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f8a000560e0 con 0x7f8a0c104a10 2024-09-13T17:08:57.787 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:57.786+0000 7f8a12c96640 1 -- 172.21.15.115:0/2541672614 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8a0c10bb60 con 0x7f8a0c104a10 2024-09-13T17:08:57.787 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:57.786+0000 7f8a09ffb640 1 -- 172.21.15.115:0/2541672614 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+733 (secure 0 0 0) 0x7f8a000172f0 con 0x7f8a0c104a10 2024-09-13T17:08:57.790 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:57.789+0000 7f8a12c96640 1 -- 172.21.15.115:0/2541672614 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f89f406cc50 msgr2=0x7f89f406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:57.790 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:57.789+0000 7f8a12c96640 1 --2- 172.21.15.115:0/2541672614 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f89f406cc50 0x7f89f406f110 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f89fc000c00 tx=0x7f89fc0058d0 comp rx=0 tx=0).stop 2024-09-13T17:08:57.790 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:57.789+0000 7f8a12c96640 1 -- 172.21.15.115:0/2541672614 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a0c104a10 msgr2=0x7f8a0c196e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:57.790 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:57.789+0000 7f8a12c96640 1 --2- 172.21.15.115:0/2541672614 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a0c104a10 0x7f8a0c196e00 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f8a0000d6f0 tx=0x7f8a0000dbb0 comp rx=0 tx=0).stop 2024-09-13T17:08:57.790 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:57.789+0000 7f8a12c96640 1 -- 172.21.15.115:0/2541672614 shutdown_connections 2024-09-13T17:08:57.790 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:57.789+0000 7f8a12c96640 1 --2- 172.21.15.115:0/2541672614 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f89f406cc50 0x7f89f406f110 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:57.790 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:57.789+0000 7f8a12c96640 1 --2- 172.21.15.115:0/2541672614 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a0c104a10 0x7f8a0c196e00 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:57.791 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:57.789+0000 7f8a12c96640 1 --2- 172.21.15.115:0/2541672614 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a0c0fea10 0x7f8a0c1968c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:57.791 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:57.789+0000 7f8a12c96640 1 -- 172.21.15.115:0/2541672614 >> 172.21.15.115:0/2541672614 conn(0x7f8a0c0fa730 msgr2=0x7f8a0c0fb560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:57.791 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:57.789+0000 7f8a12c96640 1 -- 172.21.15.115:0/2541672614 shutdown_connections 2024-09-13T17:08:57.791 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:08:57.789+0000 7f8a12c96640 1 -- 172.21.15.115:0/2541672614 wait complete. 2024-09-13T17:08:57.799 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)" 2024-09-13T17:08:58.544 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -e sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 2'"'"'' 2024-09-13T17:08:58.739 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T17:08:58.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:58 smithi195 ceph-mon[34981]: pgmap v74: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:08:58.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:08:58 smithi195 ceph-mon[34981]: from='client.? 172.21.15.115:0/2541672614' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:08:58.859 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:58 smithi115 ceph-mon[27708]: pgmap v74: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:08:58.859 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:08:58 smithi115 ceph-mon[27708]: from='client.? 172.21.15.115:0/2541672614' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:09:00.485 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:00.462+0000 7fda8dd10640 1 -- 172.21.15.115:0/3444152462 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda88100d50 msgr2=0x7fda88101130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:00.485 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:00.462+0000 7fda8dd10640 1 --2- 172.21.15.115:0/3444152462 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda88100d50 0x7fda88101130 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fda78009880 tx=0x7fda7802a530 comp rx=0 tx=0).stop 2024-09-13T17:09:00.485 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:00.462+0000 7fda8dd10640 1 -- 172.21.15.115:0/3444152462 shutdown_connections 2024-09-13T17:09:00.486 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:00.462+0000 7fda8dd10640 1 --2- 172.21.15.115:0/3444152462 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fda88101670 0x7fda88109b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:00.486 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:00.462+0000 7fda8dd10640 1 --2- 172.21.15.115:0/3444152462 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda88100d50 0x7fda88101130 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:00.486 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:00.462+0000 7fda8dd10640 1 -- 172.21.15.115:0/3444152462 >> 172.21.15.115:0/3444152462 conn(0x7fda880fa7b0 msgr2=0x7fda880fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:00.486 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:00.462+0000 7fda8dd10640 1 -- 172.21.15.115:0/3444152462 shutdown_connections 2024-09-13T17:09:00.486 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:00.462+0000 7fda8dd10640 1 -- 172.21.15.115:0/3444152462 wait complete. 2024-09-13T17:09:00.486 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:00.463+0000 7fda8dd10640 1 Processor -- start 2024-09-13T17:09:00.486 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:00.463+0000 7fda8dd10640 1 -- start start 2024-09-13T17:09:00.486 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:00.463+0000 7fda8dd10640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fda88100d50 0x7fda8819b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:00.486 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:00.463+0000 7fda8dd10640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda88101670 0x7fda8819bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:00.486 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:00.463+0000 7fda8dd10640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda8819c3f0 con 0x7fda88101670 2024-09-13T17:09:00.486 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:00.463+0000 7fda8dd10640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda88195980 con 0x7fda88100d50 2024-09-13T17:09:00.486 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:00.463+0000 7fda86ffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda88101670 0x7fda8819bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:00.487 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:00.463+0000 7fda86ffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda88101670 0x7fda8819bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47324/0 (socket says 172.21.15.115:47324) 2024-09-13T17:09:00.487 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:00.463+0000 7fda86ffd640 1 -- 172.21.15.115:0/964412741 learned_addr learned my addr 172.21.15.115:0/964412741 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:09:00.487 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:00.463+0000 7fda877fe640 1 --2- 172.21.15.115:0/964412741 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fda88100d50 0x7fda8819b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:00.487 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:00.463+0000 7fda86ffd640 1 -- 172.21.15.115:0/964412741 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fda88100d50 msgr2=0x7fda8819b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:00.487 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:00.463+0000 7fda86ffd640 1 --2- 172.21.15.115:0/964412741 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fda88100d50 0x7fda8819b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:00.487 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:00.463+0000 7fda86ffd640 1 -- 172.21.15.115:0/964412741 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda78009560 con 0x7fda88101670 2024-09-13T17:09:00.487 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:00.464+0000 7fda86ffd640 1 --2- 172.21.15.115:0/964412741 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda88101670 0x7fda8819bdd0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fda7c00b370 tx=0x7fda7c00b830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:00.487 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:00.464+0000 7fda84ff9640 1 -- 172.21.15.115:0/964412741 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda7c011800 con 0x7fda88101670 2024-09-13T17:09:00.487 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:00.464+0000 7fda8dd10640 1 -- 172.21.15.115:0/964412741 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda88195c60 con 0x7fda88101670 2024-09-13T17:09:00.487 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:00.464+0000 7fda84ff9640 1 -- 172.21.15.115:0/964412741 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fda7c011e00 con 0x7fda88101670 2024-09-13T17:09:00.487 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:00.464+0000 7fda84ff9640 1 -- 172.21.15.115:0/964412741 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda7c00f2e0 con 0x7fda88101670 2024-09-13T17:09:00.487 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:00.464+0000 7fda8dd10640 1 -- 172.21.15.115:0/964412741 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda881961b0 con 0x7fda88101670 2024-09-13T17:09:00.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:00.465+0000 7fda8dd10640 1 -- 172.21.15.115:0/964412741 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda88068ce0 con 0x7fda88101670 2024-09-13T17:09:00.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:00.465+0000 7fda84ff9640 1 -- 172.21.15.115:0/964412741 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fda7c010380 con 0x7fda88101670 2024-09-13T17:09:00.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:00.466+0000 7fda84ff9640 1 --2- 172.21.15.115:0/964412741 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fda7006cc50 0x7fda7006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:00.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:00.466+0000 7fda84ff9640 1 -- 172.21.15.115:0/964412741 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fda7c08c1a0 con 0x7fda88101670 2024-09-13T17:09:00.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:00.466+0000 7fda877fe640 1 --2- 172.21.15.115:0/964412741 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fda7006cc50 0x7fda7006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:00.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:00.466+0000 7fda877fe640 1 --2- 172.21.15.115:0/964412741 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fda7006cc50 0x7fda7006f110 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fda78005ab0 tx=0x7fda78005a20 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:00.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:00.470+0000 7fda84ff9640 1 -- 172.21.15.115:0/964412741 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fda7c0562c0 con 0x7fda88101670 2024-09-13T17:09:00.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:00 smithi115 ceph-mon[27708]: pgmap v75: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:09:00.700 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:00.699+0000 7fda8dd10640 1 -- 172.21.15.115:0/964412741 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fda88101130 con 0x7fda88101670 2024-09-13T17:09:00.700 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:00.699+0000 7fda84ff9640 1 -- 172.21.15.115:0/964412741 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+733 (secure 0 0 0) 0x7fda7c0598e0 con 0x7fda88101670 2024-09-13T17:09:00.703 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:00.701+0000 7fda8dd10640 1 -- 172.21.15.115:0/964412741 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fda7006cc50 msgr2=0x7fda7006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:00.703 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:00.701+0000 7fda8dd10640 1 --2- 172.21.15.115:0/964412741 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fda7006cc50 0x7fda7006f110 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fda78005ab0 tx=0x7fda78005a20 comp rx=0 tx=0).stop 2024-09-13T17:09:00.703 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:00.701+0000 7fda8dd10640 1 -- 172.21.15.115:0/964412741 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda88101670 msgr2=0x7fda8819bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:00.703 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:00.701+0000 7fda8dd10640 1 --2- 172.21.15.115:0/964412741 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda88101670 0x7fda8819bdd0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fda7c00b370 tx=0x7fda7c00b830 comp rx=0 tx=0).stop 2024-09-13T17:09:00.703 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:00.701+0000 7fda8dd10640 1 -- 172.21.15.115:0/964412741 shutdown_connections 2024-09-13T17:09:00.703 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:00.701+0000 7fda8dd10640 1 --2- 172.21.15.115:0/964412741 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fda7006cc50 0x7fda7006f110 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:00.703 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:00.701+0000 7fda8dd10640 1 --2- 172.21.15.115:0/964412741 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda88101670 0x7fda8819bdd0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:00.703 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:00.701+0000 7fda8dd10640 1 --2- 172.21.15.115:0/964412741 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fda88100d50 0x7fda8819b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:00.704 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:00.701+0000 7fda8dd10640 1 -- 172.21.15.115:0/964412741 >> 172.21.15.115:0/964412741 conn(0x7fda880fa7b0 msgr2=0x7fda88102000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:00.704 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:00.701+0000 7fda8dd10640 1 -- 172.21.15.115:0/964412741 shutdown_connections 2024-09-13T17:09:00.704 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:00.701+0000 7fda8dd10640 1 -- 172.21.15.115:0/964412741 wait complete. 2024-09-13T17:09:00.711 INFO:teuthology.orchestra.run.smithi115.stdout:true 2024-09-13T17:09:00.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:00 smithi195 ceph-mon[34981]: pgmap v75: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:09:01.402 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -e sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 -- bash -c 'ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '"'"'.up_to_date | length == 2'"'"'' 2024-09-13T17:09:01.601 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T17:09:01.825 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:01 smithi115 ceph-mon[27708]: from='client.? 172.21.15.115:0/964412741' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:09:01.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:01 smithi195 ceph-mon[34981]: from='client.? 172.21.15.115:0/964412741' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:09:02.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:02 smithi115 ceph-mon[27708]: pgmap v76: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:09:02.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:02 smithi195 ceph-mon[34981]: pgmap v76: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:09:03.316 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:03.287+0000 7f7a79cd7640 1 -- 172.21.15.115:0/2187415574 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7a74100ce0 msgr2=0x7f7a741010c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:03.316 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:03.287+0000 7f7a79cd7640 1 --2- 172.21.15.115:0/2187415574 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7a74100ce0 0x7f7a741010c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f7a64009880 tx=0x7f7a6402a530 comp rx=0 tx=0).stop 2024-09-13T17:09:03.316 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:03.287+0000 7f7a79cd7640 1 -- 172.21.15.115:0/2187415574 shutdown_connections 2024-09-13T17:09:03.316 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:03.287+0000 7f7a79cd7640 1 --2- 172.21.15.115:0/2187415574 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7a74101600 0x7f7a74109af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:03.317 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:03.287+0000 7f7a79cd7640 1 --2- 172.21.15.115:0/2187415574 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7a74100ce0 0x7f7a741010c0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:03.317 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:03.287+0000 7f7a79cd7640 1 -- 172.21.15.115:0/2187415574 >> 172.21.15.115:0/2187415574 conn(0x7f7a740fa720 msgr2=0x7f7a740fcb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:03.317 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:03.287+0000 7f7a79cd7640 1 -- 172.21.15.115:0/2187415574 shutdown_connections 2024-09-13T17:09:03.317 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:03.287+0000 7f7a79cd7640 1 -- 172.21.15.115:0/2187415574 wait complete. 2024-09-13T17:09:03.317 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:03.288+0000 7f7a79cd7640 1 Processor -- start 2024-09-13T17:09:03.317 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:03.288+0000 7f7a79cd7640 1 -- start start 2024-09-13T17:09:03.317 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:03.288+0000 7f7a79cd7640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7a74100ce0 0x7f7a7419b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:03.317 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:03.288+0000 7f7a79cd7640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7a74101600 0x7f7a7419be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:03.317 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:03.288+0000 7f7a79cd7640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7419c460 con 0x7f7a74100ce0 2024-09-13T17:09:03.318 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:03.288+0000 7f7a79cd7640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a741959f0 con 0x7f7a74101600 2024-09-13T17:09:03.318 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:03.288+0000 7f7a737fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7a74100ce0 0x7f7a7419b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:03.318 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:03.288+0000 7f7a737fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7a74100ce0 0x7f7a7419b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47342/0 (socket says 172.21.15.115:47342) 2024-09-13T17:09:03.318 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:03.288+0000 7f7a737fe640 1 -- 172.21.15.115:0/2743337985 learned_addr learned my addr 172.21.15.115:0/2743337985 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:09:03.318 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:03.289+0000 7f7a737fe640 1 -- 172.21.15.115:0/2743337985 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7a74101600 msgr2=0x7f7a7419be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:03.318 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:03.289+0000 7f7a737fe640 1 --2- 172.21.15.115:0/2743337985 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7a74101600 0x7f7a7419be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:03.318 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:03.289+0000 7f7a737fe640 1 -- 172.21.15.115:0/2743337985 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a64009560 con 0x7f7a74100ce0 2024-09-13T17:09:03.318 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:03.289+0000 7f7a737fe640 1 --2- 172.21.15.115:0/2743337985 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7a74100ce0 0x7f7a7419b900 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f7a64006010 tx=0x7f7a640056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:03.318 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:03.289+0000 7f7a70ff9640 1 -- 172.21.15.115:0/2743337985 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a64004ba0 con 0x7f7a74100ce0 2024-09-13T17:09:03.318 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:03.289+0000 7f7a79cd7640 1 -- 172.21.15.115:0/2743337985 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a74195c70 con 0x7f7a74100ce0 2024-09-13T17:09:03.318 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:03.289+0000 7f7a70ff9640 1 -- 172.21.15.115:0/2743337985 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7a64004d00 con 0x7f7a74100ce0 2024-09-13T17:09:03.318 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:03.289+0000 7f7a70ff9640 1 -- 172.21.15.115:0/2743337985 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a64031910 con 0x7f7a74100ce0 2024-09-13T17:09:03.318 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:03.289+0000 7f7a79cd7640 1 -- 172.21.15.115:0/2743337985 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a74196160 con 0x7f7a74100ce0 2024-09-13T17:09:03.319 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:03.290+0000 7f7a79cd7640 1 -- 172.21.15.115:0/2743337985 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a74068ce0 con 0x7f7a74100ce0 2024-09-13T17:09:03.319 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:03.290+0000 7f7a70ff9640 1 -- 172.21.15.115:0/2743337985 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f7a6402ad50 con 0x7f7a74100ce0 2024-09-13T17:09:03.319 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:03.291+0000 7f7a70ff9640 1 --2- 172.21.15.115:0/2743337985 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f7a5c06cc50 0x7f7a5c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:03.319 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:03.291+0000 7f7a70ff9640 1 -- 172.21.15.115:0/2743337985 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f7a640ad460 con 0x7f7a74100ce0 2024-09-13T17:09:03.319 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:03.291+0000 7f7a72ffd640 1 --2- 172.21.15.115:0/2743337985 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f7a5c06cc50 0x7f7a5c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:03.319 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:03.291+0000 7f7a72ffd640 1 --2- 172.21.15.115:0/2743337985 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f7a5c06cc50 0x7f7a5c06f110 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7a74196e60 tx=0x7f7a68006d30 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:03.319 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:03.295+0000 7f7a70ff9640 1 -- 172.21.15.115:0/2743337985 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f7a64077580 con 0x7f7a74100ce0 2024-09-13T17:09:03.474 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:03.473+0000 7f7a79cd7640 1 -- 172.21.15.115:0/2743337985 --> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] -- mgr_command(tid 0: {"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", "target": ["mon-mgr", ""]}) v1 -- 0x7f7a7410ccf0 con 0x7f7a5c06cc50 2024-09-13T17:09:04.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:04 smithi115 ceph-mon[27708]: pgmap v77: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:09:04.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:04 smithi115 ceph-mon[27708]: from='client.14790 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:09:04.796 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:04.795+0000 7f7a70ff9640 1 -- 172.21.15.115:0/2743337985 <== mgr.14660 v2:172.21.15.115:6800/1049502673 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+5741 (secure 0 0 0) 0x7f7a7410ccf0 con 0x7f7a5c06cc50 2024-09-13T17:09:04.798 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:04.797+0000 7f7a79cd7640 1 -- 172.21.15.115:0/2743337985 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f7a5c06cc50 msgr2=0x7f7a5c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:04.798 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:04.797+0000 7f7a79cd7640 1 --2- 172.21.15.115:0/2743337985 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f7a5c06cc50 0x7f7a5c06f110 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7a74196e60 tx=0x7f7a68006d30 comp rx=0 tx=0).stop 2024-09-13T17:09:04.798 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:04.797+0000 7f7a79cd7640 1 -- 172.21.15.115:0/2743337985 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7a74100ce0 msgr2=0x7f7a7419b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:04.799 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:04.797+0000 7f7a79cd7640 1 --2- 172.21.15.115:0/2743337985 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7a74100ce0 0x7f7a7419b900 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f7a64006010 tx=0x7f7a640056e0 comp rx=0 tx=0).stop 2024-09-13T17:09:04.799 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:04.797+0000 7f7a79cd7640 1 -- 172.21.15.115:0/2743337985 shutdown_connections 2024-09-13T17:09:04.799 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:04.797+0000 7f7a79cd7640 1 --2- 172.21.15.115:0/2743337985 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f7a5c06cc50 0x7f7a5c06f110 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:04.799 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:04.797+0000 7f7a79cd7640 1 --2- 172.21.15.115:0/2743337985 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7a74101600 0x7f7a7419be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:04.799 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:04.797+0000 7f7a79cd7640 1 --2- 172.21.15.115:0/2743337985 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7a74100ce0 0x7f7a7419b900 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:04.799 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:04.797+0000 7f7a79cd7640 1 -- 172.21.15.115:0/2743337985 >> 172.21.15.115:0/2743337985 conn(0x7f7a740fa720 msgr2=0x7f7a74101fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:04.799 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:04.797+0000 7f7a79cd7640 1 -- 172.21.15.115:0/2743337985 shutdown_connections 2024-09-13T17:09:04.799 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:04.797+0000 7f7a79cd7640 1 -- 172.21.15.115:0/2743337985 wait complete. 2024-09-13T17:09:04.808 INFO:teuthology.orchestra.run.smithi115.stdout:true 2024-09-13T17:09:04.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:04 smithi195 ceph-mon[34981]: pgmap v77: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:09:04.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:04 smithi195 ceph-mon[34981]: from='client.14790 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:09:05.466 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -e sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 -- bash -c 'ceph orch ps' 2024-09-13T17:09:05.667 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T17:09:06.790 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:06 smithi115 ceph-mon[27708]: pgmap v78: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:09:06.790 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:06 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:09:06.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:06 smithi195 ceph-mon[34981]: pgmap v78: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:09:06.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:06 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:09:07.288 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:07.265+0000 7f7a97f90640 1 -- 172.21.15.115:0/1611646794 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7a90105bf0 msgr2=0x7f7a90105fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:07.288 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:07.265+0000 7f7a97f90640 1 --2- 172.21.15.115:0/1611646794 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7a90105bf0 0x7f7a90105fd0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c009880 tx=0x7f7a8c02a4a0 comp rx=0 tx=0).stop 2024-09-13T17:09:07.289 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:07.265+0000 7f7a97f90640 1 -- 172.21.15.115:0/1611646794 shutdown_connections 2024-09-13T17:09:07.289 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:07.265+0000 7f7a97f90640 1 --2- 172.21.15.115:0/1611646794 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7a900ffb40 0x7f7a900fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:07.289 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:07.265+0000 7f7a97f90640 1 --2- 172.21.15.115:0/1611646794 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7a90105bf0 0x7f7a90105fd0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:07.289 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:07.265+0000 7f7a97f90640 1 -- 172.21.15.115:0/1611646794 >> 172.21.15.115:0/1611646794 conn(0x7f7a900fb840 msgr2=0x7f7a900fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:07.289 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:07.265+0000 7f7a97f90640 1 -- 172.21.15.115:0/1611646794 shutdown_connections 2024-09-13T17:09:07.289 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:07.265+0000 7f7a97f90640 1 -- 172.21.15.115:0/1611646794 wait complete. 2024-09-13T17:09:07.289 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:07.266+0000 7f7a97f90640 1 Processor -- start 2024-09-13T17:09:07.289 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:07.266+0000 7f7a97f90640 1 -- start start 2024-09-13T17:09:07.289 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:07.266+0000 7f7a97f90640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7a900ffb40 0x7f7a9019b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:07.289 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:07.266+0000 7f7a97f90640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7a90105bf0 0x7f7a9019bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:07.289 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:07.266+0000 7f7a97f90640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a90195910 con 0x7f7a90105bf0 2024-09-13T17:09:07.290 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:07.266+0000 7f7a97f90640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a90195a50 con 0x7f7a900ffb40 2024-09-13T17:09:07.290 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:07.266+0000 7f7a9552b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7a90105bf0 0x7f7a9019bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:07.290 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:07.266+0000 7f7a9552b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7a90105bf0 0x7f7a9019bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:46322/0 (socket says 172.21.15.115:46322) 2024-09-13T17:09:07.290 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:07.266+0000 7f7a9552b640 1 -- 172.21.15.115:0/1526608569 learned_addr learned my addr 172.21.15.115:0/1526608569 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:09:07.290 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:07.267+0000 7f7a95d2c640 1 --2- 172.21.15.115:0/1526608569 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7a900ffb40 0x7f7a9019b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:07.290 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:07.267+0000 7f7a9552b640 1 -- 172.21.15.115:0/1526608569 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7a900ffb40 msgr2=0x7f7a9019b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:07.290 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:07.267+0000 7f7a9552b640 1 --2- 172.21.15.115:0/1526608569 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7a900ffb40 0x7f7a9019b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:07.290 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:07.267+0000 7f7a9552b640 1 -- 172.21.15.115:0/1526608569 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a8c009560 con 0x7f7a90105bf0 2024-09-13T17:09:07.290 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:07.267+0000 7f7a9552b640 1 --2- 172.21.15.115:0/1526608569 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7a90105bf0 0x7f7a9019bdf0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f7a8000b420 tx=0x7f7a8000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:07.290 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:07.267+0000 7f7a86ffd640 1 -- 172.21.15.115:0/1526608569 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a80011800 con 0x7f7a90105bf0 2024-09-13T17:09:07.290 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:07.267+0000 7f7a97f90640 1 -- 172.21.15.115:0/1526608569 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a90195d30 con 0x7f7a90105bf0 2024-09-13T17:09:07.290 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:07.267+0000 7f7a86ffd640 1 -- 172.21.15.115:0/1526608569 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7a80011e00 con 0x7f7a90105bf0 2024-09-13T17:09:07.291 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:07.267+0000 7f7a86ffd640 1 -- 172.21.15.115:0/1526608569 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a8000f2e0 con 0x7f7a90105bf0 2024-09-13T17:09:07.291 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:07.267+0000 7f7a97f90640 1 -- 172.21.15.115:0/1526608569 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a90196280 con 0x7f7a90105bf0 2024-09-13T17:09:07.291 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:07.268+0000 7f7a97f90640 1 -- 172.21.15.115:0/1526608569 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a901011f0 con 0x7f7a90105bf0 2024-09-13T17:09:07.291 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:07.268+0000 7f7a86ffd640 1 -- 172.21.15.115:0/1526608569 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f7a80010380 con 0x7f7a90105bf0 2024-09-13T17:09:07.291 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:07.269+0000 7f7a86ffd640 1 --2- 172.21.15.115:0/1526608569 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f7a7c06cc50 0x7f7a7c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:07.291 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:07.269+0000 7f7a86ffd640 1 -- 172.21.15.115:0/1526608569 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f7a8008beb0 con 0x7f7a90105bf0 2024-09-13T17:09:07.291 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:07.269+0000 7f7a95d2c640 1 --2- 172.21.15.115:0/1526608569 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f7a7c06cc50 0x7f7a7c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:07.291 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:07.269+0000 7f7a95d2c640 1 --2- 172.21.15.115:0/1526608569 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f7a7c06cc50 0x7f7a7c06f110 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c005ab0 tx=0x7f7a8c005a20 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:07.291 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:07.273+0000 7f7a86ffd640 1 -- 172.21.15.115:0/1526608569 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f7a80055fd0 con 0x7f7a90105bf0 2024-09-13T17:09:07.446 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:07.445+0000 7f7a97f90640 1 -- 172.21.15.115:0/1526608569 --> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7a9010ccd0 con 0x7f7a7c06cc50 2024-09-13T17:09:07.455 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:07.454+0000 7f7a86ffd640 1 -- 172.21.15.115:0/1526608569 <== mgr.14660 v2:172.21.15.115:6800/1049502673 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f7a9010ccd0 con 0x7f7a7c06cc50 2024-09-13T17:09:07.456 INFO:teuthology.orchestra.run.smithi115.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T17:09:07.456 INFO:teuthology.orchestra.run.smithi115.stdout:alertmanager.smithi115 smithi115 *:9093,9094 running (57s) 37s ago 11m 16.0M - 0.25.0 c8568f914cd2 d56b91240fe1 2024-09-13T17:09:07.456 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-exporter.smithi115 smithi115 running (11m) 37s ago 11m 8108k - 18.2.4-843-g2c01458a c129f5a2fd4e 0f1eebeaf9bb 2024-09-13T17:09:07.456 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-exporter.smithi195 smithi195 running (10m) 88s ago 10m 7600k - 18.2.4-843-g2c01458a c129f5a2fd4e 6d05bafbac8a 2024-09-13T17:09:07.456 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi115 smithi115 running (11m) 37s ago 11m 6899k - 18.2.4-843-g2c01458a c129f5a2fd4e 624a903fec23 2024-09-13T17:09:07.456 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi195 smithi195 running (10m) 88s ago 10m 6891k - 18.2.4-843-g2c01458a c129f5a2fd4e 42e6ce26130d 2024-09-13T17:09:07.456 INFO:teuthology.orchestra.run.smithi115.stdout:grafana.smithi115 smithi115 *:3000 running (42s) 37s ago 10m 38.9M - 9.4.7 954c08fa6188 e1eccb1a8f3e 2024-09-13T17:09:07.456 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi115.hbtxod smithi115 running (5m) 37s ago 5m 98.8M - 18.2.4-843-g2c01458a c129f5a2fd4e 12b4f4874491 2024-09-13T17:09:07.456 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi115.ijznvr smithi115 running (5m) 37s ago 5m 166M - 18.2.4-843-g2c01458a c129f5a2fd4e 2d552564a9f4 2024-09-13T17:09:07.456 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi195.aevvgz smithi195 running (5m) 88s ago 5m 16.1M - 18.2.4-843-g2c01458a c129f5a2fd4e 299b9ad657c9 2024-09-13T17:09:07.456 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi195.qzghxj smithi195 running (5m) 88s ago 5m 14.3M - 18.2.4-843-g2c01458a c129f5a2fd4e fb16b16181ff 2024-09-13T17:09:07.457 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi115.hetcni smithi115 *:8443,9283,8765 running (2m) 37s ago 12m 487M - 18.2.4-860-g6c6b083f 8a91f241d7d4 b945dbde1934 2024-09-13T17:09:07.457 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi195.hjjifz smithi195 *:8443,9283,8765 running (107s) 88s ago 10m 438M - 18.2.4-860-g6c6b083f 8a91f241d7d4 17bccdfbcae1 2024-09-13T17:09:07.457 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi115 smithi115 running (12m) 37s ago 12m 54.4M 2048M 18.2.4-843-g2c01458a c129f5a2fd4e 202375d41e68 2024-09-13T17:09:07.457 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi195 smithi195 running (10m) 88s ago 10m 42.7M 2048M 18.2.4-843-g2c01458a c129f5a2fd4e 0f54c30e5970 2024-09-13T17:09:07.457 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi115 smithi115 *:9100 running (96s) 37s ago 11m 16.5M - 1.5.0 0da6a335fe13 26fb6f9844b5 2024-09-13T17:09:07.457 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi195 smithi195 *:9100 running (92s) 88s ago 10m 3581k - 1.5.0 0da6a335fe13 6d38e798fb16 2024-09-13T17:09:07.457 INFO:teuthology.orchestra.run.smithi115.stdout:osd.0 smithi115 running (9m) 37s ago 9m 246M 1216M 18.2.4-843-g2c01458a c129f5a2fd4e 8a8ad231962e 2024-09-13T17:09:07.457 INFO:teuthology.orchestra.run.smithi115.stdout:osd.1 smithi115 running (8m) 37s ago 8m 264M 1216M 18.2.4-843-g2c01458a c129f5a2fd4e 3fbc020102a0 2024-09-13T17:09:07.457 INFO:teuthology.orchestra.run.smithi115.stdout:osd.2 smithi115 running (8m) 37s ago 8m 223M 1216M 18.2.4-843-g2c01458a c129f5a2fd4e 7c623823e920 2024-09-13T17:09:07.457 INFO:teuthology.orchestra.run.smithi115.stdout:osd.3 smithi195 running (8m) 88s ago 8m 293M 2240M 18.2.4-843-g2c01458a c129f5a2fd4e 10ea833fd5c5 2024-09-13T17:09:07.457 INFO:teuthology.orchestra.run.smithi115.stdout:osd.4 smithi195 running (7m) 88s ago 7m 263M 2240M 18.2.4-843-g2c01458a c129f5a2fd4e 4bbc3acb9aff 2024-09-13T17:09:07.457 INFO:teuthology.orchestra.run.smithi115.stdout:osd.5 smithi195 running (7m) 88s ago 7m 234M 2240M 18.2.4-843-g2c01458a c129f5a2fd4e 4bd1b3a232d0 2024-09-13T17:09:07.457 INFO:teuthology.orchestra.run.smithi115.stdout:prometheus.smithi115 smithi115 *:9095 running (75s) 37s ago 10m 47.3M - 2.43.0 a07b618ecd1d e03fb39f6b76 2024-09-13T17:09:07.458 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:07.456+0000 7f7a97f90640 1 -- 172.21.15.115:0/1526608569 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f7a7c06cc50 msgr2=0x7f7a7c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:07.458 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:07.456+0000 7f7a97f90640 1 --2- 172.21.15.115:0/1526608569 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f7a7c06cc50 0x7f7a7c06f110 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c005ab0 tx=0x7f7a8c005a20 comp rx=0 tx=0).stop 2024-09-13T17:09:07.458 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:07.456+0000 7f7a97f90640 1 -- 172.21.15.115:0/1526608569 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7a90105bf0 msgr2=0x7f7a9019bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:07.458 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:07.456+0000 7f7a97f90640 1 --2- 172.21.15.115:0/1526608569 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7a90105bf0 0x7f7a9019bdf0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f7a8000b420 tx=0x7f7a8000b8e0 comp rx=0 tx=0).stop 2024-09-13T17:09:07.458 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:07.456+0000 7f7a97f90640 1 -- 172.21.15.115:0/1526608569 shutdown_connections 2024-09-13T17:09:07.458 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:07.456+0000 7f7a97f90640 1 --2- 172.21.15.115:0/1526608569 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f7a7c06cc50 0x7f7a7c06f110 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:07.459 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:07.456+0000 7f7a97f90640 1 --2- 172.21.15.115:0/1526608569 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7a90105bf0 0x7f7a9019bdf0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:07.459 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:07.456+0000 7f7a97f90640 1 --2- 172.21.15.115:0/1526608569 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7a900ffb40 0x7f7a9019b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:07.459 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:07.456+0000 7f7a97f90640 1 -- 172.21.15.115:0/1526608569 >> 172.21.15.115:0/1526608569 conn(0x7f7a900fb840 msgr2=0x7f7a900fd980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:07.459 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:07.456+0000 7f7a97f90640 1 -- 172.21.15.115:0/1526608569 shutdown_connections 2024-09-13T17:09:07.459 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:07.456+0000 7f7a97f90640 1 -- 172.21.15.115:0/1526608569 wait complete. 2024-09-13T17:09:08.079 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-13T17:09:08.081 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi115.front.sepia.ceph.com 2024-09-13T17:09:08.081 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -e sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs true' 2024-09-13T17:09:08.279 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T17:09:08.651 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:08 smithi115 ceph-mon[27708]: pgmap v79: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:09:08.651 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:08 smithi115 ceph-mon[27708]: from='client.14794 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:09:08.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:08 smithi195 ceph-mon[34981]: pgmap v79: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:09:08.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:08 smithi195 ceph-mon[34981]: from='client.14794 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:09:09.940 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:09.905+0000 7f6684081640 1 -- 172.21.15.115:0/1723745352 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f667c0fea20 msgr2=0x7f667c0fee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:09.940 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:09.905+0000 7f6684081640 1 --2- 172.21.15.115:0/1723745352 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f667c0fea20 0x7f667c0fee80 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f6670009880 tx=0x7f667002a4a0 comp rx=0 tx=0).stop 2024-09-13T17:09:09.940 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:09.905+0000 7f6684081640 1 -- 172.21.15.115:0/1723745352 shutdown_connections 2024-09-13T17:09:09.941 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:09.905+0000 7f6684081640 1 --2- 172.21.15.115:0/1723745352 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f667c0fea20 0x7f667c0fee80 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:09.941 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:09.905+0000 7f6684081640 1 --2- 172.21.15.115:0/1723745352 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f667c104a20 0x7f667c104e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:09.941 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:09.905+0000 7f6684081640 1 -- 172.21.15.115:0/1723745352 >> 172.21.15.115:0/1723745352 conn(0x7f667c0fa720 msgr2=0x7f667c0fcb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:09.941 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:09.905+0000 7f6684081640 1 -- 172.21.15.115:0/1723745352 shutdown_connections 2024-09-13T17:09:09.941 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:09.905+0000 7f6684081640 1 -- 172.21.15.115:0/1723745352 wait complete. 2024-09-13T17:09:09.941 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:09.905+0000 7f6684081640 1 Processor -- start 2024-09-13T17:09:09.941 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:09.905+0000 7f6684081640 1 -- start start 2024-09-13T17:09:09.941 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:09.906+0000 7f6684081640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f667c0fea20 0x7f667c19a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:09.941 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:09.906+0000 7f6684081640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f667c104a20 0x7f667c19ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:09.941 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:09.906+0000 7f6684081640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f667c19b300 con 0x7f667c104a20 2024-09-13T17:09:09.941 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:09.906+0000 7f6684081640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f667c194890 con 0x7f667c0fea20 2024-09-13T17:09:09.941 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:09.906+0000 7f668161c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f667c104a20 0x7f667c19ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:09.942 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:09.906+0000 7f668161c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f667c104a20 0x7f667c19ace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:46332/0 (socket says 172.21.15.115:46332) 2024-09-13T17:09:09.942 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:09.906+0000 7f668161c640 1 -- 172.21.15.115:0/1264450171 learned_addr learned my addr 172.21.15.115:0/1264450171 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:09:09.942 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:09.906+0000 7f6681e1d640 1 --2- 172.21.15.115:0/1264450171 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f667c0fea20 0x7f667c19a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:09.942 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:09.906+0000 7f668161c640 1 -- 172.21.15.115:0/1264450171 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f667c0fea20 msgr2=0x7f667c19a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:09.942 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:09.906+0000 7f668161c640 1 --2- 172.21.15.115:0/1264450171 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f667c0fea20 0x7f667c19a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:09.942 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:09.906+0000 7f668161c640 1 -- 172.21.15.115:0/1264450171 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6670009560 con 0x7f667c104a20 2024-09-13T17:09:09.942 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:09.906+0000 7f6681e1d640 1 --2- 172.21.15.115:0/1264450171 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f667c0fea20 0x7f667c19a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:09:09.942 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:09.906+0000 7f668161c640 1 --2- 172.21.15.115:0/1264450171 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f667c104a20 0x7f667c19ace0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f6670006010 tx=0x7f66700055f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:09.942 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:09.906+0000 7f667affd640 1 -- 172.21.15.115:0/1264450171 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6670004b20 con 0x7f667c104a20 2024-09-13T17:09:09.942 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:09.906+0000 7f667affd640 1 -- 172.21.15.115:0/1264450171 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6670004c80 con 0x7f667c104a20 2024-09-13T17:09:09.942 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:09.906+0000 7f6684081640 1 -- 172.21.15.115:0/1264450171 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f667c194b10 con 0x7f667c104a20 2024-09-13T17:09:09.942 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:09.906+0000 7f667affd640 1 -- 172.21.15.115:0/1264450171 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6670031960 con 0x7f667c104a20 2024-09-13T17:09:09.942 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:09.906+0000 7f6684081640 1 -- 172.21.15.115:0/1264450171 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f667c195000 con 0x7f667c104a20 2024-09-13T17:09:09.942 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:09.908+0000 7f6684081640 1 -- 172.21.15.115:0/1264450171 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f667c100160 con 0x7f667c104a20 2024-09-13T17:09:09.943 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:09.908+0000 7f667affd640 1 -- 172.21.15.115:0/1264450171 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f6670031c20 con 0x7f667c104a20 2024-09-13T17:09:09.943 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:09.908+0000 7f667affd640 1 --2- 172.21.15.115:0/1264450171 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f666406cc60 0x7f666406f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:09.943 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:09.908+0000 7f667affd640 1 -- 172.21.15.115:0/1264450171 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f66700ad7b0 con 0x7f667c104a20 2024-09-13T17:09:09.943 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:09.908+0000 7f6681e1d640 1 --2- 172.21.15.115:0/1264450171 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f666406cc60 0x7f666406f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:09.943 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:09.909+0000 7f6681e1d640 1 --2- 172.21.15.115:0/1264450171 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f666406cc60 0x7f666406f120 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6674009fa0 tx=0x7f6674009570 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:09.943 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:09.913+0000 7f667affd640 1 -- 172.21.15.115:0/1264450171 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f66700778d0 con 0x7f667c104a20 2024-09-13T17:09:10.083 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:10.082+0000 7f6684081640 1 -- 172.21.15.115:0/1264450171 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) v1 -- 0x7f667c0fef00 con 0x7f667c104a20 2024-09-13T17:09:10.087 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:10.086+0000 7f667affd640 1 -- 172.21.15.115:0/1264450171 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=0 v47)=0 v47) v1 ==== 125+0+0 (secure 0 0 0) 0x7f667007aef0 con 0x7f667c104a20 2024-09-13T17:09:10.090 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:10.088+0000 7f6684081640 1 -- 172.21.15.115:0/1264450171 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f666406cc60 msgr2=0x7f666406f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:10.090 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:10.088+0000 7f6684081640 1 --2- 172.21.15.115:0/1264450171 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f666406cc60 0x7f666406f120 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6674009fa0 tx=0x7f6674009570 comp rx=0 tx=0).stop 2024-09-13T17:09:10.090 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:10.088+0000 7f6684081640 1 -- 172.21.15.115:0/1264450171 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f667c104a20 msgr2=0x7f667c19ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:10.090 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:10.088+0000 7f6684081640 1 --2- 172.21.15.115:0/1264450171 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f667c104a20 0x7f667c19ace0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f6670006010 tx=0x7f66700055f0 comp rx=0 tx=0).stop 2024-09-13T17:09:10.090 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:10.088+0000 7f6684081640 1 -- 172.21.15.115:0/1264450171 shutdown_connections 2024-09-13T17:09:10.090 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:10.088+0000 7f6684081640 1 --2- 172.21.15.115:0/1264450171 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f666406cc60 0x7f666406f120 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:10.090 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:10.088+0000 7f6684081640 1 --2- 172.21.15.115:0/1264450171 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f667c104a20 0x7f667c19ace0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:10.090 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:10.088+0000 7f6684081640 1 --2- 172.21.15.115:0/1264450171 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f667c0fea20 0x7f667c19a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:10.090 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:10.088+0000 7f6684081640 1 -- 172.21.15.115:0/1264450171 >> 172.21.15.115:0/1264450171 conn(0x7f667c0fa720 msgr2=0x7f667c0fb880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:10.090 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:10.089+0000 7f6684081640 1 -- 172.21.15.115:0/1264450171 shutdown_connections 2024-09-13T17:09:10.090 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:10.089+0000 7f6684081640 1 -- 172.21.15.115:0/1264450171 wait complete. 2024-09-13T17:09:10.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:10 smithi115 ceph-mon[27708]: pgmap v80: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:09:10.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:10 smithi115 ceph-mon[27708]: from='client.? 172.21.15.115:0/1264450171' entity='client.admin' 2024-09-13T17:09:10.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:10 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:09:10.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:10 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:09:10.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:10 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:09:10.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:10 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:09:10.737 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-13T17:09:10.738 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi115.front.sepia.ceph.com 2024-09-13T17:09:10.738 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -e sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-09-13T17:09:10.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:10 smithi195 ceph-mon[34981]: pgmap v80: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:09:10.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:10 smithi195 ceph-mon[34981]: from='client.? 172.21.15.115:0/1264450171' entity='client.admin' 2024-09-13T17:09:10.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:10 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:09:10.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:10 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:09:10.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:10 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:09:10.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:10 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:09:10.935 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T17:09:12.601 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:12.584+0000 7fb1cefa4640 1 -- 172.21.15.115:0/3226246896 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1c80ffb40 msgr2=0x7fb1c80fffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:12.601 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:12.584+0000 7fb1cefa4640 1 --2- 172.21.15.115:0/3226246896 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1c80ffb40 0x7fb1c80fffa0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fb1b4009880 tx=0x7fb1b402a4a0 comp rx=0 tx=0).stop 2024-09-13T17:09:12.601 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:12.584+0000 7fb1cefa4640 1 -- 172.21.15.115:0/3226246896 shutdown_connections 2024-09-13T17:09:12.601 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:12.584+0000 7fb1cefa4640 1 --2- 172.21.15.115:0/3226246896 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1c80ffb40 0x7fb1c80fffa0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:12.601 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:12.584+0000 7fb1cefa4640 1 --2- 172.21.15.115:0/3226246896 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb1c8105bf0 0x7fb1c8105fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:12.601 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:12.584+0000 7fb1cefa4640 1 -- 172.21.15.115:0/3226246896 >> 172.21.15.115:0/3226246896 conn(0x7fb1c80fb840 msgr2=0x7fb1c80fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:12.601 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:12.584+0000 7fb1cefa4640 1 -- 172.21.15.115:0/3226246896 shutdown_connections 2024-09-13T17:09:12.601 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:12.584+0000 7fb1cefa4640 1 -- 172.21.15.115:0/3226246896 wait complete. 2024-09-13T17:09:12.602 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:12.585+0000 7fb1cefa4640 1 Processor -- start 2024-09-13T17:09:12.602 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:12.585+0000 7fb1cefa4640 1 -- start start 2024-09-13T17:09:12.602 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:12.585+0000 7fb1cefa4640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb1c80ffb40 0x7fb1c80727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:12.602 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:12.585+0000 7fb1cefa4640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1c8105bf0 0x7fb1c8072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:12.602 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:12.585+0000 7fb1cefa4640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c8073230 con 0x7fb1c8105bf0 2024-09-13T17:09:12.602 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:12.585+0000 7fb1cefa4640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c80733a0 con 0x7fb1c80ffb40 2024-09-13T17:09:12.602 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:12.585+0000 7fb1c7fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1c8105bf0 0x7fb1c8072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:12.602 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:12.585+0000 7fb1c7fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1c8105bf0 0x7fb1c8072cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:46342/0 (socket says 172.21.15.115:46342) 2024-09-13T17:09:12.603 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:12.585+0000 7fb1c7fff640 1 -- 172.21.15.115:0/2669581391 learned_addr learned my addr 172.21.15.115:0/2669581391 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:09:12.603 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:12.585+0000 7fb1c7fff640 1 -- 172.21.15.115:0/2669581391 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb1c80ffb40 msgr2=0x7fb1c80727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:12.603 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:12.585+0000 7fb1c7fff640 1 --2- 172.21.15.115:0/2669581391 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb1c80ffb40 0x7fb1c80727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:12.603 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:12.585+0000 7fb1c7fff640 1 -- 172.21.15.115:0/2669581391 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1b4009560 con 0x7fb1c8105bf0 2024-09-13T17:09:12.603 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:12.586+0000 7fb1c7fff640 1 --2- 172.21.15.115:0/2669581391 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1c8105bf0 0x7fb1c8072cf0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fb1b4006010 tx=0x7fb1b40056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:12.603 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:12.586+0000 7fb1c5ffb640 1 -- 172.21.15.115:0/2669581391 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1b4004ba0 con 0x7fb1c8105bf0 2024-09-13T17:09:12.603 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:12.586+0000 7fb1cefa4640 1 -- 172.21.15.115:0/2669581391 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1c8073620 con 0x7fb1c8105bf0 2024-09-13T17:09:12.603 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:12.586+0000 7fb1c5ffb640 1 -- 172.21.15.115:0/2669581391 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb1b4004d00 con 0x7fb1c8105bf0 2024-09-13T17:09:12.603 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:12.586+0000 7fb1c5ffb640 1 -- 172.21.15.115:0/2669581391 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1b4031910 con 0x7fb1c8105bf0 2024-09-13T17:09:12.603 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:12.586+0000 7fb1cefa4640 1 -- 172.21.15.115:0/2669581391 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1c81a1f50 con 0x7fb1c8105bf0 2024-09-13T17:09:12.603 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:12.587+0000 7fb1cefa4640 1 -- 172.21.15.115:0/2669581391 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1c81011f0 con 0x7fb1c8105bf0 2024-09-13T17:09:12.603 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:12.587+0000 7fb1c5ffb640 1 -- 172.21.15.115:0/2669581391 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fb1b4031b80 con 0x7fb1c8105bf0 2024-09-13T17:09:12.604 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:12.588+0000 7fb1c5ffb640 1 --2- 172.21.15.115:0/2669581391 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fb1b806cc50 0x7fb1b806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:12.604 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:12.588+0000 7fb1c5ffb640 1 -- 172.21.15.115:0/2669581391 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fb1b40ad570 con 0x7fb1c8105bf0 2024-09-13T17:09:12.604 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:12.588+0000 7fb1ccd40640 1 --2- 172.21.15.115:0/2669581391 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fb1b806cc50 0x7fb1b806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:12.604 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:12.588+0000 7fb1ccd40640 1 --2- 172.21.15.115:0/2669581391 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fb1b806cc50 0x7fb1b806f110 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc009710 tx=0x7fb1bc006c90 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:12.604 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:12.592+0000 7fb1c5ffb640 1 -- 172.21.15.115:0/2669581391 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fb1b4077690 con 0x7fb1c8105bf0 2024-09-13T17:09:12.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:12 smithi115 ceph-mon[27708]: pgmap v81: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:09:12.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:12.754+0000 7fb1cefa4640 1 -- 172.21.15.115:0/2669581391 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7fb1c8100020 con 0x7fb1c8105bf0 2024-09-13T17:09:12.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:12.755+0000 7fb1c5ffb640 1 -- 172.21.15.115:0/2669581391 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v47)=0 v47) v1 ==== 155+0+0 (secure 0 0 0) 0x7fb1b407acb0 con 0x7fb1c8105bf0 2024-09-13T17:09:12.758 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:12.757+0000 7fb1cefa4640 1 -- 172.21.15.115:0/2669581391 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fb1b806cc50 msgr2=0x7fb1b806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:12.759 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:12.757+0000 7fb1cefa4640 1 --2- 172.21.15.115:0/2669581391 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fb1b806cc50 0x7fb1b806f110 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc009710 tx=0x7fb1bc006c90 comp rx=0 tx=0).stop 2024-09-13T17:09:12.759 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:12.757+0000 7fb1cefa4640 1 -- 172.21.15.115:0/2669581391 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1c8105bf0 msgr2=0x7fb1c8072cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:12.759 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:12.757+0000 7fb1cefa4640 1 --2- 172.21.15.115:0/2669581391 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1c8105bf0 0x7fb1c8072cf0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fb1b4006010 tx=0x7fb1b40056e0 comp rx=0 tx=0).stop 2024-09-13T17:09:12.759 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:12.757+0000 7fb1cefa4640 1 -- 172.21.15.115:0/2669581391 shutdown_connections 2024-09-13T17:09:12.759 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:12.757+0000 7fb1cefa4640 1 --2- 172.21.15.115:0/2669581391 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fb1b806cc50 0x7fb1b806f110 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:12.759 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:12.757+0000 7fb1cefa4640 1 --2- 172.21.15.115:0/2669581391 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1c8105bf0 0x7fb1c8072cf0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:12.759 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:12.757+0000 7fb1cefa4640 1 --2- 172.21.15.115:0/2669581391 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb1c80ffb40 0x7fb1c80727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:12.759 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:12.757+0000 7fb1cefa4640 1 -- 172.21.15.115:0/2669581391 >> 172.21.15.115:0/2669581391 conn(0x7fb1c80fb840 msgr2=0x7fb1c80fd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:12.759 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:12.757+0000 7fb1cefa4640 1 -- 172.21.15.115:0/2669581391 shutdown_connections 2024-09-13T17:09:12.759 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:12.757+0000 7fb1cefa4640 1 -- 172.21.15.115:0/2669581391 wait complete. 2024-09-13T17:09:12.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:12 smithi195 ceph-mon[34981]: pgmap v81: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:09:13.350 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -e sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-09-13T17:09:13.553 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T17:09:14.628 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:14 smithi115 ceph-mon[27708]: pgmap v82: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:09:14.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:14 smithi195 ceph-mon[34981]: pgmap v82: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:09:15.139 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:15.122+0000 7f9c87817640 1 -- 172.21.15.115:0/1050934033 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c80104a20 msgr2=0x7f9c80104e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:15.139 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:15.122+0000 7f9c87817640 1 --2- 172.21.15.115:0/1050934033 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c80104a20 0x7f9c80104e00 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f9c70009880 tx=0x7f9c7002a4a0 comp rx=0 tx=0).stop 2024-09-13T17:09:15.139 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:15.122+0000 7f9c87817640 1 -- 172.21.15.115:0/1050934033 shutdown_connections 2024-09-13T17:09:15.140 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:15.122+0000 7f9c87817640 1 --2- 172.21.15.115:0/1050934033 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9c800fea20 0x7f9c800fee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:15.140 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:15.122+0000 7f9c87817640 1 --2- 172.21.15.115:0/1050934033 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c80104a20 0x7f9c80104e00 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:15.140 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:15.122+0000 7f9c87817640 1 -- 172.21.15.115:0/1050934033 >> 172.21.15.115:0/1050934033 conn(0x7f9c800fa720 msgr2=0x7f9c800fcb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:15.140 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:15.122+0000 7f9c87817640 1 -- 172.21.15.115:0/1050934033 shutdown_connections 2024-09-13T17:09:15.140 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:15.122+0000 7f9c87817640 1 -- 172.21.15.115:0/1050934033 wait complete. 2024-09-13T17:09:15.140 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:15.122+0000 7f9c87817640 1 Processor -- start 2024-09-13T17:09:15.140 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:15.122+0000 7f9c87817640 1 -- start start 2024-09-13T17:09:15.140 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:15.122+0000 7f9c87817640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9c800fea20 0x7f9c80196970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:15.140 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:15.122+0000 7f9c87817640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c80104a20 0x7f9c80196eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:15.140 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:15.122+0000 7f9c87817640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c80197480 con 0x7f9c80104a20 2024-09-13T17:09:15.140 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:15.122+0000 7f9c87817640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c801975f0 con 0x7f9c800fea20 2024-09-13T17:09:15.140 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:15.123+0000 7f9c84db2640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c80104a20 0x7f9c80196eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:15.141 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:15.123+0000 7f9c84db2640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c80104a20 0x7f9c80196eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:58688/0 (socket says 172.21.15.115:58688) 2024-09-13T17:09:15.141 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:15.123+0000 7f9c84db2640 1 -- 172.21.15.115:0/2885948990 learned_addr learned my addr 172.21.15.115:0/2885948990 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:09:15.141 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:15.123+0000 7f9c855b3640 1 --2- 172.21.15.115:0/2885948990 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9c800fea20 0x7f9c80196970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:15.141 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:15.123+0000 7f9c84db2640 1 -- 172.21.15.115:0/2885948990 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9c800fea20 msgr2=0x7f9c80196970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:15.141 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:15.123+0000 7f9c84db2640 1 --2- 172.21.15.115:0/2885948990 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9c800fea20 0x7f9c80196970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:15.141 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:15.123+0000 7f9c84db2640 1 -- 172.21.15.115:0/2885948990 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c70009560 con 0x7f9c80104a20 2024-09-13T17:09:15.141 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:15.123+0000 7f9c855b3640 1 --2- 172.21.15.115:0/2885948990 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9c800fea20 0x7f9c80196970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:09:15.141 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:15.123+0000 7f9c84db2640 1 --2- 172.21.15.115:0/2885948990 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c80104a20 0x7f9c80196eb0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f9c7400b420 tx=0x7f9c7400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:15.141 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:15.123+0000 7f9c7e7fc640 1 -- 172.21.15.115:0/2885948990 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c74011800 con 0x7f9c80104a20 2024-09-13T17:09:15.141 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:15.123+0000 7f9c7e7fc640 1 -- 172.21.15.115:0/2885948990 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9c74011e00 con 0x7f9c80104a20 2024-09-13T17:09:15.141 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:15.123+0000 7f9c87817640 1 -- 172.21.15.115:0/2885948990 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c8019f9e0 con 0x7f9c80104a20 2024-09-13T17:09:15.141 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:15.123+0000 7f9c7e7fc640 1 -- 172.21.15.115:0/2885948990 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c7400f2e0 con 0x7f9c80104a20 2024-09-13T17:09:15.141 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:15.123+0000 7f9c87817640 1 -- 172.21.15.115:0/2885948990 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c8019fe50 con 0x7f9c80104a20 2024-09-13T17:09:15.141 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:15.124+0000 7f9c87817640 1 -- 172.21.15.115:0/2885948990 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c80100160 con 0x7f9c80104a20 2024-09-13T17:09:15.142 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:15.125+0000 7f9c7e7fc640 1 -- 172.21.15.115:0/2885948990 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f9c74010380 con 0x7f9c80104a20 2024-09-13T17:09:15.142 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:15.125+0000 7f9c7e7fc640 1 --2- 172.21.15.115:0/2885948990 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f9c6806cc50 0x7f9c6806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:15.142 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:15.125+0000 7f9c7e7fc640 1 -- 172.21.15.115:0/2885948990 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f9c7408beb0 con 0x7f9c80104a20 2024-09-13T17:09:15.142 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:15.125+0000 7f9c855b3640 1 --2- 172.21.15.115:0/2885948990 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f9c6806cc50 0x7f9c6806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:15.142 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:15.126+0000 7f9c855b3640 1 --2- 172.21.15.115:0/2885948990 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f9c6806cc50 0x7f9c6806f110 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9c70005ab0 tx=0x7f9c70005a20 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:15.142 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:15.130+0000 7f9c7e7fc640 1 -- 172.21.15.115:0/2885948990 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f9c74055fd0 con 0x7f9c80104a20 2024-09-13T17:09:15.297 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:15.295+0000 7f9c87817640 1 -- 172.21.15.115:0/2885948990 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7f9c800fef00 con 0x7f9c80104a20 2024-09-13T17:09:15.297 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:15.295+0000 7f9c7e7fc640 1 -- 172.21.15.115:0/2885948990 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v47)=0 v47) v1 ==== 163+0+0 (secure 0 0 0) 0x7f9c740595f0 con 0x7f9c80104a20 2024-09-13T17:09:15.299 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:15.297+0000 7f9c87817640 1 -- 172.21.15.115:0/2885948990 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f9c6806cc50 msgr2=0x7f9c6806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:15.300 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:15.297+0000 7f9c87817640 1 --2- 172.21.15.115:0/2885948990 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f9c6806cc50 0x7f9c6806f110 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9c70005ab0 tx=0x7f9c70005a20 comp rx=0 tx=0).stop 2024-09-13T17:09:15.300 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:15.297+0000 7f9c87817640 1 -- 172.21.15.115:0/2885948990 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c80104a20 msgr2=0x7f9c80196eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:15.300 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:15.297+0000 7f9c87817640 1 --2- 172.21.15.115:0/2885948990 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c80104a20 0x7f9c80196eb0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f9c7400b420 tx=0x7f9c7400b8e0 comp rx=0 tx=0).stop 2024-09-13T17:09:15.300 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:15.297+0000 7f9c87817640 1 -- 172.21.15.115:0/2885948990 shutdown_connections 2024-09-13T17:09:15.300 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:15.297+0000 7f9c87817640 1 --2- 172.21.15.115:0/2885948990 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f9c6806cc50 0x7f9c6806f110 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:15.300 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:15.297+0000 7f9c87817640 1 --2- 172.21.15.115:0/2885948990 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c80104a20 0x7f9c80196eb0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:15.301 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:15.297+0000 7f9c87817640 1 --2- 172.21.15.115:0/2885948990 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9c800fea20 0x7f9c80196970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:15.301 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:15.297+0000 7f9c87817640 1 -- 172.21.15.115:0/2885948990 >> 172.21.15.115:0/2885948990 conn(0x7f9c800fa720 msgr2=0x7f9c800fb8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:15.301 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:15.297+0000 7f9c87817640 1 -- 172.21.15.115:0/2885948990 shutdown_connections 2024-09-13T17:09:15.301 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:15.297+0000 7f9c87817640 1 -- 172.21.15.115:0/2885948990 wait complete. 2024-09-13T17:09:16.026 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -e sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 -- bash -c 'ceph config set global log_to_journald false --force' 2024-09-13T17:09:16.227 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T17:09:16.580 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:16 smithi115 ceph-mon[27708]: pgmap v83: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:09:16.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:16 smithi195 ceph-mon[34981]: pgmap v83: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:09:17.854 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:17.836+0000 7fa47d466640 1 -- 172.21.15.115:0/304709244 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa478100cb0 msgr2=0x7fa478101090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:17.854 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:17.836+0000 7fa47d466640 1 --2- 172.21.15.115:0/304709244 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa478100cb0 0x7fa478101090 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fa468009c20 tx=0x7fa46802aa00 comp rx=0 tx=0).stop 2024-09-13T17:09:17.854 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:17.836+0000 7fa47d466640 1 -- 172.21.15.115:0/304709244 shutdown_connections 2024-09-13T17:09:17.854 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:17.836+0000 7fa47d466640 1 --2- 172.21.15.115:0/304709244 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa4781015d0 0x7fa478109ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:17.854 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:17.836+0000 7fa47d466640 1 --2- 172.21.15.115:0/304709244 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa478100cb0 0x7fa478101090 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:17.854 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:17.836+0000 7fa47d466640 1 -- 172.21.15.115:0/304709244 >> 172.21.15.115:0/304709244 conn(0x7fa4780fa6d0 msgr2=0x7fa4780fcaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:17.854 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:17.836+0000 7fa47d466640 1 -- 172.21.15.115:0/304709244 shutdown_connections 2024-09-13T17:09:17.855 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:17.836+0000 7fa47d466640 1 -- 172.21.15.115:0/304709244 wait complete. 2024-09-13T17:09:17.855 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:17.836+0000 7fa47d466640 1 Processor -- start 2024-09-13T17:09:17.855 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:17.837+0000 7fa47d466640 1 -- start start 2024-09-13T17:09:17.855 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:17.837+0000 7fa47d466640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa478100cb0 0x7fa47819d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:17.855 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:17.837+0000 7fa47d466640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa4781015d0 0x7fa47819def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:17.855 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:17.837+0000 7fa47d466640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa478197a10 con 0x7fa4781015d0 2024-09-13T17:09:17.855 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:17.837+0000 7fa47d466640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa478197b50 con 0x7fa478100cb0 2024-09-13T17:09:17.855 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:17.837+0000 7fa4767fc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa4781015d0 0x7fa47819def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:17.855 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:17.837+0000 7fa4767fc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa4781015d0 0x7fa47819def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:58704/0 (socket says 172.21.15.115:58704) 2024-09-13T17:09:17.855 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:17.837+0000 7fa4767fc640 1 -- 172.21.15.115:0/4246035497 learned_addr learned my addr 172.21.15.115:0/4246035497 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:09:17.855 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:17.837+0000 7fa476ffd640 1 --2- 172.21.15.115:0/4246035497 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa478100cb0 0x7fa47819d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:17.855 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:17.837+0000 7fa4767fc640 1 -- 172.21.15.115:0/4246035497 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa478100cb0 msgr2=0x7fa47819d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:17.855 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:17.837+0000 7fa4767fc640 1 --2- 172.21.15.115:0/4246035497 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa478100cb0 0x7fa47819d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:17.856 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:17.837+0000 7fa4767fc640 1 -- 172.21.15.115:0/4246035497 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa468009900 con 0x7fa4781015d0 2024-09-13T17:09:17.856 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:17.837+0000 7fa4767fc640 1 --2- 172.21.15.115:0/4246035497 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa4781015d0 0x7fa47819def0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fa46c00d8d0 tx=0x7fa46c00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:17.856 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:17.838+0000 7fa45ffff640 1 -- 172.21.15.115:0/4246035497 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa46c009a30 con 0x7fa4781015d0 2024-09-13T17:09:17.856 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:17.838+0000 7fa47d466640 1 -- 172.21.15.115:0/4246035497 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa478197e30 con 0x7fa4781015d0 2024-09-13T17:09:17.856 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:17.838+0000 7fa45ffff640 1 -- 172.21.15.115:0/4246035497 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa46c0044c0 con 0x7fa4781015d0 2024-09-13T17:09:17.856 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:17.838+0000 7fa45ffff640 1 -- 172.21.15.115:0/4246035497 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa46c0049d0 con 0x7fa4781015d0 2024-09-13T17:09:17.856 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:17.838+0000 7fa47d466640 1 -- 172.21.15.115:0/4246035497 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa478198380 con 0x7fa4781015d0 2024-09-13T17:09:17.856 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:17.839+0000 7fa47d466640 1 -- 172.21.15.115:0/4246035497 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa478068ce0 con 0x7fa4781015d0 2024-09-13T17:09:17.856 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:17.839+0000 7fa45ffff640 1 -- 172.21.15.115:0/4246035497 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fa46c009b90 con 0x7fa4781015d0 2024-09-13T17:09:17.856 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:17.839+0000 7fa45ffff640 1 --2- 172.21.15.115:0/4246035497 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fa46006cc50 0x7fa46006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:17.856 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:17.840+0000 7fa45ffff640 1 -- 172.21.15.115:0/4246035497 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fa46c08c0c0 con 0x7fa4781015d0 2024-09-13T17:09:17.856 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:17.840+0000 7fa476ffd640 1 --2- 172.21.15.115:0/4246035497 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fa46006cc50 0x7fa46006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:17.856 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:17.840+0000 7fa476ffd640 1 --2- 172.21.15.115:0/4246035497 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fa46006cc50 0x7fa46006f110 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa468004af0 tx=0x7fa468004a40 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:17.857 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:17.844+0000 7fa45ffff640 1 -- 172.21.15.115:0/4246035497 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa46c0561e0 con 0x7fa4781015d0 2024-09-13T17:09:18.011 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:18.009+0000 7fa47d466640 1 -- 172.21.15.115:0/4246035497 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7fa47810cc40 con 0x7fa4781015d0 2024-09-13T17:09:18.011 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:18.009+0000 7fa45ffff640 1 -- 172.21.15.115:0/4246035497 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v47)=0 v47) v1 ==== 135+0+0 (secure 0 0 0) 0x7fa46c059800 con 0x7fa4781015d0 2024-09-13T17:09:18.013 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:18.011+0000 7fa47d466640 1 -- 172.21.15.115:0/4246035497 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fa46006cc50 msgr2=0x7fa46006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:18.013 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:18.011+0000 7fa47d466640 1 --2- 172.21.15.115:0/4246035497 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fa46006cc50 0x7fa46006f110 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa468004af0 tx=0x7fa468004a40 comp rx=0 tx=0).stop 2024-09-13T17:09:18.013 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:18.011+0000 7fa47d466640 1 -- 172.21.15.115:0/4246035497 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa4781015d0 msgr2=0x7fa47819def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:18.014 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:18.011+0000 7fa47d466640 1 --2- 172.21.15.115:0/4246035497 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa4781015d0 0x7fa47819def0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fa46c00d8d0 tx=0x7fa46c00dd90 comp rx=0 tx=0).stop 2024-09-13T17:09:18.014 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:18.011+0000 7fa47d466640 1 -- 172.21.15.115:0/4246035497 shutdown_connections 2024-09-13T17:09:18.014 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:18.011+0000 7fa47d466640 1 --2- 172.21.15.115:0/4246035497 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fa46006cc50 0x7fa46006f110 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:18.014 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:18.011+0000 7fa47d466640 1 --2- 172.21.15.115:0/4246035497 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa4781015d0 0x7fa47819def0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:18.014 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:18.011+0000 7fa47d466640 1 --2- 172.21.15.115:0/4246035497 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa478100cb0 0x7fa47819d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:18.014 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:18.011+0000 7fa47d466640 1 -- 172.21.15.115:0/4246035497 >> 172.21.15.115:0/4246035497 conn(0x7fa4780fa6d0 msgr2=0x7fa478109640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:18.014 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:18.011+0000 7fa47d466640 1 -- 172.21.15.115:0/4246035497 shutdown_connections 2024-09-13T17:09:18.014 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:18.011+0000 7fa47d466640 1 -- 172.21.15.115:0/4246035497 wait complete. 2024-09-13T17:09:18.653 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -e sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-09-13T17:09:18.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:18 smithi195 ceph-mon[34981]: pgmap v84: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:09:18.851 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T17:09:18.928 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:18 smithi115 ceph-mon[27708]: pgmap v84: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:09:20.413 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:20.409+0000 7f8881f75640 1 -- 172.21.15.115:0/4254354341 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f887c101660 msgr2=0x7f887c109b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:20.413 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:20.409+0000 7f8881f75640 1 --2- 172.21.15.115:0/4254354341 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f887c101660 0x7f887c109b50 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f886c0098b0 tx=0x7f886c02a560 comp rx=0 tx=0).stop 2024-09-13T17:09:20.413 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:20.409+0000 7f8881f75640 1 -- 172.21.15.115:0/4254354341 shutdown_connections 2024-09-13T17:09:20.413 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:20.409+0000 7f8881f75640 1 --2- 172.21.15.115:0/4254354341 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f887c101660 0x7f887c109b50 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:20.413 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:20.409+0000 7f8881f75640 1 --2- 172.21.15.115:0/4254354341 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f887c100d40 0x7f887c101120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:20.414 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:20.409+0000 7f8881f75640 1 -- 172.21.15.115:0/4254354341 >> 172.21.15.115:0/4254354341 conn(0x7f887c0fa720 msgr2=0x7f887c0fcb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:20.414 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:20.409+0000 7f8881f75640 1 -- 172.21.15.115:0/4254354341 shutdown_connections 2024-09-13T17:09:20.414 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:20.409+0000 7f8881f75640 1 -- 172.21.15.115:0/4254354341 wait complete. 2024-09-13T17:09:20.414 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:20.410+0000 7f8881f75640 1 Processor -- start 2024-09-13T17:09:20.414 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:20.410+0000 7f8881f75640 1 -- start start 2024-09-13T17:09:20.414 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:20.410+0000 7f8881f75640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f887c100d40 0x7f887c19b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:20.414 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:20.410+0000 7f8881f75640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f887c101660 0x7f887c19bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:20.414 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:20.410+0000 7f8881f75640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f887c19c360 con 0x7f887c100d40 2024-09-13T17:09:20.414 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:20.410+0000 7f8881f75640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f887c1958f0 con 0x7f887c101660 2024-09-13T17:09:20.414 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:20.410+0000 7f887b7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f887c100d40 0x7f887c19b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:20.414 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:20.410+0000 7f887b7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f887c100d40 0x7f887c19b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:58734/0 (socket says 172.21.15.115:58734) 2024-09-13T17:09:20.414 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:20.410+0000 7f887b7fe640 1 -- 172.21.15.115:0/3212376536 learned_addr learned my addr 172.21.15.115:0/3212376536 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:09:20.414 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:20.410+0000 7f887affd640 1 --2- 172.21.15.115:0/3212376536 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f887c101660 0x7f887c19bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:20.415 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:20.410+0000 7f887b7fe640 1 -- 172.21.15.115:0/3212376536 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f887c101660 msgr2=0x7f887c19bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:20.415 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:20.410+0000 7f887b7fe640 1 --2- 172.21.15.115:0/3212376536 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f887c101660 0x7f887c19bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:20.415 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:20.410+0000 7f887b7fe640 1 -- 172.21.15.115:0/3212376536 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f886c009560 con 0x7f887c100d40 2024-09-13T17:09:20.415 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:20.410+0000 7f887b7fe640 1 --2- 172.21.15.115:0/3212376536 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f887c100d40 0x7f887c19b800 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f886400d6f0 tx=0x7f886400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:20.415 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:20.411+0000 7f8878ff9640 1 -- 172.21.15.115:0/3212376536 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8864009a30 con 0x7f887c100d40 2024-09-13T17:09:20.415 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:20.411+0000 7f8878ff9640 1 -- 172.21.15.115:0/3212376536 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f88640054c0 con 0x7f887c100d40 2024-09-13T17:09:20.415 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:20.411+0000 7f8878ff9640 1 -- 172.21.15.115:0/3212376536 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8864004db0 con 0x7f887c100d40 2024-09-13T17:09:20.415 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:20.411+0000 7f8881f75640 1 -- 172.21.15.115:0/3212376536 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f887c195bd0 con 0x7f887c100d40 2024-09-13T17:09:20.415 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:20.411+0000 7f8881f75640 1 -- 172.21.15.115:0/3212376536 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f887c1960f0 con 0x7f887c100d40 2024-09-13T17:09:20.416 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:20.412+0000 7f8881f75640 1 -- 172.21.15.115:0/3212376536 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f887c068c80 con 0x7f887c100d40 2024-09-13T17:09:20.416 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:20.412+0000 7f8878ff9640 1 -- 172.21.15.115:0/3212376536 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f8864004f30 con 0x7f887c100d40 2024-09-13T17:09:20.416 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:20.412+0000 7f8878ff9640 1 --2- 172.21.15.115:0/3212376536 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f886806cbf0 0x7f886806f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:20.416 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:20.413+0000 7f8878ff9640 1 -- 172.21.15.115:0/3212376536 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f886408c010 con 0x7f887c100d40 2024-09-13T17:09:20.416 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:20.413+0000 7f887affd640 1 --2- 172.21.15.115:0/3212376536 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f886806cbf0 0x7f886806f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:20.417 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:20.413+0000 7f887affd640 1 --2- 172.21.15.115:0/3212376536 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f886806cbf0 0x7f886806f0b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f886c000c00 tx=0x7f886c005a20 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:20.419 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:20.417+0000 7f8878ff9640 1 -- 172.21.15.115:0/3212376536 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f8864056130 con 0x7f887c100d40 2024-09-13T17:09:20.599 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:20.597+0000 7f8881f75640 1 -- 172.21.15.115:0/3212376536 --> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", "target": ["mon-mgr", ""]}) v1 -- 0x7f887c10cc90 con 0x7f886806cbf0 2024-09-13T17:09:20.610 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:20.608+0000 7f8878ff9640 1 -- 172.21.15.115:0/3212376536 <== mgr.14660 v2:172.21.15.115:6800/1049502673 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7f887c10cc90 con 0x7f886806cbf0 2024-09-13T17:09:20.610 INFO:teuthology.orchestra.run.smithi115.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T17:09:20.612 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:20.610+0000 7f8881f75640 1 -- 172.21.15.115:0/3212376536 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f886806cbf0 msgr2=0x7f886806f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:20.612 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:20.610+0000 7f8881f75640 1 --2- 172.21.15.115:0/3212376536 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f886806cbf0 0x7f886806f0b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f886c000c00 tx=0x7f886c005a20 comp rx=0 tx=0).stop 2024-09-13T17:09:20.613 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:20.610+0000 7f8881f75640 1 -- 172.21.15.115:0/3212376536 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f887c100d40 msgr2=0x7f887c19b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:20.613 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:20.610+0000 7f8881f75640 1 --2- 172.21.15.115:0/3212376536 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f887c100d40 0x7f887c19b800 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f886400d6f0 tx=0x7f886400dbb0 comp rx=0 tx=0).stop 2024-09-13T17:09:20.613 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:20.610+0000 7f8881f75640 1 -- 172.21.15.115:0/3212376536 shutdown_connections 2024-09-13T17:09:20.613 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:20.610+0000 7f8881f75640 1 --2- 172.21.15.115:0/3212376536 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f886806cbf0 0x7f886806f0b0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:20.613 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:20.610+0000 7f8881f75640 1 --2- 172.21.15.115:0/3212376536 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f887c101660 0x7f887c19bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:20.613 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:20.610+0000 7f8881f75640 1 --2- 172.21.15.115:0/3212376536 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f887c100d40 0x7f887c19b800 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:20.613 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:20.610+0000 7f8881f75640 1 -- 172.21.15.115:0/3212376536 >> 172.21.15.115:0/3212376536 conn(0x7f887c0fa720 msgr2=0x7f887c101f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:20.613 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:20.610+0000 7f8881f75640 1 -- 172.21.15.115:0/3212376536 shutdown_connections 2024-09-13T17:09:20.613 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:20.610+0000 7f8881f75640 1 -- 172.21.15.115:0/3212376536 wait complete. 2024-09-13T17:09:20.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:20 smithi195 ceph-mon[34981]: pgmap v85: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:09:20.928 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:20 smithi115 ceph-mon[27708]: pgmap v85: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:09:21.286 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-13T17:09:21.286 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi115.front.sepia.ceph.com 2024-09-13T17:09:21.286 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -e sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2024-09-13T17:09:21.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:21 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:09:21.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:21 smithi195 ceph-mon[34981]: from='client.14814 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:09:21.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:21 smithi195 ceph-mon[34981]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T17:09:21.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:21 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:09:21.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:21 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:09:21.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:21 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:09:21.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:21 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:09:21.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:21 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:09:21.828 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:21 smithi195 ceph-mon[34981]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T17:09:21.838 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:21 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:09:21.838 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:21 smithi115 ceph-mon[27708]: from='client.14814 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:09:21.838 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:21 smithi115 ceph-mon[27708]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T17:09:21.838 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:21 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:09:21.838 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:21 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:09:21.838 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:21 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:09:21.838 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:21 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:09:21.838 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:21 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:09:21.839 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:21 smithi115 ceph-mon[27708]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T17:09:22.556 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T17:09:22.706 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:22 smithi115 ceph-mon[27708]: pgmap v86: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:09:22.706 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:22 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:09:22.706 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:22 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:09:22.706 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:22 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:09:22.707 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:22 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:09:22.707 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:22 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:09:22.707 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:22 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-13T17:09:23.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:22 smithi195 ceph-mon[34981]: pgmap v86: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:09:23.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:22 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:09:23.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:22 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:09:23.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:22 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:09:23.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:22 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:09:23.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:22 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:09:23.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:22 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-13T17:09:23.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:23 smithi115 ceph-mon[27708]: Upgrade: Target is version 18.2.4-860-g6c6b083f (reef) 2024-09-13T17:09:23.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:23 smithi115 ceph-mon[27708]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, digests ['quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256'] 2024-09-13T17:09:23.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:23 smithi115 ceph-mon[27708]: Upgrade: Setting container_image for all mgr 2024-09-13T17:09:24.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:23 smithi195 ceph-mon[34981]: Upgrade: Target is version 18.2.4-860-g6c6b083f (reef) 2024-09-13T17:09:24.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:23 smithi195 ceph-mon[34981]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, digests ['quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256'] 2024-09-13T17:09:24.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:23 smithi195 ceph-mon[34981]: Upgrade: Setting container_image for all mgr 2024-09-13T17:09:24.918 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:24 smithi115 ceph-mon[27708]: pgmap v87: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:09:25.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:24 smithi195 ceph-mon[34981]: pgmap v87: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:09:25.340 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.294+0000 7fe391ff9640 1 -- 172.21.15.115:0/1390782184 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe38c1049a0 msgr2=0x7fe38c104d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:25.341 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.294+0000 7fe391ff9640 1 --2- 172.21.15.115:0/1390782184 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe38c1049a0 0x7fe38c104d80 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fe37c009880 tx=0x7fe37c02a4a0 comp rx=0 tx=0).stop 2024-09-13T17:09:25.341 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.294+0000 7fe391ff9640 1 -- 172.21.15.115:0/1390782184 shutdown_connections 2024-09-13T17:09:25.341 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.294+0000 7fe391ff9640 1 --2- 172.21.15.115:0/1390782184 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe38c0fe9a0 0x7fe38c0fee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:25.341 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.294+0000 7fe391ff9640 1 --2- 172.21.15.115:0/1390782184 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe38c1049a0 0x7fe38c104d80 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:25.341 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.294+0000 7fe391ff9640 1 -- 172.21.15.115:0/1390782184 >> 172.21.15.115:0/1390782184 conn(0x7fe38c0758c0 msgr2=0x7fe38c0fcc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:25.341 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.294+0000 7fe391ff9640 1 -- 172.21.15.115:0/1390782184 shutdown_connections 2024-09-13T17:09:25.341 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.294+0000 7fe391ff9640 1 -- 172.21.15.115:0/1390782184 wait complete. 2024-09-13T17:09:25.341 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.294+0000 7fe391ff9640 1 Processor -- start 2024-09-13T17:09:25.341 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.294+0000 7fe391ff9640 1 -- start start 2024-09-13T17:09:25.341 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.295+0000 7fe391ff9640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe38c0fe9a0 0x7fe38c1959e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:25.341 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.295+0000 7fe391ff9640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe38c1049a0 0x7fe38c195f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:25.341 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.295+0000 7fe391ff9640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe38c196600 con 0x7fe38c0fe9a0 2024-09-13T17:09:25.342 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.295+0000 7fe391ff9640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe38c19a350 con 0x7fe38c1049a0 2024-09-13T17:09:25.342 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.295+0000 7fe38b7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe38c0fe9a0 0x7fe38c1959e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:25.342 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.295+0000 7fe38b7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe38c0fe9a0 0x7fe38c1959e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:58622/0 (socket says 172.21.15.115:58622) 2024-09-13T17:09:25.342 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.295+0000 7fe38b7fe640 1 -- 172.21.15.115:0/1574580846 learned_addr learned my addr 172.21.15.115:0/1574580846 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:09:25.342 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.295+0000 7fe382ffd640 1 --2- 172.21.15.115:0/1574580846 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe38c1049a0 0x7fe38c195f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:25.342 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.295+0000 7fe38b7fe640 1 -- 172.21.15.115:0/1574580846 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe38c1049a0 msgr2=0x7fe38c195f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:25.342 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.295+0000 7fe38b7fe640 1 --2- 172.21.15.115:0/1574580846 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe38c1049a0 0x7fe38c195f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:25.342 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.295+0000 7fe38b7fe640 1 -- 172.21.15.115:0/1574580846 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe37c009560 con 0x7fe38c0fe9a0 2024-09-13T17:09:25.342 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.295+0000 7fe382ffd640 1 --2- 172.21.15.115:0/1574580846 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe38c1049a0 0x7fe38c195f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:09:25.342 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.295+0000 7fe38b7fe640 1 --2- 172.21.15.115:0/1574580846 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe38c0fe9a0 0x7fe38c1959e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fe37c006010 tx=0x7fe37c0056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:25.342 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.295+0000 7fe3897fa640 1 -- 172.21.15.115:0/1574580846 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe37c004ba0 con 0x7fe38c0fe9a0 2024-09-13T17:09:25.342 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.295+0000 7fe3897fa640 1 -- 172.21.15.115:0/1574580846 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe37c004d00 con 0x7fe38c0fe9a0 2024-09-13T17:09:25.342 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.295+0000 7fe391ff9640 1 -- 172.21.15.115:0/1574580846 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe38c19a5d0 con 0x7fe38c0fe9a0 2024-09-13T17:09:25.343 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.295+0000 7fe3897fa640 1 -- 172.21.15.115:0/1574580846 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe37c031910 con 0x7fe38c0fe9a0 2024-09-13T17:09:25.343 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.295+0000 7fe391ff9640 1 -- 172.21.15.115:0/1574580846 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe38c19aac0 con 0x7fe38c0fe9a0 2024-09-13T17:09:25.343 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.296+0000 7fe391ff9640 1 -- 172.21.15.115:0/1574580846 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe38c1000e0 con 0x7fe38c0fe9a0 2024-09-13T17:09:25.343 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.297+0000 7fe3897fa640 1 -- 172.21.15.115:0/1574580846 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fe37c031af0 con 0x7fe38c0fe9a0 2024-09-13T17:09:25.343 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.297+0000 7fe3897fa640 1 --2- 172.21.15.115:0/1574580846 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fe37806cc50 0x7fe37806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:25.343 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.297+0000 7fe3897fa640 1 -- 172.21.15.115:0/1574580846 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fe37c0ad630 con 0x7fe38c0fe9a0 2024-09-13T17:09:25.343 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.297+0000 7fe382ffd640 1 --2- 172.21.15.115:0/1574580846 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fe37806cc50 0x7fe37806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:25.343 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.298+0000 7fe382ffd640 1 --2- 172.21.15.115:0/1574580846 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fe37806cc50 0x7fe37806f110 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe38c196f90 tx=0x7fe374005d30 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:25.343 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.301+0000 7fe3897fa640 1 -- 172.21.15.115:0/1574580846 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe37c0777d0 con 0x7fe38c0fe9a0 2024-09-13T17:09:25.487 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.486+0000 7fe391ff9640 1 -- 172.21.15.115:0/1574580846 --> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe38c10bad0 con 0x7fe37806cc50 2024-09-13T17:09:25.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.487+0000 7fe3897fa640 1 -- 172.21.15.115:0/1574580846 <== mgr.14660 v2:172.21.15.115:6800/1049502673 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7fe38c10bad0 con 0x7fe37806cc50 2024-09-13T17:09:25.491 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.490+0000 7fe391ff9640 1 -- 172.21.15.115:0/1574580846 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fe37806cc50 msgr2=0x7fe37806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:25.491 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.490+0000 7fe391ff9640 1 --2- 172.21.15.115:0/1574580846 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fe37806cc50 0x7fe37806f110 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe38c196f90 tx=0x7fe374005d30 comp rx=0 tx=0).stop 2024-09-13T17:09:25.491 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.490+0000 7fe391ff9640 1 -- 172.21.15.115:0/1574580846 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe38c0fe9a0 msgr2=0x7fe38c1959e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:25.491 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.490+0000 7fe391ff9640 1 --2- 172.21.15.115:0/1574580846 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe38c0fe9a0 0x7fe38c1959e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fe37c006010 tx=0x7fe37c0056e0 comp rx=0 tx=0).stop 2024-09-13T17:09:25.491 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.490+0000 7fe391ff9640 1 -- 172.21.15.115:0/1574580846 shutdown_connections 2024-09-13T17:09:25.491 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.490+0000 7fe391ff9640 1 --2- 172.21.15.115:0/1574580846 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fe37806cc50 0x7fe37806f110 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:25.491 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.490+0000 7fe391ff9640 1 --2- 172.21.15.115:0/1574580846 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe38c1049a0 0x7fe38c195f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:25.491 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.490+0000 7fe391ff9640 1 --2- 172.21.15.115:0/1574580846 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe38c0fe9a0 0x7fe38c1959e0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:25.491 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.490+0000 7fe391ff9640 1 -- 172.21.15.115:0/1574580846 >> 172.21.15.115:0/1574580846 conn(0x7fe38c0758c0 msgr2=0x7fe38c067fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:25.492 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.490+0000 7fe391ff9640 1 -- 172.21.15.115:0/1574580846 shutdown_connections 2024-09-13T17:09:25.492 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.490+0000 7fe391ff9640 1 -- 172.21.15.115:0/1574580846 wait complete. 2024-09-13T17:09:25.499 INFO:teuthology.orchestra.run.smithi115.stdout:true 2024-09-13T17:09:25.577 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.575+0000 7f657943f640 1 -- 172.21.15.115:0/1524042241 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f65740fe9a0 msgr2=0x7f65740fee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:25.577 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.575+0000 7f657943f640 1 --2- 172.21.15.115:0/1524042241 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f65740fe9a0 0x7f65740fee00 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f655c009880 tx=0x7f655c02a4a0 comp rx=0 tx=0).stop 2024-09-13T17:09:25.577 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.575+0000 7f657943f640 1 -- 172.21.15.115:0/1524042241 shutdown_connections 2024-09-13T17:09:25.577 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.575+0000 7f657943f640 1 --2- 172.21.15.115:0/1524042241 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f65740fe9a0 0x7f65740fee00 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:25.577 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.575+0000 7f657943f640 1 --2- 172.21.15.115:0/1524042241 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f65741049a0 0x7f6574104d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:25.577 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.575+0000 7f657943f640 1 -- 172.21.15.115:0/1524042241 >> 172.21.15.115:0/1524042241 conn(0x7f65740758c0 msgr2=0x7f65740fcc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:25.577 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.575+0000 7f657943f640 1 -- 172.21.15.115:0/1524042241 shutdown_connections 2024-09-13T17:09:25.577 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.575+0000 7f657943f640 1 -- 172.21.15.115:0/1524042241 wait complete. 2024-09-13T17:09:25.577 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.576+0000 7f657943f640 1 Processor -- start 2024-09-13T17:09:25.577 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.576+0000 7f657943f640 1 -- start start 2024-09-13T17:09:25.579 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.576+0000 7f657943f640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f65740fe9a0 0x7f6574196990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:25.579 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.576+0000 7f657943f640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f65741049a0 0x7f6574196ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:25.579 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.576+0000 7f657943f640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65741974a0 con 0x7f65740fe9a0 2024-09-13T17:09:25.579 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.576+0000 7f657943f640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6574197610 con 0x7f65741049a0 2024-09-13T17:09:25.579 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.576+0000 7f6572ffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f65740fe9a0 0x7f6574196990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:25.579 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.576+0000 7f6572ffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f65740fe9a0 0x7f6574196990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:58636/0 (socket says 172.21.15.115:58636) 2024-09-13T17:09:25.579 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.576+0000 7f6572ffd640 1 -- 172.21.15.115:0/2181872477 learned_addr learned my addr 172.21.15.115:0/2181872477 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:09:25.579 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.576+0000 7f6572ffd640 1 -- 172.21.15.115:0/2181872477 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f65741049a0 msgr2=0x7f6574196ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:25.579 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.576+0000 7f6572ffd640 1 --2- 172.21.15.115:0/2181872477 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f65741049a0 0x7f6574196ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:25.579 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.576+0000 7f6572ffd640 1 -- 172.21.15.115:0/2181872477 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f655c009560 con 0x7f65740fe9a0 2024-09-13T17:09:25.579 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.577+0000 7f6572ffd640 1 --2- 172.21.15.115:0/2181872477 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f65740fe9a0 0x7f6574196990 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f656400b420 tx=0x7f656400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:25.580 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.577+0000 7f6570ff9640 1 -- 172.21.15.115:0/2181872477 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6564011800 con 0x7f65740fe9a0 2024-09-13T17:09:25.580 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.577+0000 7f6570ff9640 1 -- 172.21.15.115:0/2181872477 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6564011e00 con 0x7f65740fe9a0 2024-09-13T17:09:25.580 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.577+0000 7f657943f640 1 -- 172.21.15.115:0/2181872477 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f657419fa00 con 0x7f65740fe9a0 2024-09-13T17:09:25.580 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.577+0000 7f6570ff9640 1 -- 172.21.15.115:0/2181872477 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f656400f2e0 con 0x7f65740fe9a0 2024-09-13T17:09:25.580 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.577+0000 7f657943f640 1 -- 172.21.15.115:0/2181872477 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f657419fe70 con 0x7f65740fe9a0 2024-09-13T17:09:25.581 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.578+0000 7f657943f640 1 -- 172.21.15.115:0/2181872477 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65741000e0 con 0x7f65740fe9a0 2024-09-13T17:09:25.581 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.578+0000 7f6570ff9640 1 -- 172.21.15.115:0/2181872477 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f6564010380 con 0x7f65740fe9a0 2024-09-13T17:09:25.581 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.579+0000 7f6570ff9640 1 --2- 172.21.15.115:0/2181872477 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f656006cc50 0x7f656006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:25.581 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.579+0000 7f6570ff9640 1 -- 172.21.15.115:0/2181872477 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f656408beb0 con 0x7f65740fe9a0 2024-09-13T17:09:25.581 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.579+0000 7f656bfff640 1 --2- 172.21.15.115:0/2181872477 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f656006cc50 0x7f656006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:25.581 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.579+0000 7f656bfff640 1 --2- 172.21.15.115:0/2181872477 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f656006cc50 0x7f656006f110 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6574068420 tx=0x7f655c000bc0 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:25.584 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.583+0000 7f6570ff9640 1 -- 172.21.15.115:0/2181872477 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f6564055fd0 con 0x7f65740fe9a0 2024-09-13T17:09:25.774 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.772+0000 7f657943f640 1 -- 172.21.15.115:0/2181872477 --> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f657410bb50 con 0x7f656006cc50 2024-09-13T17:09:25.774 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.774+0000 7f6570ff9640 1 -- 172.21.15.115:0/2181872477 <== mgr.14660 v2:172.21.15.115:6800/1049502673 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f657410bb50 con 0x7f656006cc50 2024-09-13T17:09:25.777 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.776+0000 7f657943f640 1 -- 172.21.15.115:0/2181872477 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f656006cc50 msgr2=0x7f656006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:25.777 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.776+0000 7f657943f640 1 --2- 172.21.15.115:0/2181872477 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f656006cc50 0x7f656006f110 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6574068420 tx=0x7f655c000bc0 comp rx=0 tx=0).stop 2024-09-13T17:09:25.777 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.776+0000 7f657943f640 1 -- 172.21.15.115:0/2181872477 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f65740fe9a0 msgr2=0x7f6574196990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:25.777 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.776+0000 7f657943f640 1 --2- 172.21.15.115:0/2181872477 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f65740fe9a0 0x7f6574196990 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f656400b420 tx=0x7f656400b8e0 comp rx=0 tx=0).stop 2024-09-13T17:09:25.777 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.776+0000 7f657943f640 1 -- 172.21.15.115:0/2181872477 shutdown_connections 2024-09-13T17:09:25.777 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.776+0000 7f657943f640 1 --2- 172.21.15.115:0/2181872477 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f656006cc50 0x7f656006f110 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:25.778 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.776+0000 7f657943f640 1 --2- 172.21.15.115:0/2181872477 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f65741049a0 0x7f6574196ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:25.778 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.776+0000 7f657943f640 1 --2- 172.21.15.115:0/2181872477 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f65740fe9a0 0x7f6574196990 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:25.778 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.776+0000 7f657943f640 1 -- 172.21.15.115:0/2181872477 >> 172.21.15.115:0/2181872477 conn(0x7f65740758c0 msgr2=0x7f6574102310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:25.778 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.776+0000 7f657943f640 1 -- 172.21.15.115:0/2181872477 shutdown_connections 2024-09-13T17:09:25.778 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.776+0000 7f657943f640 1 -- 172.21.15.115:0/2181872477 wait complete. 2024-09-13T17:09:25.861 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.858+0000 7f7c3df64640 1 -- 172.21.15.115:0/1968902710 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7c38105bf0 msgr2=0x7f7c38105fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:25.861 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.858+0000 7f7c3df64640 1 --2- 172.21.15.115:0/1968902710 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7c38105bf0 0x7f7c38105fd0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f7c28009880 tx=0x7f7c2802a4a0 comp rx=0 tx=0).stop 2024-09-13T17:09:25.861 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.858+0000 7f7c3df64640 1 -- 172.21.15.115:0/1968902710 shutdown_connections 2024-09-13T17:09:25.861 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.858+0000 7f7c3df64640 1 --2- 172.21.15.115:0/1968902710 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7c380ffb40 0x7f7c380fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:25.861 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.858+0000 7f7c3df64640 1 --2- 172.21.15.115:0/1968902710 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7c38105bf0 0x7f7c38105fd0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:25.861 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.858+0000 7f7c3df64640 1 -- 172.21.15.115:0/1968902710 >> 172.21.15.115:0/1968902710 conn(0x7f7c380fb840 msgr2=0x7f7c380fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:25.862 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.858+0000 7f7c3df64640 1 -- 172.21.15.115:0/1968902710 shutdown_connections 2024-09-13T17:09:25.862 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.858+0000 7f7c3df64640 1 -- 172.21.15.115:0/1968902710 wait complete. 2024-09-13T17:09:25.862 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.859+0000 7f7c3df64640 1 Processor -- start 2024-09-13T17:09:25.862 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.859+0000 7f7c3df64640 1 -- start start 2024-09-13T17:09:25.862 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.859+0000 7f7c3df64640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7c380ffb40 0x7f7c3819b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:25.862 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.859+0000 7f7c3df64640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7c38105bf0 0x7f7c3819bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:25.862 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.859+0000 7f7c3df64640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c38195890 con 0x7f7c38105bf0 2024-09-13T17:09:25.862 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.859+0000 7f7c3df64640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c381959d0 con 0x7f7c380ffb40 2024-09-13T17:09:25.862 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.859+0000 7f7c2ffff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7c38105bf0 0x7f7c3819bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:25.862 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.859+0000 7f7c2ffff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7c38105bf0 0x7f7c3819bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:58666/0 (socket says 172.21.15.115:58666) 2024-09-13T17:09:25.862 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.859+0000 7f7c2ffff640 1 -- 172.21.15.115:0/2252739186 learned_addr learned my addr 172.21.15.115:0/2252739186 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:09:25.862 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.859+0000 7f7c377fe640 1 --2- 172.21.15.115:0/2252739186 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7c380ffb40 0x7f7c3819b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:25.862 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.859+0000 7f7c2ffff640 1 -- 172.21.15.115:0/2252739186 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7c380ffb40 msgr2=0x7f7c3819b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:25.863 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.859+0000 7f7c2ffff640 1 --2- 172.21.15.115:0/2252739186 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7c380ffb40 0x7f7c3819b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:25.863 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.859+0000 7f7c2ffff640 1 -- 172.21.15.115:0/2252739186 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c28009560 con 0x7f7c38105bf0 2024-09-13T17:09:25.863 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.860+0000 7f7c2ffff640 1 --2- 172.21.15.115:0/2252739186 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7c38105bf0 0x7f7c3819bd70 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f7c2000b420 tx=0x7f7c2000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:25.863 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.860+0000 7f7c357fa640 1 -- 172.21.15.115:0/2252739186 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c20011800 con 0x7f7c38105bf0 2024-09-13T17:09:25.863 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.860+0000 7f7c3df64640 1 -- 172.21.15.115:0/2252739186 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c38195cb0 con 0x7f7c38105bf0 2024-09-13T17:09:25.863 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.860+0000 7f7c357fa640 1 -- 172.21.15.115:0/2252739186 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7c20011e00 con 0x7f7c38105bf0 2024-09-13T17:09:25.863 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.860+0000 7f7c357fa640 1 -- 172.21.15.115:0/2252739186 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c2000f2e0 con 0x7f7c38105bf0 2024-09-13T17:09:25.863 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.860+0000 7f7c3df64640 1 -- 172.21.15.115:0/2252739186 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c38196280 con 0x7f7c38105bf0 2024-09-13T17:09:25.864 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.861+0000 7f7c3df64640 1 -- 172.21.15.115:0/2252739186 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c381011f0 con 0x7f7c38105bf0 2024-09-13T17:09:25.864 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.861+0000 7f7c357fa640 1 -- 172.21.15.115:0/2252739186 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f7c20010380 con 0x7f7c38105bf0 2024-09-13T17:09:25.864 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.862+0000 7f7c357fa640 1 --2- 172.21.15.115:0/2252739186 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f7c2406cc50 0x7f7c2406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:25.864 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.862+0000 7f7c357fa640 1 -- 172.21.15.115:0/2252739186 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f7c2008bdf0 con 0x7f7c38105bf0 2024-09-13T17:09:25.865 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.862+0000 7f7c377fe640 1 --2- 172.21.15.115:0/2252739186 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f7c2406cc50 0x7f7c2406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:25.865 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.862+0000 7f7c377fe640 1 --2- 172.21.15.115:0/2252739186 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f7c2406cc50 0x7f7c2406f110 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7c28000c00 tx=0x7f7c280058d0 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:25.867 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:25.866+0000 7f7c357fa640 1 -- 172.21.15.115:0/2252739186 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f7c20055f10 con 0x7f7c38105bf0 2024-09-13T17:09:26.039 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.038+0000 7f7c3df64640 1 -- 172.21.15.115:0/2252739186 --> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7c38196500 con 0x7f7c2406cc50 2024-09-13T17:09:26.040 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:25 smithi115 ceph-mon[27708]: Upgrade: Updating mon.smithi115 2024-09-13T17:09:26.040 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:25 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:09:26.040 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:25 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T17:09:26.040 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:25 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T17:09:26.040 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:25 smithi115 ceph-mon[27708]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:09:26.040 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:25 smithi115 ceph-mon[27708]: Deploying daemon mon.smithi115 on smithi115 2024-09-13T17:09:26.049 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.048+0000 7f7c357fa640 1 -- 172.21.15.115:0/2252739186 <== mgr.14660 v2:172.21.15.115:6800/1049502673 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f7c38196500 con 0x7f7c2406cc50 2024-09-13T17:09:26.049 INFO:teuthology.orchestra.run.smithi115.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T17:09:26.049 INFO:teuthology.orchestra.run.smithi115.stdout:alertmanager.smithi115 smithi115 *:9093,9094 running (76s) 56s ago 11m 16.0M - 0.25.0 c8568f914cd2 d56b91240fe1 2024-09-13T17:09:26.049 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-exporter.smithi115 smithi115 running (11m) 56s ago 11m 8108k - 18.2.4-843-g2c01458a c129f5a2fd4e 0f1eebeaf9bb 2024-09-13T17:09:26.049 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-exporter.smithi195 smithi195 running (10m) 107s ago 10m 7600k - 18.2.4-843-g2c01458a c129f5a2fd4e 6d05bafbac8a 2024-09-13T17:09:26.050 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi115 smithi115 running (11m) 56s ago 11m 6899k - 18.2.4-843-g2c01458a c129f5a2fd4e 624a903fec23 2024-09-13T17:09:26.050 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi195 smithi195 running (10m) 107s ago 10m 6891k - 18.2.4-843-g2c01458a c129f5a2fd4e 42e6ce26130d 2024-09-13T17:09:26.050 INFO:teuthology.orchestra.run.smithi115.stdout:grafana.smithi115 smithi115 *:3000 running (61s) 56s ago 11m 38.9M - 9.4.7 954c08fa6188 e1eccb1a8f3e 2024-09-13T17:09:26.050 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi115.hbtxod smithi115 running (6m) 56s ago 6m 98.8M - 18.2.4-843-g2c01458a c129f5a2fd4e 12b4f4874491 2024-09-13T17:09:26.050 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi115.ijznvr smithi115 running (6m) 56s ago 6m 166M - 18.2.4-843-g2c01458a c129f5a2fd4e 2d552564a9f4 2024-09-13T17:09:26.050 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi195.aevvgz smithi195 running (5m) 107s ago 5m 16.1M - 18.2.4-843-g2c01458a c129f5a2fd4e 299b9ad657c9 2024-09-13T17:09:26.050 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi195.qzghxj smithi195 running (6m) 107s ago 6m 14.3M - 18.2.4-843-g2c01458a c129f5a2fd4e fb16b16181ff 2024-09-13T17:09:26.050 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi115.hetcni smithi115 *:8443,9283,8765 running (3m) 56s ago 12m 487M - 18.2.4-860-g6c6b083f 8a91f241d7d4 b945dbde1934 2024-09-13T17:09:26.050 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi195.hjjifz smithi195 *:8443,9283,8765 running (2m) 107s ago 10m 438M - 18.2.4-860-g6c6b083f 8a91f241d7d4 17bccdfbcae1 2024-09-13T17:09:26.050 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi115 smithi115 running (12m) 56s ago 12m 54.4M 2048M 18.2.4-843-g2c01458a c129f5a2fd4e 202375d41e68 2024-09-13T17:09:26.050 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi195 smithi195 running (10m) 107s ago 10m 42.7M 2048M 18.2.4-843-g2c01458a c129f5a2fd4e 0f54c30e5970 2024-09-13T17:09:26.050 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi115 smithi115 *:9100 running (115s) 56s ago 11m 16.5M - 1.5.0 0da6a335fe13 26fb6f9844b5 2024-09-13T17:09:26.050 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi195 smithi195 *:9100 running (111s) 107s ago 10m 3581k - 1.5.0 0da6a335fe13 6d38e798fb16 2024-09-13T17:09:26.050 INFO:teuthology.orchestra.run.smithi115.stdout:osd.0 smithi115 running (9m) 56s ago 9m 246M 1216M 18.2.4-843-g2c01458a c129f5a2fd4e 8a8ad231962e 2024-09-13T17:09:26.051 INFO:teuthology.orchestra.run.smithi115.stdout:osd.1 smithi115 running (9m) 56s ago 9m 264M 1216M 18.2.4-843-g2c01458a c129f5a2fd4e 3fbc020102a0 2024-09-13T17:09:26.051 INFO:teuthology.orchestra.run.smithi115.stdout:osd.2 smithi115 running (8m) 56s ago 8m 223M 1216M 18.2.4-843-g2c01458a c129f5a2fd4e 7c623823e920 2024-09-13T17:09:26.051 INFO:teuthology.orchestra.run.smithi115.stdout:osd.3 smithi195 running (8m) 107s ago 8m 293M 2240M 18.2.4-843-g2c01458a c129f5a2fd4e 10ea833fd5c5 2024-09-13T17:09:26.051 INFO:teuthology.orchestra.run.smithi115.stdout:osd.4 smithi195 running (8m) 107s ago 8m 263M 2240M 18.2.4-843-g2c01458a c129f5a2fd4e 4bbc3acb9aff 2024-09-13T17:09:26.051 INFO:teuthology.orchestra.run.smithi115.stdout:osd.5 smithi195 running (7m) 107s ago 7m 234M 2240M 18.2.4-843-g2c01458a c129f5a2fd4e 4bd1b3a232d0 2024-09-13T17:09:26.051 INFO:teuthology.orchestra.run.smithi115.stdout:prometheus.smithi115 smithi115 *:9095 running (94s) 56s ago 11m 47.3M - 2.43.0 a07b618ecd1d e03fb39f6b76 2024-09-13T17:09:26.052 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.050+0000 7f7c3df64640 1 -- 172.21.15.115:0/2252739186 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f7c2406cc50 msgr2=0x7f7c2406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:26.052 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.050+0000 7f7c3df64640 1 --2- 172.21.15.115:0/2252739186 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f7c2406cc50 0x7f7c2406f110 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7c28000c00 tx=0x7f7c280058d0 comp rx=0 tx=0).stop 2024-09-13T17:09:26.052 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.050+0000 7f7c3df64640 1 -- 172.21.15.115:0/2252739186 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7c38105bf0 msgr2=0x7f7c3819bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:26.052 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.050+0000 7f7c3df64640 1 --2- 172.21.15.115:0/2252739186 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7c38105bf0 0x7f7c3819bd70 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f7c2000b420 tx=0x7f7c2000b8e0 comp rx=0 tx=0).stop 2024-09-13T17:09:26.052 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.050+0000 7f7c3df64640 1 -- 172.21.15.115:0/2252739186 shutdown_connections 2024-09-13T17:09:26.052 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.050+0000 7f7c3df64640 1 --2- 172.21.15.115:0/2252739186 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f7c2406cc50 0x7f7c2406f110 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:26.052 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.050+0000 7f7c3df64640 1 --2- 172.21.15.115:0/2252739186 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7c38105bf0 0x7f7c3819bd70 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:26.052 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.050+0000 7f7c3df64640 1 --2- 172.21.15.115:0/2252739186 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7c380ffb40 0x7f7c3819b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:26.052 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.050+0000 7f7c3df64640 1 -- 172.21.15.115:0/2252739186 >> 172.21.15.115:0/2252739186 conn(0x7f7c380fb840 msgr2=0x7f7c380fd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:26.052 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.050+0000 7f7c3df64640 1 -- 172.21.15.115:0/2252739186 shutdown_connections 2024-09-13T17:09:26.053 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.050+0000 7f7c3df64640 1 -- 172.21.15.115:0/2252739186 wait complete. 2024-09-13T17:09:26.076 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:25 smithi195 ceph-mon[34981]: Upgrade: Updating mon.smithi115 2024-09-13T17:09:26.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:25 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:09:26.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:25 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T17:09:26.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:25 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T17:09:26.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:25 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:09:26.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:25 smithi195 ceph-mon[34981]: Deploying daemon mon.smithi115 on smithi115 2024-09-13T17:09:26.131 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.130+0000 7f5142779640 1 -- 172.21.15.115:0/3746491432 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f513c0ffb40 msgr2=0x7f513c0fffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:26.131 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.130+0000 7f5142779640 1 --2- 172.21.15.115:0/3746491432 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f513c0ffb40 0x7f513c0fffa0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f5130009880 tx=0x7f513002a4a0 comp rx=0 tx=0).stop 2024-09-13T17:09:26.131 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.130+0000 7f5142779640 1 -- 172.21.15.115:0/3746491432 shutdown_connections 2024-09-13T17:09:26.131 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.130+0000 7f5142779640 1 --2- 172.21.15.115:0/3746491432 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f513c0ffb40 0x7f513c0fffa0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:26.131 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.130+0000 7f5142779640 1 --2- 172.21.15.115:0/3746491432 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f513c105bf0 0x7f513c105fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:26.131 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.130+0000 7f5142779640 1 -- 172.21.15.115:0/3746491432 >> 172.21.15.115:0/3746491432 conn(0x7f513c0fb840 msgr2=0x7f513c0fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:26.131 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.130+0000 7f5142779640 1 -- 172.21.15.115:0/3746491432 shutdown_connections 2024-09-13T17:09:26.131 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.130+0000 7f5142779640 1 -- 172.21.15.115:0/3746491432 wait complete. 2024-09-13T17:09:26.133 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.130+0000 7f5142779640 1 Processor -- start 2024-09-13T17:09:26.133 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.130+0000 7f5142779640 1 -- start start 2024-09-13T17:09:26.133 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.131+0000 7f5142779640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f513c0ffb40 0x7f513c0727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:26.133 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.131+0000 7f5142779640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f513c105bf0 0x7f513c072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:26.134 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.131+0000 7f5142779640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f513c073230 con 0x7f513c105bf0 2024-09-13T17:09:26.134 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.131+0000 7f5142779640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f513c0733a0 con 0x7f513c0ffb40 2024-09-13T17:09:26.134 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.131+0000 7f513b7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f513c105bf0 0x7f513c072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:26.134 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.131+0000 7f513b7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f513c105bf0 0x7f513c072cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:58690/0 (socket says 172.21.15.115:58690) 2024-09-13T17:09:26.134 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.131+0000 7f513b7fe640 1 -- 172.21.15.115:0/141907388 learned_addr learned my addr 172.21.15.115:0/141907388 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:09:26.134 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.131+0000 7f513bfff640 1 --2- 172.21.15.115:0/141907388 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f513c0ffb40 0x7f513c0727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:26.134 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.131+0000 7f513b7fe640 1 -- 172.21.15.115:0/141907388 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f513c0ffb40 msgr2=0x7f513c0727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:26.134 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.131+0000 7f513b7fe640 1 --2- 172.21.15.115:0/141907388 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f513c0ffb40 0x7f513c0727b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:26.134 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.131+0000 7f513b7fe640 1 -- 172.21.15.115:0/141907388 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5130009560 con 0x7f513c105bf0 2024-09-13T17:09:26.134 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.131+0000 7f513b7fe640 1 --2- 172.21.15.115:0/141907388 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f513c105bf0 0x7f513c072cf0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f5130006010 tx=0x7f51300056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:26.134 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.131+0000 7f51397fa640 1 -- 172.21.15.115:0/141907388 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5130004ba0 con 0x7f513c105bf0 2024-09-13T17:09:26.134 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.131+0000 7f5142779640 1 -- 172.21.15.115:0/141907388 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f513c073620 con 0x7f513c105bf0 2024-09-13T17:09:26.134 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.131+0000 7f51397fa640 1 -- 172.21.15.115:0/141907388 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5130004d00 con 0x7f513c105bf0 2024-09-13T17:09:26.134 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.131+0000 7f51397fa640 1 -- 172.21.15.115:0/141907388 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5130031910 con 0x7f513c105bf0 2024-09-13T17:09:26.135 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.132+0000 7f5142779640 1 -- 172.21.15.115:0/141907388 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f513c1a1f70 con 0x7f513c105bf0 2024-09-13T17:09:26.135 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.133+0000 7f5142779640 1 -- 172.21.15.115:0/141907388 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f513c1011f0 con 0x7f513c105bf0 2024-09-13T17:09:26.135 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.133+0000 7f51397fa640 1 -- 172.21.15.115:0/141907388 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f5130031b80 con 0x7f513c105bf0 2024-09-13T17:09:26.135 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.133+0000 7f51397fa640 1 --2- 172.21.15.115:0/141907388 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f512406cc50 0x7f512406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:26.135 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.134+0000 7f51397fa640 1 -- 172.21.15.115:0/141907388 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f51300ad570 con 0x7f513c105bf0 2024-09-13T17:09:26.136 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.134+0000 7f513bfff640 1 --2- 172.21.15.115:0/141907388 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f512406cc50 0x7f512406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:26.136 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.134+0000 7f513bfff640 1 --2- 172.21.15.115:0/141907388 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f512406cc50 0x7f512406f110 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f512c009890 tx=0x7f512c008040 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:26.139 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.138+0000 7f51397fa640 1 -- 172.21.15.115:0/141907388 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f5130077690 con 0x7f513c105bf0 2024-09-13T17:09:26.372 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.370+0000 7f5142779640 1 -- 172.21.15.115:0/141907388 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f513c073620 con 0x7f513c105bf0 2024-09-13T17:09:26.372 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.371+0000 7f51397fa640 1 -- 172.21.15.115:0/141907388 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+733 (secure 0 0 0) 0x7f513c073620 con 0x7f513c105bf0 2024-09-13T17:09:26.372 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-13T17:09:26.373 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": { 2024-09-13T17:09:26.373 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-843-g2c01458a (2c01458affee2b2435cd231b6e392435c1c21661) reef (stable)": 2 2024-09-13T17:09:26.373 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T17:09:26.373 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": { 2024-09-13T17:09:26.373 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 2 2024-09-13T17:09:26.373 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T17:09:26.373 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": { 2024-09-13T17:09:26.373 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-843-g2c01458a (2c01458affee2b2435cd231b6e392435c1c21661) reef (stable)": 6 2024-09-13T17:09:26.373 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T17:09:26.373 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": { 2024-09-13T17:09:26.373 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-843-g2c01458a (2c01458affee2b2435cd231b6e392435c1c21661) reef (stable)": 4 2024-09-13T17:09:26.373 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T17:09:26.373 INFO:teuthology.orchestra.run.smithi115.stdout: "overall": { 2024-09-13T17:09:26.373 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-843-g2c01458a (2c01458affee2b2435cd231b6e392435c1c21661) reef (stable)": 12, 2024-09-13T17:09:26.374 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 2 2024-09-13T17:09:26.374 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-13T17:09:26.374 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-13T17:09:26.374 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.373+0000 7f5142779640 1 -- 172.21.15.115:0/141907388 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f512406cc50 msgr2=0x7f512406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:26.374 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.373+0000 7f5142779640 1 --2- 172.21.15.115:0/141907388 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f512406cc50 0x7f512406f110 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f512c009890 tx=0x7f512c008040 comp rx=0 tx=0).stop 2024-09-13T17:09:26.375 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.373+0000 7f5142779640 1 -- 172.21.15.115:0/141907388 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f513c105bf0 msgr2=0x7f513c072cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:26.375 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.373+0000 7f5142779640 1 --2- 172.21.15.115:0/141907388 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f513c105bf0 0x7f513c072cf0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f5130006010 tx=0x7f51300056e0 comp rx=0 tx=0).stop 2024-09-13T17:09:26.375 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.373+0000 7f5142779640 1 -- 172.21.15.115:0/141907388 shutdown_connections 2024-09-13T17:09:26.375 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.373+0000 7f5142779640 1 --2- 172.21.15.115:0/141907388 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f512406cc50 0x7f512406f110 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:26.375 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.373+0000 7f5142779640 1 --2- 172.21.15.115:0/141907388 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f513c105bf0 0x7f513c072cf0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:26.375 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.373+0000 7f5142779640 1 --2- 172.21.15.115:0/141907388 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f513c0ffb40 0x7f513c0727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:26.375 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.373+0000 7f5142779640 1 -- 172.21.15.115:0/141907388 >> 172.21.15.115:0/141907388 conn(0x7f513c0fb840 msgr2=0x7f513c0fd9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:26.375 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.373+0000 7f5142779640 1 -- 172.21.15.115:0/141907388 shutdown_connections 2024-09-13T17:09:26.375 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.373+0000 7f5142779640 1 -- 172.21.15.115:0/141907388 wait complete. 2024-09-13T17:09:26.458 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.455+0000 7f260f585640 1 -- 172.21.15.115:0/2313047861 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2608101620 msgr2=0x7f2608109b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:26.458 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.455+0000 7f260f585640 1 --2- 172.21.15.115:0/2313047861 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2608101620 0x7f2608109b10 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f25f8009880 tx=0x7f25f802a530 comp rx=0 tx=0).stop 2024-09-13T17:09:26.458 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.456+0000 7f260f585640 1 -- 172.21.15.115:0/2313047861 shutdown_connections 2024-09-13T17:09:26.458 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.456+0000 7f260f585640 1 --2- 172.21.15.115:0/2313047861 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2608101620 0x7f2608109b10 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:26.458 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.456+0000 7f260f585640 1 --2- 172.21.15.115:0/2313047861 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2608100d00 0x7f26081010e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:26.458 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.456+0000 7f260f585640 1 -- 172.21.15.115:0/2313047861 >> 172.21.15.115:0/2313047861 conn(0x7f26080758c0 msgr2=0x7f26080fcc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:26.458 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.456+0000 7f260f585640 1 -- 172.21.15.115:0/2313047861 shutdown_connections 2024-09-13T17:09:26.459 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.456+0000 7f260f585640 1 -- 172.21.15.115:0/2313047861 wait complete. 2024-09-13T17:09:26.459 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.456+0000 7f260f585640 1 Processor -- start 2024-09-13T17:09:26.459 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.456+0000 7f260f585640 1 -- start start 2024-09-13T17:09:26.459 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.456+0000 7f260f585640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2608100d00 0x7f260819b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:26.459 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.456+0000 7f260f585640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2608101620 0x7f260819bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:26.459 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.456+0000 7f260f585640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f260819c3e0 con 0x7f2608100d00 2024-09-13T17:09:26.459 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.456+0000 7f260f585640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2608195970 con 0x7f2608101620 2024-09-13T17:09:26.459 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.457+0000 7f260d321640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2608100d00 0x7f260819b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:26.459 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.457+0000 7f260d321640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2608100d00 0x7f260819b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:58712/0 (socket says 172.21.15.115:58712) 2024-09-13T17:09:26.459 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.457+0000 7f260d321640 1 -- 172.21.15.115:0/2140228304 learned_addr learned my addr 172.21.15.115:0/2140228304 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:09:26.459 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.457+0000 7f260cb20640 1 --2- 172.21.15.115:0/2140228304 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2608101620 0x7f260819bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:26.459 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.457+0000 7f260d321640 1 -- 172.21.15.115:0/2140228304 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2608101620 msgr2=0x7f260819bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:26.459 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.457+0000 7f260d321640 1 --2- 172.21.15.115:0/2140228304 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2608101620 0x7f260819bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:26.459 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.457+0000 7f260d321640 1 -- 172.21.15.115:0/2140228304 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25f8009560 con 0x7f2608100d00 2024-09-13T17:09:26.460 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.457+0000 7f260d321640 1 --2- 172.21.15.115:0/2140228304 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2608100d00 0x7f260819b880 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f260400b420 tx=0x7f260400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:26.461 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.457+0000 7f25fe7fc640 1 -- 172.21.15.115:0/2140228304 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2604011800 con 0x7f2608100d00 2024-09-13T17:09:26.461 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.457+0000 7f260f585640 1 -- 172.21.15.115:0/2140228304 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2608195c50 con 0x7f2608100d00 2024-09-13T17:09:26.461 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.457+0000 7f25fe7fc640 1 -- 172.21.15.115:0/2140228304 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2604011e00 con 0x7f2608100d00 2024-09-13T17:09:26.461 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.457+0000 7f25fe7fc640 1 -- 172.21.15.115:0/2140228304 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f260400f2e0 con 0x7f2608100d00 2024-09-13T17:09:26.461 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.457+0000 7f260f585640 1 -- 172.21.15.115:0/2140228304 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2608196170 con 0x7f2608100d00 2024-09-13T17:09:26.461 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.458+0000 7f260f585640 1 -- 172.21.15.115:0/2140228304 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2608068420 con 0x7f2608100d00 2024-09-13T17:09:26.461 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.459+0000 7f25fe7fc640 1 -- 172.21.15.115:0/2140228304 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f2604010380 con 0x7f2608100d00 2024-09-13T17:09:26.461 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.459+0000 7f25fe7fc640 1 --2- 172.21.15.115:0/2140228304 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f25f406cc50 0x7f25f406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:26.461 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.459+0000 7f25fe7fc640 1 -- 172.21.15.115:0/2140228304 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f260408bdf0 con 0x7f2608100d00 2024-09-13T17:09:26.462 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.459+0000 7f260cb20640 1 --2- 172.21.15.115:0/2140228304 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f25f406cc50 0x7f25f406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:26.462 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.460+0000 7f260cb20640 1 --2- 172.21.15.115:0/2140228304 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f25f406cc50 0x7f25f406f110 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f25f8000c00 tx=0x7f25f80058d0 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:26.465 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.464+0000 7f25fe7fc640 1 -- 172.21.15.115:0/2140228304 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f2604055f10 con 0x7f2608100d00 2024-09-13T17:09:26.676 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.674+0000 7f260f585640 1 -- 172.21.15.115:0/2140228304 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f2608104490 con 0x7f2608100d00 2024-09-13T17:09:26.676 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.674+0000 7f25fe7fc640 1 -- 172.21.15.115:0/2140228304 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1874 (secure 0 0 0) 0x7f2604059530 con 0x7f2608100d00 2024-09-13T17:09:26.676 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 19 2024-09-13T17:09:26.677 INFO:teuthology.orchestra.run.smithi115.stdout:e19 2024-09-13T17:09:26.677 INFO:teuthology.orchestra.run.smithi115.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T17:09:26.677 INFO:teuthology.orchestra.run.smithi115.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T17:09:26.677 INFO:teuthology.orchestra.run.smithi115.stdout:legacy client fscid: 1 2024-09-13T17:09:26.677 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:09:26.677 INFO:teuthology.orchestra.run.smithi115.stdout:Filesystem 'cephfs' (1) 2024-09-13T17:09:26.677 INFO:teuthology.orchestra.run.smithi115.stdout:fs_name cephfs 2024-09-13T17:09:26.677 INFO:teuthology.orchestra.run.smithi115.stdout:epoch 19 2024-09-13T17:09:26.677 INFO:teuthology.orchestra.run.smithi115.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T17:09:26.677 INFO:teuthology.orchestra.run.smithi115.stdout:created 2024-09-13T17:03:16.313116+0000 2024-09-13T17:09:26.678 INFO:teuthology.orchestra.run.smithi115.stdout:modified 2024-09-13T17:03:33.410348+0000 2024-09-13T17:09:26.678 INFO:teuthology.orchestra.run.smithi115.stdout:tableserver 0 2024-09-13T17:09:26.678 INFO:teuthology.orchestra.run.smithi115.stdout:root 0 2024-09-13T17:09:26.678 INFO:teuthology.orchestra.run.smithi115.stdout:session_timeout 60 2024-09-13T17:09:26.678 INFO:teuthology.orchestra.run.smithi115.stdout:session_autoclose 300 2024-09-13T17:09:26.678 INFO:teuthology.orchestra.run.smithi115.stdout:max_file_size 1099511627776 2024-09-13T17:09:26.678 INFO:teuthology.orchestra.run.smithi115.stdout:max_xattr_size 65536 2024-09-13T17:09:26.678 INFO:teuthology.orchestra.run.smithi115.stdout:required_client_features {} 2024-09-13T17:09:26.678 INFO:teuthology.orchestra.run.smithi115.stdout:last_failure 0 2024-09-13T17:09:26.678 INFO:teuthology.orchestra.run.smithi115.stdout:last_failure_osd_epoch 46 2024-09-13T17:09:26.678 INFO:teuthology.orchestra.run.smithi115.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T17:09:26.678 INFO:teuthology.orchestra.run.smithi115.stdout:max_mds 1 2024-09-13T17:09:26.678 INFO:teuthology.orchestra.run.smithi115.stdout:in 0 2024-09-13T17:09:26.678 INFO:teuthology.orchestra.run.smithi115.stdout:up {0=14470} 2024-09-13T17:09:26.679 INFO:teuthology.orchestra.run.smithi115.stdout:failed 2024-09-13T17:09:26.679 INFO:teuthology.orchestra.run.smithi115.stdout:damaged 2024-09-13T17:09:26.679 INFO:teuthology.orchestra.run.smithi115.stdout:stopped 2024-09-13T17:09:26.679 INFO:teuthology.orchestra.run.smithi115.stdout:data_pools [3] 2024-09-13T17:09:26.679 INFO:teuthology.orchestra.run.smithi115.stdout:metadata_pool 2 2024-09-13T17:09:26.679 INFO:teuthology.orchestra.run.smithi115.stdout:inline_data enabled 2024-09-13T17:09:26.679 INFO:teuthology.orchestra.run.smithi115.stdout:balancer 2024-09-13T17:09:26.679 INFO:teuthology.orchestra.run.smithi115.stdout:bal_rank_mask -1 2024-09-13T17:09:26.679 INFO:teuthology.orchestra.run.smithi115.stdout:standby_count_wanted 1 2024-09-13T17:09:26.679 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi115.ijznvr{0:14470} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.115:6828/4128583274,v1:172.21.15.115:6829/4128583274] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T17:09:26.679 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi115.hbtxod{0:14486} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.115:6826/1977394649,v1:172.21.15.115:6827/1977394649] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T17:09:26.680 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:09:26.680 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:09:26.680 INFO:teuthology.orchestra.run.smithi115.stdout:Standby daemons: 2024-09-13T17:09:26.680 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:09:26.680 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi195.aevvgz{-1:24253} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.195:6826/8826118,v1:172.21.15.195:6827/8826118] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T17:09:26.680 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi195.qzghxj{-1:24259} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.195:6824/3335357704,v1:172.21.15.195:6825/3335357704] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T17:09:26.681 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.677+0000 7f260f585640 1 -- 172.21.15.115:0/2140228304 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f25f406cc50 msgr2=0x7f25f406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:26.681 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.677+0000 7f260f585640 1 --2- 172.21.15.115:0/2140228304 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f25f406cc50 0x7f25f406f110 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f25f8000c00 tx=0x7f25f80058d0 comp rx=0 tx=0).stop 2024-09-13T17:09:26.681 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.677+0000 7f260f585640 1 -- 172.21.15.115:0/2140228304 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2608100d00 msgr2=0x7f260819b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:26.681 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.677+0000 7f260f585640 1 --2- 172.21.15.115:0/2140228304 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2608100d00 0x7f260819b880 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f260400b420 tx=0x7f260400b8e0 comp rx=0 tx=0).stop 2024-09-13T17:09:26.682 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.677+0000 7f260f585640 1 -- 172.21.15.115:0/2140228304 shutdown_connections 2024-09-13T17:09:26.682 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.677+0000 7f260f585640 1 --2- 172.21.15.115:0/2140228304 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f25f406cc50 0x7f25f406f110 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:26.682 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.677+0000 7f260f585640 1 --2- 172.21.15.115:0/2140228304 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2608101620 0x7f260819bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:26.682 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.677+0000 7f260f585640 1 --2- 172.21.15.115:0/2140228304 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2608100d00 0x7f260819b880 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:26.682 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.677+0000 7f260f585640 1 -- 172.21.15.115:0/2140228304 >> 172.21.15.115:0/2140228304 conn(0x7f26080758c0 msgr2=0x7f2608101f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:26.682 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.677+0000 7f260f585640 1 -- 172.21.15.115:0/2140228304 shutdown_connections 2024-09-13T17:09:26.682 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.677+0000 7f260f585640 1 -- 172.21.15.115:0/2140228304 wait complete. 2024-09-13T17:09:26.765 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.763+0000 7f500b298640 1 -- 172.21.15.115:0/928426353 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5004100cc0 msgr2=0x7f50041010a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:26.765 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.763+0000 7f500b298640 1 --2- 172.21.15.115:0/928426353 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5004100cc0 0x7f50041010a0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f50000098b0 tx=0x7f500002a560 comp rx=0 tx=0).stop 2024-09-13T17:09:26.765 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.763+0000 7f500b298640 1 -- 172.21.15.115:0/928426353 shutdown_connections 2024-09-13T17:09:26.765 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.763+0000 7f500b298640 1 --2- 172.21.15.115:0/928426353 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50041015e0 0x7f5004109ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:26.765 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.763+0000 7f500b298640 1 --2- 172.21.15.115:0/928426353 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5004100cc0 0x7f50041010a0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:26.765 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.763+0000 7f500b298640 1 -- 172.21.15.115:0/928426353 >> 172.21.15.115:0/928426353 conn(0x7f50040758c0 msgr2=0x7f50040fcc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:26.765 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.764+0000 7f500b298640 1 -- 172.21.15.115:0/928426353 shutdown_connections 2024-09-13T17:09:26.765 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.764+0000 7f500b298640 1 -- 172.21.15.115:0/928426353 wait complete. 2024-09-13T17:09:26.767 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.764+0000 7f500b298640 1 Processor -- start 2024-09-13T17:09:26.767 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.764+0000 7f500b298640 1 -- start start 2024-09-13T17:09:26.767 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.765+0000 7f500b298640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5004100cc0 0x7f500419d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:26.767 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.765+0000 7f500b298640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f50041015e0 0x7f500419ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:26.767 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.765+0000 7f500b298640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f500419e4f0 con 0x7f50041015e0 2024-09-13T17:09:26.768 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.765+0000 7f500b298640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5004197ad0 con 0x7f5004100cc0 2024-09-13T17:09:26.768 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.765+0000 7f5008833640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f50041015e0 0x7f500419ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:26.768 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.765+0000 7f5008833640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f50041015e0 0x7f500419ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:58722/0 (socket says 172.21.15.115:58722) 2024-09-13T17:09:26.768 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.765+0000 7f5008833640 1 -- 172.21.15.115:0/3945613222 learned_addr learned my addr 172.21.15.115:0/3945613222 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:09:26.768 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.765+0000 7f5009034640 1 --2- 172.21.15.115:0/3945613222 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5004100cc0 0x7f500419d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:26.768 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.765+0000 7f5008833640 1 -- 172.21.15.115:0/3945613222 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5004100cc0 msgr2=0x7f500419d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:26.768 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.765+0000 7f5008833640 1 --2- 172.21.15.115:0/3945613222 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5004100cc0 0x7f500419d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:26.768 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.765+0000 7f5008833640 1 -- 172.21.15.115:0/3945613222 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5000009560 con 0x7f50041015e0 2024-09-13T17:09:26.768 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.765+0000 7f5009034640 1 --2- 172.21.15.115:0/3945613222 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5004100cc0 0x7f500419d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:09:26.768 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.765+0000 7f5008833640 1 --2- 172.21.15.115:0/3945613222 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f50041015e0 0x7f500419ded0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f4ff400c810 tx=0x7f4ff400ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:26.768 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.765+0000 7f4ffa7fc640 1 -- 172.21.15.115:0/3945613222 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ff40041f0 con 0x7f50041015e0 2024-09-13T17:09:26.769 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.766+0000 7f4ffa7fc640 1 -- 172.21.15.115:0/3945613222 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4ff4007e50 con 0x7f50041015e0 2024-09-13T17:09:26.769 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.766+0000 7f4ffa7fc640 1 -- 172.21.15.115:0/3945613222 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ff40049d0 con 0x7f50041015e0 2024-09-13T17:09:26.769 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.766+0000 7f500b298640 1 -- 172.21.15.115:0/3945613222 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5004197db0 con 0x7f50041015e0 2024-09-13T17:09:26.769 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.766+0000 7f500b298640 1 -- 172.21.15.115:0/3945613222 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5004198300 con 0x7f50041015e0 2024-09-13T17:09:26.770 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.767+0000 7f500b298640 1 -- 172.21.15.115:0/3945613222 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5004068460 con 0x7f50041015e0 2024-09-13T17:09:26.770 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.767+0000 7f4ffa7fc640 1 -- 172.21.15.115:0/3945613222 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f4ff40079b0 con 0x7f50041015e0 2024-09-13T17:09:26.770 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.768+0000 7f4ffa7fc640 1 --2- 172.21.15.115:0/3945613222 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f4ff006cc50 0x7f4ff006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:26.770 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.768+0000 7f4ffa7fc640 1 -- 172.21.15.115:0/3945613222 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f4ff408c360 con 0x7f50041015e0 2024-09-13T17:09:26.770 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.768+0000 7f5009034640 1 --2- 172.21.15.115:0/3945613222 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f4ff006cc50 0x7f4ff006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:26.770 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.768+0000 7f5009034640 1 --2- 172.21.15.115:0/3945613222 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f4ff006cc50 0x7f4ff006f110 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5000000c00 tx=0x7f5000005a20 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:26.773 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.772+0000 7f4ffa7fc640 1 -- 172.21.15.115:0/3945613222 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f4ff4056480 con 0x7f50041015e0 2024-09-13T17:09:26.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:26 smithi115 systemd[1]: Stopping Ceph mon.smithi115 for ffbd7588-71f0-11ef-bceb-c7b262605968... 2024-09-13T17:09:26.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:26 smithi115 ceph-mon[27708]: pgmap v88: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:09:26.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:26 smithi115 ceph-mon[27708]: from='client.14818 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:09:26.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:26 smithi115 ceph-mon[27708]: from='client.14822 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:09:26.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:26 smithi115 ceph-mon[27708]: from='client.? 172.21.15.115:0/141907388' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:09:26.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:26 smithi115 ceph-mon[27708]: from='client.? 172.21.15.115:0/2140228304' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T17:09:26.980 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.979+0000 7f500b298640 1 -- 172.21.15.115:0/3945613222 --> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f500410cbf0 con 0x7f4ff006cc50 2024-09-13T17:09:26.982 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.981+0000 7f4ffa7fc640 1 -- 172.21.15.115:0/3945613222 <== mgr.14660 v2:172.21.15.115:6800/1049502673 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f500410cbf0 con 0x7f4ff006cc50 2024-09-13T17:09:26.982 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-13T17:09:26.982 INFO:teuthology.orchestra.run.smithi115.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256", 2024-09-13T17:09:26.982 INFO:teuthology.orchestra.run.smithi115.stdout: "in_progress": true, 2024-09-13T17:09:26.982 INFO:teuthology.orchestra.run.smithi115.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T17:09:26.982 INFO:teuthology.orchestra.run.smithi115.stdout: "services_complete": [ 2024-09-13T17:09:26.982 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr" 2024-09-13T17:09:26.982 INFO:teuthology.orchestra.run.smithi115.stdout: ], 2024-09-13T17:09:26.982 INFO:teuthology.orchestra.run.smithi115.stdout: "progress": "2/23 daemons upgraded", 2024-09-13T17:09:26.982 INFO:teuthology.orchestra.run.smithi115.stdout: "message": "Currently upgrading mon daemons", 2024-09-13T17:09:26.982 INFO:teuthology.orchestra.run.smithi115.stdout: "is_paused": false 2024-09-13T17:09:26.982 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-13T17:09:26.984 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.983+0000 7f500b298640 1 -- 172.21.15.115:0/3945613222 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f4ff006cc50 msgr2=0x7f4ff006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:26.984 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.983+0000 7f500b298640 1 --2- 172.21.15.115:0/3945613222 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f4ff006cc50 0x7f4ff006f110 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5000000c00 tx=0x7f5000005a20 comp rx=0 tx=0).stop 2024-09-13T17:09:26.984 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.983+0000 7f500b298640 1 -- 172.21.15.115:0/3945613222 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f50041015e0 msgr2=0x7f500419ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:26.984 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.983+0000 7f500b298640 1 --2- 172.21.15.115:0/3945613222 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f50041015e0 0x7f500419ded0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f4ff400c810 tx=0x7f4ff400ccd0 comp rx=0 tx=0).stop 2024-09-13T17:09:26.984 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.983+0000 7f500b298640 1 -- 172.21.15.115:0/3945613222 shutdown_connections 2024-09-13T17:09:26.984 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.983+0000 7f500b298640 1 --2- 172.21.15.115:0/3945613222 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f4ff006cc50 0x7f4ff006f110 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:26.985 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.983+0000 7f500b298640 1 --2- 172.21.15.115:0/3945613222 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f50041015e0 0x7f500419ded0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:26.985 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.983+0000 7f500b298640 1 --2- 172.21.15.115:0/3945613222 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5004100cc0 0x7f500419d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:26.985 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.983+0000 7f500b298640 1 -- 172.21.15.115:0/3945613222 >> 172.21.15.115:0/3945613222 conn(0x7f50040758c0 msgr2=0x7f5004100130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:26.985 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.983+0000 7f500b298640 1 -- 172.21.15.115:0/3945613222 shutdown_connections 2024-09-13T17:09:26.985 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:26.983+0000 7f500b298640 1 -- 172.21.15.115:0/3945613222 wait complete. 2024-09-13T17:09:27.072 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:27.068+0000 7f6a02b6c640 1 -- 172.21.15.115:0/3850100141 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f69fc1016a0 msgr2=0x7f69fc109b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:27.072 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:27.068+0000 7f6a02b6c640 1 --2- 172.21.15.115:0/3850100141 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f69fc1016a0 0x7f69fc109b90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f69e80098b0 tx=0x7f69e802a580 comp rx=0 tx=0).stop 2024-09-13T17:09:27.072 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:27.068+0000 7f6a02b6c640 1 -- 172.21.15.115:0/3850100141 shutdown_connections 2024-09-13T17:09:27.072 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:27.068+0000 7f6a02b6c640 1 --2- 172.21.15.115:0/3850100141 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f69fc1016a0 0x7f69fc109b90 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:27.072 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:27.068+0000 7f6a02b6c640 1 --2- 172.21.15.115:0/3850100141 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f69fc100d80 0x7f69fc101160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:27.072 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:27.068+0000 7f6a02b6c640 1 -- 172.21.15.115:0/3850100141 >> 172.21.15.115:0/3850100141 conn(0x7f69fc0fa720 msgr2=0x7f69fc0fcb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:27.072 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:27.069+0000 7f6a02b6c640 1 -- 172.21.15.115:0/3850100141 shutdown_connections 2024-09-13T17:09:27.072 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:27.069+0000 7f6a02b6c640 1 -- 172.21.15.115:0/3850100141 wait complete. 2024-09-13T17:09:27.072 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:27.069+0000 7f6a02b6c640 1 Processor -- start 2024-09-13T17:09:27.072 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:27.069+0000 7f6a02b6c640 1 -- start start 2024-09-13T17:09:27.073 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:27.069+0000 7f6a02b6c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f69fc100d80 0x7f69fc19b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:27.073 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:27.069+0000 7f6a02b6c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f69fc1016a0 0x7f69fc19bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:27.073 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:27.069+0000 7f6a02b6c640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69fc19c400 con 0x7f69fc100d80 2024-09-13T17:09:27.073 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:27.069+0000 7f6a02b6c640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69fc195990 con 0x7f69fc1016a0 2024-09-13T17:09:27.073 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:27.069+0000 7f6a00908640 1 -- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f69fc100d80 msgr2=0x7f69fc19b8a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:3300/0 2024-09-13T17:09:27.073 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:27.069+0000 7f6a00908640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f69fc100d80 0x7f69fc19b8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T17:09:27.073 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:27.070+0000 7f69fbfff640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f69fc1016a0 0x7f69fc19bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:27.073 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:27.070+0000 7f69fbfff640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f69fc1016a0 0x7f69fc19bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.115:34184/0 (socket says 172.21.15.115:34184) 2024-09-13T17:09:27.073 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:27.070+0000 7f69fbfff640 1 -- 172.21.15.115:0/606602884 learned_addr learned my addr 172.21.15.115:0/606602884 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:09:27.073 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:27.070+0000 7f69fbfff640 1 -- 172.21.15.115:0/606602884 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f69fc100d80 msgr2=0x7f69fc19b8a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T17:09:27.073 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:27.070+0000 7f69fbfff640 1 --2- 172.21.15.115:0/606602884 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f69fc100d80 0x7f69fc19b8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:27.073 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:27.070+0000 7f69fbfff640 1 -- 172.21.15.115:0/606602884 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69e8009560 con 0x7f69fc1016a0 2024-09-13T17:09:27.073 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:27.070+0000 7f69fbfff640 1 --2- 172.21.15.115:0/606602884 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f69fc1016a0 0x7f69fc19bde0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f69e8006010 tx=0x7f69e8005700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:27.074 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:27.070+0000 7f69f9ffb640 1 -- 172.21.15.115:0/606602884 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f69e8004ba0 con 0x7f69fc1016a0 2024-09-13T17:09:27.074 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:27.070+0000 7f6a02b6c640 1 -- 172.21.15.115:0/606602884 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69fc195c10 con 0x7f69fc1016a0 2024-09-13T17:09:27.074 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:27.070+0000 7f69f9ffb640 1 -- 172.21.15.115:0/606602884 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f69e8004d00 con 0x7f69fc1016a0 2024-09-13T17:09:27.074 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:27.070+0000 7f69f9ffb640 1 -- 172.21.15.115:0/606602884 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f69e803c8d0 con 0x7f69fc1016a0 2024-09-13T17:09:27.074 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:27.071+0000 7f6a02b6c640 1 -- 172.21.15.115:0/606602884 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69fc196100 con 0x7f69fc1016a0 2024-09-13T17:09:27.075 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:27.072+0000 7f6a02b6c640 1 -- 172.21.15.115:0/606602884 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69fc068c40 con 0x7f69fc1016a0 2024-09-13T17:09:27.075 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:27.072+0000 7f69f9ffb640 1 -- 172.21.15.115:0/606602884 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f69e8003c90 con 0x7f69fc1016a0 2024-09-13T17:09:27.075 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:27.073+0000 7f69f9ffb640 1 --2- 172.21.15.115:0/606602884 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f69ec06cbb0 0x7f69ec06f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:27.075 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:27.073+0000 7f69f9ffb640 1 -- 172.21.15.115:0/606602884 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f69e80ad620 con 0x7f69fc1016a0 2024-09-13T17:09:27.075 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:27.073+0000 7f6a00908640 1 --2- 172.21.15.115:0/606602884 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f69ec06cbb0 0x7f69ec06f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:27.075 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:27.073+0000 7f6a00908640 1 --2- 172.21.15.115:0/606602884 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f69ec06cbb0 0x7f69ec06f070 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f69f0006fd0 tx=0x7f69f0006da0 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:27.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:26 smithi195 ceph-mon[34981]: pgmap v88: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:09:27.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:26 smithi195 ceph-mon[34981]: from='client.14818 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:09:27.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:26 smithi195 ceph-mon[34981]: from='client.14822 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:09:27.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:26 smithi195 ceph-mon[34981]: from='client.? 172.21.15.115:0/141907388' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:09:27.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:26 smithi195 ceph-mon[34981]: from='client.? 172.21.15.115:0/2140228304' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T17:09:27.078 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:27.078+0000 7f69f9ffb640 1 -- 172.21.15.115:0/606602884 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f69e8077760 con 0x7f69fc1016a0 2024-09-13T17:09:27.252 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:27 smithi115 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-mon-smithi115[27704]: 2024-09-13T17:09:27.027+0000 7fb9a2adf640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi115 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T17:09:27.253 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:27 smithi115 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-mon-smithi115[27704]: 2024-09-13T17:09:27.027+0000 7fb9a2adf640 -1 mon.smithi115@0(leader) e2 *** Got Signal Terminated *** 2024-09-13T17:09:27.310 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:27.308+0000 7f6a02b6c640 1 -- 172.21.15.115:0/606602884 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f69fc1044a0 con 0x7f69fc1016a0 2024-09-13T17:09:27.310 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:27.309+0000 7f69f9ffb640 1 -- 172.21.15.115:0/606602884 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f69e8081020 con 0x7f69fc1016a0 2024-09-13T17:09:27.310 INFO:teuthology.orchestra.run.smithi115.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-13T17:09:27.311 INFO:teuthology.orchestra.run.smithi115.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T17:09:27.311 INFO:teuthology.orchestra.run.smithi115.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T17:09:27.313 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:27.311+0000 7f6a02b6c640 1 -- 172.21.15.115:0/606602884 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f69ec06cbb0 msgr2=0x7f69ec06f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:27.313 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:27.311+0000 7f6a02b6c640 1 --2- 172.21.15.115:0/606602884 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f69ec06cbb0 0x7f69ec06f070 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f69f0006fd0 tx=0x7f69f0006da0 comp rx=0 tx=0).stop 2024-09-13T17:09:27.313 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:27.311+0000 7f6a02b6c640 1 -- 172.21.15.115:0/606602884 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f69fc1016a0 msgr2=0x7f69fc19bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:27.313 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:27.311+0000 7f6a02b6c640 1 --2- 172.21.15.115:0/606602884 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f69fc1016a0 0x7f69fc19bde0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f69e8006010 tx=0x7f69e8005700 comp rx=0 tx=0).stop 2024-09-13T17:09:27.313 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:27.311+0000 7f6a02b6c640 1 -- 172.21.15.115:0/606602884 shutdown_connections 2024-09-13T17:09:27.313 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:27.311+0000 7f6a02b6c640 1 --2- 172.21.15.115:0/606602884 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f69ec06cbb0 0x7f69ec06f070 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:27.313 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:27.311+0000 7f6a02b6c640 1 --2- 172.21.15.115:0/606602884 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f69fc1016a0 0x7f69fc19bde0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:27.313 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:27.311+0000 7f6a02b6c640 1 --2- 172.21.15.115:0/606602884 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f69fc100d80 0x7f69fc19b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:27.313 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:27.311+0000 7f6a02b6c640 1 -- 172.21.15.115:0/606602884 >> 172.21.15.115:0/606602884 conn(0x7f69fc0fa720 msgr2=0x7f69fc101fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:27.313 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:27.311+0000 7f6a02b6c640 1 -- 172.21.15.115:0/606602884 shutdown_connections 2024-09-13T17:09:27.313 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:27.311+0000 7f6a02b6c640 1 -- 172.21.15.115:0/606602884 wait complete. 2024-09-13T17:09:27.588 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:27 smithi115 podman[109290]: 2024-09-13 17:09:27.252037354 +0000 UTC m=+0.322091522 container died 202375d41e6879d250542be38d20001638a9d3acc0e1cb69e0f9b784a1c5a105 (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-mon-smithi115, RELEASE=reef-2c01458, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-13T17:09:27.872 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:27 smithi115 podman[109290]: 2024-09-13 17:09:27.68704236 +0000 UTC m=+0.757096536 container cleanup 202375d41e6879d250542be38d20001638a9d3acc0e1cb69e0f9b784a1c5a105 (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-mon-smithi115, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=reef-2c01458, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-13T17:09:27.872 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:27 smithi115 bash[109290]: ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-mon-smithi115 2024-09-13T17:09:28.122 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:27 smithi115 podman[109323]: 2024-09-13 17:09:27.871591622 +0000 UTC m=+0.621996194 container remove 202375d41e6879d250542be38d20001638a9d3acc0e1cb69e0f9b784a1c5a105 (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-mon-smithi115, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=reef-2c01458, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-13T17:09:28.123 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 systemd[1]: ceph-ffbd7588-71f0-11ef-bceb-c7b262605968@mon.smithi115.service: Deactivated successfully. 2024-09-13T17:09:28.123 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 systemd[1]: Stopped Ceph mon.smithi115 for ffbd7588-71f0-11ef-bceb-c7b262605968. 2024-09-13T17:09:28.123 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 systemd[1]: ceph-ffbd7588-71f0-11ef-bceb-c7b262605968@mon.smithi115.service: Consumed 12.223s CPU time. 2024-09-13T17:09:28.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 systemd[1]: Starting Ceph mon.smithi115 for ffbd7588-71f0-11ef-bceb-c7b262605968... 2024-09-13T17:09:28.792 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 podman[109469]: 2024-09-13 17:09:28.428967056 +0000 UTC m=+0.015676960 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T17:09:28.792 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 podman[109469]: 2024-09-13 17:09:28.539504364 +0000 UTC m=+0.126214254 container create 8dd7baf2c6b6e9584cc7f662fd57d1b6c4e981ba543e41b2616f5da09f099327 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-mon-smithi115, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T17:09:29.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 podman[109469]: 2024-09-13 17:09:28.79210159 +0000 UTC m=+0.378811479 container init 8dd7baf2c6b6e9584cc7f662fd57d1b6c4e981ba543e41b2616f5da09f099327 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-mon-smithi115, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-13T17:09:29.180 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 podman[109469]: 2024-09-13 17:09:28.795491994 +0000 UTC m=+0.382201887 container start 8dd7baf2c6b6e9584cc7f662fd57d1b6c4e981ba543e41b2616f5da09f099327 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-mon-smithi115, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-13T17:09:29.180 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: set uid:gid to 167:167 (ceph:ceph) 2024-09-13T17:09:29.180 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable), process ceph-mon, pid 2 2024-09-13T17:09:29.180 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: pidfile_write: ignore empty --pid-file 2024-09-13T17:09:29.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: load: jerasure load: lrc 2024-09-13T17:09:29.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: RocksDB version: 7.9.2 2024-09-13T17:09:29.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Git sha 0 2024-09-13T17:09:29.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Compile date 2024-09-10 12:59:06 2024-09-13T17:09:29.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: DB SUMMARY 2024-09-13T17:09:29.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: DB Session ID: 4YW8IJ1OJAABJC6U11Y6 2024-09-13T17:09:29.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: CURRENT file: CURRENT 2024-09-13T17:09:29.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: IDENTITY file: IDENTITY 2024-09-13T17:09:29.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: MANIFEST file: MANIFEST-000015 size: 1508 Bytes 2024-09-13T17:09:29.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi115/store.db dir, Total Num: 1, files: 000032.sst 2024-09-13T17:09:29.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi115/store.db: 000030.log size: 946059 ; 2024-09-13T17:09:29.183 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.error_if_exists: 0 2024-09-13T17:09:29.183 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.create_if_missing: 0 2024-09-13T17:09:29.183 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.paranoid_checks: 1 2024-09-13T17:09:29.183 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-13T17:09:29.183 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-13T17:09:29.183 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-13T17:09:29.184 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.env: 0x55f7b9770bc0 2024-09-13T17:09:29.184 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.fs: PosixFileSystem 2024-09-13T17:09:29.184 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.info_log: 0x55f7baa98dc0 2024-09-13T17:09:29.184 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.max_file_opening_threads: 16 2024-09-13T17:09:29.184 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.statistics: (nil) 2024-09-13T17:09:29.185 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.use_fsync: 0 2024-09-13T17:09:29.185 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.max_log_file_size: 0 2024-09-13T17:09:29.185 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-13T17:09:29.185 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-13T17:09:29.185 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.keep_log_file_num: 1000 2024-09-13T17:09:29.185 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.recycle_log_file_num: 0 2024-09-13T17:09:29.186 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.allow_fallocate: 1 2024-09-13T17:09:29.186 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.allow_mmap_reads: 0 2024-09-13T17:09:29.186 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.allow_mmap_writes: 0 2024-09-13T17:09:29.186 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.use_direct_reads: 0 2024-09-13T17:09:29.186 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-13T17:09:29.186 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.create_missing_column_families: 0 2024-09-13T17:09:29.187 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.db_log_dir: 2024-09-13T17:09:29.187 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.wal_dir: 2024-09-13T17:09:29.187 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-13T17:09:29.187 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-13T17:09:29.187 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-13T17:09:29.187 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-13T17:09:29.188 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-13T17:09:29.188 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-13T17:09:29.188 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.advise_random_on_open: 1 2024-09-13T17:09:29.188 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.db_write_buffer_size: 0 2024-09-13T17:09:29.188 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.write_buffer_manager: 0x55f7baaa6320 2024-09-13T17:09:29.189 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-13T17:09:29.189 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-13T17:09:29.189 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-13T17:09:29.189 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.rate_limiter: (nil) 2024-09-13T17:09:29.189 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-13T17:09:29.189 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.wal_recovery_mode: 2 2024-09-13T17:09:29.190 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.enable_thread_tracking: 0 2024-09-13T17:09:29.190 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.enable_pipelined_write: 0 2024-09-13T17:09:29.190 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.unordered_write: 0 2024-09-13T17:09:29.190 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-13T17:09:29.190 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-13T17:09:29.190 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-13T17:09:29.191 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-13T17:09:29.191 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.row_cache: None 2024-09-13T17:09:29.194 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.wal_filter: None 2024-09-13T17:09:29.194 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-13T17:09:29.194 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.allow_ingest_behind: 0 2024-09-13T17:09:29.194 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.two_write_queues: 0 2024-09-13T17:09:29.194 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.manual_wal_flush: 0 2024-09-13T17:09:29.195 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.wal_compression: 0 2024-09-13T17:09:29.195 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.atomic_flush: 0 2024-09-13T17:09:29.195 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-13T17:09:29.195 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-13T17:09:29.195 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-13T17:09:29.195 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.log_readahead_size: 0 2024-09-13T17:09:29.196 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-13T17:09:29.196 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.best_efforts_recovery: 0 2024-09-13T17:09:29.196 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-13T17:09:29.196 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-13T17:09:29.196 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.allow_data_in_errors: 0 2024-09-13T17:09:29.196 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.db_host_id: __hostname__ 2024-09-13T17:09:29.197 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-13T17:09:29.197 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.max_background_jobs: 2 2024-09-13T17:09:29.197 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.max_background_compactions: -1 2024-09-13T17:09:29.198 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.max_subcompactions: 1 2024-09-13T17:09:29.198 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-13T17:09:29.198 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-13T17:09:29.198 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-13T17:09:29.198 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.max_total_wal_size: 0 2024-09-13T17:09:29.198 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-13T17:09:29.199 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-13T17:09:29.199 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-13T17:09:29.199 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-13T17:09:29.199 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.max_open_files: -1 2024-09-13T17:09:29.199 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.bytes_per_sync: 0 2024-09-13T17:09:29.200 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-13T17:09:29.200 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-13T17:09:29.200 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.compaction_readahead_size: 0 2024-09-13T17:09:29.200 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.max_background_flushes: -1 2024-09-13T17:09:29.200 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Compression algorithms supported: 2024-09-13T17:09:29.201 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: kZSTD supported: 0 2024-09-13T17:09:29.201 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: kXpressCompression supported: 0 2024-09-13T17:09:29.201 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: kBZip2Compression supported: 0 2024-09-13T17:09:29.201 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-13T17:09:29.201 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: kLZ4Compression supported: 1 2024-09-13T17:09:29.201 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: kZlibCompression supported: 1 2024-09-13T17:09:29.201 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: kLZ4HCCompression supported: 1 2024-09-13T17:09:29.202 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: kSnappyCompression supported: 1 2024-09-13T17:09:29.202 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-13T17:09:29.202 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-13T17:09:29.202 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi115/store.db/MANIFEST-000015 2024-09-13T17:09:29.202 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-13T17:09:29.202 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-13T17:09:29.202 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.merge_operator: 2024-09-13T17:09:29.203 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.compaction_filter: None 2024-09-13T17:09:29.203 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.compaction_filter_factory: None 2024-09-13T17:09:29.203 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.sst_partitioner_factory: None 2024-09-13T17:09:29.203 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-13T17:09:29.203 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-13T17:09:29.203 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55f7baa98a20) 2024-09-13T17:09:29.203 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: cache_index_and_filter_blocks: 1 2024-09-13T17:09:29.203 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-13T17:09:29.203 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-13T17:09:29.204 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: pin_top_level_index_and_filter: 1 2024-09-13T17:09:29.204 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: index_type: 0 2024-09-13T17:09:29.204 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: data_block_index_type: 0 2024-09-13T17:09:29.204 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: index_shortening: 1 2024-09-13T17:09:29.204 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-13T17:09:29.204 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: checksum: 4 2024-09-13T17:09:29.204 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: no_block_cache: 0 2024-09-13T17:09:29.204 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: block_cache: 0x55f7baa8d1f0 2024-09-13T17:09:29.204 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: block_cache_name: BinnedLRUCache 2024-09-13T17:09:29.204 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: block_cache_options: 2024-09-13T17:09:29.204 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: capacity : 536870912 2024-09-13T17:09:29.204 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: num_shard_bits : 4 2024-09-13T17:09:29.204 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: strict_capacity_limit : 0 2024-09-13T17:09:29.205 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: high_pri_pool_ratio: 0.000 2024-09-13T17:09:29.205 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: block_cache_compressed: (nil) 2024-09-13T17:09:29.205 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: persistent_cache: (nil) 2024-09-13T17:09:29.205 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: block_size: 4096 2024-09-13T17:09:29.205 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: block_size_deviation: 10 2024-09-13T17:09:29.205 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: block_restart_interval: 16 2024-09-13T17:09:29.205 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: index_block_restart_interval: 1 2024-09-13T17:09:29.205 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: metadata_block_size: 4096 2024-09-13T17:09:29.205 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: partition_filters: 0 2024-09-13T17:09:29.205 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: use_delta_encoding: 1 2024-09-13T17:09:29.205 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: filter_policy: bloomfilter 2024-09-13T17:09:29.205 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: whole_key_filtering: 1 2024-09-13T17:09:29.205 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: verify_compression: 0 2024-09-13T17:09:29.205 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: read_amp_bytes_per_bit: 0 2024-09-13T17:09:29.206 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: format_version: 5 2024-09-13T17:09:29.206 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: enable_index_compression: 1 2024-09-13T17:09:29.206 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: block_align: 0 2024-09-13T17:09:29.206 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: max_auto_readahead_size: 262144 2024-09-13T17:09:29.206 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: prepopulate_block_cache: 0 2024-09-13T17:09:29.206 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: initial_auto_readahead_size: 8192 2024-09-13T17:09:29.206 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: num_file_reads_for_auto_readahead: 2 2024-09-13T17:09:29.206 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.write_buffer_size: 33554432 2024-09-13T17:09:29.206 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.max_write_buffer_number: 2 2024-09-13T17:09:29.206 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.compression: NoCompression 2024-09-13T17:09:29.206 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.bottommost_compression: Disabled 2024-09-13T17:09:29.207 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.prefix_extractor: nullptr 2024-09-13T17:09:29.207 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-13T17:09:29.207 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.num_levels: 7 2024-09-13T17:09:29.207 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-13T17:09:29.207 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-13T17:09:29.207 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-13T17:09:29.207 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-13T17:09:29.207 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-13T17:09:29.207 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-13T17:09:29.207 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-13T17:09:29.207 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-13T17:09:29.207 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-13T17:09:29.207 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-13T17:09:29.208 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-13T17:09:29.208 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-13T17:09:29.208 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-13T17:09:29.208 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.compression_opts.level: 32767 2024-09-13T17:09:29.208 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.compression_opts.strategy: 0 2024-09-13T17:09:29.208 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-13T17:09:29.208 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-13T17:09:29.208 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-13T17:09:29.208 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-13T17:09:29.209 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.compression_opts.enabled: false 2024-09-13T17:09:29.209 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-13T17:09:29.209 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-13T17:09:29.209 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-13T17:09:29.209 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-13T17:09:29.209 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.target_file_size_base: 67108864 2024-09-13T17:09:29.209 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-13T17:09:29.209 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-13T17:09:29.209 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-13T17:09:29.209 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-13T17:09:29.209 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-13T17:09:29.209 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-13T17:09:29.209 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-13T17:09:29.210 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-13T17:09:29.210 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-13T17:09:29.210 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-13T17:09:29.210 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-13T17:09:29.210 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-13T17:09:29.210 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-13T17:09:29.210 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-13T17:09:29.210 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.arena_block_size: 1048576 2024-09-13T17:09:29.210 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-13T17:09:29.210 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-13T17:09:29.210 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.disable_auto_compactions: 0 2024-09-13T17:09:29.210 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-13T17:09:29.211 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-13T17:09:29.211 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-13T17:09:29.211 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-13T17:09:29.211 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-13T17:09:29.211 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-13T17:09:29.211 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-13T17:09:29.211 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-13T17:09:29.211 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-13T17:09:29.211 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-13T17:09:29.211 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-13T17:09:29.211 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.inplace_update_support: 0 2024-09-13T17:09:29.212 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-13T17:09:29.212 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-13T17:09:29.212 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-13T17:09:29.212 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-13T17:09:29.212 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.bloom_locality: 0 2024-09-13T17:09:29.212 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.max_successive_merges: 0 2024-09-13T17:09:29.212 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-13T17:09:29.212 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.paranoid_file_checks: 0 2024-09-13T17:09:29.212 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.force_consistency_checks: 1 2024-09-13T17:09:29.212 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.report_bg_io_stats: 0 2024-09-13T17:09:29.212 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.ttl: 2592000 2024-09-13T17:09:29.212 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-13T17:09:29.213 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-13T17:09:29.213 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-13T17:09:29.213 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.enable_blob_files: false 2024-09-13T17:09:29.213 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.min_blob_size: 0 2024-09-13T17:09:29.213 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.blob_file_size: 268435456 2024-09-13T17:09:29.213 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-13T17:09:29.213 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-13T17:09:29.213 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-13T17:09:29.213 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-13T17:09:29.213 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-13T17:09:29.213 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.blob_file_starting_level: 0 2024-09-13T17:09:29.214 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-13T17:09:29.214 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-13T17:09:29.214 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi115/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 34, last_sequence is 12039, log_number is 30,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 30 2024-09-13T17:09:29.214 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 30 2024-09-13T17:09:29.214 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 3a9c1a52-0c37-4393-b1e6-e7dadded2995 2024-09-13T17:09:29.214 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726247368821514, "job": 1, "event": "recovery_started", "wal_files": [30]} 2024-09-13T17:09:29.214 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #30 mode 2 2024-09-13T17:09:29.214 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726247368825495, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 35, "file_size": 868813, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12040, "largest_seqno": 13043, "table_properties": {"data_size": 863807, "index_size": 2750, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1221, "raw_key_size": 11639, "raw_average_key_size": 24, "raw_value_size": 853790, "raw_average_value_size": 1820, "num_data_blocks": 123, "num_entries": 469, "num_filter_entries": 469, "num_deletions": 6, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726247368, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "3a9c1a52-0c37-4393-b1e6-e7dadded2995", "db_session_id": "4YW8IJ1OJAABJC6U11Y6", "orig_file_number": 35, "seqno_to_time_mapping": "N/A"}} 2024-09-13T17:09:29.214 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726247368825597, "job": 1, "event": "recovery_finished"} 2024-09-13T17:09:29.214 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: [db/version_set.cc:5047] Creating manifest 37 2024-09-13T17:09:29.214 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-13T17:09:29.214 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi115/store.db/000030.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-13T17:09:29.214 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55f7baab8e00 2024-09-13T17:09:29.215 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: DB pointer 0x55f7babac000 2024-09-13T17:09:29.215 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-13T17:09:29.215 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-13T17:09:29.215 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: ** DB Stats ** 2024-09-13T17:09:29.215 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T17:09:29.215 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-13T17:09:29.215 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T17:09:29.215 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T17:09:29.215 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-13T17:09:29.215 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T17:09:29.215 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T17:09:29.215 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: 2024-09-13T17:09:29.215 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: ** Compaction Stats [default] ** 2024-09-13T17:09:29.216 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T17:09:29.216 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-13T17:09:29.216 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: L0 1/0 848.45 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 358.2 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-09-13T17:09:29.216 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: L6 1/0 7.32 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-13T17:09:29.216 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Sum 2/0 8.15 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 358.2 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-09-13T17:09:29.216 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 358.2 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-09-13T17:09:29.216 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: 2024-09-13T17:09:29.216 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: ** Compaction Stats [default] ** 2024-09-13T17:09:29.216 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T17:09:29.216 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-13T17:09:29.216 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 358.2 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-09-13T17:09:29.216 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: 2024-09-13T17:09:29.217 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-13T17:09:29.217 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: 2024-09-13T17:09:29.217 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T17:09:29.217 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Flush(GB): cumulative 0.001, interval 0.001 2024-09-13T17:09:29.217 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-13T17:09:29.217 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-13T17:09:29.217 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-13T17:09:29.217 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-13T17:09:29.217 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Cumulative compaction: 0.00 GB write, 133.57 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T17:09:29.217 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Interval compaction: 0.00 GB write, 133.57 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T17:09:29.217 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-13T17:09:29.217 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Block cache BinnedLRUCache@0x55f7baa8d1f0#2 capacity: 512.00 MB usage: 4.11 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-09-13T17:09:29.218 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,1.28 KB,0.000244379%) IndexBlock(1,2.83 KB,0.000539422%) Misc(1,0.00 KB,0%) 2024-09-13T17:09:29.218 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: 2024-09-13T17:09:29.218 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-13T17:09:29.218 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: starting mon.smithi115 rank 0 at public addrs [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] at bind addrs [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi115 fsid ffbd7588-71f0-11ef-bceb-c7b262605968 2024-09-13T17:09:29.218 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: mon.smithi115@-1(???) e2 preinit fsid ffbd7588-71f0-11ef-bceb-c7b262605968 2024-09-13T17:09:29.218 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: mon.smithi115@-1(???).mds e19 new map 2024-09-13T17:09:29.218 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: mon.smithi115@-1(???).mds e19 print_map 2024-09-13T17:09:29.218 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: e19 2024-09-13T17:09:29.218 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T17:09:29.218 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T17:09:29.218 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: legacy client fscid: 1 2024-09-13T17:09:29.218 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: 2024-09-13T17:09:29.218 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Filesystem 'cephfs' (1) 2024-09-13T17:09:29.219 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: fs_name cephfs 2024-09-13T17:09:29.219 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: epoch 19 2024-09-13T17:09:29.219 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T17:09:29.219 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: created 2024-09-13T17:03:16.313116+0000 2024-09-13T17:09:29.219 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: modified 2024-09-13T17:03:33.410348+0000 2024-09-13T17:09:29.219 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: tableserver 0 2024-09-13T17:09:29.219 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: root 0 2024-09-13T17:09:29.219 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: session_timeout 60 2024-09-13T17:09:29.219 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: session_autoclose 300 2024-09-13T17:09:29.219 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: max_file_size 1099511627776 2024-09-13T17:09:29.220 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: max_xattr_size 65536 2024-09-13T17:09:29.220 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: required_client_features {} 2024-09-13T17:09:29.220 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: last_failure 0 2024-09-13T17:09:29.220 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: last_failure_osd_epoch 46 2024-09-13T17:09:29.220 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T17:09:29.220 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: max_mds 1 2024-09-13T17:09:29.220 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: in 0 2024-09-13T17:09:29.220 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: up {0=14470} 2024-09-13T17:09:29.220 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: failed 2024-09-13T17:09:29.220 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: damaged 2024-09-13T17:09:29.220 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: stopped 2024-09-13T17:09:29.220 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: data_pools [3] 2024-09-13T17:09:29.220 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: metadata_pool 2 2024-09-13T17:09:29.221 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: inline_data enabled 2024-09-13T17:09:29.221 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: balancer 2024-09-13T17:09:29.221 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: bal_rank_mask -1 2024-09-13T17:09:29.221 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: standby_count_wanted 1 2024-09-13T17:09:29.221 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: [mds.cephfs.smithi115.ijznvr{0:14470} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.115:6828/4128583274,v1:172.21.15.115:6829/4128583274] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T17:09:29.221 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: [mds.cephfs.smithi115.hbtxod{0:14486} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.115:6826/1977394649,v1:172.21.15.115:6827/1977394649] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T17:09:29.221 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: 2024-09-13T17:09:29.221 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: 2024-09-13T17:09:29.221 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Standby daemons: 2024-09-13T17:09:29.221 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: 2024-09-13T17:09:29.221 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: [mds.cephfs.smithi195.aevvgz{-1:24253} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.195:6826/8826118,v1:172.21.15.195:6827/8826118] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T17:09:29.221 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: [mds.cephfs.smithi195.qzghxj{-1:24259} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.195:6824/3335357704,v1:172.21.15.195:6825/3335357704] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T17:09:29.221 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: mon.smithi115@-1(???).osd e48 crush map has features 3314933000852226048, adjusting msgr requires 2024-09-13T17:09:29.222 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: mon.smithi115@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-09-13T17:09:29.222 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: mon.smithi115@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-09-13T17:09:29.222 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: mon.smithi115@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-09-13T17:09:29.222 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 ceph-mon[109488]: mon.smithi115@-1(???).paxosservice(auth 1..23) refresh upgraded, format 0 -> 3 2024-09-13T17:09:29.222 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 bash[109469]: 8dd7baf2c6b6e9584cc7f662fd57d1b6c4e981ba543e41b2616f5da09f099327 2024-09-13T17:09:29.222 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:28 smithi115 systemd[1]: Started Ceph mon.smithi115 for ffbd7588-71f0-11ef-bceb-c7b262605968. 2024-09-13T17:09:30.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:30 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mon metadata", "id": "smithi115"}]: dispatch 2024-09-13T17:09:30.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:30 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-09-13T17:09:30.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:30 smithi195 ceph-mon[34981]: from='client.? 172.21.15.115:0/606602884' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T17:09:30.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:30 smithi195 ceph-mon[34981]: pgmap v89: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:09:30.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:30 smithi195 ceph-mon[34981]: pgmap v90: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:09:30.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:30 smithi195 ceph-mon[34981]: mon.smithi115 calling monitor election 2024-09-13T17:09:30.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:30 smithi195 ceph-mon[34981]: mon.smithi115 is new leader, mons smithi115,smithi195 in quorum (ranks 0,1) 2024-09-13T17:09:30.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:30 smithi195 ceph-mon[34981]: monmap e2: 2 mons at {smithi115=[v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0],smithi195=[v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T17:09:30.578 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:30 smithi195 ceph-mon[34981]: fsmap cephfs:1 {0=cephfs.smithi115.ijznvr=up:active} 1 up:standby-replay 2 up:standby 2024-09-13T17:09:30.578 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:30 smithi195 ceph-mon[34981]: osdmap e48: 6 total, 6 up, 6 in 2024-09-13T17:09:30.578 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:30 smithi195 ceph-mon[34981]: mgrmap e31: smithi115.hetcni(active, since 2m), standbys: smithi195.hjjifz 2024-09-13T17:09:30.578 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:30 smithi195 ceph-mon[34981]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-13T17:09:30.578 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:30 smithi195 ceph-mon[34981]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T17:09:30.578 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:30 smithi195 ceph-mon[34981]: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T17:09:30.578 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:30 smithi195 ceph-mon[34981]: from='mgr.14660 ' entity='' 2024-09-13T17:09:30.578 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:30 smithi195 ceph-mon[34981]: from='mgr.14660 ' entity='mgr.smithi115.hetcni' 2024-09-13T17:09:30.578 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:30 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:09:30.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:30 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mon metadata", "id": "smithi115"}]: dispatch 2024-09-13T17:09:30.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:30 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-09-13T17:09:30.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:30 smithi115 ceph-mon[109488]: from='client.? 172.21.15.115:0/606602884' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T17:09:30.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:30 smithi115 ceph-mon[109488]: pgmap v89: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:09:30.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:30 smithi115 ceph-mon[109488]: pgmap v90: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:09:30.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:30 smithi115 ceph-mon[109488]: mon.smithi115 calling monitor election 2024-09-13T17:09:30.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:30 smithi115 ceph-mon[109488]: mon.smithi115 is new leader, mons smithi115,smithi195 in quorum (ranks 0,1) 2024-09-13T17:09:30.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:30 smithi115 ceph-mon[109488]: monmap e2: 2 mons at {smithi115=[v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0],smithi195=[v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T17:09:30.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:30 smithi115 ceph-mon[109488]: fsmap cephfs:1 {0=cephfs.smithi115.ijznvr=up:active} 1 up:standby-replay 2 up:standby 2024-09-13T17:09:30.680 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:30 smithi115 ceph-mon[109488]: osdmap e48: 6 total, 6 up, 6 in 2024-09-13T17:09:30.680 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:30 smithi115 ceph-mon[109488]: mgrmap e31: smithi115.hetcni(active, since 2m), standbys: smithi195.hjjifz 2024-09-13T17:09:30.680 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:30 smithi115 ceph-mon[109488]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-13T17:09:30.680 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:30 smithi115 ceph-mon[109488]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T17:09:30.680 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:30 smithi115 ceph-mon[109488]: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T17:09:30.680 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:30 smithi115 ceph-mon[109488]: from='mgr.14660 ' entity='' 2024-09-13T17:09:30.680 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:30 smithi115 ceph-mon[109488]: from='mgr.14660 ' entity='mgr.smithi115.hetcni' 2024-09-13T17:09:30.680 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:30 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:09:32.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:32 smithi115 ceph-mon[109488]: pgmap v91: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:09:32.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:32 smithi195 ceph-mon[34981]: pgmap v91: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:09:34.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:34 smithi115 ceph-mon[109488]: pgmap v92: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:09:34.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:34 smithi195 ceph-mon[34981]: pgmap v92: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:09:36.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:36 smithi115 ceph-mon[109488]: from='mgr.14660 ' entity='mgr.smithi115.hetcni' 2024-09-13T17:09:36.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:36 smithi115 ceph-mon[109488]: from='mgr.14660 ' entity='mgr.smithi115.hetcni' 2024-09-13T17:09:36.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:36 smithi115 ceph-mon[109488]: pgmap v93: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:09:36.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:36 smithi115 ceph-mon[109488]: from='mgr.14660 ' entity='mgr.smithi115.hetcni' 2024-09-13T17:09:36.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:36 smithi115 ceph-mon[109488]: from='mgr.14660 ' entity='mgr.smithi115.hetcni' 2024-09-13T17:09:36.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:36 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:09:36.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:36 smithi195 ceph-mon[34981]: from='mgr.14660 ' entity='mgr.smithi115.hetcni' 2024-09-13T17:09:36.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:36 smithi195 ceph-mon[34981]: from='mgr.14660 ' entity='mgr.smithi115.hetcni' 2024-09-13T17:09:36.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:36 smithi195 ceph-mon[34981]: pgmap v93: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:09:36.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:36 smithi195 ceph-mon[34981]: from='mgr.14660 ' entity='mgr.smithi115.hetcni' 2024-09-13T17:09:36.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:36 smithi195 ceph-mon[34981]: from='mgr.14660 ' entity='mgr.smithi115.hetcni' 2024-09-13T17:09:36.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:36 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:09:38.564 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:38 smithi115 ceph-mon[109488]: pgmap v94: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:09:38.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:38 smithi195 ceph-mon[34981]: pgmap v94: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:09:39.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:39 smithi195 ceph-mon[34981]: from='mgr.14660 ' entity='mgr.smithi115.hetcni' 2024-09-13T17:09:39.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:39 smithi195 ceph-mon[34981]: from='mgr.14660 ' entity='mgr.smithi115.hetcni' 2024-09-13T17:09:39.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:39 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:09:39.828 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:39 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:09:39.828 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:39 smithi195 ceph-mon[34981]: from='mgr.14660 ' entity='mgr.smithi115.hetcni' 2024-09-13T17:09:39.828 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:39 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:09:39.828 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:39 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:09:39.828 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:39 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-13T17:09:39.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:39 smithi115 ceph-mon[109488]: from='mgr.14660 ' entity='mgr.smithi115.hetcni' 2024-09-13T17:09:39.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:39 smithi115 ceph-mon[109488]: from='mgr.14660 ' entity='mgr.smithi115.hetcni' 2024-09-13T17:09:39.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:39 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:09:39.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:39 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:09:39.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:39 smithi115 ceph-mon[109488]: from='mgr.14660 ' entity='mgr.smithi115.hetcni' 2024-09-13T17:09:39.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:39 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:09:39.930 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:39 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:09:39.930 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:39 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-13T17:09:40.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:40 smithi115 ceph-mon[109488]: pgmap v95: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-09-13T17:09:40.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:40 smithi115 ceph-mon[109488]: from='mgr.14660 ' entity='mgr.smithi115.hetcni' 2024-09-13T17:09:40.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:40 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T17:09:40.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:40 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T17:09:40.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:40 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:09:40.691 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:40 smithi195 ceph-mon[34981]: pgmap v95: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-09-13T17:09:40.691 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:40 smithi195 ceph-mon[34981]: from='mgr.14660 ' entity='mgr.smithi115.hetcni' 2024-09-13T17:09:40.691 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:40 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T17:09:40.692 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:40 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T17:09:40.692 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:40 smithi195 ceph-mon[34981]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:09:41.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:41 smithi195 ceph-mon[34981]: Upgrade: Updating mon.smithi195 2024-09-13T17:09:41.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:41 smithi195 ceph-mon[34981]: Deploying daemon mon.smithi195 on smithi195 2024-09-13T17:09:41.928 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:41 smithi115 ceph-mon[109488]: Upgrade: Updating mon.smithi195 2024-09-13T17:09:41.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:41 smithi115 ceph-mon[109488]: Deploying daemon mon.smithi195 on smithi195 2024-09-13T17:09:42.167 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:41 smithi195 systemd[1]: Stopping Ceph mon.smithi195 for ffbd7588-71f0-11ef-bceb-c7b262605968... 2024-09-13T17:09:42.167 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:42 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-mon-smithi195[34977]: 2024-09-13T17:09:42.094+0000 7f2570294640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi195 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T17:09:42.168 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:42 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-mon-smithi195[34977]: 2024-09-13T17:09:42.094+0000 7f2570294640 -1 mon.smithi195@1(peon) e2 *** Got Signal Terminated *** 2024-09-13T17:09:42.446 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:42 smithi195 podman[79852]: 2024-09-13 17:09:42.166736397 +0000 UTC m=+0.173672918 container died 0f54c30e597025c8c4f9aa9371c88c25c1d74822d59cec2564c40b507a1d6e84 (image=quay.ceph.io/ceph-ci/ceph@sha256:c37c250ffe653639d7a4124ac8acdc3c8f6a53cb4ef1f26b1d2df36648631a11, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-mon-smithi195, GIT_CLEAN=True, RELEASE=reef-2c01458, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-13T17:09:42.764 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:42 smithi195 podman[79852]: 2024-09-13 17:09:42.553841242 +0000 UTC m=+0.560777759 container cleanup 0f54c30e597025c8c4f9aa9371c88c25c1d74822d59cec2564c40b507a1d6e84 (image=quay.ceph.io/ceph-ci/ceph@sha256:c37c250ffe653639d7a4124ac8acdc3c8f6a53cb4ef1f26b1d2df36648631a11, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-mon-smithi195, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=reef-2c01458, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True) 2024-09-13T17:09:42.764 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:42 smithi195 bash[79852]: ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-mon-smithi195 2024-09-13T17:09:43.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:42 smithi195 podman[79864]: 2024-09-13 17:09:42.763468282 +0000 UTC m=+0.587477011 container remove 0f54c30e597025c8c4f9aa9371c88c25c1d74822d59cec2564c40b507a1d6e84 (image=quay.ceph.io/ceph-ci/ceph@sha256:c37c250ffe653639d7a4124ac8acdc3c8f6a53cb4ef1f26b1d2df36648631a11, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-mon-smithi195, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=reef-2c01458) 2024-09-13T17:09:43.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:42 smithi195 systemd[1]: ceph-ffbd7588-71f0-11ef-bceb-c7b262605968@mon.smithi195.service: Deactivated successfully. 2024-09-13T17:09:43.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:42 smithi195 systemd[1]: Stopped Ceph mon.smithi195 for ffbd7588-71f0-11ef-bceb-c7b262605968. 2024-09-13T17:09:43.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:42 smithi195 systemd[1]: ceph-ffbd7588-71f0-11ef-bceb-c7b262605968@mon.smithi195.service: Consumed 6.782s CPU time. 2024-09-13T17:09:43.357 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 systemd[1]: Starting Ceph mon.smithi195 for ffbd7588-71f0-11ef-bceb-c7b262605968... 2024-09-13T17:09:43.357 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 podman[79993]: 2024-09-13 17:09:43.225190927 +0000 UTC m=+0.015837195 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T17:09:43.357 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 podman[79993]: 2024-09-13 17:09:43.330968028 +0000 UTC m=+0.121614288 container create 0459bc5e6b0806185c69b9f670c56d97a2b5157826f08ce4f1795180c121c7ea (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-mon-smithi195, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T17:09:43.618 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 podman[79993]: 2024-09-13 17:09:43.592531287 +0000 UTC m=+0.383177544 container init 0459bc5e6b0806185c69b9f670c56d97a2b5157826f08ce4f1795180c121c7ea (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-mon-smithi195, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-13T17:09:43.618 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 podman[79993]: 2024-09-13 17:09:43.597107562 +0000 UTC m=+0.387753819 container start 0459bc5e6b0806185c69b9f670c56d97a2b5157826f08ce4f1795180c121c7ea (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-mon-smithi195, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T17:09:43.928 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:43 smithi115 ceph-mon[109488]: pgmap v96: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-09-13T17:09:43.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:43 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mon metadata", "id": "smithi115"}]: dispatch 2024-09-13T17:09:43.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:43 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-09-13T17:09:44.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: set uid:gid to 167:167 (ceph:ceph) 2024-09-13T17:09:44.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable), process ceph-mon, pid 2 2024-09-13T17:09:44.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: pidfile_write: ignore empty --pid-file 2024-09-13T17:09:44.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: load: jerasure load: lrc 2024-09-13T17:09:44.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: RocksDB version: 7.9.2 2024-09-13T17:09:44.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Git sha 0 2024-09-13T17:09:44.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Compile date 2024-09-10 12:59:06 2024-09-13T17:09:44.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: DB SUMMARY 2024-09-13T17:09:44.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: DB Session ID: I6EDZW4EQZ59ZX8W0V8P 2024-09-13T17:09:44.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: CURRENT file: CURRENT 2024-09-13T17:09:44.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: IDENTITY file: IDENTITY 2024-09-13T17:09:44.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: MANIFEST file: MANIFEST-000010 size: 1401 Bytes 2024-09-13T17:09:44.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi195/store.db dir, Total Num: 1, files: 000027.sst 2024-09-13T17:09:44.079 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi195/store.db: 000025.log size: 1966940 ; 2024-09-13T17:09:44.079 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.error_if_exists: 0 2024-09-13T17:09:44.079 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.create_if_missing: 0 2024-09-13T17:09:44.079 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.paranoid_checks: 1 2024-09-13T17:09:44.079 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-13T17:09:44.079 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-13T17:09:44.079 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-13T17:09:44.079 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.env: 0x55a8ad6febc0 2024-09-13T17:09:44.079 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.fs: PosixFileSystem 2024-09-13T17:09:44.079 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.info_log: 0x55a8ae5c8dc0 2024-09-13T17:09:44.079 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.max_file_opening_threads: 16 2024-09-13T17:09:44.079 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.statistics: (nil) 2024-09-13T17:09:44.079 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.use_fsync: 0 2024-09-13T17:09:44.079 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.max_log_file_size: 0 2024-09-13T17:09:44.080 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-13T17:09:44.080 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-13T17:09:44.080 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.keep_log_file_num: 1000 2024-09-13T17:09:44.080 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.recycle_log_file_num: 0 2024-09-13T17:09:44.080 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.allow_fallocate: 1 2024-09-13T17:09:44.080 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.allow_mmap_reads: 0 2024-09-13T17:09:44.080 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.allow_mmap_writes: 0 2024-09-13T17:09:44.080 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.use_direct_reads: 0 2024-09-13T17:09:44.080 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-13T17:09:44.080 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.create_missing_column_families: 0 2024-09-13T17:09:44.080 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.db_log_dir: 2024-09-13T17:09:44.080 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.wal_dir: 2024-09-13T17:09:44.081 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-13T17:09:44.081 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-13T17:09:44.081 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-13T17:09:44.081 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-13T17:09:44.081 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-13T17:09:44.081 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-13T17:09:44.081 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.advise_random_on_open: 1 2024-09-13T17:09:44.081 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.db_write_buffer_size: 0 2024-09-13T17:09:44.081 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.write_buffer_manager: 0x55a8ae5d6320 2024-09-13T17:09:44.081 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-13T17:09:44.081 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-13T17:09:44.081 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-13T17:09:44.081 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.rate_limiter: (nil) 2024-09-13T17:09:44.081 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-13T17:09:44.082 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.wal_recovery_mode: 2 2024-09-13T17:09:44.082 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.enable_thread_tracking: 0 2024-09-13T17:09:44.082 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.enable_pipelined_write: 0 2024-09-13T17:09:44.082 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.unordered_write: 0 2024-09-13T17:09:44.082 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-13T17:09:44.082 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-13T17:09:44.083 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-13T17:09:44.083 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-13T17:09:44.083 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.row_cache: None 2024-09-13T17:09:44.083 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.wal_filter: None 2024-09-13T17:09:44.083 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-13T17:09:44.083 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.allow_ingest_behind: 0 2024-09-13T17:09:44.083 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.two_write_queues: 0 2024-09-13T17:09:44.083 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.manual_wal_flush: 0 2024-09-13T17:09:44.083 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.wal_compression: 0 2024-09-13T17:09:44.083 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.atomic_flush: 0 2024-09-13T17:09:44.083 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-13T17:09:44.083 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-13T17:09:44.083 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-13T17:09:44.083 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.log_readahead_size: 0 2024-09-13T17:09:44.084 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-13T17:09:44.084 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.best_efforts_recovery: 0 2024-09-13T17:09:44.084 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-13T17:09:44.084 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-13T17:09:44.084 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.allow_data_in_errors: 0 2024-09-13T17:09:44.084 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.db_host_id: __hostname__ 2024-09-13T17:09:44.085 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-13T17:09:44.085 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.max_background_jobs: 2 2024-09-13T17:09:44.085 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.max_background_compactions: -1 2024-09-13T17:09:44.085 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.max_subcompactions: 1 2024-09-13T17:09:44.086 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-13T17:09:44.086 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-13T17:09:44.086 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-13T17:09:44.086 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.max_total_wal_size: 0 2024-09-13T17:09:44.086 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-13T17:09:44.086 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-13T17:09:44.086 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-13T17:09:44.086 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-13T17:09:44.086 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.max_open_files: -1 2024-09-13T17:09:44.086 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.bytes_per_sync: 0 2024-09-13T17:09:44.086 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-13T17:09:44.086 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-13T17:09:44.086 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.compaction_readahead_size: 0 2024-09-13T17:09:44.086 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.max_background_flushes: -1 2024-09-13T17:09:44.087 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Compression algorithms supported: 2024-09-13T17:09:44.087 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: kZSTD supported: 0 2024-09-13T17:09:44.087 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: kXpressCompression supported: 0 2024-09-13T17:09:44.087 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: kBZip2Compression supported: 0 2024-09-13T17:09:44.087 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-13T17:09:44.087 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: kLZ4Compression supported: 1 2024-09-13T17:09:44.087 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: kZlibCompression supported: 1 2024-09-13T17:09:44.087 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: kLZ4HCCompression supported: 1 2024-09-13T17:09:44.087 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: kSnappyCompression supported: 1 2024-09-13T17:09:44.087 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-13T17:09:44.087 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-13T17:09:44.087 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi195/store.db/MANIFEST-000010 2024-09-13T17:09:44.087 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-13T17:09:44.087 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-13T17:09:44.088 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.merge_operator: 2024-09-13T17:09:44.088 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.compaction_filter: None 2024-09-13T17:09:44.088 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.compaction_filter_factory: None 2024-09-13T17:09:44.088 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.sst_partitioner_factory: None 2024-09-13T17:09:44.088 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-13T17:09:44.088 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-13T17:09:44.088 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55a8ae5c8a20) 2024-09-13T17:09:44.088 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: cache_index_and_filter_blocks: 1 2024-09-13T17:09:44.088 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-13T17:09:44.088 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-13T17:09:44.088 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: pin_top_level_index_and_filter: 1 2024-09-13T17:09:44.088 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: index_type: 0 2024-09-13T17:09:44.088 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: data_block_index_type: 0 2024-09-13T17:09:44.088 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: index_shortening: 1 2024-09-13T17:09:44.089 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-13T17:09:44.089 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: checksum: 4 2024-09-13T17:09:44.089 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: no_block_cache: 0 2024-09-13T17:09:44.089 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: block_cache: 0x55a8ae5bd350 2024-09-13T17:09:44.089 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: block_cache_name: BinnedLRUCache 2024-09-13T17:09:44.089 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: block_cache_options: 2024-09-13T17:09:44.089 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: capacity : 536870912 2024-09-13T17:09:44.089 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: num_shard_bits : 4 2024-09-13T17:09:44.089 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: strict_capacity_limit : 0 2024-09-13T17:09:44.089 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: high_pri_pool_ratio: 0.000 2024-09-13T17:09:44.089 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: block_cache_compressed: (nil) 2024-09-13T17:09:44.089 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: persistent_cache: (nil) 2024-09-13T17:09:44.090 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: block_size: 4096 2024-09-13T17:09:44.090 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: block_size_deviation: 10 2024-09-13T17:09:44.090 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: block_restart_interval: 16 2024-09-13T17:09:44.090 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: index_block_restart_interval: 1 2024-09-13T17:09:44.090 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: metadata_block_size: 4096 2024-09-13T17:09:44.090 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: partition_filters: 0 2024-09-13T17:09:44.090 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: use_delta_encoding: 1 2024-09-13T17:09:44.090 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: filter_policy: bloomfilter 2024-09-13T17:09:44.090 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: whole_key_filtering: 1 2024-09-13T17:09:44.090 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: verify_compression: 0 2024-09-13T17:09:44.090 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: read_amp_bytes_per_bit: 0 2024-09-13T17:09:44.090 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: format_version: 5 2024-09-13T17:09:44.090 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: enable_index_compression: 1 2024-09-13T17:09:44.091 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: block_align: 0 2024-09-13T17:09:44.091 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: max_auto_readahead_size: 262144 2024-09-13T17:09:44.091 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: prepopulate_block_cache: 0 2024-09-13T17:09:44.091 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: initial_auto_readahead_size: 8192 2024-09-13T17:09:44.091 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: num_file_reads_for_auto_readahead: 2 2024-09-13T17:09:44.091 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.write_buffer_size: 33554432 2024-09-13T17:09:44.091 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.max_write_buffer_number: 2 2024-09-13T17:09:44.091 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.compression: NoCompression 2024-09-13T17:09:44.091 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.bottommost_compression: Disabled 2024-09-13T17:09:44.091 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.prefix_extractor: nullptr 2024-09-13T17:09:44.091 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-13T17:09:44.091 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.num_levels: 7 2024-09-13T17:09:44.091 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-13T17:09:44.091 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-13T17:09:44.091 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-13T17:09:44.092 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-13T17:09:44.092 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-13T17:09:44.092 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-13T17:09:44.092 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-13T17:09:44.092 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-13T17:09:44.092 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-13T17:09:44.092 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-13T17:09:44.092 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-13T17:09:44.092 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-13T17:09:44.092 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-13T17:09:44.092 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.compression_opts.level: 32767 2024-09-13T17:09:44.092 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.compression_opts.strategy: 0 2024-09-13T17:09:44.092 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-13T17:09:44.093 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-13T17:09:44.093 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-13T17:09:44.093 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-13T17:09:44.093 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.compression_opts.enabled: false 2024-09-13T17:09:44.093 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-13T17:09:44.093 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-13T17:09:44.093 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-13T17:09:44.094 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-13T17:09:44.094 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.target_file_size_base: 67108864 2024-09-13T17:09:44.094 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-13T17:09:44.094 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-13T17:09:44.094 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-13T17:09:44.094 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-13T17:09:44.094 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-13T17:09:44.094 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-13T17:09:44.094 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-13T17:09:44.094 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-13T17:09:44.094 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-13T17:09:44.094 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-13T17:09:44.095 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-13T17:09:44.095 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-13T17:09:44.095 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-13T17:09:44.095 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-13T17:09:44.095 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.arena_block_size: 1048576 2024-09-13T17:09:44.095 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-13T17:09:44.095 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-13T17:09:44.095 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.disable_auto_compactions: 0 2024-09-13T17:09:44.095 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-13T17:09:44.095 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-13T17:09:44.095 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-13T17:09:44.095 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-13T17:09:44.095 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-13T17:09:44.095 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-13T17:09:44.096 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-13T17:09:44.096 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-13T17:09:44.096 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-13T17:09:44.096 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-13T17:09:44.096 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-13T17:09:44.096 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.inplace_update_support: 0 2024-09-13T17:09:44.096 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-13T17:09:44.096 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-13T17:09:44.096 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-13T17:09:44.096 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-13T17:09:44.096 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.bloom_locality: 0 2024-09-13T17:09:44.096 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.max_successive_merges: 0 2024-09-13T17:09:44.096 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-13T17:09:44.096 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.paranoid_file_checks: 0 2024-09-13T17:09:44.097 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.force_consistency_checks: 1 2024-09-13T17:09:44.097 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.report_bg_io_stats: 0 2024-09-13T17:09:44.097 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.ttl: 2592000 2024-09-13T17:09:44.097 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-13T17:09:44.097 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-13T17:09:44.097 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-13T17:09:44.097 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.enable_blob_files: false 2024-09-13T17:09:44.097 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.min_blob_size: 0 2024-09-13T17:09:44.097 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.blob_file_size: 268435456 2024-09-13T17:09:44.097 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-13T17:09:44.097 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-13T17:09:44.097 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-13T17:09:44.097 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-13T17:09:44.097 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-13T17:09:44.097 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.blob_file_starting_level: 0 2024-09-13T17:09:44.098 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-13T17:09:44.098 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-13T17:09:44.098 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi195/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 29, last_sequence is 12237, log_number is 25,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 25 2024-09-13T17:09:44.098 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 25 2024-09-13T17:09:44.098 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: b19c3093-b4d9-47cf-b24d-2dc0adfd9e93 2024-09-13T17:09:44.098 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726247383623341, "job": 1, "event": "recovery_started", "wal_files": [25]} 2024-09-13T17:09:44.098 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #25 mode 2 2024-09-13T17:09:44.098 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726247383629212, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 30, "file_size": 1169463, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12242, "largest_seqno": 13611, "table_properties": {"data_size": 1163493, "index_size": 3457, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1477, "raw_key_size": 13927, "raw_average_key_size": 24, "raw_value_size": 1151317, "raw_average_value_size": 2026, "num_data_blocks": 156, "num_entries": 568, "num_filter_entries": 568, "num_deletions": 6, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726247383, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "b19c3093-b4d9-47cf-b24d-2dc0adfd9e93", "db_session_id": "I6EDZW4EQZ59ZX8W0V8P", "orig_file_number": 30, "seqno_to_time_mapping": "N/A"}} 2024-09-13T17:09:44.098 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726247383629334, "job": 1, "event": "recovery_finished"} 2024-09-13T17:09:44.098 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: [db/version_set.cc:5047] Creating manifest 32 2024-09-13T17:09:44.098 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-13T17:09:44.098 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi195/store.db/000025.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-13T17:09:44.098 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55a8ae5e8e00 2024-09-13T17:09:44.099 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: DB pointer 0x55a8ae6dc000 2024-09-13T17:09:44.099 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-13T17:09:44.099 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-13T17:09:44.099 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: ** DB Stats ** 2024-09-13T17:09:44.099 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T17:09:44.099 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-13T17:09:44.099 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T17:09:44.099 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T17:09:44.099 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-13T17:09:44.099 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T17:09:44.099 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T17:09:44.099 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: 2024-09-13T17:09:44.099 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: ** Compaction Stats [default] ** 2024-09-13T17:09:44.099 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T17:09:44.100 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-13T17:09:44.100 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: L0 1/0 1.12 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 388.7 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-09-13T17:09:44.100 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: L6 1/0 7.33 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-13T17:09:44.100 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Sum 2/0 8.44 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 388.7 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-09-13T17:09:44.100 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 388.7 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-09-13T17:09:44.100 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: 2024-09-13T17:09:44.100 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: ** Compaction Stats [default] ** 2024-09-13T17:09:44.100 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T17:09:44.100 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-13T17:09:44.100 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 388.7 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-09-13T17:09:44.100 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: 2024-09-13T17:09:44.100 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-13T17:09:44.100 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: 2024-09-13T17:09:44.101 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T17:09:44.101 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Flush(GB): cumulative 0.001, interval 0.001 2024-09-13T17:09:44.101 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-13T17:09:44.101 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-13T17:09:44.101 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-13T17:09:44.101 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-13T17:09:44.101 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Cumulative compaction: 0.00 GB write, 133.49 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T17:09:44.101 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Interval compaction: 0.00 GB write, 133.49 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T17:09:44.102 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-13T17:09:44.102 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Block cache BinnedLRUCache@0x55a8ae5bd350#2 capacity: 512.00 MB usage: 5.61 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.3e-05 secs_since: 0 2024-09-13T17:09:44.102 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,1.53 KB,0.000292063%) IndexBlock(1,4.08 KB,0.000777841%) Misc(1,0.00 KB,0%) 2024-09-13T17:09:44.102 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: 2024-09-13T17:09:44.102 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-13T17:09:44.102 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: starting mon.smithi195 rank 1 at public addrs [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] at bind addrs [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi195 fsid ffbd7588-71f0-11ef-bceb-c7b262605968 2024-09-13T17:09:44.103 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: mon.smithi195@-1(???) e2 preinit fsid ffbd7588-71f0-11ef-bceb-c7b262605968 2024-09-13T17:09:44.103 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: mon.smithi195@-1(???).mds e19 new map 2024-09-13T17:09:44.103 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: mon.smithi195@-1(???).mds e19 print_map 2024-09-13T17:09:44.103 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: e19 2024-09-13T17:09:44.103 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T17:09:44.103 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T17:09:44.103 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: legacy client fscid: 1 2024-09-13T17:09:44.103 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: 2024-09-13T17:09:44.103 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Filesystem 'cephfs' (1) 2024-09-13T17:09:44.103 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: fs_name cephfs 2024-09-13T17:09:44.103 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: epoch 19 2024-09-13T17:09:44.103 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T17:09:44.104 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: created 2024-09-13T17:03:16.313116+0000 2024-09-13T17:09:44.104 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: modified 2024-09-13T17:03:33.410348+0000 2024-09-13T17:09:44.104 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: tableserver 0 2024-09-13T17:09:44.104 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: root 0 2024-09-13T17:09:44.104 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: session_timeout 60 2024-09-13T17:09:44.104 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: session_autoclose 300 2024-09-13T17:09:44.104 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: max_file_size 1099511627776 2024-09-13T17:09:44.104 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: max_xattr_size 65536 2024-09-13T17:09:44.104 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: required_client_features {} 2024-09-13T17:09:44.104 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: last_failure 0 2024-09-13T17:09:44.104 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: last_failure_osd_epoch 46 2024-09-13T17:09:44.104 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T17:09:44.104 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: max_mds 1 2024-09-13T17:09:44.104 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: in 0 2024-09-13T17:09:44.105 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: up {0=14470} 2024-09-13T17:09:44.105 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: failed 2024-09-13T17:09:44.105 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: damaged 2024-09-13T17:09:44.105 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: stopped 2024-09-13T17:09:44.105 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: data_pools [3] 2024-09-13T17:09:44.105 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: metadata_pool 2 2024-09-13T17:09:44.105 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: inline_data enabled 2024-09-13T17:09:44.105 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: balancer 2024-09-13T17:09:44.105 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: bal_rank_mask -1 2024-09-13T17:09:44.105 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: standby_count_wanted 1 2024-09-13T17:09:44.105 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: [mds.cephfs.smithi115.ijznvr{0:14470} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.115:6828/4128583274,v1:172.21.15.115:6829/4128583274] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T17:09:44.105 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: [mds.cephfs.smithi115.hbtxod{0:14486} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.115:6826/1977394649,v1:172.21.15.115:6827/1977394649] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T17:09:44.106 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: 2024-09-13T17:09:44.106 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: 2024-09-13T17:09:44.106 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Standby daemons: 2024-09-13T17:09:44.106 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: 2024-09-13T17:09:44.106 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: [mds.cephfs.smithi195.aevvgz{-1:24253} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.195:6826/8826118,v1:172.21.15.195:6827/8826118] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T17:09:44.106 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: [mds.cephfs.smithi195.qzghxj{-1:24259} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.195:6824/3335357704,v1:172.21.15.195:6825/3335357704] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T17:09:44.106 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: mon.smithi195@-1(???).osd e48 crush map has features 3314933000852226048, adjusting msgr requires 2024-09-13T17:09:44.106 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: mon.smithi195@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-09-13T17:09:44.107 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: mon.smithi195@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-09-13T17:09:44.107 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: mon.smithi195@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-09-13T17:09:44.107 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: mon.smithi195@-1(???).paxosservice(auth 1..24) refresh upgraded, format 0 -> 3 2024-09-13T17:09:44.107 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: pgmap v96: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-09-13T17:09:44.107 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mon metadata", "id": "smithi115"}]: dispatch 2024-09-13T17:09:44.107 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-09-13T17:09:44.108 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 bash[79993]: 0459bc5e6b0806185c69b9f670c56d97a2b5157826f08ce4f1795180c121c7ea 2024-09-13T17:09:44.108 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:43 smithi195 systemd[1]: Started Ceph mon.smithi195 for ffbd7588-71f0-11ef-bceb-c7b262605968. 2024-09-13T17:09:44.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:44 smithi115 ceph-mon[109488]: pgmap v97: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:09:44.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:44 smithi115 ceph-mon[109488]: mon.smithi195 calling monitor election 2024-09-13T17:09:44.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:44 smithi115 ceph-mon[109488]: mon.smithi115 calling monitor election 2024-09-13T17:09:44.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:44 smithi115 ceph-mon[109488]: mon.smithi115 is new leader, mons smithi115,smithi195 in quorum (ranks 0,1) 2024-09-13T17:09:44.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:44 smithi115 ceph-mon[109488]: monmap e2: 2 mons at {smithi115=[v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0],smithi195=[v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T17:09:44.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:44 smithi115 ceph-mon[109488]: fsmap cephfs:1 {0=cephfs.smithi115.ijznvr=up:active} 1 up:standby-replay 2 up:standby 2024-09-13T17:09:44.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:44 smithi115 ceph-mon[109488]: osdmap e48: 6 total, 6 up, 6 in 2024-09-13T17:09:44.930 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:44 smithi115 ceph-mon[109488]: mgrmap e31: smithi115.hetcni(active, since 3m), standbys: smithi195.hjjifz 2024-09-13T17:09:44.930 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:44 smithi115 ceph-mon[109488]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-13T17:09:44.930 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:44 smithi115 ceph-mon[109488]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T17:09:44.930 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:44 smithi115 ceph-mon[109488]: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T17:09:44.930 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:44 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:09:44.930 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:44 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:09:44.930 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:44 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:09:45.024 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:44 smithi195 ceph-mon[80021]: pgmap v97: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:09:45.025 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:44 smithi195 ceph-mon[80021]: mon.smithi195 calling monitor election 2024-09-13T17:09:45.025 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:44 smithi195 ceph-mon[80021]: mon.smithi115 calling monitor election 2024-09-13T17:09:45.025 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:44 smithi195 ceph-mon[80021]: mon.smithi115 is new leader, mons smithi115,smithi195 in quorum (ranks 0,1) 2024-09-13T17:09:45.025 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:44 smithi195 ceph-mon[80021]: monmap e2: 2 mons at {smithi115=[v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0],smithi195=[v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T17:09:45.025 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:44 smithi195 ceph-mon[80021]: fsmap cephfs:1 {0=cephfs.smithi115.ijznvr=up:active} 1 up:standby-replay 2 up:standby 2024-09-13T17:09:45.025 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:44 smithi195 ceph-mon[80021]: osdmap e48: 6 total, 6 up, 6 in 2024-09-13T17:09:45.025 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:44 smithi195 ceph-mon[80021]: mgrmap e31: smithi115.hetcni(active, since 3m), standbys: smithi195.hjjifz 2024-09-13T17:09:45.025 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:44 smithi195 ceph-mon[80021]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-13T17:09:45.025 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:44 smithi195 ceph-mon[80021]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T17:09:45.025 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:44 smithi195 ceph-mon[80021]: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T17:09:45.025 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:44 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:09:45.025 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:44 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:09:45.026 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:44 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:09:46.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:46 smithi115 ceph-mon[109488]: pgmap v98: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-09-13T17:09:46.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:46 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:09:46.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:46 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:09:47.076 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:46 smithi195 ceph-mon[80021]: pgmap v98: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-09-13T17:09:47.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:46 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:09:47.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:46 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:09:48.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:48 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:09:48.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:48 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:09:48.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:48 smithi115 ceph-mon[109488]: pgmap v99: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:09:48.510 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:48 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:09:48.511 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:48 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:09:48.511 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:48 smithi195 ceph-mon[80021]: pgmap v99: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:09:50.859 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:50 smithi115 ceph-mon[109488]: pgmap v100: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:09:50.859 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:50 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:09:50.859 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:50 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:09:50.859 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:50 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:09:50.859 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:50 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:09:50.859 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:50 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:09:50.859 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:50 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:09:50.859 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:50 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:09:50.859 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:50 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:09:50.860 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:50 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:09:50.860 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:50 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi115"}]: dispatch 2024-09-13T17:09:50.860 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:50 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi115"}]': finished 2024-09-13T17:09:50.860 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:50 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi195"}]: dispatch 2024-09-13T17:09:50.860 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:50 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi195"}]': finished 2024-09-13T17:09:50.860 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:50 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:09:51.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:50 smithi195 ceph-mon[80021]: pgmap v100: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:09:51.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:50 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:09:51.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:50 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:09:51.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:50 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:09:51.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:50 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:09:51.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:50 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:09:51.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:50 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:09:51.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:50 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:09:51.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:50 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:09:51.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:50 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:09:51.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:50 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi115"}]: dispatch 2024-09-13T17:09:51.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:50 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi115"}]': finished 2024-09-13T17:09:51.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:50 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi195"}]: dispatch 2024-09-13T17:09:51.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:50 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi195"}]': finished 2024-09-13T17:09:51.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:50 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:09:51.928 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:51 smithi115 ceph-mon[109488]: Upgrade: Setting container_image for all mon 2024-09-13T17:09:51.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:51 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:09:51.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:51 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi115", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T17:09:51.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:51 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:09:52.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:51 smithi195 ceph-mon[80021]: Upgrade: Setting container_image for all mon 2024-09-13T17:09:52.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:51 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:09:52.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:51 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi115", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T17:09:52.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:51 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:09:52.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:52 smithi115 ceph-mon[109488]: pgmap v101: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:09:52.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:52 smithi115 ceph-mon[109488]: Upgrade: Updating crash.smithi115 (1/2) 2024-09-13T17:09:52.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:52 smithi115 ceph-mon[109488]: Deploying daemon crash.smithi115 on smithi115 2024-09-13T17:09:53.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:52 smithi195 ceph-mon[80021]: pgmap v101: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:09:53.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:52 smithi195 ceph-mon[80021]: Upgrade: Updating crash.smithi115 (1/2) 2024-09-13T17:09:53.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:52 smithi195 ceph-mon[80021]: Deploying daemon crash.smithi115 on smithi115 2024-09-13T17:09:54.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:54 smithi195 ceph-mon[80021]: pgmap v102: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:09:54.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:54 smithi115 ceph-mon[109488]: pgmap v102: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:09:56.313 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:55 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:09:56.313 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:55 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:09:56.313 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:55 smithi195 ceph-mon[80021]: pgmap v103: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:09:56.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:55 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:09:56.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:55 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:09:56.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:55 smithi115 ceph-mon[109488]: pgmap v103: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:09:57.409 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:57 smithi115 ceph-mon[109488]: Upgrade: Updating crash.smithi195 (2/2) 2024-09-13T17:09:57.409 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:57 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:09:57.409 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:57 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi195", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T17:09:57.410 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:57 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:09:57.410 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:57 smithi115 ceph-mon[109488]: Deploying daemon crash.smithi195 on smithi195 2024-09-13T17:09:57.411 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.407+0000 7fddfd195640 1 -- 172.21.15.115:0/3535848971 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fddf8100d00 msgr2=0x7fddf81010e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:57.411 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.407+0000 7fddfd195640 1 --2- 172.21.15.115:0/3535848971 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fddf8100d00 0x7fddf81010e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fdde8009880 tx=0x7fdde802a530 comp rx=0 tx=0).stop 2024-09-13T17:09:57.411 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.407+0000 7fddfd195640 1 -- 172.21.15.115:0/3535848971 shutdown_connections 2024-09-13T17:09:57.411 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.407+0000 7fddfd195640 1 --2- 172.21.15.115:0/3535848971 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fddf8101620 0x7fddf8109b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:57.411 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.407+0000 7fddfd195640 1 --2- 172.21.15.115:0/3535848971 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fddf8100d00 0x7fddf81010e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:57.411 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.407+0000 7fddfd195640 1 -- 172.21.15.115:0/3535848971 >> 172.21.15.115:0/3535848971 conn(0x7fddf80758c0 msgr2=0x7fddf80fcc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:57.412 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.407+0000 7fddfd195640 1 -- 172.21.15.115:0/3535848971 shutdown_connections 2024-09-13T17:09:57.412 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.407+0000 7fddfd195640 1 -- 172.21.15.115:0/3535848971 wait complete. 2024-09-13T17:09:57.412 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.408+0000 7fddfd195640 1 Processor -- start 2024-09-13T17:09:57.412 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.408+0000 7fddfd195640 1 -- start start 2024-09-13T17:09:57.412 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.408+0000 7fddfd195640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fddf8100d00 0x7fddf819b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:57.412 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.408+0000 7fddfd195640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fddf8101620 0x7fddf819bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:57.412 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.408+0000 7fddfd195640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf819c340 con 0x7fddf8100d00 2024-09-13T17:09:57.412 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.408+0000 7fddfd195640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf81958d0 con 0x7fddf8101620 2024-09-13T17:09:57.412 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.409+0000 7fddf6d9d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fddf8100d00 0x7fddf819b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:57.412 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.409+0000 7fddf6d9d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fddf8100d00 0x7fddf819b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:40568/0 (socket says 172.21.15.115:40568) 2024-09-13T17:09:57.412 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.409+0000 7fddf6d9d640 1 -- 172.21.15.115:0/3503301459 learned_addr learned my addr 172.21.15.115:0/3503301459 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:09:57.413 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.409+0000 7fddf659c640 1 --2- 172.21.15.115:0/3503301459 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fddf8101620 0x7fddf819bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:57.413 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.409+0000 7fddf6d9d640 1 -- 172.21.15.115:0/3503301459 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fddf8101620 msgr2=0x7fddf819bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:57.413 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.409+0000 7fddf6d9d640 1 --2- 172.21.15.115:0/3503301459 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fddf8101620 0x7fddf819bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:57.413 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.409+0000 7fddf6d9d640 1 -- 172.21.15.115:0/3503301459 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdde8009560 con 0x7fddf8100d00 2024-09-13T17:09:57.413 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.409+0000 7fddf6d9d640 1 --2- 172.21.15.115:0/3503301459 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fddf8100d00 0x7fddf819b7e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fdde802aa50 tx=0x7fdde8004c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:57.413 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.409+0000 7fdddffff640 1 -- 172.21.15.115:0/3503301459 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdde8005330 con 0x7fddf8100d00 2024-09-13T17:09:57.413 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.409+0000 7fddfd195640 1 -- 172.21.15.115:0/3503301459 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddf8195b50 con 0x7fddf8100d00 2024-09-13T17:09:57.413 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.409+0000 7fdddffff640 1 -- 172.21.15.115:0/3503301459 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdde8005490 con 0x7fddf8100d00 2024-09-13T17:09:57.413 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.410+0000 7fdddffff640 1 -- 172.21.15.115:0/3503301459 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdde80318f0 con 0x7fddf8100d00 2024-09-13T17:09:57.413 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.410+0000 7fddfd195640 1 -- 172.21.15.115:0/3503301459 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddf8196040 con 0x7fddf8100d00 2024-09-13T17:09:57.414 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.411+0000 7fddfd195640 1 -- 172.21.15.115:0/3503301459 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddf8068420 con 0x7fddf8100d00 2024-09-13T17:09:57.414 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.411+0000 7fdddffff640 1 -- 172.21.15.115:0/3503301459 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fdde802ad50 con 0x7fddf8100d00 2024-09-13T17:09:57.414 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.412+0000 7fdddffff640 1 --2- 172.21.15.115:0/3503301459 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fdde006cc50 0x7fdde006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:57.414 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.412+0000 7fdddffff640 1 -- 172.21.15.115:0/3503301459 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fdde80ad470 con 0x7fddf8100d00 2024-09-13T17:09:57.414 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.412+0000 7fddf659c640 1 --2- 172.21.15.115:0/3503301459 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fdde006cc50 0x7fdde006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:57.414 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.412+0000 7fddf659c640 1 --2- 172.21.15.115:0/3503301459 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fdde006cc50 0x7fdde006f110 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fddf8196d40 tx=0x7fddec009680 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:57.417 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.416+0000 7fdddffff640 1 -- 172.21.15.115:0/3503301459 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fdde8077700 con 0x7fddf8100d00 2024-09-13T17:09:57.448 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:57 smithi195 ceph-mon[80021]: Upgrade: Updating crash.smithi195 (2/2) 2024-09-13T17:09:57.448 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:57 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:09:57.448 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:57 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi195", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T17:09:57.448 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:57 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:09:57.448 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:57 smithi195 ceph-mon[80021]: Deploying daemon crash.smithi195 on smithi195 2024-09-13T17:09:57.597 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.596+0000 7fddfd195640 1 -- 172.21.15.115:0/3503301459 --> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fddf810cbf0 con 0x7fdde006cc50 2024-09-13T17:09:57.598 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.597+0000 7fdddffff640 1 -- 172.21.15.115:0/3503301459 <== mgr.14660 v2:172.21.15.115:6800/1049502673 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7fddf810cbf0 con 0x7fdde006cc50 2024-09-13T17:09:57.600 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.599+0000 7fddfd195640 1 -- 172.21.15.115:0/3503301459 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fdde006cc50 msgr2=0x7fdde006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:57.601 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.599+0000 7fddfd195640 1 --2- 172.21.15.115:0/3503301459 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fdde006cc50 0x7fdde006f110 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fddf8196d40 tx=0x7fddec009680 comp rx=0 tx=0).stop 2024-09-13T17:09:57.601 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.599+0000 7fddfd195640 1 -- 172.21.15.115:0/3503301459 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fddf8100d00 msgr2=0x7fddf819b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:57.601 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.599+0000 7fddfd195640 1 --2- 172.21.15.115:0/3503301459 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fddf8100d00 0x7fddf819b7e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fdde802aa50 tx=0x7fdde8004c60 comp rx=0 tx=0).stop 2024-09-13T17:09:57.601 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.599+0000 7fddfd195640 1 -- 172.21.15.115:0/3503301459 shutdown_connections 2024-09-13T17:09:57.601 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.599+0000 7fddfd195640 1 --2- 172.21.15.115:0/3503301459 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fdde006cc50 0x7fdde006f110 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:57.601 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.599+0000 7fddfd195640 1 --2- 172.21.15.115:0/3503301459 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fddf8101620 0x7fddf819bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:57.601 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.599+0000 7fddfd195640 1 --2- 172.21.15.115:0/3503301459 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fddf8100d00 0x7fddf819b7e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:57.601 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.599+0000 7fddfd195640 1 -- 172.21.15.115:0/3503301459 >> 172.21.15.115:0/3503301459 conn(0x7fddf80758c0 msgr2=0x7fddf8101f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:57.601 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.599+0000 7fddfd195640 1 -- 172.21.15.115:0/3503301459 shutdown_connections 2024-09-13T17:09:57.601 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.599+0000 7fddfd195640 1 -- 172.21.15.115:0/3503301459 wait complete. 2024-09-13T17:09:57.610 INFO:teuthology.orchestra.run.smithi115.stdout:true 2024-09-13T17:09:57.684 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.682+0000 7f3631205640 1 -- 172.21.15.115:0/460041790 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f362c0727d0 msgr2=0x7f362c072bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:57.684 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.682+0000 7f3631205640 1 --2- 172.21.15.115:0/460041790 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f362c0727d0 0x7f362c072bb0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f361c009880 tx=0x7f361c02a530 comp rx=0 tx=0).stop 2024-09-13T17:09:57.684 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.682+0000 7f3631205640 1 -- 172.21.15.115:0/460041790 shutdown_connections 2024-09-13T17:09:57.684 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.682+0000 7f3631205640 1 --2- 172.21.15.115:0/460041790 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f362c0730f0 0x7f362c10be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:57.684 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.682+0000 7f3631205640 1 --2- 172.21.15.115:0/460041790 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f362c0727d0 0x7f362c072bb0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:57.684 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.682+0000 7f3631205640 1 -- 172.21.15.115:0/460041790 >> 172.21.15.115:0/460041790 conn(0x7f362c0fb810 msgr2=0x7f362c0fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:57.684 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.682+0000 7f3631205640 1 -- 172.21.15.115:0/460041790 shutdown_connections 2024-09-13T17:09:57.684 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.682+0000 7f3631205640 1 -- 172.21.15.115:0/460041790 wait complete. 2024-09-13T17:09:57.686 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.683+0000 7f3631205640 1 Processor -- start 2024-09-13T17:09:57.686 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.683+0000 7f3631205640 1 -- start start 2024-09-13T17:09:57.686 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.683+0000 7f3631205640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f362c0727d0 0x7f362c19d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:57.686 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.683+0000 7f3631205640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f362c0730f0 0x7f362c19def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:57.686 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.683+0000 7f3631205640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f362c19e510 con 0x7f362c0727d0 2024-09-13T17:09:57.686 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.683+0000 7f3631205640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f362c197aa0 con 0x7f362c0730f0 2024-09-13T17:09:57.686 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.684+0000 7f362ad9d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f362c0727d0 0x7f362c19d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:57.687 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.684+0000 7f362ad9d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f362c0727d0 0x7f362c19d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:40588/0 (socket says 172.21.15.115:40588) 2024-09-13T17:09:57.687 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.684+0000 7f362ad9d640 1 -- 172.21.15.115:0/482704778 learned_addr learned my addr 172.21.15.115:0/482704778 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:09:57.687 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.684+0000 7f362a59c640 1 --2- 172.21.15.115:0/482704778 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f362c0730f0 0x7f362c19def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:57.687 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.684+0000 7f362ad9d640 1 -- 172.21.15.115:0/482704778 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f362c0730f0 msgr2=0x7f362c19def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:57.687 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.684+0000 7f362ad9d640 1 --2- 172.21.15.115:0/482704778 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f362c0730f0 0x7f362c19def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:57.687 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.684+0000 7f362ad9d640 1 -- 172.21.15.115:0/482704778 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f361c009560 con 0x7f362c0727d0 2024-09-13T17:09:57.687 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.684+0000 7f362a59c640 1 --2- 172.21.15.115:0/482704778 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f362c0730f0 0x7f362c19def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:09:57.687 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.684+0000 7f362ad9d640 1 --2- 172.21.15.115:0/482704778 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f362c0727d0 0x7f362c19d9b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f361c02aa50 tx=0x7f361c0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:57.687 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.684+0000 7f3623fff640 1 -- 172.21.15.115:0/482704778 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f361c004aa0 con 0x7f362c0727d0 2024-09-13T17:09:57.687 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.684+0000 7f3623fff640 1 -- 172.21.15.115:0/482704778 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f361c004c00 con 0x7f362c0727d0 2024-09-13T17:09:57.687 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.684+0000 7f3631205640 1 -- 172.21.15.115:0/482704778 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f362c197d20 con 0x7f362c0727d0 2024-09-13T17:09:57.687 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.684+0000 7f3623fff640 1 -- 172.21.15.115:0/482704778 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f361c031750 con 0x7f362c0727d0 2024-09-13T17:09:57.687 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.684+0000 7f3631205640 1 -- 172.21.15.115:0/482704778 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f362c198210 con 0x7f362c0727d0 2024-09-13T17:09:57.688 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.685+0000 7f3631205640 1 -- 172.21.15.115:0/482704778 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f362c073f10 con 0x7f362c0727d0 2024-09-13T17:09:57.688 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.686+0000 7f3623fff640 1 -- 172.21.15.115:0/482704778 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f361c02ad50 con 0x7f362c0727d0 2024-09-13T17:09:57.689 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.686+0000 7f3623fff640 1 --2- 172.21.15.115:0/482704778 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f361806cc50 0x7f361806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:57.689 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.686+0000 7f3623fff640 1 -- 172.21.15.115:0/482704778 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f361c0ad1c0 con 0x7f362c0727d0 2024-09-13T17:09:57.689 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.686+0000 7f362a59c640 1 --2- 172.21.15.115:0/482704778 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f361806cc50 0x7f361806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:57.689 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.687+0000 7f362a59c640 1 --2- 172.21.15.115:0/482704778 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f361806cc50 0x7f361806f110 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f362c198f10 tx=0x7f3614005f90 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:57.691 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.690+0000 7f3623fff640 1 -- 172.21.15.115:0/482704778 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f361c077390 con 0x7f362c0727d0 2024-09-13T17:09:57.868 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.867+0000 7f3631205640 1 -- 172.21.15.115:0/482704778 --> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f362c106810 con 0x7f361806cc50 2024-09-13T17:09:57.869 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.868+0000 7f3623fff640 1 -- 172.21.15.115:0/482704778 <== mgr.14660 v2:172.21.15.115:6800/1049502673 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7f362c106810 con 0x7f361806cc50 2024-09-13T17:09:57.872 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.870+0000 7f3631205640 1 -- 172.21.15.115:0/482704778 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f361806cc50 msgr2=0x7f361806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:57.872 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.870+0000 7f3631205640 1 --2- 172.21.15.115:0/482704778 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f361806cc50 0x7f361806f110 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f362c198f10 tx=0x7f3614005f90 comp rx=0 tx=0).stop 2024-09-13T17:09:57.872 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.870+0000 7f3631205640 1 -- 172.21.15.115:0/482704778 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f362c0727d0 msgr2=0x7f362c19d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:57.872 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.870+0000 7f3631205640 1 --2- 172.21.15.115:0/482704778 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f362c0727d0 0x7f362c19d9b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f361c02aa50 tx=0x7f361c0055a0 comp rx=0 tx=0).stop 2024-09-13T17:09:57.872 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.871+0000 7f3631205640 1 -- 172.21.15.115:0/482704778 shutdown_connections 2024-09-13T17:09:57.872 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.871+0000 7f3631205640 1 --2- 172.21.15.115:0/482704778 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f361806cc50 0x7f361806f110 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:57.872 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.871+0000 7f3631205640 1 --2- 172.21.15.115:0/482704778 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f362c0730f0 0x7f362c19def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:57.873 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.871+0000 7f3631205640 1 --2- 172.21.15.115:0/482704778 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f362c0727d0 0x7f362c19d9b0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:57.873 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.871+0000 7f3631205640 1 -- 172.21.15.115:0/482704778 >> 172.21.15.115:0/482704778 conn(0x7f362c0fb810 msgr2=0x7f362c104350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:57.873 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.871+0000 7f3631205640 1 -- 172.21.15.115:0/482704778 shutdown_connections 2024-09-13T17:09:57.873 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.871+0000 7f3631205640 1 -- 172.21.15.115:0/482704778 wait complete. 2024-09-13T17:09:57.954 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.952+0000 7efe3a056640 1 -- 172.21.15.115:0/1638288767 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe340fea10 msgr2=0x7efe340fee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:57.954 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.952+0000 7efe3a056640 1 --2- 172.21.15.115:0/1638288767 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe340fea10 0x7efe340fee70 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7efe28009880 tx=0x7efe2802a4a0 comp rx=0 tx=0).stop 2024-09-13T17:09:57.954 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.952+0000 7efe3a056640 1 -- 172.21.15.115:0/1638288767 shutdown_connections 2024-09-13T17:09:57.954 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.952+0000 7efe3a056640 1 --2- 172.21.15.115:0/1638288767 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe340fea10 0x7efe340fee70 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:57.954 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.952+0000 7efe3a056640 1 --2- 172.21.15.115:0/1638288767 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efe34104a10 0x7efe34104df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:57.954 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.952+0000 7efe3a056640 1 -- 172.21.15.115:0/1638288767 >> 172.21.15.115:0/1638288767 conn(0x7efe340fa730 msgr2=0x7efe340fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:57.954 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.952+0000 7efe3a056640 1 -- 172.21.15.115:0/1638288767 shutdown_connections 2024-09-13T17:09:57.955 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.952+0000 7efe3a056640 1 -- 172.21.15.115:0/1638288767 wait complete. 2024-09-13T17:09:57.955 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.953+0000 7efe3a056640 1 Processor -- start 2024-09-13T17:09:57.956 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.953+0000 7efe3a056640 1 -- start start 2024-09-13T17:09:57.956 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.953+0000 7efe3a056640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efe340fea10 0x7efe3419a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:57.956 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.953+0000 7efe3a056640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe34104a10 0x7efe3419ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:57.956 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.953+0000 7efe3a056640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe3419b190 con 0x7efe34104a10 2024-09-13T17:09:57.956 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.953+0000 7efe3a056640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe34194720 con 0x7efe340fea10 2024-09-13T17:09:57.956 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.954+0000 7efe32ffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe34104a10 0x7efe3419ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:57.957 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.954+0000 7efe337fe640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efe340fea10 0x7efe3419a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:57.957 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.954+0000 7efe337fe640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efe340fea10 0x7efe3419a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.115:54078/0 (socket says 172.21.15.115:54078) 2024-09-13T17:09:57.957 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.954+0000 7efe337fe640 1 -- 172.21.15.115:0/2370621785 learned_addr learned my addr 172.21.15.115:0/2370621785 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:09:57.957 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.954+0000 7efe32ffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe34104a10 0x7efe3419ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:40608/0 (socket says 172.21.15.115:40608) 2024-09-13T17:09:57.957 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.954+0000 7efe337fe640 1 -- 172.21.15.115:0/2370621785 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe34104a10 msgr2=0x7efe3419ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:57.957 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.954+0000 7efe337fe640 1 --2- 172.21.15.115:0/2370621785 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe34104a10 0x7efe3419ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:57.957 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.954+0000 7efe337fe640 1 -- 172.21.15.115:0/2370621785 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe28009560 con 0x7efe340fea10 2024-09-13T17:09:57.957 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.954+0000 7efe337fe640 1 --2- 172.21.15.115:0/2370621785 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efe340fea10 0x7efe3419a630 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7efe2400d6f0 tx=0x7efe2400dbb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:57.957 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.954+0000 7efe30ff9640 1 -- 172.21.15.115:0/2370621785 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe24009a30 con 0x7efe340fea10 2024-09-13T17:09:57.957 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.954+0000 7efe3a056640 1 -- 172.21.15.115:0/2370621785 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe341949a0 con 0x7efe340fea10 2024-09-13T17:09:57.957 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.954+0000 7efe30ff9640 1 -- 172.21.15.115:0/2370621785 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7efe240054c0 con 0x7efe340fea10 2024-09-13T17:09:57.957 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.954+0000 7efe30ff9640 1 -- 172.21.15.115:0/2370621785 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe24004db0 con 0x7efe340fea10 2024-09-13T17:09:57.958 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.954+0000 7efe3a056640 1 -- 172.21.15.115:0/2370621785 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe34194ec0 con 0x7efe340fea10 2024-09-13T17:09:57.958 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.955+0000 7efe3a056640 1 -- 172.21.15.115:0/2370621785 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe34100150 con 0x7efe340fea10 2024-09-13T17:09:57.958 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.956+0000 7efe30ff9640 1 -- 172.21.15.115:0/2370621785 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7efe24004f30 con 0x7efe340fea10 2024-09-13T17:09:57.958 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.956+0000 7efe30ff9640 1 --2- 172.21.15.115:0/2370621785 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7efe1c06cbf0 0x7efe1c06f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:57.959 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.957+0000 7efe30ff9640 1 -- 172.21.15.115:0/2370621785 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7efe2408bfc0 con 0x7efe340fea10 2024-09-13T17:09:57.959 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.957+0000 7efe32ffd640 1 --2- 172.21.15.115:0/2370621785 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7efe1c06cbf0 0x7efe1c06f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:57.959 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.957+0000 7efe32ffd640 1 --2- 172.21.15.115:0/2370621785 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7efe1c06cbf0 0x7efe1c06f0b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7efe28000c00 tx=0x7efe280058d0 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:57.962 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:57.961+0000 7efe30ff9640 1 -- 172.21.15.115:0/2370621785 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7efe240bfe20 con 0x7efe340fea10 2024-09-13T17:09:58.133 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.132+0000 7efe3a056640 1 -- 172.21.15.115:0/2370621785 --> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7efe3410bc30 con 0x7efe1c06cbf0 2024-09-13T17:09:58.142 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.141+0000 7efe30ff9640 1 -- 172.21.15.115:0/2370621785 <== mgr.14660 v2:172.21.15.115:6800/1049502673 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7efe3410bc30 con 0x7efe1c06cbf0 2024-09-13T17:09:58.143 INFO:teuthology.orchestra.run.smithi115.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T17:09:58.143 INFO:teuthology.orchestra.run.smithi115.stdout:alertmanager.smithi115 smithi115 *:9093,9094 running (108s) 23s ago 11m 23.5M - 0.25.0 c8568f914cd2 d56b91240fe1 2024-09-13T17:09:58.143 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-exporter.smithi115 smithi115 running (12m) 23s ago 12m 8224k - 18.2.4-843-g2c01458a c129f5a2fd4e 0f1eebeaf9bb 2024-09-13T17:09:58.143 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-exporter.smithi195 smithi195 running (11m) 11s ago 11m 7772k - 18.2.4-843-g2c01458a c129f5a2fd4e 6d05bafbac8a 2024-09-13T17:09:58.143 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi115 smithi115 starting - - - - 2024-09-13T17:09:58.143 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi195 smithi195 running (11m) 11s ago 11m 6891k - 18.2.4-843-g2c01458a c129f5a2fd4e 42e6ce26130d 2024-09-13T17:09:58.143 INFO:teuthology.orchestra.run.smithi115.stdout:grafana.smithi115 smithi115 *:3000 running (93s) 23s ago 11m 80.2M - 9.4.7 954c08fa6188 e1eccb1a8f3e 2024-09-13T17:09:58.143 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi115.hbtxod smithi115 running (6m) 23s ago 6m 98.8M - 18.2.4-843-g2c01458a c129f5a2fd4e 12b4f4874491 2024-09-13T17:09:58.143 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi115.ijznvr smithi115 running (6m) 23s ago 6m 166M - 18.2.4-843-g2c01458a c129f5a2fd4e 2d552564a9f4 2024-09-13T17:09:58.143 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi195.aevvgz smithi195 running (6m) 11s ago 6m 17.4M - 18.2.4-843-g2c01458a c129f5a2fd4e 299b9ad657c9 2024-09-13T17:09:58.144 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi195.qzghxj smithi195 running (6m) 11s ago 6m 15.3M - 18.2.4-843-g2c01458a c129f5a2fd4e fb16b16181ff 2024-09-13T17:09:58.144 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi115.hetcni smithi115 *:8443,9283,8765 running (3m) 23s ago 13m 489M - 18.2.4-860-g6c6b083f 8a91f241d7d4 b945dbde1934 2024-09-13T17:09:58.144 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi195.hjjifz smithi195 *:8443,9283,8765 running (2m) 11s ago 11m 440M - 18.2.4-860-g6c6b083f 8a91f241d7d4 17bccdfbcae1 2024-09-13T17:09:58.144 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi115 smithi115 running (29s) 23s ago 13m 22.2M 2048M 18.2.4-860-g6c6b083f 8a91f241d7d4 8dd7baf2c6b6 2024-09-13T17:09:58.144 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi195 smithi195 running (14s) 11s ago 11m 18.7M 2048M 18.2.4-860-g6c6b083f 8a91f241d7d4 0459bc5e6b08 2024-09-13T17:09:58.144 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi115 smithi115 *:9100 running (2m) 23s ago 12m 16.8M - 1.5.0 0da6a335fe13 26fb6f9844b5 2024-09-13T17:09:58.144 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi195 smithi195 *:9100 running (2m) 11s ago 11m 17.3M - 1.5.0 0da6a335fe13 6d38e798fb16 2024-09-13T17:09:58.144 INFO:teuthology.orchestra.run.smithi115.stdout:osd.0 smithi115 running (10m) 23s ago 10m 247M 1216M 18.2.4-843-g2c01458a c129f5a2fd4e 8a8ad231962e 2024-09-13T17:09:58.144 INFO:teuthology.orchestra.run.smithi115.stdout:osd.1 smithi115 running (9m) 23s ago 9m 266M 1216M 18.2.4-843-g2c01458a c129f5a2fd4e 3fbc020102a0 2024-09-13T17:09:58.144 INFO:teuthology.orchestra.run.smithi115.stdout:osd.2 smithi115 running (9m) 23s ago 9m 224M 1216M 18.2.4-843-g2c01458a c129f5a2fd4e 7c623823e920 2024-09-13T17:09:58.144 INFO:teuthology.orchestra.run.smithi115.stdout:osd.3 smithi195 running (8m) 11s ago 8m 294M 2240M 18.2.4-843-g2c01458a c129f5a2fd4e 10ea833fd5c5 2024-09-13T17:09:58.144 INFO:teuthology.orchestra.run.smithi115.stdout:osd.4 smithi195 running (8m) 11s ago 8m 266M 2240M 18.2.4-843-g2c01458a c129f5a2fd4e 4bbc3acb9aff 2024-09-13T17:09:58.144 INFO:teuthology.orchestra.run.smithi115.stdout:osd.5 smithi195 running (8m) 11s ago 8m 237M 2240M 18.2.4-843-g2c01458a c129f5a2fd4e 4bd1b3a232d0 2024-09-13T17:09:58.144 INFO:teuthology.orchestra.run.smithi115.stdout:prometheus.smithi115 smithi115 *:9095 running (2m) 23s ago 11m 60.3M - 2.43.0 a07b618ecd1d e03fb39f6b76 2024-09-13T17:09:58.145 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.144+0000 7efe3a056640 1 -- 172.21.15.115:0/2370621785 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7efe1c06cbf0 msgr2=0x7efe1c06f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:58.145 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.144+0000 7efe3a056640 1 --2- 172.21.15.115:0/2370621785 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7efe1c06cbf0 0x7efe1c06f0b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7efe28000c00 tx=0x7efe280058d0 comp rx=0 tx=0).stop 2024-09-13T17:09:58.145 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.144+0000 7efe3a056640 1 -- 172.21.15.115:0/2370621785 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efe340fea10 msgr2=0x7efe3419a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:58.145 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.144+0000 7efe3a056640 1 --2- 172.21.15.115:0/2370621785 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efe340fea10 0x7efe3419a630 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7efe2400d6f0 tx=0x7efe2400dbb0 comp rx=0 tx=0).stop 2024-09-13T17:09:58.145 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.144+0000 7efe3a056640 1 -- 172.21.15.115:0/2370621785 shutdown_connections 2024-09-13T17:09:58.145 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.144+0000 7efe3a056640 1 --2- 172.21.15.115:0/2370621785 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7efe1c06cbf0 0x7efe1c06f0b0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:58.146 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.144+0000 7efe3a056640 1 --2- 172.21.15.115:0/2370621785 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe34104a10 0x7efe3419ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:58.146 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.144+0000 7efe3a056640 1 --2- 172.21.15.115:0/2370621785 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efe340fea10 0x7efe3419a630 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:58.146 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.144+0000 7efe3a056640 1 -- 172.21.15.115:0/2370621785 >> 172.21.15.115:0/2370621785 conn(0x7efe340fa730 msgr2=0x7efe340fb540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:58.146 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.144+0000 7efe3a056640 1 -- 172.21.15.115:0/2370621785 shutdown_connections 2024-09-13T17:09:58.146 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.144+0000 7efe3a056640 1 -- 172.21.15.115:0/2370621785 wait complete. 2024-09-13T17:09:58.226 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.224+0000 7f8a3bddb640 1 -- 172.21.15.115:0/1940239717 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a34100d40 msgr2=0x7f8a34101120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:58.226 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.224+0000 7f8a3bddb640 1 --2- 172.21.15.115:0/1940239717 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a34100d40 0x7f8a34101120 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8a300098b0 tx=0x7f8a3002a560 comp rx=0 tx=0).stop 2024-09-13T17:09:58.226 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.224+0000 7f8a3bddb640 1 -- 172.21.15.115:0/1940239717 shutdown_connections 2024-09-13T17:09:58.226 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.224+0000 7f8a3bddb640 1 --2- 172.21.15.115:0/1940239717 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a34101660 0x7f8a34109b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:58.226 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.224+0000 7f8a3bddb640 1 --2- 172.21.15.115:0/1940239717 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a34100d40 0x7f8a34101120 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:58.226 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.224+0000 7f8a3bddb640 1 -- 172.21.15.115:0/1940239717 >> 172.21.15.115:0/1940239717 conn(0x7f8a340fa720 msgr2=0x7f8a340fcb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:58.227 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:58 smithi115 ceph-mon[109488]: pgmap v104: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:09:58.227 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:58 smithi115 ceph-mon[109488]: from='client.34100 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:09:58.227 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:58 smithi115 ceph-mon[109488]: from='client.34104 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:09:58.228 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.225+0000 7f8a3bddb640 1 -- 172.21.15.115:0/1940239717 shutdown_connections 2024-09-13T17:09:58.229 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.225+0000 7f8a3bddb640 1 -- 172.21.15.115:0/1940239717 wait complete. 2024-09-13T17:09:58.229 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.225+0000 7f8a3bddb640 1 Processor -- start 2024-09-13T17:09:58.229 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.225+0000 7f8a3bddb640 1 -- start start 2024-09-13T17:09:58.229 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.225+0000 7f8a3bddb640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a34100d40 0x7f8a3419d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:58.229 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.225+0000 7f8a3bddb640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a34101660 0x7f8a3419def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:58.229 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.225+0000 7f8a3bddb640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a34197a10 con 0x7f8a34101660 2024-09-13T17:09:58.229 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.225+0000 7f8a3bddb640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a34197b50 con 0x7f8a34100d40 2024-09-13T17:09:58.229 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.226+0000 7f8a39b77640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a34100d40 0x7f8a3419d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:58.229 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.226+0000 7f8a39b77640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a34100d40 0x7f8a3419d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.115:54106/0 (socket says 172.21.15.115:54106) 2024-09-13T17:09:58.229 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.226+0000 7f8a39b77640 1 -- 172.21.15.115:0/4125124066 learned_addr learned my addr 172.21.15.115:0/4125124066 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:09:58.229 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.226+0000 7f8a39376640 1 --2- 172.21.15.115:0/4125124066 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a34101660 0x7f8a3419def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:58.229 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.226+0000 7f8a39b77640 1 -- 172.21.15.115:0/4125124066 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a34101660 msgr2=0x7f8a3419def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:58.229 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.226+0000 7f8a39b77640 1 --2- 172.21.15.115:0/4125124066 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a34101660 0x7f8a3419def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:58.230 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.226+0000 7f8a39b77640 1 -- 172.21.15.115:0/4125124066 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a30009560 con 0x7f8a34100d40 2024-09-13T17:09:58.230 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.226+0000 7f8a39b77640 1 --2- 172.21.15.115:0/4125124066 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a34100d40 0x7f8a3419d9b0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f8a30009230 tx=0x7f8a300055a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:58.230 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.226+0000 7f8a39376640 1 --2- 172.21.15.115:0/4125124066 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a34101660 0x7f8a3419def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:09:58.230 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.226+0000 7f8a2affd640 1 -- 172.21.15.115:0/4125124066 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a30004b60 con 0x7f8a34100d40 2024-09-13T17:09:58.230 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.227+0000 7f8a3bddb640 1 -- 172.21.15.115:0/4125124066 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a34197dd0 con 0x7f8a34100d40 2024-09-13T17:09:58.230 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.227+0000 7f8a2affd640 1 -- 172.21.15.115:0/4125124066 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8a30004cc0 con 0x7f8a34100d40 2024-09-13T17:09:58.230 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.227+0000 7f8a2affd640 1 -- 172.21.15.115:0/4125124066 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a30031990 con 0x7f8a34100d40 2024-09-13T17:09:58.230 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.227+0000 7f8a3bddb640 1 -- 172.21.15.115:0/4125124066 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a341982c0 con 0x7f8a34100d40 2024-09-13T17:09:58.231 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:58 smithi195 ceph-mon[80021]: pgmap v104: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:09:58.231 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:58 smithi195 ceph-mon[80021]: from='client.34100 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:09:58.231 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:58 smithi195 ceph-mon[80021]: from='client.34104 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:09:58.231 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.228+0000 7f8a3bddb640 1 -- 172.21.15.115:0/4125124066 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a34068c80 con 0x7f8a34100d40 2024-09-13T17:09:58.232 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.228+0000 7f8a2affd640 1 -- 172.21.15.115:0/4125124066 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f8a30003c00 con 0x7f8a34100d40 2024-09-13T17:09:58.232 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.229+0000 7f8a2affd640 1 --2- 172.21.15.115:0/4125124066 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f8a2006cc60 0x7f8a2006f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:58.232 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.229+0000 7f8a2affd640 1 -- 172.21.15.115:0/4125124066 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f8a300ad620 con 0x7f8a34100d40 2024-09-13T17:09:58.232 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.229+0000 7f8a39376640 1 --2- 172.21.15.115:0/4125124066 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f8a2006cc60 0x7f8a2006f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:58.232 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.229+0000 7f8a39376640 1 --2- 172.21.15.115:0/4125124066 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f8a2006cc60 0x7f8a2006f120 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8a34199260 tx=0x7f8a24005e50 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:58.234 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.233+0000 7f8a2affd640 1 -- 172.21.15.115:0/4125124066 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f8a300776a0 con 0x7f8a34100d40 2024-09-13T17:09:58.457 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.456+0000 7f8a3bddb640 1 -- 172.21.15.115:0/4125124066 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8a34101120 con 0x7f8a34100d40 2024-09-13T17:09:58.458 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.457+0000 7f8a2affd640 1 -- 172.21.15.115:0/4125124066 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+733 (secure 0 0 0) 0x7f8a3007acc0 con 0x7f8a34100d40 2024-09-13T17:09:58.458 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-13T17:09:58.458 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": { 2024-09-13T17:09:58.459 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 2 2024-09-13T17:09:58.459 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T17:09:58.459 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": { 2024-09-13T17:09:58.459 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 2 2024-09-13T17:09:58.459 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T17:09:58.459 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": { 2024-09-13T17:09:58.459 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-843-g2c01458a (2c01458affee2b2435cd231b6e392435c1c21661) reef (stable)": 6 2024-09-13T17:09:58.459 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T17:09:58.459 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": { 2024-09-13T17:09:58.459 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-843-g2c01458a (2c01458affee2b2435cd231b6e392435c1c21661) reef (stable)": 4 2024-09-13T17:09:58.459 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T17:09:58.459 INFO:teuthology.orchestra.run.smithi115.stdout: "overall": { 2024-09-13T17:09:58.459 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-843-g2c01458a (2c01458affee2b2435cd231b6e392435c1c21661) reef (stable)": 10, 2024-09-13T17:09:58.460 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 4 2024-09-13T17:09:58.460 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-13T17:09:58.460 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-13T17:09:58.461 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.459+0000 7f8a3bddb640 1 -- 172.21.15.115:0/4125124066 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f8a2006cc60 msgr2=0x7f8a2006f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:58.461 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.459+0000 7f8a3bddb640 1 --2- 172.21.15.115:0/4125124066 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f8a2006cc60 0x7f8a2006f120 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8a34199260 tx=0x7f8a24005e50 comp rx=0 tx=0).stop 2024-09-13T17:09:58.461 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.459+0000 7f8a3bddb640 1 -- 172.21.15.115:0/4125124066 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a34100d40 msgr2=0x7f8a3419d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:58.461 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.459+0000 7f8a3bddb640 1 --2- 172.21.15.115:0/4125124066 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a34100d40 0x7f8a3419d9b0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f8a30009230 tx=0x7f8a300055a0 comp rx=0 tx=0).stop 2024-09-13T17:09:58.461 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.459+0000 7f8a3bddb640 1 -- 172.21.15.115:0/4125124066 shutdown_connections 2024-09-13T17:09:58.461 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.459+0000 7f8a3bddb640 1 --2- 172.21.15.115:0/4125124066 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f8a2006cc60 0x7f8a2006f120 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:58.461 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.459+0000 7f8a3bddb640 1 --2- 172.21.15.115:0/4125124066 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a34101660 0x7f8a3419def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:58.461 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.459+0000 7f8a3bddb640 1 --2- 172.21.15.115:0/4125124066 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a34100d40 0x7f8a3419d9b0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:58.461 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.459+0000 7f8a3bddb640 1 -- 172.21.15.115:0/4125124066 >> 172.21.15.115:0/4125124066 conn(0x7f8a340fa720 msgr2=0x7f8a341000b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:58.461 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.460+0000 7f8a3bddb640 1 -- 172.21.15.115:0/4125124066 shutdown_connections 2024-09-13T17:09:58.461 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.460+0000 7f8a3bddb640 1 -- 172.21.15.115:0/4125124066 wait complete. 2024-09-13T17:09:58.542 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.540+0000 7f3569f97640 1 -- 172.21.15.115:0/3781943936 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f35641049a0 msgr2=0x7f3564104d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:58.542 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.540+0000 7f3569f97640 1 --2- 172.21.15.115:0/3781943936 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f35641049a0 0x7f3564104d80 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3554009880 tx=0x7f355402a4a0 comp rx=0 tx=0).stop 2024-09-13T17:09:58.542 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.540+0000 7f3569f97640 1 -- 172.21.15.115:0/3781943936 shutdown_connections 2024-09-13T17:09:58.542 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.540+0000 7f3569f97640 1 --2- 172.21.15.115:0/3781943936 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f35640fe9a0 0x7f35640fee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:58.542 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.540+0000 7f3569f97640 1 --2- 172.21.15.115:0/3781943936 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f35641049a0 0x7f3564104d80 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:58.542 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.540+0000 7f3569f97640 1 -- 172.21.15.115:0/3781943936 >> 172.21.15.115:0/3781943936 conn(0x7f35640758c0 msgr2=0x7f35640fcc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:58.542 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.540+0000 7f3569f97640 1 -- 172.21.15.115:0/3781943936 shutdown_connections 2024-09-13T17:09:58.542 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.540+0000 7f3569f97640 1 -- 172.21.15.115:0/3781943936 wait complete. 2024-09-13T17:09:58.542 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.541+0000 7f3569f97640 1 Processor -- start 2024-09-13T17:09:58.542 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.541+0000 7f3569f97640 1 -- start start 2024-09-13T17:09:58.544 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.541+0000 7f3569f97640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f35640fe9a0 0x7f356419a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:58.544 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.541+0000 7f3569f97640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f35641049a0 0x7f356419ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:58.544 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.541+0000 7f3569f97640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3564194850 con 0x7f35640fe9a0 2024-09-13T17:09:58.544 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.541+0000 7f3569f97640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3564194990 con 0x7f35641049a0 2024-09-13T17:09:58.544 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.541+0000 7f35637fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f35640fe9a0 0x7f356419a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:58.544 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.541+0000 7f35637fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f35640fe9a0 0x7f356419a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:40642/0 (socket says 172.21.15.115:40642) 2024-09-13T17:09:58.545 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.541+0000 7f35637fe640 1 -- 172.21.15.115:0/657451948 learned_addr learned my addr 172.21.15.115:0/657451948 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:09:58.545 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.541+0000 7f355bfff640 1 --2- 172.21.15.115:0/657451948 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f35641049a0 0x7f356419ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:58.545 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.541+0000 7f35637fe640 1 -- 172.21.15.115:0/657451948 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f35641049a0 msgr2=0x7f356419ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:58.545 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.541+0000 7f35637fe640 1 --2- 172.21.15.115:0/657451948 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f35641049a0 0x7f356419ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:58.545 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.541+0000 7f35637fe640 1 -- 172.21.15.115:0/657451948 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3554009560 con 0x7f35640fe9a0 2024-09-13T17:09:58.545 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.542+0000 7f35637fe640 1 --2- 172.21.15.115:0/657451948 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f35640fe9a0 0x7f356419a7f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f355402a9c0 tx=0x7f35540055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:58.545 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.542+0000 7f35617fa640 1 -- 172.21.15.115:0/657451948 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3554004b60 con 0x7f35640fe9a0 2024-09-13T17:09:58.545 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.542+0000 7f35617fa640 1 -- 172.21.15.115:0/657451948 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3554004cc0 con 0x7f35640fe9a0 2024-09-13T17:09:58.545 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.542+0000 7f3569f97640 1 -- 172.21.15.115:0/657451948 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3564194c10 con 0x7f35640fe9a0 2024-09-13T17:09:58.545 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.542+0000 7f35617fa640 1 -- 172.21.15.115:0/657451948 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3554031950 con 0x7f35640fe9a0 2024-09-13T17:09:58.545 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.542+0000 7f3569f97640 1 -- 172.21.15.115:0/657451948 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3564195100 con 0x7f35640fe9a0 2024-09-13T17:09:58.545 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.543+0000 7f3569f97640 1 -- 172.21.15.115:0/657451948 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35641000e0 con 0x7f35640fe9a0 2024-09-13T17:09:58.546 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.543+0000 7f35617fa640 1 -- 172.21.15.115:0/657451948 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f3554003c20 con 0x7f35640fe9a0 2024-09-13T17:09:58.546 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.544+0000 7f35617fa640 1 --2- 172.21.15.115:0/657451948 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f355006cc50 0x7f355006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:58.546 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.544+0000 7f355bfff640 1 --2- 172.21.15.115:0/657451948 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f355006cc50 0x7f355006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:58.546 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.544+0000 7f35617fa640 1 -- 172.21.15.115:0/657451948 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f35540ad4b0 con 0x7f35640fe9a0 2024-09-13T17:09:58.547 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.545+0000 7f355bfff640 1 --2- 172.21.15.115:0/657451948 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f355006cc50 0x7f355006f110 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f35641960a0 tx=0x7f354c00b390 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:58.549 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.548+0000 7f35617fa640 1 -- 172.21.15.115:0/657451948 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f3554077700 con 0x7f35640fe9a0 2024-09-13T17:09:58.745 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.744+0000 7f3569f97640 1 -- 172.21.15.115:0/657451948 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f3564195d80 con 0x7f35640fe9a0 2024-09-13T17:09:58.745 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.744+0000 7f35617fa640 1 -- 172.21.15.115:0/657451948 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1874 (secure 0 0 0) 0x7f3554004e30 con 0x7f35640fe9a0 2024-09-13T17:09:58.746 INFO:teuthology.orchestra.run.smithi115.stdout:e19 2024-09-13T17:09:58.746 INFO:teuthology.orchestra.run.smithi115.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T17:09:58.746 INFO:teuthology.orchestra.run.smithi115.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T17:09:58.746 INFO:teuthology.orchestra.run.smithi115.stdout:legacy client fscid: 1 2024-09-13T17:09:58.746 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:09:58.746 INFO:teuthology.orchestra.run.smithi115.stdout:Filesystem 'cephfs' (1) 2024-09-13T17:09:58.746 INFO:teuthology.orchestra.run.smithi115.stdout:fs_name cephfs 2024-09-13T17:09:58.746 INFO:teuthology.orchestra.run.smithi115.stdout:epoch 19 2024-09-13T17:09:58.746 INFO:teuthology.orchestra.run.smithi115.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T17:09:58.746 INFO:teuthology.orchestra.run.smithi115.stdout:created 2024-09-13T17:03:16.313116+0000 2024-09-13T17:09:58.747 INFO:teuthology.orchestra.run.smithi115.stdout:modified 2024-09-13T17:03:33.410348+0000 2024-09-13T17:09:58.747 INFO:teuthology.orchestra.run.smithi115.stdout:tableserver 0 2024-09-13T17:09:58.747 INFO:teuthology.orchestra.run.smithi115.stdout:root 0 2024-09-13T17:09:58.747 INFO:teuthology.orchestra.run.smithi115.stdout:session_timeout 60 2024-09-13T17:09:58.747 INFO:teuthology.orchestra.run.smithi115.stdout:session_autoclose 300 2024-09-13T17:09:58.747 INFO:teuthology.orchestra.run.smithi115.stdout:max_file_size 1099511627776 2024-09-13T17:09:58.747 INFO:teuthology.orchestra.run.smithi115.stdout:max_xattr_size 65536 2024-09-13T17:09:58.747 INFO:teuthology.orchestra.run.smithi115.stdout:required_client_features {} 2024-09-13T17:09:58.747 INFO:teuthology.orchestra.run.smithi115.stdout:last_failure 0 2024-09-13T17:09:58.747 INFO:teuthology.orchestra.run.smithi115.stdout:last_failure_osd_epoch 46 2024-09-13T17:09:58.747 INFO:teuthology.orchestra.run.smithi115.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T17:09:58.747 INFO:teuthology.orchestra.run.smithi115.stdout:max_mds 1 2024-09-13T17:09:58.747 INFO:teuthology.orchestra.run.smithi115.stdout:in 0 2024-09-13T17:09:58.748 INFO:teuthology.orchestra.run.smithi115.stdout:up {0=14470} 2024-09-13T17:09:58.748 INFO:teuthology.orchestra.run.smithi115.stdout:failed 2024-09-13T17:09:58.748 INFO:teuthology.orchestra.run.smithi115.stdout:damaged 2024-09-13T17:09:58.748 INFO:teuthology.orchestra.run.smithi115.stdout:stopped 2024-09-13T17:09:58.748 INFO:teuthology.orchestra.run.smithi115.stdout:data_pools [3] 2024-09-13T17:09:58.748 INFO:teuthology.orchestra.run.smithi115.stdout:metadata_pool 2 2024-09-13T17:09:58.748 INFO:teuthology.orchestra.run.smithi115.stdout:inline_data enabled 2024-09-13T17:09:58.748 INFO:teuthology.orchestra.run.smithi115.stdout:balancer 2024-09-13T17:09:58.748 INFO:teuthology.orchestra.run.smithi115.stdout:bal_rank_mask -1 2024-09-13T17:09:58.748 INFO:teuthology.orchestra.run.smithi115.stdout:standby_count_wanted 1 2024-09-13T17:09:58.748 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi115.ijznvr{0:14470} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.115:6828/4128583274,v1:172.21.15.115:6829/4128583274] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T17:09:58.748 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi115.hbtxod{0:14486} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.115:6826/1977394649,v1:172.21.15.115:6827/1977394649] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T17:09:58.748 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:09:58.749 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:09:58.749 INFO:teuthology.orchestra.run.smithi115.stdout:Standby daemons: 2024-09-13T17:09:58.749 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:09:58.749 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi195.aevvgz{-1:24253} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.195:6826/8826118,v1:172.21.15.195:6827/8826118] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T17:09:58.749 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi195.qzghxj{-1:24259} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.195:6824/3335357704,v1:172.21.15.195:6825/3335357704] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T17:09:58.750 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 19 2024-09-13T17:09:58.750 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.746+0000 7f3569f97640 1 -- 172.21.15.115:0/657451948 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f355006cc50 msgr2=0x7f355006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:58.750 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.746+0000 7f3569f97640 1 --2- 172.21.15.115:0/657451948 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f355006cc50 0x7f355006f110 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f35641960a0 tx=0x7f354c00b390 comp rx=0 tx=0).stop 2024-09-13T17:09:58.750 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.746+0000 7f3569f97640 1 -- 172.21.15.115:0/657451948 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f35640fe9a0 msgr2=0x7f356419a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:58.750 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.746+0000 7f3569f97640 1 --2- 172.21.15.115:0/657451948 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f35640fe9a0 0x7f356419a7f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f355402a9c0 tx=0x7f35540055a0 comp rx=0 tx=0).stop 2024-09-13T17:09:58.750 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.746+0000 7f3569f97640 1 -- 172.21.15.115:0/657451948 shutdown_connections 2024-09-13T17:09:58.750 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.746+0000 7f3569f97640 1 --2- 172.21.15.115:0/657451948 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f355006cc50 0x7f355006f110 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:58.750 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.746+0000 7f3569f97640 1 --2- 172.21.15.115:0/657451948 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f35641049a0 0x7f356419ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:58.750 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.746+0000 7f3569f97640 1 --2- 172.21.15.115:0/657451948 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f35640fe9a0 0x7f356419a7f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:58.750 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.746+0000 7f3569f97640 1 -- 172.21.15.115:0/657451948 >> 172.21.15.115:0/657451948 conn(0x7f35640758c0 msgr2=0x7f3564102350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:58.750 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.746+0000 7f3569f97640 1 -- 172.21.15.115:0/657451948 shutdown_connections 2024-09-13T17:09:58.751 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.747+0000 7f3569f97640 1 -- 172.21.15.115:0/657451948 wait complete. 2024-09-13T17:09:58.829 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.828+0000 7f5cf16d9640 1 -- 172.21.15.115:0/911293786 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5cec1016a0 msgr2=0x7f5cec109b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:58.830 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.828+0000 7f5cf16d9640 1 --2- 172.21.15.115:0/911293786 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5cec1016a0 0x7f5cec109b90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5cd4009880 tx=0x7f5cd402a530 comp rx=0 tx=0).stop 2024-09-13T17:09:58.830 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.828+0000 7f5cf16d9640 1 -- 172.21.15.115:0/911293786 shutdown_connections 2024-09-13T17:09:58.830 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.828+0000 7f5cf16d9640 1 --2- 172.21.15.115:0/911293786 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5cec1016a0 0x7f5cec109b90 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:58.830 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.828+0000 7f5cf16d9640 1 --2- 172.21.15.115:0/911293786 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5cec100d80 0x7f5cec101160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:58.830 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.828+0000 7f5cf16d9640 1 -- 172.21.15.115:0/911293786 >> 172.21.15.115:0/911293786 conn(0x7f5cec0fa720 msgr2=0x7f5cec0fcb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:58.830 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.828+0000 7f5cf16d9640 1 -- 172.21.15.115:0/911293786 shutdown_connections 2024-09-13T17:09:58.830 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.828+0000 7f5cf16d9640 1 -- 172.21.15.115:0/911293786 wait complete. 2024-09-13T17:09:58.832 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.829+0000 7f5cf16d9640 1 Processor -- start 2024-09-13T17:09:58.832 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.829+0000 7f5cf16d9640 1 -- start start 2024-09-13T17:09:58.832 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.829+0000 7f5cf16d9640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5cec100d80 0x7f5cec0fe9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:58.832 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.829+0000 7f5cf16d9640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5cec1016a0 0x7f5cec0fef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:58.832 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.829+0000 7f5cf16d9640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cec0ff460 con 0x7f5cec100d80 2024-09-13T17:09:58.832 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.829+0000 7f5cf16d9640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cec0ff5d0 con 0x7f5cec1016a0 2024-09-13T17:09:58.832 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.829+0000 7f5ceaffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5cec100d80 0x7f5cec0fe9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:58.832 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.829+0000 7f5ceaffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5cec100d80 0x7f5cec0fe9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:40660/0 (socket says 172.21.15.115:40660) 2024-09-13T17:09:58.832 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.829+0000 7f5ceaffd640 1 -- 172.21.15.115:0/2638846042 learned_addr learned my addr 172.21.15.115:0/2638846042 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:09:58.832 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.830+0000 7f5cea7fc640 1 --2- 172.21.15.115:0/2638846042 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5cec1016a0 0x7f5cec0fef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:58.832 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.830+0000 7f5ceaffd640 1 -- 172.21.15.115:0/2638846042 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5cec1016a0 msgr2=0x7f5cec0fef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:58.833 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.830+0000 7f5ceaffd640 1 --2- 172.21.15.115:0/2638846042 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5cec1016a0 0x7f5cec0fef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:58.833 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.830+0000 7f5ceaffd640 1 -- 172.21.15.115:0/2638846042 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cd4009560 con 0x7f5cec100d80 2024-09-13T17:09:58.833 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.830+0000 7f5ceaffd640 1 --2- 172.21.15.115:0/2638846042 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5cec100d80 0x7f5cec0fe9e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc00d6f0 tx=0x7f5cdc00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:58.833 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.830+0000 7f5ce3fff640 1 -- 172.21.15.115:0/2638846042 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5cdc009a30 con 0x7f5cec100d80 2024-09-13T17:09:58.833 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.830+0000 7f5ce3fff640 1 -- 172.21.15.115:0/2638846042 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5cdc0054c0 con 0x7f5cec100d80 2024-09-13T17:09:58.833 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.830+0000 7f5cf16d9640 1 -- 172.21.15.115:0/2638846042 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cec1a1c70 con 0x7f5cec100d80 2024-09-13T17:09:58.833 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.830+0000 7f5ce3fff640 1 -- 172.21.15.115:0/2638846042 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5cdc004db0 con 0x7f5cec100d80 2024-09-13T17:09:58.833 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.830+0000 7f5cf16d9640 1 -- 172.21.15.115:0/2638846042 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cec1a1fd0 con 0x7f5cec100d80 2024-09-13T17:09:58.834 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.832+0000 7f5cf16d9640 1 -- 172.21.15.115:0/2638846042 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cec068c40 con 0x7f5cec100d80 2024-09-13T17:09:58.834 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.832+0000 7f5ce3fff640 1 -- 172.21.15.115:0/2638846042 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f5cdc005020 con 0x7f5cec100d80 2024-09-13T17:09:58.834 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.832+0000 7f5ce3fff640 1 --2- 172.21.15.115:0/2638846042 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f5cd806cc50 0x7f5cd806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:58.834 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.833+0000 7f5ce3fff640 1 -- 172.21.15.115:0/2638846042 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f5cdc08bf90 con 0x7f5cec100d80 2024-09-13T17:09:58.834 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.833+0000 7f5cea7fc640 1 --2- 172.21.15.115:0/2638846042 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f5cd806cc50 0x7f5cd806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:58.834 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.833+0000 7f5cea7fc640 1 --2- 172.21.15.115:0/2638846042 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f5cd806cc50 0x7f5cd806f110 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5cec100160 tx=0x7f5cd4005a20 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:58.838 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:58.837+0000 7f5ce3fff640 1 -- 172.21.15.115:0/2638846042 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f5cdc056130 con 0x7f5cec100d80 2024-09-13T17:09:59.012 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:59.011+0000 7f5cf16d9640 1 -- 172.21.15.115:0/2638846042 --> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5cec0ff790 con 0x7f5cd806cc50 2024-09-13T17:09:59.013 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:59.012+0000 7f5ce3fff640 1 -- 172.21.15.115:0/2638846042 <== mgr.14660 v2:172.21.15.115:6800/1049502673 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7f5cec0ff790 con 0x7f5cd806cc50 2024-09-13T17:09:59.013 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-13T17:09:59.013 INFO:teuthology.orchestra.run.smithi115.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256", 2024-09-13T17:09:59.014 INFO:teuthology.orchestra.run.smithi115.stdout: "in_progress": true, 2024-09-13T17:09:59.014 INFO:teuthology.orchestra.run.smithi115.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T17:09:59.014 INFO:teuthology.orchestra.run.smithi115.stdout: "services_complete": [ 2024-09-13T17:09:59.014 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr", 2024-09-13T17:09:59.014 INFO:teuthology.orchestra.run.smithi115.stdout: "mon" 2024-09-13T17:09:59.014 INFO:teuthology.orchestra.run.smithi115.stdout: ], 2024-09-13T17:09:59.014 INFO:teuthology.orchestra.run.smithi115.stdout: "progress": "4/23 daemons upgraded", 2024-09-13T17:09:59.014 INFO:teuthology.orchestra.run.smithi115.stdout: "message": "Currently upgrading crash daemons", 2024-09-13T17:09:59.014 INFO:teuthology.orchestra.run.smithi115.stdout: "is_paused": false 2024-09-13T17:09:59.014 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-13T17:09:59.015 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:59.014+0000 7f5cf16d9640 1 -- 172.21.15.115:0/2638846042 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f5cd806cc50 msgr2=0x7f5cd806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:59.015 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:59.014+0000 7f5cf16d9640 1 --2- 172.21.15.115:0/2638846042 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f5cd806cc50 0x7f5cd806f110 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5cec100160 tx=0x7f5cd4005a20 comp rx=0 tx=0).stop 2024-09-13T17:09:59.016 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:59.014+0000 7f5cf16d9640 1 -- 172.21.15.115:0/2638846042 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5cec100d80 msgr2=0x7f5cec0fe9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:59.016 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:59.014+0000 7f5cf16d9640 1 --2- 172.21.15.115:0/2638846042 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5cec100d80 0x7f5cec0fe9e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc00d6f0 tx=0x7f5cdc00dbb0 comp rx=0 tx=0).stop 2024-09-13T17:09:59.016 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:59.014+0000 7f5cf16d9640 1 -- 172.21.15.115:0/2638846042 shutdown_connections 2024-09-13T17:09:59.016 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:59.014+0000 7f5cf16d9640 1 --2- 172.21.15.115:0/2638846042 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f5cd806cc50 0x7f5cd806f110 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:59.016 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:59.014+0000 7f5cf16d9640 1 --2- 172.21.15.115:0/2638846042 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5cec1016a0 0x7f5cec0fef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:59.016 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:59.014+0000 7f5cf16d9640 1 --2- 172.21.15.115:0/2638846042 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5cec100d80 0x7f5cec0fe9e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:59.016 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:59.014+0000 7f5cf16d9640 1 -- 172.21.15.115:0/2638846042 >> 172.21.15.115:0/2638846042 conn(0x7f5cec0fa720 msgr2=0x7f5cec101fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:59.016 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:59.014+0000 7f5cf16d9640 1 -- 172.21.15.115:0/2638846042 shutdown_connections 2024-09-13T17:09:59.016 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:59.014+0000 7f5cf16d9640 1 -- 172.21.15.115:0/2638846042 wait complete. 2024-09-13T17:09:59.095 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:59.094+0000 7f2315209640 1 -- 172.21.15.115:0/2216321497 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2310073170 msgr2=0x7f23101105f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:59.096 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:59.094+0000 7f2315209640 1 --2- 172.21.15.115:0/2216321497 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2310073170 0x7f23101105f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2300009880 tx=0x7f230002a530 comp rx=0 tx=0).stop 2024-09-13T17:09:59.096 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:59.094+0000 7f2315209640 1 -- 172.21.15.115:0/2216321497 shutdown_connections 2024-09-13T17:09:59.096 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:59.094+0000 7f2315209640 1 --2- 172.21.15.115:0/2216321497 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2310073170 0x7f23101105f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:59.096 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:59.094+0000 7f2315209640 1 --2- 172.21.15.115:0/2216321497 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2310072850 0x7f2310072c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:59.096 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:59.094+0000 7f2315209640 1 -- 172.21.15.115:0/2216321497 >> 172.21.15.115:0/2216321497 conn(0x7f23100fb840 msgr2=0x7f23100fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:59.096 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:59.094+0000 7f2315209640 1 -- 172.21.15.115:0/2216321497 shutdown_connections 2024-09-13T17:09:59.096 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:59.094+0000 7f2315209640 1 -- 172.21.15.115:0/2216321497 wait complete. 2024-09-13T17:09:59.098 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:59.095+0000 7f2315209640 1 Processor -- start 2024-09-13T17:09:59.098 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:59.095+0000 7f2315209640 1 -- start start 2024-09-13T17:09:59.098 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:59.095+0000 7f2315209640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2310072850 0x7f231019bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:59.098 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:59.095+0000 7f2315209640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2310073170 0x7f231019c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:59.098 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:59.095+0000 7f2315209640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f231019cb80 con 0x7f2310073170 2024-09-13T17:09:59.098 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:59.095+0000 7f2315209640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23101a08f0 con 0x7f2310072850 2024-09-13T17:09:59.098 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:59.096+0000 7f230e59c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2310073170 0x7f231019c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:59.098 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:59.096+0000 7f230ed9d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2310072850 0x7f231019bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:59.098 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:59.096+0000 7f230e59c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2310073170 0x7f231019c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:40676/0 (socket says 172.21.15.115:40676) 2024-09-13T17:09:59.099 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:59.096+0000 7f230e59c640 1 -- 172.21.15.115:0/2828778698 learned_addr learned my addr 172.21.15.115:0/2828778698 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:09:59.099 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:59.096+0000 7f230e59c640 1 -- 172.21.15.115:0/2828778698 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2310072850 msgr2=0x7f231019bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:59.099 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:59.096+0000 7f230e59c640 1 --2- 172.21.15.115:0/2828778698 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2310072850 0x7f231019bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:59.099 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:59.096+0000 7f230e59c640 1 -- 172.21.15.115:0/2828778698 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2300009560 con 0x7f2310073170 2024-09-13T17:09:59.099 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:59.096+0000 7f230ed9d640 1 --2- 172.21.15.115:0/2828778698 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2310072850 0x7f231019bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:09:59.099 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:59.096+0000 7f230e59c640 1 --2- 172.21.15.115:0/2828778698 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2310073170 0x7f231019c4f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f230002aa50 tx=0x7f2300004c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:59.099 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:59.096+0000 7f2307fff640 1 -- 172.21.15.115:0/2828778698 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2300005330 con 0x7f2310073170 2024-09-13T17:09:59.099 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:59.096+0000 7f2307fff640 1 -- 172.21.15.115:0/2828778698 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2300005490 con 0x7f2310073170 2024-09-13T17:09:59.099 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:59.096+0000 7f2315209640 1 -- 172.21.15.115:0/2828778698 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23101a0bd0 con 0x7f2310073170 2024-09-13T17:09:59.099 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:59.096+0000 7f2307fff640 1 -- 172.21.15.115:0/2828778698 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f23000318f0 con 0x7f2310073170 2024-09-13T17:09:59.099 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:59.096+0000 7f2315209640 1 -- 172.21.15.115:0/2828778698 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23101a1120 con 0x7f2310073170 2024-09-13T17:09:59.100 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:59.097+0000 7f2315209640 1 -- 172.21.15.115:0/2828778698 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2310073f90 con 0x7f2310073170 2024-09-13T17:09:59.100 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:59.098+0000 7f2307fff640 1 -- 172.21.15.115:0/2828778698 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f230002ad50 con 0x7f2310073170 2024-09-13T17:09:59.100 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:59.098+0000 7f2307fff640 1 --2- 172.21.15.115:0/2828778698 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f22fc06cc50 0x7f22fc06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:59.101 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:59.098+0000 7f2307fff640 1 -- 172.21.15.115:0/2828778698 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f23000ad290 con 0x7f2310073170 2024-09-13T17:09:59.101 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:59.098+0000 7f230ed9d640 1 --2- 172.21.15.115:0/2828778698 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f22fc06cc50 0x7f22fc06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:59.101 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:59.099+0000 7f230ed9d640 1 --2- 172.21.15.115:0/2828778698 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f22fc06cc50 0x7f22fc06f110 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f22f8005d00 tx=0x7f22f800b410 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:59.103 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:59.102+0000 7f2307fff640 1 -- 172.21.15.115:0/2828778698 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f23000775a0 con 0x7f2310073170 2024-09-13T17:09:59.297 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:59 smithi195 ceph-mon[80021]: from='client.44109 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:09:59.297 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:59 smithi195 ceph-mon[80021]: from='client.? 172.21.15.115:0/4125124066' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:09:59.297 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:09:59 smithi195 ceph-mon[80021]: from='client.? 172.21.15.115:0/657451948' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T17:09:59.332 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:59.331+0000 7f2315209640 1 -- 172.21.15.115:0/2828778698 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f2310113220 con 0x7f2310073170 2024-09-13T17:09:59.333 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:59.331+0000 7f2307fff640 1 -- 172.21.15.115:0/2828778698 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f230007abc0 con 0x7f2310073170 2024-09-13T17:09:59.333 INFO:teuthology.orchestra.run.smithi115.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-13T17:09:59.333 INFO:teuthology.orchestra.run.smithi115.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T17:09:59.333 INFO:teuthology.orchestra.run.smithi115.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T17:09:59.335 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:59.334+0000 7f2315209640 1 -- 172.21.15.115:0/2828778698 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f22fc06cc50 msgr2=0x7f22fc06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:59.335 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:59.334+0000 7f2315209640 1 --2- 172.21.15.115:0/2828778698 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f22fc06cc50 0x7f22fc06f110 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f22f8005d00 tx=0x7f22f800b410 comp rx=0 tx=0).stop 2024-09-13T17:09:59.335 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:59.334+0000 7f2315209640 1 -- 172.21.15.115:0/2828778698 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2310073170 msgr2=0x7f231019c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:59.335 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:59.334+0000 7f2315209640 1 --2- 172.21.15.115:0/2828778698 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2310073170 0x7f231019c4f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f230002aa50 tx=0x7f2300004c60 comp rx=0 tx=0).stop 2024-09-13T17:09:59.335 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:59.334+0000 7f2315209640 1 -- 172.21.15.115:0/2828778698 shutdown_connections 2024-09-13T17:09:59.335 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:59.334+0000 7f2315209640 1 --2- 172.21.15.115:0/2828778698 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f22fc06cc50 0x7f22fc06f110 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:59.335 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:59.334+0000 7f2315209640 1 --2- 172.21.15.115:0/2828778698 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2310073170 0x7f231019c4f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:59.335 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:59.334+0000 7f2315209640 1 --2- 172.21.15.115:0/2828778698 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2310072850 0x7f231019bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:59.336 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:59.334+0000 7f2315209640 1 -- 172.21.15.115:0/2828778698 >> 172.21.15.115:0/2828778698 conn(0x7f23100fb840 msgr2=0x7f23100ff850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:59.336 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:59.334+0000 7f2315209640 1 -- 172.21.15.115:0/2828778698 shutdown_connections 2024-09-13T17:09:59.336 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:09:59.334+0000 7f2315209640 1 -- 172.21.15.115:0/2828778698 wait complete. 2024-09-13T17:09:59.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:59 smithi115 ceph-mon[109488]: from='client.44109 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:09:59.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:59 smithi115 ceph-mon[109488]: from='client.? 172.21.15.115:0/4125124066' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:09:59.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:09:59 smithi115 ceph-mon[109488]: from='client.? 172.21.15.115:0/657451948' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T17:10:00.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:00 smithi195 ceph-mon[80021]: from='client.34118 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:10:00.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:00 smithi195 ceph-mon[80021]: from='client.? 172.21.15.115:0/2828778698' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T17:10:00.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:00 smithi195 ceph-mon[80021]: pgmap v105: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:10:00.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:00 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:10:00.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:00 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:10:00.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:00 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:10:00.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:00 smithi195 ceph-mon[80021]: overall HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-13T17:10:00.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:00 smithi115 ceph-mon[109488]: from='client.34118 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:10:00.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:00 smithi115 ceph-mon[109488]: from='client.? 172.21.15.115:0/2828778698' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T17:10:00.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:00 smithi115 ceph-mon[109488]: pgmap v105: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:10:00.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:00 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:10:00.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:00 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:10:00.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:00 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:10:00.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:00 smithi115 ceph-mon[109488]: overall HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-13T17:10:02.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:02 smithi195 ceph-mon[80021]: pgmap v106: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:10:02.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:02 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:10:02.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:02 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:10:02.843 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:02 smithi115 ceph-mon[109488]: pgmap v106: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:10:02.843 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:02 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:10:02.844 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:02 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:10:03.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:03 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:10:03.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:03 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:10:04.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:03 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:10:04.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:03 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:10:05.076 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:04 smithi115 ceph-mon[109488]: pgmap v107: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:10:05.076 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:04 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:10:05.076 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:04 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:10:05.076 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:04 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:10:05.076 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:04 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:10:05.076 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:04 smithi195 ceph-mon[80021]: pgmap v107: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:10:05.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:04 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:10:05.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:04 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:10:05.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:04 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:10:05.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:04 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:10:06.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:05 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:10:06.078 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:05 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:10:07.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:06 smithi195 ceph-mon[80021]: pgmap v108: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:10:07.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:06 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:10:07.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:06 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:10:07.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:06 smithi115 ceph-mon[109488]: pgmap v108: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:10:07.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:06 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:10:07.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:06 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:10:09.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:08 smithi195 ceph-mon[80021]: pgmap v109: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:10:09.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:08 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:10:09.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:08 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:10:09.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:08 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:10:09.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:08 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:10:09.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:08 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:10:09.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:08 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:10:09.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:08 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:10:09.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:08 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:10:09.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:08 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:10:09.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:08 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:10:09.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:08 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi115"}]: dispatch 2024-09-13T17:10:09.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:08 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi115"}]': finished 2024-09-13T17:10:09.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:08 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi195"}]: dispatch 2024-09-13T17:10:09.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:08 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi195"}]': finished 2024-09-13T17:10:09.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:08 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-13T17:10:09.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:08 smithi115 ceph-mon[109488]: pgmap v109: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:10:09.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:08 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:10:09.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:08 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:10:09.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:08 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:10:09.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:08 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:10:09.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:08 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:10:09.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:08 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:10:09.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:08 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:10:09.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:08 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:10:09.180 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:08 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:10:09.180 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:08 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:10:09.180 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:08 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi115"}]: dispatch 2024-09-13T17:10:09.180 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:08 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi115"}]': finished 2024-09-13T17:10:09.180 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:08 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi195"}]: dispatch 2024-09-13T17:10:09.180 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:08 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi195"}]': finished 2024-09-13T17:10:09.180 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:08 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-13T17:10:10.043 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:09 smithi115 ceph-mon[109488]: Upgrade: Setting container_image for all crash 2024-09-13T17:10:10.043 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:09 smithi115 ceph-mon[109488]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-13T17:10:10.043 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:09 smithi115 ceph-mon[109488]: Upgrade: osd.0 is safe to restart 2024-09-13T17:10:10.043 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:09 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:10:10.043 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:09 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-13T17:10:10.043 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:09 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:10:10.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:09 smithi195 ceph-mon[80021]: Upgrade: Setting container_image for all crash 2024-09-13T17:10:10.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:09 smithi195 ceph-mon[80021]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-13T17:10:10.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:09 smithi195 ceph-mon[80021]: Upgrade: osd.0 is safe to restart 2024-09-13T17:10:10.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:09 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:10:10.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:09 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-13T17:10:10.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:09 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:10:10.888 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:10 smithi115 ceph-mon[109488]: pgmap v110: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:10:10.888 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:10 smithi115 ceph-mon[109488]: Upgrade: Updating osd.0 2024-09-13T17:10:10.888 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:10 smithi115 ceph-mon[109488]: Deploying daemon osd.0 on smithi115 2024-09-13T17:10:11.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:10 smithi195 ceph-mon[80021]: pgmap v110: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:10:11.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:10 smithi195 ceph-mon[80021]: Upgrade: Updating osd.0 2024-09-13T17:10:11.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:10 smithi195 ceph-mon[80021]: Deploying daemon osd.0 on smithi115 2024-09-13T17:10:12.669 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 17:10:12 smithi115 systemd[1]: Stopping Ceph osd.0 for ffbd7588-71f0-11ef-bceb-c7b262605968... 2024-09-13T17:10:12.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:12 smithi115 ceph-mon[109488]: pgmap v111: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:10:12.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:12 smithi115 ceph-mon[109488]: osd.0 marked itself down and dead 2024-09-13T17:10:12.929 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 17:10:12 smithi115 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-0[46402]: 2024-09-13T17:10:12.665+0000 7f36bc849640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T17:10:12.929 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 17:10:12 smithi115 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-0[46402]: 2024-09-13T17:10:12.665+0000 7f36bc849640 -1 osd.0 48 *** Got signal Terminated *** 2024-09-13T17:10:12.929 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 17:10:12 smithi115 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-0[46402]: 2024-09-13T17:10:12.665+0000 7f36bc849640 -1 osd.0 48 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T17:10:13.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:12 smithi195 ceph-mon[80021]: pgmap v111: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:10:13.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:12 smithi195 ceph-mon[80021]: osd.0 marked itself down and dead 2024-09-13T17:10:13.679 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 17:10:13 smithi115 podman[118059]: 2024-09-13 17:10:13.391429131 +0000 UTC m=+0.844013492 container died 8a8ad231962ec9ec8c073891c4c3d42943e8a3d16784c04ba535afe7755d45f6 (image=quay.ceph.io/ceph-ci/ceph@sha256:c37c250ffe653639d7a4124ac8acdc3c8f6a53cb4ef1f26b1d2df36648631a11, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=reef-2c01458) 2024-09-13T17:10:14.045 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:13 smithi115 ceph-mon[109488]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T17:10:14.046 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:13 smithi115 ceph-mon[109488]: osdmap e49: 6 total, 5 up, 6 in 2024-09-13T17:10:14.046 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 17:10:13 smithi115 podman[118059]: 2024-09-13 17:10:13.767235833 +0000 UTC m=+1.219820201 container cleanup 8a8ad231962ec9ec8c073891c4c3d42943e8a3d16784c04ba535afe7755d45f6 (image=quay.ceph.io/ceph-ci/ceph@sha256:c37c250ffe653639d7a4124ac8acdc3c8f6a53cb4ef1f26b1d2df36648631a11, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=reef-2c01458, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-13T17:10:14.046 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 17:10:13 smithi115 bash[118059]: ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-0 2024-09-13T17:10:14.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:13 smithi195 ceph-mon[80021]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T17:10:14.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:13 smithi195 ceph-mon[80021]: osdmap e49: 6 total, 5 up, 6 in 2024-09-13T17:10:14.378 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 17:10:14 smithi115 podman[118079]: 2024-09-13 17:10:14.043917561 +0000 UTC m=+0.646861243 container remove 8a8ad231962ec9ec8c073891c4c3d42943e8a3d16784c04ba535afe7755d45f6 (image=quay.ceph.io/ceph-ci/ceph@sha256:c37c250ffe653639d7a4124ac8acdc3c8f6a53cb4ef1f26b1d2df36648631a11, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=reef-2c01458, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-13T17:10:14.664 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 17:10:14 smithi115 podman[118165]: 2024-09-13 17:10:14.280587376 +0000 UTC m=+0.015847315 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T17:10:14.665 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 17:10:14 smithi115 podman[118165]: 2024-09-13 17:10:14.386377342 +0000 UTC m=+0.121637330 container create ec12fbb637ee888c9a083f9a5b8da975972d75b641b1758d8a85e53d4bb5ba7a (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-0-deactivate, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-13T17:10:14.665 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 17:10:14 smithi115 podman[118165]: 2024-09-13 17:10:14.664166961 +0000 UTC m=+0.399426894 container init ec12fbb637ee888c9a083f9a5b8da975972d75b641b1758d8a85e53d4bb5ba7a (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-13T17:10:14.928 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:14 smithi115 ceph-mon[109488]: pgmap v113: 65 pgs: 9 stale+active+clean, 56 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-13T17:10:14.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:14 smithi115 ceph-mon[109488]: osdmap e50: 6 total, 5 up, 6 in 2024-09-13T17:10:14.929 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 17:10:14 smithi115 podman[118165]: 2024-09-13 17:10:14.667503739 +0000 UTC m=+0.402763675 container start ec12fbb637ee888c9a083f9a5b8da975972d75b641b1758d8a85e53d4bb5ba7a (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-13T17:10:14.929 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 17:10:14 smithi115 podman[118165]: 2024-09-13 17:10:14.722453234 +0000 UTC m=+0.457713175 container attach ec12fbb637ee888c9a083f9a5b8da975972d75b641b1758d8a85e53d4bb5ba7a (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True) 2024-09-13T17:10:14.929 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 17:10:14 smithi115 podman[118165]: 2024-09-13 17:10:14.853584284 +0000 UTC m=+0.588844220 container died ec12fbb637ee888c9a083f9a5b8da975972d75b641b1758d8a85e53d4bb5ba7a (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-0-deactivate, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-13T17:10:15.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:14 smithi195 ceph-mon[80021]: pgmap v113: 65 pgs: 9 stale+active+clean, 56 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-13T17:10:15.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:14 smithi195 ceph-mon[80021]: osdmap e50: 6 total, 5 up, 6 in 2024-09-13T17:10:15.887 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 17:10:15 smithi115 podman[118187]: 2024-09-13 17:10:15.451198095 +0000 UTC m=+0.588498191 container remove ec12fbb637ee888c9a083f9a5b8da975972d75b641b1758d8a85e53d4bb5ba7a (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-0-deactivate, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-13T17:10:15.887 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 17:10:15 smithi115 systemd[1]: ceph-ffbd7588-71f0-11ef-bceb-c7b262605968@osd.0.service: Deactivated successfully. 2024-09-13T17:10:15.887 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 17:10:15 smithi115 systemd[1]: Stopped Ceph osd.0 for ffbd7588-71f0-11ef-bceb-c7b262605968. 2024-09-13T17:10:15.887 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 17:10:15 smithi115 systemd[1]: ceph-ffbd7588-71f0-11ef-bceb-c7b262605968@osd.0.service: Consumed 58.044s CPU time. 2024-09-13T17:10:15.887 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 17:10:15 smithi115 systemd[1]: Starting Ceph osd.0 for ffbd7588-71f0-11ef-bceb-c7b262605968... 2024-09-13T17:10:16.156 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 17:10:15 smithi115 podman[118285]: 2024-09-13 17:10:15.885450891 +0000 UTC m=+0.112554642 container create 9d850a5316579ba18af6e625005961a54d2bc5071c3d29026e7d04dff2a6121e (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-0-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-13T17:10:16.156 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 17:10:15 smithi115 podman[118285]: 2024-09-13 17:10:15.788831012 +0000 UTC m=+0.015934711 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T17:10:16.429 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 17:10:16 smithi115 podman[118285]: 2024-09-13 17:10:16.155904331 +0000 UTC m=+0.383008037 container init 9d850a5316579ba18af6e625005961a54d2bc5071c3d29026e7d04dff2a6121e (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-0-activate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T17:10:16.429 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 17:10:16 smithi115 podman[118285]: 2024-09-13 17:10:16.160022445 +0000 UTC m=+0.387126144 container start 9d850a5316579ba18af6e625005961a54d2bc5071c3d29026e7d04dff2a6121e (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-0-activate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-13T17:10:16.429 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 17:10:16 smithi115 podman[118285]: 2024-09-13 17:10:16.255355409 +0000 UTC m=+0.482459100 container attach 9d850a5316579ba18af6e625005961a54d2bc5071c3d29026e7d04dff2a6121e (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-0-activate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-13T17:10:16.841 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 17:10:16 smithi115 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-0-activate[118301]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-13T17:10:16.841 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 17:10:16 smithi115 bash[118285]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-13T17:10:16.841 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 17:10:16 smithi115 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-0-activate[118301]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-13T17:10:16.841 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 17:10:16 smithi115 bash[118285]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-13T17:10:16.841 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 17:10:16 smithi115 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-0-activate[118301]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-13T17:10:16.841 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 17:10:16 smithi115 bash[118285]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-13T17:10:16.841 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 17:10:16 smithi115 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-0-activate[118301]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-13T17:10:16.842 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 17:10:16 smithi115 bash[118285]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-13T17:10:16.842 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 17:10:16 smithi115 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-0-activate[118301]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-13T17:10:16.842 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 17:10:16 smithi115 bash[118285]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-13T17:10:16.842 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 17:10:16 smithi115 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-0-activate[118301]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-13T17:10:16.842 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 17:10:16 smithi115 bash[118285]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-13T17:10:16.842 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 17:10:16 smithi115 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-0-activate[118301]: --> ceph-volume raw activate successful for osd ID: 0 2024-09-13T17:10:16.842 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 17:10:16 smithi115 bash[118285]: --> ceph-volume raw activate successful for osd ID: 0 2024-09-13T17:10:16.842 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 17:10:16 smithi115 podman[118285]: 2024-09-13 17:10:16.509402256 +0000 UTC m=+0.736505954 container died 9d850a5316579ba18af6e625005961a54d2bc5071c3d29026e7d04dff2a6121e (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-0-activate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-13T17:10:17.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:16 smithi115 ceph-mon[109488]: pgmap v115: 65 pgs: 9 stale+active+clean, 56 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-09-13T17:10:17.326 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:16 smithi195 ceph-mon[80021]: pgmap v115: 65 pgs: 9 stale+active+clean, 56 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-09-13T17:10:17.562 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 17:10:17 smithi115 podman[118432]: 2024-09-13 17:10:17.210609707 +0000 UTC m=+0.695529966 container remove 9d850a5316579ba18af6e625005961a54d2bc5071c3d29026e7d04dff2a6121e (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-0-activate, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-13T17:10:17.562 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 17:10:17 smithi115 podman[118492]: 2024-09-13 17:10:17.319973774 +0000 UTC m=+0.015966186 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T17:10:17.562 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 17:10:17 smithi115 podman[118492]: 2024-09-13 17:10:17.434953242 +0000 UTC m=+0.130945649 container create 3b9f874c64e9b478689368fdb13922eadb1d3c11621eaccaf128ca57949a509f (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-0, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-13T17:10:17.830 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 17:10:17 smithi115 podman[118492]: 2024-09-13 17:10:17.721070802 +0000 UTC m=+0.417063209 container init 3b9f874c64e9b478689368fdb13922eadb1d3c11621eaccaf128ca57949a509f (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-0, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-13T17:10:17.830 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 17:10:17 smithi115 podman[118492]: 2024-09-13 17:10:17.724428008 +0000 UTC m=+0.420420424 container start 3b9f874c64e9b478689368fdb13922eadb1d3c11621eaccaf128ca57949a509f (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-0, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=) 2024-09-13T17:10:17.830 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 17:10:17 smithi115 ceph-osd[118511]: -- 172.21.15.115:0/1378976376 <== mon.0 v2:172.21.15.115:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55ce6b52b1e0 con 0x55ce6b4c9c00 2024-09-13T17:10:17.830 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 17:10:17 smithi115 bash[118492]: 3b9f874c64e9b478689368fdb13922eadb1d3c11621eaccaf128ca57949a509f 2024-09-13T17:10:18.178 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 17:10:17 smithi115 systemd[1]: Started Ceph osd.0 for ffbd7588-71f0-11ef-bceb-c7b262605968. 2024-09-13T17:10:18.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:17 smithi115 ceph-mon[109488]: pgmap v116: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s; 45/222 objects degraded (20.270%) 2024-09-13T17:10:18.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:17 smithi115 ceph-mon[109488]: Health check failed: Degraded data redundancy: 45/222 objects degraded (20.270%), 17 pgs degraded (PG_DEGRADED) 2024-09-13T17:10:18.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:17 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:10:18.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:17 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:10:18.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:17 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:10:18.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:17 smithi195 ceph-mon[80021]: pgmap v116: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s; 45/222 objects degraded (20.270%) 2024-09-13T17:10:18.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:17 smithi195 ceph-mon[80021]: Health check failed: Degraded data redundancy: 45/222 objects degraded (20.270%), 17 pgs degraded (PG_DEGRADED) 2024-09-13T17:10:18.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:17 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:10:18.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:17 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:10:18.328 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:17 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:10:18.583 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 17:10:18 smithi115 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-0[118507]: 2024-09-13T17:10:18.260+0000 7fefb5dad640 -1 Falling back to public interface 2024-09-13T17:10:20.767 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:20 smithi115 ceph-mon[109488]: pgmap v117: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s; 45/222 objects degraded (20.270%) 2024-09-13T17:10:20.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:20 smithi195 ceph-mon[80021]: pgmap v117: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s; 45/222 objects degraded (20.270%) 2024-09-13T17:10:21.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:21 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:10:21.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:21 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:10:22.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:21 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:10:22.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:21 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:10:22.928 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:22 smithi115 ceph-mon[109488]: pgmap v118: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 595 B/s rd, 0 op/s; 45/222 objects degraded (20.270%) 2024-09-13T17:10:23.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:22 smithi195 ceph-mon[80021]: pgmap v118: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 595 B/s rd, 0 op/s; 45/222 objects degraded (20.270%) 2024-09-13T17:10:23.678 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 17:10:23 smithi115 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-0[118507]: 2024-09-13T17:10:23.256+0000 7fefb5dad640 -1 osd.0 48 log_to_monitors true 2024-09-13T17:10:24.131 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:24 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:10:24.132 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:24 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:10:24.132 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:24 smithi115 ceph-mon[109488]: from='osd.0 [v2:172.21.15.115:6802/1186998944,v1:172.21.15.115:6803/1186998944]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-13T17:10:24.132 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:24 smithi115 ceph-mon[109488]: pgmap v119: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 45/222 objects degraded (20.270%) 2024-09-13T17:10:24.132 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:24 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:10:24.132 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:24 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:10:24.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:24 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:10:24.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:24 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:10:24.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:24 smithi195 ceph-mon[80021]: from='osd.0 [v2:172.21.15.115:6802/1186998944,v1:172.21.15.115:6803/1186998944]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-13T17:10:24.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:24 smithi195 ceph-mon[80021]: pgmap v119: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 45/222 objects degraded (20.270%) 2024-09-13T17:10:24.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:24 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:10:24.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:24 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:10:25.168 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:25 smithi115 ceph-mon[109488]: from='osd.0 [v2:172.21.15.115:6802/1186998944,v1:172.21.15.115:6803/1186998944]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-13T17:10:25.168 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:25 smithi115 ceph-mon[109488]: osdmap e51: 6 total, 5 up, 6 in 2024-09-13T17:10:25.168 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:25 smithi115 ceph-mon[109488]: from='osd.0 [v2:172.21.15.115:6802/1186998944,v1:172.21.15.115:6803/1186998944]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-13T17:10:25.168 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:25 smithi115 ceph-mon[109488]: from='osd.0 [v2:172.21.15.115:6802/1186998944,v1:172.21.15.115:6803/1186998944]' entity='osd.0' 2024-09-13T17:10:25.168 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 17:10:24 smithi115 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-0[118507]: 2024-09-13T17:10:24.865+0000 7fefa9b3e640 -1 osd.0 48 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T17:10:25.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:25 smithi195 ceph-mon[80021]: from='osd.0 [v2:172.21.15.115:6802/1186998944,v1:172.21.15.115:6803/1186998944]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-13T17:10:25.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:25 smithi195 ceph-mon[80021]: osdmap e51: 6 total, 5 up, 6 in 2024-09-13T17:10:25.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:25 smithi195 ceph-mon[80021]: from='osd.0 [v2:172.21.15.115:6802/1186998944,v1:172.21.15.115:6803/1186998944]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-13T17:10:25.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:25 smithi195 ceph-mon[80021]: from='osd.0 [v2:172.21.15.115:6802/1186998944,v1:172.21.15.115:6803/1186998944]' entity='osd.0' 2024-09-13T17:10:26.268 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:26 smithi115 ceph-mon[109488]: pgmap v121: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 199 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 45/222 objects degraded (20.270%) 2024-09-13T17:10:26.268 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:26 smithi115 ceph-mon[109488]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T17:10:26.268 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:26 smithi115 ceph-mon[109488]: osd.0 [v2:172.21.15.115:6802/1186998944,v1:172.21.15.115:6803/1186998944] boot 2024-09-13T17:10:26.268 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:26 smithi115 ceph-mon[109488]: osdmap e52: 6 total, 6 up, 6 in 2024-09-13T17:10:26.268 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:26 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T17:10:26.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:26 smithi195 ceph-mon[80021]: pgmap v121: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 199 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 45/222 objects degraded (20.270%) 2024-09-13T17:10:26.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:26 smithi195 ceph-mon[80021]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T17:10:26.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:26 smithi195 ceph-mon[80021]: osd.0 [v2:172.21.15.115:6802/1186998944,v1:172.21.15.115:6803/1186998944] boot 2024-09-13T17:10:26.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:26 smithi195 ceph-mon[80021]: osdmap e52: 6 total, 6 up, 6 in 2024-09-13T17:10:26.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:26 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T17:10:27.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:27 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:10:27.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:27 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:10:27.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:27 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:10:27.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:27 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:10:27.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:27 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:10:27.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:27 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:10:27.930 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:27 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:10:27.930 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:27 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:10:27.930 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:27 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:10:27.930 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:27 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-13T17:10:27.930 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:27 smithi115 ceph-mon[109488]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-13T17:10:27.930 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:27 smithi115 ceph-mon[109488]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-09-13T17:10:27.930 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:27 smithi115 ceph-mon[109488]: osdmap e53: 6 total, 6 up, 6 in 2024-09-13T17:10:28.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:27 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:10:28.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:27 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:10:28.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:27 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:10:28.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:27 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:10:28.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:27 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:10:28.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:27 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:10:28.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:27 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:10:28.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:27 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:10:28.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:27 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:10:28.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:27 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-13T17:10:28.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:27 smithi195 ceph-mon[80021]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-13T17:10:28.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:27 smithi195 ceph-mon[80021]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-09-13T17:10:28.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:27 smithi195 ceph-mon[80021]: osdmap e53: 6 total, 6 up, 6 in 2024-09-13T17:10:28.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:28 smithi115 ceph-mon[109488]: pgmap v124: 65 pgs: 25 peering, 7 active+undersized, 2 active+undersized+degraded, 31 active+clean; 199 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 2 op/s; 6/222 objects degraded (2.703%) 2024-09-13T17:10:28.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:28 smithi115 ceph-mon[109488]: Health check update: Degraded data redundancy: 6/222 objects degraded (2.703%), 2 pgs degraded (PG_DEGRADED) 2024-09-13T17:10:29.076 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:28 smithi195 ceph-mon[80021]: pgmap v124: 65 pgs: 25 peering, 7 active+undersized, 2 active+undersized+degraded, 31 active+clean; 199 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 2 op/s; 6/222 objects degraded (2.703%) 2024-09-13T17:10:29.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:28 smithi195 ceph-mon[80021]: Health check update: Degraded data redundancy: 6/222 objects degraded (2.703%), 2 pgs degraded (PG_DEGRADED) 2024-09-13T17:10:29.430 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.428+0000 7f588e229640 1 -- 172.21.15.115:0/983198400 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58880fe870 msgr2=0x7f58880fec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:29.431 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.428+0000 7f588e229640 1 --2- 172.21.15.115:0/983198400 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58880fe870 0x7f58880fec50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5878009880 tx=0x7f587802a490 comp rx=0 tx=0).stop 2024-09-13T17:10:29.431 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.429+0000 7f588e229640 1 -- 172.21.15.115:0/983198400 shutdown_connections 2024-09-13T17:10:29.431 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.429+0000 7f588e229640 1 --2- 172.21.15.115:0/983198400 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58880ff220 0x7f588810bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:29.431 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.429+0000 7f588e229640 1 --2- 172.21.15.115:0/983198400 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58880fe870 0x7f58880fec50 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:29.431 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.429+0000 7f588e229640 1 -- 172.21.15.115:0/983198400 >> 172.21.15.115:0/983198400 conn(0x7f58880758c0 msgr2=0x7f58880fcc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:29.431 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.429+0000 7f588e229640 1 -- 172.21.15.115:0/983198400 shutdown_connections 2024-09-13T17:10:29.431 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.429+0000 7f588e229640 1 -- 172.21.15.115:0/983198400 wait complete. 2024-09-13T17:10:29.431 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.429+0000 7f588e229640 1 Processor -- start 2024-09-13T17:10:29.431 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.430+0000 7f588e229640 1 -- start start 2024-09-13T17:10:29.432 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.430+0000 7f588e229640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58880fe870 0x7f588819d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:29.433 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.430+0000 7f588e229640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58880ff220 0x7f588819de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:29.433 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.430+0000 7f588e229640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f588819e470 con 0x7f58880ff220 2024-09-13T17:10:29.433 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.430+0000 7f588e229640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5888197a00 con 0x7f58880fe870 2024-09-13T17:10:29.433 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.430+0000 7f5886ffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58880ff220 0x7f588819de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:29.433 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.430+0000 7f5886ffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58880ff220 0x7f588819de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:34978/0 (socket says 172.21.15.115:34978) 2024-09-13T17:10:29.433 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.430+0000 7f5886ffd640 1 -- 172.21.15.115:0/3225483110 learned_addr learned my addr 172.21.15.115:0/3225483110 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:10:29.433 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.430+0000 7f58877fe640 1 --2- 172.21.15.115:0/3225483110 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58880fe870 0x7f588819d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:29.433 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.430+0000 7f5886ffd640 1 -- 172.21.15.115:0/3225483110 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58880fe870 msgr2=0x7f588819d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:29.433 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.430+0000 7f5886ffd640 1 --2- 172.21.15.115:0/3225483110 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58880fe870 0x7f588819d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:29.433 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.430+0000 7f5886ffd640 1 -- 172.21.15.115:0/3225483110 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5878009560 con 0x7f58880ff220 2024-09-13T17:10:29.433 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.430+0000 7f5886ffd640 1 --2- 172.21.15.115:0/3225483110 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58880ff220 0x7f588819de50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f587c00d8d0 tx=0x7f587c00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:29.433 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.431+0000 7f5884ff9640 1 -- 172.21.15.115:0/3225483110 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f587c00bea0 con 0x7f58880ff220 2024-09-13T17:10:29.434 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.431+0000 7f588e229640 1 -- 172.21.15.115:0/3225483110 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5888197ce0 con 0x7f58880ff220 2024-09-13T17:10:29.434 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.431+0000 7f588e229640 1 -- 172.21.15.115:0/3225483110 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5888198230 con 0x7f58880ff220 2024-09-13T17:10:29.434 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.431+0000 7f5884ff9640 1 -- 172.21.15.115:0/3225483110 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f587c009c00 con 0x7f58880ff220 2024-09-13T17:10:29.434 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.431+0000 7f5884ff9640 1 -- 172.21.15.115:0/3225483110 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f587c00f680 con 0x7f58880ff220 2024-09-13T17:10:29.435 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.432+0000 7f588e229640 1 -- 172.21.15.115:0/3225483110 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5874005250 con 0x7f58880ff220 2024-09-13T17:10:29.435 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.432+0000 7f5884ff9640 1 -- 172.21.15.115:0/3225483110 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f587c00f870 con 0x7f58880ff220 2024-09-13T17:10:29.435 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.433+0000 7f5884ff9640 1 --2- 172.21.15.115:0/3225483110 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f587006cc50 0x7f587006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:29.435 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.433+0000 7f5884ff9640 1 -- 172.21.15.115:0/3225483110 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f587c08c000 con 0x7f58880ff220 2024-09-13T17:10:29.435 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.433+0000 7f58877fe640 1 --2- 172.21.15.115:0/3225483110 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f587006cc50 0x7f587006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:29.435 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.433+0000 7f58877fe640 1 --2- 172.21.15.115:0/3225483110 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f587006cc50 0x7f587006f110 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5878000c00 tx=0x7f58780058d0 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:29.438 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.438+0000 7f5884ff9640 1 -- 172.21.15.115:0/3225483110 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f587c059ce0 con 0x7f58880ff220 2024-09-13T17:10:29.614 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.613+0000 7f588e229640 1 -- 172.21.15.115:0/3225483110 --> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5874000bc0 con 0x7f587006cc50 2024-09-13T17:10:29.615 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.614+0000 7f5884ff9640 1 -- 172.21.15.115:0/3225483110 <== mgr.14660 v2:172.21.15.115:6800/1049502673 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f5874000bc0 con 0x7f587006cc50 2024-09-13T17:10:29.617 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.616+0000 7f588e229640 1 -- 172.21.15.115:0/3225483110 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f587006cc50 msgr2=0x7f587006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:29.617 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.616+0000 7f588e229640 1 --2- 172.21.15.115:0/3225483110 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f587006cc50 0x7f587006f110 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5878000c00 tx=0x7f58780058d0 comp rx=0 tx=0).stop 2024-09-13T17:10:29.617 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.616+0000 7f588e229640 1 -- 172.21.15.115:0/3225483110 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58880ff220 msgr2=0x7f588819de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:29.617 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.616+0000 7f588e229640 1 --2- 172.21.15.115:0/3225483110 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58880ff220 0x7f588819de50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f587c00d8d0 tx=0x7f587c00dd90 comp rx=0 tx=0).stop 2024-09-13T17:10:29.618 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.616+0000 7f588e229640 1 -- 172.21.15.115:0/3225483110 shutdown_connections 2024-09-13T17:10:29.618 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.616+0000 7f588e229640 1 --2- 172.21.15.115:0/3225483110 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f587006cc50 0x7f587006f110 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:29.618 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.616+0000 7f588e229640 1 --2- 172.21.15.115:0/3225483110 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58880ff220 0x7f588819de50 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:29.618 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.616+0000 7f588e229640 1 --2- 172.21.15.115:0/3225483110 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58880fe870 0x7f588819d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:29.618 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.616+0000 7f588e229640 1 -- 172.21.15.115:0/3225483110 >> 172.21.15.115:0/3225483110 conn(0x7f58880758c0 msgr2=0x7f58880fcc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:29.618 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.616+0000 7f588e229640 1 -- 172.21.15.115:0/3225483110 shutdown_connections 2024-09-13T17:10:29.618 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.616+0000 7f588e229640 1 -- 172.21.15.115:0/3225483110 wait complete. 2024-09-13T17:10:29.626 INFO:teuthology.orchestra.run.smithi115.stdout:true 2024-09-13T17:10:29.702 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.699+0000 7fd41e8d7640 1 -- 172.21.15.115:0/155152125 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4181015e0 msgr2=0x7fd418109ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:29.702 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.699+0000 7fd41e8d7640 1 --2- 172.21.15.115:0/155152125 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4181015e0 0x7fd418109ad0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd4000098b0 tx=0x7fd40002a560 comp rx=0 tx=0).stop 2024-09-13T17:10:29.702 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.699+0000 7fd41e8d7640 1 -- 172.21.15.115:0/155152125 shutdown_connections 2024-09-13T17:10:29.702 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.699+0000 7fd41e8d7640 1 --2- 172.21.15.115:0/155152125 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4181015e0 0x7fd418109ad0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:29.702 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.699+0000 7fd41e8d7640 1 --2- 172.21.15.115:0/155152125 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd418100cc0 0x7fd4181010a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:29.702 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.699+0000 7fd41e8d7640 1 -- 172.21.15.115:0/155152125 >> 172.21.15.115:0/155152125 conn(0x7fd4180758c0 msgr2=0x7fd4180fcc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:29.702 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.699+0000 7fd41e8d7640 1 -- 172.21.15.115:0/155152125 shutdown_connections 2024-09-13T17:10:29.702 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.699+0000 7fd41e8d7640 1 -- 172.21.15.115:0/155152125 wait complete. 2024-09-13T17:10:29.702 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.699+0000 7fd41e8d7640 1 Processor -- start 2024-09-13T17:10:29.702 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.699+0000 7fd41e8d7640 1 -- start start 2024-09-13T17:10:29.703 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.700+0000 7fd41e8d7640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd418100cc0 0x7fd41819b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:29.703 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.700+0000 7fd41e8d7640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4181015e0 0x7fd41819bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:29.703 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.700+0000 7fd41e8d7640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd41819c2e0 con 0x7fd4181015e0 2024-09-13T17:10:29.703 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.700+0000 7fd41e8d7640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd418195870 con 0x7fd418100cc0 2024-09-13T17:10:29.703 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.700+0000 7fd40ffff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4181015e0 0x7fd41819bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:29.703 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.700+0000 7fd40ffff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4181015e0 0x7fd41819bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:35000/0 (socket says 172.21.15.115:35000) 2024-09-13T17:10:29.703 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.700+0000 7fd40ffff640 1 -- 172.21.15.115:0/1239097812 learned_addr learned my addr 172.21.15.115:0/1239097812 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:10:29.703 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.700+0000 7fd417fff640 1 --2- 172.21.15.115:0/1239097812 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd418100cc0 0x7fd41819b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:29.703 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.700+0000 7fd40ffff640 1 -- 172.21.15.115:0/1239097812 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd418100cc0 msgr2=0x7fd41819b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:29.703 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.700+0000 7fd40ffff640 1 --2- 172.21.15.115:0/1239097812 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd418100cc0 0x7fd41819b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:29.703 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.700+0000 7fd40ffff640 1 -- 172.21.15.115:0/1239097812 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd400009560 con 0x7fd4181015e0 2024-09-13T17:10:29.704 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.700+0000 7fd40ffff640 1 --2- 172.21.15.115:0/1239097812 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4181015e0 0x7fd41819bcc0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd400009230 tx=0x7fd4000056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:29.704 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.700+0000 7fd415ffb640 1 -- 172.21.15.115:0/1239097812 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd400004b20 con 0x7fd4181015e0 2024-09-13T17:10:29.704 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.700+0000 7fd415ffb640 1 -- 172.21.15.115:0/1239097812 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd400004c80 con 0x7fd4181015e0 2024-09-13T17:10:29.704 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.700+0000 7fd415ffb640 1 -- 172.21.15.115:0/1239097812 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd400031950 con 0x7fd4181015e0 2024-09-13T17:10:29.704 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.700+0000 7fd41e8d7640 1 -- 172.21.15.115:0/1239097812 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd418195af0 con 0x7fd4181015e0 2024-09-13T17:10:29.704 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.700+0000 7fd41e8d7640 1 -- 172.21.15.115:0/1239097812 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd418195fe0 con 0x7fd4181015e0 2024-09-13T17:10:29.705 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.701+0000 7fd41e8d7640 1 -- 172.21.15.115:0/1239097812 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd418068460 con 0x7fd4181015e0 2024-09-13T17:10:29.705 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.702+0000 7fd415ffb640 1 -- 172.21.15.115:0/1239097812 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fd400031b50 con 0x7fd4181015e0 2024-09-13T17:10:29.706 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.702+0000 7fd415ffb640 1 --2- 172.21.15.115:0/1239097812 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fd40406cc50 0x7fd40406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:29.706 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.702+0000 7fd415ffb640 1 -- 172.21.15.115:0/1239097812 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fd4000ad660 con 0x7fd4181015e0 2024-09-13T17:10:29.706 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.702+0000 7fd417fff640 1 --2- 172.21.15.115:0/1239097812 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fd40406cc50 0x7fd40406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:29.706 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.703+0000 7fd417fff640 1 --2- 172.21.15.115:0/1239097812 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fd40406cc50 0x7fd40406f110 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd4080058c0 tx=0x7fd40800a4c0 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:29.707 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.706+0000 7fd415ffb640 1 -- 172.21.15.115:0/1239097812 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd400077780 con 0x7fd4181015e0 2024-09-13T17:10:29.885 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.883+0000 7fd41e8d7640 1 -- 172.21.15.115:0/1239097812 --> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd41810cbf0 con 0x7fd40406cc50 2024-09-13T17:10:29.886 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.885+0000 7fd415ffb640 1 -- 172.21.15.115:0/1239097812 <== mgr.14660 v2:172.21.15.115:6800/1049502673 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fd41810cbf0 con 0x7fd40406cc50 2024-09-13T17:10:29.888 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.887+0000 7fd41e8d7640 1 -- 172.21.15.115:0/1239097812 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fd40406cc50 msgr2=0x7fd40406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:29.888 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.887+0000 7fd41e8d7640 1 --2- 172.21.15.115:0/1239097812 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fd40406cc50 0x7fd40406f110 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd4080058c0 tx=0x7fd40800a4c0 comp rx=0 tx=0).stop 2024-09-13T17:10:29.888 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.887+0000 7fd41e8d7640 1 -- 172.21.15.115:0/1239097812 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4181015e0 msgr2=0x7fd41819bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:29.888 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.887+0000 7fd41e8d7640 1 --2- 172.21.15.115:0/1239097812 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4181015e0 0x7fd41819bcc0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd400009230 tx=0x7fd4000056e0 comp rx=0 tx=0).stop 2024-09-13T17:10:29.888 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.887+0000 7fd41e8d7640 1 -- 172.21.15.115:0/1239097812 shutdown_connections 2024-09-13T17:10:29.888 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.887+0000 7fd41e8d7640 1 --2- 172.21.15.115:0/1239097812 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fd40406cc50 0x7fd40406f110 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:29.888 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.887+0000 7fd41e8d7640 1 --2- 172.21.15.115:0/1239097812 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4181015e0 0x7fd41819bcc0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:29.889 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.887+0000 7fd41e8d7640 1 --2- 172.21.15.115:0/1239097812 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd418100cc0 0x7fd41819b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:29.889 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.887+0000 7fd41e8d7640 1 -- 172.21.15.115:0/1239097812 >> 172.21.15.115:0/1239097812 conn(0x7fd4180758c0 msgr2=0x7fd418101f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:29.889 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.887+0000 7fd41e8d7640 1 -- 172.21.15.115:0/1239097812 shutdown_connections 2024-09-13T17:10:29.889 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.887+0000 7fd41e8d7640 1 -- 172.21.15.115:0/1239097812 wait complete. 2024-09-13T17:10:29.968 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.967+0000 7f91eb0eb640 1 -- 172.21.15.115:0/67113968 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f91e40ffb40 msgr2=0x7f91e40fffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:29.969 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.967+0000 7f91eb0eb640 1 --2- 172.21.15.115:0/67113968 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f91e40ffb40 0x7f91e40fffa0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f91d0009880 tx=0x7f91d002a4a0 comp rx=0 tx=0).stop 2024-09-13T17:10:29.969 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.967+0000 7f91eb0eb640 1 -- 172.21.15.115:0/67113968 shutdown_connections 2024-09-13T17:10:29.969 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.967+0000 7f91eb0eb640 1 --2- 172.21.15.115:0/67113968 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f91e40ffb40 0x7f91e40fffa0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:29.969 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.967+0000 7f91eb0eb640 1 --2- 172.21.15.115:0/67113968 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f91e4105bf0 0x7f91e4105fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:29.969 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.967+0000 7f91eb0eb640 1 -- 172.21.15.115:0/67113968 >> 172.21.15.115:0/67113968 conn(0x7f91e40fb840 msgr2=0x7f91e40fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:29.969 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:29 smithi115 ceph-mon[109488]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/222 objects degraded (2.703%), 2 pgs degraded) 2024-09-13T17:10:29.971 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.967+0000 7f91eb0eb640 1 -- 172.21.15.115:0/67113968 shutdown_connections 2024-09-13T17:10:29.971 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.967+0000 7f91eb0eb640 1 -- 172.21.15.115:0/67113968 wait complete. 2024-09-13T17:10:29.971 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.968+0000 7f91eb0eb640 1 Processor -- start 2024-09-13T17:10:29.971 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.968+0000 7f91eb0eb640 1 -- start start 2024-09-13T17:10:29.971 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.968+0000 7f91eb0eb640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f91e40ffb40 0x7f91e40727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:29.971 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.968+0000 7f91eb0eb640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f91e4105bf0 0x7f91e4072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:29.971 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.968+0000 7f91eb0eb640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e4073230 con 0x7f91e4105bf0 2024-09-13T17:10:29.972 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.968+0000 7f91eb0eb640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e40733a0 con 0x7f91e40ffb40 2024-09-13T17:10:29.972 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.968+0000 7f91e3fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f91e4105bf0 0x7f91e4072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:29.972 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.968+0000 7f91e3fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f91e4105bf0 0x7f91e4072cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:35014/0 (socket says 172.21.15.115:35014) 2024-09-13T17:10:29.972 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.968+0000 7f91e3fff640 1 -- 172.21.15.115:0/4038976979 learned_addr learned my addr 172.21.15.115:0/4038976979 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:10:29.972 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.968+0000 7f91e8e87640 1 --2- 172.21.15.115:0/4038976979 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f91e40ffb40 0x7f91e40727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:29.972 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.968+0000 7f91e3fff640 1 -- 172.21.15.115:0/4038976979 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f91e40ffb40 msgr2=0x7f91e40727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:29.972 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.968+0000 7f91e3fff640 1 --2- 172.21.15.115:0/4038976979 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f91e40ffb40 0x7f91e40727b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:29.972 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.968+0000 7f91e3fff640 1 -- 172.21.15.115:0/4038976979 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91d0009560 con 0x7f91e4105bf0 2024-09-13T17:10:29.972 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.969+0000 7f91e3fff640 1 --2- 172.21.15.115:0/4038976979 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f91e4105bf0 0x7f91e4072cf0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f91d002a9c0 tx=0x7f91d00055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:29.972 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.969+0000 7f91e1ffb640 1 -- 172.21.15.115:0/4038976979 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91d0004b60 con 0x7f91e4105bf0 2024-09-13T17:10:29.972 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.969+0000 7f91e1ffb640 1 -- 172.21.15.115:0/4038976979 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f91d0004cc0 con 0x7f91e4105bf0 2024-09-13T17:10:29.972 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.969+0000 7f91eb0eb640 1 -- 172.21.15.115:0/4038976979 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91e4073620 con 0x7f91e4105bf0 2024-09-13T17:10:29.972 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.969+0000 7f91e1ffb640 1 -- 172.21.15.115:0/4038976979 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91d0031950 con 0x7f91e4105bf0 2024-09-13T17:10:29.973 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.969+0000 7f91eb0eb640 1 -- 172.21.15.115:0/4038976979 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91e41a1e30 con 0x7f91e4105bf0 2024-09-13T17:10:29.973 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.970+0000 7f91eb0eb640 1 -- 172.21.15.115:0/4038976979 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91e41011f0 con 0x7f91e4105bf0 2024-09-13T17:10:29.974 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.971+0000 7f91e1ffb640 1 -- 172.21.15.115:0/4038976979 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f91d0003c20 con 0x7f91e4105bf0 2024-09-13T17:10:29.974 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.971+0000 7f91e1ffb640 1 --2- 172.21.15.115:0/4038976979 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f91d406cc50 0x7f91d406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:29.974 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.972+0000 7f91e1ffb640 1 -- 172.21.15.115:0/4038976979 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f91d00ad3a0 con 0x7f91e4105bf0 2024-09-13T17:10:29.974 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.972+0000 7f91e8e87640 1 --2- 172.21.15.115:0/4038976979 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f91d406cc50 0x7f91d406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:29.974 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.972+0000 7f91e8e87640 1 --2- 172.21.15.115:0/4038976979 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f91d406cc50 0x7f91d406f110 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f91d8005fd0 tx=0x7f91d800b390 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:29.977 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:29.976+0000 7f91e1ffb640 1 -- 172.21.15.115:0/4038976979 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f91d0077570 con 0x7f91e4105bf0 2024-09-13T17:10:30.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:29 smithi195 ceph-mon[80021]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/222 objects degraded (2.703%), 2 pgs degraded) 2024-09-13T17:10:30.148 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.146+0000 7f91eb0eb640 1 -- 172.21.15.115:0/4038976979 --> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f91e4073620 con 0x7f91d406cc50 2024-09-13T17:10:30.157 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.156+0000 7f91e1ffb640 1 -- 172.21.15.115:0/4038976979 <== mgr.14660 v2:172.21.15.115:6800/1049502673 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7f91e4073620 con 0x7f91d406cc50 2024-09-13T17:10:30.157 INFO:teuthology.orchestra.run.smithi115.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T17:10:30.157 INFO:teuthology.orchestra.run.smithi115.stdout:alertmanager.smithi115 smithi115 *:9093,9094 running (2m) 7s ago 12m 25.0M - 0.25.0 c8568f914cd2 d56b91240fe1 2024-09-13T17:10:30.157 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-exporter.smithi115 smithi115 running (12m) 7s ago 12m 8284k - 18.2.4-843-g2c01458a c129f5a2fd4e 0f1eebeaf9bb 2024-09-13T17:10:30.157 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-exporter.smithi195 smithi195 running (11m) 27s ago 11m 7792k - 18.2.4-843-g2c01458a c129f5a2fd4e 6d05bafbac8a 2024-09-13T17:10:30.158 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi115 smithi115 running (35s) 7s ago 12m 6895k - 18.2.4-860-g6c6b083f 8a91f241d7d4 e8175bc055bf 2024-09-13T17:10:30.158 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi195 smithi195 running (31s) 27s ago 11m 6903k - 18.2.4-860-g6c6b083f 8a91f241d7d4 ccb4895be776 2024-09-13T17:10:30.158 INFO:teuthology.orchestra.run.smithi115.stdout:grafana.smithi115 smithi115 *:3000 running (2m) 7s ago 12m 80.4M - 9.4.7 954c08fa6188 e1eccb1a8f3e 2024-09-13T17:10:30.158 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi115.hbtxod smithi115 running (7m) 7s ago 7m 98.8M - 18.2.4-843-g2c01458a c129f5a2fd4e 12b4f4874491 2024-09-13T17:10:30.158 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi115.ijznvr smithi115 running (7m) 7s ago 7m 166M - 18.2.4-843-g2c01458a c129f5a2fd4e 2d552564a9f4 2024-09-13T17:10:30.158 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi195.aevvgz smithi195 running (7m) 27s ago 7m 17.5M - 18.2.4-843-g2c01458a c129f5a2fd4e 299b9ad657c9 2024-09-13T17:10:30.158 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi195.qzghxj smithi195 running (7m) 27s ago 7m 15.5M - 18.2.4-843-g2c01458a c129f5a2fd4e fb16b16181ff 2024-09-13T17:10:30.158 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi115.hetcni smithi115 *:8443,9283,8765 running (4m) 7s ago 13m 492M - 18.2.4-860-g6c6b083f 8a91f241d7d4 b945dbde1934 2024-09-13T17:10:30.158 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi195.hjjifz smithi195 *:8443,9283,8765 running (3m) 27s ago 11m 440M - 18.2.4-860-g6c6b083f 8a91f241d7d4 17bccdfbcae1 2024-09-13T17:10:30.158 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi115 smithi115 running (61s) 7s ago 14m 36.7M 2048M 18.2.4-860-g6c6b083f 8a91f241d7d4 8dd7baf2c6b6 2024-09-13T17:10:30.158 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi195 smithi195 running (46s) 27s ago 11m 26.0M 2048M 18.2.4-860-g6c6b083f 8a91f241d7d4 0459bc5e6b08 2024-09-13T17:10:30.158 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi115 smithi115 *:9100 running (2m) 7s ago 12m 16.9M - 1.5.0 0da6a335fe13 26fb6f9844b5 2024-09-13T17:10:30.158 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi195 smithi195 *:9100 running (2m) 27s ago 11m 16.8M - 1.5.0 0da6a335fe13 6d38e798fb16 2024-09-13T17:10:30.158 INFO:teuthology.orchestra.run.smithi115.stdout:osd.0 smithi115 running (12s) 7s ago 10m 11.2M 1216M 18.2.4-860-g6c6b083f 8a91f241d7d4 3b9f874c64e9 2024-09-13T17:10:30.159 INFO:teuthology.orchestra.run.smithi115.stdout:osd.1 smithi115 running (10m) 7s ago 10m 266M 1216M 18.2.4-843-g2c01458a c129f5a2fd4e 3fbc020102a0 2024-09-13T17:10:30.159 INFO:teuthology.orchestra.run.smithi115.stdout:osd.2 smithi115 running (9m) 7s ago 9m 224M 1216M 18.2.4-843-g2c01458a c129f5a2fd4e 7c623823e920 2024-09-13T17:10:30.159 INFO:teuthology.orchestra.run.smithi115.stdout:osd.3 smithi195 running (9m) 27s ago 9m 294M 2240M 18.2.4-843-g2c01458a c129f5a2fd4e 10ea833fd5c5 2024-09-13T17:10:30.159 INFO:teuthology.orchestra.run.smithi115.stdout:osd.4 smithi195 running (9m) 27s ago 9m 265M 2240M 18.2.4-843-g2c01458a c129f5a2fd4e 4bbc3acb9aff 2024-09-13T17:10:30.159 INFO:teuthology.orchestra.run.smithi115.stdout:osd.5 smithi195 running (8m) 27s ago 8m 237M 2240M 18.2.4-843-g2c01458a c129f5a2fd4e 4bd1b3a232d0 2024-09-13T17:10:30.159 INFO:teuthology.orchestra.run.smithi115.stdout:prometheus.smithi115 smithi115 *:9095 running (2m) 7s ago 12m 63.5M - 2.43.0 a07b618ecd1d e03fb39f6b76 2024-09-13T17:10:30.160 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.158+0000 7f91eb0eb640 1 -- 172.21.15.115:0/4038976979 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f91d406cc50 msgr2=0x7f91d406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:30.160 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.158+0000 7f91eb0eb640 1 --2- 172.21.15.115:0/4038976979 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f91d406cc50 0x7f91d406f110 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f91d8005fd0 tx=0x7f91d800b390 comp rx=0 tx=0).stop 2024-09-13T17:10:30.160 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.158+0000 7f91eb0eb640 1 -- 172.21.15.115:0/4038976979 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f91e4105bf0 msgr2=0x7f91e4072cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:30.160 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.158+0000 7f91eb0eb640 1 --2- 172.21.15.115:0/4038976979 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f91e4105bf0 0x7f91e4072cf0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f91d002a9c0 tx=0x7f91d00055a0 comp rx=0 tx=0).stop 2024-09-13T17:10:30.160 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.158+0000 7f91eb0eb640 1 -- 172.21.15.115:0/4038976979 shutdown_connections 2024-09-13T17:10:30.160 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.158+0000 7f91eb0eb640 1 --2- 172.21.15.115:0/4038976979 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f91d406cc50 0x7f91d406f110 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:30.160 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.158+0000 7f91eb0eb640 1 --2- 172.21.15.115:0/4038976979 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f91e4105bf0 0x7f91e4072cf0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:30.160 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.158+0000 7f91eb0eb640 1 --2- 172.21.15.115:0/4038976979 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f91e40ffb40 0x7f91e40727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:30.160 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.158+0000 7f91eb0eb640 1 -- 172.21.15.115:0/4038976979 >> 172.21.15.115:0/4038976979 conn(0x7f91e40fb840 msgr2=0x7f91e40fd960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:30.160 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.158+0000 7f91eb0eb640 1 -- 172.21.15.115:0/4038976979 shutdown_connections 2024-09-13T17:10:30.160 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.158+0000 7f91eb0eb640 1 -- 172.21.15.115:0/4038976979 wait complete. 2024-09-13T17:10:30.239 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.237+0000 7f35e08fe640 1 -- 172.21.15.115:0/287992133 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f35dc101600 msgr2=0x7f35dc109af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:30.239 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.237+0000 7f35e08fe640 1 --2- 172.21.15.115:0/287992133 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f35dc101600 0x7f35dc109af0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f35d0009880 tx=0x7f35d002a530 comp rx=0 tx=0).stop 2024-09-13T17:10:30.239 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.237+0000 7f35e08fe640 1 -- 172.21.15.115:0/287992133 shutdown_connections 2024-09-13T17:10:30.239 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.237+0000 7f35e08fe640 1 --2- 172.21.15.115:0/287992133 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f35dc101600 0x7f35dc109af0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:30.239 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.237+0000 7f35e08fe640 1 --2- 172.21.15.115:0/287992133 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f35dc100ce0 0x7f35dc1010c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:30.240 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.237+0000 7f35e08fe640 1 -- 172.21.15.115:0/287992133 >> 172.21.15.115:0/287992133 conn(0x7f35dc0fa720 msgr2=0x7f35dc0fcb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:30.240 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.238+0000 7f35e08fe640 1 -- 172.21.15.115:0/287992133 shutdown_connections 2024-09-13T17:10:30.240 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.238+0000 7f35e08fe640 1 -- 172.21.15.115:0/287992133 wait complete. 2024-09-13T17:10:30.242 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.238+0000 7f35e08fe640 1 Processor -- start 2024-09-13T17:10:30.242 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.238+0000 7f35e08fe640 1 -- start start 2024-09-13T17:10:30.242 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.239+0000 7f35e08fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f35dc100ce0 0x7f35dc19b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:30.242 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.239+0000 7f35e08fe640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f35dc101600 0x7f35dc19bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:30.242 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.239+0000 7f35e08fe640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35dc19c320 con 0x7f35dc100ce0 2024-09-13T17:10:30.242 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.239+0000 7f35e08fe640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35dc1958b0 con 0x7f35dc101600 2024-09-13T17:10:30.242 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.239+0000 7f35da59c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f35dc100ce0 0x7f35dc19b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:30.242 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.239+0000 7f35da59c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f35dc100ce0 0x7f35dc19b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:35038/0 (socket says 172.21.15.115:35038) 2024-09-13T17:10:30.243 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.239+0000 7f35da59c640 1 -- 172.21.15.115:0/3483713849 learned_addr learned my addr 172.21.15.115:0/3483713849 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:10:30.243 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.239+0000 7f35d9d9b640 1 --2- 172.21.15.115:0/3483713849 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f35dc101600 0x7f35dc19bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:30.243 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.239+0000 7f35da59c640 1 -- 172.21.15.115:0/3483713849 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f35dc101600 msgr2=0x7f35dc19bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:30.243 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.239+0000 7f35da59c640 1 --2- 172.21.15.115:0/3483713849 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f35dc101600 0x7f35dc19bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:30.243 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.239+0000 7f35da59c640 1 -- 172.21.15.115:0/3483713849 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35d0009560 con 0x7f35dc100ce0 2024-09-13T17:10:30.243 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.239+0000 7f35da59c640 1 --2- 172.21.15.115:0/3483713849 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f35dc100ce0 0x7f35dc19b7c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f35cc00d6f0 tx=0x7f35cc00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:30.243 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.240+0000 7f35cb7fe640 1 -- 172.21.15.115:0/3483713849 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f35cc009a30 con 0x7f35dc100ce0 2024-09-13T17:10:30.243 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.240+0000 7f35cb7fe640 1 -- 172.21.15.115:0/3483713849 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f35cc0054c0 con 0x7f35dc100ce0 2024-09-13T17:10:30.243 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.240+0000 7f35e08fe640 1 -- 172.21.15.115:0/3483713849 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35dc195b90 con 0x7f35dc100ce0 2024-09-13T17:10:30.243 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.240+0000 7f35cb7fe640 1 -- 172.21.15.115:0/3483713849 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f35cc004db0 con 0x7f35dc100ce0 2024-09-13T17:10:30.244 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.240+0000 7f35e08fe640 1 -- 172.21.15.115:0/3483713849 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35dc1960b0 con 0x7f35dc100ce0 2024-09-13T17:10:30.244 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.241+0000 7f35e08fe640 1 -- 172.21.15.115:0/3483713849 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35dc068ce0 con 0x7f35dc100ce0 2024-09-13T17:10:30.244 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.241+0000 7f35cb7fe640 1 -- 172.21.15.115:0/3483713849 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f35cc010460 con 0x7f35dc100ce0 2024-09-13T17:10:30.245 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.242+0000 7f35cb7fe640 1 --2- 172.21.15.115:0/3483713849 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f35c406cc60 0x7f35c406f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:30.245 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.242+0000 7f35cb7fe640 1 -- 172.21.15.115:0/3483713849 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f35cc08bea0 con 0x7f35dc100ce0 2024-09-13T17:10:30.245 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.242+0000 7f35d9d9b640 1 --2- 172.21.15.115:0/3483713849 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f35c406cc60 0x7f35c406f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:30.245 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.242+0000 7f35d9d9b640 1 --2- 172.21.15.115:0/3483713849 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f35c406cc60 0x7f35c406f120 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f35d0000c00 tx=0x7f35d0005a20 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:30.247 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.246+0000 7f35cb7fe640 1 -- 172.21.15.115:0/3483713849 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f35cc056240 con 0x7f35dc100ce0 2024-09-13T17:10:30.473 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.472+0000 7f35e08fe640 1 -- 172.21.15.115:0/3483713849 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f35dc1043b0 con 0x7f35dc100ce0 2024-09-13T17:10:30.473 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.472+0000 7f35cb7fe640 1 -- 172.21.15.115:0/3483713849 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+837 (secure 0 0 0) 0x7f35cc020360 con 0x7f35dc100ce0 2024-09-13T17:10:30.474 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-13T17:10:30.474 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": { 2024-09-13T17:10:30.474 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 2 2024-09-13T17:10:30.474 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T17:10:30.474 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": { 2024-09-13T17:10:30.474 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 2 2024-09-13T17:10:30.474 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T17:10:30.474 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": { 2024-09-13T17:10:30.474 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-843-g2c01458a (2c01458affee2b2435cd231b6e392435c1c21661) reef (stable)": 5, 2024-09-13T17:10:30.475 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 1 2024-09-13T17:10:30.475 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T17:10:30.475 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": { 2024-09-13T17:10:30.475 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-843-g2c01458a (2c01458affee2b2435cd231b6e392435c1c21661) reef (stable)": 4 2024-09-13T17:10:30.475 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T17:10:30.475 INFO:teuthology.orchestra.run.smithi115.stdout: "overall": { 2024-09-13T17:10:30.475 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-843-g2c01458a (2c01458affee2b2435cd231b6e392435c1c21661) reef (stable)": 9, 2024-09-13T17:10:30.475 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 5 2024-09-13T17:10:30.475 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-13T17:10:30.475 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-13T17:10:30.476 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.474+0000 7f35e08fe640 1 -- 172.21.15.115:0/3483713849 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f35c406cc60 msgr2=0x7f35c406f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:30.476 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.474+0000 7f35e08fe640 1 --2- 172.21.15.115:0/3483713849 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f35c406cc60 0x7f35c406f120 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f35d0000c00 tx=0x7f35d0005a20 comp rx=0 tx=0).stop 2024-09-13T17:10:30.476 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.474+0000 7f35e08fe640 1 -- 172.21.15.115:0/3483713849 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f35dc100ce0 msgr2=0x7f35dc19b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:30.476 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.474+0000 7f35e08fe640 1 --2- 172.21.15.115:0/3483713849 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f35dc100ce0 0x7f35dc19b7c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f35cc00d6f0 tx=0x7f35cc00dbb0 comp rx=0 tx=0).stop 2024-09-13T17:10:30.476 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.474+0000 7f35e08fe640 1 -- 172.21.15.115:0/3483713849 shutdown_connections 2024-09-13T17:10:30.477 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.474+0000 7f35e08fe640 1 --2- 172.21.15.115:0/3483713849 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f35c406cc60 0x7f35c406f120 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:30.477 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.474+0000 7f35e08fe640 1 --2- 172.21.15.115:0/3483713849 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f35dc101600 0x7f35dc19bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:30.477 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.474+0000 7f35e08fe640 1 --2- 172.21.15.115:0/3483713849 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f35dc100ce0 0x7f35dc19b7c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:30.477 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.474+0000 7f35e08fe640 1 -- 172.21.15.115:0/3483713849 >> 172.21.15.115:0/3483713849 conn(0x7f35dc0fa720 msgr2=0x7f35dc101fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:30.477 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.474+0000 7f35e08fe640 1 -- 172.21.15.115:0/3483713849 shutdown_connections 2024-09-13T17:10:30.477 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.474+0000 7f35e08fe640 1 -- 172.21.15.115:0/3483713849 wait complete. 2024-09-13T17:10:30.557 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.555+0000 7f4dc2317640 1 -- 172.21.15.115:0/1704236204 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4dbc104b40 msgr2=0x7f4dbc104f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:30.557 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.555+0000 7f4dc2317640 1 --2- 172.21.15.115:0/1704236204 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4dbc104b40 0x7f4dbc104f20 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4dac009880 tx=0x7f4dac02a4a0 comp rx=0 tx=0).stop 2024-09-13T17:10:30.557 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.555+0000 7f4dc2317640 1 -- 172.21.15.115:0/1704236204 shutdown_connections 2024-09-13T17:10:30.557 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.555+0000 7f4dc2317640 1 --2- 172.21.15.115:0/1704236204 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4dbc0fdf60 0x7f4dbc0fe3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:30.557 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.555+0000 7f4dc2317640 1 --2- 172.21.15.115:0/1704236204 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4dbc104b40 0x7f4dbc104f20 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:30.557 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.555+0000 7f4dc2317640 1 -- 172.21.15.115:0/1704236204 >> 172.21.15.115:0/1704236204 conn(0x7f4dbc0f9e70 msgr2=0x7f4dbc0fc290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:30.557 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.555+0000 7f4dc2317640 1 -- 172.21.15.115:0/1704236204 shutdown_connections 2024-09-13T17:10:30.557 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.555+0000 7f4dc2317640 1 -- 172.21.15.115:0/1704236204 wait complete. 2024-09-13T17:10:30.559 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.556+0000 7f4dc2317640 1 Processor -- start 2024-09-13T17:10:30.559 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.556+0000 7f4dc2317640 1 -- start start 2024-09-13T17:10:30.559 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.556+0000 7f4dc2317640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4dbc0fdf60 0x7f4dbc19b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:30.559 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.556+0000 7f4dc2317640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4dbc104b40 0x7f4dbc19bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:30.559 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.556+0000 7f4dc2317640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dbc19c390 con 0x7f4dbc104b40 2024-09-13T17:10:30.559 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.556+0000 7f4dc2317640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dbc195920 con 0x7f4dbc0fdf60 2024-09-13T17:10:30.559 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.557+0000 7f4dbb7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4dbc104b40 0x7f4dbc19bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:30.559 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.557+0000 7f4dbb7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4dbc104b40 0x7f4dbc19bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:35062/0 (socket says 172.21.15.115:35062) 2024-09-13T17:10:30.559 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.557+0000 7f4dbb7fe640 1 -- 172.21.15.115:0/3668335508 learned_addr learned my addr 172.21.15.115:0/3668335508 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:10:30.560 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.557+0000 7f4dbbfff640 1 --2- 172.21.15.115:0/3668335508 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4dbc0fdf60 0x7f4dbc19b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:30.560 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.557+0000 7f4dbb7fe640 1 -- 172.21.15.115:0/3668335508 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4dbc0fdf60 msgr2=0x7f4dbc19b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:30.560 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.557+0000 7f4dbb7fe640 1 --2- 172.21.15.115:0/3668335508 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4dbc0fdf60 0x7f4dbc19b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:30.560 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.557+0000 7f4dbb7fe640 1 -- 172.21.15.115:0/3668335508 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dac009560 con 0x7f4dbc104b40 2024-09-13T17:10:30.560 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.557+0000 7f4dbbfff640 1 --2- 172.21.15.115:0/3668335508 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4dbc0fdf60 0x7f4dbc19b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:10:30.560 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.557+0000 7f4dbb7fe640 1 --2- 172.21.15.115:0/3668335508 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4dbc104b40 0x7f4dbc19bd70 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4db000b420 tx=0x7f4db000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:30.560 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.557+0000 7f4db97fa640 1 -- 172.21.15.115:0/3668335508 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4db0011800 con 0x7f4dbc104b40 2024-09-13T17:10:30.560 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.557+0000 7f4dc2317640 1 -- 172.21.15.115:0/3668335508 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dbc195c00 con 0x7f4dbc104b40 2024-09-13T17:10:30.560 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.557+0000 7f4db97fa640 1 -- 172.21.15.115:0/3668335508 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4db0011e00 con 0x7f4dbc104b40 2024-09-13T17:10:30.560 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.557+0000 7f4db97fa640 1 -- 172.21.15.115:0/3668335508 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4db000f2e0 con 0x7f4dbc104b40 2024-09-13T17:10:30.560 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.557+0000 7f4dc2317640 1 -- 172.21.15.115:0/3668335508 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dbc196150 con 0x7f4dbc104b40 2024-09-13T17:10:30.561 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.558+0000 7f4dc2317640 1 -- 172.21.15.115:0/3668335508 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dbc101280 con 0x7f4dbc104b40 2024-09-13T17:10:30.561 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.559+0000 7f4db97fa640 1 -- 172.21.15.115:0/3668335508 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f4db0010380 con 0x7f4dbc104b40 2024-09-13T17:10:30.561 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.559+0000 7f4db97fa640 1 --2- 172.21.15.115:0/3668335508 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f4da406cc50 0x7f4da406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:30.561 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.559+0000 7f4db97fa640 1 -- 172.21.15.115:0/3668335508 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f4db008beb0 con 0x7f4dbc104b40 2024-09-13T17:10:30.562 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.559+0000 7f4dbbfff640 1 --2- 172.21.15.115:0/3668335508 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f4da406cc50 0x7f4da406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:30.562 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.560+0000 7f4dbbfff640 1 --2- 172.21.15.115:0/3668335508 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f4da406cc50 0x7f4da406f110 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4dac005ab0 tx=0x7f4dac005a20 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:30.564 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.563+0000 7f4db97fa640 1 -- 172.21.15.115:0/3668335508 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f4db0055fd0 con 0x7f4dbc104b40 2024-09-13T17:10:30.761 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.760+0000 7f4dc2317640 1 -- 172.21.15.115:0/3668335508 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f4dbc108080 con 0x7f4dbc104b40 2024-09-13T17:10:30.761 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.760+0000 7f4db97fa640 1 -- 172.21.15.115:0/3668335508 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1874 (secure 0 0 0) 0x7f4db00595f0 con 0x7f4dbc104b40 2024-09-13T17:10:30.762 INFO:teuthology.orchestra.run.smithi115.stdout:e19 2024-09-13T17:10:30.762 INFO:teuthology.orchestra.run.smithi115.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T17:10:30.762 INFO:teuthology.orchestra.run.smithi115.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T17:10:30.762 INFO:teuthology.orchestra.run.smithi115.stdout:legacy client fscid: 1 2024-09-13T17:10:30.762 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:10:30.762 INFO:teuthology.orchestra.run.smithi115.stdout:Filesystem 'cephfs' (1) 2024-09-13T17:10:30.762 INFO:teuthology.orchestra.run.smithi115.stdout:fs_name cephfs 2024-09-13T17:10:30.762 INFO:teuthology.orchestra.run.smithi115.stdout:epoch 19 2024-09-13T17:10:30.762 INFO:teuthology.orchestra.run.smithi115.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T17:10:30.762 INFO:teuthology.orchestra.run.smithi115.stdout:created 2024-09-13T17:03:16.313116+0000 2024-09-13T17:10:30.763 INFO:teuthology.orchestra.run.smithi115.stdout:modified 2024-09-13T17:03:33.410348+0000 2024-09-13T17:10:30.763 INFO:teuthology.orchestra.run.smithi115.stdout:tableserver 0 2024-09-13T17:10:30.763 INFO:teuthology.orchestra.run.smithi115.stdout:root 0 2024-09-13T17:10:30.763 INFO:teuthology.orchestra.run.smithi115.stdout:session_timeout 60 2024-09-13T17:10:30.763 INFO:teuthology.orchestra.run.smithi115.stdout:session_autoclose 300 2024-09-13T17:10:30.763 INFO:teuthology.orchestra.run.smithi115.stdout:max_file_size 1099511627776 2024-09-13T17:10:30.763 INFO:teuthology.orchestra.run.smithi115.stdout:max_xattr_size 65536 2024-09-13T17:10:30.763 INFO:teuthology.orchestra.run.smithi115.stdout:required_client_features {} 2024-09-13T17:10:30.763 INFO:teuthology.orchestra.run.smithi115.stdout:last_failure 0 2024-09-13T17:10:30.763 INFO:teuthology.orchestra.run.smithi115.stdout:last_failure_osd_epoch 46 2024-09-13T17:10:30.763 INFO:teuthology.orchestra.run.smithi115.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T17:10:30.763 INFO:teuthology.orchestra.run.smithi115.stdout:max_mds 1 2024-09-13T17:10:30.763 INFO:teuthology.orchestra.run.smithi115.stdout:in 0 2024-09-13T17:10:30.764 INFO:teuthology.orchestra.run.smithi115.stdout:up {0=14470} 2024-09-13T17:10:30.764 INFO:teuthology.orchestra.run.smithi115.stdout:failed 2024-09-13T17:10:30.764 INFO:teuthology.orchestra.run.smithi115.stdout:damaged 2024-09-13T17:10:30.764 INFO:teuthology.orchestra.run.smithi115.stdout:stopped 2024-09-13T17:10:30.764 INFO:teuthology.orchestra.run.smithi115.stdout:data_pools [3] 2024-09-13T17:10:30.764 INFO:teuthology.orchestra.run.smithi115.stdout:metadata_pool 2 2024-09-13T17:10:30.764 INFO:teuthology.orchestra.run.smithi115.stdout:inline_data enabled 2024-09-13T17:10:30.764 INFO:teuthology.orchestra.run.smithi115.stdout:balancer 2024-09-13T17:10:30.764 INFO:teuthology.orchestra.run.smithi115.stdout:bal_rank_mask -1 2024-09-13T17:10:30.764 INFO:teuthology.orchestra.run.smithi115.stdout:standby_count_wanted 1 2024-09-13T17:10:30.764 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi115.ijznvr{0:14470} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.115:6828/4128583274,v1:172.21.15.115:6829/4128583274] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T17:10:30.764 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi115.hbtxod{0:14486} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.115:6826/1977394649,v1:172.21.15.115:6827/1977394649] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T17:10:30.764 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:10:30.764 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:10:30.765 INFO:teuthology.orchestra.run.smithi115.stdout:Standby daemons: 2024-09-13T17:10:30.765 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:10:30.765 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi195.aevvgz{-1:24253} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.195:6826/8826118,v1:172.21.15.195:6827/8826118] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T17:10:30.765 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi195.qzghxj{-1:24259} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.195:6824/3335357704,v1:172.21.15.195:6825/3335357704] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T17:10:30.766 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 19 2024-09-13T17:10:30.766 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.762+0000 7f4dc2317640 1 -- 172.21.15.115:0/3668335508 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f4da406cc50 msgr2=0x7f4da406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:30.766 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.762+0000 7f4dc2317640 1 --2- 172.21.15.115:0/3668335508 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f4da406cc50 0x7f4da406f110 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4dac005ab0 tx=0x7f4dac005a20 comp rx=0 tx=0).stop 2024-09-13T17:10:30.766 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.762+0000 7f4dc2317640 1 -- 172.21.15.115:0/3668335508 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4dbc104b40 msgr2=0x7f4dbc19bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:30.766 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.762+0000 7f4dc2317640 1 --2- 172.21.15.115:0/3668335508 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4dbc104b40 0x7f4dbc19bd70 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4db000b420 tx=0x7f4db000b8e0 comp rx=0 tx=0).stop 2024-09-13T17:10:30.766 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.762+0000 7f4dc2317640 1 -- 172.21.15.115:0/3668335508 shutdown_connections 2024-09-13T17:10:30.766 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.762+0000 7f4dc2317640 1 --2- 172.21.15.115:0/3668335508 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f4da406cc50 0x7f4da406f110 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:30.766 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.762+0000 7f4dc2317640 1 --2- 172.21.15.115:0/3668335508 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4dbc104b40 0x7f4dbc19bd70 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:30.766 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.762+0000 7f4dc2317640 1 --2- 172.21.15.115:0/3668335508 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4dbc0fdf60 0x7f4dbc19b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:30.766 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.762+0000 7f4dc2317640 1 -- 172.21.15.115:0/3668335508 >> 172.21.15.115:0/3668335508 conn(0x7f4dbc0f9e70 msgr2=0x7f4dbc0fb020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:30.766 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.762+0000 7f4dc2317640 1 -- 172.21.15.115:0/3668335508 shutdown_connections 2024-09-13T17:10:30.767 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.762+0000 7f4dc2317640 1 -- 172.21.15.115:0/3668335508 wait complete. 2024-09-13T17:10:30.845 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.844+0000 7ff768802640 1 -- 172.21.15.115:0/2683613785 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff764100d20 msgr2=0x7ff764101100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:30.846 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.844+0000 7ff768802640 1 --2- 172.21.15.115:0/2683613785 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff764100d20 0x7ff764101100 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff754009880 tx=0x7ff75402a530 comp rx=0 tx=0).stop 2024-09-13T17:10:30.846 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.844+0000 7ff768802640 1 -- 172.21.15.115:0/2683613785 shutdown_connections 2024-09-13T17:10:30.846 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.844+0000 7ff768802640 1 --2- 172.21.15.115:0/2683613785 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff764101640 0x7ff764109b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:30.846 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.844+0000 7ff768802640 1 --2- 172.21.15.115:0/2683613785 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff764100d20 0x7ff764101100 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:30.846 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.844+0000 7ff768802640 1 -- 172.21.15.115:0/2683613785 >> 172.21.15.115:0/2683613785 conn(0x7ff7640758c0 msgr2=0x7ff7640fcc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:30.846 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:30 smithi115 ceph-mon[109488]: pgmap v125: 65 pgs: 25 peering, 40 active+clean; 199 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:10:30.846 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:30 smithi115 ceph-mon[109488]: from='client.34130 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:10:30.846 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:30 smithi115 ceph-mon[109488]: from='client.34134 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:10:30.846 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:30 smithi115 ceph-mon[109488]: from='client.? 172.21.15.115:0/3483713849' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:10:30.848 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.844+0000 7ff768802640 1 -- 172.21.15.115:0/2683613785 shutdown_connections 2024-09-13T17:10:30.848 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.844+0000 7ff768802640 1 -- 172.21.15.115:0/2683613785 wait complete. 2024-09-13T17:10:30.848 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.845+0000 7ff768802640 1 Processor -- start 2024-09-13T17:10:30.848 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.845+0000 7ff768802640 1 -- start start 2024-09-13T17:10:30.848 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.845+0000 7ff768802640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff764100d20 0x7ff7640fe980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:30.849 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.845+0000 7ff768802640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff764101640 0x7ff7640feec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:30.849 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.845+0000 7ff768802640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7640ff400 con 0x7ff764100d20 2024-09-13T17:10:30.849 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.845+0000 7ff768802640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7640ff570 con 0x7ff764101640 2024-09-13T17:10:30.849 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.845+0000 7ff76259c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff764100d20 0x7ff7640fe980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:30.849 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.845+0000 7ff76259c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff764100d20 0x7ff7640fe980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:35082/0 (socket says 172.21.15.115:35082) 2024-09-13T17:10:30.849 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.845+0000 7ff76259c640 1 -- 172.21.15.115:0/704112204 learned_addr learned my addr 172.21.15.115:0/704112204 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:10:30.849 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.845+0000 7ff761d9b640 1 --2- 172.21.15.115:0/704112204 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff764101640 0x7ff7640feec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:30.849 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.845+0000 7ff76259c640 1 -- 172.21.15.115:0/704112204 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff764101640 msgr2=0x7ff7640feec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:30.849 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.845+0000 7ff76259c640 1 --2- 172.21.15.115:0/704112204 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff764101640 0x7ff7640feec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:30.849 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.845+0000 7ff76259c640 1 -- 172.21.15.115:0/704112204 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff754009560 con 0x7ff764100d20 2024-09-13T17:10:30.849 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.846+0000 7ff76259c640 1 --2- 172.21.15.115:0/704112204 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff764100d20 0x7ff7640fe980 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff754006010 tx=0x7ff754004da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:30.849 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.846+0000 7ff7537fe640 1 -- 172.21.15.115:0/704112204 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7540053b0 con 0x7ff764100d20 2024-09-13T17:10:30.849 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.846+0000 7ff7537fe640 1 -- 172.21.15.115:0/704112204 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff754005510 con 0x7ff764100d20 2024-09-13T17:10:30.849 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.846+0000 7ff768802640 1 -- 172.21.15.115:0/704112204 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7640ff7f0 con 0x7ff764100d20 2024-09-13T17:10:30.849 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.846+0000 7ff7537fe640 1 -- 172.21.15.115:0/704112204 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7540319f0 con 0x7ff764100d20 2024-09-13T17:10:30.850 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.846+0000 7ff768802640 1 -- 172.21.15.115:0/704112204 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7641a1e70 con 0x7ff764100d20 2024-09-13T17:10:30.850 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.847+0000 7ff768802640 1 -- 172.21.15.115:0/704112204 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff764068400 con 0x7ff764100d20 2024-09-13T17:10:30.851 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.847+0000 7ff7537fe640 1 -- 172.21.15.115:0/704112204 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7ff75402ad50 con 0x7ff764100d20 2024-09-13T17:10:30.851 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.848+0000 7ff7537fe640 1 --2- 172.21.15.115:0/704112204 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7ff74c06cc50 0x7ff74c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:30.851 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.848+0000 7ff7537fe640 1 -- 172.21.15.115:0/704112204 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6156+0+0 (secure 0 0 0) 0x7ff7540ad1b0 con 0x7ff764100d20 2024-09-13T17:10:30.851 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.848+0000 7ff761d9b640 1 --2- 172.21.15.115:0/704112204 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7ff74c06cc50 0x7ff74c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:30.851 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.848+0000 7ff761d9b640 1 --2- 172.21.15.115:0/704112204 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7ff74c06cc50 0x7ff74c06f110 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff764100100 tx=0x7ff75800a2d0 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:30.853 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:30.852+0000 7ff7537fe640 1 -- 172.21.15.115:0/704112204 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff754077380 con 0x7ff764100d20 2024-09-13T17:10:31.032 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:31.031+0000 7ff768802640 1 -- 172.21.15.115:0/704112204 --> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff7640ff7f0 con 0x7ff74c06cc50 2024-09-13T17:10:31.033 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:31.032+0000 7ff7537fe640 1 -- 172.21.15.115:0/704112204 <== mgr.14660 v2:172.21.15.115:6800/1049502673 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7ff7640ff7f0 con 0x7ff74c06cc50 2024-09-13T17:10:31.033 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-13T17:10:31.033 INFO:teuthology.orchestra.run.smithi115.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256", 2024-09-13T17:10:31.034 INFO:teuthology.orchestra.run.smithi115.stdout: "in_progress": true, 2024-09-13T17:10:31.034 INFO:teuthology.orchestra.run.smithi115.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T17:10:31.034 INFO:teuthology.orchestra.run.smithi115.stdout: "services_complete": [ 2024-09-13T17:10:31.034 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr", 2024-09-13T17:10:31.034 INFO:teuthology.orchestra.run.smithi115.stdout: "mon", 2024-09-13T17:10:31.034 INFO:teuthology.orchestra.run.smithi115.stdout: "crash" 2024-09-13T17:10:31.034 INFO:teuthology.orchestra.run.smithi115.stdout: ], 2024-09-13T17:10:31.034 INFO:teuthology.orchestra.run.smithi115.stdout: "progress": "7/23 daemons upgraded", 2024-09-13T17:10:31.034 INFO:teuthology.orchestra.run.smithi115.stdout: "message": "Currently upgrading osd daemons", 2024-09-13T17:10:31.034 INFO:teuthology.orchestra.run.smithi115.stdout: "is_paused": false 2024-09-13T17:10:31.034 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-13T17:10:31.036 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:31.034+0000 7ff768802640 1 -- 172.21.15.115:0/704112204 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7ff74c06cc50 msgr2=0x7ff74c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:31.036 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:31.034+0000 7ff768802640 1 --2- 172.21.15.115:0/704112204 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7ff74c06cc50 0x7ff74c06f110 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff764100100 tx=0x7ff75800a2d0 comp rx=0 tx=0).stop 2024-09-13T17:10:31.036 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:31.034+0000 7ff768802640 1 -- 172.21.15.115:0/704112204 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff764100d20 msgr2=0x7ff7640fe980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:31.036 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:31.034+0000 7ff768802640 1 --2- 172.21.15.115:0/704112204 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff764100d20 0x7ff7640fe980 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff754006010 tx=0x7ff754004da0 comp rx=0 tx=0).stop 2024-09-13T17:10:31.036 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:31.034+0000 7ff768802640 1 -- 172.21.15.115:0/704112204 shutdown_connections 2024-09-13T17:10:31.036 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:31.034+0000 7ff768802640 1 --2- 172.21.15.115:0/704112204 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7ff74c06cc50 0x7ff74c06f110 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:31.036 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:31.034+0000 7ff768802640 1 --2- 172.21.15.115:0/704112204 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff764101640 0x7ff7640feec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:31.036 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:31.034+0000 7ff768802640 1 --2- 172.21.15.115:0/704112204 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff764100d20 0x7ff7640fe980 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:31.036 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:31.034+0000 7ff768802640 1 -- 172.21.15.115:0/704112204 >> 172.21.15.115:0/704112204 conn(0x7ff7640758c0 msgr2=0x7ff764101fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:31.036 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:31.034+0000 7ff768802640 1 -- 172.21.15.115:0/704112204 shutdown_connections 2024-09-13T17:10:31.036 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:31.034+0000 7ff768802640 1 -- 172.21.15.115:0/704112204 wait complete. 2024-09-13T17:10:31.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:30 smithi195 ceph-mon[80021]: pgmap v125: 65 pgs: 25 peering, 40 active+clean; 199 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:10:31.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:30 smithi195 ceph-mon[80021]: from='client.34130 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:10:31.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:30 smithi195 ceph-mon[80021]: from='client.34134 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:10:31.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:30 smithi195 ceph-mon[80021]: from='client.? 172.21.15.115:0/3483713849' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:10:31.116 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:31.115+0000 7f214a234640 1 -- 172.21.15.115:0/982327313 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21440fe9a0 msgr2=0x7f21440fee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:31.116 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:31.115+0000 7f214a234640 1 --2- 172.21.15.115:0/982327313 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21440fe9a0 0x7f21440fee00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2138009880 tx=0x7f213802a4a0 comp rx=0 tx=0).stop 2024-09-13T17:10:31.117 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:31.115+0000 7f214a234640 1 -- 172.21.15.115:0/982327313 shutdown_connections 2024-09-13T17:10:31.117 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:31.115+0000 7f214a234640 1 --2- 172.21.15.115:0/982327313 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21440fe9a0 0x7f21440fee00 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:31.117 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:31.115+0000 7f214a234640 1 --2- 172.21.15.115:0/982327313 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f21441049a0 0x7f2144104d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:31.117 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:31.115+0000 7f214a234640 1 -- 172.21.15.115:0/982327313 >> 172.21.15.115:0/982327313 conn(0x7f21440758c0 msgr2=0x7f21440fcc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:31.117 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:31.115+0000 7f214a234640 1 -- 172.21.15.115:0/982327313 shutdown_connections 2024-09-13T17:10:31.117 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:31.115+0000 7f214a234640 1 -- 172.21.15.115:0/982327313 wait complete. 2024-09-13T17:10:31.118 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:31.116+0000 7f214a234640 1 Processor -- start 2024-09-13T17:10:31.119 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:31.116+0000 7f214a234640 1 -- start start 2024-09-13T17:10:31.119 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:31.116+0000 7f214a234640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21440fe9a0 0x7f214419b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:31.119 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:31.116+0000 7f214a234640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f21441049a0 0x7f214419bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:31.119 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:31.116+0000 7f214a234640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f214419c2e0 con 0x7f21440fe9a0 2024-09-13T17:10:31.119 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:31.116+0000 7f214a234640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2144195870 con 0x7f21441049a0 2024-09-13T17:10:31.119 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:31.116+0000 7f21437fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21440fe9a0 0x7f214419b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:31.119 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:31.116+0000 7f21437fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21440fe9a0 0x7f214419b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:35100/0 (socket says 172.21.15.115:35100) 2024-09-13T17:10:31.119 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:31.116+0000 7f21437fe640 1 -- 172.21.15.115:0/635566138 learned_addr learned my addr 172.21.15.115:0/635566138 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:10:31.119 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:31.116+0000 7f2142ffd640 1 --2- 172.21.15.115:0/635566138 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f21441049a0 0x7f214419bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:31.119 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:31.117+0000 7f21437fe640 1 -- 172.21.15.115:0/635566138 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f21441049a0 msgr2=0x7f214419bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:31.119 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:31.117+0000 7f21437fe640 1 --2- 172.21.15.115:0/635566138 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f21441049a0 0x7f214419bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:31.119 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:31.117+0000 7f21437fe640 1 -- 172.21.15.115:0/635566138 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2138009560 con 0x7f21440fe9a0 2024-09-13T17:10:31.119 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:31.117+0000 7f21437fe640 1 --2- 172.21.15.115:0/635566138 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21440fe9a0 0x7f214419b780 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f213400d6f0 tx=0x7f213400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:31.120 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:31.117+0000 7f2140ff9640 1 -- 172.21.15.115:0/635566138 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2134009a30 con 0x7f21440fe9a0 2024-09-13T17:10:31.120 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:31.117+0000 7f2140ff9640 1 -- 172.21.15.115:0/635566138 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f21340054c0 con 0x7f21440fe9a0 2024-09-13T17:10:31.120 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:31.117+0000 7f214a234640 1 -- 172.21.15.115:0/635566138 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2144195b50 con 0x7f21440fe9a0 2024-09-13T17:10:31.120 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:31.117+0000 7f2140ff9640 1 -- 172.21.15.115:0/635566138 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2134004db0 con 0x7f21440fe9a0 2024-09-13T17:10:31.120 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:31.117+0000 7f214a234640 1 -- 172.21.15.115:0/635566138 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2144196070 con 0x7f21440fe9a0 2024-09-13T17:10:31.121 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:31.118+0000 7f214a234640 1 -- 172.21.15.115:0/635566138 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21441000e0 con 0x7f21440fe9a0 2024-09-13T17:10:31.121 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:31.118+0000 7f2140ff9640 1 -- 172.21.15.115:0/635566138 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f2134010460 con 0x7f21440fe9a0 2024-09-13T17:10:31.121 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:31.119+0000 7f2140ff9640 1 --2- 172.21.15.115:0/635566138 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f212c06cc50 0x7f212c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:31.121 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:31.119+0000 7f2140ff9640 1 -- 172.21.15.115:0/635566138 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f213408be90 con 0x7f21440fe9a0 2024-09-13T17:10:31.121 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:31.119+0000 7f2142ffd640 1 --2- 172.21.15.115:0/635566138 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f212c06cc50 0x7f212c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:31.121 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:31.120+0000 7f2142ffd640 1 --2- 172.21.15.115:0/635566138 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f212c06cc50 0x7f212c06f110 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2138000c00 tx=0x7f2138005a20 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:31.124 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:31.123+0000 7f2140ff9640 1 -- 172.21.15.115:0/635566138 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f21340560e0 con 0x7f21440fe9a0 2024-09-13T17:10:31.388 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:31.387+0000 7f214a234640 1 -- 172.21.15.115:0/635566138 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f21440fee00 con 0x7f21440fe9a0 2024-09-13T17:10:31.388 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:31.387+0000 7f2140ff9640 1 -- 172.21.15.115:0/635566138 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f2134017090 con 0x7f21440fe9a0 2024-09-13T17:10:31.389 INFO:teuthology.orchestra.run.smithi115.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-13T17:10:31.389 INFO:teuthology.orchestra.run.smithi115.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T17:10:31.389 INFO:teuthology.orchestra.run.smithi115.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T17:10:31.391 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:31.389+0000 7f214a234640 1 -- 172.21.15.115:0/635566138 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f212c06cc50 msgr2=0x7f212c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:31.391 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:31.389+0000 7f214a234640 1 --2- 172.21.15.115:0/635566138 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f212c06cc50 0x7f212c06f110 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2138000c00 tx=0x7f2138005a20 comp rx=0 tx=0).stop 2024-09-13T17:10:31.391 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:31.389+0000 7f214a234640 1 -- 172.21.15.115:0/635566138 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21440fe9a0 msgr2=0x7f214419b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:31.391 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:31.389+0000 7f214a234640 1 --2- 172.21.15.115:0/635566138 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21440fe9a0 0x7f214419b780 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f213400d6f0 tx=0x7f213400dbb0 comp rx=0 tx=0).stop 2024-09-13T17:10:31.391 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:31.389+0000 7f214a234640 1 -- 172.21.15.115:0/635566138 shutdown_connections 2024-09-13T17:10:31.391 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:31.389+0000 7f214a234640 1 --2- 172.21.15.115:0/635566138 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f212c06cc50 0x7f212c06f110 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:31.391 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:31.389+0000 7f214a234640 1 --2- 172.21.15.115:0/635566138 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f21441049a0 0x7f214419bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:31.392 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:31.389+0000 7f214a234640 1 --2- 172.21.15.115:0/635566138 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21440fe9a0 0x7f214419b780 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:31.392 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:31.389+0000 7f214a234640 1 -- 172.21.15.115:0/635566138 >> 172.21.15.115:0/635566138 conn(0x7f21440758c0 msgr2=0x7f21440fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:31.392 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:31.390+0000 7f214a234640 1 -- 172.21.15.115:0/635566138 shutdown_connections 2024-09-13T17:10:31.392 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:10:31.390+0000 7f214a234640 1 -- 172.21.15.115:0/635566138 wait complete. 2024-09-13T17:10:32.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:31 smithi195 ceph-mon[80021]: from='client.34138 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:10:32.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:31 smithi195 ceph-mon[80021]: from='client.? 172.21.15.115:0/3668335508' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T17:10:32.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:31 smithi195 ceph-mon[80021]: from='client.? 172.21.15.115:0/635566138' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T17:10:32.178 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:31 smithi115 ceph-mon[109488]: from='client.34138 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:10:32.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:31 smithi115 ceph-mon[109488]: from='client.? 172.21.15.115:0/3668335508' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T17:10:32.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:31 smithi115 ceph-mon[109488]: from='client.? 172.21.15.115:0/635566138' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T17:10:33.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:32 smithi195 ceph-mon[80021]: from='client.34150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:10:33.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:32 smithi195 ceph-mon[80021]: pgmap v126: 65 pgs: 25 peering, 40 active+clean; 199 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 692 B/s rd, 1 op/s 2024-09-13T17:10:33.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:32 smithi115 ceph-mon[109488]: from='client.34150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:10:33.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:32 smithi115 ceph-mon[109488]: pgmap v126: 65 pgs: 25 peering, 40 active+clean; 199 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 692 B/s rd, 1 op/s 2024-09-13T17:10:34.993 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:34 smithi115 ceph-mon[109488]: pgmap v127: 65 pgs: 65 active+clean; 199 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-13T17:10:35.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:34 smithi195 ceph-mon[80021]: pgmap v127: 65 pgs: 65 active+clean; 199 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-13T17:10:36.879 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:36 smithi195 ceph-mon[80021]: pgmap v128: 65 pgs: 65 active+clean; 199 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 964 B/s rd, 1 op/s 2024-09-13T17:10:36.879 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:36 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:10:36.879 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:36 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:10:36.928 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:36 smithi115 ceph-mon[109488]: pgmap v128: 65 pgs: 65 active+clean; 199 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 964 B/s rd, 1 op/s 2024-09-13T17:10:36.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:36 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:10:36.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:36 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:10:38.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:38 smithi115 ceph-mon[109488]: pgmap v129: 65 pgs: 65 active+clean; 199 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 873 B/s rd, 1 op/s 2024-09-13T17:10:39.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:38 smithi195 ceph-mon[80021]: pgmap v129: 65 pgs: 65 active+clean; 199 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 873 B/s rd, 1 op/s 2024-09-13T17:10:40.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:40 smithi115 ceph-mon[109488]: pgmap v130: 65 pgs: 65 active+clean; 199 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-09-13T17:10:41.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:40 smithi195 ceph-mon[80021]: pgmap v130: 65 pgs: 65 active+clean; 199 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-09-13T17:10:41.928 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:41 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:10:42.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:41 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:10:42.655 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:42 smithi115 ceph-mon[109488]: pgmap v131: 65 pgs: 65 active+clean; 199 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-09-13T17:10:42.655 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:42 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-13T17:10:42.655 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:42 smithi115 ceph-mon[109488]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-13T17:10:42.655 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:42 smithi115 ceph-mon[109488]: Upgrade: osd.1 is safe to restart 2024-09-13T17:10:43.076 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:42 smithi195 ceph-mon[80021]: pgmap v131: 65 pgs: 65 active+clean; 199 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-09-13T17:10:43.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:42 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-13T17:10:43.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:42 smithi195 ceph-mon[80021]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-13T17:10:43.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:42 smithi195 ceph-mon[80021]: Upgrade: osd.1 is safe to restart 2024-09-13T17:10:44.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:44 smithi195 ceph-mon[80021]: Upgrade: Updating osd.1 2024-09-13T17:10:44.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:44 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:10:44.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:44 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-13T17:10:44.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:44 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:10:44.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:44 smithi195 ceph-mon[80021]: Deploying daemon osd.1 on smithi115 2024-09-13T17:10:44.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:44 smithi195 ceph-mon[80021]: pgmap v132: 65 pgs: 65 active+clean; 199 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:10:44.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:44 smithi115 ceph-mon[109488]: Upgrade: Updating osd.1 2024-09-13T17:10:44.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:44 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:10:44.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:44 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-13T17:10:44.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:44 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:10:44.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:44 smithi115 ceph-mon[109488]: Deploying daemon osd.1 on smithi115 2024-09-13T17:10:44.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:44 smithi115 ceph-mon[109488]: pgmap v132: 65 pgs: 65 active+clean; 199 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:10:46.179 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 17:10:45 smithi115 systemd[1]: Stopping Ceph osd.1 for ffbd7588-71f0-11ef-bceb-c7b262605968... 2024-09-13T17:10:46.479 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 17:10:46 smithi115 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-1[53752]: 2024-09-13T17:10:46.184+0000 7fed03919640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T17:10:46.479 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 17:10:46 smithi115 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-1[53752]: 2024-09-13T17:10:46.184+0000 7fed03919640 -1 osd.1 53 *** Got signal Terminated *** 2024-09-13T17:10:46.480 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 17:10:46 smithi115 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-1[53752]: 2024-09-13T17:10:46.184+0000 7fed03919640 -1 osd.1 53 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T17:10:46.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:46 smithi195 ceph-mon[80021]: pgmap v133: 65 pgs: 65 active+clean; 199 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:10:46.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:46 smithi195 ceph-mon[80021]: osd.1 marked itself down and dead 2024-09-13T17:10:46.830 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:46 smithi115 ceph-mon[109488]: pgmap v133: 65 pgs: 65 active+clean; 199 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:10:46.830 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:46 smithi115 ceph-mon[109488]: osd.1 marked itself down and dead 2024-09-13T17:10:47.152 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 17:10:46 smithi115 podman[123710]: 2024-09-13 17:10:46.829608213 +0000 UTC m=+0.741339742 container died 3fbc020102a06b66ed3554817ed2a76456dcf16d022fed81eb9ca88ab0ecd369 (image=quay.ceph.io/ceph-ci/ceph@sha256:c37c250ffe653639d7a4124ac8acdc3c8f6a53cb4ef1f26b1d2df36648631a11, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-1, RELEASE=reef-2c01458, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-13T17:10:47.152 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 17:10:47 smithi115 podman[123710]: 2024-09-13 17:10:47.151689772 +0000 UTC m=+1.063421291 container cleanup 3fbc020102a06b66ed3554817ed2a76456dcf16d022fed81eb9ca88ab0ecd369 (image=quay.ceph.io/ceph-ci/ceph@sha256:c37c250ffe653639d7a4124ac8acdc3c8f6a53cb4ef1f26b1d2df36648631a11, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-1, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=reef-2c01458, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T17:10:47.428 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 17:10:47 smithi115 bash[123710]: ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-1 2024-09-13T17:10:47.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:47 smithi195 ceph-mon[80021]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T17:10:47.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:47 smithi195 ceph-mon[80021]: osdmap e54: 6 total, 5 up, 6 in 2024-09-13T17:10:47.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:47 smithi195 ceph-mon[80021]: osdmap e55: 6 total, 5 up, 6 in 2024-09-13T17:10:47.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:47 smithi115 ceph-mon[109488]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T17:10:47.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:47 smithi115 ceph-mon[109488]: osdmap e54: 6 total, 5 up, 6 in 2024-09-13T17:10:47.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:47 smithi115 ceph-mon[109488]: osdmap e55: 6 total, 5 up, 6 in 2024-09-13T17:10:47.929 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 17:10:47 smithi115 podman[123725]: 2024-09-13 17:10:47.611911005 +0000 UTC m=+0.781172399 container remove 3fbc020102a06b66ed3554817ed2a76456dcf16d022fed81eb9ca88ab0ecd369 (image=quay.ceph.io/ceph-ci/ceph@sha256:c37c250ffe653639d7a4124ac8acdc3c8f6a53cb4ef1f26b1d2df36648631a11, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-1, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=reef-2c01458, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-13T17:10:48.282 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 17:10:48 smithi115 podman[123812]: 2024-09-13 17:10:47.909742789 +0000 UTC m=+0.016052051 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T17:10:48.282 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 17:10:48 smithi115 podman[123812]: 2024-09-13 17:10:48.038095483 +0000 UTC m=+0.144404745 container create 5f4df48b44b82b45be9b5f73887699a6182cac211211fa52cf00ec64587e4e53 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-13T17:10:48.283 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 17:10:48 smithi115 podman[123812]: 2024-09-13 17:10:48.28202832 +0000 UTC m=+0.388337583 container init 5f4df48b44b82b45be9b5f73887699a6182cac211211fa52cf00ec64587e4e53 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-1-deactivate, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T17:10:48.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:48 smithi115 ceph-mon[109488]: pgmap v135: 65 pgs: 7 peering, 9 stale+active+clean, 49 active+clean; 199 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-13T17:10:48.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:48 smithi115 ceph-mon[109488]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-09-13T17:10:48.679 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 17:10:48 smithi115 podman[123812]: 2024-09-13 17:10:48.286095013 +0000 UTC m=+0.392404279 container start 5f4df48b44b82b45be9b5f73887699a6182cac211211fa52cf00ec64587e4e53 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS) 2024-09-13T17:10:48.679 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 17:10:48 smithi115 podman[123812]: 2024-09-13 17:10:48.381867955 +0000 UTC m=+0.488177224 container attach 5f4df48b44b82b45be9b5f73887699a6182cac211211fa52cf00ec64587e4e53 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-13T17:10:48.679 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 17:10:48 smithi115 podman[123812]: 2024-09-13 17:10:48.47116259 +0000 UTC m=+0.577471860 container died 5f4df48b44b82b45be9b5f73887699a6182cac211211fa52cf00ec64587e4e53 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-1-deactivate, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-13T17:10:48.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:48 smithi195 ceph-mon[80021]: pgmap v135: 65 pgs: 7 peering, 9 stale+active+clean, 49 active+clean; 199 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-13T17:10:48.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:48 smithi195 ceph-mon[80021]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-09-13T17:10:49.540 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 17:10:49 smithi115 podman[123835]: 2024-09-13 17:10:49.202699274 +0000 UTC m=+0.725685443 container remove 5f4df48b44b82b45be9b5f73887699a6182cac211211fa52cf00ec64587e4e53 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0) 2024-09-13T17:10:49.540 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 17:10:49 smithi115 systemd[1]: ceph-ffbd7588-71f0-11ef-bceb-c7b262605968@osd.1.service: Deactivated successfully. 2024-09-13T17:10:49.540 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 17:10:49 smithi115 systemd[1]: Stopped Ceph osd.1 for ffbd7588-71f0-11ef-bceb-c7b262605968. 2024-09-13T17:10:49.540 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 17:10:49 smithi115 systemd[1]: ceph-ffbd7588-71f0-11ef-bceb-c7b262605968@osd.1.service: Consumed 1min 5.323s CPU time. 2024-09-13T17:10:49.540 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 17:10:49 smithi115 systemd[1]: Starting Ceph osd.1 for ffbd7588-71f0-11ef-bceb-c7b262605968... 2024-09-13T17:10:49.793 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:49 smithi115 ceph-mon[109488]: Health check failed: Degraded data redundancy: 2/222 objects degraded (0.901%), 2 pgs degraded (PG_DEGRADED) 2024-09-13T17:10:49.794 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 17:10:49 smithi115 podman[123935]: 2024-09-13 17:10:49.645637082 +0000 UTC m=+0.113624616 container create f070589dac26c6e52fe67d97eef30278ec17062bade4839f74f90a298cd0cf1d (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-1-activate, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_BRANCH=HEAD) 2024-09-13T17:10:49.794 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 17:10:49 smithi115 podman[123935]: 2024-09-13 17:10:49.549429349 +0000 UTC m=+0.017416880 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T17:10:49.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:49 smithi195 ceph-mon[80021]: Health check failed: Degraded data redundancy: 2/222 objects degraded (0.901%), 2 pgs degraded (PG_DEGRADED) 2024-09-13T17:10:50.179 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 17:10:49 smithi115 podman[123935]: 2024-09-13 17:10:49.906387554 +0000 UTC m=+0.374375085 container init f070589dac26c6e52fe67d97eef30278ec17062bade4839f74f90a298cd0cf1d (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-1-activate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, CEPH_POINT_RELEASE=) 2024-09-13T17:10:50.179 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 17:10:49 smithi115 podman[123935]: 2024-09-13 17:10:49.909774553 +0000 UTC m=+0.377762092 container start f070589dac26c6e52fe67d97eef30278ec17062bade4839f74f90a298cd0cf1d (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-1-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-13T17:10:50.179 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 17:10:49 smithi115 podman[123935]: 2024-09-13 17:10:49.989641241 +0000 UTC m=+0.457628785 container attach f070589dac26c6e52fe67d97eef30278ec17062bade4839f74f90a298cd0cf1d (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-1-activate, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-13T17:10:50.540 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 17:10:50 smithi115 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-1-activate[123949]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-13T17:10:50.540 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 17:10:50 smithi115 bash[123935]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-13T17:10:50.541 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 17:10:50 smithi115 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-1-activate[123949]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-13T17:10:50.541 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 17:10:50 smithi115 bash[123935]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-13T17:10:50.541 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 17:10:50 smithi115 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-1-activate[123949]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-13T17:10:50.541 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 17:10:50 smithi115 bash[123935]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-13T17:10:50.541 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 17:10:50 smithi115 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-1-activate[123949]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-13T17:10:50.541 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 17:10:50 smithi115 bash[123935]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-13T17:10:50.541 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 17:10:50 smithi115 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-1-activate[123949]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-13T17:10:50.541 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 17:10:50 smithi115 bash[123935]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-13T17:10:50.541 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 17:10:50 smithi115 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-1-activate[123949]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-13T17:10:50.541 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 17:10:50 smithi115 bash[123935]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-13T17:10:50.541 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 17:10:50 smithi115 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-1-activate[123949]: --> ceph-volume raw activate successful for osd ID: 1 2024-09-13T17:10:50.541 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 17:10:50 smithi115 bash[123935]: --> ceph-volume raw activate successful for osd ID: 1 2024-09-13T17:10:50.542 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 17:10:50 smithi115 podman[123935]: 2024-09-13 17:10:50.254989051 +0000 UTC m=+0.722976587 container died f070589dac26c6e52fe67d97eef30278ec17062bade4839f74f90a298cd0cf1d (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-1-activate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-13T17:10:50.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:50 smithi195 ceph-mon[80021]: pgmap v137: 65 pgs: 3 active+undersized, 7 peering, 6 stale+active+clean, 2 active+undersized+degraded, 47 active+clean; 199 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 2/222 objects degraded (0.901%) 2024-09-13T17:10:50.902 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:50 smithi115 ceph-mon[109488]: pgmap v137: 65 pgs: 3 active+undersized, 7 peering, 6 stale+active+clean, 2 active+undersized+degraded, 47 active+clean; 199 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 2/222 objects degraded (0.901%) 2024-09-13T17:10:51.179 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 17:10:50 smithi115 podman[124085]: 2024-09-13 17:10:50.902233064 +0000 UTC m=+0.637326697 container remove f070589dac26c6e52fe67d97eef30278ec17062bade4839f74f90a298cd0cf1d (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-1-activate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T17:10:51.179 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 17:10:51 smithi115 podman[124150]: 2024-09-13 17:10:51.094810415 +0000 UTC m=+0.101141412 container create f0de6684601cfca0f7e33b1dc7176aca4f2225c0acc5c996bd14197ec846138f (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-1, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-13T17:10:51.179 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 17:10:51 smithi115 podman[124150]: 2024-09-13 17:10:51.009134927 +0000 UTC m=+0.015465937 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T17:10:51.601 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 17:10:51 smithi115 podman[124150]: 2024-09-13 17:10:51.338588711 +0000 UTC m=+0.344919712 container init f0de6684601cfca0f7e33b1dc7176aca4f2225c0acc5c996bd14197ec846138f (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-1, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083) 2024-09-13T17:10:51.601 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 17:10:51 smithi115 podman[124150]: 2024-09-13 17:10:51.341762285 +0000 UTC m=+0.348093284 container start f0de6684601cfca0f7e33b1dc7176aca4f2225c0acc5c996bd14197ec846138f (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083) 2024-09-13T17:10:51.601 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 17:10:51 smithi115 ceph-osd[124169]: -- 172.21.15.115:0/2740615317 <== mon.0 v2:172.21.15.115:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55ee5b48d1e0 con 0x55ee5b42bc00 2024-09-13T17:10:51.601 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 17:10:51 smithi115 bash[124150]: f0de6684601cfca0f7e33b1dc7176aca4f2225c0acc5c996bd14197ec846138f 2024-09-13T17:10:51.601 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 17:10:51 smithi115 systemd[1]: Started Ceph osd.1 for ffbd7588-71f0-11ef-bceb-c7b262605968. 2024-09-13T17:10:51.884 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:51 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:10:51.884 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:51 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:10:51.884 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:51 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:10:51.884 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:51 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:10:51.884 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:51 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:10:52.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:51 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:10:52.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:51 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:10:52.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:51 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:10:52.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:51 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:10:52.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:51 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:10:52.179 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 17:10:51 smithi115 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-1[124165]: 2024-09-13T17:10:51.882+0000 7f77478f8640 -1 Falling back to public interface 2024-09-13T17:10:52.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:52 smithi115 ceph-mon[109488]: pgmap v138: 65 pgs: 3 active+undersized, 7 peering, 6 stale+active+clean, 2 active+undersized+degraded, 47 active+clean; 199 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 2/222 objects degraded (0.901%) 2024-09-13T17:10:53.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:52 smithi195 ceph-mon[80021]: pgmap v138: 65 pgs: 3 active+undersized, 7 peering, 6 stale+active+clean, 2 active+undersized+degraded, 47 active+clean; 199 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 2/222 objects degraded (0.901%) 2024-09-13T17:10:53.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:53 smithi115 ceph-mon[109488]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-09-13T17:10:54.044 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:53 smithi195 ceph-mon[80021]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-09-13T17:10:54.928 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:54 smithi115 ceph-mon[109488]: pgmap v139: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 199 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 32/222 objects degraded (14.414%) 2024-09-13T17:10:55.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:54 smithi195 ceph-mon[80021]: pgmap v139: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 199 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 32/222 objects degraded (14.414%) 2024-09-13T17:10:56.928 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:56 smithi115 ceph-mon[109488]: pgmap v140: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 199 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 1 op/s; 32/222 objects degraded (14.414%) 2024-09-13T17:10:56.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:56 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:10:56.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:56 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:10:57.076 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:56 smithi195 ceph-mon[80021]: pgmap v140: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 199 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 1 op/s; 32/222 objects degraded (14.414%) 2024-09-13T17:10:57.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:56 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:10:57.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:56 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:10:57.428 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 17:10:56 smithi115 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-1[124165]: 2024-09-13T17:10:56.983+0000 7f77478f8640 -1 osd.1 53 log_to_monitors true 2024-09-13T17:10:57.790 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 17:10:57 smithi115 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-1[124165]: 2024-09-13T17:10:57.676+0000 7f773f691640 -1 osd.1 53 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T17:10:57.791 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:57 smithi115 ceph-mon[109488]: from='osd.1 [v2:172.21.15.115:6810/698342085,v1:172.21.15.115:6811/698342085]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-13T17:10:57.791 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:57 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:10:57.791 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:57 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:10:58.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:57 smithi195 ceph-mon[80021]: from='osd.1 [v2:172.21.15.115:6810/698342085,v1:172.21.15.115:6811/698342085]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-13T17:10:58.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:57 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:10:58.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:57 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:10:58.870 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:58 smithi115 ceph-mon[109488]: pgmap v141: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 199 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 32/222 objects degraded (14.414%) 2024-09-13T17:10:58.871 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:58 smithi115 ceph-mon[109488]: from='osd.1 [v2:172.21.15.115:6810/698342085,v1:172.21.15.115:6811/698342085]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-13T17:10:58.871 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:58 smithi115 ceph-mon[109488]: osdmap e56: 6 total, 5 up, 6 in 2024-09-13T17:10:58.871 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:58 smithi115 ceph-mon[109488]: from='osd.1 [v2:172.21.15.115:6810/698342085,v1:172.21.15.115:6811/698342085]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-13T17:10:59.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:58 smithi195 ceph-mon[80021]: pgmap v141: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 199 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 32/222 objects degraded (14.414%) 2024-09-13T17:10:59.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:58 smithi195 ceph-mon[80021]: from='osd.1 [v2:172.21.15.115:6810/698342085,v1:172.21.15.115:6811/698342085]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-13T17:10:59.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:58 smithi195 ceph-mon[80021]: osdmap e56: 6 total, 5 up, 6 in 2024-09-13T17:10:59.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:58 smithi195 ceph-mon[80021]: from='osd.1 [v2:172.21.15.115:6810/698342085,v1:172.21.15.115:6811/698342085]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-13T17:11:00.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:59 smithi195 ceph-mon[80021]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T17:11:00.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:59 smithi195 ceph-mon[80021]: osd.1 [v2:172.21.15.115:6810/698342085,v1:172.21.15.115:6811/698342085] boot 2024-09-13T17:11:00.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:59 smithi195 ceph-mon[80021]: osdmap e57: 6 total, 6 up, 6 in 2024-09-13T17:11:00.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:59 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T17:11:00.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:59 smithi195 ceph-mon[80021]: Health check update: Degraded data redundancy: 32/222 objects degraded (14.414%), 13 pgs degraded (PG_DEGRADED) 2024-09-13T17:11:00.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:10:59 smithi195 ceph-mon[80021]: osdmap e58: 6 total, 6 up, 6 in 2024-09-13T17:11:00.161 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:59 smithi115 ceph-mon[109488]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T17:11:00.161 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:59 smithi115 ceph-mon[109488]: osd.1 [v2:172.21.15.115:6810/698342085,v1:172.21.15.115:6811/698342085] boot 2024-09-13T17:11:00.161 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:59 smithi115 ceph-mon[109488]: osdmap e57: 6 total, 6 up, 6 in 2024-09-13T17:11:00.162 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:59 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T17:11:00.162 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:59 smithi115 ceph-mon[109488]: Health check update: Degraded data redundancy: 32/222 objects degraded (14.414%), 13 pgs degraded (PG_DEGRADED) 2024-09-13T17:11:00.162 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:10:59 smithi115 ceph-mon[109488]: osdmap e58: 6 total, 6 up, 6 in 2024-09-13T17:11:00.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:00 smithi115 ceph-mon[109488]: pgmap v144: 65 pgs: 2 peering, 19 active+undersized, 13 active+undersized+degraded, 31 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 32/222 objects degraded (14.414%) 2024-09-13T17:11:00.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:00 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:11:00.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:00 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:11:00.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:00 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:11:00.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:00 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:11:00.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:00 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:11:00.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:00 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:11:00.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:00 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:11:00.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:00 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:11:00.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:00 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:11:00.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:00 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-13T17:11:01.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:00 smithi195 ceph-mon[80021]: pgmap v144: 65 pgs: 2 peering, 19 active+undersized, 13 active+undersized+degraded, 31 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 32/222 objects degraded (14.414%) 2024-09-13T17:11:01.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:00 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:11:01.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:00 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:11:01.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:00 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:11:01.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:00 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:11:01.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:00 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:11:01.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:00 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:11:01.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:00 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:11:01.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:00 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:11:01.079 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:00 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:11:01.079 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:00 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-13T17:11:01.481 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.479+0000 7f52b4843640 1 -- 172.21.15.115:0/910478229 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f52b00fe2f0 msgr2=0x7f52b00fe6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:01.482 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.479+0000 7f52b4843640 1 --2- 172.21.15.115:0/910478229 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f52b00fe2f0 0x7f52b00fe6d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f52a0009880 tx=0x7f52a002a4a0 comp rx=0 tx=0).stop 2024-09-13T17:11:01.482 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.479+0000 7f52b4843640 1 -- 172.21.15.115:0/910478229 shutdown_connections 2024-09-13T17:11:01.482 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.479+0000 7f52b4843640 1 --2- 172.21.15.115:0/910478229 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f52b00feca0 0x7f52b0104840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:01.482 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.479+0000 7f52b4843640 1 --2- 172.21.15.115:0/910478229 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f52b00fe2f0 0x7f52b00fe6d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:01.482 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.479+0000 7f52b4843640 1 -- 172.21.15.115:0/910478229 >> 172.21.15.115:0/910478229 conn(0x7f52b00f9ec0 msgr2=0x7f52b00fc2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:01.482 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.479+0000 7f52b4843640 1 -- 172.21.15.115:0/910478229 shutdown_connections 2024-09-13T17:11:01.482 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.479+0000 7f52b4843640 1 -- 172.21.15.115:0/910478229 wait complete. 2024-09-13T17:11:01.482 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.479+0000 7f52b4843640 1 Processor -- start 2024-09-13T17:11:01.482 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.480+0000 7f52b4843640 1 -- start start 2024-09-13T17:11:01.484 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.480+0000 7f52b4843640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f52b00fe2f0 0x7f52b00ff270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:01.484 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.480+0000 7f52b4843640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f52b00feca0 0x7f52b00ff7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:01.484 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.480+0000 7f52b4843640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52b00ffcf0 con 0x7f52b00fe2f0 2024-09-13T17:11:01.484 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.480+0000 7f52b4843640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52b00ffe60 con 0x7f52b00feca0 2024-09-13T17:11:01.484 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.480+0000 7f52ae59c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f52b00fe2f0 0x7f52b00ff270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:01.484 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.480+0000 7f52ae59c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f52b00fe2f0 0x7f52b00ff270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:44994/0 (socket says 172.21.15.115:44994) 2024-09-13T17:11:01.484 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.480+0000 7f52ae59c640 1 -- 172.21.15.115:0/3811054074 learned_addr learned my addr 172.21.15.115:0/3811054074 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:11:01.484 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.480+0000 7f52add9b640 1 --2- 172.21.15.115:0/3811054074 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f52b00feca0 0x7f52b00ff7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:01.484 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.480+0000 7f52ae59c640 1 -- 172.21.15.115:0/3811054074 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f52b00feca0 msgr2=0x7f52b00ff7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:01.485 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.480+0000 7f52ae59c640 1 --2- 172.21.15.115:0/3811054074 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f52b00feca0 0x7f52b00ff7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:01.485 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.480+0000 7f52ae59c640 1 -- 172.21.15.115:0/3811054074 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52a0009560 con 0x7f52b00fe2f0 2024-09-13T17:11:01.485 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.481+0000 7f52ae59c640 1 --2- 172.21.15.115:0/3811054074 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f52b00fe2f0 0x7f52b00ff270 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f52a0006010 tx=0x7f52a00056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:01.485 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.481+0000 7f529f7fe640 1 -- 172.21.15.115:0/3811054074 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f52a0004ba0 con 0x7f52b00fe2f0 2024-09-13T17:11:01.485 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.481+0000 7f529f7fe640 1 -- 172.21.15.115:0/3811054074 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f52a0005d50 con 0x7f52b00fe2f0 2024-09-13T17:11:01.485 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.481+0000 7f52b4843640 1 -- 172.21.15.115:0/3811054074 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52b01000e0 con 0x7f52b00fe2f0 2024-09-13T17:11:01.485 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.481+0000 7f529f7fe640 1 -- 172.21.15.115:0/3811054074 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f52a00318b0 con 0x7f52b00fe2f0 2024-09-13T17:11:01.485 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.481+0000 7f52b4843640 1 -- 172.21.15.115:0/3811054074 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52b01a1fb0 con 0x7f52b00fe2f0 2024-09-13T17:11:01.485 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.482+0000 7f52b4843640 1 -- 172.21.15.115:0/3811054074 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52b00fe6d0 con 0x7f52b00fe2f0 2024-09-13T17:11:01.486 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.482+0000 7f529f7fe640 1 -- 172.21.15.115:0/3811054074 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f52a0003b90 con 0x7f52b00fe2f0 2024-09-13T17:11:01.486 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.483+0000 7f529f7fe640 1 --2- 172.21.15.115:0/3811054074 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f529806cc50 0x7f529806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:01.486 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.483+0000 7f529f7fe640 1 -- 172.21.15.115:0/3811054074 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f52a00ad440 con 0x7f52b00fe2f0 2024-09-13T17:11:01.486 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.483+0000 7f52add9b640 1 --2- 172.21.15.115:0/3811054074 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f529806cc50 0x7f529806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:01.486 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.483+0000 7f52add9b640 1 --2- 172.21.15.115:0/3811054074 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f529806cc50 0x7f529806f110 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f52b01009f0 tx=0x7f52a4009110 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:01.489 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.487+0000 7f529f7fe640 1 -- 172.21.15.115:0/3811054074 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f52a0077560 con 0x7f52b00fe2f0 2024-09-13T17:11:01.665 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.663+0000 7f52b4843640 1 -- 172.21.15.115:0/3811054074 --> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f52b01000e0 con 0x7f529806cc50 2024-09-13T17:11:01.666 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.664+0000 7f529f7fe640 1 -- 172.21.15.115:0/3811054074 <== mgr.14660 v2:172.21.15.115:6800/1049502673 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f52b01000e0 con 0x7f529806cc50 2024-09-13T17:11:01.668 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.666+0000 7f52b4843640 1 -- 172.21.15.115:0/3811054074 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f529806cc50 msgr2=0x7f529806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:01.669 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.666+0000 7f52b4843640 1 --2- 172.21.15.115:0/3811054074 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f529806cc50 0x7f529806f110 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f52b01009f0 tx=0x7f52a4009110 comp rx=0 tx=0).stop 2024-09-13T17:11:01.669 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.666+0000 7f52b4843640 1 -- 172.21.15.115:0/3811054074 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f52b00fe2f0 msgr2=0x7f52b00ff270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:01.669 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.666+0000 7f52b4843640 1 --2- 172.21.15.115:0/3811054074 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f52b00fe2f0 0x7f52b00ff270 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f52a0006010 tx=0x7f52a00056e0 comp rx=0 tx=0).stop 2024-09-13T17:11:01.669 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.666+0000 7f52b4843640 1 -- 172.21.15.115:0/3811054074 shutdown_connections 2024-09-13T17:11:01.669 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.666+0000 7f52b4843640 1 --2- 172.21.15.115:0/3811054074 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f529806cc50 0x7f529806f110 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:01.669 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.666+0000 7f52b4843640 1 --2- 172.21.15.115:0/3811054074 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f52b00feca0 0x7f52b00ff7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:01.669 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.666+0000 7f52b4843640 1 --2- 172.21.15.115:0/3811054074 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f52b00fe2f0 0x7f52b00ff270 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:01.669 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.666+0000 7f52b4843640 1 -- 172.21.15.115:0/3811054074 >> 172.21.15.115:0/3811054074 conn(0x7f52b00f9ec0 msgr2=0x7f52b00fb1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:01.669 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.666+0000 7f52b4843640 1 -- 172.21.15.115:0/3811054074 shutdown_connections 2024-09-13T17:11:01.669 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.666+0000 7f52b4843640 1 -- 172.21.15.115:0/3811054074 wait complete. 2024-09-13T17:11:01.677 INFO:teuthology.orchestra.run.smithi115.stdout:true 2024-09-13T17:11:01.752 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.749+0000 7fd39430e640 1 -- 172.21.15.115:0/2778471284 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd38c0fe9a0 msgr2=0x7fd38c0fee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:01.752 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.749+0000 7fd39430e640 1 --2- 172.21.15.115:0/2778471284 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd38c0fe9a0 0x7fd38c0fee00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd37c009880 tx=0x7fd37c02a4a0 comp rx=0 tx=0).stop 2024-09-13T17:11:01.752 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.750+0000 7fd39430e640 1 -- 172.21.15.115:0/2778471284 shutdown_connections 2024-09-13T17:11:01.753 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.750+0000 7fd39430e640 1 --2- 172.21.15.115:0/2778471284 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd38c0fe9a0 0x7fd38c0fee00 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:01.753 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.750+0000 7fd39430e640 1 --2- 172.21.15.115:0/2778471284 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd38c1049a0 0x7fd38c104d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:01.753 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.750+0000 7fd39430e640 1 -- 172.21.15.115:0/2778471284 >> 172.21.15.115:0/2778471284 conn(0x7fd38c0758c0 msgr2=0x7fd38c0fcc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:01.753 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:01 smithi115 ceph-mon[109488]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-13T17:11:01.753 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:01 smithi115 ceph-mon[109488]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-09-13T17:11:01.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.750+0000 7fd39430e640 1 -- 172.21.15.115:0/2778471284 shutdown_connections 2024-09-13T17:11:01.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.750+0000 7fd39430e640 1 -- 172.21.15.115:0/2778471284 wait complete. 2024-09-13T17:11:01.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.750+0000 7fd39430e640 1 Processor -- start 2024-09-13T17:11:01.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.750+0000 7fd39430e640 1 -- start start 2024-09-13T17:11:01.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.751+0000 7fd39430e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd38c0fe9a0 0x7fd38c1968f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:01.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.751+0000 7fd39430e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd38c1049a0 0x7fd38c196e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:01.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.751+0000 7fd39430e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd38c197450 con 0x7fd38c1049a0 2024-09-13T17:11:01.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.751+0000 7fd39430e640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd38c197590 con 0x7fd38c0fe9a0 2024-09-13T17:11:01.757 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.751+0000 7fd3918a9640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd38c1049a0 0x7fd38c196e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:01.757 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.751+0000 7fd3918a9640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd38c1049a0 0x7fd38c196e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:45008/0 (socket says 172.21.15.115:45008) 2024-09-13T17:11:01.757 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.751+0000 7fd3918a9640 1 -- 172.21.15.115:0/382237411 learned_addr learned my addr 172.21.15.115:0/382237411 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:11:01.757 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.751+0000 7fd3920aa640 1 --2- 172.21.15.115:0/382237411 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd38c0fe9a0 0x7fd38c1968f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:01.757 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.751+0000 7fd3918a9640 1 -- 172.21.15.115:0/382237411 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd38c0fe9a0 msgr2=0x7fd38c1968f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:01.757 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.751+0000 7fd3918a9640 1 --2- 172.21.15.115:0/382237411 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd38c0fe9a0 0x7fd38c1968f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:01.758 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.751+0000 7fd3918a9640 1 -- 172.21.15.115:0/382237411 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd37c009560 con 0x7fd38c1049a0 2024-09-13T17:11:01.758 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.751+0000 7fd3918a9640 1 --2- 172.21.15.115:0/382237411 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd38c1049a0 0x7fd38c196e30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd37c006010 tx=0x7fd37c0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:01.758 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.751+0000 7fd3837fe640 1 -- 172.21.15.115:0/382237411 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd37c004aa0 con 0x7fd38c1049a0 2024-09-13T17:11:01.758 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.752+0000 7fd3837fe640 1 -- 172.21.15.115:0/382237411 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd37c005d50 con 0x7fd38c1049a0 2024-09-13T17:11:01.758 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.752+0000 7fd39430e640 1 -- 172.21.15.115:0/382237411 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd38c19f960 con 0x7fd38c1049a0 2024-09-13T17:11:01.758 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.752+0000 7fd3837fe640 1 -- 172.21.15.115:0/382237411 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd37c031860 con 0x7fd38c1049a0 2024-09-13T17:11:01.759 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.752+0000 7fd39430e640 1 -- 172.21.15.115:0/382237411 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd38c19fd70 con 0x7fd38c1049a0 2024-09-13T17:11:01.759 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.753+0000 7fd39430e640 1 -- 172.21.15.115:0/382237411 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd38c1000e0 con 0x7fd38c1049a0 2024-09-13T17:11:01.759 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.753+0000 7fd3837fe640 1 -- 172.21.15.115:0/382237411 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fd37c004c00 con 0x7fd38c1049a0 2024-09-13T17:11:01.759 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.753+0000 7fd3837fe640 1 --2- 172.21.15.115:0/382237411 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fd37806cc50 0x7fd37806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:01.759 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.754+0000 7fd3920aa640 1 --2- 172.21.15.115:0/382237411 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fd37806cc50 0x7fd37806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:01.759 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.754+0000 7fd3837fe640 1 -- 172.21.15.115:0/382237411 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fd37c0ad420 con 0x7fd38c1049a0 2024-09-13T17:11:01.760 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.754+0000 7fd3920aa640 1 --2- 172.21.15.115:0/382237411 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fd37806cc50 0x7fd37806f110 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd388005fd0 tx=0x7fd388009500 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:01.760 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.758+0000 7fd3837fe640 1 -- 172.21.15.115:0/382237411 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd37c0775c0 con 0x7fd38c1049a0 2024-09-13T17:11:01.947 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.945+0000 7fd39430e640 1 -- 172.21.15.115:0/382237411 --> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd38c10baf0 con 0x7fd37806cc50 2024-09-13T17:11:01.948 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.946+0000 7fd3837fe640 1 -- 172.21.15.115:0/382237411 <== mgr.14660 v2:172.21.15.115:6800/1049502673 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fd38c10baf0 con 0x7fd37806cc50 2024-09-13T17:11:01.950 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.948+0000 7fd39430e640 1 -- 172.21.15.115:0/382237411 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fd37806cc50 msgr2=0x7fd37806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:01.950 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.948+0000 7fd39430e640 1 --2- 172.21.15.115:0/382237411 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fd37806cc50 0x7fd37806f110 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd388005fd0 tx=0x7fd388009500 comp rx=0 tx=0).stop 2024-09-13T17:11:01.950 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.948+0000 7fd39430e640 1 -- 172.21.15.115:0/382237411 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd38c1049a0 msgr2=0x7fd38c196e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:01.950 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.948+0000 7fd39430e640 1 --2- 172.21.15.115:0/382237411 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd38c1049a0 0x7fd38c196e30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd37c006010 tx=0x7fd37c0055a0 comp rx=0 tx=0).stop 2024-09-13T17:11:01.950 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.948+0000 7fd39430e640 1 -- 172.21.15.115:0/382237411 shutdown_connections 2024-09-13T17:11:01.950 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.948+0000 7fd39430e640 1 --2- 172.21.15.115:0/382237411 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fd37806cc50 0x7fd37806f110 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:01.950 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.948+0000 7fd39430e640 1 --2- 172.21.15.115:0/382237411 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd38c1049a0 0x7fd38c196e30 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:01.951 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.948+0000 7fd39430e640 1 --2- 172.21.15.115:0/382237411 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd38c0fe9a0 0x7fd38c1968f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:01.951 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.948+0000 7fd39430e640 1 -- 172.21.15.115:0/382237411 >> 172.21.15.115:0/382237411 conn(0x7fd38c0758c0 msgr2=0x7fd38c102280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:01.951 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.948+0000 7fd39430e640 1 -- 172.21.15.115:0/382237411 shutdown_connections 2024-09-13T17:11:01.951 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:01.948+0000 7fd39430e640 1 -- 172.21.15.115:0/382237411 wait complete. 2024-09-13T17:11:02.032 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.029+0000 7f929ff75640 1 -- 172.21.15.115:0/4080248597 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9298104a20 msgr2=0x7f9298104e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:02.032 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.029+0000 7f929ff75640 1 --2- 172.21.15.115:0/4080248597 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9298104a20 0x7f9298104e00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9294009880 tx=0x7f929402a4a0 comp rx=0 tx=0).stop 2024-09-13T17:11:02.032 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.029+0000 7f929ff75640 1 -- 172.21.15.115:0/4080248597 shutdown_connections 2024-09-13T17:11:02.032 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.029+0000 7f929ff75640 1 --2- 172.21.15.115:0/4080248597 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f92980fea20 0x7f92980fee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:02.032 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.029+0000 7f929ff75640 1 --2- 172.21.15.115:0/4080248597 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9298104a20 0x7f9298104e00 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:02.032 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.029+0000 7f929ff75640 1 -- 172.21.15.115:0/4080248597 >> 172.21.15.115:0/4080248597 conn(0x7f92980fa720 msgr2=0x7f92980fcb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:02.032 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.029+0000 7f929ff75640 1 -- 172.21.15.115:0/4080248597 shutdown_connections 2024-09-13T17:11:02.032 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.029+0000 7f929ff75640 1 -- 172.21.15.115:0/4080248597 wait complete. 2024-09-13T17:11:02.034 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.030+0000 7f929ff75640 1 Processor -- start 2024-09-13T17:11:02.034 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.030+0000 7f929ff75640 1 -- start start 2024-09-13T17:11:02.034 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.030+0000 7f929ff75640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f92980fea20 0x7f9298196830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:02.034 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.030+0000 7f929ff75640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9298104a20 0x7f9298196d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:02.034 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.030+0000 7f929ff75640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9298197340 con 0x7f9298104a20 2024-09-13T17:11:02.034 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.030+0000 7f929ff75640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92981974b0 con 0x7f92980fea20 2024-09-13T17:11:02.034 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.030+0000 7f929d510640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9298104a20 0x7f9298196d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:02.034 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.030+0000 7f929d510640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9298104a20 0x7f9298196d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:45040/0 (socket says 172.21.15.115:45040) 2024-09-13T17:11:02.035 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.030+0000 7f929d510640 1 -- 172.21.15.115:0/1084911572 learned_addr learned my addr 172.21.15.115:0/1084911572 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:11:02.035 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.031+0000 7f929dd11640 1 --2- 172.21.15.115:0/1084911572 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f92980fea20 0x7f9298196830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:02.035 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.031+0000 7f929d510640 1 -- 172.21.15.115:0/1084911572 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f92980fea20 msgr2=0x7f9298196830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:02.035 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.031+0000 7f929d510640 1 --2- 172.21.15.115:0/1084911572 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f92980fea20 0x7f9298196830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:02.035 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.031+0000 7f929d510640 1 -- 172.21.15.115:0/1084911572 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9294009560 con 0x7f9298104a20 2024-09-13T17:11:02.035 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.031+0000 7f929d510640 1 --2- 172.21.15.115:0/1084911572 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9298104a20 0x7f9298196d70 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f928800c810 tx=0x7f928800ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:02.035 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.031+0000 7f928effd640 1 -- 172.21.15.115:0/1084911572 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f92880041f0 con 0x7f9298104a20 2024-09-13T17:11:02.035 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.031+0000 7f929ff75640 1 -- 172.21.15.115:0/1084911572 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f929819f8a0 con 0x7f9298104a20 2024-09-13T17:11:02.035 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.031+0000 7f928effd640 1 -- 172.21.15.115:0/1084911572 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9288007e50 con 0x7f9298104a20 2024-09-13T17:11:02.035 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.031+0000 7f928effd640 1 -- 172.21.15.115:0/1084911572 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f92880049d0 con 0x7f9298104a20 2024-09-13T17:11:02.035 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.031+0000 7f929ff75640 1 -- 172.21.15.115:0/1084911572 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f929819fd10 con 0x7f9298104a20 2024-09-13T17:11:02.036 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.032+0000 7f929ff75640 1 -- 172.21.15.115:0/1084911572 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9298100160 con 0x7f9298104a20 2024-09-13T17:11:02.036 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.033+0000 7f928effd640 1 -- 172.21.15.115:0/1084911572 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f92880079b0 con 0x7f9298104a20 2024-09-13T17:11:02.036 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.033+0000 7f928effd640 1 --2- 172.21.15.115:0/1084911572 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f928406cc60 0x7f928406f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:02.036 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.033+0000 7f929dd11640 1 --2- 172.21.15.115:0/1084911572 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f928406cc60 0x7f928406f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:02.036 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.033+0000 7f928effd640 1 -- 172.21.15.115:0/1084911572 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f928808c270 con 0x7f9298104a20 2024-09-13T17:11:02.037 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.034+0000 7f929dd11640 1 --2- 172.21.15.115:0/1084911572 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f928406cc60 0x7f928406f120 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9294000c00 tx=0x7f9294005a20 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:02.040 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.038+0000 7f928effd640 1 -- 172.21.15.115:0/1084911572 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f9288056440 con 0x7f9298104a20 2024-09-13T17:11:02.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:01 smithi195 ceph-mon[80021]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-13T17:11:02.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:01 smithi195 ceph-mon[80021]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-09-13T17:11:02.209 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.207+0000 7f929ff75640 1 -- 172.21.15.115:0/1084911572 --> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9298101cd0 con 0x7f928406cc60 2024-09-13T17:11:02.219 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.217+0000 7f928effd640 1 -- 172.21.15.115:0/1084911572 <== mgr.14660 v2:172.21.15.115:6800/1049502673 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7f9298101cd0 con 0x7f928406cc60 2024-09-13T17:11:02.219 INFO:teuthology.orchestra.run.smithi115.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T17:11:02.219 INFO:teuthology.orchestra.run.smithi115.stdout:alertmanager.smithi115 smithi115 *:9093,9094 running (2m) 5s ago 13m 25.0M - 0.25.0 c8568f914cd2 d56b91240fe1 2024-09-13T17:11:02.219 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-exporter.smithi115 smithi115 running (13m) 5s ago 13m 8338k - 18.2.4-843-g2c01458a c129f5a2fd4e 0f1eebeaf9bb 2024-09-13T17:11:02.219 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-exporter.smithi195 smithi195 running (12m) 59s ago 12m 7792k - 18.2.4-843-g2c01458a c129f5a2fd4e 6d05bafbac8a 2024-09-13T17:11:02.219 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi115 smithi115 running (67s) 5s ago 13m 6895k - 18.2.4-860-g6c6b083f 8a91f241d7d4 e8175bc055bf 2024-09-13T17:11:02.220 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi195 smithi195 running (63s) 59s ago 12m 6903k - 18.2.4-860-g6c6b083f 8a91f241d7d4 ccb4895be776 2024-09-13T17:11:02.220 INFO:teuthology.orchestra.run.smithi115.stdout:grafana.smithi115 smithi115 *:3000 running (2m) 5s ago 12m 80.5M - 9.4.7 954c08fa6188 e1eccb1a8f3e 2024-09-13T17:11:02.220 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi115.hbtxod smithi115 running (7m) 5s ago 7m 98.7M - 18.2.4-843-g2c01458a c129f5a2fd4e 12b4f4874491 2024-09-13T17:11:02.220 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi115.ijznvr smithi115 running (7m) 5s ago 7m 166M - 18.2.4-843-g2c01458a c129f5a2fd4e 2d552564a9f4 2024-09-13T17:11:02.220 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi195.aevvgz smithi195 running (7m) 59s ago 7m 17.5M - 18.2.4-843-g2c01458a c129f5a2fd4e 299b9ad657c9 2024-09-13T17:11:02.220 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi195.qzghxj smithi195 running (7m) 59s ago 7m 15.5M - 18.2.4-843-g2c01458a c129f5a2fd4e fb16b16181ff 2024-09-13T17:11:02.220 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi115.hetcni smithi115 *:8443,9283,8765 running (4m) 5s ago 14m 493M - 18.2.4-860-g6c6b083f 8a91f241d7d4 b945dbde1934 2024-09-13T17:11:02.220 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi195.hjjifz smithi195 *:8443,9283,8765 running (3m) 59s ago 12m 440M - 18.2.4-860-g6c6b083f 8a91f241d7d4 17bccdfbcae1 2024-09-13T17:11:02.220 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi115 smithi115 running (93s) 5s ago 14m 39.0M 2048M 18.2.4-860-g6c6b083f 8a91f241d7d4 8dd7baf2c6b6 2024-09-13T17:11:02.220 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi195 smithi195 running (78s) 59s ago 12m 26.0M 2048M 18.2.4-860-g6c6b083f 8a91f241d7d4 0459bc5e6b08 2024-09-13T17:11:02.220 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi115 smithi115 *:9100 running (3m) 5s ago 13m 16.5M - 1.5.0 0da6a335fe13 26fb6f9844b5 2024-09-13T17:11:02.220 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi195 smithi195 *:9100 running (3m) 59s ago 12m 16.8M - 1.5.0 0da6a335fe13 6d38e798fb16 2024-09-13T17:11:02.221 INFO:teuthology.orchestra.run.smithi115.stdout:osd.0 smithi115 running (44s) 5s ago 11m 99.8M 1216M 18.2.4-860-g6c6b083f 8a91f241d7d4 3b9f874c64e9 2024-09-13T17:11:02.221 INFO:teuthology.orchestra.run.smithi115.stdout:osd.1 smithi115 running (11s) 5s ago 10m 12.5M 1216M 18.2.4-860-g6c6b083f 8a91f241d7d4 f0de6684601c 2024-09-13T17:11:02.221 INFO:teuthology.orchestra.run.smithi115.stdout:osd.2 smithi115 running (10m) 5s ago 10m 224M 1216M 18.2.4-843-g2c01458a c129f5a2fd4e 7c623823e920 2024-09-13T17:11:02.221 INFO:teuthology.orchestra.run.smithi115.stdout:osd.3 smithi195 running (10m) 59s ago 10m 294M 2240M 18.2.4-843-g2c01458a c129f5a2fd4e 10ea833fd5c5 2024-09-13T17:11:02.221 INFO:teuthology.orchestra.run.smithi115.stdout:osd.4 smithi195 running (9m) 59s ago 9m 265M 2240M 18.2.4-843-g2c01458a c129f5a2fd4e 4bbc3acb9aff 2024-09-13T17:11:02.221 INFO:teuthology.orchestra.run.smithi115.stdout:osd.5 smithi195 running (9m) 59s ago 9m 237M 2240M 18.2.4-843-g2c01458a c129f5a2fd4e 4bd1b3a232d0 2024-09-13T17:11:02.221 INFO:teuthology.orchestra.run.smithi115.stdout:prometheus.smithi115 smithi115 *:9095 running (3m) 5s ago 12m 63.9M - 2.43.0 a07b618ecd1d e03fb39f6b76 2024-09-13T17:11:02.222 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.219+0000 7f929ff75640 1 -- 172.21.15.115:0/1084911572 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f928406cc60 msgr2=0x7f928406f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:02.222 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.219+0000 7f929ff75640 1 --2- 172.21.15.115:0/1084911572 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f928406cc60 0x7f928406f120 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9294000c00 tx=0x7f9294005a20 comp rx=0 tx=0).stop 2024-09-13T17:11:02.222 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.219+0000 7f929ff75640 1 -- 172.21.15.115:0/1084911572 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9298104a20 msgr2=0x7f9298196d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:02.222 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.219+0000 7f929ff75640 1 --2- 172.21.15.115:0/1084911572 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9298104a20 0x7f9298196d70 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f928800c810 tx=0x7f928800ccd0 comp rx=0 tx=0).stop 2024-09-13T17:11:02.222 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.219+0000 7f929ff75640 1 -- 172.21.15.115:0/1084911572 shutdown_connections 2024-09-13T17:11:02.222 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.219+0000 7f929ff75640 1 --2- 172.21.15.115:0/1084911572 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f928406cc60 0x7f928406f120 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:02.222 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.219+0000 7f929ff75640 1 --2- 172.21.15.115:0/1084911572 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9298104a20 0x7f9298196d70 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:02.222 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.219+0000 7f929ff75640 1 --2- 172.21.15.115:0/1084911572 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f92980fea20 0x7f9298196830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:02.222 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.219+0000 7f929ff75640 1 -- 172.21.15.115:0/1084911572 >> 172.21.15.115:0/1084911572 conn(0x7f92980fa720 msgr2=0x7f92980fc850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:02.222 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.219+0000 7f929ff75640 1 -- 172.21.15.115:0/1084911572 shutdown_connections 2024-09-13T17:11:02.222 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.219+0000 7f929ff75640 1 -- 172.21.15.115:0/1084911572 wait complete. 2024-09-13T17:11:02.302 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.299+0000 7fe0ebde5640 1 -- 172.21.15.115:0/684465122 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0e40fe9a0 msgr2=0x7fe0e40fee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:02.302 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.299+0000 7fe0ebde5640 1 --2- 172.21.15.115:0/684465122 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0e40fe9a0 0x7fe0e40fee00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe0d4009880 tx=0x7fe0d402a4a0 comp rx=0 tx=0).stop 2024-09-13T17:11:02.302 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.299+0000 7fe0ebde5640 1 -- 172.21.15.115:0/684465122 shutdown_connections 2024-09-13T17:11:02.302 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.299+0000 7fe0ebde5640 1 --2- 172.21.15.115:0/684465122 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0e40fe9a0 0x7fe0e40fee00 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:02.302 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.299+0000 7fe0ebde5640 1 --2- 172.21.15.115:0/684465122 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0e41049a0 0x7fe0e4104d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:02.303 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.299+0000 7fe0ebde5640 1 -- 172.21.15.115:0/684465122 >> 172.21.15.115:0/684465122 conn(0x7fe0e40758c0 msgr2=0x7fe0e40fcc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:02.303 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.300+0000 7fe0ebde5640 1 -- 172.21.15.115:0/684465122 shutdown_connections 2024-09-13T17:11:02.303 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.300+0000 7fe0ebde5640 1 -- 172.21.15.115:0/684465122 wait complete. 2024-09-13T17:11:02.304 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.300+0000 7fe0ebde5640 1 Processor -- start 2024-09-13T17:11:02.304 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.300+0000 7fe0ebde5640 1 -- start start 2024-09-13T17:11:02.304 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.301+0000 7fe0ebde5640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0e40fe9a0 0x7fe0e419a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:02.305 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.301+0000 7fe0ebde5640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0e41049a0 0x7fe0e419abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:02.305 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.301+0000 7fe0ebde5640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e419b270 con 0x7fe0e40fe9a0 2024-09-13T17:11:02.305 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.301+0000 7fe0ebde5640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e41947b0 con 0x7fe0e41049a0 2024-09-13T17:11:02.305 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.301+0000 7fe0e9b81640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0e40fe9a0 0x7fe0e419a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:02.305 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.301+0000 7fe0e9b81640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0e40fe9a0 0x7fe0e419a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:45058/0 (socket says 172.21.15.115:45058) 2024-09-13T17:11:02.305 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.301+0000 7fe0e9b81640 1 -- 172.21.15.115:0/3479258815 learned_addr learned my addr 172.21.15.115:0/3479258815 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:11:02.305 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.301+0000 7fe0e9380640 1 --2- 172.21.15.115:0/3479258815 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0e41049a0 0x7fe0e419abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:02.305 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.301+0000 7fe0e9b81640 1 -- 172.21.15.115:0/3479258815 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0e41049a0 msgr2=0x7fe0e419abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:02.305 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.301+0000 7fe0e9b81640 1 --2- 172.21.15.115:0/3479258815 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0e41049a0 0x7fe0e419abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:02.305 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.301+0000 7fe0e9b81640 1 -- 172.21.15.115:0/3479258815 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0d4009560 con 0x7fe0e40fe9a0 2024-09-13T17:11:02.305 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.301+0000 7fe0e9b81640 1 --2- 172.21.15.115:0/3479258815 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0e40fe9a0 0x7fe0e419a6a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe0e000c8f0 tx=0x7fe0e000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:02.305 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.302+0000 7fe0daffd640 1 -- 172.21.15.115:0/3479258815 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0e0007b80 con 0x7fe0e40fe9a0 2024-09-13T17:11:02.305 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.302+0000 7fe0daffd640 1 -- 172.21.15.115:0/3479258815 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe0e0007ce0 con 0x7fe0e40fe9a0 2024-09-13T17:11:02.306 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.302+0000 7fe0ebde5640 1 -- 172.21.15.115:0/3479258815 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0e4194a90 con 0x7fe0e40fe9a0 2024-09-13T17:11:02.306 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.302+0000 7fe0daffd640 1 -- 172.21.15.115:0/3479258815 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0e000f450 con 0x7fe0e40fe9a0 2024-09-13T17:11:02.306 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.302+0000 7fe0ebde5640 1 -- 172.21.15.115:0/3479258815 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0e4194fb0 con 0x7fe0e40fe9a0 2024-09-13T17:11:02.306 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.303+0000 7fe0ebde5640 1 -- 172.21.15.115:0/3479258815 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0e41000e0 con 0x7fe0e40fe9a0 2024-09-13T17:11:02.307 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.303+0000 7fe0daffd640 1 -- 172.21.15.115:0/3479258815 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fe0e0004f10 con 0x7fe0e40fe9a0 2024-09-13T17:11:02.307 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.304+0000 7fe0daffd640 1 --2- 172.21.15.115:0/3479258815 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fe0d006cc50 0x7fe0d006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:02.307 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.304+0000 7fe0daffd640 1 -- 172.21.15.115:0/3479258815 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fe0e008c2b0 con 0x7fe0e40fe9a0 2024-09-13T17:11:02.307 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.304+0000 7fe0e9380640 1 --2- 172.21.15.115:0/3479258815 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fe0d006cc50 0x7fe0d006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:02.307 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.304+0000 7fe0e9380640 1 --2- 172.21.15.115:0/3479258815 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fe0d006cc50 0x7fe0d006f110 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe0d4000c00 tx=0x7fe0d4005a20 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:02.310 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.308+0000 7fe0daffd640 1 -- 172.21.15.115:0/3479258815 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe0e0056480 con 0x7fe0e40fe9a0 2024-09-13T17:11:02.543 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.541+0000 7fe0ebde5640 1 -- 172.21.15.115:0/3479258815 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe0e40fee00 con 0x7fe0e40fe9a0 2024-09-13T17:11:02.544 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.541+0000 7fe0daffd640 1 -- 172.21.15.115:0/3479258815 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+837 (secure 0 0 0) 0x7fe0e0059aa0 con 0x7fe0e40fe9a0 2024-09-13T17:11:02.544 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-13T17:11:02.544 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": { 2024-09-13T17:11:02.544 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 2 2024-09-13T17:11:02.544 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T17:11:02.544 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": { 2024-09-13T17:11:02.545 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 2 2024-09-13T17:11:02.545 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T17:11:02.545 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": { 2024-09-13T17:11:02.545 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-843-g2c01458a (2c01458affee2b2435cd231b6e392435c1c21661) reef (stable)": 4, 2024-09-13T17:11:02.545 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 2 2024-09-13T17:11:02.545 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T17:11:02.545 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": { 2024-09-13T17:11:02.545 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-843-g2c01458a (2c01458affee2b2435cd231b6e392435c1c21661) reef (stable)": 4 2024-09-13T17:11:02.545 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T17:11:02.545 INFO:teuthology.orchestra.run.smithi115.stdout: "overall": { 2024-09-13T17:11:02.545 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-843-g2c01458a (2c01458affee2b2435cd231b6e392435c1c21661) reef (stable)": 8, 2024-09-13T17:11:02.545 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 6 2024-09-13T17:11:02.545 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-13T17:11:02.546 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-13T17:11:02.546 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.544+0000 7fe0ebde5640 1 -- 172.21.15.115:0/3479258815 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fe0d006cc50 msgr2=0x7fe0d006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:02.547 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.544+0000 7fe0ebde5640 1 --2- 172.21.15.115:0/3479258815 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fe0d006cc50 0x7fe0d006f110 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe0d4000c00 tx=0x7fe0d4005a20 comp rx=0 tx=0).stop 2024-09-13T17:11:02.547 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.544+0000 7fe0ebde5640 1 -- 172.21.15.115:0/3479258815 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0e40fe9a0 msgr2=0x7fe0e419a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:02.547 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.544+0000 7fe0ebde5640 1 --2- 172.21.15.115:0/3479258815 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0e40fe9a0 0x7fe0e419a6a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe0e000c8f0 tx=0x7fe0e000cdb0 comp rx=0 tx=0).stop 2024-09-13T17:11:02.547 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.544+0000 7fe0ebde5640 1 -- 172.21.15.115:0/3479258815 shutdown_connections 2024-09-13T17:11:02.547 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.544+0000 7fe0ebde5640 1 --2- 172.21.15.115:0/3479258815 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fe0d006cc50 0x7fe0d006f110 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:02.547 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.544+0000 7fe0ebde5640 1 --2- 172.21.15.115:0/3479258815 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0e41049a0 0x7fe0e419abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:02.547 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.544+0000 7fe0ebde5640 1 --2- 172.21.15.115:0/3479258815 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0e40fe9a0 0x7fe0e419a6a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:02.547 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.544+0000 7fe0ebde5640 1 -- 172.21.15.115:0/3479258815 >> 172.21.15.115:0/3479258815 conn(0x7fe0e40758c0 msgr2=0x7fe0e4102280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:02.547 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.544+0000 7fe0ebde5640 1 -- 172.21.15.115:0/3479258815 shutdown_connections 2024-09-13T17:11:02.547 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.544+0000 7fe0ebde5640 1 -- 172.21.15.115:0/3479258815 wait complete. 2024-09-13T17:11:02.626 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.624+0000 7fbb98de7640 1 -- 172.21.15.115:0/3373438858 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbb94100ce0 msgr2=0x7fbb941010c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:02.627 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.624+0000 7fbb98de7640 1 --2- 172.21.15.115:0/3373438858 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbb94100ce0 0x7fbb941010c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbb84009880 tx=0x7fbb8402a530 comp rx=0 tx=0).stop 2024-09-13T17:11:02.627 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.624+0000 7fbb98de7640 1 -- 172.21.15.115:0/3373438858 shutdown_connections 2024-09-13T17:11:02.627 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.624+0000 7fbb98de7640 1 --2- 172.21.15.115:0/3373438858 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbb94101600 0x7fbb94109af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:02.627 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.624+0000 7fbb98de7640 1 --2- 172.21.15.115:0/3373438858 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbb94100ce0 0x7fbb941010c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:02.627 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.624+0000 7fbb98de7640 1 -- 172.21.15.115:0/3373438858 >> 172.21.15.115:0/3373438858 conn(0x7fbb940fa720 msgr2=0x7fbb940fcb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:02.627 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.624+0000 7fbb98de7640 1 -- 172.21.15.115:0/3373438858 shutdown_connections 2024-09-13T17:11:02.627 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.624+0000 7fbb98de7640 1 -- 172.21.15.115:0/3373438858 wait complete. 2024-09-13T17:11:02.629 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.625+0000 7fbb98de7640 1 Processor -- start 2024-09-13T17:11:02.629 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.625+0000 7fbb98de7640 1 -- start start 2024-09-13T17:11:02.629 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.625+0000 7fbb98de7640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbb94100ce0 0x7fbb940fe940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:02.629 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.625+0000 7fbb98de7640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbb94101600 0x7fbb940fee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:02.629 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.625+0000 7fbb98de7640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb940ff3c0 con 0x7fbb94100ce0 2024-09-13T17:11:02.629 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.625+0000 7fbb98de7640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb940ff530 con 0x7fbb94101600 2024-09-13T17:11:02.629 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.625+0000 7fbb9259c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbb94100ce0 0x7fbb940fe940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:02.629 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.625+0000 7fbb9259c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbb94100ce0 0x7fbb940fe940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:45062/0 (socket says 172.21.15.115:45062) 2024-09-13T17:11:02.629 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.625+0000 7fbb9259c640 1 -- 172.21.15.115:0/4064491622 learned_addr learned my addr 172.21.15.115:0/4064491622 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:11:02.629 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.625+0000 7fbb8bfff640 1 --2- 172.21.15.115:0/4064491622 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbb94101600 0x7fbb940fee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:02.629 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.626+0000 7fbb9259c640 1 -- 172.21.15.115:0/4064491622 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbb94101600 msgr2=0x7fbb940fee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:02.629 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.626+0000 7fbb9259c640 1 --2- 172.21.15.115:0/4064491622 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbb94101600 0x7fbb940fee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:02.630 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.626+0000 7fbb9259c640 1 -- 172.21.15.115:0/4064491622 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb84009560 con 0x7fbb94100ce0 2024-09-13T17:11:02.630 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.626+0000 7fbb8bfff640 1 --2- 172.21.15.115:0/4064491622 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbb94101600 0x7fbb940fee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:11:02.630 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.626+0000 7fbb9259c640 1 --2- 172.21.15.115:0/4064491622 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbb94100ce0 0x7fbb940fe940 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbb8402aa50 tx=0x7fbb840055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:02.630 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.626+0000 7fbb8b7fe640 1 -- 172.21.15.115:0/4064491622 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb84004b60 con 0x7fbb94100ce0 2024-09-13T17:11:02.630 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.626+0000 7fbb98de7640 1 -- 172.21.15.115:0/4064491622 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb940ff7b0 con 0x7fbb94100ce0 2024-09-13T17:11:02.630 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.626+0000 7fbb8b7fe640 1 -- 172.21.15.115:0/4064491622 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbb84004cc0 con 0x7fbb94100ce0 2024-09-13T17:11:02.630 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.626+0000 7fbb8b7fe640 1 -- 172.21.15.115:0/4064491622 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb84031950 con 0x7fbb94100ce0 2024-09-13T17:11:02.630 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.626+0000 7fbb98de7640 1 -- 172.21.15.115:0/4064491622 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb941a1e70 con 0x7fbb94100ce0 2024-09-13T17:11:02.631 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.627+0000 7fbb98de7640 1 -- 172.21.15.115:0/4064491622 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb94068ce0 con 0x7fbb94100ce0 2024-09-13T17:11:02.631 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.628+0000 7fbb8b7fe640 1 -- 172.21.15.115:0/4064491622 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fbb8402ad50 con 0x7fbb94100ce0 2024-09-13T17:11:02.631 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.628+0000 7fbb8b7fe640 1 --2- 172.21.15.115:0/4064491622 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fbb8006cc50 0x7fbb8006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:02.631 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.628+0000 7fbb8b7fe640 1 -- 172.21.15.115:0/4064491622 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fbb840ad210 con 0x7fbb94100ce0 2024-09-13T17:11:02.631 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.628+0000 7fbb8bfff640 1 --2- 172.21.15.115:0/4064491622 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fbb8006cc50 0x7fbb8006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:02.631 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.629+0000 7fbb8bfff640 1 --2- 172.21.15.115:0/4064491622 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fbb8006cc50 0x7fbb8006f110 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbb941000c0 tx=0x7fbb7c00b690 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:02.634 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.632+0000 7fbb8b7fe640 1 -- 172.21.15.115:0/4064491622 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fbb84077330 con 0x7fbb94100ce0 2024-09-13T17:11:02.832 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.830+0000 7fbb98de7640 1 -- 172.21.15.115:0/4064491622 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fbb940ff7b0 con 0x7fbb94100ce0 2024-09-13T17:11:02.833 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.830+0000 7fbb8b7fe640 1 -- 172.21.15.115:0/4064491622 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1874 (secure 0 0 0) 0x7fbb940ff7b0 con 0x7fbb94100ce0 2024-09-13T17:11:02.833 INFO:teuthology.orchestra.run.smithi115.stdout:e19 2024-09-13T17:11:02.833 INFO:teuthology.orchestra.run.smithi115.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T17:11:02.833 INFO:teuthology.orchestra.run.smithi115.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T17:11:02.833 INFO:teuthology.orchestra.run.smithi115.stdout:legacy client fscid: 1 2024-09-13T17:11:02.833 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:11:02.833 INFO:teuthology.orchestra.run.smithi115.stdout:Filesystem 'cephfs' (1) 2024-09-13T17:11:02.833 INFO:teuthology.orchestra.run.smithi115.stdout:fs_name cephfs 2024-09-13T17:11:02.834 INFO:teuthology.orchestra.run.smithi115.stdout:epoch 19 2024-09-13T17:11:02.834 INFO:teuthology.orchestra.run.smithi115.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T17:11:02.834 INFO:teuthology.orchestra.run.smithi115.stdout:created 2024-09-13T17:03:16.313116+0000 2024-09-13T17:11:02.834 INFO:teuthology.orchestra.run.smithi115.stdout:modified 2024-09-13T17:03:33.410348+0000 2024-09-13T17:11:02.834 INFO:teuthology.orchestra.run.smithi115.stdout:tableserver 0 2024-09-13T17:11:02.834 INFO:teuthology.orchestra.run.smithi115.stdout:root 0 2024-09-13T17:11:02.834 INFO:teuthology.orchestra.run.smithi115.stdout:session_timeout 60 2024-09-13T17:11:02.834 INFO:teuthology.orchestra.run.smithi115.stdout:session_autoclose 300 2024-09-13T17:11:02.834 INFO:teuthology.orchestra.run.smithi115.stdout:max_file_size 1099511627776 2024-09-13T17:11:02.834 INFO:teuthology.orchestra.run.smithi115.stdout:max_xattr_size 65536 2024-09-13T17:11:02.834 INFO:teuthology.orchestra.run.smithi115.stdout:required_client_features {} 2024-09-13T17:11:02.834 INFO:teuthology.orchestra.run.smithi115.stdout:last_failure 0 2024-09-13T17:11:02.834 INFO:teuthology.orchestra.run.smithi115.stdout:last_failure_osd_epoch 46 2024-09-13T17:11:02.834 INFO:teuthology.orchestra.run.smithi115.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T17:11:02.834 INFO:teuthology.orchestra.run.smithi115.stdout:max_mds 1 2024-09-13T17:11:02.835 INFO:teuthology.orchestra.run.smithi115.stdout:in 0 2024-09-13T17:11:02.835 INFO:teuthology.orchestra.run.smithi115.stdout:up {0=14470} 2024-09-13T17:11:02.835 INFO:teuthology.orchestra.run.smithi115.stdout:failed 2024-09-13T17:11:02.835 INFO:teuthology.orchestra.run.smithi115.stdout:damaged 2024-09-13T17:11:02.835 INFO:teuthology.orchestra.run.smithi115.stdout:stopped 2024-09-13T17:11:02.835 INFO:teuthology.orchestra.run.smithi115.stdout:data_pools [3] 2024-09-13T17:11:02.835 INFO:teuthology.orchestra.run.smithi115.stdout:metadata_pool 2 2024-09-13T17:11:02.835 INFO:teuthology.orchestra.run.smithi115.stdout:inline_data enabled 2024-09-13T17:11:02.835 INFO:teuthology.orchestra.run.smithi115.stdout:balancer 2024-09-13T17:11:02.835 INFO:teuthology.orchestra.run.smithi115.stdout:bal_rank_mask -1 2024-09-13T17:11:02.835 INFO:teuthology.orchestra.run.smithi115.stdout:standby_count_wanted 1 2024-09-13T17:11:02.835 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi115.ijznvr{0:14470} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.115:6828/4128583274,v1:172.21.15.115:6829/4128583274] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T17:11:02.835 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi115.hbtxod{0:14486} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.115:6826/1977394649,v1:172.21.15.115:6827/1977394649] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T17:11:02.835 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:11:02.836 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:11:02.836 INFO:teuthology.orchestra.run.smithi115.stdout:Standby daemons: 2024-09-13T17:11:02.836 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:11:02.836 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi195.aevvgz{-1:24253} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.195:6826/8826118,v1:172.21.15.195:6827/8826118] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T17:11:02.836 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi195.qzghxj{-1:24259} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.195:6824/3335357704,v1:172.21.15.195:6825/3335357704] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T17:11:02.837 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 19 2024-09-13T17:11:02.837 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.833+0000 7fbb98de7640 1 -- 172.21.15.115:0/4064491622 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fbb8006cc50 msgr2=0x7fbb8006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:02.837 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.833+0000 7fbb98de7640 1 --2- 172.21.15.115:0/4064491622 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fbb8006cc50 0x7fbb8006f110 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbb941000c0 tx=0x7fbb7c00b690 comp rx=0 tx=0).stop 2024-09-13T17:11:02.837 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.833+0000 7fbb98de7640 1 -- 172.21.15.115:0/4064491622 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbb94100ce0 msgr2=0x7fbb940fe940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:02.837 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.833+0000 7fbb98de7640 1 --2- 172.21.15.115:0/4064491622 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbb94100ce0 0x7fbb940fe940 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbb8402aa50 tx=0x7fbb840055a0 comp rx=0 tx=0).stop 2024-09-13T17:11:02.837 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.833+0000 7fbb98de7640 1 -- 172.21.15.115:0/4064491622 shutdown_connections 2024-09-13T17:11:02.837 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.833+0000 7fbb98de7640 1 --2- 172.21.15.115:0/4064491622 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fbb8006cc50 0x7fbb8006f110 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:02.837 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.833+0000 7fbb98de7640 1 --2- 172.21.15.115:0/4064491622 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbb94101600 0x7fbb940fee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:02.837 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.833+0000 7fbb98de7640 1 --2- 172.21.15.115:0/4064491622 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbb94100ce0 0x7fbb940fe940 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:02.837 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.833+0000 7fbb98de7640 1 -- 172.21.15.115:0/4064491622 >> 172.21.15.115:0/4064491622 conn(0x7fbb940fa720 msgr2=0x7fbb94101f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:02.837 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.833+0000 7fbb98de7640 1 -- 172.21.15.115:0/4064491622 shutdown_connections 2024-09-13T17:11:02.837 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.833+0000 7fbb98de7640 1 -- 172.21.15.115:0/4064491622 wait complete. 2024-09-13T17:11:02.918 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.915+0000 7f8c3b750640 1 -- 172.21.15.115:0/3380719927 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c34100ad0 msgr2=0x7f8c340fdfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:02.918 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.915+0000 7f8c3b750640 1 --2- 172.21.15.115:0/3380719927 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c34100ad0 0x7f8c340fdfe0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8c30009880 tx=0x7f8c3002a530 comp rx=0 tx=0).stop 2024-09-13T17:11:02.918 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.915+0000 7f8c3b750640 1 -- 172.21.15.115:0/3380719927 shutdown_connections 2024-09-13T17:11:02.918 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.915+0000 7f8c3b750640 1 --2- 172.21.15.115:0/3380719927 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8c34100eb0 0x7f8c340fe520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:02.918 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.915+0000 7f8c3b750640 1 --2- 172.21.15.115:0/3380719927 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c34100ad0 0x7f8c340fdfe0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:02.918 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.915+0000 7f8c3b750640 1 -- 172.21.15.115:0/3380719927 >> 172.21.15.115:0/3380719927 conn(0x7f8c340f9ef0 msgr2=0x7f8c340fc310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:02.918 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:02 smithi115 ceph-mon[109488]: pgmap v146: 65 pgs: 2 peering, 17 active+undersized, 13 active+undersized+degraded, 33 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 32/222 objects degraded (14.414%) 2024-09-13T17:11:02.919 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:02 smithi115 ceph-mon[109488]: from='client.34162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:11:02.919 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:02 smithi115 ceph-mon[109488]: from='client.? 172.21.15.115:0/3479258815' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:11:02.921 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.916+0000 7f8c3b750640 1 -- 172.21.15.115:0/3380719927 shutdown_connections 2024-09-13T17:11:02.921 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.916+0000 7f8c3b750640 1 -- 172.21.15.115:0/3380719927 wait complete. 2024-09-13T17:11:02.922 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.916+0000 7f8c3b750640 1 Processor -- start 2024-09-13T17:11:02.922 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.916+0000 7f8c3b750640 1 -- start start 2024-09-13T17:11:02.922 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.917+0000 7f8c3b750640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c34100ad0 0x7f8c3419d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:02.922 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.917+0000 7f8c3b750640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8c34100eb0 0x7f8c3419dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:02.922 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.917+0000 7f8c3b750640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3419e500 con 0x7f8c34100ad0 2024-09-13T17:11:02.922 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.917+0000 7f8c3b750640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c34197a90 con 0x7f8c34100eb0 2024-09-13T17:11:02.922 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.917+0000 7f8c394ec640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c34100ad0 0x7f8c3419d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:02.922 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.917+0000 7f8c394ec640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c34100ad0 0x7f8c3419d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:45088/0 (socket says 172.21.15.115:45088) 2024-09-13T17:11:02.922 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.917+0000 7f8c394ec640 1 -- 172.21.15.115:0/913084817 learned_addr learned my addr 172.21.15.115:0/913084817 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:11:02.922 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.917+0000 7f8c38ceb640 1 --2- 172.21.15.115:0/913084817 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8c34100eb0 0x7f8c3419dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:02.922 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.917+0000 7f8c394ec640 1 -- 172.21.15.115:0/913084817 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8c34100eb0 msgr2=0x7f8c3419dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:02.922 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.917+0000 7f8c394ec640 1 --2- 172.21.15.115:0/913084817 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8c34100eb0 0x7f8c3419dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:02.923 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.917+0000 7f8c394ec640 1 -- 172.21.15.115:0/913084817 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c30009560 con 0x7f8c34100ad0 2024-09-13T17:11:02.923 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.917+0000 7f8c394ec640 1 --2- 172.21.15.115:0/913084817 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c34100ad0 0x7f8c3419d9a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8c30006010 tx=0x7f8c300056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:02.923 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.917+0000 7f8c2a7fc640 1 -- 172.21.15.115:0/913084817 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c30004ba0 con 0x7f8c34100ad0 2024-09-13T17:11:02.923 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.917+0000 7f8c2a7fc640 1 -- 172.21.15.115:0/913084817 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8c30005d50 con 0x7f8c34100ad0 2024-09-13T17:11:02.923 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.917+0000 7f8c3b750640 1 -- 172.21.15.115:0/913084817 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c34197d70 con 0x7f8c34100ad0 2024-09-13T17:11:02.923 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.917+0000 7f8c2a7fc640 1 -- 172.21.15.115:0/913084817 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c300318b0 con 0x7f8c34100ad0 2024-09-13T17:11:02.923 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.918+0000 7f8c3b750640 1 -- 172.21.15.115:0/913084817 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c34198340 con 0x7f8c34100ad0 2024-09-13T17:11:02.923 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.919+0000 7f8c3b750640 1 -- 172.21.15.115:0/913084817 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c340ff200 con 0x7f8c34100ad0 2024-09-13T17:11:02.923 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.919+0000 7f8c2a7fc640 1 -- 172.21.15.115:0/913084817 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f8c3002ad50 con 0x7f8c34100ad0 2024-09-13T17:11:02.924 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.920+0000 7f8c2a7fc640 1 --2- 172.21.15.115:0/913084817 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f8c2006cc50 0x7f8c2006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:02.924 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.920+0000 7f8c2a7fc640 1 -- 172.21.15.115:0/913084817 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f8c300ad230 con 0x7f8c34100ad0 2024-09-13T17:11:02.924 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.920+0000 7f8c38ceb640 1 --2- 172.21.15.115:0/913084817 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f8c2006cc50 0x7f8c2006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:02.924 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.920+0000 7f8c38ceb640 1 --2- 172.21.15.115:0/913084817 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f8c2006cc50 0x7f8c2006f110 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8c34198f00 tx=0x7f8c24009110 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:02.926 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:02.924+0000 7f8c2a7fc640 1 -- 172.21.15.115:0/913084817 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f8c300773d0 con 0x7f8c34100ad0 2024-09-13T17:11:03.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:02 smithi195 ceph-mon[80021]: pgmap v146: 65 pgs: 2 peering, 17 active+undersized, 13 active+undersized+degraded, 33 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 32/222 objects degraded (14.414%) 2024-09-13T17:11:03.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:02 smithi195 ceph-mon[80021]: from='client.34162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:11:03.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:02 smithi195 ceph-mon[80021]: from='client.? 172.21.15.115:0/3479258815' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:11:03.103 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:03.101+0000 7f8c3b750640 1 -- 172.21.15.115:0/913084817 --> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8c34198670 con 0x7f8c2006cc50 2024-09-13T17:11:03.104 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:03.102+0000 7f8c2a7fc640 1 -- 172.21.15.115:0/913084817 <== mgr.14660 v2:172.21.15.115:6800/1049502673 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f8c34198670 con 0x7f8c2006cc50 2024-09-13T17:11:03.104 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-13T17:11:03.105 INFO:teuthology.orchestra.run.smithi115.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256", 2024-09-13T17:11:03.105 INFO:teuthology.orchestra.run.smithi115.stdout: "in_progress": true, 2024-09-13T17:11:03.105 INFO:teuthology.orchestra.run.smithi115.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T17:11:03.105 INFO:teuthology.orchestra.run.smithi115.stdout: "services_complete": [ 2024-09-13T17:11:03.105 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr", 2024-09-13T17:11:03.105 INFO:teuthology.orchestra.run.smithi115.stdout: "mon", 2024-09-13T17:11:03.105 INFO:teuthology.orchestra.run.smithi115.stdout: "crash" 2024-09-13T17:11:03.105 INFO:teuthology.orchestra.run.smithi115.stdout: ], 2024-09-13T17:11:03.105 INFO:teuthology.orchestra.run.smithi115.stdout: "progress": "8/23 daemons upgraded", 2024-09-13T17:11:03.105 INFO:teuthology.orchestra.run.smithi115.stdout: "message": "Currently upgrading osd daemons", 2024-09-13T17:11:03.105 INFO:teuthology.orchestra.run.smithi115.stdout: "is_paused": false 2024-09-13T17:11:03.105 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-13T17:11:03.106 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:03.104+0000 7f8c3b750640 1 -- 172.21.15.115:0/913084817 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f8c2006cc50 msgr2=0x7f8c2006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:03.106 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:03.104+0000 7f8c3b750640 1 --2- 172.21.15.115:0/913084817 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f8c2006cc50 0x7f8c2006f110 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8c34198f00 tx=0x7f8c24009110 comp rx=0 tx=0).stop 2024-09-13T17:11:03.106 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:03.104+0000 7f8c3b750640 1 -- 172.21.15.115:0/913084817 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c34100ad0 msgr2=0x7f8c3419d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:03.107 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:03.104+0000 7f8c3b750640 1 --2- 172.21.15.115:0/913084817 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c34100ad0 0x7f8c3419d9a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8c30006010 tx=0x7f8c300056e0 comp rx=0 tx=0).stop 2024-09-13T17:11:03.107 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:03.104+0000 7f8c3b750640 1 -- 172.21.15.115:0/913084817 shutdown_connections 2024-09-13T17:11:03.107 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:03.104+0000 7f8c3b750640 1 --2- 172.21.15.115:0/913084817 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f8c2006cc50 0x7f8c2006f110 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:03.107 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:03.104+0000 7f8c3b750640 1 --2- 172.21.15.115:0/913084817 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8c34100eb0 0x7f8c3419dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:03.107 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:03.104+0000 7f8c3b750640 1 --2- 172.21.15.115:0/913084817 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c34100ad0 0x7f8c3419d9a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:03.107 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:03.104+0000 7f8c3b750640 1 -- 172.21.15.115:0/913084817 >> 172.21.15.115:0/913084817 conn(0x7f8c340f9ef0 msgr2=0x7f8c340faf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:03.107 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:03.104+0000 7f8c3b750640 1 -- 172.21.15.115:0/913084817 shutdown_connections 2024-09-13T17:11:03.107 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:03.104+0000 7f8c3b750640 1 -- 172.21.15.115:0/913084817 wait complete. 2024-09-13T17:11:03.187 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:03.185+0000 7fa808c2b640 1 -- 172.21.15.115:0/1314989937 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa8040ffdf0 msgr2=0x7fa8041001d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:03.188 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:03.185+0000 7fa808c2b640 1 --2- 172.21.15.115:0/1314989937 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa8040ffdf0 0x7fa8041001d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc009c20 tx=0x7fa7fc02a970 comp rx=0 tx=0).stop 2024-09-13T17:11:03.188 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:03.185+0000 7fa808c2b640 1 -- 172.21.15.115:0/1314989937 shutdown_connections 2024-09-13T17:11:03.188 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:03.185+0000 7fa808c2b640 1 --2- 172.21.15.115:0/1314989937 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa8041007a0 0x7fa8041047f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:03.188 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:03.185+0000 7fa808c2b640 1 --2- 172.21.15.115:0/1314989937 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa8040ffdf0 0x7fa8041001d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:03.188 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:03.185+0000 7fa808c2b640 1 -- 172.21.15.115:0/1314989937 >> 172.21.15.115:0/1314989937 conn(0x7fa8040fb8d0 msgr2=0x7fa8040fdcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:03.188 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:03.185+0000 7fa808c2b640 1 -- 172.21.15.115:0/1314989937 shutdown_connections 2024-09-13T17:11:03.188 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:03.185+0000 7fa808c2b640 1 -- 172.21.15.115:0/1314989937 wait complete. 2024-09-13T17:11:03.190 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:03.186+0000 7fa808c2b640 1 Processor -- start 2024-09-13T17:11:03.190 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:03.186+0000 7fa808c2b640 1 -- start start 2024-09-13T17:11:03.190 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:03.186+0000 7fa808c2b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa8040ffdf0 0x7fa8040727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:03.190 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:03.186+0000 7fa808c2b640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa8041007a0 0x7fa804072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:03.190 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:03.186+0000 7fa808c2b640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa804073230 con 0x7fa8040ffdf0 2024-09-13T17:11:03.190 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:03.186+0000 7fa808c2b640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8040733a0 con 0x7fa8041007a0 2024-09-13T17:11:03.190 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:03.186+0000 7fa80259c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa8040ffdf0 0x7fa8040727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:03.190 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:03.186+0000 7fa80259c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa8040ffdf0 0x7fa8040727b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:45096/0 (socket says 172.21.15.115:45096) 2024-09-13T17:11:03.190 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:03.186+0000 7fa80259c640 1 -- 172.21.15.115:0/3261814635 learned_addr learned my addr 172.21.15.115:0/3261814635 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:11:03.190 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:03.186+0000 7fa80259c640 1 -- 172.21.15.115:0/3261814635 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa8041007a0 msgr2=0x7fa804072cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:03.190 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:03.186+0000 7fa801d9b640 1 --2- 172.21.15.115:0/3261814635 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa8041007a0 0x7fa804072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:03.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:03.186+0000 7fa80259c640 1 --2- 172.21.15.115:0/3261814635 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa8041007a0 0x7fa804072cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:03.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:03.187+0000 7fa80259c640 1 -- 172.21.15.115:0/3261814635 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7fc009900 con 0x7fa8040ffdf0 2024-09-13T17:11:03.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:03.187+0000 7fa80259c640 1 --2- 172.21.15.115:0/3261814635 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa8040ffdf0 0x7fa8040727b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc004af0 tx=0x7fa7fc0308a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:03.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:03.187+0000 7fa7fb7fe640 1 -- 172.21.15.115:0/3261814635 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa7fc02f3c0 con 0x7fa8040ffdf0 2024-09-13T17:11:03.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:03.187+0000 7fa7fb7fe640 1 -- 172.21.15.115:0/3261814635 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa7fc02f9c0 con 0x7fa8040ffdf0 2024-09-13T17:11:03.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:03.187+0000 7fa808c2b640 1 -- 172.21.15.115:0/3261814635 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa804073620 con 0x7fa8040ffdf0 2024-09-13T17:11:03.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:03.187+0000 7fa7fb7fe640 1 -- 172.21.15.115:0/3261814635 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa7fc039450 con 0x7fa8040ffdf0 2024-09-13T17:11:03.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:03.187+0000 7fa808c2b640 1 -- 172.21.15.115:0/3261814635 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8041a1f20 con 0x7fa8040ffdf0 2024-09-13T17:11:03.192 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:03.188+0000 7fa808c2b640 1 -- 172.21.15.115:0/3261814635 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8041012d0 con 0x7fa8040ffdf0 2024-09-13T17:11:03.192 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:03.188+0000 7fa7fb7fe640 1 -- 172.21.15.115:0/3261814635 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fa7fc00a040 con 0x7fa8040ffdf0 2024-09-13T17:11:03.192 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:03.189+0000 7fa7fb7fe640 1 --2- 172.21.15.115:0/3261814635 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fa7f006cc60 0x7fa7f006f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:03.192 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:03.189+0000 7fa7fb7fe640 1 -- 172.21.15.115:0/3261814635 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fa7fc02c040 con 0x7fa8040ffdf0 2024-09-13T17:11:03.192 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:03.189+0000 7fa801d9b640 1 --2- 172.21.15.115:0/3261814635 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fa7f006cc60 0x7fa7f006f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:03.192 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:03.189+0000 7fa801d9b640 1 --2- 172.21.15.115:0/3261814635 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fa7f006cc60 0x7fa7f006f120 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec005fd0 tx=0x7fa7ec009470 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:03.195 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:03.193+0000 7fa7fb7fe640 1 -- 172.21.15.115:0/3261814635 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa7fc0778a0 con 0x7fa8040ffdf0 2024-09-13T17:11:03.418 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:03.416+0000 7fa808c2b640 1 -- 172.21.15.115:0/3261814635 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fa8041001d0 con 0x7fa8040ffdf0 2024-09-13T17:11:03.419 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:03.416+0000 7fa7fb7fe640 1 -- 172.21.15.115:0/3261814635 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1093 (secure 0 0 0) 0x7fa7fc077020 con 0x7fa8040ffdf0 2024-09-13T17:11:03.419 INFO:teuthology.orchestra.run.smithi115.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; Degraded data redundancy: 32/222 objects degraded (14.414%), 13 pgs degraded 2024-09-13T17:11:03.419 INFO:teuthology.orchestra.run.smithi115.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T17:11:03.419 INFO:teuthology.orchestra.run.smithi115.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T17:11:03.419 INFO:teuthology.orchestra.run.smithi115.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 32/222 objects degraded (14.414%), 13 pgs degraded 2024-09-13T17:11:03.419 INFO:teuthology.orchestra.run.smithi115.stdout: pg 1.0 is active+undersized+degraded, acting [3,0] 2024-09-13T17:11:03.419 INFO:teuthology.orchestra.run.smithi115.stdout: pg 2.0 is active+undersized+degraded, acting [3,0] 2024-09-13T17:11:03.419 INFO:teuthology.orchestra.run.smithi115.stdout: pg 2.1 is active+undersized+degraded, acting [2,0] 2024-09-13T17:11:03.419 INFO:teuthology.orchestra.run.smithi115.stdout: pg 2.2 is active+undersized+degraded, acting [5,0] 2024-09-13T17:11:03.419 INFO:teuthology.orchestra.run.smithi115.stdout: pg 2.3 is active+undersized+degraded, acting [5,2] 2024-09-13T17:11:03.419 INFO:teuthology.orchestra.run.smithi115.stdout: pg 2.4 is active+undersized+degraded, acting [0,4] 2024-09-13T17:11:03.420 INFO:teuthology.orchestra.run.smithi115.stdout: pg 2.6 is active+undersized+degraded, acting [3,4] 2024-09-13T17:11:03.420 INFO:teuthology.orchestra.run.smithi115.stdout: pg 2.9 is active+undersized+degraded, acting [4,0] 2024-09-13T17:11:03.420 INFO:teuthology.orchestra.run.smithi115.stdout: pg 2.a is active+undersized+degraded, acting [4,3] 2024-09-13T17:11:03.420 INFO:teuthology.orchestra.run.smithi115.stdout: pg 2.d is active+undersized+degraded, acting [3,2] 2024-09-13T17:11:03.420 INFO:teuthology.orchestra.run.smithi115.stdout: pg 2.10 is active+undersized+degraded, acting [2,0] 2024-09-13T17:11:03.420 INFO:teuthology.orchestra.run.smithi115.stdout: pg 2.15 is active+undersized+degraded, acting [3,0] 2024-09-13T17:11:03.420 INFO:teuthology.orchestra.run.smithi115.stdout: pg 2.1b is active+undersized+degraded, acting [0,5] 2024-09-13T17:11:03.420 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:03.418+0000 7fa808c2b640 1 -- 172.21.15.115:0/3261814635 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fa7f006cc60 msgr2=0x7fa7f006f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:03.421 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:03.418+0000 7fa808c2b640 1 --2- 172.21.15.115:0/3261814635 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fa7f006cc60 0x7fa7f006f120 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec005fd0 tx=0x7fa7ec009470 comp rx=0 tx=0).stop 2024-09-13T17:11:03.421 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:03.418+0000 7fa808c2b640 1 -- 172.21.15.115:0/3261814635 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa8040ffdf0 msgr2=0x7fa8040727b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:03.421 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:03.418+0000 7fa808c2b640 1 --2- 172.21.15.115:0/3261814635 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa8040ffdf0 0x7fa8040727b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc004af0 tx=0x7fa7fc0308a0 comp rx=0 tx=0).stop 2024-09-13T17:11:03.421 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:03.418+0000 7fa808c2b640 1 -- 172.21.15.115:0/3261814635 shutdown_connections 2024-09-13T17:11:03.421 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:03.418+0000 7fa808c2b640 1 --2- 172.21.15.115:0/3261814635 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fa7f006cc60 0x7fa7f006f120 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:03.421 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:03.418+0000 7fa808c2b640 1 --2- 172.21.15.115:0/3261814635 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa8041007a0 0x7fa804072cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:03.421 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:03.418+0000 7fa808c2b640 1 --2- 172.21.15.115:0/3261814635 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa8040ffdf0 0x7fa8040727b0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:03.421 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:03.418+0000 7fa808c2b640 1 -- 172.21.15.115:0/3261814635 >> 172.21.15.115:0/3261814635 conn(0x7fa8040fb8d0 msgr2=0x7fa8040fcc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:03.421 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:03.418+0000 7fa808c2b640 1 -- 172.21.15.115:0/3261814635 shutdown_connections 2024-09-13T17:11:03.421 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:03.418+0000 7fa808c2b640 1 -- 172.21.15.115:0/3261814635 wait complete. 2024-09-13T17:11:04.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:03 smithi195 ceph-mon[80021]: from='client.34166 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:11:04.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:03 smithi195 ceph-mon[80021]: from='client.34170 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:11:04.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:03 smithi195 ceph-mon[80021]: from='client.? 172.21.15.115:0/4064491622' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T17:11:04.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:03 smithi195 ceph-mon[80021]: from='client.? 172.21.15.115:0/3261814635' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T17:11:04.178 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:03 smithi115 ceph-mon[109488]: from='client.34166 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:11:04.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:03 smithi115 ceph-mon[109488]: from='client.34170 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:11:04.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:03 smithi115 ceph-mon[109488]: from='client.? 172.21.15.115:0/4064491622' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T17:11:04.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:03 smithi115 ceph-mon[109488]: from='client.? 172.21.15.115:0/3261814635' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T17:11:04.992 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:04 smithi115 ceph-mon[109488]: from='client.34182 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:11:04.993 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:04 smithi115 ceph-mon[109488]: pgmap v147: 65 pgs: 2 peering, 63 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 682 B/s rd, 1 op/s 2024-09-13T17:11:04.993 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:04 smithi115 ceph-mon[109488]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 32/222 objects degraded (14.414%), 13 pgs degraded) 2024-09-13T17:11:05.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:04 smithi195 ceph-mon[80021]: from='client.34182 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:11:05.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:04 smithi195 ceph-mon[80021]: pgmap v147: 65 pgs: 2 peering, 63 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 682 B/s rd, 1 op/s 2024-09-13T17:11:05.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:04 smithi195 ceph-mon[80021]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 32/222 objects degraded (14.414%), 13 pgs degraded) 2024-09-13T17:11:06.879 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:06 smithi195 ceph-mon[80021]: pgmap v148: 65 pgs: 65 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 527 B/s rd, 1 op/s 2024-09-13T17:11:06.880 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:06 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:11:06.880 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:06 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:11:06.881 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:06 smithi115 ceph-mon[109488]: pgmap v148: 65 pgs: 65 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 527 B/s rd, 1 op/s 2024-09-13T17:11:06.882 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:06 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:11:06.882 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:06 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:11:08.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:08 smithi115 ceph-mon[109488]: pgmap v149: 65 pgs: 65 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.0 KiB/s rd, 2 op/s 2024-09-13T17:11:09.076 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:08 smithi195 ceph-mon[80021]: pgmap v149: 65 pgs: 65 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.0 KiB/s rd, 2 op/s 2024-09-13T17:11:10.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:10 smithi115 ceph-mon[109488]: pgmap v150: 65 pgs: 65 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 921 B/s rd, 1 op/s 2024-09-13T17:11:11.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:10 smithi195 ceph-mon[80021]: pgmap v150: 65 pgs: 65 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 921 B/s rd, 1 op/s 2024-09-13T17:11:11.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:11 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:11:12.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:11 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:11:12.693 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:12 smithi115 ceph-mon[109488]: pgmap v151: 65 pgs: 65 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 784 B/s rd, 1 op/s 2024-09-13T17:11:13.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:12 smithi195 ceph-mon[80021]: pgmap v151: 65 pgs: 65 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 784 B/s rd, 1 op/s 2024-09-13T17:11:14.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:14 smithi115 ceph-mon[109488]: pgmap v152: 65 pgs: 65 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:11:15.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:14 smithi195 ceph-mon[80021]: pgmap v152: 65 pgs: 65 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:11:16.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:16 smithi115 ceph-mon[109488]: pgmap v153: 65 pgs: 65 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:11:16.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:16 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-13T17:11:16.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:16 smithi115 ceph-mon[109488]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-13T17:11:16.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:16 smithi115 ceph-mon[109488]: Upgrade: osd.2 is safe to restart 2024-09-13T17:11:17.076 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:16 smithi195 ceph-mon[80021]: pgmap v153: 65 pgs: 65 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:11:17.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:16 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-13T17:11:17.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:16 smithi195 ceph-mon[80021]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-13T17:11:17.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:16 smithi195 ceph-mon[80021]: Upgrade: osd.2 is safe to restart 2024-09-13T17:11:18.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:18 smithi115 ceph-mon[109488]: Upgrade: Updating osd.2 2024-09-13T17:11:18.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:18 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:11:18.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:18 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-13T17:11:18.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:18 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:11:18.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:18 smithi115 ceph-mon[109488]: Deploying daemon osd.2 on smithi115 2024-09-13T17:11:18.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:18 smithi115 ceph-mon[109488]: pgmap v154: 65 pgs: 65 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:11:18.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:18 smithi195 ceph-mon[80021]: Upgrade: Updating osd.2 2024-09-13T17:11:18.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:18 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:11:18.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:18 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-13T17:11:18.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:18 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:11:18.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:18 smithi195 ceph-mon[80021]: Deploying daemon osd.2 on smithi115 2024-09-13T17:11:18.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:18 smithi195 ceph-mon[80021]: pgmap v154: 65 pgs: 65 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:11:20.179 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 17:11:19 smithi115 systemd[1]: Stopping Ceph osd.2 for ffbd7588-71f0-11ef-bceb-c7b262605968... 2024-09-13T17:11:20.428 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 17:11:20 smithi115 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-2[61042]: 2024-09-13T17:11:20.176+0000 7f1100fcc640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T17:11:20.429 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 17:11:20 smithi115 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-2[61042]: 2024-09-13T17:11:20.176+0000 7f1100fcc640 -1 osd.2 58 *** Got signal Terminated *** 2024-09-13T17:11:20.429 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 17:11:20 smithi115 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-2[61042]: 2024-09-13T17:11:20.176+0000 7f1100fcc640 -1 osd.2 58 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T17:11:20.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:20 smithi195 ceph-mon[80021]: pgmap v155: 65 pgs: 65 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:11:20.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:20 smithi195 ceph-mon[80021]: osd.2 marked itself down and dead 2024-09-13T17:11:20.928 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:20 smithi115 ceph-mon[109488]: pgmap v155: 65 pgs: 65 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:11:20.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:20 smithi115 ceph-mon[109488]: osd.2 marked itself down and dead 2024-09-13T17:11:21.282 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 17:11:21 smithi115 podman[129057]: 2024-09-13 17:11:21.013564826 +0000 UTC m=+0.955787820 container died 7c623823e9206f8dd00911d0d0aa29cbd188703d99996cf9f14a8ce1227f202d (image=quay.ceph.io/ceph-ci/ceph@sha256:c37c250ffe653639d7a4124ac8acdc3c8f6a53cb4ef1f26b1d2df36648631a11, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-2, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=reef-2c01458, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-13T17:11:21.679 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 17:11:21 smithi115 podman[129057]: 2024-09-13 17:11:21.468668826 +0000 UTC m=+1.410891818 container cleanup 7c623823e9206f8dd00911d0d0aa29cbd188703d99996cf9f14a8ce1227f202d (image=quay.ceph.io/ceph-ci/ceph@sha256:c37c250ffe653639d7a4124ac8acdc3c8f6a53cb4ef1f26b1d2df36648631a11, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=reef-2c01458, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-13T17:11:21.679 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 17:11:21 smithi115 bash[129057]: ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-2 2024-09-13T17:11:21.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:21 smithi115 ceph-mon[109488]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T17:11:21.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:21 smithi115 ceph-mon[109488]: osdmap e59: 6 total, 5 up, 6 in 2024-09-13T17:11:21.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:21 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:11:21.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:21 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:11:21.680 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:21 smithi115 ceph-mon[109488]: osdmap e60: 6 total, 5 up, 6 in 2024-09-13T17:11:21.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:21 smithi195 ceph-mon[80021]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T17:11:21.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:21 smithi195 ceph-mon[80021]: osdmap e59: 6 total, 5 up, 6 in 2024-09-13T17:11:21.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:21 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:11:21.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:21 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:11:21.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:21 smithi195 ceph-mon[80021]: osdmap e60: 6 total, 5 up, 6 in 2024-09-13T17:11:22.089 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 17:11:21 smithi115 podman[129072]: 2024-09-13 17:11:21.762252417 +0000 UTC m=+0.746107900 container remove 7c623823e9206f8dd00911d0d0aa29cbd188703d99996cf9f14a8ce1227f202d (image=quay.ceph.io/ceph-ci/ceph@sha256:c37c250ffe653639d7a4124ac8acdc3c8f6a53cb4ef1f26b1d2df36648631a11, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-2, RELEASE=reef-2c01458, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-13T17:11:22.399 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 17:11:22 smithi115 podman[129163]: 2024-09-13 17:11:22.088285579 +0000 UTC m=+0.108268057 container create a5901bf3a5b2339a434aca69a0602e3436572de68a3100339de00609c8132064 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, maintainer=Guillaume Abrioux ) 2024-09-13T17:11:22.399 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 17:11:22 smithi115 podman[129163]: 2024-09-13 17:11:21.995624553 +0000 UTC m=+0.015607045 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T17:11:22.400 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 17:11:22 smithi115 podman[129163]: 2024-09-13 17:11:22.316256681 +0000 UTC m=+0.336239180 container init a5901bf3a5b2339a434aca69a0602e3436572de68a3100339de00609c8132064 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-13T17:11:22.400 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 17:11:22 smithi115 podman[129163]: 2024-09-13 17:11:22.32035877 +0000 UTC m=+0.340341253 container start a5901bf3a5b2339a434aca69a0602e3436572de68a3100339de00609c8132064 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True) 2024-09-13T17:11:22.400 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 17:11:22 smithi115 podman[129163]: 2024-09-13 17:11:22.399008847 +0000 UTC m=+0.418991328 container attach a5901bf3a5b2339a434aca69a0602e3436572de68a3100339de00609c8132064 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-13T17:11:22.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:22 smithi115 ceph-mon[109488]: pgmap v157: 65 pgs: 3 peering, 9 stale+active+clean, 53 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-13T17:11:22.679 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 17:11:22 smithi115 podman[129163]: 2024-09-13 17:11:22.504850374 +0000 UTC m=+0.524832854 container died a5901bf3a5b2339a434aca69a0602e3436572de68a3100339de00609c8132064 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-13T17:11:23.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:22 smithi195 ceph-mon[80021]: pgmap v157: 65 pgs: 3 peering, 9 stale+active+clean, 53 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-13T17:11:23.530 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 17:11:23 smithi115 podman[129186]: 2024-09-13 17:11:23.27788725 +0000 UTC m=+0.766464508 container remove a5901bf3a5b2339a434aca69a0602e3436572de68a3100339de00609c8132064 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T17:11:23.530 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 17:11:23 smithi115 systemd[1]: ceph-ffbd7588-71f0-11ef-bceb-c7b262605968@osd.2.service: Deactivated successfully. 2024-09-13T17:11:23.530 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 17:11:23 smithi115 systemd[1]: Stopped Ceph osd.2 for ffbd7588-71f0-11ef-bceb-c7b262605968. 2024-09-13T17:11:23.530 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 17:11:23 smithi115 systemd[1]: ceph-ffbd7588-71f0-11ef-bceb-c7b262605968@osd.2.service: Consumed 54.791s CPU time. 2024-09-13T17:11:23.880 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:23 smithi115 ceph-mon[109488]: Health check failed: Degraded data redundancy: 17/222 objects degraded (7.658%), 5 pgs degraded (PG_DEGRADED) 2024-09-13T17:11:23.881 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 17:11:23 smithi115 systemd[1]: Starting Ceph osd.2 for ffbd7588-71f0-11ef-bceb-c7b262605968... 2024-09-13T17:11:23.881 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 17:11:23 smithi115 podman[129284]: 2024-09-13 17:11:23.638847255 +0000 UTC m=+0.015600702 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T17:11:23.881 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 17:11:23 smithi115 podman[129284]: 2024-09-13 17:11:23.754647756 +0000 UTC m=+0.131401233 container create 5075811c9b09aa15eaf3233254ec48c8e3310e2b90d9a7d4e75ed3844154cc51 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-2-activate, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2) 2024-09-13T17:11:24.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:23 smithi195 ceph-mon[80021]: Health check failed: Degraded data redundancy: 17/222 objects degraded (7.658%), 5 pgs degraded (PG_DEGRADED) 2024-09-13T17:11:24.179 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 17:11:23 smithi115 podman[129284]: 2024-09-13 17:11:23.982275782 +0000 UTC m=+0.359029217 container init 5075811c9b09aa15eaf3233254ec48c8e3310e2b90d9a7d4e75ed3844154cc51 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-2-activate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-13T17:11:24.179 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 17:11:23 smithi115 podman[129284]: 2024-09-13 17:11:23.985519193 +0000 UTC m=+0.362272635 container start 5075811c9b09aa15eaf3233254ec48c8e3310e2b90d9a7d4e75ed3844154cc51 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-2-activate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-13T17:11:24.179 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 17:11:24 smithi115 podman[129284]: 2024-09-13 17:11:24.082014793 +0000 UTC m=+0.458768256 container attach 5075811c9b09aa15eaf3233254ec48c8e3310e2b90d9a7d4e75ed3844154cc51 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-2-activate, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-13T17:11:24.653 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 17:11:24 smithi115 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-2-activate[129299]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-13T17:11:24.653 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 17:11:24 smithi115 bash[129284]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-13T17:11:24.653 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 17:11:24 smithi115 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-2-activate[129299]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-13T17:11:24.653 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 17:11:24 smithi115 bash[129284]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-13T17:11:24.654 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 17:11:24 smithi115 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-2-activate[129299]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-13T17:11:24.654 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 17:11:24 smithi115 bash[129284]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-13T17:11:24.654 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 17:11:24 smithi115 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-2-activate[129299]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-13T17:11:24.654 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 17:11:24 smithi115 bash[129284]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-13T17:11:24.654 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 17:11:24 smithi115 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-2-activate[129299]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-13T17:11:24.654 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 17:11:24 smithi115 bash[129284]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-13T17:11:24.654 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 17:11:24 smithi115 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-2-activate[129299]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-13T17:11:24.654 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 17:11:24 smithi115 bash[129284]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-13T17:11:24.654 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 17:11:24 smithi115 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-2-activate[129299]: --> ceph-volume raw activate successful for osd ID: 2 2024-09-13T17:11:24.654 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 17:11:24 smithi115 bash[129284]: --> ceph-volume raw activate successful for osd ID: 2 2024-09-13T17:11:24.654 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 17:11:24 smithi115 podman[129284]: 2024-09-13 17:11:24.32666221 +0000 UTC m=+0.703415659 container died 5075811c9b09aa15eaf3233254ec48c8e3310e2b90d9a7d4e75ed3844154cc51 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-2-activate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-13T17:11:24.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:24 smithi195 ceph-mon[80021]: pgmap v159: 65 pgs: 7 active+undersized, 7 peering, 3 stale+active+clean, 5 active+undersized+degraded, 43 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 255 B/s rd, 1 op/s; 17/222 objects degraded (7.658%) 2024-09-13T17:11:24.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:24 smithi115 ceph-mon[109488]: pgmap v159: 65 pgs: 7 active+undersized, 7 peering, 3 stale+active+clean, 5 active+undersized+degraded, 43 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 255 B/s rd, 1 op/s; 17/222 objects degraded (7.658%) 2024-09-13T17:11:25.281 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 17:11:24 smithi115 podman[129425]: 2024-09-13 17:11:24.943992832 +0000 UTC m=+0.611705606 container remove 5075811c9b09aa15eaf3233254ec48c8e3310e2b90d9a7d4e75ed3844154cc51 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-2-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083) 2024-09-13T17:11:25.281 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 17:11:25 smithi115 podman[129484]: 2024-09-13 17:11:25.050631716 +0000 UTC m=+0.015664584 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T17:11:25.281 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 17:11:25 smithi115 podman[129484]: 2024-09-13 17:11:25.153319373 +0000 UTC m=+0.118352241 container create edb753bab54adf30d629c67775863d5a26b7d003451368b3651aa69bfdef4be8 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-13T17:11:25.679 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 17:11:25 smithi115 podman[129484]: 2024-09-13 17:11:25.389501379 +0000 UTC m=+0.354534259 container init edb753bab54adf30d629c67775863d5a26b7d003451368b3651aa69bfdef4be8 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T17:11:25.679 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 17:11:25 smithi115 podman[129484]: 2024-09-13 17:11:25.392780948 +0000 UTC m=+0.357813819 container start edb753bab54adf30d629c67775863d5a26b7d003451368b3651aa69bfdef4be8 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-13T17:11:25.679 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 17:11:25 smithi115 ceph-osd[129503]: -- 172.21.15.115:0/261557320 <== mon.0 v2:172.21.15.115:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x561f7f6e91e0 con 0x561f80468000 2024-09-13T17:11:25.679 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 17:11:25 smithi115 bash[129484]: edb753bab54adf30d629c67775863d5a26b7d003451368b3651aa69bfdef4be8 2024-09-13T17:11:25.679 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 17:11:25 smithi115 systemd[1]: Started Ceph osd.2 for ffbd7588-71f0-11ef-bceb-c7b262605968. 2024-09-13T17:11:26.267 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 17:11:25 smithi115 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-2[129499]: 2024-09-13T17:11:25.937+0000 7fa89b55d640 -1 Falling back to public interface 2024-09-13T17:11:26.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:26 smithi115 ceph-mon[109488]: pgmap v160: 65 pgs: 12 active+undersized, 7 peering, 8 active+undersized+degraded, 38 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 26/222 objects degraded (11.712%) 2024-09-13T17:11:26.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:26 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:11:26.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:26 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:11:26.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:26 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:11:26.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:26 smithi195 ceph-mon[80021]: pgmap v160: 65 pgs: 12 active+undersized, 7 peering, 8 active+undersized+degraded, 38 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 26/222 objects degraded (11.712%) 2024-09-13T17:11:26.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:26 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:11:26.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:26 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:11:26.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:26 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:11:28.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:28 smithi195 ceph-mon[80021]: pgmap v161: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 31/222 objects degraded (13.964%) 2024-09-13T17:11:28.928 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:28 smithi115 ceph-mon[109488]: pgmap v161: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 31/222 objects degraded (13.964%) 2024-09-13T17:11:29.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:29 smithi195 ceph-mon[80021]: Health check update: Degraded data redundancy: 31/222 objects degraded (13.964%), 11 pgs degraded (PG_DEGRADED) 2024-09-13T17:11:29.859 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:29 smithi115 ceph-mon[109488]: Health check update: Degraded data redundancy: 31/222 objects degraded (13.964%), 11 pgs degraded (PG_DEGRADED) 2024-09-13T17:11:30.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:30 smithi195 ceph-mon[80021]: pgmap v162: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 31/222 objects degraded (13.964%) 2024-09-13T17:11:30.846 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:30 smithi115 ceph-mon[109488]: pgmap v162: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 31/222 objects degraded (13.964%) 2024-09-13T17:11:31.178 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 17:11:30 smithi115 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-2[129499]: 2024-09-13T17:11:30.844+0000 7fa89b55d640 -1 osd.2 58 log_to_monitors true 2024-09-13T17:11:31.757 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 17:11:31 smithi115 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-2[129499]: 2024-09-13T17:11:31.573+0000 7fa88f2ee640 -1 osd.2 58 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T17:11:31.757 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:31 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:11:31.757 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:31 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:11:31.757 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:31 smithi115 ceph-mon[109488]: from='osd.2 [v2:172.21.15.115:6818/3735356389,v1:172.21.15.115:6819/3735356389]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-13T17:11:31.757 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:31 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:11:31.757 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:31 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:11:31.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:31 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:11:31.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:31 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:11:31.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:31 smithi195 ceph-mon[80021]: from='osd.2 [v2:172.21.15.115:6818/3735356389,v1:172.21.15.115:6819/3735356389]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-13T17:11:31.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:31 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:11:31.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:31 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:11:32.567 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:32 smithi115 ceph-mon[109488]: pgmap v163: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 31/222 objects degraded (13.964%) 2024-09-13T17:11:32.567 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:32 smithi115 ceph-mon[109488]: from='osd.2 [v2:172.21.15.115:6818/3735356389,v1:172.21.15.115:6819/3735356389]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-13T17:11:32.567 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:32 smithi115 ceph-mon[109488]: osdmap e61: 6 total, 5 up, 6 in 2024-09-13T17:11:32.567 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:32 smithi115 ceph-mon[109488]: from='osd.2 [v2:172.21.15.115:6818/3735356389,v1:172.21.15.115:6819/3735356389]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-13T17:11:32.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:32 smithi195 ceph-mon[80021]: pgmap v163: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 31/222 objects degraded (13.964%) 2024-09-13T17:11:32.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:32 smithi195 ceph-mon[80021]: from='osd.2 [v2:172.21.15.115:6818/3735356389,v1:172.21.15.115:6819/3735356389]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-13T17:11:32.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:32 smithi195 ceph-mon[80021]: osdmap e61: 6 total, 5 up, 6 in 2024-09-13T17:11:32.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:32 smithi195 ceph-mon[80021]: from='osd.2 [v2:172.21.15.115:6818/3735356389,v1:172.21.15.115:6819/3735356389]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-13T17:11:33.522 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:33.518+0000 7fe51fa5a640 1 -- 172.21.15.115:0/1649166302 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe5180fed60 msgr2=0x7fe518102db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:33.522 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:33.518+0000 7fe51fa5a640 1 --2- 172.21.15.115:0/1649166302 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe5180fed60 0x7fe518102db0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe508009880 tx=0x7fe50802a4a0 comp rx=0 tx=0).stop 2024-09-13T17:11:33.522 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:33.518+0000 7fe51fa5a640 1 -- 172.21.15.115:0/1649166302 shutdown_connections 2024-09-13T17:11:33.522 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:33.518+0000 7fe51fa5a640 1 --2- 172.21.15.115:0/1649166302 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe5180fed60 0x7fe518102db0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:33.522 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:33.518+0000 7fe51fa5a640 1 --2- 172.21.15.115:0/1649166302 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe5180fe3b0 0x7fe5180fe790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:33.522 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:33.518+0000 7fe51fa5a640 1 -- 172.21.15.115:0/1649166302 >> 172.21.15.115:0/1649166302 conn(0x7fe5180f9e30 msgr2=0x7fe5180fc250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:33.522 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:33.518+0000 7fe51fa5a640 1 -- 172.21.15.115:0/1649166302 shutdown_connections 2024-09-13T17:11:33.523 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:33.518+0000 7fe51fa5a640 1 -- 172.21.15.115:0/1649166302 wait complete. 2024-09-13T17:11:33.523 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:33.519+0000 7fe51fa5a640 1 Processor -- start 2024-09-13T17:11:33.523 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:33.519+0000 7fe51fa5a640 1 -- start start 2024-09-13T17:11:33.523 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:33.519+0000 7fe51fa5a640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe5180fe3b0 0x7fe51819b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:33.523 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:33.519+0000 7fe51fa5a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe5180fed60 0x7fe51819bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:33.523 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:33.519+0000 7fe51fa5a640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5181959c0 con 0x7fe5180fed60 2024-09-13T17:11:33.523 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:33.519+0000 7fe51fa5a640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe518195b00 con 0x7fe5180fe3b0 2024-09-13T17:11:33.523 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:33.519+0000 7fe51cff5640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe5180fed60 0x7fe51819bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:33.523 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:33.519+0000 7fe51cff5640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe5180fed60 0x7fe51819bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56650/0 (socket says 172.21.15.115:56650) 2024-09-13T17:11:33.524 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:33.519+0000 7fe51cff5640 1 -- 172.21.15.115:0/3670233185 learned_addr learned my addr 172.21.15.115:0/3670233185 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:11:33.524 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:33.519+0000 7fe51d7f6640 1 --2- 172.21.15.115:0/3670233185 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe5180fe3b0 0x7fe51819b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:33.524 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:33.519+0000 7fe51cff5640 1 -- 172.21.15.115:0/3670233185 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe5180fe3b0 msgr2=0x7fe51819b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:33.524 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:33.519+0000 7fe51cff5640 1 --2- 172.21.15.115:0/3670233185 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe5180fe3b0 0x7fe51819b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:33.524 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:33.519+0000 7fe51cff5640 1 -- 172.21.15.115:0/3670233185 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe508009560 con 0x7fe5180fed60 2024-09-13T17:11:33.524 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:33.519+0000 7fe51cff5640 1 --2- 172.21.15.115:0/3670233185 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe5180fed60 0x7fe51819bea0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe50802a9c0 tx=0x7fe5080055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:33.524 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:33.520+0000 7fe50e7fc640 1 -- 172.21.15.115:0/3670233185 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe508004b60 con 0x7fe5180fed60 2024-09-13T17:11:33.524 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:33.520+0000 7fe51fa5a640 1 -- 172.21.15.115:0/3670233185 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe518195d80 con 0x7fe5180fed60 2024-09-13T17:11:33.524 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:33.520+0000 7fe51fa5a640 1 -- 172.21.15.115:0/3670233185 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe518196270 con 0x7fe5180fed60 2024-09-13T17:11:33.524 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:33.520+0000 7fe50e7fc640 1 -- 172.21.15.115:0/3670233185 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe508004cc0 con 0x7fe5180fed60 2024-09-13T17:11:33.525 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:33.520+0000 7fe50e7fc640 1 -- 172.21.15.115:0/3670233185 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5080318f0 con 0x7fe5180fed60 2024-09-13T17:11:33.525 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:33.521+0000 7fe51fa5a640 1 -- 172.21.15.115:0/3670233185 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5180ff890 con 0x7fe5180fed60 2024-09-13T17:11:33.526 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:33.521+0000 7fe50e7fc640 1 -- 172.21.15.115:0/3670233185 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fe508003c20 con 0x7fe5180fed60 2024-09-13T17:11:33.526 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:33.522+0000 7fe50e7fc640 1 --2- 172.21.15.115:0/3670233185 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fe50406cc50 0x7fe50406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:33.526 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:33.522+0000 7fe50e7fc640 1 -- 172.21.15.115:0/3670233185 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fe5080ad5f0 con 0x7fe5180fed60 2024-09-13T17:11:33.526 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:33.522+0000 7fe51d7f6640 1 --2- 172.21.15.115:0/3670233185 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fe50406cc50 0x7fe50406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:33.526 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:33.523+0000 7fe51d7f6640 1 --2- 172.21.15.115:0/3670233185 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fe50406cc50 0x7fe50406f110 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe514005fd0 tx=0x7fe51400b590 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:33.528 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:33.527+0000 7fe50e7fc640 1 -- 172.21.15.115:0/3670233185 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe508077710 con 0x7fe5180fed60 2024-09-13T17:11:33.733 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:33.732+0000 7fe51fa5a640 1 -- 172.21.15.115:0/3670233185 --> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe518196ef0 con 0x7fe50406cc50 2024-09-13T17:11:33.734 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:33 smithi115 ceph-mon[109488]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T17:11:33.734 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:33 smithi115 ceph-mon[109488]: osd.2 [v2:172.21.15.115:6818/3735356389,v1:172.21.15.115:6819/3735356389] boot 2024-09-13T17:11:33.734 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:33 smithi115 ceph-mon[109488]: osdmap e62: 6 total, 6 up, 6 in 2024-09-13T17:11:33.734 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:33 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T17:11:33.734 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:33.733+0000 7fe50e7fc640 1 -- 172.21.15.115:0/3670233185 <== mgr.14660 v2:172.21.15.115:6800/1049502673 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fe518196ef0 con 0x7fe50406cc50 2024-09-13T17:11:33.737 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:33.735+0000 7fe51fa5a640 1 -- 172.21.15.115:0/3670233185 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fe50406cc50 msgr2=0x7fe50406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:33.737 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:33.735+0000 7fe51fa5a640 1 --2- 172.21.15.115:0/3670233185 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fe50406cc50 0x7fe50406f110 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe514005fd0 tx=0x7fe51400b590 comp rx=0 tx=0).stop 2024-09-13T17:11:33.737 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:33.735+0000 7fe51fa5a640 1 -- 172.21.15.115:0/3670233185 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe5180fed60 msgr2=0x7fe51819bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:33.737 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:33.735+0000 7fe51fa5a640 1 --2- 172.21.15.115:0/3670233185 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe5180fed60 0x7fe51819bea0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe50802a9c0 tx=0x7fe5080055a0 comp rx=0 tx=0).stop 2024-09-13T17:11:33.737 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:33.735+0000 7fe51fa5a640 1 -- 172.21.15.115:0/3670233185 shutdown_connections 2024-09-13T17:11:33.737 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:33.735+0000 7fe51fa5a640 1 --2- 172.21.15.115:0/3670233185 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fe50406cc50 0x7fe50406f110 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:33.737 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:33.735+0000 7fe51fa5a640 1 --2- 172.21.15.115:0/3670233185 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe5180fed60 0x7fe51819bea0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:33.737 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:33.735+0000 7fe51fa5a640 1 --2- 172.21.15.115:0/3670233185 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe5180fe3b0 0x7fe51819b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:33.737 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:33.735+0000 7fe51fa5a640 1 -- 172.21.15.115:0/3670233185 >> 172.21.15.115:0/3670233185 conn(0x7fe5180f9e30 msgr2=0x7fe518101f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:33.738 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:33.735+0000 7fe51fa5a640 1 -- 172.21.15.115:0/3670233185 shutdown_connections 2024-09-13T17:11:33.738 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:33.735+0000 7fe51fa5a640 1 -- 172.21.15.115:0/3670233185 wait complete. 2024-09-13T17:11:33.745 INFO:teuthology.orchestra.run.smithi115.stdout:true 2024-09-13T17:11:33.820 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:33.818+0000 7f9dea1c7640 1 -- 172.21.15.115:0/81128947 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9de40fe9a0 msgr2=0x7f9de40fee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:33.820 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:33.818+0000 7f9dea1c7640 1 --2- 172.21.15.115:0/81128947 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9de40fe9a0 0x7f9de40fee00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc009c20 tx=0x7f9dcc02a970 comp rx=0 tx=0).stop 2024-09-13T17:11:33.820 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:33.818+0000 7f9dea1c7640 1 -- 172.21.15.115:0/81128947 shutdown_connections 2024-09-13T17:11:33.821 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:33.818+0000 7f9dea1c7640 1 --2- 172.21.15.115:0/81128947 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9de40fe9a0 0x7f9de40fee00 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:33.821 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:33.818+0000 7f9dea1c7640 1 --2- 172.21.15.115:0/81128947 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9de41049a0 0x7f9de4104d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:33.821 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:33.818+0000 7f9dea1c7640 1 -- 172.21.15.115:0/81128947 >> 172.21.15.115:0/81128947 conn(0x7f9de40758c0 msgr2=0x7f9de40fcc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:33.821 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:33.818+0000 7f9dea1c7640 1 -- 172.21.15.115:0/81128947 shutdown_connections 2024-09-13T17:11:33.821 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:33.818+0000 7f9dea1c7640 1 -- 172.21.15.115:0/81128947 wait complete. 2024-09-13T17:11:33.821 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:33.819+0000 7f9dea1c7640 1 Processor -- start 2024-09-13T17:11:33.821 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:33.819+0000 7f9dea1c7640 1 -- start start 2024-09-13T17:11:33.823 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:33.819+0000 7f9dea1c7640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9de40fe9a0 0x7f9de419b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:33.823 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:33.819+0000 7f9dea1c7640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9de41049a0 0x7f9de419bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:33.823 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:33.819+0000 7f9dea1c7640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9de419c380 con 0x7f9de40fe9a0 2024-09-13T17:11:33.823 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:33.819+0000 7f9dea1c7640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9de4195910 con 0x7f9de41049a0 2024-09-13T17:11:33.823 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:33.820+0000 7f9de37fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9de40fe9a0 0x7f9de419b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:33.823 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:33.820+0000 7f9de37fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9de40fe9a0 0x7f9de419b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56668/0 (socket says 172.21.15.115:56668) 2024-09-13T17:11:33.823 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:33.820+0000 7f9de37fe640 1 -- 172.21.15.115:0/3347506681 learned_addr learned my addr 172.21.15.115:0/3347506681 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:11:33.823 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:33.820+0000 7f9de2ffd640 1 --2- 172.21.15.115:0/3347506681 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9de41049a0 0x7f9de419bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:33.823 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:33.820+0000 7f9de37fe640 1 -- 172.21.15.115:0/3347506681 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9de41049a0 msgr2=0x7f9de419bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:33.823 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:33.820+0000 7f9de37fe640 1 --2- 172.21.15.115:0/3347506681 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9de41049a0 0x7f9de419bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:33.823 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:33.820+0000 7f9de37fe640 1 -- 172.21.15.115:0/3347506681 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dcc009900 con 0x7f9de40fe9a0 2024-09-13T17:11:33.823 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:33.820+0000 7f9de37fe640 1 --2- 172.21.15.115:0/3347506681 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9de40fe9a0 0x7f9de419b820 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9dd400b420 tx=0x7f9dd400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:33.824 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:33.820+0000 7f9de0ff9640 1 -- 172.21.15.115:0/3347506681 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9dd4011800 con 0x7f9de40fe9a0 2024-09-13T17:11:33.824 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:33.820+0000 7f9de0ff9640 1 -- 172.21.15.115:0/3347506681 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9dd4011e00 con 0x7f9de40fe9a0 2024-09-13T17:11:33.824 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:33.820+0000 7f9dea1c7640 1 -- 172.21.15.115:0/3347506681 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9de4195bf0 con 0x7f9de40fe9a0 2024-09-13T17:11:33.824 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:33.820+0000 7f9de0ff9640 1 -- 172.21.15.115:0/3347506681 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9dd400f2e0 con 0x7f9de40fe9a0 2024-09-13T17:11:33.824 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:33.820+0000 7f9dea1c7640 1 -- 172.21.15.115:0/3347506681 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9de4196110 con 0x7f9de40fe9a0 2024-09-13T17:11:33.824 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:33.821+0000 7f9dea1c7640 1 -- 172.21.15.115:0/3347506681 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9de41000e0 con 0x7f9de40fe9a0 2024-09-13T17:11:33.824 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:33.822+0000 7f9de0ff9640 1 -- 172.21.15.115:0/3347506681 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f9dd400f550 con 0x7f9de40fe9a0 2024-09-13T17:11:33.825 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:33.822+0000 7f9de0ff9640 1 --2- 172.21.15.115:0/3347506681 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f9dd006cc50 0x7f9dd006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:33.825 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:33.822+0000 7f9de0ff9640 1 -- 172.21.15.115:0/3347506681 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f9dd408beb0 con 0x7f9de40fe9a0 2024-09-13T17:11:33.825 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:33.822+0000 7f9de2ffd640 1 --2- 172.21.15.115:0/3347506681 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f9dd006cc50 0x7f9dd006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:33.825 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:33.823+0000 7f9de2ffd640 1 --2- 172.21.15.115:0/3347506681 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f9dd006cc50 0x7f9dd006f110 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc000f80 tx=0x7f9dcc009860 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:33.827 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:33.826+0000 7f9de0ff9640 1 -- 172.21.15.115:0/3347506681 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f9dd4056040 con 0x7f9de40fe9a0 2024-09-13T17:11:34.008 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.006+0000 7f9dea1c7640 1 -- 172.21.15.115:0/3347506681 --> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9de410bb50 con 0x7f9dd006cc50 2024-09-13T17:11:34.009 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.008+0000 7f9de0ff9640 1 -- 172.21.15.115:0/3347506681 <== mgr.14660 v2:172.21.15.115:6800/1049502673 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f9de410bb50 con 0x7f9dd006cc50 2024-09-13T17:11:34.011 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.009+0000 7f9dea1c7640 1 -- 172.21.15.115:0/3347506681 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f9dd006cc50 msgr2=0x7f9dd006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:34.011 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.009+0000 7f9dea1c7640 1 --2- 172.21.15.115:0/3347506681 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f9dd006cc50 0x7f9dd006f110 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc000f80 tx=0x7f9dcc009860 comp rx=0 tx=0).stop 2024-09-13T17:11:34.011 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.009+0000 7f9dea1c7640 1 -- 172.21.15.115:0/3347506681 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9de40fe9a0 msgr2=0x7f9de419b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:34.011 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.009+0000 7f9dea1c7640 1 --2- 172.21.15.115:0/3347506681 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9de40fe9a0 0x7f9de419b820 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9dd400b420 tx=0x7f9dd400b8e0 comp rx=0 tx=0).stop 2024-09-13T17:11:34.011 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.009+0000 7f9dea1c7640 1 -- 172.21.15.115:0/3347506681 shutdown_connections 2024-09-13T17:11:34.011 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.009+0000 7f9dea1c7640 1 --2- 172.21.15.115:0/3347506681 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f9dd006cc50 0x7f9dd006f110 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:34.011 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.009+0000 7f9dea1c7640 1 --2- 172.21.15.115:0/3347506681 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9de41049a0 0x7f9de419bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:34.011 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.009+0000 7f9dea1c7640 1 --2- 172.21.15.115:0/3347506681 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9de40fe9a0 0x7f9de419b820 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:34.011 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.010+0000 7f9dea1c7640 1 -- 172.21.15.115:0/3347506681 >> 172.21.15.115:0/3347506681 conn(0x7f9de40758c0 msgr2=0x7f9de40fd970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:34.012 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.010+0000 7f9dea1c7640 1 -- 172.21.15.115:0/3347506681 shutdown_connections 2024-09-13T17:11:34.012 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.010+0000 7f9dea1c7640 1 -- 172.21.15.115:0/3347506681 wait complete. 2024-09-13T17:11:34.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:33 smithi195 ceph-mon[80021]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T17:11:34.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:33 smithi195 ceph-mon[80021]: osd.2 [v2:172.21.15.115:6818/3735356389,v1:172.21.15.115:6819/3735356389] boot 2024-09-13T17:11:34.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:33 smithi195 ceph-mon[80021]: osdmap e62: 6 total, 6 up, 6 in 2024-09-13T17:11:34.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:33 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T17:11:34.093 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.092+0000 7feb2dfab640 1 -- 172.21.15.115:0/3518194429 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb28104a20 msgr2=0x7feb28104e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:34.093 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.092+0000 7feb2dfab640 1 --2- 172.21.15.115:0/3518194429 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb28104a20 0x7feb28104e00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7feb18009880 tx=0x7feb1802a4a0 comp rx=0 tx=0).stop 2024-09-13T17:11:34.093 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.092+0000 7feb2dfab640 1 -- 172.21.15.115:0/3518194429 shutdown_connections 2024-09-13T17:11:34.093 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.092+0000 7feb2dfab640 1 --2- 172.21.15.115:0/3518194429 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb280fea20 0x7feb280fee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:34.093 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.092+0000 7feb2dfab640 1 --2- 172.21.15.115:0/3518194429 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb28104a20 0x7feb28104e00 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:34.093 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.092+0000 7feb2dfab640 1 -- 172.21.15.115:0/3518194429 >> 172.21.15.115:0/3518194429 conn(0x7feb280fa720 msgr2=0x7feb280fcb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:34.094 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.092+0000 7feb2dfab640 1 -- 172.21.15.115:0/3518194429 shutdown_connections 2024-09-13T17:11:34.094 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.092+0000 7feb2dfab640 1 -- 172.21.15.115:0/3518194429 wait complete. 2024-09-13T17:11:34.095 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.092+0000 7feb2dfab640 1 Processor -- start 2024-09-13T17:11:34.095 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.093+0000 7feb2dfab640 1 -- start start 2024-09-13T17:11:34.095 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.093+0000 7feb2dfab640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb280fea20 0x7feb2819a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:34.096 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.093+0000 7feb2dfab640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb28104a20 0x7feb2819ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:34.096 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.093+0000 7feb2dfab640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb2819b180 con 0x7feb280fea20 2024-09-13T17:11:34.096 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.093+0000 7feb2dfab640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb28194710 con 0x7feb28104a20 2024-09-13T17:11:34.096 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.093+0000 7feb277fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb280fea20 0x7feb2819a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:34.096 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.093+0000 7feb277fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb280fea20 0x7feb2819a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57312/0 (socket says 172.21.15.115:57312) 2024-09-13T17:11:34.096 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.093+0000 7feb277fe640 1 -- 172.21.15.115:0/762520406 learned_addr learned my addr 172.21.15.115:0/762520406 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:11:34.096 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.093+0000 7feb1effd640 1 --2- 172.21.15.115:0/762520406 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb28104a20 0x7feb2819ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:34.096 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.093+0000 7feb277fe640 1 -- 172.21.15.115:0/762520406 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb28104a20 msgr2=0x7feb2819ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:34.096 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.093+0000 7feb277fe640 1 --2- 172.21.15.115:0/762520406 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb28104a20 0x7feb2819ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:34.096 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.093+0000 7feb277fe640 1 -- 172.21.15.115:0/762520406 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb18009560 con 0x7feb280fea20 2024-09-13T17:11:34.096 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.094+0000 7feb277fe640 1 --2- 172.21.15.115:0/762520406 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb280fea20 0x7feb2819a620 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7feb18006010 tx=0x7feb180056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:34.096 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.094+0000 7feb257fa640 1 -- 172.21.15.115:0/762520406 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb1803e070 con 0x7feb280fea20 2024-09-13T17:11:34.097 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.094+0000 7feb257fa640 1 -- 172.21.15.115:0/762520406 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7feb180035f0 con 0x7feb280fea20 2024-09-13T17:11:34.097 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.094+0000 7feb2dfab640 1 -- 172.21.15.115:0/762520406 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb28194990 con 0x7feb280fea20 2024-09-13T17:11:34.097 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.094+0000 7feb257fa640 1 -- 172.21.15.115:0/762520406 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb18031790 con 0x7feb280fea20 2024-09-13T17:11:34.097 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.094+0000 7feb2dfab640 1 -- 172.21.15.115:0/762520406 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb28194e80 con 0x7feb280fea20 2024-09-13T17:11:34.098 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.095+0000 7feb2dfab640 1 -- 172.21.15.115:0/762520406 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb28100160 con 0x7feb280fea20 2024-09-13T17:11:34.098 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.095+0000 7feb257fa640 1 -- 172.21.15.115:0/762520406 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7feb18004b20 con 0x7feb280fea20 2024-09-13T17:11:34.098 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.096+0000 7feb257fa640 1 --2- 172.21.15.115:0/762520406 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7feb1406cc50 0x7feb1406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:34.098 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.096+0000 7feb257fa640 1 -- 172.21.15.115:0/762520406 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6156+0+0 (secure 0 0 0) 0x7feb180ae920 con 0x7feb280fea20 2024-09-13T17:11:34.098 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.096+0000 7feb1effd640 1 --2- 172.21.15.115:0/762520406 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7feb1406cc50 0x7feb1406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:34.098 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.096+0000 7feb1effd640 1 --2- 172.21.15.115:0/762520406 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7feb1406cc50 0x7feb1406f110 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7feb28195b80 tx=0x7feb10005c60 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:34.101 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.100+0000 7feb257fa640 1 -- 172.21.15.115:0/762520406 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7feb18078ac0 con 0x7feb280fea20 2024-09-13T17:11:34.283 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.282+0000 7feb2dfab640 1 -- 172.21.15.115:0/762520406 --> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7feb2810bb50 con 0x7feb1406cc50 2024-09-13T17:11:34.292 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.291+0000 7feb257fa640 1 -- 172.21.15.115:0/762520406 <== mgr.14660 v2:172.21.15.115:6800/1049502673 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7feb2810bb50 con 0x7feb1406cc50 2024-09-13T17:11:34.293 INFO:teuthology.orchestra.run.smithi115.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T17:11:34.293 INFO:teuthology.orchestra.run.smithi115.stdout:alertmanager.smithi115 smithi115 *:9093,9094 running (3m) 3s ago 13m 25.0M - 0.25.0 c8568f914cd2 d56b91240fe1 2024-09-13T17:11:34.293 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-exporter.smithi115 smithi115 running (13m) 3s ago 13m 8376k - 18.2.4-843-g2c01458a c129f5a2fd4e 0f1eebeaf9bb 2024-09-13T17:11:34.293 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-exporter.smithi195 smithi195 running (12m) 92s ago 12m 7792k - 18.2.4-843-g2c01458a c129f5a2fd4e 6d05bafbac8a 2024-09-13T17:11:34.293 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi115 smithi115 running (99s) 3s ago 13m 6895k - 18.2.4-860-g6c6b083f 8a91f241d7d4 e8175bc055bf 2024-09-13T17:11:34.293 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi195 smithi195 running (95s) 92s ago 12m 6903k - 18.2.4-860-g6c6b083f 8a91f241d7d4 ccb4895be776 2024-09-13T17:11:34.293 INFO:teuthology.orchestra.run.smithi115.stdout:grafana.smithi115 smithi115 *:3000 running (3m) 3s ago 13m 80.6M - 9.4.7 954c08fa6188 e1eccb1a8f3e 2024-09-13T17:11:34.293 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi115.hbtxod smithi115 running (8m) 3s ago 8m 98.5M - 18.2.4-843-g2c01458a c129f5a2fd4e 12b4f4874491 2024-09-13T17:11:34.293 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi115.ijznvr smithi115 running (8m) 3s ago 8m 166M - 18.2.4-843-g2c01458a c129f5a2fd4e 2d552564a9f4 2024-09-13T17:11:34.293 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi195.aevvgz smithi195 running (8m) 92s ago 8m 17.5M - 18.2.4-843-g2c01458a c129f5a2fd4e 299b9ad657c9 2024-09-13T17:11:34.294 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi195.qzghxj smithi195 running (8m) 92s ago 8m 15.5M - 18.2.4-843-g2c01458a c129f5a2fd4e fb16b16181ff 2024-09-13T17:11:34.294 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi115.hetcni smithi115 *:8443,9283,8765 running (5m) 3s ago 14m 494M - 18.2.4-860-g6c6b083f 8a91f241d7d4 b945dbde1934 2024-09-13T17:11:34.294 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi195.hjjifz smithi195 *:8443,9283,8765 running (4m) 92s ago 12m 440M - 18.2.4-860-g6c6b083f 8a91f241d7d4 17bccdfbcae1 2024-09-13T17:11:34.294 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi115 smithi115 running (2m) 3s ago 15m 40.7M 2048M 18.2.4-860-g6c6b083f 8a91f241d7d4 8dd7baf2c6b6 2024-09-13T17:11:34.294 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi195 smithi195 running (111s) 92s ago 12m 26.0M 2048M 18.2.4-860-g6c6b083f 8a91f241d7d4 0459bc5e6b08 2024-09-13T17:11:34.294 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi115 smithi115 *:9100 running (4m) 3s ago 13m 16.5M - 1.5.0 0da6a335fe13 26fb6f9844b5 2024-09-13T17:11:34.294 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi195 smithi195 *:9100 running (3m) 92s ago 12m 16.8M - 1.5.0 0da6a335fe13 6d38e798fb16 2024-09-13T17:11:34.294 INFO:teuthology.orchestra.run.smithi115.stdout:osd.0 smithi115 running (76s) 3s ago 11m 99.7M 1216M 18.2.4-860-g6c6b083f 8a91f241d7d4 3b9f874c64e9 2024-09-13T17:11:34.294 INFO:teuthology.orchestra.run.smithi115.stdout:osd.1 smithi115 running (43s) 3s ago 11m 101M 1216M 18.2.4-860-g6c6b083f 8a91f241d7d4 f0de6684601c 2024-09-13T17:11:34.294 INFO:teuthology.orchestra.run.smithi115.stdout:osd.2 smithi115 running (9s) 3s ago 10m 13.6M 1216M 18.2.4-860-g6c6b083f 8a91f241d7d4 edb753bab54a 2024-09-13T17:11:34.294 INFO:teuthology.orchestra.run.smithi115.stdout:osd.3 smithi195 running (10m) 92s ago 10m 294M 2240M 18.2.4-843-g2c01458a c129f5a2fd4e 10ea833fd5c5 2024-09-13T17:11:34.294 INFO:teuthology.orchestra.run.smithi115.stdout:osd.4 smithi195 running (10m) 92s ago 10m 265M 2240M 18.2.4-843-g2c01458a c129f5a2fd4e 4bbc3acb9aff 2024-09-13T17:11:34.294 INFO:teuthology.orchestra.run.smithi115.stdout:osd.5 smithi195 running (9m) 92s ago 9m 237M 2240M 18.2.4-843-g2c01458a c129f5a2fd4e 4bd1b3a232d0 2024-09-13T17:11:34.294 INFO:teuthology.orchestra.run.smithi115.stdout:prometheus.smithi115 smithi115 *:9095 running (3m) 3s ago 13m 64.3M - 2.43.0 a07b618ecd1d e03fb39f6b76 2024-09-13T17:11:34.295 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.293+0000 7feb2dfab640 1 -- 172.21.15.115:0/762520406 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7feb1406cc50 msgr2=0x7feb1406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:34.295 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.293+0000 7feb2dfab640 1 --2- 172.21.15.115:0/762520406 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7feb1406cc50 0x7feb1406f110 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7feb28195b80 tx=0x7feb10005c60 comp rx=0 tx=0).stop 2024-09-13T17:11:34.295 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.294+0000 7feb2dfab640 1 -- 172.21.15.115:0/762520406 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb280fea20 msgr2=0x7feb2819a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:34.295 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.294+0000 7feb2dfab640 1 --2- 172.21.15.115:0/762520406 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb280fea20 0x7feb2819a620 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7feb18006010 tx=0x7feb180056e0 comp rx=0 tx=0).stop 2024-09-13T17:11:34.296 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.294+0000 7feb2dfab640 1 -- 172.21.15.115:0/762520406 shutdown_connections 2024-09-13T17:11:34.296 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.294+0000 7feb2dfab640 1 --2- 172.21.15.115:0/762520406 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7feb1406cc50 0x7feb1406f110 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:34.296 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.294+0000 7feb2dfab640 1 --2- 172.21.15.115:0/762520406 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb28104a20 0x7feb2819ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:34.296 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.294+0000 7feb2dfab640 1 --2- 172.21.15.115:0/762520406 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb280fea20 0x7feb2819a620 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:34.296 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.294+0000 7feb2dfab640 1 -- 172.21.15.115:0/762520406 >> 172.21.15.115:0/762520406 conn(0x7feb280fa720 msgr2=0x7feb280fc850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:34.296 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.294+0000 7feb2dfab640 1 -- 172.21.15.115:0/762520406 shutdown_connections 2024-09-13T17:11:34.296 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.294+0000 7feb2dfab640 1 -- 172.21.15.115:0/762520406 wait complete. 2024-09-13T17:11:34.376 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.374+0000 7f611bd17640 1 -- 172.21.15.115:0/1570683334 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61141049a0 msgr2=0x7f6114104d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:34.376 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.374+0000 7f611bd17640 1 --2- 172.21.15.115:0/1570683334 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61141049a0 0x7f6114104d80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f610c009880 tx=0x7f610c02a4a0 comp rx=0 tx=0).stop 2024-09-13T17:11:34.376 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.374+0000 7f611bd17640 1 -- 172.21.15.115:0/1570683334 shutdown_connections 2024-09-13T17:11:34.376 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.374+0000 7f611bd17640 1 --2- 172.21.15.115:0/1570683334 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61140fe9a0 0x7f61140fee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:34.376 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.374+0000 7f611bd17640 1 --2- 172.21.15.115:0/1570683334 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61141049a0 0x7f6114104d80 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:34.376 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.374+0000 7f611bd17640 1 -- 172.21.15.115:0/1570683334 >> 172.21.15.115:0/1570683334 conn(0x7f61140758c0 msgr2=0x7f61140fcc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:34.376 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.375+0000 7f611bd17640 1 -- 172.21.15.115:0/1570683334 shutdown_connections 2024-09-13T17:11:34.376 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.375+0000 7f611bd17640 1 -- 172.21.15.115:0/1570683334 wait complete. 2024-09-13T17:11:34.378 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.375+0000 7f611bd17640 1 Processor -- start 2024-09-13T17:11:34.378 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.375+0000 7f611bd17640 1 -- start start 2024-09-13T17:11:34.378 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.375+0000 7f611bd17640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61140fe9a0 0x7f61141959f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:34.378 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.375+0000 7f611bd17640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61141049a0 0x7f6114195f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:34.378 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.375+0000 7f611bd17640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6114196610 con 0x7f61140fe9a0 2024-09-13T17:11:34.379 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.375+0000 7f611bd17640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f611419a360 con 0x7f61141049a0 2024-09-13T17:11:34.379 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.375+0000 7f6119ab3640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61140fe9a0 0x7f61141959f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:34.379 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.376+0000 7f6119ab3640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61140fe9a0 0x7f61141959f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57316/0 (socket says 172.21.15.115:57316) 2024-09-13T17:11:34.379 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.376+0000 7f6119ab3640 1 -- 172.21.15.115:0/782117267 learned_addr learned my addr 172.21.15.115:0/782117267 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:11:34.379 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.376+0000 7f61192b2640 1 --2- 172.21.15.115:0/782117267 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61141049a0 0x7f6114195f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:34.379 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.376+0000 7f6119ab3640 1 -- 172.21.15.115:0/782117267 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61141049a0 msgr2=0x7f6114195f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:34.379 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.376+0000 7f6119ab3640 1 --2- 172.21.15.115:0/782117267 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61141049a0 0x7f6114195f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:34.379 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.376+0000 7f6119ab3640 1 -- 172.21.15.115:0/782117267 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f610c009560 con 0x7f61140fe9a0 2024-09-13T17:11:34.379 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.376+0000 7f6119ab3640 1 --2- 172.21.15.115:0/782117267 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61140fe9a0 0x7f61141959f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f610c006010 tx=0x7f610c0056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:34.379 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.376+0000 7f6112ffd640 1 -- 172.21.15.115:0/782117267 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f610c004ba0 con 0x7f61140fe9a0 2024-09-13T17:11:34.379 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.376+0000 7f6112ffd640 1 -- 172.21.15.115:0/782117267 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f610c004d00 con 0x7f61140fe9a0 2024-09-13T17:11:34.379 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.376+0000 7f611bd17640 1 -- 172.21.15.115:0/782117267 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f611419a5e0 con 0x7f61140fe9a0 2024-09-13T17:11:34.379 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.376+0000 7f6112ffd640 1 -- 172.21.15.115:0/782117267 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f610c031910 con 0x7f61140fe9a0 2024-09-13T17:11:34.379 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.376+0000 7f611bd17640 1 -- 172.21.15.115:0/782117267 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f611419aad0 con 0x7f61140fe9a0 2024-09-13T17:11:34.380 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.377+0000 7f611bd17640 1 -- 172.21.15.115:0/782117267 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61141000e0 con 0x7f61140fe9a0 2024-09-13T17:11:34.380 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.378+0000 7f6112ffd640 1 -- 172.21.15.115:0/782117267 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f610c031b80 con 0x7f61140fe9a0 2024-09-13T17:11:34.380 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.378+0000 7f6112ffd640 1 --2- 172.21.15.115:0/782117267 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f60fc06cc50 0x7f60fc06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:34.380 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.378+0000 7f6112ffd640 1 -- 172.21.15.115:0/782117267 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f610c0ad670 con 0x7f61140fe9a0 2024-09-13T17:11:34.381 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.378+0000 7f61192b2640 1 --2- 172.21.15.115:0/782117267 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f60fc06cc50 0x7f60fc06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:34.381 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.379+0000 7f61192b2640 1 --2- 172.21.15.115:0/782117267 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f60fc06cc50 0x7f60fc06f110 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6114196fa0 tx=0x7f610800a250 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:34.384 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.383+0000 7f6112ffd640 1 -- 172.21.15.115:0/782117267 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f610c077840 con 0x7f61140fe9a0 2024-09-13T17:11:34.612 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.610+0000 7f611bd17640 1 -- 172.21.15.115:0/782117267 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f611410baf0 con 0x7f61140fe9a0 2024-09-13T17:11:34.612 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.611+0000 7f6112ffd640 1 -- 172.21.15.115:0/782117267 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+837 (secure 0 0 0) 0x7f610c07ae60 con 0x7f61140fe9a0 2024-09-13T17:11:34.612 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-13T17:11:34.613 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": { 2024-09-13T17:11:34.613 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 2 2024-09-13T17:11:34.613 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T17:11:34.613 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": { 2024-09-13T17:11:34.613 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 2 2024-09-13T17:11:34.613 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T17:11:34.613 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": { 2024-09-13T17:11:34.613 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-843-g2c01458a (2c01458affee2b2435cd231b6e392435c1c21661) reef (stable)": 3, 2024-09-13T17:11:34.613 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 3 2024-09-13T17:11:34.613 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T17:11:34.614 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": { 2024-09-13T17:11:34.614 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-843-g2c01458a (2c01458affee2b2435cd231b6e392435c1c21661) reef (stable)": 4 2024-09-13T17:11:34.614 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T17:11:34.614 INFO:teuthology.orchestra.run.smithi115.stdout: "overall": { 2024-09-13T17:11:34.614 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-843-g2c01458a (2c01458affee2b2435cd231b6e392435c1c21661) reef (stable)": 7, 2024-09-13T17:11:34.614 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 7 2024-09-13T17:11:34.614 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-13T17:11:34.614 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-13T17:11:34.615 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.613+0000 7f611bd17640 1 -- 172.21.15.115:0/782117267 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f60fc06cc50 msgr2=0x7f60fc06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:34.615 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.613+0000 7f611bd17640 1 --2- 172.21.15.115:0/782117267 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f60fc06cc50 0x7f60fc06f110 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6114196fa0 tx=0x7f610800a250 comp rx=0 tx=0).stop 2024-09-13T17:11:34.615 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.613+0000 7f611bd17640 1 -- 172.21.15.115:0/782117267 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61140fe9a0 msgr2=0x7f61141959f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:34.615 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.613+0000 7f611bd17640 1 --2- 172.21.15.115:0/782117267 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61140fe9a0 0x7f61141959f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f610c006010 tx=0x7f610c0056e0 comp rx=0 tx=0).stop 2024-09-13T17:11:34.615 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.613+0000 7f611bd17640 1 -- 172.21.15.115:0/782117267 shutdown_connections 2024-09-13T17:11:34.615 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.613+0000 7f611bd17640 1 --2- 172.21.15.115:0/782117267 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f60fc06cc50 0x7f60fc06f110 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:34.615 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.613+0000 7f611bd17640 1 --2- 172.21.15.115:0/782117267 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61141049a0 0x7f6114195f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:34.615 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.613+0000 7f611bd17640 1 --2- 172.21.15.115:0/782117267 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61140fe9a0 0x7f61141959f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:34.616 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.613+0000 7f611bd17640 1 -- 172.21.15.115:0/782117267 >> 172.21.15.115:0/782117267 conn(0x7f61140758c0 msgr2=0x7f61140fd910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:34.616 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.613+0000 7f611bd17640 1 -- 172.21.15.115:0/782117267 shutdown_connections 2024-09-13T17:11:34.616 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.613+0000 7f611bd17640 1 -- 172.21.15.115:0/782117267 wait complete. 2024-09-13T17:11:34.694 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.693+0000 7f1e6b47e640 1 -- 172.21.15.115:0/3804797581 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e640fea20 msgr2=0x7f1e640fee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:34.695 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.693+0000 7f1e6b47e640 1 --2- 172.21.15.115:0/3804797581 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e640fea20 0x7f1e640fee80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1e54009880 tx=0x7f1e5402a4a0 comp rx=0 tx=0).stop 2024-09-13T17:11:34.695 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.693+0000 7f1e6b47e640 1 -- 172.21.15.115:0/3804797581 shutdown_connections 2024-09-13T17:11:34.695 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.693+0000 7f1e6b47e640 1 --2- 172.21.15.115:0/3804797581 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e640fea20 0x7f1e640fee80 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:34.695 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.693+0000 7f1e6b47e640 1 --2- 172.21.15.115:0/3804797581 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e64104a20 0x7f1e64104e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:34.695 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.693+0000 7f1e6b47e640 1 -- 172.21.15.115:0/3804797581 >> 172.21.15.115:0/3804797581 conn(0x7f1e640fa720 msgr2=0x7f1e640fcb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:34.695 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.693+0000 7f1e6b47e640 1 -- 172.21.15.115:0/3804797581 shutdown_connections 2024-09-13T17:11:34.695 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.693+0000 7f1e6b47e640 1 -- 172.21.15.115:0/3804797581 wait complete. 2024-09-13T17:11:34.697 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.694+0000 7f1e6b47e640 1 Processor -- start 2024-09-13T17:11:34.697 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.694+0000 7f1e6b47e640 1 -- start start 2024-09-13T17:11:34.697 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.694+0000 7f1e6b47e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e640fea20 0x7f1e641099b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:34.697 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.694+0000 7f1e6b47e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e64104a20 0x7f1e64109ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:34.697 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.694+0000 7f1e6b47e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6410a430 con 0x7f1e64104a20 2024-09-13T17:11:34.698 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.694+0000 7f1e6b47e640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6410a5a0 con 0x7f1e640fea20 2024-09-13T17:11:34.698 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.694+0000 7f1e68a19640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e64104a20 0x7f1e64109ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:34.698 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.694+0000 7f1e68a19640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e64104a20 0x7f1e64109ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57336/0 (socket says 172.21.15.115:57336) 2024-09-13T17:11:34.698 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.694+0000 7f1e68a19640 1 -- 172.21.15.115:0/4270706912 learned_addr learned my addr 172.21.15.115:0/4270706912 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:11:34.698 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.694+0000 7f1e6921a640 1 --2- 172.21.15.115:0/4270706912 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e640fea20 0x7f1e641099b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:34.698 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.694+0000 7f1e68a19640 1 -- 172.21.15.115:0/4270706912 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e640fea20 msgr2=0x7f1e641099b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:34.698 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.694+0000 7f1e68a19640 1 --2- 172.21.15.115:0/4270706912 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e640fea20 0x7f1e641099b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:34.698 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.694+0000 7f1e68a19640 1 -- 172.21.15.115:0/4270706912 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e54009560 con 0x7f1e64104a20 2024-09-13T17:11:34.698 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.695+0000 7f1e68a19640 1 --2- 172.21.15.115:0/4270706912 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e64104a20 0x7f1e64109ef0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1e5402a9c0 tx=0x7f1e540055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:34.698 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.695+0000 7f1e5a7fc640 1 -- 172.21.15.115:0/4270706912 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e54004aa0 con 0x7f1e64104a20 2024-09-13T17:11:34.698 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.695+0000 7f1e6b47e640 1 -- 172.21.15.115:0/4270706912 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e6410a820 con 0x7f1e64104a20 2024-09-13T17:11:34.699 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.695+0000 7f1e5a7fc640 1 -- 172.21.15.115:0/4270706912 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1e54004c00 con 0x7f1e64104a20 2024-09-13T17:11:34.699 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.695+0000 7f1e5a7fc640 1 -- 172.21.15.115:0/4270706912 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e54031750 con 0x7f1e64104a20 2024-09-13T17:11:34.699 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.695+0000 7f1e6b47e640 1 -- 172.21.15.115:0/4270706912 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e641a1e40 con 0x7f1e64104a20 2024-09-13T17:11:34.699 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.696+0000 7f1e6b47e640 1 -- 172.21.15.115:0/4270706912 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e64100160 con 0x7f1e64104a20 2024-09-13T17:11:34.699 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.696+0000 7f1e5a7fc640 1 -- 172.21.15.115:0/4270706912 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f1e54031a10 con 0x7f1e64104a20 2024-09-13T17:11:34.700 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.697+0000 7f1e5a7fc640 1 --2- 172.21.15.115:0/4270706912 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f1e5006cc50 0x7f1e5006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:34.700 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.697+0000 7f1e5a7fc640 1 -- 172.21.15.115:0/4270706912 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f1e540ad2c0 con 0x7f1e64104a20 2024-09-13T17:11:34.700 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.697+0000 7f1e6921a640 1 --2- 172.21.15.115:0/4270706912 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f1e5006cc50 0x7f1e5006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:34.700 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.697+0000 7f1e6921a640 1 --2- 172.21.15.115:0/4270706912 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f1e5006cc50 0x7f1e5006f110 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1e60009bd0 tx=0x7f1e60005f90 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:34.702 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.701+0000 7f1e5a7fc640 1 -- 172.21.15.115:0/4270706912 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f1e54077490 con 0x7f1e64104a20 2024-09-13T17:11:34.897 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.896+0000 7f1e6b47e640 1 -- 172.21.15.115:0/4270706912 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1e640fee80 con 0x7f1e64104a20 2024-09-13T17:11:34.898 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:34 smithi115 ceph-mon[109488]: pgmap v166: 65 pgs: 3 peering, 14 active+undersized, 10 active+undersized+degraded, 38 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s; 28/222 objects degraded (12.613%) 2024-09-13T17:11:34.898 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:34 smithi115 ceph-mon[109488]: osdmap e63: 6 total, 6 up, 6 in 2024-09-13T17:11:34.898 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:34 smithi115 ceph-mon[109488]: from='client.34194 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:11:34.898 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:34 smithi115 ceph-mon[109488]: Health check update: Degraded data redundancy: 28/222 objects degraded (12.613%), 10 pgs degraded (PG_DEGRADED) 2024-09-13T17:11:34.898 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:34 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:11:34.898 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:34 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:11:34.898 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:34 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:11:34.898 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:34 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:11:34.898 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:34 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:11:34.898 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:34 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:11:34.899 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:34 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:11:34.899 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:34 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:11:34.899 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:34 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:11:34.899 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:34 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-13T17:11:34.899 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.896+0000 7f1e5a7fc640 1 -- 172.21.15.115:0/4270706912 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1874 (secure 0 0 0) 0x7f1e5407aab0 con 0x7f1e64104a20 2024-09-13T17:11:34.899 INFO:teuthology.orchestra.run.smithi115.stdout:e19 2024-09-13T17:11:34.899 INFO:teuthology.orchestra.run.smithi115.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T17:11:34.899 INFO:teuthology.orchestra.run.smithi115.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T17:11:34.900 INFO:teuthology.orchestra.run.smithi115.stdout:legacy client fscid: 1 2024-09-13T17:11:34.900 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:11:34.900 INFO:teuthology.orchestra.run.smithi115.stdout:Filesystem 'cephfs' (1) 2024-09-13T17:11:34.900 INFO:teuthology.orchestra.run.smithi115.stdout:fs_name cephfs 2024-09-13T17:11:34.900 INFO:teuthology.orchestra.run.smithi115.stdout:epoch 19 2024-09-13T17:11:34.900 INFO:teuthology.orchestra.run.smithi115.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T17:11:34.900 INFO:teuthology.orchestra.run.smithi115.stdout:created 2024-09-13T17:03:16.313116+0000 2024-09-13T17:11:34.900 INFO:teuthology.orchestra.run.smithi115.stdout:modified 2024-09-13T17:03:33.410348+0000 2024-09-13T17:11:34.900 INFO:teuthology.orchestra.run.smithi115.stdout:tableserver 0 2024-09-13T17:11:34.900 INFO:teuthology.orchestra.run.smithi115.stdout:root 0 2024-09-13T17:11:34.900 INFO:teuthology.orchestra.run.smithi115.stdout:session_timeout 60 2024-09-13T17:11:34.900 INFO:teuthology.orchestra.run.smithi115.stdout:session_autoclose 300 2024-09-13T17:11:34.900 INFO:teuthology.orchestra.run.smithi115.stdout:max_file_size 1099511627776 2024-09-13T17:11:34.901 INFO:teuthology.orchestra.run.smithi115.stdout:max_xattr_size 65536 2024-09-13T17:11:34.901 INFO:teuthology.orchestra.run.smithi115.stdout:required_client_features {} 2024-09-13T17:11:34.901 INFO:teuthology.orchestra.run.smithi115.stdout:last_failure 0 2024-09-13T17:11:34.901 INFO:teuthology.orchestra.run.smithi115.stdout:last_failure_osd_epoch 46 2024-09-13T17:11:34.901 INFO:teuthology.orchestra.run.smithi115.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T17:11:34.901 INFO:teuthology.orchestra.run.smithi115.stdout:max_mds 1 2024-09-13T17:11:34.901 INFO:teuthology.orchestra.run.smithi115.stdout:in 0 2024-09-13T17:11:34.901 INFO:teuthology.orchestra.run.smithi115.stdout:up {0=14470} 2024-09-13T17:11:34.901 INFO:teuthology.orchestra.run.smithi115.stdout:failed 2024-09-13T17:11:34.901 INFO:teuthology.orchestra.run.smithi115.stdout:damaged 2024-09-13T17:11:34.901 INFO:teuthology.orchestra.run.smithi115.stdout:stopped 2024-09-13T17:11:34.901 INFO:teuthology.orchestra.run.smithi115.stdout:data_pools [3] 2024-09-13T17:11:34.901 INFO:teuthology.orchestra.run.smithi115.stdout:metadata_pool 2 2024-09-13T17:11:34.901 INFO:teuthology.orchestra.run.smithi115.stdout:inline_data enabled 2024-09-13T17:11:34.903 INFO:teuthology.orchestra.run.smithi115.stdout:balancer 2024-09-13T17:11:34.903 INFO:teuthology.orchestra.run.smithi115.stdout:bal_rank_mask -1 2024-09-13T17:11:34.903 INFO:teuthology.orchestra.run.smithi115.stdout:standby_count_wanted 1 2024-09-13T17:11:34.903 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi115.ijznvr{0:14470} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.115:6828/4128583274,v1:172.21.15.115:6829/4128583274] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T17:11:34.903 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi115.hbtxod{0:14486} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.115:6826/1977394649,v1:172.21.15.115:6827/1977394649] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T17:11:34.903 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:11:34.903 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:11:34.903 INFO:teuthology.orchestra.run.smithi115.stdout:Standby daemons: 2024-09-13T17:11:34.903 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:11:34.904 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi195.aevvgz{-1:24253} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.195:6826/8826118,v1:172.21.15.195:6827/8826118] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T17:11:34.904 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi195.qzghxj{-1:24259} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.195:6824/3335357704,v1:172.21.15.195:6825/3335357704] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T17:11:34.905 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 19 2024-09-13T17:11:34.905 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.898+0000 7f1e6b47e640 1 -- 172.21.15.115:0/4270706912 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f1e5006cc50 msgr2=0x7f1e5006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:34.905 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.898+0000 7f1e6b47e640 1 --2- 172.21.15.115:0/4270706912 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f1e5006cc50 0x7f1e5006f110 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1e60009bd0 tx=0x7f1e60005f90 comp rx=0 tx=0).stop 2024-09-13T17:11:34.905 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.898+0000 7f1e6b47e640 1 -- 172.21.15.115:0/4270706912 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e64104a20 msgr2=0x7f1e64109ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:34.905 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.898+0000 7f1e6b47e640 1 --2- 172.21.15.115:0/4270706912 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e64104a20 0x7f1e64109ef0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1e5402a9c0 tx=0x7f1e540055a0 comp rx=0 tx=0).stop 2024-09-13T17:11:34.905 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.898+0000 7f1e6b47e640 1 -- 172.21.15.115:0/4270706912 shutdown_connections 2024-09-13T17:11:34.905 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.898+0000 7f1e6b47e640 1 --2- 172.21.15.115:0/4270706912 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f1e5006cc50 0x7f1e5006f110 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:34.905 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.898+0000 7f1e6b47e640 1 --2- 172.21.15.115:0/4270706912 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e64104a20 0x7f1e64109ef0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:34.905 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.898+0000 7f1e6b47e640 1 --2- 172.21.15.115:0/4270706912 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e640fea20 0x7f1e641099b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:34.905 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.898+0000 7f1e6b47e640 1 -- 172.21.15.115:0/4270706912 >> 172.21.15.115:0/4270706912 conn(0x7f1e640fa720 msgr2=0x7f1e640fb530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:34.905 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.899+0000 7f1e6b47e640 1 -- 172.21.15.115:0/4270706912 shutdown_connections 2024-09-13T17:11:34.905 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.899+0000 7f1e6b47e640 1 -- 172.21.15.115:0/4270706912 wait complete. 2024-09-13T17:11:34.984 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.981+0000 7f8165cd0640 1 -- 172.21.15.115:0/4211707319 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8160104a10 msgr2=0x7f8160104df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:34.984 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.981+0000 7f8165cd0640 1 --2- 172.21.15.115:0/4211707319 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8160104a10 0x7f8160104df0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8150009880 tx=0x7f815002a4a0 comp rx=0 tx=0).stop 2024-09-13T17:11:34.985 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.981+0000 7f8165cd0640 1 -- 172.21.15.115:0/4211707319 shutdown_connections 2024-09-13T17:11:34.985 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.981+0000 7f8165cd0640 1 --2- 172.21.15.115:0/4211707319 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f81600fea10 0x7f81600fee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:34.985 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.981+0000 7f8165cd0640 1 --2- 172.21.15.115:0/4211707319 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8160104a10 0x7f8160104df0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:34.985 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.981+0000 7f8165cd0640 1 -- 172.21.15.115:0/4211707319 >> 172.21.15.115:0/4211707319 conn(0x7f81600fa730 msgr2=0x7f81600fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:34.985 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.981+0000 7f8165cd0640 1 -- 172.21.15.115:0/4211707319 shutdown_connections 2024-09-13T17:11:34.985 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.981+0000 7f8165cd0640 1 -- 172.21.15.115:0/4211707319 wait complete. 2024-09-13T17:11:34.985 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.982+0000 7f8165cd0640 1 Processor -- start 2024-09-13T17:11:34.985 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.982+0000 7f8165cd0640 1 -- start start 2024-09-13T17:11:34.985 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.982+0000 7f8165cd0640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f81600fea10 0x7f81601968c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:34.986 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.982+0000 7f8165cd0640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8160104a10 0x7f8160196e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:34.986 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.982+0000 7f8165cd0640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8160197340 con 0x7f8160104a10 2024-09-13T17:11:34.986 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.982+0000 7f8165cd0640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81601974b0 con 0x7f81600fea10 2024-09-13T17:11:34.986 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.982+0000 7f815effd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8160104a10 0x7f8160196e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:34.986 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.982+0000 7f815effd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8160104a10 0x7f8160196e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57350/0 (socket says 172.21.15.115:57350) 2024-09-13T17:11:34.986 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.982+0000 7f815effd640 1 -- 172.21.15.115:0/1496604384 learned_addr learned my addr 172.21.15.115:0/1496604384 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:11:34.986 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.982+0000 7f815f7fe640 1 --2- 172.21.15.115:0/1496604384 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f81600fea10 0x7f81601968c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:34.986 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.983+0000 7f815effd640 1 -- 172.21.15.115:0/1496604384 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f81600fea10 msgr2=0x7f81601968c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:34.986 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.983+0000 7f815effd640 1 --2- 172.21.15.115:0/1496604384 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f81600fea10 0x7f81601968c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:34.986 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.983+0000 7f815effd640 1 -- 172.21.15.115:0/1496604384 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8150009560 con 0x7f8160104a10 2024-09-13T17:11:34.986 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.983+0000 7f815effd640 1 --2- 172.21.15.115:0/1496604384 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8160104a10 0x7f8160196e00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f815400e970 tx=0x7f815400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:34.986 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.983+0000 7f815cff9640 1 -- 172.21.15.115:0/1496604384 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f815400cc90 con 0x7f8160104a10 2024-09-13T17:11:34.986 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.983+0000 7f815cff9640 1 -- 172.21.15.115:0/1496604384 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f815400cdf0 con 0x7f8160104a10 2024-09-13T17:11:34.987 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.983+0000 7f8165cd0640 1 -- 172.21.15.115:0/1496604384 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f816019f930 con 0x7f8160104a10 2024-09-13T17:11:34.987 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.983+0000 7f815cff9640 1 -- 172.21.15.115:0/1496604384 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8154010430 con 0x7f8160104a10 2024-09-13T17:11:34.987 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.983+0000 7f8165cd0640 1 -- 172.21.15.115:0/1496604384 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f816019fd40 con 0x7f8160104a10 2024-09-13T17:11:34.988 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.984+0000 7f8165cd0640 1 -- 172.21.15.115:0/1496604384 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8160100150 con 0x7f8160104a10 2024-09-13T17:11:34.988 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.984+0000 7f815cff9640 1 -- 172.21.15.115:0/1496604384 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f81540046c0 con 0x7f8160104a10 2024-09-13T17:11:34.988 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.985+0000 7f815cff9640 1 --2- 172.21.15.115:0/1496604384 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f814806cc60 0x7f814806f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:34.988 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.985+0000 7f815cff9640 1 -- 172.21.15.115:0/1496604384 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f8154014070 con 0x7f8160104a10 2024-09-13T17:11:34.988 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.985+0000 7f815f7fe640 1 --2- 172.21.15.115:0/1496604384 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f814806cc60 0x7f814806f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:34.989 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.985+0000 7f815f7fe640 1 --2- 172.21.15.115:0/1496604384 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f814806cc60 0x7f814806f120 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8150000c00 tx=0x7f8150005a20 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:34.990 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:34.989+0000 7f815cff9640 1 -- 172.21.15.115:0/1496604384 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f8154056ad0 con 0x7f8160104a10 2024-09-13T17:11:35.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:34 smithi195 ceph-mon[80021]: pgmap v166: 65 pgs: 3 peering, 14 active+undersized, 10 active+undersized+degraded, 38 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s; 28/222 objects degraded (12.613%) 2024-09-13T17:11:35.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:34 smithi195 ceph-mon[80021]: osdmap e63: 6 total, 6 up, 6 in 2024-09-13T17:11:35.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:34 smithi195 ceph-mon[80021]: from='client.34194 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:11:35.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:34 smithi195 ceph-mon[80021]: Health check update: Degraded data redundancy: 28/222 objects degraded (12.613%), 10 pgs degraded (PG_DEGRADED) 2024-09-13T17:11:35.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:34 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:11:35.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:34 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:11:35.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:34 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:11:35.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:34 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:11:35.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:34 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:11:35.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:34 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:11:35.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:34 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:11:35.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:34 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:11:35.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:34 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:11:35.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:34 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-13T17:11:35.168 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:35.166+0000 7f8165cd0640 1 -- 172.21.15.115:0/1496604384 --> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f816010bb60 con 0x7f814806cc60 2024-09-13T17:11:35.169 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:35.168+0000 7f815cff9640 1 -- 172.21.15.115:0/1496604384 <== mgr.14660 v2:172.21.15.115:6800/1049502673 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f816010bb60 con 0x7f814806cc60 2024-09-13T17:11:35.169 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-13T17:11:35.169 INFO:teuthology.orchestra.run.smithi115.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256", 2024-09-13T17:11:35.169 INFO:teuthology.orchestra.run.smithi115.stdout: "in_progress": true, 2024-09-13T17:11:35.169 INFO:teuthology.orchestra.run.smithi115.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T17:11:35.169 INFO:teuthology.orchestra.run.smithi115.stdout: "services_complete": [ 2024-09-13T17:11:35.169 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr", 2024-09-13T17:11:35.169 INFO:teuthology.orchestra.run.smithi115.stdout: "mon", 2024-09-13T17:11:35.170 INFO:teuthology.orchestra.run.smithi115.stdout: "crash" 2024-09-13T17:11:35.170 INFO:teuthology.orchestra.run.smithi115.stdout: ], 2024-09-13T17:11:35.170 INFO:teuthology.orchestra.run.smithi115.stdout: "progress": "9/23 daemons upgraded", 2024-09-13T17:11:35.170 INFO:teuthology.orchestra.run.smithi115.stdout: "message": "Currently upgrading osd daemons", 2024-09-13T17:11:35.170 INFO:teuthology.orchestra.run.smithi115.stdout: "is_paused": false 2024-09-13T17:11:35.170 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-13T17:11:35.171 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:35.169+0000 7f8165cd0640 1 -- 172.21.15.115:0/1496604384 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f814806cc60 msgr2=0x7f814806f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:35.171 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:35.169+0000 7f8165cd0640 1 --2- 172.21.15.115:0/1496604384 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f814806cc60 0x7f814806f120 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8150000c00 tx=0x7f8150005a20 comp rx=0 tx=0).stop 2024-09-13T17:11:35.171 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:35.169+0000 7f8165cd0640 1 -- 172.21.15.115:0/1496604384 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8160104a10 msgr2=0x7f8160196e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:35.171 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:35.169+0000 7f8165cd0640 1 --2- 172.21.15.115:0/1496604384 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8160104a10 0x7f8160196e00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f815400e970 tx=0x7f815400ed70 comp rx=0 tx=0).stop 2024-09-13T17:11:35.171 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:35.170+0000 7f8165cd0640 1 -- 172.21.15.115:0/1496604384 shutdown_connections 2024-09-13T17:11:35.171 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:35.170+0000 7f8165cd0640 1 --2- 172.21.15.115:0/1496604384 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f814806cc60 0x7f814806f120 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:35.172 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:35.170+0000 7f8165cd0640 1 --2- 172.21.15.115:0/1496604384 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8160104a10 0x7f8160196e00 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:35.172 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:35.170+0000 7f8165cd0640 1 --2- 172.21.15.115:0/1496604384 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f81600fea10 0x7f81601968c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:35.172 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:35.170+0000 7f8165cd0640 1 -- 172.21.15.115:0/1496604384 >> 172.21.15.115:0/1496604384 conn(0x7f81600fa730 msgr2=0x7f81600fb560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:35.172 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:35.170+0000 7f8165cd0640 1 -- 172.21.15.115:0/1496604384 shutdown_connections 2024-09-13T17:11:35.172 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:35.170+0000 7f8165cd0640 1 -- 172.21.15.115:0/1496604384 wait complete. 2024-09-13T17:11:35.253 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:35.250+0000 7f083c21a640 1 -- 172.21.15.115:0/1246373420 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0834104a10 msgr2=0x7f0834104df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:35.253 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:35.250+0000 7f083c21a640 1 --2- 172.21.15.115:0/1246373420 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0834104a10 0x7f0834104df0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0830009880 tx=0x7f083002a4a0 comp rx=0 tx=0).stop 2024-09-13T17:11:35.253 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:35.250+0000 7f083c21a640 1 -- 172.21.15.115:0/1246373420 shutdown_connections 2024-09-13T17:11:35.253 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:35.250+0000 7f083c21a640 1 --2- 172.21.15.115:0/1246373420 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f08340fea10 0x7f08340fee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:35.253 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:35.250+0000 7f083c21a640 1 --2- 172.21.15.115:0/1246373420 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0834104a10 0x7f0834104df0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:35.254 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:35.250+0000 7f083c21a640 1 -- 172.21.15.115:0/1246373420 >> 172.21.15.115:0/1246373420 conn(0x7f08340fa730 msgr2=0x7f08340fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:35.254 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:35.250+0000 7f083c21a640 1 -- 172.21.15.115:0/1246373420 shutdown_connections 2024-09-13T17:11:35.254 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:35.250+0000 7f083c21a640 1 -- 172.21.15.115:0/1246373420 wait complete. 2024-09-13T17:11:35.254 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:35.251+0000 7f083c21a640 1 Processor -- start 2024-09-13T17:11:35.254 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:35.251+0000 7f083c21a640 1 -- start start 2024-09-13T17:11:35.254 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:35.251+0000 7f083c21a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08340fea10 0x7f08341959f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:35.254 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:35.251+0000 7f083c21a640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0834104a10 0x7f0834195f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:35.254 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:35.251+0000 7f083c21a640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0834196610 con 0x7f08340fea10 2024-09-13T17:11:35.254 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:35.251+0000 7f083c21a640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f083419a360 con 0x7f0834104a10 2024-09-13T17:11:35.254 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:35.251+0000 7f0839fb6640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08340fea10 0x7f08341959f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:35.254 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:35.251+0000 7f0839fb6640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08340fea10 0x7f08341959f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57366/0 (socket says 172.21.15.115:57366) 2024-09-13T17:11:35.254 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:35.251+0000 7f0839fb6640 1 -- 172.21.15.115:0/2278036776 learned_addr learned my addr 172.21.15.115:0/2278036776 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:11:35.254 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:35.251+0000 7f08397b5640 1 --2- 172.21.15.115:0/2278036776 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0834104a10 0x7f0834195f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:35.255 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:35.251+0000 7f0839fb6640 1 -- 172.21.15.115:0/2278036776 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0834104a10 msgr2=0x7f0834195f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:35.255 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:35.251+0000 7f0839fb6640 1 --2- 172.21.15.115:0/2278036776 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0834104a10 0x7f0834195f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:35.255 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:35.251+0000 7f0839fb6640 1 -- 172.21.15.115:0/2278036776 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0830009560 con 0x7f08340fea10 2024-09-13T17:11:35.255 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:35.252+0000 7f0839fb6640 1 --2- 172.21.15.115:0/2278036776 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08340fea10 0x7f08341959f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f083002a9c0 tx=0x7f08300055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:35.255 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:35.252+0000 7f082affd640 1 -- 172.21.15.115:0/2278036776 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0830004aa0 con 0x7f08340fea10 2024-09-13T17:11:35.255 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:35.252+0000 7f082affd640 1 -- 172.21.15.115:0/2278036776 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0830004c00 con 0x7f08340fea10 2024-09-13T17:11:35.255 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:35.252+0000 7f083c21a640 1 -- 172.21.15.115:0/2278036776 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f083419a5e0 con 0x7f08340fea10 2024-09-13T17:11:35.255 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:35.252+0000 7f082affd640 1 -- 172.21.15.115:0/2278036776 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0830031750 con 0x7f08340fea10 2024-09-13T17:11:35.255 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:35.252+0000 7f083c21a640 1 -- 172.21.15.115:0/2278036776 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f083419aad0 con 0x7f08340fea10 2024-09-13T17:11:35.256 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:35.253+0000 7f083c21a640 1 -- 172.21.15.115:0/2278036776 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0834100150 con 0x7f08340fea10 2024-09-13T17:11:35.256 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:35.253+0000 7f082affd640 1 -- 172.21.15.115:0/2278036776 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f08300319c0 con 0x7f08340fea10 2024-09-13T17:11:35.256 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:35.254+0000 7f082affd640 1 --2- 172.21.15.115:0/2278036776 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f082006cc50 0x7f082006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:35.256 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:35.254+0000 7f082affd640 1 -- 172.21.15.115:0/2278036776 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f08300ad400 con 0x7f08340fea10 2024-09-13T17:11:35.256 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:35.254+0000 7f08397b5640 1 --2- 172.21.15.115:0/2278036776 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f082006cc50 0x7f082006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:35.256 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:35.254+0000 7f08397b5640 1 --2- 172.21.15.115:0/2278036776 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f082006cc50 0x7f082006f110 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0834196fa0 tx=0x7f0824005f90 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:35.259 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:35.258+0000 7f082affd640 1 -- 172.21.15.115:0/2278036776 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f08300775a0 con 0x7f08340fea10 2024-09-13T17:11:35.486 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:35.484+0000 7f083c21a640 1 -- 172.21.15.115:0/2278036776 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f083410bb60 con 0x7f08340fea10 2024-09-13T17:11:35.486 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:35.485+0000 7f082affd640 1 -- 172.21.15.115:0/2278036776 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+930 (secure 0 0 0) 0x7f083007abc0 con 0x7f08340fea10 2024-09-13T17:11:35.486 INFO:teuthology.orchestra.run.smithi115.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; Degraded data redundancy: 28/222 objects degraded (12.613%), 10 pgs degraded 2024-09-13T17:11:35.486 INFO:teuthology.orchestra.run.smithi115.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T17:11:35.487 INFO:teuthology.orchestra.run.smithi115.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T17:11:35.487 INFO:teuthology.orchestra.run.smithi115.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 28/222 objects degraded (12.613%), 10 pgs degraded 2024-09-13T17:11:35.487 INFO:teuthology.orchestra.run.smithi115.stdout: pg 2.1 is active+undersized+degraded, acting [1,0] 2024-09-13T17:11:35.487 INFO:teuthology.orchestra.run.smithi115.stdout: pg 2.3 is active+undersized+degraded, acting [5,1] 2024-09-13T17:11:35.487 INFO:teuthology.orchestra.run.smithi115.stdout: pg 2.7 is active+undersized+degraded, acting [3,4] 2024-09-13T17:11:35.487 INFO:teuthology.orchestra.run.smithi115.stdout: pg 2.c is active+undersized+degraded, acting [3,0] 2024-09-13T17:11:35.487 INFO:teuthology.orchestra.run.smithi115.stdout: pg 2.e is active+undersized+degraded, acting [0,3] 2024-09-13T17:11:35.487 INFO:teuthology.orchestra.run.smithi115.stdout: pg 2.10 is active+undersized+degraded, acting [1,0] 2024-09-13T17:11:35.487 INFO:teuthology.orchestra.run.smithi115.stdout: pg 2.13 is active+undersized+degraded, acting [0,4] 2024-09-13T17:11:35.487 INFO:teuthology.orchestra.run.smithi115.stdout: pg 2.16 is active+undersized+degraded, acting [5,3] 2024-09-13T17:11:35.488 INFO:teuthology.orchestra.run.smithi115.stdout: pg 2.1c is active+undersized+degraded, acting [4,5] 2024-09-13T17:11:35.488 INFO:teuthology.orchestra.run.smithi115.stdout: pg 2.1e is active+undersized+degraded, acting [0,5] 2024-09-13T17:11:35.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:35.487+0000 7f083c21a640 1 -- 172.21.15.115:0/2278036776 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f082006cc50 msgr2=0x7f082006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:35.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:35.487+0000 7f083c21a640 1 --2- 172.21.15.115:0/2278036776 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f082006cc50 0x7f082006f110 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0834196fa0 tx=0x7f0824005f90 comp rx=0 tx=0).stop 2024-09-13T17:11:35.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:35.487+0000 7f083c21a640 1 -- 172.21.15.115:0/2278036776 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08340fea10 msgr2=0x7f08341959f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:35.489 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:35.487+0000 7f083c21a640 1 --2- 172.21.15.115:0/2278036776 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08340fea10 0x7f08341959f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f083002a9c0 tx=0x7f08300055a0 comp rx=0 tx=0).stop 2024-09-13T17:11:35.489 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:35.487+0000 7f083c21a640 1 -- 172.21.15.115:0/2278036776 shutdown_connections 2024-09-13T17:11:35.489 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:35.487+0000 7f083c21a640 1 --2- 172.21.15.115:0/2278036776 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f082006cc50 0x7f082006f110 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:35.489 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:35.487+0000 7f083c21a640 1 --2- 172.21.15.115:0/2278036776 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0834104a10 0x7f0834195f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:35.489 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:35.487+0000 7f083c21a640 1 --2- 172.21.15.115:0/2278036776 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08340fea10 0x7f08341959f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:35.489 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:35.487+0000 7f083c21a640 1 -- 172.21.15.115:0/2278036776 >> 172.21.15.115:0/2278036776 conn(0x7f08340fa730 msgr2=0x7f0834102a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:35.489 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:35.487+0000 7f083c21a640 1 -- 172.21.15.115:0/2278036776 shutdown_connections 2024-09-13T17:11:35.489 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:11:35.487+0000 7f083c21a640 1 -- 172.21.15.115:0/2278036776 wait complete. 2024-09-13T17:11:35.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:35 smithi115 ceph-mon[109488]: from='client.34198 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:11:35.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:35 smithi115 ceph-mon[109488]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-13T17:11:35.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:35 smithi115 ceph-mon[109488]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-13T17:11:35.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:35 smithi115 ceph-mon[109488]: from='client.34202 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:11:35.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:35 smithi115 ceph-mon[109488]: from='client.? 172.21.15.115:0/782117267' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:11:35.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:35 smithi115 ceph-mon[109488]: from='client.? 172.21.15.115:0/4270706912' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T17:11:35.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:35 smithi115 ceph-mon[109488]: from='client.? 172.21.15.115:0/2278036776' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T17:11:36.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:35 smithi195 ceph-mon[80021]: from='client.34198 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:11:36.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:35 smithi195 ceph-mon[80021]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-13T17:11:36.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:35 smithi195 ceph-mon[80021]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-13T17:11:36.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:35 smithi195 ceph-mon[80021]: from='client.34202 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:11:36.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:35 smithi195 ceph-mon[80021]: from='client.? 172.21.15.115:0/782117267' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:11:36.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:35 smithi195 ceph-mon[80021]: from='client.? 172.21.15.115:0/4270706912' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T17:11:36.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:35 smithi195 ceph-mon[80021]: from='client.? 172.21.15.115:0/2278036776' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T17:11:36.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:36 smithi115 ceph-mon[109488]: from='client.34214 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:11:36.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:36 smithi115 ceph-mon[109488]: pgmap v168: 65 pgs: 3 peering, 10 active+undersized, 9 active+undersized+degraded, 43 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 0 op/s; 25/222 objects degraded (11.261%) 2024-09-13T17:11:36.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:36 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:11:36.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:36 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:11:36.978 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:36 smithi195 ceph-mon[80021]: from='client.34214 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:11:36.978 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:36 smithi195 ceph-mon[80021]: pgmap v168: 65 pgs: 3 peering, 10 active+undersized, 9 active+undersized+degraded, 43 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 0 op/s; 25/222 objects degraded (11.261%) 2024-09-13T17:11:36.978 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:36 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:11:36.979 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:36 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:11:37.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:37 smithi115 ceph-mon[109488]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 25/222 objects degraded (11.261%), 9 pgs degraded) 2024-09-13T17:11:38.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:37 smithi195 ceph-mon[80021]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 25/222 objects degraded (11.261%), 9 pgs degraded) 2024-09-13T17:11:38.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:38 smithi115 ceph-mon[109488]: pgmap v169: 65 pgs: 3 peering, 62 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s 2024-09-13T17:11:39.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:38 smithi195 ceph-mon[80021]: pgmap v169: 65 pgs: 3 peering, 62 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s 2024-09-13T17:11:40.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:40 smithi115 ceph-mon[109488]: pgmap v170: 65 pgs: 65 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 520 B/s rd, 1 op/s 2024-09-13T17:11:41.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:40 smithi195 ceph-mon[80021]: pgmap v170: 65 pgs: 65 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 520 B/s rd, 1 op/s 2024-09-13T17:11:41.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:41 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:11:42.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:41 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:11:42.830 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:42 smithi115 ceph-mon[109488]: pgmap v171: 65 pgs: 65 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 461 B/s rd, 1 op/s 2024-09-13T17:11:43.076 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:42 smithi195 ceph-mon[80021]: pgmap v171: 65 pgs: 65 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 461 B/s rd, 1 op/s 2024-09-13T17:11:44.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:44 smithi115 ceph-mon[109488]: pgmap v172: 65 pgs: 65 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 921 B/s rd, 1 op/s 2024-09-13T17:11:45.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:44 smithi195 ceph-mon[80021]: pgmap v172: 65 pgs: 65 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 921 B/s rd, 1 op/s 2024-09-13T17:11:46.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:46 smithi115 ceph-mon[109488]: pgmap v173: 65 pgs: 65 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 776 B/s rd, 1 op/s 2024-09-13T17:11:47.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:46 smithi195 ceph-mon[80021]: pgmap v173: 65 pgs: 65 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 776 B/s rd, 1 op/s 2024-09-13T17:11:49.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:48 smithi195 ceph-mon[80021]: pgmap v174: 65 pgs: 65 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:11:49.178 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:48 smithi115 ceph-mon[109488]: pgmap v174: 65 pgs: 65 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:11:49.895 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:49 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-13T17:11:50.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:49 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-13T17:11:50.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:50 smithi195 ceph-mon[80021]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-13T17:11:50.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:50 smithi195 ceph-mon[80021]: Upgrade: osd.3 is safe to restart 2024-09-13T17:11:50.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:50 smithi195 ceph-mon[80021]: pgmap v175: 65 pgs: 65 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:11:50.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:50 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:11:50.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:50 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-13T17:11:50.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:50 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:11:50.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:50 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:11:50.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:50 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:11:51.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:50 smithi115 ceph-mon[109488]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-13T17:11:51.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:50 smithi115 ceph-mon[109488]: Upgrade: osd.3 is safe to restart 2024-09-13T17:11:51.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:50 smithi115 ceph-mon[109488]: pgmap v175: 65 pgs: 65 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:11:51.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:50 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:11:51.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:50 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-13T17:11:51.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:50 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:11:51.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:50 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:11:51.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:50 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:11:51.980 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:51 smithi195 ceph-mon[80021]: Upgrade: Updating osd.3 2024-09-13T17:11:51.980 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:51 smithi195 ceph-mon[80021]: Deploying daemon osd.3 on smithi195 2024-09-13T17:11:52.178 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:51 smithi115 ceph-mon[109488]: Upgrade: Updating osd.3 2024-09-13T17:11:52.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:51 smithi115 ceph-mon[109488]: Deploying daemon osd.3 on smithi195 2024-09-13T17:11:52.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:52 smithi115 ceph-mon[109488]: pgmap v176: 65 pgs: 65 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:11:52.937 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:52 smithi195 ceph-mon[80021]: pgmap v176: 65 pgs: 65 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:11:53.827 INFO:journalctl@ceph.osd.3.smithi195.stdout:Sep 13 17:11:53 smithi195 systemd[1]: Stopping Ceph osd.3 for ffbd7588-71f0-11ef-bceb-c7b262605968... 2024-09-13T17:11:54.327 INFO:journalctl@ceph.osd.3.smithi195.stdout:Sep 13 17:11:53 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-3[40836]: 2024-09-13T17:11:53.833+0000 7ff11d84d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T17:11:54.327 INFO:journalctl@ceph.osd.3.smithi195.stdout:Sep 13 17:11:53 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-3[40836]: 2024-09-13T17:11:53.833+0000 7ff11d84d640 -1 osd.3 63 *** Got signal Terminated *** 2024-09-13T17:11:54.327 INFO:journalctl@ceph.osd.3.smithi195.stdout:Sep 13 17:11:53 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-3[40836]: 2024-09-13T17:11:53.833+0000 7ff11d84d640 -1 osd.3 63 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T17:11:54.993 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:54 smithi115 ceph-mon[109488]: pgmap v177: 65 pgs: 65 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:11:54.993 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:54 smithi115 ceph-mon[109488]: osd.3 marked itself down and dead 2024-09-13T17:11:55.076 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:54 smithi195 ceph-mon[80021]: pgmap v177: 65 pgs: 65 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:11:55.076 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:54 smithi195 ceph-mon[80021]: osd.3 marked itself down and dead 2024-09-13T17:11:55.327 INFO:journalctl@ceph.osd.3.smithi195.stdout:Sep 13 17:11:55 smithi195 podman[88370]: 2024-09-13 17:11:55.075928874 +0000 UTC m=+1.353182031 container died 10ea833fd5c55b80c6afbc232613b1ddf1b2cb93f2c344ff3d0ed154a3b50432 (image=quay.ceph.io/ceph-ci/ceph@sha256:c37c250ffe653639d7a4124ac8acdc3c8f6a53cb4ef1f26b1d2df36648631a11, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-3, RELEASE=reef-2c01458, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True) 2024-09-13T17:11:55.703 INFO:journalctl@ceph.osd.3.smithi195.stdout:Sep 13 17:11:55 smithi195 podman[88370]: 2024-09-13 17:11:55.484053794 +0000 UTC m=+1.761306959 container cleanup 10ea833fd5c55b80c6afbc232613b1ddf1b2cb93f2c344ff3d0ed154a3b50432 (image=quay.ceph.io/ceph-ci/ceph@sha256:c37c250ffe653639d7a4124ac8acdc3c8f6a53cb4ef1f26b1d2df36648631a11, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=reef-2c01458, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T17:11:55.703 INFO:journalctl@ceph.osd.3.smithi195.stdout:Sep 13 17:11:55 smithi195 bash[88370]: ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-3 2024-09-13T17:11:56.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:55 smithi195 ceph-mon[80021]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T17:11:56.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:55 smithi195 ceph-mon[80021]: osdmap e64: 6 total, 5 up, 6 in 2024-09-13T17:11:56.048 INFO:journalctl@ceph.osd.3.smithi195.stdout:Sep 13 17:11:55 smithi195 podman[88398]: 2024-09-13 17:11:55.710625787 +0000 UTC m=+0.638980896 container remove 10ea833fd5c55b80c6afbc232613b1ddf1b2cb93f2c344ff3d0ed154a3b50432 (image=quay.ceph.io/ceph-ci/ceph@sha256:c37c250ffe653639d7a4124ac8acdc3c8f6a53cb4ef1f26b1d2df36648631a11, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-3, io.buildah.version=1.37.2, RELEASE=reef-2c01458, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-13T17:11:56.178 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:55 smithi115 ceph-mon[109488]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T17:11:56.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:55 smithi115 ceph-mon[109488]: osdmap e64: 6 total, 5 up, 6 in 2024-09-13T17:11:56.327 INFO:journalctl@ceph.osd.3.smithi195.stdout:Sep 13 17:11:56 smithi195 podman[88487]: 2024-09-13 17:11:55.950136921 +0000 UTC m=+0.015895765 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T17:11:56.327 INFO:journalctl@ceph.osd.3.smithi195.stdout:Sep 13 17:11:56 smithi195 podman[88487]: 2024-09-13 17:11:56.053242134 +0000 UTC m=+0.119001011 container create a4dd38efd1fd3d3d7903ec20e8063d6f9c0a7304ed928ee97bcb7fc7e90347aa (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T17:11:56.717 INFO:journalctl@ceph.osd.3.smithi195.stdout:Sep 13 17:11:56 smithi195 podman[88487]: 2024-09-13 17:11:56.439480365 +0000 UTC m=+0.505239205 container init a4dd38efd1fd3d3d7903ec20e8063d6f9c0a7304ed928ee97bcb7fc7e90347aa (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-13T17:11:56.717 INFO:journalctl@ceph.osd.3.smithi195.stdout:Sep 13 17:11:56 smithi195 podman[88487]: 2024-09-13 17:11:56.442956564 +0000 UTC m=+0.508715400 container start a4dd38efd1fd3d3d7903ec20e8063d6f9c0a7304ed928ee97bcb7fc7e90347aa (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-3-deactivate, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS) 2024-09-13T17:11:56.717 INFO:journalctl@ceph.osd.3.smithi195.stdout:Sep 13 17:11:56 smithi195 podman[88487]: 2024-09-13 17:11:56.530911828 +0000 UTC m=+0.596670664 container attach a4dd38efd1fd3d3d7903ec20e8063d6f9c0a7304ed928ee97bcb7fc7e90347aa (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-13T17:11:56.717 INFO:journalctl@ceph.osd.3.smithi195.stdout:Sep 13 17:11:56 smithi195 podman[88487]: 2024-09-13 17:11:56.634128605 +0000 UTC m=+0.699887442 container died a4dd38efd1fd3d3d7903ec20e8063d6f9c0a7304ed928ee97bcb7fc7e90347aa (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-13T17:11:56.968 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:56 smithi195 ceph-mon[80021]: pgmap v179: 65 pgs: 16 stale+active+clean, 49 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-13T17:11:56.968 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:56 smithi195 ceph-mon[80021]: osdmap e65: 6 total, 5 up, 6 in 2024-09-13T17:11:57.178 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:56 smithi115 ceph-mon[109488]: pgmap v179: 65 pgs: 16 stale+active+clean, 49 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-13T17:11:57.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:56 smithi115 ceph-mon[109488]: osdmap e65: 6 total, 5 up, 6 in 2024-09-13T17:11:57.577 INFO:journalctl@ceph.osd.3.smithi195.stdout:Sep 13 17:11:57 smithi195 podman[88510]: 2024-09-13 17:11:57.282828995 +0000 UTC m=+0.637633089 container remove a4dd38efd1fd3d3d7903ec20e8063d6f9c0a7304ed928ee97bcb7fc7e90347aa (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-09-13T17:11:57.577 INFO:journalctl@ceph.osd.3.smithi195.stdout:Sep 13 17:11:57 smithi195 systemd[1]: ceph-ffbd7588-71f0-11ef-bceb-c7b262605968@osd.3.service: Deactivated successfully. 2024-09-13T17:11:57.578 INFO:journalctl@ceph.osd.3.smithi195.stdout:Sep 13 17:11:57 smithi195 systemd[1]: Stopped Ceph osd.3 for ffbd7588-71f0-11ef-bceb-c7b262605968. 2024-09-13T17:11:57.578 INFO:journalctl@ceph.osd.3.smithi195.stdout:Sep 13 17:11:57 smithi195 systemd[1]: ceph-ffbd7588-71f0-11ef-bceb-c7b262605968@osd.3.service: Consumed 1min 14.469s CPU time. 2024-09-13T17:11:57.578 INFO:journalctl@ceph.osd.3.smithi195.stdout:Sep 13 17:11:57 smithi195 systemd[1]: Starting Ceph osd.3 for ffbd7588-71f0-11ef-bceb-c7b262605968... 2024-09-13T17:11:57.999 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:57 smithi195 ceph-mon[80021]: Health check failed: Degraded data redundancy: 27/222 objects degraded (12.162%), 9 pgs degraded (PG_DEGRADED) 2024-09-13T17:11:58.000 INFO:journalctl@ceph.osd.3.smithi195.stdout:Sep 13 17:11:57 smithi195 podman[88610]: 2024-09-13 17:11:57.628232645 +0000 UTC m=+0.015662716 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T17:11:58.000 INFO:journalctl@ceph.osd.3.smithi195.stdout:Sep 13 17:11:57 smithi195 podman[88610]: 2024-09-13 17:11:57.736119612 +0000 UTC m=+0.123549682 container create 7edb39d0f0886b85c534d3ac6f23d8b848059d8e03f4ef7eb721ac6720cde6e5 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-3-activate, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-13T17:11:58.000 INFO:journalctl@ceph.osd.3.smithi195.stdout:Sep 13 17:11:57 smithi195 podman[88610]: 2024-09-13 17:11:57.999018031 +0000 UTC m=+0.386448104 container init 7edb39d0f0886b85c534d3ac6f23d8b848059d8e03f4ef7eb721ac6720cde6e5 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-3-activate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-13T17:11:58.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:57 smithi115 ceph-mon[109488]: Health check failed: Degraded data redundancy: 27/222 objects degraded (12.162%), 9 pgs degraded (PG_DEGRADED) 2024-09-13T17:11:58.302 INFO:journalctl@ceph.osd.3.smithi195.stdout:Sep 13 17:11:58 smithi195 podman[88610]: 2024-09-13 17:11:58.002450678 +0000 UTC m=+0.389880754 container start 7edb39d0f0886b85c534d3ac6f23d8b848059d8e03f4ef7eb721ac6720cde6e5 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-3-activate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True) 2024-09-13T17:11:58.302 INFO:journalctl@ceph.osd.3.smithi195.stdout:Sep 13 17:11:58 smithi195 podman[88610]: 2024-09-13 17:11:58.098908245 +0000 UTC m=+0.486338334 container attach 7edb39d0f0886b85c534d3ac6f23d8b848059d8e03f4ef7eb721ac6720cde6e5 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-3-activate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T17:11:58.577 INFO:journalctl@ceph.osd.3.smithi195.stdout:Sep 13 17:11:58 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-3-activate[88624]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-13T17:11:58.577 INFO:journalctl@ceph.osd.3.smithi195.stdout:Sep 13 17:11:58 smithi195 bash[88610]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-13T17:11:58.577 INFO:journalctl@ceph.osd.3.smithi195.stdout:Sep 13 17:11:58 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-3-activate[88624]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-13T17:11:58.578 INFO:journalctl@ceph.osd.3.smithi195.stdout:Sep 13 17:11:58 smithi195 bash[88610]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-13T17:11:58.578 INFO:journalctl@ceph.osd.3.smithi195.stdout:Sep 13 17:11:58 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-3-activate[88624]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-13T17:11:58.578 INFO:journalctl@ceph.osd.3.smithi195.stdout:Sep 13 17:11:58 smithi195 bash[88610]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-13T17:11:58.578 INFO:journalctl@ceph.osd.3.smithi195.stdout:Sep 13 17:11:58 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-3-activate[88624]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-13T17:11:58.578 INFO:journalctl@ceph.osd.3.smithi195.stdout:Sep 13 17:11:58 smithi195 bash[88610]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-13T17:11:58.578 INFO:journalctl@ceph.osd.3.smithi195.stdout:Sep 13 17:11:58 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-3-activate[88624]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-09-13T17:11:58.578 INFO:journalctl@ceph.osd.3.smithi195.stdout:Sep 13 17:11:58 smithi195 bash[88610]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-09-13T17:11:58.578 INFO:journalctl@ceph.osd.3.smithi195.stdout:Sep 13 17:11:58 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-3-activate[88624]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-13T17:11:58.578 INFO:journalctl@ceph.osd.3.smithi195.stdout:Sep 13 17:11:58 smithi195 bash[88610]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-13T17:11:58.578 INFO:journalctl@ceph.osd.3.smithi195.stdout:Sep 13 17:11:58 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-3-activate[88624]: --> ceph-volume raw activate successful for osd ID: 3 2024-09-13T17:11:58.578 INFO:journalctl@ceph.osd.3.smithi195.stdout:Sep 13 17:11:58 smithi195 bash[88610]: --> ceph-volume raw activate successful for osd ID: 3 2024-09-13T17:11:58.578 INFO:journalctl@ceph.osd.3.smithi195.stdout:Sep 13 17:11:58 smithi195 podman[88610]: 2024-09-13 17:11:58.34902389 +0000 UTC m=+0.736453963 container died 7edb39d0f0886b85c534d3ac6f23d8b848059d8e03f4ef7eb721ac6720cde6e5 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-3-activate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD) 2024-09-13T17:11:59.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:11:58 smithi195 ceph-mon[80021]: pgmap v181: 65 pgs: 13 active+undersized, 5 stale+active+clean, 9 active+undersized+degraded, 38 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 27/222 objects degraded (12.162%) 2024-09-13T17:11:59.077 INFO:journalctl@ceph.osd.3.smithi195.stdout:Sep 13 17:11:58 smithi195 podman[88750]: 2024-09-13 17:11:58.962150492 +0000 UTC m=+0.607272134 container remove 7edb39d0f0886b85c534d3ac6f23d8b848059d8e03f4ef7eb721ac6720cde6e5 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-3-activate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, io.buildah.version=1.37.2) 2024-09-13T17:11:59.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:11:58 smithi115 ceph-mon[109488]: pgmap v181: 65 pgs: 13 active+undersized, 5 stale+active+clean, 9 active+undersized+degraded, 38 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 27/222 objects degraded (12.162%) 2024-09-13T17:11:59.431 INFO:journalctl@ceph.osd.3.smithi195.stdout:Sep 13 17:11:59 smithi195 podman[88811]: 2024-09-13 17:11:59.072592845 +0000 UTC m=+0.016214543 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T17:11:59.431 INFO:journalctl@ceph.osd.3.smithi195.stdout:Sep 13 17:11:59 smithi195 podman[88811]: 2024-09-13 17:11:59.171254716 +0000 UTC m=+0.114876401 container create ccd1b2bf7d86bf422d7a1366de81abbad8983f53753df2b1faa1258d63d69074 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-3, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-13T17:11:59.431 INFO:journalctl@ceph.osd.3.smithi195.stdout:Sep 13 17:11:59 smithi195 podman[88811]: 2024-09-13 17:11:59.406768376 +0000 UTC m=+0.350390061 container init ccd1b2bf7d86bf422d7a1366de81abbad8983f53753df2b1faa1258d63d69074 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-3, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, ceph=True, org.label-schema.build-date=20240731) 2024-09-13T17:11:59.431 INFO:journalctl@ceph.osd.3.smithi195.stdout:Sep 13 17:11:59 smithi195 podman[88811]: 2024-09-13 17:11:59.409811348 +0000 UTC m=+0.353433036 container start ccd1b2bf7d86bf422d7a1366de81abbad8983f53753df2b1faa1258d63d69074 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-3, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-13T17:11:59.827 INFO:journalctl@ceph.osd.3.smithi195.stdout:Sep 13 17:11:59 smithi195 ceph-osd[88830]: -- 172.21.15.195:0/247439137 <== mon.1 v2:172.21.15.195:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55b635f7d1e0 con 0x55b636cfc000 2024-09-13T17:11:59.827 INFO:journalctl@ceph.osd.3.smithi195.stdout:Sep 13 17:11:59 smithi195 bash[88811]: ccd1b2bf7d86bf422d7a1366de81abbad8983f53753df2b1faa1258d63d69074 2024-09-13T17:11:59.827 INFO:journalctl@ceph.osd.3.smithi195.stdout:Sep 13 17:11:59 smithi195 systemd[1]: Started Ceph osd.3 for ffbd7588-71f0-11ef-bceb-c7b262605968. 2024-09-13T17:12:00.228 INFO:journalctl@ceph.osd.3.smithi195.stdout:Sep 13 17:11:59 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-3[88826]: 2024-09-13T17:11:59.956+0000 7f5dcf62d640 -1 Falling back to public interface 2024-09-13T17:12:00.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:00 smithi195 ceph-mon[80021]: pgmap v182: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 48/222 objects degraded (21.622%) 2024-09-13T17:12:00.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:00 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:12:00.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:00 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:12:00.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:00 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:12:00.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:00 smithi115 ceph-mon[109488]: pgmap v182: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 48/222 objects degraded (21.622%) 2024-09-13T17:12:00.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:00 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:12:00.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:00 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:12:00.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:00 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:12:02.823 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:02 smithi115 ceph-mon[109488]: pgmap v183: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 48/222 objects degraded (21.622%) 2024-09-13T17:12:02.884 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:02 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:12:02.884 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:02 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:12:02.885 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:02 smithi195 ceph-mon[80021]: pgmap v183: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 48/222 objects degraded (21.622%) 2024-09-13T17:12:02.885 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:02 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:12:02.885 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:02 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:12:04.253 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:03 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:12:04.253 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:03 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:12:04.253 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:03 smithi195 ceph-mon[80021]: pgmap v184: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 48/222 objects degraded (21.622%) 2024-09-13T17:12:04.253 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:03 smithi195 ceph-mon[80021]: Health check update: Degraded data redundancy: 48/222 objects degraded (21.622%), 17 pgs degraded (PG_DEGRADED) 2024-09-13T17:12:04.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:03 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:12:04.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:03 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:12:04.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:03 smithi115 ceph-mon[109488]: pgmap v184: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 199 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 48/222 objects degraded (21.622%) 2024-09-13T17:12:04.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:03 smithi115 ceph-mon[109488]: Health check update: Degraded data redundancy: 48/222 objects degraded (21.622%), 17 pgs degraded (PG_DEGRADED) 2024-09-13T17:12:05.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:05 smithi115 ceph-mon[109488]: from='osd.3 [v2:172.21.15.195:6800/2321302370,v1:172.21.15.195:6801/2321302370]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T17:12:05.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:05 smithi115 ceph-mon[109488]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T17:12:05.568 INFO:journalctl@ceph.osd.3.smithi195.stdout:Sep 13 17:12:05 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-3[88826]: 2024-09-13T17:12:05.156+0000 7f5dcf62d640 -1 osd.3 63 log_to_monitors true 2024-09-13T17:12:05.568 INFO:journalctl@ceph.osd.3.smithi195.stdout:Sep 13 17:12:05 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-3[88826]: 2024-09-13T17:12:05.248+0000 7f5dc33be640 -1 osd.3 63 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T17:12:05.568 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:05 smithi195 ceph-mon[80021]: from='osd.3 [v2:172.21.15.195:6800/2321302370,v1:172.21.15.195:6801/2321302370]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T17:12:05.568 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:05 smithi195 ceph-mon[80021]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T17:12:05.584 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:05.583+0000 7f935a492640 1 -- 172.21.15.115:0/4032138087 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f93541049a0 msgr2=0x7f9354104d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:05.585 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:05.583+0000 7f935a492640 1 --2- 172.21.15.115:0/4032138087 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f93541049a0 0x7f9354104d80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9344009880 tx=0x7f934402a4a0 comp rx=0 tx=0).stop 2024-09-13T17:12:05.585 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:05.583+0000 7f935a492640 1 -- 172.21.15.115:0/4032138087 shutdown_connections 2024-09-13T17:12:05.585 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:05.583+0000 7f935a492640 1 --2- 172.21.15.115:0/4032138087 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f93540fe9a0 0x7f93540fee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:05.585 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:05.583+0000 7f935a492640 1 --2- 172.21.15.115:0/4032138087 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f93541049a0 0x7f9354104d80 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:05.585 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:05.583+0000 7f935a492640 1 -- 172.21.15.115:0/4032138087 >> 172.21.15.115:0/4032138087 conn(0x7f93540758c0 msgr2=0x7f93540fcc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:05.585 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:05.583+0000 7f935a492640 1 -- 172.21.15.115:0/4032138087 shutdown_connections 2024-09-13T17:12:05.585 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:05.583+0000 7f935a492640 1 -- 172.21.15.115:0/4032138087 wait complete. 2024-09-13T17:12:05.587 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:05.584+0000 7f935a492640 1 Processor -- start 2024-09-13T17:12:05.587 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:05.584+0000 7f935a492640 1 -- start start 2024-09-13T17:12:05.587 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:05.585+0000 7f935a492640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f93540fe9a0 0x7f9354196990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:05.587 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:05.585+0000 7f935a492640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f93541049a0 0x7f9354196ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:05.587 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:05.585+0000 7f935a492640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93541974f0 con 0x7f93541049a0 2024-09-13T17:12:05.587 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:05.585+0000 7f935a492640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9354197630 con 0x7f93540fe9a0 2024-09-13T17:12:05.587 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:05.585+0000 7f93537fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f93541049a0 0x7f9354196ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:05.587 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:05.585+0000 7f9353fff640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f93540fe9a0 0x7f9354196990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:05.587 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:05.585+0000 7f9353fff640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f93540fe9a0 0x7f9354196990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.115:50378/0 (socket says 172.21.15.115:50378) 2024-09-13T17:12:05.587 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:05.585+0000 7f93537fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f93541049a0 0x7f9354196ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52532/0 (socket says 172.21.15.115:52532) 2024-09-13T17:12:05.588 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:05.585+0000 7f9353fff640 1 -- 172.21.15.115:0/205479721 learned_addr learned my addr 172.21.15.115:0/205479721 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:12:05.588 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:05.585+0000 7f9353fff640 1 -- 172.21.15.115:0/205479721 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f93541049a0 msgr2=0x7f9354196ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:05.588 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:05.585+0000 7f9353fff640 1 --2- 172.21.15.115:0/205479721 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f93541049a0 0x7f9354196ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:05.588 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:05.585+0000 7f9353fff640 1 -- 172.21.15.115:0/205479721 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9344009560 con 0x7f93540fe9a0 2024-09-13T17:12:05.588 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:05.585+0000 7f9353fff640 1 --2- 172.21.15.115:0/205479721 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f93540fe9a0 0x7f9354196990 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f934402a9c0 tx=0x7f93440055a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:05.588 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:05.586+0000 7f93517fa640 1 -- 172.21.15.115:0/205479721 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9344004b60 con 0x7f93540fe9a0 2024-09-13T17:12:05.588 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:05.586+0000 7f93517fa640 1 -- 172.21.15.115:0/205479721 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9344004cc0 con 0x7f93540fe9a0 2024-09-13T17:12:05.588 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:05.586+0000 7f93517fa640 1 -- 172.21.15.115:0/205479721 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9344031950 con 0x7f93540fe9a0 2024-09-13T17:12:05.588 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:05.586+0000 7f935a492640 1 -- 172.21.15.115:0/205479721 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f935419fa00 con 0x7f93540fe9a0 2024-09-13T17:12:05.588 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:05.586+0000 7f935a492640 1 -- 172.21.15.115:0/205479721 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f935419fe10 con 0x7f93540fe9a0 2024-09-13T17:12:05.589 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:05.587+0000 7f935a492640 1 -- 172.21.15.115:0/205479721 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93541000e0 con 0x7f93540fe9a0 2024-09-13T17:12:05.589 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:05.587+0000 7f93517fa640 1 -- 172.21.15.115:0/205479721 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f9344003c20 con 0x7f93540fe9a0 2024-09-13T17:12:05.589 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:05.588+0000 7f93517fa640 1 --2- 172.21.15.115:0/205479721 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f934006cc50 0x7f934006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:05.589 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:05.588+0000 7f93517fa640 1 -- 172.21.15.115:0/205479721 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f93440ad550 con 0x7f93540fe9a0 2024-09-13T17:12:05.589 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:05.588+0000 7f93537fe640 1 --2- 172.21.15.115:0/205479721 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f934006cc50 0x7f934006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:05.590 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:05.588+0000 7f93537fe640 1 --2- 172.21.15.115:0/205479721 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f934006cc50 0x7f934006f110 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f93540687a0 tx=0x7f933c00b390 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:05.593 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:05.592+0000 7f93517fa640 1 -- 172.21.15.115:0/205479721 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f9344077700 con 0x7f93540fe9a0 2024-09-13T17:12:05.775 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:05.774+0000 7f935a492640 1 -- 172.21.15.115:0/205479721 --> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9354068220 con 0x7f934006cc50 2024-09-13T17:12:05.776 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:05.775+0000 7f93517fa640 1 -- 172.21.15.115:0/205479721 <== mgr.14660 v2:172.21.15.115:6800/1049502673 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f9354068220 con 0x7f934006cc50 2024-09-13T17:12:05.779 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:05.777+0000 7f935a492640 1 -- 172.21.15.115:0/205479721 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f934006cc50 msgr2=0x7f934006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:05.779 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:05.777+0000 7f935a492640 1 --2- 172.21.15.115:0/205479721 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f934006cc50 0x7f934006f110 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f93540687a0 tx=0x7f933c00b390 comp rx=0 tx=0).stop 2024-09-13T17:12:05.779 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:05.777+0000 7f935a492640 1 -- 172.21.15.115:0/205479721 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f93540fe9a0 msgr2=0x7f9354196990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:05.779 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:05.777+0000 7f935a492640 1 --2- 172.21.15.115:0/205479721 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f93540fe9a0 0x7f9354196990 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f934402a9c0 tx=0x7f93440055a0 comp rx=0 tx=0).stop 2024-09-13T17:12:05.779 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:05.777+0000 7f935a492640 1 -- 172.21.15.115:0/205479721 shutdown_connections 2024-09-13T17:12:05.779 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:05.777+0000 7f935a492640 1 --2- 172.21.15.115:0/205479721 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f934006cc50 0x7f934006f110 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:05.779 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:05.777+0000 7f935a492640 1 --2- 172.21.15.115:0/205479721 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f93541049a0 0x7f9354196ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:05.779 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:05.777+0000 7f935a492640 1 --2- 172.21.15.115:0/205479721 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f93540fe9a0 0x7f9354196990 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:05.779 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:05.777+0000 7f935a492640 1 -- 172.21.15.115:0/205479721 >> 172.21.15.115:0/205479721 conn(0x7f93540758c0 msgr2=0x7f9354102350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:05.779 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:05.777+0000 7f935a492640 1 -- 172.21.15.115:0/205479721 shutdown_connections 2024-09-13T17:12:05.780 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:05.777+0000 7f935a492640 1 -- 172.21.15.115:0/205479721 wait complete. 2024-09-13T17:12:05.788 INFO:teuthology.orchestra.run.smithi115.stdout:true 2024-09-13T17:12:05.861 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:05.859+0000 7f1680cb4640 1 -- 172.21.15.115:0/974327349 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f167c101600 msgr2=0x7f167c109af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:05.861 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:05.859+0000 7f1680cb4640 1 --2- 172.21.15.115:0/974327349 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f167c101600 0x7f167c109af0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1670009880 tx=0x7f167002a530 comp rx=0 tx=0).stop 2024-09-13T17:12:05.861 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:05.860+0000 7f1680cb4640 1 -- 172.21.15.115:0/974327349 shutdown_connections 2024-09-13T17:12:05.861 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:05.860+0000 7f1680cb4640 1 --2- 172.21.15.115:0/974327349 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f167c101600 0x7f167c109af0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:05.861 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:05.860+0000 7f1680cb4640 1 --2- 172.21.15.115:0/974327349 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f167c100ce0 0x7f167c1010c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:05.862 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:05.860+0000 7f1680cb4640 1 -- 172.21.15.115:0/974327349 >> 172.21.15.115:0/974327349 conn(0x7f167c0758c0 msgr2=0x7f167c0fcc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:05.862 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:05.860+0000 7f1680cb4640 1 -- 172.21.15.115:0/974327349 shutdown_connections 2024-09-13T17:12:05.862 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:05.860+0000 7f1680cb4640 1 -- 172.21.15.115:0/974327349 wait complete. 2024-09-13T17:12:05.865 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:05.861+0000 7f1680cb4640 1 Processor -- start 2024-09-13T17:12:05.865 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:05.861+0000 7f1680cb4640 1 -- start start 2024-09-13T17:12:05.865 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:05.861+0000 7f1680cb4640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f167c100ce0 0x7f167c0fe940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:05.865 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:05.861+0000 7f1680cb4640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f167c101600 0x7f167c0fee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:05.865 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:05.861+0000 7f1680cb4640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f167c0ff3c0 con 0x7f167c101600 2024-09-13T17:12:05.865 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:05.861+0000 7f1680cb4640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f167c0ff530 con 0x7f167c100ce0 2024-09-13T17:12:05.865 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:05.861+0000 7f1679d9b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f167c101600 0x7f167c0fee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:05.865 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:05.861+0000 7f1679d9b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f167c101600 0x7f167c0fee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52548/0 (socket says 172.21.15.115:52548) 2024-09-13T17:12:05.866 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:05.861+0000 7f1679d9b640 1 -- 172.21.15.115:0/4146674218 learned_addr learned my addr 172.21.15.115:0/4146674218 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:12:05.866 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:05.861+0000 7f167a59c640 1 --2- 172.21.15.115:0/4146674218 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f167c100ce0 0x7f167c0fe940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:05.866 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:05.861+0000 7f1679d9b640 1 -- 172.21.15.115:0/4146674218 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f167c100ce0 msgr2=0x7f167c0fe940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:05.866 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:05.861+0000 7f1679d9b640 1 --2- 172.21.15.115:0/4146674218 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f167c100ce0 0x7f167c0fe940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:05.866 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:05.861+0000 7f1679d9b640 1 -- 172.21.15.115:0/4146674218 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1670009560 con 0x7f167c101600 2024-09-13T17:12:05.866 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:05.862+0000 7f1679d9b640 1 --2- 172.21.15.115:0/4146674218 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f167c101600 0x7f167c0fee80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f167002aa50 tx=0x7f1670004c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:05.866 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:05.862+0000 7f166b7fe640 1 -- 172.21.15.115:0/4146674218 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1670005330 con 0x7f167c101600 2024-09-13T17:12:05.866 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:05.862+0000 7f166b7fe640 1 -- 172.21.15.115:0/4146674218 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1670005490 con 0x7f167c101600 2024-09-13T17:12:05.866 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:05.862+0000 7f1680cb4640 1 -- 172.21.15.115:0/4146674218 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f167c0ff7b0 con 0x7f167c101600 2024-09-13T17:12:05.866 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:05.862+0000 7f166b7fe640 1 -- 172.21.15.115:0/4146674218 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f16700318f0 con 0x7f167c101600 2024-09-13T17:12:05.866 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:05.862+0000 7f1680cb4640 1 -- 172.21.15.115:0/4146674218 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f167c1a1e90 con 0x7f167c101600 2024-09-13T17:12:05.866 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:05.863+0000 7f1680cb4640 1 -- 172.21.15.115:0/4146674218 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f167c068440 con 0x7f167c101600 2024-09-13T17:12:05.866 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:05.863+0000 7f166b7fe640 1 -- 172.21.15.115:0/4146674218 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f167002ad50 con 0x7f167c101600 2024-09-13T17:12:05.866 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:05.864+0000 7f166b7fe640 1 --2- 172.21.15.115:0/4146674218 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f166406cc50 0x7f166406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:05.867 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:05.864+0000 7f166b7fe640 1 -- 172.21.15.115:0/4146674218 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f16700ad200 con 0x7f167c101600 2024-09-13T17:12:05.867 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:05.864+0000 7f167a59c640 1 --2- 172.21.15.115:0/4146674218 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f166406cc50 0x7f166406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:05.867 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:05.865+0000 7f167a59c640 1 --2- 172.21.15.115:0/4146674218 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f166406cc50 0x7f166406f110 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f166c005fd0 tx=0x7f166c009680 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:05.869 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:05.869+0000 7f166b7fe640 1 -- 172.21.15.115:0/4146674218 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f16700773d0 con 0x7f167c101600 2024-09-13T17:12:06.054 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.053+0000 7f1680cb4640 1 -- 172.21.15.115:0/4146674218 --> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f167c0ff7b0 con 0x7f166406cc50 2024-09-13T17:12:06.055 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.054+0000 7f166b7fe640 1 -- 172.21.15.115:0/4146674218 <== mgr.14660 v2:172.21.15.115:6800/1049502673 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f167c0ff7b0 con 0x7f166406cc50 2024-09-13T17:12:06.057 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.056+0000 7f1680cb4640 1 -- 172.21.15.115:0/4146674218 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f166406cc50 msgr2=0x7f166406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:06.057 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.056+0000 7f1680cb4640 1 --2- 172.21.15.115:0/4146674218 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f166406cc50 0x7f166406f110 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f166c005fd0 tx=0x7f166c009680 comp rx=0 tx=0).stop 2024-09-13T17:12:06.057 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.056+0000 7f1680cb4640 1 -- 172.21.15.115:0/4146674218 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f167c101600 msgr2=0x7f167c0fee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:06.057 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.056+0000 7f1680cb4640 1 --2- 172.21.15.115:0/4146674218 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f167c101600 0x7f167c0fee80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f167002aa50 tx=0x7f1670004c60 comp rx=0 tx=0).stop 2024-09-13T17:12:06.057 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.056+0000 7f1680cb4640 1 -- 172.21.15.115:0/4146674218 shutdown_connections 2024-09-13T17:12:06.057 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.056+0000 7f1680cb4640 1 --2- 172.21.15.115:0/4146674218 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f166406cc50 0x7f166406f110 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:06.058 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.056+0000 7f1680cb4640 1 --2- 172.21.15.115:0/4146674218 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f167c101600 0x7f167c0fee80 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:06.058 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.056+0000 7f1680cb4640 1 --2- 172.21.15.115:0/4146674218 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f167c100ce0 0x7f167c0fe940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:06.058 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.056+0000 7f1680cb4640 1 -- 172.21.15.115:0/4146674218 >> 172.21.15.115:0/4146674218 conn(0x7f167c0758c0 msgr2=0x7f167c101f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:06.058 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.056+0000 7f1680cb4640 1 -- 172.21.15.115:0/4146674218 shutdown_connections 2024-09-13T17:12:06.058 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.056+0000 7f1680cb4640 1 -- 172.21.15.115:0/4146674218 wait complete. 2024-09-13T17:12:06.137 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.136+0000 7f3021cd2640 1 -- 172.21.15.115:0/1454595888 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f301c0fea20 msgr2=0x7f301c0fee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:06.138 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.136+0000 7f3021cd2640 1 --2- 172.21.15.115:0/1454595888 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f301c0fea20 0x7f301c0fee80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3004009880 tx=0x7f300402a4a0 comp rx=0 tx=0).stop 2024-09-13T17:12:06.138 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.136+0000 7f3021cd2640 1 -- 172.21.15.115:0/1454595888 shutdown_connections 2024-09-13T17:12:06.138 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.136+0000 7f3021cd2640 1 --2- 172.21.15.115:0/1454595888 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f301c0fea20 0x7f301c0fee80 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:06.138 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.136+0000 7f3021cd2640 1 --2- 172.21.15.115:0/1454595888 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f301c104a20 0x7f301c104e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:06.138 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.136+0000 7f3021cd2640 1 -- 172.21.15.115:0/1454595888 >> 172.21.15.115:0/1454595888 conn(0x7f301c0fa720 msgr2=0x7f301c0fcb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:06.138 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.136+0000 7f3021cd2640 1 -- 172.21.15.115:0/1454595888 shutdown_connections 2024-09-13T17:12:06.138 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.137+0000 7f3021cd2640 1 -- 172.21.15.115:0/1454595888 wait complete. 2024-09-13T17:12:06.140 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.137+0000 7f3021cd2640 1 Processor -- start 2024-09-13T17:12:06.140 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.137+0000 7f3021cd2640 1 -- start start 2024-09-13T17:12:06.140 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.137+0000 7f3021cd2640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f301c0fea20 0x7f301c0fb080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:06.140 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.137+0000 7f3021cd2640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f301c104a20 0x7f301c0fb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:06.140 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.137+0000 7f3021cd2640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f301c0fbb00 con 0x7f301c104a20 2024-09-13T17:12:06.140 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.137+0000 7f3021cd2640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f301c0fbc40 con 0x7f301c0fea20 2024-09-13T17:12:06.140 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.138+0000 7f3013fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f301c104a20 0x7f301c0fb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:06.140 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.138+0000 7f3013fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f301c104a20 0x7f301c0fb5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52576/0 (socket says 172.21.15.115:52576) 2024-09-13T17:12:06.140 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.138+0000 7f3013fff640 1 -- 172.21.15.115:0/128327707 learned_addr learned my addr 172.21.15.115:0/128327707 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:12:06.140 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.138+0000 7f301b7fe640 1 --2- 172.21.15.115:0/128327707 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f301c0fea20 0x7f301c0fb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:06.140 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.138+0000 7f3013fff640 1 -- 172.21.15.115:0/128327707 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f301c0fea20 msgr2=0x7f301c0fb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:06.140 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.138+0000 7f3013fff640 1 --2- 172.21.15.115:0/128327707 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f301c0fea20 0x7f301c0fb080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:06.141 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.138+0000 7f3013fff640 1 -- 172.21.15.115:0/128327707 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3004009560 con 0x7f301c104a20 2024-09-13T17:12:06.141 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.138+0000 7f3013fff640 1 --2- 172.21.15.115:0/128327707 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f301c104a20 0x7f301c0fb5c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f300402a9c0 tx=0x7f30040055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:06.141 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.138+0000 7f30197fa640 1 -- 172.21.15.115:0/128327707 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3004004b60 con 0x7f301c104a20 2024-09-13T17:12:06.141 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.138+0000 7f30197fa640 1 -- 172.21.15.115:0/128327707 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3004004cc0 con 0x7f301c104a20 2024-09-13T17:12:06.141 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.138+0000 7f3021cd2640 1 -- 172.21.15.115:0/128327707 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f301c0fbec0 con 0x7f301c104a20 2024-09-13T17:12:06.141 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.138+0000 7f30197fa640 1 -- 172.21.15.115:0/128327707 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3004031950 con 0x7f301c104a20 2024-09-13T17:12:06.141 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.138+0000 7f3021cd2640 1 -- 172.21.15.115:0/128327707 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f301c1a1f00 con 0x7f301c104a20 2024-09-13T17:12:06.142 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.139+0000 7f3021cd2640 1 -- 172.21.15.115:0/128327707 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f301c100160 con 0x7f301c104a20 2024-09-13T17:12:06.142 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.140+0000 7f30197fa640 1 -- 172.21.15.115:0/128327707 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f3004003c20 con 0x7f301c104a20 2024-09-13T17:12:06.142 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.141+0000 7f30197fa640 1 --2- 172.21.15.115:0/128327707 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f300806cc50 0x7f300806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:06.142 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.141+0000 7f301b7fe640 1 --2- 172.21.15.115:0/128327707 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f300806cc50 0x7f300806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:06.142 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.141+0000 7f30197fa640 1 -- 172.21.15.115:0/128327707 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f30040ad490 con 0x7f301c104a20 2024-09-13T17:12:06.142 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.141+0000 7f301b7fe640 1 --2- 172.21.15.115:0/128327707 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f300806cc50 0x7f300806f110 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f300c00bbe0 tx=0x7f300c00b390 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:06.146 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.145+0000 7f30197fa640 1 -- 172.21.15.115:0/128327707 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f30040776e0 con 0x7f301c104a20 2024-09-13T17:12:06.332 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.331+0000 7f3021cd2640 1 -- 172.21.15.115:0/128327707 --> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f301c10bb50 con 0x7f300806cc50 2024-09-13T17:12:06.341 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.340+0000 7f30197fa640 1 -- 172.21.15.115:0/128327707 <== mgr.14660 v2:172.21.15.115:6800/1049502673 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f301c10bb50 con 0x7f300806cc50 2024-09-13T17:12:06.341 INFO:teuthology.orchestra.run.smithi115.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T17:12:06.341 INFO:teuthology.orchestra.run.smithi115.stdout:alertmanager.smithi115 smithi115 *:9093,9094 running (3m) 35s ago 14m 25.0M - 0.25.0 c8568f914cd2 d56b91240fe1 2024-09-13T17:12:06.342 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-exporter.smithi115 smithi115 running (14m) 35s ago 14m 8376k - 18.2.4-843-g2c01458a c129f5a2fd4e 0f1eebeaf9bb 2024-09-13T17:12:06.342 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-exporter.smithi195 smithi195 running (13m) 3s ago 13m 7948k - 18.2.4-843-g2c01458a c129f5a2fd4e 6d05bafbac8a 2024-09-13T17:12:06.342 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi115 smithi115 running (2m) 35s ago 14m 6895k - 18.2.4-860-g6c6b083f 8a91f241d7d4 e8175bc055bf 2024-09-13T17:12:06.342 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi195 smithi195 running (2m) 3s ago 13m 6903k - 18.2.4-860-g6c6b083f 8a91f241d7d4 ccb4895be776 2024-09-13T17:12:06.342 INFO:teuthology.orchestra.run.smithi115.stdout:grafana.smithi115 smithi115 *:3000 running (3m) 35s ago 13m 80.6M - 9.4.7 954c08fa6188 e1eccb1a8f3e 2024-09-13T17:12:06.342 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi115.hbtxod smithi115 running (8m) 35s ago 8m 98.5M - 18.2.4-843-g2c01458a c129f5a2fd4e 12b4f4874491 2024-09-13T17:12:06.342 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi115.ijznvr smithi115 running (8m) 35s ago 8m 166M - 18.2.4-843-g2c01458a c129f5a2fd4e 2d552564a9f4 2024-09-13T17:12:06.342 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi195.aevvgz smithi195 running (8m) 3s ago 8m 18.4M - 18.2.4-843-g2c01458a c129f5a2fd4e 299b9ad657c9 2024-09-13T17:12:06.342 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi195.qzghxj smithi195 running (8m) 3s ago 8m 16.2M - 18.2.4-843-g2c01458a c129f5a2fd4e fb16b16181ff 2024-09-13T17:12:06.342 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi115.hetcni smithi115 *:8443,9283,8765 running (5m) 35s ago 15m 494M - 18.2.4-860-g6c6b083f 8a91f241d7d4 b945dbde1934 2024-09-13T17:12:06.342 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi195.hjjifz smithi195 *:8443,9283,8765 running (4m) 3s ago 13m 441M - 18.2.4-860-g6c6b083f 8a91f241d7d4 17bccdfbcae1 2024-09-13T17:12:06.342 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi115 smithi115 running (2m) 35s ago 15m 40.7M 2048M 18.2.4-860-g6c6b083f 8a91f241d7d4 8dd7baf2c6b6 2024-09-13T17:12:06.343 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi195 smithi195 running (2m) 3s ago 13m 35.7M 2048M 18.2.4-860-g6c6b083f 8a91f241d7d4 0459bc5e6b08 2024-09-13T17:12:06.343 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi115 smithi115 *:9100 running (4m) 35s ago 14m 16.5M - 1.5.0 0da6a335fe13 26fb6f9844b5 2024-09-13T17:12:06.343 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi195 smithi195 *:9100 running (4m) 3s ago 13m 16.9M - 1.5.0 0da6a335fe13 6d38e798fb16 2024-09-13T17:12:06.343 INFO:teuthology.orchestra.run.smithi115.stdout:osd.0 smithi115 running (109s) 35s ago 12m 99.7M 1216M 18.2.4-860-g6c6b083f 8a91f241d7d4 3b9f874c64e9 2024-09-13T17:12:06.343 INFO:teuthology.orchestra.run.smithi115.stdout:osd.1 smithi115 running (75s) 35s ago 11m 101M 1216M 18.2.4-860-g6c6b083f 8a91f241d7d4 f0de6684601c 2024-09-13T17:12:06.343 INFO:teuthology.orchestra.run.smithi115.stdout:osd.2 smithi115 running (41s) 35s ago 11m 13.6M 1216M 18.2.4-860-g6c6b083f 8a91f241d7d4 edb753bab54a 2024-09-13T17:12:06.343 INFO:teuthology.orchestra.run.smithi115.stdout:osd.3 smithi195 running (7s) 3s ago 11m 12.1M 2240M 18.2.4-860-g6c6b083f 8a91f241d7d4 ccd1b2bf7d86 2024-09-13T17:12:06.343 INFO:teuthology.orchestra.run.smithi115.stdout:osd.4 smithi195 running (10m) 3s ago 10m 265M 2240M 18.2.4-843-g2c01458a c129f5a2fd4e 4bbc3acb9aff 2024-09-13T17:12:06.343 INFO:teuthology.orchestra.run.smithi115.stdout:osd.5 smithi195 running (10m) 3s ago 10m 236M 2240M 18.2.4-843-g2c01458a c129f5a2fd4e 4bd1b3a232d0 2024-09-13T17:12:06.343 INFO:teuthology.orchestra.run.smithi115.stdout:prometheus.smithi115 smithi115 *:9095 running (4m) 35s ago 13m 64.3M - 2.43.0 a07b618ecd1d e03fb39f6b76 2024-09-13T17:12:06.344 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.342+0000 7f3021cd2640 1 -- 172.21.15.115:0/128327707 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f300806cc50 msgr2=0x7f300806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:06.344 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.342+0000 7f3021cd2640 1 --2- 172.21.15.115:0/128327707 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f300806cc50 0x7f300806f110 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f300c00bbe0 tx=0x7f300c00b390 comp rx=0 tx=0).stop 2024-09-13T17:12:06.344 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.342+0000 7f3021cd2640 1 -- 172.21.15.115:0/128327707 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f301c104a20 msgr2=0x7f301c0fb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:06.344 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.342+0000 7f3021cd2640 1 --2- 172.21.15.115:0/128327707 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f301c104a20 0x7f301c0fb5c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f300402a9c0 tx=0x7f30040055a0 comp rx=0 tx=0).stop 2024-09-13T17:12:06.344 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.342+0000 7f3021cd2640 1 -- 172.21.15.115:0/128327707 shutdown_connections 2024-09-13T17:12:06.344 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.342+0000 7f3021cd2640 1 --2- 172.21.15.115:0/128327707 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f300806cc50 0x7f300806f110 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:06.344 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.342+0000 7f3021cd2640 1 --2- 172.21.15.115:0/128327707 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f301c104a20 0x7f301c0fb5c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:06.345 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.342+0000 7f3021cd2640 1 --2- 172.21.15.115:0/128327707 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f301c0fea20 0x7f301c0fb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:06.345 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.342+0000 7f3021cd2640 1 -- 172.21.15.115:0/128327707 >> 172.21.15.115:0/128327707 conn(0x7f301c0fa720 msgr2=0x7f301c068960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:06.345 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.342+0000 7f3021cd2640 1 -- 172.21.15.115:0/128327707 shutdown_connections 2024-09-13T17:12:06.345 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.342+0000 7f3021cd2640 1 -- 172.21.15.115:0/128327707 wait complete. 2024-09-13T17:12:06.424 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.422+0000 7fce912b6640 1 -- 172.21.15.115:0/1793900654 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce8c105b80 msgr2=0x7fce8c105f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:06.424 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.422+0000 7fce912b6640 1 --2- 172.21.15.115:0/1793900654 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce8c105b80 0x7fce8c105f60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fce7c009880 tx=0x7fce7c02a4a0 comp rx=0 tx=0).stop 2024-09-13T17:12:06.424 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.422+0000 7fce912b6640 1 -- 172.21.15.115:0/1793900654 shutdown_connections 2024-09-13T17:12:06.424 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.422+0000 7fce912b6640 1 --2- 172.21.15.115:0/1793900654 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce8c0ffaf0 0x7fce8c0fff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:06.424 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.422+0000 7fce912b6640 1 --2- 172.21.15.115:0/1793900654 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce8c105b80 0x7fce8c105f60 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:06.424 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.422+0000 7fce912b6640 1 -- 172.21.15.115:0/1793900654 >> 172.21.15.115:0/1793900654 conn(0x7fce8c0fb810 msgr2=0x7fce8c0fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:06.424 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.422+0000 7fce912b6640 1 -- 172.21.15.115:0/1793900654 shutdown_connections 2024-09-13T17:12:06.424 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.422+0000 7fce912b6640 1 -- 172.21.15.115:0/1793900654 wait complete. 2024-09-13T17:12:06.425 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:06 smithi115 ceph-mon[109488]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-13T17:12:06.425 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:06 smithi115 ceph-mon[109488]: osdmap e66: 6 total, 5 up, 6 in 2024-09-13T17:12:06.425 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:06 smithi115 ceph-mon[109488]: from='osd.3 [v2:172.21.15.195:6800/2321302370,v1:172.21.15.195:6801/2321302370]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-09-13T17:12:06.425 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:06 smithi115 ceph-mon[109488]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-09-13T17:12:06.425 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:06 smithi115 ceph-mon[109488]: pgmap v186: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 199 MiB data, 984 MiB used, 535 GiB / 536 GiB avail; 48/222 objects degraded (21.622%) 2024-09-13T17:12:06.425 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:06 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:12:06.425 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:06 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:12:06.425 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:06 smithi115 ceph-mon[109488]: from='client.44197 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:12:06.425 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:06 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:12:06.425 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:06 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:12:06.425 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:06 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:12:06.426 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:06 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:12:06.426 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:06 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:12:06.426 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:06 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:12:06.426 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:06 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:12:06.426 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:06 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:12:06.426 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:06 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:12:06.426 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:06 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-13T17:12:06.428 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.423+0000 7fce912b6640 1 Processor -- start 2024-09-13T17:12:06.428 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.423+0000 7fce912b6640 1 -- start start 2024-09-13T17:12:06.428 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.424+0000 7fce912b6640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce8c0ffaf0 0x7fce8c19b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:06.428 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.424+0000 7fce912b6640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce8c105b80 0x7fce8c19bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:06.428 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.424+0000 7fce912b6640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce8c19c260 con 0x7fce8c0ffaf0 2024-09-13T17:12:06.428 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.424+0000 7fce912b6640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce8c195880 con 0x7fce8c105b80 2024-09-13T17:12:06.428 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.424+0000 7fce8affd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce8c0ffaf0 0x7fce8c19b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:06.428 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.424+0000 7fce8affd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce8c0ffaf0 0x7fce8c19b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52588/0 (socket says 172.21.15.115:52588) 2024-09-13T17:12:06.428 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.424+0000 7fce8affd640 1 -- 172.21.15.115:0/2304413838 learned_addr learned my addr 172.21.15.115:0/2304413838 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:12:06.428 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.424+0000 7fce827fc640 1 --2- 172.21.15.115:0/2304413838 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce8c105b80 0x7fce8c19bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:06.429 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.424+0000 7fce8affd640 1 -- 172.21.15.115:0/2304413838 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce8c105b80 msgr2=0x7fce8c19bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:06.429 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.424+0000 7fce8affd640 1 --2- 172.21.15.115:0/2304413838 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce8c105b80 0x7fce8c19bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:06.429 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.424+0000 7fce8affd640 1 -- 172.21.15.115:0/2304413838 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce7c009560 con 0x7fce8c0ffaf0 2024-09-13T17:12:06.429 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.424+0000 7fce8affd640 1 --2- 172.21.15.115:0/2304413838 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce8c0ffaf0 0x7fce8c19b790 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fce7c006010 tx=0x7fce7c0055f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:06.429 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.424+0000 7fce88ff9640 1 -- 172.21.15.115:0/2304413838 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce7c004b20 con 0x7fce8c0ffaf0 2024-09-13T17:12:06.429 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.425+0000 7fce912b6640 1 -- 172.21.15.115:0/2304413838 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce8c195b00 con 0x7fce8c0ffaf0 2024-09-13T17:12:06.429 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.425+0000 7fce88ff9640 1 -- 172.21.15.115:0/2304413838 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fce7c004c80 con 0x7fce8c0ffaf0 2024-09-13T17:12:06.429 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.425+0000 7fce88ff9640 1 -- 172.21.15.115:0/2304413838 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce7c031890 con 0x7fce8c0ffaf0 2024-09-13T17:12:06.429 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.425+0000 7fce912b6640 1 -- 172.21.15.115:0/2304413838 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce8c195ff0 con 0x7fce8c0ffaf0 2024-09-13T17:12:06.429 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.426+0000 7fce912b6640 1 -- 172.21.15.115:0/2304413838 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce6c005250 con 0x7fce8c0ffaf0 2024-09-13T17:12:06.429 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.426+0000 7fce88ff9640 1 -- 172.21.15.115:0/2304413838 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fce7c031bd0 con 0x7fce8c0ffaf0 2024-09-13T17:12:06.429 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.427+0000 7fce88ff9640 1 --2- 172.21.15.115:0/2304413838 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fce7806cc50 0x7fce7806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:06.429 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.427+0000 7fce88ff9640 1 -- 172.21.15.115:0/2304413838 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fce7c0ad570 con 0x7fce8c0ffaf0 2024-09-13T17:12:06.430 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.427+0000 7fce827fc640 1 --2- 172.21.15.115:0/2304413838 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fce7806cc50 0x7fce7806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:06.430 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.427+0000 7fce827fc640 1 --2- 172.21.15.115:0/2304413838 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fce7806cc50 0x7fce7806f110 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fce8c196cf0 tx=0x7fce7400a2d0 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:06.432 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.431+0000 7fce88ff9640 1 -- 172.21.15.115:0/2304413838 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fce7c077690 con 0x7fce8c0ffaf0 2024-09-13T17:12:06.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:06 smithi195 ceph-mon[80021]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-13T17:12:06.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:06 smithi195 ceph-mon[80021]: osdmap e66: 6 total, 5 up, 6 in 2024-09-13T17:12:06.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:06 smithi195 ceph-mon[80021]: from='osd.3 [v2:172.21.15.195:6800/2321302370,v1:172.21.15.195:6801/2321302370]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-09-13T17:12:06.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:06 smithi195 ceph-mon[80021]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-09-13T17:12:06.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:06 smithi195 ceph-mon[80021]: pgmap v186: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 199 MiB data, 984 MiB used, 535 GiB / 536 GiB avail; 48/222 objects degraded (21.622%) 2024-09-13T17:12:06.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:06 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:12:06.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:06 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:12:06.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:06 smithi195 ceph-mon[80021]: from='client.44197 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:12:06.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:06 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:12:06.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:06 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:12:06.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:06 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:12:06.578 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:06 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:12:06.578 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:06 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:12:06.578 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:06 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:12:06.578 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:06 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:12:06.578 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:06 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:12:06.578 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:06 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:12:06.578 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:06 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-13T17:12:06.659 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.658+0000 7fce912b6640 1 -- 172.21.15.115:0/2304413838 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fce6c005d10 con 0x7fce8c0ffaf0 2024-09-13T17:12:06.660 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.658+0000 7fce88ff9640 1 -- 172.21.15.115:0/2304413838 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+837 (secure 0 0 0) 0x7fce7c07acb0 con 0x7fce8c0ffaf0 2024-09-13T17:12:06.660 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-13T17:12:06.660 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": { 2024-09-13T17:12:06.660 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 2 2024-09-13T17:12:06.660 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T17:12:06.660 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": { 2024-09-13T17:12:06.660 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 2 2024-09-13T17:12:06.660 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T17:12:06.660 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": { 2024-09-13T17:12:06.660 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-843-g2c01458a (2c01458affee2b2435cd231b6e392435c1c21661) reef (stable)": 2, 2024-09-13T17:12:06.661 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 4 2024-09-13T17:12:06.661 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T17:12:06.661 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": { 2024-09-13T17:12:06.661 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-843-g2c01458a (2c01458affee2b2435cd231b6e392435c1c21661) reef (stable)": 4 2024-09-13T17:12:06.661 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T17:12:06.661 INFO:teuthology.orchestra.run.smithi115.stdout: "overall": { 2024-09-13T17:12:06.661 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-843-g2c01458a (2c01458affee2b2435cd231b6e392435c1c21661) reef (stable)": 6, 2024-09-13T17:12:06.661 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 8 2024-09-13T17:12:06.661 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-13T17:12:06.661 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-13T17:12:06.662 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.661+0000 7fce912b6640 1 -- 172.21.15.115:0/2304413838 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fce7806cc50 msgr2=0x7fce7806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:06.662 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.661+0000 7fce912b6640 1 --2- 172.21.15.115:0/2304413838 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fce7806cc50 0x7fce7806f110 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fce8c196cf0 tx=0x7fce7400a2d0 comp rx=0 tx=0).stop 2024-09-13T17:12:06.662 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.661+0000 7fce912b6640 1 -- 172.21.15.115:0/2304413838 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce8c0ffaf0 msgr2=0x7fce8c19b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:06.662 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.661+0000 7fce912b6640 1 --2- 172.21.15.115:0/2304413838 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce8c0ffaf0 0x7fce8c19b790 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fce7c006010 tx=0x7fce7c0055f0 comp rx=0 tx=0).stop 2024-09-13T17:12:06.662 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.661+0000 7fce912b6640 1 -- 172.21.15.115:0/2304413838 shutdown_connections 2024-09-13T17:12:06.662 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.661+0000 7fce912b6640 1 --2- 172.21.15.115:0/2304413838 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fce7806cc50 0x7fce7806f110 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:06.662 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.661+0000 7fce912b6640 1 --2- 172.21.15.115:0/2304413838 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce8c105b80 0x7fce8c19bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:06.663 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.661+0000 7fce912b6640 1 --2- 172.21.15.115:0/2304413838 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce8c0ffaf0 0x7fce8c19b790 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:06.663 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.661+0000 7fce912b6640 1 -- 172.21.15.115:0/2304413838 >> 172.21.15.115:0/2304413838 conn(0x7fce8c0fb810 msgr2=0x7fce8c0fda90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:06.663 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.661+0000 7fce912b6640 1 -- 172.21.15.115:0/2304413838 shutdown_connections 2024-09-13T17:12:06.663 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.661+0000 7fce912b6640 1 -- 172.21.15.115:0/2304413838 wait complete. 2024-09-13T17:12:06.743 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.742+0000 7f23302e6640 1 -- 172.21.15.115:0/663566187 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23280ffb40 msgr2=0x7f23280fffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:06.744 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.742+0000 7f23302e6640 1 --2- 172.21.15.115:0/663566187 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23280ffb40 0x7f23280fffa0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2324009880 tx=0x7f232402a4a0 comp rx=0 tx=0).stop 2024-09-13T17:12:06.744 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.742+0000 7f23302e6640 1 -- 172.21.15.115:0/663566187 shutdown_connections 2024-09-13T17:12:06.744 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.742+0000 7f23302e6640 1 --2- 172.21.15.115:0/663566187 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23280ffb40 0x7f23280fffa0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:06.744 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.742+0000 7f23302e6640 1 --2- 172.21.15.115:0/663566187 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2328105bf0 0x7f2328105fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:06.744 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.742+0000 7f23302e6640 1 -- 172.21.15.115:0/663566187 >> 172.21.15.115:0/663566187 conn(0x7f23280fb840 msgr2=0x7f23280fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:06.744 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.742+0000 7f23302e6640 1 -- 172.21.15.115:0/663566187 shutdown_connections 2024-09-13T17:12:06.744 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.742+0000 7f23302e6640 1 -- 172.21.15.115:0/663566187 wait complete. 2024-09-13T17:12:06.746 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.743+0000 7f23302e6640 1 Processor -- start 2024-09-13T17:12:06.746 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.743+0000 7f23302e6640 1 -- start start 2024-09-13T17:12:06.746 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.743+0000 7f23302e6640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23280ffb40 0x7f232819b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:06.747 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.743+0000 7f23302e6640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2328105bf0 0x7f232819bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:06.747 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.743+0000 7f23302e6640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23281957d0 con 0x7f23280ffb40 2024-09-13T17:12:06.747 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.743+0000 7f23302e6640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2328195940 con 0x7f2328105bf0 2024-09-13T17:12:06.747 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.743+0000 7f232e082640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23280ffb40 0x7f232819b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:06.747 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.743+0000 7f232e082640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23280ffb40 0x7f232819b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52604/0 (socket says 172.21.15.115:52604) 2024-09-13T17:12:06.747 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.743+0000 7f232e082640 1 -- 172.21.15.115:0/2178952931 learned_addr learned my addr 172.21.15.115:0/2178952931 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:12:06.747 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.743+0000 7f232e082640 1 -- 172.21.15.115:0/2178952931 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2328105bf0 msgr2=0x7f232819bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:06.747 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.743+0000 7f232e082640 1 --2- 172.21.15.115:0/2178952931 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2328105bf0 0x7f232819bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:06.747 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.743+0000 7f232e082640 1 -- 172.21.15.115:0/2178952931 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2324009560 con 0x7f23280ffb40 2024-09-13T17:12:06.747 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.743+0000 7f232e082640 1 --2- 172.21.15.115:0/2178952931 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23280ffb40 0x7f232819b6e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f231800d6f0 tx=0x7f231800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:06.747 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.744+0000 7f231f7fe640 1 -- 172.21.15.115:0/2178952931 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2318009a30 con 0x7f23280ffb40 2024-09-13T17:12:06.747 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.744+0000 7f231f7fe640 1 -- 172.21.15.115:0/2178952931 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f23180054c0 con 0x7f23280ffb40 2024-09-13T17:12:06.748 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.744+0000 7f23302e6640 1 -- 172.21.15.115:0/2178952931 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2328195c20 con 0x7f23280ffb40 2024-09-13T17:12:06.748 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.744+0000 7f231f7fe640 1 -- 172.21.15.115:0/2178952931 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2318004db0 con 0x7f23280ffb40 2024-09-13T17:12:06.748 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.744+0000 7f23302e6640 1 -- 172.21.15.115:0/2178952931 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23281961f0 con 0x7f23280ffb40 2024-09-13T17:12:06.748 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.745+0000 7f23302e6640 1 -- 172.21.15.115:0/2178952931 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23281011f0 con 0x7f23280ffb40 2024-09-13T17:12:06.749 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.745+0000 7f231f7fe640 1 -- 172.21.15.115:0/2178952931 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f2318004f10 con 0x7f23280ffb40 2024-09-13T17:12:06.749 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.746+0000 7f231f7fe640 1 --2- 172.21.15.115:0/2178952931 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f231406cc50 0x7f231406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:06.749 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.746+0000 7f231f7fe640 1 -- 172.21.15.115:0/2178952931 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f231808bf40 con 0x7f23280ffb40 2024-09-13T17:12:06.749 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.746+0000 7f232d881640 1 --2- 172.21.15.115:0/2178952931 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f231406cc50 0x7f231406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:06.749 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.746+0000 7f232d881640 1 --2- 172.21.15.115:0/2178952931 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f231406cc50 0x7f231406f110 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2328196c40 tx=0x7f2324000bc0 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:06.751 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.750+0000 7f231f7fe640 1 -- 172.21.15.115:0/2178952931 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f23180bfe20 con 0x7f23280ffb40 2024-09-13T17:12:06.948 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.946+0000 7f23302e6640 1 -- 172.21.15.115:0/2178952931 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f2328196ce0 con 0x7f23280ffb40 2024-09-13T17:12:06.948 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.947+0000 7f231f7fe640 1 -- 172.21.15.115:0/2178952931 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1874 (secure 0 0 0) 0x7f2318017070 con 0x7f23280ffb40 2024-09-13T17:12:06.948 INFO:teuthology.orchestra.run.smithi115.stdout:e19 2024-09-13T17:12:06.949 INFO:teuthology.orchestra.run.smithi115.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T17:12:06.949 INFO:teuthology.orchestra.run.smithi115.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T17:12:06.949 INFO:teuthology.orchestra.run.smithi115.stdout:legacy client fscid: 1 2024-09-13T17:12:06.949 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:12:06.949 INFO:teuthology.orchestra.run.smithi115.stdout:Filesystem 'cephfs' (1) 2024-09-13T17:12:06.949 INFO:teuthology.orchestra.run.smithi115.stdout:fs_name cephfs 2024-09-13T17:12:06.949 INFO:teuthology.orchestra.run.smithi115.stdout:epoch 19 2024-09-13T17:12:06.949 INFO:teuthology.orchestra.run.smithi115.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T17:12:06.949 INFO:teuthology.orchestra.run.smithi115.stdout:created 2024-09-13T17:03:16.313116+0000 2024-09-13T17:12:06.949 INFO:teuthology.orchestra.run.smithi115.stdout:modified 2024-09-13T17:03:33.410348+0000 2024-09-13T17:12:06.949 INFO:teuthology.orchestra.run.smithi115.stdout:tableserver 0 2024-09-13T17:12:06.949 INFO:teuthology.orchestra.run.smithi115.stdout:root 0 2024-09-13T17:12:06.950 INFO:teuthology.orchestra.run.smithi115.stdout:session_timeout 60 2024-09-13T17:12:06.950 INFO:teuthology.orchestra.run.smithi115.stdout:session_autoclose 300 2024-09-13T17:12:06.950 INFO:teuthology.orchestra.run.smithi115.stdout:max_file_size 1099511627776 2024-09-13T17:12:06.950 INFO:teuthology.orchestra.run.smithi115.stdout:max_xattr_size 65536 2024-09-13T17:12:06.950 INFO:teuthology.orchestra.run.smithi115.stdout:required_client_features {} 2024-09-13T17:12:06.950 INFO:teuthology.orchestra.run.smithi115.stdout:last_failure 0 2024-09-13T17:12:06.950 INFO:teuthology.orchestra.run.smithi115.stdout:last_failure_osd_epoch 46 2024-09-13T17:12:06.950 INFO:teuthology.orchestra.run.smithi115.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T17:12:06.950 INFO:teuthology.orchestra.run.smithi115.stdout:max_mds 1 2024-09-13T17:12:06.950 INFO:teuthology.orchestra.run.smithi115.stdout:in 0 2024-09-13T17:12:06.950 INFO:teuthology.orchestra.run.smithi115.stdout:up {0=14470} 2024-09-13T17:12:06.950 INFO:teuthology.orchestra.run.smithi115.stdout:failed 2024-09-13T17:12:06.950 INFO:teuthology.orchestra.run.smithi115.stdout:damaged 2024-09-13T17:12:06.950 INFO:teuthology.orchestra.run.smithi115.stdout:stopped 2024-09-13T17:12:06.951 INFO:teuthology.orchestra.run.smithi115.stdout:data_pools [3] 2024-09-13T17:12:06.951 INFO:teuthology.orchestra.run.smithi115.stdout:metadata_pool 2 2024-09-13T17:12:06.951 INFO:teuthology.orchestra.run.smithi115.stdout:inline_data enabled 2024-09-13T17:12:06.951 INFO:teuthology.orchestra.run.smithi115.stdout:balancer 2024-09-13T17:12:06.951 INFO:teuthology.orchestra.run.smithi115.stdout:bal_rank_mask -1 2024-09-13T17:12:06.951 INFO:teuthology.orchestra.run.smithi115.stdout:standby_count_wanted 1 2024-09-13T17:12:06.951 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi115.ijznvr{0:14470} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.115:6828/4128583274,v1:172.21.15.115:6829/4128583274] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T17:12:06.951 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi115.hbtxod{0:14486} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.115:6826/1977394649,v1:172.21.15.115:6827/1977394649] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T17:12:06.951 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:12:06.951 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:12:06.951 INFO:teuthology.orchestra.run.smithi115.stdout:Standby daemons: 2024-09-13T17:12:06.951 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:12:06.951 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi195.aevvgz{-1:24253} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.195:6826/8826118,v1:172.21.15.195:6827/8826118] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T17:12:06.951 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi195.qzghxj{-1:24259} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.195:6824/3335357704,v1:172.21.15.195:6825/3335357704] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T17:12:06.952 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 19 2024-09-13T17:12:06.952 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.949+0000 7f23302e6640 1 -- 172.21.15.115:0/2178952931 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f231406cc50 msgr2=0x7f231406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:06.952 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.949+0000 7f23302e6640 1 --2- 172.21.15.115:0/2178952931 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f231406cc50 0x7f231406f110 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2328196c40 tx=0x7f2324000bc0 comp rx=0 tx=0).stop 2024-09-13T17:12:06.952 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.949+0000 7f23302e6640 1 -- 172.21.15.115:0/2178952931 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23280ffb40 msgr2=0x7f232819b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:06.953 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.949+0000 7f23302e6640 1 --2- 172.21.15.115:0/2178952931 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23280ffb40 0x7f232819b6e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f231800d6f0 tx=0x7f231800dbb0 comp rx=0 tx=0).stop 2024-09-13T17:12:06.953 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.949+0000 7f23302e6640 1 -- 172.21.15.115:0/2178952931 shutdown_connections 2024-09-13T17:12:06.953 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.949+0000 7f23302e6640 1 --2- 172.21.15.115:0/2178952931 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f231406cc50 0x7f231406f110 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:06.953 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.949+0000 7f23302e6640 1 --2- 172.21.15.115:0/2178952931 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2328105bf0 0x7f232819bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:06.953 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.949+0000 7f23302e6640 1 --2- 172.21.15.115:0/2178952931 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23280ffb40 0x7f232819b6e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:06.953 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.949+0000 7f23302e6640 1 -- 172.21.15.115:0/2178952931 >> 172.21.15.115:0/2178952931 conn(0x7f23280fb840 msgr2=0x7f23280fd530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:06.953 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.949+0000 7f23302e6640 1 -- 172.21.15.115:0/2178952931 shutdown_connections 2024-09-13T17:12:06.953 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:06.949+0000 7f23302e6640 1 -- 172.21.15.115:0/2178952931 wait complete. 2024-09-13T17:12:07.031 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.029+0000 7fbe0490b640 1 -- 172.21.15.115:0/4022675944 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe00104a20 msgr2=0x7fbe00104e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:07.031 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.029+0000 7fbe0490b640 1 --2- 172.21.15.115:0/4022675944 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe00104a20 0x7fbe00104e00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fbdf0009880 tx=0x7fbdf002a4a0 comp rx=0 tx=0).stop 2024-09-13T17:12:07.031 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.030+0000 7fbe0490b640 1 -- 172.21.15.115:0/4022675944 shutdown_connections 2024-09-13T17:12:07.031 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.030+0000 7fbe0490b640 1 --2- 172.21.15.115:0/4022675944 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbe000fea20 0x7fbe000fee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:07.031 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.030+0000 7fbe0490b640 1 --2- 172.21.15.115:0/4022675944 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe00104a20 0x7fbe00104e00 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:07.031 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.030+0000 7fbe0490b640 1 -- 172.21.15.115:0/4022675944 >> 172.21.15.115:0/4022675944 conn(0x7fbe000fa720 msgr2=0x7fbe000fcb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:07.032 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.030+0000 7fbe0490b640 1 -- 172.21.15.115:0/4022675944 shutdown_connections 2024-09-13T17:12:07.032 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.030+0000 7fbe0490b640 1 -- 172.21.15.115:0/4022675944 wait complete. 2024-09-13T17:12:07.033 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.030+0000 7fbe0490b640 1 Processor -- start 2024-09-13T17:12:07.033 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.031+0000 7fbe0490b640 1 -- start start 2024-09-13T17:12:07.033 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.031+0000 7fbe0490b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe000fea20 0x7fbe0019b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:07.033 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.031+0000 7fbe0490b640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbe00104a20 0x7fbe0019bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:07.033 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.031+0000 7fbe0490b640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0019c380 con 0x7fbe000fea20 2024-09-13T17:12:07.033 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.031+0000 7fbe0490b640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe00195910 con 0x7fbe00104a20 2024-09-13T17:12:07.033 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.031+0000 7fbdfe59c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe000fea20 0x7fbe0019b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:07.034 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.031+0000 7fbdfe59c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe000fea20 0x7fbe0019b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52622/0 (socket says 172.21.15.115:52622) 2024-09-13T17:12:07.034 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.031+0000 7fbdfe59c640 1 -- 172.21.15.115:0/1471167130 learned_addr learned my addr 172.21.15.115:0/1471167130 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:12:07.034 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.031+0000 7fbdfdd9b640 1 --2- 172.21.15.115:0/1471167130 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbe00104a20 0x7fbe0019bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:07.034 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.031+0000 7fbdfe59c640 1 -- 172.21.15.115:0/1471167130 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbe00104a20 msgr2=0x7fbe0019bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:07.034 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.031+0000 7fbdfe59c640 1 --2- 172.21.15.115:0/1471167130 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbe00104a20 0x7fbe0019bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:07.034 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.031+0000 7fbdfe59c640 1 -- 172.21.15.115:0/1471167130 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf0009560 con 0x7fbe000fea20 2024-09-13T17:12:07.034 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.031+0000 7fbdfe59c640 1 --2- 172.21.15.115:0/1471167130 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe000fea20 0x7fbe0019b820 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbdf0006010 tx=0x7fbdf00056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:07.034 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.032+0000 7fbdef7fe640 1 -- 172.21.15.115:0/1471167130 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbdf0004ba0 con 0x7fbe000fea20 2024-09-13T17:12:07.034 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.032+0000 7fbe0490b640 1 -- 172.21.15.115:0/1471167130 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe00195b90 con 0x7fbe000fea20 2024-09-13T17:12:07.034 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.032+0000 7fbdef7fe640 1 -- 172.21.15.115:0/1471167130 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbdf0005d50 con 0x7fbe000fea20 2024-09-13T17:12:07.034 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.032+0000 7fbe0490b640 1 -- 172.21.15.115:0/1471167130 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe00196080 con 0x7fbe000fea20 2024-09-13T17:12:07.034 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.032+0000 7fbdef7fe640 1 -- 172.21.15.115:0/1471167130 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbdf00318b0 con 0x7fbe000fea20 2024-09-13T17:12:07.035 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.033+0000 7fbe0490b640 1 -- 172.21.15.115:0/1471167130 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe00100160 con 0x7fbe000fea20 2024-09-13T17:12:07.035 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.033+0000 7fbdef7fe640 1 -- 172.21.15.115:0/1471167130 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fbdf0003b90 con 0x7fbe000fea20 2024-09-13T17:12:07.035 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.034+0000 7fbdef7fe640 1 --2- 172.21.15.115:0/1471167130 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fbde806cc50 0x7fbde806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:07.035 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.034+0000 7fbdef7fe640 1 -- 172.21.15.115:0/1471167130 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fbdf00ad5e0 con 0x7fbe000fea20 2024-09-13T17:12:07.035 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.034+0000 7fbdfdd9b640 1 --2- 172.21.15.115:0/1471167130 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fbde806cc50 0x7fbde806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:07.036 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.034+0000 7fbdfdd9b640 1 --2- 172.21.15.115:0/1471167130 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fbde806cc50 0x7fbde806f110 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fbe00196d80 tx=0x7fbdf4009110 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:07.039 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.038+0000 7fbdef7fe640 1 -- 172.21.15.115:0/1471167130 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fbdf0077700 con 0x7fbe000fea20 2024-09-13T17:12:07.215 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.214+0000 7fbe0490b640 1 -- 172.21.15.115:0/1471167130 --> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbe0010bbd0 con 0x7fbde806cc50 2024-09-13T17:12:07.216 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.215+0000 7fbdef7fe640 1 -- 172.21.15.115:0/1471167130 <== mgr.14660 v2:172.21.15.115:6800/1049502673 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fbe0010bbd0 con 0x7fbde806cc50 2024-09-13T17:12:07.216 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-13T17:12:07.216 INFO:teuthology.orchestra.run.smithi115.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256", 2024-09-13T17:12:07.216 INFO:teuthology.orchestra.run.smithi115.stdout: "in_progress": true, 2024-09-13T17:12:07.217 INFO:teuthology.orchestra.run.smithi115.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T17:12:07.217 INFO:teuthology.orchestra.run.smithi115.stdout: "services_complete": [ 2024-09-13T17:12:07.217 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr", 2024-09-13T17:12:07.217 INFO:teuthology.orchestra.run.smithi115.stdout: "mon", 2024-09-13T17:12:07.217 INFO:teuthology.orchestra.run.smithi115.stdout: "crash" 2024-09-13T17:12:07.217 INFO:teuthology.orchestra.run.smithi115.stdout: ], 2024-09-13T17:12:07.217 INFO:teuthology.orchestra.run.smithi115.stdout: "progress": "10/23 daemons upgraded", 2024-09-13T17:12:07.217 INFO:teuthology.orchestra.run.smithi115.stdout: "message": "Currently upgrading osd daemons", 2024-09-13T17:12:07.217 INFO:teuthology.orchestra.run.smithi115.stdout: "is_paused": false 2024-09-13T17:12:07.217 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-13T17:12:07.218 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.217+0000 7fbe0490b640 1 -- 172.21.15.115:0/1471167130 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fbde806cc50 msgr2=0x7fbde806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:07.218 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.217+0000 7fbe0490b640 1 --2- 172.21.15.115:0/1471167130 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fbde806cc50 0x7fbde806f110 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fbe00196d80 tx=0x7fbdf4009110 comp rx=0 tx=0).stop 2024-09-13T17:12:07.218 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.217+0000 7fbe0490b640 1 -- 172.21.15.115:0/1471167130 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe000fea20 msgr2=0x7fbe0019b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:07.219 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.217+0000 7fbe0490b640 1 --2- 172.21.15.115:0/1471167130 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe000fea20 0x7fbe0019b820 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbdf0006010 tx=0x7fbdf00056e0 comp rx=0 tx=0).stop 2024-09-13T17:12:07.219 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.217+0000 7fbe0490b640 1 -- 172.21.15.115:0/1471167130 shutdown_connections 2024-09-13T17:12:07.219 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.217+0000 7fbe0490b640 1 --2- 172.21.15.115:0/1471167130 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fbde806cc50 0x7fbde806f110 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:07.219 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.217+0000 7fbe0490b640 1 --2- 172.21.15.115:0/1471167130 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbe00104a20 0x7fbe0019bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:07.219 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.217+0000 7fbe0490b640 1 --2- 172.21.15.115:0/1471167130 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe000fea20 0x7fbe0019b820 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:07.219 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.217+0000 7fbe0490b640 1 -- 172.21.15.115:0/1471167130 >> 172.21.15.115:0/1471167130 conn(0x7fbe000fa720 msgr2=0x7fbe00068c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:07.219 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.217+0000 7fbe0490b640 1 -- 172.21.15.115:0/1471167130 shutdown_connections 2024-09-13T17:12:07.219 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.217+0000 7fbe0490b640 1 -- 172.21.15.115:0/1471167130 wait complete. 2024-09-13T17:12:07.315 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.314+0000 7fc195eac640 1 -- 172.21.15.115:0/1728348433 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1901049a0 msgr2=0x7fc190104d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:07.316 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.314+0000 7fc195eac640 1 --2- 172.21.15.115:0/1728348433 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1901049a0 0x7fc190104d80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc180009880 tx=0x7fc18002a4a0 comp rx=0 tx=0).stop 2024-09-13T17:12:07.316 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.314+0000 7fc195eac640 1 -- 172.21.15.115:0/1728348433 shutdown_connections 2024-09-13T17:12:07.316 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.314+0000 7fc195eac640 1 --2- 172.21.15.115:0/1728348433 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1900fe9a0 0x7fc1900fee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:07.316 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.314+0000 7fc195eac640 1 --2- 172.21.15.115:0/1728348433 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1901049a0 0x7fc190104d80 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:07.316 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.314+0000 7fc195eac640 1 -- 172.21.15.115:0/1728348433 >> 172.21.15.115:0/1728348433 conn(0x7fc1900758c0 msgr2=0x7fc1900fcc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:07.316 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.314+0000 7fc195eac640 1 -- 172.21.15.115:0/1728348433 shutdown_connections 2024-09-13T17:12:07.316 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.314+0000 7fc195eac640 1 -- 172.21.15.115:0/1728348433 wait complete. 2024-09-13T17:12:07.316 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:07 smithi115 ceph-mon[109488]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-13T17:12:07.317 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:07 smithi115 ceph-mon[109488]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-09-13T17:12:07.317 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:07 smithi115 ceph-mon[109488]: from='client.34230 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:12:07.317 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:07 smithi115 ceph-mon[109488]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T17:12:07.317 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:07 smithi115 ceph-mon[109488]: osd.3 [v2:172.21.15.195:6800/2321302370,v1:172.21.15.195:6801/2321302370] boot 2024-09-13T17:12:07.317 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:07 smithi115 ceph-mon[109488]: osdmap e67: 6 total, 6 up, 6 in 2024-09-13T17:12:07.317 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:07 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T17:12:07.317 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:07 smithi115 ceph-mon[109488]: from='client.34234 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:12:07.317 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:07 smithi115 ceph-mon[109488]: from='client.? 172.21.15.115:0/2304413838' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:12:07.317 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:07 smithi115 ceph-mon[109488]: from='client.? 172.21.15.115:0/2178952931' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T17:12:07.317 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:07 smithi115 ceph-mon[109488]: osdmap e68: 6 total, 6 up, 6 in 2024-09-13T17:12:07.319 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.315+0000 7fc195eac640 1 Processor -- start 2024-09-13T17:12:07.319 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.315+0000 7fc195eac640 1 -- start start 2024-09-13T17:12:07.319 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.315+0000 7fc195eac640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1900fe9a0 0x7fc1901058d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:07.319 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.315+0000 7fc195eac640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1901049a0 0x7fc190105e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:07.319 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.315+0000 7fc195eac640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc190106350 con 0x7fc1900fe9a0 2024-09-13T17:12:07.319 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.315+0000 7fc195eac640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc190106490 con 0x7fc1901049a0 2024-09-13T17:12:07.319 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.315+0000 7fc18f7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1900fe9a0 0x7fc1901058d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:07.319 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.315+0000 7fc18f7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1900fe9a0 0x7fc1901058d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52648/0 (socket says 172.21.15.115:52648) 2024-09-13T17:12:07.319 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.315+0000 7fc18f7fe640 1 -- 172.21.15.115:0/2168366313 learned_addr learned my addr 172.21.15.115:0/2168366313 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:12:07.319 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.315+0000 7fc187fff640 1 --2- 172.21.15.115:0/2168366313 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1901049a0 0x7fc190105e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:07.319 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.315+0000 7fc18f7fe640 1 -- 172.21.15.115:0/2168366313 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1901049a0 msgr2=0x7fc190105e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:07.320 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.315+0000 7fc18f7fe640 1 --2- 172.21.15.115:0/2168366313 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1901049a0 0x7fc190105e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:07.320 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.315+0000 7fc18f7fe640 1 -- 172.21.15.115:0/2168366313 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc180009560 con 0x7fc1900fe9a0 2024-09-13T17:12:07.320 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.316+0000 7fc18f7fe640 1 --2- 172.21.15.115:0/2168366313 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1900fe9a0 0x7fc1901058d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc18002a9c0 tx=0x7fc1800055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:07.320 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.316+0000 7fc18d7fa640 1 -- 172.21.15.115:0/2168366313 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc180004b60 con 0x7fc1900fe9a0 2024-09-13T17:12:07.320 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.316+0000 7fc18d7fa640 1 -- 172.21.15.115:0/2168366313 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc180004cc0 con 0x7fc1900fe9a0 2024-09-13T17:12:07.320 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.316+0000 7fc195eac640 1 -- 172.21.15.115:0/2168366313 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc190106710 con 0x7fc1900fe9a0 2024-09-13T17:12:07.320 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.316+0000 7fc18d7fa640 1 -- 172.21.15.115:0/2168366313 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc180031950 con 0x7fc1900fe9a0 2024-09-13T17:12:07.320 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.316+0000 7fc195eac640 1 -- 172.21.15.115:0/2168366313 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1901a1ee0 con 0x7fc1900fe9a0 2024-09-13T17:12:07.320 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.317+0000 7fc195eac640 1 -- 172.21.15.115:0/2168366313 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1901000e0 con 0x7fc1900fe9a0 2024-09-13T17:12:07.320 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.317+0000 7fc18d7fa640 1 -- 172.21.15.115:0/2168366313 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fc180003c20 con 0x7fc1900fe9a0 2024-09-13T17:12:07.321 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.318+0000 7fc18d7fa640 1 --2- 172.21.15.115:0/2168366313 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fc17c06cc50 0x7fc17c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:07.321 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.318+0000 7fc18d7fa640 1 -- 172.21.15.115:0/2168366313 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fc1800ad530 con 0x7fc1900fe9a0 2024-09-13T17:12:07.321 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.318+0000 7fc187fff640 1 --2- 172.21.15.115:0/2168366313 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fc17c06cc50 0x7fc17c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:07.321 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.318+0000 7fc187fff640 1 --2- 172.21.15.115:0/2168366313 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fc17c06cc50 0x7fc17c06f110 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc1901073d0 tx=0x7fc17800b390 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:07.323 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.322+0000 7fc18d7fa640 1 -- 172.21.15.115:0/2168366313 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc180077700 con 0x7fc1900fe9a0 2024-09-13T17:12:07.500 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:07 smithi195 ceph-mon[80021]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-13T17:12:07.500 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:07 smithi195 ceph-mon[80021]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-09-13T17:12:07.500 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:07 smithi195 ceph-mon[80021]: from='client.34230 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:12:07.500 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:07 smithi195 ceph-mon[80021]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T17:12:07.500 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:07 smithi195 ceph-mon[80021]: osd.3 [v2:172.21.15.195:6800/2321302370,v1:172.21.15.195:6801/2321302370] boot 2024-09-13T17:12:07.500 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:07 smithi195 ceph-mon[80021]: osdmap e67: 6 total, 6 up, 6 in 2024-09-13T17:12:07.500 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:07 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T17:12:07.500 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:07 smithi195 ceph-mon[80021]: from='client.34234 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:12:07.500 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:07 smithi195 ceph-mon[80021]: from='client.? 172.21.15.115:0/2304413838' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:12:07.500 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:07 smithi195 ceph-mon[80021]: from='client.? 172.21.15.115:0/2178952931' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T17:12:07.500 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:07 smithi195 ceph-mon[80021]: osdmap e68: 6 total, 6 up, 6 in 2024-09-13T17:12:07.544 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.543+0000 7fc195eac640 1 -- 172.21.15.115:0/2168366313 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fc1900fee00 con 0x7fc1900fe9a0 2024-09-13T17:12:07.544 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.543+0000 7fc18d7fa640 1 -- 172.21.15.115:0/2168366313 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1317 (secure 0 0 0) 0x7fc18007ad20 con 0x7fc1900fe9a0 2024-09-13T17:12:07.544 INFO:teuthology.orchestra.run.smithi115.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; Degraded data redundancy: 48/222 objects degraded (21.622%), 17 pgs degraded 2024-09-13T17:12:07.544 INFO:teuthology.orchestra.run.smithi115.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T17:12:07.545 INFO:teuthology.orchestra.run.smithi115.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T17:12:07.545 INFO:teuthology.orchestra.run.smithi115.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 48/222 objects degraded (21.622%), 17 pgs degraded 2024-09-13T17:12:07.545 INFO:teuthology.orchestra.run.smithi115.stdout: pg 1.0 is active+undersized+degraded, acting [0,1] 2024-09-13T17:12:07.545 INFO:teuthology.orchestra.run.smithi115.stdout: pg 2.0 is active+undersized+degraded, acting [1,0] 2024-09-13T17:12:07.545 INFO:teuthology.orchestra.run.smithi115.stdout: pg 2.5 is active+undersized+degraded, acting [0,4] 2024-09-13T17:12:07.545 INFO:teuthology.orchestra.run.smithi115.stdout: pg 2.6 is active+undersized+degraded, acting [1,4] 2024-09-13T17:12:07.545 INFO:teuthology.orchestra.run.smithi115.stdout: pg 2.7 is active+undersized+degraded, acting [4,2] 2024-09-13T17:12:07.545 INFO:teuthology.orchestra.run.smithi115.stdout: pg 2.a is active+undersized+degraded, acting [1,4] 2024-09-13T17:12:07.545 INFO:teuthology.orchestra.run.smithi115.stdout: pg 2.b is active+undersized+degraded, acting [4,5] 2024-09-13T17:12:07.545 INFO:teuthology.orchestra.run.smithi115.stdout: pg 2.c is active+undersized+degraded, acting [2,0] 2024-09-13T17:12:07.545 INFO:teuthology.orchestra.run.smithi115.stdout: pg 2.d is active+undersized+degraded, acting [1,2] 2024-09-13T17:12:07.545 INFO:teuthology.orchestra.run.smithi115.stdout: pg 2.e is active+undersized+degraded, acting [2,0] 2024-09-13T17:12:07.545 INFO:teuthology.orchestra.run.smithi115.stdout: pg 2.14 is active+undersized+degraded, acting [4,5] 2024-09-13T17:12:07.546 INFO:teuthology.orchestra.run.smithi115.stdout: pg 2.15 is active+undersized+degraded, acting [1,0] 2024-09-13T17:12:07.546 INFO:teuthology.orchestra.run.smithi115.stdout: pg 2.16 is active+undersized+degraded, acting [5,2] 2024-09-13T17:12:07.546 INFO:teuthology.orchestra.run.smithi115.stdout: pg 2.18 is active+undersized+degraded, acting [5,4] 2024-09-13T17:12:07.546 INFO:teuthology.orchestra.run.smithi115.stdout: pg 2.1a is active+undersized+degraded, acting [4,5] 2024-09-13T17:12:07.546 INFO:teuthology.orchestra.run.smithi115.stdout: pg 2.1d is active+undersized+degraded, acting [5,0] 2024-09-13T17:12:07.546 INFO:teuthology.orchestra.run.smithi115.stdout: pg 2.1f is active+undersized+degraded, acting [0,4] 2024-09-13T17:12:07.547 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.545+0000 7fc195eac640 1 -- 172.21.15.115:0/2168366313 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fc17c06cc50 msgr2=0x7fc17c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:07.547 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.545+0000 7fc195eac640 1 --2- 172.21.15.115:0/2168366313 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fc17c06cc50 0x7fc17c06f110 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc1901073d0 tx=0x7fc17800b390 comp rx=0 tx=0).stop 2024-09-13T17:12:07.547 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.545+0000 7fc195eac640 1 -- 172.21.15.115:0/2168366313 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1900fe9a0 msgr2=0x7fc1901058d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:07.547 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.545+0000 7fc195eac640 1 --2- 172.21.15.115:0/2168366313 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1900fe9a0 0x7fc1901058d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc18002a9c0 tx=0x7fc1800055a0 comp rx=0 tx=0).stop 2024-09-13T17:12:07.547 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.545+0000 7fc195eac640 1 -- 172.21.15.115:0/2168366313 shutdown_connections 2024-09-13T17:12:07.547 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.545+0000 7fc195eac640 1 --2- 172.21.15.115:0/2168366313 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fc17c06cc50 0x7fc17c06f110 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:07.547 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.545+0000 7fc195eac640 1 --2- 172.21.15.115:0/2168366313 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1901049a0 0x7fc190105e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:07.547 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.545+0000 7fc195eac640 1 --2- 172.21.15.115:0/2168366313 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1900fe9a0 0x7fc1901058d0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:07.547 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.545+0000 7fc195eac640 1 -- 172.21.15.115:0/2168366313 >> 172.21.15.115:0/2168366313 conn(0x7fc1900758c0 msgr2=0x7fc190067fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:07.547 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.545+0000 7fc195eac640 1 -- 172.21.15.115:0/2168366313 shutdown_connections 2024-09-13T17:12:07.547 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:07.545+0000 7fc195eac640 1 -- 172.21.15.115:0/2168366313 wait complete. 2024-09-13T17:12:08.576 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:08 smithi195 ceph-mon[80021]: from='client.34246 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:12:08.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:08 smithi195 ceph-mon[80021]: pgmap v189: 65 pgs: 11 peering, 14 active+undersized, 13 active+undersized+degraded, 27 active+clean; 199 MiB data, 984 MiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 38/222 objects degraded (17.117%) 2024-09-13T17:12:08.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:08 smithi195 ceph-mon[80021]: from='client.? 172.21.15.115:0/2168366313' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T17:12:08.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:08 smithi115 ceph-mon[109488]: from='client.34246 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:12:08.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:08 smithi115 ceph-mon[109488]: pgmap v189: 65 pgs: 11 peering, 14 active+undersized, 13 active+undersized+degraded, 27 active+clean; 199 MiB data, 984 MiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 38/222 objects degraded (17.117%) 2024-09-13T17:12:08.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:08 smithi115 ceph-mon[109488]: from='client.? 172.21.15.115:0/2168366313' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T17:12:09.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:09 smithi195 ceph-mon[80021]: Health check update: Degraded data redundancy: 38/222 objects degraded (17.117%), 13 pgs degraded (PG_DEGRADED) 2024-09-13T17:12:09.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:09 smithi115 ceph-mon[109488]: Health check update: Degraded data redundancy: 38/222 objects degraded (17.117%), 13 pgs degraded (PG_DEGRADED) 2024-09-13T17:12:10.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:10 smithi195 ceph-mon[80021]: pgmap v190: 65 pgs: 11 peering, 8 active+undersized, 8 active+undersized+degraded, 38 active+clean; 199 MiB data, 984 MiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 23/222 objects degraded (10.360%) 2024-09-13T17:12:10.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:10 smithi115 ceph-mon[109488]: pgmap v190: 65 pgs: 11 peering, 8 active+undersized, 8 active+undersized+degraded, 38 active+clean; 199 MiB data, 984 MiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 23/222 objects degraded (10.360%) 2024-09-13T17:12:11.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:11 smithi195 ceph-mon[80021]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 23/222 objects degraded (10.360%), 8 pgs degraded) 2024-09-13T17:12:11.928 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:11 smithi115 ceph-mon[109488]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 23/222 objects degraded (10.360%), 8 pgs degraded) 2024-09-13T17:12:12.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:12 smithi195 ceph-mon[80021]: pgmap v191: 65 pgs: 9 peering, 56 active+clean; 199 MiB data, 984 MiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-13T17:12:12.830 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:12 smithi115 ceph-mon[109488]: pgmap v191: 65 pgs: 9 peering, 56 active+clean; 199 MiB data, 984 MiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-13T17:12:14.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:14 smithi195 ceph-mon[80021]: pgmap v192: 65 pgs: 65 active+clean; 199 MiB data, 984 MiB used, 535 GiB / 536 GiB avail; 895 B/s rd, 1 op/s 2024-09-13T17:12:14.928 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:14 smithi115 ceph-mon[109488]: pgmap v192: 65 pgs: 65 active+clean; 199 MiB data, 984 MiB used, 535 GiB / 536 GiB avail; 895 B/s rd, 1 op/s 2024-09-13T17:12:16.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:16 smithi195 ceph-mon[80021]: pgmap v193: 65 pgs: 65 active+clean; 199 MiB data, 984 MiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-13T17:12:16.928 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:16 smithi115 ceph-mon[109488]: pgmap v193: 65 pgs: 65 active+clean; 199 MiB data, 984 MiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-13T17:12:18.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:18 smithi195 ceph-mon[80021]: pgmap v194: 65 pgs: 65 active+clean; 199 MiB data, 984 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:12:18.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:18 smithi115 ceph-mon[109488]: pgmap v194: 65 pgs: 65 active+clean; 199 MiB data, 984 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:12:20.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:20 smithi195 ceph-mon[80021]: pgmap v195: 65 pgs: 65 active+clean; 199 MiB data, 984 MiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-13T17:12:20.928 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:20 smithi115 ceph-mon[109488]: pgmap v195: 65 pgs: 65 active+clean; 199 MiB data, 984 MiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-13T17:12:21.680 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:21 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:12:21.680 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:21 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:12:21.680 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:21 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:12:21.681 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:21 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-13T17:12:21.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:21 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:12:21.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:21 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:12:21.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:21 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:12:21.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:21 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-13T17:12:22.782 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:22 smithi195 ceph-mon[80021]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-13T17:12:22.782 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:22 smithi195 ceph-mon[80021]: Upgrade: osd.4 is safe to restart 2024-09-13T17:12:22.782 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:22 smithi195 ceph-mon[80021]: pgmap v196: 65 pgs: 65 active+clean; 199 MiB data, 984 MiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-13T17:12:22.782 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:22 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:12:22.782 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:22 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-13T17:12:22.782 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:22 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:12:22.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:22 smithi115 ceph-mon[109488]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-13T17:12:22.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:22 smithi115 ceph-mon[109488]: Upgrade: osd.4 is safe to restart 2024-09-13T17:12:22.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:22 smithi115 ceph-mon[109488]: pgmap v196: 65 pgs: 65 active+clean; 199 MiB data, 984 MiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-13T17:12:22.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:22 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:12:22.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:22 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-13T17:12:22.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:22 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:12:23.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:23 smithi115 ceph-mon[109488]: Upgrade: Updating osd.4 2024-09-13T17:12:23.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:23 smithi115 ceph-mon[109488]: Deploying daemon osd.4 on smithi195 2024-09-13T17:12:23.975 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:23 smithi195 ceph-mon[80021]: Upgrade: Updating osd.4 2024-09-13T17:12:23.975 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:23 smithi195 ceph-mon[80021]: Deploying daemon osd.4 on smithi195 2024-09-13T17:12:24.951 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:24 smithi195 ceph-mon[80021]: pgmap v197: 65 pgs: 65 active+clean; 199 MiB data, 984 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T17:12:24.992 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:24 smithi115 ceph-mon[109488]: pgmap v197: 65 pgs: 65 active+clean; 199 MiB data, 984 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T17:12:25.577 INFO:journalctl@ceph.osd.4.smithi195.stdout:Sep 13 17:12:25 smithi195 systemd[1]: Stopping Ceph osd.4 for ffbd7588-71f0-11ef-bceb-c7b262605968... 2024-09-13T17:12:26.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:25 smithi195 ceph-mon[80021]: osd.4 marked itself down and dead 2024-09-13T17:12:26.077 INFO:journalctl@ceph.osd.4.smithi195.stdout:Sep 13 17:12:25 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-4[47256]: 2024-09-13T17:12:25.595+0000 7f07c1441640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T17:12:26.077 INFO:journalctl@ceph.osd.4.smithi195.stdout:Sep 13 17:12:25 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-4[47256]: 2024-09-13T17:12:25.595+0000 7f07c1441640 -1 osd.4 68 *** Got signal Terminated *** 2024-09-13T17:12:26.078 INFO:journalctl@ceph.osd.4.smithi195.stdout:Sep 13 17:12:25 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-4[47256]: 2024-09-13T17:12:25.595+0000 7f07c1441640 -1 osd.4 68 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T17:12:26.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:25 smithi115 ceph-mon[109488]: osd.4 marked itself down and dead 2024-09-13T17:12:26.340 INFO:journalctl@ceph.osd.4.smithi195.stdout:Sep 13 17:12:26 smithi195 podman[93233]: 2024-09-13 17:12:26.085479808 +0000 UTC m=+0.591662530 container died 4bbc3acb9aff4428c6364dfda52a966e40e65f288bba7cd0fcae4d73125af28b (image=quay.ceph.io/ceph-ci/ceph@sha256:c37c250ffe653639d7a4124ac8acdc3c8f6a53cb4ef1f26b1d2df36648631a11, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-4, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=reef-2c01458, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS) 2024-09-13T17:12:27.008 INFO:journalctl@ceph.osd.4.smithi195.stdout:Sep 13 17:12:26 smithi195 podman[93233]: 2024-09-13 17:12:26.739120299 +0000 UTC m=+1.245303021 container cleanup 4bbc3acb9aff4428c6364dfda52a966e40e65f288bba7cd0fcae4d73125af28b (image=quay.ceph.io/ceph-ci/ceph@sha256:c37c250ffe653639d7a4124ac8acdc3c8f6a53cb4ef1f26b1d2df36648631a11, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=reef-2c01458, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2) 2024-09-13T17:12:27.008 INFO:journalctl@ceph.osd.4.smithi195.stdout:Sep 13 17:12:26 smithi195 bash[93233]: ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-4 2024-09-13T17:12:27.008 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:26 smithi195 ceph-mon[80021]: pgmap v198: 65 pgs: 65 active+clean; 199 MiB data, 984 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:12:27.008 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:26 smithi195 ceph-mon[80021]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T17:12:27.008 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:26 smithi195 ceph-mon[80021]: osdmap e69: 6 total, 5 up, 6 in 2024-09-13T17:12:27.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:26 smithi115 ceph-mon[109488]: pgmap v198: 65 pgs: 65 active+clean; 199 MiB data, 984 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:12:27.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:26 smithi115 ceph-mon[109488]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T17:12:27.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:26 smithi115 ceph-mon[109488]: osdmap e69: 6 total, 5 up, 6 in 2024-09-13T17:12:27.327 INFO:journalctl@ceph.osd.4.smithi195.stdout:Sep 13 17:12:27 smithi195 podman[93257]: 2024-09-13 17:12:27.007191399 +0000 UTC m=+0.921484406 container remove 4bbc3acb9aff4428c6364dfda52a966e40e65f288bba7cd0fcae4d73125af28b (image=quay.ceph.io/ceph-ci/ceph@sha256:c37c250ffe653639d7a4124ac8acdc3c8f6a53cb4ef1f26b1d2df36648631a11, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-4, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=reef-2c01458, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T17:12:27.698 INFO:journalctl@ceph.osd.4.smithi195.stdout:Sep 13 17:12:27 smithi195 podman[93348]: 2024-09-13 17:12:27.349624412 +0000 UTC m=+0.110251690 container create 0e483922fd9797ec7a2639a94758340cf8a2e6bfde594153af66dbc388210779 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-13T17:12:27.698 INFO:journalctl@ceph.osd.4.smithi195.stdout:Sep 13 17:12:27 smithi195 podman[93348]: 2024-09-13 17:12:27.255069737 +0000 UTC m=+0.015697020 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T17:12:27.698 INFO:journalctl@ceph.osd.4.smithi195.stdout:Sep 13 17:12:27 smithi195 podman[93348]: 2024-09-13 17:12:27.535992711 +0000 UTC m=+0.296620000 container init 0e483922fd9797ec7a2639a94758340cf8a2e6bfde594153af66dbc388210779 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_CLEAN=True) 2024-09-13T17:12:27.698 INFO:journalctl@ceph.osd.4.smithi195.stdout:Sep 13 17:12:27 smithi195 podman[93348]: 2024-09-13 17:12:27.539754527 +0000 UTC m=+0.300381803 container start 0e483922fd9797ec7a2639a94758340cf8a2e6bfde594153af66dbc388210779 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-13T17:12:27.698 INFO:journalctl@ceph.osd.4.smithi195.stdout:Sep 13 17:12:27 smithi195 podman[93348]: 2024-09-13 17:12:27.593855096 +0000 UTC m=+0.354482371 container attach 0e483922fd9797ec7a2639a94758340cf8a2e6bfde594153af66dbc388210779 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-4-deactivate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-13T17:12:28.065 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:27 smithi195 ceph-mon[80021]: osdmap e70: 6 total, 5 up, 6 in 2024-09-13T17:12:28.065 INFO:journalctl@ceph.osd.4.smithi195.stdout:Sep 13 17:12:27 smithi195 podman[93348]: 2024-09-13 17:12:27.728208239 +0000 UTC m=+0.488835515 container died 0e483922fd9797ec7a2639a94758340cf8a2e6bfde594153af66dbc388210779 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T17:12:28.178 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:27 smithi115 ceph-mon[109488]: osdmap e70: 6 total, 5 up, 6 in 2024-09-13T17:12:28.327 INFO:journalctl@ceph.osd.4.smithi195.stdout:Sep 13 17:12:28 smithi195 podman[93371]: 2024-09-13 17:12:28.305806043 +0000 UTC m=+0.571362364 container remove 0e483922fd9797ec7a2639a94758340cf8a2e6bfde594153af66dbc388210779 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, ceph=True, CEPH_POINT_RELEASE=) 2024-09-13T17:12:28.699 INFO:journalctl@ceph.osd.4.smithi195.stdout:Sep 13 17:12:28 smithi195 systemd[1]: ceph-ffbd7588-71f0-11ef-bceb-c7b262605968@osd.4.service: Deactivated successfully. 2024-09-13T17:12:28.700 INFO:journalctl@ceph.osd.4.smithi195.stdout:Sep 13 17:12:28 smithi195 systemd[1]: Stopped Ceph osd.4 for ffbd7588-71f0-11ef-bceb-c7b262605968. 2024-09-13T17:12:28.700 INFO:journalctl@ceph.osd.4.smithi195.stdout:Sep 13 17:12:28 smithi195 systemd[1]: ceph-ffbd7588-71f0-11ef-bceb-c7b262605968@osd.4.service: Consumed 1min 3.145s CPU time. 2024-09-13T17:12:28.700 INFO:journalctl@ceph.osd.4.smithi195.stdout:Sep 13 17:12:28 smithi195 systemd[1]: Starting Ceph osd.4 for ffbd7588-71f0-11ef-bceb-c7b262605968... 2024-09-13T17:12:28.976 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:28 smithi195 ceph-mon[80021]: pgmap v201: 65 pgs: 7 peering, 4 stale+active+clean, 54 active+clean; 199 MiB data, 984 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:12:28.977 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:28 smithi195 ceph-mon[80021]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-09-13T17:12:28.977 INFO:journalctl@ceph.osd.4.smithi195.stdout:Sep 13 17:12:28 smithi195 podman[93472]: 2024-09-13 17:12:28.650912162 +0000 UTC m=+0.016121292 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T17:12:28.977 INFO:journalctl@ceph.osd.4.smithi195.stdout:Sep 13 17:12:28 smithi195 podman[93472]: 2024-09-13 17:12:28.765174504 +0000 UTC m=+0.130383627 container create 0c49cadb48e314927354c52768ed82ef4fddd1a86153391c4eecdc9eab9d1c57 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-4-activate, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-13T17:12:28.977 INFO:journalctl@ceph.osd.4.smithi195.stdout:Sep 13 17:12:28 smithi195 podman[93472]: 2024-09-13 17:12:28.976019425 +0000 UTC m=+0.341228546 container init 0c49cadb48e314927354c52768ed82ef4fddd1a86153391c4eecdc9eab9d1c57 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-4-activate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083) 2024-09-13T17:12:29.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:28 smithi115 ceph-mon[109488]: pgmap v201: 65 pgs: 7 peering, 4 stale+active+clean, 54 active+clean; 199 MiB data, 984 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:12:29.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:28 smithi115 ceph-mon[109488]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-09-13T17:12:29.277 INFO:journalctl@ceph.osd.4.smithi195.stdout:Sep 13 17:12:28 smithi195 podman[93472]: 2024-09-13 17:12:28.979317034 +0000 UTC m=+0.344526160 container start 0c49cadb48e314927354c52768ed82ef4fddd1a86153391c4eecdc9eab9d1c57 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-4-activate, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T17:12:29.277 INFO:journalctl@ceph.osd.4.smithi195.stdout:Sep 13 17:12:29 smithi195 podman[93472]: 2024-09-13 17:12:29.059453524 +0000 UTC m=+0.424662659 container attach 0c49cadb48e314927354c52768ed82ef4fddd1a86153391c4eecdc9eab9d1c57 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-4-activate, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-13T17:12:29.577 INFO:journalctl@ceph.osd.4.smithi195.stdout:Sep 13 17:12:29 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-4-activate[93487]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-13T17:12:29.577 INFO:journalctl@ceph.osd.4.smithi195.stdout:Sep 13 17:12:29 smithi195 bash[93472]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-13T17:12:29.577 INFO:journalctl@ceph.osd.4.smithi195.stdout:Sep 13 17:12:29 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-4-activate[93487]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-13T17:12:29.577 INFO:journalctl@ceph.osd.4.smithi195.stdout:Sep 13 17:12:29 smithi195 bash[93472]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-13T17:12:29.577 INFO:journalctl@ceph.osd.4.smithi195.stdout:Sep 13 17:12:29 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-4-activate[93487]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-13T17:12:29.577 INFO:journalctl@ceph.osd.4.smithi195.stdout:Sep 13 17:12:29 smithi195 bash[93472]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-13T17:12:29.577 INFO:journalctl@ceph.osd.4.smithi195.stdout:Sep 13 17:12:29 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-4-activate[93487]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-13T17:12:29.577 INFO:journalctl@ceph.osd.4.smithi195.stdout:Sep 13 17:12:29 smithi195 bash[93472]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-13T17:12:29.577 INFO:journalctl@ceph.osd.4.smithi195.stdout:Sep 13 17:12:29 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-4-activate[93487]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-09-13T17:12:29.578 INFO:journalctl@ceph.osd.4.smithi195.stdout:Sep 13 17:12:29 smithi195 bash[93472]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-09-13T17:12:29.578 INFO:journalctl@ceph.osd.4.smithi195.stdout:Sep 13 17:12:29 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-4-activate[93487]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-13T17:12:29.578 INFO:journalctl@ceph.osd.4.smithi195.stdout:Sep 13 17:12:29 smithi195 bash[93472]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-13T17:12:29.578 INFO:journalctl@ceph.osd.4.smithi195.stdout:Sep 13 17:12:29 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-4-activate[93487]: --> ceph-volume raw activate successful for osd ID: 4 2024-09-13T17:12:29.578 INFO:journalctl@ceph.osd.4.smithi195.stdout:Sep 13 17:12:29 smithi195 bash[93472]: --> ceph-volume raw activate successful for osd ID: 4 2024-09-13T17:12:29.578 INFO:journalctl@ceph.osd.4.smithi195.stdout:Sep 13 17:12:29 smithi195 podman[93472]: 2024-09-13 17:12:29.3240848 +0000 UTC m=+0.689293921 container died 0c49cadb48e314927354c52768ed82ef4fddd1a86153391c4eecdc9eab9d1c57 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-4-activate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-13T17:12:30.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:29 smithi195 ceph-mon[80021]: Health check failed: Degraded data redundancy: 14/222 objects degraded (6.306%), 7 pgs degraded (PG_DEGRADED) 2024-09-13T17:12:30.077 INFO:journalctl@ceph.osd.4.smithi195.stdout:Sep 13 17:12:29 smithi195 podman[93619]: 2024-09-13 17:12:29.887914068 +0000 UTC m=+0.557836128 container remove 0c49cadb48e314927354c52768ed82ef4fddd1a86153391c4eecdc9eab9d1c57 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-4-activate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T17:12:30.178 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:29 smithi115 ceph-mon[109488]: Health check failed: Degraded data redundancy: 14/222 objects degraded (6.306%), 7 pgs degraded (PG_DEGRADED) 2024-09-13T17:12:30.353 INFO:journalctl@ceph.osd.4.smithi195.stdout:Sep 13 17:12:30 smithi195 podman[93678]: 2024-09-13 17:12:29.994458626 +0000 UTC m=+0.015898945 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T17:12:30.353 INFO:journalctl@ceph.osd.4.smithi195.stdout:Sep 13 17:12:30 smithi195 podman[93678]: 2024-09-13 17:12:30.122155694 +0000 UTC m=+0.143596009 container create c88b3dacb207cb42472bf4cb75fab1d13a4d8ed37276d3ec678a1e2e0f1ca459 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-4, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T17:12:30.353 INFO:journalctl@ceph.osd.4.smithi195.stdout:Sep 13 17:12:30 smithi195 podman[93678]: 2024-09-13 17:12:30.31593058 +0000 UTC m=+0.337370895 container init c88b3dacb207cb42472bf4cb75fab1d13a4d8ed37276d3ec678a1e2e0f1ca459 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-4, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-13T17:12:30.353 INFO:journalctl@ceph.osd.4.smithi195.stdout:Sep 13 17:12:30 smithi195 podman[93678]: 2024-09-13 17:12:30.319109933 +0000 UTC m=+0.340550250 container start c88b3dacb207cb42472bf4cb75fab1d13a4d8ed37276d3ec678a1e2e0f1ca459 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-4, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-13T17:12:30.353 INFO:journalctl@ceph.osd.4.smithi195.stdout:Sep 13 17:12:30 smithi195 ceph-osd[93697]: -- 172.21.15.195:0/3994261175 <== mon.1 v2:172.21.15.195:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56266d5671e0 con 0x56266d505c00 2024-09-13T17:12:30.754 INFO:journalctl@ceph.osd.4.smithi195.stdout:Sep 13 17:12:30 smithi195 bash[93678]: c88b3dacb207cb42472bf4cb75fab1d13a4d8ed37276d3ec678a1e2e0f1ca459 2024-09-13T17:12:30.755 INFO:journalctl@ceph.osd.4.smithi195.stdout:Sep 13 17:12:30 smithi195 systemd[1]: Started Ceph osd.4 for ffbd7588-71f0-11ef-bceb-c7b262605968. 2024-09-13T17:12:31.077 INFO:journalctl@ceph.osd.4.smithi195.stdout:Sep 13 17:12:30 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-4[93693]: 2024-09-13T17:12:30.864+0000 7f8651dbd640 -1 Falling back to public interface 2024-09-13T17:12:31.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:30 smithi195 ceph-mon[80021]: pgmap v202: 65 pgs: 9 active+undersized, 7 peering, 1 stale+active+clean, 7 active+undersized+degraded, 41 active+clean; 199 MiB data, 988 MiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 14/222 objects degraded (6.306%) 2024-09-13T17:12:31.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:30 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:12:31.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:30 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:12:31.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:30 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:12:31.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:30 smithi115 ceph-mon[109488]: pgmap v202: 65 pgs: 9 active+undersized, 7 peering, 1 stale+active+clean, 7 active+undersized+degraded, 41 active+clean; 199 MiB data, 988 MiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 14/222 objects degraded (6.306%) 2024-09-13T17:12:31.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:30 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:12:31.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:30 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:12:31.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:30 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:12:33.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:32 smithi195 ceph-mon[80021]: pgmap v203: 65 pgs: 15 active+undersized, 7 peering, 12 active+undersized+degraded, 31 active+clean; 199 MiB data, 988 MiB used, 535 GiB / 536 GiB avail; 895 B/s rd, 1 op/s; 32/222 objects degraded (14.414%) 2024-09-13T17:12:33.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:32 smithi115 ceph-mon[109488]: pgmap v203: 65 pgs: 15 active+undersized, 7 peering, 12 active+undersized+degraded, 31 active+clean; 199 MiB data, 988 MiB used, 535 GiB / 536 GiB avail; 895 B/s rd, 1 op/s; 32/222 objects degraded (14.414%) 2024-09-13T17:12:34.307 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:34 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:12:34.307 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:34 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:12:34.307 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:34 smithi195 ceph-mon[80021]: pgmap v204: 65 pgs: 20 active+undersized, 14 active+undersized+degraded, 31 active+clean; 199 MiB data, 988 MiB used, 535 GiB / 536 GiB avail; 255 B/s rd, 1 op/s; 36/222 objects degraded (16.216%) 2024-09-13T17:12:34.307 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:34 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:12:34.307 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:34 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:12:34.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:34 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:12:34.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:34 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:12:34.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:34 smithi115 ceph-mon[109488]: pgmap v204: 65 pgs: 20 active+undersized, 14 active+undersized+degraded, 31 active+clean; 199 MiB data, 988 MiB used, 535 GiB / 536 GiB avail; 255 B/s rd, 1 op/s; 36/222 objects degraded (16.216%) 2024-09-13T17:12:34.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:34 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:12:34.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:34 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:12:35.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:35 smithi195 ceph-mon[80021]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-09-13T17:12:35.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:35 smithi115 ceph-mon[109488]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-09-13T17:12:36.326 INFO:journalctl@ceph.osd.4.smithi195.stdout:Sep 13 17:12:35 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-4[93693]: 2024-09-13T17:12:35.952+0000 7f8651dbd640 -1 osd.4 68 log_to_monitors true 2024-09-13T17:12:36.881 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:36 smithi115 ceph-mon[109488]: pgmap v205: 65 pgs: 20 active+undersized, 14 active+undersized+degraded, 31 active+clean; 199 MiB data, 988 MiB used, 535 GiB / 536 GiB avail; 734 B/s rd, 1 op/s; 36/222 objects degraded (16.216%) 2024-09-13T17:12:36.882 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:36 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:12:36.882 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:36 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:12:36.882 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:36 smithi115 ceph-mon[109488]: from='osd.4 [v2:172.21.15.195:6808/1718354216,v1:172.21.15.195:6809/1718354216]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T17:12:36.882 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:36 smithi115 ceph-mon[109488]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T17:12:37.077 INFO:journalctl@ceph.osd.4.smithi195.stdout:Sep 13 17:12:36 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-4[93693]: 2024-09-13T17:12:36.617+0000 7f8649b56640 -1 osd.4 68 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T17:12:37.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:36 smithi195 ceph-mon[80021]: pgmap v205: 65 pgs: 20 active+undersized, 14 active+undersized+degraded, 31 active+clean; 199 MiB data, 988 MiB used, 535 GiB / 536 GiB avail; 734 B/s rd, 1 op/s; 36/222 objects degraded (16.216%) 2024-09-13T17:12:37.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:36 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:12:37.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:36 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:12:37.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:36 smithi195 ceph-mon[80021]: from='osd.4 [v2:172.21.15.195:6808/1718354216,v1:172.21.15.195:6809/1718354216]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T17:12:37.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:36 smithi195 ceph-mon[80021]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T17:12:37.654 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:37.650+0000 7f3fcb60a640 1 -- 172.21.15.115:0/52438984 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3fc4100ce0 msgr2=0x7f3fc41010c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:37.654 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:37.650+0000 7f3fcb60a640 1 --2- 172.21.15.115:0/52438984 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3fc4100ce0 0x7f3fc41010c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3fc0009880 tx=0x7f3fc002a530 comp rx=0 tx=0).stop 2024-09-13T17:12:37.654 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:37.650+0000 7f3fcb60a640 1 -- 172.21.15.115:0/52438984 shutdown_connections 2024-09-13T17:12:37.654 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:37.650+0000 7f3fcb60a640 1 --2- 172.21.15.115:0/52438984 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3fc4101600 0x7f3fc4109af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:37.654 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:37.650+0000 7f3fcb60a640 1 --2- 172.21.15.115:0/52438984 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3fc4100ce0 0x7f3fc41010c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:37.654 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:37.650+0000 7f3fcb60a640 1 -- 172.21.15.115:0/52438984 >> 172.21.15.115:0/52438984 conn(0x7f3fc40fa720 msgr2=0x7f3fc40fcb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:37.655 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:37.650+0000 7f3fcb60a640 1 -- 172.21.15.115:0/52438984 shutdown_connections 2024-09-13T17:12:37.655 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:37.650+0000 7f3fcb60a640 1 -- 172.21.15.115:0/52438984 wait complete. 2024-09-13T17:12:37.655 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:37.651+0000 7f3fcb60a640 1 Processor -- start 2024-09-13T17:12:37.655 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:37.651+0000 7f3fcb60a640 1 -- start start 2024-09-13T17:12:37.655 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:37.651+0000 7f3fcb60a640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3fc4100ce0 0x7f3fc419b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:37.655 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:37.651+0000 7f3fcb60a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3fc4101600 0x7f3fc419bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:37.655 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:37.651+0000 7f3fcb60a640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc419c250 con 0x7f3fc4101600 2024-09-13T17:12:37.655 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:37.651+0000 7f3fcb60a640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc4195870 con 0x7f3fc4100ce0 2024-09-13T17:12:37.655 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:37.651+0000 7f3fc8ba5640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3fc4101600 0x7f3fc419bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:37.655 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:37.652+0000 7f3fc93a6640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3fc4100ce0 0x7f3fc419b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:37.655 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:37.652+0000 7f3fc8ba5640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3fc4101600 0x7f3fc419bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52872/0 (socket says 172.21.15.115:52872) 2024-09-13T17:12:37.655 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:37.652+0000 7f3fc8ba5640 1 -- 172.21.15.115:0/2092818941 learned_addr learned my addr 172.21.15.115:0/2092818941 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:12:37.655 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:37.652+0000 7f3fc8ba5640 1 -- 172.21.15.115:0/2092818941 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3fc4100ce0 msgr2=0x7f3fc419b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:37.656 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:37.652+0000 7f3fc8ba5640 1 --2- 172.21.15.115:0/2092818941 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3fc4100ce0 0x7f3fc419b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:37.656 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:37.652+0000 7f3fc8ba5640 1 -- 172.21.15.115:0/2092818941 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fc0009560 con 0x7f3fc4101600 2024-09-13T17:12:37.656 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:37.652+0000 7f3fc8ba5640 1 --2- 172.21.15.115:0/2092818941 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3fc4101600 0x7f3fc419bcc0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3fb400c8f0 tx=0x7f3fb400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:37.656 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:37.652+0000 7f3fba7fc640 1 -- 172.21.15.115:0/2092818941 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3fb4007b80 con 0x7f3fc4101600 2024-09-13T17:12:37.656 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:37.652+0000 7f3fba7fc640 1 -- 172.21.15.115:0/2092818941 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3fb4007ce0 con 0x7f3fc4101600 2024-09-13T17:12:37.657 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:37.652+0000 7f3fcb60a640 1 -- 172.21.15.115:0/2092818941 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fc4195b50 con 0x7f3fc4101600 2024-09-13T17:12:37.657 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:37.652+0000 7f3fba7fc640 1 -- 172.21.15.115:0/2092818941 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3fb40186c0 con 0x7f3fc4101600 2024-09-13T17:12:37.657 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:37.652+0000 7f3fcb60a640 1 -- 172.21.15.115:0/2092818941 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fc41960a0 con 0x7f3fc4101600 2024-09-13T17:12:37.658 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:37.653+0000 7f3fcb60a640 1 -- 172.21.15.115:0/2092818941 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fc4068ce0 con 0x7f3fc4101600 2024-09-13T17:12:37.658 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:37.654+0000 7f3fba7fc640 1 -- 172.21.15.115:0/2092818941 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f3fb400f450 con 0x7f3fc4101600 2024-09-13T17:12:37.658 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:37.654+0000 7f3fba7fc640 1 --2- 172.21.15.115:0/2092818941 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f3fb006cc60 0x7f3fb006f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:37.658 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:37.655+0000 7f3fba7fc640 1 -- 172.21.15.115:0/2092818941 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f3fb408c500 con 0x7f3fc4101600 2024-09-13T17:12:37.658 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:37.655+0000 7f3fc93a6640 1 --2- 172.21.15.115:0/2092818941 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f3fb006cc60 0x7f3fb006f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:37.658 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:37.655+0000 7f3fc93a6640 1 --2- 172.21.15.115:0/2092818941 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f3fb006cc60 0x7f3fb006f120 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3fc0000c00 tx=0x7f3fc0005a20 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:37.660 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:37.659+0000 7f3fba7fc640 1 -- 172.21.15.115:0/2092818941 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f3fb40566a0 con 0x7f3fc4101600 2024-09-13T17:12:37.838 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:37.836+0000 7f3fcb60a640 1 -- 172.21.15.115:0/2092818941 --> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3fc410cc70 con 0x7f3fb006cc60 2024-09-13T17:12:37.838 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:37.837+0000 7f3fba7fc640 1 -- 172.21.15.115:0/2092818941 <== mgr.14660 v2:172.21.15.115:6800/1049502673 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f3fc410cc70 con 0x7f3fb006cc60 2024-09-13T17:12:37.841 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:37.840+0000 7f3fcb60a640 1 -- 172.21.15.115:0/2092818941 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f3fb006cc60 msgr2=0x7f3fb006f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:37.841 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:37.840+0000 7f3fcb60a640 1 --2- 172.21.15.115:0/2092818941 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f3fb006cc60 0x7f3fb006f120 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3fc0000c00 tx=0x7f3fc0005a20 comp rx=0 tx=0).stop 2024-09-13T17:12:37.841 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:37.840+0000 7f3fcb60a640 1 -- 172.21.15.115:0/2092818941 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3fc4101600 msgr2=0x7f3fc419bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:37.841 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:37.840+0000 7f3fcb60a640 1 --2- 172.21.15.115:0/2092818941 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3fc4101600 0x7f3fc419bcc0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3fb400c8f0 tx=0x7f3fb400cdb0 comp rx=0 tx=0).stop 2024-09-13T17:12:37.841 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:37.840+0000 7f3fcb60a640 1 -- 172.21.15.115:0/2092818941 shutdown_connections 2024-09-13T17:12:37.841 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:37.840+0000 7f3fcb60a640 1 --2- 172.21.15.115:0/2092818941 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f3fb006cc60 0x7f3fb006f120 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:37.841 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:37.840+0000 7f3fcb60a640 1 --2- 172.21.15.115:0/2092818941 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3fc4101600 0x7f3fc419bcc0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:37.842 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:37.840+0000 7f3fcb60a640 1 --2- 172.21.15.115:0/2092818941 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3fc4100ce0 0x7f3fc419b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:37.842 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:37.840+0000 7f3fcb60a640 1 -- 172.21.15.115:0/2092818941 >> 172.21.15.115:0/2092818941 conn(0x7f3fc40fa720 msgr2=0x7f3fc4101f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:37.842 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:37.840+0000 7f3fcb60a640 1 -- 172.21.15.115:0/2092818941 shutdown_connections 2024-09-13T17:12:37.842 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:37.840+0000 7f3fcb60a640 1 -- 172.21.15.115:0/2092818941 wait complete. 2024-09-13T17:12:37.850 INFO:teuthology.orchestra.run.smithi115.stdout:true 2024-09-13T17:12:37.924 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:37.922+0000 7f3757cb2640 1 -- 172.21.15.115:0/3231846356 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37500fe9a0 msgr2=0x7f37500fee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:37.924 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:37.922+0000 7f3757cb2640 1 --2- 172.21.15.115:0/3231846356 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37500fe9a0 0x7f37500fee00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3744009880 tx=0x7f374402a4a0 comp rx=0 tx=0).stop 2024-09-13T17:12:37.925 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:37.922+0000 7f3757cb2640 1 -- 172.21.15.115:0/3231846356 shutdown_connections 2024-09-13T17:12:37.925 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:37.922+0000 7f3757cb2640 1 --2- 172.21.15.115:0/3231846356 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37500fe9a0 0x7f37500fee00 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:37.925 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:37.922+0000 7f3757cb2640 1 --2- 172.21.15.115:0/3231846356 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37501049a0 0x7f3750104d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:37.925 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:37.922+0000 7f3757cb2640 1 -- 172.21.15.115:0/3231846356 >> 172.21.15.115:0/3231846356 conn(0x7f37500758c0 msgr2=0x7f37500fcc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:37.925 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:37.923+0000 7f3757cb2640 1 -- 172.21.15.115:0/3231846356 shutdown_connections 2024-09-13T17:12:37.925 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:37.923+0000 7f3757cb2640 1 -- 172.21.15.115:0/3231846356 wait complete. 2024-09-13T17:12:37.925 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:37 smithi115 ceph-mon[109488]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-13T17:12:37.925 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:37 smithi115 ceph-mon[109488]: osdmap e71: 6 total, 5 up, 6 in 2024-09-13T17:12:37.925 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:37 smithi115 ceph-mon[109488]: from='osd.4 [v2:172.21.15.195:6808/1718354216,v1:172.21.15.195:6809/1718354216]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-09-13T17:12:37.926 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:37 smithi115 ceph-mon[109488]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-09-13T17:12:37.926 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:37 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:12:37.926 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:37 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:12:37.926 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:37 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:12:37.926 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:37 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:12:37.926 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:37 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:12:37.926 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:37 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:12:37.926 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:37 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:12:37.926 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:37 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:12:37.926 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:37 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:12:37.926 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:37 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-13T17:12:37.926 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:37 smithi115 ceph-mon[109488]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-13T17:12:37.926 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:37 smithi115 ceph-mon[109488]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-13T17:12:37.929 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:37.923+0000 7f3757cb2640 1 Processor -- start 2024-09-13T17:12:37.929 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:37.923+0000 7f3757cb2640 1 -- start start 2024-09-13T17:12:37.929 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:37.923+0000 7f3757cb2640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37500fe9a0 0x7f37500facf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:37.929 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:37.923+0000 7f3757cb2640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37501049a0 0x7f37500fb230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:37.929 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:37.924+0000 7f3757cb2640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37500fb770 con 0x7f37501049a0 2024-09-13T17:12:37.929 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:37.924+0000 7f3757cb2640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37500fb8e0 con 0x7f37500fe9a0 2024-09-13T17:12:37.929 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:37.924+0000 7f375524d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37501049a0 0x7f37500fb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:37.929 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:37.924+0000 7f375524d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37501049a0 0x7f37500fb230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52884/0 (socket says 172.21.15.115:52884) 2024-09-13T17:12:37.929 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:37.924+0000 7f375524d640 1 -- 172.21.15.115:0/140405663 learned_addr learned my addr 172.21.15.115:0/140405663 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:12:37.929 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:37.924+0000 7f3755a4e640 1 --2- 172.21.15.115:0/140405663 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37500fe9a0 0x7f37500facf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:37.929 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:37.924+0000 7f375524d640 1 -- 172.21.15.115:0/140405663 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37500fe9a0 msgr2=0x7f37500facf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:37.930 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:37.924+0000 7f375524d640 1 --2- 172.21.15.115:0/140405663 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37500fe9a0 0x7f37500facf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:37.930 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:37.924+0000 7f375524d640 1 -- 172.21.15.115:0/140405663 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3744009560 con 0x7f37501049a0 2024-09-13T17:12:37.930 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:37.924+0000 7f375524d640 1 --2- 172.21.15.115:0/140405663 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37501049a0 0x7f37500fb230 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3744006010 tx=0x7f37440056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:37.930 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:37.924+0000 7f374effd640 1 -- 172.21.15.115:0/140405663 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3744004ba0 con 0x7f37501049a0 2024-09-13T17:12:37.930 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:37.924+0000 7f3757cb2640 1 -- 172.21.15.115:0/140405663 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37500fbb60 con 0x7f37501049a0 2024-09-13T17:12:37.930 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:37.925+0000 7f374effd640 1 -- 172.21.15.115:0/140405663 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3744004d00 con 0x7f37501049a0 2024-09-13T17:12:37.930 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:37.925+0000 7f374effd640 1 -- 172.21.15.115:0/140405663 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3744031910 con 0x7f37501049a0 2024-09-13T17:12:37.930 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:37.925+0000 7f3757cb2640 1 -- 172.21.15.115:0/140405663 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37501a1fd0 con 0x7f37501049a0 2024-09-13T17:12:37.930 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:37.926+0000 7f3757cb2640 1 -- 172.21.15.115:0/140405663 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37501000e0 con 0x7f37501049a0 2024-09-13T17:12:37.931 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:37.926+0000 7f374effd640 1 -- 172.21.15.115:0/140405663 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f3744031bb0 con 0x7f37501049a0 2024-09-13T17:12:37.931 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:37.927+0000 7f374effd640 1 --2- 172.21.15.115:0/140405663 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f373806cc50 0x7f373806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:37.931 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:37.927+0000 7f374effd640 1 -- 172.21.15.115:0/140405663 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f37440ad3f0 con 0x7f37501049a0 2024-09-13T17:12:37.931 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:37.927+0000 7f3755a4e640 1 --2- 172.21.15.115:0/140405663 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f373806cc50 0x7f373806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:37.931 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:37.927+0000 7f3755a4e640 1 --2- 172.21.15.115:0/140405663 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f373806cc50 0x7f373806f110 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f374000a400 tx=0x7f374000d040 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:37.933 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:37.932+0000 7f374effd640 1 -- 172.21.15.115:0/140405663 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f3744077640 con 0x7f37501049a0 2024-09-13T17:12:38.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:37 smithi195 ceph-mon[80021]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-13T17:12:38.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:37 smithi195 ceph-mon[80021]: osdmap e71: 6 total, 5 up, 6 in 2024-09-13T17:12:38.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:37 smithi195 ceph-mon[80021]: from='osd.4 [v2:172.21.15.195:6808/1718354216,v1:172.21.15.195:6809/1718354216]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-09-13T17:12:38.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:37 smithi195 ceph-mon[80021]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-09-13T17:12:38.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:37 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:12:38.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:37 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:12:38.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:37 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:12:38.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:37 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:12:38.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:37 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:12:38.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:37 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:12:38.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:37 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:12:38.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:37 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:12:38.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:37 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:12:38.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:37 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-13T17:12:38.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:37 smithi195 ceph-mon[80021]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-13T17:12:38.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:37 smithi195 ceph-mon[80021]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-13T17:12:38.108 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.107+0000 7f3757cb2640 1 -- 172.21.15.115:0/140405663 --> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f37500fbb60 con 0x7f373806cc50 2024-09-13T17:12:38.109 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.108+0000 7f374effd640 1 -- 172.21.15.115:0/140405663 <== mgr.14660 v2:172.21.15.115:6800/1049502673 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f37500fbb60 con 0x7f373806cc50 2024-09-13T17:12:38.111 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.110+0000 7f3757cb2640 1 -- 172.21.15.115:0/140405663 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f373806cc50 msgr2=0x7f373806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:38.111 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.110+0000 7f3757cb2640 1 --2- 172.21.15.115:0/140405663 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f373806cc50 0x7f373806f110 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f374000a400 tx=0x7f374000d040 comp rx=0 tx=0).stop 2024-09-13T17:12:38.112 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.110+0000 7f3757cb2640 1 -- 172.21.15.115:0/140405663 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37501049a0 msgr2=0x7f37500fb230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:38.112 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.110+0000 7f3757cb2640 1 --2- 172.21.15.115:0/140405663 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37501049a0 0x7f37500fb230 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3744006010 tx=0x7f37440056e0 comp rx=0 tx=0).stop 2024-09-13T17:12:38.112 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.110+0000 7f3757cb2640 1 -- 172.21.15.115:0/140405663 shutdown_connections 2024-09-13T17:12:38.112 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.110+0000 7f3757cb2640 1 --2- 172.21.15.115:0/140405663 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f373806cc50 0x7f373806f110 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:38.112 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.110+0000 7f3757cb2640 1 --2- 172.21.15.115:0/140405663 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37501049a0 0x7f37500fb230 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:38.112 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.110+0000 7f3757cb2640 1 --2- 172.21.15.115:0/140405663 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37500fe9a0 0x7f37500facf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:38.112 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.110+0000 7f3757cb2640 1 -- 172.21.15.115:0/140405663 >> 172.21.15.115:0/140405663 conn(0x7f37500758c0 msgr2=0x7f37500fda40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:38.112 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.110+0000 7f3757cb2640 1 -- 172.21.15.115:0/140405663 shutdown_connections 2024-09-13T17:12:38.112 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.110+0000 7f3757cb2640 1 -- 172.21.15.115:0/140405663 wait complete. 2024-09-13T17:12:38.194 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.192+0000 7f46f4f09640 1 -- 172.21.15.115:0/4190449733 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f46f01015e0 msgr2=0x7f46f0109ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:38.194 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.192+0000 7f46f4f09640 1 --2- 172.21.15.115:0/4190449733 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f46f01015e0 0x7f46f0109ad0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f46d80098b0 tx=0x7f46d802a560 comp rx=0 tx=0).stop 2024-09-13T17:12:38.194 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.192+0000 7f46f4f09640 1 -- 172.21.15.115:0/4190449733 shutdown_connections 2024-09-13T17:12:38.195 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.192+0000 7f46f4f09640 1 --2- 172.21.15.115:0/4190449733 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f46f01015e0 0x7f46f0109ad0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:38.195 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.192+0000 7f46f4f09640 1 --2- 172.21.15.115:0/4190449733 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f46f0100cc0 0x7f46f01010a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:38.195 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.192+0000 7f46f4f09640 1 -- 172.21.15.115:0/4190449733 >> 172.21.15.115:0/4190449733 conn(0x7f46f00758c0 msgr2=0x7f46f00fcc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:38.195 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.192+0000 7f46f4f09640 1 -- 172.21.15.115:0/4190449733 shutdown_connections 2024-09-13T17:12:38.195 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.192+0000 7f46f4f09640 1 -- 172.21.15.115:0/4190449733 wait complete. 2024-09-13T17:12:38.195 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.192+0000 7f46f4f09640 1 Processor -- start 2024-09-13T17:12:38.195 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.192+0000 7f46f4f09640 1 -- start start 2024-09-13T17:12:38.195 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.193+0000 7f46f4f09640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f46f0100cc0 0x7f46f019b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:38.195 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.193+0000 7f46f4f09640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f46f01015e0 0x7f46f019bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:38.195 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.193+0000 7f46f4f09640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46f019c250 con 0x7f46f01015e0 2024-09-13T17:12:38.195 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.193+0000 7f46f4f09640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46f0195870 con 0x7f46f0100cc0 2024-09-13T17:12:38.195 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.193+0000 7f46edd9b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f46f01015e0 0x7f46f019bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:38.195 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.193+0000 7f46edd9b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f46f01015e0 0x7f46f019bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52904/0 (socket says 172.21.15.115:52904) 2024-09-13T17:12:38.195 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.193+0000 7f46edd9b640 1 -- 172.21.15.115:0/2960821598 learned_addr learned my addr 172.21.15.115:0/2960821598 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:12:38.196 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.193+0000 7f46ee59c640 1 --2- 172.21.15.115:0/2960821598 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f46f0100cc0 0x7f46f019b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:38.196 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.193+0000 7f46edd9b640 1 -- 172.21.15.115:0/2960821598 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f46f0100cc0 msgr2=0x7f46f019b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:38.196 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.193+0000 7f46edd9b640 1 --2- 172.21.15.115:0/2960821598 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f46f0100cc0 0x7f46f019b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:38.196 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.193+0000 7f46edd9b640 1 -- 172.21.15.115:0/2960821598 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46d8009560 con 0x7f46f01015e0 2024-09-13T17:12:38.197 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.193+0000 7f46edd9b640 1 --2- 172.21.15.115:0/2960821598 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f46f01015e0 0x7f46f019bcc0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f46d8006010 tx=0x7f46d8005610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:38.197 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.194+0000 7f46e77fe640 1 -- 172.21.15.115:0/2960821598 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46d8004b20 con 0x7f46f01015e0 2024-09-13T17:12:38.197 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.194+0000 7f46f4f09640 1 -- 172.21.15.115:0/2960821598 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46f0195af0 con 0x7f46f01015e0 2024-09-13T17:12:38.197 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.194+0000 7f46e77fe640 1 -- 172.21.15.115:0/2960821598 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f46d8004c80 con 0x7f46f01015e0 2024-09-13T17:12:38.197 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.194+0000 7f46e77fe640 1 -- 172.21.15.115:0/2960821598 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46d8031820 con 0x7f46f01015e0 2024-09-13T17:12:38.197 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.194+0000 7f46f4f09640 1 -- 172.21.15.115:0/2960821598 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46f0195fe0 con 0x7f46f01015e0 2024-09-13T17:12:38.198 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.195+0000 7f46f4f09640 1 -- 172.21.15.115:0/2960821598 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46f0068460 con 0x7f46f01015e0 2024-09-13T17:12:38.198 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.195+0000 7f46e77fe640 1 -- 172.21.15.115:0/2960821598 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f46d8031ae0 con 0x7f46f01015e0 2024-09-13T17:12:38.198 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.196+0000 7f46e77fe640 1 --2- 172.21.15.115:0/2960821598 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f46dc06cc50 0x7f46dc06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:38.198 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.196+0000 7f46e77fe640 1 -- 172.21.15.115:0/2960821598 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f46d80ad5a0 con 0x7f46f01015e0 2024-09-13T17:12:38.198 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.196+0000 7f46ee59c640 1 --2- 172.21.15.115:0/2960821598 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f46dc06cc50 0x7f46dc06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:38.198 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.196+0000 7f46ee59c640 1 --2- 172.21.15.115:0/2960821598 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f46dc06cc50 0x7f46dc06f110 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f46e000abe0 tx=0x7f46e000a2d0 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:38.201 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.200+0000 7f46e77fe640 1 -- 172.21.15.115:0/2960821598 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f46d80776c0 con 0x7f46f01015e0 2024-09-13T17:12:38.377 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.376+0000 7f46f4f09640 1 -- 172.21.15.115:0/2960821598 --> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f46f010cbf0 con 0x7f46dc06cc50 2024-09-13T17:12:38.386 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.385+0000 7f46e77fe640 1 -- 172.21.15.115:0/2960821598 <== mgr.14660 v2:172.21.15.115:6800/1049502673 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f46f010cbf0 con 0x7f46dc06cc50 2024-09-13T17:12:38.386 INFO:teuthology.orchestra.run.smithi115.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T17:12:38.386 INFO:teuthology.orchestra.run.smithi115.stdout:alertmanager.smithi115 smithi115 *:9093,9094 running (4m) 67s ago 14m 25.0M - 0.25.0 c8568f914cd2 d56b91240fe1 2024-09-13T17:12:38.386 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-exporter.smithi115 smithi115 running (14m) 67s ago 14m 8376k - 18.2.4-843-g2c01458a c129f5a2fd4e 0f1eebeaf9bb 2024-09-13T17:12:38.386 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-exporter.smithi195 smithi195 running (13m) 5s ago 13m 7994k - 18.2.4-843-g2c01458a c129f5a2fd4e 6d05bafbac8a 2024-09-13T17:12:38.387 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi115 smithi115 running (2m) 67s ago 14m 6895k - 18.2.4-860-g6c6b083f 8a91f241d7d4 e8175bc055bf 2024-09-13T17:12:38.387 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi195 smithi195 running (2m) 5s ago 13m 6903k - 18.2.4-860-g6c6b083f 8a91f241d7d4 ccb4895be776 2024-09-13T17:12:38.387 INFO:teuthology.orchestra.run.smithi115.stdout:grafana.smithi115 smithi115 *:3000 running (4m) 67s ago 14m 80.6M - 9.4.7 954c08fa6188 e1eccb1a8f3e 2024-09-13T17:12:38.387 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi115.hbtxod smithi115 running (9m) 67s ago 9m 98.5M - 18.2.4-843-g2c01458a c129f5a2fd4e 12b4f4874491 2024-09-13T17:12:38.387 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi115.ijznvr smithi115 running (9m) 67s ago 9m 166M - 18.2.4-843-g2c01458a c129f5a2fd4e 2d552564a9f4 2024-09-13T17:12:38.387 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi195.aevvgz smithi195 running (9m) 5s ago 9m 18.6M - 18.2.4-843-g2c01458a c129f5a2fd4e 299b9ad657c9 2024-09-13T17:12:38.387 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi195.qzghxj smithi195 running (9m) 5s ago 9m 16.5M - 18.2.4-843-g2c01458a c129f5a2fd4e fb16b16181ff 2024-09-13T17:12:38.387 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi115.hetcni smithi115 *:8443,9283,8765 running (6m) 67s ago 15m 494M - 18.2.4-860-g6c6b083f 8a91f241d7d4 b945dbde1934 2024-09-13T17:12:38.387 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi195.hjjifz smithi195 *:8443,9283,8765 running (5m) 5s ago 13m 442M - 18.2.4-860-g6c6b083f 8a91f241d7d4 17bccdfbcae1 2024-09-13T17:12:38.387 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi115 smithi115 running (3m) 67s ago 16m 40.7M 2048M 18.2.4-860-g6c6b083f 8a91f241d7d4 8dd7baf2c6b6 2024-09-13T17:12:38.387 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi195 smithi195 running (2m) 5s ago 13m 37.0M 2048M 18.2.4-860-g6c6b083f 8a91f241d7d4 0459bc5e6b08 2024-09-13T17:12:38.387 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi115 smithi115 *:9100 running (5m) 67s ago 14m 16.5M - 1.5.0 0da6a335fe13 26fb6f9844b5 2024-09-13T17:12:38.387 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi195 smithi195 *:9100 running (5m) 5s ago 13m 17.0M - 1.5.0 0da6a335fe13 6d38e798fb16 2024-09-13T17:12:38.388 INFO:teuthology.orchestra.run.smithi115.stdout:osd.0 smithi115 running (2m) 67s ago 12m 99.7M 1216M 18.2.4-860-g6c6b083f 8a91f241d7d4 3b9f874c64e9 2024-09-13T17:12:38.388 INFO:teuthology.orchestra.run.smithi115.stdout:osd.1 smithi115 running (107s) 67s ago 12m 101M 1216M 18.2.4-860-g6c6b083f 8a91f241d7d4 f0de6684601c 2024-09-13T17:12:38.388 INFO:teuthology.orchestra.run.smithi115.stdout:osd.2 smithi115 running (73s) 67s ago 11m 13.6M 1216M 18.2.4-860-g6c6b083f 8a91f241d7d4 edb753bab54a 2024-09-13T17:12:38.388 INFO:teuthology.orchestra.run.smithi115.stdout:osd.3 smithi195 running (39s) 5s ago 11m 106M 2240M 18.2.4-860-g6c6b083f 8a91f241d7d4 ccd1b2bf7d86 2024-09-13T17:12:38.388 INFO:teuthology.orchestra.run.smithi115.stdout:osd.4 smithi195 running (8s) 5s ago 11m 12.7M 2240M 18.2.4-860-g6c6b083f 8a91f241d7d4 c88b3dacb207 2024-09-13T17:12:38.388 INFO:teuthology.orchestra.run.smithi115.stdout:osd.5 smithi195 running (10m) 5s ago 10m 236M 2240M 18.2.4-843-g2c01458a c129f5a2fd4e 4bd1b3a232d0 2024-09-13T17:12:38.388 INFO:teuthology.orchestra.run.smithi115.stdout:prometheus.smithi115 smithi115 *:9095 running (4m) 67s ago 14m 64.3M - 2.43.0 a07b618ecd1d e03fb39f6b76 2024-09-13T17:12:38.389 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.387+0000 7f46f4f09640 1 -- 172.21.15.115:0/2960821598 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f46dc06cc50 msgr2=0x7f46dc06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:38.389 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.387+0000 7f46f4f09640 1 --2- 172.21.15.115:0/2960821598 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f46dc06cc50 0x7f46dc06f110 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f46e000abe0 tx=0x7f46e000a2d0 comp rx=0 tx=0).stop 2024-09-13T17:12:38.389 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.387+0000 7f46f4f09640 1 -- 172.21.15.115:0/2960821598 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f46f01015e0 msgr2=0x7f46f019bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:38.389 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.387+0000 7f46f4f09640 1 --2- 172.21.15.115:0/2960821598 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f46f01015e0 0x7f46f019bcc0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f46d8006010 tx=0x7f46d8005610 comp rx=0 tx=0).stop 2024-09-13T17:12:38.389 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.387+0000 7f46f4f09640 1 -- 172.21.15.115:0/2960821598 shutdown_connections 2024-09-13T17:12:38.389 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.387+0000 7f46f4f09640 1 --2- 172.21.15.115:0/2960821598 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f46dc06cc50 0x7f46dc06f110 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:38.389 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.387+0000 7f46f4f09640 1 --2- 172.21.15.115:0/2960821598 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f46f01015e0 0x7f46f019bcc0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:38.389 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.387+0000 7f46f4f09640 1 --2- 172.21.15.115:0/2960821598 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f46f0100cc0 0x7f46f019b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:38.389 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.387+0000 7f46f4f09640 1 -- 172.21.15.115:0/2960821598 >> 172.21.15.115:0/2960821598 conn(0x7f46f00758c0 msgr2=0x7f46f0101f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:38.390 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.387+0000 7f46f4f09640 1 -- 172.21.15.115:0/2960821598 shutdown_connections 2024-09-13T17:12:38.390 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.387+0000 7f46f4f09640 1 -- 172.21.15.115:0/2960821598 wait complete. 2024-09-13T17:12:38.474 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.472+0000 7f19a238c640 1 -- 172.21.15.115:0/2859736145 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f199c0fe9a0 msgr2=0x7f199c0fee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:38.474 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.472+0000 7f19a238c640 1 --2- 172.21.15.115:0/2859736145 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f199c0fe9a0 0x7f199c0fee00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1990009880 tx=0x7f199002a4a0 comp rx=0 tx=0).stop 2024-09-13T17:12:38.474 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.472+0000 7f19a238c640 1 -- 172.21.15.115:0/2859736145 shutdown_connections 2024-09-13T17:12:38.474 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.472+0000 7f19a238c640 1 --2- 172.21.15.115:0/2859736145 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f199c0fe9a0 0x7f199c0fee00 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:38.474 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.472+0000 7f19a238c640 1 --2- 172.21.15.115:0/2859736145 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f199c1049a0 0x7f199c104d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:38.474 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.472+0000 7f19a238c640 1 -- 172.21.15.115:0/2859736145 >> 172.21.15.115:0/2859736145 conn(0x7f199c0758c0 msgr2=0x7f199c0fcc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:38.474 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.472+0000 7f19a238c640 1 -- 172.21.15.115:0/2859736145 shutdown_connections 2024-09-13T17:12:38.474 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.473+0000 7f19a238c640 1 -- 172.21.15.115:0/2859736145 wait complete. 2024-09-13T17:12:38.476 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.473+0000 7f19a238c640 1 Processor -- start 2024-09-13T17:12:38.476 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.473+0000 7f19a238c640 1 -- start start 2024-09-13T17:12:38.476 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.474+0000 7f19a238c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f199c0fe9a0 0x7f199c19b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:38.476 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.474+0000 7f19a238c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f199c1049a0 0x7f199c19bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:38.476 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.474+0000 7f19a238c640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f199c19c300 con 0x7f199c1049a0 2024-09-13T17:12:38.476 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.474+0000 7f19a238c640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f199c195890 con 0x7f199c0fe9a0 2024-09-13T17:12:38.476 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.474+0000 7f199b7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f199c1049a0 0x7f199c19bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:38.476 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.474+0000 7f199b7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f199c1049a0 0x7f199c19bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52924/0 (socket says 172.21.15.115:52924) 2024-09-13T17:12:38.477 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.474+0000 7f199b7fe640 1 -- 172.21.15.115:0/3086446584 learned_addr learned my addr 172.21.15.115:0/3086446584 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:12:38.477 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.474+0000 7f199bfff640 1 --2- 172.21.15.115:0/3086446584 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f199c0fe9a0 0x7f199c19b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:38.477 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.474+0000 7f199b7fe640 1 -- 172.21.15.115:0/3086446584 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f199c0fe9a0 msgr2=0x7f199c19b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:38.477 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.474+0000 7f199b7fe640 1 --2- 172.21.15.115:0/3086446584 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f199c0fe9a0 0x7f199c19b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:38.477 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.474+0000 7f199b7fe640 1 -- 172.21.15.115:0/3086446584 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1990009560 con 0x7f199c1049a0 2024-09-13T17:12:38.477 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.474+0000 7f199bfff640 1 --2- 172.21.15.115:0/3086446584 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f199c0fe9a0 0x7f199c19b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:12:38.477 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.474+0000 7f199b7fe640 1 --2- 172.21.15.115:0/3086446584 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f199c1049a0 0x7f199c19bce0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1990006010 tx=0x7f19900055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:38.477 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.475+0000 7f19997fa640 1 -- 172.21.15.115:0/3086446584 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1990004aa0 con 0x7f199c1049a0 2024-09-13T17:12:38.477 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.475+0000 7f19a238c640 1 -- 172.21.15.115:0/3086446584 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f199c195b10 con 0x7f199c1049a0 2024-09-13T17:12:38.477 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.475+0000 7f19997fa640 1 -- 172.21.15.115:0/3086446584 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1990004c00 con 0x7f199c1049a0 2024-09-13T17:12:38.478 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.475+0000 7f19997fa640 1 -- 172.21.15.115:0/3086446584 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1990031910 con 0x7f199c1049a0 2024-09-13T17:12:38.479 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.475+0000 7f19a238c640 1 -- 172.21.15.115:0/3086446584 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f199c196000 con 0x7f199c1049a0 2024-09-13T17:12:38.479 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.476+0000 7f19a238c640 1 -- 172.21.15.115:0/3086446584 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f199c1000e0 con 0x7f199c1049a0 2024-09-13T17:12:38.479 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.477+0000 7f19997fa640 1 -- 172.21.15.115:0/3086446584 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f1990031a70 con 0x7f199c1049a0 2024-09-13T17:12:38.479 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.477+0000 7f19997fa640 1 --2- 172.21.15.115:0/3086446584 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f198406cc50 0x7f198406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:38.479 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.477+0000 7f19997fa640 1 -- 172.21.15.115:0/3086446584 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f19900ad5e0 con 0x7f199c1049a0 2024-09-13T17:12:38.479 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.478+0000 7f199bfff640 1 --2- 172.21.15.115:0/3086446584 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f198406cc50 0x7f198406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:38.480 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.478+0000 7f199bfff640 1 --2- 172.21.15.115:0/3086446584 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f198406cc50 0x7f198406f110 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f198c0058c0 tx=0x7f198c005850 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:38.483 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.482+0000 7f19997fa640 1 -- 172.21.15.115:0/3086446584 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f1990077780 con 0x7f199c1049a0 2024-09-13T17:12:38.733 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.732+0000 7f19a238c640 1 -- 172.21.15.115:0/3086446584 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f199c0fee00 con 0x7f199c1049a0 2024-09-13T17:12:38.734 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:38 smithi115 ceph-mon[109488]: pgmap v207: 65 pgs: 20 active+undersized, 14 active+undersized+degraded, 31 active+clean; 199 MiB data, 879 MiB used, 536 GiB / 536 GiB avail; 716 B/s rd, 1 op/s; 36/222 objects degraded (16.216%) 2024-09-13T17:12:38.734 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:38 smithi115 ceph-mon[109488]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T17:12:38.734 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:38 smithi115 ceph-mon[109488]: osd.4 [v2:172.21.15.195:6808/1718354216,v1:172.21.15.195:6809/1718354216] boot 2024-09-13T17:12:38.734 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:38 smithi115 ceph-mon[109488]: osdmap e72: 6 total, 6 up, 6 in 2024-09-13T17:12:38.734 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:38 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T17:12:38.734 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:38 smithi115 ceph-mon[109488]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:12:38.734 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:38 smithi115 ceph-mon[109488]: osdmap e73: 6 total, 6 up, 6 in 2024-09-13T17:12:38.735 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.732+0000 7f19997fa640 1 -- 172.21.15.115:0/3086446584 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+837 (secure 0 0 0) 0x7f199007ada0 con 0x7f199c1049a0 2024-09-13T17:12:38.735 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-13T17:12:38.735 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": { 2024-09-13T17:12:38.735 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 2 2024-09-13T17:12:38.735 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T17:12:38.736 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": { 2024-09-13T17:12:38.736 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 2 2024-09-13T17:12:38.736 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T17:12:38.736 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": { 2024-09-13T17:12:38.736 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-843-g2c01458a (2c01458affee2b2435cd231b6e392435c1c21661) reef (stable)": 1, 2024-09-13T17:12:38.736 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 5 2024-09-13T17:12:38.736 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T17:12:38.736 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": { 2024-09-13T17:12:38.736 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-843-g2c01458a (2c01458affee2b2435cd231b6e392435c1c21661) reef (stable)": 4 2024-09-13T17:12:38.736 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T17:12:38.736 INFO:teuthology.orchestra.run.smithi115.stdout: "overall": { 2024-09-13T17:12:38.737 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-843-g2c01458a (2c01458affee2b2435cd231b6e392435c1c21661) reef (stable)": 5, 2024-09-13T17:12:38.737 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 9 2024-09-13T17:12:38.737 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-13T17:12:38.737 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-13T17:12:38.738 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.734+0000 7f19a238c640 1 -- 172.21.15.115:0/3086446584 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f198406cc50 msgr2=0x7f198406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:38.738 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.734+0000 7f19a238c640 1 --2- 172.21.15.115:0/3086446584 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f198406cc50 0x7f198406f110 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f198c0058c0 tx=0x7f198c005850 comp rx=0 tx=0).stop 2024-09-13T17:12:38.738 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.734+0000 7f19a238c640 1 -- 172.21.15.115:0/3086446584 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f199c1049a0 msgr2=0x7f199c19bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:38.738 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.734+0000 7f19a238c640 1 --2- 172.21.15.115:0/3086446584 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f199c1049a0 0x7f199c19bce0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1990006010 tx=0x7f19900055a0 comp rx=0 tx=0).stop 2024-09-13T17:12:38.738 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.734+0000 7f19a238c640 1 -- 172.21.15.115:0/3086446584 shutdown_connections 2024-09-13T17:12:38.738 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.734+0000 7f19a238c640 1 --2- 172.21.15.115:0/3086446584 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f198406cc50 0x7f198406f110 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:38.738 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.734+0000 7f19a238c640 1 --2- 172.21.15.115:0/3086446584 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f199c1049a0 0x7f199c19bce0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:38.738 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.734+0000 7f19a238c640 1 --2- 172.21.15.115:0/3086446584 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f199c0fe9a0 0x7f199c19b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:38.738 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.734+0000 7f19a238c640 1 -- 172.21.15.115:0/3086446584 >> 172.21.15.115:0/3086446584 conn(0x7f199c0758c0 msgr2=0x7f199c0fd910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:38.739 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.734+0000 7f19a238c640 1 -- 172.21.15.115:0/3086446584 shutdown_connections 2024-09-13T17:12:38.739 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.734+0000 7f19a238c640 1 -- 172.21.15.115:0/3086446584 wait complete. 2024-09-13T17:12:38.818 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.815+0000 7f2bb2b48640 1 -- 172.21.15.115:0/284673107 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2bac1049a0 msgr2=0x7f2bac104d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:38.818 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.815+0000 7f2bb2b48640 1 --2- 172.21.15.115:0/284673107 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2bac1049a0 0x7f2bac104d80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2ba0009900 tx=0x7f2ba002c6e0 comp rx=0 tx=0).stop 2024-09-13T17:12:38.818 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.815+0000 7f2bb2b48640 1 -- 172.21.15.115:0/284673107 shutdown_connections 2024-09-13T17:12:38.818 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.815+0000 7f2bb2b48640 1 --2- 172.21.15.115:0/284673107 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2bac0fe9a0 0x7f2bac0fee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:38.819 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.815+0000 7f2bb2b48640 1 --2- 172.21.15.115:0/284673107 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2bac1049a0 0x7f2bac104d80 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:38.819 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.815+0000 7f2bb2b48640 1 -- 172.21.15.115:0/284673107 >> 172.21.15.115:0/284673107 conn(0x7f2bac0758c0 msgr2=0x7f2bac0fcc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:38.819 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.815+0000 7f2bb2b48640 1 -- 172.21.15.115:0/284673107 shutdown_connections 2024-09-13T17:12:38.819 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.815+0000 7f2bb2b48640 1 -- 172.21.15.115:0/284673107 wait complete. 2024-09-13T17:12:38.819 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.815+0000 7f2bb2b48640 1 Processor -- start 2024-09-13T17:12:38.819 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.815+0000 7f2bb2b48640 1 -- start start 2024-09-13T17:12:38.820 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.816+0000 7f2bb2b48640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2bac0fe9a0 0x7f2bac19d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:38.820 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.816+0000 7f2bb2b48640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2bac1049a0 0x7f2bac19def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:38.820 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.816+0000 7f2bb2b48640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bac19e510 con 0x7f2bac0fe9a0 2024-09-13T17:12:38.820 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.816+0000 7f2bb2b48640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bac197aa0 con 0x7f2bac1049a0 2024-09-13T17:12:38.820 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.816+0000 7f2bb08e4640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2bac0fe9a0 0x7f2bac19d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:38.820 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.816+0000 7f2bb08e4640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2bac0fe9a0 0x7f2bac19d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52944/0 (socket says 172.21.15.115:52944) 2024-09-13T17:12:38.821 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.816+0000 7f2bb08e4640 1 -- 172.21.15.115:0/3985632523 learned_addr learned my addr 172.21.15.115:0/3985632523 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:12:38.821 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.816+0000 7f2babfff640 1 --2- 172.21.15.115:0/3985632523 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2bac1049a0 0x7f2bac19def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:38.821 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.816+0000 7f2bb08e4640 1 -- 172.21.15.115:0/3985632523 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2bac1049a0 msgr2=0x7f2bac19def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:38.821 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.816+0000 7f2bb08e4640 1 --2- 172.21.15.115:0/3985632523 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2bac1049a0 0x7f2bac19def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:38.821 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.816+0000 7f2bb08e4640 1 -- 172.21.15.115:0/3985632523 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ba0009560 con 0x7f2bac0fe9a0 2024-09-13T17:12:38.821 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.816+0000 7f2bb08e4640 1 --2- 172.21.15.115:0/3985632523 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2bac0fe9a0 0x7f2bac19d9b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2ba0006010 tx=0x7f2ba00055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:38.821 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.816+0000 7f2ba9ffb640 1 -- 172.21.15.115:0/3985632523 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ba0004aa0 con 0x7f2bac0fe9a0 2024-09-13T17:12:38.821 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.816+0000 7f2bb2b48640 1 -- 172.21.15.115:0/3985632523 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bac197d20 con 0x7f2bac0fe9a0 2024-09-13T17:12:38.821 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.816+0000 7f2ba9ffb640 1 -- 172.21.15.115:0/3985632523 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2ba0005d50 con 0x7f2bac0fe9a0 2024-09-13T17:12:38.821 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.816+0000 7f2ba9ffb640 1 -- 172.21.15.115:0/3985632523 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ba0033790 con 0x7f2bac0fe9a0 2024-09-13T17:12:38.822 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.817+0000 7f2bb2b48640 1 -- 172.21.15.115:0/3985632523 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bac198210 con 0x7f2bac0fe9a0 2024-09-13T17:12:38.822 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.818+0000 7f2bb2b48640 1 -- 172.21.15.115:0/3985632523 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bac1000e0 con 0x7f2bac0fe9a0 2024-09-13T17:12:38.823 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.818+0000 7f2ba9ffb640 1 -- 172.21.15.115:0/3985632523 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f2ba0004c00 con 0x7f2bac0fe9a0 2024-09-13T17:12:38.823 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.819+0000 7f2ba9ffb640 1 --2- 172.21.15.115:0/3985632523 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f2b9c06cc50 0x7f2b9c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:38.823 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.819+0000 7f2ba9ffb640 1 -- 172.21.15.115:0/3985632523 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f2ba00ad300 con 0x7f2bac0fe9a0 2024-09-13T17:12:38.823 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.819+0000 7f2babfff640 1 --2- 172.21.15.115:0/3985632523 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f2b9c06cc50 0x7f2b9c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:38.823 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.819+0000 7f2babfff640 1 --2- 172.21.15.115:0/3985632523 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f2b9c06cc50 0x7f2b9c06f110 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2b98005fd0 tx=0x7f2b98005850 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:38.824 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:38.823+0000 7f2ba9ffb640 1 -- 172.21.15.115:0/3985632523 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f2ba0077420 con 0x7f2bac0fe9a0 2024-09-13T17:12:39.020 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.019+0000 7f2bb2b48640 1 -- 172.21.15.115:0/3985632523 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f2bac106f60 con 0x7f2bac0fe9a0 2024-09-13T17:12:39.021 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.019+0000 7f2ba9ffb640 1 -- 172.21.15.115:0/3985632523 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1874 (secure 0 0 0) 0x7f2ba007aa40 con 0x7f2bac0fe9a0 2024-09-13T17:12:39.021 INFO:teuthology.orchestra.run.smithi115.stdout:e19 2024-09-13T17:12:39.021 INFO:teuthology.orchestra.run.smithi115.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T17:12:39.021 INFO:teuthology.orchestra.run.smithi115.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T17:12:39.021 INFO:teuthology.orchestra.run.smithi115.stdout:legacy client fscid: 1 2024-09-13T17:12:39.021 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:12:39.022 INFO:teuthology.orchestra.run.smithi115.stdout:Filesystem 'cephfs' (1) 2024-09-13T17:12:39.022 INFO:teuthology.orchestra.run.smithi115.stdout:fs_name cephfs 2024-09-13T17:12:39.022 INFO:teuthology.orchestra.run.smithi115.stdout:epoch 19 2024-09-13T17:12:39.022 INFO:teuthology.orchestra.run.smithi115.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T17:12:39.022 INFO:teuthology.orchestra.run.smithi115.stdout:created 2024-09-13T17:03:16.313116+0000 2024-09-13T17:12:39.022 INFO:teuthology.orchestra.run.smithi115.stdout:modified 2024-09-13T17:03:33.410348+0000 2024-09-13T17:12:39.022 INFO:teuthology.orchestra.run.smithi115.stdout:tableserver 0 2024-09-13T17:12:39.022 INFO:teuthology.orchestra.run.smithi115.stdout:root 0 2024-09-13T17:12:39.022 INFO:teuthology.orchestra.run.smithi115.stdout:session_timeout 60 2024-09-13T17:12:39.022 INFO:teuthology.orchestra.run.smithi115.stdout:session_autoclose 300 2024-09-13T17:12:39.022 INFO:teuthology.orchestra.run.smithi115.stdout:max_file_size 1099511627776 2024-09-13T17:12:39.023 INFO:teuthology.orchestra.run.smithi115.stdout:max_xattr_size 65536 2024-09-13T17:12:39.023 INFO:teuthology.orchestra.run.smithi115.stdout:required_client_features {} 2024-09-13T17:12:39.023 INFO:teuthology.orchestra.run.smithi115.stdout:last_failure 0 2024-09-13T17:12:39.023 INFO:teuthology.orchestra.run.smithi115.stdout:last_failure_osd_epoch 46 2024-09-13T17:12:39.023 INFO:teuthology.orchestra.run.smithi115.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T17:12:39.023 INFO:teuthology.orchestra.run.smithi115.stdout:max_mds 1 2024-09-13T17:12:39.023 INFO:teuthology.orchestra.run.smithi115.stdout:in 0 2024-09-13T17:12:39.023 INFO:teuthology.orchestra.run.smithi115.stdout:up {0=14470} 2024-09-13T17:12:39.023 INFO:teuthology.orchestra.run.smithi115.stdout:failed 2024-09-13T17:12:39.023 INFO:teuthology.orchestra.run.smithi115.stdout:damaged 2024-09-13T17:12:39.023 INFO:teuthology.orchestra.run.smithi115.stdout:stopped 2024-09-13T17:12:39.023 INFO:teuthology.orchestra.run.smithi115.stdout:data_pools [3] 2024-09-13T17:12:39.023 INFO:teuthology.orchestra.run.smithi115.stdout:metadata_pool 2 2024-09-13T17:12:39.024 INFO:teuthology.orchestra.run.smithi115.stdout:inline_data enabled 2024-09-13T17:12:39.024 INFO:teuthology.orchestra.run.smithi115.stdout:balancer 2024-09-13T17:12:39.024 INFO:teuthology.orchestra.run.smithi115.stdout:bal_rank_mask -1 2024-09-13T17:12:39.024 INFO:teuthology.orchestra.run.smithi115.stdout:standby_count_wanted 1 2024-09-13T17:12:39.024 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi115.ijznvr{0:14470} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.115:6828/4128583274,v1:172.21.15.115:6829/4128583274] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T17:12:39.024 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi115.hbtxod{0:14486} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.115:6826/1977394649,v1:172.21.15.115:6827/1977394649] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T17:12:39.024 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:12:39.024 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:12:39.024 INFO:teuthology.orchestra.run.smithi115.stdout:Standby daemons: 2024-09-13T17:12:39.024 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:12:39.024 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi195.aevvgz{-1:24253} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.195:6826/8826118,v1:172.21.15.195:6827/8826118] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T17:12:39.024 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi195.qzghxj{-1:24259} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.195:6824/3335357704,v1:172.21.15.195:6825/3335357704] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T17:12:39.025 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 19 2024-09-13T17:12:39.025 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.022+0000 7f2bb2b48640 1 -- 172.21.15.115:0/3985632523 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f2b9c06cc50 msgr2=0x7f2b9c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:39.025 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.022+0000 7f2bb2b48640 1 --2- 172.21.15.115:0/3985632523 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f2b9c06cc50 0x7f2b9c06f110 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2b98005fd0 tx=0x7f2b98005850 comp rx=0 tx=0).stop 2024-09-13T17:12:39.025 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.022+0000 7f2bb2b48640 1 -- 172.21.15.115:0/3985632523 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2bac0fe9a0 msgr2=0x7f2bac19d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:39.025 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.022+0000 7f2bb2b48640 1 --2- 172.21.15.115:0/3985632523 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2bac0fe9a0 0x7f2bac19d9b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2ba0006010 tx=0x7f2ba00055a0 comp rx=0 tx=0).stop 2024-09-13T17:12:39.025 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.022+0000 7f2bb2b48640 1 -- 172.21.15.115:0/3985632523 shutdown_connections 2024-09-13T17:12:39.025 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.022+0000 7f2bb2b48640 1 --2- 172.21.15.115:0/3985632523 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f2b9c06cc50 0x7f2b9c06f110 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:39.025 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.022+0000 7f2bb2b48640 1 --2- 172.21.15.115:0/3985632523 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2bac1049a0 0x7f2bac19def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:39.026 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.022+0000 7f2bb2b48640 1 --2- 172.21.15.115:0/3985632523 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2bac0fe9a0 0x7f2bac19d9b0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:39.026 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.022+0000 7f2bb2b48640 1 -- 172.21.15.115:0/3985632523 >> 172.21.15.115:0/3985632523 conn(0x7f2bac0758c0 msgr2=0x7f2bac1023b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:39.026 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.022+0000 7f2bb2b48640 1 -- 172.21.15.115:0/3985632523 shutdown_connections 2024-09-13T17:12:39.026 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.022+0000 7f2bb2b48640 1 -- 172.21.15.115:0/3985632523 wait complete. 2024-09-13T17:12:39.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:38 smithi195 ceph-mon[80021]: pgmap v207: 65 pgs: 20 active+undersized, 14 active+undersized+degraded, 31 active+clean; 199 MiB data, 879 MiB used, 536 GiB / 536 GiB avail; 716 B/s rd, 1 op/s; 36/222 objects degraded (16.216%) 2024-09-13T17:12:39.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:38 smithi195 ceph-mon[80021]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T17:12:39.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:38 smithi195 ceph-mon[80021]: osd.4 [v2:172.21.15.195:6808/1718354216,v1:172.21.15.195:6809/1718354216] boot 2024-09-13T17:12:39.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:38 smithi195 ceph-mon[80021]: osdmap e72: 6 total, 6 up, 6 in 2024-09-13T17:12:39.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:38 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T17:12:39.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:38 smithi195 ceph-mon[80021]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:12:39.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:38 smithi195 ceph-mon[80021]: osdmap e73: 6 total, 6 up, 6 in 2024-09-13T17:12:39.107 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.104+0000 7f31a374d640 1 -- 172.21.15.115:0/2254306644 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f319c0ffb40 msgr2=0x7f319c0fffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:39.107 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.104+0000 7f31a374d640 1 --2- 172.21.15.115:0/2254306644 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f319c0ffb40 0x7f319c0fffa0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f318c009880 tx=0x7f318c02a4a0 comp rx=0 tx=0).stop 2024-09-13T17:12:39.107 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.104+0000 7f31a374d640 1 -- 172.21.15.115:0/2254306644 shutdown_connections 2024-09-13T17:12:39.107 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.104+0000 7f31a374d640 1 --2- 172.21.15.115:0/2254306644 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f319c0ffb40 0x7f319c0fffa0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:39.107 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.104+0000 7f31a374d640 1 --2- 172.21.15.115:0/2254306644 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f319c105bf0 0x7f319c105fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:39.108 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.104+0000 7f31a374d640 1 -- 172.21.15.115:0/2254306644 >> 172.21.15.115:0/2254306644 conn(0x7f319c0fb840 msgr2=0x7f319c0fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:39.108 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.104+0000 7f31a374d640 1 -- 172.21.15.115:0/2254306644 shutdown_connections 2024-09-13T17:12:39.108 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.104+0000 7f31a374d640 1 -- 172.21.15.115:0/2254306644 wait complete. 2024-09-13T17:12:39.108 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.105+0000 7f31a374d640 1 Processor -- start 2024-09-13T17:12:39.108 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.105+0000 7f31a374d640 1 -- start start 2024-09-13T17:12:39.108 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.105+0000 7f31a374d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f319c0ffb40 0x7f319c19b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:39.108 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.105+0000 7f31a374d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f319c105bf0 0x7f319c19bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:39.108 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.105+0000 7f31a374d640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f319c1957b0 con 0x7f319c105bf0 2024-09-13T17:12:39.108 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.105+0000 7f31a374d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f319c195920 con 0x7f319c0ffb40 2024-09-13T17:12:39.108 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.105+0000 7f31a0ce8640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f319c105bf0 0x7f319c19bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:39.108 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.105+0000 7f31a0ce8640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f319c105bf0 0x7f319c19bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52962/0 (socket says 172.21.15.115:52962) 2024-09-13T17:12:39.108 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.105+0000 7f31a0ce8640 1 -- 172.21.15.115:0/4162347224 learned_addr learned my addr 172.21.15.115:0/4162347224 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:12:39.108 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.105+0000 7f31a14e9640 1 --2- 172.21.15.115:0/4162347224 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f319c0ffb40 0x7f319c19b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:39.109 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.105+0000 7f31a0ce8640 1 -- 172.21.15.115:0/4162347224 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f319c0ffb40 msgr2=0x7f319c19b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:39.109 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.105+0000 7f31a0ce8640 1 --2- 172.21.15.115:0/4162347224 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f319c0ffb40 0x7f319c19b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:39.109 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.105+0000 7f31a0ce8640 1 -- 172.21.15.115:0/4162347224 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f318c009560 con 0x7f319c105bf0 2024-09-13T17:12:39.109 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.105+0000 7f31a0ce8640 1 --2- 172.21.15.115:0/4162347224 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f319c105bf0 0x7f319c19bc00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f318c02a9c0 tx=0x7f318c0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:39.109 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.106+0000 7f31927fc640 1 -- 172.21.15.115:0/4162347224 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f318c004b60 con 0x7f319c105bf0 2024-09-13T17:12:39.109 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.106+0000 7f31927fc640 1 -- 172.21.15.115:0/4162347224 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f318c004cc0 con 0x7f319c105bf0 2024-09-13T17:12:39.109 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.106+0000 7f31a374d640 1 -- 172.21.15.115:0/4162347224 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f319c195ba0 con 0x7f319c105bf0 2024-09-13T17:12:39.109 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.106+0000 7f31927fc640 1 -- 172.21.15.115:0/4162347224 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f318c031950 con 0x7f319c105bf0 2024-09-13T17:12:39.109 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.106+0000 7f31a374d640 1 -- 172.21.15.115:0/4162347224 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f319c196110 con 0x7f319c105bf0 2024-09-13T17:12:39.110 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.107+0000 7f31a374d640 1 -- 172.21.15.115:0/4162347224 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f319c1011f0 con 0x7f319c105bf0 2024-09-13T17:12:39.110 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.107+0000 7f31927fc640 1 -- 172.21.15.115:0/4162347224 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f318c003c20 con 0x7f319c105bf0 2024-09-13T17:12:39.110 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.108+0000 7f31927fc640 1 --2- 172.21.15.115:0/4162347224 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f318806cc50 0x7f318806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:39.111 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.108+0000 7f31927fc640 1 -- 172.21.15.115:0/4162347224 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f318c0ad580 con 0x7f319c105bf0 2024-09-13T17:12:39.111 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.108+0000 7f31a14e9640 1 --2- 172.21.15.115:0/4162347224 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f318806cc50 0x7f318806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:39.111 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.108+0000 7f31a14e9640 1 --2- 172.21.15.115:0/4162347224 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f318806cc50 0x7f318806f110 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3198005fd0 tx=0x7f319800b390 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:39.113 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.112+0000 7f31927fc640 1 -- 172.21.15.115:0/4162347224 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f318c077750 con 0x7f319c105bf0 2024-09-13T17:12:39.293 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.291+0000 7f31a374d640 1 -- 172.21.15.115:0/4162347224 --> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f319c196cc0 con 0x7f318806cc50 2024-09-13T17:12:39.294 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.293+0000 7f31927fc640 1 -- 172.21.15.115:0/4162347224 <== mgr.14660 v2:172.21.15.115:6800/1049502673 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f319c196cc0 con 0x7f318806cc50 2024-09-13T17:12:39.294 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-13T17:12:39.294 INFO:teuthology.orchestra.run.smithi115.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256", 2024-09-13T17:12:39.295 INFO:teuthology.orchestra.run.smithi115.stdout: "in_progress": true, 2024-09-13T17:12:39.295 INFO:teuthology.orchestra.run.smithi115.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T17:12:39.295 INFO:teuthology.orchestra.run.smithi115.stdout: "services_complete": [ 2024-09-13T17:12:39.295 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr", 2024-09-13T17:12:39.295 INFO:teuthology.orchestra.run.smithi115.stdout: "mon", 2024-09-13T17:12:39.295 INFO:teuthology.orchestra.run.smithi115.stdout: "crash" 2024-09-13T17:12:39.295 INFO:teuthology.orchestra.run.smithi115.stdout: ], 2024-09-13T17:12:39.295 INFO:teuthology.orchestra.run.smithi115.stdout: "progress": "11/23 daemons upgraded", 2024-09-13T17:12:39.295 INFO:teuthology.orchestra.run.smithi115.stdout: "message": "Currently upgrading osd daemons", 2024-09-13T17:12:39.295 INFO:teuthology.orchestra.run.smithi115.stdout: "is_paused": false 2024-09-13T17:12:39.295 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-13T17:12:39.297 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.295+0000 7f31a374d640 1 -- 172.21.15.115:0/4162347224 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f318806cc50 msgr2=0x7f318806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:39.297 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.295+0000 7f31a374d640 1 --2- 172.21.15.115:0/4162347224 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f318806cc50 0x7f318806f110 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3198005fd0 tx=0x7f319800b390 comp rx=0 tx=0).stop 2024-09-13T17:12:39.297 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.295+0000 7f31a374d640 1 -- 172.21.15.115:0/4162347224 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f319c105bf0 msgr2=0x7f319c19bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:39.297 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.295+0000 7f31a374d640 1 --2- 172.21.15.115:0/4162347224 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f319c105bf0 0x7f319c19bc00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f318c02a9c0 tx=0x7f318c0055a0 comp rx=0 tx=0).stop 2024-09-13T17:12:39.297 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.295+0000 7f31a374d640 1 -- 172.21.15.115:0/4162347224 shutdown_connections 2024-09-13T17:12:39.297 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.295+0000 7f31a374d640 1 --2- 172.21.15.115:0/4162347224 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f318806cc50 0x7f318806f110 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:39.297 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.295+0000 7f31a374d640 1 --2- 172.21.15.115:0/4162347224 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f319c105bf0 0x7f319c19bc00 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:39.297 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.295+0000 7f31a374d640 1 --2- 172.21.15.115:0/4162347224 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f319c0ffb40 0x7f319c19b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:39.297 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.295+0000 7f31a374d640 1 -- 172.21.15.115:0/4162347224 >> 172.21.15.115:0/4162347224 conn(0x7f319c0fb840 msgr2=0x7f319c0fd960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:39.297 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.295+0000 7f31a374d640 1 -- 172.21.15.115:0/4162347224 shutdown_connections 2024-09-13T17:12:39.297 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.295+0000 7f31a374d640 1 -- 172.21.15.115:0/4162347224 wait complete. 2024-09-13T17:12:39.380 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.375+0000 7fc7ae59c640 1 -- 172.21.15.115:0/36687409 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7a80fea20 msgr2=0x7fc7a80fee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:39.380 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.375+0000 7fc7ae59c640 1 --2- 172.21.15.115:0/36687409 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7a80fea20 0x7fc7a80fee80 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc79c009880 tx=0x7fc79c02a4a0 comp rx=0 tx=0).stop 2024-09-13T17:12:39.380 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.375+0000 7fc7ae59c640 1 -- 172.21.15.115:0/36687409 shutdown_connections 2024-09-13T17:12:39.381 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.375+0000 7fc7ae59c640 1 --2- 172.21.15.115:0/36687409 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7a80fea20 0x7fc7a80fee80 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:39.381 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.375+0000 7fc7ae59c640 1 --2- 172.21.15.115:0/36687409 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc7a8104a20 0x7fc7a8104e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:39.381 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.375+0000 7fc7ae59c640 1 -- 172.21.15.115:0/36687409 >> 172.21.15.115:0/36687409 conn(0x7fc7a80fa720 msgr2=0x7fc7a80fcb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:39.381 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.375+0000 7fc7ae59c640 1 -- 172.21.15.115:0/36687409 shutdown_connections 2024-09-13T17:12:39.381 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.375+0000 7fc7ae59c640 1 -- 172.21.15.115:0/36687409 wait complete. 2024-09-13T17:12:39.382 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.376+0000 7fc7ae59c640 1 Processor -- start 2024-09-13T17:12:39.382 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.376+0000 7fc7ae59c640 1 -- start start 2024-09-13T17:12:39.382 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.376+0000 7fc7ae59c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7a80fea20 0x7fc7a8196850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:39.382 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.376+0000 7fc7ae59c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc7a8104a20 0x7fc7a8196d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:39.382 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.376+0000 7fc7ae59c640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a8197360 con 0x7fc7a80fea20 2024-09-13T17:12:39.383 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.376+0000 7fc7ae59c640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a81974d0 con 0x7fc7a8104a20 2024-09-13T17:12:39.383 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.377+0000 7fc7a7fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7a80fea20 0x7fc7a8196850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:39.383 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.377+0000 7fc7a7fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7a80fea20 0x7fc7a8196850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52986/0 (socket says 172.21.15.115:52986) 2024-09-13T17:12:39.383 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.377+0000 7fc7a7fff640 1 -- 172.21.15.115:0/2118997965 learned_addr learned my addr 172.21.15.115:0/2118997965 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:12:39.383 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.377+0000 7fc7a77fe640 1 --2- 172.21.15.115:0/2118997965 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc7a8104a20 0x7fc7a8196d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:39.383 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.377+0000 7fc7a7fff640 1 -- 172.21.15.115:0/2118997965 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc7a8104a20 msgr2=0x7fc7a8196d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:39.384 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.377+0000 7fc7a7fff640 1 --2- 172.21.15.115:0/2118997965 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc7a8104a20 0x7fc7a8196d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:39.384 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.377+0000 7fc7a7fff640 1 -- 172.21.15.115:0/2118997965 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc79c009560 con 0x7fc7a80fea20 2024-09-13T17:12:39.384 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.377+0000 7fc7a7fff640 1 --2- 172.21.15.115:0/2118997965 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7a80fea20 0x7fc7a8196850 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc79800d6f0 tx=0x7fc79800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:39.384 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.377+0000 7fc7a57fa640 1 -- 172.21.15.115:0/2118997965 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc798009a30 con 0x7fc7a80fea20 2024-09-13T17:12:39.384 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.377+0000 7fc7a57fa640 1 -- 172.21.15.115:0/2118997965 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc7980054c0 con 0x7fc7a80fea20 2024-09-13T17:12:39.384 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.377+0000 7fc7a57fa640 1 -- 172.21.15.115:0/2118997965 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc798004db0 con 0x7fc7a80fea20 2024-09-13T17:12:39.385 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.377+0000 7fc7ae59c640 1 -- 172.21.15.115:0/2118997965 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7a819f8c0 con 0x7fc7a80fea20 2024-09-13T17:12:39.385 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.377+0000 7fc7ae59c640 1 -- 172.21.15.115:0/2118997965 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7a819fcd0 con 0x7fc7a80fea20 2024-09-13T17:12:39.385 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.378+0000 7fc7ae59c640 1 -- 172.21.15.115:0/2118997965 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7a8100160 con 0x7fc7a80fea20 2024-09-13T17:12:39.385 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.379+0000 7fc7a57fa640 1 -- 172.21.15.115:0/2118997965 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fc798004f30 con 0x7fc7a80fea20 2024-09-13T17:12:39.387 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.379+0000 7fc7a57fa640 1 --2- 172.21.15.115:0/2118997965 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fc79006cbf0 0x7fc79006f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:39.387 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.379+0000 7fc7a57fa640 1 -- 172.21.15.115:0/2118997965 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fc79808bf60 con 0x7fc7a80fea20 2024-09-13T17:12:39.387 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.379+0000 7fc7a77fe640 1 --2- 172.21.15.115:0/2118997965 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fc79006cbf0 0x7fc79006f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:39.387 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.380+0000 7fc7a77fe640 1 --2- 172.21.15.115:0/2118997965 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fc79006cbf0 0x7fc79006f0b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc79c000c00 tx=0x7fc79c0058d0 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:39.387 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.384+0000 7fc7a57fa640 1 -- 172.21.15.115:0/2118997965 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc7980bfe20 con 0x7fc7a80fea20 2024-09-13T17:12:39.607 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.606+0000 7fc7ae59c640 1 -- 172.21.15.115:0/2118997965 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fc7a8068a90 con 0x7fc7a80fea20 2024-09-13T17:12:39.607 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.606+0000 7fc7a57fa640 1 -- 172.21.15.115:0/2118997965 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1151 (secure 0 0 0) 0x7fc798017490 con 0x7fc7a80fea20 2024-09-13T17:12:39.607 INFO:teuthology.orchestra.run.smithi115.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; Degraded data redundancy: 36/222 objects degraded (16.216%), 14 pgs degraded 2024-09-13T17:12:39.608 INFO:teuthology.orchestra.run.smithi115.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T17:12:39.608 INFO:teuthology.orchestra.run.smithi115.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T17:12:39.608 INFO:teuthology.orchestra.run.smithi115.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 36/222 objects degraded (16.216%), 14 pgs degraded 2024-09-13T17:12:39.608 INFO:teuthology.orchestra.run.smithi115.stdout: pg 2.4 is active+undersized+degraded, acting [1,0] 2024-09-13T17:12:39.608 INFO:teuthology.orchestra.run.smithi115.stdout: pg 2.5 is active+undersized+degraded, acting [3,0] 2024-09-13T17:12:39.608 INFO:teuthology.orchestra.run.smithi115.stdout: pg 2.6 is active+undersized+degraded, acting [1,3] 2024-09-13T17:12:39.608 INFO:teuthology.orchestra.run.smithi115.stdout: pg 2.7 is active+undersized+degraded, acting [3,2] 2024-09-13T17:12:39.608 INFO:teuthology.orchestra.run.smithi115.stdout: pg 2.9 is active+undersized+degraded, acting [1,0] 2024-09-13T17:12:39.608 INFO:teuthology.orchestra.run.smithi115.stdout: pg 2.a is active+undersized+degraded, acting [1,3] 2024-09-13T17:12:39.608 INFO:teuthology.orchestra.run.smithi115.stdout: pg 2.b is active+undersized+degraded, acting [3,5] 2024-09-13T17:12:39.609 INFO:teuthology.orchestra.run.smithi115.stdout: pg 2.f is active+undersized+degraded, acting [0,5] 2024-09-13T17:12:39.609 INFO:teuthology.orchestra.run.smithi115.stdout: pg 2.13 is active+undersized+degraded, acting [0,2] 2024-09-13T17:12:39.609 INFO:teuthology.orchestra.run.smithi115.stdout: pg 2.14 is active+undersized+degraded, acting [3,5] 2024-09-13T17:12:39.609 INFO:teuthology.orchestra.run.smithi115.stdout: pg 2.18 is active+undersized+degraded, acting [5,3] 2024-09-13T17:12:39.609 INFO:teuthology.orchestra.run.smithi115.stdout: pg 2.1a is active+undersized+degraded, acting [3,5] 2024-09-13T17:12:39.609 INFO:teuthology.orchestra.run.smithi115.stdout: pg 2.1c is active+undersized+degraded, acting [5,2] 2024-09-13T17:12:39.609 INFO:teuthology.orchestra.run.smithi115.stdout: pg 2.1f is active+undersized+degraded, acting [0,3] 2024-09-13T17:12:39.610 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.608+0000 7fc7ae59c640 1 -- 172.21.15.115:0/2118997965 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fc79006cbf0 msgr2=0x7fc79006f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:39.610 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.608+0000 7fc7ae59c640 1 --2- 172.21.15.115:0/2118997965 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fc79006cbf0 0x7fc79006f0b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc79c000c00 tx=0x7fc79c0058d0 comp rx=0 tx=0).stop 2024-09-13T17:12:39.610 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.608+0000 7fc7ae59c640 1 -- 172.21.15.115:0/2118997965 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7a80fea20 msgr2=0x7fc7a8196850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:39.610 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.608+0000 7fc7ae59c640 1 --2- 172.21.15.115:0/2118997965 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7a80fea20 0x7fc7a8196850 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc79800d6f0 tx=0x7fc79800dbb0 comp rx=0 tx=0).stop 2024-09-13T17:12:39.610 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.608+0000 7fc7ae59c640 1 -- 172.21.15.115:0/2118997965 shutdown_connections 2024-09-13T17:12:39.610 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.608+0000 7fc7ae59c640 1 --2- 172.21.15.115:0/2118997965 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fc79006cbf0 0x7fc79006f0b0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:39.610 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.608+0000 7fc7ae59c640 1 --2- 172.21.15.115:0/2118997965 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc7a8104a20 0x7fc7a8196d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:39.610 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.608+0000 7fc7ae59c640 1 --2- 172.21.15.115:0/2118997965 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7a80fea20 0x7fc7a8196850 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:39.611 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.608+0000 7fc7ae59c640 1 -- 172.21.15.115:0/2118997965 >> 172.21.15.115:0/2118997965 conn(0x7fc7a80fa720 msgr2=0x7fc7a80fb530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:39.611 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.608+0000 7fc7ae59c640 1 -- 172.21.15.115:0/2118997965 shutdown_connections 2024-09-13T17:12:39.611 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:12:39.608+0000 7fc7ae59c640 1 -- 172.21.15.115:0/2118997965 wait complete. 2024-09-13T17:12:39.928 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:39 smithi115 ceph-mon[109488]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:12:39.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:39 smithi115 ceph-mon[109488]: from='client.34264 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:12:39.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:39 smithi115 ceph-mon[109488]: from='client.? 172.21.15.115:0/3086446584' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:12:39.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:39 smithi115 ceph-mon[109488]: Health check update: Degraded data redundancy: 36/222 objects degraded (16.216%), 14 pgs degraded (PG_DEGRADED) 2024-09-13T17:12:39.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:39 smithi115 ceph-mon[109488]: from='client.? 172.21.15.115:0/3985632523' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T17:12:39.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:39 smithi115 ceph-mon[109488]: from='client.? 172.21.15.115:0/2118997965' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T17:12:40.051 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:39 smithi195 ceph-mon[80021]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:12:40.052 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:39 smithi195 ceph-mon[80021]: from='client.34264 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:12:40.052 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:39 smithi195 ceph-mon[80021]: from='client.? 172.21.15.115:0/3086446584' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:12:40.052 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:39 smithi195 ceph-mon[80021]: Health check update: Degraded data redundancy: 36/222 objects degraded (16.216%), 14 pgs degraded (PG_DEGRADED) 2024-09-13T17:12:40.052 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:39 smithi195 ceph-mon[80021]: from='client.? 172.21.15.115:0/3985632523' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T17:12:40.052 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:39 smithi195 ceph-mon[80021]: from='client.? 172.21.15.115:0/2118997965' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T17:12:40.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:40 smithi195 ceph-mon[80021]: from='client.34276 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:12:40.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:40 smithi195 ceph-mon[80021]: pgmap v210: 65 pgs: 7 peering, 13 active+undersized, 8 active+undersized+degraded, 37 active+clean; 199 MiB data, 879 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 24/222 objects degraded (10.811%) 2024-09-13T17:12:40.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:40 smithi115 ceph-mon[109488]: from='client.34276 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:12:40.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:40 smithi115 ceph-mon[109488]: pgmap v210: 65 pgs: 7 peering, 13 active+undersized, 8 active+undersized+degraded, 37 active+clean; 199 MiB data, 879 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 24/222 objects degraded (10.811%) 2024-09-13T17:12:42.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:42 smithi115 ceph-mon[109488]: pgmap v211: 65 pgs: 7 peering, 8 active+undersized, 3 active+undersized+degraded, 47 active+clean; 199 MiB data, 879 MiB used, 536 GiB / 536 GiB avail; 511 B/s rd, 1 op/s; 6/222 objects degraded (2.703%) 2024-09-13T17:12:43.076 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:42 smithi195 ceph-mon[80021]: pgmap v211: 65 pgs: 7 peering, 8 active+undersized, 3 active+undersized+degraded, 47 active+clean; 199 MiB data, 879 MiB used, 536 GiB / 536 GiB avail; 511 B/s rd, 1 op/s; 6/222 objects degraded (2.703%) 2024-09-13T17:12:43.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:43 smithi115 ceph-mon[109488]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/222 objects degraded (2.703%), 3 pgs degraded) 2024-09-13T17:12:44.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:43 smithi195 ceph-mon[80021]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/222 objects degraded (2.703%), 3 pgs degraded) 2024-09-13T17:12:44.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:44 smithi115 ceph-mon[109488]: pgmap v212: 65 pgs: 65 active+clean; 199 MiB data, 880 MiB used, 536 GiB / 536 GiB avail; 448 B/s rd, 1 op/s 2024-09-13T17:12:45.076 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:44 smithi195 ceph-mon[80021]: pgmap v212: 65 pgs: 65 active+clean; 199 MiB data, 880 MiB used, 536 GiB / 536 GiB avail; 448 B/s rd, 1 op/s 2024-09-13T17:12:47.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:46 smithi195 ceph-mon[80021]: pgmap v213: 65 pgs: 65 active+clean; 199 MiB data, 880 MiB used, 536 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-13T17:12:47.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:46 smithi115 ceph-mon[109488]: pgmap v213: 65 pgs: 65 active+clean; 199 MiB data, 880 MiB used, 536 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-13T17:12:48.928 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:48 smithi115 ceph-mon[109488]: pgmap v214: 65 pgs: 65 active+clean; 199 MiB data, 880 MiB used, 536 GiB / 536 GiB avail; 832 B/s rd, 1 op/s 2024-09-13T17:12:49.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:48 smithi195 ceph-mon[80021]: pgmap v214: 65 pgs: 65 active+clean; 199 MiB data, 880 MiB used, 536 GiB / 536 GiB avail; 832 B/s rd, 1 op/s 2024-09-13T17:12:51.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:50 smithi195 ceph-mon[80021]: pgmap v215: 65 pgs: 65 active+clean; 199 MiB data, 880 MiB used, 536 GiB / 536 GiB avail; 755 B/s rd, 1 op/s 2024-09-13T17:12:51.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:50 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:12:51.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:50 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:12:51.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:50 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:12:51.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:50 smithi115 ceph-mon[109488]: pgmap v215: 65 pgs: 65 active+clean; 199 MiB data, 880 MiB used, 536 GiB / 536 GiB avail; 755 B/s rd, 1 op/s 2024-09-13T17:12:51.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:50 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:12:51.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:50 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:12:51.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:50 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:12:52.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:52 smithi195 ceph-mon[80021]: pgmap v216: 65 pgs: 65 active+clean; 199 MiB data, 880 MiB used, 536 GiB / 536 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-13T17:12:52.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:52 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-13T17:12:52.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:52 smithi195 ceph-mon[80021]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-13T17:12:52.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:52 smithi195 ceph-mon[80021]: Upgrade: osd.5 is safe to restart 2024-09-13T17:12:53.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:52 smithi115 ceph-mon[109488]: pgmap v216: 65 pgs: 65 active+clean; 199 MiB data, 880 MiB used, 536 GiB / 536 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-13T17:12:53.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:52 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-13T17:12:53.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:52 smithi115 ceph-mon[109488]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-13T17:12:53.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:52 smithi115 ceph-mon[109488]: Upgrade: osd.5 is safe to restart 2024-09-13T17:12:54.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:54 smithi195 ceph-mon[80021]: Upgrade: Updating osd.5 2024-09-13T17:12:54.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:54 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:12:54.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:54 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-13T17:12:54.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:54 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:12:54.578 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:54 smithi195 ceph-mon[80021]: Deploying daemon osd.5 on smithi195 2024-09-13T17:12:54.578 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:54 smithi195 ceph-mon[80021]: pgmap v217: 65 pgs: 65 active+clean; 199 MiB data, 880 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:12:54.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:54 smithi115 ceph-mon[109488]: Upgrade: Updating osd.5 2024-09-13T17:12:54.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:54 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:12:54.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:54 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-13T17:12:54.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:54 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:12:54.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:54 smithi115 ceph-mon[109488]: Deploying daemon osd.5 on smithi195 2024-09-13T17:12:54.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:54 smithi115 ceph-mon[109488]: pgmap v217: 65 pgs: 65 active+clean; 199 MiB data, 880 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:12:56.294 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:12:56 smithi195 systemd[1]: Stopping Ceph osd.5 for ffbd7588-71f0-11ef-bceb-c7b262605968... 2024-09-13T17:12:56.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:56 smithi195 ceph-mon[80021]: pgmap v218: 65 pgs: 65 active+clean; 199 MiB data, 880 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:12:56.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:56 smithi195 ceph-mon[80021]: osd.5 marked itself down and dead 2024-09-13T17:12:56.577 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:12:56 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-5[54144]: 2024-09-13T17:12:56.292+0000 7f3afcb59640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T17:12:56.577 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:12:56 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-5[54144]: 2024-09-13T17:12:56.292+0000 7f3afcb59640 -1 osd.5 73 *** Got signal Terminated *** 2024-09-13T17:12:56.577 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:12:56 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-5[54144]: 2024-09-13T17:12:56.292+0000 7f3afcb59640 -1 osd.5 73 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T17:12:56.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:56 smithi115 ceph-mon[109488]: pgmap v218: 65 pgs: 65 active+clean; 199 MiB data, 880 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:12:56.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:56 smithi115 ceph-mon[109488]: osd.5 marked itself down and dead 2024-09-13T17:12:57.186 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:12:56 smithi195 podman[98246]: 2024-09-13 17:12:56.884574396 +0000 UTC m=+0.698805446 container died 4bd1b3a232d0d79040cba231b87aee3c08838e6fbc3fc96cd23ea1cdd122f276 (image=quay.ceph.io/ceph-ci/ceph@sha256:c37c250ffe653639d7a4124ac8acdc3c8f6a53cb4ef1f26b1d2df36648631a11, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-5, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=reef-2c01458, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-13T17:12:57.519 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:12:57 smithi195 podman[98246]: 2024-09-13 17:12:57.292555747 +0000 UTC m=+1.106786801 container cleanup 4bd1b3a232d0d79040cba231b87aee3c08838e6fbc3fc96cd23ea1cdd122f276 (image=quay.ceph.io/ceph-ci/ceph@sha256:c37c250ffe653639d7a4124ac8acdc3c8f6a53cb4ef1f26b1d2df36648631a11, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-5, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=reef-2c01458, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-13T17:12:57.520 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:12:57 smithi195 bash[98246]: ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-5 2024-09-13T17:12:57.826 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:12:57 smithi195 podman[98263]: 2024-09-13 17:12:57.51882617 +0000 UTC m=+0.629847692 container remove 4bd1b3a232d0d79040cba231b87aee3c08838e6fbc3fc96cd23ea1cdd122f276 (image=quay.ceph.io/ceph-ci/ceph@sha256:c37c250ffe653639d7a4124ac8acdc3c8f6a53cb4ef1f26b1d2df36648631a11, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=reef-2c01458, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T17:12:57.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:57 smithi195 ceph-mon[80021]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T17:12:57.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:57 smithi195 ceph-mon[80021]: osdmap e74: 6 total, 5 up, 6 in 2024-09-13T17:12:57.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:57 smithi195 ceph-mon[80021]: osdmap e75: 6 total, 5 up, 6 in 2024-09-13T17:12:57.928 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:57 smithi115 ceph-mon[109488]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T17:12:57.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:57 smithi115 ceph-mon[109488]: osdmap e74: 6 total, 5 up, 6 in 2024-09-13T17:12:57.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:57 smithi115 ceph-mon[109488]: osdmap e75: 6 total, 5 up, 6 in 2024-09-13T17:12:58.172 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:12:57 smithi195 podman[98350]: 2024-09-13 17:12:57.852916184 +0000 UTC m=+0.111363975 container create e94705581f29af52a948fd00f97b35f28d87d56c3974425664708534f16a18b2 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-13T17:12:58.173 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:12:57 smithi195 podman[98350]: 2024-09-13 17:12:57.757616817 +0000 UTC m=+0.016064616 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T17:12:58.173 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:12:58 smithi195 podman[98350]: 2024-09-13 17:12:58.07201608 +0000 UTC m=+0.330463882 container init e94705581f29af52a948fd00f97b35f28d87d56c3974425664708534f16a18b2 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0) 2024-09-13T17:12:58.173 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:12:58 smithi195 podman[98350]: 2024-09-13 17:12:58.075912499 +0000 UTC m=+0.334360297 container start e94705581f29af52a948fd00f97b35f28d87d56c3974425664708534f16a18b2 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-13T17:12:58.173 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:12:58 smithi195 podman[98350]: 2024-09-13 17:12:58.171892012 +0000 UTC m=+0.430339805 container attach e94705581f29af52a948fd00f97b35f28d87d56c3974425664708534f16a18b2 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-5-deactivate, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True) 2024-09-13T17:12:58.527 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:12:58 smithi195 podman[98350]: 2024-09-13 17:12:58.264952462 +0000 UTC m=+0.523400255 container died e94705581f29af52a948fd00f97b35f28d87d56c3974425664708534f16a18b2 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.build-date=20240731) 2024-09-13T17:12:58.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:58 smithi195 ceph-mon[80021]: pgmap v220: 65 pgs: 12 peering, 6 stale+active+clean, 47 active+clean; 199 MiB data, 880 MiB used, 536 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-13T17:12:58.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:58 smithi195 ceph-mon[80021]: Health check failed: Reduced data availability: 7 pgs peering (PG_AVAILABILITY) 2024-09-13T17:12:58.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:58 smithi115 ceph-mon[109488]: pgmap v220: 65 pgs: 12 peering, 6 stale+active+clean, 47 active+clean; 199 MiB data, 880 MiB used, 536 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-13T17:12:58.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:58 smithi115 ceph-mon[109488]: Health check failed: Reduced data availability: 7 pgs peering (PG_AVAILABILITY) 2024-09-13T17:12:59.077 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:12:58 smithi195 podman[98374]: 2024-09-13 17:12:58.825498121 +0000 UTC m=+0.554387710 container remove e94705581f29af52a948fd00f97b35f28d87d56c3974425664708534f16a18b2 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-13T17:12:59.077 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:12:58 smithi195 systemd[1]: ceph-ffbd7588-71f0-11ef-bceb-c7b262605968@osd.5.service: Deactivated successfully. 2024-09-13T17:12:59.077 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:12:58 smithi195 systemd[1]: Stopped Ceph osd.5 for ffbd7588-71f0-11ef-bceb-c7b262605968. 2024-09-13T17:12:59.077 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:12:58 smithi195 systemd[1]: ceph-ffbd7588-71f0-11ef-bceb-c7b262605968@osd.5.service: Consumed 1min 2.380s CPU time. 2024-09-13T17:12:59.077 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:12:59 smithi195 systemd[1]: Starting Ceph osd.5 for ffbd7588-71f0-11ef-bceb-c7b262605968... 2024-09-13T17:12:59.571 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:12:59 smithi195 podman[98472]: 2024-09-13 17:12:59.163276636 +0000 UTC m=+0.016196620 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T17:12:59.571 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:12:59 smithi195 podman[98472]: 2024-09-13 17:12:59.284722931 +0000 UTC m=+0.137642902 container create 9875eaba333cc220e5a2a4cc3ec64a04a36a451999c80f079ef492be86c895d8 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-5-activate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-13T17:12:59.571 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:12:59 smithi195 podman[98472]: 2024-09-13 17:12:59.495420904 +0000 UTC m=+0.348340884 container init 9875eaba333cc220e5a2a4cc3ec64a04a36a451999c80f079ef492be86c895d8 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-5-activate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-13T17:12:59.571 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:12:59 smithi195 podman[98472]: 2024-09-13 17:12:59.498767252 +0000 UTC m=+0.351687223 container start 9875eaba333cc220e5a2a4cc3ec64a04a36a451999c80f079ef492be86c895d8 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-5-activate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-13T17:12:59.571 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:12:59 smithi195 podman[98472]: 2024-09-13 17:12:59.570273505 +0000 UTC m=+0.423193483 container attach 9875eaba333cc220e5a2a4cc3ec64a04a36a451999c80f079ef492be86c895d8 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-5-activate, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-13T17:12:59.821 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:12:59 smithi195 ceph-mon[80021]: Health check failed: Degraded data redundancy: 2/222 objects degraded (0.901%), 2 pgs degraded (PG_DEGRADED) 2024-09-13T17:12:59.822 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:12:59 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-5-activate[98487]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-13T17:12:59.822 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:12:59 smithi195 bash[98472]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-13T17:12:59.822 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:12:59 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-5-activate[98487]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-13T17:12:59.822 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:12:59 smithi195 bash[98472]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-13T17:12:59.822 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:12:59 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-5-activate[98487]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-13T17:12:59.822 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:12:59 smithi195 bash[98472]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-13T17:12:59.822 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:12:59 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-5-activate[98487]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-13T17:12:59.822 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:12:59 smithi195 bash[98472]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-13T17:12:59.822 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:12:59 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-5-activate[98487]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-09-13T17:12:59.822 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:12:59 smithi195 bash[98472]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-09-13T17:12:59.928 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:12:59 smithi115 ceph-mon[109488]: Health check failed: Degraded data redundancy: 2/222 objects degraded (0.901%), 2 pgs degraded (PG_DEGRADED) 2024-09-13T17:13:00.077 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:12:59 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-5-activate[98487]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-13T17:13:00.077 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:12:59 smithi195 bash[98472]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-13T17:13:00.077 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:12:59 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-5-activate[98487]: --> ceph-volume raw activate successful for osd ID: 5 2024-09-13T17:13:00.077 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:12:59 smithi195 bash[98472]: --> ceph-volume raw activate successful for osd ID: 5 2024-09-13T17:13:00.077 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:12:59 smithi195 podman[98472]: 2024-09-13 17:12:59.843674694 +0000 UTC m=+0.696594668 container died 9875eaba333cc220e5a2a4cc3ec64a04a36a451999c80f079ef492be86c895d8 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-5-activate, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T17:13:00.759 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:00 smithi195 ceph-mon[80021]: pgmap v222: 65 pgs: 4 active+undersized, 12 peering, 3 stale+active+clean, 2 active+undersized+degraded, 44 active+clean; 199 MiB data, 880 MiB used, 536 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 2/222 objects degraded (0.901%) 2024-09-13T17:13:00.759 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:13:00 smithi195 podman[98603]: 2024-09-13 17:13:00.415935998 +0000 UTC m=+0.566055529 container remove 9875eaba333cc220e5a2a4cc3ec64a04a36a451999c80f079ef492be86c895d8 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-5-activate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T17:13:00.760 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:13:00 smithi195 podman[98661]: 2024-09-13 17:13:00.523513303 +0000 UTC m=+0.015931395 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T17:13:00.760 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:13:00 smithi195 podman[98661]: 2024-09-13 17:13:00.650086406 +0000 UTC m=+0.142504498 container create 40ccbc2f51950351d6c1dca790fd052acf49fa6d84bf6db2136846872ce6b995 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-5, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T17:13:00.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:00 smithi115 ceph-mon[109488]: pgmap v222: 65 pgs: 4 active+undersized, 12 peering, 3 stale+active+clean, 2 active+undersized+degraded, 44 active+clean; 199 MiB data, 880 MiB used, 536 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 2/222 objects degraded (0.901%) 2024-09-13T17:13:01.077 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:13:00 smithi195 podman[98661]: 2024-09-13 17:13:00.894224437 +0000 UTC m=+0.386642529 container init 40ccbc2f51950351d6c1dca790fd052acf49fa6d84bf6db2136846872ce6b995 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-5, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-13T17:13:01.077 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:13:00 smithi195 podman[98661]: 2024-09-13 17:13:00.897643877 +0000 UTC m=+0.390061969 container start 40ccbc2f51950351d6c1dca790fd052acf49fa6d84bf6db2136846872ce6b995 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-5, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083) 2024-09-13T17:13:01.077 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:13:00 smithi195 ceph-osd[98680]: -- 172.21.15.195:0/3519708554 <== mon.1 v2:172.21.15.195:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x560fcfa011e0 con 0x560fcf99fc00 2024-09-13T17:13:01.077 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:13:00 smithi195 bash[98661]: 40ccbc2f51950351d6c1dca790fd052acf49fa6d84bf6db2136846872ce6b995 2024-09-13T17:13:01.077 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:13:00 smithi195 systemd[1]: Started Ceph osd.5 for ffbd7588-71f0-11ef-bceb-c7b262605968. 2024-09-13T17:13:01.781 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:13:01 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-5[98676]: 2024-09-13T17:13:01.432+0000 7f0f59816640 -1 Falling back to public interface 2024-09-13T17:13:02.326 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:02 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:13:02.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:02 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:13:02.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:02 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:13:02.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:02 smithi195 ceph-mon[80021]: pgmap v223: 65 pgs: 9 active+undersized, 12 peering, 7 active+undersized+degraded, 37 active+clean; 199 MiB data, 880 MiB used, 536 GiB / 536 GiB avail; 895 B/s rd, 1 op/s; 20/222 objects degraded (9.009%) 2024-09-13T17:13:02.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:02 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:13:02.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:02 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:13:02.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:02 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:13:02.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:02 smithi115 ceph-mon[109488]: pgmap v223: 65 pgs: 9 active+undersized, 12 peering, 7 active+undersized+degraded, 37 active+clean; 199 MiB data, 880 MiB used, 536 GiB / 536 GiB avail; 895 B/s rd, 1 op/s; 20/222 objects degraded (9.009%) 2024-09-13T17:13:03.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:03 smithi195 ceph-mon[80021]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 7 pgs peering) 2024-09-13T17:13:03.854 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:03 smithi115 ceph-mon[109488]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 7 pgs peering) 2024-09-13T17:13:04.828 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:04 smithi195 ceph-mon[80021]: pgmap v224: 65 pgs: 16 active+undersized, 12 active+undersized+degraded, 37 active+clean; 199 MiB data, 880 MiB used, 536 GiB / 536 GiB avail; 255 B/s rd, 1 op/s; 30/222 objects degraded (13.514%) 2024-09-13T17:13:04.829 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:04 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:13:04.829 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:04 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:13:04.829 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:04 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:13:04.829 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:04 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:13:04.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:04 smithi115 ceph-mon[109488]: pgmap v224: 65 pgs: 16 active+undersized, 12 active+undersized+degraded, 37 active+clean; 199 MiB data, 880 MiB used, 536 GiB / 536 GiB avail; 255 B/s rd, 1 op/s; 30/222 objects degraded (13.514%) 2024-09-13T17:13:04.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:04 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:13:04.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:04 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:13:04.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:04 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:13:04.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:04 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:13:06.141 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:13:06 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-5[98676]: 2024-09-13T17:13:06.038+0000 7f0f59816640 -1 osd.5 73 log_to_monitors true 2024-09-13T17:13:06.858 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:13:06 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-5[98676]: 2024-09-13T17:13:06.648+0000 7f0f515af640 -1 osd.5 73 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T17:13:06.859 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:06 smithi195 ceph-mon[80021]: pgmap v225: 65 pgs: 16 active+undersized, 12 active+undersized+degraded, 37 active+clean; 199 MiB data, 880 MiB used, 536 GiB / 536 GiB avail; 801 B/s rd, 1 op/s; 30/222 objects degraded (13.514%) 2024-09-13T17:13:06.859 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:06 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:13:06.859 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:06 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:13:06.859 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:06 smithi195 ceph-mon[80021]: from='osd.5 [v2:172.21.15.195:6816/2051626892,v1:172.21.15.195:6817/2051626892]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T17:13:06.859 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:06 smithi195 ceph-mon[80021]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T17:13:06.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:06 smithi115 ceph-mon[109488]: pgmap v225: 65 pgs: 16 active+undersized, 12 active+undersized+degraded, 37 active+clean; 199 MiB data, 880 MiB used, 536 GiB / 536 GiB avail; 801 B/s rd, 1 op/s; 30/222 objects degraded (13.514%) 2024-09-13T17:13:06.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:06 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:13:06.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:06 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:13:06.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:06 smithi115 ceph-mon[109488]: from='osd.5 [v2:172.21.15.195:6816/2051626892,v1:172.21.15.195:6817/2051626892]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T17:13:06.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:06 smithi115 ceph-mon[109488]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T17:13:07.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:07 smithi115 ceph-mon[109488]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-13T17:13:07.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:07 smithi115 ceph-mon[109488]: osdmap e76: 6 total, 5 up, 6 in 2024-09-13T17:13:07.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:07 smithi115 ceph-mon[109488]: from='osd.5 [v2:172.21.15.195:6816/2051626892,v1:172.21.15.195:6817/2051626892]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-09-13T17:13:07.930 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:07 smithi115 ceph-mon[109488]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-09-13T17:13:07.930 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:07 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:13:07.930 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:07 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:13:07.930 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:07 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:13:07.930 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:07 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:13:07.930 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:07 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:13:07.930 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:07 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:13:07.930 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:07 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:13:07.930 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:07 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:13:07.930 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:07 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:13:07.930 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:07 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:13:07.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:07 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:13:07.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:07 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-09-13T17:13:07.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:07 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-13T17:13:07.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:07 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-09-13T17:13:07.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:07 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-13T17:13:07.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:07 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-09-13T17:13:07.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:07 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-13T17:13:07.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:07 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-09-13T17:13:07.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:07 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-13T17:13:07.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:07 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-09-13T17:13:07.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:07 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-13T17:13:07.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:07 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-09-13T17:13:07.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:07 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-13T17:13:07.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:07 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:13:07.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:07 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]: dispatch 2024-09-13T17:13:07.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:07 smithi115 ceph-mon[109488]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T17:13:07.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:07 smithi115 ceph-mon[109488]: osd.5 [v2:172.21.15.195:6816/2051626892,v1:172.21.15.195:6817/2051626892] boot 2024-09-13T17:13:07.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:07 smithi115 ceph-mon[109488]: osdmap e77: 6 total, 6 up, 6 in 2024-09-13T17:13:07.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:07 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T17:13:08.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:07 smithi195 ceph-mon[80021]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-13T17:13:08.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:07 smithi195 ceph-mon[80021]: osdmap e76: 6 total, 5 up, 6 in 2024-09-13T17:13:08.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:07 smithi195 ceph-mon[80021]: from='osd.5 [v2:172.21.15.195:6816/2051626892,v1:172.21.15.195:6817/2051626892]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-09-13T17:13:08.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:07 smithi195 ceph-mon[80021]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-09-13T17:13:08.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:07 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:13:08.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:07 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:13:08.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:07 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:13:08.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:07 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:13:08.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:07 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:13:08.079 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:07 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:13:08.079 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:07 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:13:08.079 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:07 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:13:08.079 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:07 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:13:08.079 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:07 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:13:08.079 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:07 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:13:08.079 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:07 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-09-13T17:13:08.079 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:07 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-13T17:13:08.079 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:07 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-09-13T17:13:08.079 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:07 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-13T17:13:08.079 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:07 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-09-13T17:13:08.079 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:07 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-13T17:13:08.079 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:07 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-09-13T17:13:08.080 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:07 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-13T17:13:08.080 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:07 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-09-13T17:13:08.080 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:07 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-13T17:13:08.080 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:07 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-09-13T17:13:08.080 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:07 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-13T17:13:08.080 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:07 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:13:08.080 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:07 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]: dispatch 2024-09-13T17:13:08.080 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:07 smithi195 ceph-mon[80021]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T17:13:08.080 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:07 smithi195 ceph-mon[80021]: osd.5 [v2:172.21.15.195:6816/2051626892,v1:172.21.15.195:6817/2051626892] boot 2024-09-13T17:13:08.080 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:07 smithi195 ceph-mon[80021]: osdmap e77: 6 total, 6 up, 6 in 2024-09-13T17:13:08.080 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:07 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T17:13:08.914 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:08 smithi115 ceph-mon[109488]: Upgrade: Setting container_image for all osd 2024-09-13T17:13:08.914 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:08 smithi115 ceph-mon[109488]: Upgrade: Disabling standby-replay for filesystem cephfs 2024-09-13T17:13:08.914 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:08 smithi115 ceph-mon[109488]: pgmap v228: 65 pgs: 16 active+undersized, 12 active+undersized+degraded, 37 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 895 B/s rd, 2 op/s; 30/222 objects degraded (13.514%) 2024-09-13T17:13:08.914 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:08 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]': finished 2024-09-13T17:13:08.915 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:08 smithi115 ceph-mon[109488]: fsmap cephfs:1 {0=cephfs.smithi115.ijznvr=up:active} 2 up:standby 2024-09-13T17:13:08.915 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:08 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:13:08.915 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:08 smithi115 ceph-mon[109488]: osdmap e78: 6 total, 6 up, 6 in 2024-09-13T17:13:08.915 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:08 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:13:08.915 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:08 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:13:08.915 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:08 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:13:08.915 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:08 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:13:08.915 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:08 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:13:08.915 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:08 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:13:08.915 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:08 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:13:08.915 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:08 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:13:09.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:08 smithi195 ceph-mon[80021]: Upgrade: Setting container_image for all osd 2024-09-13T17:13:09.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:08 smithi195 ceph-mon[80021]: Upgrade: Disabling standby-replay for filesystem cephfs 2024-09-13T17:13:09.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:08 smithi195 ceph-mon[80021]: pgmap v228: 65 pgs: 16 active+undersized, 12 active+undersized+degraded, 37 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 895 B/s rd, 2 op/s; 30/222 objects degraded (13.514%) 2024-09-13T17:13:09.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:08 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]': finished 2024-09-13T17:13:09.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:08 smithi195 ceph-mon[80021]: fsmap cephfs:1 {0=cephfs.smithi115.ijznvr=up:active} 2 up:standby 2024-09-13T17:13:09.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:08 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:13:09.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:08 smithi195 ceph-mon[80021]: osdmap e78: 6 total, 6 up, 6 in 2024-09-13T17:13:09.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:08 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:13:09.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:08 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:13:09.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:08 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:13:09.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:08 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:13:09.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:08 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:13:09.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:08 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:13:09.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:08 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:13:09.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:08 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:13:09.699 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:09.696+0000 7f29caab2640 1 -- 172.21.15.115:0/2845972724 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29c4100ce0 msgr2=0x7f29c41010c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:09.700 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:09.696+0000 7f29caab2640 1 --2- 172.21.15.115:0/2845972724 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29c4100ce0 0x7f29c41010c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f29b8009880 tx=0x7f29b802a530 comp rx=0 tx=0).stop 2024-09-13T17:13:09.700 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:09.696+0000 7f29caab2640 1 -- 172.21.15.115:0/2845972724 shutdown_connections 2024-09-13T17:13:09.700 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:09.696+0000 7f29caab2640 1 --2- 172.21.15.115:0/2845972724 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f29c4101600 0x7f29c4109af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:09.700 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:09.696+0000 7f29caab2640 1 --2- 172.21.15.115:0/2845972724 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29c4100ce0 0x7f29c41010c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:09.700 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:09.696+0000 7f29caab2640 1 -- 172.21.15.115:0/2845972724 >> 172.21.15.115:0/2845972724 conn(0x7f29c40fa720 msgr2=0x7f29c40fcb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:09.700 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:09.696+0000 7f29caab2640 1 -- 172.21.15.115:0/2845972724 shutdown_connections 2024-09-13T17:13:09.700 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:09.696+0000 7f29caab2640 1 -- 172.21.15.115:0/2845972724 wait complete. 2024-09-13T17:13:09.700 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:09.697+0000 7f29caab2640 1 Processor -- start 2024-09-13T17:13:09.700 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:09.697+0000 7f29caab2640 1 -- start start 2024-09-13T17:13:09.700 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:09.697+0000 7f29caab2640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f29c4100ce0 0x7f29c40fe940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:09.701 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:09.697+0000 7f29caab2640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29c4101600 0x7f29c40fee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:09.701 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:09.697+0000 7f29caab2640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c40ff3c0 con 0x7f29c4101600 2024-09-13T17:13:09.701 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:09.697+0000 7f29caab2640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c40ff530 con 0x7f29c4100ce0 2024-09-13T17:13:09.701 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:09.697+0000 7f29c3fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29c4101600 0x7f29c40fee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:09.701 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:09.697+0000 7f29c3fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29c4101600 0x7f29c40fee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60292/0 (socket says 172.21.15.115:60292) 2024-09-13T17:13:09.701 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:09.697+0000 7f29c3fff640 1 -- 172.21.15.115:0/3789530894 learned_addr learned my addr 172.21.15.115:0/3789530894 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:13:09.701 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:09.697+0000 7f29c884e640 1 --2- 172.21.15.115:0/3789530894 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f29c4100ce0 0x7f29c40fe940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:09.702 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:09.697+0000 7f29c3fff640 1 -- 172.21.15.115:0/3789530894 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f29c4100ce0 msgr2=0x7f29c40fe940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:09.702 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:09.697+0000 7f29c3fff640 1 --2- 172.21.15.115:0/3789530894 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f29c4100ce0 0x7f29c40fe940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:09.702 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:09.697+0000 7f29c3fff640 1 -- 172.21.15.115:0/3789530894 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b8009560 con 0x7f29c4101600 2024-09-13T17:13:09.702 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:09.697+0000 7f29c3fff640 1 --2- 172.21.15.115:0/3789530894 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29c4101600 0x7f29c40fee80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f29b000c8f0 tx=0x7f29b000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:09.702 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:09.698+0000 7f29c1ffb640 1 -- 172.21.15.115:0/3789530894 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29b0007b80 con 0x7f29c4101600 2024-09-13T17:13:09.702 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:09.698+0000 7f29c1ffb640 1 -- 172.21.15.115:0/3789530894 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f29b000ae50 con 0x7f29c4101600 2024-09-13T17:13:09.702 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:09.698+0000 7f29caab2640 1 -- 172.21.15.115:0/3789530894 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29c41a1cb0 con 0x7f29c4101600 2024-09-13T17:13:09.702 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:09.698+0000 7f29c1ffb640 1 -- 172.21.15.115:0/3789530894 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29b0004d50 con 0x7f29c4101600 2024-09-13T17:13:09.702 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:09.698+0000 7f29caab2640 1 -- 172.21.15.115:0/3789530894 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29c41a2010 con 0x7f29c4101600 2024-09-13T17:13:09.703 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:09.699+0000 7f29caab2640 1 -- 172.21.15.115:0/3789530894 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29c4068ce0 con 0x7f29c4101600 2024-09-13T17:13:09.703 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:09.699+0000 7f29c1ffb640 1 -- 172.21.15.115:0/3789530894 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f29b0007ce0 con 0x7f29c4101600 2024-09-13T17:13:09.703 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:09.700+0000 7f29c1ffb640 1 --2- 172.21.15.115:0/3789530894 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f29b406cc50 0x7f29b406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:09.703 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:09.700+0000 7f29c1ffb640 1 -- 172.21.15.115:0/3789530894 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f29b008c1b0 con 0x7f29c4101600 2024-09-13T17:13:09.703 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:09.700+0000 7f29c884e640 1 --2- 172.21.15.115:0/3789530894 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f29b406cc50 0x7f29b406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:09.703 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:09.700+0000 7f29c884e640 1 --2- 172.21.15.115:0/3789530894 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f29b406cc50 0x7f29b406f110 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f29b8000c00 tx=0x7f29b8004200 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:09.705 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:09.704+0000 7f29c1ffb640 1 -- 172.21.15.115:0/3789530894 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f29b0056350 con 0x7f29c4101600 2024-09-13T17:13:09.883 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:09.881+0000 7f29caab2640 1 -- 172.21.15.115:0/3789530894 --> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f29c40ff6f0 con 0x7f29b406cc50 2024-09-13T17:13:09.884 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:09.883+0000 7f29c1ffb640 1 -- 172.21.15.115:0/3789530894 <== mgr.14660 v2:172.21.15.115:6800/1049502673 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f29c40ff6f0 con 0x7f29b406cc50 2024-09-13T17:13:09.886 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:09.885+0000 7f29caab2640 1 -- 172.21.15.115:0/3789530894 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f29b406cc50 msgr2=0x7f29b406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:09.886 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:09.885+0000 7f29caab2640 1 --2- 172.21.15.115:0/3789530894 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f29b406cc50 0x7f29b406f110 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f29b8000c00 tx=0x7f29b8004200 comp rx=0 tx=0).stop 2024-09-13T17:13:09.886 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:09.885+0000 7f29caab2640 1 -- 172.21.15.115:0/3789530894 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29c4101600 msgr2=0x7f29c40fee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:09.886 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:09.885+0000 7f29caab2640 1 --2- 172.21.15.115:0/3789530894 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29c4101600 0x7f29c40fee80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f29b000c8f0 tx=0x7f29b000cdb0 comp rx=0 tx=0).stop 2024-09-13T17:13:09.886 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:09.885+0000 7f29caab2640 1 -- 172.21.15.115:0/3789530894 shutdown_connections 2024-09-13T17:13:09.886 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:09.885+0000 7f29caab2640 1 --2- 172.21.15.115:0/3789530894 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f29b406cc50 0x7f29b406f110 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:09.887 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:09.885+0000 7f29caab2640 1 --2- 172.21.15.115:0/3789530894 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29c4101600 0x7f29c40fee80 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:09.887 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:09.885+0000 7f29caab2640 1 --2- 172.21.15.115:0/3789530894 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f29c4100ce0 0x7f29c40fe940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:09.887 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:09.885+0000 7f29caab2640 1 -- 172.21.15.115:0/3789530894 >> 172.21.15.115:0/3789530894 conn(0x7f29c40fa720 msgr2=0x7f29c4101fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:09.887 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:09.885+0000 7f29caab2640 1 -- 172.21.15.115:0/3789530894 shutdown_connections 2024-09-13T17:13:09.887 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:09.885+0000 7f29caab2640 1 -- 172.21.15.115:0/3789530894 wait complete. 2024-09-13T17:13:09.895 INFO:teuthology.orchestra.run.smithi115.stdout:true 2024-09-13T17:13:09.895 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:09 smithi115 ceph-mon[109488]: Health check update: Degraded data redundancy: 30/222 objects degraded (13.514%), 12 pgs degraded (PG_DEGRADED) 2024-09-13T17:13:09.895 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:09 smithi115 ceph-mon[109488]: mds.? [v2:172.21.15.115:6826/1135049211,v1:172.21.15.115:6827/1135049211] up:boot 2024-09-13T17:13:09.895 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:09 smithi115 ceph-mon[109488]: fsmap cephfs:1 {0=cephfs.smithi115.ijznvr=up:active} 3 up:standby 2024-09-13T17:13:09.896 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:09 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi115.hbtxod"}]: dispatch 2024-09-13T17:13:09.969 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:09.967+0000 7f72018e7640 1 -- 172.21.15.115:0/2529521560 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71fc1049a0 msgr2=0x7f71fc104d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:09.969 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:09.967+0000 7f72018e7640 1 --2- 172.21.15.115:0/2529521560 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71fc1049a0 0x7f71fc104d80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f71ec009880 tx=0x7f71ec02a4a0 comp rx=0 tx=0).stop 2024-09-13T17:13:09.970 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:09.968+0000 7f72018e7640 1 -- 172.21.15.115:0/2529521560 shutdown_connections 2024-09-13T17:13:09.970 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:09.968+0000 7f72018e7640 1 --2- 172.21.15.115:0/2529521560 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f71fc0fe9a0 0x7f71fc0fee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:09.970 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:09.968+0000 7f72018e7640 1 --2- 172.21.15.115:0/2529521560 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71fc1049a0 0x7f71fc104d80 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:09.970 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:09.968+0000 7f72018e7640 1 -- 172.21.15.115:0/2529521560 >> 172.21.15.115:0/2529521560 conn(0x7f71fc0758c0 msgr2=0x7f71fc0fcc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:09.970 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:09.968+0000 7f72018e7640 1 -- 172.21.15.115:0/2529521560 shutdown_connections 2024-09-13T17:13:09.970 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:09.968+0000 7f72018e7640 1 -- 172.21.15.115:0/2529521560 wait complete. 2024-09-13T17:13:09.970 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:09.968+0000 7f72018e7640 1 Processor -- start 2024-09-13T17:13:09.970 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:09.968+0000 7f72018e7640 1 -- start start 2024-09-13T17:13:09.972 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:09.969+0000 7f72018e7640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f71fc0fe9a0 0x7f71fc19b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:09.972 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:09.969+0000 7f72018e7640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71fc1049a0 0x7f71fc19bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:09.972 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:09.969+0000 7f72018e7640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71fc19c290 con 0x7f71fc1049a0 2024-09-13T17:13:09.972 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:09.969+0000 7f72018e7640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71fc195810 con 0x7f71fc0fe9a0 2024-09-13T17:13:09.972 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:09.969+0000 7f71f27fc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71fc1049a0 0x7f71fc19bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:09.972 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:09.969+0000 7f71f27fc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71fc1049a0 0x7f71fc19bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60308/0 (socket says 172.21.15.115:60308) 2024-09-13T17:13:09.972 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:09.969+0000 7f71f27fc640 1 -- 172.21.15.115:0/2311266014 learned_addr learned my addr 172.21.15.115:0/2311266014 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:13:09.972 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:09.969+0000 7f71faffd640 1 --2- 172.21.15.115:0/2311266014 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f71fc0fe9a0 0x7f71fc19b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:09.972 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:09.969+0000 7f71f27fc640 1 -- 172.21.15.115:0/2311266014 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f71fc0fe9a0 msgr2=0x7f71fc19b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:09.972 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:09.969+0000 7f71f27fc640 1 --2- 172.21.15.115:0/2311266014 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f71fc0fe9a0 0x7f71fc19b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:09.972 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:09.969+0000 7f71f27fc640 1 -- 172.21.15.115:0/2311266014 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71ec009560 con 0x7f71fc1049a0 2024-09-13T17:13:09.973 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:09.969+0000 7f71faffd640 1 --2- 172.21.15.115:0/2311266014 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f71fc0fe9a0 0x7f71fc19b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:13:09.973 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:09.969+0000 7f71f27fc640 1 --2- 172.21.15.115:0/2311266014 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71fc1049a0 0x7f71fc19bc00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f71e400c810 tx=0x7f71e400ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:09.973 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:09.970+0000 7f72008e5640 1 -- 172.21.15.115:0/2311266014 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f71e40041f0 con 0x7f71fc1049a0 2024-09-13T17:13:09.973 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:09.970+0000 7f72018e7640 1 -- 172.21.15.115:0/2311266014 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71fc195af0 con 0x7f71fc1049a0 2024-09-13T17:13:09.973 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:09.970+0000 7f72008e5640 1 -- 172.21.15.115:0/2311266014 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f71e4007e50 con 0x7f71fc1049a0 2024-09-13T17:13:09.973 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:09.970+0000 7f72018e7640 1 -- 172.21.15.115:0/2311266014 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71fc196040 con 0x7f71fc1049a0 2024-09-13T17:13:09.973 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:09.970+0000 7f72008e5640 1 -- 172.21.15.115:0/2311266014 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f71e40049d0 con 0x7f71fc1049a0 2024-09-13T17:13:09.973 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:09.971+0000 7f72018e7640 1 -- 172.21.15.115:0/2311266014 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71fc1000e0 con 0x7f71fc1049a0 2024-09-13T17:13:09.974 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:09.971+0000 7f72008e5640 1 -- 172.21.15.115:0/2311266014 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f71e40079b0 con 0x7f71fc1049a0 2024-09-13T17:13:09.974 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:09.972+0000 7f72008e5640 1 --2- 172.21.15.115:0/2311266014 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f71e806cc50 0x7f71e806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:09.974 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:09.972+0000 7f72008e5640 1 -- 172.21.15.115:0/2311266014 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f71e408c290 con 0x7f71fc1049a0 2024-09-13T17:13:09.974 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:09.972+0000 7f71faffd640 1 --2- 172.21.15.115:0/2311266014 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f71e806cc50 0x7f71e806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:09.974 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:09.972+0000 7f71faffd640 1 --2- 172.21.15.115:0/2311266014 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f71e806cc50 0x7f71e806f110 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f71ec005ec0 tx=0x7f71ec004300 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:09.977 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:09.976+0000 7f72008e5640 1 -- 172.21.15.115:0/2311266014 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f71e4056430 con 0x7f71fc1049a0 2024-09-13T17:13:10.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:09 smithi195 ceph-mon[80021]: Health check update: Degraded data redundancy: 30/222 objects degraded (13.514%), 12 pgs degraded (PG_DEGRADED) 2024-09-13T17:13:10.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:09 smithi195 ceph-mon[80021]: mds.? [v2:172.21.15.115:6826/1135049211,v1:172.21.15.115:6827/1135049211] up:boot 2024-09-13T17:13:10.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:09 smithi195 ceph-mon[80021]: fsmap cephfs:1 {0=cephfs.smithi115.ijznvr=up:active} 3 up:standby 2024-09-13T17:13:10.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:09 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi115.hbtxod"}]: dispatch 2024-09-13T17:13:10.178 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.176+0000 7f72018e7640 1 -- 172.21.15.115:0/2311266014 --> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f71fc10bad0 con 0x7f71e806cc50 2024-09-13T17:13:10.179 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.178+0000 7f72008e5640 1 -- 172.21.15.115:0/2311266014 <== mgr.14660 v2:172.21.15.115:6800/1049502673 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f71fc10bad0 con 0x7f71e806cc50 2024-09-13T17:13:10.181 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.180+0000 7f72018e7640 1 -- 172.21.15.115:0/2311266014 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f71e806cc50 msgr2=0x7f71e806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:10.181 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.180+0000 7f72018e7640 1 --2- 172.21.15.115:0/2311266014 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f71e806cc50 0x7f71e806f110 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f71ec005ec0 tx=0x7f71ec004300 comp rx=0 tx=0).stop 2024-09-13T17:13:10.181 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.180+0000 7f72018e7640 1 -- 172.21.15.115:0/2311266014 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71fc1049a0 msgr2=0x7f71fc19bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:10.182 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.180+0000 7f72018e7640 1 --2- 172.21.15.115:0/2311266014 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71fc1049a0 0x7f71fc19bc00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f71e400c810 tx=0x7f71e400ccd0 comp rx=0 tx=0).stop 2024-09-13T17:13:10.182 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.180+0000 7f72018e7640 1 -- 172.21.15.115:0/2311266014 shutdown_connections 2024-09-13T17:13:10.182 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.180+0000 7f72018e7640 1 --2- 172.21.15.115:0/2311266014 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f71e806cc50 0x7f71e806f110 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:10.182 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.180+0000 7f72018e7640 1 --2- 172.21.15.115:0/2311266014 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71fc1049a0 0x7f71fc19bc00 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:10.182 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.180+0000 7f72018e7640 1 --2- 172.21.15.115:0/2311266014 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f71fc0fe9a0 0x7f71fc19b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:10.182 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.180+0000 7f72018e7640 1 -- 172.21.15.115:0/2311266014 >> 172.21.15.115:0/2311266014 conn(0x7f71fc0758c0 msgr2=0x7f71fc068000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:10.182 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.180+0000 7f72018e7640 1 -- 172.21.15.115:0/2311266014 shutdown_connections 2024-09-13T17:13:10.182 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.180+0000 7f72018e7640 1 -- 172.21.15.115:0/2311266014 wait complete. 2024-09-13T17:13:10.271 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.270+0000 7fc0894d0640 1 -- 172.21.15.115:0/886395301 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0840fea20 msgr2=0x7fc0840fee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:10.271 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.270+0000 7fc0894d0640 1 --2- 172.21.15.115:0/886395301 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0840fea20 0x7fc0840fee80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc06c009880 tx=0x7fc06c02a4a0 comp rx=0 tx=0).stop 2024-09-13T17:13:10.272 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.270+0000 7fc0894d0640 1 -- 172.21.15.115:0/886395301 shutdown_connections 2024-09-13T17:13:10.272 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.270+0000 7fc0894d0640 1 --2- 172.21.15.115:0/886395301 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0840fea20 0x7fc0840fee80 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:10.272 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.270+0000 7fc0894d0640 1 --2- 172.21.15.115:0/886395301 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc084104a20 0x7fc084104e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:10.272 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.270+0000 7fc0894d0640 1 -- 172.21.15.115:0/886395301 >> 172.21.15.115:0/886395301 conn(0x7fc0840fa720 msgr2=0x7fc0840fcb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:10.272 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.270+0000 7fc0894d0640 1 -- 172.21.15.115:0/886395301 shutdown_connections 2024-09-13T17:13:10.272 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.270+0000 7fc0894d0640 1 -- 172.21.15.115:0/886395301 wait complete. 2024-09-13T17:13:10.273 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.271+0000 7fc0894d0640 1 Processor -- start 2024-09-13T17:13:10.273 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.271+0000 7fc0894d0640 1 -- start start 2024-09-13T17:13:10.274 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.271+0000 7fc0894d0640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc0840fea20 0x7fc0840fb110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:10.274 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.271+0000 7fc0894d0640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc084104a20 0x7fc0840fb650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:10.274 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.271+0000 7fc0894d0640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0840fbb90 con 0x7fc084104a20 2024-09-13T17:13:10.274 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.271+0000 7fc0894d0640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0840fbd00 con 0x7fc0840fea20 2024-09-13T17:13:10.274 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.271+0000 7fc07a7fc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc084104a20 0x7fc0840fb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:10.274 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.271+0000 7fc07a7fc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc084104a20 0x7fc0840fb650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60328/0 (socket says 172.21.15.115:60328) 2024-09-13T17:13:10.274 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.271+0000 7fc07a7fc640 1 -- 172.21.15.115:0/2813540468 learned_addr learned my addr 172.21.15.115:0/2813540468 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:13:10.274 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.271+0000 7fc07a7fc640 1 -- 172.21.15.115:0/2813540468 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc0840fea20 msgr2=0x7fc0840fb110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:10.274 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.271+0000 7fc07a7fc640 1 --2- 172.21.15.115:0/2813540468 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc0840fea20 0x7fc0840fb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:10.274 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.271+0000 7fc07a7fc640 1 -- 172.21.15.115:0/2813540468 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc06c009560 con 0x7fc084104a20 2024-09-13T17:13:10.274 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.272+0000 7fc07a7fc640 1 --2- 172.21.15.115:0/2813540468 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc084104a20 0x7fc0840fb650 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc06c006010 tx=0x7fc06c0056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:10.274 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.272+0000 7fc080ff9640 1 -- 172.21.15.115:0/2813540468 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc06c004ba0 con 0x7fc084104a20 2024-09-13T17:13:10.274 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.272+0000 7fc0894d0640 1 -- 172.21.15.115:0/2813540468 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0840fbf80 con 0x7fc084104a20 2024-09-13T17:13:10.275 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.272+0000 7fc080ff9640 1 -- 172.21.15.115:0/2813540468 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc06c004d00 con 0x7fc084104a20 2024-09-13T17:13:10.275 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.272+0000 7fc080ff9640 1 -- 172.21.15.115:0/2813540468 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc06c031910 con 0x7fc084104a20 2024-09-13T17:13:10.275 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.272+0000 7fc0894d0640 1 -- 172.21.15.115:0/2813540468 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0841a1e10 con 0x7fc084104a20 2024-09-13T17:13:10.275 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.273+0000 7fc0894d0640 1 -- 172.21.15.115:0/2813540468 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc084100160 con 0x7fc084104a20 2024-09-13T17:13:10.276 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.273+0000 7fc080ff9640 1 -- 172.21.15.115:0/2813540468 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fc06c031c00 con 0x7fc084104a20 2024-09-13T17:13:10.276 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.274+0000 7fc080ff9640 1 --2- 172.21.15.115:0/2813540468 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fc07006cc50 0x7fc07006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:10.276 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.274+0000 7fc080ff9640 1 -- 172.21.15.115:0/2813540468 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fc06c0ad570 con 0x7fc084104a20 2024-09-13T17:13:10.276 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.274+0000 7fc082ffd640 1 --2- 172.21.15.115:0/2813540468 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fc07006cc50 0x7fc07006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:10.276 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.274+0000 7fc082ffd640 1 --2- 172.21.15.115:0/2813540468 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fc07006cc50 0x7fc07006f110 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc07400a8f0 tx=0x7fc074005bf0 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:10.279 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.278+0000 7fc080ff9640 1 -- 172.21.15.115:0/2813540468 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc06c077690 con 0x7fc084104a20 2024-09-13T17:13:10.454 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.452+0000 7fc0894d0640 1 -- 172.21.15.115:0/2813540468 --> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc0840fbf80 con 0x7fc07006cc50 2024-09-13T17:13:10.463 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.462+0000 7fc080ff9640 1 -- 172.21.15.115:0/2813540468 <== mgr.14660 v2:172.21.15.115:6800/1049502673 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fc0840fbf80 con 0x7fc07006cc50 2024-09-13T17:13:10.463 INFO:teuthology.orchestra.run.smithi115.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T17:13:10.463 INFO:teuthology.orchestra.run.smithi115.stdout:alertmanager.smithi115 smithi115 *:9093,9094 running (5m) 99s ago 15m 25.0M - 0.25.0 c8568f914cd2 d56b91240fe1 2024-09-13T17:13:10.463 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-exporter.smithi115 smithi115 running (15m) 99s ago 15m 8376k - 18.2.4-843-g2c01458a c129f5a2fd4e 0f1eebeaf9bb 2024-09-13T17:13:10.463 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-exporter.smithi195 smithi195 running (14m) 6s ago 14m 8032k - 18.2.4-843-g2c01458a c129f5a2fd4e 6d05bafbac8a 2024-09-13T17:13:10.463 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi115 smithi115 running (3m) 99s ago 15m 6895k - 18.2.4-860-g6c6b083f 8a91f241d7d4 e8175bc055bf 2024-09-13T17:13:10.463 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi195 smithi195 running (3m) 6s ago 14m 6903k - 18.2.4-860-g6c6b083f 8a91f241d7d4 ccb4895be776 2024-09-13T17:13:10.464 INFO:teuthology.orchestra.run.smithi115.stdout:grafana.smithi115 smithi115 *:3000 running (4m) 99s ago 14m 80.6M - 9.4.7 954c08fa6188 e1eccb1a8f3e 2024-09-13T17:13:10.464 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi115.hbtxod smithi115 running (9m) 99s ago 9m 98.5M - 18.2.4-843-g2c01458a c129f5a2fd4e 12b4f4874491 2024-09-13T17:13:10.464 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi115.ijznvr smithi115 running (9m) 99s ago 9m 166M - 18.2.4-843-g2c01458a c129f5a2fd4e 2d552564a9f4 2024-09-13T17:13:10.464 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi195.aevvgz smithi195 running (9m) 6s ago 9m 18.8M - 18.2.4-843-g2c01458a c129f5a2fd4e 299b9ad657c9 2024-09-13T17:13:10.464 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi195.qzghxj smithi195 running (9m) 6s ago 9m 16.7M - 18.2.4-843-g2c01458a c129f5a2fd4e fb16b16181ff 2024-09-13T17:13:10.464 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi115.hetcni smithi115 *:8443,9283,8765 running (6m) 99s ago 16m 494M - 18.2.4-860-g6c6b083f 8a91f241d7d4 b945dbde1934 2024-09-13T17:13:10.464 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi195.hjjifz smithi195 *:8443,9283,8765 running (5m) 6s ago 14m 442M - 18.2.4-860-g6c6b083f 8a91f241d7d4 17bccdfbcae1 2024-09-13T17:13:10.464 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi115 smithi115 running (3m) 99s ago 16m 40.7M 2048M 18.2.4-860-g6c6b083f 8a91f241d7d4 8dd7baf2c6b6 2024-09-13T17:13:10.464 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi195 smithi195 running (3m) 6s ago 14m 36.7M 2048M 18.2.4-860-g6c6b083f 8a91f241d7d4 0459bc5e6b08 2024-09-13T17:13:10.464 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi115 smithi115 *:9100 running (5m) 99s ago 15m 16.5M - 1.5.0 0da6a335fe13 26fb6f9844b5 2024-09-13T17:13:10.464 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi195 smithi195 *:9100 running (5m) 6s ago 14m 17.3M - 1.5.0 0da6a335fe13 6d38e798fb16 2024-09-13T17:13:10.464 INFO:teuthology.orchestra.run.smithi115.stdout:osd.0 smithi115 running (2m) 99s ago 13m 99.7M 1216M 18.2.4-860-g6c6b083f 8a91f241d7d4 3b9f874c64e9 2024-09-13T17:13:10.465 INFO:teuthology.orchestra.run.smithi115.stdout:osd.1 smithi115 running (2m) 99s ago 13m 101M 1216M 18.2.4-860-g6c6b083f 8a91f241d7d4 f0de6684601c 2024-09-13T17:13:10.465 INFO:teuthology.orchestra.run.smithi115.stdout:osd.2 smithi115 running (105s) 99s ago 12m 13.6M 1216M 18.2.4-860-g6c6b083f 8a91f241d7d4 edb753bab54a 2024-09-13T17:13:10.465 INFO:teuthology.orchestra.run.smithi115.stdout:osd.3 smithi195 running (71s) 6s ago 12m 109M 2240M 18.2.4-860-g6c6b083f 8a91f241d7d4 ccd1b2bf7d86 2024-09-13T17:13:10.465 INFO:teuthology.orchestra.run.smithi115.stdout:osd.4 smithi195 running (40s) 6s ago 11m 102M 2240M 18.2.4-860-g6c6b083f 8a91f241d7d4 c88b3dacb207 2024-09-13T17:13:10.465 INFO:teuthology.orchestra.run.smithi115.stdout:osd.5 smithi195 running (9s) 6s ago 11m 12.1M 2240M 18.2.4-860-g6c6b083f 8a91f241d7d4 40ccbc2f5195 2024-09-13T17:13:10.465 INFO:teuthology.orchestra.run.smithi115.stdout:prometheus.smithi115 smithi115 *:9095 running (5m) 99s ago 14m 64.3M - 2.43.0 a07b618ecd1d e03fb39f6b76 2024-09-13T17:13:10.465 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.464+0000 7fc0894d0640 1 -- 172.21.15.115:0/2813540468 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fc07006cc50 msgr2=0x7fc07006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:10.466 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.464+0000 7fc0894d0640 1 --2- 172.21.15.115:0/2813540468 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fc07006cc50 0x7fc07006f110 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc07400a8f0 tx=0x7fc074005bf0 comp rx=0 tx=0).stop 2024-09-13T17:13:10.466 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.464+0000 7fc0894d0640 1 -- 172.21.15.115:0/2813540468 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc084104a20 msgr2=0x7fc0840fb650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:10.466 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.464+0000 7fc0894d0640 1 --2- 172.21.15.115:0/2813540468 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc084104a20 0x7fc0840fb650 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc06c006010 tx=0x7fc06c0056e0 comp rx=0 tx=0).stop 2024-09-13T17:13:10.466 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.464+0000 7fc0894d0640 1 -- 172.21.15.115:0/2813540468 shutdown_connections 2024-09-13T17:13:10.466 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.464+0000 7fc0894d0640 1 --2- 172.21.15.115:0/2813540468 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fc07006cc50 0x7fc07006f110 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:10.466 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.464+0000 7fc0894d0640 1 --2- 172.21.15.115:0/2813540468 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc084104a20 0x7fc0840fb650 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:10.466 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.464+0000 7fc0894d0640 1 --2- 172.21.15.115:0/2813540468 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc0840fea20 0x7fc0840fb110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:10.466 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.464+0000 7fc0894d0640 1 -- 172.21.15.115:0/2813540468 >> 172.21.15.115:0/2813540468 conn(0x7fc0840fa720 msgr2=0x7fc0840688a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:10.466 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.464+0000 7fc0894d0640 1 -- 172.21.15.115:0/2813540468 shutdown_connections 2024-09-13T17:13:10.466 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.464+0000 7fc0894d0640 1 -- 172.21.15.115:0/2813540468 wait complete. 2024-09-13T17:13:10.548 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.546+0000 7fcc9df82640 1 -- 172.21.15.115:0/399878880 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc980fea10 msgr2=0x7fcc980fee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:10.548 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.546+0000 7fcc9df82640 1 --2- 172.21.15.115:0/399878880 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc980fea10 0x7fcc980fee70 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fcc8c009880 tx=0x7fcc8c02a4a0 comp rx=0 tx=0).stop 2024-09-13T17:13:10.548 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.546+0000 7fcc9df82640 1 -- 172.21.15.115:0/399878880 shutdown_connections 2024-09-13T17:13:10.548 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.546+0000 7fcc9df82640 1 --2- 172.21.15.115:0/399878880 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc980fea10 0x7fcc980fee70 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:10.548 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.546+0000 7fcc9df82640 1 --2- 172.21.15.115:0/399878880 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc98104a10 0x7fcc98104df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:10.548 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.546+0000 7fcc9df82640 1 -- 172.21.15.115:0/399878880 >> 172.21.15.115:0/399878880 conn(0x7fcc980fa730 msgr2=0x7fcc980fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:10.548 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.546+0000 7fcc9df82640 1 -- 172.21.15.115:0/399878880 shutdown_connections 2024-09-13T17:13:10.548 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.546+0000 7fcc9df82640 1 -- 172.21.15.115:0/399878880 wait complete. 2024-09-13T17:13:10.548 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.547+0000 7fcc9df82640 1 Processor -- start 2024-09-13T17:13:10.548 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.547+0000 7fcc9df82640 1 -- start start 2024-09-13T17:13:10.550 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.547+0000 7fcc9df82640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc980fea10 0x7fcc981968c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:10.550 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.547+0000 7fcc9df82640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc98104a10 0x7fcc98196e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:10.550 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.547+0000 7fcc9df82640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc98197340 con 0x7fcc98104a10 2024-09-13T17:13:10.550 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.547+0000 7fcc9df82640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc981974b0 con 0x7fcc980fea10 2024-09-13T17:13:10.550 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.547+0000 7fcc96ffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc98104a10 0x7fcc98196e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:10.550 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.547+0000 7fcc96ffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc98104a10 0x7fcc98196e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60354/0 (socket says 172.21.15.115:60354) 2024-09-13T17:13:10.551 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.547+0000 7fcc96ffd640 1 -- 172.21.15.115:0/1426584330 learned_addr learned my addr 172.21.15.115:0/1426584330 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:13:10.551 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.547+0000 7fcc977fe640 1 --2- 172.21.15.115:0/1426584330 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc980fea10 0x7fcc981968c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:10.551 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.547+0000 7fcc96ffd640 1 -- 172.21.15.115:0/1426584330 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc980fea10 msgr2=0x7fcc981968c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:10.551 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.547+0000 7fcc96ffd640 1 --2- 172.21.15.115:0/1426584330 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc980fea10 0x7fcc981968c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:10.551 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.547+0000 7fcc96ffd640 1 -- 172.21.15.115:0/1426584330 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc8c009560 con 0x7fcc98104a10 2024-09-13T17:13:10.551 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.547+0000 7fcc977fe640 1 --2- 172.21.15.115:0/1426584330 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc980fea10 0x7fcc981968c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:10.551 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.548+0000 7fcc96ffd640 1 --2- 172.21.15.115:0/1426584330 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc98104a10 0x7fcc98196e00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fcc8c02a9c0 tx=0x7fcc8c0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:10.551 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.548+0000 7fcc94ff9640 1 -- 172.21.15.115:0/1426584330 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc8c004b60 con 0x7fcc98104a10 2024-09-13T17:13:10.551 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.548+0000 7fcc9df82640 1 -- 172.21.15.115:0/1426584330 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc98197730 con 0x7fcc98104a10 2024-09-13T17:13:10.551 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.548+0000 7fcc94ff9640 1 -- 172.21.15.115:0/1426584330 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcc8c004cc0 con 0x7fcc98104a10 2024-09-13T17:13:10.551 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.548+0000 7fcc94ff9640 1 -- 172.21.15.115:0/1426584330 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc8c031950 con 0x7fcc98104a10 2024-09-13T17:13:10.551 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.548+0000 7fcc9df82640 1 -- 172.21.15.115:0/1426584330 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc9819fc60 con 0x7fcc98104a10 2024-09-13T17:13:10.551 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.549+0000 7fcc9df82640 1 -- 172.21.15.115:0/1426584330 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc98100150 con 0x7fcc98104a10 2024-09-13T17:13:10.552 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.549+0000 7fcc94ff9640 1 -- 172.21.15.115:0/1426584330 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fcc8c0035f0 con 0x7fcc98104a10 2024-09-13T17:13:10.552 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.550+0000 7fcc94ff9640 1 --2- 172.21.15.115:0/1426584330 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fcc8006cc50 0x7fcc8006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:10.552 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.550+0000 7fcc94ff9640 1 -- 172.21.15.115:0/1426584330 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fcc8c0ad4f0 con 0x7fcc98104a10 2024-09-13T17:13:10.552 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.550+0000 7fcc977fe640 1 --2- 172.21.15.115:0/1426584330 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fcc8006cc50 0x7fcc8006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:10.552 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.550+0000 7fcc977fe640 1 --2- 172.21.15.115:0/1426584330 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fcc8006cc50 0x7fcc8006f110 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fcc88005fd0 tx=0x7fcc8800b5f0 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:10.555 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.554+0000 7fcc94ff9640 1 -- 172.21.15.115:0/1426584330 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fcc8c077570 con 0x7fcc98104a10 2024-09-13T17:13:10.704 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:10 smithi115 ceph-mon[109488]: pgmap v230: 65 pgs: 2 peering, 14 active+undersized, 11 active+undersized+degraded, 38 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 29/222 objects degraded (13.063%) 2024-09-13T17:13:10.705 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:10 smithi115 ceph-mon[109488]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:13:10.705 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:10 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:13:10.705 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:10 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi115.hbtxod", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T17:13:10.705 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:10 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:13:10.799 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.798+0000 7fcc9df82640 1 -- 172.21.15.115:0/1426584330 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fcc98107040 con 0x7fcc98104a10 2024-09-13T17:13:10.800 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.798+0000 7fcc94ff9640 1 -- 172.21.15.115:0/1426584330 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+733 (secure 0 0 0) 0x7fcc8c004e30 con 0x7fcc98104a10 2024-09-13T17:13:10.800 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-13T17:13:10.800 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": { 2024-09-13T17:13:10.800 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 2 2024-09-13T17:13:10.800 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T17:13:10.800 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": { 2024-09-13T17:13:10.800 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 2 2024-09-13T17:13:10.800 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T17:13:10.800 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": { 2024-09-13T17:13:10.801 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 6 2024-09-13T17:13:10.801 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T17:13:10.801 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": { 2024-09-13T17:13:10.801 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-843-g2c01458a (2c01458affee2b2435cd231b6e392435c1c21661) reef (stable)": 4 2024-09-13T17:13:10.801 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T17:13:10.801 INFO:teuthology.orchestra.run.smithi115.stdout: "overall": { 2024-09-13T17:13:10.801 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-843-g2c01458a (2c01458affee2b2435cd231b6e392435c1c21661) reef (stable)": 4, 2024-09-13T17:13:10.801 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 10 2024-09-13T17:13:10.801 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-13T17:13:10.801 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-13T17:13:10.802 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.801+0000 7fcc9df82640 1 -- 172.21.15.115:0/1426584330 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fcc8006cc50 msgr2=0x7fcc8006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:10.802 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.801+0000 7fcc9df82640 1 --2- 172.21.15.115:0/1426584330 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fcc8006cc50 0x7fcc8006f110 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fcc88005fd0 tx=0x7fcc8800b5f0 comp rx=0 tx=0).stop 2024-09-13T17:13:10.802 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.801+0000 7fcc9df82640 1 -- 172.21.15.115:0/1426584330 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc98104a10 msgr2=0x7fcc98196e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:10.802 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.801+0000 7fcc9df82640 1 --2- 172.21.15.115:0/1426584330 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc98104a10 0x7fcc98196e00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fcc8c02a9c0 tx=0x7fcc8c0055a0 comp rx=0 tx=0).stop 2024-09-13T17:13:10.802 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.801+0000 7fcc9df82640 1 -- 172.21.15.115:0/1426584330 shutdown_connections 2024-09-13T17:13:10.802 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.801+0000 7fcc9df82640 1 --2- 172.21.15.115:0/1426584330 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fcc8006cc50 0x7fcc8006f110 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:10.802 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.801+0000 7fcc9df82640 1 --2- 172.21.15.115:0/1426584330 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc98104a10 0x7fcc98196e00 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:10.802 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.801+0000 7fcc9df82640 1 --2- 172.21.15.115:0/1426584330 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc980fea10 0x7fcc981968c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:10.803 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.801+0000 7fcc9df82640 1 -- 172.21.15.115:0/1426584330 >> 172.21.15.115:0/1426584330 conn(0x7fcc980fa730 msgr2=0x7fcc980fb560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:10.803 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.801+0000 7fcc9df82640 1 -- 172.21.15.115:0/1426584330 shutdown_connections 2024-09-13T17:13:10.803 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.801+0000 7fcc9df82640 1 -- 172.21.15.115:0/1426584330 wait complete. 2024-09-13T17:13:10.885 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.882+0000 7fbe65720640 1 -- 172.21.15.115:0/3197634828 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe60105bf0 msgr2=0x7fbe60105fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:10.885 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.882+0000 7fbe65720640 1 --2- 172.21.15.115:0/3197634828 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe60105bf0 0x7fbe60105fd0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbe50009880 tx=0x7fbe5002a4a0 comp rx=0 tx=0).stop 2024-09-13T17:13:10.885 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.882+0000 7fbe65720640 1 -- 172.21.15.115:0/3197634828 shutdown_connections 2024-09-13T17:13:10.885 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.882+0000 7fbe65720640 1 --2- 172.21.15.115:0/3197634828 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbe600ffb40 0x7fbe600fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:10.886 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.882+0000 7fbe65720640 1 --2- 172.21.15.115:0/3197634828 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe60105bf0 0x7fbe60105fd0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:10.886 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.882+0000 7fbe65720640 1 -- 172.21.15.115:0/3197634828 >> 172.21.15.115:0/3197634828 conn(0x7fbe600fb840 msgr2=0x7fbe600fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:10.886 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.882+0000 7fbe65720640 1 -- 172.21.15.115:0/3197634828 shutdown_connections 2024-09-13T17:13:10.886 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.882+0000 7fbe65720640 1 -- 172.21.15.115:0/3197634828 wait complete. 2024-09-13T17:13:10.886 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.882+0000 7fbe65720640 1 Processor -- start 2024-09-13T17:13:10.886 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.883+0000 7fbe65720640 1 -- start start 2024-09-13T17:13:10.886 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.883+0000 7fbe65720640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbe600ffb40 0x7fbe6019b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:10.886 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.883+0000 7fbe65720640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe60105bf0 0x7fbe6019bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:10.886 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.883+0000 7fbe65720640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe60195790 con 0x7fbe60105bf0 2024-09-13T17:13:10.886 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.883+0000 7fbe65720640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe60195900 con 0x7fbe600ffb40 2024-09-13T17:13:10.886 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.883+0000 7fbe5e7fc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe60105bf0 0x7fbe6019bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:10.886 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.883+0000 7fbe5e7fc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe60105bf0 0x7fbe6019bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60368/0 (socket says 172.21.15.115:60368) 2024-09-13T17:13:10.886 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.883+0000 7fbe5e7fc640 1 -- 172.21.15.115:0/512871758 learned_addr learned my addr 172.21.15.115:0/512871758 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:13:10.887 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.883+0000 7fbe5effd640 1 --2- 172.21.15.115:0/512871758 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbe600ffb40 0x7fbe6019b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:10.887 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.883+0000 7fbe5e7fc640 1 -- 172.21.15.115:0/512871758 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbe600ffb40 msgr2=0x7fbe6019b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:10.887 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.883+0000 7fbe5e7fc640 1 --2- 172.21.15.115:0/512871758 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbe600ffb40 0x7fbe6019b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:10.887 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.883+0000 7fbe5e7fc640 1 -- 172.21.15.115:0/512871758 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe50009560 con 0x7fbe60105bf0 2024-09-13T17:13:10.887 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.884+0000 7fbe5e7fc640 1 --2- 172.21.15.115:0/512871758 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe60105bf0 0x7fbe6019bbe0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbe5400c8f0 tx=0x7fbe5400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:10.887 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.884+0000 7fbe47fff640 1 -- 172.21.15.115:0/512871758 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe54007b80 con 0x7fbe60105bf0 2024-09-13T17:13:10.887 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.884+0000 7fbe65720640 1 -- 172.21.15.115:0/512871758 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe60195be0 con 0x7fbe60105bf0 2024-09-13T17:13:10.887 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.884+0000 7fbe47fff640 1 -- 172.21.15.115:0/512871758 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbe54007ce0 con 0x7fbe60105bf0 2024-09-13T17:13:10.887 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.884+0000 7fbe47fff640 1 -- 172.21.15.115:0/512871758 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe5400f450 con 0x7fbe60105bf0 2024-09-13T17:13:10.887 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.884+0000 7fbe65720640 1 -- 172.21.15.115:0/512871758 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe601961b0 con 0x7fbe60105bf0 2024-09-13T17:13:10.888 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.885+0000 7fbe65720640 1 -- 172.21.15.115:0/512871758 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe601011f0 con 0x7fbe60105bf0 2024-09-13T17:13:10.888 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.885+0000 7fbe47fff640 1 -- 172.21.15.115:0/512871758 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fbe54004f10 con 0x7fbe60105bf0 2024-09-13T17:13:10.888 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.886+0000 7fbe47fff640 1 --2- 172.21.15.115:0/512871758 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fbe4806cc60 0x7fbe4806f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:10.888 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.886+0000 7fbe5effd640 1 --2- 172.21.15.115:0/512871758 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fbe4806cc60 0x7fbe4806f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:10.888 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.886+0000 7fbe47fff640 1 -- 172.21.15.115:0/512871758 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fbe5408c360 con 0x7fbe60105bf0 2024-09-13T17:13:10.888 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.886+0000 7fbe5effd640 1 --2- 172.21.15.115:0/512871758 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fbe4806cc60 0x7fbe4806f120 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fbe50006010 tx=0x7fbe50000bc0 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:10.891 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:10.890+0000 7fbe47fff640 1 -- 172.21.15.115:0/512871758 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fbe54056480 con 0x7fbe60105bf0 2024-09-13T17:13:10.912 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:10 smithi195 ceph-mon[80021]: pgmap v230: 65 pgs: 2 peering, 14 active+undersized, 11 active+undersized+degraded, 38 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 29/222 objects degraded (13.063%) 2024-09-13T17:13:10.913 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:10 smithi195 ceph-mon[80021]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:13:10.913 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:10 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:13:10.913 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:10 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi115.hbtxod", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T17:13:10.913 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:10 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:13:11.097 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.096+0000 7fbe65720640 1 -- 172.21.15.115:0/512871758 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fbe601080b0 con 0x7fbe60105bf0 2024-09-13T17:13:11.097 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.096+0000 7fbe47fff640 1 -- 172.21.15.115:0/512871758 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1846 (secure 0 0 0) 0x7fbe54059aa0 con 0x7fbe60105bf0 2024-09-13T17:13:11.098 INFO:teuthology.orchestra.run.smithi115.stdout:e21 2024-09-13T17:13:11.098 INFO:teuthology.orchestra.run.smithi115.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T17:13:11.098 INFO:teuthology.orchestra.run.smithi115.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T17:13:11.098 INFO:teuthology.orchestra.run.smithi115.stdout:legacy client fscid: 1 2024-09-13T17:13:11.098 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:13:11.098 INFO:teuthology.orchestra.run.smithi115.stdout:Filesystem 'cephfs' (1) 2024-09-13T17:13:11.098 INFO:teuthology.orchestra.run.smithi115.stdout:fs_name cephfs 2024-09-13T17:13:11.098 INFO:teuthology.orchestra.run.smithi115.stdout:epoch 20 2024-09-13T17:13:11.098 INFO:teuthology.orchestra.run.smithi115.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T17:13:11.099 INFO:teuthology.orchestra.run.smithi115.stdout:created 2024-09-13T17:03:16.313116+0000 2024-09-13T17:13:11.099 INFO:teuthology.orchestra.run.smithi115.stdout:modified 2024-09-13T17:13:08.443680+0000 2024-09-13T17:13:11.099 INFO:teuthology.orchestra.run.smithi115.stdout:tableserver 0 2024-09-13T17:13:11.099 INFO:teuthology.orchestra.run.smithi115.stdout:root 0 2024-09-13T17:13:11.099 INFO:teuthology.orchestra.run.smithi115.stdout:session_timeout 60 2024-09-13T17:13:11.099 INFO:teuthology.orchestra.run.smithi115.stdout:session_autoclose 300 2024-09-13T17:13:11.099 INFO:teuthology.orchestra.run.smithi115.stdout:max_file_size 1099511627776 2024-09-13T17:13:11.099 INFO:teuthology.orchestra.run.smithi115.stdout:max_xattr_size 65536 2024-09-13T17:13:11.099 INFO:teuthology.orchestra.run.smithi115.stdout:required_client_features {} 2024-09-13T17:13:11.099 INFO:teuthology.orchestra.run.smithi115.stdout:last_failure 0 2024-09-13T17:13:11.099 INFO:teuthology.orchestra.run.smithi115.stdout:last_failure_osd_epoch 0 2024-09-13T17:13:11.099 INFO:teuthology.orchestra.run.smithi115.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T17:13:11.099 INFO:teuthology.orchestra.run.smithi115.stdout:max_mds 1 2024-09-13T17:13:11.099 INFO:teuthology.orchestra.run.smithi115.stdout:in 0 2024-09-13T17:13:11.100 INFO:teuthology.orchestra.run.smithi115.stdout:up {0=14470} 2024-09-13T17:13:11.100 INFO:teuthology.orchestra.run.smithi115.stdout:failed 2024-09-13T17:13:11.100 INFO:teuthology.orchestra.run.smithi115.stdout:damaged 2024-09-13T17:13:11.100 INFO:teuthology.orchestra.run.smithi115.stdout:stopped 2024-09-13T17:13:11.100 INFO:teuthology.orchestra.run.smithi115.stdout:data_pools [3] 2024-09-13T17:13:11.100 INFO:teuthology.orchestra.run.smithi115.stdout:metadata_pool 2 2024-09-13T17:13:11.100 INFO:teuthology.orchestra.run.smithi115.stdout:inline_data enabled 2024-09-13T17:13:11.100 INFO:teuthology.orchestra.run.smithi115.stdout:balancer 2024-09-13T17:13:11.100 INFO:teuthology.orchestra.run.smithi115.stdout:bal_rank_mask -1 2024-09-13T17:13:11.100 INFO:teuthology.orchestra.run.smithi115.stdout:standby_count_wanted 1 2024-09-13T17:13:11.100 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi115.ijznvr{0:14470} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.115:6828/4128583274,v1:172.21.15.115:6829/4128583274] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T17:13:11.100 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:13:11.100 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:13:11.100 INFO:teuthology.orchestra.run.smithi115.stdout:Standby daemons: 2024-09-13T17:13:11.101 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:13:11.101 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi195.aevvgz{-1:24253} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.195:6826/8826118,v1:172.21.15.195:6827/8826118] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T17:13:11.101 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi195.qzghxj{-1:24259} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.195:6824/3335357704,v1:172.21.15.195:6825/3335357704] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T17:13:11.101 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi115.hbtxod{-1:34288} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.115:6826/1135049211,v1:172.21.15.115:6827/1135049211] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T17:13:11.101 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 21 2024-09-13T17:13:11.102 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.099+0000 7fbe65720640 1 -- 172.21.15.115:0/512871758 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fbe4806cc60 msgr2=0x7fbe4806f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:11.102 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.099+0000 7fbe65720640 1 --2- 172.21.15.115:0/512871758 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fbe4806cc60 0x7fbe4806f120 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fbe50006010 tx=0x7fbe50000bc0 comp rx=0 tx=0).stop 2024-09-13T17:13:11.102 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.099+0000 7fbe65720640 1 -- 172.21.15.115:0/512871758 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe60105bf0 msgr2=0x7fbe6019bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:11.102 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.099+0000 7fbe65720640 1 --2- 172.21.15.115:0/512871758 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe60105bf0 0x7fbe6019bbe0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbe5400c8f0 tx=0x7fbe5400cdb0 comp rx=0 tx=0).stop 2024-09-13T17:13:11.102 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.099+0000 7fbe65720640 1 -- 172.21.15.115:0/512871758 shutdown_connections 2024-09-13T17:13:11.102 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.099+0000 7fbe65720640 1 --2- 172.21.15.115:0/512871758 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fbe4806cc60 0x7fbe4806f120 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:11.102 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.099+0000 7fbe65720640 1 --2- 172.21.15.115:0/512871758 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe60105bf0 0x7fbe6019bbe0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:11.102 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.099+0000 7fbe65720640 1 --2- 172.21.15.115:0/512871758 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbe600ffb40 0x7fbe6019b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:11.102 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.099+0000 7fbe65720640 1 -- 172.21.15.115:0/512871758 >> 172.21.15.115:0/512871758 conn(0x7fbe600fb840 msgr2=0x7fbe600fd920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:11.102 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.099+0000 7fbe65720640 1 -- 172.21.15.115:0/512871758 shutdown_connections 2024-09-13T17:13:11.102 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.099+0000 7fbe65720640 1 -- 172.21.15.115:0/512871758 wait complete. 2024-09-13T17:13:11.184 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.181+0000 7f88005cc640 1 -- 172.21.15.115:0/2222522433 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87f81049a0 msgr2=0x7f87f8104d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:11.184 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.181+0000 7f88005cc640 1 --2- 172.21.15.115:0/2222522433 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87f81049a0 0x7f87f8104d80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f87f4009880 tx=0x7f87f402a4a0 comp rx=0 tx=0).stop 2024-09-13T17:13:11.184 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.181+0000 7f88005cc640 1 -- 172.21.15.115:0/2222522433 shutdown_connections 2024-09-13T17:13:11.184 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.181+0000 7f88005cc640 1 --2- 172.21.15.115:0/2222522433 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f87f80fe9a0 0x7f87f80fee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:11.184 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.181+0000 7f88005cc640 1 --2- 172.21.15.115:0/2222522433 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87f81049a0 0x7f87f8104d80 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:11.184 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.181+0000 7f88005cc640 1 -- 172.21.15.115:0/2222522433 >> 172.21.15.115:0/2222522433 conn(0x7f87f80758c0 msgr2=0x7f87f80fcc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:11.184 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.181+0000 7f88005cc640 1 -- 172.21.15.115:0/2222522433 shutdown_connections 2024-09-13T17:13:11.184 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.181+0000 7f88005cc640 1 -- 172.21.15.115:0/2222522433 wait complete. 2024-09-13T17:13:11.185 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.182+0000 7f88005cc640 1 Processor -- start 2024-09-13T17:13:11.185 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.182+0000 7f88005cc640 1 -- start start 2024-09-13T17:13:11.185 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.182+0000 7f88005cc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87f80fe9a0 0x7f87f819b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:11.185 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.182+0000 7f88005cc640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f87f81049a0 0x7f87f819bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:11.185 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.182+0000 7f88005cc640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87f819c3f0 con 0x7f87f80fe9a0 2024-09-13T17:13:11.185 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.182+0000 7f88005cc640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87f81959d0 con 0x7f87f81049a0 2024-09-13T17:13:11.185 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.182+0000 7f87fe368640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87f80fe9a0 0x7f87f819b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:11.185 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.182+0000 7f87fe368640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87f80fe9a0 0x7f87f819b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60390/0 (socket says 172.21.15.115:60390) 2024-09-13T17:13:11.185 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.182+0000 7f87fe368640 1 -- 172.21.15.115:0/3878007976 learned_addr learned my addr 172.21.15.115:0/3878007976 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:13:11.185 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.182+0000 7f87fe368640 1 -- 172.21.15.115:0/3878007976 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f87f81049a0 msgr2=0x7f87f819bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:11.185 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.182+0000 7f87fe368640 1 --2- 172.21.15.115:0/3878007976 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f87f81049a0 0x7f87f819bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:11.185 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.182+0000 7f87fe368640 1 -- 172.21.15.115:0/3878007976 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87f4009560 con 0x7f87f80fe9a0 2024-09-13T17:13:11.185 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.182+0000 7f87fe368640 1 --2- 172.21.15.115:0/3878007976 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87f80fe9a0 0x7f87f819b890 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f87f4006010 tx=0x7f87f40055f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:11.186 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.183+0000 7f87ef7fe640 1 -- 172.21.15.115:0/3878007976 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f87f4004b20 con 0x7f87f80fe9a0 2024-09-13T17:13:11.186 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.183+0000 7f87ef7fe640 1 -- 172.21.15.115:0/3878007976 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f87f4004c80 con 0x7f87f80fe9a0 2024-09-13T17:13:11.186 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.183+0000 7f87ef7fe640 1 -- 172.21.15.115:0/3878007976 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f87f4031960 con 0x7f87f80fe9a0 2024-09-13T17:13:11.186 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.183+0000 7f88005cc640 1 -- 172.21.15.115:0/3878007976 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87f8195c50 con 0x7f87f80fe9a0 2024-09-13T17:13:11.186 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.183+0000 7f88005cc640 1 -- 172.21.15.115:0/3878007976 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87f8196140 con 0x7f87f80fe9a0 2024-09-13T17:13:11.187 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.184+0000 7f88005cc640 1 -- 172.21.15.115:0/3878007976 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87f81000e0 con 0x7f87f80fe9a0 2024-09-13T17:13:11.187 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.184+0000 7f87ef7fe640 1 -- 172.21.15.115:0/3878007976 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f87f4031bd0 con 0x7f87f80fe9a0 2024-09-13T17:13:11.187 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.184+0000 7f87ef7fe640 1 --2- 172.21.15.115:0/3878007976 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f87e406cc50 0x7f87e406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:11.187 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.185+0000 7f87ef7fe640 1 -- 172.21.15.115:0/3878007976 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f87f40ad6b0 con 0x7f87f80fe9a0 2024-09-13T17:13:11.187 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.185+0000 7f87fdb67640 1 --2- 172.21.15.115:0/3878007976 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f87e406cc50 0x7f87e406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:11.187 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.185+0000 7f87fdb67640 1 --2- 172.21.15.115:0/3878007976 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f87e406cc50 0x7f87e406f110 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f87f8196df0 tx=0x7f87e8006c90 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:11.190 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.189+0000 7f87ef7fe640 1 -- 172.21.15.115:0/3878007976 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f87f4077850 con 0x7f87f80fe9a0 2024-09-13T17:13:11.379 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.378+0000 7f88005cc640 1 -- 172.21.15.115:0/3878007976 --> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f87f8106fd0 con 0x7f87e406cc50 2024-09-13T17:13:11.380 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.379+0000 7f87ef7fe640 1 -- 172.21.15.115:0/3878007976 <== mgr.14660 v2:172.21.15.115:6800/1049502673 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f87f8106fd0 con 0x7f87e406cc50 2024-09-13T17:13:11.380 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-13T17:13:11.380 INFO:teuthology.orchestra.run.smithi115.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256", 2024-09-13T17:13:11.380 INFO:teuthology.orchestra.run.smithi115.stdout: "in_progress": true, 2024-09-13T17:13:11.380 INFO:teuthology.orchestra.run.smithi115.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T17:13:11.381 INFO:teuthology.orchestra.run.smithi115.stdout: "services_complete": [ 2024-09-13T17:13:11.381 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr", 2024-09-13T17:13:11.381 INFO:teuthology.orchestra.run.smithi115.stdout: "osd", 2024-09-13T17:13:11.381 INFO:teuthology.orchestra.run.smithi115.stdout: "mon", 2024-09-13T17:13:11.381 INFO:teuthology.orchestra.run.smithi115.stdout: "crash" 2024-09-13T17:13:11.381 INFO:teuthology.orchestra.run.smithi115.stdout: ], 2024-09-13T17:13:11.381 INFO:teuthology.orchestra.run.smithi115.stdout: "progress": "12/23 daemons upgraded", 2024-09-13T17:13:11.381 INFO:teuthology.orchestra.run.smithi115.stdout: "message": "Currently upgrading mds daemons", 2024-09-13T17:13:11.381 INFO:teuthology.orchestra.run.smithi115.stdout: "is_paused": false 2024-09-13T17:13:11.381 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-13T17:13:11.382 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.381+0000 7f88005cc640 1 -- 172.21.15.115:0/3878007976 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f87e406cc50 msgr2=0x7f87e406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:11.382 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.381+0000 7f88005cc640 1 --2- 172.21.15.115:0/3878007976 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f87e406cc50 0x7f87e406f110 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f87f8196df0 tx=0x7f87e8006c90 comp rx=0 tx=0).stop 2024-09-13T17:13:11.382 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.381+0000 7f88005cc640 1 -- 172.21.15.115:0/3878007976 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87f80fe9a0 msgr2=0x7f87f819b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:11.382 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.381+0000 7f88005cc640 1 --2- 172.21.15.115:0/3878007976 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87f80fe9a0 0x7f87f819b890 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f87f4006010 tx=0x7f87f40055f0 comp rx=0 tx=0).stop 2024-09-13T17:13:11.382 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.381+0000 7f88005cc640 1 -- 172.21.15.115:0/3878007976 shutdown_connections 2024-09-13T17:13:11.383 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.381+0000 7f88005cc640 1 --2- 172.21.15.115:0/3878007976 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f87e406cc50 0x7f87e406f110 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:11.383 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.381+0000 7f88005cc640 1 --2- 172.21.15.115:0/3878007976 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f87f81049a0 0x7f87f819bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:11.383 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.381+0000 7f88005cc640 1 --2- 172.21.15.115:0/3878007976 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87f80fe9a0 0x7f87f819b890 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:11.383 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.381+0000 7f88005cc640 1 -- 172.21.15.115:0/3878007976 >> 172.21.15.115:0/3878007976 conn(0x7f87f80758c0 msgr2=0x7f87f80fcc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:11.383 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.381+0000 7f88005cc640 1 -- 172.21.15.115:0/3878007976 shutdown_connections 2024-09-13T17:13:11.383 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.381+0000 7f88005cc640 1 -- 172.21.15.115:0/3878007976 wait complete. 2024-09-13T17:13:11.466 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.462+0000 7f4b95818640 1 -- 172.21.15.115:0/2506031252 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b90100c60 msgr2=0x7f4b90101040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:11.466 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.462+0000 7f4b95818640 1 --2- 172.21.15.115:0/2506031252 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b90100c60 0x7f4b90101040 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4b80009880 tx=0x7f4b8002a530 comp rx=0 tx=0).stop 2024-09-13T17:13:11.466 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.462+0000 7f4b95818640 1 -- 172.21.15.115:0/2506031252 shutdown_connections 2024-09-13T17:13:11.466 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.462+0000 7f4b95818640 1 --2- 172.21.15.115:0/2506031252 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b90101580 0x7f4b90109a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:11.466 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.462+0000 7f4b95818640 1 --2- 172.21.15.115:0/2506031252 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b90100c60 0x7f4b90101040 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:11.466 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.463+0000 7f4b95818640 1 -- 172.21.15.115:0/2506031252 >> 172.21.15.115:0/2506031252 conn(0x7f4b900758c0 msgr2=0x7f4b900fcc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:11.467 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.463+0000 7f4b95818640 1 -- 172.21.15.115:0/2506031252 shutdown_connections 2024-09-13T17:13:11.467 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.463+0000 7f4b95818640 1 -- 172.21.15.115:0/2506031252 wait complete. 2024-09-13T17:13:11.467 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.463+0000 7f4b95818640 1 Processor -- start 2024-09-13T17:13:11.467 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.463+0000 7f4b95818640 1 -- start start 2024-09-13T17:13:11.467 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.463+0000 7f4b95818640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b90100c60 0x7f4b9019b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:11.467 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.463+0000 7f4b95818640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b90101580 0x7f4b9019be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:11.467 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.463+0000 7f4b95818640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9019c480 con 0x7f4b90100c60 2024-09-13T17:13:11.468 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.463+0000 7f4b95818640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b90195a10 con 0x7f4b90101580 2024-09-13T17:13:11.468 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.463+0000 7f4b8effd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b90100c60 0x7f4b9019b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:11.468 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.463+0000 7f4b8effd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b90100c60 0x7f4b9019b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60406/0 (socket says 172.21.15.115:60406) 2024-09-13T17:13:11.468 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.463+0000 7f4b8effd640 1 -- 172.21.15.115:0/10933087 learned_addr learned my addr 172.21.15.115:0/10933087 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:13:11.468 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.464+0000 7f4b87fff640 1 --2- 172.21.15.115:0/10933087 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b90101580 0x7f4b9019be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:11.468 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.464+0000 7f4b8effd640 1 -- 172.21.15.115:0/10933087 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b90101580 msgr2=0x7f4b9019be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:11.468 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.464+0000 7f4b8effd640 1 --2- 172.21.15.115:0/10933087 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b90101580 0x7f4b9019be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:11.469 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.464+0000 7f4b8effd640 1 -- 172.21.15.115:0/10933087 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b80009560 con 0x7f4b90100c60 2024-09-13T17:13:11.469 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.464+0000 7f4b87fff640 1 --2- 172.21.15.115:0/10933087 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b90101580 0x7f4b9019be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:13:11.469 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.464+0000 7f4b8effd640 1 --2- 172.21.15.115:0/10933087 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b90100c60 0x7f4b9019b920 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4b80006010 tx=0x7f4b800056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:11.469 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.464+0000 7f4b94816640 1 -- 172.21.15.115:0/10933087 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b80004ba0 con 0x7f4b90100c60 2024-09-13T17:13:11.469 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.464+0000 7f4b94816640 1 -- 172.21.15.115:0/10933087 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4b80004d00 con 0x7f4b90100c60 2024-09-13T17:13:11.469 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.464+0000 7f4b94816640 1 -- 172.21.15.115:0/10933087 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b80031910 con 0x7f4b90100c60 2024-09-13T17:13:11.469 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.464+0000 7f4b95818640 1 -- 172.21.15.115:0/10933087 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b90195c90 con 0x7f4b90100c60 2024-09-13T17:13:11.470 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.464+0000 7f4b95818640 1 -- 172.21.15.115:0/10933087 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b90196130 con 0x7f4b90100c60 2024-09-13T17:13:11.471 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.465+0000 7f4b95818640 1 -- 172.21.15.115:0/10933087 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b900684c0 con 0x7f4b90100c60 2024-09-13T17:13:11.471 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.466+0000 7f4b94816640 1 -- 172.21.15.115:0/10933087 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f4b8002ad50 con 0x7f4b90100c60 2024-09-13T17:13:11.471 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.466+0000 7f4b94816640 1 --2- 172.21.15.115:0/10933087 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f4b7c06cc50 0x7f4b7c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:11.471 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.466+0000 7f4b94816640 1 -- 172.21.15.115:0/10933087 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f4b800ad440 con 0x7f4b90100c60 2024-09-13T17:13:11.471 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.466+0000 7f4b87fff640 1 --2- 172.21.15.115:0/10933087 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f4b7c06cc50 0x7f4b7c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:11.471 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.467+0000 7f4b87fff640 1 --2- 172.21.15.115:0/10933087 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f4b7c06cc50 0x7f4b7c06f110 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4b78006fd0 tx=0x7f4b78008040 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:11.472 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.470+0000 7f4b94816640 1 -- 172.21.15.115:0/10933087 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f4b80077560 con 0x7f4b90100c60 2024-09-13T17:13:11.718 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.716+0000 7f4b95818640 1 -- 172.21.15.115:0/10933087 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f4b901096e0 con 0x7f4b90100c60 2024-09-13T17:13:11.718 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.716+0000 7f4b94816640 1 -- 172.21.15.115:0/10933087 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+760 (secure 0 0 0) 0x7f4b8007ab80 con 0x7f4b90100c60 2024-09-13T17:13:11.718 INFO:teuthology.orchestra.run.smithi115.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; Degraded data redundancy: 14/222 objects degraded (6.306%), 7 pgs degraded 2024-09-13T17:13:11.719 INFO:teuthology.orchestra.run.smithi115.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T17:13:11.719 INFO:teuthology.orchestra.run.smithi115.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T17:13:11.719 INFO:teuthology.orchestra.run.smithi115.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 14/222 objects degraded (6.306%), 7 pgs degraded 2024-09-13T17:13:11.719 INFO:teuthology.orchestra.run.smithi115.stdout: pg 2.2 is active+undersized+degraded, acting [1,0] 2024-09-13T17:13:11.719 INFO:teuthology.orchestra.run.smithi115.stdout: pg 2.3 is active+undersized+degraded, acting [2,1] 2024-09-13T17:13:11.719 INFO:teuthology.orchestra.run.smithi115.stdout: pg 2.f is active+undersized+degraded, acting [4,0] 2024-09-13T17:13:11.719 INFO:teuthology.orchestra.run.smithi115.stdout: pg 2.16 is active+undersized+degraded, acting [3,2] 2024-09-13T17:13:11.719 INFO:teuthology.orchestra.run.smithi115.stdout: pg 2.18 is active+undersized+degraded, acting [4,3] 2024-09-13T17:13:11.719 INFO:teuthology.orchestra.run.smithi115.stdout: pg 2.1c is active+undersized+degraded, acting [4,2] 2024-09-13T17:13:11.719 INFO:teuthology.orchestra.run.smithi115.stdout: pg 2.1e is active+undersized+degraded, acting [2,0] 2024-09-13T17:13:11.720 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.718+0000 7f4b95818640 1 -- 172.21.15.115:0/10933087 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f4b7c06cc50 msgr2=0x7f4b7c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:11.720 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.718+0000 7f4b95818640 1 --2- 172.21.15.115:0/10933087 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f4b7c06cc50 0x7f4b7c06f110 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4b78006fd0 tx=0x7f4b78008040 comp rx=0 tx=0).stop 2024-09-13T17:13:11.720 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.718+0000 7f4b95818640 1 -- 172.21.15.115:0/10933087 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b90100c60 msgr2=0x7f4b9019b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:11.720 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.718+0000 7f4b95818640 1 --2- 172.21.15.115:0/10933087 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b90100c60 0x7f4b9019b920 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4b80006010 tx=0x7f4b800056e0 comp rx=0 tx=0).stop 2024-09-13T17:13:11.720 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.718+0000 7f4b95818640 1 -- 172.21.15.115:0/10933087 shutdown_connections 2024-09-13T17:13:11.720 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.718+0000 7f4b95818640 1 --2- 172.21.15.115:0/10933087 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f4b7c06cc50 0x7f4b7c06f110 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:11.721 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.718+0000 7f4b95818640 1 --2- 172.21.15.115:0/10933087 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b90101580 0x7f4b9019be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:11.721 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.718+0000 7f4b95818640 1 --2- 172.21.15.115:0/10933087 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b90100c60 0x7f4b9019b920 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:11.721 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.718+0000 7f4b95818640 1 -- 172.21.15.115:0/10933087 >> 172.21.15.115:0/10933087 conn(0x7f4b900758c0 msgr2=0x7f4b90101f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:11.721 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.718+0000 7f4b95818640 1 -- 172.21.15.115:0/10933087 shutdown_connections 2024-09-13T17:13:11.721 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:11.718+0000 7f4b95818640 1 -- 172.21.15.115:0/10933087 wait complete. 2024-09-13T17:13:11.948 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:11 smithi115 ceph-mon[109488]: Upgrade: Updating mds.cephfs.smithi115.hbtxod 2024-09-13T17:13:11.948 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:11 smithi115 ceph-mon[109488]: Deploying daemon mds.cephfs.smithi115.hbtxod on smithi115 2024-09-13T17:13:11.948 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:11 smithi115 ceph-mon[109488]: from='client.34296 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:13:11.948 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:11 smithi115 ceph-mon[109488]: from='client.34300 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:13:11.948 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:11 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:13:11.948 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:11 smithi115 ceph-mon[109488]: from='client.? 172.21.15.115:0/1426584330' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:13:11.948 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:11 smithi115 ceph-mon[109488]: from='client.? 172.21.15.115:0/512871758' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T17:13:12.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:11 smithi195 ceph-mon[80021]: Upgrade: Updating mds.cephfs.smithi115.hbtxod 2024-09-13T17:13:12.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:11 smithi195 ceph-mon[80021]: Deploying daemon mds.cephfs.smithi115.hbtxod on smithi115 2024-09-13T17:13:12.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:11 smithi195 ceph-mon[80021]: from='client.34296 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:13:12.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:11 smithi195 ceph-mon[80021]: from='client.34300 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:13:12.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:11 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:13:12.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:11 smithi195 ceph-mon[80021]: from='client.? 172.21.15.115:0/1426584330' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:13:12.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:11 smithi195 ceph-mon[80021]: from='client.? 172.21.15.115:0/512871758' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T17:13:13.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:12 smithi195 ceph-mon[80021]: from='client.34312 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:13:13.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:12 smithi195 ceph-mon[80021]: pgmap v231: 65 pgs: 2 peering, 11 active+undersized, 7 active+undersized+degraded, 45 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 341 B/s rd, 1 op/s; 14/222 objects degraded (6.306%) 2024-09-13T17:13:13.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:12 smithi195 ceph-mon[80021]: from='client.? 172.21.15.115:0/10933087' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T17:13:13.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:12 smithi195 ceph-mon[80021]: osdmap e79: 6 total, 6 up, 6 in 2024-09-13T17:13:13.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:12 smithi115 ceph-mon[109488]: from='client.34312 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:13:13.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:12 smithi115 ceph-mon[109488]: pgmap v231: 65 pgs: 2 peering, 11 active+undersized, 7 active+undersized+degraded, 45 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 341 B/s rd, 1 op/s; 14/222 objects degraded (6.306%) 2024-09-13T17:13:13.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:12 smithi115 ceph-mon[109488]: from='client.? 172.21.15.115:0/10933087' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T17:13:13.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:12 smithi115 ceph-mon[109488]: osdmap e79: 6 total, 6 up, 6 in 2024-09-13T17:13:14.018 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:13 smithi115 ceph-mon[109488]: fsmap cephfs:1 {0=cephfs.smithi115.ijznvr=up:active} 2 up:standby 2024-09-13T17:13:14.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:13 smithi195 ceph-mon[80021]: fsmap cephfs:1 {0=cephfs.smithi115.ijznvr=up:active} 2 up:standby 2024-09-13T17:13:14.993 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:14 smithi115 ceph-mon[109488]: pgmap v233: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 340 B/s rd, 0 op/s 2024-09-13T17:13:14.993 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:14 smithi115 ceph-mon[109488]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 14/222 objects degraded (6.306%), 7 pgs degraded) 2024-09-13T17:13:14.993 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:14 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi115.hbtxod"}]: dispatch 2024-09-13T17:13:15.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:14 smithi195 ceph-mon[80021]: pgmap v233: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 340 B/s rd, 0 op/s 2024-09-13T17:13:15.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:14 smithi195 ceph-mon[80021]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 14/222 objects degraded (6.306%), 7 pgs degraded) 2024-09-13T17:13:15.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:14 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi115.hbtxod"}]: dispatch 2024-09-13T17:13:16.866 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:16 smithi115 ceph-mon[109488]: pgmap v234: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 255 B/s rd, 0 op/s 2024-09-13T17:13:17.076 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:16 smithi195 ceph-mon[80021]: pgmap v234: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 255 B/s rd, 0 op/s 2024-09-13T17:13:19.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:18 smithi195 ceph-mon[80021]: pgmap v235: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 227 B/s rd, 0 op/s 2024-09-13T17:13:19.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:18 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:13:19.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:18 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:13:19.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:18 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:13:19.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:18 smithi195 ceph-mon[80021]: mds.? [v2:172.21.15.115:6826/2768011029,v1:172.21.15.115:6827/2768011029] up:boot 2024-09-13T17:13:19.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:18 smithi195 ceph-mon[80021]: fsmap cephfs:1 {0=cephfs.smithi115.ijznvr=up:active} 3 up:standby 2024-09-13T17:13:19.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:18 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi115.hbtxod"}]: dispatch 2024-09-13T17:13:19.080 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:18 smithi115 ceph-mon[109488]: pgmap v235: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 227 B/s rd, 0 op/s 2024-09-13T17:13:19.080 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:18 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:13:19.080 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:18 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:13:19.081 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:18 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:13:19.081 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:18 smithi115 ceph-mon[109488]: mds.? [v2:172.21.15.115:6826/2768011029,v1:172.21.15.115:6827/2768011029] up:boot 2024-09-13T17:13:19.081 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:18 smithi115 ceph-mon[109488]: fsmap cephfs:1 {0=cephfs.smithi115.ijznvr=up:active} 3 up:standby 2024-09-13T17:13:19.081 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:18 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi115.hbtxod"}]: dispatch 2024-09-13T17:13:21.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:20 smithi195 ceph-mon[80021]: pgmap v236: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 204 B/s rd, 0 op/s 2024-09-13T17:13:21.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:20 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:13:21.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:20 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:13:21.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:20 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:13:21.068 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:20 smithi115 ceph-mon[109488]: pgmap v236: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 204 B/s rd, 0 op/s 2024-09-13T17:13:21.068 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:20 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:13:21.068 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:20 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:13:21.068 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:20 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:13:23.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:22 smithi195 ceph-mon[80021]: pgmap v237: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:13:23.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:22 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:13:23.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:22 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:13:23.178 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:22 smithi115 ceph-mon[109488]: pgmap v237: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:13:23.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:22 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:13:23.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:22 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:13:24.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:24 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:13:24.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:24 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:13:24.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:24 smithi195 ceph-mon[80021]: pgmap v238: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:13:24.378 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:24 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:13:24.378 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:24 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:13:24.378 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:24 smithi115 ceph-mon[109488]: pgmap v238: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:13:26.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:26 smithi115 ceph-mon[109488]: pgmap v239: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:13:26.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:26 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:13:26.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:26 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:13:26.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:26 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:13:26.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:26 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:13:26.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:26 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:13:26.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:26 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:13:26.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:26 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:13:26.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:26 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:13:26.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:26 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:13:26.680 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:26 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:13:26.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:26 smithi195 ceph-mon[80021]: pgmap v239: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:13:26.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:26 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:13:26.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:26 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:13:26.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:26 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:13:26.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:26 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:13:26.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:26 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:13:26.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:26 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:13:26.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:26 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:13:26.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:26 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:13:26.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:26 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:13:26.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:26 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:13:28.994 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:28 smithi115 ceph-mon[109488]: pgmap v240: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:13:28.994 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:28 smithi115 ceph-mon[109488]: Upgrade: Updating mds.cephfs.smithi115.ijznvr 2024-09-13T17:13:28.994 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:28 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:13:28.994 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:28 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi115.ijznvr", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T17:13:28.994 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:28 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:13:28.994 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:28 smithi115 ceph-mon[109488]: Deploying daemon mds.cephfs.smithi115.ijznvr on smithi115 2024-09-13T17:13:29.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:28 smithi195 ceph-mon[80021]: pgmap v240: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:13:29.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:28 smithi195 ceph-mon[80021]: Upgrade: Updating mds.cephfs.smithi115.ijznvr 2024-09-13T17:13:29.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:28 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:13:29.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:28 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi115.ijznvr", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T17:13:29.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:28 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:13:29.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:28 smithi195 ceph-mon[80021]: Deploying daemon mds.cephfs.smithi115.ijznvr on smithi115 2024-09-13T17:13:29.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:29 smithi115 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-mon-smithi115[109484]: 2024-09-13T17:13:29.448+0000 7f7986bb7640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T17:13:29.826 INFO:journalctl@ceph.osd.3.smithi195.stdout:Sep 13 17:13:29 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-3[88826]: 2024-09-13T17:13:29.475+0000 7f5daeb88640 -1 bdev(0x55b635fb4e00 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 4 2024-09-13T17:13:29.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:29 smithi195 ceph-mon[80021]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-13T17:13:29.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:29 smithi195 ceph-mon[80021]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T17:13:29.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:29 smithi195 ceph-mon[80021]: osdmap e80: 6 total, 6 up, 6 in 2024-09-13T17:13:29.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:29 smithi195 ceph-mon[80021]: Standby daemon mds.cephfs.smithi195.aevvgz assigned to filesystem cephfs as rank 0 2024-09-13T17:13:29.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:29 smithi195 ceph-mon[80021]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-13T17:13:29.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:29 smithi195 ceph-mon[80021]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-13T17:13:29.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:29 smithi195 ceph-mon[80021]: fsmap cephfs:1/1 {0=cephfs.smithi195.aevvgz=up:replay} 2 up:standby 2024-09-13T17:13:30.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:29 smithi115 ceph-mon[109488]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-13T17:13:30.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:29 smithi115 ceph-mon[109488]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T17:13:30.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:29 smithi115 ceph-mon[109488]: osdmap e80: 6 total, 6 up, 6 in 2024-09-13T17:13:30.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:29 smithi115 ceph-mon[109488]: Standby daemon mds.cephfs.smithi195.aevvgz assigned to filesystem cephfs as rank 0 2024-09-13T17:13:30.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:29 smithi115 ceph-mon[109488]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-13T17:13:30.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:29 smithi115 ceph-mon[109488]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-13T17:13:30.180 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:29 smithi115 ceph-mon[109488]: fsmap cephfs:1/1 {0=cephfs.smithi195.aevvgz=up:replay} 2 up:standby 2024-09-13T17:13:31.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:30 smithi195 ceph-mon[80021]: pgmap v242: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:13:31.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:30 smithi115 ceph-mon[109488]: pgmap v242: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:13:32.076 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:31 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi115.ijznvr"}]: dispatch 2024-09-13T17:13:32.178 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:31 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi115.ijznvr"}]: dispatch 2024-09-13T17:13:33.076 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:32 smithi195 ceph-mon[80021]: pgmap v243: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 2.4 MiB/s rd, 0 op/s 2024-09-13T17:13:33.178 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:32 smithi115 ceph-mon[109488]: pgmap v243: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 2.4 MiB/s rd, 0 op/s 2024-09-13T17:13:34.992 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:34 smithi115 ceph-mon[109488]: pgmap v244: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 10 MiB/s rd, 3 op/s 2024-09-13T17:13:35.076 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:34 smithi195 ceph-mon[80021]: pgmap v244: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 10 MiB/s rd, 3 op/s 2024-09-13T17:13:36.837 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:36 smithi195 ceph-mon[80021]: pgmap v245: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 4 op/s 2024-09-13T17:13:36.837 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:36 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:13:36.837 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:36 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:13:36.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:36 smithi115 ceph-mon[109488]: pgmap v245: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 4 op/s 2024-09-13T17:13:36.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:36 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:13:36.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:36 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:13:38.076 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:37 smithi195 ceph-mon[80021]: reconnect by client.24291 v1:192.168.0.1:0/3568065273 after 0 2024-09-13T17:13:38.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:37 smithi195 ceph-mon[80021]: mds.? [v2:172.21.15.195:6826/8826118,v1:172.21.15.195:6827/8826118] up:reconnect 2024-09-13T17:13:38.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:37 smithi195 ceph-mon[80021]: fsmap cephfs:1/1 {0=cephfs.smithi195.aevvgz=up:reconnect} 2 up:standby 2024-09-13T17:13:38.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:37 smithi195 ceph-mon[80021]: reconnect by client.24287 v1:172.21.15.115:0/693373336 after 0.00399992 2024-09-13T17:13:38.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:37 smithi115 ceph-mon[109488]: reconnect by client.24291 v1:192.168.0.1:0/3568065273 after 0 2024-09-13T17:13:38.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:37 smithi115 ceph-mon[109488]: mds.? [v2:172.21.15.195:6826/8826118,v1:172.21.15.195:6827/8826118] up:reconnect 2024-09-13T17:13:38.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:37 smithi115 ceph-mon[109488]: fsmap cephfs:1/1 {0=cephfs.smithi195.aevvgz=up:reconnect} 2 up:standby 2024-09-13T17:13:38.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:37 smithi115 ceph-mon[109488]: reconnect by client.24287 v1:172.21.15.115:0/693373336 after 0.00399992 2024-09-13T17:13:39.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:38 smithi195 ceph-mon[80021]: pgmap v246: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-09-13T17:13:39.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:38 smithi195 ceph-mon[80021]: mds.? [v2:172.21.15.195:6826/8826118,v1:172.21.15.195:6827/8826118] up:rejoin 2024-09-13T17:13:39.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:38 smithi195 ceph-mon[80021]: fsmap cephfs:1/1 {0=cephfs.smithi195.aevvgz=up:rejoin} 2 up:standby 2024-09-13T17:13:39.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:38 smithi195 ceph-mon[80021]: daemon mds.cephfs.smithi195.aevvgz is now active in filesystem cephfs as rank 0 2024-09-13T17:13:39.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:38 smithi115 ceph-mon[109488]: pgmap v246: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-09-13T17:13:39.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:38 smithi115 ceph-mon[109488]: mds.? [v2:172.21.15.195:6826/8826118,v1:172.21.15.195:6827/8826118] up:rejoin 2024-09-13T17:13:39.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:38 smithi115 ceph-mon[109488]: fsmap cephfs:1/1 {0=cephfs.smithi195.aevvgz=up:rejoin} 2 up:standby 2024-09-13T17:13:39.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:38 smithi115 ceph-mon[109488]: daemon mds.cephfs.smithi195.aevvgz is now active in filesystem cephfs as rank 0 2024-09-13T17:13:39.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:39 smithi115 ceph-mon[109488]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-13T17:13:39.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:39 smithi115 ceph-mon[109488]: mds.? [v2:172.21.15.195:6826/8826118,v1:172.21.15.195:6827/8826118] up:active 2024-09-13T17:13:39.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:39 smithi115 ceph-mon[109488]: fsmap cephfs:1 {0=cephfs.smithi195.aevvgz=up:active} 2 up:standby 2024-09-13T17:13:40.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:39 smithi195 ceph-mon[80021]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-13T17:13:40.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:39 smithi195 ceph-mon[80021]: mds.? [v2:172.21.15.195:6826/8826118,v1:172.21.15.195:6827/8826118] up:active 2024-09-13T17:13:40.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:39 smithi195 ceph-mon[80021]: fsmap cephfs:1 {0=cephfs.smithi195.aevvgz=up:active} 2 up:standby 2024-09-13T17:13:41.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:40 smithi195 ceph-mon[80021]: pgmap v247: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 20 MiB/s rd, 6 op/s 2024-09-13T17:13:41.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:40 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:13:41.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:40 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:13:41.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:40 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:13:41.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:40 smithi115 ceph-mon[109488]: pgmap v247: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 20 MiB/s rd, 6 op/s 2024-09-13T17:13:41.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:40 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:13:41.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:40 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:13:41.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:40 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:13:41.808 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:41.804+0000 7ffbbb124640 1 -- 172.21.15.115:0/1389479559 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffbb40ffb40 msgr2=0x7ffbb40fffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:41.808 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:41.804+0000 7ffbbb124640 1 --2- 172.21.15.115:0/1389479559 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffbb40ffb40 0x7ffbb40fffa0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ffba0009880 tx=0x7ffba002a4a0 comp rx=0 tx=0).stop 2024-09-13T17:13:41.808 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:41.804+0000 7ffbbb124640 1 -- 172.21.15.115:0/1389479559 shutdown_connections 2024-09-13T17:13:41.808 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:41.804+0000 7ffbbb124640 1 --2- 172.21.15.115:0/1389479559 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffbb40ffb40 0x7ffbb40fffa0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:41.809 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:41.804+0000 7ffbbb124640 1 --2- 172.21.15.115:0/1389479559 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffbb4105bf0 0x7ffbb4105fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:41.809 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:41.804+0000 7ffbbb124640 1 -- 172.21.15.115:0/1389479559 >> 172.21.15.115:0/1389479559 conn(0x7ffbb40fb840 msgr2=0x7ffbb40fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:41.809 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:41.804+0000 7ffbbb124640 1 -- 172.21.15.115:0/1389479559 shutdown_connections 2024-09-13T17:13:41.809 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:41.804+0000 7ffbbb124640 1 -- 172.21.15.115:0/1389479559 wait complete. 2024-09-13T17:13:41.809 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:41.805+0000 7ffbbb124640 1 Processor -- start 2024-09-13T17:13:41.809 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:41.805+0000 7ffbbb124640 1 -- start start 2024-09-13T17:13:41.809 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:41.805+0000 7ffbbb124640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffbb40ffb40 0x7ffbb419b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:41.809 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:41.805+0000 7ffbbb124640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffbb4105bf0 0x7ffbb419bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:41.809 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:41.805+0000 7ffbbb124640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb419c360 con 0x7ffbb40ffb40 2024-09-13T17:13:41.809 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:41.805+0000 7ffbbb124640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb41958f0 con 0x7ffbb4105bf0 2024-09-13T17:13:41.809 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:41.805+0000 7ffbb8ec0640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffbb40ffb40 0x7ffbb419b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:41.809 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:41.805+0000 7ffbb8ec0640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffbb40ffb40 0x7ffbb419b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47544/0 (socket says 172.21.15.115:47544) 2024-09-13T17:13:41.810 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:41.805+0000 7ffbb8ec0640 1 -- 172.21.15.115:0/803699406 learned_addr learned my addr 172.21.15.115:0/803699406 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:13:41.810 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:41.805+0000 7ffbb3fff640 1 --2- 172.21.15.115:0/803699406 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffbb4105bf0 0x7ffbb419bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:41.810 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:41.805+0000 7ffbb8ec0640 1 -- 172.21.15.115:0/803699406 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffbb4105bf0 msgr2=0x7ffbb419bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:41.810 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:41.805+0000 7ffbb8ec0640 1 --2- 172.21.15.115:0/803699406 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffbb4105bf0 0x7ffbb419bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:41.810 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:41.805+0000 7ffbb8ec0640 1 -- 172.21.15.115:0/803699406 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffba0009560 con 0x7ffbb40ffb40 2024-09-13T17:13:41.810 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:41.805+0000 7ffbb3fff640 1 --2- 172.21.15.115:0/803699406 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffbb4105bf0 0x7ffbb419bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:13:41.810 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:41.806+0000 7ffbb8ec0640 1 --2- 172.21.15.115:0/803699406 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffbb40ffb40 0x7ffbb419b800 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ffba800b420 tx=0x7ffba800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:41.810 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:41.806+0000 7ffbb1ffb640 1 -- 172.21.15.115:0/803699406 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffba8011800 con 0x7ffbb40ffb40 2024-09-13T17:13:41.810 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:41.806+0000 7ffbbb124640 1 -- 172.21.15.115:0/803699406 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbb4195bd0 con 0x7ffbb40ffb40 2024-09-13T17:13:41.810 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:41.806+0000 7ffbb1ffb640 1 -- 172.21.15.115:0/803699406 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ffba8011e00 con 0x7ffbb40ffb40 2024-09-13T17:13:41.810 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:41.806+0000 7ffbb1ffb640 1 -- 172.21.15.115:0/803699406 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffba800f2e0 con 0x7ffbb40ffb40 2024-09-13T17:13:41.810 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:41.806+0000 7ffbbb124640 1 -- 172.21.15.115:0/803699406 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbb41961a0 con 0x7ffbb40ffb40 2024-09-13T17:13:41.811 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:41.807+0000 7ffbbb124640 1 -- 172.21.15.115:0/803699406 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbb41011f0 con 0x7ffbb40ffb40 2024-09-13T17:13:41.812 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:41.808+0000 7ffbb1ffb640 1 -- 172.21.15.115:0/803699406 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7ffba8011960 con 0x7ffbb40ffb40 2024-09-13T17:13:41.812 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:41.808+0000 7ffbb1ffb640 1 --2- 172.21.15.115:0/803699406 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7ffba406cc50 0x7ffba406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:41.812 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:41.808+0000 7ffbb1ffb640 1 -- 172.21.15.115:0/803699406 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6242+0+0 (secure 0 0 0) 0x7ffba808bf40 con 0x7ffbb40ffb40 2024-09-13T17:13:41.812 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:41.808+0000 7ffbb3fff640 1 --2- 172.21.15.115:0/803699406 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7ffba406cc50 0x7ffba406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:41.812 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:41.809+0000 7ffbb3fff640 1 --2- 172.21.15.115:0/803699406 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7ffba406cc50 0x7ffba406f110 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ffba0006010 tx=0x7ffba0005d50 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:41.815 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:41.813+0000 7ffbb1ffb640 1 -- 172.21.15.115:0/803699406 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ffba80bfe20 con 0x7ffbb40ffb40 2024-09-13T17:13:42.018 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.015+0000 7ffbbb124640 1 -- 172.21.15.115:0/803699406 --> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ffbb4108080 con 0x7ffba406cc50 2024-09-13T17:13:42.018 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:41 smithi115 ceph-mon[109488]: mds.? [v2:172.21.15.115:6828/2716683507,v1:172.21.15.115:6829/2716683507] up:boot 2024-09-13T17:13:42.018 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:41 smithi115 ceph-mon[109488]: fsmap cephfs:1 {0=cephfs.smithi195.aevvgz=up:active} 3 up:standby 2024-09-13T17:13:42.019 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:41 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi115.ijznvr"}]: dispatch 2024-09-13T17:13:42.019 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.017+0000 7ffbb1ffb640 1 -- 172.21.15.115:0/803699406 <== mgr.14660 v2:172.21.15.115:6800/1049502673 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7ffbb4108080 con 0x7ffba406cc50 2024-09-13T17:13:42.022 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.019+0000 7ffbbb124640 1 -- 172.21.15.115:0/803699406 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7ffba406cc50 msgr2=0x7ffba406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:42.022 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.019+0000 7ffbbb124640 1 --2- 172.21.15.115:0/803699406 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7ffba406cc50 0x7ffba406f110 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ffba0006010 tx=0x7ffba0005d50 comp rx=0 tx=0).stop 2024-09-13T17:13:42.022 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.019+0000 7ffbbb124640 1 -- 172.21.15.115:0/803699406 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffbb40ffb40 msgr2=0x7ffbb419b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:42.022 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.019+0000 7ffbbb124640 1 --2- 172.21.15.115:0/803699406 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffbb40ffb40 0x7ffbb419b800 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ffba800b420 tx=0x7ffba800b8e0 comp rx=0 tx=0).stop 2024-09-13T17:13:42.022 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.019+0000 7ffbbb124640 1 -- 172.21.15.115:0/803699406 shutdown_connections 2024-09-13T17:13:42.022 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.019+0000 7ffbbb124640 1 --2- 172.21.15.115:0/803699406 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7ffba406cc50 0x7ffba406f110 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:42.022 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.019+0000 7ffbbb124640 1 --2- 172.21.15.115:0/803699406 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffbb4105bf0 0x7ffbb419bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:42.022 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.019+0000 7ffbbb124640 1 --2- 172.21.15.115:0/803699406 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffbb40ffb40 0x7ffbb419b800 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:42.022 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.019+0000 7ffbbb124640 1 -- 172.21.15.115:0/803699406 >> 172.21.15.115:0/803699406 conn(0x7ffbb40fb840 msgr2=0x7ffbb40fd9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:42.022 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.019+0000 7ffbbb124640 1 -- 172.21.15.115:0/803699406 shutdown_connections 2024-09-13T17:13:42.023 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.020+0000 7ffbbb124640 1 -- 172.21.15.115:0/803699406 wait complete. 2024-09-13T17:13:42.031 INFO:teuthology.orchestra.run.smithi115.stdout:true 2024-09-13T17:13:42.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:41 smithi195 ceph-mon[80021]: mds.? [v2:172.21.15.115:6828/2716683507,v1:172.21.15.115:6829/2716683507] up:boot 2024-09-13T17:13:42.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:41 smithi195 ceph-mon[80021]: fsmap cephfs:1 {0=cephfs.smithi195.aevvgz=up:active} 3 up:standby 2024-09-13T17:13:42.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:41 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi115.ijznvr"}]: dispatch 2024-09-13T17:13:42.106 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.102+0000 7fe143e60640 1 -- 172.21.15.115:0/2075320531 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe13c073170 msgr2=0x7fe13c110670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:42.106 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.102+0000 7fe143e60640 1 --2- 172.21.15.115:0/2075320531 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe13c073170 0x7fe13c110670 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe12c009880 tx=0x7fe12c02a530 comp rx=0 tx=0).stop 2024-09-13T17:13:42.106 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.102+0000 7fe143e60640 1 -- 172.21.15.115:0/2075320531 shutdown_connections 2024-09-13T17:13:42.106 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.102+0000 7fe143e60640 1 --2- 172.21.15.115:0/2075320531 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe13c073170 0x7fe13c110670 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:42.107 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.102+0000 7fe143e60640 1 --2- 172.21.15.115:0/2075320531 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe13c072850 0x7fe13c072c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:42.107 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.102+0000 7fe143e60640 1 -- 172.21.15.115:0/2075320531 >> 172.21.15.115:0/2075320531 conn(0x7fe13c0fb8e0 msgr2=0x7fe13c0fdd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:42.107 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.102+0000 7fe143e60640 1 -- 172.21.15.115:0/2075320531 shutdown_connections 2024-09-13T17:13:42.107 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.102+0000 7fe143e60640 1 -- 172.21.15.115:0/2075320531 wait complete. 2024-09-13T17:13:42.107 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.103+0000 7fe143e60640 1 Processor -- start 2024-09-13T17:13:42.107 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.103+0000 7fe143e60640 1 -- start start 2024-09-13T17:13:42.107 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.103+0000 7fe143e60640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe13c072850 0x7fe13c19c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:42.107 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.103+0000 7fe143e60640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe13c073170 0x7fe13c19c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:42.107 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.103+0000 7fe143e60640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe13c19cc90 con 0x7fe13c072850 2024-09-13T17:13:42.107 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.103+0000 7fe143e60640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe13c19ce00 con 0x7fe13c073170 2024-09-13T17:13:42.107 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.103+0000 7fe141bfc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe13c072850 0x7fe13c19c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:42.107 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.103+0000 7fe141bfc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe13c072850 0x7fe13c19c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47574/0 (socket says 172.21.15.115:47574) 2024-09-13T17:13:42.107 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.103+0000 7fe141bfc640 1 -- 172.21.15.115:0/370578152 learned_addr learned my addr 172.21.15.115:0/370578152 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:13:42.108 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.104+0000 7fe141bfc640 1 -- 172.21.15.115:0/370578152 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe13c073170 msgr2=0x7fe13c19c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:42.108 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.104+0000 7fe1413fb640 1 --2- 172.21.15.115:0/370578152 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe13c073170 0x7fe13c19c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:42.108 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.104+0000 7fe141bfc640 1 --2- 172.21.15.115:0/370578152 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe13c073170 0x7fe13c19c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:42.108 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.104+0000 7fe141bfc640 1 -- 172.21.15.115:0/370578152 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe12c009560 con 0x7fe13c072850 2024-09-13T17:13:42.108 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.104+0000 7fe141bfc640 1 --2- 172.21.15.115:0/370578152 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe13c072850 0x7fe13c19c150 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe13800c8a0 tx=0x7fe13800cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:42.108 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.104+0000 7fe132ffd640 1 -- 172.21.15.115:0/370578152 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe138007b80 con 0x7fe13c072850 2024-09-13T17:13:42.108 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.104+0000 7fe132ffd640 1 -- 172.21.15.115:0/370578152 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe138007ce0 con 0x7fe13c072850 2024-09-13T17:13:42.108 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.104+0000 7fe143e60640 1 -- 172.21.15.115:0/370578152 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe13c1a0be0 con 0x7fe13c072850 2024-09-13T17:13:42.108 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.104+0000 7fe132ffd640 1 -- 172.21.15.115:0/370578152 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe138018770 con 0x7fe13c072850 2024-09-13T17:13:42.108 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.104+0000 7fe143e60640 1 -- 172.21.15.115:0/370578152 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe13c1a1130 con 0x7fe13c072850 2024-09-13T17:13:42.109 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.105+0000 7fe143e60640 1 -- 172.21.15.115:0/370578152 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe13c073f90 con 0x7fe13c072850 2024-09-13T17:13:42.109 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.105+0000 7fe132ffd640 1 -- 172.21.15.115:0/370578152 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fe13800f450 con 0x7fe13c072850 2024-09-13T17:13:42.109 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.106+0000 7fe132ffd640 1 --2- 172.21.15.115:0/370578152 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fe12806cc50 0x7fe12806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:42.109 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.106+0000 7fe132ffd640 1 -- 172.21.15.115:0/370578152 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6242+0+0 (secure 0 0 0) 0x7fe13808c710 con 0x7fe13c072850 2024-09-13T17:13:42.109 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.106+0000 7fe1413fb640 1 --2- 172.21.15.115:0/370578152 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fe12806cc50 0x7fe12806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:42.110 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.106+0000 7fe1413fb640 1 --2- 172.21.15.115:0/370578152 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fe12806cc50 0x7fe12806f110 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe12c000c00 tx=0x7fe12c004200 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:42.112 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.110+0000 7fe132ffd640 1 -- 172.21.15.115:0/370578152 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe13805a2e0 con 0x7fe13c072850 2024-09-13T17:13:42.294 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.291+0000 7fe143e60640 1 -- 172.21.15.115:0/370578152 --> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe13c1132a0 con 0x7fe12806cc50 2024-09-13T17:13:42.295 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.293+0000 7fe132ffd640 1 -- 172.21.15.115:0/370578152 <== mgr.14660 v2:172.21.15.115:6800/1049502673 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fe13c1132a0 con 0x7fe12806cc50 2024-09-13T17:13:42.297 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.294+0000 7fe143e60640 1 -- 172.21.15.115:0/370578152 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fe12806cc50 msgr2=0x7fe12806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:42.297 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.294+0000 7fe143e60640 1 --2- 172.21.15.115:0/370578152 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fe12806cc50 0x7fe12806f110 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe12c000c00 tx=0x7fe12c004200 comp rx=0 tx=0).stop 2024-09-13T17:13:42.297 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.294+0000 7fe143e60640 1 -- 172.21.15.115:0/370578152 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe13c072850 msgr2=0x7fe13c19c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:42.297 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.294+0000 7fe143e60640 1 --2- 172.21.15.115:0/370578152 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe13c072850 0x7fe13c19c150 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe13800c8a0 tx=0x7fe13800cd60 comp rx=0 tx=0).stop 2024-09-13T17:13:42.297 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.295+0000 7fe143e60640 1 -- 172.21.15.115:0/370578152 shutdown_connections 2024-09-13T17:13:42.297 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.295+0000 7fe143e60640 1 --2- 172.21.15.115:0/370578152 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fe12806cc50 0x7fe12806f110 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:42.298 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.295+0000 7fe143e60640 1 --2- 172.21.15.115:0/370578152 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe13c073170 0x7fe13c19c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:42.298 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.295+0000 7fe143e60640 1 --2- 172.21.15.115:0/370578152 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe13c072850 0x7fe13c19c150 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:42.298 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.295+0000 7fe143e60640 1 -- 172.21.15.115:0/370578152 >> 172.21.15.115:0/370578152 conn(0x7fe13c0fb8e0 msgr2=0x7fe13c0ff8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:42.298 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.295+0000 7fe143e60640 1 -- 172.21.15.115:0/370578152 shutdown_connections 2024-09-13T17:13:42.298 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.295+0000 7fe143e60640 1 -- 172.21.15.115:0/370578152 wait complete. 2024-09-13T17:13:42.381 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.376+0000 7f01a3ab9640 1 -- 172.21.15.115:0/4259946478 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f019c0ffb40 msgr2=0x7f019c0fffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:42.381 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.377+0000 7f01a3ab9640 1 --2- 172.21.15.115:0/4259946478 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f019c0ffb40 0x7f019c0fffa0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f018c009880 tx=0x7f018c02a4a0 comp rx=0 tx=0).stop 2024-09-13T17:13:42.381 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.377+0000 7f01a3ab9640 1 -- 172.21.15.115:0/4259946478 shutdown_connections 2024-09-13T17:13:42.381 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.377+0000 7f01a3ab9640 1 --2- 172.21.15.115:0/4259946478 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f019c0ffb40 0x7f019c0fffa0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:42.381 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.377+0000 7f01a3ab9640 1 --2- 172.21.15.115:0/4259946478 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f019c105bf0 0x7f019c105fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:42.381 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.377+0000 7f01a3ab9640 1 -- 172.21.15.115:0/4259946478 >> 172.21.15.115:0/4259946478 conn(0x7f019c0fb840 msgr2=0x7f019c0fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:42.381 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.377+0000 7f01a3ab9640 1 -- 172.21.15.115:0/4259946478 shutdown_connections 2024-09-13T17:13:42.381 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.377+0000 7f01a3ab9640 1 -- 172.21.15.115:0/4259946478 wait complete. 2024-09-13T17:13:42.381 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.377+0000 7f01a3ab9640 1 Processor -- start 2024-09-13T17:13:42.381 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.377+0000 7f01a3ab9640 1 -- start start 2024-09-13T17:13:42.382 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.377+0000 7f01a3ab9640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f019c0ffb40 0x7f019c0727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:42.382 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.377+0000 7f01a3ab9640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f019c105bf0 0x7f019c072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:42.382 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.378+0000 7f01a3ab9640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f019c073230 con 0x7f019c0ffb40 2024-09-13T17:13:42.382 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.378+0000 7f01a3ab9640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f019c0733a0 con 0x7f019c105bf0 2024-09-13T17:13:42.382 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.378+0000 7f01a1855640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f019c0ffb40 0x7f019c0727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:42.382 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.378+0000 7f01a1855640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f019c0ffb40 0x7f019c0727b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47596/0 (socket says 172.21.15.115:47596) 2024-09-13T17:13:42.382 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.378+0000 7f01a1855640 1 -- 172.21.15.115:0/1618235815 learned_addr learned my addr 172.21.15.115:0/1618235815 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:13:42.382 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.378+0000 7f01a1054640 1 --2- 172.21.15.115:0/1618235815 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f019c105bf0 0x7f019c072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:42.382 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.378+0000 7f01a1855640 1 -- 172.21.15.115:0/1618235815 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f019c105bf0 msgr2=0x7f019c072cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:42.382 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.378+0000 7f01a1855640 1 --2- 172.21.15.115:0/1618235815 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f019c105bf0 0x7f019c072cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:42.382 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.378+0000 7f01a1855640 1 -- 172.21.15.115:0/1618235815 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f018c009560 con 0x7f019c0ffb40 2024-09-13T17:13:42.382 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.378+0000 7f01a1855640 1 --2- 172.21.15.115:0/1618235815 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f019c0ffb40 0x7f019c0727b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f019800d6f0 tx=0x7f019800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:42.382 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.378+0000 7f0192ffd640 1 -- 172.21.15.115:0/1618235815 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0198009a30 con 0x7f019c0ffb40 2024-09-13T17:13:42.382 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.378+0000 7f01a3ab9640 1 -- 172.21.15.115:0/1618235815 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f019c1a1b30 con 0x7f019c0ffb40 2024-09-13T17:13:42.383 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.378+0000 7f0192ffd640 1 -- 172.21.15.115:0/1618235815 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f01980054c0 con 0x7f019c0ffb40 2024-09-13T17:13:42.383 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.378+0000 7f0192ffd640 1 -- 172.21.15.115:0/1618235815 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0198004db0 con 0x7f019c0ffb40 2024-09-13T17:13:42.383 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.378+0000 7f01a3ab9640 1 -- 172.21.15.115:0/1618235815 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f019c1a1f10 con 0x7f019c0ffb40 2024-09-13T17:13:42.383 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.379+0000 7f01a3ab9640 1 -- 172.21.15.115:0/1618235815 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f019c1011f0 con 0x7f019c0ffb40 2024-09-13T17:13:42.384 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.380+0000 7f0192ffd640 1 -- 172.21.15.115:0/1618235815 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f0198004f30 con 0x7f019c0ffb40 2024-09-13T17:13:42.384 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.380+0000 7f0192ffd640 1 --2- 172.21.15.115:0/1618235815 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f018806cbf0 0x7f018806f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:42.384 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.380+0000 7f0192ffd640 1 -- 172.21.15.115:0/1618235815 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f019808c0e0 con 0x7f019c0ffb40 2024-09-13T17:13:42.384 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.380+0000 7f01a1054640 1 --2- 172.21.15.115:0/1618235815 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f018806cbf0 0x7f018806f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:42.384 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.381+0000 7f01a1054640 1 --2- 172.21.15.115:0/1618235815 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f018806cbf0 0x7f018806f0b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f019c073f30 tx=0x7f018c005a20 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:42.386 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.384+0000 7f0192ffd640 1 -- 172.21.15.115:0/1618235815 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f01980561a0 con 0x7f019c0ffb40 2024-09-13T17:13:42.558 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.556+0000 7f01a3ab9640 1 -- 172.21.15.115:0/1618235815 --> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f019c073db0 con 0x7f018806cbf0 2024-09-13T17:13:42.567 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.565+0000 7f0192ffd640 1 -- 172.21.15.115:0/1618235815 <== mgr.14660 v2:172.21.15.115:6800/1049502673 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f018c004440 con 0x7f018806cbf0 2024-09-13T17:13:42.568 INFO:teuthology.orchestra.run.smithi115.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T17:13:42.568 INFO:teuthology.orchestra.run.smithi115.stdout:alertmanager.smithi115 smithi115 *:9093,9094 running (5m) 20s ago 15m 25.0M - 0.25.0 c8568f914cd2 d56b91240fe1 2024-09-13T17:13:42.568 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-exporter.smithi115 smithi115 running (15m) 20s ago 15m 8526k - 18.2.4-843-g2c01458a c129f5a2fd4e 0f1eebeaf9bb 2024-09-13T17:13:42.568 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-exporter.smithi195 smithi195 running (15m) 38s ago 15m 8032k - 18.2.4-843-g2c01458a c129f5a2fd4e 6d05bafbac8a 2024-09-13T17:13:42.568 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi115 smithi115 running (3m) 20s ago 15m 6895k - 18.2.4-860-g6c6b083f 8a91f241d7d4 e8175bc055bf 2024-09-13T17:13:42.568 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi195 smithi195 running (3m) 38s ago 14m 6903k - 18.2.4-860-g6c6b083f 8a91f241d7d4 ccb4895be776 2024-09-13T17:13:42.568 INFO:teuthology.orchestra.run.smithi115.stdout:grafana.smithi115 smithi115 *:3000 running (5m) 20s ago 15m 86.5M - 9.4.7 954c08fa6188 e1eccb1a8f3e 2024-09-13T17:13:42.568 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi115.hbtxod smithi115 running (25s) 20s ago 10m 15.2M - 18.2.4-860-g6c6b083f 8a91f241d7d4 9221253d5ed4 2024-09-13T17:13:42.568 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi115.ijznvr smithi115 starting - - - - 2024-09-13T17:13:42.568 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi195.aevvgz smithi195 running (10m) 38s ago 10m 18.8M - 18.2.4-843-g2c01458a c129f5a2fd4e 299b9ad657c9 2024-09-13T17:13:42.569 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi195.qzghxj smithi195 running (10m) 38s ago 10m 16.7M - 18.2.4-843-g2c01458a c129f5a2fd4e fb16b16181ff 2024-09-13T17:13:42.569 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi115.hetcni smithi115 *:8443,9283,8765 running (7m) 20s ago 17m 497M - 18.2.4-860-g6c6b083f 8a91f241d7d4 b945dbde1934 2024-09-13T17:13:42.569 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi195.hjjifz smithi195 *:8443,9283,8765 running (6m) 38s ago 14m 442M - 18.2.4-860-g6c6b083f 8a91f241d7d4 17bccdfbcae1 2024-09-13T17:13:42.569 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi115 smithi115 running (4m) 20s ago 17m 46.2M 2048M 18.2.4-860-g6c6b083f 8a91f241d7d4 8dd7baf2c6b6 2024-09-13T17:13:42.569 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi195 smithi195 running (3m) 38s ago 14m 36.7M 2048M 18.2.4-860-g6c6b083f 8a91f241d7d4 0459bc5e6b08 2024-09-13T17:13:42.569 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi115 smithi115 *:9100 running (6m) 20s ago 15m 17.0M - 1.5.0 0da6a335fe13 26fb6f9844b5 2024-09-13T17:13:42.569 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi195 smithi195 *:9100 running (6m) 38s ago 14m 17.3M - 1.5.0 0da6a335fe13 6d38e798fb16 2024-09-13T17:13:42.569 INFO:teuthology.orchestra.run.smithi115.stdout:osd.0 smithi115 running (3m) 20s ago 13m 104M 1216M 18.2.4-860-g6c6b083f 8a91f241d7d4 3b9f874c64e9 2024-09-13T17:13:42.569 INFO:teuthology.orchestra.run.smithi115.stdout:osd.1 smithi115 running (2m) 20s ago 13m 104M 1216M 18.2.4-860-g6c6b083f 8a91f241d7d4 f0de6684601c 2024-09-13T17:13:42.569 INFO:teuthology.orchestra.run.smithi115.stdout:osd.2 smithi115 running (2m) 20s ago 13m 91.1M 1216M 18.2.4-860-g6c6b083f 8a91f241d7d4 edb753bab54a 2024-09-13T17:13:42.569 INFO:teuthology.orchestra.run.smithi115.stdout:osd.3 smithi195 running (103s) 38s ago 12m 109M 2240M 18.2.4-860-g6c6b083f 8a91f241d7d4 ccd1b2bf7d86 2024-09-13T17:13:42.569 INFO:teuthology.orchestra.run.smithi115.stdout:osd.4 smithi195 running (72s) 38s ago 12m 102M 2240M 18.2.4-860-g6c6b083f 8a91f241d7d4 c88b3dacb207 2024-09-13T17:13:42.569 INFO:teuthology.orchestra.run.smithi115.stdout:osd.5 smithi195 running (42s) 38s ago 11m 12.1M 2240M 18.2.4-860-g6c6b083f 8a91f241d7d4 40ccbc2f5195 2024-09-13T17:13:42.570 INFO:teuthology.orchestra.run.smithi115.stdout:prometheus.smithi115 smithi115 *:9095 running (5m) 20s ago 15m 64.5M - 2.43.0 a07b618ecd1d e03fb39f6b76 2024-09-13T17:13:42.570 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.568+0000 7f01a3ab9640 1 -- 172.21.15.115:0/1618235815 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f018806cbf0 msgr2=0x7f018806f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:42.570 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.568+0000 7f01a3ab9640 1 --2- 172.21.15.115:0/1618235815 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f018806cbf0 0x7f018806f0b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f019c073f30 tx=0x7f018c005a20 comp rx=0 tx=0).stop 2024-09-13T17:13:42.571 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.568+0000 7f01a3ab9640 1 -- 172.21.15.115:0/1618235815 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f019c0ffb40 msgr2=0x7f019c0727b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:42.571 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.568+0000 7f01a3ab9640 1 --2- 172.21.15.115:0/1618235815 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f019c0ffb40 0x7f019c0727b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f019800d6f0 tx=0x7f019800dbb0 comp rx=0 tx=0).stop 2024-09-13T17:13:42.571 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.568+0000 7f01a3ab9640 1 -- 172.21.15.115:0/1618235815 shutdown_connections 2024-09-13T17:13:42.571 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.568+0000 7f01a3ab9640 1 --2- 172.21.15.115:0/1618235815 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f018806cbf0 0x7f018806f0b0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:42.571 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.568+0000 7f01a3ab9640 1 --2- 172.21.15.115:0/1618235815 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f019c105bf0 0x7f019c072cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:42.571 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.568+0000 7f01a3ab9640 1 --2- 172.21.15.115:0/1618235815 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f019c0ffb40 0x7f019c0727b0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:42.571 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.568+0000 7f01a3ab9640 1 -- 172.21.15.115:0/1618235815 >> 172.21.15.115:0/1618235815 conn(0x7f019c0fb840 msgr2=0x7f019c0fd960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:42.571 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.568+0000 7f01a3ab9640 1 -- 172.21.15.115:0/1618235815 shutdown_connections 2024-09-13T17:13:42.571 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.568+0000 7f01a3ab9640 1 -- 172.21.15.115:0/1618235815 wait complete. 2024-09-13T17:13:42.658 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.655+0000 7f86f173a640 1 -- 172.21.15.115:0/4001256533 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86ec0ffaf0 msgr2=0x7f86ec0fff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:42.658 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.655+0000 7f86f173a640 1 --2- 172.21.15.115:0/4001256533 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86ec0ffaf0 0x7f86ec0fff50 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f86d4009880 tx=0x7f86d402a4a0 comp rx=0 tx=0).stop 2024-09-13T17:13:42.658 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.655+0000 7f86f173a640 1 -- 172.21.15.115:0/4001256533 shutdown_connections 2024-09-13T17:13:42.659 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.655+0000 7f86f173a640 1 --2- 172.21.15.115:0/4001256533 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86ec0ffaf0 0x7f86ec0fff50 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:42.659 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.655+0000 7f86f173a640 1 --2- 172.21.15.115:0/4001256533 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f86ec105b80 0x7f86ec105f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:42.659 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.655+0000 7f86f173a640 1 -- 172.21.15.115:0/4001256533 >> 172.21.15.115:0/4001256533 conn(0x7f86ec0fb810 msgr2=0x7f86ec0fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:42.659 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.656+0000 7f86f173a640 1 -- 172.21.15.115:0/4001256533 shutdown_connections 2024-09-13T17:13:42.659 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.656+0000 7f86f173a640 1 -- 172.21.15.115:0/4001256533 wait complete. 2024-09-13T17:13:42.659 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.656+0000 7f86f173a640 1 Processor -- start 2024-09-13T17:13:42.659 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.656+0000 7f86f173a640 1 -- start start 2024-09-13T17:13:42.660 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.656+0000 7f86f173a640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f86ec0ffaf0 0x7f86ec1959f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:42.660 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.656+0000 7f86f173a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86ec105b80 0x7f86ec195f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:42.660 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.656+0000 7f86f173a640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86ec196610 con 0x7f86ec105b80 2024-09-13T17:13:42.660 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.656+0000 7f86f173a640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86ec19a360 con 0x7f86ec0ffaf0 2024-09-13T17:13:42.660 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.657+0000 7f86e3fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86ec105b80 0x7f86ec195f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:42.660 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.657+0000 7f86e3fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86ec105b80 0x7f86ec195f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47612/0 (socket says 172.21.15.115:47612) 2024-09-13T17:13:42.660 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.657+0000 7f86e3fff640 1 -- 172.21.15.115:0/3822575252 learned_addr learned my addr 172.21.15.115:0/3822575252 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:13:42.661 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.657+0000 7f86eaffd640 1 --2- 172.21.15.115:0/3822575252 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f86ec0ffaf0 0x7f86ec1959f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:42.661 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.657+0000 7f86e3fff640 1 -- 172.21.15.115:0/3822575252 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f86ec0ffaf0 msgr2=0x7f86ec1959f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:42.661 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.657+0000 7f86e3fff640 1 --2- 172.21.15.115:0/3822575252 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f86ec0ffaf0 0x7f86ec1959f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:42.661 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.657+0000 7f86e3fff640 1 -- 172.21.15.115:0/3822575252 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86d4009560 con 0x7f86ec105b80 2024-09-13T17:13:42.661 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.657+0000 7f86e3fff640 1 --2- 172.21.15.115:0/3822575252 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86ec105b80 0x7f86ec195f30 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f86d402a9c0 tx=0x7f86d40055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:42.661 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.657+0000 7f86e8ff9640 1 -- 172.21.15.115:0/3822575252 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f86d4004aa0 con 0x7f86ec105b80 2024-09-13T17:13:42.661 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.657+0000 7f86f173a640 1 -- 172.21.15.115:0/3822575252 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86ec19a5e0 con 0x7f86ec105b80 2024-09-13T17:13:42.661 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.657+0000 7f86e8ff9640 1 -- 172.21.15.115:0/3822575252 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f86d4004c00 con 0x7f86ec105b80 2024-09-13T17:13:42.661 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.657+0000 7f86e8ff9640 1 -- 172.21.15.115:0/3822575252 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f86d4031750 con 0x7f86ec105b80 2024-09-13T17:13:42.661 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.657+0000 7f86f173a640 1 -- 172.21.15.115:0/3822575252 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86ec19aad0 con 0x7f86ec105b80 2024-09-13T17:13:42.662 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.659+0000 7f86f173a640 1 -- 172.21.15.115:0/3822575252 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86ec1011f0 con 0x7f86ec105b80 2024-09-13T17:13:42.662 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.659+0000 7f86e8ff9640 1 -- 172.21.15.115:0/3822575252 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f86d40319e0 con 0x7f86ec105b80 2024-09-13T17:13:42.662 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.660+0000 7f86e8ff9640 1 --2- 172.21.15.115:0/3822575252 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f86d806cc50 0x7f86d806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:42.662 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.660+0000 7f86e8ff9640 1 -- 172.21.15.115:0/3822575252 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f86d40ad480 con 0x7f86ec105b80 2024-09-13T17:13:42.662 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.660+0000 7f86eaffd640 1 --2- 172.21.15.115:0/3822575252 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f86d806cc50 0x7f86d806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:42.663 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.660+0000 7f86eaffd640 1 --2- 172.21.15.115:0/3822575252 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f86d806cc50 0x7f86d806f110 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f86dc009b60 tx=0x7f86dc005f90 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:42.667 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.665+0000 7f86e8ff9640 1 -- 172.21.15.115:0/3822575252 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f86d40775c0 con 0x7f86ec105b80 2024-09-13T17:13:42.902 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:42 smithi115 ceph-mon[109488]: pgmap v248: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 85 B/s wr, 6 op/s 2024-09-13T17:13:42.906 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.904+0000 7f86f173a640 1 -- 172.21.15.115:0/3822575252 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f86ec108080 con 0x7f86ec105b80 2024-09-13T17:13:42.906 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.904+0000 7f86e8ff9640 1 -- 172.21.15.115:0/3822575252 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+838 (secure 0 0 0) 0x7f86d407abe0 con 0x7f86ec105b80 2024-09-13T17:13:42.906 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-13T17:13:42.907 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": { 2024-09-13T17:13:42.907 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 2 2024-09-13T17:13:42.907 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T17:13:42.907 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": { 2024-09-13T17:13:42.907 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 2 2024-09-13T17:13:42.907 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T17:13:42.907 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": { 2024-09-13T17:13:42.907 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 6 2024-09-13T17:13:42.907 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T17:13:42.907 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": { 2024-09-13T17:13:42.907 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-843-g2c01458a (2c01458affee2b2435cd231b6e392435c1c21661) reef (stable)": 2, 2024-09-13T17:13:42.907 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 2 2024-09-13T17:13:42.907 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T17:13:42.907 INFO:teuthology.orchestra.run.smithi115.stdout: "overall": { 2024-09-13T17:13:42.908 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-843-g2c01458a (2c01458affee2b2435cd231b6e392435c1c21661) reef (stable)": 2, 2024-09-13T17:13:42.908 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 12 2024-09-13T17:13:42.908 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-13T17:13:42.908 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-13T17:13:42.909 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.906+0000 7f86f173a640 1 -- 172.21.15.115:0/3822575252 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f86d806cc50 msgr2=0x7f86d806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:42.909 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.906+0000 7f86f173a640 1 --2- 172.21.15.115:0/3822575252 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f86d806cc50 0x7f86d806f110 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f86dc009b60 tx=0x7f86dc005f90 comp rx=0 tx=0).stop 2024-09-13T17:13:42.909 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.906+0000 7f86f173a640 1 -- 172.21.15.115:0/3822575252 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86ec105b80 msgr2=0x7f86ec195f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:42.909 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.906+0000 7f86f173a640 1 --2- 172.21.15.115:0/3822575252 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86ec105b80 0x7f86ec195f30 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f86d402a9c0 tx=0x7f86d40055a0 comp rx=0 tx=0).stop 2024-09-13T17:13:42.909 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.906+0000 7f86f173a640 1 -- 172.21.15.115:0/3822575252 shutdown_connections 2024-09-13T17:13:42.909 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.906+0000 7f86f173a640 1 --2- 172.21.15.115:0/3822575252 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f86d806cc50 0x7f86d806f110 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:42.909 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.906+0000 7f86f173a640 1 --2- 172.21.15.115:0/3822575252 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86ec105b80 0x7f86ec195f30 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:42.909 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.906+0000 7f86f173a640 1 --2- 172.21.15.115:0/3822575252 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f86ec0ffaf0 0x7f86ec1959f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:42.910 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.906+0000 7f86f173a640 1 -- 172.21.15.115:0/3822575252 >> 172.21.15.115:0/3822575252 conn(0x7f86ec0fb810 msgr2=0x7f86ec0fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:42.910 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.907+0000 7f86f173a640 1 -- 172.21.15.115:0/3822575252 shutdown_connections 2024-09-13T17:13:42.910 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.907+0000 7f86f173a640 1 -- 172.21.15.115:0/3822575252 wait complete. 2024-09-13T17:13:42.999 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.997+0000 7f9df0b88640 1 -- 172.21.15.115:0/1922723915 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9dec104a10 msgr2=0x7f9dec104df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:42.999 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.997+0000 7f9df0b88640 1 --2- 172.21.15.115:0/1922723915 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9dec104a10 0x7f9dec104df0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc009880 tx=0x7f9ddc02a4a0 comp rx=0 tx=0).stop 2024-09-13T17:13:42.999 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.997+0000 7f9df0b88640 1 -- 172.21.15.115:0/1922723915 shutdown_connections 2024-09-13T17:13:43.000 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.997+0000 7f9df0b88640 1 --2- 172.21.15.115:0/1922723915 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9dec0fea10 0x7f9dec0fee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.000 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.997+0000 7f9df0b88640 1 --2- 172.21.15.115:0/1922723915 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9dec104a10 0x7f9dec104df0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.000 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.997+0000 7f9df0b88640 1 -- 172.21.15.115:0/1922723915 >> 172.21.15.115:0/1922723915 conn(0x7f9dec0fa730 msgr2=0x7f9dec0fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:43.000 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.997+0000 7f9df0b88640 1 -- 172.21.15.115:0/1922723915 shutdown_connections 2024-09-13T17:13:43.000 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.997+0000 7f9df0b88640 1 -- 172.21.15.115:0/1922723915 wait complete. 2024-09-13T17:13:43.002 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.997+0000 7f9df0b88640 1 Processor -- start 2024-09-13T17:13:43.002 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.998+0000 7f9df0b88640 1 -- start start 2024-09-13T17:13:43.002 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.998+0000 7f9df0b88640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9dec0fea10 0x7f9dec19b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:43.002 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.998+0000 7f9df0b88640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9dec104a10 0x7f9dec19bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:43.002 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.998+0000 7f9df0b88640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dec19c3b0 con 0x7f9dec104a10 2024-09-13T17:13:43.002 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.998+0000 7f9df0b88640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dec195940 con 0x7f9dec0fea10 2024-09-13T17:13:43.002 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.998+0000 7f9de9d9b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9dec104a10 0x7f9dec19bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:43.002 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.998+0000 7f9de9d9b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9dec104a10 0x7f9dec19bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47644/0 (socket says 172.21.15.115:47644) 2024-09-13T17:13:43.002 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.998+0000 7f9de9d9b640 1 -- 172.21.15.115:0/3714325211 learned_addr learned my addr 172.21.15.115:0/3714325211 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:13:43.002 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.998+0000 7f9dea59c640 1 --2- 172.21.15.115:0/3714325211 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9dec0fea10 0x7f9dec19b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:43.002 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.998+0000 7f9de9d9b640 1 -- 172.21.15.115:0/3714325211 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9dec0fea10 msgr2=0x7f9dec19b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:43.003 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.998+0000 7f9de9d9b640 1 --2- 172.21.15.115:0/3714325211 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9dec0fea10 0x7f9dec19b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.003 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.998+0000 7f9de9d9b640 1 -- 172.21.15.115:0/3714325211 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ddc009560 con 0x7f9dec104a10 2024-09-13T17:13:43.003 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.998+0000 7f9de9d9b640 1 --2- 172.21.15.115:0/3714325211 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9dec104a10 0x7f9dec19bd90 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9dd400b420 tx=0x7f9dd400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:43.003 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.999+0000 7f9de37fe640 1 -- 172.21.15.115:0/3714325211 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9dd4011800 con 0x7f9dec104a10 2024-09-13T17:13:43.003 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.999+0000 7f9de37fe640 1 -- 172.21.15.115:0/3714325211 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9dd4011e00 con 0x7f9dec104a10 2024-09-13T17:13:43.003 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.999+0000 7f9de37fe640 1 -- 172.21.15.115:0/3714325211 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9dd400f2e0 con 0x7f9dec104a10 2024-09-13T17:13:43.003 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.999+0000 7f9df0b88640 1 -- 172.21.15.115:0/3714325211 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dec195c20 con 0x7f9dec104a10 2024-09-13T17:13:43.003 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:42.999+0000 7f9df0b88640 1 -- 172.21.15.115:0/3714325211 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dec196170 con 0x7f9dec104a10 2024-09-13T17:13:43.003 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.000+0000 7f9df0b88640 1 -- 172.21.15.115:0/3714325211 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dec100150 con 0x7f9dec104a10 2024-09-13T17:13:43.004 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.000+0000 7f9de37fe640 1 -- 172.21.15.115:0/3714325211 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f9dd4010380 con 0x7f9dec104a10 2024-09-13T17:13:43.004 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.000+0000 7f9de37fe640 1 --2- 172.21.15.115:0/3714325211 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f9dd806cc50 0x7f9dd806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:43.004 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.001+0000 7f9de37fe640 1 -- 172.21.15.115:0/3714325211 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f9dd408be50 con 0x7f9dec104a10 2024-09-13T17:13:43.004 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.001+0000 7f9dea59c640 1 --2- 172.21.15.115:0/3714325211 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f9dd806cc50 0x7f9dd806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:43.004 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.001+0000 7f9dea59c640 1 --2- 172.21.15.115:0/3714325211 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f9dd806cc50 0x7f9dd806f110 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc000c00 tx=0x7f9ddc0058d0 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:43.007 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.005+0000 7f9de37fe640 1 -- 172.21.15.115:0/3714325211 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f9dd4055f10 con 0x7f9dec104a10 2024-09-13T17:13:43.076 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:42 smithi195 ceph-mon[80021]: pgmap v248: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 85 B/s wr, 6 op/s 2024-09-13T17:13:43.207 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.205+0000 7f9df0b88640 1 -- 172.21.15.115:0/3714325211 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9dec0feef0 con 0x7f9dec104a10 2024-09-13T17:13:43.207 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.205+0000 7f9de37fe640 1 -- 172.21.15.115:0/3714325211 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 29 v29) v1 ==== 76+0+1849 (secure 0 0 0) 0x7f9dd4059530 con 0x7f9dec104a10 2024-09-13T17:13:43.208 INFO:teuthology.orchestra.run.smithi115.stdout:e29 2024-09-13T17:13:43.208 INFO:teuthology.orchestra.run.smithi115.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T17:13:43.208 INFO:teuthology.orchestra.run.smithi115.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T17:13:43.208 INFO:teuthology.orchestra.run.smithi115.stdout:legacy client fscid: 1 2024-09-13T17:13:43.208 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:13:43.208 INFO:teuthology.orchestra.run.smithi115.stdout:Filesystem 'cephfs' (1) 2024-09-13T17:13:43.208 INFO:teuthology.orchestra.run.smithi115.stdout:fs_name cephfs 2024-09-13T17:13:43.208 INFO:teuthology.orchestra.run.smithi115.stdout:epoch 28 2024-09-13T17:13:43.208 INFO:teuthology.orchestra.run.smithi115.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T17:13:43.208 INFO:teuthology.orchestra.run.smithi115.stdout:created 2024-09-13T17:03:16.313116+0000 2024-09-13T17:13:43.208 INFO:teuthology.orchestra.run.smithi115.stdout:modified 2024-09-13T17:13:38.717470+0000 2024-09-13T17:13:43.209 INFO:teuthology.orchestra.run.smithi115.stdout:tableserver 0 2024-09-13T17:13:43.209 INFO:teuthology.orchestra.run.smithi115.stdout:root 0 2024-09-13T17:13:43.209 INFO:teuthology.orchestra.run.smithi115.stdout:session_timeout 60 2024-09-13T17:13:43.209 INFO:teuthology.orchestra.run.smithi115.stdout:session_autoclose 300 2024-09-13T17:13:43.209 INFO:teuthology.orchestra.run.smithi115.stdout:max_file_size 1099511627776 2024-09-13T17:13:43.209 INFO:teuthology.orchestra.run.smithi115.stdout:max_xattr_size 65536 2024-09-13T17:13:43.209 INFO:teuthology.orchestra.run.smithi115.stdout:required_client_features {} 2024-09-13T17:13:43.209 INFO:teuthology.orchestra.run.smithi115.stdout:last_failure 0 2024-09-13T17:13:43.209 INFO:teuthology.orchestra.run.smithi115.stdout:last_failure_osd_epoch 80 2024-09-13T17:13:43.209 INFO:teuthology.orchestra.run.smithi115.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T17:13:43.209 INFO:teuthology.orchestra.run.smithi115.stdout:max_mds 1 2024-09-13T17:13:43.209 INFO:teuthology.orchestra.run.smithi115.stdout:in 0 2024-09-13T17:13:43.209 INFO:teuthology.orchestra.run.smithi115.stdout:up {0=24253} 2024-09-13T17:13:43.209 INFO:teuthology.orchestra.run.smithi115.stdout:failed 2024-09-13T17:13:43.210 INFO:teuthology.orchestra.run.smithi115.stdout:damaged 2024-09-13T17:13:43.210 INFO:teuthology.orchestra.run.smithi115.stdout:stopped 2024-09-13T17:13:43.210 INFO:teuthology.orchestra.run.smithi115.stdout:data_pools [3] 2024-09-13T17:13:43.210 INFO:teuthology.orchestra.run.smithi115.stdout:metadata_pool 2 2024-09-13T17:13:43.210 INFO:teuthology.orchestra.run.smithi115.stdout:inline_data enabled 2024-09-13T17:13:43.210 INFO:teuthology.orchestra.run.smithi115.stdout:balancer 2024-09-13T17:13:43.210 INFO:teuthology.orchestra.run.smithi115.stdout:bal_rank_mask -1 2024-09-13T17:13:43.210 INFO:teuthology.orchestra.run.smithi115.stdout:standby_count_wanted 1 2024-09-13T17:13:43.210 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi195.aevvgz{0:24253} state up:active seq 155 join_fscid=1 addr [v2:172.21.15.195:6826/8826118,v1:172.21.15.195:6827/8826118] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T17:13:43.210 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:13:43.210 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:13:43.210 INFO:teuthology.orchestra.run.smithi115.stdout:Standby daemons: 2024-09-13T17:13:43.211 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:13:43.211 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi195.qzghxj{-1:24259} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.195:6824/3335357704,v1:172.21.15.195:6825/3335357704] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T17:13:43.211 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi115.hbtxod{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.115:6826/2768011029,v1:172.21.15.115:6827/2768011029] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T17:13:43.211 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi115.ijznvr{-1:34324} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.115:6828/2716683507,v1:172.21.15.115:6829/2716683507] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T17:13:43.212 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 29 2024-09-13T17:13:43.212 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.208+0000 7f9df0b88640 1 -- 172.21.15.115:0/3714325211 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f9dd806cc50 msgr2=0x7f9dd806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:43.212 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.208+0000 7f9df0b88640 1 --2- 172.21.15.115:0/3714325211 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f9dd806cc50 0x7f9dd806f110 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc000c00 tx=0x7f9ddc0058d0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.212 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.208+0000 7f9df0b88640 1 -- 172.21.15.115:0/3714325211 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9dec104a10 msgr2=0x7f9dec19bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:43.212 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.208+0000 7f9df0b88640 1 --2- 172.21.15.115:0/3714325211 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9dec104a10 0x7f9dec19bd90 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9dd400b420 tx=0x7f9dd400b8e0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.212 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.208+0000 7f9df0b88640 1 -- 172.21.15.115:0/3714325211 shutdown_connections 2024-09-13T17:13:43.212 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.208+0000 7f9df0b88640 1 --2- 172.21.15.115:0/3714325211 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f9dd806cc50 0x7f9dd806f110 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.212 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.208+0000 7f9df0b88640 1 --2- 172.21.15.115:0/3714325211 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9dec104a10 0x7f9dec19bd90 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.212 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.208+0000 7f9df0b88640 1 --2- 172.21.15.115:0/3714325211 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9dec0fea10 0x7f9dec19b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.212 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.208+0000 7f9df0b88640 1 -- 172.21.15.115:0/3714325211 >> 172.21.15.115:0/3714325211 conn(0x7f9dec0fa730 msgr2=0x7f9dec068c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:43.212 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.208+0000 7f9df0b88640 1 -- 172.21.15.115:0/3714325211 shutdown_connections 2024-09-13T17:13:43.212 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.208+0000 7f9df0b88640 1 -- 172.21.15.115:0/3714325211 wait complete. 2024-09-13T17:13:43.294 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.291+0000 7fabc4d3d640 1 -- 172.21.15.115:0/653144307 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fabc00fe9f0 msgr2=0x7fabc00fee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:43.294 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.291+0000 7fabc4d3d640 1 --2- 172.21.15.115:0/653144307 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fabc00fe9f0 0x7fabc00fee50 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fabb4009880 tx=0x7fabb402a4a0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.294 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.292+0000 7fabc4d3d640 1 -- 172.21.15.115:0/653144307 shutdown_connections 2024-09-13T17:13:43.294 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.292+0000 7fabc4d3d640 1 --2- 172.21.15.115:0/653144307 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fabc00fe9f0 0x7fabc00fee50 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.294 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.292+0000 7fabc4d3d640 1 --2- 172.21.15.115:0/653144307 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fabc01049f0 0x7fabc0104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.294 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.292+0000 7fabc4d3d640 1 -- 172.21.15.115:0/653144307 >> 172.21.15.115:0/653144307 conn(0x7fabc00fa710 msgr2=0x7fabc00fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:43.295 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.292+0000 7fabc4d3d640 1 -- 172.21.15.115:0/653144307 shutdown_connections 2024-09-13T17:13:43.295 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.292+0000 7fabc4d3d640 1 -- 172.21.15.115:0/653144307 wait complete. 2024-09-13T17:13:43.296 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.292+0000 7fabc4d3d640 1 Processor -- start 2024-09-13T17:13:43.297 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.292+0000 7fabc4d3d640 1 -- start start 2024-09-13T17:13:43.297 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.293+0000 7fabc4d3d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fabc00fe9f0 0x7fabc019b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:43.297 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.293+0000 7fabc4d3d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fabc01049f0 0x7fabc019bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:43.297 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.293+0000 7fabc4d3d640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabc019c3c0 con 0x7fabc00fe9f0 2024-09-13T17:13:43.297 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.293+0000 7fabc4d3d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabc0195950 con 0x7fabc01049f0 2024-09-13T17:13:43.297 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.293+0000 7fabbe59c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fabc00fe9f0 0x7fabc019b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:43.297 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.293+0000 7fabbe59c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fabc00fe9f0 0x7fabc019b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47662/0 (socket says 172.21.15.115:47662) 2024-09-13T17:13:43.297 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.293+0000 7fabbe59c640 1 -- 172.21.15.115:0/1316696132 learned_addr learned my addr 172.21.15.115:0/1316696132 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:13:43.297 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.293+0000 7fabbdd9b640 1 --2- 172.21.15.115:0/1316696132 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fabc01049f0 0x7fabc019bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:43.297 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.293+0000 7fabbe59c640 1 -- 172.21.15.115:0/1316696132 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fabc01049f0 msgr2=0x7fabc019bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:43.297 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.293+0000 7fabbe59c640 1 --2- 172.21.15.115:0/1316696132 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fabc01049f0 0x7fabc019bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.297 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.293+0000 7fabbe59c640 1 -- 172.21.15.115:0/1316696132 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabb4009560 con 0x7fabc00fe9f0 2024-09-13T17:13:43.298 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.293+0000 7fabbdd9b640 1 --2- 172.21.15.115:0/1316696132 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fabc01049f0 0x7fabc019bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:43.298 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.293+0000 7fabbe59c640 1 --2- 172.21.15.115:0/1316696132 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fabc00fe9f0 0x7fabc019b860 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fabb000ba50 tx=0x7fabb000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:43.298 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.293+0000 7fabaf7fe640 1 -- 172.21.15.115:0/1316696132 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fabb000cb30 con 0x7fabc00fe9f0 2024-09-13T17:13:43.298 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.293+0000 7fabaf7fe640 1 -- 172.21.15.115:0/1316696132 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fabb000cc90 con 0x7fabc00fe9f0 2024-09-13T17:13:43.298 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.293+0000 7fabaf7fe640 1 -- 172.21.15.115:0/1316696132 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fabb0007690 con 0x7fabc00fe9f0 2024-09-13T17:13:43.298 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.293+0000 7fabc4d3d640 1 -- 172.21.15.115:0/1316696132 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabc0195c30 con 0x7fabc00fe9f0 2024-09-13T17:13:43.298 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.294+0000 7fabc4d3d640 1 -- 172.21.15.115:0/1316696132 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabc0196130 con 0x7fabc00fe9f0 2024-09-13T17:13:43.298 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.294+0000 7fabc4d3d640 1 -- 172.21.15.115:0/1316696132 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabc0100130 con 0x7fabc00fe9f0 2024-09-13T17:13:43.299 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.295+0000 7fabaf7fe640 1 -- 172.21.15.115:0/1316696132 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fabb0014ae0 con 0x7fabc00fe9f0 2024-09-13T17:13:43.299 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.295+0000 7fabaf7fe640 1 --2- 172.21.15.115:0/1316696132 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7faba806cc50 0x7faba806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:43.299 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.295+0000 7fabaf7fe640 1 -- 172.21.15.115:0/1316696132 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6242+0+0 (secure 0 0 0) 0x7fabb008bf00 con 0x7fabc00fe9f0 2024-09-13T17:13:43.299 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.295+0000 7fabbdd9b640 1 --2- 172.21.15.115:0/1316696132 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7faba806cc50 0x7faba806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:43.299 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.296+0000 7fabbdd9b640 1 --2- 172.21.15.115:0/1316696132 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7faba806cc50 0x7faba806f110 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fabc0196dc0 tx=0x7fabb4005a20 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:43.302 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.300+0000 7fabaf7fe640 1 -- 172.21.15.115:0/1316696132 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fabb0059b00 con 0x7fabc00fe9f0 2024-09-13T17:13:43.503 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.501+0000 7fabc4d3d640 1 -- 172.21.15.115:0/1316696132 --> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fabc0107fe0 con 0x7faba806cc50 2024-09-13T17:13:43.504 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.502+0000 7fabaf7fe640 1 -- 172.21.15.115:0/1316696132 <== mgr.14660 v2:172.21.15.115:6800/1049502673 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fabc0107fe0 con 0x7faba806cc50 2024-09-13T17:13:43.504 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-13T17:13:43.504 INFO:teuthology.orchestra.run.smithi115.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256", 2024-09-13T17:13:43.504 INFO:teuthology.orchestra.run.smithi115.stdout: "in_progress": true, 2024-09-13T17:13:43.504 INFO:teuthology.orchestra.run.smithi115.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T17:13:43.505 INFO:teuthology.orchestra.run.smithi115.stdout: "services_complete": [ 2024-09-13T17:13:43.505 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr", 2024-09-13T17:13:43.505 INFO:teuthology.orchestra.run.smithi115.stdout: "osd", 2024-09-13T17:13:43.505 INFO:teuthology.orchestra.run.smithi115.stdout: "mon", 2024-09-13T17:13:43.505 INFO:teuthology.orchestra.run.smithi115.stdout: "crash" 2024-09-13T17:13:43.505 INFO:teuthology.orchestra.run.smithi115.stdout: ], 2024-09-13T17:13:43.505 INFO:teuthology.orchestra.run.smithi115.stdout: "progress": "13/23 daemons upgraded", 2024-09-13T17:13:43.505 INFO:teuthology.orchestra.run.smithi115.stdout: "message": "Currently upgrading mds daemons", 2024-09-13T17:13:43.505 INFO:teuthology.orchestra.run.smithi115.stdout: "is_paused": false 2024-09-13T17:13:43.505 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-13T17:13:43.507 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.504+0000 7fabc4d3d640 1 -- 172.21.15.115:0/1316696132 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7faba806cc50 msgr2=0x7faba806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:43.507 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.504+0000 7fabc4d3d640 1 --2- 172.21.15.115:0/1316696132 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7faba806cc50 0x7faba806f110 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fabc0196dc0 tx=0x7fabb4005a20 comp rx=0 tx=0).stop 2024-09-13T17:13:43.507 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.504+0000 7fabc4d3d640 1 -- 172.21.15.115:0/1316696132 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fabc00fe9f0 msgr2=0x7fabc019b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:43.507 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.504+0000 7fabc4d3d640 1 --2- 172.21.15.115:0/1316696132 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fabc00fe9f0 0x7fabc019b860 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fabb000ba50 tx=0x7fabb000bf10 comp rx=0 tx=0).stop 2024-09-13T17:13:43.507 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.505+0000 7fabc4d3d640 1 -- 172.21.15.115:0/1316696132 shutdown_connections 2024-09-13T17:13:43.507 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.505+0000 7fabc4d3d640 1 --2- 172.21.15.115:0/1316696132 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7faba806cc50 0x7faba806f110 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.507 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.505+0000 7fabc4d3d640 1 --2- 172.21.15.115:0/1316696132 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fabc01049f0 0x7fabc019bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.507 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.505+0000 7fabc4d3d640 1 --2- 172.21.15.115:0/1316696132 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fabc00fe9f0 0x7fabc019b860 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.507 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.505+0000 7fabc4d3d640 1 -- 172.21.15.115:0/1316696132 >> 172.21.15.115:0/1316696132 conn(0x7fabc00fa710 msgr2=0x7fabc0068c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:43.507 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.505+0000 7fabc4d3d640 1 -- 172.21.15.115:0/1316696132 shutdown_connections 2024-09-13T17:13:43.507 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.505+0000 7fabc4d3d640 1 -- 172.21.15.115:0/1316696132 wait complete. 2024-09-13T17:13:43.588 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.586+0000 7f73632ee640 1 -- 172.21.15.115:0/3886568970 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f735c105bf0 msgr2=0x7f735c105fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:43.589 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.586+0000 7f73632ee640 1 --2- 172.21.15.115:0/3886568970 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f735c105bf0 0x7f735c105fd0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7354009880 tx=0x7f735402a4a0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.589 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.586+0000 7f73632ee640 1 -- 172.21.15.115:0/3886568970 shutdown_connections 2024-09-13T17:13:43.589 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.586+0000 7f73632ee640 1 --2- 172.21.15.115:0/3886568970 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f735c0ffb40 0x7f735c0fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.589 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.586+0000 7f73632ee640 1 --2- 172.21.15.115:0/3886568970 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f735c105bf0 0x7f735c105fd0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.589 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.586+0000 7f73632ee640 1 -- 172.21.15.115:0/3886568970 >> 172.21.15.115:0/3886568970 conn(0x7f735c0fb840 msgr2=0x7f735c0fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:43.589 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.586+0000 7f73632ee640 1 -- 172.21.15.115:0/3886568970 shutdown_connections 2024-09-13T17:13:43.589 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.586+0000 7f73632ee640 1 -- 172.21.15.115:0/3886568970 wait complete. 2024-09-13T17:13:43.589 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.586+0000 7f73632ee640 1 Processor -- start 2024-09-13T17:13:43.589 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.587+0000 7f73632ee640 1 -- start start 2024-09-13T17:13:43.591 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.587+0000 7f73632ee640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f735c0ffb40 0x7f735c19b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:43.591 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.587+0000 7f73632ee640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f735c105bf0 0x7f735c19bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:43.591 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.587+0000 7f73632ee640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f735c195910 con 0x7f735c0ffb40 2024-09-13T17:13:43.591 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.587+0000 7f73632ee640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f735c195a50 con 0x7f735c105bf0 2024-09-13T17:13:43.591 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.587+0000 7f736108a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f735c0ffb40 0x7f735c19b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:43.591 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.587+0000 7f736108a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f735c0ffb40 0x7f735c19b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47684/0 (socket says 172.21.15.115:47684) 2024-09-13T17:13:43.591 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.587+0000 7f736108a640 1 -- 172.21.15.115:0/3351058656 learned_addr learned my addr 172.21.15.115:0/3351058656 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:13:43.591 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.587+0000 7f7360889640 1 --2- 172.21.15.115:0/3351058656 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f735c105bf0 0x7f735c19bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:43.591 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.587+0000 7f736108a640 1 -- 172.21.15.115:0/3351058656 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f735c105bf0 msgr2=0x7f735c19bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:43.591 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.587+0000 7f736108a640 1 --2- 172.21.15.115:0/3351058656 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f735c105bf0 0x7f735c19bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.592 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.587+0000 7f736108a640 1 -- 172.21.15.115:0/3351058656 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7354009560 con 0x7f735c0ffb40 2024-09-13T17:13:43.592 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.587+0000 7f736108a640 1 --2- 172.21.15.115:0/3351058656 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f735c0ffb40 0x7f735c19b8b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7354006010 tx=0x7f73540056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:43.592 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.588+0000 7f735a7fc640 1 -- 172.21.15.115:0/3351058656 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7354004ba0 con 0x7f735c0ffb40 2024-09-13T17:13:43.592 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.588+0000 7f73632ee640 1 -- 172.21.15.115:0/3351058656 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f735c195cd0 con 0x7f735c0ffb40 2024-09-13T17:13:43.592 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.588+0000 7f735a7fc640 1 -- 172.21.15.115:0/3351058656 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7354004d00 con 0x7f735c0ffb40 2024-09-13T17:13:43.592 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.588+0000 7f735a7fc640 1 -- 172.21.15.115:0/3351058656 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7354031910 con 0x7f735c0ffb40 2024-09-13T17:13:43.592 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.588+0000 7f73632ee640 1 -- 172.21.15.115:0/3351058656 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f735c1961c0 con 0x7f735c0ffb40 2024-09-13T17:13:43.592 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.589+0000 7f73632ee640 1 -- 172.21.15.115:0/3351058656 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f735c1011f0 con 0x7f735c0ffb40 2024-09-13T17:13:43.593 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.589+0000 7f735a7fc640 1 -- 172.21.15.115:0/3351058656 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f7354031b80 con 0x7f735c0ffb40 2024-09-13T17:13:43.593 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.590+0000 7f735a7fc640 1 --2- 172.21.15.115:0/3351058656 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f734406cc50 0x7f734406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:43.593 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.590+0000 7f735a7fc640 1 -- 172.21.15.115:0/3351058656 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f73540ad780 con 0x7f735c0ffb40 2024-09-13T17:13:43.593 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.590+0000 7f7360889640 1 --2- 172.21.15.115:0/3351058656 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f734406cc50 0x7f734406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:43.593 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.590+0000 7f7360889640 1 --2- 172.21.15.115:0/3351058656 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f734406cc50 0x7f734406f110 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f735c197160 tx=0x7f7350008040 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:43.596 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.594+0000 7f735a7fc640 1 -- 172.21.15.115:0/3351058656 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f7354077840 con 0x7f735c0ffb40 2024-09-13T17:13:43.832 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.829+0000 7f73632ee640 1 -- 172.21.15.115:0/3351058656 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f735c108010 con 0x7f735c0ffb40 2024-09-13T17:13:43.832 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:43 smithi115 ceph-mon[109488]: from='client.34328 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:13:43.832 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:43 smithi115 ceph-mon[109488]: from='client.34332 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:13:43.832 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:43 smithi115 ceph-mon[109488]: from='client.34336 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:13:43.832 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:43 smithi115 ceph-mon[109488]: from='client.? 172.21.15.115:0/3822575252' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:13:43.833 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:43 smithi115 ceph-mon[109488]: from='client.? 172.21.15.115:0/3714325211' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T17:13:43.833 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.830+0000 7f735a7fc640 1 -- 172.21.15.115:0/3351058656 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f735407ae60 con 0x7f735c0ffb40 2024-09-13T17:13:43.833 INFO:teuthology.orchestra.run.smithi115.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-13T17:13:43.833 INFO:teuthology.orchestra.run.smithi115.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T17:13:43.833 INFO:teuthology.orchestra.run.smithi115.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T17:13:43.835 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.832+0000 7f73632ee640 1 -- 172.21.15.115:0/3351058656 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f734406cc50 msgr2=0x7f734406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:43.835 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.832+0000 7f73632ee640 1 --2- 172.21.15.115:0/3351058656 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f734406cc50 0x7f734406f110 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f735c197160 tx=0x7f7350008040 comp rx=0 tx=0).stop 2024-09-13T17:13:43.835 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.832+0000 7f73632ee640 1 -- 172.21.15.115:0/3351058656 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f735c0ffb40 msgr2=0x7f735c19b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:43.835 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.832+0000 7f73632ee640 1 --2- 172.21.15.115:0/3351058656 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f735c0ffb40 0x7f735c19b8b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7354006010 tx=0x7f73540056e0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.835 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.833+0000 7f73632ee640 1 -- 172.21.15.115:0/3351058656 shutdown_connections 2024-09-13T17:13:43.835 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.833+0000 7f73632ee640 1 --2- 172.21.15.115:0/3351058656 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f734406cc50 0x7f734406f110 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.835 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.833+0000 7f73632ee640 1 --2- 172.21.15.115:0/3351058656 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f735c105bf0 0x7f735c19bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.835 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.833+0000 7f73632ee640 1 --2- 172.21.15.115:0/3351058656 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f735c0ffb40 0x7f735c19b8b0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.835 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.833+0000 7f73632ee640 1 -- 172.21.15.115:0/3351058656 >> 172.21.15.115:0/3351058656 conn(0x7f735c0fb840 msgr2=0x7f735c0fd980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:43.836 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.833+0000 7f73632ee640 1 -- 172.21.15.115:0/3351058656 shutdown_connections 2024-09-13T17:13:43.836 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:13:43.833+0000 7f73632ee640 1 -- 172.21.15.115:0/3351058656 wait complete. 2024-09-13T17:13:44.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:43 smithi195 ceph-mon[80021]: from='client.34328 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:13:44.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:43 smithi195 ceph-mon[80021]: from='client.34332 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:13:44.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:43 smithi195 ceph-mon[80021]: from='client.34336 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:13:44.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:43 smithi195 ceph-mon[80021]: from='client.? 172.21.15.115:0/3822575252' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:13:44.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:43 smithi195 ceph-mon[80021]: from='client.? 172.21.15.115:0/3714325211' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T17:13:45.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:44 smithi195 ceph-mon[80021]: pgmap v249: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T17:13:45.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:44 smithi195 ceph-mon[80021]: from='client.34348 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:13:45.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:44 smithi195 ceph-mon[80021]: from='client.? 172.21.15.115:0/3351058656' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T17:13:45.178 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:44 smithi115 ceph-mon[109488]: pgmap v249: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T17:13:45.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:44 smithi115 ceph-mon[109488]: from='client.34348 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:13:45.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:44 smithi115 ceph-mon[109488]: from='client.? 172.21.15.115:0/3351058656' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T17:13:46.541 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:46 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:13:46.541 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:46 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:13:46.541 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:46 smithi115 ceph-mon[109488]: pgmap v250: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 8.0 MiB/s rd, 426 B/s wr, 5 op/s 2024-09-13T17:13:46.541 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:46 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:13:46.541 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:46 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:13:46.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:46 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:13:46.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:46 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:13:46.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:46 smithi195 ceph-mon[80021]: pgmap v250: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 8.0 MiB/s rd, 426 B/s wr, 5 op/s 2024-09-13T17:13:46.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:46 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:13:46.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:46 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:13:48.785 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:48 smithi115 ceph-mon[109488]: pgmap v251: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 4.7 MiB/s rd, 4.8 KiB/s wr, 6 op/s 2024-09-13T17:13:48.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:48 smithi195 ceph-mon[80021]: pgmap v251: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 4.7 MiB/s rd, 4.8 KiB/s wr, 6 op/s 2024-09-13T17:13:50.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:49 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:13:50.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:49 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:13:50.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:49 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:13:50.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:49 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:13:50.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:49 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:13:50.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:49 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:13:50.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:49 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:13:50.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:49 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:13:50.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:49 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:13:50.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:49 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:13:50.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:49 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:13:50.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:49 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:13:50.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:49 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:13:50.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:49 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:13:50.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:49 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:13:50.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:49 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:13:50.180 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:49 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:13:50.180 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:49 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:13:50.180 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:49 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:13:50.180 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:49 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:13:51.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:50 smithi195 ceph-mon[80021]: pgmap v252: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 4.8 KiB/s wr, 6 op/s 2024-09-13T17:13:51.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:50 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:13:51.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:50 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi195.qzghxj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T17:13:51.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:50 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:13:51.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:50 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:13:51.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:50 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:13:51.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:50 smithi115 ceph-mon[109488]: pgmap v252: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 4.8 KiB/s wr, 6 op/s 2024-09-13T17:13:51.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:50 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:13:51.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:50 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi195.qzghxj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T17:13:51.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:50 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:13:51.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:50 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:13:51.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:50 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:13:52.076 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:51 smithi195 ceph-mon[80021]: Upgrade: Updating mds.cephfs.smithi195.qzghxj 2024-09-13T17:13:52.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:51 smithi195 ceph-mon[80021]: Deploying daemon mds.cephfs.smithi195.qzghxj on smithi195 2024-09-13T17:13:52.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:51 smithi115 ceph-mon[109488]: Upgrade: Updating mds.cephfs.smithi195.qzghxj 2024-09-13T17:13:52.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:51 smithi115 ceph-mon[109488]: Deploying daemon mds.cephfs.smithi195.qzghxj on smithi195 2024-09-13T17:13:53.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:52 smithi115 ceph-mon[109488]: pgmap v253: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 9.5 KiB/s rd, 4.8 KiB/s wr, 5 op/s 2024-09-13T17:13:53.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:52 smithi115 ceph-mon[109488]: osdmap e81: 6 total, 6 up, 6 in 2024-09-13T17:13:53.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:52 smithi195 ceph-mon[80021]: pgmap v253: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 9.5 KiB/s rd, 4.8 KiB/s wr, 5 op/s 2024-09-13T17:13:53.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:52 smithi195 ceph-mon[80021]: osdmap e81: 6 total, 6 up, 6 in 2024-09-13T17:13:54.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:53 smithi115 ceph-mon[109488]: fsmap cephfs:1 {0=cephfs.smithi195.aevvgz=up:active} 2 up:standby 2024-09-13T17:13:54.326 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:53 smithi195 ceph-mon[80021]: fsmap cephfs:1 {0=cephfs.smithi195.aevvgz=up:active} 2 up:standby 2024-09-13T17:13:54.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:54 smithi115 ceph-mon[109488]: pgmap v255: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 5.3 KiB/s wr, 2 op/s 2024-09-13T17:13:55.187 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:54 smithi195 ceph-mon[80021]: pgmap v255: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 5.3 KiB/s wr, 2 op/s 2024-09-13T17:13:56.928 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:56 smithi195 ceph-mon[80021]: pgmap v256: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 5.3 KiB/s wr, 2 op/s 2024-09-13T17:13:56.928 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:56 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:13:56.928 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:56 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:13:56.928 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:56 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:13:57.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:56 smithi115 ceph-mon[109488]: pgmap v256: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 5.3 KiB/s wr, 2 op/s 2024-09-13T17:13:57.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:56 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:13:57.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:56 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:13:57.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:56 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:13:58.163 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:57 smithi195 ceph-mon[80021]: mds.? [v2:172.21.15.195:6824/825791083,v1:172.21.15.195:6825/825791083] up:boot 2024-09-13T17:13:58.163 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:57 smithi195 ceph-mon[80021]: fsmap cephfs:1 {0=cephfs.smithi195.aevvgz=up:active} 3 up:standby 2024-09-13T17:13:58.163 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:57 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.qzghxj"}]: dispatch 2024-09-13T17:13:58.178 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:57 smithi115 ceph-mon[109488]: mds.? [v2:172.21.15.195:6824/825791083,v1:172.21.15.195:6825/825791083] up:boot 2024-09-13T17:13:58.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:57 smithi115 ceph-mon[109488]: fsmap cephfs:1 {0=cephfs.smithi195.aevvgz=up:active} 3 up:standby 2024-09-13T17:13:58.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:57 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.qzghxj"}]: dispatch 2024-09-13T17:13:59.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:58 smithi115 ceph-mon[109488]: pgmap v257: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2024-09-13T17:13:59.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:58 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:13:59.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:13:58 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:13:59.326 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:58 smithi195 ceph-mon[80021]: pgmap v257: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2024-09-13T17:13:59.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:58 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:13:59.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:13:58 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:00.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:00 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:00.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:00 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:00.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:00 smithi195 ceph-mon[80021]: pgmap v258: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:14:00.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:00 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:00.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:00 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:00.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:00 smithi115 ceph-mon[109488]: pgmap v258: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:14:02.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:02 smithi195 ceph-mon[80021]: pgmap v259: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:14:02.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:02 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:02.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:02 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:02.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:02 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:14:02.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:02 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:14:02.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:02 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:02.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:02 smithi115 ceph-mon[109488]: pgmap v259: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:14:02.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:02 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:02.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:02 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:02.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:02 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:14:02.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:02 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:14:02.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:02 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:03.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:03 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:14:03.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:03 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:14:03.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:03 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:14:03.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:03 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:14:03.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:03 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:14:03.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:03 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:14:03.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:03 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:14:03.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:03 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:14:03.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:03 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:14:03.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:03 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:14:04.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:04 smithi195 ceph-mon[80021]: pgmap v260: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:14:04.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:04 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:04.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:04 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi195.aevvgz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T17:14:04.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:04 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:14:04.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:04 smithi115 ceph-mon[109488]: pgmap v260: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:14:04.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:04 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:04.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:04 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi195.aevvgz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T17:14:04.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:04 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:14:05.810 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:05 smithi195 ceph-mon[80021]: Upgrade: Updating mds.cephfs.smithi195.aevvgz 2024-09-13T17:14:05.814 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:05 smithi195 ceph-mon[80021]: Deploying daemon mds.cephfs.smithi195.aevvgz on smithi195 2024-09-13T17:14:05.814 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:05 smithi115 ceph-mon[109488]: Upgrade: Updating mds.cephfs.smithi195.aevvgz 2024-09-13T17:14:05.814 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:05 smithi115 ceph-mon[109488]: Deploying daemon mds.cephfs.smithi195.aevvgz on smithi195 2024-09-13T17:14:06.076 INFO:journalctl@ceph.osd.3.smithi195.stdout:Sep 13 17:14:05 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-3[88826]: 2024-09-13T17:14:05.831+0000 7f5dad385640 -1 bdev(0x55b635fb4e00 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 4 2024-09-13T17:14:06.077 INFO:journalctl@ceph.osd.3.smithi195.stdout:Sep 13 17:14:05 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-3[88826]: 2024-09-13T17:14:05.831+0000 7f5daab80640 -1 bdev(0x55b635fb4e00 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 4 2024-09-13T17:14:06.178 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:05 smithi115 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-mon-smithi115[109484]: 2024-09-13T17:14:05.809+0000 7f7986bb7640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T17:14:06.797 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:06 smithi195 ceph-mon[80021]: pgmap v261: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:14:06.797 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:06 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:14:06.797 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:06 smithi195 ceph-mon[80021]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-13T17:14:06.797 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:06 smithi195 ceph-mon[80021]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T17:14:06.797 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:06 smithi195 ceph-mon[80021]: osdmap e82: 6 total, 6 up, 6 in 2024-09-13T17:14:06.797 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:06 smithi195 ceph-mon[80021]: Standby daemon mds.cephfs.smithi115.hbtxod assigned to filesystem cephfs as rank 0 2024-09-13T17:14:06.797 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:06 smithi195 ceph-mon[80021]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-13T17:14:06.797 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:06 smithi195 ceph-mon[80021]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-13T17:14:06.798 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:06 smithi195 ceph-mon[80021]: fsmap cephfs:1/1 {0=cephfs.smithi115.hbtxod=up:replay} 2 up:standby 2024-09-13T17:14:06.798 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:06 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.aevvgz"}]: dispatch 2024-09-13T17:14:06.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:06 smithi115 ceph-mon[109488]: pgmap v261: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:14:06.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:06 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:14:06.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:06 smithi115 ceph-mon[109488]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-13T17:14:06.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:06 smithi115 ceph-mon[109488]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T17:14:06.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:06 smithi115 ceph-mon[109488]: osdmap e82: 6 total, 6 up, 6 in 2024-09-13T17:14:06.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:06 smithi115 ceph-mon[109488]: Standby daemon mds.cephfs.smithi115.hbtxod assigned to filesystem cephfs as rank 0 2024-09-13T17:14:06.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:06 smithi115 ceph-mon[109488]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-13T17:14:06.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:06 smithi115 ceph-mon[109488]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-13T17:14:06.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:06 smithi115 ceph-mon[109488]: fsmap cephfs:1/1 {0=cephfs.smithi115.hbtxod=up:replay} 2 up:standby 2024-09-13T17:14:06.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:06 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.aevvgz"}]: dispatch 2024-09-13T17:14:08.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:08 smithi195 ceph-mon[80021]: pgmap v263: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 2.4 MiB/s rd, 0 op/s 2024-09-13T17:14:08.928 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:08 smithi115 ceph-mon[109488]: pgmap v263: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 2.4 MiB/s rd, 0 op/s 2024-09-13T17:14:10.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:10 smithi195 ceph-mon[80021]: pgmap v264: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 4.8 MiB/s rd, 2 op/s 2024-09-13T17:14:10.928 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:10 smithi115 ceph-mon[109488]: pgmap v264: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 4.8 MiB/s rd, 2 op/s 2024-09-13T17:14:12.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:12 smithi195 ceph-mon[80021]: pgmap v265: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 10 MiB/s rd, 3 op/s 2024-09-13T17:14:12.928 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:12 smithi115 ceph-mon[109488]: pgmap v265: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 10 MiB/s rd, 3 op/s 2024-09-13T17:14:13.933 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:13.930+0000 7f5c27356640 1 -- 172.21.15.115:0/1083154094 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5c20100cd0 msgr2=0x7f5c201010b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:13.933 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:13.930+0000 7f5c27356640 1 --2- 172.21.15.115:0/1083154094 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5c20100cd0 0x7f5c201010b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5c1c009880 tx=0x7f5c1c02a530 comp rx=0 tx=0).stop 2024-09-13T17:14:13.933 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:13.930+0000 7f5c27356640 1 -- 172.21.15.115:0/1083154094 shutdown_connections 2024-09-13T17:14:13.933 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:13.930+0000 7f5c27356640 1 --2- 172.21.15.115:0/1083154094 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5c201015f0 0x7f5c20109ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:13.933 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:13.930+0000 7f5c27356640 1 --2- 172.21.15.115:0/1083154094 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5c20100cd0 0x7f5c201010b0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:13.933 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:13.930+0000 7f5c27356640 1 -- 172.21.15.115:0/1083154094 >> 172.21.15.115:0/1083154094 conn(0x7f5c200fa730 msgr2=0x7f5c200fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:13.934 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:13.930+0000 7f5c27356640 1 -- 172.21.15.115:0/1083154094 shutdown_connections 2024-09-13T17:14:13.934 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:13.930+0000 7f5c27356640 1 -- 172.21.15.115:0/1083154094 wait complete. 2024-09-13T17:14:13.934 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:13.930+0000 7f5c27356640 1 Processor -- start 2024-09-13T17:14:13.934 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:13.930+0000 7f5c27356640 1 -- start start 2024-09-13T17:14:13.934 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:13.931+0000 7f5c27356640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5c20100cd0 0x7f5c201959f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:13.934 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:13.931+0000 7f5c27356640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5c201015f0 0x7f5c20195f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:13.934 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:13.931+0000 7f5c27356640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c20196580 con 0x7f5c201015f0 2024-09-13T17:14:13.934 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:13.931+0000 7f5c27356640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c201966f0 con 0x7f5c20100cd0 2024-09-13T17:14:13.934 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:13.931+0000 7f5c248f1640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5c201015f0 0x7f5c20195f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:13.934 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:13.931+0000 7f5c248f1640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5c201015f0 0x7f5c20195f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60548/0 (socket says 172.21.15.115:60548) 2024-09-13T17:14:13.934 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:13.931+0000 7f5c248f1640 1 -- 172.21.15.115:0/3543578607 learned_addr learned my addr 172.21.15.115:0/3543578607 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:14:13.934 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:13.931+0000 7f5c250f2640 1 --2- 172.21.15.115:0/3543578607 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5c20100cd0 0x7f5c201959f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:13.935 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:13.931+0000 7f5c248f1640 1 -- 172.21.15.115:0/3543578607 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5c20100cd0 msgr2=0x7f5c201959f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:13.935 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:13.931+0000 7f5c248f1640 1 --2- 172.21.15.115:0/3543578607 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5c20100cd0 0x7f5c201959f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:13.935 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:13.931+0000 7f5c248f1640 1 -- 172.21.15.115:0/3543578607 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c1c009560 con 0x7f5c201015f0 2024-09-13T17:14:13.935 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:13.931+0000 7f5c248f1640 1 --2- 172.21.15.115:0/3543578607 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5c201015f0 0x7f5c20195f30 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5c1000c8f0 tx=0x7f5c1000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:13.935 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:13.931+0000 7f5c167fc640 1 -- 172.21.15.115:0/3543578607 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c10007b80 con 0x7f5c201015f0 2024-09-13T17:14:13.935 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:13.932+0000 7f5c27356640 1 -- 172.21.15.115:0/3543578607 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c2019a4b0 con 0x7f5c201015f0 2024-09-13T17:14:13.935 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:13.932+0000 7f5c167fc640 1 -- 172.21.15.115:0/3543578607 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5c10007ce0 con 0x7f5c201015f0 2024-09-13T17:14:13.935 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:13.932+0000 7f5c167fc640 1 -- 172.21.15.115:0/3543578607 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c100186c0 con 0x7f5c201015f0 2024-09-13T17:14:13.935 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:13.932+0000 7f5c27356640 1 -- 172.21.15.115:0/3543578607 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c2019aa00 con 0x7f5c201015f0 2024-09-13T17:14:13.936 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:13.933+0000 7f5c27356640 1 -- 172.21.15.115:0/3543578607 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c20068ce0 con 0x7f5c201015f0 2024-09-13T17:14:13.936 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:13.933+0000 7f5c167fc640 1 -- 172.21.15.115:0/3543578607 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f5c1000f450 con 0x7f5c201015f0 2024-09-13T17:14:13.936 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:13.934+0000 7f5c167fc640 1 --2- 172.21.15.115:0/3543578607 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f5c0c06cc50 0x7f5c0c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:13.936 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:13.934+0000 7f5c250f2640 1 --2- 172.21.15.115:0/3543578607 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f5c0c06cc50 0x7f5c0c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:13.936 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:13.934+0000 7f5c167fc640 1 -- 172.21.15.115:0/3543578607 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f5c1008c740 con 0x7f5c201015f0 2024-09-13T17:14:13.936 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:13.934+0000 7f5c250f2640 1 --2- 172.21.15.115:0/3543578607 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f5c0c06cc50 0x7f5c0c06f110 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5c1c005ab0 tx=0x7f5c1c005a20 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:13.939 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:13.938+0000 7f5c167fc640 1 -- 172.21.15.115:0/3543578607 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f5c100567b0 con 0x7f5c201015f0 2024-09-13T17:14:14.116 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.115+0000 7f5c27356640 1 -- 172.21.15.115:0/3543578607 --> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5c2010cc60 con 0x7f5c0c06cc50 2024-09-13T17:14:14.117 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.116+0000 7f5c167fc640 1 -- 172.21.15.115:0/3543578607 <== mgr.14660 v2:172.21.15.115:6800/1049502673 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f5c2010cc60 con 0x7f5c0c06cc50 2024-09-13T17:14:14.119 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.118+0000 7f5c27356640 1 -- 172.21.15.115:0/3543578607 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f5c0c06cc50 msgr2=0x7f5c0c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:14.119 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.118+0000 7f5c27356640 1 --2- 172.21.15.115:0/3543578607 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f5c0c06cc50 0x7f5c0c06f110 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5c1c005ab0 tx=0x7f5c1c005a20 comp rx=0 tx=0).stop 2024-09-13T17:14:14.120 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.118+0000 7f5c27356640 1 -- 172.21.15.115:0/3543578607 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5c201015f0 msgr2=0x7f5c20195f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:14.120 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.118+0000 7f5c27356640 1 --2- 172.21.15.115:0/3543578607 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5c201015f0 0x7f5c20195f30 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5c1000c8f0 tx=0x7f5c1000cdb0 comp rx=0 tx=0).stop 2024-09-13T17:14:14.120 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.118+0000 7f5c27356640 1 -- 172.21.15.115:0/3543578607 shutdown_connections 2024-09-13T17:14:14.120 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.118+0000 7f5c27356640 1 --2- 172.21.15.115:0/3543578607 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f5c0c06cc50 0x7f5c0c06f110 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:14.120 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.118+0000 7f5c27356640 1 --2- 172.21.15.115:0/3543578607 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5c201015f0 0x7f5c20195f30 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:14.120 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.118+0000 7f5c27356640 1 --2- 172.21.15.115:0/3543578607 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5c20100cd0 0x7f5c201959f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:14.120 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.118+0000 7f5c27356640 1 -- 172.21.15.115:0/3543578607 >> 172.21.15.115:0/3543578607 conn(0x7f5c200fa730 msgr2=0x7f5c20101fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:14.120 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.118+0000 7f5c27356640 1 -- 172.21.15.115:0/3543578607 shutdown_connections 2024-09-13T17:14:14.120 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.118+0000 7f5c27356640 1 -- 172.21.15.115:0/3543578607 wait complete. 2024-09-13T17:14:14.128 INFO:teuthology.orchestra.run.smithi115.stdout:true 2024-09-13T17:14:14.201 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.199+0000 7f1d113c1640 1 -- 172.21.15.115:0/3502403459 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d0c101f80 msgr2=0x7f1d0c102360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:14.201 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.199+0000 7f1d113c1640 1 --2- 172.21.15.115:0/3502403459 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d0c101f80 0x7f1d0c102360 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc009c20 tx=0x7f1cfc02a970 comp rx=0 tx=0).stop 2024-09-13T17:14:14.201 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.199+0000 7f1d113c1640 1 -- 172.21.15.115:0/3502403459 shutdown_connections 2024-09-13T17:14:14.201 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.199+0000 7f1d113c1640 1 --2- 172.21.15.115:0/3502403459 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1d0c102930 0x7f1d0c106980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:14.201 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.199+0000 7f1d113c1640 1 --2- 172.21.15.115:0/3502403459 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d0c101f80 0x7f1d0c102360 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:14.201 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.199+0000 7f1d113c1640 1 -- 172.21.15.115:0/3502403459 >> 172.21.15.115:0/3502403459 conn(0x7f1d0c0fda40 msgr2=0x7f1d0c0ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:14.201 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.199+0000 7f1d113c1640 1 -- 172.21.15.115:0/3502403459 shutdown_connections 2024-09-13T17:14:14.201 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.199+0000 7f1d113c1640 1 -- 172.21.15.115:0/3502403459 wait complete. 2024-09-13T17:14:14.203 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.200+0000 7f1d113c1640 1 Processor -- start 2024-09-13T17:14:14.203 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.200+0000 7f1d113c1640 1 -- start start 2024-09-13T17:14:14.203 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.201+0000 7f1d113c1640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1d0c101f80 0x7f1d0c197dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:14.203 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.201+0000 7f1d113c1640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d0c102930 0x7f1d0c198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:14.203 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.201+0000 7f1d113c1640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d0c198990 con 0x7f1d0c102930 2024-09-13T17:14:14.203 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.201+0000 7f1d113c1640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d0c19c700 con 0x7f1d0c101f80 2024-09-13T17:14:14.203 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.201+0000 7f1d0a7fc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d0c102930 0x7f1d0c198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:14.203 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.201+0000 7f1d0a7fc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d0c102930 0x7f1d0c198300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56682/0 (socket says 172.21.15.115:56682) 2024-09-13T17:14:14.203 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.201+0000 7f1d0a7fc640 1 -- 172.21.15.115:0/1828097963 learned_addr learned my addr 172.21.15.115:0/1828097963 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:14:14.203 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.201+0000 7f1d0affd640 1 --2- 172.21.15.115:0/1828097963 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1d0c101f80 0x7f1d0c197dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:14.203 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.201+0000 7f1d0a7fc640 1 -- 172.21.15.115:0/1828097963 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1d0c101f80 msgr2=0x7f1d0c197dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:14.204 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.201+0000 7f1d0a7fc640 1 --2- 172.21.15.115:0/1828097963 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1d0c101f80 0x7f1d0c197dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:14.204 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.201+0000 7f1d0a7fc640 1 -- 172.21.15.115:0/1828097963 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cfc009900 con 0x7f1d0c102930 2024-09-13T17:14:14.204 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.201+0000 7f1d0a7fc640 1 --2- 172.21.15.115:0/1828097963 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d0c102930 0x7f1d0c198300 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1d0000b420 tx=0x7f1d0000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:14.204 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.202+0000 7f1cf3fff640 1 -- 172.21.15.115:0/1828097963 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d00011800 con 0x7f1d0c102930 2024-09-13T17:14:14.204 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.202+0000 7f1cf3fff640 1 -- 172.21.15.115:0/1828097963 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1d00011e00 con 0x7f1d0c102930 2024-09-13T17:14:14.204 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.202+0000 7f1cf3fff640 1 -- 172.21.15.115:0/1828097963 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d0000f2e0 con 0x7f1d0c102930 2024-09-13T17:14:14.204 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.202+0000 7f1d113c1640 1 -- 172.21.15.115:0/1828097963 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d0c19c9e0 con 0x7f1d0c102930 2024-09-13T17:14:14.205 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.202+0000 7f1d113c1640 1 -- 172.21.15.115:0/1828097963 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d0c19cf30 con 0x7f1d0c102930 2024-09-13T17:14:14.205 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.203+0000 7f1d113c1640 1 -- 172.21.15.115:0/1828097963 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d0c103460 con 0x7f1d0c102930 2024-09-13T17:14:14.205 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.203+0000 7f1cf3fff640 1 -- 172.21.15.115:0/1828097963 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f1d00010380 con 0x7f1d0c102930 2024-09-13T17:14:14.206 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.204+0000 7f1cf3fff640 1 --2- 172.21.15.115:0/1828097963 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f1cf406cc50 0x7f1cf406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:14.206 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.204+0000 7f1cf3fff640 1 -- 172.21.15.115:0/1828097963 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f1d0008be00 con 0x7f1d0c102930 2024-09-13T17:14:14.206 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.204+0000 7f1d0affd640 1 --2- 172.21.15.115:0/1828097963 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f1cf406cc50 0x7f1cf406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:14.206 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.204+0000 7f1d0affd640 1 --2- 172.21.15.115:0/1828097963 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f1cf406cc50 0x7f1cf406f110 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc030040 tx=0x7f1cfc03d040 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:14.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.209+0000 7f1cf3fff640 1 -- 172.21.15.115:0/1828097963 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f1d00055ef0 con 0x7f1d0c102930 2024-09-13T17:14:14.394 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.392+0000 7f1d113c1640 1 -- 172.21.15.115:0/1828097963 --> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1d0c10eed0 con 0x7f1cf406cc50 2024-09-13T17:14:14.394 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.393+0000 7f1cf3fff640 1 -- 172.21.15.115:0/1828097963 <== mgr.14660 v2:172.21.15.115:6800/1049502673 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f1d0c10eed0 con 0x7f1cf406cc50 2024-09-13T17:14:14.397 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.396+0000 7f1d113c1640 1 -- 172.21.15.115:0/1828097963 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f1cf406cc50 msgr2=0x7f1cf406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:14.397 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.396+0000 7f1d113c1640 1 --2- 172.21.15.115:0/1828097963 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f1cf406cc50 0x7f1cf406f110 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc030040 tx=0x7f1cfc03d040 comp rx=0 tx=0).stop 2024-09-13T17:14:14.397 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.396+0000 7f1d113c1640 1 -- 172.21.15.115:0/1828097963 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d0c102930 msgr2=0x7f1d0c198300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:14.398 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.396+0000 7f1d113c1640 1 --2- 172.21.15.115:0/1828097963 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d0c102930 0x7f1d0c198300 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1d0000b420 tx=0x7f1d0000b8e0 comp rx=0 tx=0).stop 2024-09-13T17:14:14.398 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.396+0000 7f1d113c1640 1 -- 172.21.15.115:0/1828097963 shutdown_connections 2024-09-13T17:14:14.398 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.396+0000 7f1d113c1640 1 --2- 172.21.15.115:0/1828097963 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f1cf406cc50 0x7f1cf406f110 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:14.398 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.396+0000 7f1d113c1640 1 --2- 172.21.15.115:0/1828097963 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d0c102930 0x7f1d0c198300 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:14.398 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.396+0000 7f1d113c1640 1 --2- 172.21.15.115:0/1828097963 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1d0c101f80 0x7f1d0c197dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:14.398 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.396+0000 7f1d113c1640 1 -- 172.21.15.115:0/1828097963 >> 172.21.15.115:0/1828097963 conn(0x7f1d0c0fda40 msgr2=0x7f1d0c0fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:14.398 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.396+0000 7f1d113c1640 1 -- 172.21.15.115:0/1828097963 shutdown_connections 2024-09-13T17:14:14.398 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.396+0000 7f1d113c1640 1 -- 172.21.15.115:0/1828097963 wait complete. 2024-09-13T17:14:14.481 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.479+0000 7fdbe1396640 1 -- 172.21.15.115:0/2468571995 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdbdc1049a0 msgr2=0x7fdbdc104d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:14.482 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.479+0000 7fdbe1396640 1 --2- 172.21.15.115:0/2468571995 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdbdc1049a0 0x7fdbdc104d80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc009880 tx=0x7fdbcc02a4a0 comp rx=0 tx=0).stop 2024-09-13T17:14:14.482 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.480+0000 7fdbe1396640 1 -- 172.21.15.115:0/2468571995 shutdown_connections 2024-09-13T17:14:14.482 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.480+0000 7fdbe1396640 1 --2- 172.21.15.115:0/2468571995 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdbdc0fe9a0 0x7fdbdc0fee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:14.482 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.480+0000 7fdbe1396640 1 --2- 172.21.15.115:0/2468571995 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdbdc1049a0 0x7fdbdc104d80 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:14.482 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.480+0000 7fdbe1396640 1 -- 172.21.15.115:0/2468571995 >> 172.21.15.115:0/2468571995 conn(0x7fdbdc0758c0 msgr2=0x7fdbdc0fcc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:14.482 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.480+0000 7fdbe1396640 1 -- 172.21.15.115:0/2468571995 shutdown_connections 2024-09-13T17:14:14.482 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.480+0000 7fdbe1396640 1 -- 172.21.15.115:0/2468571995 wait complete. 2024-09-13T17:14:14.482 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.480+0000 7fdbe1396640 1 Processor -- start 2024-09-13T17:14:14.482 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.481+0000 7fdbe1396640 1 -- start start 2024-09-13T17:14:14.487 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.481+0000 7fdbe1396640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdbdc0fe9a0 0x7fdbdc19b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:14.487 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.481+0000 7fdbe1396640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdbdc1049a0 0x7fdbdc19bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:14.487 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.481+0000 7fdbe1396640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbdc19c300 con 0x7fdbdc0fe9a0 2024-09-13T17:14:14.487 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.481+0000 7fdbe1396640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbdc195890 con 0x7fdbdc1049a0 2024-09-13T17:14:14.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.481+0000 7fdbdaffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdbdc0fe9a0 0x7fdbdc19b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:14.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.481+0000 7fdbdaffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdbdc0fe9a0 0x7fdbdc19b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56690/0 (socket says 172.21.15.115:56690) 2024-09-13T17:14:14.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.481+0000 7fdbdaffd640 1 -- 172.21.15.115:0/3728010924 learned_addr learned my addr 172.21.15.115:0/3728010924 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:14:14.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.481+0000 7fdbda7fc640 1 --2- 172.21.15.115:0/3728010924 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdbdc1049a0 0x7fdbdc19bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:14.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.481+0000 7fdbdaffd640 1 -- 172.21.15.115:0/3728010924 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdbdc1049a0 msgr2=0x7fdbdc19bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:14.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.481+0000 7fdbdaffd640 1 --2- 172.21.15.115:0/3728010924 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdbdc1049a0 0x7fdbdc19bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:14.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.481+0000 7fdbdaffd640 1 -- 172.21.15.115:0/3728010924 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbcc009560 con 0x7fdbdc0fe9a0 2024-09-13T17:14:14.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.482+0000 7fdbdaffd640 1 --2- 172.21.15.115:0/3728010924 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdbdc0fe9a0 0x7fdbdc19b7a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc02a9c0 tx=0x7fdbcc0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:14.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.482+0000 7fdbc3fff640 1 -- 172.21.15.115:0/3728010924 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdbcc004b60 con 0x7fdbdc0fe9a0 2024-09-13T17:14:14.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.482+0000 7fdbc3fff640 1 -- 172.21.15.115:0/3728010924 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdbcc004cc0 con 0x7fdbdc0fe9a0 2024-09-13T17:14:14.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.482+0000 7fdbe1396640 1 -- 172.21.15.115:0/3728010924 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbdc195b10 con 0x7fdbdc0fe9a0 2024-09-13T17:14:14.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.482+0000 7fdbe1396640 1 -- 172.21.15.115:0/3728010924 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbdc196000 con 0x7fdbdc0fe9a0 2024-09-13T17:14:14.489 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.482+0000 7fdbc3fff640 1 -- 172.21.15.115:0/3728010924 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdbcc031950 con 0x7fdbdc0fe9a0 2024-09-13T17:14:14.489 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.483+0000 7fdbe1396640 1 -- 172.21.15.115:0/3728010924 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbdc1000e0 con 0x7fdbdc0fe9a0 2024-09-13T17:14:14.489 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.484+0000 7fdbc3fff640 1 -- 172.21.15.115:0/3728010924 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fdbcc003c20 con 0x7fdbdc0fe9a0 2024-09-13T17:14:14.489 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.484+0000 7fdbc3fff640 1 --2- 172.21.15.115:0/3728010924 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fdbc406cc50 0x7fdbc406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:14.489 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.484+0000 7fdbc3fff640 1 -- 172.21.15.115:0/3728010924 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fdbcc0ad630 con 0x7fdbdc0fe9a0 2024-09-13T17:14:14.489 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.484+0000 7fdbda7fc640 1 --2- 172.21.15.115:0/3728010924 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fdbc406cc50 0x7fdbc406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:14.489 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.485+0000 7fdbda7fc640 1 --2- 172.21.15.115:0/3728010924 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fdbc406cc50 0x7fdbc406f110 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc196d00 tx=0x7fdbd000b390 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:14.489 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.488+0000 7fdbc3fff640 1 -- 172.21.15.115:0/3728010924 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fdbcc077750 con 0x7fdbdc0fe9a0 2024-09-13T17:14:14.694 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.692+0000 7fdbe1396640 1 -- 172.21.15.115:0/3728010924 --> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fdbdc10baf0 con 0x7fdbc406cc50 2024-09-13T17:14:14.703 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.702+0000 7fdbc3fff640 1 -- 172.21.15.115:0/3728010924 <== mgr.14660 v2:172.21.15.115:6800/1049502673 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fdbdc10baf0 con 0x7fdbc406cc50 2024-09-13T17:14:14.703 INFO:teuthology.orchestra.run.smithi115.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T17:14:14.704 INFO:teuthology.orchestra.run.smithi115.stdout:alertmanager.smithi115 smithi115 *:9093,9094 running (6m) 29s ago 16m 25.0M - 0.25.0 c8568f914cd2 d56b91240fe1 2024-09-13T17:14:14.704 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-exporter.smithi115 smithi115 running (16m) 29s ago 16m 8560k - 18.2.4-843-g2c01458a c129f5a2fd4e 0f1eebeaf9bb 2024-09-13T17:14:14.704 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-exporter.smithi195 smithi195 running (15m) 15s ago 15m 8300k - 18.2.4-843-g2c01458a c129f5a2fd4e 6d05bafbac8a 2024-09-13T17:14:14.704 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi115 smithi115 running (4m) 29s ago 16m 6895k - 18.2.4-860-g6c6b083f 8a91f241d7d4 e8175bc055bf 2024-09-13T17:14:14.704 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi195 smithi195 running (4m) 15s ago 15m 6903k - 18.2.4-860-g6c6b083f 8a91f241d7d4 ccb4895be776 2024-09-13T17:14:14.704 INFO:teuthology.orchestra.run.smithi115.stdout:grafana.smithi115 smithi115 *:3000 running (5m) 29s ago 16m 86.7M - 9.4.7 954c08fa6188 e1eccb1a8f3e 2024-09-13T17:14:14.704 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi115.hbtxod smithi115 running (57s) 29s ago 10m 16.2M - 18.2.4-860-g6c6b083f 8a91f241d7d4 9221253d5ed4 2024-09-13T17:14:14.704 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi115.ijznvr smithi115 running (34s) 29s ago 10m 10.7M - 18.2.4-860-g6c6b083f 8a91f241d7d4 aab0c23ec15b 2024-09-13T17:14:14.704 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi195.aevvgz smithi195 running (10m) 15s ago 10m 85.7M - 18.2.4-843-g2c01458a c129f5a2fd4e 299b9ad657c9 2024-09-13T17:14:14.704 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi195.qzghxj smithi195 running (19s) 15s ago 10m 13.4M - 18.2.4-860-g6c6b083f 8a91f241d7d4 653d67d222ce 2024-09-13T17:14:14.704 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi115.hetcni smithi115 *:8443,9283,8765 running (7m) 29s ago 17m 498M - 18.2.4-860-g6c6b083f 8a91f241d7d4 b945dbde1934 2024-09-13T17:14:14.704 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi195.hjjifz smithi195 *:8443,9283,8765 running (6m) 15s ago 15m 442M - 18.2.4-860-g6c6b083f 8a91f241d7d4 17bccdfbcae1 2024-09-13T17:14:14.704 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi115 smithi115 running (4m) 29s ago 17m 47.4M 2048M 18.2.4-860-g6c6b083f 8a91f241d7d4 8dd7baf2c6b6 2024-09-13T17:14:14.705 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi195 smithi195 running (4m) 15s ago 15m 38.0M 2048M 18.2.4-860-g6c6b083f 8a91f241d7d4 0459bc5e6b08 2024-09-13T17:14:14.705 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi115 smithi115 *:9100 running (6m) 29s ago 16m 16.7M - 1.5.0 0da6a335fe13 26fb6f9844b5 2024-09-13T17:14:14.705 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi195 smithi195 *:9100 running (6m) 15s ago 15m 17.5M - 1.5.0 0da6a335fe13 6d38e798fb16 2024-09-13T17:14:14.705 INFO:teuthology.orchestra.run.smithi115.stdout:osd.0 smithi115 running (3m) 29s ago 14m 108M 1216M 18.2.4-860-g6c6b083f 8a91f241d7d4 3b9f874c64e9 2024-09-13T17:14:14.705 INFO:teuthology.orchestra.run.smithi115.stdout:osd.1 smithi115 running (3m) 29s ago 14m 115M 1216M 18.2.4-860-g6c6b083f 8a91f241d7d4 f0de6684601c 2024-09-13T17:14:14.705 INFO:teuthology.orchestra.run.smithi115.stdout:osd.2 smithi115 running (2m) 29s ago 13m 99.1M 1216M 18.2.4-860-g6c6b083f 8a91f241d7d4 edb753bab54a 2024-09-13T17:14:14.705 INFO:teuthology.orchestra.run.smithi115.stdout:osd.3 smithi195 running (2m) 15s ago 13m 120M 2240M 18.2.4-860-g6c6b083f 8a91f241d7d4 ccd1b2bf7d86 2024-09-13T17:14:14.705 INFO:teuthology.orchestra.run.smithi115.stdout:osd.4 smithi195 running (104s) 15s ago 12m 104M 2240M 18.2.4-860-g6c6b083f 8a91f241d7d4 c88b3dacb207 2024-09-13T17:14:14.705 INFO:teuthology.orchestra.run.smithi115.stdout:osd.5 smithi195 running (74s) 15s ago 12m 97.5M 2240M 18.2.4-860-g6c6b083f 8a91f241d7d4 40ccbc2f5195 2024-09-13T17:14:14.705 INFO:teuthology.orchestra.run.smithi115.stdout:prometheus.smithi115 smithi115 *:9095 running (6m) 29s ago 15m 64.5M - 2.43.0 a07b618ecd1d e03fb39f6b76 2024-09-13T17:14:14.706 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.705+0000 7fdbe1396640 1 -- 172.21.15.115:0/3728010924 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fdbc406cc50 msgr2=0x7fdbc406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:14.706 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.705+0000 7fdbe1396640 1 --2- 172.21.15.115:0/3728010924 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fdbc406cc50 0x7fdbc406f110 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc196d00 tx=0x7fdbd000b390 comp rx=0 tx=0).stop 2024-09-13T17:14:14.706 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.705+0000 7fdbe1396640 1 -- 172.21.15.115:0/3728010924 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdbdc0fe9a0 msgr2=0x7fdbdc19b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:14.706 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.705+0000 7fdbe1396640 1 --2- 172.21.15.115:0/3728010924 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdbdc0fe9a0 0x7fdbdc19b7a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc02a9c0 tx=0x7fdbcc0055a0 comp rx=0 tx=0).stop 2024-09-13T17:14:14.706 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.705+0000 7fdbe1396640 1 -- 172.21.15.115:0/3728010924 shutdown_connections 2024-09-13T17:14:14.706 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.705+0000 7fdbe1396640 1 --2- 172.21.15.115:0/3728010924 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fdbc406cc50 0x7fdbc406f110 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:14.706 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.705+0000 7fdbe1396640 1 --2- 172.21.15.115:0/3728010924 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdbdc1049a0 0x7fdbdc19bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:14.706 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.705+0000 7fdbe1396640 1 --2- 172.21.15.115:0/3728010924 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdbdc0fe9a0 0x7fdbdc19b7a0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:14.707 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.705+0000 7fdbe1396640 1 -- 172.21.15.115:0/3728010924 >> 172.21.15.115:0/3728010924 conn(0x7fdbdc0758c0 msgr2=0x7fdbdc102350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:14.707 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.705+0000 7fdbe1396640 1 -- 172.21.15.115:0/3728010924 shutdown_connections 2024-09-13T17:14:14.707 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.705+0000 7fdbe1396640 1 -- 172.21.15.115:0/3728010924 wait complete. 2024-09-13T17:14:14.788 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.787+0000 7fae32d31640 1 -- 172.21.15.115:0/3363168641 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae2c1049a0 msgr2=0x7fae2c104d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:14.788 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.787+0000 7fae32d31640 1 --2- 172.21.15.115:0/3363168641 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae2c1049a0 0x7fae2c104d80 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fae20009880 tx=0x7fae2002a4a0 comp rx=0 tx=0).stop 2024-09-13T17:14:14.789 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.787+0000 7fae32d31640 1 -- 172.21.15.115:0/3363168641 shutdown_connections 2024-09-13T17:14:14.789 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.787+0000 7fae32d31640 1 --2- 172.21.15.115:0/3363168641 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fae2c0fe9a0 0x7fae2c0fee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:14.789 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.787+0000 7fae32d31640 1 --2- 172.21.15.115:0/3363168641 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae2c1049a0 0x7fae2c104d80 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:14.789 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.787+0000 7fae32d31640 1 -- 172.21.15.115:0/3363168641 >> 172.21.15.115:0/3363168641 conn(0x7fae2c0758c0 msgr2=0x7fae2c0fcc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:14.789 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:14 smithi115 ceph-mon[109488]: pgmap v266: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 19 MiB/s rd, 5 op/s 2024-09-13T17:14:14.789 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:14 smithi115 ceph-mon[109488]: reconnect by client.24287 v1:172.21.15.115:0/693373336 after 0 2024-09-13T17:14:14.789 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:14 smithi115 ceph-mon[109488]: mds.? [v2:172.21.15.115:6826/2768011029,v1:172.21.15.115:6827/2768011029] up:reconnect 2024-09-13T17:14:14.789 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:14 smithi115 ceph-mon[109488]: fsmap cephfs:1/1 {0=cephfs.smithi115.hbtxod=up:reconnect} 2 up:standby 2024-09-13T17:14:14.789 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:14 smithi115 ceph-mon[109488]: reconnect by client.24291 v1:192.168.0.1:0/3568065273 after 0.00399992 2024-09-13T17:14:14.791 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.787+0000 7fae32d31640 1 -- 172.21.15.115:0/3363168641 shutdown_connections 2024-09-13T17:14:14.791 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.788+0000 7fae32d31640 1 -- 172.21.15.115:0/3363168641 wait complete. 2024-09-13T17:14:14.791 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.788+0000 7fae32d31640 1 Processor -- start 2024-09-13T17:14:14.791 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.788+0000 7fae32d31640 1 -- start start 2024-09-13T17:14:14.791 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.789+0000 7fae32d31640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae2c0fe9a0 0x7fae2c19a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:14.792 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.789+0000 7fae32d31640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fae2c1049a0 0x7fae2c19ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:14.792 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.789+0000 7fae32d31640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae2c194850 con 0x7fae2c0fe9a0 2024-09-13T17:14:14.792 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.789+0000 7fae32d31640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae2c194990 con 0x7fae2c1049a0 2024-09-13T17:14:14.792 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.789+0000 7fae30acd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae2c0fe9a0 0x7fae2c19a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:14.792 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.789+0000 7fae30acd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae2c0fe9a0 0x7fae2c19a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56698/0 (socket says 172.21.15.115:56698) 2024-09-13T17:14:14.792 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.789+0000 7fae30acd640 1 -- 172.21.15.115:0/97506717 learned_addr learned my addr 172.21.15.115:0/97506717 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:14:14.792 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.789+0000 7fae2bfff640 1 --2- 172.21.15.115:0/97506717 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fae2c1049a0 0x7fae2c19ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:14.792 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.789+0000 7fae2bfff640 1 -- 172.21.15.115:0/97506717 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae2c0fe9a0 msgr2=0x7fae2c19a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:14.792 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.789+0000 7fae2bfff640 1 --2- 172.21.15.115:0/97506717 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae2c0fe9a0 0x7fae2c19a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:14.792 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.789+0000 7fae2bfff640 1 -- 172.21.15.115:0/97506717 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae20009560 con 0x7fae2c1049a0 2024-09-13T17:14:14.792 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.789+0000 7fae30acd640 1 --2- 172.21.15.115:0/97506717 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae2c0fe9a0 0x7fae2c19a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:14:14.792 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.790+0000 7fae2bfff640 1 --2- 172.21.15.115:0/97506717 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fae2c1049a0 0x7fae2c19ad30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fae1800eb00 tx=0x7fae18009e40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:14.792 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.790+0000 7fae29ffb640 1 -- 172.21.15.115:0/97506717 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae18013070 con 0x7fae2c1049a0 2024-09-13T17:14:14.792 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.790+0000 7fae29ffb640 1 -- 172.21.15.115:0/97506717 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fae180044d0 con 0x7fae2c1049a0 2024-09-13T17:14:14.793 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.790+0000 7fae29ffb640 1 -- 172.21.15.115:0/97506717 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae18003e40 con 0x7fae2c1049a0 2024-09-13T17:14:14.793 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.790+0000 7fae32d31640 1 -- 172.21.15.115:0/97506717 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae2c194c10 con 0x7fae2c1049a0 2024-09-13T17:14:14.793 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.790+0000 7fae32d31640 1 -- 172.21.15.115:0/97506717 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae2c195110 con 0x7fae2c1049a0 2024-09-13T17:14:14.794 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.791+0000 7fae29ffb640 1 -- 172.21.15.115:0/97506717 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fae1800bcc0 con 0x7fae2c1049a0 2024-09-13T17:14:14.794 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.791+0000 7fae32d31640 1 -- 172.21.15.115:0/97506717 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae2c1000e0 con 0x7fae2c1049a0 2024-09-13T17:14:14.794 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.792+0000 7fae29ffb640 1 --2- 172.21.15.115:0/97506717 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fae1c06cc50 0x7fae1c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:14.794 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.792+0000 7fae29ffb640 1 -- 172.21.15.115:0/97506717 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fae1808e120 con 0x7fae2c1049a0 2024-09-13T17:14:14.794 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.792+0000 7fae30acd640 1 --2- 172.21.15.115:0/97506717 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fae1c06cc50 0x7fae1c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:14.794 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.793+0000 7fae30acd640 1 --2- 172.21.15.115:0/97506717 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fae1c06cc50 0x7fae1c06f110 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fae20009230 tx=0x7fae20031400 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:14.797 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:14.796+0000 7fae29ffb640 1 -- 172.21.15.115:0/97506717 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fae1805bc30 con 0x7fae2c1049a0 2024-09-13T17:14:14.805 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:14 smithi195 ceph-mon[80021]: pgmap v266: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 19 MiB/s rd, 5 op/s 2024-09-13T17:14:14.805 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:14 smithi195 ceph-mon[80021]: reconnect by client.24287 v1:172.21.15.115:0/693373336 after 0 2024-09-13T17:14:14.805 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:14 smithi195 ceph-mon[80021]: mds.? [v2:172.21.15.115:6826/2768011029,v1:172.21.15.115:6827/2768011029] up:reconnect 2024-09-13T17:14:14.805 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:14 smithi195 ceph-mon[80021]: fsmap cephfs:1/1 {0=cephfs.smithi115.hbtxod=up:reconnect} 2 up:standby 2024-09-13T17:14:14.805 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:14 smithi195 ceph-mon[80021]: reconnect by client.24291 v1:192.168.0.1:0/3568065273 after 0.00399992 2024-09-13T17:14:15.060 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.059+0000 7fae32d31640 1 -- 172.21.15.115:0/97506717 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fae2c10baf0 con 0x7fae2c1049a0 2024-09-13T17:14:15.061 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.059+0000 7fae29ffb640 1 -- 172.21.15.115:0/97506717 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7fae1805b7c0 con 0x7fae2c1049a0 2024-09-13T17:14:15.061 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-13T17:14:15.061 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": { 2024-09-13T17:14:15.061 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 2 2024-09-13T17:14:15.061 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T17:14:15.061 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": { 2024-09-13T17:14:15.061 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 2 2024-09-13T17:14:15.061 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T17:14:15.061 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": { 2024-09-13T17:14:15.061 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 6 2024-09-13T17:14:15.061 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T17:14:15.062 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": { 2024-09-13T17:14:15.062 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 3 2024-09-13T17:14:15.062 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T17:14:15.062 INFO:teuthology.orchestra.run.smithi115.stdout: "overall": { 2024-09-13T17:14:15.062 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 13 2024-09-13T17:14:15.062 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-13T17:14:15.062 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-13T17:14:15.064 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.062+0000 7fae32d31640 1 -- 172.21.15.115:0/97506717 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fae1c06cc50 msgr2=0x7fae1c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:15.064 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.062+0000 7fae32d31640 1 --2- 172.21.15.115:0/97506717 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fae1c06cc50 0x7fae1c06f110 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fae20009230 tx=0x7fae20031400 comp rx=0 tx=0).stop 2024-09-13T17:14:15.064 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.062+0000 7fae32d31640 1 -- 172.21.15.115:0/97506717 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fae2c1049a0 msgr2=0x7fae2c19ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:15.064 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.062+0000 7fae32d31640 1 --2- 172.21.15.115:0/97506717 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fae2c1049a0 0x7fae2c19ad30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fae1800eb00 tx=0x7fae18009e40 comp rx=0 tx=0).stop 2024-09-13T17:14:15.064 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.062+0000 7fae32d31640 1 -- 172.21.15.115:0/97506717 shutdown_connections 2024-09-13T17:14:15.064 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.062+0000 7fae32d31640 1 --2- 172.21.15.115:0/97506717 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fae1c06cc50 0x7fae1c06f110 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:15.064 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.062+0000 7fae32d31640 1 --2- 172.21.15.115:0/97506717 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fae2c1049a0 0x7fae2c19ad30 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:15.064 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.062+0000 7fae32d31640 1 --2- 172.21.15.115:0/97506717 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae2c0fe9a0 0x7fae2c19a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:15.064 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.062+0000 7fae32d31640 1 -- 172.21.15.115:0/97506717 >> 172.21.15.115:0/97506717 conn(0x7fae2c0758c0 msgr2=0x7fae2c102350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:15.065 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.063+0000 7fae32d31640 1 -- 172.21.15.115:0/97506717 shutdown_connections 2024-09-13T17:14:15.065 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.063+0000 7fae32d31640 1 -- 172.21.15.115:0/97506717 wait complete. 2024-09-13T17:14:15.149 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.147+0000 7fcf8a6c4640 1 -- 172.21.15.115:0/659850869 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcf84101580 msgr2=0x7fcf84109a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:15.149 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.147+0000 7fcf8a6c4640 1 --2- 172.21.15.115:0/659850869 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcf84101580 0x7fcf84109a70 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fcf78009880 tx=0x7fcf7802a530 comp rx=0 tx=0).stop 2024-09-13T17:14:15.149 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.147+0000 7fcf8a6c4640 1 -- 172.21.15.115:0/659850869 shutdown_connections 2024-09-13T17:14:15.149 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.147+0000 7fcf8a6c4640 1 --2- 172.21.15.115:0/659850869 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcf84101580 0x7fcf84109a70 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:15.149 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.147+0000 7fcf8a6c4640 1 --2- 172.21.15.115:0/659850869 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf84100c60 0x7fcf84101040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:15.149 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.147+0000 7fcf8a6c4640 1 -- 172.21.15.115:0/659850869 >> 172.21.15.115:0/659850869 conn(0x7fcf840758c0 msgr2=0x7fcf840fcc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:15.149 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.147+0000 7fcf8a6c4640 1 -- 172.21.15.115:0/659850869 shutdown_connections 2024-09-13T17:14:15.149 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.147+0000 7fcf8a6c4640 1 -- 172.21.15.115:0/659850869 wait complete. 2024-09-13T17:14:15.149 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.148+0000 7fcf8a6c4640 1 Processor -- start 2024-09-13T17:14:15.149 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.148+0000 7fcf8a6c4640 1 -- start start 2024-09-13T17:14:15.151 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.148+0000 7fcf8a6c4640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf84100c60 0x7fcf8419b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:15.151 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.148+0000 7fcf8a6c4640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcf84101580 0x7fcf8419bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:15.151 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.148+0000 7fcf8a6c4640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8419c3e0 con 0x7fcf84101580 2024-09-13T17:14:15.151 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.148+0000 7fcf8a6c4640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf84195970 con 0x7fcf84100c60 2024-09-13T17:14:15.151 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.148+0000 7fcf837fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcf84101580 0x7fcf8419bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:15.151 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.148+0000 7fcf837fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcf84101580 0x7fcf8419bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56718/0 (socket says 172.21.15.115:56718) 2024-09-13T17:14:15.151 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.148+0000 7fcf837fe640 1 -- 172.21.15.115:0/2013879533 learned_addr learned my addr 172.21.15.115:0/2013879533 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:14:15.151 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.149+0000 7fcf837fe640 1 -- 172.21.15.115:0/2013879533 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf84100c60 msgr2=0x7fcf8419b880 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-13T17:14:15.151 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.149+0000 7fcf837fe640 1 --2- 172.21.15.115:0/2013879533 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf84100c60 0x7fcf8419b880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:15.151 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.149+0000 7fcf837fe640 1 -- 172.21.15.115:0/2013879533 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf78009560 con 0x7fcf84101580 2024-09-13T17:14:15.151 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.149+0000 7fcf837fe640 1 --2- 172.21.15.115:0/2013879533 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcf84101580 0x7fcf8419bdc0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fcf78006010 tx=0x7fcf78005610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:15.152 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.149+0000 7fcf817fa640 1 -- 172.21.15.115:0/2013879533 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf78004aa0 con 0x7fcf84101580 2024-09-13T17:14:15.152 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.149+0000 7fcf817fa640 1 -- 172.21.15.115:0/2013879533 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcf78004c00 con 0x7fcf84101580 2024-09-13T17:14:15.152 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.149+0000 7fcf817fa640 1 -- 172.21.15.115:0/2013879533 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf780318b0 con 0x7fcf84101580 2024-09-13T17:14:15.152 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.149+0000 7fcf8a6c4640 1 -- 172.21.15.115:0/2013879533 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf84195bf0 con 0x7fcf84101580 2024-09-13T17:14:15.152 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.149+0000 7fcf8a6c4640 1 -- 172.21.15.115:0/2013879533 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf841960e0 con 0x7fcf84101580 2024-09-13T17:14:15.153 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.150+0000 7fcf8a6c4640 1 -- 172.21.15.115:0/2013879533 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf840684c0 con 0x7fcf84101580 2024-09-13T17:14:15.153 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.151+0000 7fcf817fa640 1 -- 172.21.15.115:0/2013879533 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fcf7802ad50 con 0x7fcf84101580 2024-09-13T17:14:15.153 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.151+0000 7fcf817fa640 1 --2- 172.21.15.115:0/2013879533 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fcf6c06cc50 0x7fcf6c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:15.153 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.152+0000 7fcf817fa640 1 -- 172.21.15.115:0/2013879533 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fcf780ad320 con 0x7fcf84101580 2024-09-13T17:14:15.153 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.152+0000 7fcf83fff640 1 --2- 172.21.15.115:0/2013879533 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fcf6c06cc50 0x7fcf6c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:15.153 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.152+0000 7fcf83fff640 1 --2- 172.21.15.115:0/2013879533 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fcf6c06cc50 0x7fcf6c06f110 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fcf740096b0 tx=0x7fcf74006c20 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:15.161 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.160+0000 7fcf817fa640 1 -- 172.21.15.115:0/2013879533 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fcf78077410 con 0x7fcf84101580 2024-09-13T17:14:15.364 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.363+0000 7fcf8a6c4640 1 -- 172.21.15.115:0/2013879533 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fcf841010c0 con 0x7fcf84101580 2024-09-13T17:14:15.365 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.364+0000 7fcf817fa640 1 -- 172.21.15.115:0/2013879533 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 35 v35) v1 ==== 76+0+1674 (secure 0 0 0) 0x7fcf78003b90 con 0x7fcf84101580 2024-09-13T17:14:15.365 INFO:teuthology.orchestra.run.smithi115.stdout:e35 2024-09-13T17:14:15.365 INFO:teuthology.orchestra.run.smithi115.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T17:14:15.365 INFO:teuthology.orchestra.run.smithi115.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T17:14:15.365 INFO:teuthology.orchestra.run.smithi115.stdout:legacy client fscid: 1 2024-09-13T17:14:15.365 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:14:15.365 INFO:teuthology.orchestra.run.smithi115.stdout:Filesystem 'cephfs' (1) 2024-09-13T17:14:15.366 INFO:teuthology.orchestra.run.smithi115.stdout:fs_name cephfs 2024-09-13T17:14:15.366 INFO:teuthology.orchestra.run.smithi115.stdout:epoch 35 2024-09-13T17:14:15.366 INFO:teuthology.orchestra.run.smithi115.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T17:14:15.366 INFO:teuthology.orchestra.run.smithi115.stdout:created 2024-09-13T17:03:16.313116+0000 2024-09-13T17:14:15.366 INFO:teuthology.orchestra.run.smithi115.stdout:modified 2024-09-13T17:14:14.542908+0000 2024-09-13T17:14:15.366 INFO:teuthology.orchestra.run.smithi115.stdout:tableserver 0 2024-09-13T17:14:15.366 INFO:teuthology.orchestra.run.smithi115.stdout:root 0 2024-09-13T17:14:15.366 INFO:teuthology.orchestra.run.smithi115.stdout:session_timeout 60 2024-09-13T17:14:15.366 INFO:teuthology.orchestra.run.smithi115.stdout:session_autoclose 300 2024-09-13T17:14:15.366 INFO:teuthology.orchestra.run.smithi115.stdout:max_file_size 1099511627776 2024-09-13T17:14:15.366 INFO:teuthology.orchestra.run.smithi115.stdout:max_xattr_size 65536 2024-09-13T17:14:15.366 INFO:teuthology.orchestra.run.smithi115.stdout:required_client_features {} 2024-09-13T17:14:15.366 INFO:teuthology.orchestra.run.smithi115.stdout:last_failure 0 2024-09-13T17:14:15.366 INFO:teuthology.orchestra.run.smithi115.stdout:last_failure_osd_epoch 82 2024-09-13T17:14:15.367 INFO:teuthology.orchestra.run.smithi115.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T17:14:15.367 INFO:teuthology.orchestra.run.smithi115.stdout:max_mds 1 2024-09-13T17:14:15.367 INFO:teuthology.orchestra.run.smithi115.stdout:in 0 2024-09-13T17:14:15.367 INFO:teuthology.orchestra.run.smithi115.stdout:up {0=34320} 2024-09-13T17:14:15.367 INFO:teuthology.orchestra.run.smithi115.stdout:failed 2024-09-13T17:14:15.367 INFO:teuthology.orchestra.run.smithi115.stdout:damaged 2024-09-13T17:14:15.367 INFO:teuthology.orchestra.run.smithi115.stdout:stopped 2024-09-13T17:14:15.367 INFO:teuthology.orchestra.run.smithi115.stdout:data_pools [3] 2024-09-13T17:14:15.367 INFO:teuthology.orchestra.run.smithi115.stdout:metadata_pool 2 2024-09-13T17:14:15.367 INFO:teuthology.orchestra.run.smithi115.stdout:inline_data enabled 2024-09-13T17:14:15.367 INFO:teuthology.orchestra.run.smithi115.stdout:balancer 2024-09-13T17:14:15.367 INFO:teuthology.orchestra.run.smithi115.stdout:bal_rank_mask -1 2024-09-13T17:14:15.367 INFO:teuthology.orchestra.run.smithi115.stdout:standby_count_wanted 1 2024-09-13T17:14:15.367 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi115.hbtxod{0:34320} state up:rejoin seq 16 join_fscid=1 addr [v2:172.21.15.115:6826/2768011029,v1:172.21.15.115:6827/2768011029] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T17:14:15.367 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:14:15.368 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:14:15.368 INFO:teuthology.orchestra.run.smithi115.stdout:Standby daemons: 2024-09-13T17:14:15.368 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:14:15.368 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi115.ijznvr{-1:34324} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.115:6828/2716683507,v1:172.21.15.115:6829/2716683507] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T17:14:15.368 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi195.qzghxj{-1:44271} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.195:6824/825791083,v1:172.21.15.195:6825/825791083] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T17:14:15.369 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 35 2024-09-13T17:14:15.369 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.367+0000 7fcf8a6c4640 1 -- 172.21.15.115:0/2013879533 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fcf6c06cc50 msgr2=0x7fcf6c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:15.369 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.367+0000 7fcf8a6c4640 1 --2- 172.21.15.115:0/2013879533 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fcf6c06cc50 0x7fcf6c06f110 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fcf740096b0 tx=0x7fcf74006c20 comp rx=0 tx=0).stop 2024-09-13T17:14:15.369 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.367+0000 7fcf8a6c4640 1 -- 172.21.15.115:0/2013879533 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcf84101580 msgr2=0x7fcf8419bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:15.369 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.367+0000 7fcf8a6c4640 1 --2- 172.21.15.115:0/2013879533 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcf84101580 0x7fcf8419bdc0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fcf78006010 tx=0x7fcf78005610 comp rx=0 tx=0).stop 2024-09-13T17:14:15.369 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.367+0000 7fcf8a6c4640 1 -- 172.21.15.115:0/2013879533 shutdown_connections 2024-09-13T17:14:15.369 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.367+0000 7fcf8a6c4640 1 --2- 172.21.15.115:0/2013879533 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fcf6c06cc50 0x7fcf6c06f110 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:15.369 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.367+0000 7fcf8a6c4640 1 --2- 172.21.15.115:0/2013879533 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcf84101580 0x7fcf8419bdc0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:15.369 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.367+0000 7fcf8a6c4640 1 --2- 172.21.15.115:0/2013879533 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf84100c60 0x7fcf8419b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:15.369 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.367+0000 7fcf8a6c4640 1 -- 172.21.15.115:0/2013879533 >> 172.21.15.115:0/2013879533 conn(0x7fcf840758c0 msgr2=0x7fcf84101f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:15.369 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.367+0000 7fcf8a6c4640 1 -- 172.21.15.115:0/2013879533 shutdown_connections 2024-09-13T17:14:15.369 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.367+0000 7fcf8a6c4640 1 -- 172.21.15.115:0/2013879533 wait complete. 2024-09-13T17:14:15.465 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.463+0000 7fa8783fb640 1 -- 172.21.15.115:0/166688583 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa8701049f0 msgr2=0x7fa870104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:15.465 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.463+0000 7fa8783fb640 1 --2- 172.21.15.115:0/166688583 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa8701049f0 0x7fa870104dd0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa86c009880 tx=0x7fa86c02a4a0 comp rx=0 tx=0).stop 2024-09-13T17:14:15.465 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.463+0000 7fa8783fb640 1 -- 172.21.15.115:0/166688583 shutdown_connections 2024-09-13T17:14:15.465 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.463+0000 7fa8783fb640 1 --2- 172.21.15.115:0/166688583 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa8700fe9f0 0x7fa8700fee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:15.465 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.463+0000 7fa8783fb640 1 --2- 172.21.15.115:0/166688583 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa8701049f0 0x7fa870104dd0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:15.465 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.463+0000 7fa8783fb640 1 -- 172.21.15.115:0/166688583 >> 172.21.15.115:0/166688583 conn(0x7fa8700fa6d0 msgr2=0x7fa8700fcaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:15.465 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.463+0000 7fa8783fb640 1 -- 172.21.15.115:0/166688583 shutdown_connections 2024-09-13T17:14:15.465 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.463+0000 7fa8783fb640 1 -- 172.21.15.115:0/166688583 wait complete. 2024-09-13T17:14:15.465 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.464+0000 7fa8783fb640 1 Processor -- start 2024-09-13T17:14:15.465 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.464+0000 7fa8783fb640 1 -- start start 2024-09-13T17:14:15.467 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.464+0000 7fa8783fb640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa8700fe9f0 0x7fa8701968e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:15.467 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.464+0000 7fa8783fb640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa8701049f0 0x7fa870196e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:15.467 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.464+0000 7fa8783fb640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8701973f0 con 0x7fa8701049f0 2024-09-13T17:14:15.467 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.464+0000 7fa8783fb640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa870197560 con 0x7fa8700fe9f0 2024-09-13T17:14:15.467 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.464+0000 7fa875996640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa8701049f0 0x7fa870196e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:15.467 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.464+0000 7fa875996640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa8701049f0 0x7fa870196e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56748/0 (socket says 172.21.15.115:56748) 2024-09-13T17:14:15.467 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.464+0000 7fa875996640 1 -- 172.21.15.115:0/1949690355 learned_addr learned my addr 172.21.15.115:0/1949690355 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:14:15.467 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.464+0000 7fa876197640 1 --2- 172.21.15.115:0/1949690355 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa8700fe9f0 0x7fa8701968e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:15.467 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.464+0000 7fa875996640 1 -- 172.21.15.115:0/1949690355 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa8700fe9f0 msgr2=0x7fa8701968e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:15.467 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.464+0000 7fa875996640 1 --2- 172.21.15.115:0/1949690355 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa8700fe9f0 0x7fa8701968e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:15.467 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.464+0000 7fa875996640 1 -- 172.21.15.115:0/1949690355 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa86c009560 con 0x7fa8701049f0 2024-09-13T17:14:15.467 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.465+0000 7fa875996640 1 --2- 172.21.15.115:0/1949690355 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa8701049f0 0x7fa870196e20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa86000e970 tx=0x7fa86000ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:15.468 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.465+0000 7fa8677fe640 1 -- 172.21.15.115:0/1949690355 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa86000cc90 con 0x7fa8701049f0 2024-09-13T17:14:15.468 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.465+0000 7fa8783fb640 1 -- 172.21.15.115:0/1949690355 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa87019f950 con 0x7fa8701049f0 2024-09-13T17:14:15.468 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.465+0000 7fa8783fb640 1 -- 172.21.15.115:0/1949690355 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa87019fdc0 con 0x7fa8701049f0 2024-09-13T17:14:15.468 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.465+0000 7fa8677fe640 1 -- 172.21.15.115:0/1949690355 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa86000cdf0 con 0x7fa8701049f0 2024-09-13T17:14:15.468 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.465+0000 7fa8677fe640 1 -- 172.21.15.115:0/1949690355 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa860018770 con 0x7fa8701049f0 2024-09-13T17:14:15.469 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.466+0000 7fa8783fb640 1 -- 172.21.15.115:0/1949690355 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa870100130 con 0x7fa8701049f0 2024-09-13T17:14:15.469 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.466+0000 7fa8677fe640 1 -- 172.21.15.115:0/1949690355 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fa860010b60 con 0x7fa8701049f0 2024-09-13T17:14:15.469 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.467+0000 7fa8677fe640 1 --2- 172.21.15.115:0/1949690355 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fa85c06cc50 0x7fa85c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:15.469 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.467+0000 7fa8677fe640 1 -- 172.21.15.115:0/1949690355 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fa860014070 con 0x7fa8701049f0 2024-09-13T17:14:15.469 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.467+0000 7fa876197640 1 --2- 172.21.15.115:0/1949690355 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fa85c06cc50 0x7fa85c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:15.469 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.467+0000 7fa876197640 1 --2- 172.21.15.115:0/1949690355 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fa85c06cc50 0x7fa85c06f110 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa86c000c00 tx=0x7fa86c0058d0 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:15.472 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.471+0000 7fa8677fe640 1 -- 172.21.15.115:0/1949690355 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa860052e20 con 0x7fa8701049f0 2024-09-13T17:14:15.655 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.654+0000 7fa8783fb640 1 -- 172.21.15.115:0/1949690355 --> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa87010bb20 con 0x7fa85c06cc50 2024-09-13T17:14:15.655 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:15 smithi115 ceph-mon[109488]: from='client.34358 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:14:15.655 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:15 smithi115 ceph-mon[109488]: from='client.34362 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:14:15.655 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:15 smithi115 ceph-mon[109488]: mds.? [v2:172.21.15.115:6826/2768011029,v1:172.21.15.115:6827/2768011029] up:rejoin 2024-09-13T17:14:15.656 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:15 smithi115 ceph-mon[109488]: fsmap cephfs:1/1 {0=cephfs.smithi115.hbtxod=up:rejoin} 2 up:standby 2024-09-13T17:14:15.656 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:15 smithi115 ceph-mon[109488]: daemon mds.cephfs.smithi115.hbtxod is now active in filesystem cephfs as rank 0 2024-09-13T17:14:15.656 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:15 smithi115 ceph-mon[109488]: from='client.34366 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:14:15.656 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:15 smithi115 ceph-mon[109488]: from='client.? 172.21.15.115:0/97506717' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:14:15.656 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:15 smithi115 ceph-mon[109488]: from='client.? 172.21.15.115:0/2013879533' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T17:14:15.656 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:15 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:15.656 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:15 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:15.656 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:15 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:14:15.657 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.655+0000 7fa8677fe640 1 -- 172.21.15.115:0/1949690355 <== mgr.14660 v2:172.21.15.115:6800/1049502673 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fa87010bb20 con 0x7fa85c06cc50 2024-09-13T17:14:15.657 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-13T17:14:15.657 INFO:teuthology.orchestra.run.smithi115.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256", 2024-09-13T17:14:15.657 INFO:teuthology.orchestra.run.smithi115.stdout: "in_progress": true, 2024-09-13T17:14:15.657 INFO:teuthology.orchestra.run.smithi115.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T17:14:15.657 INFO:teuthology.orchestra.run.smithi115.stdout: "services_complete": [ 2024-09-13T17:14:15.657 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr", 2024-09-13T17:14:15.657 INFO:teuthology.orchestra.run.smithi115.stdout: "osd", 2024-09-13T17:14:15.658 INFO:teuthology.orchestra.run.smithi115.stdout: "mon", 2024-09-13T17:14:15.658 INFO:teuthology.orchestra.run.smithi115.stdout: "crash" 2024-09-13T17:14:15.658 INFO:teuthology.orchestra.run.smithi115.stdout: ], 2024-09-13T17:14:15.658 INFO:teuthology.orchestra.run.smithi115.stdout: "progress": "15/23 daemons upgraded", 2024-09-13T17:14:15.658 INFO:teuthology.orchestra.run.smithi115.stdout: "message": "Currently upgrading mds daemons", 2024-09-13T17:14:15.658 INFO:teuthology.orchestra.run.smithi115.stdout: "is_paused": false 2024-09-13T17:14:15.658 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-13T17:14:15.659 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.657+0000 7fa8783fb640 1 -- 172.21.15.115:0/1949690355 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fa85c06cc50 msgr2=0x7fa85c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:15.659 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.657+0000 7fa8783fb640 1 --2- 172.21.15.115:0/1949690355 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fa85c06cc50 0x7fa85c06f110 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa86c000c00 tx=0x7fa86c0058d0 comp rx=0 tx=0).stop 2024-09-13T17:14:15.659 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.657+0000 7fa8783fb640 1 -- 172.21.15.115:0/1949690355 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa8701049f0 msgr2=0x7fa870196e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:15.659 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.657+0000 7fa8783fb640 1 --2- 172.21.15.115:0/1949690355 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa8701049f0 0x7fa870196e20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa86000e970 tx=0x7fa86000ee30 comp rx=0 tx=0).stop 2024-09-13T17:14:15.659 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.657+0000 7fa8783fb640 1 -- 172.21.15.115:0/1949690355 shutdown_connections 2024-09-13T17:14:15.659 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.657+0000 7fa8783fb640 1 --2- 172.21.15.115:0/1949690355 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fa85c06cc50 0x7fa85c06f110 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:15.659 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.657+0000 7fa8783fb640 1 --2- 172.21.15.115:0/1949690355 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa8701049f0 0x7fa870196e20 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:15.659 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.657+0000 7fa8783fb640 1 --2- 172.21.15.115:0/1949690355 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa8700fe9f0 0x7fa8701968e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:15.659 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.657+0000 7fa8783fb640 1 -- 172.21.15.115:0/1949690355 >> 172.21.15.115:0/1949690355 conn(0x7fa8700fa6d0 msgr2=0x7fa8700fc920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:15.659 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.657+0000 7fa8783fb640 1 -- 172.21.15.115:0/1949690355 shutdown_connections 2024-09-13T17:14:15.659 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.657+0000 7fa8783fb640 1 -- 172.21.15.115:0/1949690355 wait complete. 2024-09-13T17:14:15.739 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.737+0000 7ff75d4f2640 1 -- 172.21.15.115:0/4180095169 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff758100c60 msgr2=0x7ff758101040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:15.739 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.737+0000 7ff75d4f2640 1 --2- 172.21.15.115:0/4180095169 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff758100c60 0x7ff758101040 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff748009c20 tx=0x7ff74802aa00 comp rx=0 tx=0).stop 2024-09-13T17:14:15.739 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.738+0000 7ff75d4f2640 1 -- 172.21.15.115:0/4180095169 shutdown_connections 2024-09-13T17:14:15.739 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.738+0000 7ff75d4f2640 1 --2- 172.21.15.115:0/4180095169 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff758101580 0x7ff758109a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:15.739 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.738+0000 7ff75d4f2640 1 --2- 172.21.15.115:0/4180095169 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff758100c60 0x7ff758101040 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:15.740 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.738+0000 7ff75d4f2640 1 -- 172.21.15.115:0/4180095169 >> 172.21.15.115:0/4180095169 conn(0x7ff7580758c0 msgr2=0x7ff7580fcc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:15.740 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.738+0000 7ff75d4f2640 1 -- 172.21.15.115:0/4180095169 shutdown_connections 2024-09-13T17:14:15.740 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.738+0000 7ff75d4f2640 1 -- 172.21.15.115:0/4180095169 wait complete. 2024-09-13T17:14:15.740 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.738+0000 7ff75d4f2640 1 Processor -- start 2024-09-13T17:14:15.741 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.738+0000 7ff75d4f2640 1 -- start start 2024-09-13T17:14:15.741 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.739+0000 7ff75d4f2640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff758100c60 0x7ff75819b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:15.741 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.739+0000 7ff75d4f2640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff758101580 0x7ff75819bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:15.741 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.739+0000 7ff75d4f2640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff75819c380 con 0x7ff758101580 2024-09-13T17:14:15.741 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.739+0000 7ff75d4f2640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff758195910 con 0x7ff758100c60 2024-09-13T17:14:15.742 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.739+0000 7ff7567fc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff758101580 0x7ff75819bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:15.742 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.739+0000 7ff7567fc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff758101580 0x7ff75819bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56754/0 (socket says 172.21.15.115:56754) 2024-09-13T17:14:15.742 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.739+0000 7ff7567fc640 1 -- 172.21.15.115:0/4103590010 learned_addr learned my addr 172.21.15.115:0/4103590010 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:14:15.742 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.739+0000 7ff756ffd640 1 --2- 172.21.15.115:0/4103590010 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff758100c60 0x7ff75819b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:15.742 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.739+0000 7ff7567fc640 1 -- 172.21.15.115:0/4103590010 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff758100c60 msgr2=0x7ff75819b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:15.742 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.739+0000 7ff7567fc640 1 --2- 172.21.15.115:0/4103590010 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff758100c60 0x7ff75819b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:15.742 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.739+0000 7ff7567fc640 1 -- 172.21.15.115:0/4103590010 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff748009900 con 0x7ff758101580 2024-09-13T17:14:15.742 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.739+0000 7ff7567fc640 1 --2- 172.21.15.115:0/4103590010 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff758101580 0x7ff75819bd60 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff74c00d6d0 tx=0x7ff74c00db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:15.742 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.739+0000 7ff73ffff640 1 -- 172.21.15.115:0/4103590010 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff74c0051f0 con 0x7ff758101580 2024-09-13T17:14:15.742 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.739+0000 7ff73ffff640 1 -- 172.21.15.115:0/4103590010 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff74c009820 con 0x7ff758101580 2024-09-13T17:14:15.742 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.739+0000 7ff75d4f2640 1 -- 172.21.15.115:0/4103590010 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff758195bf0 con 0x7ff758101580 2024-09-13T17:14:15.742 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.739+0000 7ff73ffff640 1 -- 172.21.15.115:0/4103590010 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff74c004d00 con 0x7ff758101580 2024-09-13T17:14:15.742 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.739+0000 7ff75d4f2640 1 -- 172.21.15.115:0/4103590010 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff758196140 con 0x7ff758101580 2024-09-13T17:14:15.743 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.741+0000 7ff75d4f2640 1 -- 172.21.15.115:0/4103590010 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7580684c0 con 0x7ff758101580 2024-09-13T17:14:15.743 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.741+0000 7ff73ffff640 1 -- 172.21.15.115:0/4103590010 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7ff74c005350 con 0x7ff758101580 2024-09-13T17:14:15.743 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.741+0000 7ff73ffff640 1 --2- 172.21.15.115:0/4103590010 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7ff74006cc50 0x7ff74006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:15.743 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.741+0000 7ff73ffff640 1 -- 172.21.15.115:0/4103590010 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6328+0+0 (secure 0 0 0) 0x7ff74c08c100 con 0x7ff758101580 2024-09-13T17:14:15.744 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.741+0000 7ff756ffd640 1 --2- 172.21.15.115:0/4103590010 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7ff74006cc50 0x7ff74006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:15.744 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.742+0000 7ff756ffd640 1 --2- 172.21.15.115:0/4103590010 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7ff74006cc50 0x7ff74006f110 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff748000f80 tx=0x7ff74803b040 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:15.746 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.746+0000 7ff73ffff640 1 -- 172.21.15.115:0/4103590010 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff74c056170 con 0x7ff758101580 2024-09-13T17:14:15.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:15 smithi195 ceph-mon[80021]: from='client.34358 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:14:15.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:15 smithi195 ceph-mon[80021]: from='client.34362 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:14:15.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:15 smithi195 ceph-mon[80021]: mds.? [v2:172.21.15.115:6826/2768011029,v1:172.21.15.115:6827/2768011029] up:rejoin 2024-09-13T17:14:15.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:15 smithi195 ceph-mon[80021]: fsmap cephfs:1/1 {0=cephfs.smithi115.hbtxod=up:rejoin} 2 up:standby 2024-09-13T17:14:15.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:15 smithi195 ceph-mon[80021]: daemon mds.cephfs.smithi115.hbtxod is now active in filesystem cephfs as rank 0 2024-09-13T17:14:15.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:15 smithi195 ceph-mon[80021]: from='client.34366 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:14:15.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:15 smithi195 ceph-mon[80021]: from='client.? 172.21.15.115:0/97506717' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:14:15.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:15 smithi195 ceph-mon[80021]: from='client.? 172.21.15.115:0/2013879533' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T17:14:15.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:15 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:15.828 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:15 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:15.828 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:15 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:14:15.973 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.972+0000 7ff75d4f2640 1 -- 172.21.15.115:0/4103590010 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7ff758101040 con 0x7ff758101580 2024-09-13T17:14:15.973 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.972+0000 7ff73ffff640 1 -- 172.21.15.115:0/4103590010 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7ff74c059790 con 0x7ff758101580 2024-09-13T17:14:15.974 INFO:teuthology.orchestra.run.smithi115.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-13T17:14:15.974 INFO:teuthology.orchestra.run.smithi115.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T17:14:15.974 INFO:teuthology.orchestra.run.smithi115.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T17:14:15.976 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.974+0000 7ff75d4f2640 1 -- 172.21.15.115:0/4103590010 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7ff74006cc50 msgr2=0x7ff74006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:15.976 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.974+0000 7ff75d4f2640 1 --2- 172.21.15.115:0/4103590010 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7ff74006cc50 0x7ff74006f110 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff748000f80 tx=0x7ff74803b040 comp rx=0 tx=0).stop 2024-09-13T17:14:15.976 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.974+0000 7ff75d4f2640 1 -- 172.21.15.115:0/4103590010 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff758101580 msgr2=0x7ff75819bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:15.976 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.974+0000 7ff75d4f2640 1 --2- 172.21.15.115:0/4103590010 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff758101580 0x7ff75819bd60 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff74c00d6d0 tx=0x7ff74c00db90 comp rx=0 tx=0).stop 2024-09-13T17:14:15.976 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.975+0000 7ff75d4f2640 1 -- 172.21.15.115:0/4103590010 shutdown_connections 2024-09-13T17:14:15.976 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.975+0000 7ff75d4f2640 1 --2- 172.21.15.115:0/4103590010 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7ff74006cc50 0x7ff74006f110 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:15.976 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.975+0000 7ff75d4f2640 1 --2- 172.21.15.115:0/4103590010 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff758101580 0x7ff75819bd60 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:15.976 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.975+0000 7ff75d4f2640 1 --2- 172.21.15.115:0/4103590010 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff758100c60 0x7ff75819b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:15.976 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.975+0000 7ff75d4f2640 1 -- 172.21.15.115:0/4103590010 >> 172.21.15.115:0/4103590010 conn(0x7ff7580758c0 msgr2=0x7ff758101f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:15.977 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.975+0000 7ff75d4f2640 1 -- 172.21.15.115:0/4103590010 shutdown_connections 2024-09-13T17:14:15.977 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:15.975+0000 7ff75d4f2640 1 -- 172.21.15.115:0/4103590010 wait complete. 2024-09-13T17:14:16.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:16 smithi195 ceph-mon[80021]: pgmap v267: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 20 MiB/s rd, 102 B/s wr, 6 op/s 2024-09-13T17:14:16.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:16 smithi195 ceph-mon[80021]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-13T17:14:16.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:16 smithi195 ceph-mon[80021]: mds.? [v2:172.21.15.115:6826/2768011029,v1:172.21.15.115:6827/2768011029] up:active 2024-09-13T17:14:16.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:16 smithi195 ceph-mon[80021]: mds.? [v2:172.21.15.195:6826/589520116,v1:172.21.15.195:6827/589520116] up:boot 2024-09-13T17:14:16.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:16 smithi195 ceph-mon[80021]: fsmap cephfs:1 {0=cephfs.smithi115.hbtxod=up:active} 3 up:standby 2024-09-13T17:14:16.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:16 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.aevvgz"}]: dispatch 2024-09-13T17:14:16.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:16 smithi195 ceph-mon[80021]: from='client.34382 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:14:16.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:16 smithi195 ceph-mon[80021]: from='client.? 172.21.15.115:0/4103590010' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T17:14:16.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:16 smithi115 ceph-mon[109488]: pgmap v267: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 20 MiB/s rd, 102 B/s wr, 6 op/s 2024-09-13T17:14:16.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:16 smithi115 ceph-mon[109488]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-13T17:14:16.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:16 smithi115 ceph-mon[109488]: mds.? [v2:172.21.15.115:6826/2768011029,v1:172.21.15.115:6827/2768011029] up:active 2024-09-13T17:14:16.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:16 smithi115 ceph-mon[109488]: mds.? [v2:172.21.15.195:6826/589520116,v1:172.21.15.195:6827/589520116] up:boot 2024-09-13T17:14:16.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:16 smithi115 ceph-mon[109488]: fsmap cephfs:1 {0=cephfs.smithi115.hbtxod=up:active} 3 up:standby 2024-09-13T17:14:16.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:16 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.aevvgz"}]: dispatch 2024-09-13T17:14:16.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:16 smithi115 ceph-mon[109488]: from='client.34382 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:14:16.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:16 smithi115 ceph-mon[109488]: from='client.? 172.21.15.115:0/4103590010' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T17:14:18.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:18 smithi195 ceph-mon[80021]: pgmap v268: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 175 B/s wr, 7 op/s 2024-09-13T17:14:18.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:18 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:18.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:18 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:18.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:18 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:18.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:18 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:18.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:18 smithi115 ceph-mon[109488]: pgmap v268: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 175 B/s wr, 7 op/s 2024-09-13T17:14:18.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:18 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:18.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:18 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:18.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:18 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:18.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:18 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:20.828 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:20 smithi195 ceph-mon[80021]: pgmap v269: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 170 B/s wr, 6 op/s 2024-09-13T17:14:20.928 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:20 smithi115 ceph-mon[109488]: pgmap v269: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 170 B/s wr, 6 op/s 2024-09-13T17:14:21.753 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:21 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:14:21.928 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:21 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:14:23.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:22 smithi195 ceph-mon[80021]: pgmap v270: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 170 B/s wr, 6 op/s 2024-09-13T17:14:23.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:22 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:23.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:22 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:23.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:22 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:14:23.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:22 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:14:23.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:22 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:23.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:22 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:14:23.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:22 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:14:23.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:22 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:14:23.078 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:22 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:14:23.079 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:22 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:14:23.079 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:22 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:14:23.079 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:22 smithi195 ceph-mon[80021]: Upgrade: Setting container_image for all mds 2024-09-13T17:14:23.079 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:22 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:23.079 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:22 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi115.hbtxod"}]: dispatch 2024-09-13T17:14:23.079 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:22 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi115.hbtxod"}]': finished 2024-09-13T17:14:23.079 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:22 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi115.ijznvr"}]: dispatch 2024-09-13T17:14:23.079 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:22 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi115.ijznvr"}]': finished 2024-09-13T17:14:23.079 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:22 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi195.aevvgz"}]: dispatch 2024-09-13T17:14:23.080 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:22 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi195.aevvgz"}]': finished 2024-09-13T17:14:23.080 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:22 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi195.qzghxj"}]: dispatch 2024-09-13T17:14:23.080 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:22 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi195.qzghxj"}]': finished 2024-09-13T17:14:23.080 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:22 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]: dispatch 2024-09-13T17:14:23.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:22 smithi115 ceph-mon[109488]: pgmap v270: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 170 B/s wr, 6 op/s 2024-09-13T17:14:23.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:22 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:23.180 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:22 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:23.180 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:22 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:14:23.180 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:22 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:14:23.180 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:22 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:23.180 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:22 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:14:23.180 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:22 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:14:23.180 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:22 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:14:23.180 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:22 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:14:23.180 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:22 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:14:23.180 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:22 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:14:23.180 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:22 smithi115 ceph-mon[109488]: Upgrade: Setting container_image for all mds 2024-09-13T17:14:23.180 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:22 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:23.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:22 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi115.hbtxod"}]: dispatch 2024-09-13T17:14:23.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:22 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi115.hbtxod"}]': finished 2024-09-13T17:14:23.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:22 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi115.ijznvr"}]: dispatch 2024-09-13T17:14:23.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:22 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi115.ijznvr"}]': finished 2024-09-13T17:14:23.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:22 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi195.aevvgz"}]: dispatch 2024-09-13T17:14:23.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:22 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi195.aevvgz"}]': finished 2024-09-13T17:14:23.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:22 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi195.qzghxj"}]: dispatch 2024-09-13T17:14:23.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:22 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi195.qzghxj"}]': finished 2024-09-13T17:14:23.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:22 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]: dispatch 2024-09-13T17:14:24.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:23 smithi195 ceph-mon[80021]: Upgrade: Setting filesystem cephfs Joinable 2024-09-13T17:14:24.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:23 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-09-13T17:14:24.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:23 smithi195 ceph-mon[80021]: fsmap cephfs:1 {0=cephfs.smithi115.hbtxod=up:active} 3 up:standby 2024-09-13T17:14:24.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:23 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]: dispatch 2024-09-13T17:14:24.077 INFO:journalctl@ceph.osd.3.smithi195.stdout:Sep 13 17:14:23 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-3[88826]: 2024-09-13T17:14:23.895+0000 7f5db0b8c640 -1 bdev(0x55b635fb4e00 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 3 2024-09-13T17:14:24.077 INFO:journalctl@ceph.osd.3.smithi195.stdout:Sep 13 17:14:23 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-3[88826]: 2024-09-13T17:14:23.895+0000 7f5dabb82640 -1 bdev(0x55b635fb4e00 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 4 2024-09-13T17:14:24.077 INFO:journalctl@ceph.osd.3.smithi195.stdout:Sep 13 17:14:23 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-3[88826]: 2024-09-13T17:14:23.896+0000 7f5daeb88640 -1 bdev(0x55b635fb4e00 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 6 2024-09-13T17:14:24.077 INFO:journalctl@ceph.osd.3.smithi195.stdout:Sep 13 17:14:23 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-3[88826]: 2024-09-13T17:14:23.897+0000 7f5da937d640 -1 bdev(0x55b635fb4e00 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 9 2024-09-13T17:14:24.179 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 17:14:23 smithi115 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-1[124165]: 2024-09-13T17:14:23.895+0000 7f7726e53640 -1 bdev(0x55ee5b4c4e00 /var/lib/ceph/osd/ceph-1/block) aio_submit retries 4 2024-09-13T17:14:24.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:23 smithi115 ceph-mon[109488]: Upgrade: Setting filesystem cephfs Joinable 2024-09-13T17:14:24.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:23 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-09-13T17:14:24.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:23 smithi115 ceph-mon[109488]: fsmap cephfs:1 {0=cephfs.smithi115.hbtxod=up:active} 3 up:standby 2024-09-13T17:14:24.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:23 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]: dispatch 2024-09-13T17:14:25.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:24 smithi115 ceph-mon[109488]: Upgrade: Enabling allow_standby_replay on filesystem cephfs 2024-09-13T17:14:25.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:24 smithi115 ceph-mon[109488]: pgmap v271: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 7.7 MiB/s rd, 4.4 KiB/s wr, 7 op/s 2024-09-13T17:14:25.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:24 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]': finished 2024-09-13T17:14:25.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:24 smithi115 ceph-mon[109488]: fsmap cephfs:1 {0=cephfs.smithi115.hbtxod=up:active} 1 up:standby-replay 2 up:standby 2024-09-13T17:14:25.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:24 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:25.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:24 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:14:25.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:24 smithi115 ceph-mon[109488]: Upgrade: Setting container_image for all rgw 2024-09-13T17:14:25.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:24 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:25.180 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:24 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:14:25.180 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:24 smithi115 ceph-mon[109488]: Upgrade: Setting container_image for all rbd-mirror 2024-09-13T17:14:25.180 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:24 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:25.180 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:24 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:14:25.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:24 smithi195 ceph-mon[80021]: Upgrade: Enabling allow_standby_replay on filesystem cephfs 2024-09-13T17:14:25.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:24 smithi195 ceph-mon[80021]: pgmap v271: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 7.7 MiB/s rd, 4.4 KiB/s wr, 7 op/s 2024-09-13T17:14:25.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:24 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]': finished 2024-09-13T17:14:25.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:24 smithi195 ceph-mon[80021]: fsmap cephfs:1 {0=cephfs.smithi115.hbtxod=up:active} 1 up:standby-replay 2 up:standby 2024-09-13T17:14:25.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:24 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:25.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:24 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:14:25.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:24 smithi195 ceph-mon[80021]: Upgrade: Setting container_image for all rgw 2024-09-13T17:14:25.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:24 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:25.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:24 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:14:25.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:24 smithi195 ceph-mon[80021]: Upgrade: Setting container_image for all rbd-mirror 2024-09-13T17:14:25.328 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:24 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:25.328 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:24 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:14:26.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:26 smithi195 ceph-mon[80021]: Upgrade: Updating ceph-exporter.smithi115 (1/2) 2024-09-13T17:14:26.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:26 smithi195 ceph-mon[80021]: pgmap v272: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 3.7 MiB/s rd, 4.4 KiB/s wr, 6 op/s 2024-09-13T17:14:26.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:26 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:26.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:26 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi115", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T17:14:26.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:26 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:14:26.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:26 smithi195 ceph-mon[80021]: Deploying daemon ceph-exporter.smithi115 on smithi115 2024-09-13T17:14:26.928 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:26 smithi115 ceph-mon[109488]: Upgrade: Updating ceph-exporter.smithi115 (1/2) 2024-09-13T17:14:26.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:26 smithi115 ceph-mon[109488]: pgmap v272: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 3.7 MiB/s rd, 4.4 KiB/s wr, 6 op/s 2024-09-13T17:14:26.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:26 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:26.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:26 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi115", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T17:14:26.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:26 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:14:26.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:26 smithi115 ceph-mon[109488]: Deploying daemon ceph-exporter.smithi115 on smithi115 2024-09-13T17:14:28.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:28 smithi115 ceph-mon[109488]: pgmap v273: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 6.7 MiB/s rd, 4.3 KiB/s wr, 7 op/s 2024-09-13T17:14:28.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:28 smithi195 ceph-mon[80021]: pgmap v273: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 6.7 MiB/s rd, 4.3 KiB/s wr, 7 op/s 2024-09-13T17:14:30.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:30 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:30.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:30 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:30.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:30 smithi115 ceph-mon[109488]: pgmap v274: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 9.7 MiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-09-13T17:14:30.757 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:30 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:30.757 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:30 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:30.757 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:30 smithi195 ceph-mon[80021]: pgmap v274: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 9.7 MiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-09-13T17:14:31.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:31 smithi115 ceph-mon[109488]: Upgrade: Updating ceph-exporter.smithi195 (2/2) 2024-09-13T17:14:31.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:31 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:31.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:31 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi195", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T17:14:31.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:31 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:14:31.930 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:31 smithi115 ceph-mon[109488]: Deploying daemon ceph-exporter.smithi195 on smithi195 2024-09-13T17:14:31.946 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:31 smithi195 ceph-mon[80021]: Upgrade: Updating ceph-exporter.smithi195 (2/2) 2024-09-13T17:14:31.946 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:31 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:31.946 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:31 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi195", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T17:14:31.946 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:31 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:14:31.946 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:31 smithi195 ceph-mon[80021]: Deploying daemon ceph-exporter.smithi195 on smithi195 2024-09-13T17:14:33.018 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:32 smithi195 ceph-mon[80021]: pgmap v275: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-09-13T17:14:33.178 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:32 smithi115 ceph-mon[109488]: pgmap v275: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-09-13T17:14:35.076 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:34 smithi195 ceph-mon[80021]: pgmap v276: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-09-13T17:14:35.076 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:34 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:35.076 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:34 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:35.076 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:34 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:14:35.084 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:34 smithi115 ceph-mon[109488]: pgmap v276: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-09-13T17:14:35.084 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:34 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:35.084 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:34 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:35.084 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:34 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:14:36.076 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:35 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:14:36.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:35 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:14:36.928 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:36 smithi115 ceph-mon[109488]: pgmap v277: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2024-09-13T17:14:36.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:36 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:36.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:36 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:37.076 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:36 smithi195 ceph-mon[80021]: pgmap v277: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2024-09-13T17:14:37.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:36 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:37.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:36 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:38.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:37 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:38.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:37 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:38.278 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:37 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:38.278 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:37 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:39.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:38 smithi115 ceph-mon[109488]: pgmap v278: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4 op/s 2024-09-13T17:14:39.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:38 smithi195 ceph-mon[80021]: pgmap v278: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4 op/s 2024-09-13T17:14:40.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:39 smithi195 ceph-mon[80021]: pgmap v279: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 9.7 MiB/s rd, 3 op/s 2024-09-13T17:14:40.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:39 smithi115 ceph-mon[109488]: pgmap v279: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 9.7 MiB/s rd, 3 op/s 2024-09-13T17:14:41.420 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:41 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:41.420 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:41 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:41.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:41 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:41.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:41 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:42.428 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:42 smithi115 ceph-mon[109488]: pgmap v280: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 6.7 MiB/s rd, 2 op/s 2024-09-13T17:14:42.576 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:42 smithi195 ceph-mon[80021]: pgmap v280: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 6.7 MiB/s rd, 2 op/s 2024-09-13T17:14:43.407 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:43 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:43.407 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:43 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:43.407 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:43 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:43.407 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:43 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:43.576 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:43 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:43.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:43 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:43.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:43 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:43.577 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:43 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:45.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:44 smithi115 ceph-mon[109488]: pgmap v281: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 4.3 MiB/s rd, 2 op/s 2024-09-13T17:14:45.326 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:44 smithi195 ceph-mon[80021]: pgmap v281: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 4.3 MiB/s rd, 2 op/s 2024-09-13T17:14:46.063 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.060+0000 7f7b36ef6640 1 -- 172.21.15.115:0/1261984779 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7b300fe9a0 msgr2=0x7f7b300fee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:46.063 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.060+0000 7f7b36ef6640 1 --2- 172.21.15.115:0/1261984779 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7b300fe9a0 0x7f7b300fee00 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c009880 tx=0x7f7b1c02a4a0 comp rx=0 tx=0).stop 2024-09-13T17:14:46.063 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.060+0000 7f7b36ef6640 1 -- 172.21.15.115:0/1261984779 shutdown_connections 2024-09-13T17:14:46.063 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.060+0000 7f7b36ef6640 1 --2- 172.21.15.115:0/1261984779 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7b300fe9a0 0x7f7b300fee00 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:46.063 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.060+0000 7f7b36ef6640 1 --2- 172.21.15.115:0/1261984779 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7b301049a0 0x7f7b30104d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:46.063 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.060+0000 7f7b36ef6640 1 -- 172.21.15.115:0/1261984779 >> 172.21.15.115:0/1261984779 conn(0x7f7b300758c0 msgr2=0x7f7b300fcc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:46.063 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.060+0000 7f7b36ef6640 1 -- 172.21.15.115:0/1261984779 shutdown_connections 2024-09-13T17:14:46.064 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.060+0000 7f7b36ef6640 1 -- 172.21.15.115:0/1261984779 wait complete. 2024-09-13T17:14:46.064 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.061+0000 7f7b36ef6640 1 Processor -- start 2024-09-13T17:14:46.064 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.061+0000 7f7b36ef6640 1 -- start start 2024-09-13T17:14:46.064 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.061+0000 7f7b36ef6640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7b300fe9a0 0x7f7b30196990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:46.064 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.061+0000 7f7b36ef6640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7b301049a0 0x7f7b30196ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:46.064 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.061+0000 7f7b36ef6640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b301974a0 con 0x7f7b300fe9a0 2024-09-13T17:14:46.064 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.061+0000 7f7b36ef6640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b30197610 con 0x7f7b301049a0 2024-09-13T17:14:46.064 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.061+0000 7f7b34c92640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7b300fe9a0 0x7f7b30196990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:46.064 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.061+0000 7f7b34c92640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7b300fe9a0 0x7f7b30196990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47456/0 (socket says 172.21.15.115:47456) 2024-09-13T17:14:46.064 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.061+0000 7f7b34c92640 1 -- 172.21.15.115:0/2116279823 learned_addr learned my addr 172.21.15.115:0/2116279823 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:14:46.064 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.061+0000 7f7b2ffff640 1 --2- 172.21.15.115:0/2116279823 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7b301049a0 0x7f7b30196ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:46.065 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.061+0000 7f7b34c92640 1 -- 172.21.15.115:0/2116279823 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7b301049a0 msgr2=0x7f7b30196ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:46.065 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.061+0000 7f7b34c92640 1 --2- 172.21.15.115:0/2116279823 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7b301049a0 0x7f7b30196ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:46.065 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.061+0000 7f7b34c92640 1 -- 172.21.15.115:0/2116279823 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b1c009560 con 0x7f7b300fe9a0 2024-09-13T17:14:46.065 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.062+0000 7f7b34c92640 1 --2- 172.21.15.115:0/2116279823 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7b300fe9a0 0x7f7b30196990 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7b2400b420 tx=0x7f7b2400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:46.065 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.062+0000 7f7b2dffb640 1 -- 172.21.15.115:0/2116279823 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b24011800 con 0x7f7b300fe9a0 2024-09-13T17:14:46.065 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.062+0000 7f7b2dffb640 1 -- 172.21.15.115:0/2116279823 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7b24011e00 con 0x7f7b300fe9a0 2024-09-13T17:14:46.066 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.062+0000 7f7b36ef6640 1 -- 172.21.15.115:0/2116279823 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b3019fa00 con 0x7f7b300fe9a0 2024-09-13T17:14:46.067 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.062+0000 7f7b2dffb640 1 -- 172.21.15.115:0/2116279823 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b2400f2e0 con 0x7f7b300fe9a0 2024-09-13T17:14:46.067 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.062+0000 7f7b36ef6640 1 -- 172.21.15.115:0/2116279823 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b3019fe70 con 0x7f7b300fe9a0 2024-09-13T17:14:46.068 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.063+0000 7f7b36ef6640 1 -- 172.21.15.115:0/2116279823 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b301000e0 con 0x7f7b300fe9a0 2024-09-13T17:14:46.068 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.064+0000 7f7b2dffb640 1 -- 172.21.15.115:0/2116279823 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f7b24010380 con 0x7f7b300fe9a0 2024-09-13T17:14:46.068 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.064+0000 7f7b2dffb640 1 --2- 172.21.15.115:0/2116279823 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f7b2006cc50 0x7f7b2006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:46.068 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.064+0000 7f7b2dffb640 1 -- 172.21.15.115:0/2116279823 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f7b2408bee0 con 0x7f7b300fe9a0 2024-09-13T17:14:46.068 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.064+0000 7f7b2ffff640 1 --2- 172.21.15.115:0/2116279823 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f7b2006cc50 0x7f7b2006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:46.069 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.065+0000 7f7b2ffff640 1 --2- 172.21.15.115:0/2116279823 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f7b2006cc50 0x7f7b2006f110 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c006010 tx=0x7f7b1c000bc0 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:46.069 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.068+0000 7f7b2dffb640 1 -- 172.21.15.115:0/2116279823 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f7b24055f70 con 0x7f7b300fe9a0 2024-09-13T17:14:46.250 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.249+0000 7f7b36ef6640 1 -- 172.21.15.115:0/2116279823 --> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7b30068270 con 0x7f7b2006cc50 2024-09-13T17:14:46.252 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.251+0000 7f7b2dffb640 1 -- 172.21.15.115:0/2116279823 <== mgr.14660 v2:172.21.15.115:6800/1049502673 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+466 (secure 0 0 0) 0x7f7b30068270 con 0x7f7b2006cc50 2024-09-13T17:14:46.254 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.253+0000 7f7b36ef6640 1 -- 172.21.15.115:0/2116279823 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f7b2006cc50 msgr2=0x7f7b2006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:46.254 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.253+0000 7f7b36ef6640 1 --2- 172.21.15.115:0/2116279823 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f7b2006cc50 0x7f7b2006f110 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c006010 tx=0x7f7b1c000bc0 comp rx=0 tx=0).stop 2024-09-13T17:14:46.254 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.253+0000 7f7b36ef6640 1 -- 172.21.15.115:0/2116279823 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7b300fe9a0 msgr2=0x7f7b30196990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:46.255 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.253+0000 7f7b36ef6640 1 --2- 172.21.15.115:0/2116279823 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7b300fe9a0 0x7f7b30196990 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7b2400b420 tx=0x7f7b2400b8e0 comp rx=0 tx=0).stop 2024-09-13T17:14:46.255 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.253+0000 7f7b36ef6640 1 -- 172.21.15.115:0/2116279823 shutdown_connections 2024-09-13T17:14:46.255 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.253+0000 7f7b36ef6640 1 --2- 172.21.15.115:0/2116279823 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f7b2006cc50 0x7f7b2006f110 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:46.255 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.253+0000 7f7b36ef6640 1 --2- 172.21.15.115:0/2116279823 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7b301049a0 0x7f7b30196ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:46.255 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.253+0000 7f7b36ef6640 1 --2- 172.21.15.115:0/2116279823 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7b300fe9a0 0x7f7b30196990 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:46.255 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.253+0000 7f7b36ef6640 1 -- 172.21.15.115:0/2116279823 >> 172.21.15.115:0/2116279823 conn(0x7f7b300758c0 msgr2=0x7f7b30102310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:46.255 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.253+0000 7f7b36ef6640 1 -- 172.21.15.115:0/2116279823 shutdown_connections 2024-09-13T17:14:46.255 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.253+0000 7f7b36ef6640 1 -- 172.21.15.115:0/2116279823 wait complete. 2024-09-13T17:14:46.263 INFO:teuthology.orchestra.run.smithi115.stdout:true 2024-09-13T17:14:46.337 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.336+0000 7fcf21a80640 1 -- 172.21.15.115:0/3640876392 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcf1c0fec40 msgr2=0x7fcf1c0ff0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:46.337 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.336+0000 7fcf21a80640 1 --2- 172.21.15.115:0/3640876392 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcf1c0fec40 0x7fcf1c0ff0a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fcf04009880 tx=0x7fcf0402a4a0 comp rx=0 tx=0).stop 2024-09-13T17:14:46.338 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.336+0000 7fcf21a80640 1 -- 172.21.15.115:0/3640876392 shutdown_connections 2024-09-13T17:14:46.338 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.336+0000 7fcf21a80640 1 --2- 172.21.15.115:0/3640876392 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcf1c0fec40 0x7fcf1c0ff0a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:46.338 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.336+0000 7fcf21a80640 1 --2- 172.21.15.115:0/3640876392 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf1c104990 0x7fcf1c104d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:46.338 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.336+0000 7fcf21a80640 1 -- 172.21.15.115:0/3640876392 >> 172.21.15.115:0/3640876392 conn(0x7fcf1c074700 msgr2=0x7fcf1c074b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:46.338 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.336+0000 7fcf21a80640 1 -- 172.21.15.115:0/3640876392 shutdown_connections 2024-09-13T17:14:46.338 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.336+0000 7fcf21a80640 1 -- 172.21.15.115:0/3640876392 wait complete. 2024-09-13T17:14:46.338 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.336+0000 7fcf21a80640 1 Processor -- start 2024-09-13T17:14:46.338 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.336+0000 7fcf21a80640 1 -- start start 2024-09-13T17:14:46.339 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.337+0000 7fcf21a80640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf1c0fec40 0x7fcf1c1959c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:46.339 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.337+0000 7fcf21a80640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcf1c104990 0x7fcf1c195f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:46.339 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.337+0000 7fcf21a80640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1c1965e0 con 0x7fcf1c104990 2024-09-13T17:14:46.340 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.337+0000 7fcf21a80640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1c19a330 con 0x7fcf1c0fec40 2024-09-13T17:14:46.340 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.337+0000 7fcf13fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcf1c104990 0x7fcf1c195f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:46.340 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.337+0000 7fcf13fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcf1c104990 0x7fcf1c195f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47462/0 (socket says 172.21.15.115:47462) 2024-09-13T17:14:46.340 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.337+0000 7fcf13fff640 1 -- 172.21.15.115:0/1965742687 learned_addr learned my addr 172.21.15.115:0/1965742687 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:14:46.340 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.337+0000 7fcf1b7fe640 1 --2- 172.21.15.115:0/1965742687 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf1c0fec40 0x7fcf1c1959c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:46.340 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.337+0000 7fcf13fff640 1 -- 172.21.15.115:0/1965742687 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf1c0fec40 msgr2=0x7fcf1c1959c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:46.340 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.337+0000 7fcf13fff640 1 --2- 172.21.15.115:0/1965742687 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf1c0fec40 0x7fcf1c1959c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:46.340 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.337+0000 7fcf13fff640 1 -- 172.21.15.115:0/1965742687 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf04009560 con 0x7fcf1c104990 2024-09-13T17:14:46.340 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.337+0000 7fcf1b7fe640 1 --2- 172.21.15.115:0/1965742687 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf1c0fec40 0x7fcf1c1959c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:14:46.340 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.337+0000 7fcf13fff640 1 --2- 172.21.15.115:0/1965742687 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcf1c104990 0x7fcf1c195f00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fcf0402a9c0 tx=0x7fcf040055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:46.340 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.337+0000 7fcf197fa640 1 -- 172.21.15.115:0/1965742687 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf04004b60 con 0x7fcf1c104990 2024-09-13T17:14:46.340 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.337+0000 7fcf197fa640 1 -- 172.21.15.115:0/1965742687 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcf04004cc0 con 0x7fcf1c104990 2024-09-13T17:14:46.340 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.337+0000 7fcf21a80640 1 -- 172.21.15.115:0/1965742687 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf1c19a5b0 con 0x7fcf1c104990 2024-09-13T17:14:46.341 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.338+0000 7fcf197fa640 1 -- 172.21.15.115:0/1965742687 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf04031950 con 0x7fcf1c104990 2024-09-13T17:14:46.341 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.338+0000 7fcf21a80640 1 -- 172.21.15.115:0/1965742687 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf1c19aaa0 con 0x7fcf1c104990 2024-09-13T17:14:46.341 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.339+0000 7fcf21a80640 1 -- 172.21.15.115:0/1965742687 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf1c103cc0 con 0x7fcf1c104990 2024-09-13T17:14:46.341 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.339+0000 7fcf197fa640 1 -- 172.21.15.115:0/1965742687 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fcf04003c20 con 0x7fcf1c104990 2024-09-13T17:14:46.342 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.340+0000 7fcf197fa640 1 --2- 172.21.15.115:0/1965742687 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fcf0806cc50 0x7fcf0806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:46.342 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.340+0000 7fcf197fa640 1 -- 172.21.15.115:0/1965742687 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fcf040ad610 con 0x7fcf1c104990 2024-09-13T17:14:46.342 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.340+0000 7fcf1b7fe640 1 --2- 172.21.15.115:0/1965742687 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fcf0806cc50 0x7fcf0806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:46.342 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.340+0000 7fcf1b7fe640 1 --2- 172.21.15.115:0/1965742687 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fcf0806cc50 0x7fcf0806f110 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c0058c0 tx=0x7fcf0c005850 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:46.345 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.344+0000 7fcf197fa640 1 -- 172.21.15.115:0/1965742687 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fcf04077700 con 0x7fcf1c104990 2024-09-13T17:14:46.523 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.522+0000 7fcf21a80640 1 -- 172.21.15.115:0/1965742687 --> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcf1c10bae0 con 0x7fcf0806cc50 2024-09-13T17:14:46.524 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.523+0000 7fcf197fa640 1 -- 172.21.15.115:0/1965742687 <== mgr.14660 v2:172.21.15.115:6800/1049502673 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+466 (secure 0 0 0) 0x7fcf1c10bae0 con 0x7fcf0806cc50 2024-09-13T17:14:46.526 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.525+0000 7fcf21a80640 1 -- 172.21.15.115:0/1965742687 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fcf0806cc50 msgr2=0x7fcf0806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:46.526 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.525+0000 7fcf21a80640 1 --2- 172.21.15.115:0/1965742687 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fcf0806cc50 0x7fcf0806f110 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c0058c0 tx=0x7fcf0c005850 comp rx=0 tx=0).stop 2024-09-13T17:14:46.527 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.525+0000 7fcf21a80640 1 -- 172.21.15.115:0/1965742687 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcf1c104990 msgr2=0x7fcf1c195f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:46.527 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.525+0000 7fcf21a80640 1 --2- 172.21.15.115:0/1965742687 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcf1c104990 0x7fcf1c195f00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fcf0402a9c0 tx=0x7fcf040055a0 comp rx=0 tx=0).stop 2024-09-13T17:14:46.527 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.525+0000 7fcf21a80640 1 -- 172.21.15.115:0/1965742687 shutdown_connections 2024-09-13T17:14:46.527 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.525+0000 7fcf21a80640 1 --2- 172.21.15.115:0/1965742687 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fcf0806cc50 0x7fcf0806f110 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:46.527 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.525+0000 7fcf21a80640 1 --2- 172.21.15.115:0/1965742687 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcf1c104990 0x7fcf1c195f00 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:46.527 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.525+0000 7fcf21a80640 1 --2- 172.21.15.115:0/1965742687 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf1c0fec40 0x7fcf1c1959c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:46.527 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.525+0000 7fcf21a80640 1 -- 172.21.15.115:0/1965742687 >> 172.21.15.115:0/1965742687 conn(0x7fcf1c074700 msgr2=0x7fcf1c0fd2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:46.527 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.525+0000 7fcf21a80640 1 -- 172.21.15.115:0/1965742687 shutdown_connections 2024-09-13T17:14:46.527 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.525+0000 7fcf21a80640 1 -- 172.21.15.115:0/1965742687 wait complete. 2024-09-13T17:14:46.609 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.606+0000 7f589b9bc640 1 -- 172.21.15.115:0/866064020 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5894104a20 msgr2=0x7f5894104e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:46.609 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.606+0000 7f589b9bc640 1 --2- 172.21.15.115:0/866064020 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5894104a20 0x7f5894104e00 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5890009880 tx=0x7f589002a4a0 comp rx=0 tx=0).stop 2024-09-13T17:14:46.609 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.606+0000 7f589b9bc640 1 -- 172.21.15.115:0/866064020 shutdown_connections 2024-09-13T17:14:46.609 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.606+0000 7f589b9bc640 1 --2- 172.21.15.115:0/866064020 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58940fea20 0x7f58940fee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:46.610 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.606+0000 7f589b9bc640 1 --2- 172.21.15.115:0/866064020 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5894104a20 0x7f5894104e00 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:46.610 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.606+0000 7f589b9bc640 1 -- 172.21.15.115:0/866064020 >> 172.21.15.115:0/866064020 conn(0x7f58940fa720 msgr2=0x7f58940fcb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:46.610 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.606+0000 7f589b9bc640 1 -- 172.21.15.115:0/866064020 shutdown_connections 2024-09-13T17:14:46.610 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.606+0000 7f589b9bc640 1 -- 172.21.15.115:0/866064020 wait complete. 2024-09-13T17:14:46.610 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.606+0000 7f589b9bc640 1 Processor -- start 2024-09-13T17:14:46.610 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.606+0000 7f589b9bc640 1 -- start start 2024-09-13T17:14:46.610 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.607+0000 7f589b9bc640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58940fea20 0x7f589419b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:46.610 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.607+0000 7f589b9bc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5894104a20 0x7f589419bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:46.610 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.607+0000 7f589b9bc640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f589419c380 con 0x7f5894104a20 2024-09-13T17:14:46.610 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.607+0000 7f589b9bc640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5894195910 con 0x7f58940fea20 2024-09-13T17:14:46.610 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.607+0000 7f5898f57640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5894104a20 0x7f589419bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:46.610 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.607+0000 7f5898f57640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5894104a20 0x7f589419bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47486/0 (socket says 172.21.15.115:47486) 2024-09-13T17:14:46.611 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.607+0000 7f5898f57640 1 -- 172.21.15.115:0/2352781135 learned_addr learned my addr 172.21.15.115:0/2352781135 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:14:46.611 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.607+0000 7f5899758640 1 --2- 172.21.15.115:0/2352781135 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58940fea20 0x7f589419b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:46.611 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.607+0000 7f5898f57640 1 -- 172.21.15.115:0/2352781135 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58940fea20 msgr2=0x7f589419b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:46.611 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.607+0000 7f5898f57640 1 --2- 172.21.15.115:0/2352781135 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58940fea20 0x7f589419b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:46.611 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.607+0000 7f5898f57640 1 -- 172.21.15.115:0/2352781135 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5890009560 con 0x7f5894104a20 2024-09-13T17:14:46.611 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.607+0000 7f5899758640 1 --2- 172.21.15.115:0/2352781135 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58940fea20 0x7f589419b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:14:46.611 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.607+0000 7f5898f57640 1 --2- 172.21.15.115:0/2352781135 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5894104a20 0x7f589419bd60 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f588400b420 tx=0x7f588400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:46.611 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.607+0000 7f588a7fc640 1 -- 172.21.15.115:0/2352781135 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5884011800 con 0x7f5894104a20 2024-09-13T17:14:46.611 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.607+0000 7f588a7fc640 1 -- 172.21.15.115:0/2352781135 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5884011e00 con 0x7f5894104a20 2024-09-13T17:14:46.611 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.607+0000 7f589b9bc640 1 -- 172.21.15.115:0/2352781135 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5894195bf0 con 0x7f5894104a20 2024-09-13T17:14:46.611 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.607+0000 7f588a7fc640 1 -- 172.21.15.115:0/2352781135 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f588400f2e0 con 0x7f5894104a20 2024-09-13T17:14:46.611 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.608+0000 7f589b9bc640 1 -- 172.21.15.115:0/2352781135 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5894196140 con 0x7f5894104a20 2024-09-13T17:14:46.612 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.608+0000 7f589b9bc640 1 -- 172.21.15.115:0/2352781135 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5894100160 con 0x7f5894104a20 2024-09-13T17:14:46.612 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.609+0000 7f588a7fc640 1 -- 172.21.15.115:0/2352781135 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f5884010380 con 0x7f5894104a20 2024-09-13T17:14:46.612 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.609+0000 7f588a7fc640 1 --2- 172.21.15.115:0/2352781135 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f588006cc50 0x7f588006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:46.613 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.609+0000 7f588a7fc640 1 -- 172.21.15.115:0/2352781135 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f588408be80 con 0x7f5894104a20 2024-09-13T17:14:46.613 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.610+0000 7f5899758640 1 --2- 172.21.15.115:0/2352781135 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f588006cc50 0x7f588006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:46.613 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.610+0000 7f5899758640 1 --2- 172.21.15.115:0/2352781135 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f588006cc50 0x7f588006f110 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5890005ab0 tx=0x7f5890005a20 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:46.615 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.614+0000 7f588a7fc640 1 -- 172.21.15.115:0/2352781135 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f5884055f70 con 0x7f5894104a20 2024-09-13T17:14:46.788 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.786+0000 7f589b9bc640 1 -- 172.21.15.115:0/2352781135 --> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f589410bbd0 con 0x7f588006cc50 2024-09-13T17:14:46.797 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.795+0000 7f588a7fc640 1 -- 172.21.15.115:0/2352781135 <== mgr.14660 v2:172.21.15.115:6800/1049502673 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f589410bbd0 con 0x7f588006cc50 2024-09-13T17:14:46.797 INFO:teuthology.orchestra.run.smithi115.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T17:14:46.797 INFO:teuthology.orchestra.run.smithi115.stdout:alertmanager.smithi115 smithi115 *:9093,9094 running (6m) 4s ago 16m 24.7M - 0.25.0 c8568f914cd2 d56b91240fe1 2024-09-13T17:14:46.797 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-exporter.smithi115 smithi115 running (17s) 4s ago 17m 7470k - 18.2.4-860-g6c6b083f 8a91f241d7d4 61191fa97aa7 2024-09-13T17:14:46.797 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-exporter.smithi195 smithi195 running (12s) 10s ago 16m 6786k - 18.2.4-860-g6c6b083f 8a91f241d7d4 f2ef90ec9def 2024-09-13T17:14:46.797 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi115 smithi115 running (4m) 4s ago 16m 6895k - 18.2.4-860-g6c6b083f 8a91f241d7d4 e8175bc055bf 2024-09-13T17:14:46.797 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi195 smithi195 running (4m) 10s ago 16m 6903k - 18.2.4-860-g6c6b083f 8a91f241d7d4 ccb4895be776 2024-09-13T17:14:46.797 INFO:teuthology.orchestra.run.smithi115.stdout:grafana.smithi115 smithi115 *:3000 running (6m) 4s ago 16m 86.7M - 9.4.7 954c08fa6188 e1eccb1a8f3e 2024-09-13T17:14:46.797 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi115.hbtxod smithi115 running (89s) 4s ago 11m 88.9M - 18.2.4-860-g6c6b083f 8a91f241d7d4 9221253d5ed4 2024-09-13T17:14:46.798 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi115.ijznvr smithi115 running (67s) 4s ago 11m 84.8M - 18.2.4-860-g6c6b083f 8a91f241d7d4 aab0c23ec15b 2024-09-13T17:14:46.798 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi195.aevvgz smithi195 running (31s) 10s ago 11m 15.3M - 18.2.4-860-g6c6b083f 8a91f241d7d4 1f6eafd16096 2024-09-13T17:14:46.798 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi195.qzghxj smithi195 running (51s) 10s ago 11m 15.4M - 18.2.4-860-g6c6b083f 8a91f241d7d4 653d67d222ce 2024-09-13T17:14:46.798 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi115.hetcni smithi115 *:8443,9283,8765 running (8m) 4s ago 18m 499M - 18.2.4-860-g6c6b083f 8a91f241d7d4 b945dbde1934 2024-09-13T17:14:46.798 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi195.hjjifz smithi195 *:8443,9283,8765 running (7m) 10s ago 15m 442M - 18.2.4-860-g6c6b083f 8a91f241d7d4 17bccdfbcae1 2024-09-13T17:14:46.798 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi115 smithi115 running (5m) 4s ago 18m 49.5M 2048M 18.2.4-860-g6c6b083f 8a91f241d7d4 8dd7baf2c6b6 2024-09-13T17:14:46.798 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi195 smithi195 running (5m) 10s ago 15m 39.9M 2048M 18.2.4-860-g6c6b083f 8a91f241d7d4 0459bc5e6b08 2024-09-13T17:14:46.798 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi115 smithi115 *:9100 running (7m) 4s ago 16m 17.3M - 1.5.0 0da6a335fe13 26fb6f9844b5 2024-09-13T17:14:46.798 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi195 smithi195 *:9100 running (7m) 10s ago 15m 16.6M - 1.5.0 0da6a335fe13 6d38e798fb16 2024-09-13T17:14:46.798 INFO:teuthology.orchestra.run.smithi115.stdout:osd.0 smithi115 running (4m) 4s ago 15m 110M 1216M 18.2.4-860-g6c6b083f 8a91f241d7d4 3b9f874c64e9 2024-09-13T17:14:46.798 INFO:teuthology.orchestra.run.smithi115.stdout:osd.1 smithi115 running (3m) 4s ago 14m 119M 1216M 18.2.4-860-g6c6b083f 8a91f241d7d4 f0de6684601c 2024-09-13T17:14:46.798 INFO:teuthology.orchestra.run.smithi115.stdout:osd.2 smithi115 running (3m) 4s ago 14m 102M 1216M 18.2.4-860-g6c6b083f 8a91f241d7d4 edb753bab54a 2024-09-13T17:14:46.798 INFO:teuthology.orchestra.run.smithi115.stdout:osd.3 smithi195 running (2m) 10s ago 13m 125M 2240M 18.2.4-860-g6c6b083f 8a91f241d7d4 ccd1b2bf7d86 2024-09-13T17:14:46.798 INFO:teuthology.orchestra.run.smithi115.stdout:osd.4 smithi195 running (2m) 10s ago 13m 106M 2240M 18.2.4-860-g6c6b083f 8a91f241d7d4 c88b3dacb207 2024-09-13T17:14:46.799 INFO:teuthology.orchestra.run.smithi115.stdout:osd.5 smithi195 running (106s) 10s ago 12m 99.1M 2240M 18.2.4-860-g6c6b083f 8a91f241d7d4 40ccbc2f5195 2024-09-13T17:14:46.799 INFO:teuthology.orchestra.run.smithi115.stdout:prometheus.smithi115 smithi115 *:9095 running (6m) 4s ago 16m 64.6M - 2.43.0 a07b618ecd1d e03fb39f6b76 2024-09-13T17:14:46.799 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.797+0000 7f589b9bc640 1 -- 172.21.15.115:0/2352781135 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f588006cc50 msgr2=0x7f588006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:46.799 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.797+0000 7f589b9bc640 1 --2- 172.21.15.115:0/2352781135 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f588006cc50 0x7f588006f110 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5890005ab0 tx=0x7f5890005a20 comp rx=0 tx=0).stop 2024-09-13T17:14:46.800 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.797+0000 7f589b9bc640 1 -- 172.21.15.115:0/2352781135 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5894104a20 msgr2=0x7f589419bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:46.800 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.797+0000 7f589b9bc640 1 --2- 172.21.15.115:0/2352781135 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5894104a20 0x7f589419bd60 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f588400b420 tx=0x7f588400b8e0 comp rx=0 tx=0).stop 2024-09-13T17:14:46.800 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.798+0000 7f589b9bc640 1 -- 172.21.15.115:0/2352781135 shutdown_connections 2024-09-13T17:14:46.800 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.798+0000 7f589b9bc640 1 --2- 172.21.15.115:0/2352781135 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f588006cc50 0x7f588006f110 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:46.800 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.798+0000 7f589b9bc640 1 --2- 172.21.15.115:0/2352781135 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5894104a20 0x7f589419bd60 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:46.800 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.798+0000 7f589b9bc640 1 --2- 172.21.15.115:0/2352781135 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58940fea20 0x7f589419b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:46.800 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.798+0000 7f589b9bc640 1 -- 172.21.15.115:0/2352781135 >> 172.21.15.115:0/2352781135 conn(0x7f58940fa720 msgr2=0x7f5894068c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:46.800 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.798+0000 7f589b9bc640 1 -- 172.21.15.115:0/2352781135 shutdown_connections 2024-09-13T17:14:46.800 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.798+0000 7f589b9bc640 1 -- 172.21.15.115:0/2352781135 wait complete. 2024-09-13T17:14:46.881 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.878+0000 7f58496d6640 1 -- 172.21.15.115:0/3365522375 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5844104aa0 msgr2=0x7f5844104e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:46.881 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.878+0000 7f58496d6640 1 --2- 172.21.15.115:0/3365522375 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5844104aa0 0x7f5844104e80 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5834009880 tx=0x7f583402a4a0 comp rx=0 tx=0).stop 2024-09-13T17:14:46.881 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.878+0000 7f58496d6640 1 -- 172.21.15.115:0/3365522375 shutdown_connections 2024-09-13T17:14:46.881 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.878+0000 7f58496d6640 1 --2- 172.21.15.115:0/3365522375 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58440feaa0 0x7f58440fef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:46.881 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.878+0000 7f58496d6640 1 --2- 172.21.15.115:0/3365522375 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5844104aa0 0x7f5844104e80 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:46.881 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.878+0000 7f58496d6640 1 -- 172.21.15.115:0/3365522375 >> 172.21.15.115:0/3365522375 conn(0x7f58440fa780 msgr2=0x7f58440fcba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:46.881 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.878+0000 7f58496d6640 1 -- 172.21.15.115:0/3365522375 shutdown_connections 2024-09-13T17:14:46.882 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.878+0000 7f58496d6640 1 -- 172.21.15.115:0/3365522375 wait complete. 2024-09-13T17:14:46.882 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.879+0000 7f58496d6640 1 Processor -- start 2024-09-13T17:14:46.882 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.879+0000 7f58496d6640 1 -- start start 2024-09-13T17:14:46.882 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.879+0000 7f58496d6640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58440feaa0 0x7f58441968f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:46.882 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.879+0000 7f58496d6640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5844104aa0 0x7f5844196e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:46.882 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.879+0000 7f58496d6640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5844197370 con 0x7f58440feaa0 2024-09-13T17:14:46.882 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.879+0000 7f58496d6640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58441974e0 con 0x7f5844104aa0 2024-09-13T17:14:46.882 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.879+0000 7f5842ffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58440feaa0 0x7f58441968f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:46.882 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.879+0000 7f5842ffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58440feaa0 0x7f58441968f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47508/0 (socket says 172.21.15.115:47508) 2024-09-13T17:14:46.882 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.879+0000 7f5842ffd640 1 -- 172.21.15.115:0/487975262 learned_addr learned my addr 172.21.15.115:0/487975262 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:14:46.882 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.879+0000 7f583a7fc640 1 --2- 172.21.15.115:0/487975262 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5844104aa0 0x7f5844196e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:46.882 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.879+0000 7f5842ffd640 1 -- 172.21.15.115:0/487975262 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5844104aa0 msgr2=0x7f5844196e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:46.882 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.879+0000 7f5842ffd640 1 --2- 172.21.15.115:0/487975262 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5844104aa0 0x7f5844196e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:46.883 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.879+0000 7f5842ffd640 1 -- 172.21.15.115:0/487975262 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5834009560 con 0x7f58440feaa0 2024-09-13T17:14:46.883 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.880+0000 7f5842ffd640 1 --2- 172.21.15.115:0/487975262 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58440feaa0 0x7f58441968f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f583402a9c0 tx=0x7f58340055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:46.883 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.880+0000 7f5840ff9640 1 -- 172.21.15.115:0/487975262 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5834004b60 con 0x7f58440feaa0 2024-09-13T17:14:46.883 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.880+0000 7f5840ff9640 1 -- 172.21.15.115:0/487975262 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5834004cc0 con 0x7f58440feaa0 2024-09-13T17:14:46.883 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.880+0000 7f58496d6640 1 -- 172.21.15.115:0/487975262 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5844197760 con 0x7f58440feaa0 2024-09-13T17:14:46.883 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.880+0000 7f5840ff9640 1 -- 172.21.15.115:0/487975262 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5834031950 con 0x7f58440feaa0 2024-09-13T17:14:46.883 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.880+0000 7f58496d6640 1 -- 172.21.15.115:0/487975262 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f584419fc90 con 0x7f58440feaa0 2024-09-13T17:14:46.884 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.881+0000 7f58496d6640 1 -- 172.21.15.115:0/487975262 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58441001e0 con 0x7f58440feaa0 2024-09-13T17:14:46.884 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.881+0000 7f5840ff9640 1 -- 172.21.15.115:0/487975262 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f5834003c20 con 0x7f58440feaa0 2024-09-13T17:14:46.884 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.882+0000 7f5840ff9640 1 --2- 172.21.15.115:0/487975262 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f583006cc50 0x7f583006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:46.884 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.882+0000 7f5840ff9640 1 -- 172.21.15.115:0/487975262 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f58340ad500 con 0x7f58440feaa0 2024-09-13T17:14:46.884 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.882+0000 7f583a7fc640 1 --2- 172.21.15.115:0/487975262 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f583006cc50 0x7f583006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:46.884 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.882+0000 7f583a7fc640 1 --2- 172.21.15.115:0/487975262 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f583006cc50 0x7f583006f110 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f582c005fd0 tx=0x7f582c005850 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:46.887 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:46.886+0000 7f5840ff9640 1 -- 172.21.15.115:0/487975262 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f5834077570 con 0x7f58440feaa0 2024-09-13T17:14:47.139 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.137+0000 7f58496d6640 1 -- 172.21.15.115:0/487975262 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f58440fef00 con 0x7f58440feaa0 2024-09-13T17:14:47.139 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:46 smithi115 ceph-mon[109488]: pgmap v282: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 342 KiB/s rd, 1 op/s 2024-09-13T17:14:47.139 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:46 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:47.139 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:46 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:47.139 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:46 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:14:47.139 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:46 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:14:47.139 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:46 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:47.140 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:46 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:14:47.140 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:46 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:14:47.140 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:46 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:14:47.140 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:46 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:14:47.140 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:46 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:14:47.140 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:46 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:14:47.140 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:46 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]: dispatch 2024-09-13T17:14:47.140 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.138+0000 7f5840ff9640 1 -- 172.21.15.115:0/487975262 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7f583407ab90 con 0x7f58440feaa0 2024-09-13T17:14:47.141 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-13T17:14:47.141 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": { 2024-09-13T17:14:47.141 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 2 2024-09-13T17:14:47.141 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T17:14:47.141 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": { 2024-09-13T17:14:47.141 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 2 2024-09-13T17:14:47.141 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T17:14:47.141 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": { 2024-09-13T17:14:47.141 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 6 2024-09-13T17:14:47.141 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T17:14:47.141 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": { 2024-09-13T17:14:47.141 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 4 2024-09-13T17:14:47.141 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T17:14:47.142 INFO:teuthology.orchestra.run.smithi115.stdout: "overall": { 2024-09-13T17:14:47.142 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 14 2024-09-13T17:14:47.142 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-13T17:14:47.142 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-13T17:14:47.142 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.140+0000 7f58496d6640 1 -- 172.21.15.115:0/487975262 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f583006cc50 msgr2=0x7f583006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:47.142 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.140+0000 7f58496d6640 1 --2- 172.21.15.115:0/487975262 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f583006cc50 0x7f583006f110 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f582c005fd0 tx=0x7f582c005850 comp rx=0 tx=0).stop 2024-09-13T17:14:47.143 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.140+0000 7f58496d6640 1 -- 172.21.15.115:0/487975262 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58440feaa0 msgr2=0x7f58441968f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:47.143 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.140+0000 7f58496d6640 1 --2- 172.21.15.115:0/487975262 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58440feaa0 0x7f58441968f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f583402a9c0 tx=0x7f58340055a0 comp rx=0 tx=0).stop 2024-09-13T17:14:47.143 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.140+0000 7f58496d6640 1 -- 172.21.15.115:0/487975262 shutdown_connections 2024-09-13T17:14:47.143 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.140+0000 7f58496d6640 1 --2- 172.21.15.115:0/487975262 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f583006cc50 0x7f583006f110 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:47.143 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.140+0000 7f58496d6640 1 --2- 172.21.15.115:0/487975262 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5844104aa0 0x7f5844196e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:47.143 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.140+0000 7f58496d6640 1 --2- 172.21.15.115:0/487975262 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58440feaa0 0x7f58441968f0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:47.143 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.140+0000 7f58496d6640 1 -- 172.21.15.115:0/487975262 >> 172.21.15.115:0/487975262 conn(0x7f58440fa780 msgr2=0x7f58440fc8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:47.143 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.141+0000 7f58496d6640 1 -- 172.21.15.115:0/487975262 shutdown_connections 2024-09-13T17:14:47.143 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.141+0000 7f58496d6640 1 -- 172.21.15.115:0/487975262 wait complete. 2024-09-13T17:14:47.223 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.221+0000 7f1431014640 1 -- 172.21.15.115:0/2375485761 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f142c0ffaf0 msgr2=0x7f142c0fff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:47.223 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.221+0000 7f1431014640 1 --2- 172.21.15.115:0/2375485761 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f142c0ffaf0 0x7f142c0fff50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f141c009880 tx=0x7f141c02a4a0 comp rx=0 tx=0).stop 2024-09-13T17:14:47.223 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.221+0000 7f1431014640 1 -- 172.21.15.115:0/2375485761 shutdown_connections 2024-09-13T17:14:47.223 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.221+0000 7f1431014640 1 --2- 172.21.15.115:0/2375485761 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f142c0ffaf0 0x7f142c0fff50 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:47.223 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.221+0000 7f1431014640 1 --2- 172.21.15.115:0/2375485761 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f142c105b80 0x7f142c105f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:47.223 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.221+0000 7f1431014640 1 -- 172.21.15.115:0/2375485761 >> 172.21.15.115:0/2375485761 conn(0x7f142c0fb810 msgr2=0x7f142c0fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:47.223 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.221+0000 7f1431014640 1 -- 172.21.15.115:0/2375485761 shutdown_connections 2024-09-13T17:14:47.224 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.222+0000 7f1431014640 1 -- 172.21.15.115:0/2375485761 wait complete. 2024-09-13T17:14:47.225 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.222+0000 7f1431014640 1 Processor -- start 2024-09-13T17:14:47.225 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.222+0000 7f1431014640 1 -- start start 2024-09-13T17:14:47.225 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.223+0000 7f1431014640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f142c0ffaf0 0x7f142c0727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:47.225 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.223+0000 7f1431014640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f142c105b80 0x7f142c072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:47.226 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.223+0000 7f1431014640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f142c073230 con 0x7f142c105b80 2024-09-13T17:14:47.226 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.223+0000 7f1431014640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f142c0733a0 con 0x7f142c0ffaf0 2024-09-13T17:14:47.226 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.223+0000 7f142a59c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f142c105b80 0x7f142c072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:47.226 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.223+0000 7f142a59c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f142c105b80 0x7f142c072cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47522/0 (socket says 172.21.15.115:47522) 2024-09-13T17:14:47.226 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.223+0000 7f142a59c640 1 -- 172.21.15.115:0/2741234463 learned_addr learned my addr 172.21.15.115:0/2741234463 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:14:47.226 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.223+0000 7f142ad9d640 1 --2- 172.21.15.115:0/2741234463 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f142c0ffaf0 0x7f142c0727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:47.226 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.223+0000 7f142a59c640 1 -- 172.21.15.115:0/2741234463 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f142c0ffaf0 msgr2=0x7f142c0727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:47.226 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.223+0000 7f142a59c640 1 --2- 172.21.15.115:0/2741234463 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f142c0ffaf0 0x7f142c0727b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:47.226 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.223+0000 7f142a59c640 1 -- 172.21.15.115:0/2741234463 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f141c009560 con 0x7f142c105b80 2024-09-13T17:14:47.226 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.223+0000 7f142a59c640 1 --2- 172.21.15.115:0/2741234463 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f142c105b80 0x7f142c072cf0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f141c006010 tx=0x7f141c0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:47.226 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.224+0000 7f1413fff640 1 -- 172.21.15.115:0/2741234463 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f141c004aa0 con 0x7f142c105b80 2024-09-13T17:14:47.226 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.224+0000 7f1413fff640 1 -- 172.21.15.115:0/2741234463 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f141c004c00 con 0x7f142c105b80 2024-09-13T17:14:47.226 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.224+0000 7f1431014640 1 -- 172.21.15.115:0/2741234463 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f142c073620 con 0x7f142c105b80 2024-09-13T17:14:47.226 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.224+0000 7f1413fff640 1 -- 172.21.15.115:0/2741234463 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f141c031910 con 0x7f142c105b80 2024-09-13T17:14:47.227 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.224+0000 7f1431014640 1 -- 172.21.15.115:0/2741234463 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f142c1a1e60 con 0x7f142c105b80 2024-09-13T17:14:47.227 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.225+0000 7f1431014640 1 -- 172.21.15.115:0/2741234463 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f142c1011f0 con 0x7f142c105b80 2024-09-13T17:14:47.227 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.225+0000 7f1413fff640 1 -- 172.21.15.115:0/2741234463 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f141c031b80 con 0x7f142c105b80 2024-09-13T17:14:47.227 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.226+0000 7f1413fff640 1 --2- 172.21.15.115:0/2741234463 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f141406cc50 0x7f141406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:47.228 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.226+0000 7f142ad9d640 1 --2- 172.21.15.115:0/2741234463 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f141406cc50 0x7f141406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:47.228 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.226+0000 7f1413fff640 1 -- 172.21.15.115:0/2741234463 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f141c0ad520 con 0x7f142c105b80 2024-09-13T17:14:47.228 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.226+0000 7f142ad9d640 1 --2- 172.21.15.115:0/2741234463 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f141406cc50 0x7f141406f110 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1420005fd0 tx=0x7f142000b390 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:47.231 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.230+0000 7f1413fff640 1 -- 172.21.15.115:0/2741234463 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f141c077640 con 0x7f142c105b80 2024-09-13T17:14:47.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:46 smithi195 ceph-mon[80021]: pgmap v282: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 342 KiB/s rd, 1 op/s 2024-09-13T17:14:47.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:46 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:47.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:46 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:47.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:46 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:14:47.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:46 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:14:47.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:46 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:47.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:46 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:14:47.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:46 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:14:47.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:46 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:14:47.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:46 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:14:47.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:46 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:14:47.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:46 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:14:47.328 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:46 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]: dispatch 2024-09-13T17:14:47.433 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.432+0000 7f1431014640 1 -- 172.21.15.115:0/2741234463 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f142c0fff50 con 0x7f142c105b80 2024-09-13T17:14:47.434 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.432+0000 7f1413fff640 1 -- 172.21.15.115:0/2741234463 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 39 v39) v1 ==== 76+0+1877 (secure 0 0 0) 0x7f141c07ac60 con 0x7f142c105b80 2024-09-13T17:14:47.434 INFO:teuthology.orchestra.run.smithi115.stdout:e39 2024-09-13T17:14:47.434 INFO:teuthology.orchestra.run.smithi115.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T17:14:47.434 INFO:teuthology.orchestra.run.smithi115.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T17:14:47.434 INFO:teuthology.orchestra.run.smithi115.stdout:legacy client fscid: 1 2024-09-13T17:14:47.434 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:14:47.434 INFO:teuthology.orchestra.run.smithi115.stdout:Filesystem 'cephfs' (1) 2024-09-13T17:14:47.434 INFO:teuthology.orchestra.run.smithi115.stdout:fs_name cephfs 2024-09-13T17:14:47.435 INFO:teuthology.orchestra.run.smithi115.stdout:epoch 39 2024-09-13T17:14:47.435 INFO:teuthology.orchestra.run.smithi115.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T17:14:47.435 INFO:teuthology.orchestra.run.smithi115.stdout:created 2024-09-13T17:03:16.313116+0000 2024-09-13T17:14:47.435 INFO:teuthology.orchestra.run.smithi115.stdout:modified 2024-09-13T17:14:46.892655+0000 2024-09-13T17:14:47.435 INFO:teuthology.orchestra.run.smithi115.stdout:tableserver 0 2024-09-13T17:14:47.435 INFO:teuthology.orchestra.run.smithi115.stdout:root 0 2024-09-13T17:14:47.435 INFO:teuthology.orchestra.run.smithi115.stdout:session_timeout 60 2024-09-13T17:14:47.435 INFO:teuthology.orchestra.run.smithi115.stdout:session_autoclose 300 2024-09-13T17:14:47.435 INFO:teuthology.orchestra.run.smithi115.stdout:max_file_size 1099511627776 2024-09-13T17:14:47.435 INFO:teuthology.orchestra.run.smithi115.stdout:max_xattr_size 65536 2024-09-13T17:14:47.435 INFO:teuthology.orchestra.run.smithi115.stdout:required_client_features {} 2024-09-13T17:14:47.436 INFO:teuthology.orchestra.run.smithi115.stdout:last_failure 0 2024-09-13T17:14:47.436 INFO:teuthology.orchestra.run.smithi115.stdout:last_failure_osd_epoch 82 2024-09-13T17:14:47.436 INFO:teuthology.orchestra.run.smithi115.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T17:14:47.436 INFO:teuthology.orchestra.run.smithi115.stdout:max_mds 1 2024-09-13T17:14:47.436 INFO:teuthology.orchestra.run.smithi115.stdout:in 0 2024-09-13T17:14:47.436 INFO:teuthology.orchestra.run.smithi115.stdout:up {0=34320} 2024-09-13T17:14:47.436 INFO:teuthology.orchestra.run.smithi115.stdout:failed 2024-09-13T17:14:47.436 INFO:teuthology.orchestra.run.smithi115.stdout:damaged 2024-09-13T17:14:47.436 INFO:teuthology.orchestra.run.smithi115.stdout:stopped 2024-09-13T17:14:47.436 INFO:teuthology.orchestra.run.smithi115.stdout:data_pools [3] 2024-09-13T17:14:47.436 INFO:teuthology.orchestra.run.smithi115.stdout:metadata_pool 2 2024-09-13T17:14:47.436 INFO:teuthology.orchestra.run.smithi115.stdout:inline_data enabled 2024-09-13T17:14:47.436 INFO:teuthology.orchestra.run.smithi115.stdout:balancer 2024-09-13T17:14:47.437 INFO:teuthology.orchestra.run.smithi115.stdout:bal_rank_mask -1 2024-09-13T17:14:47.437 INFO:teuthology.orchestra.run.smithi115.stdout:standby_count_wanted 1 2024-09-13T17:14:47.437 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi115.hbtxod{0:34320} state up:active seq 17 join_fscid=1 addr [v2:172.21.15.115:6826/2768011029,v1:172.21.15.115:6827/2768011029] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T17:14:47.437 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi115.ijznvr{0:34324} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.115:6828/2716683507,v1:172.21.15.115:6829/2716683507] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T17:14:47.437 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:14:47.437 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:14:47.437 INFO:teuthology.orchestra.run.smithi115.stdout:Standby daemons: 2024-09-13T17:14:47.437 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:14:47.437 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi195.qzghxj{-1:44271} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.195:6824/825791083,v1:172.21.15.195:6825/825791083] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T17:14:47.437 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi195.aevvgz{-1:44287} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.195:6826/589520116,v1:172.21.15.195:6827/589520116] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T17:14:47.438 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 39 2024-09-13T17:14:47.438 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.434+0000 7f1431014640 1 -- 172.21.15.115:0/2741234463 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f141406cc50 msgr2=0x7f141406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:47.438 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.434+0000 7f1431014640 1 --2- 172.21.15.115:0/2741234463 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f141406cc50 0x7f141406f110 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1420005fd0 tx=0x7f142000b390 comp rx=0 tx=0).stop 2024-09-13T17:14:47.438 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.434+0000 7f1431014640 1 -- 172.21.15.115:0/2741234463 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f142c105b80 msgr2=0x7f142c072cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:47.439 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.434+0000 7f1431014640 1 --2- 172.21.15.115:0/2741234463 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f142c105b80 0x7f142c072cf0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f141c006010 tx=0x7f141c0055a0 comp rx=0 tx=0).stop 2024-09-13T17:14:47.439 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.434+0000 7f1431014640 1 -- 172.21.15.115:0/2741234463 shutdown_connections 2024-09-13T17:14:47.439 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.434+0000 7f1431014640 1 --2- 172.21.15.115:0/2741234463 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f141406cc50 0x7f141406f110 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:47.439 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.434+0000 7f1431014640 1 --2- 172.21.15.115:0/2741234463 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f142c105b80 0x7f142c072cf0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:47.439 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.434+0000 7f1431014640 1 --2- 172.21.15.115:0/2741234463 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f142c0ffaf0 0x7f142c0727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:47.439 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.434+0000 7f1431014640 1 -- 172.21.15.115:0/2741234463 >> 172.21.15.115:0/2741234463 conn(0x7f142c0fb810 msgr2=0x7f142c104ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:47.439 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.435+0000 7f1431014640 1 -- 172.21.15.115:0/2741234463 shutdown_connections 2024-09-13T17:14:47.439 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.435+0000 7f1431014640 1 -- 172.21.15.115:0/2741234463 wait complete. 2024-09-13T17:14:47.518 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.516+0000 7f25d214b640 1 -- 172.21.15.115:0/2488999916 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25cc105bf0 msgr2=0x7f25cc105fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:47.518 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.516+0000 7f25d214b640 1 --2- 172.21.15.115:0/2488999916 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25cc105bf0 0x7f25cc105fd0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f25bc009880 tx=0x7f25bc02a4a0 comp rx=0 tx=0).stop 2024-09-13T17:14:47.518 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.516+0000 7f25d214b640 1 -- 172.21.15.115:0/2488999916 shutdown_connections 2024-09-13T17:14:47.518 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.516+0000 7f25d214b640 1 --2- 172.21.15.115:0/2488999916 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f25cc0ffb40 0x7f25cc0fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:47.519 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.516+0000 7f25d214b640 1 --2- 172.21.15.115:0/2488999916 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25cc105bf0 0x7f25cc105fd0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:47.519 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.516+0000 7f25d214b640 1 -- 172.21.15.115:0/2488999916 >> 172.21.15.115:0/2488999916 conn(0x7f25cc0fb840 msgr2=0x7f25cc0fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:47.519 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.516+0000 7f25d214b640 1 -- 172.21.15.115:0/2488999916 shutdown_connections 2024-09-13T17:14:47.519 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.516+0000 7f25d214b640 1 -- 172.21.15.115:0/2488999916 wait complete. 2024-09-13T17:14:47.519 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.517+0000 7f25d214b640 1 Processor -- start 2024-09-13T17:14:47.519 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.517+0000 7f25d214b640 1 -- start start 2024-09-13T17:14:47.520 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.517+0000 7f25d214b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25cc0ffb40 0x7f25cc19b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:47.520 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.517+0000 7f25d214b640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f25cc105bf0 0x7f25cc19bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:47.520 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.517+0000 7f25d214b640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25cc195790 con 0x7f25cc0ffb40 2024-09-13T17:14:47.521 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.517+0000 7f25d214b640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25cc195900 con 0x7f25cc105bf0 2024-09-13T17:14:47.521 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.518+0000 7f25cb7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25cc0ffb40 0x7f25cc19b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:47.521 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.518+0000 7f25cb7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25cc0ffb40 0x7f25cc19b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47542/0 (socket says 172.21.15.115:47542) 2024-09-13T17:14:47.521 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.518+0000 7f25cb7fe640 1 -- 172.21.15.115:0/3526523451 learned_addr learned my addr 172.21.15.115:0/3526523451 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:14:47.521 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.518+0000 7f25caffd640 1 --2- 172.21.15.115:0/3526523451 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f25cc105bf0 0x7f25cc19bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:47.521 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.518+0000 7f25cb7fe640 1 -- 172.21.15.115:0/3526523451 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f25cc105bf0 msgr2=0x7f25cc19bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:47.521 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.518+0000 7f25cb7fe640 1 --2- 172.21.15.115:0/3526523451 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f25cc105bf0 0x7f25cc19bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:47.521 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.518+0000 7f25cb7fe640 1 -- 172.21.15.115:0/3526523451 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25bc009560 con 0x7f25cc0ffb40 2024-09-13T17:14:47.521 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.518+0000 7f25cb7fe640 1 --2- 172.21.15.115:0/3526523451 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25cc0ffb40 0x7f25cc19b6a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f25bc02a9c0 tx=0x7f25bc0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:47.521 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.518+0000 7f25c8ff9640 1 -- 172.21.15.115:0/3526523451 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f25bc004b60 con 0x7f25cc0ffb40 2024-09-13T17:14:47.521 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.518+0000 7f25d214b640 1 -- 172.21.15.115:0/3526523451 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25cc195b80 con 0x7f25cc0ffb40 2024-09-13T17:14:47.521 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.518+0000 7f25c8ff9640 1 -- 172.21.15.115:0/3526523451 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f25bc004cc0 con 0x7f25cc0ffb40 2024-09-13T17:14:47.522 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.518+0000 7f25c8ff9640 1 -- 172.21.15.115:0/3526523451 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f25bc031950 con 0x7f25cc0ffb40 2024-09-13T17:14:47.522 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.518+0000 7f25d214b640 1 -- 172.21.15.115:0/3526523451 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25cc1960f0 con 0x7f25cc0ffb40 2024-09-13T17:14:47.522 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.520+0000 7f25d214b640 1 -- 172.21.15.115:0/3526523451 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25cc1011f0 con 0x7f25cc0ffb40 2024-09-13T17:14:47.523 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.520+0000 7f25c8ff9640 1 -- 172.21.15.115:0/3526523451 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f25bc003c20 con 0x7f25cc0ffb40 2024-09-13T17:14:47.523 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.521+0000 7f25c8ff9640 1 --2- 172.21.15.115:0/3526523451 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f25b406cc50 0x7f25b406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:47.523 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.521+0000 7f25c8ff9640 1 -- 172.21.15.115:0/3526523451 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f25bc0ad630 con 0x7f25cc0ffb40 2024-09-13T17:14:47.523 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.521+0000 7f25caffd640 1 --2- 172.21.15.115:0/3526523451 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f25b406cc50 0x7f25b406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:47.523 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.521+0000 7f25caffd640 1 --2- 172.21.15.115:0/3526523451 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f25b406cc50 0x7f25b406f110 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f25cc196c00 tx=0x7f25c0009680 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:47.526 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.525+0000 7f25c8ff9640 1 -- 172.21.15.115:0/3526523451 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f25bc077750 con 0x7f25cc0ffb40 2024-09-13T17:14:47.701 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.699+0000 7f25d214b640 1 -- 172.21.15.115:0/3526523451 --> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f25cc196ca0 con 0x7f25b406cc50 2024-09-13T17:14:47.701 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.700+0000 7f25c8ff9640 1 -- 172.21.15.115:0/3526523451 <== mgr.14660 v2:172.21.15.115:6800/1049502673 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f25cc196ca0 con 0x7f25b406cc50 2024-09-13T17:14:47.702 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-13T17:14:47.702 INFO:teuthology.orchestra.run.smithi115.stdout: "target_image": null, 2024-09-13T17:14:47.702 INFO:teuthology.orchestra.run.smithi115.stdout: "in_progress": false, 2024-09-13T17:14:47.702 INFO:teuthology.orchestra.run.smithi115.stdout: "which": "", 2024-09-13T17:14:47.702 INFO:teuthology.orchestra.run.smithi115.stdout: "services_complete": [], 2024-09-13T17:14:47.702 INFO:teuthology.orchestra.run.smithi115.stdout: "progress": null, 2024-09-13T17:14:47.702 INFO:teuthology.orchestra.run.smithi115.stdout: "message": "", 2024-09-13T17:14:47.702 INFO:teuthology.orchestra.run.smithi115.stdout: "is_paused": false 2024-09-13T17:14:47.702 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-13T17:14:47.704 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.702+0000 7f25d214b640 1 -- 172.21.15.115:0/3526523451 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f25b406cc50 msgr2=0x7f25b406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:47.704 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.702+0000 7f25d214b640 1 --2- 172.21.15.115:0/3526523451 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f25b406cc50 0x7f25b406f110 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f25cc196c00 tx=0x7f25c0009680 comp rx=0 tx=0).stop 2024-09-13T17:14:47.704 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.702+0000 7f25d214b640 1 -- 172.21.15.115:0/3526523451 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25cc0ffb40 msgr2=0x7f25cc19b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:47.704 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.702+0000 7f25d214b640 1 --2- 172.21.15.115:0/3526523451 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25cc0ffb40 0x7f25cc19b6a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f25bc02a9c0 tx=0x7f25bc0055a0 comp rx=0 tx=0).stop 2024-09-13T17:14:47.704 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.702+0000 7f25d214b640 1 -- 172.21.15.115:0/3526523451 shutdown_connections 2024-09-13T17:14:47.704 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.702+0000 7f25d214b640 1 --2- 172.21.15.115:0/3526523451 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f25b406cc50 0x7f25b406f110 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:47.704 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.702+0000 7f25d214b640 1 --2- 172.21.15.115:0/3526523451 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f25cc105bf0 0x7f25cc19bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:47.704 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.702+0000 7f25d214b640 1 --2- 172.21.15.115:0/3526523451 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25cc0ffb40 0x7f25cc19b6a0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:47.705 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.702+0000 7f25d214b640 1 -- 172.21.15.115:0/3526523451 >> 172.21.15.115:0/3526523451 conn(0x7f25cc0fb840 msgr2=0x7f25cc0fd920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:47.705 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.703+0000 7f25d214b640 1 -- 172.21.15.115:0/3526523451 shutdown_connections 2024-09-13T17:14:47.705 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.703+0000 7f25d214b640 1 -- 172.21.15.115:0/3526523451 wait complete. 2024-09-13T17:14:47.787 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.783+0000 7fa2a3672640 1 -- 172.21.15.115:0/1307044322 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa29c100cd0 msgr2=0x7fa29c1010b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:47.787 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.783+0000 7fa2a3672640 1 --2- 172.21.15.115:0/1307044322 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa29c100cd0 0x7fa29c1010b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa298009880 tx=0x7fa29802a530 comp rx=0 tx=0).stop 2024-09-13T17:14:47.787 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.783+0000 7fa2a3672640 1 -- 172.21.15.115:0/1307044322 shutdown_connections 2024-09-13T17:14:47.787 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.783+0000 7fa2a3672640 1 --2- 172.21.15.115:0/1307044322 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa29c1015f0 0x7fa29c109ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:47.787 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.783+0000 7fa2a3672640 1 --2- 172.21.15.115:0/1307044322 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa29c100cd0 0x7fa29c1010b0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:47.787 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.783+0000 7fa2a3672640 1 -- 172.21.15.115:0/1307044322 >> 172.21.15.115:0/1307044322 conn(0x7fa29c0fa730 msgr2=0x7fa29c0fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:47.787 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.783+0000 7fa2a3672640 1 -- 172.21.15.115:0/1307044322 shutdown_connections 2024-09-13T17:14:47.787 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.783+0000 7fa2a3672640 1 -- 172.21.15.115:0/1307044322 wait complete. 2024-09-13T17:14:47.787 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.784+0000 7fa2a3672640 1 Processor -- start 2024-09-13T17:14:47.787 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.784+0000 7fa2a3672640 1 -- start start 2024-09-13T17:14:47.788 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.784+0000 7fa2a3672640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa29c100cd0 0x7fa29c19b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:47.788 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.784+0000 7fa2a3672640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa29c1015f0 0x7fa29c19bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:47.788 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.784+0000 7fa2a3672640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa29c19c2f0 con 0x7fa29c1015f0 2024-09-13T17:14:47.788 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.784+0000 7fa2a3672640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa29c195880 con 0x7fa29c100cd0 2024-09-13T17:14:47.788 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.784+0000 7fa2a0c0d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa29c1015f0 0x7fa29c19bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:47.788 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.784+0000 7fa2a0c0d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa29c1015f0 0x7fa29c19bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47572/0 (socket says 172.21.15.115:47572) 2024-09-13T17:14:47.788 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.784+0000 7fa2a0c0d640 1 -- 172.21.15.115:0/19112707 learned_addr learned my addr 172.21.15.115:0/19112707 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:14:47.788 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.784+0000 7fa2a140e640 1 --2- 172.21.15.115:0/19112707 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa29c100cd0 0x7fa29c19b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:47.788 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.784+0000 7fa2a0c0d640 1 -- 172.21.15.115:0/19112707 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa29c100cd0 msgr2=0x7fa29c19b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:47.788 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.785+0000 7fa2a0c0d640 1 --2- 172.21.15.115:0/19112707 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa29c100cd0 0x7fa29c19b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:47.788 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.785+0000 7fa2a0c0d640 1 -- 172.21.15.115:0/19112707 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa298009560 con 0x7fa29c1015f0 2024-09-13T17:14:47.788 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.785+0000 7fa2a140e640 1 --2- 172.21.15.115:0/19112707 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa29c100cd0 0x7fa29c19b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:14:47.788 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.785+0000 7fa2a0c0d640 1 --2- 172.21.15.115:0/19112707 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa29c1015f0 0x7fa29c19bcd0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa28c00c8f0 tx=0x7fa28c00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:47.789 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.785+0000 7fa2927fc640 1 -- 172.21.15.115:0/19112707 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa28c007b80 con 0x7fa29c1015f0 2024-09-13T17:14:47.789 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.785+0000 7fa2927fc640 1 -- 172.21.15.115:0/19112707 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa28c00ae50 con 0x7fa29c1015f0 2024-09-13T17:14:47.789 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.785+0000 7fa2a3672640 1 -- 172.21.15.115:0/19112707 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa29c195b60 con 0x7fa29c1015f0 2024-09-13T17:14:47.789 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.785+0000 7fa2927fc640 1 -- 172.21.15.115:0/19112707 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa28c004d50 con 0x7fa29c1015f0 2024-09-13T17:14:47.789 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.785+0000 7fa2a3672640 1 -- 172.21.15.115:0/19112707 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa29c1960b0 con 0x7fa29c1015f0 2024-09-13T17:14:47.790 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.786+0000 7fa2a3672640 1 -- 172.21.15.115:0/19112707 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa29c068ce0 con 0x7fa29c1015f0 2024-09-13T17:14:47.790 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.786+0000 7fa2927fc640 1 -- 172.21.15.115:0/19112707 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fa28c005020 con 0x7fa29c1015f0 2024-09-13T17:14:47.790 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.787+0000 7fa2927fc640 1 --2- 172.21.15.115:0/19112707 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fa28806cc50 0x7fa28806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:47.790 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.787+0000 7fa2a140e640 1 --2- 172.21.15.115:0/19112707 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fa28806cc50 0x7fa28806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:47.790 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.787+0000 7fa2927fc640 1 -- 172.21.15.115:0/19112707 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fa28c08c250 con 0x7fa29c1015f0 2024-09-13T17:14:47.790 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.787+0000 7fa2a140e640 1 --2- 172.21.15.115:0/19112707 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fa28806cc50 0x7fa28806f110 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa298006010 tx=0x7fa298005d50 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:47.792 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:47.791+0000 7fa2927fc640 1 -- 172.21.15.115:0/19112707 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa28c056340 con 0x7fa29c1015f0 2024-09-13T17:14:48.021 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:48.020+0000 7fa2a3672640 1 -- 172.21.15.115:0/19112707 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fa29c1010b0 con 0x7fa29c1015f0 2024-09-13T17:14:48.022 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:48.020+0000 7fa2927fc640 1 -- 172.21.15.115:0/19112707 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fa28c059960 con 0x7fa29c1015f0 2024-09-13T17:14:48.022 INFO:teuthology.orchestra.run.smithi115.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-13T17:14:48.022 INFO:teuthology.orchestra.run.smithi115.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T17:14:48.022 INFO:teuthology.orchestra.run.smithi115.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T17:14:48.022 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:47 smithi115 ceph-mon[109488]: Upgrade: Setting filesystem cephfs Joinable 2024-09-13T17:14:48.022 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:47 smithi115 ceph-mon[109488]: from='client.34392 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:14:48.022 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:47 smithi115 ceph-mon[109488]: from='client.34396 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:14:48.023 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:47 smithi115 ceph-mon[109488]: from='client.34400 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:14:48.023 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:47 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-09-13T17:14:48.023 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:47 smithi115 ceph-mon[109488]: fsmap cephfs:1 {0=cephfs.smithi115.hbtxod=up:active} 1 up:standby-replay 2 up:standby 2024-09-13T17:14:48.023 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:47 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:14:48.023 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:47 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:14:48.023 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:47 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:14:48.023 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:47 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:14:48.023 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:47 smithi115 ceph-mon[109488]: Upgrade: Setting container_image for all ceph-exporter 2024-09-13T17:14:48.023 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:47 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:48.023 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:47 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi115"}]: dispatch 2024-09-13T17:14:48.023 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:47 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi115"}]': finished 2024-09-13T17:14:48.023 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:47 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi195"}]: dispatch 2024-09-13T17:14:48.024 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:47 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi195"}]': finished 2024-09-13T17:14:48.024 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:47 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:14:48.024 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:47 smithi115 ceph-mon[109488]: Upgrade: Setting container_image for all iscsi 2024-09-13T17:14:48.024 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:47 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:48.024 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:47 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:14:48.024 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:47 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:48.024 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:47 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:14:48.024 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:47 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:48.024 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:47 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:14:48.024 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:47 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:14:48.024 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:47 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:14:48.024 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:47 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:14:48.024 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:47 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:14:48.024 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:47 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:14:48.025 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:47 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-13T17:14:48.025 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:47 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-13T17:14:48.025 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:47 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T17:14:48.025 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:47 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-13T17:14:48.025 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:47 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-13T17:14:48.025 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:47 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-13T17:14:48.025 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:47 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-13T17:14:48.025 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:47 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-13T17:14:48.025 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:47 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-13T17:14:48.025 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:47 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-13T17:14:48.025 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:47 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-13T17:14:48.025 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:47 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-13T17:14:48.026 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:47 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-13T17:14:48.026 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:47 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-13T17:14:48.026 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:47 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T17:14:48.026 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:47 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-13T17:14:48.026 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:47 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-13T17:14:48.026 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:47 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-13T17:14:48.026 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:47 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-13T17:14:48.026 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:47 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-13T17:14:48.027 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:47 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-13T17:14:48.027 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:47 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-13T17:14:48.027 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:47 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-13T17:14:48.027 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:47 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T17:14:48.027 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:47 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T17:14:48.027 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:47 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T17:14:48.027 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:47 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T17:14:48.027 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:47 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T17:14:48.027 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:47 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T17:14:48.027 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:47 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-09-13T17:14:48.027 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:47 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]': finished 2024-09-13T17:14:48.027 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:47 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-13T17:14:48.027 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:47 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-13T17:14:48.028 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:47 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:14:48.028 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:47 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:14:48.028 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:47 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:14:48.028 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:47 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:48.028 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:47 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:14:48.028 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:47 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:14:48.028 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:47 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:14:48.028 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:47 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:48.028 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:47 smithi115 ceph-mon[109488]: from='client.? 172.21.15.115:0/487975262' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:14:48.028 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:47 smithi115 ceph-mon[109488]: from='client.? 172.21.15.115:0/2741234463' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T17:14:48.029 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:48.023+0000 7fa2a3672640 1 -- 172.21.15.115:0/19112707 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fa28806cc50 msgr2=0x7fa28806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:48.029 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:48.023+0000 7fa2a3672640 1 --2- 172.21.15.115:0/19112707 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fa28806cc50 0x7fa28806f110 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa298006010 tx=0x7fa298005d50 comp rx=0 tx=0).stop 2024-09-13T17:14:48.029 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:48.023+0000 7fa2a3672640 1 -- 172.21.15.115:0/19112707 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa29c1015f0 msgr2=0x7fa29c19bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:48.029 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:48.023+0000 7fa2a3672640 1 --2- 172.21.15.115:0/19112707 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa29c1015f0 0x7fa29c19bcd0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa28c00c8f0 tx=0x7fa28c00cdb0 comp rx=0 tx=0).stop 2024-09-13T17:14:48.029 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:48.023+0000 7fa2a3672640 1 -- 172.21.15.115:0/19112707 shutdown_connections 2024-09-13T17:14:48.029 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:48.023+0000 7fa2a3672640 1 --2- 172.21.15.115:0/19112707 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fa28806cc50 0x7fa28806f110 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:48.029 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:48.023+0000 7fa2a3672640 1 --2- 172.21.15.115:0/19112707 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa29c1015f0 0x7fa29c19bcd0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:48.029 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:48.023+0000 7fa2a3672640 1 --2- 172.21.15.115:0/19112707 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa29c100cd0 0x7fa29c19b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:48.029 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:48.023+0000 7fa2a3672640 1 -- 172.21.15.115:0/19112707 >> 172.21.15.115:0/19112707 conn(0x7fa29c0fa730 msgr2=0x7fa29c101f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:48.029 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:48.023+0000 7fa2a3672640 1 -- 172.21.15.115:0/19112707 shutdown_connections 2024-09-13T17:14:48.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:14:48.023+0000 7fa2a3672640 1 -- 172.21.15.115:0/19112707 wait complete. 2024-09-13T17:14:48.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:47 smithi195 ceph-mon[80021]: Upgrade: Setting filesystem cephfs Joinable 2024-09-13T17:14:48.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:47 smithi195 ceph-mon[80021]: from='client.34392 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:14:48.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:47 smithi195 ceph-mon[80021]: from='client.34396 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:14:48.328 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:47 smithi195 ceph-mon[80021]: from='client.34400 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:14:48.328 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:47 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-09-13T17:14:48.328 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:47 smithi195 ceph-mon[80021]: fsmap cephfs:1 {0=cephfs.smithi115.hbtxod=up:active} 1 up:standby-replay 2 up:standby 2024-09-13T17:14:48.328 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:47 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:14:48.328 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:47 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:14:48.328 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:47 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:14:48.328 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:47 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:14:48.328 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:47 smithi195 ceph-mon[80021]: Upgrade: Setting container_image for all ceph-exporter 2024-09-13T17:14:48.328 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:47 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:48.328 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:47 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi115"}]: dispatch 2024-09-13T17:14:48.328 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:47 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi115"}]': finished 2024-09-13T17:14:48.329 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:47 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi195"}]: dispatch 2024-09-13T17:14:48.329 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:47 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi195"}]': finished 2024-09-13T17:14:48.329 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:47 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:14:48.329 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:47 smithi195 ceph-mon[80021]: Upgrade: Setting container_image for all iscsi 2024-09-13T17:14:48.329 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:47 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:48.329 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:47 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:14:48.329 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:47 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:48.329 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:47 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:14:48.329 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:47 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:48.329 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:47 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:14:48.329 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:47 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:14:48.330 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:47 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:14:48.330 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:47 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:14:48.330 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:47 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:14:48.330 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:47 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:14:48.330 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:47 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-13T17:14:48.330 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:47 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-13T17:14:48.330 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:47 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T17:14:48.330 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:47 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-13T17:14:48.330 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:47 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-13T17:14:48.330 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:47 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-13T17:14:48.330 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:47 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-13T17:14:48.330 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:47 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-13T17:14:48.330 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:47 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-13T17:14:48.330 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:47 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-13T17:14:48.331 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:47 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-13T17:14:48.331 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:47 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-13T17:14:48.331 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:47 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-13T17:14:48.331 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:47 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-13T17:14:48.331 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:47 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T17:14:48.331 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:47 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-13T17:14:48.331 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:47 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-13T17:14:48.331 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:47 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-13T17:14:48.331 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:47 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-13T17:14:48.331 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:47 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-13T17:14:48.331 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:47 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-13T17:14:48.331 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:47 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-13T17:14:48.331 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:47 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-13T17:14:48.332 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:47 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T17:14:48.332 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:47 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T17:14:48.332 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:47 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T17:14:48.332 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:47 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T17:14:48.332 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:47 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T17:14:48.332 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:47 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T17:14:48.332 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:47 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-09-13T17:14:48.332 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:47 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd='[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]': finished 2024-09-13T17:14:48.332 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:47 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-13T17:14:48.333 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:47 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-13T17:14:48.333 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:47 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:14:48.333 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:47 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:14:48.333 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:47 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:14:48.333 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:47 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:48.333 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:47 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:14:48.333 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:47 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:14:48.333 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:47 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:14:48.333 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:47 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:48.333 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:47 smithi195 ceph-mon[80021]: from='client.? 172.21.15.115:0/487975262' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:14:48.333 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:47 smithi195 ceph-mon[80021]: from='client.? 172.21.15.115:0/2741234463' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T17:14:49.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:48 smithi115 ceph-mon[109488]: Upgrade: Setting container_image for all nfs 2024-09-13T17:14:49.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:48 smithi115 ceph-mon[109488]: Upgrade: Setting container_image for all nvmeof 2024-09-13T17:14:49.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:48 smithi115 ceph-mon[109488]: Upgrade: Finalizing container_image settings 2024-09-13T17:14:49.180 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:48 smithi115 ceph-mon[109488]: Upgrade: Complete! 2024-09-13T17:14:49.180 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:48 smithi115 ceph-mon[109488]: pgmap v283: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T17:14:49.180 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:48 smithi115 ceph-mon[109488]: from='client.34412 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:14:49.180 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:48 smithi115 ceph-mon[109488]: from='client.? 172.21.15.115:0/19112707' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T17:14:49.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:48 smithi195 ceph-mon[80021]: Upgrade: Setting container_image for all nfs 2024-09-13T17:14:49.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:48 smithi195 ceph-mon[80021]: Upgrade: Setting container_image for all nvmeof 2024-09-13T17:14:49.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:48 smithi195 ceph-mon[80021]: Upgrade: Finalizing container_image settings 2024-09-13T17:14:49.328 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:48 smithi195 ceph-mon[80021]: Upgrade: Complete! 2024-09-13T17:14:49.328 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:48 smithi195 ceph-mon[80021]: pgmap v283: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T17:14:49.328 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:48 smithi195 ceph-mon[80021]: from='client.34412 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:14:49.328 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:48 smithi195 ceph-mon[80021]: from='client.? 172.21.15.115:0/19112707' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T17:14:51.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:50 smithi115 ceph-mon[109488]: pgmap v284: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:14:51.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:50 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:14:51.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:50 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:51.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:50 smithi195 ceph-mon[80021]: pgmap v284: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:14:51.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:50 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:14:51.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:50 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:14:53.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:52 smithi115 ceph-mon[109488]: pgmap v285: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:14:53.326 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:52 smithi195 ceph-mon[80021]: pgmap v285: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:14:54.993 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:54 smithi115 ceph-mon[109488]: pgmap v286: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T17:14:55.326 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:54 smithi195 ceph-mon[80021]: pgmap v286: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T17:14:57.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:56 smithi115 ceph-mon[109488]: pgmap v287: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:14:57.326 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:56 smithi195 ceph-mon[80021]: pgmap v287: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:14:59.178 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:14:58 smithi115 ceph-mon[109488]: pgmap v288: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T17:14:59.326 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:14:58 smithi195 ceph-mon[80021]: pgmap v288: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T17:15:01.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:15:00 smithi115 ceph-mon[109488]: pgmap v289: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:15:01.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:15:00 smithi195 ceph-mon[80021]: pgmap v289: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:15:03.178 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:15:02 smithi115 ceph-mon[109488]: pgmap v290: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:15:03.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:15:02 smithi195 ceph-mon[80021]: pgmap v290: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:15:05.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:15:04 smithi195 ceph-mon[80021]: pgmap v291: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T17:15:05.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:15:04 smithi115 ceph-mon[109488]: pgmap v291: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T17:15:06.326 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:15:05 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:15:06.428 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:15:05 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:15:07.228 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:15:06 smithi195 ceph-mon[80021]: pgmap v292: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:15:07.428 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:15:06 smithi115 ceph-mon[109488]: pgmap v292: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:15:08.326 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:15:07 smithi195 ceph-mon[80021]: pgmap v293: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T17:15:08.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:15:07 smithi115 ceph-mon[109488]: pgmap v293: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T17:15:10.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:15:10 smithi195 ceph-mon[80021]: pgmap v294: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:15:10.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:15:10 smithi115 ceph-mon[109488]: pgmap v294: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:15:12.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:15:12 smithi195 ceph-mon[80021]: pgmap v295: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:15:12.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:15:12 smithi115 ceph-mon[109488]: pgmap v295: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:15:14.812 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:15:14 smithi195 ceph-mon[80021]: pgmap v296: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T17:15:14.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:15:14 smithi115 ceph-mon[109488]: pgmap v296: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T17:15:16.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:15:16 smithi195 ceph-mon[80021]: pgmap v297: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:15:16.928 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:15:16 smithi115 ceph-mon[109488]: pgmap v297: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:15:18.120 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:18.116+0000 7fbfa9a9f640 1 -- 172.21.15.115:0/1828577288 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbfa4105bf0 msgr2=0x7fbfa4105fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:18.120 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:18.116+0000 7fbfa9a9f640 1 --2- 172.21.15.115:0/1828577288 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbfa4105bf0 0x7fbfa4105fd0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fbf94009880 tx=0x7fbf9402a4a0 comp rx=0 tx=0).stop 2024-09-13T17:15:18.120 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:18.116+0000 7fbfa9a9f640 1 -- 172.21.15.115:0/1828577288 shutdown_connections 2024-09-13T17:15:18.120 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:18.116+0000 7fbfa9a9f640 1 --2- 172.21.15.115:0/1828577288 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbfa40ffb40 0x7fbfa40fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:18.120 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:18.116+0000 7fbfa9a9f640 1 --2- 172.21.15.115:0/1828577288 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbfa4105bf0 0x7fbfa4105fd0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:18.121 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:18.116+0000 7fbfa9a9f640 1 -- 172.21.15.115:0/1828577288 >> 172.21.15.115:0/1828577288 conn(0x7fbfa40fb840 msgr2=0x7fbfa40fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:18.121 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:18.117+0000 7fbfa9a9f640 1 -- 172.21.15.115:0/1828577288 shutdown_connections 2024-09-13T17:15:18.121 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:18.117+0000 7fbfa9a9f640 1 -- 172.21.15.115:0/1828577288 wait complete. 2024-09-13T17:15:18.121 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:18.117+0000 7fbfa9a9f640 1 Processor -- start 2024-09-13T17:15:18.121 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:18.117+0000 7fbfa9a9f640 1 -- start start 2024-09-13T17:15:18.121 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:18.118+0000 7fbfa9a9f640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbfa40ffb40 0x7fbfa40727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:18.121 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:18.118+0000 7fbfa9a9f640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbfa4105bf0 0x7fbfa4072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:18.121 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:18.118+0000 7fbfa9a9f640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa4073230 con 0x7fbfa4105bf0 2024-09-13T17:15:18.121 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:18.118+0000 7fbfa9a9f640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa4073370 con 0x7fbfa40ffb40 2024-09-13T17:15:18.121 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:18.118+0000 7fbfa2ffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbfa4105bf0 0x7fbfa4072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:18.121 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:18.118+0000 7fbfa2ffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbfa4105bf0 0x7fbfa4072cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50456/0 (socket says 172.21.15.115:50456) 2024-09-13T17:15:18.121 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:18.118+0000 7fbfa2ffd640 1 -- 172.21.15.115:0/744209228 learned_addr learned my addr 172.21.15.115:0/744209228 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:15:18.122 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:18.118+0000 7fbfa37fe640 1 --2- 172.21.15.115:0/744209228 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbfa40ffb40 0x7fbfa40727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:18.122 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:18.118+0000 7fbfa2ffd640 1 -- 172.21.15.115:0/744209228 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbfa40ffb40 msgr2=0x7fbfa40727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:18.122 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:18.118+0000 7fbfa2ffd640 1 --2- 172.21.15.115:0/744209228 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbfa40ffb40 0x7fbfa40727b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:18.122 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:18.118+0000 7fbfa2ffd640 1 -- 172.21.15.115:0/744209228 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf94009560 con 0x7fbfa4105bf0 2024-09-13T17:15:18.122 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:18.118+0000 7fbfa37fe640 1 --2- 172.21.15.115:0/744209228 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbfa40ffb40 0x7fbfa40727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:15:18.122 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:18.118+0000 7fbfa2ffd640 1 --2- 172.21.15.115:0/744209228 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbfa4105bf0 0x7fbfa4072cf0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fbf9800d6f0 tx=0x7fbf9800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:18.122 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:18.118+0000 7fbfa0ff9640 1 -- 172.21.15.115:0/744209228 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf98009a30 con 0x7fbfa4105bf0 2024-09-13T17:15:18.122 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:18.118+0000 7fbfa0ff9640 1 -- 172.21.15.115:0/744209228 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbf980054c0 con 0x7fbfa4105bf0 2024-09-13T17:15:18.122 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:18.119+0000 7fbfa9a9f640 1 -- 172.21.15.115:0/744209228 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfa41a1b10 con 0x7fbfa4105bf0 2024-09-13T17:15:18.123 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:18.119+0000 7fbfa0ff9640 1 -- 172.21.15.115:0/744209228 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf98004db0 con 0x7fbfa4105bf0 2024-09-13T17:15:18.123 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:18.119+0000 7fbfa9a9f640 1 -- 172.21.15.115:0/744209228 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfa41a1e70 con 0x7fbfa4105bf0 2024-09-13T17:15:18.124 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:18.120+0000 7fbfa9a9f640 1 -- 172.21.15.115:0/744209228 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfa41011f0 con 0x7fbfa4105bf0 2024-09-13T17:15:18.125 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:18.120+0000 7fbfa0ff9640 1 -- 172.21.15.115:0/744209228 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fbf98005020 con 0x7fbfa4105bf0 2024-09-13T17:15:18.125 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:18.120+0000 7fbfa0ff9640 1 --2- 172.21.15.115:0/744209228 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fbf8c06cbf0 0x7fbf8c06f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:18.125 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:18.121+0000 7fbfa0ff9640 1 -- 172.21.15.115:0/744209228 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fbf9808c160 con 0x7fbfa4105bf0 2024-09-13T17:15:18.125 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:18.121+0000 7fbfa37fe640 1 --2- 172.21.15.115:0/744209228 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fbf8c06cbf0 0x7fbf8c06f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:18.125 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:18.121+0000 7fbfa37fe640 1 --2- 172.21.15.115:0/744209228 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fbf8c06cbf0 0x7fbf8c06f0b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fbf94005ab0 tx=0x7fbf94005a20 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:18.126 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:18.125+0000 7fbfa0ff9640 1 -- 172.21.15.115:0/744209228 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fbf980561d0 con 0x7fbfa4105bf0 2024-09-13T17:15:18.302 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:18.301+0000 7fbfa9a9f640 1 -- 172.21.15.115:0/744209228 --> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbfa41080b0 con 0x7fbf8c06cbf0 2024-09-13T17:15:18.303 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:18.302+0000 7fbfa0ff9640 1 -- 172.21.15.115:0/744209228 <== mgr.14660 v2:172.21.15.115:6800/1049502673 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7fbfa41080b0 con 0x7fbf8c06cbf0 2024-09-13T17:15:18.305 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:18.304+0000 7fbfa9a9f640 1 -- 172.21.15.115:0/744209228 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fbf8c06cbf0 msgr2=0x7fbf8c06f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:18.306 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:18.304+0000 7fbfa9a9f640 1 --2- 172.21.15.115:0/744209228 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fbf8c06cbf0 0x7fbf8c06f0b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fbf94005ab0 tx=0x7fbf94005a20 comp rx=0 tx=0).stop 2024-09-13T17:15:18.306 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:18.304+0000 7fbfa9a9f640 1 -- 172.21.15.115:0/744209228 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbfa4105bf0 msgr2=0x7fbfa4072cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:18.306 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:18.304+0000 7fbfa9a9f640 1 --2- 172.21.15.115:0/744209228 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbfa4105bf0 0x7fbfa4072cf0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fbf9800d6f0 tx=0x7fbf9800dbb0 comp rx=0 tx=0).stop 2024-09-13T17:15:18.306 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:18.304+0000 7fbfa9a9f640 1 -- 172.21.15.115:0/744209228 shutdown_connections 2024-09-13T17:15:18.306 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:18.304+0000 7fbfa9a9f640 1 --2- 172.21.15.115:0/744209228 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fbf8c06cbf0 0x7fbf8c06f0b0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:18.306 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:18.304+0000 7fbfa9a9f640 1 --2- 172.21.15.115:0/744209228 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbfa4105bf0 0x7fbfa4072cf0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:18.306 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:18.304+0000 7fbfa9a9f640 1 --2- 172.21.15.115:0/744209228 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbfa40ffb40 0x7fbfa40727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:18.306 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:18.304+0000 7fbfa9a9f640 1 -- 172.21.15.115:0/744209228 >> 172.21.15.115:0/744209228 conn(0x7fbfa40fb840 msgr2=0x7fbfa40fd920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:18.306 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:18.304+0000 7fbfa9a9f640 1 -- 172.21.15.115:0/744209228 shutdown_connections 2024-09-13T17:15:18.306 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:18.304+0000 7fbfa9a9f640 1 -- 172.21.15.115:0/744209228 wait complete. 2024-09-13T17:15:18.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:15:18 smithi195 ceph-mon[80021]: pgmap v298: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T17:15:18.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:15:18 smithi115 ceph-mon[109488]: pgmap v298: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T17:15:19.043 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -e sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 -- bash -c 'ceph orch ps' 2024-09-13T17:15:19.286 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T17:15:19.679 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:15:19 smithi115 ceph-mon[109488]: from='client.34420 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:15:19.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:15:19 smithi195 ceph-mon[80021]: from='client.34420 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:15:20.603 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:15:20 smithi115 ceph-mon[109488]: pgmap v299: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:15:20.817 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:20.793+0000 7f8cbc8a3640 1 -- 172.21.15.115:0/1384152782 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8cb80730f0 msgr2=0x7f8cb810be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:20.817 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:20.793+0000 7f8cbc8a3640 1 --2- 172.21.15.115:0/1384152782 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8cb80730f0 0x7f8cb810be70 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f8cac009c20 tx=0x7f8cac02aa00 comp rx=0 tx=0).stop 2024-09-13T17:15:20.817 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:20.793+0000 7f8cbc8a3640 1 -- 172.21.15.115:0/1384152782 shutdown_connections 2024-09-13T17:15:20.817 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:20.793+0000 7f8cbc8a3640 1 --2- 172.21.15.115:0/1384152782 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8cb80730f0 0x7f8cb810be70 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:20.817 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:20.793+0000 7f8cbc8a3640 1 --2- 172.21.15.115:0/1384152782 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8cb80727d0 0x7f8cb8072bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:20.817 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:20.793+0000 7f8cbc8a3640 1 -- 172.21.15.115:0/1384152782 >> 172.21.15.115:0/1384152782 conn(0x7f8cb80fb810 msgr2=0x7f8cb80fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:20.817 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:20.793+0000 7f8cbc8a3640 1 -- 172.21.15.115:0/1384152782 shutdown_connections 2024-09-13T17:15:20.817 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:20.793+0000 7f8cbc8a3640 1 -- 172.21.15.115:0/1384152782 wait complete. 2024-09-13T17:15:20.818 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:20.794+0000 7f8cbc8a3640 1 Processor -- start 2024-09-13T17:15:20.818 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:20.794+0000 7f8cbc8a3640 1 -- start start 2024-09-13T17:15:20.818 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:20.794+0000 7f8cbc8a3640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8cb80727d0 0x7f8cb819d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:20.818 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:20.794+0000 7f8cbc8a3640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8cb80730f0 0x7f8cb819dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:20.818 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:20.794+0000 7f8cbc8a3640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb819e4c0 con 0x7f8cb80727d0 2024-09-13T17:15:20.818 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:20.794+0000 7f8cbc8a3640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb8197a50 con 0x7f8cb80730f0 2024-09-13T17:15:20.818 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:20.794+0000 7f8cb659c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8cb80727d0 0x7f8cb819d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:20.818 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:20.794+0000 7f8cb659c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8cb80727d0 0x7f8cb819d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50474/0 (socket says 172.21.15.115:50474) 2024-09-13T17:15:20.818 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:20.794+0000 7f8cb659c640 1 -- 172.21.15.115:0/3773073010 learned_addr learned my addr 172.21.15.115:0/3773073010 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:15:20.818 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:20.794+0000 7f8cb5d9b640 1 --2- 172.21.15.115:0/3773073010 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8cb80730f0 0x7f8cb819dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:20.818 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:20.794+0000 7f8cb659c640 1 -- 172.21.15.115:0/3773073010 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8cb80730f0 msgr2=0x7f8cb819dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:20.818 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:20.794+0000 7f8cb659c640 1 --2- 172.21.15.115:0/3773073010 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8cb80730f0 0x7f8cb819dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:20.819 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:20.794+0000 7f8cb659c640 1 -- 172.21.15.115:0/3773073010 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cac009900 con 0x7f8cb80727d0 2024-09-13T17:15:20.819 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:20.794+0000 7f8cb5d9b640 1 --2- 172.21.15.115:0/3773073010 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8cb80730f0 0x7f8cb819dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:15:20.819 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:20.794+0000 7f8cb659c640 1 --2- 172.21.15.115:0/3773073010 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8cb80727d0 0x7f8cb819d960 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8cb000d8d0 tx=0x7f8cb000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:20.819 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:20.795+0000 7f8ca77fe640 1 -- 172.21.15.115:0/3773073010 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8cb000bea0 con 0x7f8cb80727d0 2024-09-13T17:15:20.819 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:20.795+0000 7f8cbc8a3640 1 -- 172.21.15.115:0/3773073010 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cb8197d30 con 0x7f8cb80727d0 2024-09-13T17:15:20.819 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:20.795+0000 7f8ca77fe640 1 -- 172.21.15.115:0/3773073010 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8cb0009c00 con 0x7f8cb80727d0 2024-09-13T17:15:20.819 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:20.795+0000 7f8ca77fe640 1 -- 172.21.15.115:0/3773073010 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8cb000f680 con 0x7f8cb80727d0 2024-09-13T17:15:20.819 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:20.795+0000 7f8cbc8a3640 1 -- 172.21.15.115:0/3773073010 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cb8198280 con 0x7f8cb80727d0 2024-09-13T17:15:20.819 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:20.796+0000 7f8cbc8a3640 1 -- 172.21.15.115:0/3773073010 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cb8073f10 con 0x7f8cb80727d0 2024-09-13T17:15:20.819 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:20.796+0000 7f8ca77fe640 1 -- 172.21.15.115:0/3773073010 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f8cb0010460 con 0x7f8cb80727d0 2024-09-13T17:15:20.819 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:20.796+0000 7f8ca77fe640 1 --2- 172.21.15.115:0/3773073010 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f8ca006cc50 0x7f8ca006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:20.819 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:20.797+0000 7f8ca77fe640 1 -- 172.21.15.115:0/3773073010 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f8cb008c3b0 con 0x7f8cb80727d0 2024-09-13T17:15:20.819 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:20.797+0000 7f8cb5d9b640 1 --2- 172.21.15.115:0/3773073010 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f8ca006cc50 0x7f8ca006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:20.819 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:20.797+0000 7f8cb5d9b640 1 --2- 172.21.15.115:0/3773073010 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f8ca006cc50 0x7f8ca006f110 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8cb8198ec0 tx=0x7f8cac03b040 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:20.820 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:20.801+0000 7f8ca77fe640 1 -- 172.21.15.115:0/3773073010 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f8cb0059eb0 con 0x7f8cb80727d0 2024-09-13T17:15:20.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:15:20 smithi195 ceph-mon[80021]: pgmap v299: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:15:20.974 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:20.973+0000 7f8cbc8a3640 1 -- 172.21.15.115:0/3773073010 --> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8cb8106820 con 0x7f8ca006cc50 2024-09-13T17:15:20.983 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:20.982+0000 7f8ca77fe640 1 -- 172.21.15.115:0/3773073010 <== mgr.14660 v2:172.21.15.115:6800/1049502673 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f8cb8106820 con 0x7f8ca006cc50 2024-09-13T17:15:20.984 INFO:teuthology.orchestra.run.smithi115.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T17:15:20.984 INFO:teuthology.orchestra.run.smithi115.stdout:alertmanager.smithi115 smithi115 *:9093,9094 running (7m) 38s ago 17m 24.7M - 0.25.0 c8568f914cd2 d56b91240fe1 2024-09-13T17:15:20.984 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-exporter.smithi115 smithi115 running (52s) 38s ago 17m 7470k - 18.2.4-860-g6c6b083f 8a91f241d7d4 61191fa97aa7 2024-09-13T17:15:20.984 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-exporter.smithi195 smithi195 running (47s) 44s ago 16m 6786k - 18.2.4-860-g6c6b083f 8a91f241d7d4 f2ef90ec9def 2024-09-13T17:15:20.984 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi115 smithi115 running (5m) 38s ago 17m 6895k - 18.2.4-860-g6c6b083f 8a91f241d7d4 e8175bc055bf 2024-09-13T17:15:20.984 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi195 smithi195 running (5m) 44s ago 16m 6903k - 18.2.4-860-g6c6b083f 8a91f241d7d4 ccb4895be776 2024-09-13T17:15:20.984 INFO:teuthology.orchestra.run.smithi115.stdout:grafana.smithi115 smithi115 *:3000 running (6m) 38s ago 17m 86.7M - 9.4.7 954c08fa6188 e1eccb1a8f3e 2024-09-13T17:15:20.984 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi115.hbtxod smithi115 running (2m) 38s ago 12m 88.9M - 18.2.4-860-g6c6b083f 8a91f241d7d4 9221253d5ed4 2024-09-13T17:15:20.984 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi115.ijznvr smithi115 running (101s) 38s ago 11m 84.8M - 18.2.4-860-g6c6b083f 8a91f241d7d4 aab0c23ec15b 2024-09-13T17:15:20.985 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi195.aevvgz smithi195 running (66s) 44s ago 11m 15.3M - 18.2.4-860-g6c6b083f 8a91f241d7d4 1f6eafd16096 2024-09-13T17:15:20.985 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi195.qzghxj smithi195 running (85s) 44s ago 11m 15.4M - 18.2.4-860-g6c6b083f 8a91f241d7d4 653d67d222ce 2024-09-13T17:15:20.985 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi115.hetcni smithi115 *:8443,9283,8765 running (8m) 38s ago 18m 499M - 18.2.4-860-g6c6b083f 8a91f241d7d4 b945dbde1934 2024-09-13T17:15:20.985 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi195.hjjifz smithi195 *:8443,9283,8765 running (8m) 44s ago 16m 442M - 18.2.4-860-g6c6b083f 8a91f241d7d4 17bccdfbcae1 2024-09-13T17:15:20.985 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi115 smithi115 running (5m) 38s ago 18m 49.5M 2048M 18.2.4-860-g6c6b083f 8a91f241d7d4 8dd7baf2c6b6 2024-09-13T17:15:20.985 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi195 smithi195 running (5m) 44s ago 16m 39.9M 2048M 18.2.4-860-g6c6b083f 8a91f241d7d4 0459bc5e6b08 2024-09-13T17:15:20.985 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi115 smithi115 *:9100 running (7m) 38s ago 17m 17.3M - 1.5.0 0da6a335fe13 26fb6f9844b5 2024-09-13T17:15:20.985 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi195 smithi195 *:9100 running (7m) 44s ago 16m 16.6M - 1.5.0 0da6a335fe13 6d38e798fb16 2024-09-13T17:15:20.985 INFO:teuthology.orchestra.run.smithi115.stdout:osd.0 smithi115 running (5m) 38s ago 15m 110M 1216M 18.2.4-860-g6c6b083f 8a91f241d7d4 3b9f874c64e9 2024-09-13T17:15:20.985 INFO:teuthology.orchestra.run.smithi115.stdout:osd.1 smithi115 running (4m) 38s ago 15m 119M 1216M 18.2.4-860-g6c6b083f 8a91f241d7d4 f0de6684601c 2024-09-13T17:15:20.985 INFO:teuthology.orchestra.run.smithi115.stdout:osd.2 smithi115 running (3m) 38s ago 14m 102M 1216M 18.2.4-860-g6c6b083f 8a91f241d7d4 edb753bab54a 2024-09-13T17:15:20.985 INFO:teuthology.orchestra.run.smithi115.stdout:osd.3 smithi195 running (3m) 44s ago 14m 125M 2240M 18.2.4-860-g6c6b083f 8a91f241d7d4 ccd1b2bf7d86 2024-09-13T17:15:20.985 INFO:teuthology.orchestra.run.smithi115.stdout:osd.4 smithi195 running (2m) 44s ago 13m 106M 2240M 18.2.4-860-g6c6b083f 8a91f241d7d4 c88b3dacb207 2024-09-13T17:15:20.985 INFO:teuthology.orchestra.run.smithi115.stdout:osd.5 smithi195 running (2m) 44s ago 13m 99.1M 2240M 18.2.4-860-g6c6b083f 8a91f241d7d4 40ccbc2f5195 2024-09-13T17:15:20.986 INFO:teuthology.orchestra.run.smithi115.stdout:prometheus.smithi115 smithi115 *:9095 running (7m) 38s ago 16m 64.6M - 2.43.0 a07b618ecd1d e03fb39f6b76 2024-09-13T17:15:20.986 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:20.984+0000 7f8cbc8a3640 1 -- 172.21.15.115:0/3773073010 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f8ca006cc50 msgr2=0x7f8ca006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:20.986 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:20.984+0000 7f8cbc8a3640 1 --2- 172.21.15.115:0/3773073010 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f8ca006cc50 0x7f8ca006f110 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8cb8198ec0 tx=0x7f8cac03b040 comp rx=0 tx=0).stop 2024-09-13T17:15:20.986 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:20.984+0000 7f8cbc8a3640 1 -- 172.21.15.115:0/3773073010 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8cb80727d0 msgr2=0x7f8cb819d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:20.986 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:20.984+0000 7f8cbc8a3640 1 --2- 172.21.15.115:0/3773073010 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8cb80727d0 0x7f8cb819d960 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8cb000d8d0 tx=0x7f8cb000dd90 comp rx=0 tx=0).stop 2024-09-13T17:15:20.987 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:20.984+0000 7f8cbc8a3640 1 -- 172.21.15.115:0/3773073010 shutdown_connections 2024-09-13T17:15:20.987 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:20.984+0000 7f8cbc8a3640 1 --2- 172.21.15.115:0/3773073010 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f8ca006cc50 0x7f8ca006f110 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:20.987 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:20.984+0000 7f8cbc8a3640 1 --2- 172.21.15.115:0/3773073010 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8cb80730f0 0x7f8cb819dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:20.987 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:20.984+0000 7f8cbc8a3640 1 --2- 172.21.15.115:0/3773073010 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8cb80727d0 0x7f8cb819d960 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:20.987 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:20.984+0000 7f8cbc8a3640 1 -- 172.21.15.115:0/3773073010 >> 172.21.15.115:0/3773073010 conn(0x7f8cb80fb810 msgr2=0x7f8cb8104350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:20.987 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:20.984+0000 7f8cbc8a3640 1 -- 172.21.15.115:0/3773073010 shutdown_connections 2024-09-13T17:15:20.987 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:20.984+0000 7f8cbc8a3640 1 -- 172.21.15.115:0/3773073010 wait complete. 2024-09-13T17:15:21.605 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -e sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 -- bash -c 'ceph orch upgrade status' 2024-09-13T17:15:21.804 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T17:15:21.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:15:21 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:15:21.924 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:15:21 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:15:22.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:15:22 smithi195 ceph-mon[80021]: from='client.34424 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:15:22.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:15:22 smithi195 ceph-mon[80021]: pgmap v300: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:15:22.907 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:15:22 smithi115 ceph-mon[109488]: from='client.34424 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:15:22.908 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:15:22 smithi115 ceph-mon[109488]: pgmap v300: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:15:23.410 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:23.400+0000 7fec94fdb640 1 -- 172.21.15.115:0/2276758245 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec900fea20 msgr2=0x7fec900fee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:23.411 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:23.400+0000 7fec94fdb640 1 --2- 172.21.15.115:0/2276758245 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec900fea20 0x7fec900fee80 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fec84009880 tx=0x7fec8402a4a0 comp rx=0 tx=0).stop 2024-09-13T17:15:23.411 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:23.400+0000 7fec94fdb640 1 -- 172.21.15.115:0/2276758245 shutdown_connections 2024-09-13T17:15:23.411 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:23.400+0000 7fec94fdb640 1 --2- 172.21.15.115:0/2276758245 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec900fea20 0x7fec900fee80 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:23.411 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:23.400+0000 7fec94fdb640 1 --2- 172.21.15.115:0/2276758245 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fec90104a20 0x7fec90104e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:23.411 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:23.400+0000 7fec94fdb640 1 -- 172.21.15.115:0/2276758245 >> 172.21.15.115:0/2276758245 conn(0x7fec900fa720 msgr2=0x7fec900fcb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:23.411 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:23.400+0000 7fec94fdb640 1 -- 172.21.15.115:0/2276758245 shutdown_connections 2024-09-13T17:15:23.411 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:23.400+0000 7fec94fdb640 1 -- 172.21.15.115:0/2276758245 wait complete. 2024-09-13T17:15:23.411 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:23.401+0000 7fec94fdb640 1 Processor -- start 2024-09-13T17:15:23.411 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:23.401+0000 7fec94fdb640 1 -- start start 2024-09-13T17:15:23.411 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:23.402+0000 7fec94fdb640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec900fea20 0x7fec9019b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:23.412 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:23.402+0000 7fec94fdb640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fec90104a20 0x7fec9019bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:23.412 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:23.402+0000 7fec94fdb640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec9019c3e0 con 0x7fec900fea20 2024-09-13T17:15:23.412 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:23.402+0000 7fec94fdb640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec90195970 con 0x7fec90104a20 2024-09-13T17:15:23.412 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:23.402+0000 7fec8e59c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec900fea20 0x7fec9019b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:23.412 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:23.402+0000 7fec8e59c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec900fea20 0x7fec9019b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50492/0 (socket says 172.21.15.115:50492) 2024-09-13T17:15:23.412 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:23.402+0000 7fec8e59c640 1 -- 172.21.15.115:0/1816184956 learned_addr learned my addr 172.21.15.115:0/1816184956 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:15:23.412 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:23.402+0000 7fec8dd9b640 1 --2- 172.21.15.115:0/1816184956 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fec90104a20 0x7fec9019bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:23.412 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:23.402+0000 7fec8e59c640 1 -- 172.21.15.115:0/1816184956 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fec90104a20 msgr2=0x7fec9019bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:23.412 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:23.402+0000 7fec8e59c640 1 --2- 172.21.15.115:0/1816184956 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fec90104a20 0x7fec9019bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:23.412 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:23.402+0000 7fec8e59c640 1 -- 172.21.15.115:0/1816184956 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec84009560 con 0x7fec900fea20 2024-09-13T17:15:23.412 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:23.402+0000 7fec8e59c640 1 --2- 172.21.15.115:0/1816184956 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec900fea20 0x7fec9019b880 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fec8000b420 tx=0x7fec8000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:23.412 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:23.402+0000 7fec7f7fe640 1 -- 172.21.15.115:0/1816184956 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec80011800 con 0x7fec900fea20 2024-09-13T17:15:23.413 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:23.402+0000 7fec94fdb640 1 -- 172.21.15.115:0/1816184956 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec90195c50 con 0x7fec900fea20 2024-09-13T17:15:23.413 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:23.402+0000 7fec7f7fe640 1 -- 172.21.15.115:0/1816184956 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fec80011e00 con 0x7fec900fea20 2024-09-13T17:15:23.413 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:23.402+0000 7fec7f7fe640 1 -- 172.21.15.115:0/1816184956 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec8000f2e0 con 0x7fec900fea20 2024-09-13T17:15:23.413 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:23.403+0000 7fec94fdb640 1 -- 172.21.15.115:0/1816184956 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec901961a0 con 0x7fec900fea20 2024-09-13T17:15:23.413 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:23.403+0000 7fec94fdb640 1 -- 172.21.15.115:0/1816184956 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec90100160 con 0x7fec900fea20 2024-09-13T17:15:23.413 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:23.404+0000 7fec7f7fe640 1 -- 172.21.15.115:0/1816184956 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fec80010380 con 0x7fec900fea20 2024-09-13T17:15:23.413 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:23.404+0000 7fec7f7fe640 1 --2- 172.21.15.115:0/1816184956 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fec7806cc50 0x7fec7806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:23.413 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:23.404+0000 7fec7f7fe640 1 -- 172.21.15.115:0/1816184956 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fec8008bf60 con 0x7fec900fea20 2024-09-13T17:15:23.413 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:23.405+0000 7fec8dd9b640 1 --2- 172.21.15.115:0/1816184956 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fec7806cc50 0x7fec7806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:23.413 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:23.405+0000 7fec8dd9b640 1 --2- 172.21.15.115:0/1816184956 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fec7806cc50 0x7fec7806f110 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fec90196de0 tx=0x7fec84005a20 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:23.413 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:23.409+0000 7fec7f7fe640 1 -- 172.21.15.115:0/1816184956 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fec800bfe20 con 0x7fec900fea20 2024-09-13T17:15:23.586 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:23.585+0000 7fec94fdb640 1 -- 172.21.15.115:0/1816184956 --> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fec9010bc20 con 0x7fec7806cc50 2024-09-13T17:15:23.587 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:23.586+0000 7fec7f7fe640 1 -- 172.21.15.115:0/1816184956 <== mgr.14660 v2:172.21.15.115:6800/1049502673 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7fec9010bc20 con 0x7fec7806cc50 2024-09-13T17:15:23.588 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-13T17:15:23.588 INFO:teuthology.orchestra.run.smithi115.stdout: "target_image": null, 2024-09-13T17:15:23.588 INFO:teuthology.orchestra.run.smithi115.stdout: "in_progress": false, 2024-09-13T17:15:23.588 INFO:teuthology.orchestra.run.smithi115.stdout: "which": "", 2024-09-13T17:15:23.588 INFO:teuthology.orchestra.run.smithi115.stdout: "services_complete": [], 2024-09-13T17:15:23.588 INFO:teuthology.orchestra.run.smithi115.stdout: "progress": null, 2024-09-13T17:15:23.588 INFO:teuthology.orchestra.run.smithi115.stdout: "message": "", 2024-09-13T17:15:23.588 INFO:teuthology.orchestra.run.smithi115.stdout: "is_paused": false 2024-09-13T17:15:23.588 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-13T17:15:23.590 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:23.588+0000 7fec94fdb640 1 -- 172.21.15.115:0/1816184956 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fec7806cc50 msgr2=0x7fec7806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:23.590 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:23.588+0000 7fec94fdb640 1 --2- 172.21.15.115:0/1816184956 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fec7806cc50 0x7fec7806f110 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fec90196de0 tx=0x7fec84005a20 comp rx=0 tx=0).stop 2024-09-13T17:15:23.590 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:23.588+0000 7fec94fdb640 1 -- 172.21.15.115:0/1816184956 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec900fea20 msgr2=0x7fec9019b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:23.590 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:23.588+0000 7fec94fdb640 1 --2- 172.21.15.115:0/1816184956 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec900fea20 0x7fec9019b880 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fec8000b420 tx=0x7fec8000b8e0 comp rx=0 tx=0).stop 2024-09-13T17:15:23.590 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:23.588+0000 7fec94fdb640 1 -- 172.21.15.115:0/1816184956 shutdown_connections 2024-09-13T17:15:23.590 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:23.588+0000 7fec94fdb640 1 --2- 172.21.15.115:0/1816184956 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fec7806cc50 0x7fec7806f110 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:23.590 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:23.588+0000 7fec94fdb640 1 --2- 172.21.15.115:0/1816184956 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fec90104a20 0x7fec9019bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:23.590 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:23.588+0000 7fec94fdb640 1 --2- 172.21.15.115:0/1816184956 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec900fea20 0x7fec9019b880 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:23.590 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:23.588+0000 7fec94fdb640 1 -- 172.21.15.115:0/1816184956 >> 172.21.15.115:0/1816184956 conn(0x7fec900fa720 msgr2=0x7fec900fb910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:23.590 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:23.589+0000 7fec94fdb640 1 -- 172.21.15.115:0/1816184956 shutdown_connections 2024-09-13T17:15:23.591 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:23.589+0000 7fec94fdb640 1 -- 172.21.15.115:0/1816184956 wait complete. 2024-09-13T17:15:24.129 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -e sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 -- bash -c 'ceph health detail' 2024-09-13T17:15:24.329 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T17:15:24.734 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:15:24 smithi115 ceph-mon[109488]: pgmap v301: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T17:15:24.734 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:15:24 smithi115 ceph-mon[109488]: from='client.34428 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:15:24.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:15:24 smithi195 ceph-mon[80021]: pgmap v301: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T17:15:24.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:15:24 smithi195 ceph-mon[80021]: from='client.34428 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:15:26.057 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:26.053+0000 7fb4ba188640 1 -- 172.21.15.115:0/3052696407 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb4b4105bf0 msgr2=0x7fb4b4105fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:26.057 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:26.053+0000 7fb4ba188640 1 --2- 172.21.15.115:0/3052696407 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb4b4105bf0 0x7fb4b4105fd0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb4a4009880 tx=0x7fb4a402a4a0 comp rx=0 tx=0).stop 2024-09-13T17:15:26.057 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:26.053+0000 7fb4ba188640 1 -- 172.21.15.115:0/3052696407 shutdown_connections 2024-09-13T17:15:26.058 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:26.053+0000 7fb4ba188640 1 --2- 172.21.15.115:0/3052696407 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb4b40ffb40 0x7fb4b40fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:26.058 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:26.053+0000 7fb4ba188640 1 --2- 172.21.15.115:0/3052696407 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb4b4105bf0 0x7fb4b4105fd0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:26.058 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:26.053+0000 7fb4ba188640 1 -- 172.21.15.115:0/3052696407 >> 172.21.15.115:0/3052696407 conn(0x7fb4b40fb840 msgr2=0x7fb4b40fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:26.058 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:26.053+0000 7fb4ba188640 1 -- 172.21.15.115:0/3052696407 shutdown_connections 2024-09-13T17:15:26.058 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:26.053+0000 7fb4ba188640 1 -- 172.21.15.115:0/3052696407 wait complete. 2024-09-13T17:15:26.058 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:26.053+0000 7fb4ba188640 1 Processor -- start 2024-09-13T17:15:26.058 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:26.054+0000 7fb4ba188640 1 -- start start 2024-09-13T17:15:26.058 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:26.054+0000 7fb4ba188640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb4b40ffb40 0x7fb4b419b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:26.058 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:26.054+0000 7fb4ba188640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb4b4105bf0 0x7fb4b419bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:26.058 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:26.054+0000 7fb4ba188640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b41957b0 con 0x7fb4b40ffb40 2024-09-13T17:15:26.058 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:26.054+0000 7fb4ba188640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b4195920 con 0x7fb4b4105bf0 2024-09-13T17:15:26.059 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:26.054+0000 7fb4b37fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb4b40ffb40 0x7fb4b419b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:26.059 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:26.054+0000 7fb4b37fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb4b40ffb40 0x7fb4b419b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:36804/0 (socket says 172.21.15.115:36804) 2024-09-13T17:15:26.059 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:26.054+0000 7fb4b37fe640 1 -- 172.21.15.115:0/1853700889 learned_addr learned my addr 172.21.15.115:0/1853700889 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:15:26.059 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:26.054+0000 7fb4b2ffd640 1 --2- 172.21.15.115:0/1853700889 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb4b4105bf0 0x7fb4b419bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:26.059 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:26.054+0000 7fb4b37fe640 1 -- 172.21.15.115:0/1853700889 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb4b4105bf0 msgr2=0x7fb4b419bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:26.059 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:26.054+0000 7fb4b37fe640 1 --2- 172.21.15.115:0/1853700889 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb4b4105bf0 0x7fb4b419bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:26.059 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:26.054+0000 7fb4b37fe640 1 -- 172.21.15.115:0/1853700889 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4a4009560 con 0x7fb4b40ffb40 2024-09-13T17:15:26.059 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:26.054+0000 7fb4b2ffd640 1 --2- 172.21.15.115:0/1853700889 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb4b4105bf0 0x7fb4b419bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:15:26.059 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:26.055+0000 7fb4b37fe640 1 --2- 172.21.15.115:0/1853700889 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb4b40ffb40 0x7fb4b419b6c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb4a402a9c0 tx=0x7fb4a40055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:26.059 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:26.055+0000 7fb4b0ff9640 1 -- 172.21.15.115:0/1853700889 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb4a4004b60 con 0x7fb4b40ffb40 2024-09-13T17:15:26.059 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:26.055+0000 7fb4b0ff9640 1 -- 172.21.15.115:0/1853700889 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb4a4004cc0 con 0x7fb4b40ffb40 2024-09-13T17:15:26.059 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:26.055+0000 7fb4ba188640 1 -- 172.21.15.115:0/1853700889 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4b4195ba0 con 0x7fb4b40ffb40 2024-09-13T17:15:26.060 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:26.055+0000 7fb4b0ff9640 1 -- 172.21.15.115:0/1853700889 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb4a4031950 con 0x7fb4b40ffb40 2024-09-13T17:15:26.060 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:26.055+0000 7fb4ba188640 1 -- 172.21.15.115:0/1853700889 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4b4196110 con 0x7fb4b40ffb40 2024-09-13T17:15:26.061 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:26.056+0000 7fb4ba188640 1 -- 172.21.15.115:0/1853700889 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4b41011f0 con 0x7fb4b40ffb40 2024-09-13T17:15:26.061 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:26.056+0000 7fb4b0ff9640 1 -- 172.21.15.115:0/1853700889 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fb4a4003c20 con 0x7fb4b40ffb40 2024-09-13T17:15:26.061 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:26.057+0000 7fb4b0ff9640 1 --2- 172.21.15.115:0/1853700889 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fb49c06cc50 0x7fb49c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:26.062 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:26.057+0000 7fb4b0ff9640 1 -- 172.21.15.115:0/1853700889 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fb4a40ad780 con 0x7fb4b40ffb40 2024-09-13T17:15:26.062 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:26.057+0000 7fb4b2ffd640 1 --2- 172.21.15.115:0/1853700889 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fb49c06cc50 0x7fb49c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:26.062 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:26.057+0000 7fb4b2ffd640 1 --2- 172.21.15.115:0/1853700889 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fb49c06cc50 0x7fb49c06f110 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb4a80058c0 tx=0x7fb4a8005850 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:26.063 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:26.061+0000 7fb4b0ff9640 1 -- 172.21.15.115:0/1853700889 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fb4a4077750 con 0x7fb4b40ffb40 2024-09-13T17:15:26.288 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:26.286+0000 7fb4ba188640 1 -- 172.21.15.115:0/1853700889 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fb4b4108040 con 0x7fb4b40ffb40 2024-09-13T17:15:26.288 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:26.286+0000 7fb4b0ff9640 1 -- 172.21.15.115:0/1853700889 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fb4a407ad70 con 0x7fb4b40ffb40 2024-09-13T17:15:26.289 INFO:teuthology.orchestra.run.smithi115.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-13T17:15:26.289 INFO:teuthology.orchestra.run.smithi115.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T17:15:26.289 INFO:teuthology.orchestra.run.smithi115.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T17:15:26.290 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:26.288+0000 7fb4ba188640 1 -- 172.21.15.115:0/1853700889 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fb49c06cc50 msgr2=0x7fb49c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:26.291 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:26.288+0000 7fb4ba188640 1 --2- 172.21.15.115:0/1853700889 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fb49c06cc50 0x7fb49c06f110 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb4a80058c0 tx=0x7fb4a8005850 comp rx=0 tx=0).stop 2024-09-13T17:15:26.291 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:26.288+0000 7fb4ba188640 1 -- 172.21.15.115:0/1853700889 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb4b40ffb40 msgr2=0x7fb4b419b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:26.291 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:26.288+0000 7fb4ba188640 1 --2- 172.21.15.115:0/1853700889 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb4b40ffb40 0x7fb4b419b6c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb4a402a9c0 tx=0x7fb4a40055a0 comp rx=0 tx=0).stop 2024-09-13T17:15:26.291 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:26.288+0000 7fb4ba188640 1 -- 172.21.15.115:0/1853700889 shutdown_connections 2024-09-13T17:15:26.291 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:26.288+0000 7fb4ba188640 1 --2- 172.21.15.115:0/1853700889 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fb49c06cc50 0x7fb49c06f110 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:26.291 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:26.288+0000 7fb4ba188640 1 --2- 172.21.15.115:0/1853700889 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb4b4105bf0 0x7fb4b419bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:26.291 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:26.288+0000 7fb4ba188640 1 --2- 172.21.15.115:0/1853700889 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb4b40ffb40 0x7fb4b419b6c0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:26.291 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:26.288+0000 7fb4ba188640 1 -- 172.21.15.115:0/1853700889 >> 172.21.15.115:0/1853700889 conn(0x7fb4b40fb840 msgr2=0x7fb4b40fd8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:26.291 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:26.288+0000 7fb4ba188640 1 -- 172.21.15.115:0/1853700889 shutdown_connections 2024-09-13T17:15:26.291 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:26.288+0000 7fb4ba188640 1 -- 172.21.15.115:0/1853700889 wait complete. 2024-09-13T17:15:26.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:15:26 smithi195 ceph-mon[80021]: pgmap v302: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:15:26.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:15:26 smithi195 ceph-mon[80021]: from='client.? 172.21.15.115:0/1853700889' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T17:15:26.895 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:15:26 smithi115 ceph-mon[109488]: pgmap v302: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:15:26.895 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:15:26 smithi115 ceph-mon[109488]: from='client.? 172.21.15.115:0/1853700889' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T17:15:26.916 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -e sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 -- bash -c 'ceph versions' 2024-09-13T17:15:27.112 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T17:15:28.739 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:28.716+0000 7fddbfd93640 1 -- 172.21.15.115:0/1714052139 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fddb80fe9a0 msgr2=0x7fddb80fee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:28.739 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:28.716+0000 7fddbfd93640 1 --2- 172.21.15.115:0/1714052139 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fddb80fe9a0 0x7fddb80fee00 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fdda8009880 tx=0x7fdda802a4a0 comp rx=0 tx=0).stop 2024-09-13T17:15:28.739 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:28.716+0000 7fddbfd93640 1 -- 172.21.15.115:0/1714052139 shutdown_connections 2024-09-13T17:15:28.739 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:28.716+0000 7fddbfd93640 1 --2- 172.21.15.115:0/1714052139 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fddb80fe9a0 0x7fddb80fee00 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:28.739 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:28.716+0000 7fddbfd93640 1 --2- 172.21.15.115:0/1714052139 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fddb81049a0 0x7fddb8104d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:28.739 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:28.716+0000 7fddbfd93640 1 -- 172.21.15.115:0/1714052139 >> 172.21.15.115:0/1714052139 conn(0x7fddb80758c0 msgr2=0x7fddb80fcc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:28.739 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:28.716+0000 7fddbfd93640 1 -- 172.21.15.115:0/1714052139 shutdown_connections 2024-09-13T17:15:28.739 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:28.716+0000 7fddbfd93640 1 -- 172.21.15.115:0/1714052139 wait complete. 2024-09-13T17:15:28.740 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:28.717+0000 7fddbfd93640 1 Processor -- start 2024-09-13T17:15:28.740 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:28.717+0000 7fddbfd93640 1 -- start start 2024-09-13T17:15:28.740 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:28.717+0000 7fddbfd93640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fddb80fe9a0 0x7fddb819b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:28.740 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:28.717+0000 7fddbfd93640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fddb81049a0 0x7fddb819be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:28.740 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:28.717+0000 7fddbfd93640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb8195990 con 0x7fddb80fe9a0 2024-09-13T17:15:28.740 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:28.717+0000 7fddbfd93640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb8195ad0 con 0x7fddb81049a0 2024-09-13T17:15:28.740 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:28.717+0000 7fddbdb2f640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fddb80fe9a0 0x7fddb819b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:28.740 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:28.717+0000 7fddbdb2f640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fddb80fe9a0 0x7fddb819b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:36818/0 (socket says 172.21.15.115:36818) 2024-09-13T17:15:28.740 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:28.717+0000 7fddbdb2f640 1 -- 172.21.15.115:0/412591005 learned_addr learned my addr 172.21.15.115:0/412591005 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:15:28.740 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:28.717+0000 7fddbd32e640 1 --2- 172.21.15.115:0/412591005 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fddb81049a0 0x7fddb819be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:28.740 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:28.717+0000 7fddbdb2f640 1 -- 172.21.15.115:0/412591005 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fddb81049a0 msgr2=0x7fddb819be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:28.740 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:28.717+0000 7fddbdb2f640 1 --2- 172.21.15.115:0/412591005 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fddb81049a0 0x7fddb819be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:28.741 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:28.717+0000 7fddbdb2f640 1 -- 172.21.15.115:0/412591005 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdda8009560 con 0x7fddb80fe9a0 2024-09-13T17:15:28.741 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:28.717+0000 7fddbdb2f640 1 --2- 172.21.15.115:0/412591005 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fddb80fe9a0 0x7fddb819b930 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fddb400b420 tx=0x7fddb400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:28.741 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:28.718+0000 7fddaeffd640 1 -- 172.21.15.115:0/412591005 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fddb4011800 con 0x7fddb80fe9a0 2024-09-13T17:15:28.741 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:28.718+0000 7fddbfd93640 1 -- 172.21.15.115:0/412591005 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddb8195db0 con 0x7fddb80fe9a0 2024-09-13T17:15:28.741 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:28.718+0000 7fddaeffd640 1 -- 172.21.15.115:0/412591005 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fddb4011e00 con 0x7fddb80fe9a0 2024-09-13T17:15:28.741 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:28.718+0000 7fddaeffd640 1 -- 172.21.15.115:0/412591005 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fddb400f2e0 con 0x7fddb80fe9a0 2024-09-13T17:15:28.741 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:28.718+0000 7fddbfd93640 1 -- 172.21.15.115:0/412591005 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddb8196300 con 0x7fddb80fe9a0 2024-09-13T17:15:28.741 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:28.719+0000 7fddbfd93640 1 -- 172.21.15.115:0/412591005 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddb81000e0 con 0x7fddb80fe9a0 2024-09-13T17:15:28.741 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:28.719+0000 7fddaeffd640 1 -- 172.21.15.115:0/412591005 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fddb4010380 con 0x7fddb80fe9a0 2024-09-13T17:15:28.741 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:28.720+0000 7fddaeffd640 1 --2- 172.21.15.115:0/412591005 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fdda406cc50 0x7fdda406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:28.741 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:28.720+0000 7fddbd32e640 1 --2- 172.21.15.115:0/412591005 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fdda406cc50 0x7fdda406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:28.741 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:28.720+0000 7fddaeffd640 1 -- 172.21.15.115:0/412591005 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fddb408bf60 con 0x7fddb80fe9a0 2024-09-13T17:15:28.741 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:28.720+0000 7fddbd32e640 1 --2- 172.21.15.115:0/412591005 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fdda406cc50 0x7fdda406f110 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fdda8000c00 tx=0x7fdda8004200 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:28.742 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:28.724+0000 7fddaeffd640 1 -- 172.21.15.115:0/412591005 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fddb40bfe20 con 0x7fddb80fe9a0 2024-09-13T17:15:28.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:15:28 smithi195 ceph-mon[80021]: pgmap v303: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T17:15:28.928 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:15:28 smithi115 ceph-mon[109488]: pgmap v303: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T17:15:28.952 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:28.950+0000 7fddbfd93640 1 -- 172.21.15.115:0/412591005 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fddb810bb50 con 0x7fddb80fe9a0 2024-09-13T17:15:28.953 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:28.950+0000 7fddaeffd640 1 -- 172.21.15.115:0/412591005 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7fddb4055fd0 con 0x7fddb80fe9a0 2024-09-13T17:15:28.953 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-13T17:15:28.953 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": { 2024-09-13T17:15:28.953 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 2 2024-09-13T17:15:28.953 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T17:15:28.953 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": { 2024-09-13T17:15:28.953 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 2 2024-09-13T17:15:28.953 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T17:15:28.953 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": { 2024-09-13T17:15:28.954 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 6 2024-09-13T17:15:28.954 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T17:15:28.954 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": { 2024-09-13T17:15:28.954 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 4 2024-09-13T17:15:28.954 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T17:15:28.954 INFO:teuthology.orchestra.run.smithi115.stdout: "overall": { 2024-09-13T17:15:28.954 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 14 2024-09-13T17:15:28.954 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-13T17:15:28.954 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-13T17:15:28.955 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:28.952+0000 7fddbfd93640 1 -- 172.21.15.115:0/412591005 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fdda406cc50 msgr2=0x7fdda406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:28.955 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:28.952+0000 7fddbfd93640 1 --2- 172.21.15.115:0/412591005 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fdda406cc50 0x7fdda406f110 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fdda8000c00 tx=0x7fdda8004200 comp rx=0 tx=0).stop 2024-09-13T17:15:28.955 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:28.952+0000 7fddbfd93640 1 -- 172.21.15.115:0/412591005 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fddb80fe9a0 msgr2=0x7fddb819b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:28.955 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:28.952+0000 7fddbfd93640 1 --2- 172.21.15.115:0/412591005 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fddb80fe9a0 0x7fddb819b930 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fddb400b420 tx=0x7fddb400b8e0 comp rx=0 tx=0).stop 2024-09-13T17:15:28.955 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:28.952+0000 7fddbfd93640 1 -- 172.21.15.115:0/412591005 shutdown_connections 2024-09-13T17:15:28.955 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:28.952+0000 7fddbfd93640 1 --2- 172.21.15.115:0/412591005 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fdda406cc50 0x7fdda406f110 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:28.955 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:28.952+0000 7fddbfd93640 1 --2- 172.21.15.115:0/412591005 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fddb81049a0 0x7fddb819be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:28.955 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:28.952+0000 7fddbfd93640 1 --2- 172.21.15.115:0/412591005 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fddb80fe9a0 0x7fddb819b930 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:28.955 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:28.952+0000 7fddbfd93640 1 -- 172.21.15.115:0/412591005 >> 172.21.15.115:0/412591005 conn(0x7fddb80758c0 msgr2=0x7fddb80fd930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:28.956 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:28.952+0000 7fddbfd93640 1 -- 172.21.15.115:0/412591005 shutdown_connections 2024-09-13T17:15:28.956 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:15:28.953+0000 7fddbfd93640 1 -- 172.21.15.115:0/412591005 wait complete. 2024-09-13T17:15:29.621 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -e sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-09-13T17:15:29.821 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T17:15:29.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:15:29 smithi195 ceph-mon[80021]: from='client.? 172.21.15.115:0/412591005' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:15:29.928 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:15:29 smithi115 ceph-mon[109488]: from='client.? 172.21.15.115:0/412591005' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:15:30.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:15:30 smithi115 ceph-mon[109488]: pgmap v304: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:15:31.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:15:30 smithi195 ceph-mon[80021]: pgmap v304: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:15:31.545 INFO:teuthology.orchestra.run.smithi115.stdout:wait for servicemap items w/ changing names to refresh 2024-09-13T17:15:32.361 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -e sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 -- bash -c 'sleep 60' 2024-09-13T17:15:32.565 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T17:15:32.678 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:15:32 smithi115 ceph-mon[109488]: pgmap v305: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:15:33.076 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:15:32 smithi195 ceph-mon[80021]: pgmap v305: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:15:34.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:15:34 smithi115 ceph-mon[109488]: pgmap v306: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T17:15:35.076 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:15:34 smithi195 ceph-mon[80021]: pgmap v306: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T17:15:36.928 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:15:36 smithi115 ceph-mon[109488]: pgmap v307: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:15:36.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:15:36 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:15:37.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:15:36 smithi195 ceph-mon[80021]: pgmap v307: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:15:37.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:15:36 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:15:38.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:15:38 smithi115 ceph-mon[109488]: pgmap v308: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T17:15:39.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:15:38 smithi195 ceph-mon[80021]: pgmap v308: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T17:15:40.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:15:40 smithi115 ceph-mon[109488]: pgmap v309: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:15:41.076 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:15:40 smithi195 ceph-mon[80021]: pgmap v309: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:15:42.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:15:42 smithi115 ceph-mon[109488]: pgmap v310: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:15:43.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:15:42 smithi195 ceph-mon[80021]: pgmap v310: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:15:44.928 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:15:44 smithi115 ceph-mon[109488]: pgmap v311: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T17:15:45.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:15:44 smithi195 ceph-mon[80021]: pgmap v311: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T17:15:46.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:15:46 smithi115 ceph-mon[109488]: pgmap v312: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:15:47.076 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:15:46 smithi195 ceph-mon[80021]: pgmap v312: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:15:47.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:15:47 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:15:47.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:15:47 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:15:47.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:15:47 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:15:47.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:15:47 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:15:48.076 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:15:47 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:15:48.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:15:47 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:15:48.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:15:47 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:15:48.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:15:47 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:15:48.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:15:48 smithi115 ceph-mon[109488]: pgmap v313: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T17:15:49.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:15:48 smithi195 ceph-mon[80021]: pgmap v313: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T17:15:50.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:15:50 smithi115 ceph-mon[109488]: pgmap v314: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:15:50.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:15:50 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:15:51.076 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:15:50 smithi195 ceph-mon[80021]: pgmap v314: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:15:51.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:15:50 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:15:52.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:15:52 smithi115 ceph-mon[109488]: pgmap v315: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:15:53.076 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:15:52 smithi195 ceph-mon[80021]: pgmap v315: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:15:54.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:15:54 smithi115 ceph-mon[109488]: pgmap v316: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T17:15:55.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:15:54 smithi195 ceph-mon[80021]: pgmap v316: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T17:15:56.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:15:56 smithi115 ceph-mon[109488]: pgmap v317: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:15:57.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:15:56 smithi195 ceph-mon[80021]: pgmap v317: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:15:58.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:15:58 smithi115 ceph-mon[109488]: pgmap v318: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T17:15:59.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:15:58 smithi195 ceph-mon[80021]: pgmap v318: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T17:16:00.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:16:00 smithi195 ceph-mon[80021]: pgmap v319: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:16:00.928 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:16:00 smithi115 ceph-mon[109488]: pgmap v319: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:16:02.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:16:02 smithi115 ceph-mon[109488]: pgmap v320: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:16:03.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:16:02 smithi195 ceph-mon[80021]: pgmap v320: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:16:04.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:16:04 smithi115 ceph-mon[109488]: pgmap v321: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:16:05.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:16:04 smithi195 ceph-mon[80021]: pgmap v321: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:16:05.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:16:05 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:16:05.928 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:16:05 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:16:06.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:16:06 smithi115 ceph-mon[109488]: pgmap v322: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T17:16:07.076 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:16:06 smithi195 ceph-mon[80021]: pgmap v322: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T17:16:08.890 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:16:08 smithi195 ceph-mon[80021]: pgmap v323: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:16:08.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:16:08 smithi115 ceph-mon[109488]: pgmap v323: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:16:10.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:16:10 smithi195 ceph-mon[80021]: pgmap v324: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:16:10.928 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:16:10 smithi115 ceph-mon[109488]: pgmap v324: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:16:12.928 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:16:12 smithi115 ceph-mon[109488]: pgmap v325: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T17:16:13.076 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:16:12 smithi195 ceph-mon[80021]: pgmap v325: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T17:16:14.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:16:14 smithi115 ceph-mon[109488]: pgmap v326: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:16:15.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:16:14 smithi195 ceph-mon[80021]: pgmap v326: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:16:16.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:16:16 smithi115 ceph-mon[109488]: pgmap v327: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:16:17.076 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:16:16 smithi195 ceph-mon[80021]: pgmap v327: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:16:18.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:16:18 smithi115 ceph-mon[109488]: pgmap v328: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T17:16:19.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:16:18 smithi195 ceph-mon[80021]: pgmap v328: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T17:16:20.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:16:20 smithi115 ceph-mon[109488]: pgmap v329: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:16:20.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:16:20 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:16:21.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:16:20 smithi195 ceph-mon[80021]: pgmap v329: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:16:21.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:16:20 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:16:22.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:16:22 smithi115 ceph-mon[109488]: pgmap v330: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:16:23.076 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:16:22 smithi195 ceph-mon[80021]: pgmap v330: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:16:24.933 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:16:24 smithi115 ceph-mon[109488]: pgmap v331: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T17:16:25.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:16:24 smithi195 ceph-mon[80021]: pgmap v331: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T17:16:26.928 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:16:26 smithi115 ceph-mon[109488]: pgmap v332: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:16:27.076 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:16:26 smithi195 ceph-mon[80021]: pgmap v332: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:16:28.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:16:28 smithi115 ceph-mon[109488]: pgmap v333: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T17:16:29.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:16:28 smithi195 ceph-mon[80021]: pgmap v333: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T17:16:30.928 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:16:30 smithi115 ceph-mon[109488]: pgmap v334: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:16:31.076 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:16:30 smithi195 ceph-mon[80021]: pgmap v334: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:16:32.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:16:32 smithi115 ceph-mon[109488]: pgmap v335: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:16:33.077 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:16:32 smithi195 ceph-mon[80021]: pgmap v335: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:16:34.883 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -e sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 -- bash -c 'ceph orch ps' 2024-09-13T17:16:35.089 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T17:16:35.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:16:34 smithi115 ceph-mon[109488]: pgmap v336: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T17:16:35.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:16:34 smithi195 ceph-mon[80021]: pgmap v336: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T17:16:36.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:16:35 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:16:36.326 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:16:35 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:16:36.750 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:36.729+0000 7f4502e9c640 1 -- 172.21.15.115:0/917487341 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f44fc0fea20 msgr2=0x7f44fc0fee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:36.750 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:36.729+0000 7f4502e9c640 1 --2- 172.21.15.115:0/917487341 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f44fc0fea20 0x7f44fc0fee80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f44ec009880 tx=0x7f44ec02a4a0 comp rx=0 tx=0).stop 2024-09-13T17:16:36.750 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:36.729+0000 7f4502e9c640 1 -- 172.21.15.115:0/917487341 shutdown_connections 2024-09-13T17:16:36.750 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:36.729+0000 7f4502e9c640 1 --2- 172.21.15.115:0/917487341 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f44fc0fea20 0x7f44fc0fee80 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:36.750 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:36.729+0000 7f4502e9c640 1 --2- 172.21.15.115:0/917487341 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f44fc104a20 0x7f44fc104e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:36.750 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:36.729+0000 7f4502e9c640 1 -- 172.21.15.115:0/917487341 >> 172.21.15.115:0/917487341 conn(0x7f44fc0fa720 msgr2=0x7f44fc0fcb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:36.750 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:36.729+0000 7f4502e9c640 1 -- 172.21.15.115:0/917487341 shutdown_connections 2024-09-13T17:16:36.750 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:36.729+0000 7f4502e9c640 1 -- 172.21.15.115:0/917487341 wait complete. 2024-09-13T17:16:36.750 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:36.729+0000 7f4502e9c640 1 Processor -- start 2024-09-13T17:16:36.751 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:36.729+0000 7f4502e9c640 1 -- start start 2024-09-13T17:16:36.751 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:36.729+0000 7f4502e9c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f44fc0fea20 0x7f44fc19a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:36.751 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:36.729+0000 7f4502e9c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f44fc104a20 0x7f44fc19ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:36.751 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:36.729+0000 7f4502e9c640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44fc194730 con 0x7f44fc0fea20 2024-09-13T17:16:36.751 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:36.729+0000 7f4502e9c640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44fc1948a0 con 0x7f44fc104a20 2024-09-13T17:16:36.751 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:36.730+0000 7f4500c38640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f44fc0fea20 0x7f44fc19a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:36.751 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:36.730+0000 7f4500c38640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f44fc0fea20 0x7f44fc19a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:34600/0 (socket says 172.21.15.115:34600) 2024-09-13T17:16:36.751 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:36.730+0000 7f4500c38640 1 -- 172.21.15.115:0/2995650957 learned_addr learned my addr 172.21.15.115:0/2995650957 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:16:36.751 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:36.730+0000 7f44f3fff640 1 --2- 172.21.15.115:0/2995650957 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f44fc104a20 0x7f44fc19ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:36.752 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:36.730+0000 7f4500c38640 1 -- 172.21.15.115:0/2995650957 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f44fc104a20 msgr2=0x7f44fc19ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:36.752 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:36.730+0000 7f4500c38640 1 --2- 172.21.15.115:0/2995650957 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f44fc104a20 0x7f44fc19ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:36.752 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:36.730+0000 7f4500c38640 1 -- 172.21.15.115:0/2995650957 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44ec009560 con 0x7f44fc0fea20 2024-09-13T17:16:36.752 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:36.730+0000 7f4500c38640 1 --2- 172.21.15.115:0/2995650957 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f44fc0fea20 0x7f44fc19a640 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f44f800e970 tx=0x7f44f800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:36.752 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:36.730+0000 7f44f1ffb640 1 -- 172.21.15.115:0/2995650957 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f44f800cc90 con 0x7f44fc0fea20 2024-09-13T17:16:36.752 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:36.730+0000 7f4502e9c640 1 -- 172.21.15.115:0/2995650957 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44fc194b80 con 0x7f44fc0fea20 2024-09-13T17:16:36.752 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:36.730+0000 7f44f1ffb640 1 -- 172.21.15.115:0/2995650957 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f44f800cdf0 con 0x7f44fc0fea20 2024-09-13T17:16:36.752 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:36.730+0000 7f44f1ffb640 1 -- 172.21.15.115:0/2995650957 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f44f8010430 con 0x7f44fc0fea20 2024-09-13T17:16:36.752 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:36.730+0000 7f4502e9c640 1 -- 172.21.15.115:0/2995650957 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44fc1950a0 con 0x7f44fc0fea20 2024-09-13T17:16:36.752 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:36.731+0000 7f4502e9c640 1 -- 172.21.15.115:0/2995650957 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44fc100160 con 0x7f44fc0fea20 2024-09-13T17:16:36.752 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:36.732+0000 7f44f1ffb640 1 -- 172.21.15.115:0/2995650957 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f44f80046c0 con 0x7f44fc0fea20 2024-09-13T17:16:36.752 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:36.732+0000 7f44f1ffb640 1 --2- 172.21.15.115:0/2995650957 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f44e406cc50 0x7f44e406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:36.753 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:36.732+0000 7f44f1ffb640 1 -- 172.21.15.115:0/2995650957 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f44f8014070 con 0x7f44fc0fea20 2024-09-13T17:16:36.753 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:36.732+0000 7f44f3fff640 1 --2- 172.21.15.115:0/2995650957 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f44e406cc50 0x7f44e406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:36.753 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:36.733+0000 7f44f3fff640 1 --2- 172.21.15.115:0/2995650957 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f44e406cc50 0x7f44e406f110 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f44fc0fcec0 tx=0x7f44ec005a20 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:36.753 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:36.736+0000 7f44f1ffb640 1 -- 172.21.15.115:0/2995650957 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f44f8056b60 con 0x7f44fc0fea20 2024-09-13T17:16:36.905 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:36.904+0000 7f4502e9c640 1 -- 172.21.15.115:0/2995650957 --> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f44fc195c40 con 0x7f44e406cc50 2024-09-13T17:16:36.915 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:36.914+0000 7f44f1ffb640 1 -- 172.21.15.115:0/2995650957 <== mgr.14660 v2:172.21.15.115:6800/1049502673 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7f44fc195c40 con 0x7f44e406cc50 2024-09-13T17:16:36.915 INFO:teuthology.orchestra.run.smithi115.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T17:16:36.915 INFO:teuthology.orchestra.run.smithi115.stdout:alertmanager.smithi115 smithi115 *:9093,9094 running (8m) 114s ago 18m 24.7M - 0.25.0 c8568f914cd2 d56b91240fe1 2024-09-13T17:16:36.915 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-exporter.smithi115 smithi115 running (2m) 114s ago 18m 7470k - 18.2.4-860-g6c6b083f 8a91f241d7d4 61191fa97aa7 2024-09-13T17:16:36.915 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-exporter.smithi195 smithi195 running (2m) 2m ago 17m 6786k - 18.2.4-860-g6c6b083f 8a91f241d7d4 f2ef90ec9def 2024-09-13T17:16:36.915 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi115 smithi115 running (6m) 114s ago 18m 6895k - 18.2.4-860-g6c6b083f 8a91f241d7d4 e8175bc055bf 2024-09-13T17:16:36.916 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi195 smithi195 running (6m) 2m ago 17m 6903k - 18.2.4-860-g6c6b083f 8a91f241d7d4 ccb4895be776 2024-09-13T17:16:36.916 INFO:teuthology.orchestra.run.smithi115.stdout:grafana.smithi115 smithi115 *:3000 running (8m) 114s ago 18m 86.7M - 9.4.7 954c08fa6188 e1eccb1a8f3e 2024-09-13T17:16:36.916 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi115.hbtxod smithi115 running (3m) 114s ago 13m 88.9M - 18.2.4-860-g6c6b083f 8a91f241d7d4 9221253d5ed4 2024-09-13T17:16:36.916 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi115.ijznvr smithi115 running (2m) 114s ago 13m 84.8M - 18.2.4-860-g6c6b083f 8a91f241d7d4 aab0c23ec15b 2024-09-13T17:16:36.916 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi195.aevvgz smithi195 running (2m) 2m ago 13m 15.3M - 18.2.4-860-g6c6b083f 8a91f241d7d4 1f6eafd16096 2024-09-13T17:16:36.916 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi195.qzghxj smithi195 running (2m) 2m ago 13m 15.4M - 18.2.4-860-g6c6b083f 8a91f241d7d4 653d67d222ce 2024-09-13T17:16:36.916 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi115.hetcni smithi115 *:8443,9283,8765 running (10m) 114s ago 19m 499M - 18.2.4-860-g6c6b083f 8a91f241d7d4 b945dbde1934 2024-09-13T17:16:36.916 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi195.hjjifz smithi195 *:8443,9283,8765 running (9m) 2m ago 17m 442M - 18.2.4-860-g6c6b083f 8a91f241d7d4 17bccdfbcae1 2024-09-13T17:16:36.916 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi115 smithi115 running (7m) 114s ago 20m 49.5M 2048M 18.2.4-860-g6c6b083f 8a91f241d7d4 8dd7baf2c6b6 2024-09-13T17:16:36.916 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi195 smithi195 running (6m) 2m ago 17m 39.9M 2048M 18.2.4-860-g6c6b083f 8a91f241d7d4 0459bc5e6b08 2024-09-13T17:16:36.916 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi115 smithi115 *:9100 running (9m) 114s ago 18m 17.3M - 1.5.0 0da6a335fe13 26fb6f9844b5 2024-09-13T17:16:36.916 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi195 smithi195 *:9100 running (9m) 2m ago 17m 16.6M - 1.5.0 0da6a335fe13 6d38e798fb16 2024-09-13T17:16:36.916 INFO:teuthology.orchestra.run.smithi115.stdout:osd.0 smithi115 running (6m) 114s ago 16m 110M 1216M 18.2.4-860-g6c6b083f 8a91f241d7d4 3b9f874c64e9 2024-09-13T17:16:36.917 INFO:teuthology.orchestra.run.smithi115.stdout:osd.1 smithi115 running (5m) 114s ago 16m 119M 1216M 18.2.4-860-g6c6b083f 8a91f241d7d4 f0de6684601c 2024-09-13T17:16:36.917 INFO:teuthology.orchestra.run.smithi115.stdout:osd.2 smithi115 running (5m) 114s ago 15m 102M 1216M 18.2.4-860-g6c6b083f 8a91f241d7d4 edb753bab54a 2024-09-13T17:16:36.917 INFO:teuthology.orchestra.run.smithi115.stdout:osd.3 smithi195 running (4m) 2m ago 15m 125M 2240M 18.2.4-860-g6c6b083f 8a91f241d7d4 ccd1b2bf7d86 2024-09-13T17:16:36.917 INFO:teuthology.orchestra.run.smithi115.stdout:osd.4 smithi195 running (4m) 2m ago 15m 106M 2240M 18.2.4-860-g6c6b083f 8a91f241d7d4 c88b3dacb207 2024-09-13T17:16:36.917 INFO:teuthology.orchestra.run.smithi115.stdout:osd.5 smithi195 running (3m) 2m ago 14m 99.1M 2240M 18.2.4-860-g6c6b083f 8a91f241d7d4 40ccbc2f5195 2024-09-13T17:16:36.917 INFO:teuthology.orchestra.run.smithi115.stdout:prometheus.smithi115 smithi115 *:9095 running (8m) 114s ago 18m 64.6M - 2.43.0 a07b618ecd1d e03fb39f6b76 2024-09-13T17:16:36.918 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:36.917+0000 7f4502e9c640 1 -- 172.21.15.115:0/2995650957 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f44e406cc50 msgr2=0x7f44e406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:36.918 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:36.917+0000 7f4502e9c640 1 --2- 172.21.15.115:0/2995650957 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f44e406cc50 0x7f44e406f110 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f44fc0fcec0 tx=0x7f44ec005a20 comp rx=0 tx=0).stop 2024-09-13T17:16:36.918 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:36.917+0000 7f4502e9c640 1 -- 172.21.15.115:0/2995650957 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f44fc0fea20 msgr2=0x7f44fc19a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:36.918 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:36.917+0000 7f4502e9c640 1 --2- 172.21.15.115:0/2995650957 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f44fc0fea20 0x7f44fc19a640 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f44f800e970 tx=0x7f44f800ed70 comp rx=0 tx=0).stop 2024-09-13T17:16:36.918 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:36.917+0000 7f4502e9c640 1 -- 172.21.15.115:0/2995650957 shutdown_connections 2024-09-13T17:16:36.918 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:36.917+0000 7f4502e9c640 1 --2- 172.21.15.115:0/2995650957 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f44e406cc50 0x7f44e406f110 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:36.918 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:36.917+0000 7f4502e9c640 1 --2- 172.21.15.115:0/2995650957 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f44fc104a20 0x7f44fc19ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:36.919 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:36.917+0000 7f4502e9c640 1 --2- 172.21.15.115:0/2995650957 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f44fc0fea20 0x7f44fc19a640 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:36.919 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:36.917+0000 7f4502e9c640 1 -- 172.21.15.115:0/2995650957 >> 172.21.15.115:0/2995650957 conn(0x7f44fc0fa720 msgr2=0x7f44fc0fb530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:36.919 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:36.917+0000 7f4502e9c640 1 -- 172.21.15.115:0/2995650957 shutdown_connections 2024-09-13T17:16:36.919 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:36.917+0000 7f4502e9c640 1 -- 172.21.15.115:0/2995650957 wait complete. 2024-09-13T17:16:37.178 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:16:36 smithi115 ceph-mon[109488]: pgmap v337: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:16:37.326 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:16:36 smithi195 ceph-mon[80021]: pgmap v337: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:16:37.583 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -e sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 -- bash -c 'ceph versions' 2024-09-13T17:16:37.789 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T17:16:38.131 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:16:37 smithi115 ceph-mon[109488]: from='client.34440 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:16:38.228 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:16:37 smithi195 ceph-mon[80021]: from='client.34440 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:16:39.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:16:38 smithi115 ceph-mon[109488]: pgmap v338: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T17:16:39.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:16:38 smithi195 ceph-mon[80021]: pgmap v338: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T17:16:39.471 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:39.458+0000 7f3f23934640 1 -- 172.21.15.115:0/4219419482 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3f1c0fead0 msgr2=0x7f3f1c0feeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:39.472 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:39.458+0000 7f3f23934640 1 --2- 172.21.15.115:0/4219419482 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3f1c0fead0 0x7f3f1c0feeb0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3f18009880 tx=0x7f3f1802a530 comp rx=0 tx=0).stop 2024-09-13T17:16:39.472 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:39.458+0000 7f3f23934640 1 -- 172.21.15.115:0/4219419482 shutdown_connections 2024-09-13T17:16:39.472 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:39.458+0000 7f3f23934640 1 --2- 172.21.15.115:0/4219419482 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f1c0ff3f0 0x7f3f1c1038c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:39.472 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:39.458+0000 7f3f23934640 1 --2- 172.21.15.115:0/4219419482 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3f1c0fead0 0x7f3f1c0feeb0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:39.472 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:39.458+0000 7f3f23934640 1 -- 172.21.15.115:0/4219419482 >> 172.21.15.115:0/4219419482 conn(0x7f3f1c0fa720 msgr2=0x7f3f1c0fcb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:39.472 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:39.459+0000 7f3f23934640 1 -- 172.21.15.115:0/4219419482 shutdown_connections 2024-09-13T17:16:39.472 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:39.459+0000 7f3f23934640 1 -- 172.21.15.115:0/4219419482 wait complete. 2024-09-13T17:16:39.472 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:39.459+0000 7f3f23934640 1 Processor -- start 2024-09-13T17:16:39.472 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:39.459+0000 7f3f23934640 1 -- start start 2024-09-13T17:16:39.472 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:39.459+0000 7f3f23934640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3f1c0fead0 0x7f3f1c19c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:39.473 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:39.459+0000 7f3f23934640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f1c0ff3f0 0x7f3f1c19c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:39.473 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:39.459+0000 7f3f23934640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1c19ccd0 con 0x7f3f1c0fead0 2024-09-13T17:16:39.473 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:39.459+0000 7f3f23934640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1c1a0a40 con 0x7f3f1c0ff3f0 2024-09-13T17:16:39.473 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:39.459+0000 7f3f216d0640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3f1c0fead0 0x7f3f1c19c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:39.473 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:39.459+0000 7f3f216d0640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3f1c0fead0 0x7f3f1c19c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:34614/0 (socket says 172.21.15.115:34614) 2024-09-13T17:16:39.473 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:39.459+0000 7f3f216d0640 1 -- 172.21.15.115:0/3534947439 learned_addr learned my addr 172.21.15.115:0/3534947439 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:16:39.473 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:39.460+0000 7f3f20ecf640 1 --2- 172.21.15.115:0/3534947439 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f1c0ff3f0 0x7f3f1c19c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:39.473 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:39.460+0000 7f3f216d0640 1 -- 172.21.15.115:0/3534947439 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f1c0ff3f0 msgr2=0x7f3f1c19c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:39.473 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:39.460+0000 7f3f216d0640 1 --2- 172.21.15.115:0/3534947439 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f1c0ff3f0 0x7f3f1c19c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:39.473 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:39.460+0000 7f3f216d0640 1 -- 172.21.15.115:0/3534947439 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f18009560 con 0x7f3f1c0fead0 2024-09-13T17:16:39.473 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:39.460+0000 7f3f20ecf640 1 --2- 172.21.15.115:0/3534947439 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f1c0ff3f0 0x7f3f1c19c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:16:39.473 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:39.460+0000 7f3f216d0640 1 --2- 172.21.15.115:0/3534947439 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3f1c0fead0 0x7f3f1c19c100 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3f18006010 tx=0x7f3f180056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:39.473 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:39.460+0000 7f3f127fc640 1 -- 172.21.15.115:0/3534947439 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f18004ba0 con 0x7f3f1c0fead0 2024-09-13T17:16:39.474 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:39.460+0000 7f3f127fc640 1 -- 172.21.15.115:0/3534947439 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3f18004d00 con 0x7f3f1c0fead0 2024-09-13T17:16:39.474 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:39.460+0000 7f3f23934640 1 -- 172.21.15.115:0/3534947439 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f1c1a0cc0 con 0x7f3f1c0fead0 2024-09-13T17:16:39.474 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:39.460+0000 7f3f127fc640 1 -- 172.21.15.115:0/3534947439 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f18031910 con 0x7f3f1c0fead0 2024-09-13T17:16:39.474 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:39.460+0000 7f3f23934640 1 -- 172.21.15.115:0/3534947439 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f1c1a11b0 con 0x7f3f1c0fead0 2024-09-13T17:16:39.474 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:39.461+0000 7f3f23934640 1 -- 172.21.15.115:0/3534947439 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f1c068ce0 con 0x7f3f1c0fead0 2024-09-13T17:16:39.474 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:39.462+0000 7f3f127fc640 1 -- 172.21.15.115:0/3534947439 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f3f1802ad50 con 0x7f3f1c0fead0 2024-09-13T17:16:39.474 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:39.462+0000 7f3f127fc640 1 --2- 172.21.15.115:0/3534947439 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f3f0806cc50 0x7f3f0806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:39.474 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:39.462+0000 7f3f127fc640 1 -- 172.21.15.115:0/3534947439 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f3f180ad4f0 con 0x7f3f1c0fead0 2024-09-13T17:16:39.474 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:39.462+0000 7f3f20ecf640 1 --2- 172.21.15.115:0/3534947439 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f3f0806cc50 0x7f3f0806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:39.474 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:39.463+0000 7f3f20ecf640 1 --2- 172.21.15.115:0/3534947439 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f3f0806cc50 0x7f3f0806f110 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c19d6b0 tx=0x7f3f0c008040 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:39.474 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:39.466+0000 7f3f127fc640 1 -- 172.21.15.115:0/3534947439 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f3f18077560 con 0x7f3f1c0fead0 2024-09-13T17:16:39.695 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:39.693+0000 7f3f23934640 1 -- 172.21.15.115:0/3534947439 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3f1c0fef30 con 0x7f3f1c0fead0 2024-09-13T17:16:39.695 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:39.694+0000 7f3f127fc640 1 -- 172.21.15.115:0/3534947439 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7f3f1807ab80 con 0x7f3f1c0fead0 2024-09-13T17:16:39.695 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-13T17:16:39.695 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": { 2024-09-13T17:16:39.695 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 2 2024-09-13T17:16:39.695 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T17:16:39.696 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": { 2024-09-13T17:16:39.696 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 2 2024-09-13T17:16:39.696 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T17:16:39.696 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": { 2024-09-13T17:16:39.696 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 6 2024-09-13T17:16:39.696 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T17:16:39.696 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": { 2024-09-13T17:16:39.696 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 4 2024-09-13T17:16:39.696 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T17:16:39.696 INFO:teuthology.orchestra.run.smithi115.stdout: "overall": { 2024-09-13T17:16:39.696 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 14 2024-09-13T17:16:39.696 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-13T17:16:39.696 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-13T17:16:39.697 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:39.696+0000 7f3f23934640 1 -- 172.21.15.115:0/3534947439 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f3f0806cc50 msgr2=0x7f3f0806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:39.697 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:39.696+0000 7f3f23934640 1 --2- 172.21.15.115:0/3534947439 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f3f0806cc50 0x7f3f0806f110 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c19d6b0 tx=0x7f3f0c008040 comp rx=0 tx=0).stop 2024-09-13T17:16:39.697 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:39.696+0000 7f3f23934640 1 -- 172.21.15.115:0/3534947439 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3f1c0fead0 msgr2=0x7f3f1c19c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:39.697 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:39.696+0000 7f3f23934640 1 --2- 172.21.15.115:0/3534947439 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3f1c0fead0 0x7f3f1c19c100 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3f18006010 tx=0x7f3f180056e0 comp rx=0 tx=0).stop 2024-09-13T17:16:39.698 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:39.696+0000 7f3f23934640 1 -- 172.21.15.115:0/3534947439 shutdown_connections 2024-09-13T17:16:39.698 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:39.696+0000 7f3f23934640 1 --2- 172.21.15.115:0/3534947439 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f3f0806cc50 0x7f3f0806f110 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:39.698 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:39.696+0000 7f3f23934640 1 --2- 172.21.15.115:0/3534947439 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f1c0ff3f0 0x7f3f1c19c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:39.698 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:39.696+0000 7f3f23934640 1 --2- 172.21.15.115:0/3534947439 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3f1c0fead0 0x7f3f1c19c100 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:39.698 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:39.696+0000 7f3f23934640 1 -- 172.21.15.115:0/3534947439 >> 172.21.15.115:0/3534947439 conn(0x7f3f1c0fa720 msgr2=0x7f3f1c10d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:39.698 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:39.696+0000 7f3f23934640 1 -- 172.21.15.115:0/3534947439 shutdown_connections 2024-09-13T17:16:39.698 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:39.696+0000 7f3f23934640 1 -- 172.21.15.115:0/3534947439 wait complete. 2024-09-13T17:16:40.076 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:16:39 smithi115 ceph-mon[109488]: from='client.? 172.21.15.115:0/3534947439' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:16:40.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:16:39 smithi195 ceph-mon[80021]: from='client.? 172.21.15.115:0/3534947439' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:16:40.340 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -e sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-09-13T17:16:40.538 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T17:16:41.215 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:16:40 smithi115 ceph-mon[109488]: pgmap v339: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:16:41.326 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:16:40 smithi195 ceph-mon[80021]: pgmap v339: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:16:41.952 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:41.946+0000 7f05b1aa1640 1 -- 172.21.15.115:0/3478163364 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f05ac0fea20 msgr2=0x7f05ac0fee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:41.952 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:41.946+0000 7f05b1aa1640 1 --2- 172.21.15.115:0/3478163364 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f05ac0fea20 0x7f05ac0fee80 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f05a0009880 tx=0x7f05a002a4a0 comp rx=0 tx=0).stop 2024-09-13T17:16:41.952 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:41.946+0000 7f05b1aa1640 1 -- 172.21.15.115:0/3478163364 shutdown_connections 2024-09-13T17:16:41.952 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:41.946+0000 7f05b1aa1640 1 --2- 172.21.15.115:0/3478163364 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f05ac0fea20 0x7f05ac0fee80 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:41.952 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:41.946+0000 7f05b1aa1640 1 --2- 172.21.15.115:0/3478163364 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f05ac104a20 0x7f05ac104e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:41.952 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:41.946+0000 7f05b1aa1640 1 -- 172.21.15.115:0/3478163364 >> 172.21.15.115:0/3478163364 conn(0x7f05ac0fa720 msgr2=0x7f05ac0fcb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:41.953 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:41.946+0000 7f05b1aa1640 1 -- 172.21.15.115:0/3478163364 shutdown_connections 2024-09-13T17:16:41.953 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:41.946+0000 7f05b1aa1640 1 -- 172.21.15.115:0/3478163364 wait complete. 2024-09-13T17:16:41.953 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:41.947+0000 7f05b1aa1640 1 Processor -- start 2024-09-13T17:16:41.953 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:41.947+0000 7f05b1aa1640 1 -- start start 2024-09-13T17:16:41.953 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:41.947+0000 7f05b1aa1640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f05ac0fea20 0x7f05ac1005f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:41.953 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:41.947+0000 7f05b1aa1640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f05ac104a20 0x7f05ac100b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:41.953 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:41.947+0000 7f05b1aa1640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05ac101070 con 0x7f05ac104a20 2024-09-13T17:16:41.953 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:41.947+0000 7f05b1aa1640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05ac1011e0 con 0x7f05ac0fea20 2024-09-13T17:16:41.953 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:41.947+0000 7f05aaffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f05ac104a20 0x7f05ac100b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:41.953 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:41.947+0000 7f05aaffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f05ac104a20 0x7f05ac100b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:34626/0 (socket says 172.21.15.115:34626) 2024-09-13T17:16:41.953 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:41.947+0000 7f05aaffd640 1 -- 172.21.15.115:0/3523940515 learned_addr learned my addr 172.21.15.115:0/3523940515 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:16:41.953 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:41.948+0000 7f05aaffd640 1 -- 172.21.15.115:0/3523940515 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f05ac0fea20 msgr2=0x7f05ac1005f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:41.953 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:41.948+0000 7f05aaffd640 1 --2- 172.21.15.115:0/3523940515 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f05ac0fea20 0x7f05ac1005f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:41.953 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:41.948+0000 7f05aaffd640 1 -- 172.21.15.115:0/3523940515 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05a0009560 con 0x7f05ac104a20 2024-09-13T17:16:41.954 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:41.948+0000 7f05aaffd640 1 --2- 172.21.15.115:0/3523940515 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f05ac104a20 0x7f05ac100b30 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f05a0006010 tx=0x7f05a00055f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:41.954 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:41.948+0000 7f05a8ff9640 1 -- 172.21.15.115:0/3523940515 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05a0004b20 con 0x7f05ac104a20 2024-09-13T17:16:41.954 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:41.948+0000 7f05a8ff9640 1 -- 172.21.15.115:0/3523940515 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f05a0004c80 con 0x7f05ac104a20 2024-09-13T17:16:41.954 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:41.948+0000 7f05b1aa1640 1 -- 172.21.15.115:0/3523940515 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05ac101460 con 0x7f05ac104a20 2024-09-13T17:16:41.954 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:41.948+0000 7f05a8ff9640 1 -- 172.21.15.115:0/3523940515 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05a0031960 con 0x7f05ac104a20 2024-09-13T17:16:41.954 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:41.948+0000 7f05b1aa1640 1 -- 172.21.15.115:0/3523940515 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05ac1a1f80 con 0x7f05ac104a20 2024-09-13T17:16:41.954 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:41.949+0000 7f05b1aa1640 1 -- 172.21.15.115:0/3523940515 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05ac100160 con 0x7f05ac104a20 2024-09-13T17:16:41.954 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:41.950+0000 7f05a8ff9640 1 -- 172.21.15.115:0/3523940515 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f05a0031c20 con 0x7f05ac104a20 2024-09-13T17:16:41.954 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:41.950+0000 7f05a8ff9640 1 --2- 172.21.15.115:0/3523940515 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f059406cc60 0x7f059406f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:41.954 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:41.950+0000 7f05a8ff9640 1 -- 172.21.15.115:0/3523940515 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f05a00ad6c0 con 0x7f05ac104a20 2024-09-13T17:16:41.954 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:41.950+0000 7f05ab7fe640 1 --2- 172.21.15.115:0/3523940515 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f059406cc60 0x7f059406f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:41.954 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:41.951+0000 7f05ab7fe640 1 --2- 172.21.15.115:0/3523940515 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f059406cc60 0x7f059406f120 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f059c00ab90 tx=0x7f059c009250 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:41.955 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:41.954+0000 7f05a8ff9640 1 -- 172.21.15.115:0/3523940515 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f05a0077730 con 0x7f05ac104a20 2024-09-13T17:16:42.181 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:42.179+0000 7f05b1aa1640 1 -- 172.21.15.115:0/3523940515 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f05ac0fef00 con 0x7f05ac104a20 2024-09-13T17:16:42.181 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:42.180+0000 7f05a8ff9640 1 -- 172.21.15.115:0/3523940515 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7f05a007ad50 con 0x7f05ac104a20 2024-09-13T17:16:42.183 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:42.182+0000 7f05b1aa1640 1 -- 172.21.15.115:0/3523940515 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f059406cc60 msgr2=0x7f059406f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:42.183 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:42.182+0000 7f05b1aa1640 1 --2- 172.21.15.115:0/3523940515 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f059406cc60 0x7f059406f120 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f059c00ab90 tx=0x7f059c009250 comp rx=0 tx=0).stop 2024-09-13T17:16:42.184 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:42.182+0000 7f05b1aa1640 1 -- 172.21.15.115:0/3523940515 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f05ac104a20 msgr2=0x7f05ac100b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:42.184 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:42.182+0000 7f05b1aa1640 1 --2- 172.21.15.115:0/3523940515 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f05ac104a20 0x7f05ac100b30 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f05a0006010 tx=0x7f05a00055f0 comp rx=0 tx=0).stop 2024-09-13T17:16:42.184 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:42.182+0000 7f05b1aa1640 1 -- 172.21.15.115:0/3523940515 shutdown_connections 2024-09-13T17:16:42.184 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:42.182+0000 7f05b1aa1640 1 --2- 172.21.15.115:0/3523940515 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f059406cc60 0x7f059406f120 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:42.184 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:42.182+0000 7f05b1aa1640 1 --2- 172.21.15.115:0/3523940515 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f05ac104a20 0x7f05ac100b30 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:42.184 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:42.182+0000 7f05b1aa1640 1 --2- 172.21.15.115:0/3523940515 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f05ac0fea20 0x7f05ac1005f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:42.184 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:42.182+0000 7f05b1aa1640 1 -- 172.21.15.115:0/3523940515 >> 172.21.15.115:0/3523940515 conn(0x7f05ac0fa720 msgr2=0x7f05ac068c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:42.184 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:42.182+0000 7f05b1aa1640 1 -- 172.21.15.115:0/3523940515 shutdown_connections 2024-09-13T17:16:42.184 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:42.182+0000 7f05b1aa1640 1 -- 172.21.15.115:0/3523940515 wait complete. 2024-09-13T17:16:42.192 INFO:teuthology.orchestra.run.smithi115.stdout:true 2024-09-13T17:16:42.828 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -e sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-09-13T17:16:43.030 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T17:16:43.148 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:16:42 smithi115 ceph-mon[109488]: pgmap v340: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:16:43.149 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:16:42 smithi115 ceph-mon[109488]: from='client.? 172.21.15.115:0/3523940515' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:16:43.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:16:42 smithi195 ceph-mon[80021]: pgmap v340: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:16:43.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:16:42 smithi195 ceph-mon[80021]: from='client.? 172.21.15.115:0/3523940515' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:16:44.659 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:44.653+0000 7f5e07d9a640 1 -- 172.21.15.115:0/212209365 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e00073200 msgr2=0x7f5e0010be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:44.659 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:44.653+0000 7f5e07d9a640 1 --2- 172.21.15.115:0/212209365 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e00073200 0x7f5e0010be90 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5df4009880 tx=0x7f5df402a530 comp rx=0 tx=0).stop 2024-09-13T17:16:44.660 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:44.653+0000 7f5e07d9a640 1 -- 172.21.15.115:0/212209365 shutdown_connections 2024-09-13T17:16:44.660 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:44.653+0000 7f5e07d9a640 1 --2- 172.21.15.115:0/212209365 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e00073200 0x7f5e0010be90 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:44.660 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:44.653+0000 7f5e07d9a640 1 --2- 172.21.15.115:0/212209365 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5e000728e0 0x7f5e00072cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:44.660 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:44.653+0000 7f5e07d9a640 1 -- 172.21.15.115:0/212209365 >> 172.21.15.115:0/212209365 conn(0x7f5e000fb8d0 msgr2=0x7f5e000fdcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:44.660 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:44.653+0000 7f5e07d9a640 1 -- 172.21.15.115:0/212209365 shutdown_connections 2024-09-13T17:16:44.660 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:44.653+0000 7f5e07d9a640 1 -- 172.21.15.115:0/212209365 wait complete. 2024-09-13T17:16:44.660 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:44.654+0000 7f5e07d9a640 1 Processor -- start 2024-09-13T17:16:44.660 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:44.654+0000 7f5e07d9a640 1 -- start start 2024-09-13T17:16:44.660 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:44.654+0000 7f5e07d9a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e000728e0 0x7f5e0019d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:44.660 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:44.654+0000 7f5e07d9a640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5e00073200 0x7f5e0019df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:44.660 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:44.654+0000 7f5e07d9a640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0019e4a0 con 0x7f5e000728e0 2024-09-13T17:16:44.660 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:44.654+0000 7f5e07d9a640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e00197ac0 con 0x7f5e00073200 2024-09-13T17:16:44.660 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:44.654+0000 7f5e05b36640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e000728e0 0x7f5e0019d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:44.661 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:44.654+0000 7f5e05b36640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e000728e0 0x7f5e0019d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:43990/0 (socket says 172.21.15.115:43990) 2024-09-13T17:16:44.661 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:44.654+0000 7f5e05b36640 1 -- 172.21.15.115:0/1842590559 learned_addr learned my addr 172.21.15.115:0/1842590559 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:16:44.661 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:44.654+0000 7f5e05b36640 1 -- 172.21.15.115:0/1842590559 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5e00073200 msgr2=0x7f5e0019df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:44.661 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:44.654+0000 7f5e05b36640 1 --2- 172.21.15.115:0/1842590559 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5e00073200 0x7f5e0019df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:44.661 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:44.654+0000 7f5e05b36640 1 -- 172.21.15.115:0/1842590559 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df4009560 con 0x7f5e000728e0 2024-09-13T17:16:44.661 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:44.654+0000 7f5e05b36640 1 --2- 172.21.15.115:0/1842590559 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e000728e0 0x7f5e0019d9d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5df000cc60 tx=0x7f5df000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:44.661 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:44.655+0000 7f5dfeffd640 1 -- 172.21.15.115:0/1842590559 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5df000f450 con 0x7f5e000728e0 2024-09-13T17:16:44.661 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:44.655+0000 7f5e07d9a640 1 -- 172.21.15.115:0/1842590559 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e00197da0 con 0x7f5e000728e0 2024-09-13T17:16:44.661 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:44.655+0000 7f5dfeffd640 1 -- 172.21.15.115:0/1842590559 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5df000fa50 con 0x7f5e000728e0 2024-09-13T17:16:44.661 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:44.655+0000 7f5dfeffd640 1 -- 172.21.15.115:0/1842590559 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5df0018b80 con 0x7f5e000728e0 2024-09-13T17:16:44.661 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:44.655+0000 7f5e07d9a640 1 -- 172.21.15.115:0/1842590559 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e001982f0 con 0x7f5e000728e0 2024-09-13T17:16:44.662 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:44.656+0000 7f5e07d9a640 1 -- 172.21.15.115:0/1842590559 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e00073f90 con 0x7f5e000728e0 2024-09-13T17:16:44.662 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:44.656+0000 7f5dfeffd640 1 -- 172.21.15.115:0/1842590559 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f5df0018ce0 con 0x7f5e000728e0 2024-09-13T17:16:44.662 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:44.657+0000 7f5dfeffd640 1 --2- 172.21.15.115:0/1842590559 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f5de806cc50 0x7f5de806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:44.662 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:44.657+0000 7f5dfeffd640 1 -- 172.21.15.115:0/1842590559 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f5df008cb80 con 0x7f5e000728e0 2024-09-13T17:16:44.662 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:44.657+0000 7f5e05335640 1 --2- 172.21.15.115:0/1842590559 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f5de806cc50 0x7f5de806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:44.662 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:44.657+0000 7f5e05335640 1 --2- 172.21.15.115:0/1842590559 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f5de806cc50 0x7f5de806f110 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5e00198f30 tx=0x7f5df4000bc0 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:44.662 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:44.661+0000 7f5dfeffd640 1 -- 172.21.15.115:0/1842590559 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f5df0056bf0 con 0x7f5e000728e0 2024-09-13T17:16:44.892 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:44.889+0000 7f5e07d9a640 1 -- 172.21.15.115:0/1842590559 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5e00072cc0 con 0x7f5e000728e0 2024-09-13T17:16:44.892 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:44.890+0000 7f5dfeffd640 1 -- 172.21.15.115:0/1842590559 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7f5df005a210 con 0x7f5e000728e0 2024-09-13T17:16:44.894 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:44.892+0000 7f5e07d9a640 1 -- 172.21.15.115:0/1842590559 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f5de806cc50 msgr2=0x7f5de806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:44.894 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:44.892+0000 7f5e07d9a640 1 --2- 172.21.15.115:0/1842590559 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f5de806cc50 0x7f5de806f110 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5e00198f30 tx=0x7f5df4000bc0 comp rx=0 tx=0).stop 2024-09-13T17:16:44.894 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:44.892+0000 7f5e07d9a640 1 -- 172.21.15.115:0/1842590559 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e000728e0 msgr2=0x7f5e0019d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:44.894 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:44.892+0000 7f5e07d9a640 1 --2- 172.21.15.115:0/1842590559 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e000728e0 0x7f5e0019d9d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5df000cc60 tx=0x7f5df000a620 comp rx=0 tx=0).stop 2024-09-13T17:16:44.894 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:44.892+0000 7f5e07d9a640 1 -- 172.21.15.115:0/1842590559 shutdown_connections 2024-09-13T17:16:44.894 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:44.892+0000 7f5e07d9a640 1 --2- 172.21.15.115:0/1842590559 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f5de806cc50 0x7f5de806f110 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:44.894 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:44.892+0000 7f5e07d9a640 1 --2- 172.21.15.115:0/1842590559 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5e00073200 0x7f5e0019df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:44.894 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:44.892+0000 7f5e07d9a640 1 --2- 172.21.15.115:0/1842590559 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e000728e0 0x7f5e0019d9d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:44.894 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:44.892+0000 7f5e07d9a640 1 -- 172.21.15.115:0/1842590559 >> 172.21.15.115:0/1842590559 conn(0x7f5e000fb8d0 msgr2=0x7f5e00104370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:44.894 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:44.892+0000 7f5e07d9a640 1 -- 172.21.15.115:0/1842590559 shutdown_connections 2024-09-13T17:16:44.894 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:44.893+0000 7f5e07d9a640 1 -- 172.21.15.115:0/1842590559 wait complete. 2024-09-13T17:16:44.902 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)" 2024-09-13T17:16:45.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:16:44 smithi115 ceph-mon[109488]: pgmap v341: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T17:16:45.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:16:44 smithi115 ceph-mon[109488]: from='client.? 172.21.15.115:0/1842590559' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:16:45.326 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:16:44 smithi195 ceph-mon[80021]: pgmap v341: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T17:16:45.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:16:44 smithi195 ceph-mon[80021]: from='client.? 172.21.15.115:0/1842590559' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T17:16:45.486 DEBUG:teuthology.parallel:result is None 2024-09-13T17:16:45.486 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T17:16:45.498 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi115.front.sepia.ceph.com 2024-09-13T17:16:45.498 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-13T17:16:45.699 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T17:16:47.067 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:16:46 smithi115 ceph-mon[109488]: pgmap v342: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:16:47.250 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:47.244+0000 7fc40be63640 1 -- 172.21.15.115:0/4203187072 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc404105bf0 msgr2=0x7fc404105fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:47.250 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:47.244+0000 7fc40be63640 1 --2- 172.21.15.115:0/4203187072 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc404105bf0 0x7fc404105fd0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc400009880 tx=0x7fc40002a4a0 comp rx=0 tx=0).stop 2024-09-13T17:16:47.250 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:47.244+0000 7fc40be63640 1 -- 172.21.15.115:0/4203187072 shutdown_connections 2024-09-13T17:16:47.250 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:47.244+0000 7fc40be63640 1 --2- 172.21.15.115:0/4203187072 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc4040ffb40 0x7fc4040fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:47.251 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:47.244+0000 7fc40be63640 1 --2- 172.21.15.115:0/4203187072 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc404105bf0 0x7fc404105fd0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:47.251 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:47.244+0000 7fc40be63640 1 -- 172.21.15.115:0/4203187072 >> 172.21.15.115:0/4203187072 conn(0x7fc4040fb840 msgr2=0x7fc4040fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:47.251 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:47.244+0000 7fc40be63640 1 -- 172.21.15.115:0/4203187072 shutdown_connections 2024-09-13T17:16:47.251 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:47.244+0000 7fc40be63640 1 -- 172.21.15.115:0/4203187072 wait complete. 2024-09-13T17:16:47.251 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:47.245+0000 7fc40be63640 1 Processor -- start 2024-09-13T17:16:47.251 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:47.245+0000 7fc40be63640 1 -- start start 2024-09-13T17:16:47.252 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:47.245+0000 7fc40be63640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc4040ffb40 0x7fc40419b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:47.252 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:47.245+0000 7fc40be63640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc404105bf0 0x7fc40419bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:47.252 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:47.245+0000 7fc40be63640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc404195910 con 0x7fc404105bf0 2024-09-13T17:16:47.252 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:47.245+0000 7fc40be63640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc404195a50 con 0x7fc4040ffb40 2024-09-13T17:16:47.252 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:47.245+0000 7fc4093fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc404105bf0 0x7fc40419bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:47.253 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:47.245+0000 7fc4093fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc404105bf0 0x7fc40419bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:44008/0 (socket says 172.21.15.115:44008) 2024-09-13T17:16:47.253 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:47.245+0000 7fc4093fe640 1 -- 172.21.15.115:0/3687861770 learned_addr learned my addr 172.21.15.115:0/3687861770 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:16:47.253 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:47.245+0000 7fc409bff640 1 --2- 172.21.15.115:0/3687861770 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc4040ffb40 0x7fc40419b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:47.253 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:47.246+0000 7fc4093fe640 1 -- 172.21.15.115:0/3687861770 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc4040ffb40 msgr2=0x7fc40419b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:47.253 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:47.246+0000 7fc4093fe640 1 --2- 172.21.15.115:0/3687861770 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc4040ffb40 0x7fc40419b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:47.254 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:47.246+0000 7fc4093fe640 1 -- 172.21.15.115:0/3687861770 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc400009560 con 0x7fc404105bf0 2024-09-13T17:16:47.254 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:47.246+0000 7fc4093fe640 1 --2- 172.21.15.115:0/3687861770 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc404105bf0 0x7fc40419bdf0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc3f400b420 tx=0x7fc3f400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:47.254 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:47.246+0000 7fc3faffd640 1 -- 172.21.15.115:0/3687861770 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3f4011800 con 0x7fc404105bf0 2024-09-13T17:16:47.254 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:47.246+0000 7fc3faffd640 1 -- 172.21.15.115:0/3687861770 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc3f4011e00 con 0x7fc404105bf0 2024-09-13T17:16:47.254 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:47.246+0000 7fc3faffd640 1 -- 172.21.15.115:0/3687861770 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3f400f2e0 con 0x7fc404105bf0 2024-09-13T17:16:47.254 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:47.246+0000 7fc40be63640 1 -- 172.21.15.115:0/3687861770 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc404195d30 con 0x7fc404105bf0 2024-09-13T17:16:47.255 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:47.246+0000 7fc40be63640 1 -- 172.21.15.115:0/3687861770 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc404196280 con 0x7fc404105bf0 2024-09-13T17:16:47.255 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:47.247+0000 7fc40be63640 1 -- 172.21.15.115:0/3687861770 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4041011f0 con 0x7fc404105bf0 2024-09-13T17:16:47.255 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:47.248+0000 7fc3faffd640 1 -- 172.21.15.115:0/3687861770 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fc3f4010380 con 0x7fc404105bf0 2024-09-13T17:16:47.255 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:47.248+0000 7fc3faffd640 1 --2- 172.21.15.115:0/3687861770 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fc3f006cc60 0x7fc3f006f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:47.255 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:47.248+0000 7fc3faffd640 1 -- 172.21.15.115:0/3687861770 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fc3f408bea0 con 0x7fc404105bf0 2024-09-13T17:16:47.256 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:47.249+0000 7fc409bff640 1 --2- 172.21.15.115:0/3687861770 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fc3f006cc60 0x7fc3f006f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:47.256 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:47.249+0000 7fc409bff640 1 --2- 172.21.15.115:0/3687861770 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fc3f006cc60 0x7fc3f006f120 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc400000c00 tx=0x7fc400005a20 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:47.256 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:47.253+0000 7fc3faffd640 1 -- 172.21.15.115:0/3687861770 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc3f4055f10 con 0x7fc404105bf0 2024-09-13T17:16:47.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:16:46 smithi195 ceph-mon[80021]: pgmap v342: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:16:47.454 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:47.452+0000 7fc40be63640 1 -- 172.21.15.115:0/3687861770 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc404108010 con 0x7fc404105bf0 2024-09-13T17:16:47.454 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:47.453+0000 7fc3faffd640 1 -- 172.21.15.115:0/3687861770 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 39 v39) v1 ==== 76+0+1877 (secure 0 0 0) 0x7fc3f4059530 con 0x7fc404105bf0 2024-09-13T17:16:47.454 INFO:teuthology.orchestra.run.smithi115.stdout:e39 2024-09-13T17:16:47.454 INFO:teuthology.orchestra.run.smithi115.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T17:16:47.454 INFO:teuthology.orchestra.run.smithi115.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T17:16:47.455 INFO:teuthology.orchestra.run.smithi115.stdout:legacy client fscid: 1 2024-09-13T17:16:47.455 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:16:47.455 INFO:teuthology.orchestra.run.smithi115.stdout:Filesystem 'cephfs' (1) 2024-09-13T17:16:47.455 INFO:teuthology.orchestra.run.smithi115.stdout:fs_name cephfs 2024-09-13T17:16:47.455 INFO:teuthology.orchestra.run.smithi115.stdout:epoch 39 2024-09-13T17:16:47.455 INFO:teuthology.orchestra.run.smithi115.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T17:16:47.455 INFO:teuthology.orchestra.run.smithi115.stdout:created 2024-09-13T17:03:16.313116+0000 2024-09-13T17:16:47.455 INFO:teuthology.orchestra.run.smithi115.stdout:modified 2024-09-13T17:14:46.892655+0000 2024-09-13T17:16:47.455 INFO:teuthology.orchestra.run.smithi115.stdout:tableserver 0 2024-09-13T17:16:47.455 INFO:teuthology.orchestra.run.smithi115.stdout:root 0 2024-09-13T17:16:47.455 INFO:teuthology.orchestra.run.smithi115.stdout:session_timeout 60 2024-09-13T17:16:47.455 INFO:teuthology.orchestra.run.smithi115.stdout:session_autoclose 300 2024-09-13T17:16:47.455 INFO:teuthology.orchestra.run.smithi115.stdout:max_file_size 1099511627776 2024-09-13T17:16:47.455 INFO:teuthology.orchestra.run.smithi115.stdout:max_xattr_size 65536 2024-09-13T17:16:47.456 INFO:teuthology.orchestra.run.smithi115.stdout:required_client_features {} 2024-09-13T17:16:47.456 INFO:teuthology.orchestra.run.smithi115.stdout:last_failure 0 2024-09-13T17:16:47.456 INFO:teuthology.orchestra.run.smithi115.stdout:last_failure_osd_epoch 82 2024-09-13T17:16:47.456 INFO:teuthology.orchestra.run.smithi115.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T17:16:47.456 INFO:teuthology.orchestra.run.smithi115.stdout:max_mds 1 2024-09-13T17:16:47.456 INFO:teuthology.orchestra.run.smithi115.stdout:in 0 2024-09-13T17:16:47.456 INFO:teuthology.orchestra.run.smithi115.stdout:up {0=34320} 2024-09-13T17:16:47.456 INFO:teuthology.orchestra.run.smithi115.stdout:failed 2024-09-13T17:16:47.456 INFO:teuthology.orchestra.run.smithi115.stdout:damaged 2024-09-13T17:16:47.456 INFO:teuthology.orchestra.run.smithi115.stdout:stopped 2024-09-13T17:16:47.456 INFO:teuthology.orchestra.run.smithi115.stdout:data_pools [3] 2024-09-13T17:16:47.456 INFO:teuthology.orchestra.run.smithi115.stdout:metadata_pool 2 2024-09-13T17:16:47.456 INFO:teuthology.orchestra.run.smithi115.stdout:inline_data enabled 2024-09-13T17:16:47.456 INFO:teuthology.orchestra.run.smithi115.stdout:balancer 2024-09-13T17:16:47.457 INFO:teuthology.orchestra.run.smithi115.stdout:bal_rank_mask -1 2024-09-13T17:16:47.457 INFO:teuthology.orchestra.run.smithi115.stdout:standby_count_wanted 1 2024-09-13T17:16:47.457 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi115.hbtxod{0:34320} state up:active seq 17 join_fscid=1 addr [v2:172.21.15.115:6826/2768011029,v1:172.21.15.115:6827/2768011029] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T17:16:47.457 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi115.ijznvr{0:34324} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.115:6828/2716683507,v1:172.21.15.115:6829/2716683507] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T17:16:47.457 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:16:47.457 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:16:47.457 INFO:teuthology.orchestra.run.smithi115.stdout:Standby daemons: 2024-09-13T17:16:47.457 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:16:47.457 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi195.qzghxj{-1:44271} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.195:6824/825791083,v1:172.21.15.195:6825/825791083] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T17:16:47.457 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi195.aevvgz{-1:44287} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.195:6826/589520116,v1:172.21.15.195:6827/589520116] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T17:16:47.458 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 39 2024-09-13T17:16:47.458 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:47.455+0000 7fc40be63640 1 -- 172.21.15.115:0/3687861770 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fc3f006cc60 msgr2=0x7fc3f006f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:47.458 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:47.455+0000 7fc40be63640 1 --2- 172.21.15.115:0/3687861770 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fc3f006cc60 0x7fc3f006f120 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc400000c00 tx=0x7fc400005a20 comp rx=0 tx=0).stop 2024-09-13T17:16:47.458 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:47.455+0000 7fc40be63640 1 -- 172.21.15.115:0/3687861770 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc404105bf0 msgr2=0x7fc40419bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:47.458 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:47.455+0000 7fc40be63640 1 --2- 172.21.15.115:0/3687861770 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc404105bf0 0x7fc40419bdf0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc3f400b420 tx=0x7fc3f400b8e0 comp rx=0 tx=0).stop 2024-09-13T17:16:47.458 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:47.455+0000 7fc40be63640 1 -- 172.21.15.115:0/3687861770 shutdown_connections 2024-09-13T17:16:47.458 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:47.455+0000 7fc40be63640 1 --2- 172.21.15.115:0/3687861770 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fc3f006cc60 0x7fc3f006f120 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:47.458 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:47.455+0000 7fc40be63640 1 --2- 172.21.15.115:0/3687861770 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc404105bf0 0x7fc40419bdf0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:47.458 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:47.455+0000 7fc40be63640 1 --2- 172.21.15.115:0/3687861770 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc4040ffb40 0x7fc40419b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:47.458 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:47.455+0000 7fc40be63640 1 -- 172.21.15.115:0/3687861770 >> 172.21.15.115:0/3687861770 conn(0x7fc4040fb840 msgr2=0x7fc4040fd980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:47.458 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:47.455+0000 7fc40be63640 1 -- 172.21.15.115:0/3687861770 shutdown_connections 2024-09-13T17:16:47.458 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:47.455+0000 7fc40be63640 1 -- 172.21.15.115:0/3687861770 wait complete. 2024-09-13T17:16:48.174 INFO:teuthology.run_tasks:Running task fs.post_upgrade_checks... 2024-09-13T17:16:48.186 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:16:48.208 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:16:47 smithi115 ceph-mon[109488]: from='client.? 172.21.15.115:0/3687861770' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T17:16:48.208 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:16:47 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:16:48.290 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.287+0000 7ff3d5b25640 1 -- 172.21.15.115:0/1058101534 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff3d0101590 msgr2=0x7ff3d0109a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:48.291 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.287+0000 7ff3d5b25640 1 --2- 172.21.15.115:0/1058101534 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff3d0101590 0x7ff3d0109a70 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff3c40098b0 tx=0x7ff3c402a560 comp rx=0 tx=0).stop 2024-09-13T17:16:48.291 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.287+0000 7ff3d5b25640 1 -- 172.21.15.115:0/1058101534 shutdown_connections 2024-09-13T17:16:48.291 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.287+0000 7ff3d5b25640 1 --2- 172.21.15.115:0/1058101534 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff3d0101590 0x7ff3d0109a70 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:48.291 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.287+0000 7ff3d5b25640 1 --2- 172.21.15.115:0/1058101534 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3d0100c70 0x7ff3d0101050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:48.291 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.287+0000 7ff3d5b25640 1 -- 172.21.15.115:0/1058101534 >> 172.21.15.115:0/1058101534 conn(0x7ff3d00fa620 msgr2=0x7ff3d00fca40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:48.291 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.287+0000 7ff3d5b25640 1 -- 172.21.15.115:0/1058101534 shutdown_connections 2024-09-13T17:16:48.291 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.287+0000 7ff3d5b25640 1 -- 172.21.15.115:0/1058101534 wait complete. 2024-09-13T17:16:48.291 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.288+0000 7ff3d5b25640 1 Processor -- start 2024-09-13T17:16:48.291 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.288+0000 7ff3d5b25640 1 -- start start 2024-09-13T17:16:48.291 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.288+0000 7ff3d5b25640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff3d0100c70 0x7ff3d019b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:48.291 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.288+0000 7ff3d5b25640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3d0101590 0x7ff3d019bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:48.292 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.288+0000 7ff3d5b25640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d019c2a0 con 0x7ff3d0100c70 2024-09-13T17:16:48.292 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.288+0000 7ff3d5b25640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d01957f0 con 0x7ff3d0101590 2024-09-13T17:16:48.292 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.288+0000 7ff3cf7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff3d0100c70 0x7ff3d019b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:48.292 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.289+0000 7ff3cf7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff3d0100c70 0x7ff3d019b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:44028/0 (socket says 172.21.15.115:44028) 2024-09-13T17:16:48.292 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.289+0000 7ff3cf7fe640 1 -- 172.21.15.115:0/2151603087 learned_addr learned my addr 172.21.15.115:0/2151603087 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:16:48.292 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.289+0000 7ff3ceffd640 1 --2- 172.21.15.115:0/2151603087 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3d0101590 0x7ff3d019bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:48.292 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.289+0000 7ff3cf7fe640 1 -- 172.21.15.115:0/2151603087 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3d0101590 msgr2=0x7ff3d019bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:48.293 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.289+0000 7ff3cf7fe640 1 --2- 172.21.15.115:0/2151603087 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3d0101590 0x7ff3d019bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:48.293 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.289+0000 7ff3cf7fe640 1 -- 172.21.15.115:0/2151603087 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3c4009560 con 0x7ff3d0100c70 2024-09-13T17:16:48.293 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.289+0000 7ff3cf7fe640 1 --2- 172.21.15.115:0/2151603087 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff3d0100c70 0x7ff3d019b710 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff3c000c8a0 tx=0x7ff3c000cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:48.293 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.289+0000 7ff3ccff9640 1 -- 172.21.15.115:0/2151603087 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff3c0007b80 con 0x7ff3d0100c70 2024-09-13T17:16:48.293 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.289+0000 7ff3ccff9640 1 -- 172.21.15.115:0/2151603087 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff3c0007ce0 con 0x7ff3d0100c70 2024-09-13T17:16:48.293 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.289+0000 7ff3d5b25640 1 -- 172.21.15.115:0/2151603087 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3d0195aa0 con 0x7ff3d0100c70 2024-09-13T17:16:48.293 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.289+0000 7ff3ccff9640 1 -- 172.21.15.115:0/2151603087 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff3c0018770 con 0x7ff3d0100c70 2024-09-13T17:16:48.293 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.289+0000 7ff3d5b25640 1 -- 172.21.15.115:0/2151603087 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3d0195fd0 con 0x7ff3d0100c70 2024-09-13T17:16:48.294 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.290+0000 7ff3d5b25640 1 -- 172.21.15.115:0/2151603087 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3d0068850 con 0x7ff3d0100c70 2024-09-13T17:16:48.294 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.291+0000 7ff3ccff9640 1 -- 172.21.15.115:0/2151603087 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7ff3c00189e0 con 0x7ff3d0100c70 2024-09-13T17:16:48.294 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.291+0000 7ff3ccff9640 1 --2- 172.21.15.115:0/2151603087 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7ff3b806cc90 0x7ff3b806f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:48.294 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.291+0000 7ff3ccff9640 1 -- 172.21.15.115:0/2151603087 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6328+0+0 (secure 0 0 0) 0x7ff3c008c7e0 con 0x7ff3d0100c70 2024-09-13T17:16:48.294 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.291+0000 7ff3ceffd640 1 --2- 172.21.15.115:0/2151603087 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7ff3b806cc90 0x7ff3b806f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:48.294 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.292+0000 7ff3ceffd640 1 --2- 172.21.15.115:0/2151603087 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7ff3b806cc90 0x7ff3b806f150 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff3c4000c00 tx=0x7ff3c4005a20 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:48.296 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.295+0000 7ff3ccff9640 1 -- 172.21.15.115:0/2151603087 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff3c00568c0 con 0x7ff3d0100c70 2024-09-13T17:16:48.326 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:16:47 smithi195 ceph-mon[80021]: from='client.? 172.21.15.115:0/3687861770' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T17:16:48.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:16:47 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:16:48.484 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.483+0000 7ff3d5b25640 1 -- 172.21.15.115:0/2151603087 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff3d0196d00 con 0x7ff3d0100c70 2024-09-13T17:16:48.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.484+0000 7ff3ccff9640 1 -- 172.21.15.115:0/2151603087 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+16363 (secure 0 0 0) 0x7ff3c0059ee0 con 0x7ff3d0100c70 2024-09-13T17:16:48.488 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:16:48.488 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":82,"fsid":"ffbd7588-71f0-11ef-bceb-c7b262605968","created":"2024-09-13T16:56:28.790927+0000","modified":"2024-09-13T17:14:05.809689+0000","last_up_change":"2024-09-13T17:13:07.445406+0000","last_in_change":"2024-09-13T17:01:39.088735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:00:47.472140+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-09-13T17:03:15.097618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-09-13T17:03:15.539103+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9fb96264-a71d-43b2-8d65-b4280a8ad8ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":48,"up_from":52,"up_thru":77,"down_at":49,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":1186998944},{"type":"v1","addr":"172.21.15.115:6803","nonce":1186998944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":1186998944},{"type":"v1","addr":"172.21.15.115:6805","nonce":1186998944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":1186998944},{"type":"v1","addr":"172.21.15.115:6809","nonce":1186998944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":1186998944},{"type":"v1","addr":"172.21.15.115:6807","nonce":1186998944}]},"public_addr":"172.21.15.115:6803/1186998944","cluster_addr":"172.21.15.115:6805/1186998944","heartbeat_back_addr":"172.21.15.115:6809/1186998944","heartbeat_front_addr":"172.21.15.115:6807/1186998944","state":["exists","up"]},{"osd":1,"uuid":"876bf075-f0e1-49dc-90cc-aedccbd19b2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":53,"up_from":57,"up_thru":77,"down_at":54,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":698342085},{"type":"v1","addr":"172.21.15.115:6811","nonce":698342085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":698342085},{"type":"v1","addr":"172.21.15.115:6813","nonce":698342085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":698342085},{"type":"v1","addr":"172.21.15.115:6817","nonce":698342085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":698342085},{"type":"v1","addr":"172.21.15.115:6815","nonce":698342085}]},"public_addr":"172.21.15.115:6811/698342085","cluster_addr":"172.21.15.115:6813/698342085","heartbeat_back_addr":"172.21.15.115:6817/698342085","heartbeat_front_addr":"172.21.15.115:6815/698342085","state":["exists","up"]},{"osd":2,"uuid":"40bc0278-21e6-4863-86bf-f5ee3bfc2fbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":58,"up_from":62,"up_thru":77,"down_at":59,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":3735356389},{"type":"v1","addr":"172.21.15.115:6819","nonce":3735356389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":3735356389},{"type":"v1","addr":"172.21.15.115:6821","nonce":3735356389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":3735356389},{"type":"v1","addr":"172.21.15.115:6825","nonce":3735356389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":3735356389},{"type":"v1","addr":"172.21.15.115:6823","nonce":3735356389}]},"public_addr":"172.21.15.115:6819/3735356389","cluster_addr":"172.21.15.115:6821/3735356389","heartbeat_back_addr":"172.21.15.115:6825/3735356389","heartbeat_front_addr":"172.21.15.115:6823/3735356389","state":["exists","up"]},{"osd":3,"uuid":"af3d701a-1c69-4cf2-a343-938ac1bbb34a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":26,"last_clean_end":63,"up_from":67,"up_thru":77,"down_at":64,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":2321302370},{"type":"v1","addr":"172.21.15.195:6801","nonce":2321302370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":2321302370},{"type":"v1","addr":"172.21.15.195:6803","nonce":2321302370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":2321302370},{"type":"v1","addr":"172.21.15.195:6807","nonce":2321302370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":2321302370},{"type":"v1","addr":"172.21.15.195:6805","nonce":2321302370}]},"public_addr":"172.21.15.195:6801/2321302370","cluster_addr":"172.21.15.195:6803/2321302370","heartbeat_back_addr":"172.21.15.195:6807/2321302370","heartbeat_front_addr":"172.21.15.195:6805/2321302370","state":["exists","up"]},{"osd":4,"uuid":"7bf484b6-6ed5-4fe7-8aa4-505853e2cd1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":34,"last_clean_end":68,"up_from":72,"up_thru":77,"down_at":69,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":1718354216},{"type":"v1","addr":"172.21.15.195:6809","nonce":1718354216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":1718354216},{"type":"v1","addr":"172.21.15.195:6811","nonce":1718354216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":1718354216},{"type":"v1","addr":"172.21.15.195:6815","nonce":1718354216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":1718354216},{"type":"v1","addr":"172.21.15.195:6813","nonce":1718354216}]},"public_addr":"172.21.15.195:6809/1718354216","cluster_addr":"172.21.15.195:6811/1718354216","heartbeat_back_addr":"172.21.15.195:6815/1718354216","heartbeat_front_addr":"172.21.15.195:6813/1718354216","state":["exists","up"]},{"osd":5,"uuid":"1eb8bcc4-dc9b-4a00-bf43-a707da3c141f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":39,"last_clean_end":73,"up_from":77,"up_thru":77,"down_at":74,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2051626892},{"type":"v1","addr":"172.21.15.195:6817","nonce":2051626892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":2051626892},{"type":"v1","addr":"172.21.15.195:6819","nonce":2051626892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":2051626892},{"type":"v1","addr":"172.21.15.195:6823","nonce":2051626892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2051626892},{"type":"v1","addr":"172.21.15.195:6821","nonce":2051626892}]},"public_addr":"172.21.15.195:6817/2051626892","cluster_addr":"172.21.15.195:6819/2051626892","heartbeat_back_addr":"172.21.15.195:6823/2051626892","heartbeat_front_addr":"172.21.15.195:6821/2051626892","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:59:47.662383+0000","dead_epoch":48},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:00:14.730551+0000","dead_epoch":53},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:00:43.856416+0000","dead_epoch":58},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:01:06.336209+0000","dead_epoch":63},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:01:30.680442+0000","dead_epoch":68},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:01:55.518043+0000","dead_epoch":73}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.115:6829/4128583274":"2024-09-14T17:13:29.448814+0000","172.21.15.115:6801/244039928":"2024-09-14T17:05:27.560242+0000","172.21.15.195:6828/1660911692":"2024-09-14T17:06:35.351905+0000","172.21.15.115:6801/2943337696":"2024-09-14T16:57:27.333203+0000","172.21.15.195:0/3889921339":"2024-09-14T17:06:35.351905+0000","172.21.15.195:6829/1660911692":"2024-09-14T17:06:35.351905+0000","172.21.15.115:6801/1463863592":"2024-09-14T16:56:57.112847+0000","172.21.15.195:6826/8826118":"2024-09-14T17:14:05.809662+0000","172.21.15.115:6828/4128583274":"2024-09-14T17:13:29.448814+0000","172.21.15.115:0/376622152":"2024-09-14T16:57:27.333203+0000","172.21.15.115:6800/1463863592":"2024-09-14T16:56:57.112847+0000","172.21.15.115:0/3586970461":"2024-09-14T16:57:27.333203+0000","172.21.15.195:0/14125648":"2024-09-14T17:06:35.351905+0000","172.21.15.115:0/1473439240":"2024-09-14T17:05:27.560242+0000","172.21.15.115:0/931588236":"2024-09-14T16:58:29.159373+0000","172.21.15.115:6826/1900336545":"2024-09-14T17:03:30.385433+0000","172.21.15.195:0/2985838805":"2024-09-14T17:06:35.351905+0000","172.21.15.115:6800/244039928":"2024-09-14T17:05:27.560242+0000","172.21.15.195:0/2501790483":"2024-09-14T17:06:35.351905+0000","172.21.15.195:0/3420173457":"2024-09-14T17:06:35.351905+0000","172.21.15.115:0/648599851":"2024-09-14T16:56:57.112847+0000","172.21.15.115:6800/2943337696":"2024-09-14T16:57:27.333203+0000","172.21.15.115:6827/1900336545":"2024-09-14T17:03:30.385433+0000","172.21.15.115:6801/3889408988":"2024-09-14T16:58:29.159373+0000","172.21.15.195:0/2917880554":"2024-09-14T17:06:35.351905+0000","172.21.15.115:0/247720257":"2024-09-14T16:58:29.159373+0000","172.21.15.115:0/3723628457":"2024-09-14T16:56:57.112847+0000","172.21.15.115:0/3268617158":"2024-09-14T17:05:27.560242+0000","172.21.15.195:6827/8826118":"2024-09-14T17:14:05.809662+0000","172.21.15.115:0/1641850753":"2024-09-14T17:05:27.560242+0000","172.21.15.115:6800/3889408988":"2024-09-14T16:58:29.159373+0000","172.21.15.115:0/2751677160":"2024-09-14T16:58:29.159373+0000","172.21.15.115:0/3967447202":"2024-09-14T17:05:27.560242+0000","172.21.15.115:0/3791301867":"2024-09-14T16:57:27.333203+0000","172.21.15.115:0/2966038005":"2024-09-14T16:56:57.112847+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:16:48.489 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.486+0000 7ff3d5b25640 1 -- 172.21.15.115:0/2151603087 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7ff3b806cc90 msgr2=0x7ff3b806f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:48.489 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.486+0000 7ff3d5b25640 1 --2- 172.21.15.115:0/2151603087 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7ff3b806cc90 0x7ff3b806f150 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff3c4000c00 tx=0x7ff3c4005a20 comp rx=0 tx=0).stop 2024-09-13T17:16:48.489 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.486+0000 7ff3d5b25640 1 -- 172.21.15.115:0/2151603087 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff3d0100c70 msgr2=0x7ff3d019b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:48.490 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.486+0000 7ff3d5b25640 1 --2- 172.21.15.115:0/2151603087 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff3d0100c70 0x7ff3d019b710 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff3c000c8a0 tx=0x7ff3c000cd60 comp rx=0 tx=0).stop 2024-09-13T17:16:48.490 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.487+0000 7ff3d5b25640 1 -- 172.21.15.115:0/2151603087 shutdown_connections 2024-09-13T17:16:48.490 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.487+0000 7ff3d5b25640 1 --2- 172.21.15.115:0/2151603087 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7ff3b806cc90 0x7ff3b806f150 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:48.490 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.487+0000 7ff3d5b25640 1 --2- 172.21.15.115:0/2151603087 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3d0101590 0x7ff3d019bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:48.490 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.487+0000 7ff3d5b25640 1 --2- 172.21.15.115:0/2151603087 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff3d0100c70 0x7ff3d019b710 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:48.490 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.487+0000 7ff3d5b25640 1 -- 172.21.15.115:0/2151603087 >> 172.21.15.115:0/2151603087 conn(0x7ff3d00fa620 msgr2=0x7ff3d0101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:48.490 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.487+0000 7ff3d5b25640 1 -- 172.21.15.115:0/2151603087 shutdown_connections 2024-09-13T17:16:48.490 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.487+0000 7ff3d5b25640 1 -- 172.21.15.115:0/2151603087 wait complete. 2024-09-13T17:16:48.499 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:00:47.472140+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-09-13T17:03:15.097618+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-09-13T17:03:15.539103+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:16:48.499 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:16:48.642 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.639+0000 7f82083ce640 1 -- 172.21.15.115:0/4010590897 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8200104900 msgr2=0x7f8200104ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:48.642 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.639+0000 7f82083ce640 1 --2- 172.21.15.115:0/4010590897 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8200104900 0x7f8200104ce0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f81f4009880 tx=0x7f81f402a4a0 comp rx=0 tx=0).stop 2024-09-13T17:16:48.643 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.639+0000 7f82083ce640 1 -- 172.21.15.115:0/4010590897 shutdown_connections 2024-09-13T17:16:48.643 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.639+0000 7f82083ce640 1 --2- 172.21.15.115:0/4010590897 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f82000fe8f0 0x7f82000fed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:48.643 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.639+0000 7f82083ce640 1 --2- 172.21.15.115:0/4010590897 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8200104900 0x7f8200104ce0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:48.643 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.639+0000 7f82083ce640 1 -- 172.21.15.115:0/4010590897 >> 172.21.15.115:0/4010590897 conn(0x7f82000fa5d0 msgr2=0x7f82000fc9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:48.643 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.639+0000 7f82083ce640 1 -- 172.21.15.115:0/4010590897 shutdown_connections 2024-09-13T17:16:48.643 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.639+0000 7f82083ce640 1 -- 172.21.15.115:0/4010590897 wait complete. 2024-09-13T17:16:48.643 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.640+0000 7f82083ce640 1 Processor -- start 2024-09-13T17:16:48.643 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.640+0000 7f82083ce640 1 -- start start 2024-09-13T17:16:48.643 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.640+0000 7f82083ce640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f82000fe8f0 0x7f820019b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:48.643 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.640+0000 7f82083ce640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8200104900 0x7f820019bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:48.643 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.640+0000 7f82083ce640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8200195940 con 0x7f8200104900 2024-09-13T17:16:48.643 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.640+0000 7f82083ce640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8200195ab0 con 0x7f82000fe8f0 2024-09-13T17:16:48.644 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.640+0000 7f8205969640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8200104900 0x7f820019bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:48.644 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.640+0000 7f8205969640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8200104900 0x7f820019bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:44054/0 (socket says 172.21.15.115:44054) 2024-09-13T17:16:48.644 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.640+0000 7f8205969640 1 -- 172.21.15.115:0/3550512784 learned_addr learned my addr 172.21.15.115:0/3550512784 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:16:48.644 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.640+0000 7f820616a640 1 --2- 172.21.15.115:0/3550512784 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f82000fe8f0 0x7f820019b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:48.644 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.640+0000 7f8205969640 1 -- 172.21.15.115:0/3550512784 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f82000fe8f0 msgr2=0x7f820019b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:48.644 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.640+0000 7f8205969640 1 --2- 172.21.15.115:0/3550512784 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f82000fe8f0 0x7f820019b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:48.644 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.640+0000 7f8205969640 1 -- 172.21.15.115:0/3550512784 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81f4009560 con 0x7f8200104900 2024-09-13T17:16:48.644 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.640+0000 7f820616a640 1 --2- 172.21.15.115:0/3550512784 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f82000fe8f0 0x7f820019b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:16:48.644 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.640+0000 7f8205969640 1 --2- 172.21.15.115:0/3550512784 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8200104900 0x7f820019bda0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f81fc00b420 tx=0x7f81fc00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:48.644 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.640+0000 7f81f37fe640 1 -- 172.21.15.115:0/3550512784 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f81fc011800 con 0x7f8200104900 2024-09-13T17:16:48.644 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.641+0000 7f81f37fe640 1 -- 172.21.15.115:0/3550512784 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f81fc011e00 con 0x7f8200104900 2024-09-13T17:16:48.644 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.641+0000 7f82083ce640 1 -- 172.21.15.115:0/3550512784 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8200195d90 con 0x7f8200104900 2024-09-13T17:16:48.645 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.641+0000 7f81f37fe640 1 -- 172.21.15.115:0/3550512784 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f81fc00f2e0 con 0x7f8200104900 2024-09-13T17:16:48.645 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.641+0000 7f82083ce640 1 -- 172.21.15.115:0/3550512784 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82001962f0 con 0x7f8200104900 2024-09-13T17:16:48.645 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.642+0000 7f82083ce640 1 -- 172.21.15.115:0/3550512784 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8200100030 con 0x7f8200104900 2024-09-13T17:16:48.646 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.642+0000 7f81f37fe640 1 -- 172.21.15.115:0/3550512784 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f81fc010380 con 0x7f8200104900 2024-09-13T17:16:48.646 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.642+0000 7f81f37fe640 1 --2- 172.21.15.115:0/3550512784 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f81ec06cc50 0x7f81ec06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:48.646 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.642+0000 7f81f37fe640 1 -- 172.21.15.115:0/3550512784 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f81fc08be80 con 0x7f8200104900 2024-09-13T17:16:48.646 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.642+0000 7f820616a640 1 --2- 172.21.15.115:0/3550512784 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f81ec06cc50 0x7f81ec06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:48.646 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.643+0000 7f820616a640 1 --2- 172.21.15.115:0/3550512784 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f81ec06cc50 0x7f81ec06f110 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f81f4000c00 tx=0x7f81f4005e30 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:48.647 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.646+0000 7f81f37fe640 1 -- 172.21.15.115:0/3550512784 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f81fc055f70 con 0x7f8200104900 2024-09-13T17:16:48.809 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.807+0000 7f82083ce640 1 -- 172.21.15.115:0/3550512784 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f82001965c0 con 0x7f8200104900 2024-09-13T17:16:48.809 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.808+0000 7f81f37fe640 1 -- 172.21.15.115:0/3550512784 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) v1 ==== 93+0+10 (secure 0 0 0) 0x7f81fc059590 con 0x7f8200104900 2024-09-13T17:16:48.809 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 1 2024-09-13T17:16:48.811 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.810+0000 7f82083ce640 1 -- 172.21.15.115:0/3550512784 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f81ec06cc50 msgr2=0x7f81ec06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:48.811 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.810+0000 7f82083ce640 1 --2- 172.21.15.115:0/3550512784 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f81ec06cc50 0x7f81ec06f110 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f81f4000c00 tx=0x7f81f4005e30 comp rx=0 tx=0).stop 2024-09-13T17:16:48.811 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.810+0000 7f82083ce640 1 -- 172.21.15.115:0/3550512784 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8200104900 msgr2=0x7f820019bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:48.811 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.810+0000 7f82083ce640 1 --2- 172.21.15.115:0/3550512784 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8200104900 0x7f820019bda0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f81fc00b420 tx=0x7f81fc00b8e0 comp rx=0 tx=0).stop 2024-09-13T17:16:48.812 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.810+0000 7f82083ce640 1 -- 172.21.15.115:0/3550512784 shutdown_connections 2024-09-13T17:16:48.812 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.810+0000 7f82083ce640 1 --2- 172.21.15.115:0/3550512784 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f81ec06cc50 0x7f81ec06f110 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:48.812 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.810+0000 7f82083ce640 1 --2- 172.21.15.115:0/3550512784 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8200104900 0x7f820019bda0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:48.812 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.810+0000 7f82083ce640 1 --2- 172.21.15.115:0/3550512784 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f82000fe8f0 0x7f820019b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:48.812 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.810+0000 7f82083ce640 1 -- 172.21.15.115:0/3550512784 >> 172.21.15.115:0/3550512784 conn(0x7f82000fa5d0 msgr2=0x7f82000fb8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:48.812 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.810+0000 7f82083ce640 1 -- 172.21.15.115:0/3550512784 shutdown_connections 2024-09-13T17:16:48.812 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.810+0000 7f82083ce640 1 -- 172.21.15.115:0/3550512784 wait complete. 2024-09-13T17:16:48.822 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-09-13T17:16:48.925 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.922+0000 7f6dc477d640 1 -- 172.21.15.115:0/3269142393 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6dbc0fe910 msgr2=0x7f6dbc0fed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:48.925 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.922+0000 7f6dc477d640 1 --2- 172.21.15.115:0/3269142393 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6dbc0fe910 0x7f6dbc0fed70 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6dac009880 tx=0x7f6dac02a4a0 comp rx=0 tx=0).stop 2024-09-13T17:16:48.925 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.922+0000 7f6dc477d640 1 -- 172.21.15.115:0/3269142393 shutdown_connections 2024-09-13T17:16:48.925 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.922+0000 7f6dc477d640 1 --2- 172.21.15.115:0/3269142393 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6dbc0fe910 0x7f6dbc0fed70 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:48.926 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.922+0000 7f6dc477d640 1 --2- 172.21.15.115:0/3269142393 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6dbc104920 0x7f6dbc104d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:48.926 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.922+0000 7f6dc477d640 1 -- 172.21.15.115:0/3269142393 >> 172.21.15.115:0/3269142393 conn(0x7f6dbc0757b0 msgr2=0x7f6dbc0fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:48.926 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.922+0000 7f6dc477d640 1 -- 172.21.15.115:0/3269142393 shutdown_connections 2024-09-13T17:16:48.926 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.922+0000 7f6dc477d640 1 -- 172.21.15.115:0/3269142393 wait complete. 2024-09-13T17:16:48.926 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.923+0000 7f6dc477d640 1 Processor -- start 2024-09-13T17:16:48.926 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.923+0000 7f6dc477d640 1 -- start start 2024-09-13T17:16:48.926 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.923+0000 7f6dc477d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6dbc0fe910 0x7f6dbc196830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:48.926 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.923+0000 7f6dc477d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6dbc104920 0x7f6dbc196d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:48.926 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.923+0000 7f6dc477d640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dbc197340 con 0x7f6dbc0fe910 2024-09-13T17:16:48.926 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.923+0000 7f6dc477d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dbc1974b0 con 0x7f6dbc104920 2024-09-13T17:16:48.926 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.923+0000 7f6dc2519640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6dbc0fe910 0x7f6dbc196830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:48.926 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.923+0000 7f6dc2519640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6dbc0fe910 0x7f6dbc196830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:44062/0 (socket says 172.21.15.115:44062) 2024-09-13T17:16:48.926 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.923+0000 7f6dc2519640 1 -- 172.21.15.115:0/491805098 learned_addr learned my addr 172.21.15.115:0/491805098 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:16:48.927 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.923+0000 7f6dc2519640 1 -- 172.21.15.115:0/491805098 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6dbc104920 msgr2=0x7f6dbc196d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:48.927 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.923+0000 7f6dc2519640 1 --2- 172.21.15.115:0/491805098 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6dbc104920 0x7f6dbc196d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:48.927 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.923+0000 7f6dc2519640 1 -- 172.21.15.115:0/491805098 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dac009560 con 0x7f6dbc0fe910 2024-09-13T17:16:48.927 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.924+0000 7f6dc2519640 1 --2- 172.21.15.115:0/491805098 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6dbc0fe910 0x7f6dbc196830 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6db800d6f0 tx=0x7f6db800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:48.927 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.924+0000 7f6db37fe640 1 -- 172.21.15.115:0/491805098 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6db8009a30 con 0x7f6dbc0fe910 2024-09-13T17:16:48.927 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.924+0000 7f6db37fe640 1 -- 172.21.15.115:0/491805098 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6db80054c0 con 0x7f6dbc0fe910 2024-09-13T17:16:48.927 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.924+0000 7f6dc477d640 1 -- 172.21.15.115:0/491805098 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dbc19f8a0 con 0x7f6dbc0fe910 2024-09-13T17:16:48.927 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.924+0000 7f6db37fe640 1 -- 172.21.15.115:0/491805098 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6db8004db0 con 0x7f6dbc0fe910 2024-09-13T17:16:48.927 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.924+0000 7f6dc477d640 1 -- 172.21.15.115:0/491805098 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dbc19fd20 con 0x7f6dbc0fe910 2024-09-13T17:16:48.928 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.925+0000 7f6dc477d640 1 -- 172.21.15.115:0/491805098 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dbc100050 con 0x7f6dbc0fe910 2024-09-13T17:16:48.928 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.925+0000 7f6db37fe640 1 -- 172.21.15.115:0/491805098 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f6db8004f30 con 0x7f6dbc0fe910 2024-09-13T17:16:48.928 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.926+0000 7f6db37fe640 1 --2- 172.21.15.115:0/491805098 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f6da806cbf0 0x7f6da806f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:48.928 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.926+0000 7f6db37fe640 1 -- 172.21.15.115:0/491805098 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f6db808c050 con 0x7f6dbc0fe910 2024-09-13T17:16:48.929 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.926+0000 7f6dc1d18640 1 --2- 172.21.15.115:0/491805098 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f6da806cbf0 0x7f6da806f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:48.929 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.926+0000 7f6dc1d18640 1 --2- 172.21.15.115:0/491805098 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f6da806cbf0 0x7f6da806f0b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc067c90 tx=0x7f6dac000bc0 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:48.932 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:48.930+0000 7f6db37fe640 1 -- 172.21.15.115:0/491805098 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f6db80560c0 con 0x7f6dbc0fe910 2024-09-13T17:16:49.093 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.092+0000 7f6dc477d640 1 -- 172.21.15.115:0/491805098 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f6dbc10ba70 con 0x7f6dbc0fe910 2024-09-13T17:16:49.094 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.092+0000 7f6db37fe640 1 -- 172.21.15.115:0/491805098 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v82) v1 ==== 107+0+11 (secure 0 0 0) 0x7f6db80596e0 con 0x7f6dbc0fe910 2024-09-13T17:16:49.094 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 32 2024-09-13T17:16:49.096 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.094+0000 7f6dc477d640 1 -- 172.21.15.115:0/491805098 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f6da806cbf0 msgr2=0x7f6da806f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:49.096 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.094+0000 7f6dc477d640 1 --2- 172.21.15.115:0/491805098 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f6da806cbf0 0x7f6da806f0b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc067c90 tx=0x7f6dac000bc0 comp rx=0 tx=0).stop 2024-09-13T17:16:49.096 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.094+0000 7f6dc477d640 1 -- 172.21.15.115:0/491805098 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6dbc0fe910 msgr2=0x7f6dbc196830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:49.096 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.094+0000 7f6dc477d640 1 --2- 172.21.15.115:0/491805098 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6dbc0fe910 0x7f6dbc196830 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6db800d6f0 tx=0x7f6db800dbb0 comp rx=0 tx=0).stop 2024-09-13T17:16:49.096 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.094+0000 7f6dc477d640 1 -- 172.21.15.115:0/491805098 shutdown_connections 2024-09-13T17:16:49.096 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.094+0000 7f6dc477d640 1 --2- 172.21.15.115:0/491805098 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f6da806cbf0 0x7f6da806f0b0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:49.096 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.094+0000 7f6dc477d640 1 --2- 172.21.15.115:0/491805098 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6dbc104920 0x7f6dbc196d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:49.096 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.094+0000 7f6dc477d640 1 --2- 172.21.15.115:0/491805098 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6dbc0fe910 0x7f6dbc196830 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:49.097 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.094+0000 7f6dc477d640 1 -- 172.21.15.115:0/491805098 >> 172.21.15.115:0/491805098 conn(0x7f6dbc0757b0 msgr2=0x7f6dbc0fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:49.097 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.094+0000 7f6dc477d640 1 -- 172.21.15.115:0/491805098 shutdown_connections 2024-09-13T17:16:49.097 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.094+0000 7f6dc477d640 1 -- 172.21.15.115:0/491805098 wait complete. 2024-09-13T17:16:49.105 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:16:48 smithi115 ceph-mon[109488]: pgmap v343: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T17:16:49.105 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:16:48 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:16:49.105 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:16:48 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:16:49.105 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:16:48 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:16:49.105 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:16:48 smithi115 ceph-mon[109488]: from='client.? 172.21.15.115:0/2151603087' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:16:49.105 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:16:48 smithi115 ceph-mon[109488]: from='client.? 172.21.15.115:0/3550512784' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T17:16:49.106 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-09-13T17:16:49.209 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.206+0000 7f590933e640 1 -- 172.21.15.115:0/3614068450 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5904104940 msgr2=0x7f5904104d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:49.209 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.206+0000 7f590933e640 1 --2- 172.21.15.115:0/3614068450 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5904104940 0x7f5904104d20 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f58f4009880 tx=0x7f58f402a4a0 comp rx=0 tx=0).stop 2024-09-13T17:16:49.209 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.206+0000 7f590933e640 1 -- 172.21.15.115:0/3614068450 shutdown_connections 2024-09-13T17:16:49.209 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.206+0000 7f590933e640 1 --2- 172.21.15.115:0/3614068450 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f59040fe930 0x7f59040fed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:49.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.206+0000 7f590933e640 1 --2- 172.21.15.115:0/3614068450 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5904104940 0x7f5904104d20 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:49.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.206+0000 7f590933e640 1 -- 172.21.15.115:0/3614068450 >> 172.21.15.115:0/3614068450 conn(0x7f59040fa650 msgr2=0x7f59040fca70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:49.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.206+0000 7f590933e640 1 -- 172.21.15.115:0/3614068450 shutdown_connections 2024-09-13T17:16:49.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.206+0000 7f590933e640 1 -- 172.21.15.115:0/3614068450 wait complete. 2024-09-13T17:16:49.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.206+0000 7f590933e640 1 Processor -- start 2024-09-13T17:16:49.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.206+0000 7f590933e640 1 -- start start 2024-09-13T17:16:49.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.207+0000 7f590933e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f59040fe930 0x7f590419a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:49.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.207+0000 7f590933e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5904104940 0x7f590419ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:49.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.207+0000 7f590933e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f590419b1e0 con 0x7f5904104940 2024-09-13T17:16:49.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.207+0000 7f590933e640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5904194730 con 0x7f59040fe930 2024-09-13T17:16:49.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.207+0000 7f59027fc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5904104940 0x7f590419ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:49.211 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.207+0000 7f59027fc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5904104940 0x7f590419ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:44078/0 (socket says 172.21.15.115:44078) 2024-09-13T17:16:49.211 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.207+0000 7f59027fc640 1 -- 172.21.15.115:0/3285414767 learned_addr learned my addr 172.21.15.115:0/3285414767 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:16:49.211 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.207+0000 7f5902ffd640 1 --2- 172.21.15.115:0/3285414767 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f59040fe930 0x7f590419a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:49.211 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.207+0000 7f59027fc640 1 -- 172.21.15.115:0/3285414767 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f59040fe930 msgr2=0x7f590419a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:49.211 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.207+0000 7f59027fc640 1 --2- 172.21.15.115:0/3285414767 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f59040fe930 0x7f590419a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:49.211 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.207+0000 7f59027fc640 1 -- 172.21.15.115:0/3285414767 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58f4009560 con 0x7f5904104940 2024-09-13T17:16:49.211 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.207+0000 7f59027fc640 1 --2- 172.21.15.115:0/3285414767 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5904104940 0x7f590419ab90 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f58f800c8a0 tx=0x7f58f800cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:49.211 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.207+0000 7f58ebfff640 1 -- 172.21.15.115:0/3285414767 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f58f8007b80 con 0x7f5904104940 2024-09-13T17:16:49.211 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.207+0000 7f590933e640 1 -- 172.21.15.115:0/3285414767 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59041949e0 con 0x7f5904104940 2024-09-13T17:16:49.211 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.207+0000 7f58ebfff640 1 -- 172.21.15.115:0/3285414767 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f58f8007ce0 con 0x7f5904104940 2024-09-13T17:16:49.211 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.207+0000 7f58ebfff640 1 -- 172.21.15.115:0/3285414767 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f58f8018770 con 0x7f5904104940 2024-09-13T17:16:49.211 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.207+0000 7f590933e640 1 -- 172.21.15.115:0/3285414767 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5904194f40 con 0x7f5904104940 2024-09-13T17:16:49.212 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.209+0000 7f590933e640 1 -- 172.21.15.115:0/3285414767 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5904100070 con 0x7f5904104940 2024-09-13T17:16:49.212 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.209+0000 7f58ebfff640 1 -- 172.21.15.115:0/3285414767 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f58f800f450 con 0x7f5904104940 2024-09-13T17:16:49.213 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.209+0000 7f58ebfff640 1 --2- 172.21.15.115:0/3285414767 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f58ec06cc60 0x7f58ec06f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:49.213 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.209+0000 7f58ebfff640 1 -- 172.21.15.115:0/3285414767 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f58f808c870 con 0x7f5904104940 2024-09-13T17:16:49.213 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.209+0000 7f5902ffd640 1 --2- 172.21.15.115:0/3285414767 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f58ec06cc60 0x7f58ec06f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:49.213 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.210+0000 7f5902ffd640 1 --2- 172.21.15.115:0/3285414767 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f58ec06cc60 0x7f58ec06f120 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f58f4005ab0 tx=0x7f58f4005a20 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:49.214 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.213+0000 7f58ebfff640 1 -- 172.21.15.115:0/3285414767 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f58f805a370 con 0x7f5904104940 2024-09-13T17:16:49.326 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:16:48 smithi195 ceph-mon[80021]: pgmap v343: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T17:16:49.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:16:48 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:16:49.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:16:48 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:16:49.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:16:48 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' 2024-09-13T17:16:49.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:16:48 smithi195 ceph-mon[80021]: from='client.? 172.21.15.115:0/2151603087' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:16:49.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:16:48 smithi195 ceph-mon[80021]: from='client.? 172.21.15.115:0/3550512784' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T17:16:49.374 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.373+0000 7f590933e640 1 -- 172.21.15.115:0/3285414767 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f59040fed90 con 0x7f5904104940 2024-09-13T17:16:49.375 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.373+0000 7f58ebfff640 1 -- 172.21.15.115:0/3285414767 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v82) v1 ==== 107+0+11 (secure 0 0 0) 0x7f58f8059f00 con 0x7f5904104940 2024-09-13T17:16:49.375 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 32 2024-09-13T17:16:49.377 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.375+0000 7f590933e640 1 -- 172.21.15.115:0/3285414767 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f58ec06cc60 msgr2=0x7f58ec06f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:49.377 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.375+0000 7f590933e640 1 --2- 172.21.15.115:0/3285414767 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f58ec06cc60 0x7f58ec06f120 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f58f4005ab0 tx=0x7f58f4005a20 comp rx=0 tx=0).stop 2024-09-13T17:16:49.377 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.375+0000 7f590933e640 1 -- 172.21.15.115:0/3285414767 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5904104940 msgr2=0x7f590419ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:49.377 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.375+0000 7f590933e640 1 --2- 172.21.15.115:0/3285414767 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5904104940 0x7f590419ab90 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f58f800c8a0 tx=0x7f58f800cd60 comp rx=0 tx=0).stop 2024-09-13T17:16:49.377 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.375+0000 7f590933e640 1 -- 172.21.15.115:0/3285414767 shutdown_connections 2024-09-13T17:16:49.377 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.375+0000 7f590933e640 1 --2- 172.21.15.115:0/3285414767 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f58ec06cc60 0x7f58ec06f120 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:49.377 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.375+0000 7f590933e640 1 --2- 172.21.15.115:0/3285414767 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5904104940 0x7f590419ab90 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:49.377 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.375+0000 7f590933e640 1 --2- 172.21.15.115:0/3285414767 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f59040fe930 0x7f590419a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:49.377 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.375+0000 7f590933e640 1 -- 172.21.15.115:0/3285414767 >> 172.21.15.115:0/3285414767 conn(0x7f59040fa650 msgr2=0x7f59040fc860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:49.378 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.376+0000 7f590933e640 1 -- 172.21.15.115:0/3285414767 shutdown_connections 2024-09-13T17:16:49.378 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.376+0000 7f590933e640 1 -- 172.21.15.115:0/3285414767 wait complete. 2024-09-13T17:16:49.387 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:16:49.485 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.484+0000 7f1f0a48b640 1 -- 172.21.15.115:0/2840687112 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1f040fe930 msgr2=0x7f1f040fed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:49.486 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.484+0000 7f1f0a48b640 1 --2- 172.21.15.115:0/2840687112 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1f040fe930 0x7f1f040fed90 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f1ef8009880 tx=0x7f1ef802a4a0 comp rx=0 tx=0).stop 2024-09-13T17:16:49.486 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.484+0000 7f1f0a48b640 1 -- 172.21.15.115:0/2840687112 shutdown_connections 2024-09-13T17:16:49.486 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.484+0000 7f1f0a48b640 1 --2- 172.21.15.115:0/2840687112 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1f040fe930 0x7f1f040fed90 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:49.486 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.484+0000 7f1f0a48b640 1 --2- 172.21.15.115:0/2840687112 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1f04104940 0x7f1f04104d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:49.486 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.484+0000 7f1f0a48b640 1 -- 172.21.15.115:0/2840687112 >> 172.21.15.115:0/2840687112 conn(0x7f1f040fa610 msgr2=0x7f1f040fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:49.486 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.484+0000 7f1f0a48b640 1 -- 172.21.15.115:0/2840687112 shutdown_connections 2024-09-13T17:16:49.487 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.484+0000 7f1f0a48b640 1 -- 172.21.15.115:0/2840687112 wait complete. 2024-09-13T17:16:49.487 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.484+0000 7f1f0a48b640 1 Processor -- start 2024-09-13T17:16:49.487 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.485+0000 7f1f0a48b640 1 -- start start 2024-09-13T17:16:49.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.485+0000 7f1f0a48b640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1f040fe930 0x7f1f0419a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:49.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.485+0000 7f1f0a48b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1f04104940 0x7f1f0419abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:49.489 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.485+0000 7f1f0a48b640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f04194750 con 0x7f1f04104940 2024-09-13T17:16:49.489 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.485+0000 7f1f0a48b640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f041948c0 con 0x7f1f040fe930 2024-09-13T17:16:49.489 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.485+0000 7f1f037fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1f04104940 0x7f1f0419abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:49.489 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.485+0000 7f1f037fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1f04104940 0x7f1f0419abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:44088/0 (socket says 172.21.15.115:44088) 2024-09-13T17:16:49.489 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.485+0000 7f1f037fe640 1 -- 172.21.15.115:0/2638830450 learned_addr learned my addr 172.21.15.115:0/2638830450 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:16:49.489 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.485+0000 7f1f037fe640 1 -- 172.21.15.115:0/2638830450 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1f040fe930 msgr2=0x7f1f0419a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:49.489 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.485+0000 7f1f03fff640 1 --2- 172.21.15.115:0/2638830450 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1f040fe930 0x7f1f0419a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:49.489 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.485+0000 7f1f037fe640 1 --2- 172.21.15.115:0/2638830450 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1f040fe930 0x7f1f0419a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:49.489 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.485+0000 7f1f037fe640 1 -- 172.21.15.115:0/2638830450 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ef8009560 con 0x7f1f04104940 2024-09-13T17:16:49.489 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.485+0000 7f1f037fe640 1 --2- 172.21.15.115:0/2638830450 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1f04104940 0x7f1f0419abb0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1ef8006010 tx=0x7f1ef80056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:49.490 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.486+0000 7f1f017fa640 1 -- 172.21.15.115:0/2638830450 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ef8004ba0 con 0x7f1f04104940 2024-09-13T17:16:49.490 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.486+0000 7f1f017fa640 1 -- 172.21.15.115:0/2638830450 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1ef8004d00 con 0x7f1f04104940 2024-09-13T17:16:49.490 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.486+0000 7f1f0a48b640 1 -- 172.21.15.115:0/2638830450 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f04194b40 con 0x7f1f04104940 2024-09-13T17:16:49.490 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.486+0000 7f1f017fa640 1 -- 172.21.15.115:0/2638830450 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ef8031910 con 0x7f1f04104940 2024-09-13T17:16:49.490 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.486+0000 7f1f0a48b640 1 -- 172.21.15.115:0/2638830450 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f04195040 con 0x7f1f04104940 2024-09-13T17:16:49.490 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.487+0000 7f1f0a48b640 1 -- 172.21.15.115:0/2638830450 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f04100070 con 0x7f1f04104940 2024-09-13T17:16:49.490 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.487+0000 7f1f017fa640 1 -- 172.21.15.115:0/2638830450 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f1ef8031b80 con 0x7f1f04104940 2024-09-13T17:16:49.491 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.488+0000 7f1f017fa640 1 --2- 172.21.15.115:0/2638830450 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f1eec06cc50 0x7f1eec06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:49.491 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.488+0000 7f1f017fa640 1 -- 172.21.15.115:0/2638830450 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f1ef80ad7d0 con 0x7f1f04104940 2024-09-13T17:16:49.491 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.488+0000 7f1f03fff640 1 --2- 172.21.15.115:0/2638830450 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f1eec06cc50 0x7f1eec06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:49.491 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.488+0000 7f1f03fff640 1 --2- 172.21.15.115:0/2638830450 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f1eec06cc50 0x7f1eec06f110 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1ef40058c0 tx=0x7f1ef4005c60 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:49.493 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.492+0000 7f1f017fa640 1 -- 172.21.15.115:0/2638830450 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f1ef8077840 con 0x7f1f04104940 2024-09-13T17:16:49.688 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.686+0000 7f1f0a48b640 1 -- 172.21.15.115:0/2638830450 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1f04106ec0 con 0x7f1f04104940 2024-09-13T17:16:49.688 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.687+0000 7f1f017fa640 1 -- 172.21.15.115:0/2638830450 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4840 (secure 0 0 0) 0x7f1ef807ae60 con 0x7f1f04104940 2024-09-13T17:16:49.688 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:16:49.689 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":39,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44271,"name":"cephfs.smithi195.qzghxj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6825/825791083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":825791083},{"type":"v1","addr":"172.21.15.195:6825","nonce":825791083}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":31},{"gid":44287,"name":"cephfs.smithi195.aevvgz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6827/589520116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":589520116},{"type":"v1","addr":"172.21.15.195:6827","nonce":589520116}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":39,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T17:03:16.313116+0000","modified":"2024-09-13T17:14:46.892655+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34320},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34320":{"gid":34320,"name":"cephfs.smithi115.hbtxod","rank":0,"incarnation":33,"state":"up:active","state_seq":17,"addr":"172.21.15.115:6827/2768011029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2768011029},{"type":"v1","addr":"172.21.15.115:6827","nonce":2768011029}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_34324":{"gid":34324,"name":"cephfs.smithi115.ijznvr","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.115:6829/2716683507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":2716683507},{"type":"v1","addr":"172.21.15.115:6829","nonce":2716683507}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-13T17:16:49.689 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 39 2024-09-13T17:16:49.690 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.689+0000 7f1f0a48b640 1 -- 172.21.15.115:0/2638830450 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f1eec06cc50 msgr2=0x7f1eec06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:49.690 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.689+0000 7f1f0a48b640 1 --2- 172.21.15.115:0/2638830450 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f1eec06cc50 0x7f1eec06f110 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1ef40058c0 tx=0x7f1ef4005c60 comp rx=0 tx=0).stop 2024-09-13T17:16:49.690 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.689+0000 7f1f0a48b640 1 -- 172.21.15.115:0/2638830450 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1f04104940 msgr2=0x7f1f0419abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:49.691 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.689+0000 7f1f0a48b640 1 --2- 172.21.15.115:0/2638830450 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1f04104940 0x7f1f0419abb0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1ef8006010 tx=0x7f1ef80056e0 comp rx=0 tx=0).stop 2024-09-13T17:16:49.691 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.689+0000 7f1f0a48b640 1 -- 172.21.15.115:0/2638830450 shutdown_connections 2024-09-13T17:16:49.691 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.689+0000 7f1f0a48b640 1 --2- 172.21.15.115:0/2638830450 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f1eec06cc50 0x7f1eec06f110 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:49.691 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.689+0000 7f1f0a48b640 1 --2- 172.21.15.115:0/2638830450 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1f04104940 0x7f1f0419abb0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:49.691 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.689+0000 7f1f0a48b640 1 --2- 172.21.15.115:0/2638830450 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1f040fe930 0x7f1f0419a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:49.691 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.689+0000 7f1f0a48b640 1 -- 172.21.15.115:0/2638830450 >> 172.21.15.115:0/2638830450 conn(0x7f1f040fa610 msgr2=0x7f1f040fb810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:49.691 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.689+0000 7f1f0a48b640 1 -- 172.21.15.115:0/2638830450 shutdown_connections 2024-09-13T17:16:49.691 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.689+0000 7f1f0a48b640 1 -- 172.21.15.115:0/2638830450 wait complete. 2024-09-13T17:16:49.701 DEBUG:tasks.fs:checking fs fscid=1,name=cephfs state = {'epoch': 19, 'max_mds': 1, 'flags': 50} 2024-09-13T17:16:49.702 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 20 2024-09-13T17:16:49.801 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.800+0000 7fe165e20640 1 -- 172.21.15.115:0/2690765716 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe160104920 msgr2=0x7fe160104d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:49.802 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.800+0000 7fe165e20640 1 --2- 172.21.15.115:0/2690765716 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe160104920 0x7fe160104d00 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe150009880 tx=0x7fe15002a4a0 comp rx=0 tx=0).stop 2024-09-13T17:16:49.802 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.800+0000 7fe165e20640 1 -- 172.21.15.115:0/2690765716 shutdown_connections 2024-09-13T17:16:49.802 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.800+0000 7fe165e20640 1 --2- 172.21.15.115:0/2690765716 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe1600fe910 0x7fe1600fed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:49.802 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.800+0000 7fe165e20640 1 --2- 172.21.15.115:0/2690765716 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe160104920 0x7fe160104d00 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:49.802 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.800+0000 7fe165e20640 1 -- 172.21.15.115:0/2690765716 >> 172.21.15.115:0/2690765716 conn(0x7fe1600fa5f0 msgr2=0x7fe1600fca10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:49.802 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.800+0000 7fe165e20640 1 -- 172.21.15.115:0/2690765716 shutdown_connections 2024-09-13T17:16:49.802 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.800+0000 7fe165e20640 1 -- 172.21.15.115:0/2690765716 wait complete. 2024-09-13T17:16:49.803 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.801+0000 7fe165e20640 1 Processor -- start 2024-09-13T17:16:49.805 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.801+0000 7fe165e20640 1 -- start start 2024-09-13T17:16:49.805 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.801+0000 7fe165e20640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1600fe910 0x7fe160196830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:49.805 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.801+0000 7fe165e20640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe160104920 0x7fe160196d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:49.805 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.801+0000 7fe165e20640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe160197340 con 0x7fe1600fe910 2024-09-13T17:16:49.805 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.801+0000 7fe165e20640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1601974b0 con 0x7fe160104920 2024-09-13T17:16:49.805 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.801+0000 7fe15f7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1600fe910 0x7fe160196830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:49.806 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.801+0000 7fe15f7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1600fe910 0x7fe160196830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:44108/0 (socket says 172.21.15.115:44108) 2024-09-13T17:16:49.806 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.801+0000 7fe15f7fe640 1 -- 172.21.15.115:0/501386016 learned_addr learned my addr 172.21.15.115:0/501386016 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:16:49.806 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.801+0000 7fe15effd640 1 --2- 172.21.15.115:0/501386016 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe160104920 0x7fe160196d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:49.806 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.801+0000 7fe15f7fe640 1 -- 172.21.15.115:0/501386016 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe160104920 msgr2=0x7fe160196d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:49.806 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.801+0000 7fe15f7fe640 1 --2- 172.21.15.115:0/501386016 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe160104920 0x7fe160196d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:49.806 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.801+0000 7fe15f7fe640 1 -- 172.21.15.115:0/501386016 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe150009560 con 0x7fe1600fe910 2024-09-13T17:16:49.806 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.802+0000 7fe15f7fe640 1 --2- 172.21.15.115:0/501386016 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1600fe910 0x7fe160196830 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe15002a9c0 tx=0x7fe1500055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:49.806 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.802+0000 7fe15cff9640 1 -- 172.21.15.115:0/501386016 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe150004aa0 con 0x7fe1600fe910 2024-09-13T17:16:49.806 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.802+0000 7fe15cff9640 1 -- 172.21.15.115:0/501386016 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe150004c00 con 0x7fe1600fe910 2024-09-13T17:16:49.806 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.802+0000 7fe165e20640 1 -- 172.21.15.115:0/501386016 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe16019f8a0 con 0x7fe1600fe910 2024-09-13T17:16:49.806 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.802+0000 7fe15cff9640 1 -- 172.21.15.115:0/501386016 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe150031750 con 0x7fe1600fe910 2024-09-13T17:16:49.806 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.802+0000 7fe165e20640 1 -- 172.21.15.115:0/501386016 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe16019fc60 con 0x7fe1600fe910 2024-09-13T17:16:49.807 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.803+0000 7fe165e20640 1 -- 172.21.15.115:0/501386016 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe160100050 con 0x7fe1600fe910 2024-09-13T17:16:49.807 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.803+0000 7fe15cff9640 1 -- 172.21.15.115:0/501386016 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fe1500035f0 con 0x7fe1600fe910 2024-09-13T17:16:49.807 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.804+0000 7fe15cff9640 1 --2- 172.21.15.115:0/501386016 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fe14806cc50 0x7fe14806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:49.807 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.804+0000 7fe15cff9640 1 -- 172.21.15.115:0/501386016 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fe1500ad5c0 con 0x7fe1600fe910 2024-09-13T17:16:49.807 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.804+0000 7fe15effd640 1 --2- 172.21.15.115:0/501386016 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fe14806cc50 0x7fe14806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:49.807 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.804+0000 7fe15effd640 1 --2- 172.21.15.115:0/501386016 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fe14806cc50 0x7fe14806f110 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe160068810 tx=0x7fe154005f90 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:49.809 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:49.808+0000 7fe15cff9640 1 -- 172.21.15.115:0/501386016 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe150077630 con 0x7fe1600fe910 2024-09-13T17:16:50.005 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.004+0000 7fe165e20640 1 -- 172.21.15.115:0/501386016 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 20, "format": "json"} v 0) v1 -- 0x7fe1600fed70 con 0x7fe1600fe910 2024-09-13T17:16:50.005 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.004+0000 7fe15cff9640 1 -- 172.21.15.115:0/501386016 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 20, "format": "json"}]=0 dumped fsmap epoch 20 v39) v1 ==== 107+0+4047 (secure 0 0 0) 0x7fe15007ac50 con 0x7fe1600fe910 2024-09-13T17:16:50.006 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:16:50.006 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24253,"name":"cephfs.smithi195.aevvgz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.195:6827/8826118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":8826118},{"type":"v1","addr":"172.21.15.195:6827","nonce":8826118}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":24259,"name":"cephfs.smithi195.qzghxj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6825/3335357704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3335357704},{"type":"v1","addr":"172.21.15.195:6825","nonce":3335357704}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T17:03:16.313116+0000","modified":"2024-09-13T17:13:08.443680+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14470":{"gid":14470,"name":"cephfs.smithi115.ijznvr","rank":0,"incarnation":15,"state":"up:active","state_seq":5,"addr":"172.21.15.115:6829/4128583274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":4128583274},{"type":"v1","addr":"172.21.15.115:6829","nonce":4128583274}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-13T17:16:50.006 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 20 2024-09-13T17:16:50.008 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.006+0000 7fe165e20640 1 -- 172.21.15.115:0/501386016 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fe14806cc50 msgr2=0x7fe14806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:50.008 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.006+0000 7fe165e20640 1 --2- 172.21.15.115:0/501386016 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fe14806cc50 0x7fe14806f110 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe160068810 tx=0x7fe154005f90 comp rx=0 tx=0).stop 2024-09-13T17:16:50.008 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.006+0000 7fe165e20640 1 -- 172.21.15.115:0/501386016 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1600fe910 msgr2=0x7fe160196830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:50.008 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.006+0000 7fe165e20640 1 --2- 172.21.15.115:0/501386016 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1600fe910 0x7fe160196830 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe15002a9c0 tx=0x7fe1500055a0 comp rx=0 tx=0).stop 2024-09-13T17:16:50.008 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.006+0000 7fe165e20640 1 -- 172.21.15.115:0/501386016 shutdown_connections 2024-09-13T17:16:50.008 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.006+0000 7fe165e20640 1 --2- 172.21.15.115:0/501386016 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fe14806cc50 0x7fe14806f110 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:50.008 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.006+0000 7fe165e20640 1 --2- 172.21.15.115:0/501386016 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe160104920 0x7fe160196d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:50.008 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.006+0000 7fe165e20640 1 --2- 172.21.15.115:0/501386016 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1600fe910 0x7fe160196830 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:50.008 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.006+0000 7fe165e20640 1 -- 172.21.15.115:0/501386016 >> 172.21.15.115:0/501386016 conn(0x7fe1600fa5f0 msgr2=0x7fe1600fb870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:50.008 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.006+0000 7fe165e20640 1 -- 172.21.15.115:0/501386016 shutdown_connections 2024-09-13T17:16:50.008 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.006+0000 7fe165e20640 1 -- 172.21.15.115:0/501386016 wait complete. 2024-09-13T17:16:50.018 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 20 2024-09-13T17:16:50.018 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 21 2024-09-13T17:16:50.121 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.117+0000 7f06a24e9640 1 -- 172.21.15.115:0/652931880 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f069c104910 msgr2=0x7f069c104cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:50.121 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.117+0000 7f06a24e9640 1 --2- 172.21.15.115:0/652931880 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f069c104910 0x7f069c104cf0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f068c009880 tx=0x7f068c02a4d0 comp rx=0 tx=0).stop 2024-09-13T17:16:50.121 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.117+0000 7f06a24e9640 1 -- 172.21.15.115:0/652931880 shutdown_connections 2024-09-13T17:16:50.121 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.117+0000 7f06a24e9640 1 --2- 172.21.15.115:0/652931880 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f069c0fe900 0x7f069c0fed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:50.121 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.117+0000 7f06a24e9640 1 --2- 172.21.15.115:0/652931880 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f069c104910 0x7f069c104cf0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:50.121 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.117+0000 7f06a24e9640 1 -- 172.21.15.115:0/652931880 >> 172.21.15.115:0/652931880 conn(0x7f069c075750 msgr2=0x7f069c0fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:50.121 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.117+0000 7f06a24e9640 1 -- 172.21.15.115:0/652931880 shutdown_connections 2024-09-13T17:16:50.121 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.117+0000 7f06a24e9640 1 -- 172.21.15.115:0/652931880 wait complete. 2024-09-13T17:16:50.121 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.118+0000 7f06a24e9640 1 Processor -- start 2024-09-13T17:16:50.122 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.118+0000 7f06a24e9640 1 -- start start 2024-09-13T17:16:50.122 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.118+0000 7f06a24e9640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f069c0fe900 0x7f069c196960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:50.122 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.118+0000 7f06a24e9640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f069c104910 0x7f069c196ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:50.122 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.118+0000 7f06a24e9640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f069c197470 con 0x7f069c104910 2024-09-13T17:16:50.122 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.118+0000 7f06a24e9640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f069c1975e0 con 0x7f069c0fe900 2024-09-13T17:16:50.122 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.118+0000 7f0693fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f069c104910 0x7f069c196ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:50.122 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.118+0000 7f0693fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f069c104910 0x7f069c196ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:44128/0 (socket says 172.21.15.115:44128) 2024-09-13T17:16:50.122 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.118+0000 7f0693fff640 1 -- 172.21.15.115:0/2147397542 learned_addr learned my addr 172.21.15.115:0/2147397542 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:16:50.122 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.118+0000 7f069bfff640 1 --2- 172.21.15.115:0/2147397542 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f069c0fe900 0x7f069c196960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:50.122 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.118+0000 7f0693fff640 1 -- 172.21.15.115:0/2147397542 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f069c0fe900 msgr2=0x7f069c196960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:50.122 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.118+0000 7f0693fff640 1 --2- 172.21.15.115:0/2147397542 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f069c0fe900 0x7f069c196960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:50.122 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.118+0000 7f0693fff640 1 -- 172.21.15.115:0/2147397542 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f068c009560 con 0x7f069c104910 2024-09-13T17:16:50.122 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.119+0000 7f0693fff640 1 --2- 172.21.15.115:0/2147397542 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f069c104910 0x7f069c196ea0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f068400b3d0 tx=0x7f068400b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:50.123 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.119+0000 7f0699ffb640 1 -- 172.21.15.115:0/2147397542 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0684011800 con 0x7f069c104910 2024-09-13T17:16:50.123 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.119+0000 7f06a24e9640 1 -- 172.21.15.115:0/2147397542 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f069c19f9d0 con 0x7f069c104910 2024-09-13T17:16:50.123 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.119+0000 7f0699ffb640 1 -- 172.21.15.115:0/2147397542 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0684011e00 con 0x7f069c104910 2024-09-13T17:16:50.123 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.119+0000 7f0699ffb640 1 -- 172.21.15.115:0/2147397542 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f068400f2e0 con 0x7f069c104910 2024-09-13T17:16:50.123 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.119+0000 7f06a24e9640 1 -- 172.21.15.115:0/2147397542 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f069c19fe50 con 0x7f069c104910 2024-09-13T17:16:50.123 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.120+0000 7f06a24e9640 1 -- 172.21.15.115:0/2147397542 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f069c100040 con 0x7f069c104910 2024-09-13T17:16:50.124 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.120+0000 7f0699ffb640 1 -- 172.21.15.115:0/2147397542 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f0684010380 con 0x7f069c104910 2024-09-13T17:16:50.124 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.121+0000 7f0699ffb640 1 --2- 172.21.15.115:0/2147397542 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f068806cc50 0x7f068806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:50.124 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.121+0000 7f0699ffb640 1 -- 172.21.15.115:0/2147397542 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f068408c270 con 0x7f069c104910 2024-09-13T17:16:50.124 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.121+0000 7f069bfff640 1 --2- 172.21.15.115:0/2147397542 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f068806cc50 0x7f068806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:50.124 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.121+0000 7f069bfff640 1 --2- 172.21.15.115:0/2147397542 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f068806cc50 0x7f068806f110 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f068c005ab0 tx=0x7f068c005a00 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:50.128 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.125+0000 7f0699ffb640 1 -- 172.21.15.115:0/2147397542 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f06840562e0 con 0x7f069c104910 2024-09-13T17:16:50.322 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.321+0000 7f06a24e9640 1 -- 172.21.15.115:0/2147397542 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 21, "format": "json"} v 0) v1 -- 0x7f069c0fede0 con 0x7f069c104910 2024-09-13T17:16:50.323 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.322+0000 7f0699ffb640 1 -- 172.21.15.115:0/2147397542 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 21, "format": "json"}]=0 dumped fsmap epoch 21 v39) v1 ==== 107+0+4829 (secure 0 0 0) 0x7f0684059900 con 0x7f069c104910 2024-09-13T17:16:50.324 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:16:50.324 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24253,"name":"cephfs.smithi195.aevvgz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.195:6827/8826118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":8826118},{"type":"v1","addr":"172.21.15.195:6827","nonce":8826118}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":24259,"name":"cephfs.smithi195.qzghxj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6825/3335357704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3335357704},{"type":"v1","addr":"172.21.15.195:6825","nonce":3335357704}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":34288,"name":"cephfs.smithi115.hbtxod","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6827/1135049211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":1135049211},{"type":"v1","addr":"172.21.15.115:6827","nonce":1135049211}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T17:03:16.313116+0000","modified":"2024-09-13T17:13:08.443680+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14470":{"gid":14470,"name":"cephfs.smithi115.ijznvr","rank":0,"incarnation":15,"state":"up:active","state_seq":5,"addr":"172.21.15.115:6829/4128583274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":4128583274},{"type":"v1","addr":"172.21.15.115:6829","nonce":4128583274}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-13T17:16:50.324 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 21 2024-09-13T17:16:50.326 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.324+0000 7f06a24e9640 1 -- 172.21.15.115:0/2147397542 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f068806cc50 msgr2=0x7f068806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:50.326 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.324+0000 7f06a24e9640 1 --2- 172.21.15.115:0/2147397542 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f068806cc50 0x7f068806f110 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f068c005ab0 tx=0x7f068c005a00 comp rx=0 tx=0).stop 2024-09-13T17:16:50.326 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.324+0000 7f06a24e9640 1 -- 172.21.15.115:0/2147397542 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f069c104910 msgr2=0x7f069c196ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:50.326 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.324+0000 7f06a24e9640 1 --2- 172.21.15.115:0/2147397542 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f069c104910 0x7f069c196ea0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f068400b3d0 tx=0x7f068400b890 comp rx=0 tx=0).stop 2024-09-13T17:16:50.326 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.324+0000 7f06a24e9640 1 -- 172.21.15.115:0/2147397542 shutdown_connections 2024-09-13T17:16:50.326 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.324+0000 7f06a24e9640 1 --2- 172.21.15.115:0/2147397542 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f068806cc50 0x7f068806f110 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:50.327 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.324+0000 7f06a24e9640 1 --2- 172.21.15.115:0/2147397542 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f069c104910 0x7f069c196ea0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:50.327 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.324+0000 7f06a24e9640 1 --2- 172.21.15.115:0/2147397542 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f069c0fe900 0x7f069c196960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:50.327 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.324+0000 7f06a24e9640 1 -- 172.21.15.115:0/2147397542 >> 172.21.15.115:0/2147397542 conn(0x7f069c075750 msgr2=0x7f069c1022c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:50.327 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.324+0000 7f06a24e9640 1 -- 172.21.15.115:0/2147397542 shutdown_connections 2024-09-13T17:16:50.327 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.324+0000 7f06a24e9640 1 -- 172.21.15.115:0/2147397542 wait complete. 2024-09-13T17:16:50.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:16:49 smithi195 ceph-mon[80021]: from='client.? 172.21.15.115:0/491805098' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-09-13T17:16:50.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:16:49 smithi195 ceph-mon[80021]: from='client.? 172.21.15.115:0/3285414767' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-09-13T17:16:50.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:16:49 smithi195 ceph-mon[80021]: pgmap v344: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:16:50.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:16:49 smithi195 ceph-mon[80021]: from='client.? 172.21.15.115:0/2638830450' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:16:50.335 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:16:49 smithi115 ceph-mon[109488]: from='client.? 172.21.15.115:0/491805098' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-09-13T17:16:50.335 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:16:49 smithi115 ceph-mon[109488]: from='client.? 172.21.15.115:0/3285414767' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-09-13T17:16:50.335 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:16:49 smithi115 ceph-mon[109488]: pgmap v344: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T17:16:50.335 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:16:49 smithi115 ceph-mon[109488]: from='client.? 172.21.15.115:0/2638830450' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:16:50.337 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 21 2024-09-13T17:16:50.337 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 22 2024-09-13T17:16:50.439 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.435+0000 7f68caa87640 1 -- 172.21.15.115:0/1821916744 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f68c40fe900 msgr2=0x7f68c40fed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:50.439 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.435+0000 7f68caa87640 1 --2- 172.21.15.115:0/1821916744 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f68c40fe900 0x7f68c40fed60 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f68b4009880 tx=0x7f68b402a4a0 comp rx=0 tx=0).stop 2024-09-13T17:16:50.439 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.435+0000 7f68caa87640 1 -- 172.21.15.115:0/1821916744 shutdown_connections 2024-09-13T17:16:50.439 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.435+0000 7f68caa87640 1 --2- 172.21.15.115:0/1821916744 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f68c40fe900 0x7f68c40fed60 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:50.439 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.435+0000 7f68caa87640 1 --2- 172.21.15.115:0/1821916744 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f68c4104910 0x7f68c4104cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:50.439 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.435+0000 7f68caa87640 1 -- 172.21.15.115:0/1821916744 >> 172.21.15.115:0/1821916744 conn(0x7f68c4075750 msgr2=0x7f68c40fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:50.439 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.435+0000 7f68caa87640 1 -- 172.21.15.115:0/1821916744 shutdown_connections 2024-09-13T17:16:50.440 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.435+0000 7f68caa87640 1 -- 172.21.15.115:0/1821916744 wait complete. 2024-09-13T17:16:50.440 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.436+0000 7f68caa87640 1 Processor -- start 2024-09-13T17:16:50.440 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.436+0000 7f68caa87640 1 -- start start 2024-09-13T17:16:50.440 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.436+0000 7f68caa87640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f68c40fe900 0x7f68c419a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:50.440 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.436+0000 7f68caa87640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f68c4104910 0x7f68c419ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:50.440 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.436+0000 7f68caa87640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c4194800 con 0x7f68c4104910 2024-09-13T17:16:50.440 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.436+0000 7f68caa87640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c4194970 con 0x7f68c40fe900 2024-09-13T17:16:50.440 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.436+0000 7f68bbfff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f68c4104910 0x7f68c419ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:50.440 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.436+0000 7f68bbfff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f68c4104910 0x7f68c419ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:44148/0 (socket says 172.21.15.115:44148) 2024-09-13T17:16:50.440 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.436+0000 7f68bbfff640 1 -- 172.21.15.115:0/623966260 learned_addr learned my addr 172.21.15.115:0/623966260 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:16:50.440 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.437+0000 7f68bbfff640 1 -- 172.21.15.115:0/623966260 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f68c40fe900 msgr2=0x7f68c419a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:50.440 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.437+0000 7f68bbfff640 1 --2- 172.21.15.115:0/623966260 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f68c40fe900 0x7f68c419a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:50.441 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.437+0000 7f68bbfff640 1 -- 172.21.15.115:0/623966260 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68b4009560 con 0x7f68c4104910 2024-09-13T17:16:50.441 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.437+0000 7f68bbfff640 1 --2- 172.21.15.115:0/623966260 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f68c4104910 0x7f68c419ac60 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f68b4006010 tx=0x7f68b40056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:50.441 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.437+0000 7f68b9ffb640 1 -- 172.21.15.115:0/623966260 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f68b403e070 con 0x7f68c4104910 2024-09-13T17:16:50.441 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.437+0000 7f68b9ffb640 1 -- 172.21.15.115:0/623966260 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f68b40035f0 con 0x7f68c4104910 2024-09-13T17:16:50.441 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.437+0000 7f68caa87640 1 -- 172.21.15.115:0/623966260 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68c4194bf0 con 0x7f68c4104910 2024-09-13T17:16:50.441 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.437+0000 7f68b9ffb640 1 -- 172.21.15.115:0/623966260 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f68b4031790 con 0x7f68c4104910 2024-09-13T17:16:50.441 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.437+0000 7f68caa87640 1 -- 172.21.15.115:0/623966260 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68c41950f0 con 0x7f68c4104910 2024-09-13T17:16:50.442 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.438+0000 7f68caa87640 1 -- 172.21.15.115:0/623966260 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68c4100040 con 0x7f68c4104910 2024-09-13T17:16:50.442 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.439+0000 7f68b9ffb640 1 -- 172.21.15.115:0/623966260 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f68b4003760 con 0x7f68c4104910 2024-09-13T17:16:50.443 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.439+0000 7f68b9ffb640 1 --2- 172.21.15.115:0/623966260 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f68ac06cc50 0x7f68ac06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:50.443 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.439+0000 7f68b9ffb640 1 -- 172.21.15.115:0/623966260 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f68b40aead0 con 0x7f68c4104910 2024-09-13T17:16:50.443 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.439+0000 7f68c8823640 1 --2- 172.21.15.115:0/623966260 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f68ac06cc50 0x7f68ac06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:50.443 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.440+0000 7f68c8823640 1 --2- 172.21.15.115:0/623966260 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f68ac06cc50 0x7f68ac06f110 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f68c0009710 tx=0x7f68c0006c90 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:50.444 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.443+0000 7f68b9ffb640 1 -- 172.21.15.115:0/623966260 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f68b4078b40 con 0x7f68c4104910 2024-09-13T17:16:50.640 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.639+0000 7f68caa87640 1 -- 172.21.15.115:0/623966260 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 22, "format": "json"} v 0) v1 -- 0x7f68c410bac0 con 0x7f68c4104910 2024-09-13T17:16:50.641 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.639+0000 7f68b9ffb640 1 -- 172.21.15.115:0/623966260 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 22, "format": "json"}]=0 dumped fsmap epoch 22 v39) v1 ==== 107+0+4047 (secure 0 0 0) 0x7f68b407c160 con 0x7f68c4104910 2024-09-13T17:16:50.641 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:16:50.642 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24253,"name":"cephfs.smithi195.aevvgz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.195:6827/8826118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":8826118},{"type":"v1","addr":"172.21.15.195:6827","nonce":8826118}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":24259,"name":"cephfs.smithi195.qzghxj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6825/3335357704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3335357704},{"type":"v1","addr":"172.21.15.195:6825","nonce":3335357704}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T17:03:16.313116+0000","modified":"2024-09-13T17:13:08.443680+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14470":{"gid":14470,"name":"cephfs.smithi115.ijznvr","rank":0,"incarnation":15,"state":"up:active","state_seq":5,"addr":"172.21.15.115:6829/4128583274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":4128583274},{"type":"v1","addr":"172.21.15.115:6829","nonce":4128583274}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-13T17:16:50.643 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 22 2024-09-13T17:16:50.644 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.641+0000 7f68caa87640 1 -- 172.21.15.115:0/623966260 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f68ac06cc50 msgr2=0x7f68ac06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:50.644 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.641+0000 7f68caa87640 1 --2- 172.21.15.115:0/623966260 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f68ac06cc50 0x7f68ac06f110 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f68c0009710 tx=0x7f68c0006c90 comp rx=0 tx=0).stop 2024-09-13T17:16:50.644 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.641+0000 7f68caa87640 1 -- 172.21.15.115:0/623966260 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f68c4104910 msgr2=0x7f68c419ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:50.644 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.641+0000 7f68caa87640 1 --2- 172.21.15.115:0/623966260 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f68c4104910 0x7f68c419ac60 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f68b4006010 tx=0x7f68b40056e0 comp rx=0 tx=0).stop 2024-09-13T17:16:50.644 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.641+0000 7f68caa87640 1 -- 172.21.15.115:0/623966260 shutdown_connections 2024-09-13T17:16:50.644 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.641+0000 7f68caa87640 1 --2- 172.21.15.115:0/623966260 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f68ac06cc50 0x7f68ac06f110 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:50.644 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.641+0000 7f68caa87640 1 --2- 172.21.15.115:0/623966260 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f68c4104910 0x7f68c419ac60 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:50.644 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.641+0000 7f68caa87640 1 --2- 172.21.15.115:0/623966260 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f68c40fe900 0x7f68c419a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:50.644 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.641+0000 7f68caa87640 1 -- 172.21.15.115:0/623966260 >> 172.21.15.115:0/623966260 conn(0x7f68c4075750 msgr2=0x7f68c4102300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:50.644 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.641+0000 7f68caa87640 1 -- 172.21.15.115:0/623966260 shutdown_connections 2024-09-13T17:16:50.644 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.641+0000 7f68caa87640 1 -- 172.21.15.115:0/623966260 wait complete. 2024-09-13T17:16:50.653 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 22 2024-09-13T17:16:50.654 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 23 2024-09-13T17:16:50.755 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.752+0000 7fe01d508640 1 -- 172.21.15.115:0/585533497 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0181014f0 msgr2=0x7fe0181099d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:50.755 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.752+0000 7fe01d508640 1 --2- 172.21.15.115:0/585533497 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0181014f0 0x7fe0181099d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fe000009880 tx=0x7fe00002a530 comp rx=0 tx=0).stop 2024-09-13T17:16:50.755 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.752+0000 7fe01d508640 1 -- 172.21.15.115:0/585533497 shutdown_connections 2024-09-13T17:16:50.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.752+0000 7fe01d508640 1 --2- 172.21.15.115:0/585533497 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0181014f0 0x7fe0181099d0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:50.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.752+0000 7fe01d508640 1 --2- 172.21.15.115:0/585533497 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe018100bd0 0x7fe018100fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:50.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.752+0000 7fe01d508640 1 -- 172.21.15.115:0/585533497 >> 172.21.15.115:0/585533497 conn(0x7fe018075750 msgr2=0x7fe0180fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:50.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.752+0000 7fe01d508640 1 -- 172.21.15.115:0/585533497 shutdown_connections 2024-09-13T17:16:50.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.752+0000 7fe01d508640 1 -- 172.21.15.115:0/585533497 wait complete. 2024-09-13T17:16:50.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.753+0000 7fe01d508640 1 Processor -- start 2024-09-13T17:16:50.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.753+0000 7fe01d508640 1 -- start start 2024-09-13T17:16:50.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.753+0000 7fe01d508640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe018100bd0 0x7fe0181959e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:50.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.753+0000 7fe01d508640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0181014f0 0x7fe018195f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:50.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.753+0000 7fe01d508640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe018196600 con 0x7fe0181014f0 2024-09-13T17:16:50.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.753+0000 7fe01d508640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe01819a340 con 0x7fe018100bd0 2024-09-13T17:16:50.757 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.753+0000 7fe00e7fc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0181014f0 0x7fe018195f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:50.757 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.753+0000 7fe00e7fc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0181014f0 0x7fe018195f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:44164/0 (socket says 172.21.15.115:44164) 2024-09-13T17:16:50.757 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.753+0000 7fe00e7fc640 1 -- 172.21.15.115:0/1886871293 learned_addr learned my addr 172.21.15.115:0/1886871293 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:16:50.757 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.754+0000 7fe00e7fc640 1 -- 172.21.15.115:0/1886871293 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe018100bd0 msgr2=0x7fe0181959e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:50.757 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.754+0000 7fe00e7fc640 1 --2- 172.21.15.115:0/1886871293 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe018100bd0 0x7fe0181959e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:50.757 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.754+0000 7fe00e7fc640 1 -- 172.21.15.115:0/1886871293 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe000009560 con 0x7fe0181014f0 2024-09-13T17:16:50.757 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.754+0000 7fe00e7fc640 1 --2- 172.21.15.115:0/1886871293 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0181014f0 0x7fe018195f20 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe00002aa50 tx=0x7fe0000055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:50.757 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.754+0000 7fe014ff9640 1 -- 172.21.15.115:0/1886871293 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe000004aa0 con 0x7fe0181014f0 2024-09-13T17:16:50.757 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.754+0000 7fe01d508640 1 -- 172.21.15.115:0/1886871293 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe01819a5c0 con 0x7fe0181014f0 2024-09-13T17:16:50.757 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.754+0000 7fe014ff9640 1 -- 172.21.15.115:0/1886871293 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe000004c00 con 0x7fe0181014f0 2024-09-13T17:16:50.757 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.754+0000 7fe014ff9640 1 -- 172.21.15.115:0/1886871293 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe000031750 con 0x7fe0181014f0 2024-09-13T17:16:50.758 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.754+0000 7fe01d508640 1 -- 172.21.15.115:0/1886871293 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe01819aac0 con 0x7fe0181014f0 2024-09-13T17:16:50.759 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.755+0000 7fe01d508640 1 -- 172.21.15.115:0/1886871293 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe018067d30 con 0x7fe0181014f0 2024-09-13T17:16:50.759 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.755+0000 7fe014ff9640 1 -- 172.21.15.115:0/1886871293 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fe00002ad50 con 0x7fe0181014f0 2024-09-13T17:16:50.759 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.756+0000 7fe014ff9640 1 --2- 172.21.15.115:0/1886871293 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fe00406cc50 0x7fe00406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:50.759 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.756+0000 7fe014ff9640 1 -- 172.21.15.115:0/1886871293 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fe0000ad310 con 0x7fe0181014f0 2024-09-13T17:16:50.759 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.756+0000 7fe016ffd640 1 --2- 172.21.15.115:0/1886871293 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fe00406cc50 0x7fe00406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:50.759 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.756+0000 7fe016ffd640 1 --2- 172.21.15.115:0/1886871293 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fe00406cc50 0x7fe00406f110 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe008005fd0 tx=0x7fe008005850 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:50.761 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.760+0000 7fe014ff9640 1 -- 172.21.15.115:0/1886871293 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe000077380 con 0x7fe0181014f0 2024-09-13T17:16:50.955 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.954+0000 7fe01d508640 1 -- 172.21.15.115:0/1886871293 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 23, "format": "json"} v 0) v1 -- 0x7fe018196d30 con 0x7fe0181014f0 2024-09-13T17:16:50.958 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.957+0000 7fe014ff9640 1 -- 172.21.15.115:0/1886871293 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 23, "format": "json"}]=0 dumped fsmap epoch 23 v39) v1 ==== 107+0+4829 (secure 0 0 0) 0x7fe00007a9a0 con 0x7fe0181014f0 2024-09-13T17:16:50.958 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:16:50.958 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24253,"name":"cephfs.smithi195.aevvgz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.195:6827/8826118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":8826118},{"type":"v1","addr":"172.21.15.195:6827","nonce":8826118}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":24259,"name":"cephfs.smithi195.qzghxj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6825/3335357704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3335357704},{"type":"v1","addr":"172.21.15.195:6825","nonce":3335357704}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":34320,"name":"cephfs.smithi115.hbtxod","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6827/2768011029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2768011029},{"type":"v1","addr":"172.21.15.115:6827","nonce":2768011029}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T17:03:16.313116+0000","modified":"2024-09-13T17:13:08.443680+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14470":{"gid":14470,"name":"cephfs.smithi115.ijznvr","rank":0,"incarnation":15,"state":"up:active","state_seq":5,"addr":"172.21.15.115:6829/4128583274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":4128583274},{"type":"v1","addr":"172.21.15.115:6829","nonce":4128583274}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-13T17:16:50.959 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 23 2024-09-13T17:16:50.960 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.959+0000 7fe01d508640 1 -- 172.21.15.115:0/1886871293 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fe00406cc50 msgr2=0x7fe00406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:50.960 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.959+0000 7fe01d508640 1 --2- 172.21.15.115:0/1886871293 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fe00406cc50 0x7fe00406f110 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe008005fd0 tx=0x7fe008005850 comp rx=0 tx=0).stop 2024-09-13T17:16:50.960 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.959+0000 7fe01d508640 1 -- 172.21.15.115:0/1886871293 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0181014f0 msgr2=0x7fe018195f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:50.961 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.959+0000 7fe01d508640 1 --2- 172.21.15.115:0/1886871293 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0181014f0 0x7fe018195f20 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe00002aa50 tx=0x7fe0000055a0 comp rx=0 tx=0).stop 2024-09-13T17:16:50.961 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.959+0000 7fe01d508640 1 -- 172.21.15.115:0/1886871293 shutdown_connections 2024-09-13T17:16:50.961 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.959+0000 7fe01d508640 1 --2- 172.21.15.115:0/1886871293 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fe00406cc50 0x7fe00406f110 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:50.961 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.959+0000 7fe01d508640 1 --2- 172.21.15.115:0/1886871293 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0181014f0 0x7fe018195f20 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:50.961 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.959+0000 7fe01d508640 1 --2- 172.21.15.115:0/1886871293 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe018100bd0 0x7fe0181959e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:50.961 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.959+0000 7fe01d508640 1 -- 172.21.15.115:0/1886871293 >> 172.21.15.115:0/1886871293 conn(0x7fe018075750 msgr2=0x7fe018101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:50.961 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.959+0000 7fe01d508640 1 -- 172.21.15.115:0/1886871293 shutdown_connections 2024-09-13T17:16:50.961 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:50.959+0000 7fe01d508640 1 -- 172.21.15.115:0/1886871293 wait complete. 2024-09-13T17:16:50.971 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 23 2024-09-13T17:16:50.971 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 24 2024-09-13T17:16:51.074 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.070+0000 7f7bdf0a3640 1 -- 172.21.15.115:0/667149666 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7bd8103950 msgr2=0x7f7bd8103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:51.074 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.070+0000 7f7bdf0a3640 1 --2- 172.21.15.115:0/667149666 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7bd8103950 0x7f7bd8103d30 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7bc0009c20 tx=0x7f7bc002a970 comp rx=0 tx=0).stop 2024-09-13T17:16:51.074 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.070+0000 7f7bdf0a3640 1 -- 172.21.15.115:0/667149666 shutdown_connections 2024-09-13T17:16:51.074 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.070+0000 7f7bdf0a3640 1 --2- 172.21.15.115:0/667149666 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7bd80ff0f0 0x7f7bd80ff530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:51.074 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.070+0000 7f7bdf0a3640 1 --2- 172.21.15.115:0/667149666 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7bd8103950 0x7f7bd8103d30 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:51.075 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.070+0000 7f7bdf0a3640 1 -- 172.21.15.115:0/667149666 >> 172.21.15.115:0/667149666 conn(0x7f7bd80f9db0 msgr2=0x7f7bd80fc1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:51.075 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.070+0000 7f7bdf0a3640 1 -- 172.21.15.115:0/667149666 shutdown_connections 2024-09-13T17:16:51.075 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.070+0000 7f7bdf0a3640 1 -- 172.21.15.115:0/667149666 wait complete. 2024-09-13T17:16:51.075 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.070+0000 7f7bdf0a3640 1 Processor -- start 2024-09-13T17:16:51.075 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.071+0000 7f7bdf0a3640 1 -- start start 2024-09-13T17:16:51.075 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.071+0000 7f7bdf0a3640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7bd80ff0f0 0x7f7bd819da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:51.075 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.071+0000 7f7bdf0a3640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7bd8103950 0x7f7bd819dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:51.075 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.071+0000 7f7bdf0a3640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd8197b40 con 0x7f7bd80ff0f0 2024-09-13T17:16:51.075 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.071+0000 7f7bdf0a3640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd8197cb0 con 0x7f7bd8103950 2024-09-13T17:16:51.075 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.071+0000 7f7bdce3f640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7bd80ff0f0 0x7f7bd819da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:51.076 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.071+0000 7f7bdce3f640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7bd80ff0f0 0x7f7bd819da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:44188/0 (socket says 172.21.15.115:44188) 2024-09-13T17:16:51.076 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.071+0000 7f7bdce3f640 1 -- 172.21.15.115:0/3810034533 learned_addr learned my addr 172.21.15.115:0/3810034533 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:16:51.076 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.071+0000 7f7bd7fff640 1 --2- 172.21.15.115:0/3810034533 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7bd8103950 0x7f7bd819dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:51.076 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.071+0000 7f7bdce3f640 1 -- 172.21.15.115:0/3810034533 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7bd8103950 msgr2=0x7f7bd819dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:51.076 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.071+0000 7f7bdce3f640 1 --2- 172.21.15.115:0/3810034533 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7bd8103950 0x7f7bd819dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:51.076 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.071+0000 7f7bdce3f640 1 -- 172.21.15.115:0/3810034533 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc0009900 con 0x7f7bd80ff0f0 2024-09-13T17:16:51.076 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.071+0000 7f7bdce3f640 1 --2- 172.21.15.115:0/3810034533 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7bd80ff0f0 0x7f7bd819da60 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7bc0006010 tx=0x7f7bc00308a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:51.076 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.071+0000 7f7bd5ffb640 1 -- 172.21.15.115:0/3810034533 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7bc002f3c0 con 0x7f7bd80ff0f0 2024-09-13T17:16:51.076 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.072+0000 7f7bdf0a3640 1 -- 172.21.15.115:0/3810034533 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bd8197f30 con 0x7f7bd80ff0f0 2024-09-13T17:16:51.076 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.072+0000 7f7bd5ffb640 1 -- 172.21.15.115:0/3810034533 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7bc002f9c0 con 0x7f7bd80ff0f0 2024-09-13T17:16:51.076 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.072+0000 7f7bd5ffb640 1 -- 172.21.15.115:0/3810034533 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7bc0039450 con 0x7f7bd80ff0f0 2024-09-13T17:16:51.076 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.072+0000 7f7bdf0a3640 1 -- 172.21.15.115:0/3810034533 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bd8198430 con 0x7f7bd80ff0f0 2024-09-13T17:16:51.077 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.073+0000 7f7bdf0a3640 1 -- 172.21.15.115:0/3810034533 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bd8100100 con 0x7f7bd80ff0f0 2024-09-13T17:16:51.077 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.073+0000 7f7bd5ffb640 1 -- 172.21.15.115:0/3810034533 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f7bc000a040 con 0x7f7bd80ff0f0 2024-09-13T17:16:51.077 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.074+0000 7f7bd5ffb640 1 --2- 172.21.15.115:0/3810034533 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f7bc406cc50 0x7f7bc406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:51.077 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.074+0000 7f7bd5ffb640 1 -- 172.21.15.115:0/3810034533 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f7bc002c040 con 0x7f7bd80ff0f0 2024-09-13T17:16:51.078 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.074+0000 7f7bd7fff640 1 --2- 172.21.15.115:0/3810034533 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f7bc406cc50 0x7f7bc406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:51.078 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.074+0000 7f7bd7fff640 1 --2- 172.21.15.115:0/3810034533 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f7bc406cc50 0x7f7bc406f110 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7bc8005fd0 tx=0x7f7bc8005850 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:51.079 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.078+0000 7f7bd5ffb640 1 -- 172.21.15.115:0/3810034533 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f7bc0077990 con 0x7f7bd80ff0f0 2024-09-13T17:16:51.272 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.271+0000 7f7bdf0a3640 1 -- 172.21.15.115:0/3810034533 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 24, "format": "json"} v 0) v1 -- 0x7f7bd8199060 con 0x7f7bd80ff0f0 2024-09-13T17:16:51.273 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.272+0000 7f7bd5ffb640 1 -- 172.21.15.115:0/3810034533 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 24, "format": "json"}]=0 dumped fsmap epoch 24 v39) v1 ==== 107+0+4037 (secure 0 0 0) 0x7f7bc007afb0 con 0x7f7bd80ff0f0 2024-09-13T17:16:51.273 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:16:51.273 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24253,"name":"cephfs.smithi195.aevvgz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.195:6827/8826118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":8826118},{"type":"v1","addr":"172.21.15.195:6827","nonce":8826118}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":24259,"name":"cephfs.smithi195.qzghxj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6825/3335357704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3335357704},{"type":"v1","addr":"172.21.15.195:6825","nonce":3335357704}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":34320,"name":"cephfs.smithi115.hbtxod","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6827/2768011029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2768011029},{"type":"v1","addr":"172.21.15.115:6827","nonce":2768011029}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T17:03:16.313116+0000","modified":"2024-09-13T17:13:29.449248+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-13T17:16:51.273 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 24 2024-09-13T17:16:51.275 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.274+0000 7f7bdf0a3640 1 -- 172.21.15.115:0/3810034533 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f7bc406cc50 msgr2=0x7f7bc406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:51.275 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.274+0000 7f7bdf0a3640 1 --2- 172.21.15.115:0/3810034533 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f7bc406cc50 0x7f7bc406f110 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7bc8005fd0 tx=0x7f7bc8005850 comp rx=0 tx=0).stop 2024-09-13T17:16:51.275 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.274+0000 7f7bdf0a3640 1 -- 172.21.15.115:0/3810034533 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7bd80ff0f0 msgr2=0x7f7bd819da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:51.275 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.274+0000 7f7bdf0a3640 1 --2- 172.21.15.115:0/3810034533 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7bd80ff0f0 0x7f7bd819da60 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7bc0006010 tx=0x7f7bc00308a0 comp rx=0 tx=0).stop 2024-09-13T17:16:51.275 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.274+0000 7f7bdf0a3640 1 -- 172.21.15.115:0/3810034533 shutdown_connections 2024-09-13T17:16:51.275 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.274+0000 7f7bdf0a3640 1 --2- 172.21.15.115:0/3810034533 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f7bc406cc50 0x7f7bc406f110 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:51.275 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.274+0000 7f7bdf0a3640 1 --2- 172.21.15.115:0/3810034533 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7bd8103950 0x7f7bd819dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:51.276 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.274+0000 7f7bdf0a3640 1 --2- 172.21.15.115:0/3810034533 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7bd80ff0f0 0x7f7bd819da60 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:51.276 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.274+0000 7f7bdf0a3640 1 -- 172.21.15.115:0/3810034533 >> 172.21.15.115:0/3810034533 conn(0x7f7bd80f9db0 msgr2=0x7f7bd80fb090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:51.276 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.274+0000 7f7bdf0a3640 1 -- 172.21.15.115:0/3810034533 shutdown_connections 2024-09-13T17:16:51.276 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.274+0000 7f7bdf0a3640 1 -- 172.21.15.115:0/3810034533 wait complete. 2024-09-13T17:16:51.284 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:16:50 smithi115 ceph-mon[109488]: from='client.? 172.21.15.115:0/501386016' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-09-13T17:16:51.284 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:16:50 smithi115 ceph-mon[109488]: from='client.? 172.21.15.115:0/2147397542' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-09-13T17:16:51.284 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:16:50 smithi115 ceph-mon[109488]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:16:51.285 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:16:50 smithi115 ceph-mon[109488]: from='client.? 172.21.15.115:0/623966260' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-09-13T17:16:51.286 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 24 2024-09-13T17:16:51.286 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 25 2024-09-13T17:16:51.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:16:50 smithi195 ceph-mon[80021]: from='client.? 172.21.15.115:0/501386016' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-09-13T17:16:51.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:16:50 smithi195 ceph-mon[80021]: from='client.? 172.21.15.115:0/2147397542' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-09-13T17:16:51.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:16:50 smithi195 ceph-mon[80021]: from='mgr.14660 172.21.15.115:0/3274782723' entity='mgr.smithi115.hetcni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T17:16:51.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:16:50 smithi195 ceph-mon[80021]: from='client.? 172.21.15.115:0/623966260' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-09-13T17:16:51.386 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.383+0000 7ffa81d45640 1 -- 172.21.15.115:0/998922308 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa7c104910 msgr2=0x7ffa7c104cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:51.386 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.383+0000 7ffa81d45640 1 --2- 172.21.15.115:0/998922308 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa7c104910 0x7ffa7c104cf0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c009880 tx=0x7ffa6c02a4a0 comp rx=0 tx=0).stop 2024-09-13T17:16:51.386 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.383+0000 7ffa81d45640 1 -- 172.21.15.115:0/998922308 shutdown_connections 2024-09-13T17:16:51.386 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.383+0000 7ffa81d45640 1 --2- 172.21.15.115:0/998922308 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffa7c0fe900 0x7ffa7c0fed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:51.386 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.383+0000 7ffa81d45640 1 --2- 172.21.15.115:0/998922308 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa7c104910 0x7ffa7c104cf0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:51.386 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.383+0000 7ffa81d45640 1 -- 172.21.15.115:0/998922308 >> 172.21.15.115:0/998922308 conn(0x7ffa7c0fa600 msgr2=0x7ffa7c0fca20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:51.387 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.383+0000 7ffa81d45640 1 -- 172.21.15.115:0/998922308 shutdown_connections 2024-09-13T17:16:51.387 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.383+0000 7ffa81d45640 1 -- 172.21.15.115:0/998922308 wait complete. 2024-09-13T17:16:51.387 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.383+0000 7ffa81d45640 1 Processor -- start 2024-09-13T17:16:51.387 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.384+0000 7ffa81d45640 1 -- start start 2024-09-13T17:16:51.387 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.384+0000 7ffa81d45640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffa7c0fe900 0x7ffa7c1004d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:51.387 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.384+0000 7ffa81d45640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa7c104910 0x7ffa7c100a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:51.387 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.384+0000 7ffa81d45640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7c100f50 con 0x7ffa7c104910 2024-09-13T17:16:51.387 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.384+0000 7ffa81d45640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7c1010c0 con 0x7ffa7c0fe900 2024-09-13T17:16:51.387 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.384+0000 7ffa73fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa7c104910 0x7ffa7c100a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:51.387 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.384+0000 7ffa73fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa7c104910 0x7ffa7c100a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:44196/0 (socket says 172.21.15.115:44196) 2024-09-13T17:16:51.387 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.384+0000 7ffa73fff640 1 -- 172.21.15.115:0/3352816896 learned_addr learned my addr 172.21.15.115:0/3352816896 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:16:51.387 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.384+0000 7ffa7b7fe640 1 --2- 172.21.15.115:0/3352816896 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffa7c0fe900 0x7ffa7c1004d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:51.388 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.384+0000 7ffa73fff640 1 -- 172.21.15.115:0/3352816896 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffa7c0fe900 msgr2=0x7ffa7c1004d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:51.388 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.384+0000 7ffa73fff640 1 --2- 172.21.15.115:0/3352816896 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffa7c0fe900 0x7ffa7c1004d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:51.388 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.384+0000 7ffa73fff640 1 -- 172.21.15.115:0/3352816896 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa6c009560 con 0x7ffa7c104910 2024-09-13T17:16:51.388 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.384+0000 7ffa73fff640 1 --2- 172.21.15.115:0/3352816896 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa7c104910 0x7ffa7c100a10 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ffa6400b420 tx=0x7ffa6400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:51.388 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.384+0000 7ffa797fa640 1 -- 172.21.15.115:0/3352816896 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa64011800 con 0x7ffa7c104910 2024-09-13T17:16:51.388 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.384+0000 7ffa797fa640 1 -- 172.21.15.115:0/3352816896 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ffa64011e00 con 0x7ffa7c104910 2024-09-13T17:16:51.388 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.384+0000 7ffa81d45640 1 -- 172.21.15.115:0/3352816896 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa7c1a1c70 con 0x7ffa7c104910 2024-09-13T17:16:51.388 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.384+0000 7ffa797fa640 1 -- 172.21.15.115:0/3352816896 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa6400f2e0 con 0x7ffa7c104910 2024-09-13T17:16:51.388 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.385+0000 7ffa81d45640 1 -- 172.21.15.115:0/3352816896 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa7c1a1fe0 con 0x7ffa7c104910 2024-09-13T17:16:51.389 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.386+0000 7ffa81d45640 1 -- 172.21.15.115:0/3352816896 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa7c100040 con 0x7ffa7c104910 2024-09-13T17:16:51.389 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.386+0000 7ffa797fa640 1 -- 172.21.15.115:0/3352816896 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7ffa64010380 con 0x7ffa7c104910 2024-09-13T17:16:51.389 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.386+0000 7ffa797fa640 1 --2- 172.21.15.115:0/3352816896 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7ffa6806cc50 0x7ffa6806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:51.389 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.387+0000 7ffa797fa640 1 -- 172.21.15.115:0/3352816896 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6328+0+0 (secure 0 0 0) 0x7ffa6408bea0 con 0x7ffa7c104910 2024-09-13T17:16:51.389 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.387+0000 7ffa7b7fe640 1 --2- 172.21.15.115:0/3352816896 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7ffa6806cc50 0x7ffa6806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:51.389 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.387+0000 7ffa7b7fe640 1 --2- 172.21.15.115:0/3352816896 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7ffa6806cc50 0x7ffa6806f110 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c000c00 tx=0x7ffa6c0058d0 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:51.391 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.391+0000 7ffa797fa640 1 -- 172.21.15.115:0/3352816896 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ffa64055f10 con 0x7ffa7c104910 2024-09-13T17:16:51.587 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.585+0000 7ffa81d45640 1 -- 172.21.15.115:0/3352816896 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 25, "format": "json"} v 0) v1 -- 0x7ffa7c10bac0 con 0x7ffa7c104910 2024-09-13T17:16:51.587 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.586+0000 7ffa797fa640 1 -- 172.21.15.115:0/3352816896 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 25, "format": "json"}]=0 dumped fsmap epoch 25 v39) v1 ==== 107+0+4048 (secure 0 0 0) 0x7ffa64059530 con 0x7ffa7c104910 2024-09-13T17:16:51.588 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:16:51.589 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24259,"name":"cephfs.smithi195.qzghxj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6825/3335357704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3335357704},{"type":"v1","addr":"172.21.15.195:6825","nonce":3335357704}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":34320,"name":"cephfs.smithi115.hbtxod","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6827/2768011029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2768011029},{"type":"v1","addr":"172.21.15.115:6827","nonce":2768011029}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T17:03:16.313116+0000","modified":"2024-09-13T17:13:29.456117+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24253},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24253":{"gid":24253,"name":"cephfs.smithi195.aevvgz","rank":0,"incarnation":25,"state":"up:replay","state_seq":2,"addr":"172.21.15.195:6827/8826118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":8826118},{"type":"v1","addr":"172.21.15.195:6827","nonce":8826118}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-13T17:16:51.589 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 25 2024-09-13T17:16:51.589 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.588+0000 7ffa81d45640 1 -- 172.21.15.115:0/3352816896 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7ffa6806cc50 msgr2=0x7ffa6806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:51.590 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.588+0000 7ffa81d45640 1 --2- 172.21.15.115:0/3352816896 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7ffa6806cc50 0x7ffa6806f110 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c000c00 tx=0x7ffa6c0058d0 comp rx=0 tx=0).stop 2024-09-13T17:16:51.590 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.588+0000 7ffa81d45640 1 -- 172.21.15.115:0/3352816896 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa7c104910 msgr2=0x7ffa7c100a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:51.590 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.588+0000 7ffa81d45640 1 --2- 172.21.15.115:0/3352816896 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa7c104910 0x7ffa7c100a10 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ffa6400b420 tx=0x7ffa6400b8e0 comp rx=0 tx=0).stop 2024-09-13T17:16:51.590 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.588+0000 7ffa81d45640 1 -- 172.21.15.115:0/3352816896 shutdown_connections 2024-09-13T17:16:51.590 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.588+0000 7ffa81d45640 1 --2- 172.21.15.115:0/3352816896 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7ffa6806cc50 0x7ffa6806f110 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:51.590 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.588+0000 7ffa81d45640 1 --2- 172.21.15.115:0/3352816896 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa7c104910 0x7ffa7c100a10 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:51.590 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.588+0000 7ffa81d45640 1 --2- 172.21.15.115:0/3352816896 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffa7c0fe900 0x7ffa7c1004d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:51.590 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.588+0000 7ffa81d45640 1 -- 172.21.15.115:0/3352816896 >> 172.21.15.115:0/3352816896 conn(0x7ffa7c0fa600 msgr2=0x7ffa7c0fb8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:51.590 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.588+0000 7ffa81d45640 1 -- 172.21.15.115:0/3352816896 shutdown_connections 2024-09-13T17:16:51.590 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.588+0000 7ffa81d45640 1 -- 172.21.15.115:0/3352816896 wait complete. 2024-09-13T17:16:51.600 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 25 2024-09-13T17:16:51.600 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 26 2024-09-13T17:16:51.701 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.698+0000 7f45e680d640 1 -- 172.21.15.115:0/2685637187 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45e0101500 msgr2=0x7f45e01099e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:51.701 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.698+0000 7f45e680d640 1 --2- 172.21.15.115:0/2685637187 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45e0101500 0x7f45e01099e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f45c8009880 tx=0x7f45c802a4a0 comp rx=0 tx=0).stop 2024-09-13T17:16:51.702 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.698+0000 7f45e680d640 1 -- 172.21.15.115:0/2685637187 shutdown_connections 2024-09-13T17:16:51.702 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.698+0000 7f45e680d640 1 --2- 172.21.15.115:0/2685637187 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45e0101500 0x7f45e01099e0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:51.702 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.698+0000 7f45e680d640 1 --2- 172.21.15.115:0/2685637187 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45e0100b50 0x7f45e0100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:51.702 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.698+0000 7f45e680d640 1 -- 172.21.15.115:0/2685637187 >> 172.21.15.115:0/2685637187 conn(0x7f45e00fa5f0 msgr2=0x7f45e00fca10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:51.702 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.698+0000 7f45e680d640 1 -- 172.21.15.115:0/2685637187 shutdown_connections 2024-09-13T17:16:51.702 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.698+0000 7f45e680d640 1 -- 172.21.15.115:0/2685637187 wait complete. 2024-09-13T17:16:51.702 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.698+0000 7f45e680d640 1 Processor -- start 2024-09-13T17:16:51.702 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.698+0000 7f45e680d640 1 -- start start 2024-09-13T17:16:51.702 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.699+0000 7f45e680d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45e0100b50 0x7f45e019b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:51.702 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.699+0000 7f45e680d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45e0101500 0x7f45e019bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:51.703 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.699+0000 7f45e680d640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e0195800 con 0x7f45e0100b50 2024-09-13T17:16:51.703 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.699+0000 7f45e680d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e0195970 con 0x7f45e0101500 2024-09-13T17:16:51.703 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.699+0000 7f45dffff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45e0100b50 0x7f45e019b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:51.703 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.699+0000 7f45dffff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45e0100b50 0x7f45e019b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:44212/0 (socket says 172.21.15.115:44212) 2024-09-13T17:16:51.703 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.699+0000 7f45dffff640 1 -- 172.21.15.115:0/1487906493 learned_addr learned my addr 172.21.15.115:0/1487906493 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:16:51.703 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.699+0000 7f45df7fe640 1 --2- 172.21.15.115:0/1487906493 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45e0101500 0x7f45e019bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:51.703 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.699+0000 7f45dffff640 1 -- 172.21.15.115:0/1487906493 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45e0101500 msgr2=0x7f45e019bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:51.703 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.699+0000 7f45dffff640 1 --2- 172.21.15.115:0/1487906493 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45e0101500 0x7f45e019bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:51.703 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.699+0000 7f45dffff640 1 -- 172.21.15.115:0/1487906493 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45c8009560 con 0x7f45e0100b50 2024-09-13T17:16:51.704 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.699+0000 7f45dffff640 1 --2- 172.21.15.115:0/1487906493 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45e0100b50 0x7f45e019b720 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f45d000d6f0 tx=0x7f45d000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:51.704 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.699+0000 7f45dd7fa640 1 -- 172.21.15.115:0/1487906493 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f45d0009a30 con 0x7f45e0100b50 2024-09-13T17:16:51.704 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.699+0000 7f45dd7fa640 1 -- 172.21.15.115:0/1487906493 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f45d00054c0 con 0x7f45e0100b50 2024-09-13T17:16:51.704 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.699+0000 7f45e680d640 1 -- 172.21.15.115:0/1487906493 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45e0195c50 con 0x7f45e0100b50 2024-09-13T17:16:51.704 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.699+0000 7f45dd7fa640 1 -- 172.21.15.115:0/1487906493 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f45d0004db0 con 0x7f45e0100b50 2024-09-13T17:16:51.704 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.699+0000 7f45e680d640 1 -- 172.21.15.115:0/1487906493 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45e0196180 con 0x7f45e0100b50 2024-09-13T17:16:51.705 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.700+0000 7f45e680d640 1 -- 172.21.15.115:0/1487906493 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45e00688b0 con 0x7f45e0100b50 2024-09-13T17:16:51.705 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.701+0000 7f45dd7fa640 1 -- 172.21.15.115:0/1487906493 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f45d0004f30 con 0x7f45e0100b50 2024-09-13T17:16:51.705 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.701+0000 7f45dd7fa640 1 --2- 172.21.15.115:0/1487906493 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f45cc06cbf0 0x7f45cc06f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:51.705 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.701+0000 7f45dd7fa640 1 -- 172.21.15.115:0/1487906493 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f45d008c0c0 con 0x7f45e0100b50 2024-09-13T17:16:51.706 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.701+0000 7f45df7fe640 1 --2- 172.21.15.115:0/1487906493 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f45cc06cbf0 0x7f45cc06f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:51.706 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.702+0000 7f45df7fe640 1 --2- 172.21.15.115:0/1487906493 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f45cc06cbf0 0x7f45cc06f0b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f45e0102bf0 tx=0x7f45c8005d50 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:51.706 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.706+0000 7f45dd7fa640 1 -- 172.21.15.115:0/1487906493 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f45d0056130 con 0x7f45e0100b50 2024-09-13T17:16:51.912 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.911+0000 7f45e680d640 1 -- 172.21.15.115:0/1487906493 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 26, "format": "json"} v 0) v1 -- 0x7f45e0100f30 con 0x7f45e0100b50 2024-09-13T17:16:51.913 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.912+0000 7f45dd7fa640 1 -- 172.21.15.115:0/1487906493 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 26, "format": "json"}]=0 dumped fsmap epoch 26 v39) v1 ==== 107+0+4053 (secure 0 0 0) 0x7f45d0059750 con 0x7f45e0100b50 2024-09-13T17:16:51.913 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:16:51.914 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24259,"name":"cephfs.smithi195.qzghxj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6825/3335357704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3335357704},{"type":"v1","addr":"172.21.15.195:6825","nonce":3335357704}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":34320,"name":"cephfs.smithi115.hbtxod","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6827/2768011029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2768011029},{"type":"v1","addr":"172.21.15.115:6827","nonce":2768011029}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T17:03:16.313116+0000","modified":"2024-09-13T17:13:36.711480+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24253},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24253":{"gid":24253,"name":"cephfs.smithi195.aevvgz","rank":0,"incarnation":25,"state":"up:reconnect","state_seq":153,"addr":"172.21.15.195:6827/8826118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":8826118},{"type":"v1","addr":"172.21.15.195:6827","nonce":8826118}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-13T17:16:51.914 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 26 2024-09-13T17:16:51.915 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.914+0000 7f45e680d640 1 -- 172.21.15.115:0/1487906493 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f45cc06cbf0 msgr2=0x7f45cc06f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:51.916 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.914+0000 7f45e680d640 1 --2- 172.21.15.115:0/1487906493 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f45cc06cbf0 0x7f45cc06f0b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f45e0102bf0 tx=0x7f45c8005d50 comp rx=0 tx=0).stop 2024-09-13T17:16:51.916 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.914+0000 7f45e680d640 1 -- 172.21.15.115:0/1487906493 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45e0100b50 msgr2=0x7f45e019b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:51.916 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.914+0000 7f45e680d640 1 --2- 172.21.15.115:0/1487906493 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45e0100b50 0x7f45e019b720 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f45d000d6f0 tx=0x7f45d000dbb0 comp rx=0 tx=0).stop 2024-09-13T17:16:51.916 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.914+0000 7f45e680d640 1 -- 172.21.15.115:0/1487906493 shutdown_connections 2024-09-13T17:16:51.916 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.914+0000 7f45e680d640 1 --2- 172.21.15.115:0/1487906493 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f45cc06cbf0 0x7f45cc06f0b0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:51.916 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.914+0000 7f45e680d640 1 --2- 172.21.15.115:0/1487906493 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45e0101500 0x7f45e019bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:51.916 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.914+0000 7f45e680d640 1 --2- 172.21.15.115:0/1487906493 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45e0100b50 0x7f45e019b720 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:51.916 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.914+0000 7f45e680d640 1 -- 172.21.15.115:0/1487906493 >> 172.21.15.115:0/1487906493 conn(0x7f45e00fa5f0 msgr2=0x7f45e0101ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:51.916 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.914+0000 7f45e680d640 1 -- 172.21.15.115:0/1487906493 shutdown_connections 2024-09-13T17:16:51.916 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:51.914+0000 7f45e680d640 1 -- 172.21.15.115:0/1487906493 wait complete. 2024-09-13T17:16:51.926 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 26 2024-09-13T17:16:51.926 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 27 2024-09-13T17:16:52.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.024+0000 7fe0f1612640 1 -- 172.21.15.115:0/863099648 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0ec0fe940 msgr2=0x7fe0ec0feda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:52.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.024+0000 7fe0f1612640 1 --2- 172.21.15.115:0/863099648 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0ec0fe940 0x7fe0ec0feda0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe0d4009880 tx=0x7fe0d402a4a0 comp rx=0 tx=0).stop 2024-09-13T17:16:52.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.024+0000 7fe0f1612640 1 -- 172.21.15.115:0/863099648 shutdown_connections 2024-09-13T17:16:52.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.024+0000 7fe0f1612640 1 --2- 172.21.15.115:0/863099648 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0ec0fe940 0x7fe0ec0feda0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:52.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.024+0000 7fe0f1612640 1 --2- 172.21.15.115:0/863099648 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0ec104950 0x7fe0ec104d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:52.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.024+0000 7fe0f1612640 1 -- 172.21.15.115:0/863099648 >> 172.21.15.115:0/863099648 conn(0x7fe0ec0fa620 msgr2=0x7fe0ec0fca40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:52.031 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.024+0000 7fe0f1612640 1 -- 172.21.15.115:0/863099648 shutdown_connections 2024-09-13T17:16:52.031 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.024+0000 7fe0f1612640 1 -- 172.21.15.115:0/863099648 wait complete. 2024-09-13T17:16:52.031 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.025+0000 7fe0f1612640 1 Processor -- start 2024-09-13T17:16:52.031 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.025+0000 7fe0f1612640 1 -- start start 2024-09-13T17:16:52.031 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.025+0000 7fe0f1612640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0ec0fe940 0x7fe0ec19a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:52.031 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.025+0000 7fe0f1612640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0ec104950 0x7fe0ec19abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:52.031 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.025+0000 7fe0f1612640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ec194760 con 0x7fe0ec104950 2024-09-13T17:16:52.031 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.025+0000 7fe0f1612640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ec1948d0 con 0x7fe0ec0fe940 2024-09-13T17:16:52.031 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.025+0000 7fe0e27fc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0ec104950 0x7fe0ec19abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:52.032 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.025+0000 7fe0e27fc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0ec104950 0x7fe0ec19abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:44228/0 (socket says 172.21.15.115:44228) 2024-09-13T17:16:52.032 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.025+0000 7fe0e27fc640 1 -- 172.21.15.115:0/1889296554 learned_addr learned my addr 172.21.15.115:0/1889296554 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:16:52.032 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.025+0000 7fe0eaffd640 1 --2- 172.21.15.115:0/1889296554 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0ec0fe940 0x7fe0ec19a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:52.032 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.026+0000 7fe0e27fc640 1 -- 172.21.15.115:0/1889296554 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0ec0fe940 msgr2=0x7fe0ec19a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:52.032 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.026+0000 7fe0e27fc640 1 --2- 172.21.15.115:0/1889296554 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0ec0fe940 0x7fe0ec19a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:52.032 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.026+0000 7fe0e27fc640 1 -- 172.21.15.115:0/1889296554 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0d4009560 con 0x7fe0ec104950 2024-09-13T17:16:52.032 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.026+0000 7fe0eaffd640 1 --2- 172.21.15.115:0/1889296554 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0ec0fe940 0x7fe0ec19a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:16:52.032 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.026+0000 7fe0e27fc640 1 --2- 172.21.15.115:0/1889296554 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0ec104950 0x7fe0ec19abc0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe0d402a9c0 tx=0x7fe0d40055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:52.033 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.026+0000 7fe0e8ff9640 1 -- 172.21.15.115:0/1889296554 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0d403e070 con 0x7fe0ec104950 2024-09-13T17:16:52.033 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.026+0000 7fe0e8ff9640 1 -- 172.21.15.115:0/1889296554 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe0d40035f0 con 0x7fe0ec104950 2024-09-13T17:16:52.033 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.026+0000 7fe0f1612640 1 -- 172.21.15.115:0/1889296554 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0ec194b50 con 0x7fe0ec104950 2024-09-13T17:16:52.033 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.026+0000 7fe0e8ff9640 1 -- 172.21.15.115:0/1889296554 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0d4031770 con 0x7fe0ec104950 2024-09-13T17:16:52.033 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.026+0000 7fe0f1612640 1 -- 172.21.15.115:0/1889296554 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0ec195050 con 0x7fe0ec104950 2024-09-13T17:16:52.033 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.027+0000 7fe0f1612640 1 -- 172.21.15.115:0/1889296554 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0ec100080 con 0x7fe0ec104950 2024-09-13T17:16:52.033 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.027+0000 7fe0e8ff9640 1 -- 172.21.15.115:0/1889296554 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fe0d4003760 con 0x7fe0ec104950 2024-09-13T17:16:52.034 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.028+0000 7fe0e8ff9640 1 --2- 172.21.15.115:0/1889296554 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fe0d806cc50 0x7fe0d806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:52.034 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.028+0000 7fe0e8ff9640 1 -- 172.21.15.115:0/1889296554 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fe0d40aea80 con 0x7fe0ec104950 2024-09-13T17:16:52.034 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.028+0000 7fe0eaffd640 1 --2- 172.21.15.115:0/1889296554 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fe0d806cc50 0x7fe0d806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:52.034 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.028+0000 7fe0eaffd640 1 --2- 172.21.15.115:0/1889296554 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fe0d806cc50 0x7fe0d806f110 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc009b40 tx=0x7fe0dc005e50 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:52.034 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.032+0000 7fe0e8ff9640 1 -- 172.21.15.115:0/1889296554 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe0d4078af0 con 0x7fe0ec104950 2024-09-13T17:16:52.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:16:51 smithi115 ceph-mon[109488]: from='client.? 172.21.15.115:0/1886871293' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-09-13T17:16:52.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:16:51 smithi115 ceph-mon[109488]: from='client.? 172.21.15.115:0/3810034533' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-09-13T17:16:52.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:16:51 smithi115 ceph-mon[109488]: pgmap v345: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:16:52.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:16:51 smithi115 ceph-mon[109488]: from='client.? 172.21.15.115:0/3352816896' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-09-13T17:16:52.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:16:51 smithi115 ceph-mon[109488]: from='client.? 172.21.15.115:0/1487906493' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-09-13T17:16:52.230 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.229+0000 7fe0f1612640 1 -- 172.21.15.115:0/1889296554 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 27, "format": "json"} v 0) v1 -- 0x7fe0ec0feda0 con 0x7fe0ec104950 2024-09-13T17:16:52.231 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.230+0000 7fe0e8ff9640 1 -- 172.21.15.115:0/1889296554 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 27, "format": "json"}]=0 dumped fsmap epoch 27 v39) v1 ==== 107+0+4050 (secure 0 0 0) 0x7fe0d407c110 con 0x7fe0ec104950 2024-09-13T17:16:52.231 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:16:52.231 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24259,"name":"cephfs.smithi195.qzghxj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6825/3335357704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3335357704},{"type":"v1","addr":"172.21.15.195:6825","nonce":3335357704}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":34320,"name":"cephfs.smithi115.hbtxod","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6827/2768011029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2768011029},{"type":"v1","addr":"172.21.15.115:6827","nonce":2768011029}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T17:03:16.313116+0000","modified":"2024-09-13T17:13:37.713297+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24253},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24253":{"gid":24253,"name":"cephfs.smithi195.aevvgz","rank":0,"incarnation":25,"state":"up:rejoin","state_seq":154,"addr":"172.21.15.195:6827/8826118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":8826118},{"type":"v1","addr":"172.21.15.195:6827","nonce":8826118}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-13T17:16:52.231 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 27 2024-09-13T17:16:52.233 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.231+0000 7fe0f1612640 1 -- 172.21.15.115:0/1889296554 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fe0d806cc50 msgr2=0x7fe0d806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:52.233 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.231+0000 7fe0f1612640 1 --2- 172.21.15.115:0/1889296554 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fe0d806cc50 0x7fe0d806f110 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc009b40 tx=0x7fe0dc005e50 comp rx=0 tx=0).stop 2024-09-13T17:16:52.233 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.231+0000 7fe0f1612640 1 -- 172.21.15.115:0/1889296554 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0ec104950 msgr2=0x7fe0ec19abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:52.233 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.231+0000 7fe0f1612640 1 --2- 172.21.15.115:0/1889296554 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0ec104950 0x7fe0ec19abc0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe0d402a9c0 tx=0x7fe0d40055a0 comp rx=0 tx=0).stop 2024-09-13T17:16:52.233 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.232+0000 7fe0f1612640 1 -- 172.21.15.115:0/1889296554 shutdown_connections 2024-09-13T17:16:52.233 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.232+0000 7fe0f1612640 1 --2- 172.21.15.115:0/1889296554 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fe0d806cc50 0x7fe0d806f110 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:52.233 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.232+0000 7fe0f1612640 1 --2- 172.21.15.115:0/1889296554 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0ec104950 0x7fe0ec19abc0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:52.233 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.232+0000 7fe0f1612640 1 --2- 172.21.15.115:0/1889296554 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0ec0fe940 0x7fe0ec19a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:52.234 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.232+0000 7fe0f1612640 1 -- 172.21.15.115:0/1889296554 >> 172.21.15.115:0/1889296554 conn(0x7fe0ec0fa620 msgr2=0x7fe0ec0fb800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:52.234 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.232+0000 7fe0f1612640 1 -- 172.21.15.115:0/1889296554 shutdown_connections 2024-09-13T17:16:52.234 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.232+0000 7fe0f1612640 1 -- 172.21.15.115:0/1889296554 wait complete. 2024-09-13T17:16:52.244 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 27 2024-09-13T17:16:52.244 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 28 2024-09-13T17:16:52.326 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:16:51 smithi195 ceph-mon[80021]: from='client.? 172.21.15.115:0/1886871293' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-09-13T17:16:52.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:16:51 smithi195 ceph-mon[80021]: from='client.? 172.21.15.115:0/3810034533' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-09-13T17:16:52.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:16:51 smithi195 ceph-mon[80021]: pgmap v345: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:16:52.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:16:51 smithi195 ceph-mon[80021]: from='client.? 172.21.15.115:0/3352816896' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-09-13T17:16:52.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:16:51 smithi195 ceph-mon[80021]: from='client.? 172.21.15.115:0/1487906493' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-09-13T17:16:52.343 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.342+0000 7f3348b26640 1 -- 172.21.15.115:0/876527665 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3344104910 msgr2=0x7f3344104cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:52.343 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.342+0000 7f3348b26640 1 --2- 172.21.15.115:0/876527665 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3344104910 0x7f3344104cf0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f333c009880 tx=0x7f333c02a4a0 comp rx=0 tx=0).stop 2024-09-13T17:16:52.343 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.342+0000 7f3348b26640 1 -- 172.21.15.115:0/876527665 shutdown_connections 2024-09-13T17:16:52.343 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.342+0000 7f3348b26640 1 --2- 172.21.15.115:0/876527665 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f33440fe900 0x7f33440fed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:52.344 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.342+0000 7f3348b26640 1 --2- 172.21.15.115:0/876527665 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3344104910 0x7f3344104cf0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:52.344 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.342+0000 7f3348b26640 1 -- 172.21.15.115:0/876527665 >> 172.21.15.115:0/876527665 conn(0x7f3344075750 msgr2=0x7f33440fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:52.344 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.342+0000 7f3348b26640 1 -- 172.21.15.115:0/876527665 shutdown_connections 2024-09-13T17:16:52.344 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.342+0000 7f3348b26640 1 -- 172.21.15.115:0/876527665 wait complete. 2024-09-13T17:16:52.346 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.342+0000 7f3348b26640 1 Processor -- start 2024-09-13T17:16:52.346 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.343+0000 7f3348b26640 1 -- start start 2024-09-13T17:16:52.346 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.343+0000 7f3348b26640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f33440fe900 0x7f334419a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:52.346 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.343+0000 7f3348b26640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3344104910 0x7f334419abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:52.346 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.343+0000 7f3348b26640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f334419b270 con 0x7f3344104910 2024-09-13T17:16:52.346 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.343+0000 7f3348b26640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33441947a0 con 0x7f33440fe900 2024-09-13T17:16:52.346 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.343+0000 7f3341d9b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3344104910 0x7f334419abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:52.346 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.343+0000 7f3341d9b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3344104910 0x7f334419abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:44258/0 (socket says 172.21.15.115:44258) 2024-09-13T17:16:52.346 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.343+0000 7f3341d9b640 1 -- 172.21.15.115:0/363208057 learned_addr learned my addr 172.21.15.115:0/363208057 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:16:52.346 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.343+0000 7f334259c640 1 --2- 172.21.15.115:0/363208057 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f33440fe900 0x7f334419a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:52.346 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.343+0000 7f3341d9b640 1 -- 172.21.15.115:0/363208057 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f33440fe900 msgr2=0x7f334419a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:52.346 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.343+0000 7f3341d9b640 1 --2- 172.21.15.115:0/363208057 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f33440fe900 0x7f334419a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:52.347 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.343+0000 7f3341d9b640 1 -- 172.21.15.115:0/363208057 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f333c009560 con 0x7f3344104910 2024-09-13T17:16:52.347 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.343+0000 7f3341d9b640 1 --2- 172.21.15.115:0/363208057 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3344104910 0x7f334419abe0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f333800ea00 tx=0x7f333800eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:52.347 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.343+0000 7f33337fe640 1 -- 172.21.15.115:0/363208057 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f333800cd50 con 0x7f3344104910 2024-09-13T17:16:52.347 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.343+0000 7f33337fe640 1 -- 172.21.15.115:0/363208057 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3338005020 con 0x7f3344104910 2024-09-13T17:16:52.347 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.343+0000 7f3348b26640 1 -- 172.21.15.115:0/363208057 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3344194a50 con 0x7f3344104910 2024-09-13T17:16:52.347 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.343+0000 7f33337fe640 1 -- 172.21.15.115:0/363208057 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f33380116a0 con 0x7f3344104910 2024-09-13T17:16:52.347 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.344+0000 7f3348b26640 1 -- 172.21.15.115:0/363208057 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3344194fb0 con 0x7f3344104910 2024-09-13T17:16:52.347 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.344+0000 7f3348b26640 1 -- 172.21.15.115:0/363208057 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3344100040 con 0x7f3344104910 2024-09-13T17:16:52.348 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.345+0000 7f33337fe640 1 -- 172.21.15.115:0/363208057 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f3338005190 con 0x7f3344104910 2024-09-13T17:16:52.348 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.345+0000 7f33337fe640 1 --2- 172.21.15.115:0/363208057 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f332c06cc50 0x7f332c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:52.348 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.345+0000 7f33337fe640 1 -- 172.21.15.115:0/363208057 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f333808c9f0 con 0x7f3344104910 2024-09-13T17:16:52.348 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.345+0000 7f334259c640 1 --2- 172.21.15.115:0/363208057 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f332c06cc50 0x7f332c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:52.348 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.346+0000 7f334259c640 1 --2- 172.21.15.115:0/363208057 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f332c06cc50 0x7f332c06f110 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f333c005ab0 tx=0x7f333c005a20 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:52.350 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.349+0000 7f33337fe640 1 -- 172.21.15.115:0/363208057 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f333808ee60 con 0x7f3344104910 2024-09-13T17:16:52.548 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.547+0000 7f3348b26640 1 -- 172.21.15.115:0/363208057 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 28, "format": "json"} v 0) v1 -- 0x7f3344106e70 con 0x7f3344104910 2024-09-13T17:16:52.548 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.547+0000 7f33337fe640 1 -- 172.21.15.115:0/363208057 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 28, "format": "json"}]=0 dumped fsmap epoch 28 v39) v1 ==== 107+0+4050 (secure 0 0 0) 0x7f3338056a60 con 0x7f3344104910 2024-09-13T17:16:52.549 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:16:52.549 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24259,"name":"cephfs.smithi195.qzghxj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6825/3335357704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3335357704},{"type":"v1","addr":"172.21.15.195:6825","nonce":3335357704}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":34320,"name":"cephfs.smithi115.hbtxod","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6827/2768011029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2768011029},{"type":"v1","addr":"172.21.15.115:6827","nonce":2768011029}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T17:03:16.313116+0000","modified":"2024-09-13T17:13:38.717470+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24253},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24253":{"gid":24253,"name":"cephfs.smithi195.aevvgz","rank":0,"incarnation":25,"state":"up:active","state_seq":155,"addr":"172.21.15.195:6827/8826118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":8826118},{"type":"v1","addr":"172.21.15.195:6827","nonce":8826118}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-13T17:16:52.549 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 28 2024-09-13T17:16:52.551 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.549+0000 7f3348b26640 1 -- 172.21.15.115:0/363208057 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f332c06cc50 msgr2=0x7f332c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:52.551 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.549+0000 7f3348b26640 1 --2- 172.21.15.115:0/363208057 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f332c06cc50 0x7f332c06f110 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f333c005ab0 tx=0x7f333c005a20 comp rx=0 tx=0).stop 2024-09-13T17:16:52.551 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.549+0000 7f3348b26640 1 -- 172.21.15.115:0/363208057 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3344104910 msgr2=0x7f334419abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:52.551 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.549+0000 7f3348b26640 1 --2- 172.21.15.115:0/363208057 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3344104910 0x7f334419abe0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f333800ea00 tx=0x7f333800eec0 comp rx=0 tx=0).stop 2024-09-13T17:16:52.551 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.549+0000 7f3348b26640 1 -- 172.21.15.115:0/363208057 shutdown_connections 2024-09-13T17:16:52.551 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.549+0000 7f3348b26640 1 --2- 172.21.15.115:0/363208057 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f332c06cc50 0x7f332c06f110 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:52.551 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.549+0000 7f3348b26640 1 --2- 172.21.15.115:0/363208057 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3344104910 0x7f334419abe0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:52.551 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.549+0000 7f3348b26640 1 --2- 172.21.15.115:0/363208057 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f33440fe900 0x7f334419a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:52.551 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.549+0000 7f3348b26640 1 -- 172.21.15.115:0/363208057 >> 172.21.15.115:0/363208057 conn(0x7f3344075750 msgr2=0x7f33441022b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:52.551 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.549+0000 7f3348b26640 1 -- 172.21.15.115:0/363208057 shutdown_connections 2024-09-13T17:16:52.551 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.549+0000 7f3348b26640 1 -- 172.21.15.115:0/363208057 wait complete. 2024-09-13T17:16:52.561 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 28 2024-09-13T17:16:52.562 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 29 2024-09-13T17:16:52.663 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.660+0000 7fb2482d7640 1 -- 172.21.15.115:0/611137355 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb2400fe900 msgr2=0x7fb2400fed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:52.663 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.660+0000 7fb2482d7640 1 --2- 172.21.15.115:0/611137355 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb2400fe900 0x7fb2400fed60 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb23c009880 tx=0x7fb23c02a4a0 comp rx=0 tx=0).stop 2024-09-13T17:16:52.663 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.660+0000 7fb2482d7640 1 -- 172.21.15.115:0/611137355 shutdown_connections 2024-09-13T17:16:52.663 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.660+0000 7fb2482d7640 1 --2- 172.21.15.115:0/611137355 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb2400fe900 0x7fb2400fed60 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:52.663 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.660+0000 7fb2482d7640 1 --2- 172.21.15.115:0/611137355 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb240104910 0x7fb240104cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:52.663 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.660+0000 7fb2482d7640 1 -- 172.21.15.115:0/611137355 >> 172.21.15.115:0/611137355 conn(0x7fb240075750 msgr2=0x7fb2400fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:52.663 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.660+0000 7fb2482d7640 1 -- 172.21.15.115:0/611137355 shutdown_connections 2024-09-13T17:16:52.663 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.660+0000 7fb2482d7640 1 -- 172.21.15.115:0/611137355 wait complete. 2024-09-13T17:16:52.663 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.660+0000 7fb2482d7640 1 Processor -- start 2024-09-13T17:16:52.663 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.660+0000 7fb2482d7640 1 -- start start 2024-09-13T17:16:52.664 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.660+0000 7fb2482d7640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb2400fe900 0x7fb24019b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:52.664 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.660+0000 7fb2482d7640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb240104910 0x7fb24019bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:52.664 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.660+0000 7fb2482d7640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2401957d0 con 0x7fb240104910 2024-09-13T17:16:52.664 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.660+0000 7fb2482d7640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb240195940 con 0x7fb2400fe900 2024-09-13T17:16:52.664 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.661+0000 7fb245872640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb240104910 0x7fb24019bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:52.664 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.661+0000 7fb245872640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb240104910 0x7fb24019bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:44276/0 (socket says 172.21.15.115:44276) 2024-09-13T17:16:52.664 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.661+0000 7fb245872640 1 -- 172.21.15.115:0/970063225 learned_addr learned my addr 172.21.15.115:0/970063225 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:16:52.664 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.661+0000 7fb246073640 1 --2- 172.21.15.115:0/970063225 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb2400fe900 0x7fb24019b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:52.664 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.661+0000 7fb245872640 1 -- 172.21.15.115:0/970063225 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb2400fe900 msgr2=0x7fb24019b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:52.664 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.661+0000 7fb245872640 1 --2- 172.21.15.115:0/970063225 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb2400fe900 0x7fb24019b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:52.664 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.661+0000 7fb245872640 1 -- 172.21.15.115:0/970063225 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb23c009560 con 0x7fb240104910 2024-09-13T17:16:52.664 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.661+0000 7fb246073640 1 --2- 172.21.15.115:0/970063225 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb2400fe900 0x7fb24019b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:16:52.665 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.661+0000 7fb245872640 1 --2- 172.21.15.115:0/970063225 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb240104910 0x7fb24019bc30 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb23c006010 tx=0x7fb23c0056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:52.665 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.661+0000 7fb2337fe640 1 -- 172.21.15.115:0/970063225 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb23c004ba0 con 0x7fb240104910 2024-09-13T17:16:52.665 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.661+0000 7fb2482d7640 1 -- 172.21.15.115:0/970063225 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb240195bc0 con 0x7fb240104910 2024-09-13T17:16:52.665 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.661+0000 7fb2337fe640 1 -- 172.21.15.115:0/970063225 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb23c004d00 con 0x7fb240104910 2024-09-13T17:16:52.665 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.661+0000 7fb2337fe640 1 -- 172.21.15.115:0/970063225 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb23c031910 con 0x7fb240104910 2024-09-13T17:16:52.665 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.661+0000 7fb2482d7640 1 -- 172.21.15.115:0/970063225 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2401960c0 con 0x7fb240104910 2024-09-13T17:16:52.666 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.662+0000 7fb2482d7640 1 -- 172.21.15.115:0/970063225 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb240100040 con 0x7fb240104910 2024-09-13T17:16:52.666 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.663+0000 7fb2337fe640 1 -- 172.21.15.115:0/970063225 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fb23c031b80 con 0x7fb240104910 2024-09-13T17:16:52.666 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.663+0000 7fb2337fe640 1 --2- 172.21.15.115:0/970063225 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fb22c06cc50 0x7fb22c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:52.666 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.663+0000 7fb2337fe640 1 -- 172.21.15.115:0/970063225 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fb23c0ad7d0 con 0x7fb240104910 2024-09-13T17:16:52.666 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.663+0000 7fb246073640 1 --2- 172.21.15.115:0/970063225 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fb22c06cc50 0x7fb22c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:52.666 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.663+0000 7fb246073640 1 --2- 172.21.15.115:0/970063225 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fb22c06cc50 0x7fb22c06f110 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb2340058c0 tx=0x7fb234005ec0 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:52.668 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.667+0000 7fb2337fe640 1 -- 172.21.15.115:0/970063225 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fb23c077840 con 0x7fb240104910 2024-09-13T17:16:52.865 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.864+0000 7fb2482d7640 1 -- 172.21.15.115:0/970063225 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 29, "format": "json"} v 0) v1 -- 0x7fb2400fed60 con 0x7fb240104910 2024-09-13T17:16:52.866 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.865+0000 7fb2337fe640 1 -- 172.21.15.115:0/970063225 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 29, "format": "json"}]=0 dumped fsmap epoch 29 v39) v1 ==== 107+0+4832 (secure 0 0 0) 0x7fb23c07ae60 con 0x7fb240104910 2024-09-13T17:16:52.866 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:16:52.866 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24259,"name":"cephfs.smithi195.qzghxj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6825/3335357704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3335357704},{"type":"v1","addr":"172.21.15.195:6825","nonce":3335357704}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":34320,"name":"cephfs.smithi115.hbtxod","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6827/2768011029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2768011029},{"type":"v1","addr":"172.21.15.115:6827","nonce":2768011029}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":34324,"name":"cephfs.smithi115.ijznvr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6829/2716683507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":2716683507},{"type":"v1","addr":"172.21.15.115:6829","nonce":2716683507}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T17:03:16.313116+0000","modified":"2024-09-13T17:13:38.717470+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24253},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24253":{"gid":24253,"name":"cephfs.smithi195.aevvgz","rank":0,"incarnation":25,"state":"up:active","state_seq":155,"addr":"172.21.15.195:6827/8826118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":8826118},{"type":"v1","addr":"172.21.15.195:6827","nonce":8826118}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-13T17:16:52.866 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 29 2024-09-13T17:16:52.868 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.866+0000 7fb2482d7640 1 -- 172.21.15.115:0/970063225 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fb22c06cc50 msgr2=0x7fb22c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:52.868 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.866+0000 7fb2482d7640 1 --2- 172.21.15.115:0/970063225 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fb22c06cc50 0x7fb22c06f110 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb2340058c0 tx=0x7fb234005ec0 comp rx=0 tx=0).stop 2024-09-13T17:16:52.868 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.866+0000 7fb2482d7640 1 -- 172.21.15.115:0/970063225 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb240104910 msgr2=0x7fb24019bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:52.868 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.866+0000 7fb2482d7640 1 --2- 172.21.15.115:0/970063225 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb240104910 0x7fb24019bc30 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb23c006010 tx=0x7fb23c0056e0 comp rx=0 tx=0).stop 2024-09-13T17:16:52.868 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.867+0000 7fb2482d7640 1 -- 172.21.15.115:0/970063225 shutdown_connections 2024-09-13T17:16:52.868 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.867+0000 7fb2482d7640 1 --2- 172.21.15.115:0/970063225 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fb22c06cc50 0x7fb22c06f110 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:52.869 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.867+0000 7fb2482d7640 1 --2- 172.21.15.115:0/970063225 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb240104910 0x7fb24019bc30 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:52.869 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.867+0000 7fb2482d7640 1 --2- 172.21.15.115:0/970063225 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb2400fe900 0x7fb24019b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:52.869 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.867+0000 7fb2482d7640 1 -- 172.21.15.115:0/970063225 >> 172.21.15.115:0/970063225 conn(0x7fb240075750 msgr2=0x7fb2401022a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:52.869 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.867+0000 7fb2482d7640 1 -- 172.21.15.115:0/970063225 shutdown_connections 2024-09-13T17:16:52.869 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.867+0000 7fb2482d7640 1 -- 172.21.15.115:0/970063225 wait complete. 2024-09-13T17:16:52.879 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 29 2024-09-13T17:16:52.879 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 30 2024-09-13T17:16:52.981 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.978+0000 7f3d0fcaa640 1 -- 172.21.15.115:0/75623741 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3d08100bd0 msgr2=0x7f3d08100fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:52.982 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.978+0000 7f3d0fcaa640 1 --2- 172.21.15.115:0/75623741 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3d08100bd0 0x7f3d08100fb0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3d04009880 tx=0x7f3d0402a530 comp rx=0 tx=0).stop 2024-09-13T17:16:52.982 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.978+0000 7f3d0fcaa640 1 -- 172.21.15.115:0/75623741 shutdown_connections 2024-09-13T17:16:52.982 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.978+0000 7f3d0fcaa640 1 --2- 172.21.15.115:0/75623741 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d081014f0 0x7f3d081099d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:52.982 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.978+0000 7f3d0fcaa640 1 --2- 172.21.15.115:0/75623741 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3d08100bd0 0x7f3d08100fb0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:52.982 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.978+0000 7f3d0fcaa640 1 -- 172.21.15.115:0/75623741 >> 172.21.15.115:0/75623741 conn(0x7f3d08075750 msgr2=0x7f3d080fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:52.982 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.979+0000 7f3d0fcaa640 1 -- 172.21.15.115:0/75623741 shutdown_connections 2024-09-13T17:16:52.982 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.979+0000 7f3d0fcaa640 1 -- 172.21.15.115:0/75623741 wait complete. 2024-09-13T17:16:52.982 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.979+0000 7f3d0fcaa640 1 Processor -- start 2024-09-13T17:16:52.982 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.979+0000 7f3d0fcaa640 1 -- start start 2024-09-13T17:16:52.982 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.979+0000 7f3d0fcaa640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d08100bd0 0x7f3d0819b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:52.982 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.979+0000 7f3d0fcaa640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3d081014f0 0x7f3d0819bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:52.982 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.979+0000 7f3d0fcaa640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d08195800 con 0x7f3d081014f0 2024-09-13T17:16:52.982 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.979+0000 7f3d0fcaa640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d08195970 con 0x7f3d08100bd0 2024-09-13T17:16:52.983 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.979+0000 7f3d0d245640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3d081014f0 0x7f3d0819bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:52.983 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.979+0000 7f3d0d245640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3d081014f0 0x7f3d0819bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:44284/0 (socket says 172.21.15.115:44284) 2024-09-13T17:16:52.983 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.979+0000 7f3d0d245640 1 -- 172.21.15.115:0/3495771642 learned_addr learned my addr 172.21.15.115:0/3495771642 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:16:52.983 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.980+0000 7f3d0d245640 1 -- 172.21.15.115:0/3495771642 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d08100bd0 msgr2=0x7f3d0819b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:52.983 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.980+0000 7f3d0d245640 1 --2- 172.21.15.115:0/3495771642 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d08100bd0 0x7f3d0819b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:52.983 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.980+0000 7f3d0d245640 1 -- 172.21.15.115:0/3495771642 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d04009560 con 0x7f3d081014f0 2024-09-13T17:16:52.983 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.980+0000 7f3d0d245640 1 --2- 172.21.15.115:0/3495771642 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3d081014f0 0x7f3d0819bc60 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3cf800d6d0 tx=0x7f3cf800db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:52.983 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.980+0000 7f3cfeffd640 1 -- 172.21.15.115:0/3495771642 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3cf80051f0 con 0x7f3d081014f0 2024-09-13T17:16:52.983 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.980+0000 7f3cfeffd640 1 -- 172.21.15.115:0/3495771642 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3cf8009820 con 0x7f3d081014f0 2024-09-13T17:16:52.983 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.980+0000 7f3d0fcaa640 1 -- 172.21.15.115:0/3495771642 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d08195c50 con 0x7f3d081014f0 2024-09-13T17:16:52.983 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.980+0000 7f3cfeffd640 1 -- 172.21.15.115:0/3495771642 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3cf8004d00 con 0x7f3d081014f0 2024-09-13T17:16:52.983 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.980+0000 7f3d0fcaa640 1 -- 172.21.15.115:0/3495771642 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d081961b0 con 0x7f3d081014f0 2024-09-13T17:16:52.984 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.981+0000 7f3d0fcaa640 1 -- 172.21.15.115:0/3495771642 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d08067d30 con 0x7f3d081014f0 2024-09-13T17:16:52.984 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.982+0000 7f3cfeffd640 1 -- 172.21.15.115:0/3495771642 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f3cf8009990 con 0x7f3d081014f0 2024-09-13T17:16:52.984 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.982+0000 7f3cfeffd640 1 --2- 172.21.15.115:0/3495771642 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f3cf406cc50 0x7f3cf406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:52.984 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.982+0000 7f3cfeffd640 1 -- 172.21.15.115:0/3495771642 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f3cf808c160 con 0x7f3d081014f0 2024-09-13T17:16:52.984 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.982+0000 7f3d0da46640 1 --2- 172.21.15.115:0/3495771642 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f3cf406cc50 0x7f3cf406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:52.985 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.982+0000 7f3d0da46640 1 --2- 172.21.15.115:0/3495771642 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f3cf406cc50 0x7f3cf406f110 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3d04009880 tx=0x7f3d04000bc0 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:52.987 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:52.986+0000 7f3cfeffd640 1 -- 172.21.15.115:0/3495771642 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f3cf8056130 con 0x7f3d081014f0 2024-09-13T17:16:53.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:16:52 smithi115 ceph-mon[109488]: from='client.? 172.21.15.115:0/1889296554' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-09-13T17:16:53.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:16:52 smithi115 ceph-mon[109488]: from='client.? 172.21.15.115:0/363208057' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-09-13T17:16:53.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:16:52 smithi115 ceph-mon[109488]: from='client.? 172.21.15.115:0/970063225' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-09-13T17:16:53.180 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.179+0000 7f3d0fcaa640 1 -- 172.21.15.115:0/3495771642 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 30, "format": "json"} v 0) v1 -- 0x7f3d08100fb0 con 0x7f3d081014f0 2024-09-13T17:16:53.181 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.180+0000 7f3cfeffd640 1 -- 172.21.15.115:0/3495771642 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 30, "format": "json"}]=0 dumped fsmap epoch 30 v39) v1 ==== 107+0+4050 (secure 0 0 0) 0x7f3cf8059750 con 0x7f3d081014f0 2024-09-13T17:16:53.181 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:16:53.181 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34320,"name":"cephfs.smithi115.hbtxod","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6827/2768011029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2768011029},{"type":"v1","addr":"172.21.15.115:6827","nonce":2768011029}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":34324,"name":"cephfs.smithi115.ijznvr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6829/2716683507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":2716683507},{"type":"v1","addr":"172.21.15.115:6829","nonce":2716683507}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T17:03:16.313116+0000","modified":"2024-09-13T17:13:38.717470+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24253},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24253":{"gid":24253,"name":"cephfs.smithi195.aevvgz","rank":0,"incarnation":25,"state":"up:active","state_seq":155,"addr":"172.21.15.195:6827/8826118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":8826118},{"type":"v1","addr":"172.21.15.195:6827","nonce":8826118}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-13T17:16:53.181 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 30 2024-09-13T17:16:53.183 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.182+0000 7f3d0fcaa640 1 -- 172.21.15.115:0/3495771642 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f3cf406cc50 msgr2=0x7f3cf406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:53.183 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.182+0000 7f3d0fcaa640 1 --2- 172.21.15.115:0/3495771642 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f3cf406cc50 0x7f3cf406f110 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3d04009880 tx=0x7f3d04000bc0 comp rx=0 tx=0).stop 2024-09-13T17:16:53.183 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.182+0000 7f3d0fcaa640 1 -- 172.21.15.115:0/3495771642 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3d081014f0 msgr2=0x7f3d0819bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:53.183 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.182+0000 7f3d0fcaa640 1 --2- 172.21.15.115:0/3495771642 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3d081014f0 0x7f3d0819bc60 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3cf800d6d0 tx=0x7f3cf800db90 comp rx=0 tx=0).stop 2024-09-13T17:16:53.183 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.182+0000 7f3d0fcaa640 1 -- 172.21.15.115:0/3495771642 shutdown_connections 2024-09-13T17:16:53.183 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.182+0000 7f3d0fcaa640 1 --2- 172.21.15.115:0/3495771642 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f3cf406cc50 0x7f3cf406f110 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:53.183 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.182+0000 7f3d0fcaa640 1 --2- 172.21.15.115:0/3495771642 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3d081014f0 0x7f3d0819bc60 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:53.184 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.182+0000 7f3d0fcaa640 1 --2- 172.21.15.115:0/3495771642 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d08100bd0 0x7f3d0819b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:53.184 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.182+0000 7f3d0fcaa640 1 -- 172.21.15.115:0/3495771642 >> 172.21.15.115:0/3495771642 conn(0x7f3d08075750 msgr2=0x7f3d08101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:53.184 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.182+0000 7f3d0fcaa640 1 -- 172.21.15.115:0/3495771642 shutdown_connections 2024-09-13T17:16:53.184 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.182+0000 7f3d0fcaa640 1 -- 172.21.15.115:0/3495771642 wait complete. 2024-09-13T17:16:53.193 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 30 2024-09-13T17:16:53.194 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 31 2024-09-13T17:16:53.295 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.292+0000 7f36c9c19640 1 -- 172.21.15.115:0/1790521651 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f36c40fe900 msgr2=0x7f36c40fed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:53.295 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.292+0000 7f36c9c19640 1 --2- 172.21.15.115:0/1790521651 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f36c40fe900 0x7f36c40fed60 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f36ac009880 tx=0x7f36ac02a4a0 comp rx=0 tx=0).stop 2024-09-13T17:16:53.295 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.292+0000 7f36c9c19640 1 -- 172.21.15.115:0/1790521651 shutdown_connections 2024-09-13T17:16:53.295 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.292+0000 7f36c9c19640 1 --2- 172.21.15.115:0/1790521651 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f36c40fe900 0x7f36c40fed60 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:53.295 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.292+0000 7f36c9c19640 1 --2- 172.21.15.115:0/1790521651 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f36c4104910 0x7f36c4104cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:53.296 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.292+0000 7f36c9c19640 1 -- 172.21.15.115:0/1790521651 >> 172.21.15.115:0/1790521651 conn(0x7f36c4075750 msgr2=0x7f36c40fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:53.296 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.292+0000 7f36c9c19640 1 -- 172.21.15.115:0/1790521651 shutdown_connections 2024-09-13T17:16:53.296 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.292+0000 7f36c9c19640 1 -- 172.21.15.115:0/1790521651 wait complete. 2024-09-13T17:16:53.296 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.292+0000 7f36c9c19640 1 Processor -- start 2024-09-13T17:16:53.296 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.292+0000 7f36c9c19640 1 -- start start 2024-09-13T17:16:53.296 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.293+0000 7f36c9c19640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f36c40fe900 0x7f36c4196860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:53.296 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.293+0000 7f36c9c19640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f36c4104910 0x7f36c4196da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:53.296 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.293+0000 7f36c9c19640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36c41973c0 con 0x7f36c40fe900 2024-09-13T17:16:53.296 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.293+0000 7f36c9c19640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36c4197530 con 0x7f36c4104910 2024-09-13T17:16:53.296 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.293+0000 7f36c37fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f36c40fe900 0x7f36c4196860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:53.296 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.293+0000 7f36c37fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f36c40fe900 0x7f36c4196860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:44310/0 (socket says 172.21.15.115:44310) 2024-09-13T17:16:53.296 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.293+0000 7f36c37fe640 1 -- 172.21.15.115:0/3724213119 learned_addr learned my addr 172.21.15.115:0/3724213119 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:16:53.296 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.293+0000 7f36bbfff640 1 --2- 172.21.15.115:0/3724213119 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f36c4104910 0x7f36c4196da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:53.297 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.293+0000 7f36c37fe640 1 -- 172.21.15.115:0/3724213119 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f36c4104910 msgr2=0x7f36c4196da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:53.297 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.293+0000 7f36c37fe640 1 --2- 172.21.15.115:0/3724213119 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f36c4104910 0x7f36c4196da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:53.297 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.293+0000 7f36c37fe640 1 -- 172.21.15.115:0/3724213119 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36ac009560 con 0x7f36c40fe900 2024-09-13T17:16:53.297 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.293+0000 7f36c37fe640 1 --2- 172.21.15.115:0/3724213119 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f36c40fe900 0x7f36c4196860 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f36b400d8d0 tx=0x7f36b400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:53.297 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.293+0000 7f36c17fa640 1 -- 172.21.15.115:0/3724213119 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f36b4009c00 con 0x7f36c40fe900 2024-09-13T17:16:53.297 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.293+0000 7f36c17fa640 1 -- 172.21.15.115:0/3724213119 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f36b40044c0 con 0x7f36c40fe900 2024-09-13T17:16:53.297 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.293+0000 7f36c9c19640 1 -- 172.21.15.115:0/3724213119 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36c419f8d0 con 0x7f36c40fe900 2024-09-13T17:16:53.297 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.293+0000 7f36c17fa640 1 -- 172.21.15.115:0/3724213119 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f36b40049d0 con 0x7f36c40fe900 2024-09-13T17:16:53.297 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.293+0000 7f36c9c19640 1 -- 172.21.15.115:0/3724213119 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36c419fda0 con 0x7f36c40fe900 2024-09-13T17:16:53.298 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.294+0000 7f36c9c19640 1 -- 172.21.15.115:0/3724213119 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36c4100040 con 0x7f36c40fe900 2024-09-13T17:16:53.298 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.295+0000 7f36c17fa640 1 -- 172.21.15.115:0/3724213119 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f36b4004020 con 0x7f36c40fe900 2024-09-13T17:16:53.298 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.295+0000 7f36c17fa640 1 --2- 172.21.15.115:0/3724213119 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f36b006cc50 0x7f36b006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:53.298 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.295+0000 7f36bbfff640 1 --2- 172.21.15.115:0/3724213119 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f36b006cc50 0x7f36b006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:53.298 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.295+0000 7f36c17fa640 1 -- 172.21.15.115:0/3724213119 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f36b408c260 con 0x7f36c40fe900 2024-09-13T17:16:53.298 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.296+0000 7f36bbfff640 1 --2- 172.21.15.115:0/3724213119 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f36b006cc50 0x7f36b006f110 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f36ac000c00 tx=0x7f36ac005a20 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:53.300 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.299+0000 7f36c17fa640 1 -- 172.21.15.115:0/3724213119 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f36b40562d0 con 0x7f36c40fe900 2024-09-13T17:16:53.326 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:16:52 smithi195 ceph-mon[80021]: from='client.? 172.21.15.115:0/1889296554' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-09-13T17:16:53.326 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:16:52 smithi195 ceph-mon[80021]: from='client.? 172.21.15.115:0/363208057' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-09-13T17:16:53.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:16:52 smithi195 ceph-mon[80021]: from='client.? 172.21.15.115:0/970063225' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-09-13T17:16:53.496 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.495+0000 7f36c9c19640 1 -- 172.21.15.115:0/3724213119 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 31, "format": "json"} v 0) v1 -- 0x7f36c40fed60 con 0x7f36c40fe900 2024-09-13T17:16:53.496 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.495+0000 7f36c17fa640 1 -- 172.21.15.115:0/3724213119 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 31, "format": "json"}]=0 dumped fsmap epoch 31 v39) v1 ==== 107+0+4829 (secure 0 0 0) 0x7f36b40598f0 con 0x7f36c40fe900 2024-09-13T17:16:53.497 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:16:53.497 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34320,"name":"cephfs.smithi115.hbtxod","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6827/2768011029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2768011029},{"type":"v1","addr":"172.21.15.115:6827","nonce":2768011029}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":34324,"name":"cephfs.smithi115.ijznvr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6829/2716683507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":2716683507},{"type":"v1","addr":"172.21.15.115:6829","nonce":2716683507}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":44271,"name":"cephfs.smithi195.qzghxj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6825/825791083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":825791083},{"type":"v1","addr":"172.21.15.195:6825","nonce":825791083}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T17:03:16.313116+0000","modified":"2024-09-13T17:13:38.717470+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24253},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24253":{"gid":24253,"name":"cephfs.smithi195.aevvgz","rank":0,"incarnation":25,"state":"up:active","state_seq":155,"addr":"172.21.15.195:6827/8826118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":8826118},{"type":"v1","addr":"172.21.15.195:6827","nonce":8826118}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-13T17:16:53.497 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 31 2024-09-13T17:16:53.499 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.497+0000 7f36c9c19640 1 -- 172.21.15.115:0/3724213119 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f36b006cc50 msgr2=0x7f36b006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:53.499 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.497+0000 7f36c9c19640 1 --2- 172.21.15.115:0/3724213119 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f36b006cc50 0x7f36b006f110 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f36ac000c00 tx=0x7f36ac005a20 comp rx=0 tx=0).stop 2024-09-13T17:16:53.499 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.497+0000 7f36c9c19640 1 -- 172.21.15.115:0/3724213119 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f36c40fe900 msgr2=0x7f36c4196860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:53.499 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.497+0000 7f36c9c19640 1 --2- 172.21.15.115:0/3724213119 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f36c40fe900 0x7f36c4196860 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f36b400d8d0 tx=0x7f36b400dd90 comp rx=0 tx=0).stop 2024-09-13T17:16:53.499 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.497+0000 7f36c9c19640 1 -- 172.21.15.115:0/3724213119 shutdown_connections 2024-09-13T17:16:53.499 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.497+0000 7f36c9c19640 1 --2- 172.21.15.115:0/3724213119 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f36b006cc50 0x7f36b006f110 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:53.499 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.497+0000 7f36c9c19640 1 --2- 172.21.15.115:0/3724213119 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f36c4104910 0x7f36c4196da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:53.499 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.497+0000 7f36c9c19640 1 --2- 172.21.15.115:0/3724213119 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f36c40fe900 0x7f36c4196860 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:53.499 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.497+0000 7f36c9c19640 1 -- 172.21.15.115:0/3724213119 >> 172.21.15.115:0/3724213119 conn(0x7f36c4075750 msgr2=0x7f36c41022a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:53.499 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.497+0000 7f36c9c19640 1 -- 172.21.15.115:0/3724213119 shutdown_connections 2024-09-13T17:16:53.499 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.498+0000 7f36c9c19640 1 -- 172.21.15.115:0/3724213119 wait complete. 2024-09-13T17:16:53.510 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 31 2024-09-13T17:16:53.510 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 32 2024-09-13T17:16:53.611 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.609+0000 7fd456b33640 1 -- 172.21.15.115:0/2136663194 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4500fe930 msgr2=0x7fd4500fed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:53.612 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.609+0000 7fd456b33640 1 --2- 172.21.15.115:0/2136663194 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4500fe930 0x7fd4500fed90 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd43c009880 tx=0x7fd43c02a4a0 comp rx=0 tx=0).stop 2024-09-13T17:16:53.612 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.609+0000 7fd456b33640 1 -- 172.21.15.115:0/2136663194 shutdown_connections 2024-09-13T17:16:53.612 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.609+0000 7fd456b33640 1 --2- 172.21.15.115:0/2136663194 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4500fe930 0x7fd4500fed90 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:53.612 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.609+0000 7fd456b33640 1 --2- 172.21.15.115:0/2136663194 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd450104940 0x7fd450104d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:53.612 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.609+0000 7fd456b33640 1 -- 172.21.15.115:0/2136663194 >> 172.21.15.115:0/2136663194 conn(0x7fd4500fa5f0 msgr2=0x7fd4500fca10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:53.612 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.609+0000 7fd456b33640 1 -- 172.21.15.115:0/2136663194 shutdown_connections 2024-09-13T17:16:53.612 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.609+0000 7fd456b33640 1 -- 172.21.15.115:0/2136663194 wait complete. 2024-09-13T17:16:53.612 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.609+0000 7fd456b33640 1 Processor -- start 2024-09-13T17:16:53.612 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.609+0000 7fd456b33640 1 -- start start 2024-09-13T17:16:53.612 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.610+0000 7fd456b33640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4500fe930 0x7fd4501959d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:53.612 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.610+0000 7fd456b33640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd450104940 0x7fd450195f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:53.613 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.610+0000 7fd456b33640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4501965f0 con 0x7fd4500fe930 2024-09-13T17:16:53.613 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.610+0000 7fd456b33640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd45019a330 con 0x7fd450104940 2024-09-13T17:16:53.613 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.610+0000 7fd4548cf640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4500fe930 0x7fd4501959d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:53.613 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.610+0000 7fd4548cf640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4500fe930 0x7fd4501959d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:44328/0 (socket says 172.21.15.115:44328) 2024-09-13T17:16:53.613 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.610+0000 7fd4548cf640 1 -- 172.21.15.115:0/1842160484 learned_addr learned my addr 172.21.15.115:0/1842160484 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:16:53.613 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.610+0000 7fd44ffff640 1 --2- 172.21.15.115:0/1842160484 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd450104940 0x7fd450195f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:53.613 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.610+0000 7fd4548cf640 1 -- 172.21.15.115:0/1842160484 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd450104940 msgr2=0x7fd450195f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:53.613 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.610+0000 7fd4548cf640 1 --2- 172.21.15.115:0/1842160484 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd450104940 0x7fd450195f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:53.613 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.610+0000 7fd4548cf640 1 -- 172.21.15.115:0/1842160484 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd43c009560 con 0x7fd4500fe930 2024-09-13T17:16:53.613 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.610+0000 7fd44ffff640 1 --2- 172.21.15.115:0/1842160484 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd450104940 0x7fd450195f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:16:53.613 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.610+0000 7fd4548cf640 1 --2- 172.21.15.115:0/1842160484 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4500fe930 0x7fd4501959d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd44400d8d0 tx=0x7fd44400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:53.613 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.610+0000 7fd44dffb640 1 -- 172.21.15.115:0/1842160484 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd44400bea0 con 0x7fd4500fe930 2024-09-13T17:16:53.613 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.610+0000 7fd456b33640 1 -- 172.21.15.115:0/1842160484 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd45019a610 con 0x7fd4500fe930 2024-09-13T17:16:53.614 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.610+0000 7fd44dffb640 1 -- 172.21.15.115:0/1842160484 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd444009c00 con 0x7fd4500fe930 2024-09-13T17:16:53.614 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.610+0000 7fd44dffb640 1 -- 172.21.15.115:0/1842160484 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd44400f680 con 0x7fd4500fe930 2024-09-13T17:16:53.614 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.611+0000 7fd456b33640 1 -- 172.21.15.115:0/1842160484 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd45019ab70 con 0x7fd4500fe930 2024-09-13T17:16:53.617 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.611+0000 7fd456b33640 1 -- 172.21.15.115:0/1842160484 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd450100070 con 0x7fd4500fe930 2024-09-13T17:16:53.617 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.612+0000 7fd44dffb640 1 -- 172.21.15.115:0/1842160484 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fd444010460 con 0x7fd4500fe930 2024-09-13T17:16:53.617 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.612+0000 7fd44dffb640 1 --2- 172.21.15.115:0/1842160484 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fd44006cc50 0x7fd44006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:53.617 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.612+0000 7fd44dffb640 1 -- 172.21.15.115:0/1842160484 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fd44408c3b0 con 0x7fd4500fe930 2024-09-13T17:16:53.617 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.612+0000 7fd44ffff640 1 --2- 172.21.15.115:0/1842160484 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fd44006cc50 0x7fd44006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:53.617 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.613+0000 7fd44ffff640 1 --2- 172.21.15.115:0/1842160484 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fd44006cc50 0x7fd44006f110 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd43c000c00 tx=0x7fd43c005d50 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:53.617 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.616+0000 7fd44dffb640 1 -- 172.21.15.115:0/1842160484 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd444059eb0 con 0x7fd4500fe930 2024-09-13T17:16:53.813 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.812+0000 7fd456b33640 1 -- 172.21.15.115:0/1842160484 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 32, "format": "json"} v 0) v1 -- 0x7fd450196d20 con 0x7fd4500fe930 2024-09-13T17:16:53.814 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.813+0000 7fd44dffb640 1 -- 172.21.15.115:0/1842160484 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 32, "format": "json"}]=0 dumped fsmap epoch 32 v39) v1 ==== 107+0+4043 (secure 0 0 0) 0x7fd444059a40 con 0x7fd4500fe930 2024-09-13T17:16:53.814 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:16:53.814 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34320,"name":"cephfs.smithi115.hbtxod","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6827/2768011029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2768011029},{"type":"v1","addr":"172.21.15.115:6827","nonce":2768011029}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":34324,"name":"cephfs.smithi115.ijznvr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6829/2716683507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":2716683507},{"type":"v1","addr":"172.21.15.115:6829","nonce":2716683507}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":44271,"name":"cephfs.smithi195.qzghxj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6825/825791083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":825791083},{"type":"v1","addr":"172.21.15.195:6825","nonce":825791083}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T17:03:16.313116+0000","modified":"2024-09-13T17:14:05.810294+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-13T17:16:53.815 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 32 2024-09-13T17:16:53.816 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.815+0000 7fd456b33640 1 -- 172.21.15.115:0/1842160484 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fd44006cc50 msgr2=0x7fd44006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:53.816 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.815+0000 7fd456b33640 1 --2- 172.21.15.115:0/1842160484 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fd44006cc50 0x7fd44006f110 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd43c000c00 tx=0x7fd43c005d50 comp rx=0 tx=0).stop 2024-09-13T17:16:53.816 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.815+0000 7fd456b33640 1 -- 172.21.15.115:0/1842160484 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4500fe930 msgr2=0x7fd4501959d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:53.817 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.815+0000 7fd456b33640 1 --2- 172.21.15.115:0/1842160484 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4500fe930 0x7fd4501959d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd44400d8d0 tx=0x7fd44400dd90 comp rx=0 tx=0).stop 2024-09-13T17:16:53.817 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.815+0000 7fd456b33640 1 -- 172.21.15.115:0/1842160484 shutdown_connections 2024-09-13T17:16:53.817 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.815+0000 7fd456b33640 1 --2- 172.21.15.115:0/1842160484 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fd44006cc50 0x7fd44006f110 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:53.817 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.815+0000 7fd456b33640 1 --2- 172.21.15.115:0/1842160484 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd450104940 0x7fd450195f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:53.817 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.815+0000 7fd456b33640 1 --2- 172.21.15.115:0/1842160484 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4500fe930 0x7fd4501959d0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:53.817 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.815+0000 7fd456b33640 1 -- 172.21.15.115:0/1842160484 >> 172.21.15.115:0/1842160484 conn(0x7fd4500fa5f0 msgr2=0x7fd450108db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:53.817 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.815+0000 7fd456b33640 1 -- 172.21.15.115:0/1842160484 shutdown_connections 2024-09-13T17:16:53.817 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.815+0000 7fd456b33640 1 -- 172.21.15.115:0/1842160484 wait complete. 2024-09-13T17:16:53.827 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 32 2024-09-13T17:16:53.827 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 33 2024-09-13T17:16:53.928 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.925+0000 7fcbc8461640 1 -- 172.21.15.115:0/3186468902 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcbc00fe920 msgr2=0x7fcbc00fed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:53.928 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.925+0000 7fcbc8461640 1 --2- 172.21.15.115:0/3186468902 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcbc00fe920 0x7fcbc00fed80 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fcbb4009880 tx=0x7fcbb402a4a0 comp rx=0 tx=0).stop 2024-09-13T17:16:53.928 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.925+0000 7fcbc8461640 1 -- 172.21.15.115:0/3186468902 shutdown_connections 2024-09-13T17:16:53.928 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.925+0000 7fcbc8461640 1 --2- 172.21.15.115:0/3186468902 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcbc00fe920 0x7fcbc00fed80 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:53.928 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.925+0000 7fcbc8461640 1 --2- 172.21.15.115:0/3186468902 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcbc0104930 0x7fcbc0104d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:53.928 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.925+0000 7fcbc8461640 1 -- 172.21.15.115:0/3186468902 >> 172.21.15.115:0/3186468902 conn(0x7fcbc00fa600 msgr2=0x7fcbc00fca20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:53.928 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.925+0000 7fcbc8461640 1 -- 172.21.15.115:0/3186468902 shutdown_connections 2024-09-13T17:16:53.928 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.925+0000 7fcbc8461640 1 -- 172.21.15.115:0/3186468902 wait complete. 2024-09-13T17:16:53.928 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.926+0000 7fcbc8461640 1 Processor -- start 2024-09-13T17:16:53.929 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.926+0000 7fcbc8461640 1 -- start start 2024-09-13T17:16:53.929 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.926+0000 7fcbc8461640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcbc00fe920 0x7fcbc0196980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:53.929 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.926+0000 7fcbc8461640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcbc0104930 0x7fcbc0196ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:53.929 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.926+0000 7fcbc8461640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc0197490 con 0x7fcbc0104930 2024-09-13T17:16:53.929 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.926+0000 7fcbc8461640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc0197600 con 0x7fcbc00fe920 2024-09-13T17:16:53.929 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.926+0000 7fcbc59fc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcbc0104930 0x7fcbc0196ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:53.929 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.926+0000 7fcbc59fc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcbc0104930 0x7fcbc0196ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:44350/0 (socket says 172.21.15.115:44350) 2024-09-13T17:16:53.929 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.926+0000 7fcbc59fc640 1 -- 172.21.15.115:0/2299797153 learned_addr learned my addr 172.21.15.115:0/2299797153 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:16:53.929 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.926+0000 7fcbc61fd640 1 --2- 172.21.15.115:0/2299797153 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcbc00fe920 0x7fcbc0196980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:53.929 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.926+0000 7fcbc59fc640 1 -- 172.21.15.115:0/2299797153 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcbc00fe920 msgr2=0x7fcbc0196980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:53.929 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.926+0000 7fcbc59fc640 1 --2- 172.21.15.115:0/2299797153 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcbc00fe920 0x7fcbc0196980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:53.929 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.926+0000 7fcbc59fc640 1 -- 172.21.15.115:0/2299797153 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbb4009560 con 0x7fcbc0104930 2024-09-13T17:16:53.929 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.926+0000 7fcbc59fc640 1 --2- 172.21.15.115:0/2299797153 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcbc0104930 0x7fcbc0196ec0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fcbb4006010 tx=0x7fcbb40056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:53.930 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.926+0000 7fcbb37fe640 1 -- 172.21.15.115:0/2299797153 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcbb4004ba0 con 0x7fcbc0104930 2024-09-13T17:16:53.930 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.926+0000 7fcbb37fe640 1 -- 172.21.15.115:0/2299797153 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcbb4004d00 con 0x7fcbc0104930 2024-09-13T17:16:53.930 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.926+0000 7fcbc8461640 1 -- 172.21.15.115:0/2299797153 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbc019f9f0 con 0x7fcbc0104930 2024-09-13T17:16:53.930 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.926+0000 7fcbb37fe640 1 -- 172.21.15.115:0/2299797153 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcbb4031910 con 0x7fcbc0104930 2024-09-13T17:16:53.930 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.927+0000 7fcbc8461640 1 -- 172.21.15.115:0/2299797153 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbc019fdb0 con 0x7fcbc0104930 2024-09-13T17:16:53.931 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.927+0000 7fcbc8461640 1 -- 172.21.15.115:0/2299797153 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbc0100060 con 0x7fcbc0104930 2024-09-13T17:16:53.931 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.928+0000 7fcbb37fe640 1 -- 172.21.15.115:0/2299797153 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fcbb4031b80 con 0x7fcbc0104930 2024-09-13T17:16:53.931 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.928+0000 7fcbb37fe640 1 --2- 172.21.15.115:0/2299797153 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fcbac06cc50 0x7fcbac06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:53.931 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.928+0000 7fcbb37fe640 1 -- 172.21.15.115:0/2299797153 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fcbb40ad7d0 con 0x7fcbc0104930 2024-09-13T17:16:53.931 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.928+0000 7fcbc61fd640 1 --2- 172.21.15.115:0/2299797153 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fcbac06cc50 0x7fcbac06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:53.931 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.929+0000 7fcbc61fd640 1 --2- 172.21.15.115:0/2299797153 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fcbac06cc50 0x7fcbac06f110 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fcbbc00a810 tx=0x7fcbbc008040 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:53.934 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:53.933+0000 7fcbb37fe640 1 -- 172.21.15.115:0/2299797153 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fcbb4077840 con 0x7fcbc0104930 2024-09-13T17:16:54.128 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.127+0000 7fcbc8461640 1 -- 172.21.15.115:0/2299797153 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 33, "format": "json"} v 0) v1 -- 0x7fcbc00fee00 con 0x7fcbc0104930 2024-09-13T17:16:54.128 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.127+0000 7fcbb37fe640 1 -- 172.21.15.115:0/2299797153 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 33, "format": "json"}]=0 dumped fsmap epoch 33 v39) v1 ==== 107+0+4054 (secure 0 0 0) 0x7fcbb407ae60 con 0x7fcbc0104930 2024-09-13T17:16:54.129 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:16:54.129 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":33,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34324,"name":"cephfs.smithi115.ijznvr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6829/2716683507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":2716683507},{"type":"v1","addr":"172.21.15.115:6829","nonce":2716683507}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":44271,"name":"cephfs.smithi195.qzghxj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6825/825791083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":825791083},{"type":"v1","addr":"172.21.15.195:6825","nonce":825791083}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T17:03:16.313116+0000","modified":"2024-09-13T17:14:05.817149+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34320},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34320":{"gid":34320,"name":"cephfs.smithi115.hbtxod","rank":0,"incarnation":33,"state":"up:replay","state_seq":1,"addr":"172.21.15.115:6827/2768011029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2768011029},{"type":"v1","addr":"172.21.15.115:6827","nonce":2768011029}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-13T17:16:54.129 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 33 2024-09-13T17:16:54.131 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.129+0000 7fcbc8461640 1 -- 172.21.15.115:0/2299797153 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fcbac06cc50 msgr2=0x7fcbac06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:54.131 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.129+0000 7fcbc8461640 1 --2- 172.21.15.115:0/2299797153 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fcbac06cc50 0x7fcbac06f110 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fcbbc00a810 tx=0x7fcbbc008040 comp rx=0 tx=0).stop 2024-09-13T17:16:54.131 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.129+0000 7fcbc8461640 1 -- 172.21.15.115:0/2299797153 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcbc0104930 msgr2=0x7fcbc0196ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:54.131 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.129+0000 7fcbc8461640 1 --2- 172.21.15.115:0/2299797153 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcbc0104930 0x7fcbc0196ec0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fcbb4006010 tx=0x7fcbb40056e0 comp rx=0 tx=0).stop 2024-09-13T17:16:54.131 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.129+0000 7fcbc8461640 1 -- 172.21.15.115:0/2299797153 shutdown_connections 2024-09-13T17:16:54.131 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.129+0000 7fcbc8461640 1 --2- 172.21.15.115:0/2299797153 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fcbac06cc50 0x7fcbac06f110 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:54.131 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.129+0000 7fcbc8461640 1 --2- 172.21.15.115:0/2299797153 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcbc0104930 0x7fcbc0196ec0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:54.131 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.129+0000 7fcbc8461640 1 --2- 172.21.15.115:0/2299797153 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcbc00fe920 0x7fcbc0196980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:54.131 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.129+0000 7fcbc8461640 1 -- 172.21.15.115:0/2299797153 >> 172.21.15.115:0/2299797153 conn(0x7fcbc00fa600 msgr2=0x7fcbc00fb900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:54.131 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.129+0000 7fcbc8461640 1 -- 172.21.15.115:0/2299797153 shutdown_connections 2024-09-13T17:16:54.131 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.129+0000 7fcbc8461640 1 -- 172.21.15.115:0/2299797153 wait complete. 2024-09-13T17:16:54.140 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:16:53 smithi115 ceph-mon[109488]: from='client.? 172.21.15.115:0/3495771642' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-09-13T17:16:54.140 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:16:53 smithi115 ceph-mon[109488]: from='client.? 172.21.15.115:0/3724213119' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-09-13T17:16:54.140 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:16:53 smithi115 ceph-mon[109488]: pgmap v346: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T17:16:54.140 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:16:53 smithi115 ceph-mon[109488]: from='client.? 172.21.15.115:0/1842160484' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-09-13T17:16:54.141 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 33 2024-09-13T17:16:54.141 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 34 2024-09-13T17:16:54.244 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.240+0000 7f8f825ff640 1 -- 172.21.15.115:0/948704786 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f7c105a40 msgr2=0x7f8f7c105e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:54.244 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.240+0000 7f8f825ff640 1 --2- 172.21.15.115:0/948704786 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f7c105a40 0x7f8f7c105e20 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c009880 tx=0x7f8f6c02a4a0 comp rx=0 tx=0).stop 2024-09-13T17:16:54.244 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.240+0000 7f8f825ff640 1 -- 172.21.15.115:0/948704786 shutdown_connections 2024-09-13T17:16:54.244 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.240+0000 7f8f825ff640 1 --2- 172.21.15.115:0/948704786 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8f7c0ffa30 0x7f8f7c0ffe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:54.245 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.240+0000 7f8f825ff640 1 --2- 172.21.15.115:0/948704786 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f7c105a40 0x7f8f7c105e20 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:54.245 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.240+0000 7f8f825ff640 1 -- 172.21.15.115:0/948704786 >> 172.21.15.115:0/948704786 conn(0x7f8f7c0fb710 msgr2=0x7f8f7c0fdb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:54.245 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.240+0000 7f8f825ff640 1 -- 172.21.15.115:0/948704786 shutdown_connections 2024-09-13T17:16:54.245 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.240+0000 7f8f825ff640 1 -- 172.21.15.115:0/948704786 wait complete. 2024-09-13T17:16:54.245 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.240+0000 7f8f825ff640 1 Processor -- start 2024-09-13T17:16:54.246 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.240+0000 7f8f825ff640 1 -- start start 2024-09-13T17:16:54.246 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.241+0000 7f8f825ff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f7c0ffa30 0x7f8f7c195a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:54.246 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.241+0000 7f8f825ff640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8f7c105a40 0x7f8f7c195f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:54.247 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.241+0000 7f8f825ff640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f7c196630 con 0x7f8f7c0ffa30 2024-09-13T17:16:54.247 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.241+0000 7f8f825ff640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f7c19a370 con 0x7f8f7c105a40 2024-09-13T17:16:54.247 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.241+0000 7f8f7bfff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f7c0ffa30 0x7f8f7c195a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:54.247 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.241+0000 7f8f7bfff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f7c0ffa30 0x7f8f7c195a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:38798/0 (socket says 172.21.15.115:38798) 2024-09-13T17:16:54.247 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.241+0000 7f8f7bfff640 1 -- 172.21.15.115:0/3587652462 learned_addr learned my addr 172.21.15.115:0/3587652462 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:16:54.247 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.241+0000 7f8f7b7fe640 1 --2- 172.21.15.115:0/3587652462 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8f7c105a40 0x7f8f7c195f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:54.248 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.241+0000 7f8f7bfff640 1 -- 172.21.15.115:0/3587652462 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8f7c105a40 msgr2=0x7f8f7c195f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:54.248 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.241+0000 7f8f7bfff640 1 --2- 172.21.15.115:0/3587652462 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8f7c105a40 0x7f8f7c195f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:54.248 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.241+0000 7f8f7bfff640 1 -- 172.21.15.115:0/3587652462 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f6c009560 con 0x7f8f7c0ffa30 2024-09-13T17:16:54.248 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.241+0000 7f8f7b7fe640 1 --2- 172.21.15.115:0/3587652462 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8f7c105a40 0x7f8f7c195f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:16:54.248 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.241+0000 7f8f7bfff640 1 --2- 172.21.15.115:0/3587652462 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f7c0ffa30 0x7f8f7c195a10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c006010 tx=0x7f8f6c0056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:54.248 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.242+0000 7f8f797fa640 1 -- 172.21.15.115:0/3587652462 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f6c004ba0 con 0x7f8f7c0ffa30 2024-09-13T17:16:54.249 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.242+0000 7f8f797fa640 1 -- 172.21.15.115:0/3587652462 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8f6c004d00 con 0x7f8f7c0ffa30 2024-09-13T17:16:54.249 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.242+0000 7f8f797fa640 1 -- 172.21.15.115:0/3587652462 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f6c031910 con 0x7f8f7c0ffa30 2024-09-13T17:16:54.249 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.242+0000 7f8f825ff640 1 -- 172.21.15.115:0/3587652462 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f7c19a5f0 con 0x7f8f7c0ffa30 2024-09-13T17:16:54.249 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.242+0000 7f8f825ff640 1 -- 172.21.15.115:0/3587652462 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f7c19aaf0 con 0x7f8f7c0ffa30 2024-09-13T17:16:54.249 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.243+0000 7f8f825ff640 1 -- 172.21.15.115:0/3587652462 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f7c101170 con 0x7f8f7c0ffa30 2024-09-13T17:16:54.251 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.243+0000 7f8f797fa640 1 -- 172.21.15.115:0/3587652462 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f8f6c031b80 con 0x7f8f7c0ffa30 2024-09-13T17:16:54.251 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.244+0000 7f8f797fa640 1 --2- 172.21.15.115:0/3587652462 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f8f6406cc50 0x7f8f6406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:54.251 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.244+0000 7f8f797fa640 1 -- 172.21.15.115:0/3587652462 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f8f6c0ad7d0 con 0x7f8f7c0ffa30 2024-09-13T17:16:54.251 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.244+0000 7f8f7b7fe640 1 --2- 172.21.15.115:0/3587652462 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f8f6406cc50 0x7f8f6406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:54.252 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.244+0000 7f8f7b7fe640 1 --2- 172.21.15.115:0/3587652462 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f8f6406cc50 0x7f8f6406f110 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8f70005fd0 tx=0x7f8f70005ea0 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:54.252 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.248+0000 7f8f797fa640 1 -- 172.21.15.115:0/3587652462 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f8f6c077840 con 0x7f8f7c0ffa30 2024-09-13T17:16:54.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:16:53 smithi195 ceph-mon[80021]: from='client.? 172.21.15.115:0/3495771642' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-09-13T17:16:54.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:16:53 smithi195 ceph-mon[80021]: from='client.? 172.21.15.115:0/3724213119' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-09-13T17:16:54.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:16:53 smithi195 ceph-mon[80021]: pgmap v346: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T17:16:54.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:16:53 smithi195 ceph-mon[80021]: from='client.? 172.21.15.115:0/1842160484' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-09-13T17:16:54.443 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.442+0000 7f8f825ff640 1 -- 172.21.15.115:0/3587652462 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 34, "format": "json"} v 0) v1 -- 0x7f8f7c196d60 con 0x7f8f7c0ffa30 2024-09-13T17:16:54.444 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.443+0000 7f8f797fa640 1 -- 172.21.15.115:0/3587652462 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 34, "format": "json"}]=0 dumped fsmap epoch 34 v39) v1 ==== 107+0+4058 (secure 0 0 0) 0x7f8f6c07ae60 con 0x7f8f7c0ffa30 2024-09-13T17:16:54.444 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:16:54.444 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":34,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34324,"name":"cephfs.smithi115.ijznvr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6829/2716683507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":2716683507},{"type":"v1","addr":"172.21.15.115:6829","nonce":2716683507}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":44271,"name":"cephfs.smithi195.qzghxj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6825/825791083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":825791083},{"type":"v1","addr":"172.21.15.195:6825","nonce":825791083}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T17:03:16.313116+0000","modified":"2024-09-13T17:14:13.538477+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34320},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34320":{"gid":34320,"name":"cephfs.smithi115.hbtxod","rank":0,"incarnation":33,"state":"up:reconnect","state_seq":15,"addr":"172.21.15.115:6827/2768011029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2768011029},{"type":"v1","addr":"172.21.15.115:6827","nonce":2768011029}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-13T17:16:54.445 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 34 2024-09-13T17:16:54.446 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.445+0000 7f8f825ff640 1 -- 172.21.15.115:0/3587652462 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f8f6406cc50 msgr2=0x7f8f6406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:54.446 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.445+0000 7f8f825ff640 1 --2- 172.21.15.115:0/3587652462 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f8f6406cc50 0x7f8f6406f110 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8f70005fd0 tx=0x7f8f70005ea0 comp rx=0 tx=0).stop 2024-09-13T17:16:54.446 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.445+0000 7f8f825ff640 1 -- 172.21.15.115:0/3587652462 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f7c0ffa30 msgr2=0x7f8f7c195a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:54.447 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.445+0000 7f8f825ff640 1 --2- 172.21.15.115:0/3587652462 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f7c0ffa30 0x7f8f7c195a10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c006010 tx=0x7f8f6c0056e0 comp rx=0 tx=0).stop 2024-09-13T17:16:54.447 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.445+0000 7f8f825ff640 1 -- 172.21.15.115:0/3587652462 shutdown_connections 2024-09-13T17:16:54.447 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.445+0000 7f8f825ff640 1 --2- 172.21.15.115:0/3587652462 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f8f6406cc50 0x7f8f6406f110 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:54.447 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.445+0000 7f8f825ff640 1 --2- 172.21.15.115:0/3587652462 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8f7c105a40 0x7f8f7c195f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:54.447 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.445+0000 7f8f825ff640 1 --2- 172.21.15.115:0/3587652462 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f7c0ffa30 0x7f8f7c195a10 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:54.447 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.445+0000 7f8f825ff640 1 -- 172.21.15.115:0/3587652462 >> 172.21.15.115:0/3587652462 conn(0x7f8f7c0fb710 msgr2=0x7f8f7c0fc910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:54.447 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.445+0000 7f8f825ff640 1 -- 172.21.15.115:0/3587652462 shutdown_connections 2024-09-13T17:16:54.447 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.445+0000 7f8f825ff640 1 -- 172.21.15.115:0/3587652462 wait complete. 2024-09-13T17:16:54.457 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 34 2024-09-13T17:16:54.457 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 35 2024-09-13T17:16:54.559 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.556+0000 7fb8a6983640 1 -- 172.21.15.115:0/928894636 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb8a00ffa10 msgr2=0x7fb8a00ffe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:54.559 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.556+0000 7fb8a6983640 1 --2- 172.21.15.115:0/928894636 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb8a00ffa10 0x7fb8a00ffe70 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb888009880 tx=0x7fb88802a4a0 comp rx=0 tx=0).stop 2024-09-13T17:16:54.559 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.556+0000 7fb8a6983640 1 -- 172.21.15.115:0/928894636 shutdown_connections 2024-09-13T17:16:54.559 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.556+0000 7fb8a6983640 1 --2- 172.21.15.115:0/928894636 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb8a00ffa10 0x7fb8a00ffe70 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:54.559 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.556+0000 7fb8a6983640 1 --2- 172.21.15.115:0/928894636 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb8a0105a20 0x7fb8a0105e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:54.559 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.556+0000 7fb8a6983640 1 -- 172.21.15.115:0/928894636 >> 172.21.15.115:0/928894636 conn(0x7fb8a00fb710 msgr2=0x7fb8a00fdb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:54.559 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.556+0000 7fb8a6983640 1 -- 172.21.15.115:0/928894636 shutdown_connections 2024-09-13T17:16:54.559 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.556+0000 7fb8a6983640 1 -- 172.21.15.115:0/928894636 wait complete. 2024-09-13T17:16:54.560 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.557+0000 7fb8a6983640 1 Processor -- start 2024-09-13T17:16:54.560 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.557+0000 7fb8a6983640 1 -- start start 2024-09-13T17:16:54.560 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.557+0000 7fb8a6983640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb8a00ffa10 0x7fb8a019b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:54.560 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.557+0000 7fb8a6983640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb8a0105a20 0x7fb8a019bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:54.560 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.557+0000 7fb8a6983640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a019c2a0 con 0x7fb8a00ffa10 2024-09-13T17:16:54.560 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.557+0000 7fb8a6983640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a01957f0 con 0x7fb8a0105a20 2024-09-13T17:16:54.560 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.557+0000 7fb89ffff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb8a00ffa10 0x7fb8a019b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:54.560 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.557+0000 7fb89ffff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb8a00ffa10 0x7fb8a019b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:38818/0 (socket says 172.21.15.115:38818) 2024-09-13T17:16:54.560 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.557+0000 7fb89ffff640 1 -- 172.21.15.115:0/3157661670 learned_addr learned my addr 172.21.15.115:0/3157661670 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:16:54.560 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.557+0000 7fb89ffff640 1 -- 172.21.15.115:0/3157661670 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb8a0105a20 msgr2=0x7fb8a019bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:54.560 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.557+0000 7fb89ffff640 1 --2- 172.21.15.115:0/3157661670 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb8a0105a20 0x7fb8a019bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:54.560 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.557+0000 7fb89ffff640 1 -- 172.21.15.115:0/3157661670 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb888009560 con 0x7fb8a00ffa10 2024-09-13T17:16:54.560 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.557+0000 7fb89ffff640 1 --2- 172.21.15.115:0/3157661670 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb8a00ffa10 0x7fb8a019b710 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb89000c8a0 tx=0x7fb89000cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:54.561 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.557+0000 7fb89dffb640 1 -- 172.21.15.115:0/3157661670 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb890007b80 con 0x7fb8a00ffa10 2024-09-13T17:16:54.561 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.558+0000 7fb8a6983640 1 -- 172.21.15.115:0/3157661670 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8a0195aa0 con 0x7fb8a00ffa10 2024-09-13T17:16:54.561 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.558+0000 7fb89dffb640 1 -- 172.21.15.115:0/3157661670 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb890007ce0 con 0x7fb8a00ffa10 2024-09-13T17:16:54.561 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.558+0000 7fb89dffb640 1 -- 172.21.15.115:0/3157661670 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb890018770 con 0x7fb8a00ffa10 2024-09-13T17:16:54.561 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.558+0000 7fb8a6983640 1 -- 172.21.15.115:0/3157661670 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8a0196000 con 0x7fb8a00ffa10 2024-09-13T17:16:54.561 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.558+0000 7fb8a6983640 1 -- 172.21.15.115:0/3157661670 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8a0101150 con 0x7fb8a00ffa10 2024-09-13T17:16:54.562 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.559+0000 7fb89dffb640 1 -- 172.21.15.115:0/3157661670 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fb8900189e0 con 0x7fb8a00ffa10 2024-09-13T17:16:54.562 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.559+0000 7fb89dffb640 1 --2- 172.21.15.115:0/3157661670 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fb88c06cc50 0x7fb88c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:54.562 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.560+0000 7fb89dffb640 1 -- 172.21.15.115:0/3157661670 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fb89008c7e0 con 0x7fb8a00ffa10 2024-09-13T17:16:54.562 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.560+0000 7fb897fff640 1 --2- 172.21.15.115:0/3157661670 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fb88c06cc50 0x7fb88c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:54.562 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.560+0000 7fb897fff640 1 --2- 172.21.15.115:0/3157661670 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fb88c06cc50 0x7fb88c06f110 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb8a0196c60 tx=0x7fb888000bc0 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:54.565 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.564+0000 7fb89dffb640 1 -- 172.21.15.115:0/3157661670 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fb890056850 con 0x7fb8a00ffa10 2024-09-13T17:16:54.763 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.762+0000 7fb8a6983640 1 -- 172.21.15.115:0/3157661670 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 35, "format": "json"} v 0) v1 -- 0x7fb8a00ffe70 con 0x7fb8a00ffa10 2024-09-13T17:16:54.763 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.762+0000 7fb89dffb640 1 -- 172.21.15.115:0/3157661670 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 35, "format": "json"}]=0 dumped fsmap epoch 35 v39) v1 ==== 107+0+4055 (secure 0 0 0) 0x7fb890059e70 con 0x7fb8a00ffa10 2024-09-13T17:16:54.764 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:16:54.764 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":35,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34324,"name":"cephfs.smithi115.ijznvr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6829/2716683507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":2716683507},{"type":"v1","addr":"172.21.15.115:6829","nonce":2716683507}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":44271,"name":"cephfs.smithi195.qzghxj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6825/825791083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":825791083},{"type":"v1","addr":"172.21.15.195:6825","nonce":825791083}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T17:03:16.313116+0000","modified":"2024-09-13T17:14:14.542908+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34320},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34320":{"gid":34320,"name":"cephfs.smithi115.hbtxod","rank":0,"incarnation":33,"state":"up:rejoin","state_seq":16,"addr":"172.21.15.115:6827/2768011029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2768011029},{"type":"v1","addr":"172.21.15.115:6827","nonce":2768011029}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-13T17:16:54.764 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 35 2024-09-13T17:16:54.766 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.764+0000 7fb8a6983640 1 -- 172.21.15.115:0/3157661670 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fb88c06cc50 msgr2=0x7fb88c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:54.766 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.764+0000 7fb8a6983640 1 --2- 172.21.15.115:0/3157661670 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fb88c06cc50 0x7fb88c06f110 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb8a0196c60 tx=0x7fb888000bc0 comp rx=0 tx=0).stop 2024-09-13T17:16:54.766 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.764+0000 7fb8a6983640 1 -- 172.21.15.115:0/3157661670 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb8a00ffa10 msgr2=0x7fb8a019b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:54.766 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.764+0000 7fb8a6983640 1 --2- 172.21.15.115:0/3157661670 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb8a00ffa10 0x7fb8a019b710 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb89000c8a0 tx=0x7fb89000cd60 comp rx=0 tx=0).stop 2024-09-13T17:16:54.766 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.764+0000 7fb8a6983640 1 -- 172.21.15.115:0/3157661670 shutdown_connections 2024-09-13T17:16:54.766 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.764+0000 7fb8a6983640 1 --2- 172.21.15.115:0/3157661670 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fb88c06cc50 0x7fb88c06f110 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:54.766 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.764+0000 7fb8a6983640 1 --2- 172.21.15.115:0/3157661670 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb8a0105a20 0x7fb8a019bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:54.766 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.764+0000 7fb8a6983640 1 --2- 172.21.15.115:0/3157661670 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb8a00ffa10 0x7fb8a019b710 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:54.766 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.764+0000 7fb8a6983640 1 -- 172.21.15.115:0/3157661670 >> 172.21.15.115:0/3157661670 conn(0x7fb8a00fb710 msgr2=0x7fb8a00fc910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:54.766 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.764+0000 7fb8a6983640 1 -- 172.21.15.115:0/3157661670 shutdown_connections 2024-09-13T17:16:54.766 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.764+0000 7fb8a6983640 1 -- 172.21.15.115:0/3157661670 wait complete. 2024-09-13T17:16:54.776 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 35 2024-09-13T17:16:54.776 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 36 2024-09-13T17:16:54.878 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.875+0000 7fb3b2f1f640 1 -- 172.21.15.115:0/3317654144 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3ac0fdf50 msgr2=0x7fb3ac0fe3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:54.879 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.875+0000 7fb3b2f1f640 1 --2- 172.21.15.115:0/3317654144 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3ac0fdf50 0x7fb3ac0fe3b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb398009880 tx=0x7fb39802a4a0 comp rx=0 tx=0).stop 2024-09-13T17:16:54.880 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.875+0000 7fb3b2f1f640 1 -- 172.21.15.115:0/3317654144 shutdown_connections 2024-09-13T17:16:54.880 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.875+0000 7fb3b2f1f640 1 --2- 172.21.15.115:0/3317654144 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3ac0fdf50 0x7fb3ac0fe3b0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:54.880 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.875+0000 7fb3b2f1f640 1 --2- 172.21.15.115:0/3317654144 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb3ac104a30 0x7fb3ac104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:54.880 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.875+0000 7fb3b2f1f640 1 -- 172.21.15.115:0/3317654144 >> 172.21.15.115:0/3317654144 conn(0x7fb3ac0f9da0 msgr2=0x7fb3ac0fc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:54.880 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.875+0000 7fb3b2f1f640 1 -- 172.21.15.115:0/3317654144 shutdown_connections 2024-09-13T17:16:54.880 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.875+0000 7fb3b2f1f640 1 -- 172.21.15.115:0/3317654144 wait complete. 2024-09-13T17:16:54.880 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.875+0000 7fb3b2f1f640 1 Processor -- start 2024-09-13T17:16:54.880 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.876+0000 7fb3b2f1f640 1 -- start start 2024-09-13T17:16:54.880 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.876+0000 7fb3b2f1f640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb3ac0fdf50 0x7fb3ac19b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:54.880 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.876+0000 7fb3b2f1f640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3ac104a30 0x7fb3ac19bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:54.880 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.876+0000 7fb3b2f1f640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3ac19c260 con 0x7fb3ac104a30 2024-09-13T17:16:54.881 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.876+0000 7fb3b2f1f640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3ac195870 con 0x7fb3ac0fdf50 2024-09-13T17:16:54.881 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.876+0000 7fb3abfff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3ac104a30 0x7fb3ac19bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:54.881 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.876+0000 7fb3abfff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3ac104a30 0x7fb3ac19bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:38838/0 (socket says 172.21.15.115:38838) 2024-09-13T17:16:54.881 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.876+0000 7fb3abfff640 1 -- 172.21.15.115:0/256774433 learned_addr learned my addr 172.21.15.115:0/256774433 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:16:54.881 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.876+0000 7fb3b0cbb640 1 --2- 172.21.15.115:0/256774433 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb3ac0fdf50 0x7fb3ac19b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:54.881 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.876+0000 7fb3abfff640 1 -- 172.21.15.115:0/256774433 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb3ac0fdf50 msgr2=0x7fb3ac19b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:54.881 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.876+0000 7fb3abfff640 1 --2- 172.21.15.115:0/256774433 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb3ac0fdf50 0x7fb3ac19b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:54.881 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.876+0000 7fb3abfff640 1 -- 172.21.15.115:0/256774433 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb398009560 con 0x7fb3ac104a30 2024-09-13T17:16:54.881 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.876+0000 7fb3abfff640 1 --2- 172.21.15.115:0/256774433 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3ac104a30 0x7fb3ac19bcd0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb398006010 tx=0x7fb3980056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:54.881 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.876+0000 7fb3a9ffb640 1 -- 172.21.15.115:0/256774433 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb398004ba0 con 0x7fb3ac104a30 2024-09-13T17:16:54.881 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.876+0000 7fb3a9ffb640 1 -- 172.21.15.115:0/256774433 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb398004d00 con 0x7fb3ac104a30 2024-09-13T17:16:54.881 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.876+0000 7fb3b2f1f640 1 -- 172.21.15.115:0/256774433 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3ac195af0 con 0x7fb3ac104a30 2024-09-13T17:16:54.881 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.876+0000 7fb3a9ffb640 1 -- 172.21.15.115:0/256774433 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb398031910 con 0x7fb3ac104a30 2024-09-13T17:16:54.881 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.877+0000 7fb3b2f1f640 1 -- 172.21.15.115:0/256774433 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3ac195ff0 con 0x7fb3ac104a30 2024-09-13T17:16:54.882 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.878+0000 7fb3b2f1f640 1 -- 172.21.15.115:0/256774433 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3ac101270 con 0x7fb3ac104a30 2024-09-13T17:16:54.883 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.878+0000 7fb3a9ffb640 1 -- 172.21.15.115:0/256774433 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fb398031b80 con 0x7fb3ac104a30 2024-09-13T17:16:54.883 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.879+0000 7fb3a9ffb640 1 --2- 172.21.15.115:0/256774433 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fb39c06cc50 0x7fb39c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:54.883 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.879+0000 7fb3a9ffb640 1 -- 172.21.15.115:0/256774433 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fb3980ad7d0 con 0x7fb3ac104a30 2024-09-13T17:16:54.883 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.879+0000 7fb3b0cbb640 1 --2- 172.21.15.115:0/256774433 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fb39c06cc50 0x7fb39c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:54.883 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.879+0000 7fb3b0cbb640 1 --2- 172.21.15.115:0/256774433 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fb39c06cc50 0x7fb39c06f110 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb3a0005e10 tx=0x7fb3a0005da0 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:54.884 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:54.883+0000 7fb3a9ffb640 1 -- 172.21.15.115:0/256774433 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fb398077840 con 0x7fb3ac104a30 2024-09-13T17:16:55.083 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.082+0000 7fb3b2f1f640 1 -- 172.21.15.115:0/256774433 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 36, "format": "json"} v 0) v1 -- 0x7fb3ac196d80 con 0x7fb3ac104a30 2024-09-13T17:16:55.084 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.082+0000 7fb3a9ffb640 1 -- 172.21.15.115:0/256774433 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 36, "format": "json"}]=0 dumped fsmap epoch 36 v39) v1 ==== 107+0+4834 (secure 0 0 0) 0x7fb39807ae60 con 0x7fb3ac104a30 2024-09-13T17:16:55.084 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:16:55.084 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34324,"name":"cephfs.smithi115.ijznvr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6829/2716683507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":2716683507},{"type":"v1","addr":"172.21.15.115:6829","nonce":2716683507}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":44271,"name":"cephfs.smithi195.qzghxj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6825/825791083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":825791083},{"type":"v1","addr":"172.21.15.195:6825","nonce":825791083}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":31},{"gid":44287,"name":"cephfs.smithi195.aevvgz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6827/589520116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":589520116},{"type":"v1","addr":"172.21.15.195:6827","nonce":589520116}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T17:03:16.313116+0000","modified":"2024-09-13T17:14:15.547169+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34320},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34320":{"gid":34320,"name":"cephfs.smithi115.hbtxod","rank":0,"incarnation":33,"state":"up:active","state_seq":17,"addr":"172.21.15.115:6827/2768011029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2768011029},{"type":"v1","addr":"172.21.15.115:6827","nonce":2768011029}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-13T17:16:55.084 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 36 2024-09-13T17:16:55.086 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.084+0000 7fb3b2f1f640 1 -- 172.21.15.115:0/256774433 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fb39c06cc50 msgr2=0x7fb39c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:55.086 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.084+0000 7fb3b2f1f640 1 --2- 172.21.15.115:0/256774433 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fb39c06cc50 0x7fb39c06f110 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb3a0005e10 tx=0x7fb3a0005da0 comp rx=0 tx=0).stop 2024-09-13T17:16:55.086 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.084+0000 7fb3b2f1f640 1 -- 172.21.15.115:0/256774433 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3ac104a30 msgr2=0x7fb3ac19bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:55.086 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.084+0000 7fb3b2f1f640 1 --2- 172.21.15.115:0/256774433 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3ac104a30 0x7fb3ac19bcd0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb398006010 tx=0x7fb3980056e0 comp rx=0 tx=0).stop 2024-09-13T17:16:55.086 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.085+0000 7fb3b2f1f640 1 -- 172.21.15.115:0/256774433 shutdown_connections 2024-09-13T17:16:55.086 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.085+0000 7fb3b2f1f640 1 --2- 172.21.15.115:0/256774433 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fb39c06cc50 0x7fb39c06f110 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:55.086 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.085+0000 7fb3b2f1f640 1 --2- 172.21.15.115:0/256774433 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3ac104a30 0x7fb3ac19bcd0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:55.087 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.085+0000 7fb3b2f1f640 1 --2- 172.21.15.115:0/256774433 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb3ac0fdf50 0x7fb3ac19b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:55.087 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.085+0000 7fb3b2f1f640 1 -- 172.21.15.115:0/256774433 >> 172.21.15.115:0/256774433 conn(0x7fb3ac0f9da0 msgr2=0x7fb3ac0fafc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:55.087 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.085+0000 7fb3b2f1f640 1 -- 172.21.15.115:0/256774433 shutdown_connections 2024-09-13T17:16:55.087 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.085+0000 7fb3b2f1f640 1 -- 172.21.15.115:0/256774433 wait complete. 2024-09-13T17:16:55.095 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:16:54 smithi115 ceph-mon[109488]: from='client.? 172.21.15.115:0/2299797153' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-09-13T17:16:55.095 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:16:54 smithi115 ceph-mon[109488]: from='client.? 172.21.15.115:0/3587652462' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-09-13T17:16:55.096 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:16:54 smithi115 ceph-mon[109488]: from='client.? 172.21.15.115:0/3157661670' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 35, "format": "json"}]: dispatch 2024-09-13T17:16:55.097 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 36 2024-09-13T17:16:55.097 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 37 2024-09-13T17:16:55.202 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.195+0000 7fb327e72640 1 -- 172.21.15.115:0/3066692753 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb320104940 msgr2=0x7fb320104d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:55.202 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.195+0000 7fb327e72640 1 --2- 172.21.15.115:0/3066692753 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb320104940 0x7fb320104d20 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb310009880 tx=0x7fb31002a4a0 comp rx=0 tx=0).stop 2024-09-13T17:16:55.203 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.195+0000 7fb327e72640 1 -- 172.21.15.115:0/3066692753 shutdown_connections 2024-09-13T17:16:55.203 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.195+0000 7fb327e72640 1 --2- 172.21.15.115:0/3066692753 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb3200fe930 0x7fb3200fed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:55.203 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.195+0000 7fb327e72640 1 --2- 172.21.15.115:0/3066692753 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb320104940 0x7fb320104d20 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:55.203 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.195+0000 7fb327e72640 1 -- 172.21.15.115:0/3066692753 >> 172.21.15.115:0/3066692753 conn(0x7fb3200fa5f0 msgr2=0x7fb3200fca10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:55.203 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.195+0000 7fb327e72640 1 -- 172.21.15.115:0/3066692753 shutdown_connections 2024-09-13T17:16:55.204 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.195+0000 7fb327e72640 1 -- 172.21.15.115:0/3066692753 wait complete. 2024-09-13T17:16:55.204 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.196+0000 7fb327e72640 1 Processor -- start 2024-09-13T17:16:55.204 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.196+0000 7fb327e72640 1 -- start start 2024-09-13T17:16:55.204 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.196+0000 7fb327e72640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3200fe930 0x7fb320196870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:55.204 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.196+0000 7fb327e72640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb320104940 0x7fb320196db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:55.205 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.196+0000 7fb327e72640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb320197380 con 0x7fb3200fe930 2024-09-13T17:16:55.205 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.196+0000 7fb327e72640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3201974f0 con 0x7fb320104940 2024-09-13T17:16:55.205 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.196+0000 7fb325c0e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3200fe930 0x7fb320196870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:55.205 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.196+0000 7fb325c0e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3200fe930 0x7fb320196870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:38846/0 (socket says 172.21.15.115:38846) 2024-09-13T17:16:55.205 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.196+0000 7fb325c0e640 1 -- 172.21.15.115:0/2989468849 learned_addr learned my addr 172.21.15.115:0/2989468849 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:16:55.206 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.196+0000 7fb32540d640 1 --2- 172.21.15.115:0/2989468849 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb320104940 0x7fb320196db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:55.206 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.196+0000 7fb325c0e640 1 -- 172.21.15.115:0/2989468849 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb320104940 msgr2=0x7fb320196db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:55.206 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.196+0000 7fb325c0e640 1 --2- 172.21.15.115:0/2989468849 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb320104940 0x7fb320196db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:55.206 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.196+0000 7fb325c0e640 1 -- 172.21.15.115:0/2989468849 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb310009560 con 0x7fb3200fe930 2024-09-13T17:16:55.206 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.196+0000 7fb32540d640 1 --2- 172.21.15.115:0/2989468849 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb320104940 0x7fb320196db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:16:55.207 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.196+0000 7fb325c0e640 1 --2- 172.21.15.115:0/2989468849 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3200fe930 0x7fb320196870 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb310006010 tx=0x7fb3100055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:55.207 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.196+0000 7fb316ffd640 1 -- 172.21.15.115:0/2989468849 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb310004aa0 con 0x7fb3200fe930 2024-09-13T17:16:55.207 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.196+0000 7fb316ffd640 1 -- 172.21.15.115:0/2989468849 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb310004c00 con 0x7fb3200fe930 2024-09-13T17:16:55.207 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.196+0000 7fb327e72640 1 -- 172.21.15.115:0/2989468849 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb32019f8e0 con 0x7fb3200fe930 2024-09-13T17:16:55.207 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.196+0000 7fb316ffd640 1 -- 172.21.15.115:0/2989468849 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb310031910 con 0x7fb3200fe930 2024-09-13T17:16:55.208 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.197+0000 7fb327e72640 1 -- 172.21.15.115:0/2989468849 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb32019fca0 con 0x7fb3200fe930 2024-09-13T17:16:55.208 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.197+0000 7fb327e72640 1 -- 172.21.15.115:0/2989468849 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb320100070 con 0x7fb3200fe930 2024-09-13T17:16:55.208 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.198+0000 7fb316ffd640 1 -- 172.21.15.115:0/2989468849 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fb310031a70 con 0x7fb3200fe930 2024-09-13T17:16:55.208 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.198+0000 7fb316ffd640 1 --2- 172.21.15.115:0/2989468849 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fb30c06cc50 0x7fb30c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:55.208 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.198+0000 7fb316ffd640 1 -- 172.21.15.115:0/2989468849 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fb3100ad690 con 0x7fb3200fe930 2024-09-13T17:16:55.209 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.198+0000 7fb32540d640 1 --2- 172.21.15.115:0/2989468849 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fb30c06cc50 0x7fb30c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:55.209 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.199+0000 7fb32540d640 1 --2- 172.21.15.115:0/2989468849 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fb30c06cc50 0x7fb30c06f110 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb320068810 tx=0x7fb31c005e50 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:55.209 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.203+0000 7fb316ffd640 1 -- 172.21.15.115:0/2989468849 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fb310077780 con 0x7fb3200fe930 2024-09-13T17:16:55.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:16:54 smithi195 ceph-mon[80021]: from='client.? 172.21.15.115:0/2299797153' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-09-13T17:16:55.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:16:54 smithi195 ceph-mon[80021]: from='client.? 172.21.15.115:0/3587652462' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-09-13T17:16:55.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:16:54 smithi195 ceph-mon[80021]: from='client.? 172.21.15.115:0/3157661670' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 35, "format": "json"}]: dispatch 2024-09-13T17:16:55.400 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.399+0000 7fb327e72640 1 -- 172.21.15.115:0/2989468849 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 37, "format": "json"} v 0) v1 -- 0x7fb3200685c0 con 0x7fb3200fe930 2024-09-13T17:16:55.400 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.399+0000 7fb316ffd640 1 -- 172.21.15.115:0/2989468849 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 37, "format": "json"}]=0 dumped fsmap epoch 37 v39) v1 ==== 107+0+4834 (secure 0 0 0) 0x7fb31007ada0 con 0x7fb3200fe930 2024-09-13T17:16:55.401 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:16:55.401 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":37,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34324,"name":"cephfs.smithi115.ijznvr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6829/2716683507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":2716683507},{"type":"v1","addr":"172.21.15.115:6829","nonce":2716683507}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":44271,"name":"cephfs.smithi195.qzghxj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6825/825791083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":825791083},{"type":"v1","addr":"172.21.15.195:6825","nonce":825791083}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":31},{"gid":44287,"name":"cephfs.smithi195.aevvgz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6827/589520116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":589520116},{"type":"v1","addr":"172.21.15.195:6827","nonce":589520116}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T17:03:16.313116+0000","modified":"2024-09-13T17:14:22.933942+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34320},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34320":{"gid":34320,"name":"cephfs.smithi115.hbtxod","rank":0,"incarnation":33,"state":"up:active","state_seq":17,"addr":"172.21.15.115:6827/2768011029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2768011029},{"type":"v1","addr":"172.21.15.115:6827","nonce":2768011029}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-13T17:16:55.401 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 37 2024-09-13T17:16:55.403 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.401+0000 7fb327e72640 1 -- 172.21.15.115:0/2989468849 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fb30c06cc50 msgr2=0x7fb30c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:55.403 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.401+0000 7fb327e72640 1 --2- 172.21.15.115:0/2989468849 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fb30c06cc50 0x7fb30c06f110 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb320068810 tx=0x7fb31c005e50 comp rx=0 tx=0).stop 2024-09-13T17:16:55.403 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.401+0000 7fb327e72640 1 -- 172.21.15.115:0/2989468849 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3200fe930 msgr2=0x7fb320196870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:55.403 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.401+0000 7fb327e72640 1 --2- 172.21.15.115:0/2989468849 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3200fe930 0x7fb320196870 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb310006010 tx=0x7fb3100055a0 comp rx=0 tx=0).stop 2024-09-13T17:16:55.403 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.401+0000 7fb327e72640 1 -- 172.21.15.115:0/2989468849 shutdown_connections 2024-09-13T17:16:55.403 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.401+0000 7fb327e72640 1 --2- 172.21.15.115:0/2989468849 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fb30c06cc50 0x7fb30c06f110 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:55.403 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.401+0000 7fb327e72640 1 --2- 172.21.15.115:0/2989468849 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb320104940 0x7fb320196db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:55.403 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.401+0000 7fb327e72640 1 --2- 172.21.15.115:0/2989468849 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3200fe930 0x7fb320196870 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:55.403 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.401+0000 7fb327e72640 1 -- 172.21.15.115:0/2989468849 >> 172.21.15.115:0/2989468849 conn(0x7fb3200fa5f0 msgr2=0x7fb3200fb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:55.403 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.401+0000 7fb327e72640 1 -- 172.21.15.115:0/2989468849 shutdown_connections 2024-09-13T17:16:55.403 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.401+0000 7fb327e72640 1 -- 172.21.15.115:0/2989468849 wait complete. 2024-09-13T17:16:55.413 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 37 2024-09-13T17:16:55.413 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 38 2024-09-13T17:16:55.521 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.520+0000 7fbe75220640 1 -- 172.21.15.115:0/2441683192 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe70100c40 msgr2=0x7fbe70101020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:55.522 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.520+0000 7fbe75220640 1 --2- 172.21.15.115:0/2441683192 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe70100c40 0x7fbe70101020 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fbe600098b0 tx=0x7fbe6002a560 comp rx=0 tx=0).stop 2024-09-13T17:16:55.522 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.520+0000 7fbe75220640 1 -- 172.21.15.115:0/2441683192 shutdown_connections 2024-09-13T17:16:55.522 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.520+0000 7fbe75220640 1 --2- 172.21.15.115:0/2441683192 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbe70101560 0x7fbe70109a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:55.522 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.520+0000 7fbe75220640 1 --2- 172.21.15.115:0/2441683192 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe70100c40 0x7fbe70101020 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:55.522 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.520+0000 7fbe75220640 1 -- 172.21.15.115:0/2441683192 >> 172.21.15.115:0/2441683192 conn(0x7fbe70075770 msgr2=0x7fbe700fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:55.522 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.520+0000 7fbe75220640 1 -- 172.21.15.115:0/2441683192 shutdown_connections 2024-09-13T17:16:55.522 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.520+0000 7fbe75220640 1 -- 172.21.15.115:0/2441683192 wait complete. 2024-09-13T17:16:55.524 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.521+0000 7fbe75220640 1 Processor -- start 2024-09-13T17:16:55.524 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.521+0000 7fbe75220640 1 -- start start 2024-09-13T17:16:55.524 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.521+0000 7fbe75220640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe70100c40 0x7fbe7019b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:55.524 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.521+0000 7fbe75220640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbe70101560 0x7fbe7019bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:55.524 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.521+0000 7fbe75220640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe70195800 con 0x7fbe70100c40 2024-09-13T17:16:55.524 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.521+0000 7fbe75220640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe70195970 con 0x7fbe70101560 2024-09-13T17:16:55.524 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.521+0000 7fbe6ed9d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe70100c40 0x7fbe7019b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:55.524 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.521+0000 7fbe6ed9d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe70100c40 0x7fbe7019b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:38870/0 (socket says 172.21.15.115:38870) 2024-09-13T17:16:55.525 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.521+0000 7fbe6ed9d640 1 -- 172.21.15.115:0/1026811861 learned_addr learned my addr 172.21.15.115:0/1026811861 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:16:55.525 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.522+0000 7fbe6e59c640 1 --2- 172.21.15.115:0/1026811861 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbe70101560 0x7fbe7019bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:55.525 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.522+0000 7fbe6ed9d640 1 -- 172.21.15.115:0/1026811861 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbe70101560 msgr2=0x7fbe7019bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:55.525 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.522+0000 7fbe6ed9d640 1 --2- 172.21.15.115:0/1026811861 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbe70101560 0x7fbe7019bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:55.525 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.522+0000 7fbe6ed9d640 1 -- 172.21.15.115:0/1026811861 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe60009560 con 0x7fbe70100c40 2024-09-13T17:16:55.525 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.522+0000 7fbe6ed9d640 1 --2- 172.21.15.115:0/1026811861 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe70100c40 0x7fbe7019b720 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fbe60006010 tx=0x7fbe60005630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:55.525 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.522+0000 7fbe57fff640 1 -- 172.21.15.115:0/1026811861 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe60004b20 con 0x7fbe70100c40 2024-09-13T17:16:55.525 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.522+0000 7fbe75220640 1 -- 172.21.15.115:0/1026811861 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe70195bf0 con 0x7fbe70100c40 2024-09-13T17:16:55.525 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.522+0000 7fbe57fff640 1 -- 172.21.15.115:0/1026811861 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbe60004c80 con 0x7fbe70100c40 2024-09-13T17:16:55.525 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.522+0000 7fbe57fff640 1 -- 172.21.15.115:0/1026811861 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe6003c8e0 con 0x7fbe70100c40 2024-09-13T17:16:55.525 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.522+0000 7fbe75220640 1 -- 172.21.15.115:0/1026811861 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe701960f0 con 0x7fbe70100c40 2024-09-13T17:16:55.526 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.524+0000 7fbe57fff640 1 -- 172.21.15.115:0/1026811861 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fbe600035f0 con 0x7fbe70100c40 2024-09-13T17:16:55.526 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.524+0000 7fbe75220640 1 -- 172.21.15.115:0/1026811861 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe700684d0 con 0x7fbe70100c40 2024-09-13T17:16:55.526 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.524+0000 7fbe57fff640 1 --2- 172.21.15.115:0/1026811861 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fbe5806cc90 0x7fbe5806f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:55.526 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.525+0000 7fbe57fff640 1 -- 172.21.15.115:0/1026811861 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fbe600ad670 con 0x7fbe70100c40 2024-09-13T17:16:55.526 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.525+0000 7fbe6e59c640 1 --2- 172.21.15.115:0/1026811861 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fbe5806cc90 0x7fbe5806f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:55.526 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.525+0000 7fbe6e59c640 1 --2- 172.21.15.115:0/1026811861 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fbe5806cc90 0x7fbe5806f150 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fbe70196c70 tx=0x7fbe6400b390 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:55.534 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.533+0000 7fbe57fff640 1 -- 172.21.15.115:0/1026811861 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fbe60077790 con 0x7fbe70100c40 2024-09-13T17:16:55.734 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.733+0000 7fbe75220640 1 -- 172.21.15.115:0/1026811861 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 38, "format": "json"} v 0) v1 -- 0x7fbe70101020 con 0x7fbe70100c40 2024-09-13T17:16:55.734 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.733+0000 7fbe57fff640 1 -- 172.21.15.115:0/1026811861 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 38, "format": "json"}]=0 dumped fsmap epoch 38 v39) v1 ==== 107+0+4840 (secure 0 0 0) 0x7fbe6007adb0 con 0x7fbe70100c40 2024-09-13T17:16:55.735 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:16:55.735 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":38,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44271,"name":"cephfs.smithi195.qzghxj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6825/825791083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":825791083},{"type":"v1","addr":"172.21.15.195:6825","nonce":825791083}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":31},{"gid":44287,"name":"cephfs.smithi195.aevvgz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6827/589520116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":589520116},{"type":"v1","addr":"172.21.15.195:6827","nonce":589520116}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":38,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T17:03:16.313116+0000","modified":"2024-09-13T17:14:23.882131+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34320},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34320":{"gid":34320,"name":"cephfs.smithi115.hbtxod","rank":0,"incarnation":33,"state":"up:active","state_seq":17,"addr":"172.21.15.115:6827/2768011029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2768011029},{"type":"v1","addr":"172.21.15.115:6827","nonce":2768011029}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_34324":{"gid":34324,"name":"cephfs.smithi115.ijznvr","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.115:6829/2716683507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":2716683507},{"type":"v1","addr":"172.21.15.115:6829","nonce":2716683507}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-13T17:16:55.735 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 38 2024-09-13T17:16:55.737 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.735+0000 7fbe75220640 1 -- 172.21.15.115:0/1026811861 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fbe5806cc90 msgr2=0x7fbe5806f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:55.737 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.735+0000 7fbe75220640 1 --2- 172.21.15.115:0/1026811861 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fbe5806cc90 0x7fbe5806f150 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fbe70196c70 tx=0x7fbe6400b390 comp rx=0 tx=0).stop 2024-09-13T17:16:55.737 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.735+0000 7fbe75220640 1 -- 172.21.15.115:0/1026811861 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe70100c40 msgr2=0x7fbe7019b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:55.737 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.735+0000 7fbe75220640 1 --2- 172.21.15.115:0/1026811861 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe70100c40 0x7fbe7019b720 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fbe60006010 tx=0x7fbe60005630 comp rx=0 tx=0).stop 2024-09-13T17:16:55.737 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.735+0000 7fbe75220640 1 -- 172.21.15.115:0/1026811861 shutdown_connections 2024-09-13T17:16:55.737 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.735+0000 7fbe75220640 1 --2- 172.21.15.115:0/1026811861 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fbe5806cc90 0x7fbe5806f150 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:55.737 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.735+0000 7fbe75220640 1 --2- 172.21.15.115:0/1026811861 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbe70101560 0x7fbe7019bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:55.737 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.735+0000 7fbe75220640 1 --2- 172.21.15.115:0/1026811861 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe70100c40 0x7fbe7019b720 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:55.737 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.735+0000 7fbe75220640 1 -- 172.21.15.115:0/1026811861 >> 172.21.15.115:0/1026811861 conn(0x7fbe70075770 msgr2=0x7fbe70101ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:55.738 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.736+0000 7fbe75220640 1 -- 172.21.15.115:0/1026811861 shutdown_connections 2024-09-13T17:16:55.738 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.736+0000 7fbe75220640 1 -- 172.21.15.115:0/1026811861 wait complete. 2024-09-13T17:16:55.747 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-13T17:16:55.758 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-13T17:16:55.758 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-13T17:16:55.758 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:16:55.775 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-13T17:16:55.775 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:16:55.832 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:16:55.971 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.969+0000 7f6642072640 1 -- 172.21.15.115:0/175133706 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f663c0fe910 msgr2=0x7f663c0fed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:55.971 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.969+0000 7f6642072640 1 --2- 172.21.15.115:0/175133706 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f663c0fe910 0x7f663c0fed70 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6624009880 tx=0x7f662402a4a0 comp rx=0 tx=0).stop 2024-09-13T17:16:55.971 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.969+0000 7f6642072640 1 -- 172.21.15.115:0/175133706 shutdown_connections 2024-09-13T17:16:55.971 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.969+0000 7f6642072640 1 --2- 172.21.15.115:0/175133706 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f663c0fe910 0x7f663c0fed70 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:55.971 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.969+0000 7f6642072640 1 --2- 172.21.15.115:0/175133706 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f663c104920 0x7f663c104d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:55.971 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.969+0000 7f6642072640 1 -- 172.21.15.115:0/175133706 >> 172.21.15.115:0/175133706 conn(0x7f663c0757b0 msgr2=0x7f663c0fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:55.971 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.969+0000 7f6642072640 1 -- 172.21.15.115:0/175133706 shutdown_connections 2024-09-13T17:16:55.971 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.969+0000 7f6642072640 1 -- 172.21.15.115:0/175133706 wait complete. 2024-09-13T17:16:55.972 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.970+0000 7f6642072640 1 Processor -- start 2024-09-13T17:16:55.973 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.970+0000 7f6642072640 1 -- start start 2024-09-13T17:16:55.973 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.970+0000 7f6642072640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f663c0fe910 0x7f663c19b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:55.973 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.970+0000 7f6642072640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f663c104920 0x7f663c19bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:55.973 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.970+0000 7f6642072640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f663c19c2c0 con 0x7f663c104920 2024-09-13T17:16:55.973 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.970+0000 7f6642072640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f663c195830 con 0x7f663c0fe910 2024-09-13T17:16:55.973 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.970+0000 7f6633fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f663c104920 0x7f663c19bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:55.973 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.970+0000 7f6633fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f663c104920 0x7f663c19bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:38886/0 (socket says 172.21.15.115:38886) 2024-09-13T17:16:55.973 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.970+0000 7f6633fff640 1 -- 172.21.15.115:0/1226886655 learned_addr learned my addr 172.21.15.115:0/1226886655 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:16:55.973 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.970+0000 7f663b7fe640 1 --2- 172.21.15.115:0/1226886655 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f663c0fe910 0x7f663c19b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:55.973 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.971+0000 7f6633fff640 1 -- 172.21.15.115:0/1226886655 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f663c0fe910 msgr2=0x7f663c19b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:55.973 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.971+0000 7f6633fff640 1 --2- 172.21.15.115:0/1226886655 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f663c0fe910 0x7f663c19b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:55.973 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.971+0000 7f6633fff640 1 -- 172.21.15.115:0/1226886655 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6624009560 con 0x7f663c104920 2024-09-13T17:16:55.974 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.971+0000 7f6633fff640 1 --2- 172.21.15.115:0/1226886655 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f663c104920 0x7f663c19bc30 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f662402a9c0 tx=0x7f66240055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:55.974 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.972+0000 7f66397fa640 1 -- 172.21.15.115:0/1226886655 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6624004aa0 con 0x7f663c104920 2024-09-13T17:16:55.974 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.972+0000 7f66397fa640 1 -- 172.21.15.115:0/1226886655 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6624004c00 con 0x7f663c104920 2024-09-13T17:16:55.974 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.972+0000 7f6642072640 1 -- 172.21.15.115:0/1226886655 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f663c195ab0 con 0x7f663c104920 2024-09-13T17:16:55.974 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.972+0000 7f66397fa640 1 -- 172.21.15.115:0/1226886655 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6624031750 con 0x7f663c104920 2024-09-13T17:16:55.975 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.972+0000 7f6642072640 1 -- 172.21.15.115:0/1226886655 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f663c195fb0 con 0x7f663c104920 2024-09-13T17:16:55.975 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.973+0000 7f6642072640 1 -- 172.21.15.115:0/1226886655 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f663c100050 con 0x7f663c104920 2024-09-13T17:16:55.975 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.974+0000 7f66397fa640 1 -- 172.21.15.115:0/1226886655 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f66240035f0 con 0x7f663c104920 2024-09-13T17:16:55.975 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.974+0000 7f66397fa640 1 --2- 172.21.15.115:0/1226886655 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f662806cc50 0x7f662806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:55.975 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.974+0000 7f66397fa640 1 -- 172.21.15.115:0/1226886655 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f66240ad510 con 0x7f663c104920 2024-09-13T17:16:55.975 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.974+0000 7f663b7fe640 1 --2- 172.21.15.115:0/1226886655 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f662806cc50 0x7f662806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:55.976 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.975+0000 7f663b7fe640 1 --2- 172.21.15.115:0/1226886655 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f662806cc50 0x7f662806f110 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f663c196970 tx=0x7f662c005f90 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:55.979 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:55.978+0000 7f66397fa640 1 -- 172.21.15.115:0/1226886655 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f6624077630 con 0x7f663c104920 2024-09-13T17:16:56.143 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.142+0000 7f6642072640 1 -- 172.21.15.115:0/1226886655 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f663c0fed70 con 0x7f663c104920 2024-09-13T17:16:56.144 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.143+0000 7f66397fa640 1 -- 172.21.15.115:0/1226886655 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+16363 (secure 0 0 0) 0x7f662407ac50 con 0x7f663c104920 2024-09-13T17:16:56.144 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:16:56.144 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":82,"fsid":"ffbd7588-71f0-11ef-bceb-c7b262605968","created":"2024-09-13T16:56:28.790927+0000","modified":"2024-09-13T17:14:05.809689+0000","last_up_change":"2024-09-13T17:13:07.445406+0000","last_in_change":"2024-09-13T17:01:39.088735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:00:47.472140+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-09-13T17:03:15.097618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-09-13T17:03:15.539103+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9fb96264-a71d-43b2-8d65-b4280a8ad8ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":48,"up_from":52,"up_thru":77,"down_at":49,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":1186998944},{"type":"v1","addr":"172.21.15.115:6803","nonce":1186998944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":1186998944},{"type":"v1","addr":"172.21.15.115:6805","nonce":1186998944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":1186998944},{"type":"v1","addr":"172.21.15.115:6809","nonce":1186998944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":1186998944},{"type":"v1","addr":"172.21.15.115:6807","nonce":1186998944}]},"public_addr":"172.21.15.115:6803/1186998944","cluster_addr":"172.21.15.115:6805/1186998944","heartbeat_back_addr":"172.21.15.115:6809/1186998944","heartbeat_front_addr":"172.21.15.115:6807/1186998944","state":["exists","up"]},{"osd":1,"uuid":"876bf075-f0e1-49dc-90cc-aedccbd19b2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":53,"up_from":57,"up_thru":77,"down_at":54,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":698342085},{"type":"v1","addr":"172.21.15.115:6811","nonce":698342085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":698342085},{"type":"v1","addr":"172.21.15.115:6813","nonce":698342085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":698342085},{"type":"v1","addr":"172.21.15.115:6817","nonce":698342085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":698342085},{"type":"v1","addr":"172.21.15.115:6815","nonce":698342085}]},"public_addr":"172.21.15.115:6811/698342085","cluster_addr":"172.21.15.115:6813/698342085","heartbeat_back_addr":"172.21.15.115:6817/698342085","heartbeat_front_addr":"172.21.15.115:6815/698342085","state":["exists","up"]},{"osd":2,"uuid":"40bc0278-21e6-4863-86bf-f5ee3bfc2fbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":58,"up_from":62,"up_thru":77,"down_at":59,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":3735356389},{"type":"v1","addr":"172.21.15.115:6819","nonce":3735356389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":3735356389},{"type":"v1","addr":"172.21.15.115:6821","nonce":3735356389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":3735356389},{"type":"v1","addr":"172.21.15.115:6825","nonce":3735356389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":3735356389},{"type":"v1","addr":"172.21.15.115:6823","nonce":3735356389}]},"public_addr":"172.21.15.115:6819/3735356389","cluster_addr":"172.21.15.115:6821/3735356389","heartbeat_back_addr":"172.21.15.115:6825/3735356389","heartbeat_front_addr":"172.21.15.115:6823/3735356389","state":["exists","up"]},{"osd":3,"uuid":"af3d701a-1c69-4cf2-a343-938ac1bbb34a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":26,"last_clean_end":63,"up_from":67,"up_thru":77,"down_at":64,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":2321302370},{"type":"v1","addr":"172.21.15.195:6801","nonce":2321302370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":2321302370},{"type":"v1","addr":"172.21.15.195:6803","nonce":2321302370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":2321302370},{"type":"v1","addr":"172.21.15.195:6807","nonce":2321302370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":2321302370},{"type":"v1","addr":"172.21.15.195:6805","nonce":2321302370}]},"public_addr":"172.21.15.195:6801/2321302370","cluster_addr":"172.21.15.195:6803/2321302370","heartbeat_back_addr":"172.21.15.195:6807/2321302370","heartbeat_front_addr":"172.21.15.195:6805/2321302370","state":["exists","up"]},{"osd":4,"uuid":"7bf484b6-6ed5-4fe7-8aa4-505853e2cd1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":34,"last_clean_end":68,"up_from":72,"up_thru":77,"down_at":69,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":1718354216},{"type":"v1","addr":"172.21.15.195:6809","nonce":1718354216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":1718354216},{"type":"v1","addr":"172.21.15.195:6811","nonce":1718354216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":1718354216},{"type":"v1","addr":"172.21.15.195:6815","nonce":1718354216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":1718354216},{"type":"v1","addr":"172.21.15.195:6813","nonce":1718354216}]},"public_addr":"172.21.15.195:6809/1718354216","cluster_addr":"172.21.15.195:6811/1718354216","heartbeat_back_addr":"172.21.15.195:6815/1718354216","heartbeat_front_addr":"172.21.15.195:6813/1718354216","state":["exists","up"]},{"osd":5,"uuid":"1eb8bcc4-dc9b-4a00-bf43-a707da3c141f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":39,"last_clean_end":73,"up_from":77,"up_thru":77,"down_at":74,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2051626892},{"type":"v1","addr":"172.21.15.195:6817","nonce":2051626892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":2051626892},{"type":"v1","addr":"172.21.15.195:6819","nonce":2051626892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":2051626892},{"type":"v1","addr":"172.21.15.195:6823","nonce":2051626892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2051626892},{"type":"v1","addr":"172.21.15.195:6821","nonce":2051626892}]},"public_addr":"172.21.15.195:6817/2051626892","cluster_addr":"172.21.15.195:6819/2051626892","heartbeat_back_addr":"172.21.15.195:6823/2051626892","heartbeat_front_addr":"172.21.15.195:6821/2051626892","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:59:47.662383+0000","dead_epoch":48},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:00:14.730551+0000","dead_epoch":53},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:00:43.856416+0000","dead_epoch":58},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:01:06.336209+0000","dead_epoch":63},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:01:30.680442+0000","dead_epoch":68},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:01:55.518043+0000","dead_epoch":73}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.115:6829/4128583274":"2024-09-14T17:13:29.448814+0000","172.21.15.115:6801/244039928":"2024-09-14T17:05:27.560242+0000","172.21.15.195:6828/1660911692":"2024-09-14T17:06:35.351905+0000","172.21.15.115:6801/2943337696":"2024-09-14T16:57:27.333203+0000","172.21.15.195:0/3889921339":"2024-09-14T17:06:35.351905+0000","172.21.15.195:6829/1660911692":"2024-09-14T17:06:35.351905+0000","172.21.15.115:6801/1463863592":"2024-09-14T16:56:57.112847+0000","172.21.15.195:6826/8826118":"2024-09-14T17:14:05.809662+0000","172.21.15.115:6828/4128583274":"2024-09-14T17:13:29.448814+0000","172.21.15.115:0/376622152":"2024-09-14T16:57:27.333203+0000","172.21.15.115:6800/1463863592":"2024-09-14T16:56:57.112847+0000","172.21.15.115:0/3586970461":"2024-09-14T16:57:27.333203+0000","172.21.15.195:0/14125648":"2024-09-14T17:06:35.351905+0000","172.21.15.115:0/1473439240":"2024-09-14T17:05:27.560242+0000","172.21.15.115:0/931588236":"2024-09-14T16:58:29.159373+0000","172.21.15.115:6826/1900336545":"2024-09-14T17:03:30.385433+0000","172.21.15.195:0/2985838805":"2024-09-14T17:06:35.351905+0000","172.21.15.115:6800/244039928":"2024-09-14T17:05:27.560242+0000","172.21.15.195:0/2501790483":"2024-09-14T17:06:35.351905+0000","172.21.15.195:0/3420173457":"2024-09-14T17:06:35.351905+0000","172.21.15.115:0/648599851":"2024-09-14T16:56:57.112847+0000","172.21.15.115:6800/2943337696":"2024-09-14T16:57:27.333203+0000","172.21.15.115:6827/1900336545":"2024-09-14T17:03:30.385433+0000","172.21.15.115:6801/3889408988":"2024-09-14T16:58:29.159373+0000","172.21.15.195:0/2917880554":"2024-09-14T17:06:35.351905+0000","172.21.15.115:0/247720257":"2024-09-14T16:58:29.159373+0000","172.21.15.115:0/3723628457":"2024-09-14T16:56:57.112847+0000","172.21.15.115:0/3268617158":"2024-09-14T17:05:27.560242+0000","172.21.15.195:6827/8826118":"2024-09-14T17:14:05.809662+0000","172.21.15.115:0/1641850753":"2024-09-14T17:05:27.560242+0000","172.21.15.115:6800/3889408988":"2024-09-14T16:58:29.159373+0000","172.21.15.115:0/2751677160":"2024-09-14T16:58:29.159373+0000","172.21.15.115:0/3967447202":"2024-09-14T17:05:27.560242+0000","172.21.15.115:0/3791301867":"2024-09-14T16:57:27.333203+0000","172.21.15.115:0/2966038005":"2024-09-14T16:56:57.112847+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:16:56.146 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.145+0000 7f6642072640 1 -- 172.21.15.115:0/1226886655 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f662806cc50 msgr2=0x7f662806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:56.146 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.145+0000 7f6642072640 1 --2- 172.21.15.115:0/1226886655 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f662806cc50 0x7f662806f110 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f663c196970 tx=0x7f662c005f90 comp rx=0 tx=0).stop 2024-09-13T17:16:56.147 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.145+0000 7f6642072640 1 -- 172.21.15.115:0/1226886655 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f663c104920 msgr2=0x7f663c19bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:56.147 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.145+0000 7f6642072640 1 --2- 172.21.15.115:0/1226886655 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f663c104920 0x7f663c19bc30 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f662402a9c0 tx=0x7f66240055a0 comp rx=0 tx=0).stop 2024-09-13T17:16:56.147 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.145+0000 7f6642072640 1 -- 172.21.15.115:0/1226886655 shutdown_connections 2024-09-13T17:16:56.147 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.145+0000 7f6642072640 1 --2- 172.21.15.115:0/1226886655 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f662806cc50 0x7f662806f110 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:56.147 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.145+0000 7f6642072640 1 --2- 172.21.15.115:0/1226886655 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f663c104920 0x7f663c19bc30 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:56.147 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.145+0000 7f6642072640 1 --2- 172.21.15.115:0/1226886655 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f663c0fe910 0x7f663c19b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:56.147 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.145+0000 7f6642072640 1 -- 172.21.15.115:0/1226886655 >> 172.21.15.115:0/1226886655 conn(0x7f663c0757b0 msgr2=0x7f663c0fd790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:56.147 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.145+0000 7f6642072640 1 -- 172.21.15.115:0/1226886655 shutdown_connections 2024-09-13T17:16:56.147 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.145+0000 7f6642072640 1 -- 172.21.15.115:0/1226886655 wait complete. 2024-09-13T17:16:56.156 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:16:55 smithi115 ceph-mon[109488]: from='client.? 172.21.15.115:0/256774433' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 36, "format": "json"}]: dispatch 2024-09-13T17:16:56.156 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:16:55 smithi115 ceph-mon[109488]: from='client.? 172.21.15.115:0/2989468849' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 37, "format": "json"}]: dispatch 2024-09-13T17:16:56.156 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:16:55 smithi115 ceph-mon[109488]: pgmap v347: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:16:56.156 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:16:55 smithi115 ceph-mon[109488]: from='client.? 172.21.15.115:0/1026811861' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 38, "format": "json"}]: dispatch 2024-09-13T17:16:56.157 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:00:47.472140+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-09-13T17:03:15.097618+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-09-13T17:03:15.539103+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:16:56.158 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:16:56.260 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.257+0000 7f135e318640 1 -- 172.21.15.115:0/3347639623 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1358101550 msgr2=0x7f1358109a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:56.260 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.257+0000 7f135e318640 1 --2- 172.21.15.115:0/3347639623 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1358101550 0x7f1358109a30 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f13400098b0 tx=0x7f134002a560 comp rx=0 tx=0).stop 2024-09-13T17:16:56.260 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.257+0000 7f135e318640 1 -- 172.21.15.115:0/3347639623 shutdown_connections 2024-09-13T17:16:56.261 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.257+0000 7f135e318640 1 --2- 172.21.15.115:0/3347639623 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1358101550 0x7f1358109a30 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:56.261 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.257+0000 7f135e318640 1 --2- 172.21.15.115:0/3347639623 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1358100c30 0x7f1358101010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:56.261 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.257+0000 7f135e318640 1 -- 172.21.15.115:0/3347639623 >> 172.21.15.115:0/3347639623 conn(0x7f13580fa600 msgr2=0x7f13580fca20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:56.261 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.257+0000 7f135e318640 1 -- 172.21.15.115:0/3347639623 shutdown_connections 2024-09-13T17:16:56.261 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.257+0000 7f135e318640 1 -- 172.21.15.115:0/3347639623 wait complete. 2024-09-13T17:16:56.261 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.258+0000 7f135e318640 1 Processor -- start 2024-09-13T17:16:56.261 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.258+0000 7f135e318640 1 -- start start 2024-09-13T17:16:56.261 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.258+0000 7f135e318640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1358100c30 0x7f135819b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:56.261 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.258+0000 7f135e318640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1358101550 0x7f135819bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:56.261 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.258+0000 7f135e318640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f135819c2f0 con 0x7f1358101550 2024-09-13T17:16:56.261 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.258+0000 7f135e318640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1358195870 con 0x7f1358100c30 2024-09-13T17:16:56.261 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.258+0000 7f134ffff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1358101550 0x7f135819bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:56.261 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.258+0000 7f134ffff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1358101550 0x7f135819bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:38910/0 (socket says 172.21.15.115:38910) 2024-09-13T17:16:56.261 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.258+0000 7f134ffff640 1 -- 172.21.15.115:0/1375543403 learned_addr learned my addr 172.21.15.115:0/1375543403 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:16:56.262 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.258+0000 7f1357fff640 1 --2- 172.21.15.115:0/1375543403 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1358100c30 0x7f135819b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:56.262 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.258+0000 7f134ffff640 1 -- 172.21.15.115:0/1375543403 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1358100c30 msgr2=0x7f135819b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:56.262 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.258+0000 7f134ffff640 1 --2- 172.21.15.115:0/1375543403 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1358100c30 0x7f135819b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:56.262 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.258+0000 7f134ffff640 1 -- 172.21.15.115:0/1375543403 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1340009560 con 0x7f1358101550 2024-09-13T17:16:56.262 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.258+0000 7f134ffff640 1 --2- 172.21.15.115:0/1375543403 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1358101550 0x7f135819bcd0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1340006010 tx=0x7f1340005700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:56.262 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.259+0000 7f1355ffb640 1 -- 172.21.15.115:0/1375543403 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1340004ba0 con 0x7f1358101550 2024-09-13T17:16:56.262 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.259+0000 7f1355ffb640 1 -- 172.21.15.115:0/1375543403 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1340004d00 con 0x7f1358101550 2024-09-13T17:16:56.262 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.259+0000 7f135e318640 1 -- 172.21.15.115:0/1375543403 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1358195af0 con 0x7f1358101550 2024-09-13T17:16:56.262 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.259+0000 7f1355ffb640 1 -- 172.21.15.115:0/1375543403 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f134003c900 con 0x7f1358101550 2024-09-13T17:16:56.262 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.259+0000 7f135e318640 1 -- 172.21.15.115:0/1375543403 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1358195ff0 con 0x7f1358101550 2024-09-13T17:16:56.263 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.260+0000 7f135e318640 1 -- 172.21.15.115:0/1375543403 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1358068850 con 0x7f1358101550 2024-09-13T17:16:56.263 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.260+0000 7f1355ffb640 1 -- 172.21.15.115:0/1375543403 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f1340003c90 con 0x7f1358101550 2024-09-13T17:16:56.263 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.260+0000 7f1355ffb640 1 --2- 172.21.15.115:0/1375543403 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f134406cc90 0x7f134406f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:56.263 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.260+0000 7f1355ffb640 1 -- 172.21.15.115:0/1375543403 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f13400ad7b0 con 0x7f1358101550 2024-09-13T17:16:56.263 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.260+0000 7f1357fff640 1 --2- 172.21.15.115:0/1375543403 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f134406cc90 0x7f134406f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:56.263 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.261+0000 7f1357fff640 1 --2- 172.21.15.115:0/1375543403 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f134406cc90 0x7f134406f150 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1348005fd0 tx=0x7f1348005e20 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:56.265 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.264+0000 7f1355ffb640 1 -- 172.21.15.115:0/1375543403 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f1340077820 con 0x7f1358101550 2024-09-13T17:16:56.326 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:16:55 smithi195 ceph-mon[80021]: from='client.? 172.21.15.115:0/256774433' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 36, "format": "json"}]: dispatch 2024-09-13T17:16:56.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:16:55 smithi195 ceph-mon[80021]: from='client.? 172.21.15.115:0/2989468849' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 37, "format": "json"}]: dispatch 2024-09-13T17:16:56.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:16:55 smithi195 ceph-mon[80021]: pgmap v347: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T17:16:56.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:16:55 smithi195 ceph-mon[80021]: from='client.? 172.21.15.115:0/1026811861' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 38, "format": "json"}]: dispatch 2024-09-13T17:16:56.431 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.429+0000 7f135e318640 1 -- 172.21.15.115:0/1375543403 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1358104350 con 0x7f1358101550 2024-09-13T17:16:56.431 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.430+0000 7f1355ffb640 1 -- 172.21.15.115:0/1375543403 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) v1 ==== 93+0+10 (secure 0 0 0) 0x7f134007ae40 con 0x7f1358101550 2024-09-13T17:16:56.431 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 1 2024-09-13T17:16:56.433 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.432+0000 7f135e318640 1 -- 172.21.15.115:0/1375543403 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f134406cc90 msgr2=0x7f134406f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:56.434 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.432+0000 7f135e318640 1 --2- 172.21.15.115:0/1375543403 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f134406cc90 0x7f134406f150 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1348005fd0 tx=0x7f1348005e20 comp rx=0 tx=0).stop 2024-09-13T17:16:56.434 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.432+0000 7f135e318640 1 -- 172.21.15.115:0/1375543403 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1358101550 msgr2=0x7f135819bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:56.434 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.432+0000 7f135e318640 1 --2- 172.21.15.115:0/1375543403 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1358101550 0x7f135819bcd0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1340006010 tx=0x7f1340005700 comp rx=0 tx=0).stop 2024-09-13T17:16:56.434 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.432+0000 7f135e318640 1 -- 172.21.15.115:0/1375543403 shutdown_connections 2024-09-13T17:16:56.434 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.432+0000 7f135e318640 1 --2- 172.21.15.115:0/1375543403 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f134406cc90 0x7f134406f150 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:56.434 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.432+0000 7f135e318640 1 --2- 172.21.15.115:0/1375543403 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1358101550 0x7f135819bcd0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:56.434 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.432+0000 7f135e318640 1 --2- 172.21.15.115:0/1375543403 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1358100c30 0x7f135819b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:56.434 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.432+0000 7f135e318640 1 -- 172.21.15.115:0/1375543403 >> 172.21.15.115:0/1375543403 conn(0x7f13580fa600 msgr2=0x7f1358101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:56.434 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.432+0000 7f135e318640 1 -- 172.21.15.115:0/1375543403 shutdown_connections 2024-09-13T17:16:56.434 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.432+0000 7f135e318640 1 -- 172.21.15.115:0/1375543403 wait complete. 2024-09-13T17:16:56.444 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-09-13T17:16:56.548 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.545+0000 7f92e7965640 1 -- 172.21.15.115:0/3253430334 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f92e0104940 msgr2=0x7f92e0104d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:56.549 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.545+0000 7f92e7965640 1 --2- 172.21.15.115:0/3253430334 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f92e0104940 0x7f92e0104d20 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f92dc009880 tx=0x7f92dc02a4a0 comp rx=0 tx=0).stop 2024-09-13T17:16:56.549 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.545+0000 7f92e7965640 1 -- 172.21.15.115:0/3253430334 shutdown_connections 2024-09-13T17:16:56.549 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.545+0000 7f92e7965640 1 --2- 172.21.15.115:0/3253430334 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f92e00fe930 0x7f92e00fed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:56.549 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.545+0000 7f92e7965640 1 --2- 172.21.15.115:0/3253430334 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f92e0104940 0x7f92e0104d20 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:56.549 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.545+0000 7f92e7965640 1 -- 172.21.15.115:0/3253430334 >> 172.21.15.115:0/3253430334 conn(0x7f92e00fa610 msgr2=0x7f92e00fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:56.549 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.545+0000 7f92e7965640 1 -- 172.21.15.115:0/3253430334 shutdown_connections 2024-09-13T17:16:56.549 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.545+0000 7f92e7965640 1 -- 172.21.15.115:0/3253430334 wait complete. 2024-09-13T17:16:56.549 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.546+0000 7f92e7965640 1 Processor -- start 2024-09-13T17:16:56.549 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.546+0000 7f92e7965640 1 -- start start 2024-09-13T17:16:56.549 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.546+0000 7f92e7965640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f92e00fe930 0x7f92e0196910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:56.549 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.546+0000 7f92e7965640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f92e0104940 0x7f92e0196e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:56.550 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.546+0000 7f92e7965640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92e0197420 con 0x7f92e0104940 2024-09-13T17:16:56.550 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.546+0000 7f92e7965640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92e0197590 con 0x7f92e00fe930 2024-09-13T17:16:56.550 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.546+0000 7f92e4f00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f92e0104940 0x7f92e0196e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:56.550 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.546+0000 7f92e4f00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f92e0104940 0x7f92e0196e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:38922/0 (socket says 172.21.15.115:38922) 2024-09-13T17:16:56.550 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.546+0000 7f92e4f00640 1 -- 172.21.15.115:0/2505302623 learned_addr learned my addr 172.21.15.115:0/2505302623 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:16:56.550 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.547+0000 7f92e4f00640 1 -- 172.21.15.115:0/2505302623 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f92e00fe930 msgr2=0x7f92e0196910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:56.550 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.547+0000 7f92e4f00640 1 --2- 172.21.15.115:0/2505302623 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f92e00fe930 0x7f92e0196910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:56.550 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.547+0000 7f92e4f00640 1 -- 172.21.15.115:0/2505302623 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92dc009560 con 0x7f92e0104940 2024-09-13T17:16:56.550 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.547+0000 7f92e4f00640 1 --2- 172.21.15.115:0/2505302623 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f92e0104940 0x7f92e0196e50 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f92d000b420 tx=0x7f92d000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:56.550 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.547+0000 7f92d67fc640 1 -- 172.21.15.115:0/2505302623 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f92d0011800 con 0x7f92e0104940 2024-09-13T17:16:56.550 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.547+0000 7f92d67fc640 1 -- 172.21.15.115:0/2505302623 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f92d0011e00 con 0x7f92e0104940 2024-09-13T17:16:56.551 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.547+0000 7f92e7965640 1 -- 172.21.15.115:0/2505302623 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92e019f980 con 0x7f92e0104940 2024-09-13T17:16:56.551 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.547+0000 7f92d67fc640 1 -- 172.21.15.115:0/2505302623 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f92d000f2e0 con 0x7f92e0104940 2024-09-13T17:16:56.551 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.547+0000 7f92e7965640 1 -- 172.21.15.115:0/2505302623 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92e019fe00 con 0x7f92e0104940 2024-09-13T17:16:56.551 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.548+0000 7f92e7965640 1 -- 172.21.15.115:0/2505302623 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92e0100070 con 0x7f92e0104940 2024-09-13T17:16:56.552 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.548+0000 7f92d67fc640 1 -- 172.21.15.115:0/2505302623 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f92d0010380 con 0x7f92e0104940 2024-09-13T17:16:56.552 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.549+0000 7f92d67fc640 1 --2- 172.21.15.115:0/2505302623 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f92cc06cc60 0x7f92cc06f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:56.552 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.549+0000 7f92d67fc640 1 -- 172.21.15.115:0/2505302623 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f92d008bec0 con 0x7f92e0104940 2024-09-13T17:16:56.552 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.549+0000 7f92e5701640 1 --2- 172.21.15.115:0/2505302623 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f92cc06cc60 0x7f92cc06f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:56.552 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.549+0000 7f92e5701640 1 --2- 172.21.15.115:0/2505302623 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f92cc06cc60 0x7f92cc06f120 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f92dc009880 tx=0x7f92dc000bc0 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:56.554 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.553+0000 7f92d67fc640 1 -- 172.21.15.115:0/2505302623 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f92d0055f30 con 0x7f92e0104940 2024-09-13T17:16:56.719 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.718+0000 7f92e7965640 1 -- 172.21.15.115:0/2505302623 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f92e00685c0 con 0x7f92e0104940 2024-09-13T17:16:56.719 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.718+0000 7f92d67fc640 1 -- 172.21.15.115:0/2505302623 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v82) v1 ==== 107+0+11 (secure 0 0 0) 0x7f92d0059550 con 0x7f92e0104940 2024-09-13T17:16:56.720 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 32 2024-09-13T17:16:56.722 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.720+0000 7f92e7965640 1 -- 172.21.15.115:0/2505302623 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f92cc06cc60 msgr2=0x7f92cc06f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:56.722 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.720+0000 7f92e7965640 1 --2- 172.21.15.115:0/2505302623 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f92cc06cc60 0x7f92cc06f120 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f92dc009880 tx=0x7f92dc000bc0 comp rx=0 tx=0).stop 2024-09-13T17:16:56.722 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.720+0000 7f92e7965640 1 -- 172.21.15.115:0/2505302623 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f92e0104940 msgr2=0x7f92e0196e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:56.722 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.720+0000 7f92e7965640 1 --2- 172.21.15.115:0/2505302623 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f92e0104940 0x7f92e0196e50 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f92d000b420 tx=0x7f92d000b8e0 comp rx=0 tx=0).stop 2024-09-13T17:16:56.722 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.720+0000 7f92e7965640 1 -- 172.21.15.115:0/2505302623 shutdown_connections 2024-09-13T17:16:56.722 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.720+0000 7f92e7965640 1 --2- 172.21.15.115:0/2505302623 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f92cc06cc60 0x7f92cc06f120 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:56.722 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.720+0000 7f92e7965640 1 --2- 172.21.15.115:0/2505302623 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f92e0104940 0x7f92e0196e50 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:56.722 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.720+0000 7f92e7965640 1 --2- 172.21.15.115:0/2505302623 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f92e00fe930 0x7f92e0196910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:56.722 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.720+0000 7f92e7965640 1 -- 172.21.15.115:0/2505302623 >> 172.21.15.115:0/2505302623 conn(0x7f92e00fa610 msgr2=0x7f92e00fb830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:56.723 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.721+0000 7f92e7965640 1 -- 172.21.15.115:0/2505302623 shutdown_connections 2024-09-13T17:16:56.723 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.721+0000 7f92e7965640 1 -- 172.21.15.115:0/2505302623 wait complete. 2024-09-13T17:16:56.732 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-09-13T17:16:56.835 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.833+0000 7fa22dee5640 1 -- 172.21.15.115:0/1065095434 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa228104920 msgr2=0x7fa228104d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:56.835 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.833+0000 7fa22dee5640 1 --2- 172.21.15.115:0/1065095434 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa228104920 0x7fa228104d00 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fa218009880 tx=0x7fa21802a4a0 comp rx=0 tx=0).stop 2024-09-13T17:16:56.835 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.833+0000 7fa22dee5640 1 -- 172.21.15.115:0/1065095434 shutdown_connections 2024-09-13T17:16:56.835 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.833+0000 7fa22dee5640 1 --2- 172.21.15.115:0/1065095434 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2280fe910 0x7fa2280fed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:56.835 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.833+0000 7fa22dee5640 1 --2- 172.21.15.115:0/1065095434 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa228104920 0x7fa228104d00 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:56.835 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.833+0000 7fa22dee5640 1 -- 172.21.15.115:0/1065095434 >> 172.21.15.115:0/1065095434 conn(0x7fa2280757b0 msgr2=0x7fa2280fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:56.835 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.833+0000 7fa22dee5640 1 -- 172.21.15.115:0/1065095434 shutdown_connections 2024-09-13T17:16:56.835 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.833+0000 7fa22dee5640 1 -- 172.21.15.115:0/1065095434 wait complete. 2024-09-13T17:16:56.837 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.834+0000 7fa22dee5640 1 Processor -- start 2024-09-13T17:16:56.837 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.834+0000 7fa22dee5640 1 -- start start 2024-09-13T17:16:56.837 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.834+0000 7fa22dee5640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2280fe910 0x7fa22819a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:56.837 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.834+0000 7fa22dee5640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa228104920 0x7fa22819ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:56.837 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.834+0000 7fa22dee5640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa22819b220 con 0x7fa2280fe910 2024-09-13T17:16:56.837 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.834+0000 7fa22dee5640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa228194750 con 0x7fa228104920 2024-09-13T17:16:56.837 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.835+0000 7fa2277fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2280fe910 0x7fa22819a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:56.837 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.835+0000 7fa2277fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2280fe910 0x7fa22819a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:38940/0 (socket says 172.21.15.115:38940) 2024-09-13T17:16:56.838 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.835+0000 7fa2277fe640 1 -- 172.21.15.115:0/1761845905 learned_addr learned my addr 172.21.15.115:0/1761845905 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:16:56.838 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.835+0000 7fa2277fe640 1 -- 172.21.15.115:0/1761845905 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa228104920 msgr2=0x7fa22819ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:56.838 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.835+0000 7fa226ffd640 1 --2- 172.21.15.115:0/1761845905 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa228104920 0x7fa22819ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:56.838 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.835+0000 7fa2277fe640 1 --2- 172.21.15.115:0/1761845905 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa228104920 0x7fa22819ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:56.838 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.835+0000 7fa2277fe640 1 -- 172.21.15.115:0/1761845905 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa218009560 con 0x7fa2280fe910 2024-09-13T17:16:56.838 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.835+0000 7fa2277fe640 1 --2- 172.21.15.115:0/1761845905 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2280fe910 0x7fa22819a650 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa21802a9c0 tx=0x7fa2180055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:56.838 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.835+0000 7fa224ff9640 1 -- 172.21.15.115:0/1761845905 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa218004b60 con 0x7fa2280fe910 2024-09-13T17:16:56.838 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.835+0000 7fa224ff9640 1 -- 172.21.15.115:0/1761845905 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa218004cc0 con 0x7fa2280fe910 2024-09-13T17:16:56.838 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.835+0000 7fa22dee5640 1 -- 172.21.15.115:0/1761845905 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2281949a0 con 0x7fa2280fe910 2024-09-13T17:16:56.838 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.835+0000 7fa224ff9640 1 -- 172.21.15.115:0/1761845905 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa218031950 con 0x7fa2280fe910 2024-09-13T17:16:56.838 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.835+0000 7fa22dee5640 1 -- 172.21.15.115:0/1761845905 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa228194ea0 con 0x7fa2280fe910 2024-09-13T17:16:56.839 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.836+0000 7fa22dee5640 1 -- 172.21.15.115:0/1761845905 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa228100050 con 0x7fa2280fe910 2024-09-13T17:16:56.839 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.837+0000 7fa224ff9640 1 -- 172.21.15.115:0/1761845905 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fa218003c20 con 0x7fa2280fe910 2024-09-13T17:16:56.839 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.837+0000 7fa224ff9640 1 --2- 172.21.15.115:0/1761845905 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fa21406cc60 0x7fa21406f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:56.839 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.838+0000 7fa226ffd640 1 --2- 172.21.15.115:0/1761845905 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fa21406cc60 0x7fa21406f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:56.839 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.838+0000 7fa224ff9640 1 -- 172.21.15.115:0/1761845905 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fa2180ad6e0 con 0x7fa2280fe910 2024-09-13T17:16:56.839 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.838+0000 7fa226ffd640 1 --2- 172.21.15.115:0/1761845905 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fa21406cc60 0x7fa21406f120 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa210005fd0 tx=0x7fa210005850 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:56.843 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:56.842+0000 7fa224ff9640 1 -- 172.21.15.115:0/1761845905 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa218077750 con 0x7fa2280fe910 2024-09-13T17:16:57.008 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.006+0000 7fa22dee5640 1 -- 172.21.15.115:0/1761845905 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7fa228106e80 con 0x7fa2280fe910 2024-09-13T17:16:57.008 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.006+0000 7fa224ff9640 1 -- 172.21.15.115:0/1761845905 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v82) v1 ==== 107+0+11 (secure 0 0 0) 0x7fa21807ad70 con 0x7fa2280fe910 2024-09-13T17:16:57.008 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 32 2024-09-13T17:16:57.010 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.008+0000 7fa22dee5640 1 -- 172.21.15.115:0/1761845905 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fa21406cc60 msgr2=0x7fa21406f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:57.010 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.008+0000 7fa22dee5640 1 --2- 172.21.15.115:0/1761845905 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fa21406cc60 0x7fa21406f120 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa210005fd0 tx=0x7fa210005850 comp rx=0 tx=0).stop 2024-09-13T17:16:57.010 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.008+0000 7fa22dee5640 1 -- 172.21.15.115:0/1761845905 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2280fe910 msgr2=0x7fa22819a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:57.010 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.008+0000 7fa22dee5640 1 --2- 172.21.15.115:0/1761845905 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2280fe910 0x7fa22819a650 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa21802a9c0 tx=0x7fa2180055a0 comp rx=0 tx=0).stop 2024-09-13T17:16:57.010 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.008+0000 7fa22dee5640 1 -- 172.21.15.115:0/1761845905 shutdown_connections 2024-09-13T17:16:57.010 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.008+0000 7fa22dee5640 1 --2- 172.21.15.115:0/1761845905 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fa21406cc60 0x7fa21406f120 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:57.010 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.008+0000 7fa22dee5640 1 --2- 172.21.15.115:0/1761845905 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa228104920 0x7fa22819ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:57.011 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.008+0000 7fa22dee5640 1 --2- 172.21.15.115:0/1761845905 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2280fe910 0x7fa22819a650 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:57.011 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.008+0000 7fa22dee5640 1 -- 172.21.15.115:0/1761845905 >> 172.21.15.115:0/1761845905 conn(0x7fa2280757b0 msgr2=0x7fa228102230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:57.011 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.009+0000 7fa22dee5640 1 -- 172.21.15.115:0/1761845905 shutdown_connections 2024-09-13T17:16:57.011 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.009+0000 7fa22dee5640 1 -- 172.21.15.115:0/1761845905 wait complete. 2024-09-13T17:16:57.019 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:16:56 smithi115 ceph-mon[109488]: from='client.? 172.21.15.115:0/1226886655' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:16:57.019 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:16:56 smithi115 ceph-mon[109488]: from='client.? 172.21.15.115:0/1375543403' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T17:16:57.019 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:16:56 smithi115 ceph-mon[109488]: from='client.? 172.21.15.115:0/2505302623' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-09-13T17:16:57.021 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:16:57.122 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.119+0000 7f5ad8318640 1 -- 172.21.15.115:0/2224903877 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5ad0104940 msgr2=0x7f5ad0104d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:57.122 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.119+0000 7f5ad8318640 1 --2- 172.21.15.115:0/2224903877 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5ad0104940 0x7f5ad0104d20 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f5acc009880 tx=0x7f5acc02a4a0 comp rx=0 tx=0).stop 2024-09-13T17:16:57.122 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.119+0000 7f5ad8318640 1 -- 172.21.15.115:0/2224903877 shutdown_connections 2024-09-13T17:16:57.122 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.119+0000 7f5ad8318640 1 --2- 172.21.15.115:0/2224903877 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ad00fe930 0x7f5ad00fed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:57.122 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.119+0000 7f5ad8318640 1 --2- 172.21.15.115:0/2224903877 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5ad0104940 0x7f5ad0104d20 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:57.123 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.119+0000 7f5ad8318640 1 -- 172.21.15.115:0/2224903877 >> 172.21.15.115:0/2224903877 conn(0x7f5ad00fa610 msgr2=0x7f5ad00fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:57.123 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.119+0000 7f5ad8318640 1 -- 172.21.15.115:0/2224903877 shutdown_connections 2024-09-13T17:16:57.123 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.119+0000 7f5ad8318640 1 -- 172.21.15.115:0/2224903877 wait complete. 2024-09-13T17:16:57.123 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.119+0000 7f5ad8318640 1 Processor -- start 2024-09-13T17:16:57.123 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.120+0000 7f5ad8318640 1 -- start start 2024-09-13T17:16:57.123 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.120+0000 7f5ad8318640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5ad00fe930 0x7f5ad0196950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:57.123 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.120+0000 7f5ad8318640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ad0104940 0x7f5ad0196e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:57.123 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.120+0000 7f5ad8318640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad0197460 con 0x7f5ad00fe930 2024-09-13T17:16:57.123 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.120+0000 7f5ad8318640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad01975d0 con 0x7f5ad0104940 2024-09-13T17:16:57.123 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.120+0000 7f5ad60b4640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5ad00fe930 0x7f5ad0196950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:57.123 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.120+0000 7f5ad60b4640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5ad00fe930 0x7f5ad0196950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:38964/0 (socket says 172.21.15.115:38964) 2024-09-13T17:16:57.123 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.120+0000 7f5ad60b4640 1 -- 172.21.15.115:0/2743432611 learned_addr learned my addr 172.21.15.115:0/2743432611 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:16:57.123 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.120+0000 7f5ad58b3640 1 --2- 172.21.15.115:0/2743432611 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ad0104940 0x7f5ad0196e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:57.124 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.120+0000 7f5ad60b4640 1 -- 172.21.15.115:0/2743432611 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ad0104940 msgr2=0x7f5ad0196e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:57.124 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.120+0000 7f5ad60b4640 1 --2- 172.21.15.115:0/2743432611 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ad0104940 0x7f5ad0196e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:57.124 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.120+0000 7f5ad60b4640 1 -- 172.21.15.115:0/2743432611 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5acc009560 con 0x7f5ad00fe930 2024-09-13T17:16:57.124 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.120+0000 7f5ad58b3640 1 --2- 172.21.15.115:0/2743432611 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ad0104940 0x7f5ad0196e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:16:57.124 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.120+0000 7f5ad60b4640 1 --2- 172.21.15.115:0/2743432611 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5ad00fe930 0x7f5ad0196950 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5acc006010 tx=0x7f5acc0056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:57.124 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.120+0000 7f5ac37fe640 1 -- 172.21.15.115:0/2743432611 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5acc004ba0 con 0x7f5ad00fe930 2024-09-13T17:16:57.124 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.120+0000 7f5ad8318640 1 -- 172.21.15.115:0/2743432611 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ad019f9c0 con 0x7f5ad00fe930 2024-09-13T17:16:57.124 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.120+0000 7f5ac37fe640 1 -- 172.21.15.115:0/2743432611 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5acc004d00 con 0x7f5ad00fe930 2024-09-13T17:16:57.124 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.120+0000 7f5ac37fe640 1 -- 172.21.15.115:0/2743432611 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5acc031910 con 0x7f5ad00fe930 2024-09-13T17:16:57.124 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.120+0000 7f5ad8318640 1 -- 172.21.15.115:0/2743432611 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ad019fd80 con 0x7f5ad00fe930 2024-09-13T17:16:57.125 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.121+0000 7f5ad8318640 1 -- 172.21.15.115:0/2743432611 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ad0100070 con 0x7f5ad00fe930 2024-09-13T17:16:57.125 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.122+0000 7f5ac37fe640 1 -- 172.21.15.115:0/2743432611 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f5acc031b80 con 0x7f5ad00fe930 2024-09-13T17:16:57.125 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.122+0000 7f5ac37fe640 1 --2- 172.21.15.115:0/2743432611 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f5abc06cc50 0x7f5abc06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:57.125 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.122+0000 7f5ac37fe640 1 -- 172.21.15.115:0/2743432611 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f5acc0ad7d0 con 0x7f5ad00fe930 2024-09-13T17:16:57.125 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.122+0000 7f5ad58b3640 1 --2- 172.21.15.115:0/2743432611 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f5abc06cc50 0x7f5abc06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:57.125 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.123+0000 7f5ad58b3640 1 --2- 172.21.15.115:0/2743432611 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f5abc06cc50 0x7f5abc06f110 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5ac4006fd0 tx=0x7f5ac4008040 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:57.127 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.126+0000 7f5ac37fe640 1 -- 172.21.15.115:0/2743432611 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f5acc077840 con 0x7f5ad00fe930 2024-09-13T17:16:57.299 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.297+0000 7f5ad8318640 1 -- 172.21.15.115:0/2743432611 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f5ad00fee10 con 0x7f5ad00fe930 2024-09-13T17:16:57.299 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.298+0000 7f5ac37fe640 1 -- 172.21.15.115:0/2743432611 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 35 entries v82) v1 ==== 81+0+2099 (secure 0 0 0) 0x7f5acc07ae60 con 0x7f5ad00fe930 2024-09-13T17:16:57.299 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:6829/4128583274 2024-09-14T17:13:29.448814+0000 2024-09-13T17:16:57.300 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:6801/244039928 2024-09-14T17:05:27.560242+0000 2024-09-13T17:16:57.300 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.195:6828/1660911692 2024-09-14T17:06:35.351905+0000 2024-09-13T17:16:57.300 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:6801/2943337696 2024-09-14T16:57:27.333203+0000 2024-09-13T17:16:57.300 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.195:0/3889921339 2024-09-14T17:06:35.351905+0000 2024-09-13T17:16:57.300 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.195:6829/1660911692 2024-09-14T17:06:35.351905+0000 2024-09-13T17:16:57.300 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:6801/1463863592 2024-09-14T16:56:57.112847+0000 2024-09-13T17:16:57.300 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.195:6826/8826118 2024-09-14T17:14:05.809662+0000 2024-09-13T17:16:57.300 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:6828/4128583274 2024-09-14T17:13:29.448814+0000 2024-09-13T17:16:57.300 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:0/376622152 2024-09-14T16:57:27.333203+0000 2024-09-13T17:16:57.300 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:6800/1463863592 2024-09-14T16:56:57.112847+0000 2024-09-13T17:16:57.300 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:0/3586970461 2024-09-14T16:57:27.333203+0000 2024-09-13T17:16:57.300 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.195:0/14125648 2024-09-14T17:06:35.351905+0000 2024-09-13T17:16:57.301 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:0/1473439240 2024-09-14T17:05:27.560242+0000 2024-09-13T17:16:57.301 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:0/931588236 2024-09-14T16:58:29.159373+0000 2024-09-13T17:16:57.301 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:6826/1900336545 2024-09-14T17:03:30.385433+0000 2024-09-13T17:16:57.301 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.195:0/2985838805 2024-09-14T17:06:35.351905+0000 2024-09-13T17:16:57.301 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:6800/244039928 2024-09-14T17:05:27.560242+0000 2024-09-13T17:16:57.301 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.195:0/2501790483 2024-09-14T17:06:35.351905+0000 2024-09-13T17:16:57.301 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.195:0/3420173457 2024-09-14T17:06:35.351905+0000 2024-09-13T17:16:57.301 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:0/648599851 2024-09-14T16:56:57.112847+0000 2024-09-13T17:16:57.301 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:6800/2943337696 2024-09-14T16:57:27.333203+0000 2024-09-13T17:16:57.301 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:6827/1900336545 2024-09-14T17:03:30.385433+0000 2024-09-13T17:16:57.301 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:6801/3889408988 2024-09-14T16:58:29.159373+0000 2024-09-13T17:16:57.301 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.195:0/2917880554 2024-09-14T17:06:35.351905+0000 2024-09-13T17:16:57.301 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:0/247720257 2024-09-14T16:58:29.159373+0000 2024-09-13T17:16:57.302 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:0/3723628457 2024-09-14T16:56:57.112847+0000 2024-09-13T17:16:57.302 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:0/3268617158 2024-09-14T17:05:27.560242+0000 2024-09-13T17:16:57.302 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.195:6827/8826118 2024-09-14T17:14:05.809662+0000 2024-09-13T17:16:57.302 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:0/1641850753 2024-09-14T17:05:27.560242+0000 2024-09-13T17:16:57.302 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:6800/3889408988 2024-09-14T16:58:29.159373+0000 2024-09-13T17:16:57.302 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:0/2751677160 2024-09-14T16:58:29.159373+0000 2024-09-13T17:16:57.302 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:0/3967447202 2024-09-14T17:05:27.560242+0000 2024-09-13T17:16:57.302 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:0/3791301867 2024-09-14T16:57:27.333203+0000 2024-09-13T17:16:57.302 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:0/2966038005 2024-09-14T16:56:57.112847+0000 2024-09-13T17:16:57.303 INFO:teuthology.orchestra.run.smithi115.stderr:listed 35 entries 2024-09-13T17:16:57.303 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.300+0000 7f5ad8318640 1 -- 172.21.15.115:0/2743432611 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f5abc06cc50 msgr2=0x7f5abc06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:57.303 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.300+0000 7f5ad8318640 1 --2- 172.21.15.115:0/2743432611 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f5abc06cc50 0x7f5abc06f110 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5ac4006fd0 tx=0x7f5ac4008040 comp rx=0 tx=0).stop 2024-09-13T17:16:57.303 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.300+0000 7f5ad8318640 1 -- 172.21.15.115:0/2743432611 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5ad00fe930 msgr2=0x7f5ad0196950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:57.303 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.300+0000 7f5ad8318640 1 --2- 172.21.15.115:0/2743432611 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5ad00fe930 0x7f5ad0196950 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5acc006010 tx=0x7f5acc0056e0 comp rx=0 tx=0).stop 2024-09-13T17:16:57.303 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.300+0000 7f5ad8318640 1 -- 172.21.15.115:0/2743432611 shutdown_connections 2024-09-13T17:16:57.303 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.300+0000 7f5ad8318640 1 --2- 172.21.15.115:0/2743432611 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f5abc06cc50 0x7f5abc06f110 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:57.303 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.300+0000 7f5ad8318640 1 --2- 172.21.15.115:0/2743432611 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ad0104940 0x7f5ad0196e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:57.303 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.300+0000 7f5ad8318640 1 --2- 172.21.15.115:0/2743432611 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5ad00fe930 0x7f5ad0196950 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:57.303 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.300+0000 7f5ad8318640 1 -- 172.21.15.115:0/2743432611 >> 172.21.15.115:0/2743432611 conn(0x7f5ad00fa610 msgr2=0x7f5ad00fb8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:57.304 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.300+0000 7f5ad8318640 1 -- 172.21.15.115:0/2743432611 shutdown_connections 2024-09-13T17:16:57.304 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.300+0000 7f5ad8318640 1 -- 172.21.15.115:0/2743432611 wait complete. 2024-09-13T17:16:57.312 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-13T17:16:57.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:16:57.312 DEBUG:teuthology.orchestra.run.smithi115:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-13T17:16:57.326 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:16:56 smithi195 ceph-mon[80021]: from='client.? 172.21.15.115:0/1226886655' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:16:57.326 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:16:56 smithi195 ceph-mon[80021]: from='client.? 172.21.15.115:0/1375543403' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T17:16:57.326 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:16:56 smithi195 ceph-mon[80021]: from='client.? 172.21.15.115:0/2505302623' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-09-13T17:16:57.338 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi115.front.sepia.ceph.com 2024-09-13T17:16:57.338 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:16:57.338 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T17:16:57.405 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-09-13T17:16:57.405 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:16:57.426 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-09-13T17:16:57.426 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:16:57.486 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:16:57.587 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.584+0000 7f51f4525640 1 -- 172.21.15.115:0/4078584987 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f51ec0fe910 msgr2=0x7f51ec0fed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:57.587 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.584+0000 7f51f4525640 1 --2- 172.21.15.115:0/4078584987 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f51ec0fe910 0x7f51ec0fed70 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f51dc009880 tx=0x7f51dc02a4a0 comp rx=0 tx=0).stop 2024-09-13T17:16:57.587 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.584+0000 7f51f4525640 1 -- 172.21.15.115:0/4078584987 shutdown_connections 2024-09-13T17:16:57.587 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.584+0000 7f51f4525640 1 --2- 172.21.15.115:0/4078584987 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f51ec0fe910 0x7f51ec0fed70 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:57.588 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.584+0000 7f51f4525640 1 --2- 172.21.15.115:0/4078584987 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f51ec104920 0x7f51ec104d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:57.588 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.584+0000 7f51f4525640 1 -- 172.21.15.115:0/4078584987 >> 172.21.15.115:0/4078584987 conn(0x7f51ec0757b0 msgr2=0x7f51ec0fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:57.588 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.584+0000 7f51f4525640 1 -- 172.21.15.115:0/4078584987 shutdown_connections 2024-09-13T17:16:57.588 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.584+0000 7f51f4525640 1 -- 172.21.15.115:0/4078584987 wait complete. 2024-09-13T17:16:57.588 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.585+0000 7f51f4525640 1 Processor -- start 2024-09-13T17:16:57.588 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.585+0000 7f51f4525640 1 -- start start 2024-09-13T17:16:57.588 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.585+0000 7f51f4525640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f51ec0fe910 0x7f51ec1968f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:57.588 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.585+0000 7f51f4525640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f51ec104920 0x7f51ec196e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:57.588 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.585+0000 7f51f4525640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ec197400 con 0x7f51ec0fe910 2024-09-13T17:16:57.588 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.585+0000 7f51f4525640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ec197570 con 0x7f51ec104920 2024-09-13T17:16:57.588 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.585+0000 7f51f22c1640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f51ec0fe910 0x7f51ec1968f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:57.588 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.585+0000 7f51f22c1640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f51ec0fe910 0x7f51ec1968f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:38980/0 (socket says 172.21.15.115:38980) 2024-09-13T17:16:57.589 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.585+0000 7f51f22c1640 1 -- 172.21.15.115:0/2326217754 learned_addr learned my addr 172.21.15.115:0/2326217754 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:16:57.589 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.586+0000 7f51f22c1640 1 -- 172.21.15.115:0/2326217754 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f51ec104920 msgr2=0x7f51ec196e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:57.589 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.586+0000 7f51f22c1640 1 --2- 172.21.15.115:0/2326217754 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f51ec104920 0x7f51ec196e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:57.589 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.586+0000 7f51f22c1640 1 -- 172.21.15.115:0/2326217754 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51dc009560 con 0x7f51ec0fe910 2024-09-13T17:16:57.589 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.586+0000 7f51f22c1640 1 --2- 172.21.15.115:0/2326217754 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f51ec0fe910 0x7f51ec1968f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f51e800b420 tx=0x7f51e800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:57.589 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.586+0000 7f51e37fe640 1 -- 172.21.15.115:0/2326217754 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f51e8011800 con 0x7f51ec0fe910 2024-09-13T17:16:57.589 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.586+0000 7f51e37fe640 1 -- 172.21.15.115:0/2326217754 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f51e8011e00 con 0x7f51ec0fe910 2024-09-13T17:16:57.589 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.586+0000 7f51f4525640 1 -- 172.21.15.115:0/2326217754 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51ec19f960 con 0x7f51ec0fe910 2024-09-13T17:16:57.589 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.586+0000 7f51e37fe640 1 -- 172.21.15.115:0/2326217754 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f51e800f2e0 con 0x7f51ec0fe910 2024-09-13T17:16:57.589 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.586+0000 7f51f4525640 1 -- 172.21.15.115:0/2326217754 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51ec19fde0 con 0x7f51ec0fe910 2024-09-13T17:16:57.590 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.587+0000 7f51f4525640 1 -- 172.21.15.115:0/2326217754 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51ec100050 con 0x7f51ec0fe910 2024-09-13T17:16:57.590 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.587+0000 7f51e37fe640 1 -- 172.21.15.115:0/2326217754 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f51e8010380 con 0x7f51ec0fe910 2024-09-13T17:16:57.590 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.588+0000 7f51e37fe640 1 --2- 172.21.15.115:0/2326217754 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f51d806cc50 0x7f51d806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:57.590 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.588+0000 7f51e37fe640 1 -- 172.21.15.115:0/2326217754 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f51e808be30 con 0x7f51ec0fe910 2024-09-13T17:16:57.590 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.588+0000 7f51f1ac0640 1 --2- 172.21.15.115:0/2326217754 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f51d806cc50 0x7f51d806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:57.591 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.588+0000 7f51f1ac0640 1 --2- 172.21.15.115:0/2326217754 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f51d806cc50 0x7f51d806f110 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f51ec067c90 tx=0x7f51dc000bc0 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:57.593 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.592+0000 7f51e37fe640 1 -- 172.21.15.115:0/2326217754 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f51e8055f20 con 0x7f51ec0fe910 2024-09-13T17:16:57.757 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.755+0000 7f51f4525640 1 -- 172.21.15.115:0/2326217754 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f51ec0fedf0 con 0x7f51ec0fe910 2024-09-13T17:16:57.758 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.756+0000 7f51e37fe640 1 -- 172.21.15.115:0/2326217754 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+16363 (secure 0 0 0) 0x7f51e8059540 con 0x7f51ec0fe910 2024-09-13T17:16:57.758 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T17:16:57.758 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":82,"fsid":"ffbd7588-71f0-11ef-bceb-c7b262605968","created":"2024-09-13T16:56:28.790927+0000","modified":"2024-09-13T17:14:05.809689+0000","last_up_change":"2024-09-13T17:13:07.445406+0000","last_in_change":"2024-09-13T17:01:39.088735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:00:47.472140+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-09-13T17:03:15.097618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-09-13T17:03:15.539103+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9fb96264-a71d-43b2-8d65-b4280a8ad8ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":48,"up_from":52,"up_thru":77,"down_at":49,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":1186998944},{"type":"v1","addr":"172.21.15.115:6803","nonce":1186998944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":1186998944},{"type":"v1","addr":"172.21.15.115:6805","nonce":1186998944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":1186998944},{"type":"v1","addr":"172.21.15.115:6809","nonce":1186998944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":1186998944},{"type":"v1","addr":"172.21.15.115:6807","nonce":1186998944}]},"public_addr":"172.21.15.115:6803/1186998944","cluster_addr":"172.21.15.115:6805/1186998944","heartbeat_back_addr":"172.21.15.115:6809/1186998944","heartbeat_front_addr":"172.21.15.115:6807/1186998944","state":["exists","up"]},{"osd":1,"uuid":"876bf075-f0e1-49dc-90cc-aedccbd19b2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":53,"up_from":57,"up_thru":77,"down_at":54,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":698342085},{"type":"v1","addr":"172.21.15.115:6811","nonce":698342085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":698342085},{"type":"v1","addr":"172.21.15.115:6813","nonce":698342085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":698342085},{"type":"v1","addr":"172.21.15.115:6817","nonce":698342085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":698342085},{"type":"v1","addr":"172.21.15.115:6815","nonce":698342085}]},"public_addr":"172.21.15.115:6811/698342085","cluster_addr":"172.21.15.115:6813/698342085","heartbeat_back_addr":"172.21.15.115:6817/698342085","heartbeat_front_addr":"172.21.15.115:6815/698342085","state":["exists","up"]},{"osd":2,"uuid":"40bc0278-21e6-4863-86bf-f5ee3bfc2fbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":58,"up_from":62,"up_thru":77,"down_at":59,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":3735356389},{"type":"v1","addr":"172.21.15.115:6819","nonce":3735356389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":3735356389},{"type":"v1","addr":"172.21.15.115:6821","nonce":3735356389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":3735356389},{"type":"v1","addr":"172.21.15.115:6825","nonce":3735356389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":3735356389},{"type":"v1","addr":"172.21.15.115:6823","nonce":3735356389}]},"public_addr":"172.21.15.115:6819/3735356389","cluster_addr":"172.21.15.115:6821/3735356389","heartbeat_back_addr":"172.21.15.115:6825/3735356389","heartbeat_front_addr":"172.21.15.115:6823/3735356389","state":["exists","up"]},{"osd":3,"uuid":"af3d701a-1c69-4cf2-a343-938ac1bbb34a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":26,"last_clean_end":63,"up_from":67,"up_thru":77,"down_at":64,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":2321302370},{"type":"v1","addr":"172.21.15.195:6801","nonce":2321302370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":2321302370},{"type":"v1","addr":"172.21.15.195:6803","nonce":2321302370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":2321302370},{"type":"v1","addr":"172.21.15.195:6807","nonce":2321302370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":2321302370},{"type":"v1","addr":"172.21.15.195:6805","nonce":2321302370}]},"public_addr":"172.21.15.195:6801/2321302370","cluster_addr":"172.21.15.195:6803/2321302370","heartbeat_back_addr":"172.21.15.195:6807/2321302370","heartbeat_front_addr":"172.21.15.195:6805/2321302370","state":["exists","up"]},{"osd":4,"uuid":"7bf484b6-6ed5-4fe7-8aa4-505853e2cd1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":34,"last_clean_end":68,"up_from":72,"up_thru":77,"down_at":69,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":1718354216},{"type":"v1","addr":"172.21.15.195:6809","nonce":1718354216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":1718354216},{"type":"v1","addr":"172.21.15.195:6811","nonce":1718354216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":1718354216},{"type":"v1","addr":"172.21.15.195:6815","nonce":1718354216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":1718354216},{"type":"v1","addr":"172.21.15.195:6813","nonce":1718354216}]},"public_addr":"172.21.15.195:6809/1718354216","cluster_addr":"172.21.15.195:6811/1718354216","heartbeat_back_addr":"172.21.15.195:6815/1718354216","heartbeat_front_addr":"172.21.15.195:6813/1718354216","state":["exists","up"]},{"osd":5,"uuid":"1eb8bcc4-dc9b-4a00-bf43-a707da3c141f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":39,"last_clean_end":73,"up_from":77,"up_thru":77,"down_at":74,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2051626892},{"type":"v1","addr":"172.21.15.195:6817","nonce":2051626892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":2051626892},{"type":"v1","addr":"172.21.15.195:6819","nonce":2051626892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":2051626892},{"type":"v1","addr":"172.21.15.195:6823","nonce":2051626892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2051626892},{"type":"v1","addr":"172.21.15.195:6821","nonce":2051626892}]},"public_addr":"172.21.15.195:6817/2051626892","cluster_addr":"172.21.15.195:6819/2051626892","heartbeat_back_addr":"172.21.15.195:6823/2051626892","heartbeat_front_addr":"172.21.15.195:6821/2051626892","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T16:59:47.662383+0000","dead_epoch":48},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:00:14.730551+0000","dead_epoch":53},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:00:43.856416+0000","dead_epoch":58},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:01:06.336209+0000","dead_epoch":63},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:01:30.680442+0000","dead_epoch":68},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:01:55.518043+0000","dead_epoch":73}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.115:6829/4128583274":"2024-09-14T17:13:29.448814+0000","172.21.15.115:6801/244039928":"2024-09-14T17:05:27.560242+0000","172.21.15.195:6828/1660911692":"2024-09-14T17:06:35.351905+0000","172.21.15.115:6801/2943337696":"2024-09-14T16:57:27.333203+0000","172.21.15.195:0/3889921339":"2024-09-14T17:06:35.351905+0000","172.21.15.195:6829/1660911692":"2024-09-14T17:06:35.351905+0000","172.21.15.115:6801/1463863592":"2024-09-14T16:56:57.112847+0000","172.21.15.195:6826/8826118":"2024-09-14T17:14:05.809662+0000","172.21.15.115:6828/4128583274":"2024-09-14T17:13:29.448814+0000","172.21.15.115:0/376622152":"2024-09-14T16:57:27.333203+0000","172.21.15.115:6800/1463863592":"2024-09-14T16:56:57.112847+0000","172.21.15.115:0/3586970461":"2024-09-14T16:57:27.333203+0000","172.21.15.195:0/14125648":"2024-09-14T17:06:35.351905+0000","172.21.15.115:0/1473439240":"2024-09-14T17:05:27.560242+0000","172.21.15.115:0/931588236":"2024-09-14T16:58:29.159373+0000","172.21.15.115:6826/1900336545":"2024-09-14T17:03:30.385433+0000","172.21.15.195:0/2985838805":"2024-09-14T17:06:35.351905+0000","172.21.15.115:6800/244039928":"2024-09-14T17:05:27.560242+0000","172.21.15.195:0/2501790483":"2024-09-14T17:06:35.351905+0000","172.21.15.195:0/3420173457":"2024-09-14T17:06:35.351905+0000","172.21.15.115:0/648599851":"2024-09-14T16:56:57.112847+0000","172.21.15.115:6800/2943337696":"2024-09-14T16:57:27.333203+0000","172.21.15.115:6827/1900336545":"2024-09-14T17:03:30.385433+0000","172.21.15.115:6801/3889408988":"2024-09-14T16:58:29.159373+0000","172.21.15.195:0/2917880554":"2024-09-14T17:06:35.351905+0000","172.21.15.115:0/247720257":"2024-09-14T16:58:29.159373+0000","172.21.15.115:0/3723628457":"2024-09-14T16:56:57.112847+0000","172.21.15.115:0/3268617158":"2024-09-14T17:05:27.560242+0000","172.21.15.195:6827/8826118":"2024-09-14T17:14:05.809662+0000","172.21.15.115:0/1641850753":"2024-09-14T17:05:27.560242+0000","172.21.15.115:6800/3889408988":"2024-09-14T16:58:29.159373+0000","172.21.15.115:0/2751677160":"2024-09-14T16:58:29.159373+0000","172.21.15.115:0/3967447202":"2024-09-14T17:05:27.560242+0000","172.21.15.115:0/3791301867":"2024-09-14T16:57:27.333203+0000","172.21.15.115:0/2966038005":"2024-09-14T16:56:57.112847+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:16:57.760 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.758+0000 7f51f4525640 1 -- 172.21.15.115:0/2326217754 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f51d806cc50 msgr2=0x7f51d806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:57.760 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.758+0000 7f51f4525640 1 --2- 172.21.15.115:0/2326217754 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f51d806cc50 0x7f51d806f110 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f51ec067c90 tx=0x7f51dc000bc0 comp rx=0 tx=0).stop 2024-09-13T17:16:57.760 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.758+0000 7f51f4525640 1 -- 172.21.15.115:0/2326217754 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f51ec0fe910 msgr2=0x7f51ec1968f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:57.760 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.758+0000 7f51f4525640 1 --2- 172.21.15.115:0/2326217754 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f51ec0fe910 0x7f51ec1968f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f51e800b420 tx=0x7f51e800b8e0 comp rx=0 tx=0).stop 2024-09-13T17:16:57.760 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.758+0000 7f51f4525640 1 -- 172.21.15.115:0/2326217754 shutdown_connections 2024-09-13T17:16:57.760 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.758+0000 7f51f4525640 1 --2- 172.21.15.115:0/2326217754 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f51d806cc50 0x7f51d806f110 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:57.760 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.758+0000 7f51f4525640 1 --2- 172.21.15.115:0/2326217754 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f51ec104920 0x7f51ec196e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:57.760 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.758+0000 7f51f4525640 1 --2- 172.21.15.115:0/2326217754 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f51ec0fe910 0x7f51ec1968f0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:57.760 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.758+0000 7f51f4525640 1 -- 172.21.15.115:0/2326217754 >> 172.21.15.115:0/2326217754 conn(0x7f51ec0757b0 msgr2=0x7f51ec1022b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:57.761 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.758+0000 7f51f4525640 1 -- 172.21.15.115:0/2326217754 shutdown_connections 2024-09-13T17:16:57.761 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.759+0000 7f51f4525640 1 -- 172.21.15.115:0/2326217754 wait complete. 2024-09-13T17:16:57.771 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:00:47.472140+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-09-13T17:03:15.097618+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-09-13T17:03:15.539103+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:16:57.771 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:16:57.874 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.871+0000 7f1d94b45640 1 -- 172.21.15.115:0/904928953 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d900fe330 msgr2=0x7f1d900fe710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:57.874 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.871+0000 7f1d94b45640 1 --2- 172.21.15.115:0/904928953 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d900fe330 0x7f1d900fe710 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f1d8000a990 tx=0x7f1d8002b7d0 comp rx=0 tx=0).stop 2024-09-13T17:16:57.874 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.871+0000 7f1d94b45640 1 -- 172.21.15.115:0/904928953 shutdown_connections 2024-09-13T17:16:57.874 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.871+0000 7f1d94b45640 1 --2- 172.21.15.115:0/904928953 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1d900fece0 0x7f1d90102d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:57.874 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.871+0000 7f1d94b45640 1 --2- 172.21.15.115:0/904928953 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d900fe330 0x7f1d900fe710 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:57.874 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.871+0000 7f1d94b45640 1 -- 172.21.15.115:0/904928953 >> 172.21.15.115:0/904928953 conn(0x7f1d900f9da0 msgr2=0x7f1d900fc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:57.874 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.871+0000 7f1d94b45640 1 -- 172.21.15.115:0/904928953 shutdown_connections 2024-09-13T17:16:57.875 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.871+0000 7f1d94b45640 1 -- 172.21.15.115:0/904928953 wait complete. 2024-09-13T17:16:57.875 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.872+0000 7f1d94b45640 1 Processor -- start 2024-09-13T17:16:57.875 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.872+0000 7f1d94b45640 1 -- start start 2024-09-13T17:16:57.875 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.872+0000 7f1d94b45640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d900fe330 0x7f1d9019b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:57.875 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.872+0000 7f1d94b45640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1d9019bc00 0x7f1d901957a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:57.875 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.872+0000 7f1d94b45640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9019c220 con 0x7f1d900fe330 2024-09-13T17:16:57.875 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.872+0000 7f1d94b45640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d90195ce0 con 0x7f1d9019bc00 2024-09-13T17:16:57.875 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.872+0000 7f1d8e59c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d900fe330 0x7f1d9019b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:57.875 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.872+0000 7f1d8e59c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d900fe330 0x7f1d9019b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:38998/0 (socket says 172.21.15.115:38998) 2024-09-13T17:16:57.875 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.872+0000 7f1d8e59c640 1 -- 172.21.15.115:0/632930400 learned_addr learned my addr 172.21.15.115:0/632930400 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:16:57.875 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.872+0000 7f1d8e59c640 1 -- 172.21.15.115:0/632930400 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1d9019bc00 msgr2=0x7f1d901957a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:57.875 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.872+0000 7f1d8e59c640 1 --2- 172.21.15.115:0/632930400 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1d9019bc00 0x7f1d901957a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:57.875 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.872+0000 7f1d8e59c640 1 -- 172.21.15.115:0/632930400 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d8000a670 con 0x7f1d900fe330 2024-09-13T17:16:57.875 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.872+0000 7f1d8e59c640 1 --2- 172.21.15.115:0/632930400 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d900fe330 0x7f1d9019b6c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f1d8002bcf0 tx=0x7f1d80004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:57.876 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.873+0000 7f1d877fe640 1 -- 172.21.15.115:0/632930400 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d800037c0 con 0x7f1d900fe330 2024-09-13T17:16:57.876 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.873+0000 7f1d877fe640 1 -- 172.21.15.115:0/632930400 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1d80003dc0 con 0x7f1d900fe330 2024-09-13T17:16:57.876 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.873+0000 7f1d877fe640 1 -- 172.21.15.115:0/632930400 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d80040d30 con 0x7f1d900fe330 2024-09-13T17:16:57.876 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.873+0000 7f1d94b45640 1 -- 172.21.15.115:0/632930400 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d90195ed0 con 0x7f1d900fe330 2024-09-13T17:16:57.876 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.873+0000 7f1d94b45640 1 -- 172.21.15.115:0/632930400 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d90196430 con 0x7f1d900fe330 2024-09-13T17:16:57.877 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.874+0000 7f1d94b45640 1 -- 172.21.15.115:0/632930400 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d901965f0 con 0x7f1d900fe330 2024-09-13T17:16:57.877 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.874+0000 7f1d877fe640 1 -- 172.21.15.115:0/632930400 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f1d80040570 con 0x7f1d900fe330 2024-09-13T17:16:57.877 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.875+0000 7f1d877fe640 1 --2- 172.21.15.115:0/632930400 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f1d7c06cc50 0x7f1d7c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:57.877 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.875+0000 7f1d8dd9b640 1 --2- 172.21.15.115:0/632930400 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f1d7c06cc50 0x7f1d7c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:57.877 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.875+0000 7f1d877fe640 1 -- 172.21.15.115:0/632930400 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f1d800aded0 con 0x7f1d900fe330 2024-09-13T17:16:57.877 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.875+0000 7f1d8dd9b640 1 --2- 172.21.15.115:0/632930400 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f1d7c06cc50 0x7f1d7c06f110 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1d90069970 tx=0x7f1d78009710 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:57.880 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:57.879+0000 7f1d877fe640 1 -- 172.21.15.115:0/632930400 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f1d80078060 con 0x7f1d900fe330 2024-09-13T17:16:58.043 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.041+0000 7f1d94b45640 1 -- 172.21.15.115:0/632930400 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1d90196cb0 con 0x7f1d900fe330 2024-09-13T17:16:58.043 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.042+0000 7f1d877fe640 1 -- 172.21.15.115:0/632930400 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1d8007b680 con 0x7f1d900fe330 2024-09-13T17:16:58.043 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 1 2024-09-13T17:16:58.045 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.044+0000 7f1d94b45640 1 -- 172.21.15.115:0/632930400 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f1d7c06cc50 msgr2=0x7f1d7c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:58.045 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.044+0000 7f1d94b45640 1 --2- 172.21.15.115:0/632930400 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f1d7c06cc50 0x7f1d7c06f110 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1d90069970 tx=0x7f1d78009710 comp rx=0 tx=0).stop 2024-09-13T17:16:58.046 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.044+0000 7f1d94b45640 1 -- 172.21.15.115:0/632930400 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d900fe330 msgr2=0x7f1d9019b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:58.046 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.044+0000 7f1d94b45640 1 --2- 172.21.15.115:0/632930400 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d900fe330 0x7f1d9019b6c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f1d8002bcf0 tx=0x7f1d80004270 comp rx=0 tx=0).stop 2024-09-13T17:16:58.046 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.044+0000 7f1d94b45640 1 -- 172.21.15.115:0/632930400 shutdown_connections 2024-09-13T17:16:58.046 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.044+0000 7f1d94b45640 1 --2- 172.21.15.115:0/632930400 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f1d7c06cc50 0x7f1d7c06f110 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:58.046 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.044+0000 7f1d94b45640 1 --2- 172.21.15.115:0/632930400 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1d9019bc00 0x7f1d901957a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:58.046 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.044+0000 7f1d94b45640 1 --2- 172.21.15.115:0/632930400 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d900fe330 0x7f1d9019b6c0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:58.046 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.044+0000 7f1d94b45640 1 -- 172.21.15.115:0/632930400 >> 172.21.15.115:0/632930400 conn(0x7f1d900f9da0 msgr2=0x7f1d901085f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:58.046 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.044+0000 7f1d94b45640 1 -- 172.21.15.115:0/632930400 shutdown_connections 2024-09-13T17:16:58.046 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.044+0000 7f1d94b45640 1 -- 172.21.15.115:0/632930400 wait complete. 2024-09-13T17:16:58.054 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:16:57 smithi115 ceph-mon[109488]: from='client.? 172.21.15.115:0/1761845905' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-09-13T17:16:58.054 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:16:57 smithi115 ceph-mon[109488]: from='client.? 172.21.15.115:0/2743432611' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-13T17:16:58.055 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:16:57 smithi115 ceph-mon[109488]: pgmap v348: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T17:16:58.055 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:16:57 smithi115 ceph-mon[109488]: from='client.? 172.21.15.115:0/2326217754' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:16:58.056 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-09-13T17:16:58.158 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.155+0000 7f40e63fb640 1 -- 172.21.15.115:0/24443463 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f40e00ffa30 msgr2=0x7f40e00ffe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:58.158 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.155+0000 7f40e63fb640 1 --2- 172.21.15.115:0/24443463 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f40e00ffa30 0x7f40e00ffe90 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f40c8009880 tx=0x7f40c802a4a0 comp rx=0 tx=0).stop 2024-09-13T17:16:58.158 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.155+0000 7f40e63fb640 1 -- 172.21.15.115:0/24443463 shutdown_connections 2024-09-13T17:16:58.158 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.155+0000 7f40e63fb640 1 --2- 172.21.15.115:0/24443463 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f40e00ffa30 0x7f40e00ffe90 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:58.158 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.155+0000 7f40e63fb640 1 --2- 172.21.15.115:0/24443463 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f40e0105a40 0x7f40e0105e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:58.159 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.155+0000 7f40e63fb640 1 -- 172.21.15.115:0/24443463 >> 172.21.15.115:0/24443463 conn(0x7f40e00fb710 msgr2=0x7f40e00fdb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:58.159 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.155+0000 7f40e63fb640 1 -- 172.21.15.115:0/24443463 shutdown_connections 2024-09-13T17:16:58.159 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.155+0000 7f40e63fb640 1 -- 172.21.15.115:0/24443463 wait complete. 2024-09-13T17:16:58.159 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.156+0000 7f40e63fb640 1 Processor -- start 2024-09-13T17:16:58.159 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.156+0000 7f40e63fb640 1 -- start start 2024-09-13T17:16:58.159 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.156+0000 7f40e63fb640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f40e00ffa30 0x7f40e019b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:58.159 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.156+0000 7f40e63fb640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f40e0105a40 0x7f40e019bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:58.159 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.156+0000 7f40e63fb640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e01957d0 con 0x7f40e00ffa30 2024-09-13T17:16:58.159 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.156+0000 7f40e63fb640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e0195940 con 0x7f40e0105a40 2024-09-13T17:16:58.159 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.156+0000 7f40dffff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f40e00ffa30 0x7f40e019b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:58.159 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.156+0000 7f40dffff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f40e00ffa30 0x7f40e019b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:39006/0 (socket says 172.21.15.115:39006) 2024-09-13T17:16:58.159 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.156+0000 7f40dffff640 1 -- 172.21.15.115:0/1960240653 learned_addr learned my addr 172.21.15.115:0/1960240653 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:16:58.159 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.156+0000 7f40d7fff640 1 --2- 172.21.15.115:0/1960240653 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f40e0105a40 0x7f40e019bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:58.159 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.156+0000 7f40dffff640 1 -- 172.21.15.115:0/1960240653 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f40e0105a40 msgr2=0x7f40e019bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:58.160 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.156+0000 7f40dffff640 1 --2- 172.21.15.115:0/1960240653 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f40e0105a40 0x7f40e019bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:58.160 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.156+0000 7f40dffff640 1 -- 172.21.15.115:0/1960240653 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40c8009560 con 0x7f40e00ffa30 2024-09-13T17:16:58.160 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.156+0000 7f40dffff640 1 --2- 172.21.15.115:0/1960240653 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f40e00ffa30 0x7f40e019b6f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f40d000e970 tx=0x7f40d000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:58.160 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.157+0000 7f40ddffb640 1 -- 172.21.15.115:0/1960240653 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f40d000cc90 con 0x7f40e00ffa30 2024-09-13T17:16:58.160 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.157+0000 7f40ddffb640 1 -- 172.21.15.115:0/1960240653 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f40d000cdf0 con 0x7f40e00ffa30 2024-09-13T17:16:58.160 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.157+0000 7f40e63fb640 1 -- 172.21.15.115:0/1960240653 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40e0195c20 con 0x7f40e00ffa30 2024-09-13T17:16:58.160 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.157+0000 7f40ddffb640 1 -- 172.21.15.115:0/1960240653 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f40d0010430 con 0x7f40e00ffa30 2024-09-13T17:16:58.160 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.157+0000 7f40e63fb640 1 -- 172.21.15.115:0/1960240653 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40e0196150 con 0x7f40e00ffa30 2024-09-13T17:16:58.161 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.158+0000 7f40e63fb640 1 -- 172.21.15.115:0/1960240653 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40e0101170 con 0x7f40e00ffa30 2024-09-13T17:16:58.161 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.158+0000 7f40ddffb640 1 -- 172.21.15.115:0/1960240653 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f40d00046c0 con 0x7f40e00ffa30 2024-09-13T17:16:58.161 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.159+0000 7f40ddffb640 1 --2- 172.21.15.115:0/1960240653 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f40cc06cc60 0x7f40cc06f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:58.161 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.159+0000 7f40d7fff640 1 --2- 172.21.15.115:0/1960240653 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f40cc06cc60 0x7f40cc06f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:58.161 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.159+0000 7f40ddffb640 1 -- 172.21.15.115:0/1960240653 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f40d0014070 con 0x7f40e00ffa30 2024-09-13T17:16:58.161 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.159+0000 7f40d7fff640 1 --2- 172.21.15.115:0/1960240653 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f40cc06cc60 0x7f40cc06f120 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f40e0105240 tx=0x7f40c8005a20 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:58.164 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.163+0000 7f40ddffb640 1 -- 172.21.15.115:0/1960240653 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f40d0056b60 con 0x7f40e00ffa30 2024-09-13T17:16:58.326 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.324+0000 7f40e63fb640 1 -- 172.21.15.115:0/1960240653 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f40e00ffe90 con 0x7f40e00ffa30 2024-09-13T17:16:58.326 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.325+0000 7f40ddffb640 1 -- 172.21.15.115:0/1960240653 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v82) v1 ==== 107+0+11 (secure 0 0 0) 0x7f40d005a180 con 0x7f40e00ffa30 2024-09-13T17:16:58.326 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 32 2024-09-13T17:16:58.326 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:16:57 smithi195 ceph-mon[80021]: from='client.? 172.21.15.115:0/1761845905' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-09-13T17:16:58.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:16:57 smithi195 ceph-mon[80021]: from='client.? 172.21.15.115:0/2743432611' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-13T17:16:58.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:16:57 smithi195 ceph-mon[80021]: pgmap v348: 65 pgs: 65 active+clean; 199 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T17:16:58.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:16:57 smithi195 ceph-mon[80021]: from='client.? 172.21.15.115:0/2326217754' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:16:58.328 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.326+0000 7f40e63fb640 1 -- 172.21.15.115:0/1960240653 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f40cc06cc60 msgr2=0x7f40cc06f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:58.328 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.326+0000 7f40e63fb640 1 --2- 172.21.15.115:0/1960240653 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f40cc06cc60 0x7f40cc06f120 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f40e0105240 tx=0x7f40c8005a20 comp rx=0 tx=0).stop 2024-09-13T17:16:58.328 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.326+0000 7f40e63fb640 1 -- 172.21.15.115:0/1960240653 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f40e00ffa30 msgr2=0x7f40e019b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:58.328 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.326+0000 7f40e63fb640 1 --2- 172.21.15.115:0/1960240653 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f40e00ffa30 0x7f40e019b6f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f40d000e970 tx=0x7f40d000ed70 comp rx=0 tx=0).stop 2024-09-13T17:16:58.328 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.327+0000 7f40e63fb640 1 -- 172.21.15.115:0/1960240653 shutdown_connections 2024-09-13T17:16:58.328 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.327+0000 7f40e63fb640 1 --2- 172.21.15.115:0/1960240653 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f40cc06cc60 0x7f40cc06f120 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:58.328 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.327+0000 7f40e63fb640 1 --2- 172.21.15.115:0/1960240653 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f40e0105a40 0x7f40e019bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:58.329 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.327+0000 7f40e63fb640 1 --2- 172.21.15.115:0/1960240653 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f40e00ffa30 0x7f40e019b6f0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:58.329 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.327+0000 7f40e63fb640 1 -- 172.21.15.115:0/1960240653 >> 172.21.15.115:0/1960240653 conn(0x7f40e00fb710 msgr2=0x7f40e00fc8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:58.329 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.327+0000 7f40e63fb640 1 -- 172.21.15.115:0/1960240653 shutdown_connections 2024-09-13T17:16:58.329 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.327+0000 7f40e63fb640 1 -- 172.21.15.115:0/1960240653 wait complete. 2024-09-13T17:16:58.339 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-09-13T17:16:58.441 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.438+0000 7f8f1abb5640 1 -- 172.21.15.115:0/3865482130 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f141015c0 msgr2=0x7f8f14109aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:58.441 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.438+0000 7f8f1abb5640 1 --2- 172.21.15.115:0/3865482130 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f141015c0 0x7f8f14109aa0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8f00009880 tx=0x7f8f0002a530 comp rx=0 tx=0).stop 2024-09-13T17:16:58.442 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.438+0000 7f8f1abb5640 1 -- 172.21.15.115:0/3865482130 shutdown_connections 2024-09-13T17:16:58.442 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.438+0000 7f8f1abb5640 1 --2- 172.21.15.115:0/3865482130 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f141015c0 0x7f8f14109aa0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:58.442 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.438+0000 7f8f1abb5640 1 --2- 172.21.15.115:0/3865482130 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8f14100ca0 0x7f8f14101080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:58.442 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.438+0000 7f8f1abb5640 1 -- 172.21.15.115:0/3865482130 >> 172.21.15.115:0/3865482130 conn(0x7f8f140fa610 msgr2=0x7f8f140fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:58.442 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.438+0000 7f8f1abb5640 1 -- 172.21.15.115:0/3865482130 shutdown_connections 2024-09-13T17:16:58.442 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.438+0000 7f8f1abb5640 1 -- 172.21.15.115:0/3865482130 wait complete. 2024-09-13T17:16:58.442 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.439+0000 7f8f1abb5640 1 Processor -- start 2024-09-13T17:16:58.442 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.439+0000 7f8f1abb5640 1 -- start start 2024-09-13T17:16:58.442 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.439+0000 7f8f1abb5640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8f14100ca0 0x7f8f1419b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:58.442 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.439+0000 7f8f1abb5640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f141015c0 0x7f8f1419bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:58.442 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.439+0000 7f8f1abb5640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f1419c260 con 0x7f8f141015c0 2024-09-13T17:16:58.442 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.439+0000 7f8f1abb5640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f14195800 con 0x7f8f14100ca0 2024-09-13T17:16:58.442 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.439+0000 7f8f13fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f141015c0 0x7f8f1419bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:58.443 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.439+0000 7f8f13fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f141015c0 0x7f8f1419bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:39020/0 (socket says 172.21.15.115:39020) 2024-09-13T17:16:58.443 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.439+0000 7f8f13fff640 1 -- 172.21.15.115:0/2171057334 learned_addr learned my addr 172.21.15.115:0/2171057334 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:16:58.443 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.439+0000 7f8f18951640 1 --2- 172.21.15.115:0/2171057334 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8f14100ca0 0x7f8f1419b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:58.443 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.439+0000 7f8f13fff640 1 -- 172.21.15.115:0/2171057334 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8f14100ca0 msgr2=0x7f8f1419b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:58.443 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.439+0000 7f8f13fff640 1 --2- 172.21.15.115:0/2171057334 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8f14100ca0 0x7f8f1419b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:58.443 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.439+0000 7f8f13fff640 1 -- 172.21.15.115:0/2171057334 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f00009560 con 0x7f8f141015c0 2024-09-13T17:16:58.443 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.439+0000 7f8f18951640 1 --2- 172.21.15.115:0/2171057334 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8f14100ca0 0x7f8f1419b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:16:58.443 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.440+0000 7f8f13fff640 1 --2- 172.21.15.115:0/2171057334 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f141015c0 0x7f8f1419bbd0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f8f0002aa50 tx=0x7f8f00004c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:58.443 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.440+0000 7f8f11ffb640 1 -- 172.21.15.115:0/2171057334 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f00005330 con 0x7f8f141015c0 2024-09-13T17:16:58.443 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.440+0000 7f8f11ffb640 1 -- 172.21.15.115:0/2171057334 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8f00005490 con 0x7f8f141015c0 2024-09-13T17:16:58.443 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.440+0000 7f8f1abb5640 1 -- 172.21.15.115:0/2171057334 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f14195a50 con 0x7f8f141015c0 2024-09-13T17:16:58.443 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.440+0000 7f8f11ffb640 1 -- 172.21.15.115:0/2171057334 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f0003c7e0 con 0x7f8f141015c0 2024-09-13T17:16:58.443 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.440+0000 7f8f1abb5640 1 -- 172.21.15.115:0/2171057334 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f14195f50 con 0x7f8f141015c0 2024-09-13T17:16:58.444 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.441+0000 7f8f1abb5640 1 -- 172.21.15.115:0/2171057334 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f14068810 con 0x7f8f141015c0 2024-09-13T17:16:58.444 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.441+0000 7f8f11ffb640 1 -- 172.21.15.115:0/2171057334 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f8f0002ad50 con 0x7f8f141015c0 2024-09-13T17:16:58.444 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.442+0000 7f8f11ffb640 1 --2- 172.21.15.115:0/2171057334 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f8f0406cc80 0x7f8f0406f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:58.445 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.442+0000 7f8f11ffb640 1 -- 172.21.15.115:0/2171057334 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f8f000ad3b0 con 0x7f8f141015c0 2024-09-13T17:16:58.445 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.442+0000 7f8f18951640 1 --2- 172.21.15.115:0/2171057334 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f8f0406cc80 0x7f8f0406f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:58.445 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.442+0000 7f8f18951640 1 --2- 172.21.15.115:0/2171057334 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f8f0406cc80 0x7f8f0406f140 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8f08009b50 tx=0x7f8f08005f90 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:58.447 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.446+0000 7f8f11ffb640 1 -- 172.21.15.115:0/2171057334 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f8f00077420 con 0x7f8f141015c0 2024-09-13T17:16:58.607 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.606+0000 7f8f1abb5640 1 -- 172.21.15.115:0/2171057334 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f8f141043f0 con 0x7f8f141015c0 2024-09-13T17:16:58.608 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.606+0000 7f8f11ffb640 1 -- 172.21.15.115:0/2171057334 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v82) v1 ==== 107+0+11 (secure 0 0 0) 0x7f8f0007aa40 con 0x7f8f141015c0 2024-09-13T17:16:58.608 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 32 2024-09-13T17:16:58.610 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.608+0000 7f8f1abb5640 1 -- 172.21.15.115:0/2171057334 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f8f0406cc80 msgr2=0x7f8f0406f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:58.610 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.608+0000 7f8f1abb5640 1 --2- 172.21.15.115:0/2171057334 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f8f0406cc80 0x7f8f0406f140 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8f08009b50 tx=0x7f8f08005f90 comp rx=0 tx=0).stop 2024-09-13T17:16:58.610 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.608+0000 7f8f1abb5640 1 -- 172.21.15.115:0/2171057334 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f141015c0 msgr2=0x7f8f1419bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:58.610 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.608+0000 7f8f1abb5640 1 --2- 172.21.15.115:0/2171057334 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f141015c0 0x7f8f1419bbd0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f8f0002aa50 tx=0x7f8f00004c60 comp rx=0 tx=0).stop 2024-09-13T17:16:58.610 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.608+0000 7f8f1abb5640 1 -- 172.21.15.115:0/2171057334 shutdown_connections 2024-09-13T17:16:58.610 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.608+0000 7f8f1abb5640 1 --2- 172.21.15.115:0/2171057334 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7f8f0406cc80 0x7f8f0406f140 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:58.610 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.608+0000 7f8f1abb5640 1 --2- 172.21.15.115:0/2171057334 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f141015c0 0x7f8f1419bbd0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:58.610 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.608+0000 7f8f1abb5640 1 --2- 172.21.15.115:0/2171057334 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8f14100ca0 0x7f8f1419b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:58.610 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.608+0000 7f8f1abb5640 1 -- 172.21.15.115:0/2171057334 >> 172.21.15.115:0/2171057334 conn(0x7f8f140fa610 msgr2=0x7f8f14101ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:58.610 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.608+0000 7f8f1abb5640 1 -- 172.21.15.115:0/2171057334 shutdown_connections 2024-09-13T17:16:58.610 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.608+0000 7f8f1abb5640 1 -- 172.21.15.115:0/2171057334 wait complete. 2024-09-13T17:16:58.621 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:16:58.723 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.720+0000 7fa77cd11640 1 -- 172.21.15.115:0/2255410700 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa778100c10 msgr2=0x7fa778100ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:58.723 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.720+0000 7fa77cd11640 1 --2- 172.21.15.115:0/2255410700 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa778100c10 0x7fa778100ff0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa76c009c20 tx=0x7fa76c02aa00 comp rx=0 tx=0).stop 2024-09-13T17:16:58.723 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.720+0000 7fa77cd11640 1 -- 172.21.15.115:0/2255410700 shutdown_connections 2024-09-13T17:16:58.723 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.720+0000 7fa77cd11640 1 --2- 172.21.15.115:0/2255410700 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa778101530 0x7fa778109a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:58.723 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.720+0000 7fa77cd11640 1 --2- 172.21.15.115:0/2255410700 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa778100c10 0x7fa778100ff0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:58.723 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.720+0000 7fa77cd11640 1 -- 172.21.15.115:0/2255410700 >> 172.21.15.115:0/2255410700 conn(0x7fa7780fa620 msgr2=0x7fa7780fca40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:58.723 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.720+0000 7fa77cd11640 1 -- 172.21.15.115:0/2255410700 shutdown_connections 2024-09-13T17:16:58.723 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.720+0000 7fa77cd11640 1 -- 172.21.15.115:0/2255410700 wait complete. 2024-09-13T17:16:58.723 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.720+0000 7fa77cd11640 1 Processor -- start 2024-09-13T17:16:58.724 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.720+0000 7fa77cd11640 1 -- start start 2024-09-13T17:16:58.724 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.721+0000 7fa77cd11640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa778100c10 0x7fa77819b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:58.724 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.721+0000 7fa77cd11640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa778101530 0x7fa77819bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:58.724 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.721+0000 7fa77cd11640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa77819c270 con 0x7fa778100c10 2024-09-13T17:16:58.724 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.721+0000 7fa77cd11640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7781957a0 con 0x7fa778101530 2024-09-13T17:16:58.724 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.721+0000 7fa77659c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa778100c10 0x7fa77819b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:58.724 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.721+0000 7fa77659c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa778100c10 0x7fa77819b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:39024/0 (socket says 172.21.15.115:39024) 2024-09-13T17:16:58.724 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.721+0000 7fa77659c640 1 -- 172.21.15.115:0/2457612040 learned_addr learned my addr 172.21.15.115:0/2457612040 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T17:16:58.724 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.721+0000 7fa775d9b640 1 --2- 172.21.15.115:0/2457612040 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa778101530 0x7fa77819bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:58.724 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.721+0000 7fa77659c640 1 -- 172.21.15.115:0/2457612040 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa778101530 msgr2=0x7fa77819bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:58.724 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.721+0000 7fa77659c640 1 --2- 172.21.15.115:0/2457612040 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa778101530 0x7fa77819bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:58.724 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.721+0000 7fa77659c640 1 -- 172.21.15.115:0/2457612040 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa76c009900 con 0x7fa778100c10 2024-09-13T17:16:58.724 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.721+0000 7fa775d9b640 1 --2- 172.21.15.115:0/2457612040 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa778101530 0x7fa77819bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:16:58.724 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.721+0000 7fa77659c640 1 --2- 172.21.15.115:0/2457612040 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa778100c10 0x7fa77819b6a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fa76c005cc0 tx=0x7fa76c02f890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:58.725 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.721+0000 7fa7677fe640 1 -- 172.21.15.115:0/2457612040 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa76c03e070 con 0x7fa778100c10 2024-09-13T17:16:58.725 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.721+0000 7fa7677fe640 1 -- 172.21.15.115:0/2457612040 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa76c02e850 con 0x7fa778100c10 2024-09-13T17:16:58.725 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.721+0000 7fa77cd11640 1 -- 172.21.15.115:0/2457612040 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7781959f0 con 0x7fa778100c10 2024-09-13T17:16:58.725 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.721+0000 7fa7677fe640 1 -- 172.21.15.115:0/2457612040 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa76c038450 con 0x7fa778100c10 2024-09-13T17:16:58.725 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.721+0000 7fa77cd11640 1 -- 172.21.15.115:0/2457612040 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa778195ef0 con 0x7fa778100c10 2024-09-13T17:16:58.726 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.723+0000 7fa77cd11640 1 -- 172.21.15.115:0/2457612040 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7780688b0 con 0x7fa778100c10 2024-09-13T17:16:58.726 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.723+0000 7fa7677fe640 1 -- 172.21.15.115:0/2457612040 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fa76c00a040 con 0x7fa778100c10 2024-09-13T17:16:58.726 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.723+0000 7fa7677fe640 1 --2- 172.21.15.115:0/2457612040 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fa76006cc50 0x7fa76006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:58.726 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.723+0000 7fa7677fe640 1 -- 172.21.15.115:0/2457612040 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fa76c0ad630 con 0x7fa778100c10 2024-09-13T17:16:58.726 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.724+0000 7fa775d9b640 1 --2- 172.21.15.115:0/2457612040 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fa76006cc50 0x7fa76006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:58.726 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.724+0000 7fa775d9b640 1 --2- 172.21.15.115:0/2457612040 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fa76006cc50 0x7fa76006f110 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa778196f20 tx=0x7fa768005dd0 comp rx=0 tx=0).ready entity=mgr.14660 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:58.729 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.728+0000 7fa7677fe640 1 -- 172.21.15.115:0/2457612040 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa76c07b250 con 0x7fa778100c10 2024-09-13T17:16:58.900 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.899+0000 7fa77cd11640 1 -- 172.21.15.115:0/2457612040 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa77810cbc0 con 0x7fa778100c10 2024-09-13T17:16:58.901 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.899+0000 7fa7677fe640 1 -- 172.21.15.115:0/2457612040 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 35 entries v82) v1 ==== 81+0+2099 (secure 0 0 0) 0x7fa76c07ade0 con 0x7fa778100c10 2024-09-13T17:16:58.901 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:6829/4128583274 2024-09-14T17:13:29.448814+0000 2024-09-13T17:16:58.901 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:6801/244039928 2024-09-14T17:05:27.560242+0000 2024-09-13T17:16:58.901 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.195:6828/1660911692 2024-09-14T17:06:35.351905+0000 2024-09-13T17:16:58.901 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:6801/2943337696 2024-09-14T16:57:27.333203+0000 2024-09-13T17:16:58.901 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.195:0/3889921339 2024-09-14T17:06:35.351905+0000 2024-09-13T17:16:58.901 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.195:6829/1660911692 2024-09-14T17:06:35.351905+0000 2024-09-13T17:16:58.901 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:6801/1463863592 2024-09-14T16:56:57.112847+0000 2024-09-13T17:16:58.902 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.195:6826/8826118 2024-09-14T17:14:05.809662+0000 2024-09-13T17:16:58.902 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:6828/4128583274 2024-09-14T17:13:29.448814+0000 2024-09-13T17:16:58.902 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:0/376622152 2024-09-14T16:57:27.333203+0000 2024-09-13T17:16:58.902 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:6800/1463863592 2024-09-14T16:56:57.112847+0000 2024-09-13T17:16:58.902 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:0/3586970461 2024-09-14T16:57:27.333203+0000 2024-09-13T17:16:58.902 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.195:0/14125648 2024-09-14T17:06:35.351905+0000 2024-09-13T17:16:58.902 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:0/1473439240 2024-09-14T17:05:27.560242+0000 2024-09-13T17:16:58.902 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:0/931588236 2024-09-14T16:58:29.159373+0000 2024-09-13T17:16:58.902 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:6826/1900336545 2024-09-14T17:03:30.385433+0000 2024-09-13T17:16:58.902 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.195:0/2985838805 2024-09-14T17:06:35.351905+0000 2024-09-13T17:16:58.902 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:6800/244039928 2024-09-14T17:05:27.560242+0000 2024-09-13T17:16:58.902 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.195:0/2501790483 2024-09-14T17:06:35.351905+0000 2024-09-13T17:16:58.902 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.195:0/3420173457 2024-09-14T17:06:35.351905+0000 2024-09-13T17:16:58.902 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:0/648599851 2024-09-14T16:56:57.112847+0000 2024-09-13T17:16:58.902 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:6800/2943337696 2024-09-14T16:57:27.333203+0000 2024-09-13T17:16:58.903 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:6827/1900336545 2024-09-14T17:03:30.385433+0000 2024-09-13T17:16:58.903 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:6801/3889408988 2024-09-14T16:58:29.159373+0000 2024-09-13T17:16:58.903 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.195:0/2917880554 2024-09-14T17:06:35.351905+0000 2024-09-13T17:16:58.903 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:0/247720257 2024-09-14T16:58:29.159373+0000 2024-09-13T17:16:58.903 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:0/3723628457 2024-09-14T16:56:57.112847+0000 2024-09-13T17:16:58.903 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:0/3268617158 2024-09-14T17:05:27.560242+0000 2024-09-13T17:16:58.903 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.195:6827/8826118 2024-09-14T17:14:05.809662+0000 2024-09-13T17:16:58.903 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:0/1641850753 2024-09-14T17:05:27.560242+0000 2024-09-13T17:16:58.903 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:6800/3889408988 2024-09-14T16:58:29.159373+0000 2024-09-13T17:16:58.903 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:0/2751677160 2024-09-14T16:58:29.159373+0000 2024-09-13T17:16:58.903 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:0/3967447202 2024-09-14T17:05:27.560242+0000 2024-09-13T17:16:58.903 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:0/3791301867 2024-09-14T16:57:27.333203+0000 2024-09-13T17:16:58.903 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:0/2966038005 2024-09-14T16:56:57.112847+0000 2024-09-13T17:16:58.904 INFO:teuthology.orchestra.run.smithi115.stderr:listed 35 entries 2024-09-13T17:16:58.904 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.901+0000 7fa77cd11640 1 -- 172.21.15.115:0/2457612040 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fa76006cc50 msgr2=0x7fa76006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:58.904 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.901+0000 7fa77cd11640 1 --2- 172.21.15.115:0/2457612040 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fa76006cc50 0x7fa76006f110 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa778196f20 tx=0x7fa768005dd0 comp rx=0 tx=0).stop 2024-09-13T17:16:58.904 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.901+0000 7fa77cd11640 1 -- 172.21.15.115:0/2457612040 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa778100c10 msgr2=0x7fa77819b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:58.904 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.901+0000 7fa77cd11640 1 --2- 172.21.15.115:0/2457612040 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa778100c10 0x7fa77819b6a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fa76c005cc0 tx=0x7fa76c02f890 comp rx=0 tx=0).stop 2024-09-13T17:16:58.904 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.901+0000 7fa77cd11640 1 -- 172.21.15.115:0/2457612040 shutdown_connections 2024-09-13T17:16:58.905 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.901+0000 7fa77cd11640 1 --2- 172.21.15.115:0/2457612040 >> [v2:172.21.15.115:6800/1049502673,v1:172.21.15.115:6801/1049502673] conn(0x7fa76006cc50 0x7fa76006f110 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:58.905 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.901+0000 7fa77cd11640 1 --2- 172.21.15.115:0/2457612040 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa778101530 0x7fa77819bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:58.905 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.901+0000 7fa77cd11640 1 --2- 172.21.15.115:0/2457612040 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa778100c10 0x7fa77819b6a0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:58.905 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.902+0000 7fa77cd11640 1 -- 172.21.15.115:0/2457612040 >> 172.21.15.115:0/2457612040 conn(0x7fa7780fa620 msgr2=0x7fa778101f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:58.905 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.902+0000 7fa77cd11640 1 -- 172.21.15.115:0/2457612040 shutdown_connections 2024-09-13T17:16:58.905 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T17:16:58.902+0000 7fa77cd11640 1 -- 172.21.15.115:0/2457612040 wait complete. 2024-09-13T17:16:58.914 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-13T17:16:58.914 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:16:58.914 DEBUG:teuthology.orchestra.run.smithi195:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-13T17:16:58.949 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi195.front.sepia.ceph.com 2024-09-13T17:16:58.949 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:16:58.950 DEBUG:teuthology.orchestra.run.smithi195:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-13T17:16:59.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:16:59.020 DEBUG:teuthology.orchestra.run.smithi115:> ip netns list 2024-09-13T17:16:59.035 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T17:16:59.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:16:59.036 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T17:16:59.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:16:59.101 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link delete ceph-brx 2024-09-13T17:16:59.163 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:16:58 smithi115 ceph-mon[109488]: from='client.? 172.21.15.115:0/632930400' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T17:16:59.163 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:16:58 smithi115 ceph-mon[109488]: from='client.? 172.21.15.115:0/1960240653' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-09-13T17:16:59.163 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:16:58 smithi115 ceph-mon[109488]: from='client.? 172.21.15.115:0/2171057334' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-09-13T17:16:59.163 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:16:58 smithi115 ceph-mon[109488]: from='client.? 172.21.15.115:0/2457612040' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-13T17:16:59.209 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:16:59.209 DEBUG:teuthology.orchestra.run.smithi195:> ip netns list 2024-09-13T17:16:59.228 INFO:teuthology.orchestra.run.smithi195.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-13T17:16:59.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:16:59.228 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T17:16:59.293 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:16:58 smithi195 ceph-mon[80021]: from='client.? 172.21.15.115:0/632930400' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T17:16:59.293 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:16:58 smithi195 ceph-mon[80021]: from='client.? 172.21.15.115:0/1960240653' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-09-13T17:16:59.293 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:16:58 smithi195 ceph-mon[80021]: from='client.? 172.21.15.115:0/2171057334' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-09-13T17:16:59.293 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:16:58 smithi195 ceph-mon[80021]: from='client.? 172.21.15.115:0/2457612040' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-13T17:16:59.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:16:59.298 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link delete ceph-brx 2024-09-13T17:16:59.395 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-13T17:16:59.406 INFO:tasks.cephadm:Teardown begin 2024-09-13T17:16:59.406 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-13T17:16:59.435 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-13T17:16:59.462 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-13T17:16:59.462 DEBUG:teuthology.orchestra.run.smithi115:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-13T17:16:59.491 DEBUG:teuthology.orchestra.run.smithi195:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-13T17:16:59.518 INFO:tasks.cephadm:Stopping all daemons... 2024-09-13T17:16:59.518 INFO:tasks.cephadm.mon.smithi115:Stopping mon.smithi115... 2024-09-13T17:16:59.518 DEBUG:teuthology.orchestra.run.smithi115:> sudo systemctl stop ceph-ffbd7588-71f0-11ef-bceb-c7b262605968@mon.smithi115 2024-09-13T17:16:59.835 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:16:59 smithi115 systemd[1]: Stopping Ceph mon.smithi115 for ffbd7588-71f0-11ef-bceb-c7b262605968... 2024-09-13T17:17:00.108 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:16:59 smithi115 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-mon-smithi115[109484]: 2024-09-13T17:16:59.833+0000 7f798c3c2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi115 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T17:17:00.108 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:16:59 smithi115 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-mon-smithi115[109484]: 2024-09-13T17:16:59.833+0000 7f798c3c2640 -1 mon.smithi115@0(leader) e2 *** Got Signal Terminated *** 2024-09-13T17:17:00.109 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:16:59 smithi115 podman[151980]: 2024-09-13 17:16:59.854124567 +0000 UTC m=+0.138581943 container died 8dd7baf2c6b6e9584cc7f662fd57d1b6c4e981ba543e41b2616f5da09f099327 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-mon-smithi115, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-13T17:17:00.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:17:00 smithi115 podman[151980]: 2024-09-13 17:17:00.225193318 +0000 UTC m=+0.509650699 container cleanup 8dd7baf2c6b6e9584cc7f662fd57d1b6c4e981ba543e41b2616f5da09f099327 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-mon-smithi115, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-13T17:17:00.429 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 17:17:00 smithi115 bash[151980]: ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-mon-smithi115 2024-09-13T17:17:00.658 DEBUG:teuthology.orchestra.run.smithi115:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ffbd7588-71f0-11ef-bceb-c7b262605968@mon.smithi115.service' 2024-09-13T17:17:00.705 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T17:17:00.706 INFO:tasks.cephadm.mon.smithi115:Stopped mon.smithi115 2024-09-13T17:17:00.706 INFO:tasks.cephadm.mon.smithi195:Stopping mon.smithi195... 2024-09-13T17:17:00.706 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ceph-ffbd7588-71f0-11ef-bceb-c7b262605968@mon.smithi195 2024-09-13T17:17:01.003 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:17:00 smithi195 systemd[1]: Stopping Ceph mon.smithi195 for ffbd7588-71f0-11ef-bceb-c7b262605968... 2024-09-13T17:17:01.305 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:17:01 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-mon-smithi195[80011]: 2024-09-13T17:17:01.001+0000 7f09aadbb640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi195 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T17:17:01.305 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:17:01 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-mon-smithi195[80011]: 2024-09-13T17:17:01.001+0000 7f09aadbb640 -1 mon.smithi195@1(peon) e2 *** Got Signal Terminated *** 2024-09-13T17:17:01.305 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:17:01 smithi195 podman[115483]: 2024-09-13 17:17:01.093823719 +0000 UTC m=+0.193571547 container died 0459bc5e6b0806185c69b9f670c56d97a2b5157826f08ce4f1795180c121c7ea (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-mon-smithi195, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True) 2024-09-13T17:17:01.826 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:17:01 smithi195 podman[115483]: 2024-09-13 17:17:01.568761748 +0000 UTC m=+0.668509562 container cleanup 0459bc5e6b0806185c69b9f670c56d97a2b5157826f08ce4f1795180c121c7ea (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-mon-smithi195, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-13T17:17:01.827 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Sep 13 17:17:01 smithi195 bash[115483]: ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-mon-smithi195 2024-09-13T17:17:02.013 DEBUG:teuthology.orchestra.run.smithi195:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ffbd7588-71f0-11ef-bceb-c7b262605968@mon.smithi195.service' 2024-09-13T17:17:02.055 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T17:17:02.055 INFO:tasks.cephadm.mon.smithi195:Stopped mon.smithi195 2024-09-13T17:17:02.055 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-13T17:17:02.055 DEBUG:teuthology.orchestra.run.smithi115:> sudo systemctl stop ceph-ffbd7588-71f0-11ef-bceb-c7b262605968@osd.0 2024-09-13T17:17:02.178 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 17:17:02 smithi115 systemd[1]: Stopping Ceph osd.0 for ffbd7588-71f0-11ef-bceb-c7b262605968... 2024-09-13T17:17:02.679 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 17:17:02 smithi115 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-0[118507]: 2024-09-13T17:17:02.355+0000 7fefb2545640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T17:17:02.679 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 17:17:02 smithi115 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-0[118507]: 2024-09-13T17:17:02.355+0000 7fefb2545640 -1 osd.0 82 *** Got signal Terminated *** 2024-09-13T17:17:02.679 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 17:17:02 smithi115 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-0[118507]: 2024-09-13T17:17:02.355+0000 7fefb2545640 -1 osd.0 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T17:17:08.107 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 17:17:07 smithi115 podman[152110]: 2024-09-13 17:17:07.824042498 +0000 UTC m=+5.578617585 container died 3b9f874c64e9b478689368fdb13922eadb1d3c11621eaccaf128ca57949a509f (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-0, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T17:17:08.428 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 17:17:08 smithi115 podman[152110]: 2024-09-13 17:17:08.205184569 +0000 UTC m=+5.959759653 container cleanup 3b9f874c64e9b478689368fdb13922eadb1d3c11621eaccaf128ca57949a509f (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-0, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T17:17:08.429 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 17:17:08 smithi115 bash[152110]: ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-0 2024-09-13T17:17:08.824 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 17:17:08 smithi115 podman[152125]: 2024-09-13 17:17:08.46512525 +0000 UTC m=+0.640793291 container remove 3b9f874c64e9b478689368fdb13922eadb1d3c11621eaccaf128ca57949a509f (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-0, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True) 2024-09-13T17:17:09.179 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 17:17:08 smithi115 podman[152215]: 2024-09-13 17:17:08.824300759 +0000 UTC m=+0.108032361 container create 7468107502f8bc333618fdf8829c1d3ac6e68d8ea164df1a7da546f25efbd2a2 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T17:17:09.179 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 17:17:08 smithi115 podman[152215]: 2024-09-13 17:17:08.732304835 +0000 UTC m=+0.016036446 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T17:17:09.179 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 17:17:09 smithi115 podman[152215]: 2024-09-13 17:17:09.060406268 +0000 UTC m=+0.344137875 container init 7468107502f8bc333618fdf8829c1d3ac6e68d8ea164df1a7da546f25efbd2a2 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-13T17:17:09.179 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 17:17:09 smithi115 podman[152215]: 2024-09-13 17:17:09.064535054 +0000 UTC m=+0.348266657 container start 7468107502f8bc333618fdf8829c1d3ac6e68d8ea164df1a7da546f25efbd2a2 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-13T17:17:09.679 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 17:17:09 smithi115 podman[152215]: 2024-09-13 17:17:09.223713968 +0000 UTC m=+0.507445615 container attach 7468107502f8bc333618fdf8829c1d3ac6e68d8ea164df1a7da546f25efbd2a2 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083) 2024-09-13T17:17:09.679 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 17:17:09 smithi115 podman[152215]: 2024-09-13 17:17:09.255648839 +0000 UTC m=+0.539380458 container died 7468107502f8bc333618fdf8829c1d3ac6e68d8ea164df1a7da546f25efbd2a2 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-13T17:17:10.026 DEBUG:teuthology.orchestra.run.smithi115:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ffbd7588-71f0-11ef-bceb-c7b262605968@osd.0.service' 2024-09-13T17:17:10.064 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T17:17:10.065 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-13T17:17:10.065 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-13T17:17:10.065 DEBUG:teuthology.orchestra.run.smithi115:> sudo systemctl stop ceph-ffbd7588-71f0-11ef-bceb-c7b262605968@osd.1 2024-09-13T17:17:10.281 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 17:17:10 smithi115 systemd[1]: Stopping Ceph osd.1 for ffbd7588-71f0-11ef-bceb-c7b262605968... 2024-09-13T17:17:10.679 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 17:17:10 smithi115 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-1[124165]: 2024-09-13T17:17:10.400+0000 7f7744090640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T17:17:10.679 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 17:17:10 smithi115 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-1[124165]: 2024-09-13T17:17:10.400+0000 7f7744090640 -1 osd.1 82 *** Got signal Terminated *** 2024-09-13T17:17:10.679 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 17:17:10 smithi115 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-1[124165]: 2024-09-13T17:17:10.400+0000 7f7744090640 -1 osd.1 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T17:17:16.153 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 17:17:15 smithi115 podman[152316]: 2024-09-13 17:17:15.881140441 +0000 UTC m=+5.590285136 container died f0de6684601cfca0f7e33b1dc7176aca4f2225c0acc5c996bd14197ec846138f (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-1, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-13T17:17:16.429 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 17:17:16 smithi115 podman[152316]: 2024-09-13 17:17:16.259175468 +0000 UTC m=+5.968320151 container cleanup f0de6684601cfca0f7e33b1dc7176aca4f2225c0acc5c996bd14197ec846138f (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-13T17:17:16.429 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 17:17:16 smithi115 bash[152316]: ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-1 2024-09-13T17:17:16.827 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 17:17:16 smithi115 podman[152342]: 2024-09-13 17:17:16.510762666 +0000 UTC m=+0.626092774 container remove f0de6684601cfca0f7e33b1dc7176aca4f2225c0acc5c996bd14197ec846138f (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-1, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.build-date=20240731) 2024-09-13T17:17:17.112 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 17:17:16 smithi115 podman[152432]: 2024-09-13 17:17:16.730040562 +0000 UTC m=+0.015829490 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T17:17:17.112 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 17:17:16 smithi115 podman[152432]: 2024-09-13 17:17:16.828152119 +0000 UTC m=+0.113941039 container create 1e485197fb657d7106288adf5451a54259650810486f5545c811ec027c5e4fe7 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-13T17:17:17.112 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 17:17:17 smithi115 podman[152432]: 2024-09-13 17:17:17.072558016 +0000 UTC m=+0.358346939 container init 1e485197fb657d7106288adf5451a54259650810486f5545c811ec027c5e4fe7 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-1-deactivate, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T17:17:17.112 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 17:17:17 smithi115 podman[152432]: 2024-09-13 17:17:17.075932111 +0000 UTC m=+0.361721030 container start 1e485197fb657d7106288adf5451a54259650810486f5545c811ec027c5e4fe7 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-1-deactivate, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2) 2024-09-13T17:17:17.429 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 17:17:17 smithi115 podman[152432]: 2024-09-13 17:17:17.180936041 +0000 UTC m=+0.466724973 container attach 1e485197fb657d7106288adf5451a54259650810486f5545c811ec027c5e4fe7 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T17:17:17.429 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 17:17:17 smithi115 podman[152432]: 2024-09-13 17:17:17.28209434 +0000 UTC m=+0.567883263 container died 1e485197fb657d7106288adf5451a54259650810486f5545c811ec027c5e4fe7 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T17:17:17.956 DEBUG:teuthology.orchestra.run.smithi115:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ffbd7588-71f0-11ef-bceb-c7b262605968@osd.1.service' 2024-09-13T17:17:17.998 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T17:17:17.998 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-13T17:17:17.998 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-13T17:17:17.998 DEBUG:teuthology.orchestra.run.smithi115:> sudo systemctl stop ceph-ffbd7588-71f0-11ef-bceb-c7b262605968@osd.2 2024-09-13T17:17:18.322 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 17:17:18 smithi115 systemd[1]: Stopping Ceph osd.2 for ffbd7588-71f0-11ef-bceb-c7b262605968... 2024-09-13T17:17:18.678 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 17:17:18 smithi115 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-2[129499]: 2024-09-13T17:17:18.320+0000 7fa897cf5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T17:17:18.679 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 17:17:18 smithi115 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-2[129499]: 2024-09-13T17:17:18.320+0000 7fa897cf5640 -1 osd.2 82 *** Got signal Terminated *** 2024-09-13T17:17:18.679 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 17:17:18 smithi115 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-2[129499]: 2024-09-13T17:17:18.320+0000 7fa897cf5640 -1 osd.2 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T17:17:24.057 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 17:17:23 smithi115 podman[152536]: 2024-09-13 17:17:23.784089148 +0000 UTC m=+5.568099098 container died edb753bab54adf30d629c67775863d5a26b7d003451368b3651aa69bfdef4be8 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083) 2024-09-13T17:17:24.389 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 17:17:24 smithi115 podman[152536]: 2024-09-13 17:17:24.154369614 +0000 UTC m=+5.938379562 container cleanup edb753bab54adf30d629c67775863d5a26b7d003451368b3651aa69bfdef4be8 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-13T17:17:24.389 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 17:17:24 smithi115 bash[152536]: ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-2 2024-09-13T17:17:24.678 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 17:17:24 smithi115 podman[152550]: 2024-09-13 17:17:24.388757734 +0000 UTC m=+0.604241126 container remove edb753bab54adf30d629c67775863d5a26b7d003451368b3651aa69bfdef4be8 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-13T17:17:24.992 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 17:17:24 smithi115 podman[152641]: 2024-09-13 17:17:24.630668549 +0000 UTC m=+0.015652024 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T17:17:24.993 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 17:17:24 smithi115 podman[152641]: 2024-09-13 17:17:24.731407836 +0000 UTC m=+0.116391306 container create 4ab0dac85d2d6ef1f015796d1ac2cf5546ce00936a156230910551d150ca12ed (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-2-deactivate, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T17:17:24.993 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 17:17:24 smithi115 podman[152641]: 2024-09-13 17:17:24.96752665 +0000 UTC m=+0.352510117 container init 4ab0dac85d2d6ef1f015796d1ac2cf5546ce00936a156230910551d150ca12ed (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-2-deactivate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0) 2024-09-13T17:17:24.993 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 17:17:24 smithi115 podman[152641]: 2024-09-13 17:17:24.970836731 +0000 UTC m=+0.355820201 container start 4ab0dac85d2d6ef1f015796d1ac2cf5546ce00936a156230910551d150ca12ed (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-2-deactivate, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-13T17:17:25.429 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 17:17:25 smithi115 podman[152641]: 2024-09-13 17:17:25.076004258 +0000 UTC m=+0.460987751 container attach 4ab0dac85d2d6ef1f015796d1ac2cf5546ce00936a156230910551d150ca12ed (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-13T17:17:25.429 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 17:17:25 smithi115 podman[152641]: 2024-09-13 17:17:25.168719388 +0000 UTC m=+0.553702858 container died 4ab0dac85d2d6ef1f015796d1ac2cf5546ce00936a156230910551d150ca12ed (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-2-deactivate, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-13T17:17:25.839 DEBUG:teuthology.orchestra.run.smithi115:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ffbd7588-71f0-11ef-bceb-c7b262605968@osd.2.service' 2024-09-13T17:17:25.878 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T17:17:25.878 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-13T17:17:25.879 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-13T17:17:25.879 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ceph-ffbd7588-71f0-11ef-bceb-c7b262605968@osd.3 2024-09-13T17:17:26.326 INFO:journalctl@ceph.osd.3.smithi195.stdout:Sep 13 17:17:25 smithi195 systemd[1]: Stopping Ceph osd.3 for ffbd7588-71f0-11ef-bceb-c7b262605968... 2024-09-13T17:17:26.827 INFO:journalctl@ceph.osd.3.smithi195.stdout:Sep 13 17:17:26 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-3[88826]: 2024-09-13T17:17:26.387+0000 7f5dcbdc5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T17:17:26.827 INFO:journalctl@ceph.osd.3.smithi195.stdout:Sep 13 17:17:26 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-3[88826]: 2024-09-13T17:17:26.387+0000 7f5dcbdc5640 -1 osd.3 82 *** Got signal Terminated *** 2024-09-13T17:17:26.827 INFO:journalctl@ceph.osd.3.smithi195.stdout:Sep 13 17:17:26 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-3[88826]: 2024-09-13T17:17:26.387+0000 7f5dcbdc5640 -1 osd.3 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T17:17:29.675 INFO:journalctl@ceph.osd.3.smithi195.stdout:Sep 13 17:17:29 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-3[88826]: 2024-09-13T17:17:29.395+0000 7f5dc4bc1640 -1 osd.3 82 heartbeat_check: no reply from 172.21.15.115:6806 osd.0 since back 2024-09-13T17:17:04.596899+0000 front 2024-09-13T17:17:04.596807+0000 (oldest deadline 2024-09-13T17:17:28.696806+0000) 2024-09-13T17:17:30.077 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:17:29 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-5[98676]: 2024-09-13T17:17:29.674+0000 7f0f52db2640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.115:6806 osd.0 since back 2024-09-13T17:17:04.768613+0000 front 2024-09-13T17:17:04.768586+0000 (oldest deadline 2024-09-13T17:17:29.468429+0000) 2024-09-13T17:17:30.827 INFO:journalctl@ceph.osd.3.smithi195.stdout:Sep 13 17:17:30 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-3[88826]: 2024-09-13T17:17:30.436+0000 7f5dc4bc1640 -1 osd.3 82 heartbeat_check: no reply from 172.21.15.115:6806 osd.0 since back 2024-09-13T17:17:04.596899+0000 front 2024-09-13T17:17:04.596807+0000 (oldest deadline 2024-09-13T17:17:28.696806+0000) 2024-09-13T17:17:30.827 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:17:30 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-5[98676]: 2024-09-13T17:17:30.682+0000 7f0f52db2640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.115:6806 osd.0 since back 2024-09-13T17:17:04.768613+0000 front 2024-09-13T17:17:04.768586+0000 (oldest deadline 2024-09-13T17:17:29.468429+0000) 2024-09-13T17:17:31.577 INFO:journalctl@ceph.osd.4.smithi195.stdout:Sep 13 17:17:31 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-4[93693]: 2024-09-13T17:17:31.318+0000 7f864b359640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.115:6806 osd.0 since back 2024-09-13T17:17:05.287292+0000 front 2024-09-13T17:17:05.287348+0000 (oldest deadline 2024-09-13T17:17:30.587287+0000) 2024-09-13T17:17:31.904 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:17:31 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-5[98676]: 2024-09-13T17:17:31.644+0000 7f0f52db2640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.115:6806 osd.0 since back 2024-09-13T17:17:04.768613+0000 front 2024-09-13T17:17:04.768586+0000 (oldest deadline 2024-09-13T17:17:29.468429+0000) 2024-09-13T17:17:32.223 INFO:journalctl@ceph.osd.3.smithi195.stdout:Sep 13 17:17:31 smithi195 podman[115615]: 2024-09-13 17:17:31.903571764 +0000 UTC m=+5.823052468 container died ccd1b2bf7d86bf422d7a1366de81abbad8983f53753df2b1faa1258d63d69074 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-3, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T17:17:32.577 INFO:journalctl@ceph.osd.4.smithi195.stdout:Sep 13 17:17:32 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-4[93693]: 2024-09-13T17:17:32.339+0000 7f864b359640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.115:6806 osd.0 since back 2024-09-13T17:17:05.287292+0000 front 2024-09-13T17:17:05.287348+0000 (oldest deadline 2024-09-13T17:17:30.587287+0000) 2024-09-13T17:17:32.577 INFO:journalctl@ceph.osd.3.smithi195.stdout:Sep 13 17:17:32 smithi195 podman[115615]: 2024-09-13 17:17:32.414025116 +0000 UTC m=+6.333505861 container cleanup ccd1b2bf7d86bf422d7a1366de81abbad8983f53753df2b1faa1258d63d69074 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-3, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-13T17:17:32.577 INFO:journalctl@ceph.osd.3.smithi195.stdout:Sep 13 17:17:32 smithi195 bash[115615]: ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-3 2024-09-13T17:17:33.077 INFO:journalctl@ceph.osd.3.smithi195.stdout:Sep 13 17:17:32 smithi195 podman[115631]: 2024-09-13 17:17:32.682171145 +0000 UTC m=+0.777507003 container remove ccd1b2bf7d86bf422d7a1366de81abbad8983f53753df2b1faa1258d63d69074 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-3, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-13T17:17:33.077 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:17:32 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-5[98676]: 2024-09-13T17:17:32.679+0000 7f0f52db2640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.115:6806 osd.0 since back 2024-09-13T17:17:04.768613+0000 front 2024-09-13T17:17:04.768586+0000 (oldest deadline 2024-09-13T17:17:29.468429+0000) 2024-09-13T17:17:33.339 INFO:journalctl@ceph.osd.4.smithi195.stdout:Sep 13 17:17:33 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-4[93693]: 2024-09-13T17:17:33.324+0000 7f864b359640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.115:6806 osd.0 since back 2024-09-13T17:17:05.287292+0000 front 2024-09-13T17:17:05.287348+0000 (oldest deadline 2024-09-13T17:17:30.587287+0000) 2024-09-13T17:17:33.339 INFO:journalctl@ceph.osd.3.smithi195.stdout:Sep 13 17:17:33 smithi195 podman[115719]: 2024-09-13 17:17:32.988437174 +0000 UTC m=+0.015953909 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T17:17:33.339 INFO:journalctl@ceph.osd.3.smithi195.stdout:Sep 13 17:17:33 smithi195 podman[115719]: 2024-09-13 17:17:33.091195775 +0000 UTC m=+0.118712541 container create ee323aec28e7361e89f5b58774c9058cabebf7b0915db09a2f67b0bf2a8d0dd6 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T17:17:33.340 INFO:journalctl@ceph.osd.3.smithi195.stdout:Sep 13 17:17:33 smithi195 podman[115719]: 2024-09-13 17:17:33.335598333 +0000 UTC m=+0.363115057 container init ee323aec28e7361e89f5b58774c9058cabebf7b0915db09a2f67b0bf2a8d0dd6 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-13T17:17:33.340 INFO:journalctl@ceph.osd.3.smithi195.stdout:Sep 13 17:17:33 smithi195 podman[115719]: 2024-09-13 17:17:33.33896212 +0000 UTC m=+0.366478845 container start ee323aec28e7361e89f5b58774c9058cabebf7b0915db09a2f67b0bf2a8d0dd6 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, io.buildah.version=1.37.2, ceph=True) 2024-09-13T17:17:33.698 INFO:journalctl@ceph.osd.3.smithi195.stdout:Sep 13 17:17:33 smithi195 podman[115719]: 2024-09-13 17:17:33.444171169 +0000 UTC m=+0.471687890 container attach ee323aec28e7361e89f5b58774c9058cabebf7b0915db09a2f67b0bf2a8d0dd6 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2) 2024-09-13T17:17:33.698 INFO:journalctl@ceph.osd.3.smithi195.stdout:Sep 13 17:17:33 smithi195 podman[115719]: 2024-09-13 17:17:33.52746635 +0000 UTC m=+0.554983071 container died ee323aec28e7361e89f5b58774c9058cabebf7b0915db09a2f67b0bf2a8d0dd6 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=) 2024-09-13T17:17:34.076 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:17:33 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-5[98676]: 2024-09-13T17:17:33.696+0000 7f0f52db2640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.115:6806 osd.0 since back 2024-09-13T17:17:04.768613+0000 front 2024-09-13T17:17:04.768586+0000 (oldest deadline 2024-09-13T17:17:29.468429+0000) 2024-09-13T17:17:34.212 DEBUG:teuthology.orchestra.run.smithi195:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ffbd7588-71f0-11ef-bceb-c7b262605968@osd.3.service' 2024-09-13T17:17:34.253 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T17:17:34.253 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-13T17:17:34.253 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-13T17:17:34.254 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ceph-ffbd7588-71f0-11ef-bceb-c7b262605968@osd.4 2024-09-13T17:17:34.468 INFO:journalctl@ceph.osd.4.smithi195.stdout:Sep 13 17:17:34 smithi195 systemd[1]: Stopping Ceph osd.4 for ffbd7588-71f0-11ef-bceb-c7b262605968... 2024-09-13T17:17:34.469 INFO:journalctl@ceph.osd.4.smithi195.stdout:Sep 13 17:17:34 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-4[93693]: 2024-09-13T17:17:34.367+0000 7f864b359640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.115:6806 osd.0 since back 2024-09-13T17:17:05.287292+0000 front 2024-09-13T17:17:05.287348+0000 (oldest deadline 2024-09-13T17:17:30.587287+0000) 2024-09-13T17:17:34.827 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:17:34 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-5[98676]: 2024-09-13T17:17:34.664+0000 7f0f52db2640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.115:6806 osd.0 since back 2024-09-13T17:17:04.768613+0000 front 2024-09-13T17:17:04.768586+0000 (oldest deadline 2024-09-13T17:17:29.468429+0000) 2024-09-13T17:17:34.827 INFO:journalctl@ceph.osd.4.smithi195.stdout:Sep 13 17:17:34 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-4[93693]: 2024-09-13T17:17:34.584+0000 7f864e555640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T17:17:34.827 INFO:journalctl@ceph.osd.4.smithi195.stdout:Sep 13 17:17:34 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-4[93693]: 2024-09-13T17:17:34.584+0000 7f864e555640 -1 osd.4 82 *** Got signal Terminated *** 2024-09-13T17:17:34.827 INFO:journalctl@ceph.osd.4.smithi195.stdout:Sep 13 17:17:34 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-4[93693]: 2024-09-13T17:17:34.584+0000 7f864e555640 -1 osd.4 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T17:17:35.826 INFO:journalctl@ceph.osd.4.smithi195.stdout:Sep 13 17:17:35 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-4[93693]: 2024-09-13T17:17:35.384+0000 7f864b359640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.115:6806 osd.0 since back 2024-09-13T17:17:05.287292+0000 front 2024-09-13T17:17:05.287348+0000 (oldest deadline 2024-09-13T17:17:30.587287+0000) 2024-09-13T17:17:35.827 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:17:35 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-5[98676]: 2024-09-13T17:17:35.616+0000 7f0f52db2640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.115:6806 osd.0 since back 2024-09-13T17:17:04.768613+0000 front 2024-09-13T17:17:04.768586+0000 (oldest deadline 2024-09-13T17:17:29.468429+0000) 2024-09-13T17:17:36.639 INFO:journalctl@ceph.osd.4.smithi195.stdout:Sep 13 17:17:36 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-4[93693]: 2024-09-13T17:17:36.361+0000 7f864b359640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.115:6806 osd.0 since back 2024-09-13T17:17:05.287292+0000 front 2024-09-13T17:17:05.287348+0000 (oldest deadline 2024-09-13T17:17:30.587287+0000) 2024-09-13T17:17:37.077 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:17:36 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-5[98676]: 2024-09-13T17:17:36.643+0000 7f0f52db2640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.115:6806 osd.0 since back 2024-09-13T17:17:04.768613+0000 front 2024-09-13T17:17:04.768586+0000 (oldest deadline 2024-09-13T17:17:29.468429+0000) 2024-09-13T17:17:37.577 INFO:journalctl@ceph.osd.4.smithi195.stdout:Sep 13 17:17:37 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-4[93693]: 2024-09-13T17:17:37.323+0000 7f864b359640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.115:6806 osd.0 since back 2024-09-13T17:17:05.287292+0000 front 2024-09-13T17:17:05.287348+0000 (oldest deadline 2024-09-13T17:17:30.587287+0000) 2024-09-13T17:17:37.577 INFO:journalctl@ceph.osd.4.smithi195.stdout:Sep 13 17:17:37 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-4[93693]: 2024-09-13T17:17:37.323+0000 7f864b359640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.115:6814 osd.1 since back 2024-09-13T17:17:10.587763+0000 front 2024-09-13T17:17:10.587781+0000 (oldest deadline 2024-09-13T17:17:36.487650+0000) 2024-09-13T17:17:38.076 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:17:37 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-5[98676]: 2024-09-13T17:17:37.678+0000 7f0f52db2640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.115:6806 osd.0 since back 2024-09-13T17:17:04.768613+0000 front 2024-09-13T17:17:04.768586+0000 (oldest deadline 2024-09-13T17:17:29.468429+0000) 2024-09-13T17:17:38.576 INFO:journalctl@ceph.osd.4.smithi195.stdout:Sep 13 17:17:38 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-4[93693]: 2024-09-13T17:17:38.306+0000 7f864b359640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.115:6806 osd.0 since back 2024-09-13T17:17:05.287292+0000 front 2024-09-13T17:17:05.287348+0000 (oldest deadline 2024-09-13T17:17:30.587287+0000) 2024-09-13T17:17:38.576 INFO:journalctl@ceph.osd.4.smithi195.stdout:Sep 13 17:17:38 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-4[93693]: 2024-09-13T17:17:38.306+0000 7f864b359640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.115:6814 osd.1 since back 2024-09-13T17:17:10.587763+0000 front 2024-09-13T17:17:10.587781+0000 (oldest deadline 2024-09-13T17:17:36.487650+0000) 2024-09-13T17:17:39.076 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:17:38 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-5[98676]: 2024-09-13T17:17:38.670+0000 7f0f52db2640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.115:6806 osd.0 since back 2024-09-13T17:17:04.768613+0000 front 2024-09-13T17:17:04.768586+0000 (oldest deadline 2024-09-13T17:17:29.468429+0000) 2024-09-13T17:17:39.577 INFO:journalctl@ceph.osd.4.smithi195.stdout:Sep 13 17:17:39 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-4[93693]: 2024-09-13T17:17:39.282+0000 7f864b359640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.115:6806 osd.0 since back 2024-09-13T17:17:05.287292+0000 front 2024-09-13T17:17:05.287348+0000 (oldest deadline 2024-09-13T17:17:30.587287+0000) 2024-09-13T17:17:39.577 INFO:journalctl@ceph.osd.4.smithi195.stdout:Sep 13 17:17:39 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-4[93693]: 2024-09-13T17:17:39.282+0000 7f864b359640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.115:6814 osd.1 since back 2024-09-13T17:17:10.587763+0000 front 2024-09-13T17:17:10.587781+0000 (oldest deadline 2024-09-13T17:17:36.487650+0000) 2024-09-13T17:17:39.960 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:17:39 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-5[98676]: 2024-09-13T17:17:39.647+0000 7f0f52db2640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.115:6806 osd.0 since back 2024-09-13T17:17:04.768613+0000 front 2024-09-13T17:17:04.768586+0000 (oldest deadline 2024-09-13T17:17:29.468429+0000) 2024-09-13T17:17:39.961 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:17:39 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-5[98676]: 2024-09-13T17:17:39.647+0000 7f0f52db2640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.115:6814 osd.1 since back 2024-09-13T17:17:14.669777+0000 front 2024-09-13T17:17:14.669833+0000 (oldest deadline 2024-09-13T17:17:38.769678+0000) 2024-09-13T17:17:40.252 INFO:journalctl@ceph.osd.4.smithi195.stdout:Sep 13 17:17:39 smithi195 podman[115823]: 2024-09-13 17:17:39.95978565 +0000 UTC m=+5.480853126 container died c88b3dacb207cb42472bf4cb75fab1d13a4d8ed37276d3ec678a1e2e0f1ca459 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-4, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-13T17:17:40.576 INFO:journalctl@ceph.osd.4.smithi195.stdout:Sep 13 17:17:40 smithi195 podman[115823]: 2024-09-13 17:17:40.434848803 +0000 UTC m=+5.955916277 container cleanup c88b3dacb207cb42472bf4cb75fab1d13a4d8ed37276d3ec678a1e2e0f1ca459 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-4, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=) 2024-09-13T17:17:40.577 INFO:journalctl@ceph.osd.4.smithi195.stdout:Sep 13 17:17:40 smithi195 bash[115823]: ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-4 2024-09-13T17:17:41.016 INFO:journalctl@ceph.osd.4.smithi195.stdout:Sep 13 17:17:40 smithi195 podman[115854]: 2024-09-13 17:17:40.703050927 +0000 UTC m=+0.738076232 container remove c88b3dacb207cb42472bf4cb75fab1d13a4d8ed37276d3ec678a1e2e0f1ca459 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-4, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-13T17:17:41.016 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:17:40 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-5[98676]: 2024-09-13T17:17:40.598+0000 7f0f52db2640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.115:6806 osd.0 since back 2024-09-13T17:17:04.768613+0000 front 2024-09-13T17:17:04.768586+0000 (oldest deadline 2024-09-13T17:17:29.468429+0000) 2024-09-13T17:17:41.016 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:17:40 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-5[98676]: 2024-09-13T17:17:40.598+0000 7f0f52db2640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.115:6814 osd.1 since back 2024-09-13T17:17:14.669777+0000 front 2024-09-13T17:17:14.669833+0000 (oldest deadline 2024-09-13T17:17:38.769678+0000) 2024-09-13T17:17:41.307 INFO:journalctl@ceph.osd.4.smithi195.stdout:Sep 13 17:17:41 smithi195 podman[115939]: 2024-09-13 17:17:40.918308223 +0000 UTC m=+0.016175014 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T17:17:41.307 INFO:journalctl@ceph.osd.4.smithi195.stdout:Sep 13 17:17:41 smithi195 podman[115939]: 2024-09-13 17:17:41.020173233 +0000 UTC m=+0.118040015 container create 6e35f4439f0c4c45ad33990cb658df9096a317fd478df7b96f1ddfe0b10ebadc (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0) 2024-09-13T17:17:41.307 INFO:journalctl@ceph.osd.4.smithi195.stdout:Sep 13 17:17:41 smithi195 podman[115939]: 2024-09-13 17:17:41.239682543 +0000 UTC m=+0.337549324 container init 6e35f4439f0c4c45ad33990cb658df9096a317fd478df7b96f1ddfe0b10ebadc (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-4-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T17:17:41.307 INFO:journalctl@ceph.osd.4.smithi195.stdout:Sep 13 17:17:41 smithi195 podman[115939]: 2024-09-13 17:17:41.243025528 +0000 UTC m=+0.340892309 container start 6e35f4439f0c4c45ad33990cb658df9096a317fd478df7b96f1ddfe0b10ebadc (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-4-deactivate, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-13T17:17:41.307 INFO:journalctl@ceph.osd.4.smithi195.stdout:Sep 13 17:17:41 smithi195 podman[115939]: 2024-09-13 17:17:41.30612814 +0000 UTC m=+0.403994921 container attach 6e35f4439f0c4c45ad33990cb658df9096a317fd478df7b96f1ddfe0b10ebadc (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-4-deactivate, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-13T17:17:41.576 INFO:journalctl@ceph.osd.4.smithi195.stdout:Sep 13 17:17:41 smithi195 podman[115939]: 2024-09-13 17:17:41.42511758 +0000 UTC m=+0.522984374 container died 6e35f4439f0c4c45ad33990cb658df9096a317fd478df7b96f1ddfe0b10ebadc (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-13T17:17:41.977 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:17:41 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-5[98676]: 2024-09-13T17:17:41.639+0000 7f0f52db2640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.115:6806 osd.0 since back 2024-09-13T17:17:04.768613+0000 front 2024-09-13T17:17:04.768586+0000 (oldest deadline 2024-09-13T17:17:29.468429+0000) 2024-09-13T17:17:41.977 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:17:41 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-5[98676]: 2024-09-13T17:17:41.639+0000 7f0f52db2640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.115:6814 osd.1 since back 2024-09-13T17:17:14.669777+0000 front 2024-09-13T17:17:14.669833+0000 (oldest deadline 2024-09-13T17:17:38.769678+0000) 2024-09-13T17:17:42.002 DEBUG:teuthology.orchestra.run.smithi195:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ffbd7588-71f0-11ef-bceb-c7b262605968@osd.4.service' 2024-09-13T17:17:42.040 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T17:17:42.041 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-13T17:17:42.041 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-13T17:17:42.041 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ceph-ffbd7588-71f0-11ef-bceb-c7b262605968@osd.5 2024-09-13T17:17:42.326 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:17:42 smithi195 systemd[1]: Stopping Ceph osd.5 for ffbd7588-71f0-11ef-bceb-c7b262605968... 2024-09-13T17:17:42.827 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:17:42 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-5[98676]: 2024-09-13T17:17:42.370+0000 7f0f55fae640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T17:17:42.827 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:17:42 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-5[98676]: 2024-09-13T17:17:42.370+0000 7f0f55fae640 -1 osd.5 82 *** Got signal Terminated *** 2024-09-13T17:17:42.827 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:17:42 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-5[98676]: 2024-09-13T17:17:42.370+0000 7f0f55fae640 -1 osd.5 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T17:17:42.827 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:17:42 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-5[98676]: 2024-09-13T17:17:42.599+0000 7f0f52db2640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.115:6806 osd.0 since back 2024-09-13T17:17:04.768613+0000 front 2024-09-13T17:17:04.768586+0000 (oldest deadline 2024-09-13T17:17:29.468429+0000) 2024-09-13T17:17:42.827 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:17:42 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-5[98676]: 2024-09-13T17:17:42.599+0000 7f0f52db2640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.115:6814 osd.1 since back 2024-09-13T17:17:14.669777+0000 front 2024-09-13T17:17:14.669833+0000 (oldest deadline 2024-09-13T17:17:38.769678+0000) 2024-09-13T17:17:44.077 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:17:43 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-5[98676]: 2024-09-13T17:17:43.633+0000 7f0f52db2640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.115:6806 osd.0 since back 2024-09-13T17:17:04.768613+0000 front 2024-09-13T17:17:04.768586+0000 (oldest deadline 2024-09-13T17:17:29.468429+0000) 2024-09-13T17:17:44.077 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:17:43 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-5[98676]: 2024-09-13T17:17:43.633+0000 7f0f52db2640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.115:6814 osd.1 since back 2024-09-13T17:17:14.669777+0000 front 2024-09-13T17:17:14.669833+0000 (oldest deadline 2024-09-13T17:17:38.769678+0000) 2024-09-13T17:17:45.076 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:17:44 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-5[98676]: 2024-09-13T17:17:44.665+0000 7f0f52db2640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.115:6806 osd.0 since back 2024-09-13T17:17:04.768613+0000 front 2024-09-13T17:17:04.768586+0000 (oldest deadline 2024-09-13T17:17:29.468429+0000) 2024-09-13T17:17:45.077 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:17:44 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-5[98676]: 2024-09-13T17:17:44.665+0000 7f0f52db2640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.115:6814 osd.1 since back 2024-09-13T17:17:14.669777+0000 front 2024-09-13T17:17:14.669833+0000 (oldest deadline 2024-09-13T17:17:38.769678+0000) 2024-09-13T17:17:46.077 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:17:45 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-5[98676]: 2024-09-13T17:17:45.694+0000 7f0f52db2640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.115:6806 osd.0 since back 2024-09-13T17:17:04.768613+0000 front 2024-09-13T17:17:04.768586+0000 (oldest deadline 2024-09-13T17:17:29.468429+0000) 2024-09-13T17:17:46.077 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:17:45 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-5[98676]: 2024-09-13T17:17:45.694+0000 7f0f52db2640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.115:6814 osd.1 since back 2024-09-13T17:17:14.669777+0000 front 2024-09-13T17:17:14.669833+0000 (oldest deadline 2024-09-13T17:17:38.769678+0000) 2024-09-13T17:17:46.077 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:17:45 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-5[98676]: 2024-09-13T17:17:45.694+0000 7f0f52db2640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.115:6822 osd.2 since back 2024-09-13T17:17:18.770142+0000 front 2024-09-13T17:17:18.770082+0000 (oldest deadline 2024-09-13T17:17:44.670140+0000) 2024-09-13T17:17:47.077 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:17:46 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-5[98676]: 2024-09-13T17:17:46.714+0000 7f0f52db2640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.115:6806 osd.0 since back 2024-09-13T17:17:04.768613+0000 front 2024-09-13T17:17:04.768586+0000 (oldest deadline 2024-09-13T17:17:29.468429+0000) 2024-09-13T17:17:47.077 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:17:46 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-5[98676]: 2024-09-13T17:17:46.714+0000 7f0f52db2640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.115:6814 osd.1 since back 2024-09-13T17:17:14.669777+0000 front 2024-09-13T17:17:14.669833+0000 (oldest deadline 2024-09-13T17:17:38.769678+0000) 2024-09-13T17:17:47.077 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:17:46 smithi195 ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-5[98676]: 2024-09-13T17:17:46.714+0000 7f0f52db2640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.115:6822 osd.2 since back 2024-09-13T17:17:18.770142+0000 front 2024-09-13T17:17:18.770082+0000 (oldest deadline 2024-09-13T17:17:44.670140+0000) 2024-09-13T17:17:48.077 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:17:47 smithi195 podman[116042]: 2024-09-13 17:17:47.80576028 +0000 UTC m=+5.546702164 container died 40ccbc2f51950351d6c1dca790fd052acf49fa6d84bf6db2136846872ce6b995 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-5, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-13T17:17:48.576 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:17:48 smithi195 podman[116042]: 2024-09-13 17:17:48.145788257 +0000 UTC m=+5.886730138 container cleanup 40ccbc2f51950351d6c1dca790fd052acf49fa6d84bf6db2136846872ce6b995 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-5, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-13T17:17:48.577 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:17:48 smithi195 bash[116042]: ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-5 2024-09-13T17:17:48.577 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:17:48 smithi195 podman[116059]: 2024-09-13 17:17:48.363640216 +0000 UTC m=+0.551315352 container remove 40ccbc2f51950351d6c1dca790fd052acf49fa6d84bf6db2136846872ce6b995 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-5, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-13T17:17:49.077 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:17:48 smithi195 podman[116148]: 2024-09-13 17:17:48.755984706 +0000 UTC m=+0.109642903 container create 05d9245a10e1135e827885752848da625f5c22a148131b55ea8d9a3d620fa094 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-13T17:17:49.077 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:17:48 smithi195 podman[116148]: 2024-09-13 17:17:48.66239348 +0000 UTC m=+0.016051692 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T17:17:49.077 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:17:48 smithi195 podman[116148]: 2024-09-13 17:17:48.958831705 +0000 UTC m=+0.312489907 container init 05d9245a10e1135e827885752848da625f5c22a148131b55ea8d9a3d620fa094 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T17:17:49.077 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:17:48 smithi195 podman[116148]: 2024-09-13 17:17:48.962090462 +0000 UTC m=+0.315748660 container start 05d9245a10e1135e827885752848da625f5c22a148131b55ea8d9a3d620fa094 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-5-deactivate, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-13T17:17:49.438 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:17:49 smithi195 podman[116148]: 2024-09-13 17:17:49.084001689 +0000 UTC m=+0.437659899 container attach 05d9245a10e1135e827885752848da625f5c22a148131b55ea8d9a3d620fa094 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-13T17:17:49.438 INFO:journalctl@ceph.osd.5.smithi195.stdout:Sep 13 17:17:49 smithi195 podman[116148]: 2024-09-13 17:17:49.146832226 +0000 UTC m=+0.500490425 container died 05d9245a10e1135e827885752848da625f5c22a148131b55ea8d9a3d620fa094 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ffbd7588-71f0-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T17:17:49.801 DEBUG:teuthology.orchestra.run.smithi195:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ffbd7588-71f0-11ef-bceb-c7b262605968@osd.5.service' 2024-09-13T17:17:49.841 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T17:17:49.842 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-13T17:17:49.842 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-13T17:17:49.996 INFO:teuthology.orchestra.run.smithi115.stdout:Deleting cluster with fsid: ffbd7588-71f0-11ef-bceb-c7b262605968 2024-09-13T17:18:09.796 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-13T17:18:09.949 INFO:teuthology.orchestra.run.smithi195.stdout:Deleting cluster with fsid: ffbd7588-71f0-11ef-bceb-c7b262605968 2024-09-13T17:18:24.730 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-13T17:18:24.763 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-13T17:18:24.790 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-13T17:18:24.792 DEBUG:teuthology.misc:Transferring archived files from smithi115:/var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903855/remote/smithi115/crash 2024-09-13T17:18:24.793 DEBUG:teuthology.orchestra.run.smithi115:> sudo tar c -f - -C /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/crash -- . 2024-09-13T17:18:24.833 INFO:teuthology.orchestra.run.smithi115.stderr:tar: /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-13T17:18:24.833 INFO:teuthology.orchestra.run.smithi115.stderr:tar: Error is not recoverable: exiting now 2024-09-13T17:18:24.835 DEBUG:teuthology.misc:Transferring archived files from smithi195:/var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903855/remote/smithi195/crash 2024-09-13T17:18:24.836 DEBUG:teuthology.orchestra.run.smithi195:> sudo tar c -f - -C /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/crash -- . 2024-09-13T17:18:24.859 INFO:teuthology.orchestra.run.smithi195.stderr:tar: /var/lib/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-13T17:18:24.860 INFO:teuthology.orchestra.run.smithi195.stderr:tar: Error is not recoverable: exiting now 2024-09-13T17:18:24.861 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-13T17:18:24.861 DEBUG:teuthology.orchestra.run.smithi115:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-13T17:18:24.911 INFO:teuthology.orchestra.run.smithi115.stderr:grep: /var/log/ceph/ffbd7588-71f0-11ef-bceb-c7b262605968/ceph.log: No such file or directory 2024-09-13T17:18:24.916 INFO:tasks.cephadm:Compressing logs... 2024-09-13T17:18:24.916 DEBUG:teuthology.orchestra.run.smithi115:> sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T17:18:24.958 DEBUG:teuthology.orchestra.run.smithi195:> sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T17:18:24.981 INFO:teuthology.orchestra.run.smithi115.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-13T17:18:24.982 INFO:teuthology.orchestra.run.smithi195.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-13T17:20:56.417 INFO:tasks.cephadm:Archiving logs... 2024-09-13T17:20:56.418 DEBUG:teuthology.misc:Transferring archived files from smithi115:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903855/remote/smithi115/log 2024-09-13T17:20:56.419 DEBUG:teuthology.orchestra.run.smithi115:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T17:21:13.940 DEBUG:teuthology.misc:Transferring archived files from smithi195:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903855/remote/smithi195/log 2024-09-13T17:21:13.941 DEBUG:teuthology.orchestra.run.smithi195:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T17:21:16.893 INFO:tasks.cephadm:Removing cluster... 2024-09-13T17:21:16.893 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 --force 2024-09-13T17:21:17.045 INFO:teuthology.orchestra.run.smithi115.stdout:Deleting cluster with fsid: ffbd7588-71f0-11ef-bceb-c7b262605968 2024-09-13T17:21:17.487 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid ffbd7588-71f0-11ef-bceb-c7b262605968 --force 2024-09-13T17:21:17.638 INFO:teuthology.orchestra.run.smithi195.stdout:Deleting cluster with fsid: ffbd7588-71f0-11ef-bceb-c7b262605968 2024-09-13T17:21:17.952 INFO:tasks.cephadm:Removing cephadm ... 2024-09-13T17:21:17.952 DEBUG:teuthology.orchestra.run.smithi115:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-13T17:21:17.969 DEBUG:teuthology.orchestra.run.smithi195:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-13T17:21:17.985 INFO:tasks.cephadm:Teardown complete 2024-09-13T17:21:17.985 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-13T17:21:17.996 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-13T17:21:17.997 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T17:21:18.013 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T17:21:18.116 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-13T17:21:18.126 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-13T17:21:18.126 DEBUG:teuthology.orchestra.run.smithi115:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T17:21:18.129 DEBUG:teuthology.orchestra.run.smithi195:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T17:21:18.141 INFO:teuthology.orchestra.run.smithi115.stderr:bash: line 1: ntpq: command not found 2024-09-13T17:21:18.143 INFO:teuthology.orchestra.run.smithi195.stderr:bash: line 1: ntpq: command not found 2024-09-13T17:21:18.146 INFO:teuthology.orchestra.run.smithi115.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T17:21:18.146 INFO:teuthology.orchestra.run.smithi115.stdout:=============================================================================== 2024-09-13T17:21:18.146 INFO:teuthology.orchestra.run.smithi115.stdout:^* hv01.front.sepia.ceph.com 3 6 377 44 -119us[ -110us] +/- 50ms 2024-09-13T17:21:18.146 INFO:teuthology.orchestra.run.smithi115.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 40 +898us[ +898us] +/- 67ms 2024-09-13T17:21:18.146 INFO:teuthology.orchestra.run.smithi115.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 43 -709us[ -709us] +/- 65ms 2024-09-13T17:21:18.146 INFO:teuthology.orchestra.run.smithi115.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T17:21:18.148 INFO:teuthology.orchestra.run.smithi195.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T17:21:18.148 INFO:teuthology.orchestra.run.smithi195.stdout:=============================================================================== 2024-09-13T17:21:18.148 INFO:teuthology.orchestra.run.smithi195.stdout:^* hv01.front.sepia.ceph.com 3 6 377 46 -119us[ -103us] +/- 50ms 2024-09-13T17:21:18.148 INFO:teuthology.orchestra.run.smithi195.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 48 +903us[ +919us] +/- 67ms 2024-09-13T17:21:18.148 INFO:teuthology.orchestra.run.smithi195.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 45 -706us[ -706us] +/- 65ms 2024-09-13T17:21:18.148 INFO:teuthology.orchestra.run.smithi195.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T17:21:18.148 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-13T17:21:18.161 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-13T17:21:18.162 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-13T17:21:18.172 DEBUG:teuthology.orchestra.run.smithi115:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-13T17:21:18.270 DEBUG:teuthology.orchestra.run.smithi195:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-13T17:21:18.343 DEBUG:teuthology.orchestra.run.smithi115:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-13T17:21:18.372 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:21:18.372 DEBUG:teuthology.orchestra.run.smithi195:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-13T17:21:18.400 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:21:18.400 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-13T17:21:18.411 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-13T17:21:18.424 INFO:teuthology.task.internal:Duration was 1899.231067 seconds 2024-09-13T17:21:18.425 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-13T17:21:18.467 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-13T17:21:18.467 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T17:21:18.470 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T17:21:18.507 INFO:teuthology.orchestra.run.smithi115.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T17:21:18.508 INFO:teuthology.orchestra.run.smithi195.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T17:21:18.719 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-13T17:21:18.719 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi115.front.sepia.ceph.com 2024-09-13T17:21:18.719 DEBUG:teuthology.orchestra.run.smithi115:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T17:21:18.779 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi195.front.sepia.ceph.com 2024-09-13T17:21:18.780 DEBUG:teuthology.orchestra.run.smithi195:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T17:21:18.813 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-13T17:21:18.813 DEBUG:teuthology.orchestra.run.smithi115:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T17:21:18.822 DEBUG:teuthology.orchestra.run.smithi195:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T17:21:18.879 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-13T17:21:18.879 DEBUG:teuthology.orchestra.run.smithi115:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T17:21:18.888 DEBUG:teuthology.orchestra.run.smithi195:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T17:21:19.517 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-13T17:21:19.528 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-13T17:21:19.529 DEBUG:teuthology.orchestra.run.smithi115:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T17:21:19.554 DEBUG:teuthology.orchestra.run.smithi195:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T17:21:19.580 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-13T17:21:19.591 DEBUG:teuthology.orchestra.run.smithi115:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T17:21:19.596 DEBUG:teuthology.orchestra.run.smithi195:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T17:21:19.617 INFO:teuthology.orchestra.run.smithi115.stdout:kernel.core_pattern = core 2024-09-13T17:21:19.643 INFO:teuthology.orchestra.run.smithi195.stdout:kernel.core_pattern = core 2024-09-13T17:21:19.657 DEBUG:teuthology.orchestra.run.smithi115:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T17:21:19.684 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:21:19.684 DEBUG:teuthology.orchestra.run.smithi195:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T17:21:19.711 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:21:19.712 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-13T17:21:19.723 INFO:teuthology.task.internal:Transferring archived files... 2024-09-13T17:21:19.725 DEBUG:teuthology.misc:Transferring archived files from smithi115:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903855/remote/smithi115 2024-09-13T17:21:19.725 DEBUG:teuthology.orchestra.run.smithi115:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T17:21:19.778 DEBUG:teuthology.misc:Transferring archived files from smithi195:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903855/remote/smithi195 2024-09-13T17:21:19.779 DEBUG:teuthology.orchestra.run.smithi195:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T17:21:19.816 INFO:teuthology.task.internal:Removing archive directory... 2024-09-13T17:21:19.817 DEBUG:teuthology.orchestra.run.smithi115:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T17:21:19.819 DEBUG:teuthology.orchestra.run.smithi195:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T17:21:19.865 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-13T17:21:19.881 INFO:teuthology.task.internal:Not uploading archives. 2024-09-13T17:21:19.881 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-13T17:21:19.922 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-13T17:21:19.922 DEBUG:teuthology.orchestra.run.smithi115:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T17:21:19.925 DEBUG:teuthology.orchestra.run.smithi195:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T17:21:19.937 INFO:teuthology.orchestra.run.smithi115.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 17:21 /home/ubuntu/cephtest 2024-09-13T17:21:19.939 INFO:teuthology.orchestra.run.smithi195.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 17:21 /home/ubuntu/cephtest 2024-09-13T17:21:19.941 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-13T17:21:19.996 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-13T17:21:20.148 INFO:teuthology.run:Summary data: description: fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 1899.231066942215 flavor: default owner: scheduled_rishabh@teuthology success: true 2024-09-13T17:21:20.148 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T17:21:20.246 INFO:teuthology.run:pass